2024-09-04T16:13:35.044 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-04T16:13:35.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-04T16:13:35.178 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-09-04_15:42:18-orch:cephadm-wip-guits-main-2024-09-04-1323-distro-default-smithi/7889192 branch: wip-guits-main-2024-09-04-1323 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: gabrioux@ibm.com first_in_suite: false job_id: '7889192' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/squid ' name: gabrioux-2024-09-04_15:42:18-orch:cephadm-wip-guits-main-2024-09-04-1323-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-guits-main-2024-09-04-1323 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: f9fcca5273b6971f640393d33a94730179073754 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f9fcca5273b6971f640393d33a94730179073754 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-guits-main-2024-09-04-1323 sha1: f9fcca5273b6971f640393d33a94730179073754 owner: scheduled_gabrioux@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 8429 sha1: f9fcca5273b6971f640393d33a94730179073754 sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-main-2024-09-04-1323 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f9fcca5273b6971f640393d33a94730179073754/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f9fcca5273b6971f640393d33a94730179073754 targets: smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCgecEHS0P+wzj5v94FYGuGvIzhkLbRH2ZIjfOUUaohRNATe8lvLED/5YpX0sIVDLieUHAf2XJGPl+LifKmi3kw= smithi193.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI39AJ8epuhP9MB3wS1z9Q4Gfh/PslZUQnoLEhBpdCEYndcqS0j6ZhVDbuWn55/hm5eIjmzZbABXEo5ifsALa64= tasks: - install: branch: squid exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: squid conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:squid roleless: true - print: '**** done end installing squid cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-04_15:42:18 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-04T16:13:35.178 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f9fcca5273b6971f640393d33a94730179073754/qa; will attempt to use it 2024-09-04T16:13:35.179 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f9fcca5273b6971f640393d33a94730179073754/qa/tasks 2024-09-04T16:13:35.179 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-04T16:13:35.181 INFO:teuthology.task.internal:Checking packages... 2024-09-04T16:13:35.203 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f9fcca5273b6971f640393d33a94730179073754' 2024-09-04T16:13:35.203 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-04T16:13:35.203 INFO:teuthology.packaging:ref: None 2024-09-04T16:13:35.203 INFO:teuthology.packaging:tag: None 2024-09-04T16:13:35.203 INFO:teuthology.packaging:branch: wip-guits-main-2024-09-04-1323 2024-09-04T16:13:35.203 INFO:teuthology.packaging:sha1: f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:13:35.204 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-guits-main-2024-09-04-1323 2024-09-04T16:13:35.342 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4702.gf9fcca52 2024-09-04T16:13:35.343 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-04T16:13:35.350 INFO:teuthology.task.internal:no buildpackages task found 2024-09-04T16:13:35.350 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-04T16:13:35.372 INFO:teuthology.task.internal:Saving configuration 2024-09-04T16:13:35.391 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-04T16:13:35.398 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-04T16:13:35.422 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-04_15:42:18-orch:cephadm-wip-guits-main-2024-09-04-1323-distro-default-smithi/7889192', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-04 16:08:35.505949', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCgecEHS0P+wzj5v94FYGuGvIzhkLbRH2ZIjfOUUaohRNATe8lvLED/5YpX0sIVDLieUHAf2XJGPl+LifKmi3kw='} 2024-09-04T16:13:35.445 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-04_15:42:18-orch:cephadm-wip-guits-main-2024-09-04-1323-distro-default-smithi/7889192', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-04 16:08:35.507220', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI39AJ8epuhP9MB3wS1z9Q4Gfh/PslZUQnoLEhBpdCEYndcqS0j6ZhVDbuWn55/hm5eIjmzZbABXEo5ifsALa64='} 2024-09-04T16:13:35.446 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-04T16:13:35.452 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-04T16:13:35.452 INFO:teuthology.task.internal:roles: ubuntu@smithi193.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-04T16:13:35.452 INFO:teuthology.run_tasks:Running task console_log... 2024-09-04T16:13:35.518 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9114273be0>, signals=[15]) 2024-09-04T16:13:35.519 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-04T16:13:35.526 INFO:teuthology.task.internal:Opening connections... 2024-09-04T16:13:35.526 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2024-09-04T16:13:35.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-04T16:13:35.611 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi193.front.sepia.ceph.com 2024-09-04T16:13:35.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-04T16:13:35.703 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-04T16:13:35.710 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-09-04T16:13:35.728 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-09-04T16:13:35.729 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-09-04T16:13:35.785 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-09-04T16:13:35.786 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-09-04T16:13:35.786 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-09-04T16:13:35.786 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-09-04T16:13:35.786 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-09-04T16:13:35.786 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-09-04T16:13:35.786 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-04T16:13:35.786 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-09-04T16:13:35.786 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-09-04T16:13:35.786 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-04T16:13:35.786 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-09-04T16:13:35.786 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-04T16:13:35.786 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-04T16:13:35.786 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-04T16:13:35.787 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-09-04T16:13:35.811 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2024-09-04T16:13:35.829 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2024-09-04T16:13:35.830 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2024-09-04T16:13:35.888 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2024-09-04T16:13:35.888 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9" 2024-09-04T16:13:35.888 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2024-09-04T16:13:35.888 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2024-09-04T16:13:35.888 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9" 2024-09-04T16:13:35.888 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9" 2024-09-04T16:13:35.888 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-04T16:13:35.888 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2024-09-04T16:13:35.889 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon" 2024-09-04T16:13:35.889 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-04T16:13:35.889 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2024-09-04T16:13:35.889 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-04T16:13:35.889 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-04T16:13:35.889 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-04T16:13:35.889 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2024-09-04T16:13:35.911 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-04T16:13:35.920 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-04T16:13:35.927 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-04T16:13:35.928 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2024-09-04T16:13:35.930 DEBUG:teuthology.orchestra.run.smithi193:> test '!' -e /home/ubuntu/cephtest 2024-09-04T16:13:35.947 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-04T16:13:35.953 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-04T16:13:35.953 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2024-09-04T16:13:35.988 DEBUG:teuthology.orchestra.run.smithi193:> test -z $(ls -A /var/lib/ceph) 2024-09-04T16:13:36.076 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-04T16:13:36.129 INFO:teuthology.run_tasks:Running task kernel... 2024-09-04T16:13:36.143 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-04T16:13:36.143 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-04T16:13:36.143 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-04T16:13:36.144 DEBUG:teuthology.orchestra.run.smithi193:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-04T16:13:36.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-04T16:13:36.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-04T16:13:36.162 DEBUG:teuthology.orchestra.run.smithi193:> uname -r 2024-09-04T16:13:36.162 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-09-04T16:13:36.220 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-503.el9.x86_64 2024-09-04T16:13:36.220 INFO:teuthology.task.kernel:Running kernel on smithi170: 5.14.0-503.el9.x86_64 2024-09-04T16:13:36.220 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum install -y kernel 2024-09-04T16:13:36.221 INFO:teuthology.orchestra.run.smithi193.stdout:5.14.0-503.el9.x86_64 2024-09-04T16:13:36.221 INFO:teuthology.task.kernel:Running kernel on smithi193: 5.14.0-503.el9.x86_64 2024-09-04T16:13:36.221 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum install -y kernel 2024-09-04T16:13:38.597 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-04T16:13:40.107 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.2 MB 00:02 2024-09-04T16:13:40.415 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-04T16:13:42.025 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-04T16:13:45.832 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-04T16:13:46.792 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 6.5 MB 00:00 2024-09-04T16:13:49.420 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - Extras packages 7.8 kB/s | 19 kB 00:02 2024-09-04T16:13:50.412 INFO:teuthology.orchestra.run.smithi193.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-04T16:13:52.539 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 4.1 kB/s | 19 kB 00:04 2024-09-04T16:13:54.240 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 14 MB/s | 23 MB 00:01 2024-09-04T16:13:55.768 INFO:teuthology.orchestra.run.smithi193.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-09-04T16:13:57.716 INFO:teuthology.orchestra.run.smithi193.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-04T16:13:57.716 INFO:teuthology.orchestra.run.smithi193.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-04T16:13:57.803 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:13:57.804 INFO:teuthology.orchestra.run.smithi193.stdout:Nothing to do. 2024-09-04T16:13:57.804 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:13:57.899 DEBUG:teuthology.orchestra.run.smithi193:> echo no | sudo yum reinstall kernel || true 2024-09-04T16:13:58.481 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:00:03 ago on Wed 04 Sep 2024 04:13:55 PM UTC. 2024-09-04T16:13:58.639 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:13:58.650 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:13:58.650 INFO:teuthology.orchestra.run.smithi193.stdout: Package Architecture Version Repository Size 2024-09-04T16:13:58.651 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:13:58.651 INFO:teuthology.orchestra.run.smithi193.stdout:Reinstalling: 2024-09-04T16:13:58.651 INFO:teuthology.orchestra.run.smithi193.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-04T16:13:58.651 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:13:58.651 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:13:58.651 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:13:58.651 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:13:58.651 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 1.9 M 2024-09-04T16:13:58.651 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 0 2024-09-04T16:13:58.651 INFO:teuthology.orchestra.run.smithi193.stderr:Operation aborted. 2024-09-04T16:13:58.704 INFO:teuthology.orchestra.run.smithi193.stdout:Is this ok [y/N]: 2024-09-04T16:13:58.705 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum reinstall -y kernel || true 2024-09-04T16:13:59.240 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:00:04 ago on Wed 04 Sep 2024 04:13:55 PM UTC. 2024-09-04T16:13:59.367 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:13:59.368 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:13:59.368 INFO:teuthology.orchestra.run.smithi193.stdout: Package Architecture Version Repository Size 2024-09-04T16:13:59.368 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:13:59.368 INFO:teuthology.orchestra.run.smithi193.stdout:Reinstalling: 2024-09-04T16:13:59.368 INFO:teuthology.orchestra.run.smithi193.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-04T16:13:59.369 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:13:59.369 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:13:59.369 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:13:59.369 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:13:59.369 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 1.9 M 2024-09-04T16:13:59.369 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 0 2024-09-04T16:13:59.369 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-04T16:13:59.687 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-04T16:14:00.095 INFO:teuthology.orchestra.run.smithi193.stdout:kernel-5.14.0-503.el9.x86_64.rpm 4.0 MB/s | 1.9 MB 00:00 2024-09-04T16:14:00.095 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:14:00.095 INFO:teuthology.orchestra.run.smithi193.stdout:Total 2.6 MB/s | 1.9 MB 00:00 2024-09-04T16:14:00.126 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-04T16:14:00.366 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-04T16:14:00.366 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-04T16:14:00.396 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-04T16:14:00.397 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-04T16:14:00.566 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-04T16:14:00.647 INFO:teuthology.orchestra.run.smithi193.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-04T16:14:00.647 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-04T16:14:01.379 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-09-04T16:14:01.379 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-04T16:14:01.677 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-04T16:14:01.678 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-04T16:14:01.753 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:14:01.754 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-04T16:14:01.754 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:14:01.873 DEBUG:teuthology.orchestra.run.smithi170:> echo no | sudo yum reinstall kernel || true 2024-09-04T16:14:02.040 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-04T16:14:02.040 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:14:02.040 INFO:teuthology.orchestra.run.smithi193.stdout:Reinstalled: 2024-09-04T16:14:02.040 INFO:teuthology.orchestra.run.smithi193.stdout: kernel-5.14.0-503.el9.x86_64 2024-09-04T16:14:02.040 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:14:02.041 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:14:02.207 DEBUG:teuthology.orchestra.run.smithi193:> rpm -q kernel | sort -rV | head -n 1 2024-09-04T16:14:02.266 INFO:teuthology.orchestra.run.smithi193.stdout:kernel-5.14.0-503.el9.x86_64 2024-09-04T16:14:02.266 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-09-04T16:14:02.266 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-09-04T16:14:02.266 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-04T16:14:02.266 DEBUG:teuthology.orchestra.run.smithi193:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-04T16:14:02.303 INFO:teuthology.orchestra.run.smithi193.stdout:ttyS1 2024-09-04T16:14:02.328 DEBUG:teuthology.parallel:result is None 2024-09-04T16:14:02.414 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:03 ago on Wed 04 Sep 2024 04:13:59 PM UTC. 2024-09-04T16:14:02.571 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:14:02.584 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:14:02.584 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-09-04T16:14:02.584 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:14:02.585 INFO:teuthology.orchestra.run.smithi170.stdout:Reinstalling: 2024-09-04T16:14:02.585 INFO:teuthology.orchestra.run.smithi170.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-04T16:14:02.585 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:14:02.585 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:14:02.585 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:14:02.585 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:14:02.585 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 1.9 M 2024-09-04T16:14:02.585 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 0 2024-09-04T16:14:02.586 INFO:teuthology.orchestra.run.smithi170.stderr:Operation aborted. 2024-09-04T16:14:02.645 INFO:teuthology.orchestra.run.smithi170.stdout:Is this ok [y/N]: 2024-09-04T16:14:02.646 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum reinstall -y kernel || true 2024-09-04T16:14:03.181 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:04 ago on Wed 04 Sep 2024 04:13:59 PM UTC. 2024-09-04T16:14:03.309 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:14:03.312 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:14:03.312 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-09-04T16:14:03.312 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:14:03.313 INFO:teuthology.orchestra.run.smithi170.stdout:Reinstalling: 2024-09-04T16:14:03.313 INFO:teuthology.orchestra.run.smithi170.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-04T16:14:03.313 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:14:03.313 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:14:03.313 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:14:03.313 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:14:03.313 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 1.9 M 2024-09-04T16:14:03.313 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 0 2024-09-04T16:14:03.313 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-04T16:14:04.356 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-503.el9.x86_64.rpm 2.0 MB/s | 1.9 MB 00:00 2024-09-04T16:14:04.356 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:14:04.356 INFO:teuthology.orchestra.run.smithi170.stdout:Total 1.8 MB/s | 1.9 MB 00:01 2024-09-04T16:14:04.391 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-04T16:14:04.626 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-04T16:14:04.626 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-04T16:14:04.656 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-04T16:14:04.657 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-04T16:14:04.842 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-04T16:14:04.944 INFO:teuthology.orchestra.run.smithi170.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-04T16:14:04.944 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-04T16:14:05.681 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-09-04T16:14:05.681 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-04T16:14:06.408 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-04T16:14:06.408 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:14:06.408 INFO:teuthology.orchestra.run.smithi170.stdout:Reinstalled: 2024-09-04T16:14:06.409 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-5.14.0-503.el9.x86_64 2024-09-04T16:14:06.409 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:14:06.409 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:14:06.628 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2024-09-04T16:14:06.687 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-503.el9.x86_64 2024-09-04T16:14:06.688 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-09-04T16:14:06.688 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-09-04T16:14:06.688 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-04T16:14:06.688 DEBUG:teuthology.orchestra.run.smithi170:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-04T16:14:06.724 INFO:teuthology.orchestra.run.smithi170.stdout:ttyS1 2024-09-04T16:14:06.744 DEBUG:teuthology.parallel:result is None 2024-09-04T16:14:06.744 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-04T16:14:06.751 INFO:teuthology.task.internal:Creating test directory... 2024-09-04T16:14:06.751 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-04T16:14:06.790 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-04T16:14:06.809 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-04T16:14:06.815 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-04T16:14:06.824 INFO:teuthology.task.internal:Creating archive directory... 2024-09-04T16:14:06.824 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-04T16:14:06.845 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-04T16:14:06.884 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-04T16:14:06.891 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-04T16:14:06.891 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-04T16:14:06.911 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-04T16:14:06.941 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-04T16:14:06.950 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-04T16:14:06.974 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-04T16:14:06.985 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-04T16:14:06.987 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-04T16:14:06.994 INFO:teuthology.task.internal:Configuring sudo... 2024-09-04T16:14:06.995 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-04T16:14:06.997 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-04T16:14:07.025 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-04T16:14:07.034 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-04T16:14:07.034 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-04T16:14:07.063 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-04T16:14:07.083 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-04T16:14:07.160 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-04T16:14:07.217 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-04T16:14:07.297 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-04T16:14:07.340 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:14:07.341 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-04T16:14:07.405 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-04T16:14:07.451 DEBUG:teuthology.orchestra.run.smithi193:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-04T16:14:07.503 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-04T16:14:07.586 DEBUG:teuthology.orchestra.run.smithi193:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-04T16:14:07.631 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-04T16:14:07.632 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-04T16:14:07.699 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2024-09-04T16:14:07.701 DEBUG:teuthology.orchestra.run.smithi193:> sudo service rsyslog restart 2024-09-04T16:14:07.741 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-04T16:14:07.774 INFO:teuthology.orchestra.run.smithi193.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-04T16:14:08.194 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-04T16:14:08.202 INFO:teuthology.task.internal:Starting timer... 2024-09-04T16:14:08.202 INFO:teuthology.run_tasks:Running task pcp... 2024-09-04T16:14:08.214 INFO:teuthology.run_tasks:Running task selinux... 2024-09-04T16:14:08.222 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-04T16:14:08.222 DEBUG:teuthology.orchestra.run.smithi170:> sudo service auditd rotate 2024-09-04T16:14:08.259 INFO:teuthology.orchestra.run.smithi170.stdout:Rotating logs: 2024-09-04T16:14:08.261 DEBUG:teuthology.orchestra.run.smithi193:> sudo service auditd rotate 2024-09-04T16:14:08.319 INFO:teuthology.orchestra.run.smithi193.stdout:Rotating logs: 2024-09-04T16:14:08.321 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-04T16:14:08.321 DEBUG:teuthology.orchestra.run.smithi170:> /usr/sbin/getenforce 2024-09-04T16:14:08.345 INFO:teuthology.orchestra.run.smithi170.stdout:Permissive 2024-09-04T16:14:08.345 DEBUG:teuthology.orchestra.run.smithi193:> /usr/sbin/getenforce 2024-09-04T16:14:08.375 INFO:teuthology.orchestra.run.smithi193.stdout:Permissive 2024-09-04T16:14:08.375 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi170.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi193.front.sepia.ceph.com': 'permissive'} 2024-09-04T16:14:08.375 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-04T16:14:08.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-04T16:14:08.411 DEBUG:teuthology.orchestra.run.smithi193:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-04T16:14:08.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-04T16:14:08.441 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-04T16:14:08.441 DEBUG:teuthology.orchestra.run.smithi170:> sudo /usr/sbin/setenforce permissive 2024-09-04T16:14:08.486 DEBUG:teuthology.orchestra.run.smithi193:> sudo /usr/sbin/setenforce permissive 2024-09-04T16:14:08.517 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-04T16:14:08.526 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-04T16:14:08.529 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-04T16:14:08.660 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-04T16:14:08.671 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-04T16:14:08.672 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi170.front.sepia.ceph.com,smithi193.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-04T16:17:46.828 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi170.front.sepia.ceph.com'), Remote(name='ubuntu@smithi193.front.sepia.ceph.com')] 2024-09-04T16:17:46.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-04T16:17:46.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-04T16:17:46.906 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-09-04T16:17:46.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-04T16:17:46.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-04T16:17:46.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-04T16:17:47.053 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-09-04T16:17:47.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-04T16:17:47.128 INFO:teuthology.run_tasks:Running task clock... 2024-09-04T16:17:47.138 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-04T16:17:47.138 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-04T16:17:47.139 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-04T16:17:47.141 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-04T16:17:47.141 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-04T16:17:47.168 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-04T16:17:47.182 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-04T16:17:47.197 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-04T16:17:47.206 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: ntpd: command not found 2024-09-04T16:17:47.211 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-04T16:17:47.217 INFO:teuthology.orchestra.run.smithi170.stdout:506 Cannot talk to daemon 2024-09-04T16:17:47.231 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-04T16:17:47.235 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: ntpd: command not found 2024-09-04T16:17:47.245 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-04T16:17:47.246 INFO:teuthology.orchestra.run.smithi193.stdout:506 Cannot talk to daemon 2024-09-04T16:17:47.260 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-04T16:17:47.274 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-04T16:17:47.301 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-09-04T16:17:47.304 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-04T16:17:47.304 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-09-04T16:17:47.304 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-04T16:17:47.304 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-04T16:17:47.304 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-04T16:17:47.304 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-04T16:17:47.328 INFO:teuthology.orchestra.run.smithi193.stderr:bash: line 1: ntpq: command not found 2024-09-04T16:17:47.331 INFO:teuthology.orchestra.run.smithi193.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-04T16:17:47.331 INFO:teuthology.orchestra.run.smithi193.stdout:=============================================================================== 2024-09-04T16:17:47.331 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-04T16:17:47.331 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-04T16:17:47.331 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-04T16:17:47.331 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-04T16:17:47.332 INFO:teuthology.run_tasks:Running task install... 2024-09-04T16:17:47.341 DEBUG:teuthology.task.install:project ceph 2024-09-04T16:17:47.341 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f9fcca5273b6971f640393d33a94730179073754'}} 2024-09-04T16:17:47.341 DEBUG:teuthology.task.install:config {'branch': 'squid', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'f9fcca5273b6971f640393d33a94730179073754'} 2024-09-04T16:17:47.341 INFO:teuthology.task.install:Using flavor: default 2024-09-04T16:17:47.347 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-04T16:17:47.348 INFO:teuthology.task.install:extra packages: [] 2024-09-04T16:17:47.348 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f9fcca5273b6971f640393d33a94730179073754', 'tag': None, 'wait_for_package': False} 2024-09-04T16:17:47.349 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-04T16:17:47.349 INFO:teuthology.packaging:ref: None 2024-09-04T16:17:47.349 INFO:teuthology.packaging:tag: None 2024-09-04T16:17:47.349 INFO:teuthology.packaging:branch: squid 2024-09-04T16:17:47.349 INFO:teuthology.packaging:sha1: f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:17:47.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-04T16:17:47.352 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f9fcca5273b6971f640393d33a94730179073754', 'tag': None, 'wait_for_package': False} 2024-09-04T16:17:47.352 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-04T16:17:47.352 INFO:teuthology.packaging:ref: None 2024-09-04T16:17:47.352 INFO:teuthology.packaging:tag: None 2024-09-04T16:17:47.352 INFO:teuthology.packaging:branch: squid 2024-09-04T16:17:47.352 INFO:teuthology.packaging:sha1: f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:17:47.353 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-04T16:17:47.567 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/48920dabc954a29bdb7dd91079363a020369bbff/centos/9/flavors/default/ 2024-09-04T16:17:47.567 INFO:teuthology.task.install.rpm:Package version is 19.1.1-252.g48920dab 2024-09-04T16:17:47.579 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/48920dabc954a29bdb7dd91079363a020369bbff/centos/9/flavors/default/ 2024-09-04T16:17:47.579 INFO:teuthology.task.install.rpm:Package version is 19.1.1-252.g48920dab 2024-09-04T16:17:47.679 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/48920dabc954a29bdb7dd91079363a020369bbff/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/48920dabc954a29bdb7dd91079363a020369bbff/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/48920dabc954a29bdb7dd91079363a020369bbff/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-04T16:17:47.680 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-04T16:17:47.680 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-04T16:17:47.689 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/48920dabc954a29bdb7dd91079363a020369bbff/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/48920dabc954a29bdb7dd91079363a020369bbff/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/48920dabc954a29bdb7dd91079363a020369bbff/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-04T16:17:47.689 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:17:47.689 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-04T16:17:47.706 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-04T16:17:47.706 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-04T16:17:47.706 INFO:teuthology.packaging:ref: None 2024-09-04T16:17:47.706 INFO:teuthology.packaging:tag: None 2024-09-04T16:17:47.706 INFO:teuthology.packaging:branch: squid 2024-09-04T16:17:47.707 INFO:teuthology.packaging:sha1: f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:17:47.707 DEBUG:teuthology.orchestra.run.smithi193:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-04T16:17:47.715 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-04T16:17:47.715 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-04T16:17:47.715 INFO:teuthology.packaging:ref: None 2024-09-04T16:17:47.715 INFO:teuthology.packaging:tag: None 2024-09-04T16:17:47.715 INFO:teuthology.packaging:branch: squid 2024-09-04T16:17:47.715 INFO:teuthology.packaging:sha1: f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:17:47.715 DEBUG:teuthology.orchestra.run.smithi170:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-04T16:17:47.772 DEBUG:teuthology.orchestra.run.smithi193:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-04T16:17:47.781 DEBUG:teuthology.orchestra.run.smithi170:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-04T16:17:47.847 DEBUG:teuthology.orchestra.run.smithi193:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-04T16:17:47.855 DEBUG:teuthology.orchestra.run.smithi170:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-04T16:17:47.910 INFO:teuthology.orchestra.run.smithi193.stdout:check_obsoletes = 1 2024-09-04T16:17:47.912 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum clean all 2024-09-04T16:17:47.920 INFO:teuthology.orchestra.run.smithi170.stdout:check_obsoletes = 1 2024-09-04T16:17:47.921 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum clean all 2024-09-04T16:17:48.136 INFO:teuthology.orchestra.run.smithi193.stdout:45 files removed 2024-09-04T16:17:48.146 INFO:teuthology.orchestra.run.smithi170.stdout:45 files removed 2024-09-04T16:17:48.163 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph-radosgw 2024-09-04T16:17:48.173 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-radosgw 2024-09-04T16:17:48.711 INFO:teuthology.orchestra.run.smithi193.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-04T16:17:48.720 INFO:teuthology.orchestra.run.smithi170.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-04T16:17:48.995 INFO:teuthology.orchestra.run.smithi193.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-04T16:17:49.021 INFO:teuthology.orchestra.run.smithi170.stdout:ceph noarch packages 45 kB/s | 12 kB 00:00 2024-09-04T16:17:49.271 INFO:teuthology.orchestra.run.smithi193.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-04T16:17:49.288 INFO:teuthology.orchestra.run.smithi170.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-04T16:17:50.146 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 8.2 MB 00:00 2024-09-04T16:17:50.513 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 6.9 MB/s | 8.2 MB 00:01 2024-09-04T16:17:53.406 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 20 MB 00:02 2024-09-04T16:17:56.239 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-09-04T16:17:58.456 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 6.5 MB 00:01 2024-09-04T16:18:00.815 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 8.3 MB/s | 6.5 MB 00:00 2024-09-04T16:18:02.384 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - Extras packages 6.8 kB/s | 19 kB 00:02 2024-09-04T16:18:03.404 INFO:teuthology.orchestra.run.smithi193.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-04T16:18:03.560 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 19 kB 00:01 2024-09-04T16:18:04.962 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-04T16:18:08.926 INFO:teuthology.orchestra.run.smithi193.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-04T16:18:10.393 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2024-09-04T16:18:11.228 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:18:11.230 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:18:11.230 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repository Size 2024-09-04T16:18:11.230 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:18:11.230 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-04T16:18:11.230 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-radosgw x86_64 2:19.1.1-252.g48920dab.el9 ceph 11 M 2024-09-04T16:18:11.230 INFO:teuthology.orchestra.run.smithi193.stdout:Upgrading: 2024-09-04T16:18:11.231 INFO:teuthology.orchestra.run.smithi193.stdout: librados2 x86_64 2:19.1.1-252.g48920dab.el9 ceph 3.4 M 2024-09-04T16:18:11.231 INFO:teuthology.orchestra.run.smithi193.stdout: librbd1 x86_64 2:19.1.1-252.g48920dab.el9 ceph 3.2 M 2024-09-04T16:18:11.231 INFO:teuthology.orchestra.run.smithi193.stdout:Installing dependencies: 2024-09-04T16:18:11.231 INFO:teuthology.orchestra.run.smithi193.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-04T16:18:11.231 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base x86_64 2:19.1.1-252.g48920dab.el9 ceph 5.4 M 2024-09-04T16:18:11.231 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-common x86_64 2:19.1.1-252.g48920dab.el9 ceph 21 M 2024-09-04T16:18:11.231 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-selinux x86_64 2:19.1.1-252.g48920dab.el9 ceph 25 k 2024-09-04T16:18:11.231 INFO:teuthology.orchestra.run.smithi193.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-04T16:18:11.231 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-04T16:18:11.231 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-04T16:18:11.231 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs2 x86_64 2:19.1.1-252.g48920dab.el9 ceph 752 k 2024-09-04T16:18:11.231 INFO:teuthology.orchestra.run.smithi193.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-04T16:18:11.231 INFO:teuthology.orchestra.run.smithi193.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-04T16:18:11.232 INFO:teuthology.orchestra.run.smithi193.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-04T16:18:11.232 INFO:teuthology.orchestra.run.smithi193.stdout: libradosstriper1 x86_64 2:19.1.1-252.g48920dab.el9 ceph 506 k 2024-09-04T16:18:11.232 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-04T16:18:11.232 INFO:teuthology.orchestra.run.smithi193.stdout: librgw2 x86_64 2:19.1.1-252.g48920dab.el9 ceph 5.3 M 2024-09-04T16:18:11.232 INFO:teuthology.orchestra.run.smithi193.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-04T16:18:11.232 INFO:teuthology.orchestra.run.smithi193.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-04T16:18:11.232 INFO:teuthology.orchestra.run.smithi193.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-04T16:18:11.232 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse x86_64 2:19.1.1-252.g48920dab.el9 ceph 45 k 2024-09-04T16:18:11.232 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common x86_64 2:19.1.1-252.g48920dab.el9 ceph 136 k 2024-09-04T16:18:11.232 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cephfs x86_64 2:19.1.1-252.g48920dab.el9 ceph 161 k 2024-09-04T16:18:11.232 INFO:teuthology.orchestra.run.smithi193.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-04T16:18:11.232 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rados x86_64 2:19.1.1-252.g48920dab.el9 ceph 319 k 2024-09-04T16:18:11.232 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rbd x86_64 2:19.1.1-252.g48920dab.el9 ceph 301 k 2024-09-04T16:18:11.233 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rgw x86_64 2:19.1.1-252.g48920dab.el9 ceph 99 k 2024-09-04T16:18:11.233 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-04T16:18:11.233 INFO:teuthology.orchestra.run.smithi193.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-04T16:18:11.233 INFO:teuthology.orchestra.run.smithi193.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-04T16:18:11.233 INFO:teuthology.orchestra.run.smithi193.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-04T16:18:11.233 INFO:teuthology.orchestra.run.smithi193.stdout:Installing weak dependencies: 2024-09-04T16:18:11.233 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-04T16:18:11.233 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:11.233 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:18:11.234 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:18:11.234 INFO:teuthology.orchestra.run.smithi193.stdout:Install 30 Packages 2024-09-04T16:18:11.234 INFO:teuthology.orchestra.run.smithi193.stdout:Upgrade 2 Packages 2024-09-04T16:18:11.234 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:11.234 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 60 M 2024-09-04T16:18:11.234 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-04T16:18:12.052 INFO:teuthology.orchestra.run.smithi193.stdout:(1/32): ceph-base-19.1.1-252.g48920dab.el9.x86_ 8.6 MB/s | 5.4 MB 00:00 2024-09-04T16:18:12.111 INFO:teuthology.orchestra.run.smithi193.stdout:(2/32): ceph-selinux-19.1.1-252.g48920dab.el9.x 434 kB/s | 25 kB 00:00 2024-09-04T16:18:12.219 INFO:teuthology.orchestra.run.smithi193.stdout:(3/32): ceph-radosgw-19.1.1-252.g48920dab.el9.x 13 MB/s | 11 MB 00:00 2024-09-04T16:18:12.253 INFO:teuthology.orchestra.run.smithi193.stdout:(4/32): libcephfs2-19.1.1-252.g48920dab.el9.x86 5.2 MB/s | 752 kB 00:00 2024-09-04T16:18:12.278 INFO:teuthology.orchestra.run.smithi193.stdout:(5/32): libradosstriper1-19.1.1-252.g48920dab.e 8.5 MB/s | 506 kB 00:00 2024-09-04T16:18:12.328 INFO:teuthology.orchestra.run.smithi193.stdout:(6/32): python3-ceph-argparse-19.1.1-252.g48920 901 kB/s | 45 kB 00:00 2024-09-04T16:18:12.404 INFO:teuthology.orchestra.run.smithi193.stdout:(7/32): python3-ceph-common-19.1.1-252.g48920da 1.8 MB/s | 136 kB 00:00 2024-09-04T16:18:12.471 INFO:teuthology.orchestra.run.smithi193.stdout:(8/32): python3-cephfs-19.1.1-252.g48920dab.el9 2.4 MB/s | 161 kB 00:00 2024-09-04T16:18:12.546 INFO:teuthology.orchestra.run.smithi193.stdout:(9/32): librgw2-19.1.1-252.g48920dab.el9.x86_64 18 MB/s | 5.3 MB 00:00 2024-09-04T16:18:12.643 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:18:12.645 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:18:12.645 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-04T16:18:12.645 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:18:12.645 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-04T16:18:12.645 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw x86_64 2:19.1.1-252.g48920dab.el9 ceph 11 M 2024-09-04T16:18:12.645 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrading: 2024-09-04T16:18:12.646 INFO:teuthology.orchestra.run.smithi170.stdout: librados2 x86_64 2:19.1.1-252.g48920dab.el9 ceph 3.4 M 2024-09-04T16:18:12.646 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1 x86_64 2:19.1.1-252.g48920dab.el9 ceph 3.2 M 2024-09-04T16:18:12.646 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-04T16:18:12.646 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-04T16:18:12.646 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base x86_64 2:19.1.1-252.g48920dab.el9 ceph 5.4 M 2024-09-04T16:18:12.646 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common x86_64 2:19.1.1-252.g48920dab.el9 ceph 21 M 2024-09-04T16:18:12.646 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux x86_64 2:19.1.1-252.g48920dab.el9 ceph 25 k 2024-09-04T16:18:12.646 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-04T16:18:12.646 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-04T16:18:12.646 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-04T16:18:12.646 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2 x86_64 2:19.1.1-252.g48920dab.el9 ceph 752 k 2024-09-04T16:18:12.646 INFO:teuthology.orchestra.run.smithi170.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-04T16:18:12.646 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-04T16:18:12.647 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-04T16:18:12.647 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 x86_64 2:19.1.1-252.g48920dab.el9 ceph 506 k 2024-09-04T16:18:12.647 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-04T16:18:12.647 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2 x86_64 2:19.1.1-252.g48920dab.el9 ceph 5.3 M 2024-09-04T16:18:12.647 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-04T16:18:12.647 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-04T16:18:12.647 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-04T16:18:12.647 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse x86_64 2:19.1.1-252.g48920dab.el9 ceph 45 k 2024-09-04T16:18:12.647 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common x86_64 2:19.1.1-252.g48920dab.el9 ceph 136 k 2024-09-04T16:18:12.647 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs x86_64 2:19.1.1-252.g48920dab.el9 ceph 161 k 2024-09-04T16:18:12.647 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-04T16:18:12.647 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados x86_64 2:19.1.1-252.g48920dab.el9 ceph 319 k 2024-09-04T16:18:12.647 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd x86_64 2:19.1.1-252.g48920dab.el9 ceph 301 k 2024-09-04T16:18:12.648 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw x86_64 2:19.1.1-252.g48920dab.el9 ceph 99 k 2024-09-04T16:18:12.648 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-04T16:18:12.648 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-04T16:18:12.648 INFO:teuthology.orchestra.run.smithi170.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-04T16:18:12.648 INFO:teuthology.orchestra.run.smithi170.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-04T16:18:12.648 INFO:teuthology.orchestra.run.smithi170.stdout:Installing weak dependencies: 2024-09-04T16:18:12.648 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-04T16:18:12.648 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:12.648 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:18:12.648 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:18:12.648 INFO:teuthology.orchestra.run.smithi170.stdout:Install 30 Packages 2024-09-04T16:18:12.648 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrade 2 Packages 2024-09-04T16:18:12.648 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:12.649 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 60 M 2024-09-04T16:18:12.649 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-04T16:18:12.738 INFO:teuthology.orchestra.run.smithi193.stdout:(10/32): ceph-common-19.1.1-252.g48920dab.el9.x 16 MB/s | 21 MB 00:01 2024-09-04T16:18:12.763 INFO:teuthology.orchestra.run.smithi193.stdout:(11/32): python3-rados-19.1.1-252.g48920dab.el9 1.1 MB/s | 319 kB 00:00 2024-09-04T16:18:12.789 INFO:teuthology.orchestra.run.smithi193.stdout:(12/32): python3-rgw-19.1.1-252.g48920dab.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-04T16:18:12.814 INFO:teuthology.orchestra.run.smithi193.stdout:(13/32): python3-rbd-19.1.1-252.g48920dab.el9.x 1.1 MB/s | 301 kB 00:00 2024-09-04T16:18:12.872 INFO:teuthology.orchestra.run.smithi193.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 981 kB/s | 107 kB 00:00 2024-09-04T16:18:12.898 INFO:teuthology.orchestra.run.smithi193.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 541 kB/s | 45 kB 00:00 2024-09-04T16:18:12.923 INFO:teuthology.orchestra.run.smithi193.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-04T16:18:12.957 INFO:teuthology.orchestra.run.smithi193.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 1.2 MB/s | 42 kB 00:00 2024-09-04T16:18:12.982 INFO:teuthology.orchestra.run.smithi193.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-09-04T16:18:13.024 INFO:teuthology.orchestra.run.smithi193.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-04T16:18:13.041 INFO:teuthology.orchestra.run.smithi193.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 611 kB/s | 36 kB 00:00 2024-09-04T16:18:13.058 INFO:teuthology.orchestra.run.smithi193.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-04T16:18:13.083 INFO:teuthology.orchestra.run.smithi193.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-04T16:18:13.142 INFO:teuthology.orchestra.run.smithi193.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 3.0 MB/s | 309 kB 00:00 2024-09-04T16:18:13.167 INFO:teuthology.orchestra.run.smithi193.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-04T16:18:13.184 INFO:teuthology.orchestra.run.smithi193.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 299 kB/s | 26 kB 00:00 2024-09-04T16:18:13.209 INFO:teuthology.orchestra.run.smithi193.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-04T16:18:13.243 INFO:teuthology.orchestra.run.smithi193.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-04T16:18:13.276 INFO:teuthology.orchestra.run.smithi193.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-04T16:18:13.343 INFO:teuthology.orchestra.run.smithi193.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-04T16:18:13.452 INFO:teuthology.orchestra.run.smithi193.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-04T16:18:13.544 INFO:teuthology.orchestra.run.smithi193.stdout:(31/32): librados2-19.1.1-252.g48920dab.el9.x86 13 MB/s | 3.4 MB 00:00 2024-09-04T16:18:13.686 INFO:teuthology.orchestra.run.smithi170.stdout:(1/32): ceph-base-19.1.1-252.g48920dab.el9.x86_ 10 MB/s | 5.4 MB 00:00 2024-09-04T16:18:13.703 INFO:teuthology.orchestra.run.smithi193.stdout:(32/32): librbd1-19.1.1-252.g48920dab.el9.x86_6 8.8 MB/s | 3.2 MB 00:00 2024-09-04T16:18:13.707 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:18:13.707 INFO:teuthology.orchestra.run.smithi193.stdout:Total 24 MB/s | 60 MB 00:02 2024-09-04T16:18:13.744 INFO:teuthology.orchestra.run.smithi170.stdout:(2/32): ceph-selinux-19.1.1-252.g48920dab.el9.x 434 kB/s | 25 kB 00:00 2024-09-04T16:18:13.802 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-04T16:18:13.819 INFO:teuthology.orchestra.run.smithi170.stdout:(3/32): libcephfs2-19.1.1-252.g48920dab.el9.x86 9.8 MB/s | 752 kB 00:00 2024-09-04T16:18:13.838 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-04T16:18:13.838 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-04T16:18:13.987 INFO:teuthology.orchestra.run.smithi170.stdout:(4/32): ceph-radosgw-19.1.1-252.g48920dab.el9.x 13 MB/s | 11 MB 00:00 2024-09-04T16:18:14.020 INFO:teuthology.orchestra.run.smithi170.stdout:(5/32): libradosstriper1-19.1.1-252.g48920dab.e 2.5 MB/s | 506 kB 00:00 2024-09-04T16:18:14.096 INFO:teuthology.orchestra.run.smithi170.stdout:(6/32): python3-ceph-argparse-19.1.1-252.g48920 603 kB/s | 45 kB 00:00 2024-09-04T16:18:14.179 INFO:teuthology.orchestra.run.smithi170.stdout:(7/32): python3-ceph-common-19.1.1-252.g48920da 1.6 MB/s | 136 kB 00:00 2024-09-04T16:18:14.288 INFO:teuthology.orchestra.run.smithi170.stdout:(8/32): librgw2-19.1.1-252.g48920dab.el9.x86_64 18 MB/s | 5.3 MB 00:00 2024-09-04T16:18:14.310 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-04T16:18:14.311 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-04T16:18:14.313 INFO:teuthology.orchestra.run.smithi170.stdout:(9/32): python3-cephfs-19.1.1-252.g48920dab.el9 1.2 MB/s | 161 kB 00:00 2024-09-04T16:18:14.338 INFO:teuthology.orchestra.run.smithi170.stdout:(10/32): python3-rados-19.1.1-252.g48920dab.el9 6.2 MB/s | 319 kB 00:00 2024-09-04T16:18:14.372 INFO:teuthology.orchestra.run.smithi170.stdout:(11/32): python3-rbd-19.1.1-252.g48920dab.el9.x 5.0 MB/s | 301 kB 00:00 2024-09-04T16:18:14.397 INFO:teuthology.orchestra.run.smithi170.stdout:(12/32): python3-rgw-19.1.1-252.g48920dab.el9.x 1.7 MB/s | 99 kB 00:00 2024-09-04T16:18:14.481 INFO:teuthology.orchestra.run.smithi170.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 985 kB/s | 107 kB 00:00 2024-09-04T16:18:14.506 INFO:teuthology.orchestra.run.smithi170.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-04T16:18:14.531 INFO:teuthology.orchestra.run.smithi170.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-09-04T16:18:14.757 INFO:teuthology.orchestra.run.smithi170.stdout:(16/32): ceph-common-19.1.1-252.g48920dab.el9.x 13 MB/s | 21 MB 00:01 2024-09-04T16:18:14.782 INFO:teuthology.orchestra.run.smithi170.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.1 MB/s | 292 kB 00:00 2024-09-04T16:18:14.807 INFO:teuthology.orchestra.run.smithi170.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-04T16:18:14.833 INFO:teuthology.orchestra.run.smithi170.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-04T16:18:14.858 INFO:teuthology.orchestra.run.smithi170.stdout:(20/32): python3-prettytable-0.7.2-27.el9.noarc 420 kB/s | 42 kB 00:00 2024-09-04T16:18:14.883 INFO:teuthology.orchestra.run.smithi170.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 473 kB/s | 36 kB 00:00 2024-09-04T16:18:14.929 INFO:teuthology.orchestra.run.smithi170.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 495 kB/s | 47 kB 00:00 2024-09-04T16:18:14.992 INFO:teuthology.orchestra.run.smithi170.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 532 kB/s | 26 kB 00:00 2024-09-04T16:18:15.017 INFO:teuthology.orchestra.run.smithi170.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.9 MB/s | 309 kB 00:00 2024-09-04T16:18:15.043 INFO:teuthology.orchestra.run.smithi170.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 966 kB/s | 49 kB 00:00 2024-09-04T16:18:15.068 INFO:teuthology.orchestra.run.smithi170.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-04T16:18:15.110 INFO:teuthology.orchestra.run.smithi170.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-04T16:18:15.152 INFO:teuthology.orchestra.run.smithi170.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-04T16:18:15.236 INFO:teuthology.orchestra.run.smithi170.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-04T16:18:15.361 INFO:teuthology.orchestra.run.smithi170.stdout:(30/32): librados2-19.1.1-252.g48920dab.el9.x86 16 MB/s | 3.4 MB 00:00 2024-09-04T16:18:15.419 INFO:teuthology.orchestra.run.smithi170.stdout:(31/32): libarrow-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 4.4 MB 00:00 2024-09-04T16:18:15.486 INFO:teuthology.orchestra.run.smithi170.stdout:(32/32): librbd1-19.1.1-252.g48920dab.el9.x86_6 13 MB/s | 3.2 MB 00:00 2024-09-04T16:18:15.491 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:18:15.491 INFO:teuthology.orchestra.run.smithi170.stdout:Total 21 MB/s | 60 MB 00:02 2024-09-04T16:18:15.595 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-04T16:18:15.629 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-04T16:18:15.629 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-04T16:18:15.767 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-04T16:18:15.853 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-04T16:18:15.891 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-04T16:18:15.916 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-04T16:18:15.939 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-04T16:18:15.962 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-04T16:18:16.098 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-04T16:18:16.099 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-04T16:18:16.141 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-04T16:18:16.194 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-04T16:18:16.602 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-04T16:18:16.660 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : librados2-2:19.1.1-252.g48920dab.el9.x86_64 7/34 2024-09-04T16:18:16.752 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librados2-2:19.1.1-252.g48920dab.el9.x86_64 7/34 2024-09-04T16:18:16.850 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rados-2:19.1.1-252.g48920dab.el9.x86_64 8/34 2024-09-04T16:18:16.878 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephfs2-2:19.1.1-252.g48920dab.el9.x86_64 9/34 2024-09-04T16:18:16.941 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libcephfs2-2:19.1.1-252.g48920dab.el9.x86_64 9/34 2024-09-04T16:18:16.970 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-04T16:18:17.013 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ceph-argparse-2:19.1.1-252.g48920dab.el9.x 11/34 2024-09-04T16:18:17.083 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cephfs-2:19.1.1-252.g48920dab.el9.x86_64 12/34 2024-09-04T16:18:17.106 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libradosstriper1-2:19.1.1-252.g48920dab.el9.x86_64 13/34 2024-09-04T16:18:17.170 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libradosstriper1-2:19.1.1-252.g48920dab.el9.x86_64 13/34 2024-09-04T16:18:17.204 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-04T16:18:17.316 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-04T16:18:17.342 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-04T16:18:17.382 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-04T16:18:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-09-04T16:18:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-04T16:18:17.470 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-04T16:18:17.562 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-04T16:18:17.645 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-04T16:18:17.674 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-04T16:18:17.700 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-04T16:18:17.723 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-04T16:18:17.750 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-04T16:18:17.778 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-04T16:18:17.816 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : librbd1-2:19.1.1-252.g48920dab.el9.x86_64 22/34 2024-09-04T16:18:17.890 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librbd1-2:19.1.1-252.g48920dab.el9.x86_64 22/34 2024-09-04T16:18:17.921 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rbd-2:19.1.1-252.g48920dab.el9.x86_64 23/34 2024-09-04T16:18:17.943 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-04T16:18:17.956 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-04T16:18:18.005 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-04T16:18:18.338 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-04T16:18:18.434 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-04T16:18:18.463 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librados2-2:19.1.1-252.g48920dab.el9.x86_64 7/34 2024-09-04T16:18:18.469 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librgw2-2:19.1.1-252.g48920dab.el9.x86_64 26/34 2024-09-04T16:18:18.538 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:19.1.1-252.g48920dab.el9.x86_64 7/34 2024-09-04T16:18:18.540 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librgw2-2:19.1.1-252.g48920dab.el9.x86_64 26/34 2024-09-04T16:18:18.617 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rgw-2:19.1.1-252.g48920dab.el9.x86_64 27/34 2024-09-04T16:18:18.628 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rados-2:19.1.1-252.g48920dab.el9.x86_64 8/34 2024-09-04T16:18:18.655 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ceph-common-2:19.1.1-252.g48920dab.el9.x86 28/34 2024-09-04T16:18:18.656 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs2-2:19.1.1-252.g48920dab.el9.x86_64 9/34 2024-09-04T16:18:18.719 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs2-2:19.1.1-252.g48920dab.el9.x86_64 9/34 2024-09-04T16:18:18.760 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-04T16:18:18.800 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-argparse-2:19.1.1-252.g48920dab.el9.x 11/34 2024-09-04T16:18:18.869 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cephfs-2:19.1.1-252.g48920dab.el9.x86_64 12/34 2024-09-04T16:18:18.892 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libradosstriper1-2:19.1.1-252.g48920dab.el9.x86_64 13/34 2024-09-04T16:18:18.957 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libradosstriper1-2:19.1.1-252.g48920dab.el9.x86_64 13/34 2024-09-04T16:18:18.999 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-04T16:18:19.108 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-04T16:18:19.141 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-04T16:18:19.189 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-04T16:18:19.223 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-09-04T16:18:19.252 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-04T16:18:19.285 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-04T16:18:19.610 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-04T16:18:19.656 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librbd1-2:19.1.1-252.g48920dab.el9.x86_64 22/34 2024-09-04T16:18:19.746 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:19.1.1-252.g48920dab.el9.x86_64 22/34 2024-09-04T16:18:19.778 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rbd-2:19.1.1-252.g48920dab.el9.x86_64 23/34 2024-09-04T16:18:19.813 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-04T16:18:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-04T16:18:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librgw2-2:19.1.1-252.g48920dab.el9.x86_64 26/34 2024-09-04T16:18:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librgw2-2:19.1.1-252.g48920dab.el9.x86_64 26/34 2024-09-04T16:18:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rgw-2:19.1.1-252.g48920dab.el9.x86_64 27/34 2024-09-04T16:18:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-common-2:19.1.1-252.g48920dab.el9.x86 28/34 2024-09-04T16:18:20.923 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-common-2:19.1.1-252.g48920dab.el9.x86_64 29/34 2024-09-04T16:18:20.960 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-common-2:19.1.1-252.g48920dab.el9.x86_64 29/34 2024-09-04T16:18:21.502 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-common-2:19.1.1-252.g48920dab.el9.x86_64 29/34 2024-09-04T16:18:21.539 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-base-2:19.1.1-252.g48920dab.el9.x86_64 30/34 2024-09-04T16:18:21.630 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-base-2:19.1.1-252.g48920dab.el9.x86_64 30/34 2024-09-04T16:18:21.631 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-04T16:18:21.631 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-04T16:18:21.631 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:21.665 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-selinux-2:19.1.1-252.g48920dab.el9.x86_64 31/34 2024-09-04T16:18:22.775 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.1.1-252.g48920dab.el9.x86_64 29/34 2024-09-04T16:18:22.817 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-common-2:19.1.1-252.g48920dab.el9.x86_64 29/34 2024-09-04T16:18:23.366 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.1.1-252.g48920dab.el9.x86_64 29/34 2024-09-04T16:18:23.404 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-base-2:19.1.1-252.g48920dab.el9.x86_64 30/34 2024-09-04T16:18:23.519 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-base-2:19.1.1-252.g48920dab.el9.x86_64 30/34 2024-09-04T16:18:23.520 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-04T16:18:23.520 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-04T16:18:23.520 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:23.547 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-selinux-2:19.1.1-252.g48920dab.el9.x86_64 31/34 2024-09-04T16:18:31.624 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-selinux-2:19.1.1-252.g48920dab.el9.x86_64 31/34 2024-09-04T16:18:31.624 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /sys 2024-09-04T16:18:31.624 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /proc 2024-09-04T16:18:31.624 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /mnt 2024-09-04T16:18:31.624 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /var/tmp 2024-09-04T16:18:31.624 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /home 2024-09-04T16:18:31.624 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /root 2024-09-04T16:18:31.624 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /tmp 2024-09-04T16:18:31.624 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:32.601 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-radosgw-2:19.1.1-252.g48920dab.el9.x86_64 32/34 2024-09-04T16:18:32.625 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-252.g48920dab.el9.x86_64 32/34 2024-09-04T16:18:32.626 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-04T16:18:32.626 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-04T16:18:32.626 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-04T16:18:32.626 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-04T16:18:32.626 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:32.627 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-04T16:18:32.720 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-04T16:18:32.720 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-04T16:18:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-selinux-2:19.1.1-252.g48920dab.el9.x86_64 31/34 2024-09-04T16:18:33.545 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /sys 2024-09-04T16:18:33.545 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /proc 2024-09-04T16:18:33.545 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /mnt 2024-09-04T16:18:33.545 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /var/tmp 2024-09-04T16:18:33.545 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /home 2024-09-04T16:18:33.545 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /root 2024-09-04T16:18:33.546 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /tmp 2024-09-04T16:18:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:33.807 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-04T16:18:33.808 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-base-2:19.1.1-252.g48920dab.el9.x86_64 1/34 2024-09-04T16:18:33.808 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-common-2:19.1.1-252.g48920dab.el9.x86_64 2/34 2024-09-04T16:18:33.808 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-radosgw-2:19.1.1-252.g48920dab.el9.x86_64 3/34 2024-09-04T16:18:33.808 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-selinux-2:19.1.1-252.g48920dab.el9.x86_64 4/34 2024-09-04T16:18:33.808 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephfs2-2:19.1.1-252.g48920dab.el9.x86_64 5/34 2024-09-04T16:18:33.808 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libradosstriper1-2:19.1.1-252.g48920dab.el9.x86_64 6/34 2024-09-04T16:18:33.808 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librgw2-2:19.1.1-252.g48920dab.el9.x86_64 7/34 2024-09-04T16:18:33.808 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ceph-argparse-2:19.1.1-252.g48920dab.el9.x 8/34 2024-09-04T16:18:33.808 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ceph-common-2:19.1.1-252.g48920dab.el9.x86 9/34 2024-09-04T16:18:33.808 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cephfs-2:19.1.1-252.g48920dab.el9.x86_64 10/34 2024-09-04T16:18:33.808 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rados-2:19.1.1-252.g48920dab.el9.x86_64 11/34 2024-09-04T16:18:33.809 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rbd-2:19.1.1-252.g48920dab.el9.x86_64 12/34 2024-09-04T16:18:33.809 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rgw-2:19.1.1-252.g48920dab.el9.x86_64 13/34 2024-09-04T16:18:33.809 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-04T16:18:33.809 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-04T16:18:33.809 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-04T16:18:33.809 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-04T16:18:33.809 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-04T16:18:33.809 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-04T16:18:33.809 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-04T16:18:33.809 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-04T16:18:33.809 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-04T16:18:33.809 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-09-04T16:18:33.809 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-04T16:18:33.810 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-04T16:18:33.810 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-04T16:18:33.810 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-04T16:18:33.810 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-04T16:18:33.810 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-04T16:18:33.810 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-04T16:18:33.810 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados2-2:19.1.1-252.g48920dab.el9.x86_64 31/34 2024-09-04T16:18:33.811 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-04T16:18:33.811 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librbd1-2:19.1.1-252.g48920dab.el9.x86_64 33/34 2024-09-04T16:18:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-radosgw-2:19.1.1-252.g48920dab.el9.x86_64 32/34 2024-09-04T16:18:34.552 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-252.g48920dab.el9.x86_64 32/34 2024-09-04T16:18:34.552 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-04T16:18:34.552 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-04T16:18:34.553 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-04T16:18:34.553 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-04T16:18:34.553 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:34.554 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-04T16:18:34.642 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-04T16:18:34.642 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-04T16:18:34.740 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-04T16:18:34.740 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:34.740 INFO:teuthology.orchestra.run.smithi193.stdout:Upgraded: 2024-09-04T16:18:34.740 INFO:teuthology.orchestra.run.smithi193.stdout: librados2-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:34.741 INFO:teuthology.orchestra.run.smithi193.stdout: librbd1-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:34.741 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-04T16:18:34.741 INFO:teuthology.orchestra.run.smithi193.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-04T16:18:34.741 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:34.741 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-common-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:34.741 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-radosgw-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:34.741 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-selinux-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:34.741 INFO:teuthology.orchestra.run.smithi193.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-04T16:18:34.741 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-04T16:18:34.741 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-04T16:18:34.742 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs2-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:34.742 INFO:teuthology.orchestra.run.smithi193.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-04T16:18:34.742 INFO:teuthology.orchestra.run.smithi193.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-04T16:18:34.742 INFO:teuthology.orchestra.run.smithi193.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-04T16:18:34.742 INFO:teuthology.orchestra.run.smithi193.stdout: libradosstriper1-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:34.742 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-04T16:18:34.742 INFO:teuthology.orchestra.run.smithi193.stdout: librgw2-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:34.742 INFO:teuthology.orchestra.run.smithi193.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-04T16:18:34.742 INFO:teuthology.orchestra.run.smithi193.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-04T16:18:34.742 INFO:teuthology.orchestra.run.smithi193.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-04T16:18:34.742 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:34.743 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:34.743 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cephfs-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:34.743 INFO:teuthology.orchestra.run.smithi193.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-04T16:18:34.743 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rados-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:34.743 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rbd-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:34.743 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rgw-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:34.743 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-04T16:18:34.743 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-04T16:18:34.743 INFO:teuthology.orchestra.run.smithi193.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-04T16:18:34.743 INFO:teuthology.orchestra.run.smithi193.stdout: re2-1:20211101-20.el9.x86_64 2024-09-04T16:18:34.743 INFO:teuthology.orchestra.run.smithi193.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-04T16:18:34.743 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:34.744 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:18:35.072 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph-test 2024-09-04T16:18:35.619 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:00:27 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:18:35.750 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:18:35.751 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:18:35.751 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repository Size 2024-09-04T16:18:35.751 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:18:35.751 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-04T16:18:35.751 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-test x86_64 2:19.1.1-252.g48920dab.el9 ceph 49 M 2024-09-04T16:18:35.751 INFO:teuthology.orchestra.run.smithi193.stdout:Installing dependencies: 2024-09-04T16:18:35.751 INFO:teuthology.orchestra.run.smithi193.stdout: libcephsqlite x86_64 2:19.1.1-252.g48920dab.el9 ceph 164 k 2024-09-04T16:18:35.751 INFO:teuthology.orchestra.run.smithi193.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-04T16:18:35.751 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-04T16:18:35.751 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:35.751 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:18:35.752 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:18:35.752 INFO:teuthology.orchestra.run.smithi193.stdout:Install 4 Packages 2024-09-04T16:18:35.752 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:35.752 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 49 M 2024-09-04T16:18:35.752 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 209 M 2024-09-04T16:18:35.752 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-04T16:18:35.893 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-04T16:18:35.893 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-base-2:19.1.1-252.g48920dab.el9.x86_64 1/34 2024-09-04T16:18:35.893 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-common-2:19.1.1-252.g48920dab.el9.x86_64 2/34 2024-09-04T16:18:35.893 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-radosgw-2:19.1.1-252.g48920dab.el9.x86_64 3/34 2024-09-04T16:18:35.894 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-selinux-2:19.1.1-252.g48920dab.el9.x86_64 4/34 2024-09-04T16:18:35.894 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs2-2:19.1.1-252.g48920dab.el9.x86_64 5/34 2024-09-04T16:18:35.894 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libradosstriper1-2:19.1.1-252.g48920dab.el9.x86_64 6/34 2024-09-04T16:18:35.894 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librgw2-2:19.1.1-252.g48920dab.el9.x86_64 7/34 2024-09-04T16:18:35.894 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-argparse-2:19.1.1-252.g48920dab.el9.x 8/34 2024-09-04T16:18:35.894 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-common-2:19.1.1-252.g48920dab.el9.x86 9/34 2024-09-04T16:18:35.894 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cephfs-2:19.1.1-252.g48920dab.el9.x86_64 10/34 2024-09-04T16:18:35.894 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rados-2:19.1.1-252.g48920dab.el9.x86_64 11/34 2024-09-04T16:18:35.894 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rbd-2:19.1.1-252.g48920dab.el9.x86_64 12/34 2024-09-04T16:18:35.894 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rgw-2:19.1.1-252.g48920dab.el9.x86_64 13/34 2024-09-04T16:18:35.894 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-04T16:18:35.894 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-04T16:18:35.894 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-04T16:18:35.895 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-04T16:18:35.895 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-04T16:18:35.895 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-04T16:18:35.895 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-04T16:18:35.895 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-04T16:18:35.895 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-04T16:18:35.895 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-09-04T16:18:35.895 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-04T16:18:35.895 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-04T16:18:35.895 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-04T16:18:35.895 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-04T16:18:35.895 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-04T16:18:35.895 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-04T16:18:35.896 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-04T16:18:35.896 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:19.1.1-252.g48920dab.el9.x86_64 31/34 2024-09-04T16:18:35.896 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-04T16:18:35.896 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:19.1.1-252.g48920dab.el9.x86_64 33/34 2024-09-04T16:18:35.976 INFO:teuthology.orchestra.run.smithi193.stdout:(1/4): libcephsqlite-19.1.1-252.g48920dab.el9.x 812 kB/s | 164 kB 00:00 2024-09-04T16:18:36.005 INFO:teuthology.orchestra.run.smithi193.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-04T16:18:36.138 INFO:teuthology.orchestra.run.smithi193.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 392 kB/s | 64 kB 00:00 2024-09-04T16:18:36.854 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-04T16:18:36.854 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:36.854 INFO:teuthology.orchestra.run.smithi170.stdout:Upgraded: 2024-09-04T16:18:36.854 INFO:teuthology.orchestra.run.smithi170.stdout: librados2-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:36.854 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:36.854 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-04T16:18:36.854 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-04T16:18:36.854 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:36.855 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:36.855 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:36.855 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:36.855 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-04T16:18:36.855 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-04T16:18:36.855 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-04T16:18:36.855 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:36.855 INFO:teuthology.orchestra.run.smithi170.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-04T16:18:36.855 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-04T16:18:36.855 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-04T16:18:36.856 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:36.856 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-04T16:18:36.856 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:36.856 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-04T16:18:36.856 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-04T16:18:36.856 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-04T16:18:36.856 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:36.856 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:36.856 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:36.856 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-04T16:18:36.856 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:36.856 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:36.856 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:36.857 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-04T16:18:36.857 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-04T16:18:36.857 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-04T16:18:36.857 INFO:teuthology.orchestra.run.smithi170.stdout: re2-1:20211101-20.el9.x86_64 2024-09-04T16:18:36.857 INFO:teuthology.orchestra.run.smithi170.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-04T16:18:36.857 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:36.857 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:18:37.200 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-test 2024-09-04T16:18:37.314 INFO:teuthology.orchestra.run.smithi193.stdout:(4/4): ceph-test-19.1.1-252.g48920dab.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-04T16:18:37.316 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:18:37.316 INFO:teuthology.orchestra.run.smithi193.stdout:Total 31 MB/s | 49 MB 00:01 2024-09-04T16:18:37.343 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-04T16:18:37.363 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-04T16:18:37.364 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-04T16:18:37.734 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-04T16:18:37.734 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-04T16:18:37.751 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:27 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:18:37.882 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:18:37.883 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:18:37.883 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-04T16:18:37.883 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:18:37.883 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-04T16:18:37.883 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test x86_64 2:19.1.1-252.g48920dab.el9 ceph 49 M 2024-09-04T16:18:37.883 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-04T16:18:37.883 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite x86_64 2:19.1.1-252.g48920dab.el9 ceph 164 k 2024-09-04T16:18:37.883 INFO:teuthology.orchestra.run.smithi170.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-04T16:18:37.883 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-04T16:18:37.883 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:37.884 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:18:37.884 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:18:37.884 INFO:teuthology.orchestra.run.smithi170.stdout:Install 4 Packages 2024-09-04T16:18:37.884 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:37.884 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 49 M 2024-09-04T16:18:37.884 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 209 M 2024-09-04T16:18:37.884 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-04T16:18:38.177 INFO:teuthology.orchestra.run.smithi170.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-04T16:18:38.227 INFO:teuthology.orchestra.run.smithi170.stdout:(2/4): libcephsqlite-19.1.1-252.g48920dab.el9.x 679 kB/s | 164 kB 00:00 2024-09-04T16:18:38.251 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-04T16:18:38.252 INFO:teuthology.orchestra.run.smithi170.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 849 kB/s | 64 kB 00:00 2024-09-04T16:18:38.339 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-04T16:18:38.379 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-04T16:18:38.407 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephsqlite-2:19.1.1-252.g48920dab.el9.x86_64 3/4 2024-09-04T16:18:39.486 INFO:teuthology.orchestra.run.smithi170.stdout:(4/4): ceph-test-19.1.1-252.g48920dab.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-04T16:18:39.488 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:18:39.488 INFO:teuthology.orchestra.run.smithi170.stdout:Total 31 MB/s | 49 MB 00:01 2024-09-04T16:18:39.515 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-04T16:18:39.534 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-04T16:18:39.534 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-04T16:18:39.902 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-04T16:18:39.902 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-04T16:18:40.429 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-04T16:18:40.511 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-04T16:18:40.551 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-04T16:18:40.580 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephsqlite-2:19.1.1-252.g48920dab.el9.x86_64 3/4 2024-09-04T16:18:42.965 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libcephsqlite-2:19.1.1-252.g48920dab.el9.x86_64 3/4 2024-09-04T16:18:43.046 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-test-2:19.1.1-252.g48920dab.el9.x86_64 4/4 2024-09-04T16:18:45.117 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephsqlite-2:19.1.1-252.g48920dab.el9.x86_64 3/4 2024-09-04T16:18:45.184 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-test-2:19.1.1-252.g48920dab.el9.x86_64 4/4 2024-09-04T16:18:45.372 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-test-2:19.1.1-252.g48920dab.el9.x86_64 4/4 2024-09-04T16:18:45.372 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-test-2:19.1.1-252.g48920dab.el9.x86_64 1/4 2024-09-04T16:18:45.372 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephsqlite-2:19.1.1-252.g48920dab.el9.x86_64 2/4 2024-09-04T16:18:45.372 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-04T16:18:45.668 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-04T16:18:45.668 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:45.668 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-04T16:18:45.668 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-test-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:45.668 INFO:teuthology.orchestra.run.smithi193.stdout: libcephsqlite-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:45.668 INFO:teuthology.orchestra.run.smithi193.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-04T16:18:45.668 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-04T16:18:45.669 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:45.669 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:18:45.936 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph 2024-09-04T16:18:46.515 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:00:38 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:18:46.660 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:18:46.662 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:18:46.662 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repository Size 2024-09-04T16:18:46.662 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:18:46.662 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-04T16:18:46.663 INFO:teuthology.orchestra.run.smithi193.stdout: ceph x86_64 2:19.1.1-252.g48920dab.el9 ceph 6.6 k 2024-09-04T16:18:46.663 INFO:teuthology.orchestra.run.smithi193.stdout:Installing dependencies: 2024-09-04T16:18:46.663 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mds x86_64 2:19.1.1-252.g48920dab.el9 ceph 2.4 M 2024-09-04T16:18:46.663 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr x86_64 2:19.1.1-252.g48920dab.el9 ceph 1.5 M 2024-09-04T16:18:46.663 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core noarch 2:19.1.1-252.g48920dab.el9 ceph-noarch 249 k 2024-09-04T16:18:46.663 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mon x86_64 2:19.1.1-252.g48920dab.el9 ceph 4.7 M 2024-09-04T16:18:46.663 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-osd x86_64 2:19.1.1-252.g48920dab.el9 ceph 17 M 2024-09-04T16:18:46.663 INFO:teuthology.orchestra.run.smithi193.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-04T16:18:46.663 INFO:teuthology.orchestra.run.smithi193.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-04T16:18:46.663 INFO:teuthology.orchestra.run.smithi193.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-04T16:18:46.663 INFO:teuthology.orchestra.run.smithi193.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-04T16:18:46.663 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-04T16:18:46.664 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-04T16:18:46.664 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-04T16:18:46.664 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-04T16:18:46.664 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-04T16:18:46.664 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-04T16:18:46.664 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-04T16:18:46.664 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-04T16:18:46.664 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-04T16:18:46.664 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-04T16:18:46.664 INFO:teuthology.orchestra.run.smithi193.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-04T16:18:46.664 INFO:teuthology.orchestra.run.smithi193.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-04T16:18:46.664 INFO:teuthology.orchestra.run.smithi193.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-04T16:18:46.664 INFO:teuthology.orchestra.run.smithi193.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-04T16:18:46.665 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-04T16:18:46.665 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-04T16:18:46.665 INFO:teuthology.orchestra.run.smithi193.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-04T16:18:46.665 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-04T16:18:46.665 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-04T16:18:46.665 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-04T16:18:46.665 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-04T16:18:46.665 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-04T16:18:46.666 INFO:teuthology.orchestra.run.smithi193.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-04T16:18:46.666 INFO:teuthology.orchestra.run.smithi193.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-04T16:18:46.666 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-04T16:18:46.666 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-04T16:18:46.666 INFO:teuthology.orchestra.run.smithi193.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-04T16:18:46.666 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:46.666 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:18:46.666 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:18:46.666 INFO:teuthology.orchestra.run.smithi193.stdout:Install 37 Packages 2024-09-04T16:18:46.666 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:46.667 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 30 M 2024-09-04T16:18:46.667 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 108 M 2024-09-04T16:18:46.667 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-04T16:18:47.670 INFO:teuthology.orchestra.run.smithi193.stdout:(1/37): ceph-19.1.1-252.g48920dab.el9.x86_64.rp 44 kB/s | 6.6 kB 00:00 2024-09-04T16:18:47.682 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-test-2:19.1.1-252.g48920dab.el9.x86_64 4/4 2024-09-04T16:18:47.682 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-test-2:19.1.1-252.g48920dab.el9.x86_64 1/4 2024-09-04T16:18:47.682 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephsqlite-2:19.1.1-252.g48920dab.el9.x86_64 2/4 2024-09-04T16:18:47.682 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-04T16:18:47.838 INFO:teuthology.orchestra.run.smithi193.stdout:(2/37): ceph-mgr-19.1.1-252.g48920dab.el9.x86_6 4.8 MB/s | 1.5 MB 00:00 2024-09-04T16:18:47.896 INFO:teuthology.orchestra.run.smithi193.stdout:(3/37): ceph-mds-19.1.1-252.g48920dab.el9.x86_6 6.3 MB/s | 2.4 MB 00:00 2024-09-04T16:18:47.980 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-04T16:18:47.980 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:47.981 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-04T16:18:47.981 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:47.981 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:47.981 INFO:teuthology.orchestra.run.smithi170.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-04T16:18:47.981 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-04T16:18:47.981 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:47.981 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:18:47.988 INFO:teuthology.orchestra.run.smithi193.stdout:(4/37): ceph-mgr-modules-core-19.1.1-252.g48920 2.7 MB/s | 249 kB 00:00 2024-09-04T16:18:48.055 INFO:teuthology.orchestra.run.smithi193.stdout:(5/37): ceph-mon-19.1.1-252.g48920dab.el9.x86_6 12 MB/s | 4.7 MB 00:00 2024-09-04T16:18:48.255 INFO:teuthology.orchestra.run.smithi193.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 949 kB/s | 253 kB 00:00 2024-09-04T16:18:48.299 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph 2024-09-04T16:18:48.414 INFO:teuthology.orchestra.run.smithi193.stdout:(7/37): ceph-osd-19.1.1-252.g48920dab.el9.x86_6 29 MB/s | 17 MB 00:00 2024-09-04T16:18:48.439 INFO:teuthology.orchestra.run.smithi193.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 580 kB/s | 106 kB 00:00 2024-09-04T16:18:48.498 INFO:teuthology.orchestra.run.smithi193.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-09-04T16:18:48.531 INFO:teuthology.orchestra.run.smithi193.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.6 MB/s | 1.2 MB 00:00 2024-09-04T16:18:48.557 INFO:teuthology.orchestra.run.smithi193.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-04T16:18:48.590 INFO:teuthology.orchestra.run.smithi193.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 769 kB/s | 135 kB 00:00 2024-09-04T16:18:48.699 INFO:teuthology.orchestra.run.smithi193.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 320 kB/s | 35 kB 00:00 2024-09-04T16:18:48.724 INFO:teuthology.orchestra.run.smithi193.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 979 kB/s | 188 kB 00:00 2024-09-04T16:18:48.749 INFO:teuthology.orchestra.run.smithi193.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 894 kB/s | 172 kB 00:00 2024-09-04T16:18:48.766 INFO:teuthology.orchestra.run.smithi193.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-04T16:18:48.792 INFO:teuthology.orchestra.run.smithi193.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 834 kB/s | 77 kB 00:00 2024-09-04T16:18:48.808 INFO:teuthology.orchestra.run.smithi193.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 707 kB/s | 42 kB 00:00 2024-09-04T16:18:48.851 INFO:teuthology.orchestra.run.smithi193.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-04T16:18:48.862 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:38 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:18:48.876 INFO:teuthology.orchestra.run.smithi193.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 7.2 MB/s | 172 kB 00:00 2024-09-04T16:18:48.893 INFO:teuthology.orchestra.run.smithi193.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 177 kB/s | 22 kB 00:00 2024-09-04T16:18:48.918 INFO:teuthology.orchestra.run.smithi193.stdout:(22/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 397 kB/s | 43 kB 00:00 2024-09-04T16:18:48.944 INFO:teuthology.orchestra.run.smithi193.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 212 kB/s | 11 kB 00:00 2024-09-04T16:18:48.977 INFO:teuthology.orchestra.run.smithi193.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 889 kB/s | 23 kB 00:00 2024-09-04T16:18:49.002 INFO:teuthology.orchestra.run.smithi193.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 839 kB/s | 19 kB 00:00 2024-09-04T16:18:49.004 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:18:49.007 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:18:49.007 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-04T16:18:49.007 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:18:49.007 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-04T16:18:49.007 INFO:teuthology.orchestra.run.smithi170.stdout: ceph x86_64 2:19.1.1-252.g48920dab.el9 ceph 6.6 k 2024-09-04T16:18:49.007 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-04T16:18:49.008 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds x86_64 2:19.1.1-252.g48920dab.el9 ceph 2.4 M 2024-09-04T16:18:49.008 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr x86_64 2:19.1.1-252.g48920dab.el9 ceph 1.5 M 2024-09-04T16:18:49.008 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core noarch 2:19.1.1-252.g48920dab.el9 ceph-noarch 249 k 2024-09-04T16:18:49.008 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon x86_64 2:19.1.1-252.g48920dab.el9 ceph 4.7 M 2024-09-04T16:18:49.008 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd x86_64 2:19.1.1-252.g48920dab.el9 ceph 17 M 2024-09-04T16:18:49.008 INFO:teuthology.orchestra.run.smithi170.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-04T16:18:49.008 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-04T16:18:49.008 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-04T16:18:49.008 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-04T16:18:49.008 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-04T16:18:49.008 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-04T16:18:49.008 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-04T16:18:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-04T16:18:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-04T16:18:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-04T16:18:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-04T16:18:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-04T16:18:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-04T16:18:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-04T16:18:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-04T16:18:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-04T16:18:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-04T16:18:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-04T16:18:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-04T16:18:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-04T16:18:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-04T16:18:49.010 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-04T16:18:49.010 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-04T16:18:49.010 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-04T16:18:49.010 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-04T16:18:49.010 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-04T16:18:49.010 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-04T16:18:49.010 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-04T16:18:49.010 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-04T16:18:49.010 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-04T16:18:49.010 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-04T16:18:49.010 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:49.010 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:18:49.010 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:18:49.010 INFO:teuthology.orchestra.run.smithi170.stdout:Install 37 Packages 2024-09-04T16:18:49.011 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:49.011 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 30 M 2024-09-04T16:18:49.011 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 108 M 2024-09-04T16:18:49.011 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-04T16:18:49.028 INFO:teuthology.orchestra.run.smithi193.stdout:(26/37): python3-jaraco-classes-3.2.1-5.el9.noa 162 kB/s | 18 kB 00:00 2024-09-04T16:18:49.053 INFO:teuthology.orchestra.run.smithi193.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-04T16:18:49.078 INFO:teuthology.orchestra.run.smithi193.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-09-04T16:18:49.104 INFO:teuthology.orchestra.run.smithi193.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-09-04T16:18:49.129 INFO:teuthology.orchestra.run.smithi193.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-04T16:18:49.154 INFO:teuthology.orchestra.run.smithi193.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 325 kB/s | 16 kB 00:00 2024-09-04T16:18:49.180 INFO:teuthology.orchestra.run.smithi193.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-04T16:18:49.205 INFO:teuthology.orchestra.run.smithi193.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-04T16:18:49.230 INFO:teuthology.orchestra.run.smithi193.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-04T16:18:49.256 INFO:teuthology.orchestra.run.smithi193.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-04T16:18:49.281 INFO:teuthology.orchestra.run.smithi193.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 396 kB/s | 20 kB 00:00 2024-09-04T16:18:49.306 INFO:teuthology.orchestra.run.smithi193.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-04T16:18:49.309 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:18:49.309 INFO:teuthology.orchestra.run.smithi193.stdout:Total 11 MB/s | 30 MB 00:02 2024-09-04T16:18:49.456 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-04T16:18:49.496 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-04T16:18:49.496 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-04T16:18:49.516 INFO:teuthology.orchestra.run.smithi170.stdout:(1/37): ceph-19.1.1-252.g48920dab.el9.x86_64.rp 58 kB/s | 6.6 kB 00:00 2024-09-04T16:18:49.717 INFO:teuthology.orchestra.run.smithi170.stdout:(2/37): ceph-mgr-19.1.1-252.g48920dab.el9.x86_6 4.9 MB/s | 1.5 MB 00:00 2024-09-04T16:18:49.767 INFO:teuthology.orchestra.run.smithi170.stdout:(3/37): ceph-mds-19.1.1-252.g48920dab.el9.x86_6 6.6 MB/s | 2.4 MB 00:00 2024-09-04T16:18:49.793 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-04T16:18:49.794 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-04T16:18:49.834 INFO:teuthology.orchestra.run.smithi170.stdout:(4/37): ceph-mgr-modules-core-19.1.1-252.g48920 3.7 MB/s | 249 kB 00:00 2024-09-04T16:18:50.042 INFO:teuthology.orchestra.run.smithi170.stdout:(5/37): ceph-mon-19.1.1-252.g48920dab.el9.x86_6 8.9 MB/s | 4.7 MB 00:00 2024-09-04T16:18:50.076 INFO:teuthology.orchestra.run.smithi170.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-04T16:18:50.135 INFO:teuthology.orchestra.run.smithi170.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-04T16:18:50.193 INFO:teuthology.orchestra.run.smithi170.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-09-04T16:18:50.369 INFO:teuthology.orchestra.run.smithi170.stdout:(9/37): ceph-osd-19.1.1-252.g48920dab.el9.x86_6 26 MB/s | 17 MB 00:00 2024-09-04T16:18:50.403 INFO:teuthology.orchestra.run.smithi170.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 598 kB/s | 125 kB 00:00 2024-09-04T16:18:50.461 INFO:teuthology.orchestra.run.smithi170.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-04T16:18:50.495 INFO:teuthology.orchestra.run.smithi170.stdout:(12/37): python3-cryptography-36.0.1-4.el9.x86_ 2.7 MB/s | 1.2 MB 00:00 2024-09-04T16:18:50.528 INFO:teuthology.orchestra.run.smithi170.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-04T16:18:50.554 INFO:teuthology.orchestra.run.smithi170.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 593 kB/s | 35 kB 00:00 2024-09-04T16:18:50.579 INFO:teuthology.orchestra.run.smithi170.stdout:(15/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.0 MB/s | 215 kB 00:00 2024-09-04T16:18:50.613 INFO:teuthology.orchestra.run.smithi170.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 920 kB/s | 77 kB 00:00 2024-09-04T16:18:50.638 INFO:teuthology.orchestra.run.smithi170.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 607 kB/s | 51 kB 00:00 2024-09-04T16:18:50.665 INFO:teuthology.orchestra.run.smithi170.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 497 kB/s | 42 kB 00:00 2024-09-04T16:18:50.713 INFO:teuthology.orchestra.run.smithi170.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-04T16:18:50.755 INFO:teuthology.orchestra.run.smithi170.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 4.2 MB/s | 172 kB 00:00 2024-09-04T16:18:50.780 INFO:teuthology.orchestra.run.smithi170.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 371 kB/s | 43 kB 00:00 2024-09-04T16:18:50.806 INFO:teuthology.orchestra.run.smithi170.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 426 kB/s | 11 kB 00:00 2024-09-04T16:18:50.822 INFO:teuthology.orchestra.run.smithi170.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 1.1 MB/s | 18 kB 00:00 2024-09-04T16:18:50.856 INFO:teuthology.orchestra.run.smithi170.stdout:(24/37): python3-cherrypy-18.6.1-2.el9.noarch.r 3.5 MB/s | 358 kB 00:00 2024-09-04T16:18:50.873 INFO:teuthology.orchestra.run.smithi170.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-04T16:18:50.890 INFO:teuthology.orchestra.run.smithi170.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 580 kB/s | 19 kB 00:00 2024-09-04T16:18:50.907 INFO:teuthology.orchestra.run.smithi170.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 585 kB/s | 20 kB 00:00 2024-09-04T16:18:50.924 INFO:teuthology.orchestra.run.smithi170.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.3 MB/s | 46 kB 00:00 2024-09-04T16:18:50.949 INFO:teuthology.orchestra.run.smithi170.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-09-04T16:18:50.983 INFO:teuthology.orchestra.run.smithi170.stdout:(30/37): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-04T16:18:51.008 INFO:teuthology.orchestra.run.smithi170.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 321 kB/s | 16 kB 00:00 2024-09-04T16:18:51.034 INFO:teuthology.orchestra.run.smithi170.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-04T16:18:51.076 INFO:teuthology.orchestra.run.smithi170.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 531 kB/s | 36 kB 00:00 2024-09-04T16:18:51.109 INFO:teuthology.orchestra.run.smithi170.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-04T16:18:51.134 INFO:teuthology.orchestra.run.smithi170.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 808 kB/s | 20 kB 00:00 2024-09-04T16:18:51.136 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-04T16:18:51.160 INFO:teuthology.orchestra.run.smithi170.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-04T16:18:51.209 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-04T16:18:51.242 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-04T16:18:51.269 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-04T16:18:51.277 INFO:teuthology.orchestra.run.smithi170.stdout:(37/37): lua-devel-5.4.4-4.el9.x86_64.rpm 34 kB/s | 22 kB 00:00 2024-09-04T16:18:51.282 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:18:51.282 INFO:teuthology.orchestra.run.smithi170.stdout:Total 13 MB/s | 30 MB 00:02 2024-09-04T16:18:51.341 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-04T16:18:51.411 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-04T16:18:51.436 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-04T16:18:51.443 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-04T16:18:51.477 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-04T16:18:51.477 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-04T16:18:51.534 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-04T16:18:51.613 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-04T16:18:51.663 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-04T16:18:51.698 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-04T16:18:51.727 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-04T16:18:51.762 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-04T16:18:51.775 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-04T16:18:51.777 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-04T16:18:51.795 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-04T16:18:51.837 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-04T16:18:51.872 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-04T16:18:51.906 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-04T16:18:51.953 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-04T16:18:51.986 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-04T16:18:52.059 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-04T16:18:52.196 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-04T16:18:52.279 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-04T16:18:52.342 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-04T16:18:52.380 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-04T16:18:52.445 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-04T16:18:52.501 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-04T16:18:52.687 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-04T16:18:52.743 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-04T16:18:52.821 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-04T16:18:52.909 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-04T16:18:52.950 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-04T16:18:53.066 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-04T16:18:53.142 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-04T16:18:53.205 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-04T16:18:53.223 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-252.g48920dab.el9.n 32/37 2024-09-04T16:18:53.253 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-2:19.1.1-252.g48920dab.el9.x86_64 33/37 2024-09-04T16:18:53.254 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-04T16:18:53.279 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-2:19.1.1-252.g48920dab.el9.x86_64 33/37 2024-09-04T16:18:53.279 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-04T16:18:53.279 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-04T16:18:53.279 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-04T16:18:53.279 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-04T16:18:53.279 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:53.282 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-04T16:18:53.353 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-04T16:18:53.398 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-04T16:18:53.430 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-04T16:18:53.521 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-04T16:18:53.608 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-04T16:18:53.683 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-04T16:18:53.718 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-04T16:18:53.748 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-04T16:18:53.782 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-04T16:18:53.816 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-04T16:18:53.864 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-04T16:18:53.900 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-04T16:18:53.934 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-04T16:18:53.982 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-04T16:18:54.023 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-04T16:18:54.104 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-04T16:18:54.241 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-04T16:18:54.322 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-04T16:18:54.376 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-04T16:18:54.414 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-04T16:18:54.471 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-04T16:18:54.535 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-04T16:18:54.720 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-osd-2:19.1.1-252.g48920dab.el9.x86_64 34/37 2024-09-04T16:18:54.721 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-04T16:18:54.748 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-osd-2:19.1.1-252.g48920dab.el9.x86_64 34/37 2024-09-04T16:18:54.748 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-04T16:18:54.748 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-04T16:18:54.748 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-04T16:18:54.748 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-04T16:18:54.749 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:54.769 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-04T16:18:54.846 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-04T16:18:54.943 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-04T16:18:54.978 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-04T16:18:55.104 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-04T16:18:55.196 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mon-2:19.1.1-252.g48920dab.el9.x86_64 35/37 2024-09-04T16:18:55.220 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mon-2:19.1.1-252.g48920dab.el9.x86_64 35/37 2024-09-04T16:18:55.220 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-04T16:18:55.220 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-04T16:18:55.220 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-04T16:18:55.220 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-04T16:18:55.221 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:55.266 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-252.g48920dab.el9.n 32/37 2024-09-04T16:18:55.289 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-2:19.1.1-252.g48920dab.el9.x86_64 33/37 2024-09-04T16:18:55.315 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-2:19.1.1-252.g48920dab.el9.x86_64 33/37 2024-09-04T16:18:55.315 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-04T16:18:55.315 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-04T16:18:55.315 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-04T16:18:55.315 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-04T16:18:55.315 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:55.447 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mds-2:19.1.1-252.g48920dab.el9.x86_64 36/37 2024-09-04T16:18:55.470 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mds-2:19.1.1-252.g48920dab.el9.x86_64 36/37 2024-09-04T16:18:55.470 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-04T16:18:55.470 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-04T16:18:55.470 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-04T16:18:55.471 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-04T16:18:55.471 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:55.560 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-2:19.1.1-252.g48920dab.el9.x86_64 37/37 2024-09-04T16:18:56.756 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-osd-2:19.1.1-252.g48920dab.el9.x86_64 34/37 2024-09-04T16:18:56.784 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-osd-2:19.1.1-252.g48920dab.el9.x86_64 34/37 2024-09-04T16:18:56.784 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-04T16:18:56.784 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-04T16:18:56.784 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-04T16:18:56.784 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-04T16:18:56.784 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:57.224 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mon-2:19.1.1-252.g48920dab.el9.x86_64 35/37 2024-09-04T16:18:57.247 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mon-2:19.1.1-252.g48920dab.el9.x86_64 35/37 2024-09-04T16:18:57.247 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-04T16:18:57.247 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-04T16:18:57.248 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-04T16:18:57.248 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-04T16:18:57.248 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:57.304 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-2:19.1.1-252.g48920dab.el9.x86_64 37/37 2024-09-04T16:18:57.304 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-2:19.1.1-252.g48920dab.el9.x86_64 1/37 2024-09-04T16:18:57.304 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mds-2:19.1.1-252.g48920dab.el9.x86_64 2/37 2024-09-04T16:18:57.304 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-2:19.1.1-252.g48920dab.el9.x86_64 3/37 2024-09-04T16:18:57.304 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mon-2:19.1.1-252.g48920dab.el9.x86_64 4/37 2024-09-04T16:18:57.304 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-osd-2:19.1.1-252.g48920dab.el9.x86_64 5/37 2024-09-04T16:18:57.305 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-252.g48920dab.el9.n 6/37 2024-09-04T16:18:57.305 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-04T16:18:57.305 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-04T16:18:57.305 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-04T16:18:57.305 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-04T16:18:57.305 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-04T16:18:57.305 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-04T16:18:57.305 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-04T16:18:57.305 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-04T16:18:57.305 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-04T16:18:57.306 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-04T16:18:57.306 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-04T16:18:57.306 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-04T16:18:57.307 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-04T16:18:57.307 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-04T16:18:57.307 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-04T16:18:57.307 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-04T16:18:57.307 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-04T16:18:57.307 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-04T16:18:57.307 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-04T16:18:57.307 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-04T16:18:57.307 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-04T16:18:57.308 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-04T16:18:57.308 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-04T16:18:57.309 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-04T16:18:57.309 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-04T16:18:57.309 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-04T16:18:57.309 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-04T16:18:57.309 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-04T16:18:57.309 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-04T16:18:57.309 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-04T16:18:57.482 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mds-2:19.1.1-252.g48920dab.el9.x86_64 36/37 2024-09-04T16:18:57.507 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mds-2:19.1.1-252.g48920dab.el9.x86_64 36/37 2024-09-04T16:18:57.507 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-04T16:18:57.507 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-04T16:18:57.507 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-04T16:18:57.507 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-04T16:18:57.508 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:18:57.579 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-2:19.1.1-252.g48920dab.el9.x86_64 37/37 2024-09-04T16:18:58.209 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-04T16:18:58.209 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:58.209 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-04T16:18:58.209 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:58.210 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mds-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:58.210 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:58.210 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core-2:19.1.1-252.g48920dab.el9.noarch 2024-09-04T16:18:58.210 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mon-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:58.210 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-osd-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:18:58.210 INFO:teuthology.orchestra.run.smithi193.stdout: lua-5.4.4-4.el9.x86_64 2024-09-04T16:18:58.210 INFO:teuthology.orchestra.run.smithi193.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-04T16:18:58.210 INFO:teuthology.orchestra.run.smithi193.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-04T16:18:58.210 INFO:teuthology.orchestra.run.smithi193.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-04T16:18:58.210 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-04T16:18:58.210 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-04T16:18:58.210 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-04T16:18:58.210 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-04T16:18:58.210 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-04T16:18:58.211 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-04T16:18:58.211 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-04T16:18:58.211 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-04T16:18:58.211 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-04T16:18:58.211 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-04T16:18:58.211 INFO:teuthology.orchestra.run.smithi193.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-04T16:18:58.211 INFO:teuthology.orchestra.run.smithi193.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-04T16:18:58.211 INFO:teuthology.orchestra.run.smithi193.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-04T16:18:58.211 INFO:teuthology.orchestra.run.smithi193.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-04T16:18:58.211 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-04T16:18:58.211 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ply-3.11-14.el9.noarch 2024-09-04T16:18:58.211 INFO:teuthology.orchestra.run.smithi193.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-04T16:18:58.211 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-04T16:18:58.211 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-04T16:18:58.212 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-04T16:18:58.212 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-04T16:18:58.212 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-04T16:18:58.212 INFO:teuthology.orchestra.run.smithi193.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-04T16:18:58.212 INFO:teuthology.orchestra.run.smithi193.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-04T16:18:58.212 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-04T16:18:58.212 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-04T16:18:58.212 INFO:teuthology.orchestra.run.smithi193.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-04T16:18:58.212 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:18:58.212 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:18:58.599 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph-base 2024-09-04T16:18:59.154 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:00:51 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:18:59.244 INFO:teuthology.orchestra.run.smithi193.stdout:Package ceph-base-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:18:59.286 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:18:59.287 INFO:teuthology.orchestra.run.smithi193.stdout:Nothing to do. 2024-09-04T16:18:59.287 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:18:59.354 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install cephadm 2024-09-04T16:18:59.407 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-2:19.1.1-252.g48920dab.el9.x86_64 37/37 2024-09-04T16:18:59.408 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-2:19.1.1-252.g48920dab.el9.x86_64 1/37 2024-09-04T16:18:59.408 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mds-2:19.1.1-252.g48920dab.el9.x86_64 2/37 2024-09-04T16:18:59.408 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-2:19.1.1-252.g48920dab.el9.x86_64 3/37 2024-09-04T16:18:59.408 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mon-2:19.1.1-252.g48920dab.el9.x86_64 4/37 2024-09-04T16:18:59.408 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-osd-2:19.1.1-252.g48920dab.el9.x86_64 5/37 2024-09-04T16:18:59.408 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-252.g48920dab.el9.n 6/37 2024-09-04T16:18:59.408 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-04T16:18:59.408 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-04T16:18:59.408 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-04T16:18:59.408 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-04T16:18:59.408 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-04T16:18:59.408 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-04T16:18:59.409 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-04T16:18:59.409 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-04T16:18:59.409 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-04T16:18:59.409 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-04T16:18:59.409 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-04T16:18:59.409 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-04T16:18:59.409 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-04T16:18:59.409 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-04T16:18:59.409 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-04T16:18:59.409 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-04T16:18:59.409 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-04T16:18:59.409 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-04T16:18:59.409 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-04T16:18:59.410 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-04T16:18:59.410 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-04T16:18:59.410 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-04T16:18:59.411 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-04T16:18:59.411 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-04T16:18:59.411 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-04T16:18:59.411 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-04T16:18:59.411 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-04T16:18:59.411 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-04T16:18:59.411 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-04T16:18:59.411 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-04T16:18:59.907 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:00:51 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:00.039 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:00.039 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:00.040 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repository Size 2024-09-04T16:19:00.040 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:00.040 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-04T16:19:00.040 INFO:teuthology.orchestra.run.smithi193.stdout: cephadm noarch 2:19.1.1-252.g48920dab.el9 ceph-noarch 766 k 2024-09-04T16:19:00.040 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:00.040 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:19:00.040 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:00.040 INFO:teuthology.orchestra.run.smithi193.stdout:Install 1 Package 2024-09-04T16:19:00.040 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:00.040 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 766 k 2024-09-04T16:19:00.040 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 771 k 2024-09-04T16:19:00.040 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-04T16:19:00.260 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-04T16:19:00.261 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:00.261 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-04T16:19:00.261 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:19:00.261 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:19:00.261 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:19:00.261 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core-2:19.1.1-252.g48920dab.el9.noarch 2024-09-04T16:19:00.261 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:19:00.261 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:19:00.261 INFO:teuthology.orchestra.run.smithi170.stdout: lua-5.4.4-4.el9.x86_64 2024-09-04T16:19:00.261 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-04T16:19:00.261 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-04T16:19:00.261 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-04T16:19:00.261 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-04T16:19:00.262 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-04T16:19:00.262 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-04T16:19:00.262 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-04T16:19:00.262 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-04T16:19:00.262 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-04T16:19:00.262 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-04T16:19:00.262 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-04T16:19:00.262 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-04T16:19:00.262 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-04T16:19:00.262 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-04T16:19:00.262 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-04T16:19:00.262 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-04T16:19:00.262 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-04T16:19:00.262 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-04T16:19:00.262 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply-3.11-14.el9.noarch 2024-09-04T16:19:00.263 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-04T16:19:00.263 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-04T16:19:00.263 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-04T16:19:00.263 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-04T16:19:00.263 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-04T16:19:00.263 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-04T16:19:00.263 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-04T16:19:00.263 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-04T16:19:00.263 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-04T16:19:00.263 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-04T16:19:00.263 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-04T16:19:00.263 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:00.263 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:00.330 INFO:teuthology.orchestra.run.smithi193.stdout:cephadm-19.1.1-252.g48920dab.el9.noarch.rpm 2.6 MB/s | 766 kB 00:00 2024-09-04T16:19:00.331 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:00.331 INFO:teuthology.orchestra.run.smithi193.stdout:Total 2.6 MB/s | 766 kB 00:00 2024-09-04T16:19:00.331 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-04T16:19:00.336 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-04T16:19:00.336 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-04T16:19:00.342 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-04T16:19:00.342 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-04T16:19:00.416 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-04T16:19:00.642 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-base 2024-09-04T16:19:00.900 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: cephadm-2:19.1.1-252.g48920dab.el9.noarch 1/1 2024-09-04T16:19:00.983 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephadm-2:19.1.1-252.g48920dab.el9.noarch 1/1 2024-09-04T16:19:01.206 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:51 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:01.295 INFO:teuthology.orchestra.run.smithi170.stdout:Package ceph-base-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:01.336 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:01.337 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-04T16:19:01.337 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:01.338 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: cephadm-2:19.1.1-252.g48920dab.el9.noarch 1/1 2024-09-04T16:19:01.403 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install cephadm 2024-09-04T16:19:01.574 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephadm-2:19.1.1-252.g48920dab.el9.noarch 1/1 2024-09-04T16:19:01.574 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:01.574 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-04T16:19:01.574 INFO:teuthology.orchestra.run.smithi193.stdout: cephadm-2:19.1.1-252.g48920dab.el9.noarch 2024-09-04T16:19:01.574 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:01.575 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:01.780 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph-immutable-object-cache 2024-09-04T16:19:01.949 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:51 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:02.079 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:02.080 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:02.080 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-04T16:19:02.080 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:02.080 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-04T16:19:02.080 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm noarch 2:19.1.1-252.g48920dab.el9 ceph-noarch 766 k 2024-09-04T16:19:02.080 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:02.080 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:19:02.080 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:02.080 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-04T16:19:02.080 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:02.080 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 766 k 2024-09-04T16:19:02.081 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 771 k 2024-09-04T16:19:02.081 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-04T16:19:02.345 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:00:54 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:02.357 INFO:teuthology.orchestra.run.smithi170.stdout:cephadm-19.1.1-252.g48920dab.el9.noarch.rpm 2.7 MB/s | 766 kB 00:00 2024-09-04T16:19:02.358 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:02.358 INFO:teuthology.orchestra.run.smithi170.stdout:Total 2.7 MB/s | 766 kB 00:00 2024-09-04T16:19:02.358 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-04T16:19:02.364 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-04T16:19:02.364 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-04T16:19:02.369 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-04T16:19:02.370 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-04T16:19:02.442 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-04T16:19:02.479 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:02.480 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:02.480 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repo Size 2024-09-04T16:19:02.480 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:02.480 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-04T16:19:02.480 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-252.g48920dab.el9 ceph 145 k 2024-09-04T16:19:02.480 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:02.480 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:19:02.481 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:02.481 INFO:teuthology.orchestra.run.smithi193.stdout:Install 1 Package 2024-09-04T16:19:02.481 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:02.481 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 145 k 2024-09-04T16:19:02.481 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 435 k 2024-09-04T16:19:02.481 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-04T16:19:02.696 INFO:teuthology.orchestra.run.smithi193.stdout:ceph-immutable-object-cache-19.1.1-252.g48920da 676 kB/s | 145 kB 00:00 2024-09-04T16:19:02.696 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:02.697 INFO:teuthology.orchestra.run.smithi193.stdout:Total 671 kB/s | 145 kB 00:00 2024-09-04T16:19:02.697 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-04T16:19:02.704 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-04T16:19:02.704 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-04T16:19:02.765 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-04T16:19:02.766 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-04T16:19:02.910 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.1.1-252.g48920dab.el9.noarch 1/1 2024-09-04T16:19:02.921 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-04T16:19:02.988 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-252.g48920dab.e 1/1 2024-09-04T16:19:03.002 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephadm-2:19.1.1-252.g48920dab.el9.noarch 1/1 2024-09-04T16:19:03.014 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-252.g48920dab.e 1/1 2024-09-04T16:19:03.014 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-04T16:19:03.014 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-04T16:19:03.014 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:03.333 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.1.1-252.g48920dab.el9.noarch 1/1 2024-09-04T16:19:03.594 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephadm-2:19.1.1-252.g48920dab.el9.noarch 1/1 2024-09-04T16:19:03.595 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:03.595 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-04T16:19:03.595 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm-2:19.1.1-252.g48920dab.el9.noarch 2024-09-04T16:19:03.595 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:03.595 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:03.838 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-immutable-object-cache 2024-09-04T16:19:03.982 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-252.g48920dab.e 1/1 2024-09-04T16:19:03.982 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:03.982 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-04T16:19:03.982 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-immutable-object-cache-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:19:03.982 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:03.982 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:04.193 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph-mgr 2024-09-04T16:19:04.402 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:54 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:04.536 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:04.536 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:04.536 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-09-04T16:19:04.536 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:04.537 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-04T16:19:04.537 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-252.g48920dab.el9 ceph 145 k 2024-09-04T16:19:04.537 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:04.537 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:19:04.537 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:04.537 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-04T16:19:04.537 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:04.537 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 145 k 2024-09-04T16:19:04.537 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 435 k 2024-09-04T16:19:04.537 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-04T16:19:04.739 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-immutable-object-cache-19.1.1-252.g48920da 719 kB/s | 145 kB 00:00 2024-09-04T16:19:04.740 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:04.740 INFO:teuthology.orchestra.run.smithi170.stdout:Total 713 kB/s | 145 kB 00:00 2024-09-04T16:19:04.741 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-04T16:19:04.748 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-04T16:19:04.748 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-04T16:19:04.752 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:00:56 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:04.810 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-04T16:19:04.810 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-04T16:19:04.846 INFO:teuthology.orchestra.run.smithi193.stdout:Package ceph-mgr-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:04.890 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:04.891 INFO:teuthology.orchestra.run.smithi193.stdout:Nothing to do. 2024-09-04T16:19:04.891 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:04.961 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph-mgr-dashboard 2024-09-04T16:19:04.965 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-04T16:19:05.057 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-252.g48920dab.e 1/1 2024-09-04T16:19:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-252.g48920dab.e 1/1 2024-09-04T16:19:05.083 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-04T16:19:05.083 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-04T16:19:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:05.516 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:00:57 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:05.646 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:05.647 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:05.648 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repository Size 2024-09-04T16:19:05.648 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:05.648 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-04T16:19:05.648 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard noarch 2:19.1.1-252.g48920dab.el9 ceph-noarch 3.6 M 2024-09-04T16:19:05.648 INFO:teuthology.orchestra.run.smithi193.stdout:Installing dependencies: 2024-09-04T16:19:05.648 INFO:teuthology.orchestra.run.smithi193.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-04T16:19:05.648 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-grafana-dashboards noarch 2:19.1.1-252.g48920dab.el9 ceph-noarch 32 k 2024-09-04T16:19:05.648 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-prometheus-alerts noarch 2:19.1.1-252.g48920dab.el9 ceph-noarch 16 k 2024-09-04T16:19:05.648 INFO:teuthology.orchestra.run.smithi193.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-04T16:19:05.648 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-04T16:19:05.648 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-04T16:19:05.649 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-04T16:19:05.649 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-04T16:19:05.649 INFO:teuthology.orchestra.run.smithi193.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-04T16:19:05.649 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-04T16:19:05.649 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-04T16:19:05.649 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:05.649 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:19:05.649 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:05.649 INFO:teuthology.orchestra.run.smithi193.stdout:Install 12 Packages 2024-09-04T16:19:05.649 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:05.650 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 8.7 M 2024-09-04T16:19:05.650 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 104 M 2024-09-04T16:19:05.650 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-04T16:19:06.021 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-252.g48920dab.e 1/1 2024-09-04T16:19:06.021 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:06.021 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-04T16:19:06.021 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:19:06.021 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:06.021 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:06.268 INFO:teuthology.orchestra.run.smithi193.stdout:(1/12): ceph-grafana-dashboards-19.1.1-252.g489 203 kB/s | 32 kB 00:00 2024-09-04T16:19:06.273 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr 2024-09-04T16:19:06.293 INFO:teuthology.orchestra.run.smithi193.stdout:(2/12): ceph-prometheus-alerts-19.1.1-252.g4892 90 kB/s | 16 kB 00:00 2024-09-04T16:19:06.501 INFO:teuthology.orchestra.run.smithi193.stdout:(3/12): ceph-mgr-dashboard-19.1.1-252.g48920dab 9.1 MB/s | 3.6 MB 00:00 2024-09-04T16:19:06.526 INFO:teuthology.orchestra.run.smithi193.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-09-04T16:19:06.585 INFO:teuthology.orchestra.run.smithi193.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-04T16:19:06.602 INFO:teuthology.orchestra.run.smithi193.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-04T16:19:06.644 INFO:teuthology.orchestra.run.smithi193.stdout:(7/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.7 MB/s | 1.0 MB 00:00 2024-09-04T16:19:06.703 INFO:teuthology.orchestra.run.smithi193.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.4 MB/s | 144 kB 00:00 2024-09-04T16:19:06.719 INFO:teuthology.orchestra.run.smithi193.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-09-04T16:19:06.770 INFO:teuthology.orchestra.run.smithi193.stdout:(10/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 12 MB/s | 2.0 MB 00:00 2024-09-04T16:19:06.795 INFO:teuthology.orchestra.run.smithi193.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2024-09-04T16:19:06.837 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:56 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:06.931 INFO:teuthology.orchestra.run.smithi170.stdout:Package ceph-mgr-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:06.975 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:06.976 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-04T16:19:06.976 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:07.041 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-dashboard 2024-09-04T16:19:07.287 INFO:teuthology.orchestra.run.smithi193.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.1 MB/s | 863 kB 00:00 2024-09-04T16:19:07.290 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:07.291 INFO:teuthology.orchestra.run.smithi193.stdout:Total 5.3 MB/s | 8.7 MB 00:01 2024-09-04T16:19:07.338 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-04T16:19:07.355 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-04T16:19:07.355 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-04T16:19:07.513 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-04T16:19:07.514 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-04T16:19:07.590 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:57 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:07.722 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:07.722 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-04T16:19:07.723 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:07.723 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-04T16:19:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard noarch 2:19.1.1-252.g48920dab.el9 ceph-noarch 3.6 M 2024-09-04T16:19:07.723 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-04T16:19:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-04T16:19:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards noarch 2:19.1.1-252.g48920dab.el9 ceph-noarch 32 k 2024-09-04T16:19:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts noarch 2:19.1.1-252.g48920dab.el9 ceph-noarch 16 k 2024-09-04T16:19:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-04T16:19:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-04T16:19:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-04T16:19:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-04T16:19:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-04T16:19:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-04T16:19:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-04T16:19:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-04T16:19:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:07.724 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:19:07.724 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:07.724 INFO:teuthology.orchestra.run.smithi170.stdout:Install 12 Packages 2024-09-04T16:19:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:07.725 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 8.7 M 2024-09-04T16:19:07.725 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 104 M 2024-09-04T16:19:07.725 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-04T16:19:08.044 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-04T16:19:08.121 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-04T16:19:08.156 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-04T16:19:08.202 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-04T16:19:08.211 INFO:teuthology.orchestra.run.smithi170.stdout:(1/12): ceph-prometheus-alerts-19.1.1-252.g4892 109 kB/s | 16 kB 00:00 2024-09-04T16:19:08.227 INFO:teuthology.orchestra.run.smithi170.stdout:(2/12): ceph-grafana-dashboards-19.1.1-252.g489 190 kB/s | 32 kB 00:00 2024-09-04T16:19:08.233 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-04T16:19:08.309 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-04T16:19:08.369 INFO:teuthology.orchestra.run.smithi170.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.9 MB/s | 269 kB 00:00 2024-09-04T16:19:08.433 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-04T16:19:08.436 INFO:teuthology.orchestra.run.smithi170.stdout:(4/12): ceph-mgr-dashboard-19.1.1-252.g48920dab 9.5 MB/s | 3.6 MB 00:00 2024-09-04T16:19:08.478 INFO:teuthology.orchestra.run.smithi170.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.8 MB/s | 1.0 MB 00:00 2024-09-04T16:19:08.519 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-04T16:19:08.529 INFO:teuthology.orchestra.run.smithi170.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 452 kB/s | 19 kB 00:00 2024-09-04T16:19:08.563 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-04T16:19:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.0 MB/s | 548 kB 00:00 2024-09-04T16:19:08.592 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-04T16:19:08.604 INFO:teuthology.orchestra.run.smithi170.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-04T16:19:08.624 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-252.g48920dab.el9. 10/12 2024-09-04T16:19:08.629 INFO:teuthology.orchestra.run.smithi170.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-04T16:19:08.688 INFO:teuthology.orchestra.run.smithi170.stdout:(10/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 13 MB/s | 2.0 MB 00:00 2024-09-04T16:19:08.713 INFO:teuthology.orchestra.run.smithi170.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2024-09-04T16:19:08.755 INFO:teuthology.orchestra.run.smithi170.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.2 MB/s | 863 kB 00:00 2024-09-04T16:19:08.759 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:08.759 INFO:teuthology.orchestra.run.smithi170.stdout:Total 8.4 MB/s | 8.7 MB 00:01 2024-09-04T16:19:08.807 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-04T16:19:08.824 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-04T16:19:08.824 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-04T16:19:08.982 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-04T16:19:08.983 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-04T16:19:09.541 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-04T16:19:09.622 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-04T16:19:09.665 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-04T16:19:09.669 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-252.g48920dab.el9 11/12 2024-09-04T16:19:09.708 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-252.g48920dab.el9.noar 12/12 2024-09-04T16:19:09.712 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-04T16:19:09.751 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-04T16:19:09.826 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-04T16:19:09.951 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-04T16:19:10.045 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-04T16:19:10.089 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-04T16:19:10.120 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-04T16:19:10.150 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-252.g48920dab.el9. 10/12 2024-09-04T16:19:11.118 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-252.g48920dab.el9.noar 12/12 2024-09-04T16:19:11.119 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-252.g48920dab.el9 1/12 2024-09-04T16:19:11.119 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-252.g48920dab.el9.noar 2/12 2024-09-04T16:19:11.119 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-252.g48920dab.el9. 3/12 2024-09-04T16:19:11.119 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-04T16:19:11.119 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-04T16:19:11.119 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-04T16:19:11.119 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-04T16:19:11.119 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-04T16:19:11.119 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-04T16:19:11.119 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-04T16:19:11.120 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-04T16:19:11.196 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-252.g48920dab.el9 11/12 2024-09-04T16:19:11.242 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-252.g48920dab.el9.noar 12/12 2024-09-04T16:19:11.422 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-04T16:19:11.422 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:11.422 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-04T16:19:11.422 INFO:teuthology.orchestra.run.smithi193.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-04T16:19:11.422 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-grafana-dashboards-2:19.1.1-252.g48920dab.el9.noarch 2024-09-04T16:19:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard-2:19.1.1-252.g48920dab.el9.noarch 2024-09-04T16:19:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-prometheus-alerts-2:19.1.1-252.g48920dab.el9.noarch 2024-09-04T16:19:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-04T16:19:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-04T16:19:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-04T16:19:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-04T16:19:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-04T16:19:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-04T16:19:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-04T16:19:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-04T16:19:11.423 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:11.423 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:11.650 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-04T16:19:12.196 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:01:04 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:12.329 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:12.331 INFO:teuthology.orchestra.run.smithi193.stdout:====================================================================================== 2024-09-04T16:19:12.331 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repository Size 2024-09-04T16:19:12.331 INFO:teuthology.orchestra.run.smithi193.stdout:====================================================================================== 2024-09-04T16:19:12.331 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-04T16:19:12.331 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-252.g48920dab.el9 ceph-noarch 7.4 M 2024-09-04T16:19:12.331 INFO:teuthology.orchestra.run.smithi193.stdout:Installing dependencies: 2024-09-04T16:19:12.331 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-04T16:19:12.331 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-04T16:19:12.331 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-04T16:19:12.331 INFO:teuthology.orchestra.run.smithi193.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-04T16:19:12.331 INFO:teuthology.orchestra.run.smithi193.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-04T16:19:12.332 INFO:teuthology.orchestra.run.smithi193.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-04T16:19:12.332 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-04T16:19:12.332 INFO:teuthology.orchestra.run.smithi193.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-04T16:19:12.332 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-04T16:19:12.332 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-04T16:19:12.332 INFO:teuthology.orchestra.run.smithi193.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-04T16:19:12.332 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:12.332 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:19:12.332 INFO:teuthology.orchestra.run.smithi193.stdout:====================================================================================== 2024-09-04T16:19:12.332 INFO:teuthology.orchestra.run.smithi193.stdout:Install 12 Packages 2024-09-04T16:19:12.332 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:12.333 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 38 M 2024-09-04T16:19:12.333 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 212 M 2024-09-04T16:19:12.333 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-04T16:19:12.552 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-252.g48920dab.el9.noar 12/12 2024-09-04T16:19:12.553 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-252.g48920dab.el9 1/12 2024-09-04T16:19:12.553 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-252.g48920dab.el9.noar 2/12 2024-09-04T16:19:12.553 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-252.g48920dab.el9. 3/12 2024-09-04T16:19:12.553 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-04T16:19:12.553 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-04T16:19:12.553 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-04T16:19:12.553 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-04T16:19:12.553 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-04T16:19:12.553 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-04T16:19:12.554 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-04T16:19:12.554 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-04T16:19:12.721 INFO:teuthology.orchestra.run.smithi193.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-04T16:19:12.754 INFO:teuthology.orchestra.run.smithi193.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 801 kB 00:00 2024-09-04T16:19:12.835 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-04T16:19:12.835 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:12.835 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-04T16:19:12.836 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-04T16:19:12.836 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards-2:19.1.1-252.g48920dab.el9.noarch 2024-09-04T16:19:12.836 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard-2:19.1.1-252.g48920dab.el9.noarch 2024-09-04T16:19:12.836 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts-2:19.1.1-252.g48920dab.el9.noarch 2024-09-04T16:19:12.836 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-04T16:19:12.836 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-04T16:19:12.836 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-04T16:19:12.836 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-04T16:19:12.836 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-04T16:19:12.836 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-04T16:19:12.836 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-04T16:19:12.836 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-04T16:19:12.836 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:12.837 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:12.855 INFO:teuthology.orchestra.run.smithi193.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 244 kB/s | 33 kB 00:00 2024-09-04T16:19:12.922 INFO:teuthology.orchestra.run.smithi193.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 274 kB/s | 18 kB 00:00 2024-09-04T16:19:13.006 INFO:teuthology.orchestra.run.smithi193.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 461 kB/s | 38 kB 00:00 2024-09-04T16:19:13.089 INFO:teuthology.orchestra.run.smithi193.stdout:(6/12): ceph-mgr-diskprediction-local-19.1.1-25 13 MB/s | 7.4 MB 00:00 2024-09-04T16:19:13.091 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-04T16:19:13.323 INFO:teuthology.orchestra.run.smithi193.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.0 MB/s | 245 kB 00:00 2024-09-04T16:19:13.639 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:03 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:13.772 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:13.773 INFO:teuthology.orchestra.run.smithi170.stdout:====================================================================================== 2024-09-04T16:19:13.773 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-04T16:19:13.773 INFO:teuthology.orchestra.run.smithi170.stdout:====================================================================================== 2024-09-04T16:19:13.773 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-04T16:19:13.773 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-252.g48920dab.el9 ceph-noarch 7.4 M 2024-09-04T16:19:13.773 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-04T16:19:13.773 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-04T16:19:13.773 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-04T16:19:13.774 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-04T16:19:13.774 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-04T16:19:13.774 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-04T16:19:13.774 INFO:teuthology.orchestra.run.smithi170.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-04T16:19:13.774 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-04T16:19:13.774 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-04T16:19:13.774 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-04T16:19:13.774 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-04T16:19:13.774 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-04T16:19:13.774 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:13.774 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:19:13.774 INFO:teuthology.orchestra.run.smithi170.stdout:====================================================================================== 2024-09-04T16:19:13.775 INFO:teuthology.orchestra.run.smithi170.stdout:Install 12 Packages 2024-09-04T16:19:13.775 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:13.775 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 38 M 2024-09-04T16:19:13.775 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 212 M 2024-09-04T16:19:13.775 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-04T16:19:13.824 INFO:teuthology.orchestra.run.smithi193.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.8 MB/s | 3.0 MB 00:01 2024-09-04T16:19:13.973 INFO:teuthology.orchestra.run.smithi193.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.6 MB/s | 250 kB 00:00 2024-09-04T16:19:14.455 INFO:teuthology.orchestra.run.smithi170.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-04T16:19:14.497 INFO:teuthology.orchestra.run.smithi170.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 801 kB 00:00 2024-09-04T16:19:14.597 INFO:teuthology.orchestra.run.smithi170.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 230 kB/s | 33 kB 00:00 2024-09-04T16:19:14.656 INFO:teuthology.orchestra.run.smithi170.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 312 kB/s | 18 kB 00:00 2024-09-04T16:19:14.781 INFO:teuthology.orchestra.run.smithi170.stdout:(5/12): ceph-mgr-diskprediction-local-19.1.1-25 15 MB/s | 7.4 MB 00:00 2024-09-04T16:19:14.806 INFO:teuthology.orchestra.run.smithi170.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 256 kB/s | 38 kB 00:00 2024-09-04T16:19:14.873 INFO:teuthology.orchestra.run.smithi170.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.9 MB/s | 3.0 MB 00:00 2024-09-04T16:19:14.899 INFO:teuthology.orchestra.run.smithi170.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-04T16:19:14.923 INFO:teuthology.orchestra.run.smithi193.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.6 MB/s | 4.9 MB 00:01 2024-09-04T16:19:14.982 INFO:teuthology.orchestra.run.smithi170.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-04T16:19:15.082 INFO:teuthology.orchestra.run.smithi193.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.9 MB/s | 5.1 MB 00:01 2024-09-04T16:19:15.108 INFO:teuthology.orchestra.run.smithi170.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 15 MB/s | 4.9 MB 00:00 2024-09-04T16:19:15.183 INFO:teuthology.orchestra.run.smithi170.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-09-04T16:19:15.416 INFO:teuthology.orchestra.run.smithi170.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-04T16:19:15.417 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:15.418 INFO:teuthology.orchestra.run.smithi170.stdout:Total 23 MB/s | 38 MB 00:01 2024-09-04T16:19:15.770 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-04T16:19:15.794 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-04T16:19:15.795 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-04T16:19:16.205 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-04T16:19:16.205 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-04T16:19:16.957 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-04T16:19:17.029 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-04T16:19:17.081 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-04T16:19:17.191 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-04T16:19:17.241 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-04T16:19:17.423 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-04T16:19:17.457 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-04T16:19:17.532 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-04T16:19:18.170 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-04T16:19:18.293 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-04T16:19:19.507 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-04T16:19:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-04T16:19:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-252.g48920d 12/12 2024-09-04T16:19:21.731 INFO:teuthology.orchestra.run.smithi193.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.1 MB/s | 16 MB 00:07 2024-09-04T16:19:21.732 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:21.733 INFO:teuthology.orchestra.run.smithi193.stdout:Total 4.1 MB/s | 38 MB 00:09 2024-09-04T16:19:22.091 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-04T16:19:22.117 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-04T16:19:22.117 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-04T16:19:22.527 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-04T16:19:22.528 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-04T16:19:23.197 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-252.g48920d 12/12 2024-09-04T16:19:23.197 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-252.g48920d 1/12 2024-09-04T16:19:23.197 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-04T16:19:23.197 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-04T16:19:23.197 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-04T16:19:23.197 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-04T16:19:23.198 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-04T16:19:23.198 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-04T16:19:23.198 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-04T16:19:23.198 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-04T16:19:23.198 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-04T16:19:23.198 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-04T16:19:23.288 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-04T16:19:23.360 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-04T16:19:23.396 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-04T16:19:23.502 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-04T16:19:23.539 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-04T16:19:23.647 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-04T16:19:23.647 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:23.647 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-04T16:19:23.647 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local-2:19.1.1-252.g48920dab.el9.noarch 2024-09-04T16:19:23.648 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-04T16:19:23.648 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-04T16:19:23.648 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-04T16:19:23.648 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-04T16:19:23.648 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-04T16:19:23.648 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-04T16:19:23.648 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-04T16:19:23.648 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-04T16:19:23.648 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-04T16:19:23.648 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-04T16:19:23.649 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-04T16:19:23.649 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:23.649 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:23.723 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-04T16:19:23.755 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-04T16:19:23.830 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-04T16:19:23.999 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-rook 2024-09-04T16:19:24.464 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-04T16:19:24.570 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:14 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:24.583 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-04T16:19:24.705 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:24.707 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-04T16:19:24.707 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:24.707 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-04T16:19:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook noarch 2:19.1.1-252.g48920dab.el9 ceph-noarch 49 k 2024-09-04T16:19:24.707 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-04T16:19:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-04T16:19:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-04T16:19:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-04T16:19:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-04T16:19:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-04T16:19:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-04T16:19:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-04T16:19:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-04T16:19:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-04T16:19:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-04T16:19:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-04T16:19:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-04T16:19:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:24.708 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:19:24.708 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:24.708 INFO:teuthology.orchestra.run.smithi170.stdout:Install 13 Packages 2024-09-04T16:19:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:24.709 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 2.2 M 2024-09-04T16:19:24.709 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 26 M 2024-09-04T16:19:24.709 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-04T16:19:24.891 INFO:teuthology.orchestra.run.smithi170.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 201 kB/s | 19 kB 00:00 2024-09-04T16:19:24.916 INFO:teuthology.orchestra.run.smithi170.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 212 kB/s | 26 kB 00:00 2024-09-04T16:19:24.975 INFO:teuthology.orchestra.run.smithi170.stdout:(3/13): ceph-mgr-rook-19.1.1-252.g48920dab.el9. 275 kB/s | 49 kB 00:00 2024-09-04T16:19:25.000 INFO:teuthology.orchestra.run.smithi170.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-04T16:19:25.059 INFO:teuthology.orchestra.run.smithi170.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-04T16:19:25.084 INFO:teuthology.orchestra.run.smithi170.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 639 kB/s | 54 kB 00:00 2024-09-04T16:19:25.134 INFO:teuthology.orchestra.run.smithi170.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 428 kB/s | 32 kB 00:00 2024-09-04T16:19:25.160 INFO:teuthology.orchestra.run.smithi170.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 188 kB/s | 14 kB 00:00 2024-09-04T16:19:25.193 INFO:teuthology.orchestra.run.smithi170.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-04T16:19:25.235 INFO:teuthology.orchestra.run.smithi170.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.1 MB/s | 220 kB 00:00 2024-09-04T16:19:25.260 INFO:teuthology.orchestra.run.smithi170.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 885 kB/s | 59 kB 00:00 2024-09-04T16:19:25.286 INFO:teuthology.orchestra.run.smithi170.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-04T16:19:25.319 INFO:teuthology.orchestra.run.smithi170.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.4 MB/s | 1.0 MB 00:00 2024-09-04T16:19:25.322 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:25.322 INFO:teuthology.orchestra.run.smithi170.stdout:Total 3.6 MB/s | 2.2 MB 00:00 2024-09-04T16:19:25.383 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-04T16:19:25.398 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-04T16:19:25.398 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-04T16:19:25.483 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-04T16:19:25.485 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-04T16:19:25.797 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-04T16:19:25.984 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-04T16:19:26.155 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-04T16:19:26.211 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-04T16:19:26.275 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-04T16:19:26.313 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-04T16:19:26.354 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-04T16:19:26.464 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-04T16:19:26.573 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-04T16:19:26.623 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-04T16:19:26.836 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-04T16:19:26.863 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-252.g48920d 12/12 2024-09-04T16:19:27.326 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-04T16:19:27.371 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-04T16:19:27.404 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-04T16:19:27.460 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-04T16:19:27.491 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-rook-2:19.1.1-252.g48920dab.el9.noarch 13/13 2024-09-04T16:19:28.215 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-252.g48920dab.el9.noarch 13/13 2024-09-04T16:19:28.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-rook-2:19.1.1-252.g48920dab.el9.noarch 1/13 2024-09-04T16:19:28.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-04T16:19:28.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-04T16:19:28.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-04T16:19:28.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-04T16:19:28.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-04T16:19:28.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-04T16:19:28.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-04T16:19:28.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-04T16:19:28.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-04T16:19:28.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-04T16:19:28.217 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-04T16:19:28.543 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-04T16:19:28.543 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:28.543 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-04T16:19:28.543 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook-2:19.1.1-252.g48920dab.el9.noarch 2024-09-04T16:19:28.544 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-04T16:19:28.544 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-04T16:19:28.544 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-04T16:19:28.544 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-04T16:19:28.544 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-04T16:19:28.544 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-04T16:19:28.544 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-04T16:19:28.544 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-04T16:19:28.544 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-04T16:19:28.544 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-04T16:19:28.545 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-04T16:19:28.545 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-04T16:19:28.545 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:28.545 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:28.808 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-cephadm 2024-09-04T16:19:29.300 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-252.g48920d 12/12 2024-09-04T16:19:29.300 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-252.g48920d 1/12 2024-09-04T16:19:29.300 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-04T16:19:29.300 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-04T16:19:29.300 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-04T16:19:29.300 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-04T16:19:29.300 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-04T16:19:29.301 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-04T16:19:29.301 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-04T16:19:29.301 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-04T16:19:29.301 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-04T16:19:29.301 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-04T16:19:29.357 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:19 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:29.489 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:29.490 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:29.490 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-04T16:19:29.490 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:29.491 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-04T16:19:29.491 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm noarch 2:19.1.1-252.g48920dab.el9 ceph-noarch 146 k 2024-09-04T16:19:29.491 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-04T16:19:29.491 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-04T16:19:29.491 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-04T16:19:29.491 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-04T16:19:29.491 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-04T16:19:29.491 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-04T16:19:29.491 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:29.491 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:19:29.491 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:29.491 INFO:teuthology.orchestra.run.smithi170.stdout:Install 6 Packages 2024-09-04T16:19:29.491 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:29.492 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 7.0 M 2024-09-04T16:19:29.492 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 33 M 2024-09-04T16:19:29.492 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-04T16:19:29.686 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-04T16:19:29.686 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:29.686 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-04T16:19:29.686 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-diskprediction-local-2:19.1.1-252.g48920dab.el9.noarch 2024-09-04T16:19:29.686 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-04T16:19:29.687 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-04T16:19:29.687 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-04T16:19:29.687 INFO:teuthology.orchestra.run.smithi193.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-04T16:19:29.687 INFO:teuthology.orchestra.run.smithi193.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-04T16:19:29.687 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-04T16:19:29.687 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-04T16:19:29.687 INFO:teuthology.orchestra.run.smithi193.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-04T16:19:29.687 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-04T16:19:29.687 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-04T16:19:29.687 INFO:teuthology.orchestra.run.smithi193.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-04T16:19:29.687 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:29.687 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:29.798 INFO:teuthology.orchestra.run.smithi170.stdout:(1/6): ceph-mgr-cephadm-19.1.1-252.g48920dab.el 723 kB/s | 146 kB 00:00 2024-09-04T16:19:29.823 INFO:teuthology.orchestra.run.smithi170.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-04T16:19:29.873 INFO:teuthology.orchestra.run.smithi170.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-04T16:19:29.899 INFO:teuthology.orchestra.run.smithi170.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.3 MB/s | 548 kB 00:00 2024-09-04T16:19:29.924 INFO:teuthology.orchestra.run.smithi170.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-04T16:19:30.044 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph-mgr-rook 2024-09-04T16:19:30.609 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:01:22 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:30.741 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:30.742 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:30.742 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repository Size 2024-09-04T16:19:30.742 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:30.743 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-04T16:19:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-rook noarch 2:19.1.1-252.g48920dab.el9 ceph-noarch 49 k 2024-09-04T16:19:30.743 INFO:teuthology.orchestra.run.smithi193.stdout:Installing dependencies: 2024-09-04T16:19:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-04T16:19:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-04T16:19:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-04T16:19:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-04T16:19:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-04T16:19:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-04T16:19:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-04T16:19:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-04T16:19:30.743 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-04T16:19:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-04T16:19:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-04T16:19:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-04T16:19:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:30.744 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:19:30.744 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:30.744 INFO:teuthology.orchestra.run.smithi193.stdout:Install 13 Packages 2024-09-04T16:19:30.744 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:30.745 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 2.2 M 2024-09-04T16:19:30.745 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 26 M 2024-09-04T16:19:30.745 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-04T16:19:31.116 INFO:teuthology.orchestra.run.smithi193.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 302 kB/s | 26 kB 00:00 2024-09-04T16:19:31.141 INFO:teuthology.orchestra.run.smithi193.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 174 kB/s | 19 kB 00:00 2024-09-04T16:19:31.191 INFO:teuthology.orchestra.run.smithi170.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.7 MB/s | 6.0 MB 00:01 2024-09-04T16:19:31.192 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:31.193 INFO:teuthology.orchestra.run.smithi170.stdout:Total 4.1 MB/s | 7.0 MB 00:01 2024-09-04T16:19:31.233 INFO:teuthology.orchestra.run.smithi193.stdout:(3/13): ceph-mgr-rook-19.1.1-252.g48920dab.el9. 244 kB/s | 49 kB 00:00 2024-09-04T16:19:31.258 INFO:teuthology.orchestra.run.smithi193.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-04T16:19:31.264 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-04T16:19:31.275 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-04T16:19:31.275 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-04T16:19:31.283 INFO:teuthology.orchestra.run.smithi193.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-09-04T16:19:31.317 INFO:teuthology.orchestra.run.smithi193.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 917 kB/s | 54 kB 00:00 2024-09-04T16:19:31.367 INFO:teuthology.orchestra.run.smithi193.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 385 kB/s | 32 kB 00:00 2024-09-04T16:19:31.373 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-04T16:19:31.374 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-04T16:19:31.392 INFO:teuthology.orchestra.run.smithi193.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 192 kB/s | 14 kB 00:00 2024-09-04T16:19:31.418 INFO:teuthology.orchestra.run.smithi193.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.4 MB/s | 220 kB 00:00 2024-09-04T16:19:31.443 INFO:teuthology.orchestra.run.smithi193.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-04T16:19:31.468 INFO:teuthology.orchestra.run.smithi193.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-04T16:19:31.502 INFO:teuthology.orchestra.run.smithi193.stdout:(12/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.0 MB/s | 279 kB 00:00 2024-09-04T16:19:31.535 INFO:teuthology.orchestra.run.smithi193.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-04T16:19:31.537 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:31.538 INFO:teuthology.orchestra.run.smithi193.stdout:Total 2.8 MB/s | 2.2 MB 00:00 2024-09-04T16:19:31.601 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-04T16:19:31.616 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-04T16:19:31.616 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-04T16:19:31.672 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-04T16:19:31.700 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-04T16:19:31.702 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-04T16:19:31.820 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-04T16:19:31.876 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-04T16:19:32.196 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-04T16:19:32.358 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-04T16:19:32.392 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-04T16:19:32.412 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-04T16:19:32.475 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-04T16:19:32.486 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-04T16:19:32.513 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-04T16:19:32.551 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-04T16:19:32.554 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-04T16:19:32.588 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-252.g48920dab.el9.noarch 6/6 2024-09-04T16:19:32.657 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-04T16:19:32.766 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-04T16:19:32.814 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-04T16:19:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-252.g48920dab.el9.noarch 6/6 2024-09-04T16:19:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-252.g48920dab.el9.noarch 1/6 2024-09-04T16:19:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-04T16:19:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-04T16:19:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-04T16:19:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-04T16:19:33.531 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-04T16:19:33.579 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-04T16:19:33.612 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-04T16:19:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-04T16:19:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:33.642 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-04T16:19:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm-2:19.1.1-252.g48920dab.el9.noarch 2024-09-04T16:19:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-04T16:19:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-04T16:19:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-04T16:19:33.643 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-04T16:19:33.643 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-04T16:19:33.643 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:33.643 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:33.660 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-04T16:19:33.682 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-rook-2:19.1.1-252.g48920dab.el9.noarch 13/13 2024-09-04T16:19:33.890 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-fuse 2024-09-04T16:19:34.440 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:24 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:34.488 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-252.g48920dab.el9.noarch 13/13 2024-09-04T16:19:34.488 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-rook-2:19.1.1-252.g48920dab.el9.noarch 1/13 2024-09-04T16:19:34.488 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-04T16:19:34.488 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-04T16:19:34.488 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-04T16:19:34.488 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-04T16:19:34.488 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-04T16:19:34.488 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-04T16:19:34.488 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-04T16:19:34.489 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-04T16:19:34.489 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-04T16:19:34.489 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-04T16:19:34.489 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-04T16:19:34.572 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:34.573 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:34.573 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-04T16:19:34.573 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:34.573 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-04T16:19:34.573 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse x86_64 2:19.1.1-252.g48920dab.el9 ceph 897 k 2024-09-04T16:19:34.573 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-04T16:19:34.573 INFO:teuthology.orchestra.run.smithi170.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-04T16:19:34.573 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:34.574 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:19:34.574 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:34.574 INFO:teuthology.orchestra.run.smithi170.stdout:Install 2 Packages 2024-09-04T16:19:34.574 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:34.574 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 976 k 2024-09-04T16:19:34.574 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 2.9 M 2024-09-04T16:19:34.574 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-04T16:19:34.743 INFO:teuthology.orchestra.run.smithi170.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 537 kB/s | 80 kB 00:00 2024-09-04T16:19:34.809 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-04T16:19:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:34.810 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-04T16:19:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-rook-2:19.1.1-252.g48920dab.el9.noarch 2024-09-04T16:19:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-04T16:19:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-04T16:19:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-04T16:19:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-04T16:19:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-04T16:19:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-04T16:19:34.810 INFO:teuthology.orchestra.run.smithi193.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-04T16:19:34.811 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-04T16:19:34.811 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-04T16:19:34.811 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-04T16:19:34.811 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-04T16:19:34.811 INFO:teuthology.orchestra.run.smithi193.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-04T16:19:34.811 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:34.811 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:34.885 INFO:teuthology.orchestra.run.smithi170.stdout:(2/2): ceph-fuse-19.1.1-252.g48920dab.el9.x86_6 3.0 MB/s | 897 kB 00:00 2024-09-04T16:19:34.885 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:34.886 INFO:teuthology.orchestra.run.smithi170.stdout:Total 3.0 MB/s | 976 kB 00:00 2024-09-04T16:19:34.900 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-04T16:19:34.920 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-04T16:19:34.920 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-04T16:19:35.000 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-04T16:19:35.001 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-04T16:19:35.077 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph-mgr-cephadm 2024-09-04T16:19:35.192 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-04T16:19:35.337 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-04T16:19:35.399 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-fuse-2:19.1.1-252.g48920dab.el9.x86_64 2/2 2024-09-04T16:19:35.632 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:01:27 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:35.764 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:35.765 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:35.765 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repository Size 2024-09-04T16:19:35.765 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:35.765 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-04T16:19:35.765 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-cephadm noarch 2:19.1.1-252.g48920dab.el9 ceph-noarch 146 k 2024-09-04T16:19:35.765 INFO:teuthology.orchestra.run.smithi193.stdout:Installing dependencies: 2024-09-04T16:19:35.766 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-04T16:19:35.766 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-04T16:19:35.766 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-04T16:19:35.766 INFO:teuthology.orchestra.run.smithi193.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-04T16:19:35.766 INFO:teuthology.orchestra.run.smithi193.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-04T16:19:35.766 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:35.766 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:19:35.766 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:35.766 INFO:teuthology.orchestra.run.smithi193.stdout:Install 6 Packages 2024-09-04T16:19:35.766 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:35.767 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 7.0 M 2024-09-04T16:19:35.767 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 33 M 2024-09-04T16:19:35.767 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-04T16:19:36.040 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-fuse-2:19.1.1-252.g48920dab.el9.x86_64 2/2 2024-09-04T16:19:36.040 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-fuse-2:19.1.1-252.g48920dab.el9.x86_64 1/2 2024-09-04T16:19:36.316 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-04T16:19:36.316 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:36.316 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-04T16:19:36.317 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse-2:19.1.1-252.g48920dab.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-04T16:19:36.317 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:36.317 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:36.489 INFO:teuthology.orchestra.run.smithi193.stdout:(1/6): ceph-mgr-cephadm-19.1.1-252.g48920dab.el 721 kB/s | 146 kB 00:00 2024-09-04T16:19:36.564 INFO:teuthology.orchestra.run.smithi193.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.2 MB/s | 548 kB 00:00 2024-09-04T16:19:36.589 INFO:teuthology.orchestra.run.smithi193.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-04T16:19:36.614 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librados-devel 2024-09-04T16:19:36.615 INFO:teuthology.orchestra.run.smithi193.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.1 MB/s | 74 kB 00:00 2024-09-04T16:19:37.173 INFO:teuthology.orchestra.run.smithi193.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 280 kB/s | 248 kB 00:00 2024-09-04T16:19:37.177 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:27 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:37.310 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:37.311 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:37.311 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-09-04T16:19:37.311 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:37.311 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-04T16:19:37.311 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel x86_64 2:19.1.1-252.g48920dab.el9 ceph 127 k 2024-09-04T16:19:37.311 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:37.311 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:19:37.311 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:37.312 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-04T16:19:37.312 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:37.312 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 127 k 2024-09-04T16:19:37.312 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 456 k 2024-09-04T16:19:37.312 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-04T16:19:37.498 INFO:teuthology.orchestra.run.smithi170.stdout:librados-devel-19.1.1-252.g48920dab.el9.x86_64. 679 kB/s | 127 kB 00:00 2024-09-04T16:19:37.499 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:37.499 INFO:teuthology.orchestra.run.smithi170.stdout:Total 674 kB/s | 127 kB 00:00 2024-09-04T16:19:37.499 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-04T16:19:37.505 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-04T16:19:37.505 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-04T16:19:37.569 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-04T16:19:37.570 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-04T16:19:37.734 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-04T16:19:37.870 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librados-devel-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:38.271 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados-devel-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:38.522 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados-devel-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:38.522 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:38.523 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-04T16:19:38.523 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:19:38.523 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:38.523 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:38.751 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install libcephfs2 2024-09-04T16:19:39.015 INFO:teuthology.orchestra.run.smithi193.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.2 MB/s | 6.0 MB 00:02 2024-09-04T16:19:39.017 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:39.017 INFO:teuthology.orchestra.run.smithi193.stdout:Total 2.2 MB/s | 7.0 MB 00:03 2024-09-04T16:19:39.089 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-04T16:19:39.101 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-04T16:19:39.101 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-04T16:19:39.201 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-04T16:19:39.201 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-04T16:19:39.320 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:29 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:39.412 INFO:teuthology.orchestra.run.smithi170.stdout:Package libcephfs2-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:39.455 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:39.456 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-04T16:19:39.456 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-04T16:19:39.536 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install libcephfs-devel 2024-09-04T16:19:39.681 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-04T16:19:39.733 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-04T16:19:40.090 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:30 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:40.223 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:40.224 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:40.224 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-09-04T16:19:40.224 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:40.224 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-04T16:19:40.224 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel x86_64 2:19.1.1-252.g48920dab.el9 ceph 32 k 2024-09-04T16:19:40.224 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:40.224 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:19:40.224 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:40.224 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-04T16:19:40.225 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:40.225 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 32 k 2024-09-04T16:19:40.225 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 142 k 2024-09-04T16:19:40.225 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-04T16:19:40.264 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-04T16:19:40.345 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-04T16:19:40.386 INFO:teuthology.orchestra.run.smithi170.stdout:libcephfs-devel-19.1.1-252.g48920dab.el9.x86_64 196 kB/s | 32 kB 00:00 2024-09-04T16:19:40.387 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:40.387 INFO:teuthology.orchestra.run.smithi170.stdout:Total 195 kB/s | 32 kB 00:00 2024-09-04T16:19:40.387 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-04T16:19:40.390 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-04T16:19:40.391 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-04T16:19:40.395 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-04T16:19:40.395 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-04T16:19:40.408 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-04T16:19:40.438 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-252.g48920dab.el9.noarch 6/6 2024-09-04T16:19:40.485 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-04T16:19:40.625 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs-devel-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:41.006 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:41.201 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-252.g48920dab.el9.noarch 6/6 2024-09-04T16:19:41.201 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-252.g48920dab.el9.noarch 1/6 2024-09-04T16:19:41.201 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-04T16:19:41.201 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-04T16:19:41.201 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-04T16:19:41.201 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-04T16:19:41.231 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs-devel-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:41.231 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:41.231 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-04T16:19:41.231 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:19:41.231 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:41.231 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:41.429 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librados2 2024-09-04T16:19:41.483 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-04T16:19:41.483 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:41.483 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-04T16:19:41.483 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-cephadm-2:19.1.1-252.g48920dab.el9.noarch 2024-09-04T16:19:41.483 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-04T16:19:41.483 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-04T16:19:41.483 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-04T16:19:41.483 INFO:teuthology.orchestra.run.smithi193.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-04T16:19:41.483 INFO:teuthology.orchestra.run.smithi193.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-04T16:19:41.483 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:41.483 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:41.707 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph-fuse 2024-09-04T16:19:41.981 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:31 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:42.071 INFO:teuthology.orchestra.run.smithi170.stdout:Package librados2-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:42.113 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:42.114 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-04T16:19:42.114 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:42.184 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librbd1 2024-09-04T16:19:42.265 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:01:34 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:42.394 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:42.394 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:42.395 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repository Size 2024-09-04T16:19:42.395 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:42.395 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-04T16:19:42.395 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-fuse x86_64 2:19.1.1-252.g48920dab.el9 ceph 897 k 2024-09-04T16:19:42.395 INFO:teuthology.orchestra.run.smithi193.stdout:Installing dependencies: 2024-09-04T16:19:42.395 INFO:teuthology.orchestra.run.smithi193.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-04T16:19:42.395 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:42.395 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:19:42.395 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:42.395 INFO:teuthology.orchestra.run.smithi193.stdout:Install 2 Packages 2024-09-04T16:19:42.395 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:42.396 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 976 k 2024-09-04T16:19:42.396 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 2.9 M 2024-09-04T16:19:42.396 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-04T16:19:42.739 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:32 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:42.826 INFO:teuthology.orchestra.run.smithi193.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 465 kB/s | 80 kB 00:00 2024-09-04T16:19:42.828 INFO:teuthology.orchestra.run.smithi170.stdout:Package librbd1-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:42.870 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:42.871 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-04T16:19:42.871 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:42.941 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rados 2024-09-04T16:19:42.959 INFO:teuthology.orchestra.run.smithi193.stdout:(2/2): ceph-fuse-19.1.1-252.g48920dab.el9.x86_6 2.9 MB/s | 897 kB 00:00 2024-09-04T16:19:42.959 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:42.960 INFO:teuthology.orchestra.run.smithi193.stdout:Total 1.7 MB/s | 976 kB 00:00 2024-09-04T16:19:42.972 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-04T16:19:42.994 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-04T16:19:42.994 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-04T16:19:43.075 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-04T16:19:43.076 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-04T16:19:43.262 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-04T16:19:43.411 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-04T16:19:43.482 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-fuse-2:19.1.1-252.g48920dab.el9.x86_64 2/2 2024-09-04T16:19:43.494 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:33 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:43.583 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rados-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:43.625 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:43.626 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-04T16:19:43.626 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:43.689 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rgw 2024-09-04T16:19:44.095 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-fuse-2:19.1.1-252.g48920dab.el9.x86_64 2/2 2024-09-04T16:19:44.095 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-fuse-2:19.1.1-252.g48920dab.el9.x86_64 1/2 2024-09-04T16:19:44.241 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:34 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:44.330 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rgw-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:44.356 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-04T16:19:44.356 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:44.356 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-04T16:19:44.356 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-fuse-2:19.1.1-252.g48920dab.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-04T16:19:44.357 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:44.357 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:44.373 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:44.375 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-04T16:19:44.375 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:44.444 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-cephfs 2024-09-04T16:19:44.638 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install librados-devel 2024-09-04T16:19:44.996 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:34 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:45.086 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-cephfs-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:45.130 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:45.131 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-04T16:19:45.131 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:45.201 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rbd 2024-09-04T16:19:45.204 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:01:37 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:45.341 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:45.342 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:45.342 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repo Size 2024-09-04T16:19:45.342 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:45.342 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-04T16:19:45.342 INFO:teuthology.orchestra.run.smithi193.stdout: librados-devel x86_64 2:19.1.1-252.g48920dab.el9 ceph 127 k 2024-09-04T16:19:45.342 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:45.342 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:19:45.342 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:45.342 INFO:teuthology.orchestra.run.smithi193.stdout:Install 1 Package 2024-09-04T16:19:45.342 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:45.343 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 127 k 2024-09-04T16:19:45.343 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 456 k 2024-09-04T16:19:45.343 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-04T16:19:45.565 INFO:teuthology.orchestra.run.smithi193.stdout:librados-devel-19.1.1-252.g48920dab.el9.x86_64. 570 kB/s | 127 kB 00:00 2024-09-04T16:19:45.565 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:45.566 INFO:teuthology.orchestra.run.smithi193.stdout:Total 567 kB/s | 127 kB 00:00 2024-09-04T16:19:45.566 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-04T16:19:45.571 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-04T16:19:45.571 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-04T16:19:45.636 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-04T16:19:45.636 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-04T16:19:45.756 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:35 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:45.785 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-04T16:19:45.845 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rbd-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:45.889 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:45.890 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-04T16:19:45.890 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:45.893 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librados-devel-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:45.956 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-fuse 2024-09-04T16:19:46.337 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librados-devel-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:46.506 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:36 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:46.613 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados-devel-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:46.613 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:46.613 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-04T16:19:46.613 INFO:teuthology.orchestra.run.smithi193.stdout: librados-devel-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:19:46.614 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:46.614 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:46.637 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:46.638 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-09-04T16:19:46.638 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:46.638 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-04T16:19:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse x86_64 2:19.1.1-252.g48920dab.el9 ceph 85 k 2024-09-04T16:19:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:46.638 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:19:46.638 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:46.638 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-04T16:19:46.639 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:46.639 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 85 k 2024-09-04T16:19:46.639 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 231 k 2024-09-04T16:19:46.639 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-04T16:19:46.806 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-fuse-19.1.1-252.g48920dab.el9.x86_64.rpm 511 kB/s | 85 kB 00:00 2024-09-04T16:19:46.806 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:46.807 INFO:teuthology.orchestra.run.smithi170.stdout:Total 507 kB/s | 85 kB 00:00 2024-09-04T16:19:46.807 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-04T16:19:46.813 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-04T16:19:46.814 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-04T16:19:46.865 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install libcephfs2 2024-09-04T16:19:46.877 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-04T16:19:46.877 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-04T16:19:47.018 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-04T16:19:47.118 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-fuse-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:47.428 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:01:39 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:47.518 INFO:teuthology.orchestra.run.smithi193.stdout:Package libcephfs2-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:47.529 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-fuse-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:47.561 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:47.562 INFO:teuthology.orchestra.run.smithi193.stdout:Nothing to do. 2024-09-04T16:19:47.562 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:47.626 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install libcephfs-devel 2024-09-04T16:19:47.779 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-fuse-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:47.780 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:47.780 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-04T16:19:47.780 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:19:47.780 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:47.780 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:48.025 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-mirror 2024-09-04T16:19:48.173 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:01:40 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:48.307 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:48.307 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:48.307 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repo Size 2024-09-04T16:19:48.307 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:48.308 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-04T16:19:48.308 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-devel x86_64 2:19.1.1-252.g48920dab.el9 ceph 32 k 2024-09-04T16:19:48.308 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:48.308 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:19:48.308 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:48.308 INFO:teuthology.orchestra.run.smithi193.stdout:Install 1 Package 2024-09-04T16:19:48.308 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:48.308 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 32 k 2024-09-04T16:19:48.309 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 142 k 2024-09-04T16:19:48.309 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-04T16:19:48.453 INFO:teuthology.orchestra.run.smithi193.stdout:libcephfs-devel-19.1.1-252.g48920dab.el9.x86_64 219 kB/s | 32 kB 00:00 2024-09-04T16:19:48.454 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:48.454 INFO:teuthology.orchestra.run.smithi193.stdout:Total 217 kB/s | 32 kB 00:00 2024-09-04T16:19:48.454 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-04T16:19:48.457 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-04T16:19:48.457 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-04T16:19:48.461 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-04T16:19:48.462 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-04T16:19:48.552 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-04T16:19:48.584 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:38 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:48.657 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephfs-devel-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:48.716 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:48.717 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:48.717 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-09-04T16:19:48.717 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:48.718 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-04T16:19:48.718 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror x86_64 2:19.1.1-252.g48920dab.el9 ceph 3.1 M 2024-09-04T16:19:48.718 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:48.718 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:19:48.718 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:48.718 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-04T16:19:48.718 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:48.718 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 3.1 M 2024-09-04T16:19:48.718 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 13 M 2024-09-04T16:19:48.718 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-04T16:19:48.988 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:49.052 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-mirror-19.1.1-252.g48920dab.el9.x86_64.rpm 9.3 MB/s | 3.1 MB 00:00 2024-09-04T16:19:49.052 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:49.053 INFO:teuthology.orchestra.run.smithi170.stdout:Total 9.3 MB/s | 3.1 MB 00:00 2024-09-04T16:19:49.053 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-04T16:19:49.061 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-04T16:19:49.061 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-04T16:19:49.143 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-04T16:19:49.144 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-04T16:19:49.214 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephfs-devel-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:49.214 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:49.214 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-04T16:19:49.214 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-devel-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:19:49.214 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:49.214 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:49.402 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install librados2 2024-09-04T16:19:49.571 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-04T16:19:49.645 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-mirror-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:49.669 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-mirror-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:49.669 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-04T16:19:49.669 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-04T16:19:49.669 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-04T16:19:49.670 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-04T16:19:49.670 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:49.953 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:01:41 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:50.042 INFO:teuthology.orchestra.run.smithi193.stdout:Package librados2-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:50.085 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:50.086 INFO:teuthology.orchestra.run.smithi193.stdout:Nothing to do. 2024-09-04T16:19:50.086 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:50.150 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install librbd1 2024-09-04T16:19:50.702 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:01:42 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:50.780 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-mirror-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:50.780 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:50.780 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-04T16:19:50.780 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:19:50.780 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:50.781 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:50.790 INFO:teuthology.orchestra.run.smithi193.stdout:Package librbd1-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:50.833 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:50.834 INFO:teuthology.orchestra.run.smithi193.stdout:Nothing to do. 2024-09-04T16:19:50.834 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:50.902 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install python3-rados 2024-09-04T16:19:51.057 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-nbd 2024-09-04T16:19:51.459 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:01:43 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:51.549 INFO:teuthology.orchestra.run.smithi193.stdout:Package python3-rados-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:51.592 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:51.593 INFO:teuthology.orchestra.run.smithi193.stdout:Nothing to do. 2024-09-04T16:19:51.593 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:51.621 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:41 ago on Wed 04 Sep 2024 04:18:10 PM UTC. 2024-09-04T16:19:51.670 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install python3-rgw 2024-09-04T16:19:51.760 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-04T16:19:51.761 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:51.761 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-09-04T16:19:51.761 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:51.761 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-04T16:19:51.761 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd x86_64 2:19.1.1-252.g48920dab.el9 ceph 171 k 2024-09-04T16:19:51.761 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:51.761 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-04T16:19:51.762 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-04T16:19:51.762 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-04T16:19:51.762 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:51.762 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 171 k 2024-09-04T16:19:51.762 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 494 k 2024-09-04T16:19:51.762 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-04T16:19:51.973 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-nbd-19.1.1-252.g48920dab.el9.x86_64.rpm 811 kB/s | 171 kB 00:00 2024-09-04T16:19:51.973 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:51.974 INFO:teuthology.orchestra.run.smithi170.stdout:Total 805 kB/s | 171 kB 00:00 2024-09-04T16:19:51.974 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-04T16:19:51.982 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-04T16:19:51.982 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-04T16:19:52.049 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-04T16:19:52.049 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-04T16:19:52.209 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-04T16:19:52.223 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:01:44 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:52.312 INFO:teuthology.orchestra.run.smithi193.stdout:Package python3-rgw-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-nbd-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:52.355 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:52.356 INFO:teuthology.orchestra.run.smithi193.stdout:Nothing to do. 2024-09-04T16:19:52.356 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:52.420 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install python3-cephfs 2024-09-04T16:19:52.786 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-nbd-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:52.974 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:01:44 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:53.038 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-nbd-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:53.038 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:53.039 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-04T16:19:53.039 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:19:53.039 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:19:53.039 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-04T16:19:53.063 INFO:teuthology.orchestra.run.smithi193.stdout:Package python3-cephfs-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:53.106 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:53.107 INFO:teuthology.orchestra.run.smithi193.stdout:Nothing to do. 2024-09-04T16:19:53.107 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:53.181 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install python3-rbd 2024-09-04T16:19:53.290 DEBUG:teuthology.parallel:result is None 2024-09-04T16:19:53.740 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:01:45 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:53.829 INFO:teuthology.orchestra.run.smithi193.stdout:Package python3-rbd-2:19.1.1-252.g48920dab.el9.x86_64 is already installed. 2024-09-04T16:19:53.872 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:53.873 INFO:teuthology.orchestra.run.smithi193.stdout:Nothing to do. 2024-09-04T16:19:53.873 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:53.938 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install rbd-fuse 2024-09-04T16:19:54.497 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:01:46 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:54.629 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:54.630 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:54.630 INFO:teuthology.orchestra.run.smithi193.stdout: Package Architecture Version Repository Size 2024-09-04T16:19:54.630 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:54.630 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-04T16:19:54.630 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-fuse x86_64 2:19.1.1-252.g48920dab.el9 ceph 85 k 2024-09-04T16:19:54.631 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:54.631 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:19:54.631 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:54.631 INFO:teuthology.orchestra.run.smithi193.stdout:Install 1 Package 2024-09-04T16:19:54.631 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:54.631 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 85 k 2024-09-04T16:19:54.631 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 231 k 2024-09-04T16:19:54.631 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-04T16:19:54.831 INFO:teuthology.orchestra.run.smithi193.stdout:rbd-fuse-19.1.1-252.g48920dab.el9.x86_64.rpm 426 kB/s | 85 kB 00:00 2024-09-04T16:19:54.832 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:54.832 INFO:teuthology.orchestra.run.smithi193.stdout:Total 423 kB/s | 85 kB 00:00 2024-09-04T16:19:54.832 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-04T16:19:54.838 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-04T16:19:54.839 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-04T16:19:54.902 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-04T16:19:54.902 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-04T16:19:55.048 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-04T16:19:55.152 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-fuse-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:55.496 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: rbd-fuse-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:55.737 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-fuse-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:55.738 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:55.738 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-04T16:19:55.738 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-fuse-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:19:55.738 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:55.738 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:55.982 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install rbd-mirror 2024-09-04T16:19:56.543 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:01:48 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:56.680 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:56.680 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:56.680 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repo Size 2024-09-04T16:19:56.681 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:56.681 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-04T16:19:56.681 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-mirror x86_64 2:19.1.1-252.g48920dab.el9 ceph 3.1 M 2024-09-04T16:19:56.681 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:56.681 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:19:56.681 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:56.681 INFO:teuthology.orchestra.run.smithi193.stdout:Install 1 Package 2024-09-04T16:19:56.681 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:56.681 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 3.1 M 2024-09-04T16:19:56.681 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 13 M 2024-09-04T16:19:56.681 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-04T16:19:57.019 INFO:teuthology.orchestra.run.smithi193.stdout:rbd-mirror-19.1.1-252.g48920dab.el9.x86_64.rpm 9.2 MB/s | 3.1 MB 00:00 2024-09-04T16:19:57.019 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:57.020 INFO:teuthology.orchestra.run.smithi193.stdout:Total 9.1 MB/s | 3.1 MB 00:00 2024-09-04T16:19:57.020 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-04T16:19:57.029 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-04T16:19:57.029 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-04T16:19:57.110 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-04T16:19:57.110 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-04T16:19:57.550 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-04T16:19:57.620 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-mirror-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:57.643 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: rbd-mirror-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:57.663 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-04T16:19:57.663 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-04T16:19:57.663 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-04T16:19:57.663 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-04T16:19:57.663 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:58.765 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-mirror-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:19:58.765 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:58.765 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-04T16:19:58.765 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-mirror-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:19:58.765 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:58.765 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:19:59.009 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install rbd-nbd 2024-09-04T16:19:59.568 INFO:teuthology.orchestra.run.smithi193.stdout:Last metadata expiration check: 0:01:51 ago on Wed 04 Sep 2024 04:18:08 PM UTC. 2024-09-04T16:19:59.702 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-04T16:19:59.703 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: Package Architecture Version Repository Size 2024-09-04T16:19:59.703 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:59.703 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-04T16:19:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-nbd x86_64 2:19.1.1-252.g48920dab.el9 ceph 171 k 2024-09-04T16:19:59.703 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:59.703 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-04T16:19:59.704 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-04T16:19:59.704 INFO:teuthology.orchestra.run.smithi193.stdout:Install 1 Package 2024-09-04T16:19:59.704 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:19:59.704 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 171 k 2024-09-04T16:19:59.704 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 494 k 2024-09-04T16:19:59.704 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-04T16:19:59.915 INFO:teuthology.orchestra.run.smithi193.stdout:rbd-nbd-19.1.1-252.g48920dab.el9.x86_64.rpm 809 kB/s | 171 kB 00:00 2024-09-04T16:19:59.916 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:19:59.916 INFO:teuthology.orchestra.run.smithi193.stdout:Total 803 kB/s | 171 kB 00:00 2024-09-04T16:19:59.916 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-04T16:19:59.924 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-04T16:19:59.924 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-04T16:19:59.988 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-04T16:19:59.988 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-04T16:20:00.138 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-04T16:20:00.253 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-nbd-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:20:00.651 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: rbd-nbd-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:20:00.895 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-nbd-2:19.1.1-252.g48920dab.el9.x86_64 1/1 2024-09-04T16:20:00.895 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:20:00.895 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-04T16:20:00.895 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-nbd-2:19.1.1-252.g48920dab.el9.x86_64 2024-09-04T16:20:00.895 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:20:00.896 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-04T16:20:01.131 DEBUG:teuthology.parallel:result is None 2024-09-04T16:20:01.131 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-04T16:20:01.132 INFO:teuthology.packaging:ref: None 2024-09-04T16:20:01.132 INFO:teuthology.packaging:tag: None 2024-09-04T16:20:01.132 INFO:teuthology.packaging:branch: squid 2024-09-04T16:20:01.132 INFO:teuthology.packaging:sha1: f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:20:01.132 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-04T16:20:01.332 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-04T16:20:01.358 INFO:teuthology.orchestra.run.smithi170.stdout:19.1.1-252.g48920dab.el9 2024-09-04T16:20:01.359 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-252.g48920dab.el9 2024-09-04T16:20:01.359 INFO:teuthology.task.install:The correct ceph version 19.1.1-252.g48920dab is installed. 2024-09-04T16:20:01.361 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-04T16:20:01.361 INFO:teuthology.packaging:ref: None 2024-09-04T16:20:01.361 INFO:teuthology.packaging:tag: None 2024-09-04T16:20:01.361 INFO:teuthology.packaging:branch: squid 2024-09-04T16:20:01.362 INFO:teuthology.packaging:sha1: f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:20:01.362 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-04T16:20:01.554 DEBUG:teuthology.orchestra.run.smithi193:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-04T16:20:01.577 INFO:teuthology.orchestra.run.smithi193.stdout:19.1.1-252.g48920dab.el9 2024-09-04T16:20:01.577 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-252.g48920dab.el9 2024-09-04T16:20:01.577 INFO:teuthology.task.install:The correct ceph version 19.1.1-252.g48920dab is installed. 2024-09-04T16:20:01.579 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-04T16:20:01.579 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:20:01.580 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-04T16:20:01.612 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-04T16:20:01.612 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-04T16:20:01.643 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-04T16:20:01.644 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:20:01.644 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2024-09-04T16:20:01.681 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-04T16:20:01.747 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-04T16:20:01.748 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/daemon-helper 2024-09-04T16:20:01.773 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-04T16:20:01.840 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-04T16:20:01.840 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:20:01.840 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-04T16:20:01.867 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-04T16:20:01.933 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-04T16:20:01.933 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-04T16:20:01.958 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-04T16:20:02.022 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-04T16:20:02.022 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:20:02.022 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2024-09-04T16:20:02.047 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-04T16:20:02.113 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-04T16:20:02.113 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/stdin-killer 2024-09-04T16:20:02.137 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-04T16:20:02.202 INFO:teuthology.run_tasks:Running task print... 2024-09-04T16:20:02.212 INFO:teuthology.task.print:**** done install task... 2024-09-04T16:20:02.212 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-04T16:20:02.317 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'squid', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.ceph.io/ceph-ci/ceph:squid', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'f9fcca5273b6971f640393d33a94730179073754'} 2024-09-04T16:20:02.318 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:squid 2024-09-04T16:20:02.318 INFO:tasks.cephadm:Cluster fsid is 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:20:02.318 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-04T16:20:02.318 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-04T16:20:02.318 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi170': '172.21.15.170', 'mon.smithi193': '172.21.15.193'} 2024-09-04T16:20:02.318 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-04T16:20:02.319 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname $(hostname -s) 2024-09-04T16:20:02.345 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname $(hostname -s) 2024-09-04T16:20:02.370 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for squid 2024-09-04T16:20:02.371 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:20:02.513 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'f9fcca5273b6971f640393d33a94730179073754', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82771/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4702-gf9fcca52', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4702.gf9fcca52'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-04-1323/f9fcca5273b6971f640393d33a94730179073754/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-04 15:13:29.184913', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-guits-main-2024-09-04-1323', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-guits-main-2024-09-04-1323/f9fcca5273b6971f640393d33a94730179073754/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-04T16:20:02.724 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 48920dabc954a29bdb7dd91079363a020369bbff from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=squid 2024-09-04T16:20:02.726 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/48920dabc954a29bdb7dd91079363a020369bbff/centos/9/x86_64/flavors/default/cephadm 2024-09-04T16:20:02.726 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/48920dabc954a29bdb7dd91079363a020369bbff/centos/9/x86_64/flavors/default/cephadm 2024-09-04T16:20:02.726 DEBUG:teuthology.orchestra.run.smithi170:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/48920dabc954a29bdb7dd91079363a020369bbff/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-04T16:20:03.114 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r--. 1 ubuntu ubuntu 784480 Sep 4 16:20 /home/ubuntu/cephtest/cephadm 2024-09-04T16:20:03.114 DEBUG:teuthology.orchestra.run.smithi193:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/48920dabc954a29bdb7dd91079363a020369bbff/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-04T16:20:03.507 INFO:teuthology.orchestra.run.smithi193.stdout:-rw-r--r--. 1 ubuntu ubuntu 784480 Sep 4 16:20 /home/ubuntu/cephtest/cephadm 2024-09-04T16:20:03.508 DEBUG:teuthology.orchestra.run.smithi170:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-04T16:20:03.524 DEBUG:teuthology.orchestra.run.smithi193:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-04T16:20:03.552 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:squid on all hosts... 2024-09-04T16:20:03.552 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-04T16:20:03.567 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-04T16:20:05.029 INFO:teuthology.orchestra.run.smithi170.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-04T16:20:05.288 INFO:teuthology.orchestra.run.smithi193.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-04T16:20:31.775 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:20:31.776 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)", 2024-09-04T16:20:31.776 INFO:teuthology.orchestra.run.smithi170.stdout: "image_id": "b708f9119ac7ff42fd43d16a187b6031be084572c948758dbc7d877689a08b9f", 2024-09-04T16:20:31.776 INFO:teuthology.orchestra.run.smithi170.stdout: "repo_digests": [ 2024-09-04T16:20:31.776 INFO:teuthology.orchestra.run.smithi170.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666" 2024-09-04T16:20:31.776 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-09-04T16:20:31.776 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:20:36.587 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-04T16:20:36.587 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_version": "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)", 2024-09-04T16:20:36.588 INFO:teuthology.orchestra.run.smithi193.stdout: "image_id": "b708f9119ac7ff42fd43d16a187b6031be084572c948758dbc7d877689a08b9f", 2024-09-04T16:20:36.588 INFO:teuthology.orchestra.run.smithi193.stdout: "repo_digests": [ 2024-09-04T16:20:36.588 INFO:teuthology.orchestra.run.smithi193.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666" 2024-09-04T16:20:36.588 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-09-04T16:20:36.588 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-04T16:20:36.620 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph 2024-09-04T16:20:36.655 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /etc/ceph 2024-09-04T16:20:36.686 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /etc/ceph 2024-09-04T16:20:36.723 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 777 /etc/ceph 2024-09-04T16:20:36.754 INFO:tasks.cephadm:Writing seed config... 2024-09-04T16:20:36.756 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-04T16:20:36.756 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-04T16:20:36.756 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-04T16:20:36.756 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-04T16:20:36.756 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-04T16:20:36.756 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-04T16:20:36.756 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-04T16:20:36.756 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-04T16:20:36.756 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-04T16:20:36.756 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-04T16:20:36.757 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-04T16:20:36.757 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-04T16:20:36.757 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-04T16:20:36.757 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-04T16:20:36.757 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-04T16:20:36.757 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-04T16:20:36.757 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-04T16:20:36.757 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-04T16:20:36.757 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-04T16:20:36.757 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-04T16:20:36.757 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-04T16:20:36.757 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-04T16:20:36.757 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-04T16:20:36.757 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-04T16:20:36.758 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-04T16:20:36.758 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-04T16:20:36.758 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:20:36.758 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-04T16:20:36.785 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 89be7670-6ad9-11ef-bcd6-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-04T16:20:36.785 DEBUG:teuthology.orchestra.run.smithi170:mon.smithi170> sudo journalctl -f -n 0 -u ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mon.smithi170.service 2024-09-04T16:20:36.828 INFO:tasks.cephadm:Bootstrapping... 2024-09-04T16:20:36.829 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid -v bootstrap --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.170 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-04T16:20:37.036 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-04T16:20:37.036 INFO:teuthology.orchestra.run.smithi170.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:squid', '-v', 'bootstrap', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.170', '--skip-admin-label'] 2024-09-04T16:20:37.037 INFO:teuthology.orchestra.run.smithi170.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-04T16:20:37.037 INFO:teuthology.orchestra.run.smithi170.stdout:Verifying podman|docker is present... 2024-09-04T16:20:37.060 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stdout 5.2.2 2024-09-04T16:20:37.060 INFO:teuthology.orchestra.run.smithi170.stdout:Verifying lvm2 is present... 2024-09-04T16:20:37.060 INFO:teuthology.orchestra.run.smithi170.stdout:Verifying time synchronization is in place... 2024-09-04T16:20:37.067 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-04T16:20:37.068 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-04T16:20:37.074 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-04T16:20:37.074 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout inactive 2024-09-04T16:20:37.080 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout enabled 2024-09-04T16:20:37.087 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout active 2024-09-04T16:20:37.087 INFO:teuthology.orchestra.run.smithi170.stdout:Unit chronyd.service is enabled and running 2024-09-04T16:20:37.087 INFO:teuthology.orchestra.run.smithi170.stdout:Repeating the final host check... 2024-09-04T16:20:37.110 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stdout 5.2.2 2024-09-04T16:20:37.110 INFO:teuthology.orchestra.run.smithi170.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-04T16:20:37.110 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl is present 2024-09-04T16:20:37.110 INFO:teuthology.orchestra.run.smithi170.stdout:lvcreate is present 2024-09-04T16:20:37.117 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-04T16:20:37.117 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-04T16:20:37.123 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-04T16:20:37.123 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout inactive 2024-09-04T16:20:37.129 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout enabled 2024-09-04T16:20:37.136 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout active 2024-09-04T16:20:37.136 INFO:teuthology.orchestra.run.smithi170.stdout:Unit chronyd.service is enabled and running 2024-09-04T16:20:37.136 INFO:teuthology.orchestra.run.smithi170.stdout:Host looks OK 2024-09-04T16:20:37.136 INFO:teuthology.orchestra.run.smithi170.stdout:Cluster fsid: 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:20:37.136 INFO:teuthology.orchestra.run.smithi170.stdout:Acquiring lock 139735546158384 on /run/cephadm/89be7670-6ad9-11ef-bcd6-c7b262605968.lock 2024-09-04T16:20:37.136 INFO:teuthology.orchestra.run.smithi170.stdout:Lock 139735546158384 acquired on /run/cephadm/89be7670-6ad9-11ef-bcd6-c7b262605968.lock 2024-09-04T16:20:37.137 INFO:teuthology.orchestra.run.smithi170.stdout:Verifying IP 172.21.15.170 port 3300 ... 2024-09-04T16:20:37.137 INFO:teuthology.orchestra.run.smithi170.stdout:Verifying IP 172.21.15.170 port 6789 ... 2024-09-04T16:20:37.137 INFO:teuthology.orchestra.run.smithi170.stdout:Base mon IP(s) is [172.21.15.170:3300, 172.21.15.170:6789], mon addrv is [v2:172.21.15.170:3300,v1:172.21.15.170:6789] 2024-09-04T16:20:37.140 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.170 metric 100 2024-09-04T16:20:37.140 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.170 metric 100 2024-09-04T16:20:37.142 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-04T16:20:37.142 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-04T16:20:37.142 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-04T16:20:37.145 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-04T16:20:37.145 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-04T16:20:37.145 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-04T16:20:37.145 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-04T16:20:37.145 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7255/64 scope link noprefixroute 2024-09-04T16:20:37.145 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-04T16:20:37.146 INFO:teuthology.orchestra.run.smithi170.stdout:Mon IP `172.21.15.170` is in CIDR network `172.21.0.0/20` 2024-09-04T16:20:37.147 INFO:teuthology.orchestra.run.smithi170.stdout:Mon IP `172.21.15.170` is in CIDR network `172.21.0.0/20` 2024-09-04T16:20:37.147 INFO:teuthology.orchestra.run.smithi170.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-04T16:20:37.147 INFO:teuthology.orchestra.run.smithi170.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-04T16:20:37.147 INFO:teuthology.orchestra.run.smithi170.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-04T16:20:37.644 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stdout b708f9119ac7ff42fd43d16a187b6031be084572c948758dbc7d877689a08b9f 2024-09-04T16:20:37.644 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:squid... 2024-09-04T16:20:37.644 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stderr Getting image source signatures 2024-09-04T16:20:37.644 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-04T16:20:37.644 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stderr Copying blob sha256:cee90e3ca8dd4d3d1bc34c70363e0a55618a6a14cde1f15c32dc533f78ff3b6e 2024-09-04T16:20:37.644 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stderr Copying config sha256:b708f9119ac7ff42fd43d16a187b6031be084572c948758dbc7d877689a08b9f 2024-09-04T16:20:37.645 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-04T16:20:38.549 INFO:teuthology.orchestra.run.smithi170.stdout:ceph: stdout ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable) 2024-09-04T16:20:38.549 INFO:teuthology.orchestra.run.smithi170.stdout:Ceph version: ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable) 2024-09-04T16:20:38.549 INFO:teuthology.orchestra.run.smithi170.stdout:Extracting ceph user uid/gid from container image... 2024-09-04T16:20:39.463 INFO:teuthology.orchestra.run.smithi170.stdout:stat: stdout 167 167 2024-09-04T16:20:39.463 INFO:teuthology.orchestra.run.smithi170.stdout:Creating initial keys... 2024-09-04T16:20:40.335 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph-authtool: stdout AQDXiNhmRpd5KxAAvWvUBADfwBUrH9O3sm8Vsw== 2024-09-04T16:20:41.199 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph-authtool: stdout AQDYiNhmPmDkJRAAPPt5pRhE9qdNnIzMV0bMMw== 2024-09-04T16:20:42.080 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph-authtool: stdout AQDZiNhmGtZTHxAAsV3OulYUXT8qpRu5zyCPKA== 2024-09-04T16:20:42.081 INFO:teuthology.orchestra.run.smithi170.stdout:Creating initial monmap... 2024-09-04T16:20:42.969 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-04T16:20:42.969 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-04T16:20:42.969 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:20:42.969 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-04T16:20:42.970 INFO:teuthology.orchestra.run.smithi170.stdout:monmaptool for smithi170 [v2:172.21.15.170:3300,v1:172.21.15.170:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-04T16:20:42.970 INFO:teuthology.orchestra.run.smithi170.stdout:setting min_mon_release = quincy 2024-09-04T16:20:42.970 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/monmaptool: set fsid to 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:20:42.970 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-04T16:20:42.970 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:20:42.970 INFO:teuthology.orchestra.run.smithi170.stdout:Creating mon... 2024-09-04T16:20:43.849 INFO:teuthology.orchestra.run.smithi170.stdout:create mon.smithi170 on 2024-09-04T16:20:44.070 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-04T16:20:44.226 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-04T16:20:44.404 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-89be7670-6ad9-11ef-bcd6-c7b262605968.target → /etc/systemd/system/ceph-89be7670-6ad9-11ef-bcd6-c7b262605968.target. 2024-09-04T16:20:44.404 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-89be7670-6ad9-11ef-bcd6-c7b262605968.target → /etc/systemd/system/ceph-89be7670-6ad9-11ef-bcd6-c7b262605968.target. 2024-09-04T16:20:44.654 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mon.smithi170 2024-09-04T16:20:44.655 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Failed to reset failed state of unit ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mon.smithi170.service: Unit ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mon.smithi170.service not loaded. 2024-09-04T16:20:44.826 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-89be7670-6ad9-11ef-bcd6-c7b262605968.target.wants/ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mon.smithi170.service → /etc/systemd/system/ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@.service. 2024-09-04T16:20:45.350 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-04T16:20:45.350 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout disabled 2024-09-04T16:20:45.358 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-04T16:20:45.358 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout inactive 2024-09-04T16:20:45.358 INFO:teuthology.orchestra.run.smithi170.stdout:firewalld.service is not enabled 2024-09-04T16:20:45.359 INFO:teuthology.orchestra.run.smithi170.stdout:Not possible to enable service . firewalld.service is not available 2024-09-04T16:20:45.359 INFO:teuthology.orchestra.run.smithi170.stdout:Waiting for mon to start... 2024-09-04T16:20:45.359 INFO:teuthology.orchestra.run.smithi170.stdout:Waiting for mon... 2024-09-04T16:20:45.435 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:45 smithi170 systemd[1]: Started Ceph mon.smithi170 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:20:46.387 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout cluster: 2024-09-04T16:20:46.387 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout id: 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:20:46.387 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-04T16:20:46.387 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-09-04T16:20:46.387 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout services: 2024-09-04T16:20:46.387 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi170 (age 0.531223s) 2024-09-04T16:20:46.387 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-04T16:20:46.387 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-04T16:20:46.388 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-09-04T16:20:46.388 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout data: 2024-09-04T16:20:46.388 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-04T16:20:46.388 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-04T16:20:46.388 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-04T16:20:46.388 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout pgs: 2024-09-04T16:20:46.388 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-09-04T16:20:46.388 INFO:teuthology.orchestra.run.smithi170.stdout:mon is available 2024-09-04T16:20:46.388 INFO:teuthology.orchestra.run.smithi170.stdout:Assimilating anything we can from ceph.conf... 2024-09-04T16:20:46.509 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:46 smithi170 ceph-mon[28898]: mon.smithi170 is new leader, mons smithi170 in quorum (ranks 0) 2024-09-04T16:20:46.509 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:46 smithi170 ceph-mon[28898]: monmap epoch 1 2024-09-04T16:20:46.509 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:46 smithi170 ceph-mon[28898]: fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:20:46.509 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:46 smithi170 ceph-mon[28898]: last_changed 2024-09-04T16:20:42.443608+0000 2024-09-04T16:20:46.509 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:46 smithi170 ceph-mon[28898]: created 2024-09-04T16:20:42.443608+0000 2024-09-04T16:20:46.509 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:46 smithi170 ceph-mon[28898]: min_mon_release 19 (squid) 2024-09-04T16:20:46.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:46 smithi170 ceph-mon[28898]: election_strategy: 1 2024-09-04T16:20:46.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:46 smithi170 ceph-mon[28898]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.smithi170 2024-09-04T16:20:46.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:46 smithi170 ceph-mon[28898]: fsmap 2024-09-04T16:20:46.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:46 smithi170 ceph-mon[28898]: osdmap e1: 0 total, 0 up, 0 in 2024-09-04T16:20:46.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:46 smithi170 ceph-mon[28898]: mgrmap e1: no daemons active 2024-09-04T16:20:46.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:46 smithi170 ceph-mon[28898]: from='client.? 172.21.15.170:0/624630173' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-04T16:20:47.443 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-09-04T16:20:47.443 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout [global] 2024-09-04T16:20:47.443 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout fsid = 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:20:47.443 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.170:3300,v1:172.21.15.170:6789] 2024-09-04T16:20:47.443 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-04T16:20:47.443 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-04T16:20:47.443 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-04T16:20:47.444 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-04T16:20:47.444 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-09-04T16:20:47.444 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-04T16:20:47.444 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-04T16:20:47.444 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-09-04T16:20:47.444 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout [osd] 2024-09-04T16:20:47.444 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-04T16:20:47.444 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-04T16:20:47.444 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-04T16:20:47.444 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-04T16:20:47.444 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-04T16:20:47.444 INFO:teuthology.orchestra.run.smithi170.stdout:Generating new minimal ceph.conf... 2024-09-04T16:20:47.556 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:47 smithi170 ceph-mon[28898]: from='client.? 172.21.15.170:0/2213138794' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-04T16:20:47.557 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:47 smithi170 ceph-mon[28898]: from='client.? 172.21.15.170:0/2213138794' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-04T16:20:48.415 INFO:teuthology.orchestra.run.smithi170.stdout:Restarting the monitor... 2024-09-04T16:20:48.440 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:48 smithi170 ceph-mon[28898]: from='client.? 172.21.15.170:0/3688309596' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:20:48.848 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:48 smithi170 systemd[1]: Stopping Ceph mon.smithi170 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:20:48.848 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:48 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170[28894]: 2024-09-04T16:20:48.673+0000 7f96e6edc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi170 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T16:20:48.848 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:48 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170[28894]: 2024-09-04T16:20:48.673+0000 7f96e6edc640 -1 mon.smithi170@0(leader) e1 *** Got Signal Terminated *** 2024-09-04T16:20:48.848 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:48 smithi170 podman[29144]: 2024-09-04 16:20:48.848068217 +0000 UTC m=+0.265334946 container died 0d95397f8d891ac02fd7565bdf78ddbef23eb35527d9b8123e0354344236dfe6 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-48920da, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-04T16:20:49.507 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:49 smithi170 podman[29144]: 2024-09-04 16:20:49.190266803 +0000 UTC m=+0.607533531 container cleanup 0d95397f8d891ac02fd7565bdf78ddbef23eb35527d9b8123e0354344236dfe6 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-48920da, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-04T16:20:49.508 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:49 smithi170 bash[29144]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170 2024-09-04T16:20:49.841 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:49 smithi170 podman[29156]: 2024-09-04 16:20:49.507911128 +0000 UTC m=+0.662097130 container remove 0d95397f8d891ac02fd7565bdf78ddbef23eb35527d9b8123e0354344236dfe6 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-48920da) 2024-09-04T16:20:49.842 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:49 smithi170 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mon.smithi170.service: Deactivated successfully. 2024-09-04T16:20:49.842 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:49 smithi170 systemd[1]: Stopped Ceph mon.smithi170 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:20:49.842 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:49 smithi170 systemd[1]: Starting Ceph mon.smithi170 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:20:50.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:49 smithi170 podman[29253]: 2024-09-04 16:20:49.842294822 +0000 UTC m=+0.094316734 container create 194ff39cc041c031a9ab44df9ae890f2392cc9b76de6726c9d520ee0306045e4 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-48920da, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-04T16:20:50.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:49 smithi170 podman[29253]: 2024-09-04 16:20:49.763954515 +0000 UTC m=+0.015976389 image pull b708f9119ac7ff42fd43d16a187b6031be084572c948758dbc7d877689a08b9f quay.ceph.io/ceph-ci/ceph:squid 2024-09-04T16:20:50.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 podman[29253]: 2024-09-04 16:20:50.044578433 +0000 UTC m=+0.296600312 container init 194ff39cc041c031a9ab44df9ae890f2392cc9b76de6726c9d520ee0306045e4 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-48920da, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2) 2024-09-04T16:20:50.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 podman[29253]: 2024-09-04 16:20:50.047662873 +0000 UTC m=+0.299684747 container start 194ff39cc041c031a9ab44df9ae890f2392cc9b76de6726c9d520ee0306045e4 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-48920da, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-04T16:20:50.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: set uid:gid to 167:167 (ceph:ceph) 2024-09-04T16:20:50.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable), process ceph-mon, pid 2 2024-09-04T16:20:50.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: pidfile_write: ignore empty --pid-file 2024-09-04T16:20:50.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: load: jerasure load: lrc 2024-09-04T16:20:50.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: RocksDB version: 7.9.2 2024-09-04T16:20:50.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Git sha 0 2024-09-04T16:20:50.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Compile date 2024-09-03 20:42:00 2024-09-04T16:20:50.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: DB SUMMARY 2024-09-04T16:20:50.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: DB Session ID: 02XVAV6IE53K3TJU5L2M 2024-09-04T16:20:50.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: CURRENT file: CURRENT 2024-09-04T16:20:50.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: IDENTITY file: IDENTITY 2024-09-04T16:20:50.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-04T16:20:50.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi170/store.db dir, Total Num: 1, files: 000008.sst 2024-09-04T16:20:50.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi170/store.db: 000009.log size: 95861 ; 2024-09-04T16:20:50.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.error_if_exists: 0 2024-09-04T16:20:50.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.create_if_missing: 0 2024-09-04T16:20:50.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.paranoid_checks: 1 2024-09-04T16:20:50.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-04T16:20:50.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-04T16:20:50.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-04T16:20:50.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.env: 0x55e983077940 2024-09-04T16:20:50.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.fs: PosixFileSystem 2024-09-04T16:20:50.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.info_log: 0x55e983f838c0 2024-09-04T16:20:50.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_file_opening_threads: 16 2024-09-04T16:20:50.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.statistics: (nil) 2024-09-04T16:20:50.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.use_fsync: 0 2024-09-04T16:20:50.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_log_file_size: 0 2024-09-04T16:20:50.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-04T16:20:50.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-04T16:20:50.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.keep_log_file_num: 1000 2024-09-04T16:20:50.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.recycle_log_file_num: 0 2024-09-04T16:20:50.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.allow_fallocate: 1 2024-09-04T16:20:50.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.allow_mmap_reads: 0 2024-09-04T16:20:50.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.allow_mmap_writes: 0 2024-09-04T16:20:50.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.use_direct_reads: 0 2024-09-04T16:20:50.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-04T16:20:50.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.create_missing_column_families: 0 2024-09-04T16:20:50.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.db_log_dir: 2024-09-04T16:20:50.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.wal_dir: 2024-09-04T16:20:50.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-04T16:20:50.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-04T16:20:50.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-04T16:20:50.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-04T16:20:50.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-04T16:20:50.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-04T16:20:50.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.advise_random_on_open: 1 2024-09-04T16:20:50.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.db_write_buffer_size: 0 2024-09-04T16:20:50.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.write_buffer_manager: 0x55e983f92dc0 2024-09-04T16:20:50.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-04T16:20:50.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-04T16:20:50.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-04T16:20:50.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.rate_limiter: (nil) 2024-09-04T16:20:50.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-04T16:20:50.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.wal_recovery_mode: 2 2024-09-04T16:20:50.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.enable_thread_tracking: 0 2024-09-04T16:20:50.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.enable_pipelined_write: 0 2024-09-04T16:20:50.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.unordered_write: 0 2024-09-04T16:20:50.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-04T16:20:50.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-04T16:20:50.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-04T16:20:50.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-04T16:20:50.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.row_cache: None 2024-09-04T16:20:50.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.wal_filter: None 2024-09-04T16:20:50.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-04T16:20:50.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.allow_ingest_behind: 0 2024-09-04T16:20:50.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.two_write_queues: 0 2024-09-04T16:20:50.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.manual_wal_flush: 0 2024-09-04T16:20:50.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.wal_compression: 0 2024-09-04T16:20:50.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.atomic_flush: 0 2024-09-04T16:20:50.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-04T16:20:50.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-04T16:20:50.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-04T16:20:50.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.log_readahead_size: 0 2024-09-04T16:20:50.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-04T16:20:50.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.best_efforts_recovery: 0 2024-09-04T16:20:50.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-04T16:20:50.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-04T16:20:50.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.allow_data_in_errors: 0 2024-09-04T16:20:50.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.db_host_id: __hostname__ 2024-09-04T16:20:50.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-04T16:20:50.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_background_jobs: 2 2024-09-04T16:20:50.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_background_compactions: -1 2024-09-04T16:20:50.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_subcompactions: 1 2024-09-04T16:20:50.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-04T16:20:50.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-04T16:20:50.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-04T16:20:50.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_total_wal_size: 0 2024-09-04T16:20:50.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-04T16:20:50.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-04T16:20:50.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-04T16:20:50.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-04T16:20:50.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_open_files: -1 2024-09-04T16:20:50.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.bytes_per_sync: 0 2024-09-04T16:20:50.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-04T16:20:50.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-04T16:20:50.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compaction_readahead_size: 0 2024-09-04T16:20:50.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_background_flushes: -1 2024-09-04T16:20:50.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Compression algorithms supported: 2024-09-04T16:20:50.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: kZSTD supported: 0 2024-09-04T16:20:50.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: kXpressCompression supported: 0 2024-09-04T16:20:50.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: kBZip2Compression supported: 0 2024-09-04T16:20:50.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-04T16:20:50.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: kLZ4Compression supported: 1 2024-09-04T16:20:50.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: kZlibCompression supported: 1 2024-09-04T16:20:50.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: kLZ4HCCompression supported: 1 2024-09-04T16:20:50.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: kSnappyCompression supported: 1 2024-09-04T16:20:50.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-04T16:20:50.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-04T16:20:50.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi170/store.db/MANIFEST-000010 2024-09-04T16:20:50.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-04T16:20:50.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-04T16:20:50.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.merge_operator: 2024-09-04T16:20:50.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compaction_filter: None 2024-09-04T16:20:50.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compaction_filter_factory: None 2024-09-04T16:20:50.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.sst_partitioner_factory: None 2024-09-04T16:20:50.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-04T16:20:50.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-04T16:20:50.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e983f83520) 2024-09-04T16:20:50.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: cache_index_and_filter_blocks: 1 2024-09-04T16:20:50.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-04T16:20:50.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-04T16:20:50.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: pin_top_level_index_and_filter: 1 2024-09-04T16:20:50.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: index_type: 0 2024-09-04T16:20:50.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: data_block_index_type: 0 2024-09-04T16:20:50.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: index_shortening: 1 2024-09-04T16:20:50.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-04T16:20:50.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: checksum: 4 2024-09-04T16:20:50.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: no_block_cache: 0 2024-09-04T16:20:50.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_cache: 0x55e983f771f0 2024-09-04T16:20:50.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_cache_name: BinnedLRUCache 2024-09-04T16:20:50.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_cache_options: 2024-09-04T16:20:50.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: capacity : 536870912 2024-09-04T16:20:50.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: num_shard_bits : 4 2024-09-04T16:20:50.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: strict_capacity_limit : 0 2024-09-04T16:20:50.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: high_pri_pool_ratio: 0.000 2024-09-04T16:20:50.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_cache_compressed: (nil) 2024-09-04T16:20:50.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: persistent_cache: (nil) 2024-09-04T16:20:50.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_size: 4096 2024-09-04T16:20:50.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_size_deviation: 10 2024-09-04T16:20:50.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_restart_interval: 16 2024-09-04T16:20:50.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: index_block_restart_interval: 1 2024-09-04T16:20:50.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: metadata_block_size: 4096 2024-09-04T16:20:50.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: partition_filters: 0 2024-09-04T16:20:50.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: use_delta_encoding: 1 2024-09-04T16:20:50.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: filter_policy: bloomfilter 2024-09-04T16:20:50.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: whole_key_filtering: 1 2024-09-04T16:20:50.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: verify_compression: 0 2024-09-04T16:20:50.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: read_amp_bytes_per_bit: 0 2024-09-04T16:20:50.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: format_version: 5 2024-09-04T16:20:50.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: enable_index_compression: 1 2024-09-04T16:20:50.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_align: 0 2024-09-04T16:20:50.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: max_auto_readahead_size: 262144 2024-09-04T16:20:50.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: prepopulate_block_cache: 0 2024-09-04T16:20:50.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: initial_auto_readahead_size: 8192 2024-09-04T16:20:50.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: num_file_reads_for_auto_readahead: 2 2024-09-04T16:20:50.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.write_buffer_size: 33554432 2024-09-04T16:20:50.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_write_buffer_number: 2 2024-09-04T16:20:50.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compression: NoCompression 2024-09-04T16:20:50.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.bottommost_compression: Disabled 2024-09-04T16:20:50.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.prefix_extractor: nullptr 2024-09-04T16:20:50.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-04T16:20:50.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.num_levels: 7 2024-09-04T16:20:50.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-04T16:20:50.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-04T16:20:50.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-04T16:20:50.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-04T16:20:50.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-04T16:20:50.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-04T16:20:50.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-04T16:20:50.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-04T16:20:50.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-04T16:20:50.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-04T16:20:50.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-04T16:20:50.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-04T16:20:50.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-04T16:20:50.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compression_opts.level: 32767 2024-09-04T16:20:50.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compression_opts.strategy: 0 2024-09-04T16:20:50.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-04T16:20:50.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-04T16:20:50.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-04T16:20:50.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-04T16:20:50.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compression_opts.enabled: false 2024-09-04T16:20:50.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-04T16:20:50.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-04T16:20:50.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-04T16:20:50.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-04T16:20:50.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.target_file_size_base: 67108864 2024-09-04T16:20:50.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-04T16:20:50.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-04T16:20:50.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-04T16:20:50.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-04T16:20:50.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-04T16:20:50.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-04T16:20:50.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-04T16:20:50.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-04T16:20:50.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-04T16:20:50.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-04T16:20:50.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-04T16:20:50.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-04T16:20:50.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-04T16:20:50.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-04T16:20:50.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.arena_block_size: 1048576 2024-09-04T16:20:50.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-04T16:20:50.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-04T16:20:50.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.disable_auto_compactions: 0 2024-09-04T16:20:50.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-04T16:20:50.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-04T16:20:50.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-04T16:20:50.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-04T16:20:50.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-04T16:20:50.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-04T16:20:50.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-04T16:20:50.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-04T16:20:50.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-04T16:20:50.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-04T16:20:50.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-04T16:20:50.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.inplace_update_support: 0 2024-09-04T16:20:50.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-04T16:20:50.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-04T16:20:50.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-04T16:20:50.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-04T16:20:50.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.bloom_locality: 0 2024-09-04T16:20:50.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.max_successive_merges: 0 2024-09-04T16:20:50.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-04T16:20:50.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.paranoid_file_checks: 0 2024-09-04T16:20:50.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.force_consistency_checks: 1 2024-09-04T16:20:50.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.report_bg_io_stats: 0 2024-09-04T16:20:50.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.ttl: 2592000 2024-09-04T16:20:50.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-04T16:20:50.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-04T16:20:50.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-04T16:20:50.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.enable_blob_files: false 2024-09-04T16:20:50.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.min_blob_size: 0 2024-09-04T16:20:50.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.blob_file_size: 268435456 2024-09-04T16:20:50.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-04T16:20:50.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-04T16:20:50.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-04T16:20:50.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-04T16:20:50.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-04T16:20:50.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.blob_file_starting_level: 0 2024-09-04T16:20:50.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-04T16:20:50.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi170/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-04T16:20:50.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-04T16:20:50.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2ff660b3-4277-464e-9f22-6edc170e21a3 2024-09-04T16:20:50.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725466850073758, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-04T16:20:50.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-04T16:20:50.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725466850074708, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91862, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 288, "table_properties": {"data_size": 89903, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11912, "raw_average_key_size": 48, "raw_value_size": 83271, "raw_average_value_size": 337, "num_data_blocks": 12, "num_entries": 247, "num_filter_entries": 247, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725466850, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2ff660b3-4277-464e-9f22-6edc170e21a3", "db_session_id": "02XVAV6IE53K3TJU5L2M", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-04T16:20:50.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725466850074802, "job": 1, "event": "recovery_finished"} 2024-09-04T16:20:50.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-04T16:20:50.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi170/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-04T16:20:50.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e983fa4e00 2024-09-04T16:20:50.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: DB pointer 0x55e9840a0000 2024-09-04T16:20:50.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-04T16:20:50.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-04T16:20:50.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ** DB Stats ** 2024-09-04T16:20:50.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-04T16:20:50.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-04T16:20:50.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-04T16:20:50.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-04T16:20:50.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-04T16:20:50.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-04T16:20:50.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-04T16:20:50.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-09-04T16:20:50.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-04T16:20:50.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-04T16:20:50.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-04T16:20:50.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: L0 2/0 91.61 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-04T16:20:50.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Sum 2/0 91.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-04T16:20:50.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-04T16:20:50.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-09-04T16:20:50.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-04T16:20:50.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-04T16:20:50.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-04T16:20:50.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 139.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-04T16:20:50.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-09-04T16:20:50.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-04T16:20:50.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-09-04T16:20:50.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-04T16:20:50.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-04T16:20:50.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-04T16:20:50.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-04T16:20:50.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-04T16:20:50.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-04T16:20:50.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Cumulative compaction: 0.00 GB write, 28.73 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-04T16:20:50.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Interval compaction: 0.00 GB write, 28.73 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-04T16:20:50.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-04T16:20:50.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Block cache BinnedLRUCache@0x55e983f771f0#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-04T16:20:50.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-04T16:20:50.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-09-04T16:20:50.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-04T16:20:50.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: starting mon.smithi170 rank 0 at public addrs [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] at bind addrs [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi170 fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:20:50.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: mon.smithi170@-1(???) e1 preinit fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:20:50.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: mon.smithi170@-1(???).mds e1 new map 2024-09-04T16:20:50.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: mon.smithi170@-1(???).mds e1 print_map 2024-09-04T16:20:50.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: e1 2024-09-04T16:20:50.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: btime 2024-09-04T16:20:45:300930+0000 2024-09-04T16:20:50.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:20:50.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:20:50.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: legacy client fscid: -1 2024-09-04T16:20:50.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-09-04T16:20:50.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: No filesystems configured 2024-09-04T16:20:50.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: mon.smithi170@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-04T16:20:50.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: mon.smithi170@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-04T16:20:50.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: mon.smithi170@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-04T16:20:50.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: mon.smithi170@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-04T16:20:50.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: mon.smithi170@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-04T16:20:50.132 INFO:teuthology.orchestra.run.smithi170.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-04T16:20:50.446 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 bash[29253]: 194ff39cc041c031a9ab44df9ae890f2392cc9b76de6726c9d520ee0306045e4 2024-09-04T16:20:50.447 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 systemd[1]: Started Ceph mon.smithi170 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:20:50.447 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: mon.smithi170 is new leader, mons smithi170 in quorum (ranks 0) 2024-09-04T16:20:50.447 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: monmap epoch 1 2024-09-04T16:20:50.447 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:20:50.447 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: last_changed 2024-09-04T16:20:42.443608+0000 2024-09-04T16:20:50.447 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: created 2024-09-04T16:20:42.443608+0000 2024-09-04T16:20:50.448 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: min_mon_release 19 (squid) 2024-09-04T16:20:50.448 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: election_strategy: 1 2024-09-04T16:20:50.448 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.smithi170 2024-09-04T16:20:50.448 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: fsmap 2024-09-04T16:20:50.448 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: osdmap e1: 0 total, 0 up, 0 in 2024-09-04T16:20:50.448 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:50 smithi170 ceph-mon[29272]: mgrmap e1: no daemons active 2024-09-04T16:20:51.137 INFO:teuthology.orchestra.run.smithi170.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-04T16:20:51.158 INFO:teuthology.orchestra.run.smithi170.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-04T16:20:51.158 INFO:teuthology.orchestra.run.smithi170.stdout:Creating mgr... 2024-09-04T16:20:51.159 INFO:teuthology.orchestra.run.smithi170.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-04T16:20:51.159 INFO:teuthology.orchestra.run.smithi170.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-04T16:20:51.159 INFO:teuthology.orchestra.run.smithi170.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-04T16:20:51.409 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mgr.smithi170.fbszap 2024-09-04T16:20:51.409 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Failed to reset failed state of unit ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mgr.smithi170.fbszap.service: Unit ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mgr.smithi170.fbszap.service not loaded. 2024-09-04T16:20:51.555 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-89be7670-6ad9-11ef-bcd6-c7b262605968.target.wants/ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mgr.smithi170.fbszap.service → /etc/systemd/system/ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@.service. 2024-09-04T16:20:51.777 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:51 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2104448565' entity='client.admin' 2024-09-04T16:20:52.060 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-04T16:20:52.060 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout disabled 2024-09-04T16:20:52.067 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-04T16:20:52.067 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout inactive 2024-09-04T16:20:52.067 INFO:teuthology.orchestra.run.smithi170.stdout:firewalld.service is not enabled 2024-09-04T16:20:52.067 INFO:teuthology.orchestra.run.smithi170.stdout:Not possible to enable service . firewalld.service is not available 2024-09-04T16:20:52.076 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-04T16:20:52.076 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout disabled 2024-09-04T16:20:52.083 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-04T16:20:52.084 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout inactive 2024-09-04T16:20:52.084 INFO:teuthology.orchestra.run.smithi170.stdout:firewalld.service is not enabled 2024-09-04T16:20:52.084 INFO:teuthology.orchestra.run.smithi170.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-04T16:20:52.084 INFO:teuthology.orchestra.run.smithi170.stdout:Waiting for mgr to start... 2024-09-04T16:20:52.084 INFO:teuthology.orchestra.run.smithi170.stdout:Waiting for mgr... 2024-09-04T16:20:52.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:52 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1152253683' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-04T16:20:53.161 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-09-04T16:20:53.161 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout { 2024-09-04T16:20:53.161 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "fsid": "89be7670-6ad9-11ef-bcd6-c7b262605968", 2024-09-04T16:20:53.161 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "health": { 2024-09-04T16:20:53.161 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-04T16:20:53.161 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-04T16:20:53.161 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-04T16:20:53.161 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-09-04T16:20:53.161 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-04T16:20:53.162 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-04T16:20:53.162 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 0 2024-09-04T16:20:53.162 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-09-04T16:20:53.162 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-04T16:20:53.162 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "smithi170" 2024-09-04T16:20:53.162 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-09-04T16:20:53.162 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-04T16:20:53.162 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-04T16:20:53.162 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-04T16:20:53.162 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-04T16:20:53.162 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-04T16:20:53.162 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-09-04T16:20:53.162 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-04T16:20:53.163 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-04T16:20:53.163 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-04T16:20:53.163 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-04T16:20:53.163 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-04T16:20:53.163 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-04T16:20:53.163 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-04T16:20:53.163 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-04T16:20:53.163 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-09-04T16:20:53.163 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-04T16:20:53.163 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-04T16:20:53.163 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-04T16:20:53.163 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-04T16:20:53.163 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-04T16:20:53.164 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-04T16:20:53.164 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-04T16:20:53.164 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-04T16:20:53.164 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-04T16:20:53.164 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-09-04T16:20:53.164 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-04T16:20:53.164 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-04T16:20:53.164 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "btime": "2024-09-04T16:20:45:300930+0000", 2024-09-04T16:20:53.164 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-04T16:20:53.164 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-04T16:20:53.164 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-09-04T16:20:53.164 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-04T16:20:53.164 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-04T16:20:53.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-04T16:20:53.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-04T16:20:53.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-04T16:20:53.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-04T16:20:53.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "restful" 2024-09-04T16:20:53.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-09-04T16:20:53.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-04T16:20:53.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-09-04T16:20:53.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-04T16:20:53.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-04T16:20:53.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "modified": "2024-09-04T16:20:45.301530+0000", 2024-09-04T16:20:53.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-04T16:20:53.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-09-04T16:20:53.166 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-04T16:20:53.166 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout } 2024-09-04T16:20:53.166 INFO:teuthology.orchestra.run.smithi170.stdout:mgr not available, waiting (1/15)... 2024-09-04T16:20:57.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:56 smithi170 ceph-mon[29272]: Activating manager daemon smithi170.fbszap 2024-09-04T16:20:57.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:56 smithi170 ceph-mon[29272]: mgrmap e2: smithi170.fbszap(active, starting, since 0.00315421s) 2024-09-04T16:20:57.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:56 smithi170 ceph-mon[29272]: from='mgr.14100 172.21.15.170:0/3558603522' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-04T16:20:57.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:56 smithi170 ceph-mon[29272]: from='mgr.14100 172.21.15.170:0/3558603522' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-04T16:20:57.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:56 smithi170 ceph-mon[29272]: from='mgr.14100 172.21.15.170:0/3558603522' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-04T16:20:57.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:56 smithi170 ceph-mon[29272]: from='mgr.14100 172.21.15.170:0/3558603522' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-09-04T16:20:57.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:56 smithi170 ceph-mon[29272]: from='mgr.14100 172.21.15.170:0/3558603522' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr metadata", "who": "smithi170.fbszap", "id": "smithi170.fbszap"}]: dispatch 2024-09-04T16:20:57.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:56 smithi170 ceph-mon[29272]: Manager daemon smithi170.fbszap is now available 2024-09-04T16:20:57.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:56 smithi170 ceph-mon[29272]: from='mgr.14100 172.21.15.170:0/3558603522' entity='mgr.smithi170.fbszap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.fbszap/mirror_snapshot_schedule"}]: dispatch 2024-09-04T16:20:57.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:56 smithi170 ceph-mon[29272]: from='mgr.14100 172.21.15.170:0/3558603522' entity='mgr.smithi170.fbszap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.fbszap/trash_purge_schedule"}]: dispatch 2024-09-04T16:20:57.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:56 smithi170 ceph-mon[29272]: from='mgr.14100 172.21.15.170:0/3558603522' entity='mgr.smithi170.fbszap' 2024-09-04T16:20:57.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:56 smithi170 ceph-mon[29272]: from='mgr.14100 172.21.15.170:0/3558603522' entity='mgr.smithi170.fbszap' 2024-09-04T16:20:57.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:56 smithi170 ceph-mon[29272]: from='mgr.14100 172.21.15.170:0/3558603522' entity='mgr.smithi170.fbszap' 2024-09-04T16:20:59.095 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:58 smithi170 ceph-mon[29272]: mgrmap e3: smithi170.fbszap(active, since 1.0072s) 2024-09-04T16:20:59.095 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:58 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1198911167' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-04T16:21:00.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:20:59 smithi170 ceph-mon[29272]: mgrmap e4: smithi170.fbszap(active, since 2s) 2024-09-04T16:21:05.225 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-09-04T16:21:05.226 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout { 2024-09-04T16:21:05.226 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "fsid": "89be7670-6ad9-11ef-bcd6-c7b262605968", 2024-09-04T16:21:05.226 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "health": { 2024-09-04T16:21:05.226 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-04T16:21:05.226 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-04T16:21:05.226 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-04T16:21:05.226 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-09-04T16:21:05.226 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-04T16:21:05.226 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-04T16:21:05.226 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 0 2024-09-04T16:21:05.226 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-09-04T16:21:05.226 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-04T16:21:05.227 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "smithi170" 2024-09-04T16:21:05.227 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-09-04T16:21:05.227 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-04T16:21:05.227 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-04T16:21:05.227 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-04T16:21:05.227 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-04T16:21:05.227 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-04T16:21:05.227 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-09-04T16:21:05.227 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-04T16:21:05.227 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-04T16:21:05.227 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-04T16:21:05.227 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-04T16:21:05.227 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-04T16:21:05.227 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-04T16:21:05.231 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-04T16:21:05.231 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-04T16:21:05.231 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-09-04T16:21:05.231 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-04T16:21:05.231 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-04T16:21:05.231 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-04T16:21:05.231 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-04T16:21:05.232 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-04T16:21:05.232 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-04T16:21:05.232 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-04T16:21:05.232 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-04T16:21:05.232 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-04T16:21:05.232 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-09-04T16:21:05.232 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-04T16:21:05.232 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-04T16:21:05.232 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "btime": "2024-09-04T16:20:45:300930+0000", 2024-09-04T16:21:05.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-04T16:21:05.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-04T16:21:05.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-09-04T16:21:05.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-04T16:21:05.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-04T16:21:05.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-04T16:21:05.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-04T16:21:05.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-04T16:21:05.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-04T16:21:05.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "restful" 2024-09-04T16:21:05.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-09-04T16:21:05.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-04T16:21:05.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-09-04T16:21:05.234 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-04T16:21:05.234 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-04T16:21:05.235 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "modified": "2024-09-04T16:20:45.301530+0000", 2024-09-04T16:21:05.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-04T16:21:05.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-09-04T16:21:05.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-04T16:21:05.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout } 2024-09-04T16:21:05.236 INFO:teuthology.orchestra.run.smithi170.stdout:mgr is available 2024-09-04T16:21:06.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:06 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/4080325711' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-04T16:21:07.118 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-09-04T16:21:07.118 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout [global] 2024-09-04T16:21:07.119 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout fsid = 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:21:07.119 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.170:3300,v1:172.21.15.170:6789] 2024-09-04T16:21:07.119 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-04T16:21:07.119 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-04T16:21:07.119 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-04T16:21:07.119 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-04T16:21:07.119 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-09-04T16:21:07.119 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-04T16:21:07.119 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-04T16:21:07.119 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-09-04T16:21:07.119 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout [osd] 2024-09-04T16:21:07.119 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-04T16:21:07.119 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-04T16:21:07.120 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-04T16:21:07.120 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-04T16:21:07.120 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-04T16:21:07.120 INFO:teuthology.orchestra.run.smithi170.stdout:Enabling cephadm module... 2024-09-04T16:21:08.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:07 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3210589377' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-04T16:21:09.082 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:08 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3210589377' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-04T16:21:09.082 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:08 smithi170 ceph-mon[29272]: mgrmap e5: smithi170.fbszap(active, since 10s) 2024-09-04T16:21:09.647 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout { 2024-09-04T16:21:09.647 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-04T16:21:09.647 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-04T16:21:09.647 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "active_name": "smithi170.fbszap", 2024-09-04T16:21:09.647 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-04T16:21:09.647 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout } 2024-09-04T16:21:09.648 INFO:teuthology.orchestra.run.smithi170.stdout:Waiting for the mgr to restart... 2024-09-04T16:21:09.648 INFO:teuthology.orchestra.run.smithi170.stdout:Waiting for mgr epoch 5... 2024-09-04T16:21:10.071 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:09 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2270502008' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-04T16:21:13.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:12 smithi170 ceph-mon[29272]: Active manager daemon smithi170.fbszap restarted 2024-09-04T16:21:13.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:12 smithi170 ceph-mon[29272]: Activating manager daemon smithi170.fbszap 2024-09-04T16:21:13.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:12 smithi170 ceph-mon[29272]: osdmap e2: 0 total, 0 up, 0 in 2024-09-04T16:21:13.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:12 smithi170 ceph-mon[29272]: mgrmap e6: smithi170.fbszap(active, starting, since 0.0031466s) 2024-09-04T16:21:13.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:12 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-09-04T16:21:13.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:12 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr metadata", "who": "smithi170.fbszap", "id": "smithi170.fbszap"}]: dispatch 2024-09-04T16:21:13.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:12 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-04T16:21:13.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:12 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-04T16:21:13.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:12 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-04T16:21:13.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:12 smithi170 ceph-mon[29272]: Manager daemon smithi170.fbszap is now available 2024-09-04T16:21:13.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:12 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:13.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:12 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:13.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:12 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:21:13.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:12 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:21:13.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:12 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.fbszap/mirror_snapshot_schedule"}]: dispatch 2024-09-04T16:21:13.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:12 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.fbszap/trash_purge_schedule"}]: dispatch 2024-09-04T16:21:13.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:13 smithi170 ceph-mon[29272]: Found migration_current of "None". Setting to last migration. 2024-09-04T16:21:13.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:13 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:13.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:13 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:13.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:13 smithi170 ceph-mon[29272]: mgrmap e7: smithi170.fbszap(active, since 1.00484s) 2024-09-04T16:21:14.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout { 2024-09-04T16:21:14.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-04T16:21:14.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-04T16:21:14.165 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout } 2024-09-04T16:21:14.165 INFO:teuthology.orchestra.run.smithi170.stdout:mgr epoch 5 is available 2024-09-04T16:21:14.165 INFO:teuthology.orchestra.run.smithi170.stdout:Setting orchestrator backend to cephadm... 2024-09-04T16:21:14.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:14 smithi170 ceph-mon[29272]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-04T16:21:14.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:14 smithi170 ceph-mon[29272]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-04T16:21:14.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:14 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:21:16.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:15 smithi170 ceph-mon[29272]: [04/Sep/2024:16:21:14] ENGINE Bus STARTING 2024-09-04T16:21:16.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:15 smithi170 ceph-mon[29272]: [04/Sep/2024:16:21:14] ENGINE Serving on http://172.21.15.170:8765 2024-09-04T16:21:16.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:15 smithi170 ceph-mon[29272]: [04/Sep/2024:16:21:14] ENGINE Serving on https://172.21.15.170:7150 2024-09-04T16:21:16.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:15 smithi170 ceph-mon[29272]: [04/Sep/2024:16:21:14] ENGINE Bus STARTED 2024-09-04T16:21:16.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:15 smithi170 ceph-mon[29272]: [04/Sep/2024:16:21:14] ENGINE Error in HTTPServer.serve 2024-09-04T16:21:16.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Traceback (most recent call last): 2024-09-04T16:21:16.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-04T16:21:16.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self._connections.run(self.expiration_interval) 2024-09-04T16:21:16.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-04T16:21:16.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self._run(expiration_interval) 2024-09-04T16:21:16.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-04T16:21:16.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-04T16:21:16.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-04T16:21:16.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-04T16:21:16.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-04T16:21:16.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: s = self.context.wrap_socket( 2024-09-04T16:21:16.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-04T16:21:16.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: return self.sslsocket_class._create( 2024-09-04T16:21:16.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-04T16:21:16.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self.do_handshake() 2024-09-04T16:21:16.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-04T16:21:16.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self._sslobj.do_handshake() 2024-09-04T16:21:16.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-04T16:21:16.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:15 smithi170 ceph-mon[29272]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:16.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:15 smithi170 ceph-mon[29272]: mgrmap e8: smithi170.fbszap(active, since 2s) 2024-09-04T16:21:16.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:15 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:16.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:15 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:21:16.418 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-04T16:21:16.419 INFO:teuthology.orchestra.run.smithi170.stdout:Generating ssh key... 2024-09-04T16:21:17.082 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:16 smithi170 ceph-mon[29272]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:18.243 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:18 smithi170 ceph-mon[29272]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:18.243 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:18 smithi170 ceph-mon[29272]: Generating ssh key... 2024-09-04T16:21:18.243 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:18 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:18.243 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:18 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:18.790 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHpLny+cwrtr9lc8V/k/BWhiYXtciO8BY4OBZkX9Hp5C5dJDHTsGw+MR3E8vu/K0Zl+u2rtnuGMhMAEhBdl3U4TLFKI2vaw/Chc6nDrr2Cr6Bej7vBKUd9QWxbSZ9dfPhWhXDuBgFKkECRvZrFngJ59Tm7aExsp4u1+6y7dcqsB+7u2/RS9eVVfVUEt14CRMbkXh1QNyudS09+RDlS/7FKOmJ4RevGvC/uavAKVMXCbvX2tzsF1/ZwOcZkbFOogwFoKW0PBsVeYW5lR/qjx9xHptvtszNjQsX2kw/RXahb1pn5SK6vbH3mlWu+YoFW5uFkFJJloQ6MY3Flqu1US4Gc/Ytwh688/W3PjoTdnbX6RnoXFu/LMuRJNp8YV4WJk7EaTuH2LSI7euzZeAgGbPbMphllkPow0obxrbrgovmFHBOGCzofOoX+CdVr6G38ZjLf9ucfglrTkcAPfS7/goM3F5usK4thRfV72h3WwqKEkV4vMObmBjR9S6CxQOELmY0= ceph-89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:21:18.790 INFO:teuthology.orchestra.run.smithi170.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-04T16:21:18.790 INFO:teuthology.orchestra.run.smithi170.stdout:Adding key to root@localhost authorized_keys... 2024-09-04T16:21:18.790 INFO:teuthology.orchestra.run.smithi170.stdout:Adding host smithi170... 2024-09-04T16:21:19.215 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:19 smithi170 ceph-mon[29272]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:20.338 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:20 smithi170 ceph-mon[29272]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi170", "addr": "172.21.15.170", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:21.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:21 smithi170 ceph-mon[29272]: Deploying cephadm binary to smithi170 2024-09-04T16:21:23.240 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout Added host 'smithi170' with addr '172.21.15.170' 2024-09-04T16:21:23.241 INFO:teuthology.orchestra.run.smithi170.stdout:Deploying mon service with default placement... 2024-09-04T16:21:23.538 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:23 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:23.539 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:23 smithi170 ceph-mon[29272]: Added host smithi170 2024-09-04T16:21:23.539 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:23 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:21:24.559 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-04T16:21:24.559 INFO:teuthology.orchestra.run.smithi170.stdout:Deploying mgr service with default placement... 2024-09-04T16:21:25.100 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:24 smithi170 ceph-mon[29272]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:25.100 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:24 smithi170 ceph-mon[29272]: Saving service mon spec with placement count:5 2024-09-04T16:21:25.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:24 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:26.536 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-04T16:21:26.537 INFO:teuthology.orchestra.run.smithi170.stdout:Deploying crash service with default placement... 2024-09-04T16:21:26.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:26 smithi170 ceph-mon[29272]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:26.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:26 smithi170 ceph-mon[29272]: Saving service mgr spec with placement count:2 2024-09-04T16:21:26.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:26 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:26.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:26 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:26.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:26 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:27.995 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-04T16:21:27.995 INFO:teuthology.orchestra.run.smithi170.stdout:Deploying ceph-exporter service with default placement... 2024-09-04T16:21:28.411 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:28 smithi170 ceph-mon[29272]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:28.411 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:28 smithi170 ceph-mon[29272]: Saving service crash spec with placement * 2024-09-04T16:21:28.412 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:28 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:29.345 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-04T16:21:29.345 INFO:teuthology.orchestra.run.smithi170.stdout:Deploying prometheus service with default placement... 2024-09-04T16:21:29.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:29 smithi170 ceph-mon[29272]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:29.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:29 smithi170 ceph-mon[29272]: Saving service ceph-exporter spec with placement * 2024-09-04T16:21:29.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:29 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:29.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:29 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:30.609 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-04T16:21:30.610 INFO:teuthology.orchestra.run.smithi170.stdout:Deploying grafana service with default placement... 2024-09-04T16:21:31.233 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:30 smithi170 ceph-mon[29272]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:31.233 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:30 smithi170 ceph-mon[29272]: Saving service prometheus spec with placement count:1 2024-09-04T16:21:31.233 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:30 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:31.982 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-04T16:21:31.983 INFO:teuthology.orchestra.run.smithi170.stdout:Deploying node-exporter service with default placement... 2024-09-04T16:21:32.316 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:32 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:32.316 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:32 smithi170 ceph-mon[29272]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:32.316 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:32 smithi170 ceph-mon[29272]: Saving service grafana spec with placement count:1 2024-09-04T16:21:32.316 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:32 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:33.602 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-04T16:21:33.602 INFO:teuthology.orchestra.run.smithi170.stdout:Deploying alertmanager service with default placement... 2024-09-04T16:21:33.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:33 smithi170 ceph-mon[29272]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:33.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:33 smithi170 ceph-mon[29272]: Saving service node-exporter spec with placement * 2024-09-04T16:21:33.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:33 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:33.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:33 smithi170 ceph-mon[29272]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:21:34.977 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-04T16:21:35.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:35 smithi170 ceph-mon[29272]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:35.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:35 smithi170 ceph-mon[29272]: Saving service alertmanager spec with placement count:1 2024-09-04T16:21:35.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:35 smithi170 ceph-mon[29272]: from='mgr.14116 172.21.15.170:0/3940343758' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:35.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:35 smithi170 ceph-mon[29272]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:21:36.692 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:36 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2168983130' entity='client.admin' 2024-09-04T16:21:37.238 INFO:teuthology.orchestra.run.smithi170.stdout:Enabling the dashboard module... 2024-09-04T16:21:37.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:37 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3970539735' entity='client.admin' 2024-09-04T16:21:37.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:37 smithi170 ceph-mon[29272]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:21:38.992 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:38 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3849896795' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-04T16:21:39.792 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:39 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3849896795' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-04T16:21:39.793 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:39 smithi170 ceph-mon[29272]: mgrmap e9: smithi170.fbszap(active, since 26s) 2024-09-04T16:21:40.494 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout { 2024-09-04T16:21:40.495 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-04T16:21:40.495 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-04T16:21:40.495 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "active_name": "smithi170.fbszap", 2024-09-04T16:21:40.495 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-04T16:21:40.495 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout } 2024-09-04T16:21:40.495 INFO:teuthology.orchestra.run.smithi170.stdout:Waiting for the mgr to restart... 2024-09-04T16:21:40.495 INFO:teuthology.orchestra.run.smithi170.stdout:Waiting for mgr epoch 9... 2024-09-04T16:21:40.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:40 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3250364033' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-04T16:21:43.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:43 smithi170 ceph-mon[29272]: Active manager daemon smithi170.fbszap restarted 2024-09-04T16:21:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:43 smithi170 ceph-mon[29272]: Activating manager daemon smithi170.fbszap 2024-09-04T16:21:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:43 smithi170 ceph-mon[29272]: osdmap e3: 0 total, 0 up, 0 in 2024-09-04T16:21:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:43 smithi170 ceph-mon[29272]: mgrmap e10: smithi170.fbszap(active, starting, since 0.00316271s) 2024-09-04T16:21:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:43 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-09-04T16:21:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:43 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr metadata", "who": "smithi170.fbszap", "id": "smithi170.fbszap"}]: dispatch 2024-09-04T16:21:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:43 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-04T16:21:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:43 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-04T16:21:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:43 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-04T16:21:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:43 smithi170 ceph-mon[29272]: Manager daemon smithi170.fbszap is now available 2024-09-04T16:21:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:43 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:21:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:43 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.fbszap/mirror_snapshot_schedule"}]: dispatch 2024-09-04T16:21:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:43 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.fbszap/trash_purge_schedule"}]: dispatch 2024-09-04T16:21:45.271 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout { 2024-09-04T16:21:45.271 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-04T16:21:45.271 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-04T16:21:45.271 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout } 2024-09-04T16:21:45.271 INFO:teuthology.orchestra.run.smithi170.stdout:mgr epoch 9 is available 2024-09-04T16:21:45.271 INFO:teuthology.orchestra.run.smithi170.stdout:Generating a dashboard self-signed certificate... 2024-09-04T16:21:45.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:45 smithi170 ceph-mon[29272]: mgrmap e11: smithi170.fbszap(active, since 1.00546s) 2024-09-04T16:21:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:45 smithi170 ceph-mon[29272]: [04/Sep/2024:16:21:44] ENGINE Bus STARTING 2024-09-04T16:21:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:45 smithi170 ceph-mon[29272]: [04/Sep/2024:16:21:44] ENGINE Serving on https://172.21.15.170:7150 2024-09-04T16:21:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:45 smithi170 ceph-mon[29272]: [04/Sep/2024:16:21:44] ENGINE Error in HTTPServer.serve 2024-09-04T16:21:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Traceback (most recent call last): 2024-09-04T16:21:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-04T16:21:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self._connections.run(self.expiration_interval) 2024-09-04T16:21:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-04T16:21:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self._run(expiration_interval) 2024-09-04T16:21:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-04T16:21:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-04T16:21:45.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-04T16:21:45.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-04T16:21:45.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-04T16:21:45.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: s = self.context.wrap_socket( 2024-09-04T16:21:45.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-04T16:21:45.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: return self.sslsocket_class._create( 2024-09-04T16:21:45.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-04T16:21:45.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self.do_handshake() 2024-09-04T16:21:45.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-04T16:21:45.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self._sslobj.do_handshake() 2024-09-04T16:21:45.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-04T16:21:45.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:45 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:46.461 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-04T16:21:46.461 INFO:teuthology.orchestra.run.smithi170.stdout:Creating initial admin user... 2024-09-04T16:21:46.676 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:46 smithi170 ceph-mon[29272]: [04/Sep/2024:16:21:44] ENGINE Serving on http://172.21.15.170:8765 2024-09-04T16:21:46.676 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:46 smithi170 ceph-mon[29272]: [04/Sep/2024:16:21:44] ENGINE Bus STARTED 2024-09-04T16:21:46.676 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:46 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:46.677 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:46 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:46.677 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:46 smithi170 ceph-mon[29272]: mgrmap e12: smithi170.fbszap(active, since 2s) 2024-09-04T16:21:46.677 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:46 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:47.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:47 smithi170 ceph-mon[29272]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:47.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:47 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:48.046 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$7iSvHlaMJ2V1wrl47z9jGO0W/Miv8Js7zc2tmqpt0Yf/5dJy4hIcO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725466907, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-04T16:21:48.046 INFO:teuthology.orchestra.run.smithi170.stdout:Fetching dashboard port number... 2024-09-04T16:21:48.699 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:48 smithi170 ceph-mon[29272]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:49.652 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:49 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3208072068' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-04T16:21:49.655 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 8443 2024-09-04T16:21:49.665 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-04T16:21:49.665 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout disabled 2024-09-04T16:21:49.672 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-04T16:21:49.672 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout inactive 2024-09-04T16:21:49.673 INFO:teuthology.orchestra.run.smithi170.stdout:firewalld.service is not enabled 2024-09-04T16:21:49.673 INFO:teuthology.orchestra.run.smithi170.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-04T16:21:49.674 INFO:teuthology.orchestra.run.smithi170.stdout:Ceph Dashboard is now available at: 2024-09-04T16:21:49.674 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:21:49.675 INFO:teuthology.orchestra.run.smithi170.stdout: URL: https://smithi170:8443/ 2024-09-04T16:21:49.675 INFO:teuthology.orchestra.run.smithi170.stdout: User: admin 2024-09-04T16:21:49.675 INFO:teuthology.orchestra.run.smithi170.stdout: Password: xz4g28bvs7 2024-09-04T16:21:49.675 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:21:49.675 INFO:teuthology.orchestra.run.smithi170.stdout:Saving cluster configuration to /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config directory 2024-09-04T16:21:50.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:50 smithi170 ceph-mon[29272]: mgrmap e13: smithi170.fbszap(active, since 6s) 2024-09-04T16:21:50.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:50 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1581250743' entity='client.admin' 2024-09-04T16:21:50.937 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-04T16:21:50.937 INFO:teuthology.orchestra.run.smithi170.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-04T16:21:50.938 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:21:50.938 INFO:teuthology.orchestra.run.smithi170.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-04T16:21:50.938 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:21:50.938 INFO:teuthology.orchestra.run.smithi170.stdout:Or, if you are only running a single cluster on this host: 2024-09-04T16:21:50.938 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:21:50.938 INFO:teuthology.orchestra.run.smithi170.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-04T16:21:50.938 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:21:50.938 INFO:teuthology.orchestra.run.smithi170.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-04T16:21:50.938 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:21:50.938 INFO:teuthology.orchestra.run.smithi170.stdout: ceph telemetry on 2024-09-04T16:21:50.938 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:21:50.938 INFO:teuthology.orchestra.run.smithi170.stdout:For more information see: 2024-09-04T16:21:50.939 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:21:50.939 INFO:teuthology.orchestra.run.smithi170.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-04T16:21:50.939 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:21:50.939 INFO:teuthology.orchestra.run.smithi170.stdout:Bootstrap complete. 2024-09-04T16:21:50.985 INFO:tasks.cephadm:Fetching config... 2024-09-04T16:21:50.985 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:21:50.986 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-04T16:21:51.004 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-04T16:21:51.004 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:21:51.004 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-04T16:21:51.060 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-04T16:21:51.060 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:21:51.061 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/keyring of=/dev/stdout 2024-09-04T16:21:51.126 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-04T16:21:51.126 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:21:51.126 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-04T16:21:51.182 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-04T16:21:51.182 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHpLny+cwrtr9lc8V/k/BWhiYXtciO8BY4OBZkX9Hp5C5dJDHTsGw+MR3E8vu/K0Zl+u2rtnuGMhMAEhBdl3U4TLFKI2vaw/Chc6nDrr2Cr6Bej7vBKUd9QWxbSZ9dfPhWhXDuBgFKkECRvZrFngJ59Tm7aExsp4u1+6y7dcqsB+7u2/RS9eVVfVUEt14CRMbkXh1QNyudS09+RDlS/7FKOmJ4RevGvC/uavAKVMXCbvX2tzsF1/ZwOcZkbFOogwFoKW0PBsVeYW5lR/qjx9xHptvtszNjQsX2kw/RXahb1pn5SK6vbH3mlWu+YoFW5uFkFJJloQ6MY3Flqu1US4Gc/Ytwh688/W3PjoTdnbX6RnoXFu/LMuRJNp8YV4WJk7EaTuH2LSI7euzZeAgGbPbMphllkPow0obxrbrgovmFHBOGCzofOoX+CdVr6G38ZjLf9ucfglrTkcAPfS7/goM3F5usK4thRfV72h3WwqKEkV4vMObmBjR9S6CxQOELmY0= ceph-89be7670-6ad9-11ef-bcd6-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-04T16:21:51.258 INFO:teuthology.orchestra.run.smithi170.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHpLny+cwrtr9lc8V/k/BWhiYXtciO8BY4OBZkX9Hp5C5dJDHTsGw+MR3E8vu/K0Zl+u2rtnuGMhMAEhBdl3U4TLFKI2vaw/Chc6nDrr2Cr6Bej7vBKUd9QWxbSZ9dfPhWhXDuBgFKkECRvZrFngJ59Tm7aExsp4u1+6y7dcqsB+7u2/RS9eVVfVUEt14CRMbkXh1QNyudS09+RDlS/7FKOmJ4RevGvC/uavAKVMXCbvX2tzsF1/ZwOcZkbFOogwFoKW0PBsVeYW5lR/qjx9xHptvtszNjQsX2kw/RXahb1pn5SK6vbH3mlWu+YoFW5uFkFJJloQ6MY3Flqu1US4Gc/Ytwh688/W3PjoTdnbX6RnoXFu/LMuRJNp8YV4WJk7EaTuH2LSI7euzZeAgGbPbMphllkPow0obxrbrgovmFHBOGCzofOoX+CdVr6G38ZjLf9ucfglrTkcAPfS7/goM3F5usK4thRfV72h3WwqKEkV4vMObmBjR9S6CxQOELmY0= ceph-89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:21:51.274 DEBUG:teuthology.orchestra.run.smithi193:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHpLny+cwrtr9lc8V/k/BWhiYXtciO8BY4OBZkX9Hp5C5dJDHTsGw+MR3E8vu/K0Zl+u2rtnuGMhMAEhBdl3U4TLFKI2vaw/Chc6nDrr2Cr6Bej7vBKUd9QWxbSZ9dfPhWhXDuBgFKkECRvZrFngJ59Tm7aExsp4u1+6y7dcqsB+7u2/RS9eVVfVUEt14CRMbkXh1QNyudS09+RDlS/7FKOmJ4RevGvC/uavAKVMXCbvX2tzsF1/ZwOcZkbFOogwFoKW0PBsVeYW5lR/qjx9xHptvtszNjQsX2kw/RXahb1pn5SK6vbH3mlWu+YoFW5uFkFJJloQ6MY3Flqu1US4Gc/Ytwh688/W3PjoTdnbX6RnoXFu/LMuRJNp8YV4WJk7EaTuH2LSI7euzZeAgGbPbMphllkPow0obxrbrgovmFHBOGCzofOoX+CdVr6G38ZjLf9ucfglrTkcAPfS7/goM3F5usK4thRfV72h3WwqKEkV4vMObmBjR9S6CxQOELmY0= ceph-89be7670-6ad9-11ef-bcd6-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-04T16:21:51.317 INFO:teuthology.orchestra.run.smithi193.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHpLny+cwrtr9lc8V/k/BWhiYXtciO8BY4OBZkX9Hp5C5dJDHTsGw+MR3E8vu/K0Zl+u2rtnuGMhMAEhBdl3U4TLFKI2vaw/Chc6nDrr2Cr6Bej7vBKUd9QWxbSZ9dfPhWhXDuBgFKkECRvZrFngJ59Tm7aExsp4u1+6y7dcqsB+7u2/RS9eVVfVUEt14CRMbkXh1QNyudS09+RDlS/7FKOmJ4RevGvC/uavAKVMXCbvX2tzsF1/ZwOcZkbFOogwFoKW0PBsVeYW5lR/qjx9xHptvtszNjQsX2kw/RXahb1pn5SK6vbH3mlWu+YoFW5uFkFJJloQ6MY3Flqu1US4Gc/Ytwh688/W3PjoTdnbX6RnoXFu/LMuRJNp8YV4WJk7EaTuH2LSI7euzZeAgGbPbMphllkPow0obxrbrgovmFHBOGCzofOoX+CdVr6G38ZjLf9ucfglrTkcAPfS7/goM3F5usK4thRfV72h3WwqKEkV4vMObmBjR9S6CxQOELmY0= ceph-89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:21:51.330 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-04T16:21:51.578 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:21:53.352 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-04T16:21:53.353 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-04T16:21:53.499 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:53 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3596141631' entity='client.admin' 2024-09-04T16:21:53.817 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:21:55.164 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi193 2024-09-04T16:21:55.164 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-04T16:21:55.164 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/etc/ceph/ceph.conf 2024-09-04T16:21:55.183 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-04T16:21:55.183 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-04T16:21:55.241 INFO:tasks.cephadm:Adding host smithi193 to orchestrator... 2024-09-04T16:21:55.241 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph orch host add smithi193 2024-09-04T16:21:55.731 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:21:55.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:55 smithi170 ceph-mon[29272]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:55.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:55 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:56.928 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:56 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:56.928 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:56 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:56.928 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:56 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:21:56.928 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:56 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:21:56.928 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:56 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:21:56.928 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:56 smithi170 ceph-mon[29272]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-04T16:21:56.928 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:56 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:56.928 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:56 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:56.929 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:56 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:21:56.929 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:56 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-04T16:21:56.929 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:56 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-04T16:21:56.929 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:56 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:21:57.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:57 smithi170 ceph-mon[29272]: Updating smithi170:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:21:57.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:57 smithi170 ceph-mon[29272]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-04T16:21:57.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:57 smithi170 ceph-mon[29272]: Updating smithi170:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-04T16:21:57.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:57 smithi170 ceph-mon[29272]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi193", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:21:57.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:57 smithi170 ceph-mon[29272]: Deploying daemon ceph-exporter.smithi170 on smithi170 2024-09-04T16:21:59.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:58 smithi170 ceph-mon[29272]: Deploying cephadm binary to smithi193 2024-09-04T16:21:59.629 INFO:teuthology.orchestra.run.smithi170.stdout:Added host 'smithi193' with addr '172.21.15.193' 2024-09-04T16:22:00.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:59 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:00.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:59 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:00.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:59 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:00.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:59 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:00.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:59 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi170", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-04T16:22:00.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:59 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi170", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-04T16:22:00.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:59 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:22:00.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:59 smithi170 ceph-mon[29272]: Deploying daemon crash.smithi170 on smithi170 2024-09-04T16:22:00.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:59 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:00.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:21:59 smithi170 ceph-mon[29272]: Added host smithi193 2024-09-04T16:22:00.855 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph orch host ls --format=json 2024-09-04T16:22:01.583 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:22:02.302 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:22:02.302 INFO:teuthology.orchestra.run.smithi170.stdout:[{"addr": "172.21.15.170", "hostname": "smithi170", "labels": [], "status": ""}, {"addr": "172.21.15.193", "hostname": "smithi193", "labels": [], "status": ""}] 2024-09-04T16:22:02.815 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:02 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:02.815 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:02 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:02.815 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:02 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:02.815 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:02 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:02.815 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:02 smithi170 ceph-mon[29272]: Deploying daemon node-exporter.smithi170 on smithi170 2024-09-04T16:22:02.957 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-04T16:22:02.957 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph osd crush tunables default 2024-09-04T16:22:03.217 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:22:03.791 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:03 smithi170 ceph-mon[29272]: from='client.14187 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-04T16:22:04.579 INFO:teuthology.orchestra.run.smithi170.stderr:adjusted tunables profile to default 2024-09-04T16:22:04.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:04 smithi170 ceph-mon[29272]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:04.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:04 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:04.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:04 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2362653405' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-04T16:22:05.633 INFO:tasks.cephadm:Adding mon.smithi170 on smithi170 2024-09-04T16:22:05.633 INFO:tasks.cephadm:Adding mon.smithi193 on smithi193 2024-09-04T16:22:05.634 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph orch apply mon '2;smithi170:172.21.15.170=smithi170;smithi193:172.21.15.193=smithi193' 2024-09-04T16:22:05.830 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:05 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2362653405' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-04T16:22:05.830 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:05 smithi170 ceph-mon[29272]: osdmap e4: 0 total, 0 up, 0 in 2024-09-04T16:22:05.876 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:05.920 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:06.477 INFO:teuthology.orchestra.run.smithi193.stdout:Scheduled mon update... 2024-09-04T16:22:06.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:06 smithi170 ceph-mon[29272]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:06.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:06 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:06.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:06 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:06.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:06 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:06.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:06 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:06.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:06 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:07.039 DEBUG:teuthology.orchestra.run.smithi193:mon.smithi193> sudo journalctl -f -n 0 -u ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mon.smithi193.service 2024-09-04T16:22:07.041 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:07.041 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:07.310 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:07.354 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:07.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:07 smithi170 ceph-mon[29272]: Deploying daemon alertmanager.smithi170 on smithi170 2024-09-04T16:22:07.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:07 smithi170 ceph-mon[29272]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi170:172.21.15.170=smithi170;smithi193:172.21.15.193=smithi193", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:22:07.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:07 smithi170 ceph-mon[29272]: Saving service mon spec with placement smithi170:172.21.15.170=smithi170;smithi193:172.21.15.193=smithi193;count:2 2024-09-04T16:22:08.005 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:08.005 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:08.006 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:08.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:08 smithi170 ceph-mon[29272]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:08.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:08 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/4175044709' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:08.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:08 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:09.605 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:09.606 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:09.849 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:09.892 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:10.807 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:10.807 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:10.807 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:10.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:10 smithi170 ceph-mon[29272]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:11.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:11 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/4044487728' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:12.375 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:12.375 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:12.620 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:12.664 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:12.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:12 smithi170 ceph-mon[29272]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:13.276 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:13.277 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:13.277 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:13.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:13 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/2237571510' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:14.822 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:14.822 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:14.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:14 smithi170 ceph-mon[29272]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:14 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:14 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:14 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:14 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:14 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:14 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:14 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:14 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:14 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-04T16:22:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:14 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:15.065 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:15.117 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:15.734 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:15.734 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:15.734 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:15.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:15 smithi170 ceph-mon[29272]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-04T16:22:15.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:15 smithi170 ceph-mon[29272]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-04T16:22:15.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:15 smithi170 ceph-mon[29272]: Deploying daemon grafana.smithi170 on smithi170 2024-09-04T16:22:16.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:16 smithi170 ceph-mon[29272]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:16.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:16 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/965668234' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:17.303 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:17.303 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:17.548 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:17.592 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:18.340 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:18.340 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:18.340 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:18.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:18 smithi170 ceph-mon[29272]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:18.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:18 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/4146314253' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:18.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:18 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:19.908 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:19.908 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:20.151 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:20.196 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:20.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:20 smithi170 ceph-mon[29272]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:21.072 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:21.072 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:21.073 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:21.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:21 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/4178694169' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:22.674 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:22.675 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:22.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:22 smithi170 ceph-mon[29272]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:22.909 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:22.953 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:23.624 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:23.624 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:23.625 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:24.540 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:24 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:24.541 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:24 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:24.541 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:24 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:24.541 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:24 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:24.541 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:24 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:24.541 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:24 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:24.541 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:24 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:24.541 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:24 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:24.541 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:24 smithi170 ceph-mon[29272]: Deploying daemon prometheus.smithi170 on smithi170 2024-09-04T16:22:24.541 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:24 smithi170 ceph-mon[29272]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:24.541 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:24 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:24.541 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:24 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/1633313431' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:25.154 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:25.155 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:25.400 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:25.444 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:26.345 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:26.345 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:26.346 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:26.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:26 smithi170 ceph-mon[29272]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:26.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:26 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/245286555' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:27.935 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:27.935 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:28.177 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:28.221 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:28.849 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:28 smithi170 ceph-mon[29272]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:28.963 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:28.963 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:28.963 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:29.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:29 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/3460543243' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:30.530 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:30.530 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:30.725 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:30 smithi170 ceph-mon[29272]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:30.768 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:30.813 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:31.448 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:31.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:31 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/1382826078' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:32.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:32 smithi170 ceph-mon[29272]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:32.995 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:32.995 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:33.231 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:33.275 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:33.929 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:33.929 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:33.930 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:34.930 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:34 smithi170 ceph-mon[29272]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:34.930 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:34 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/2944001442' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:35.510 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:35.510 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:35.754 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:35.798 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:36.509 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:36.509 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:36.509 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:36.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:36 smithi170 ceph-mon[29272]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:36.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:36 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/586078916' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:38.048 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:38.049 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:38.290 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:38.333 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:38.757 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:38 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:38.757 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:38 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:38.757 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:38 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:38.757 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:38 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-04T16:22:38.757 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:38 smithi170 ceph-mon[29272]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:22:38.957 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:38.957 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:38.958 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:39.667 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:39 smithi170 ceph-mon[29272]: from='mgr.14160 172.21.15.170:0/4194257946' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-04T16:22:39.667 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:39 smithi170 ceph-mon[29272]: mgrmap e14: smithi170.fbszap(active, since 54s) 2024-09-04T16:22:39.667 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:39 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/1195901776' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:40.516 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:40.516 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:40.761 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:40.805 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:41.410 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:41.410 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:41.410 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:41.574 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:41 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/4258920377' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:42.971 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:42.971 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:43.214 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:43.260 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:43.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:43 smithi170 ceph-mon[29272]: Active manager daemon smithi170.fbszap restarted 2024-09-04T16:22:43.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:43 smithi170 ceph-mon[29272]: Activating manager daemon smithi170.fbszap 2024-09-04T16:22:43.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:43 smithi170 ceph-mon[29272]: osdmap e5: 0 total, 0 up, 0 in 2024-09-04T16:22:43.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:43 smithi170 ceph-mon[29272]: mgrmap e15: smithi170.fbszap(active, starting, since 0.0032419s) 2024-09-04T16:22:43.443 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-09-04T16:22:43.443 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr metadata", "who": "smithi170.fbszap", "id": "smithi170.fbszap"}]: dispatch 2024-09-04T16:22:43.443 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-04T16:22:43.443 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-04T16:22:43.443 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-04T16:22:43.443 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:43 smithi170 ceph-mon[29272]: Manager daemon smithi170.fbszap is now available 2024-09-04T16:22:43.443 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:22:43.443 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:43.443 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:22:43.443 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.fbszap/mirror_snapshot_schedule"}]: dispatch 2024-09-04T16:22:43.952 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:43.952 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:43.953 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:44.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.fbszap/trash_purge_schedule"}]: dispatch 2024-09-04T16:22:44.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:44 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/3212834244' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:44 smithi170 ceph-mon[29272]: mgrmap e16: smithi170.fbszap(active, since 1.00541s) 2024-09-04T16:22:45.526 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:45.526 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:45.596 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:45 smithi170 ceph-mon[29272]: [04/Sep/2024:16:22:44] ENGINE Bus STARTING 2024-09-04T16:22:45.597 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:45 smithi170 ceph-mon[29272]: [04/Sep/2024:16:22:44] ENGINE Serving on http://172.21.15.170:8765 2024-09-04T16:22:45.597 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:45 smithi170 ceph-mon[29272]: [04/Sep/2024:16:22:44] ENGINE Serving on https://172.21.15.170:7150 2024-09-04T16:22:45.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:45 smithi170 ceph-mon[29272]: [04/Sep/2024:16:22:44] ENGINE Bus STARTED 2024-09-04T16:22:45.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:45 smithi170 ceph-mon[29272]: [04/Sep/2024:16:22:44] ENGINE Error in HTTPServer.serve 2024-09-04T16:22:45.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Traceback (most recent call last): 2024-09-04T16:22:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-04T16:22:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self._connections.run(self.expiration_interval) 2024-09-04T16:22:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-04T16:22:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self._run(expiration_interval) 2024-09-04T16:22:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-04T16:22:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-04T16:22:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-04T16:22:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-04T16:22:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-04T16:22:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: s = self.context.wrap_socket( 2024-09-04T16:22:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-04T16:22:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: return self.sslsocket_class._create( 2024-09-04T16:22:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-04T16:22:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self.do_handshake() 2024-09-04T16:22:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-04T16:22:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self._sslobj.do_handshake() 2024-09-04T16:22:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-04T16:22:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:45 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:45.773 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:45.819 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:46.474 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:46.475 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:46.475 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:46.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:46 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:46.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:46 smithi170 ceph-mon[29272]: mgrmap e17: smithi170.fbszap(active, since 2s) 2024-09-04T16:22:46.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:46 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/2362770357' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:48.382 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:48.382 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:48.639 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:48.694 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-04T16:22:48.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:48 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:48.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:48 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:48.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:48 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:48.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:48 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:48.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:48 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:22:50.089 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:50.089 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:50.089 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:50.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd/host:smithi193", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:22:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:22:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:22:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-04T16:22:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-04T16:22:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/2783415318' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:50.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:50.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:50.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:50.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:50.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi193", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-04T16:22:50.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi193", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-04T16:22:50.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:22:51.701 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:51.702 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:51.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:51 smithi170 ceph-mon[29272]: Updating smithi193:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:22:51.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:51 smithi170 ceph-mon[29272]: Updating smithi170:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:22:51.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:51 smithi170 ceph-mon[29272]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-09-04T16:22:51.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:51 smithi170 ceph-mon[29272]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-04T16:22:51.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:51 smithi170 ceph-mon[29272]: Updating smithi193:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-04T16:22:51.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:51 smithi170 ceph-mon[29272]: Updating smithi170:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-04T16:22:51.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:51 smithi170 ceph-mon[29272]: Deploying daemon ceph-exporter.smithi193 on smithi193 2024-09-04T16:22:51.951 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:22:52.682 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:52.682 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:52.682 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:53.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:52 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/1600173427' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:54.296 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:54.296 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:54.873 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:22:55.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:54 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:55.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:54 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:55.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:54 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:55.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:54 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:55.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:54 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi193", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-04T16:22:55.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:54 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi193", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-04T16:22:55.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:54 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:22:55.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:54 smithi170 ceph-mon[29272]: Deploying daemon crash.smithi193 on smithi193 2024-09-04T16:22:55.993 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:55.993 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:55.994 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:56.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:56 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/3500812861' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:22:57.484 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:22:57.484 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:22:57.731 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:22:58.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:57 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:58.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:57 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:58.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:57 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:58.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:57 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:58.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:57 smithi170 ceph-mon[29272]: Deploying daemon node-exporter.smithi193 on smithi193 2024-09-04T16:22:58.507 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:22:58.508 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:22:58.508 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:22:59.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:59 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:22:59.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:59 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:22:59.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:22:59 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/1191211510' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:23:00.646 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:23:00.647 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:23:00.904 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:23:01.552 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:23:01.553 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:23:01.553 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:23:02.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:01 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:02.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:01 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:02.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:01 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:02.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:01 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:02.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:01 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi193.gvfizn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-04T16:23:02.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:01 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi193.gvfizn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-04T16:23:02.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:01 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-04T16:23:02.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:01 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:02.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:01 smithi170 ceph-mon[29272]: Deploying daemon mgr.smithi193.gvfizn on smithi193 2024-09-04T16:23:02.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:01 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/1209898712' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:23:03.534 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:23:03.534 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:23:03.964 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:23:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:04 smithi170 ceph-mon[29272]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:04 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:04 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:04 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:04 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:04 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:04 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-04T16:23:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:04 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:04.676 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:23:04.676 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:23:04.676 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:23:05.484 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:05 smithi170 ceph-mon[29272]: Deploying daemon mon.smithi193 on smithi193 2024-09-04T16:23:05.484 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:05 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/363110636' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:23:06.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:06 smithi170 ceph-mon[29272]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:06.715 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:23:06.716 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:23:07.316 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi193/config 2024-09-04T16:23:08.153 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:23:08.153 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":1,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:20:42.443608Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-04T16:23:08.153 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 1 2024-09-04T16:23:08.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:08 smithi170 ceph-mon[29272]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:08.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:08 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/1861332489' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:23:08.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:08 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:09.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:09 smithi193 systemd[1]: Started Ceph mon.smithi193 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:23:09.878 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-04T16:23:09.879 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-04T16:23:10.126 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi193/config 2024-09-04T16:23:14.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-09-04T16:23:14.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: mon.smithi170 calling monitor election 2024-09-04T16:23:14.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:23:14.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:14.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:23:14.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:23:14.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: mon.smithi193 calling monitor election 2024-09-04T16:23:14.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:14.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:23:14.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:23:14.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:14.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:23:14.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:23:14.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: mon.smithi170 is new leader, mons smithi170,smithi193 in quorum (ranks 0,1) 2024-09-04T16:23:14.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: monmap epoch 2 2024-09-04T16:23:14.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:23:14.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: last_changed 2024-09-04T16:23:09.098925+0000 2024-09-04T16:23:14.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: created 2024-09-04T16:20:42.443608+0000 2024-09-04T16:23:14.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: min_mon_release 19 (squid) 2024-09-04T16:23:14.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: election_strategy: 1 2024-09-04T16:23:14.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.smithi170 2024-09-04T16:23:14.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.smithi193 2024-09-04T16:23:14.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: fsmap 2024-09-04T16:23:14.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: osdmap e5: 0 total, 0 up, 0 in 2024-09-04T16:23:14.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: mgrmap e17: smithi170.fbszap(active, since 30s) 2024-09-04T16:23:14.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: overall HEALTH_OK 2024-09-04T16:23:14.355 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: Standby manager daemon smithi193.gvfizn started 2024-09-04T16:23:14.355 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:14.355 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:14.355 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:14.355 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:14.355 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:14.405 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:23:14.405 INFO:teuthology.orchestra.run.smithi193.stdout:{"epoch":2,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","modified":"2024-09-04T16:23:09.098925Z","created":"2024-09-04T16:20:42.443608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi193","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:3300","nonce":0},{"type":"v1","addr":"172.21.15.193:6789","nonce":0}]},"addr":"172.21.15.193:6789/0","public_addr":"172.21.15.193:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-04T16:23:14.406 INFO:teuthology.orchestra.run.smithi193.stderr:dumped monmap epoch 2 2024-09-04T16:23:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-09-04T16:23:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: mon.smithi170 calling monitor election 2024-09-04T16:23:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:23:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:23:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:23:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: mon.smithi193 calling monitor election 2024-09-04T16:23:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:23:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:23:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:23:14.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:23:14.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: mon.smithi170 is new leader, mons smithi170,smithi193 in quorum (ranks 0,1) 2024-09-04T16:23:14.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: monmap epoch 2 2024-09-04T16:23:14.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:23:14.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: last_changed 2024-09-04T16:23:09.098925+0000 2024-09-04T16:23:14.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: created 2024-09-04T16:20:42.443608+0000 2024-09-04T16:23:14.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: min_mon_release 19 (squid) 2024-09-04T16:23:14.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: election_strategy: 1 2024-09-04T16:23:14.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.smithi170 2024-09-04T16:23:14.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.smithi193 2024-09-04T16:23:14.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: fsmap 2024-09-04T16:23:14.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: osdmap e5: 0 total, 0 up, 0 in 2024-09-04T16:23:14.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: mgrmap e17: smithi170.fbszap(active, since 30s) 2024-09-04T16:23:14.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: overall HEALTH_OK 2024-09-04T16:23:14.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: Standby manager daemon smithi193.gvfizn started 2024-09-04T16:23:14.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:14.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:14.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:14.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:14.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:15.012 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-04T16:23:15.012 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config generate-minimal-conf 2024-09-04T16:23:15.276 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:15.305 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:15 smithi193 ceph-mon[36288]: mgrmap e18: smithi170.fbszap(active, since 30s), standbys: smithi193.gvfizn 2024-09-04T16:23:15.306 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:15 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr metadata", "who": "smithi193.gvfizn", "id": "smithi193.gvfizn"}]: dispatch 2024-09-04T16:23:15.306 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:15 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:23:15.306 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:15 smithi193 ceph-mon[36288]: from='client.? 172.21.15.193:0/3514415306' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:23:15.306 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:15 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:23:15.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:15 smithi170 ceph-mon[29272]: mgrmap e18: smithi170.fbszap(active, since 30s), standbys: smithi193.gvfizn 2024-09-04T16:23:15.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:15 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr metadata", "who": "smithi193.gvfizn", "id": "smithi193.gvfizn"}]: dispatch 2024-09-04T16:23:15.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:15 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:23:15.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:15 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/3514415306' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-04T16:23:15.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:15 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:23:15.906 INFO:teuthology.orchestra.run.smithi170.stdout:# minimal ceph.conf for 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:23:15.907 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-09-04T16:23:15.907 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:23:15.907 INFO:teuthology.orchestra.run.smithi170.stdout: mon_host = [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] 2024-09-04T16:23:16.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:16 smithi170 ceph-mon[29272]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:16.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:16 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/897547823' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:16.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:16 smithi193 ceph-mon[36288]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:16.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:16 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/897547823' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:16.546 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-04T16:23:16.546 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:23:16.546 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.conf 2024-09-04T16:23:16.575 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:23:16.575 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-04T16:23:16.640 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-04T16:23:16.640 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/ceph/ceph.conf 2024-09-04T16:23:16.667 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-04T16:23:16.667 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-04T16:23:16.733 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-04T16:23:16.734 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-04T16:23:16.736 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-04T16:23:16.736 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set client debug_client 20 2024-09-04T16:23:16.779 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-04T16:23:16.779 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set client debug_ms 1 2024-09-04T16:23:16.822 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-04T16:23:16.822 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-04T16:23:16.865 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-04T16:23:16.866 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-04T16:23:16.909 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-04T16:23:16.910 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-04T16:23:16.952 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-04T16:23:16.952 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-04T16:23:16.996 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-04T16:23:16.996 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-04T16:23:17.043 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-04T16:23:17.043 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-04T16:23:17.088 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-04T16:23:17.088 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-04T16:23:17.135 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-04T16:23:17.135 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-04T16:23:17.162 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:17.165 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-04T16:23:17.166 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-04T16:23:17.227 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-04T16:23:17.228 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-04T16:23:17.277 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-04T16:23:17.278 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-04T16:23:17.326 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-04T16:23:17.326 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-04T16:23:17.374 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-04T16:23:17.375 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-04T16:23:17.408 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:17.411 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-04T16:23:17.411 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-04T16:23:17.459 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-04T16:23:17.460 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-04T16:23:17.511 DEBUG:tasks.cephadm:set 18 configs 2024-09-04T16:23:17.512 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi170') 2024-09-04T16:23:17.598 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:17.599 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:17.599 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:17.599 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:23:17.599 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-04T16:23:17.599 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-04T16:23:17.599 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: Updating smithi193:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:23:17.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: Updating smithi170:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:23:17.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:17.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:17.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:17.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:17.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:17.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:17.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-04T16:23:17.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-04T16:23:17.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:17 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:17.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:17.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:17.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:17.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:23:17.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-04T16:23:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-04T16:23:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: Updating smithi193:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:23:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: Updating smithi170:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:23:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-04T16:23:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-04T16:23:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:17 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:19.171 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:19.177 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:19.184 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:19 smithi170 ceph-mon[29272]: Reconfiguring mon.smithi170 (unknown last config time)... 2024-09-04T16:23:19.184 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:19 smithi170 ceph-mon[29272]: Reconfiguring daemon mon.smithi170 on smithi170 2024-09-04T16:23:19.184 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:19 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/824051823' entity='client.admin' 2024-09-04T16:23:19.184 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:19 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:19.184 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:19 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3449105504' entity='client.admin' 2024-09-04T16:23:19.185 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi170') 2024-09-04T16:23:19.224 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:19.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:19 smithi193 ceph-mon[36288]: Reconfiguring mon.smithi170 (unknown last config time)... 2024-09-04T16:23:19.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:19 smithi193 ceph-mon[36288]: Reconfiguring daemon mon.smithi170 on smithi170 2024-09-04T16:23:19.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:19 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/824051823' entity='client.admin' 2024-09-04T16:23:19.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:19 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:19.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:19 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3449105504' entity='client.admin' 2024-09-04T16:23:19.622 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi170') 2024-09-04T16:23:20.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:20 smithi193 ceph-mon[36288]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:20.419 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:20 smithi170 ceph-mon[29272]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:21.981 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:21.982 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:21.982 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:22.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:22.196+0000 7f4dedd6d640 1 -- 172.21.15.170:0/1756630340 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f4dd406e020 msgr2=0x7f4dd40704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:22.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:22.196+0000 7f4dedd6d640 1 --2- 172.21.15.170:0/1756630340 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f4dd406e020 0x7f4dd40704e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0005fd0 tx=0x7f4dd0005850 comp rx=0 tx=0).stop 2024-09-04T16:23:22.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:22.196+0000 7f4dedd6d640 1 -- 172.21.15.170:0/1756630340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4de80ffeb0 msgr2=0x7f4de81bede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:22.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:22.196+0000 7f4dedd6d640 1 --2- 172.21.15.170:0/1756630340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4de80ffeb0 0x7f4de81bede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4dd80098a0 tx=0x7f4dd8004a30 comp rx=0 tx=0).stop 2024-09-04T16:23:22.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:22.196+0000 7f4dedd6d640 1 -- 172.21.15.170:0/1756630340 shutdown_connections 2024-09-04T16:23:22.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:22.196+0000 7f4dedd6d640 1 --2- 172.21.15.170:0/1756630340 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f4dd406e020 0x7f4dd40704e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:22.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:22.196+0000 7f4dedd6d640 1 --2- 172.21.15.170:0/1756630340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4de81bf320 0x7f4de81c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:22.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:22.196+0000 7f4dedd6d640 1 --2- 172.21.15.170:0/1756630340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4de80ffeb0 0x7f4de81bede0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:22.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:22.196+0000 7f4dedd6d640 1 -- 172.21.15.170:0/1756630340 >> 172.21.15.170:0/1756630340 conn(0x7f4de80fbca0 msgr2=0x7f4de80fc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:22.198 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:22 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1357988166' entity='client.admin' 2024-09-04T16:23:22.199 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:22 smithi170 ceph-mon[29272]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:22.199 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:22 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3294374821' entity='client.admin' 2024-09-04T16:23:22.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:22.196+0000 7f4dedd6d640 1 -- 172.21.15.170:0/1756630340 shutdown_connections 2024-09-04T16:23:22.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:22.196+0000 7f4dedd6d640 1 -- 172.21.15.170:0/1756630340 wait complete. 2024-09-04T16:23:22.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:22 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1357988166' entity='client.admin' 2024-09-04T16:23:22.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:22 smithi193 ceph-mon[36288]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:22.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:22 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3294374821' entity='client.admin' 2024-09-04T16:23:23.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:23 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1756630340' entity='client.admin' 2024-09-04T16:23:23.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:23 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:23.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:23 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:23.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:23 smithi170 ceph-mon[29272]: Reconfiguring mgr.smithi170.fbszap (unknown last config time)... 2024-09-04T16:23:23.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:23 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi170.fbszap", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-04T16:23:23.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:23 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-04T16:23:23.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:23 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:23.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:23 smithi170 ceph-mon[29272]: Reconfiguring daemon mgr.smithi170.fbszap on smithi170 2024-09-04T16:23:23.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:23 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1756630340' entity='client.admin' 2024-09-04T16:23:23.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:23 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:23.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:23 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:23.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:23 smithi193 ceph-mon[36288]: Reconfiguring mgr.smithi170.fbszap (unknown last config time)... 2024-09-04T16:23:23.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:23 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi170.fbszap", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-04T16:23:23.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:23 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-04T16:23:23.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:23 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:23.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:23 smithi193 ceph-mon[36288]: Reconfiguring daemon mgr.smithi170.fbszap on smithi170 2024-09-04T16:23:23.942 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:23.945 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:23.945 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:24.309 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:24 smithi170 ceph-mon[29272]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:24.310 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:24 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:24.310 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:24 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:24.310 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:24 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-04T16:23:24.310 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:24 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:24.363 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:24.366 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:24.366 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:24.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:24 smithi193 ceph-mon[36288]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:24.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:24 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:24.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:24 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:24.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:24 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-04T16:23:24.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:24 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:25.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.056+0000 7f65a5e14640 1 -- 172.21.15.170:0/2766379915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65a0101a40 msgr2=0x7f65a0101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:25.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.056+0000 7f65a5e14640 1 --2- 172.21.15.170:0/2766379915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65a0101a40 0x7f65a0101ec0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6588009880 tx=0x7f658802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:23:25.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.056+0000 7f65a5e14640 1 -- 172.21.15.170:0/2766379915 shutdown_connections 2024-09-04T16:23:25.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.056+0000 7f65a5e14640 1 --2- 172.21.15.170:0/2766379915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65a0101a40 0x7f65a0101ec0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:25.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.056+0000 7f65a5e14640 1 --2- 172.21.15.170:0/2766379915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65a0100840 0x7f65a0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:25.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.056+0000 7f65a5e14640 1 -- 172.21.15.170:0/2766379915 >> 172.21.15.170:0/2766379915 conn(0x7f65a00fbff0 msgr2=0x7f65a00fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:25.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.057+0000 7f65a5e14640 1 -- 172.21.15.170:0/2766379915 shutdown_connections 2024-09-04T16:23:25.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.057+0000 7f65a5e14640 1 -- 172.21.15.170:0/2766379915 wait complete. 2024-09-04T16:23:25.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.057+0000 7f65a5e14640 1 Processor -- start 2024-09-04T16:23:25.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.057+0000 7f65a5e14640 1 -- start start 2024-09-04T16:23:25.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.057+0000 7f65a5e14640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65a0100840 0x7f65a006a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:25.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.057+0000 7f65a5e14640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65a0101a40 0x7f65a019c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:25.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.057+0000 7f65a5e14640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0109400 con 0x7f65a0101a40 2024-09-04T16:23:25.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.057+0000 7f65a5e14640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0109280 con 0x7f65a0100840 2024-09-04T16:23:25.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.058+0000 7f659effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65a0101a40 0x7f65a019c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:25.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.058+0000 7f659effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65a0101a40 0x7f65a019c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37418/0 (socket says 172.21.15.170:37418) 2024-09-04T16:23:25.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.058+0000 7f659effd640 1 -- 172.21.15.170:0/1022702556 learned_addr learned my addr 172.21.15.170:0/1022702556 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:23:25.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.058+0000 7f659f7fe640 1 --2- 172.21.15.170:0/1022702556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65a0100840 0x7f65a006a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:25.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.058+0000 7f659effd640 1 -- 172.21.15.170:0/1022702556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65a0100840 msgr2=0x7f65a006a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:25.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.058+0000 7f659effd640 1 --2- 172.21.15.170:0/1022702556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65a0100840 0x7f65a006a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:25.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.058+0000 7f659effd640 1 -- 172.21.15.170:0/1022702556 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a019c5d0 con 0x7f65a0101a40 2024-09-04T16:23:25.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.058+0000 7f659effd640 1 --2- 172.21.15.170:0/1022702556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65a0101a40 0x7f65a019c010 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6588005940 tx=0x7f65880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:25.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.058+0000 7f659cff9640 1 -- 172.21.15.170:0/1022702556 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f658803f070 con 0x7f65a0101a40 2024-09-04T16:23:25.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.058+0000 7f65a5e14640 1 -- 172.21.15.170:0/1022702556 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a019c860 con 0x7f65a0101a40 2024-09-04T16:23:25.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.058+0000 7f659cff9640 1 -- 172.21.15.170:0/1022702556 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7f6588004ac0 con 0x7f65a0101a40 2024-09-04T16:23:25.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.058+0000 7f659cff9640 1 -- 172.21.15.170:0/1022702556 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6588035030 con 0x7f65a0101a40 2024-09-04T16:23:25.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.058+0000 7f65a5e14640 1 -- 172.21.15.170:0/1022702556 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a019ce10 con 0x7f65a0101a40 2024-09-04T16:23:25.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.059+0000 7f65a5e14640 1 -- 172.21.15.170:0/1022702556 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a0109be0 con 0x7f65a0101a40 2024-09-04T16:23:25.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.060+0000 7f659cff9640 1 -- 172.21.15.170:0/1022702556 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7f6588042070 con 0x7f65a0101a40 2024-09-04T16:23:25.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.060+0000 7f659cff9640 1 --2- 172.21.15.170:0/1022702556 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f658c06ddb0 0x7f658c070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:25.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.061+0000 7f659f7fe640 1 --2- 172.21.15.170:0/1022702556 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f658c06ddb0 0x7f658c070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:25.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.061+0000 7f659cff9640 1 -- 172.21.15.170:0/1022702556 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f65880ad5b0 con 0x7f65a0101a40 2024-09-04T16:23:25.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.061+0000 7f659f7fe640 1 --2- 172.21.15.170:0/1022702556 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f658c06ddb0 0x7f658c070270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f65a01018a0 tx=0x7f6590009680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:25.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.065+0000 7f659cff9640 1 -- 172.21.15.170:0/1022702556 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6588005470 con 0x7f65a0101a40 2024-09-04T16:23:25.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.251+0000 7f65a5e14640 1 -- 172.21.15.170:0/1022702556 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f65a019d0c0 con 0x7f65a0101a40 2024-09-04T16:23:25.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.254+0000 7f659cff9640 1 -- 172.21.15.170:0/1022702556 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v17)=0 v17) ==== 108+0+0 (secure 0 0 0) 0x7f658807fe50 con 0x7f65a0101a40 2024-09-04T16:23:25.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.256+0000 7f65a5e14640 1 -- 172.21.15.170:0/1022702556 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f658c06ddb0 msgr2=0x7f658c070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:25.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.256+0000 7f65a5e14640 1 --2- 172.21.15.170:0/1022702556 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f658c06ddb0 0x7f658c070270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f65a01018a0 tx=0x7f6590009680 comp rx=0 tx=0).stop 2024-09-04T16:23:25.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.256+0000 7f65a5e14640 1 -- 172.21.15.170:0/1022702556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65a0101a40 msgr2=0x7f65a019c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:25.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.256+0000 7f65a5e14640 1 --2- 172.21.15.170:0/1022702556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65a0101a40 0x7f65a019c010 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6588005940 tx=0x7f65880046c0 comp rx=0 tx=0).stop 2024-09-04T16:23:25.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.257+0000 7f65a5e14640 1 -- 172.21.15.170:0/1022702556 shutdown_connections 2024-09-04T16:23:25.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.257+0000 7f65a5e14640 1 --2- 172.21.15.170:0/1022702556 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f658c06ddb0 0x7f658c070270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:25.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.257+0000 7f65a5e14640 1 --2- 172.21.15.170:0/1022702556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65a0101a40 0x7f65a019c010 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:25.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.257+0000 7f65a5e14640 1 --2- 172.21.15.170:0/1022702556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65a0100840 0x7f65a006a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:25.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.257+0000 7f65a5e14640 1 -- 172.21.15.170:0/1022702556 >> 172.21.15.170:0/1022702556 conn(0x7f65a00fbff0 msgr2=0x7f65a00fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:25.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.257+0000 7f65a5e14640 1 -- 172.21.15.170:0/1022702556 shutdown_connections 2024-09-04T16:23:25.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.257+0000 7f65a5e14640 1 -- 172.21.15.170:0/1022702556 wait complete. 2024-09-04T16:23:25.484 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:25 smithi170 ceph-mon[29272]: Reconfiguring ceph-exporter.smithi170 (monmap changed)... 2024-09-04T16:23:25.484 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:25 smithi170 ceph-mon[29272]: Reconfiguring daemon ceph-exporter.smithi170 on smithi170 2024-09-04T16:23:25.484 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:25 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1374552023' entity='client.admin' 2024-09-04T16:23:25.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:25 smithi193 ceph-mon[36288]: Reconfiguring ceph-exporter.smithi170 (monmap changed)... 2024-09-04T16:23:25.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:25 smithi193 ceph-mon[36288]: Reconfiguring daemon ceph-exporter.smithi170 on smithi170 2024-09-04T16:23:25.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:25 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1374552023' entity='client.admin' 2024-09-04T16:23:26.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:26 smithi170 ceph-mon[29272]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:26.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:26 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1022702556' entity='client.admin' 2024-09-04T16:23:26.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.456+0000 7f3926023640 1 -- 172.21.15.170:0/2630164119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3920101a80 msgr2=0x7f3920101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:26.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.456+0000 7f3926023640 1 --2- 172.21.15.170:0/2630164119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3920101a80 0x7f3920101f00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3908009880 tx=0x7f390802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.456+0000 7f3926023640 1 -- 172.21.15.170:0/2630164119 shutdown_connections 2024-09-04T16:23:26.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.456+0000 7f3926023640 1 --2- 172.21.15.170:0/2630164119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3920101a80 0x7f3920101f00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.456+0000 7f3926023640 1 --2- 172.21.15.170:0/2630164119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3920100880 0x7f3920100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.456+0000 7f3926023640 1 -- 172.21.15.170:0/2630164119 >> 172.21.15.170:0/2630164119 conn(0x7f39200fc010 msgr2=0x7f39200fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:26.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.456+0000 7f3926023640 1 -- 172.21.15.170:0/2630164119 shutdown_connections 2024-09-04T16:23:26.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.456+0000 7f3926023640 1 -- 172.21.15.170:0/2630164119 wait complete. 2024-09-04T16:23:26.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.457+0000 7f3926023640 1 Processor -- start 2024-09-04T16:23:26.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.457+0000 7f3926023640 1 -- start start 2024-09-04T16:23:26.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.457+0000 7f3926023640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3920100880 0x7f392006adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:26.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.457+0000 7f3926023640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3920101a80 0x7f392019c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:26.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.457+0000 7f3926023640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f39201094c0 con 0x7f3920101a80 2024-09-04T16:23:26.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.457+0000 7f3926023640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3920109340 con 0x7f3920100880 2024-09-04T16:23:26.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.457+0000 7f3917fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3920101a80 0x7f392019c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:26.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.457+0000 7f3917fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3920101a80 0x7f392019c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37446/0 (socket says 172.21.15.170:37446) 2024-09-04T16:23:26.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.457+0000 7f3917fff640 1 -- 172.21.15.170:0/2686828832 learned_addr learned my addr 172.21.15.170:0/2686828832 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:23:26.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.457+0000 7f391f7fe640 1 --2- 172.21.15.170:0/2686828832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3920100880 0x7f392006adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:26.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.457+0000 7f3917fff640 1 -- 172.21.15.170:0/2686828832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3920100880 msgr2=0x7f392006adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:26.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.457+0000 7f3917fff640 1 --2- 172.21.15.170:0/2686828832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3920100880 0x7f392006adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.457+0000 7f3917fff640 1 -- 172.21.15.170:0/2686828832 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392019c730 con 0x7f3920101a80 2024-09-04T16:23:26.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.457+0000 7f391f7fe640 1 --2- 172.21.15.170:0/2686828832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3920100880 0x7f392006adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:23:26.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.458+0000 7f3917fff640 1 --2- 172.21.15.170:0/2686828832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3920101a80 0x7f392019c170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3908005940 tx=0x7f39080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:26.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.458+0000 7f391d7fa640 1 -- 172.21.15.170:0/2686828832 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f390803f070 con 0x7f3920101a80 2024-09-04T16:23:26.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.458+0000 7f391d7fa640 1 -- 172.21.15.170:0/2686828832 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7f3908003a70 con 0x7f3920101a80 2024-09-04T16:23:26.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.458+0000 7f3926023640 1 -- 172.21.15.170:0/2686828832 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392019c9c0 con 0x7f3920101a80 2024-09-04T16:23:26.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.458+0000 7f391d7fa640 1 -- 172.21.15.170:0/2686828832 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3908035030 con 0x7f3920101a80 2024-09-04T16:23:26.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.458+0000 7f3926023640 1 -- 172.21.15.170:0/2686828832 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392019cf70 con 0x7f3920101a80 2024-09-04T16:23:26.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.459+0000 7f3926023640 1 -- 172.21.15.170:0/2686828832 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3920109ca0 con 0x7f3920101a80 2024-09-04T16:23:26.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.459+0000 7f391d7fa640 1 -- 172.21.15.170:0/2686828832 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7f3908042070 con 0x7f3920101a80 2024-09-04T16:23:26.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.460+0000 7f391d7fa640 1 --2- 172.21.15.170:0/2686828832 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f390c06de00 0x7f390c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:26.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.460+0000 7f391d7fa640 1 -- 172.21.15.170:0/2686828832 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f39080ad6f0 con 0x7f3920101a80 2024-09-04T16:23:26.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.460+0000 7f391f7fe640 1 --2- 172.21.15.170:0/2686828832 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f390c06de00 0x7f390c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:26.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.460+0000 7f391f7fe640 1 --2- 172.21.15.170:0/2686828832 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f390c06de00 0x7f390c0702c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3910006fd0 tx=0x7f3910008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:26.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.464+0000 7f391d7fa640 1 -- 172.21.15.170:0/2686828832 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f390807c360 con 0x7f3920101a80 2024-09-04T16:23:26.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.629+0000 7fd7f110d640 1 -- 172.21.15.170:0/3926660727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7ec100840 msgr2=0x7fd7ec100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:26.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.629+0000 7fd7f110d640 1 --2- 172.21.15.170:0/3926660727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7ec100840 0x7fd7ec100c40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009880 tx=0x7fd7dc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.629+0000 7fd7f110d640 1 -- 172.21.15.170:0/3926660727 shutdown_connections 2024-09-04T16:23:26.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.629+0000 7fd7f110d640 1 --2- 172.21.15.170:0/3926660727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7ec101a40 0x7fd7ec101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.629+0000 7fd7f110d640 1 --2- 172.21.15.170:0/3926660727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7ec100840 0x7fd7ec100c40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.629+0000 7fd7f110d640 1 -- 172.21.15.170:0/3926660727 >> 172.21.15.170:0/3926660727 conn(0x7fd7ec0fbff0 msgr2=0x7fd7ec0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:26.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.630+0000 7fd7f110d640 1 -- 172.21.15.170:0/3926660727 shutdown_connections 2024-09-04T16:23:26.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.630+0000 7fd7f110d640 1 -- 172.21.15.170:0/3926660727 wait complete. 2024-09-04T16:23:26.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.630+0000 7fd7f110d640 1 Processor -- start 2024-09-04T16:23:26.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.631+0000 7fd7f110d640 1 -- start start 2024-09-04T16:23:26.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.631+0000 7fd7f110d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7ec100840 0x7fd7ec197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:26.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.631+0000 7fd7f110d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7ec101a40 0x7fd7ec197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:26.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.631+0000 7fd7f110d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec109400 con 0x7fd7ec100840 2024-09-04T16:23:26.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.631+0000 7fd7f110d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec109280 con 0x7fd7ec101a40 2024-09-04T16:23:26.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.631+0000 7fd7ead9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7ec100840 0x7fd7ec197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:26.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.631+0000 7fd7ead9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7ec100840 0x7fd7ec197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37460/0 (socket says 172.21.15.170:37460) 2024-09-04T16:23:26.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.631+0000 7fd7ead9d640 1 -- 172.21.15.170:0/3143400373 learned_addr learned my addr 172.21.15.170:0/3143400373 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:23:26.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.631+0000 7fd7ea59c640 1 --2- 172.21.15.170:0/3143400373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7ec101a40 0x7fd7ec197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:26.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.631+0000 7fd7ead9d640 1 -- 172.21.15.170:0/3143400373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7ec101a40 msgr2=0x7fd7ec197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:26.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.631+0000 7fd7ead9d640 1 --2- 172.21.15.170:0/3143400373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7ec101a40 0x7fd7ec197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.631+0000 7fd7ead9d640 1 -- 172.21.15.170:0/3143400373 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ec197ed0 con 0x7fd7ec100840 2024-09-04T16:23:26.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.631+0000 7fd7ea59c640 1 --2- 172.21.15.170:0/3143400373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7ec101a40 0x7fd7ec197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:23:26.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.632+0000 7fd7ead9d640 1 --2- 172.21.15.170:0/3143400373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7ec100840 0x7fd7ec197310 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc004e70 tx=0x7fd7dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:26.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.632+0000 7fd7d3fff640 1 -- 172.21.15.170:0/3143400373 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7dc03f070 con 0x7fd7ec100840 2024-09-04T16:23:26.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.632+0000 7fd7d3fff640 1 -- 172.21.15.170:0/3143400373 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7fd7dc004ac0 con 0x7fd7ec100840 2024-09-04T16:23:26.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.632+0000 7fd7f110d640 1 -- 172.21.15.170:0/3143400373 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7ec19c8b0 con 0x7fd7ec100840 2024-09-04T16:23:26.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.632+0000 7fd7d3fff640 1 -- 172.21.15.170:0/3143400373 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7dc035030 con 0x7fd7ec100840 2024-09-04T16:23:26.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.632+0000 7fd7f110d640 1 -- 172.21.15.170:0/3143400373 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7ec19ce90 con 0x7fd7ec100840 2024-09-04T16:23:26.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.633+0000 7fd7f110d640 1 -- 172.21.15.170:0/3143400373 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7ec109be0 con 0x7fd7ec100840 2024-09-04T16:23:26.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.634+0000 7fd7d3fff640 1 -- 172.21.15.170:0/3143400373 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7fd7dc042070 con 0x7fd7ec100840 2024-09-04T16:23:26.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.634+0000 7fd7d3fff640 1 --2- 172.21.15.170:0/3143400373 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fd7d406de00 0x7fd7d40702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:26.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.635+0000 7fd7ea59c640 1 --2- 172.21.15.170:0/3143400373 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fd7d406de00 0x7fd7d40702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:26.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.635+0000 7fd7d3fff640 1 -- 172.21.15.170:0/3143400373 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd7dc0ad570 con 0x7fd7ec100840 2024-09-04T16:23:26.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.635+0000 7fd7ea59c640 1 --2- 172.21.15.170:0/3143400373 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fd7d406de00 0x7fd7d40702c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec1987c0 tx=0x7fd7e0005e50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:26.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.639+0000 7fd7d3fff640 1 -- 172.21.15.170:0/3143400373 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd7dc07c270 con 0x7fd7ec100840 2024-09-04T16:23:26.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.642+0000 7f3926023640 1 -- 172.21.15.170:0/2686828832 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f3920100d00 con 0x7f3920101a80 2024-09-04T16:23:26.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.645+0000 7f391d7fa640 1 -- 172.21.15.170:0/2686828832 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v18)=0 v18) ==== 115+0+0 (secure 0 0 0) 0x7f3908080010 con 0x7f3920101a80 2024-09-04T16:23:26.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.647+0000 7f3926023640 1 -- 172.21.15.170:0/2686828832 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f390c06de00 msgr2=0x7f390c0702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:26.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.647+0000 7f3926023640 1 --2- 172.21.15.170:0/2686828832 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f390c06de00 0x7f390c0702c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3910006fd0 tx=0x7f3910008040 comp rx=0 tx=0).stop 2024-09-04T16:23:26.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.648+0000 7f3926023640 1 -- 172.21.15.170:0/2686828832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3920101a80 msgr2=0x7f392019c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:26.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.648+0000 7f3926023640 1 --2- 172.21.15.170:0/2686828832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3920101a80 0x7f392019c170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3908005940 tx=0x7f39080048f0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.648+0000 7f3926023640 1 -- 172.21.15.170:0/2686828832 shutdown_connections 2024-09-04T16:23:26.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.648+0000 7f3926023640 1 --2- 172.21.15.170:0/2686828832 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f390c06de00 0x7f390c0702c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.648+0000 7f3926023640 1 --2- 172.21.15.170:0/2686828832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3920101a80 0x7f392019c170 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.648+0000 7f3926023640 1 --2- 172.21.15.170:0/2686828832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3920100880 0x7f392006adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.648+0000 7f3926023640 1 -- 172.21.15.170:0/2686828832 >> 172.21.15.170:0/2686828832 conn(0x7f39200fc010 msgr2=0x7f3920105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:26.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.648+0000 7f3926023640 1 -- 172.21.15.170:0/2686828832 shutdown_connections 2024-09-04T16:23:26.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.648+0000 7f3926023640 1 -- 172.21.15.170:0/2686828832 wait complete. 2024-09-04T16:23:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:26 smithi193 ceph-mon[36288]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:26 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1022702556' entity='client.admin' 2024-09-04T16:23:26.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.971+0000 7f46c3edb640 1 -- 172.21.15.170:0/373693807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46bc101a80 msgr2=0x7f46bc101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:26.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.971+0000 7f46c3edb640 1 --2- 172.21.15.170:0/373693807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46bc101a80 0x7f46bc101f00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009880 tx=0x7f46ac02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.971+0000 7f46c3edb640 1 -- 172.21.15.170:0/373693807 shutdown_connections 2024-09-04T16:23:26.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.971+0000 7f46c3edb640 1 --2- 172.21.15.170:0/373693807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46bc101a80 0x7f46bc101f00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.971+0000 7f46c3edb640 1 --2- 172.21.15.170:0/373693807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46bc100880 0x7f46bc100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.971+0000 7f46c3edb640 1 -- 172.21.15.170:0/373693807 >> 172.21.15.170:0/373693807 conn(0x7f46bc0fc010 msgr2=0x7f46bc0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:26.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.971+0000 7f46c3edb640 1 -- 172.21.15.170:0/373693807 shutdown_connections 2024-09-04T16:23:26.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.971+0000 7f46c3edb640 1 -- 172.21.15.170:0/373693807 wait complete. 2024-09-04T16:23:26.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.972+0000 7f46c3edb640 1 Processor -- start 2024-09-04T16:23:26.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.972+0000 7f46c3edb640 1 -- start start 2024-09-04T16:23:26.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.972+0000 7f46c3edb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46bc100880 0x7f46bc196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:26.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.972+0000 7f46c3edb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46bc101a80 0x7f46bc196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:26.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.972+0000 7f46c3edb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f46bc1094c0 con 0x7f46bc101a80 2024-09-04T16:23:26.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.972+0000 7f46c3edb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f46bc109340 con 0x7f46bc100880 2024-09-04T16:23:26.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.972+0000 7f46c1476640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46bc101a80 0x7f46bc196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:26.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.972+0000 7f46c1476640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46bc101a80 0x7f46bc196850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37394/0 (socket says 172.21.15.170:37394) 2024-09-04T16:23:26.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.972+0000 7f46c1476640 1 -- 172.21.15.170:0/1374552023 learned_addr learned my addr 172.21.15.170:0/1374552023 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:23:26.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.972+0000 7f46c1c77640 1 --2- 172.21.15.170:0/1374552023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46bc100880 0x7f46bc196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:26.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.972+0000 7f46c1476640 1 -- 172.21.15.170:0/1374552023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46bc100880 msgr2=0x7f46bc196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:26.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.972+0000 7f46c1476640 1 --2- 172.21.15.170:0/1374552023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46bc100880 0x7f46bc196310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.972+0000 7f46c1476640 1 -- 172.21.15.170:0/1374552023 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46bc196ed0 con 0x7f46bc101a80 2024-09-04T16:23:26.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.972+0000 7f46c1c77640 1 --2- 172.21.15.170:0/1374552023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46bc100880 0x7f46bc196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:23:26.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.972+0000 7f46c1476640 1 --2- 172.21.15.170:0/1374552023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46bc101a80 0x7f46bc196850 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f46ac005940 tx=0x7f46ac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:26.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.973+0000 7f46b2ffd640 1 -- 172.21.15.170:0/1374552023 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46ac03f070 con 0x7f46bc101a80 2024-09-04T16:23:26.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.973+0000 7f46c3edb640 1 -- 172.21.15.170:0/1374552023 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46bc19b8b0 con 0x7f46bc101a80 2024-09-04T16:23:26.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.973+0000 7f46b2ffd640 1 -- 172.21.15.170:0/1374552023 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7f46ac003a70 con 0x7f46bc101a80 2024-09-04T16:23:26.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.973+0000 7f46b2ffd640 1 -- 172.21.15.170:0/1374552023 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46ac035030 con 0x7f46bc101a80 2024-09-04T16:23:26.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.973+0000 7f46c3edb640 1 -- 172.21.15.170:0/1374552023 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46bc19bec0 con 0x7f46bc101a80 2024-09-04T16:23:26.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.974+0000 7f46c3edb640 1 -- 172.21.15.170:0/1374552023 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46bc109ca0 con 0x7f46bc101a80 2024-09-04T16:23:26.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.974+0000 7f46b2ffd640 1 -- 172.21.15.170:0/1374552023 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7f46ac042070 con 0x7f46bc101a80 2024-09-04T16:23:26.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.975+0000 7f46b2ffd640 1 --2- 172.21.15.170:0/1374552023 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f46a806ddb0 0x7f46a8070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:26.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.975+0000 7f46b2ffd640 1 -- 172.21.15.170:0/1374552023 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f46ac0ad760 con 0x7f46bc101a80 2024-09-04T16:23:26.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.975+0000 7f46c1c77640 1 --2- 172.21.15.170:0/1374552023 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f46a806ddb0 0x7f46a8070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:26.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.975+0000 7f46c1c77640 1 --2- 172.21.15.170:0/1374552023 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f46a806ddb0 0x7f46a8070270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f46b8006fd0 tx=0x7f46b8008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:26.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:24.979+0000 7f46b2ffd640 1 -- 172.21.15.170:0/1374552023 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f46ac07c3e0 con 0x7f46bc101a80 2024-09-04T16:23:26.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.156+0000 7f46c3edb640 1 -- 172.21.15.170:0/1374552023 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f46bc1902d0 con 0x7f46bc101a80 2024-09-04T16:23:26.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.159+0000 7f46b2ffd640 1 -- 172.21.15.170:0/1374552023 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7f46ac003c20 con 0x7f46bc101a80 2024-09-04T16:23:26.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.162+0000 7f46c3edb640 1 -- 172.21.15.170:0/1374552023 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f46a806ddb0 msgr2=0x7f46a8070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:26.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.162+0000 7f46c3edb640 1 --2- 172.21.15.170:0/1374552023 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f46a806ddb0 0x7f46a8070270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f46b8006fd0 tx=0x7f46b8008040 comp rx=0 tx=0).stop 2024-09-04T16:23:26.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.162+0000 7f46c3edb640 1 -- 172.21.15.170:0/1374552023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46bc101a80 msgr2=0x7f46bc196850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:26.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.162+0000 7f46c3edb640 1 --2- 172.21.15.170:0/1374552023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46bc101a80 0x7f46bc196850 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f46ac005940 tx=0x7f46ac0048f0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.162+0000 7f46c3edb640 1 -- 172.21.15.170:0/1374552023 shutdown_connections 2024-09-04T16:23:26.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.162+0000 7f46c3edb640 1 --2- 172.21.15.170:0/1374552023 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f46a806ddb0 0x7f46a8070270 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.162+0000 7f46c3edb640 1 --2- 172.21.15.170:0/1374552023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46bc101a80 0x7f46bc196850 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.162+0000 7f46c3edb640 1 --2- 172.21.15.170:0/1374552023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46bc100880 0x7f46bc196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.162+0000 7f46c3edb640 1 -- 172.21.15.170:0/1374552023 >> 172.21.15.170:0/1374552023 conn(0x7f46bc0fc010 msgr2=0x7f46bc1050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:26.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.162+0000 7f46c3edb640 1 -- 172.21.15.170:0/1374552023 shutdown_connections 2024-09-04T16:23:26.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:25.162+0000 7f46c3edb640 1 -- 172.21.15.170:0/1374552023 wait complete. 2024-09-04T16:23:26.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.810+0000 7fd7f110d640 1 -- 172.21.15.170:0/3143400373 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fd7ec100c40 con 0x7fd7ec100840 2024-09-04T16:23:26.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.814+0000 7fd7d3fff640 1 -- 172.21.15.170:0/3143400373 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v19)=0 v19) ==== 123+0+0 (secure 0 0 0) 0x7fd7dc07ff20 con 0x7fd7ec100840 2024-09-04T16:23:26.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.814+0000 7fd7d3fff640 1 -- 172.21.15.170:0/3143400373 <== mon.0 v2:172.21.15.170:3300/0 8 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7fd7dc084750 con 0x7fd7ec100840 2024-09-04T16:23:26.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.816+0000 7fd7f110d640 1 -- 172.21.15.170:0/3143400373 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fd7d406de00 msgr2=0x7fd7d40702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:26.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.816+0000 7fd7f110d640 1 --2- 172.21.15.170:0/3143400373 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fd7d406de00 0x7fd7d40702c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec1987c0 tx=0x7fd7e0005e50 comp rx=0 tx=0).stop 2024-09-04T16:23:26.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.816+0000 7fd7f110d640 1 -- 172.21.15.170:0/3143400373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7ec100840 msgr2=0x7fd7ec197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:26.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.816+0000 7fd7f110d640 1 --2- 172.21.15.170:0/3143400373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7ec100840 0x7fd7ec197310 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc004e70 tx=0x7fd7dc0046c0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.816+0000 7fd7f110d640 1 -- 172.21.15.170:0/3143400373 shutdown_connections 2024-09-04T16:23:26.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.816+0000 7fd7f110d640 1 --2- 172.21.15.170:0/3143400373 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fd7d406de00 0x7fd7d40702c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.816+0000 7fd7f110d640 1 --2- 172.21.15.170:0/3143400373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7ec101a40 0x7fd7ec197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.816+0000 7fd7f110d640 1 --2- 172.21.15.170:0/3143400373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7ec100840 0x7fd7ec197310 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:26.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.816+0000 7fd7f110d640 1 -- 172.21.15.170:0/3143400373 >> 172.21.15.170:0/3143400373 conn(0x7fd7ec0fbff0 msgr2=0x7fd7ec069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:26.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.816+0000 7fd7f110d640 1 -- 172.21.15.170:0/3143400373 shutdown_connections 2024-09-04T16:23:26.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:26.816+0000 7fd7f110d640 1 -- 172.21.15.170:0/3143400373 wait complete. 2024-09-04T16:23:26.921 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:27.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.532+0000 7feef363e640 1 -- 172.21.15.170:0/2659527325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec100840 msgr2=0x7feeec100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:28.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.532+0000 7feef363e640 1 --2- 172.21.15.170:0/2659527325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec100840 0x7feeec100c40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feedc009c20 tx=0x7feedc02a970 comp rx=0 tx=0).stop 2024-09-04T16:23:28.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.532+0000 7feef363e640 1 -- 172.21.15.170:0/2659527325 shutdown_connections 2024-09-04T16:23:28.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.532+0000 7feef363e640 1 --2- 172.21.15.170:0/2659527325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feeec101a40 0x7feeec101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:28.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.532+0000 7feef363e640 1 --2- 172.21.15.170:0/2659527325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec100840 0x7feeec100c40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:28.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.532+0000 7feef363e640 1 -- 172.21.15.170:0/2659527325 >> 172.21.15.170:0/2659527325 conn(0x7feeec0fbff0 msgr2=0x7feeec0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:28.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.533+0000 7feef363e640 1 -- 172.21.15.170:0/2659527325 shutdown_connections 2024-09-04T16:23:28.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.533+0000 7feef363e640 1 -- 172.21.15.170:0/2659527325 wait complete. 2024-09-04T16:23:28.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.533+0000 7feef363e640 1 Processor -- start 2024-09-04T16:23:28.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.533+0000 7feef363e640 1 -- start start 2024-09-04T16:23:28.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.533+0000 7feef363e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec100840 0x7feeec06a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:28.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.534+0000 7feef363e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feeec101a40 0x7feeec19c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:28.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.534+0000 7feef363e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7feeec109520 con 0x7feeec100840 2024-09-04T16:23:28.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.534+0000 7feef363e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feeec1093a0 con 0x7feeec101a40 2024-09-04T16:23:28.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.534+0000 7feef13da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec100840 0x7feeec06a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:28.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.534+0000 7feef13da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec100840 0x7feeec06a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37480/0 (socket says 172.21.15.170:37480) 2024-09-04T16:23:28.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.534+0000 7feef13da640 1 -- 172.21.15.170:0/2499938589 learned_addr learned my addr 172.21.15.170:0/2499938589 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:23:28.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.534+0000 7feef13da640 1 -- 172.21.15.170:0/2499938589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feeec101a40 msgr2=0x7feeec19c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:28.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.534+0000 7feef13da640 1 --2- 172.21.15.170:0/2499938589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feeec101a40 0x7feeec19c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:28.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.534+0000 7feef13da640 1 -- 172.21.15.170:0/2499938589 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeec19c650 con 0x7feeec100840 2024-09-04T16:23:28.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.534+0000 7feef13da640 1 --2- 172.21.15.170:0/2499938589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec100840 0x7feeec06a620 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feedc030a10 tx=0x7feedc030a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:28.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.534+0000 7feeea7fc640 1 -- 172.21.15.170:0/2499938589 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feedc034050 con 0x7feeec100840 2024-09-04T16:23:28.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.534+0000 7feeea7fc640 1 -- 172.21.15.170:0/2499938589 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7feedc003e10 con 0x7feeec100840 2024-09-04T16:23:28.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.534+0000 7feeea7fc640 1 -- 172.21.15.170:0/2499938589 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feedc039420 con 0x7feeec100840 2024-09-04T16:23:28.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.534+0000 7feef363e640 1 -- 172.21.15.170:0/2499938589 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeec19c8e0 con 0x7feeec100840 2024-09-04T16:23:28.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.534+0000 7feef363e640 1 -- 172.21.15.170:0/2499938589 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeec19ce90 con 0x7feeec100840 2024-09-04T16:23:28.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.535+0000 7feef363e640 1 -- 172.21.15.170:0/2499938589 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeec100c40 con 0x7feeec100840 2024-09-04T16:23:28.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.536+0000 7feeea7fc640 1 -- 172.21.15.170:0/2499938589 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7feedc037020 con 0x7feeec100840 2024-09-04T16:23:28.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.536+0000 7feeea7fc640 1 --2- 172.21.15.170:0/2499938589 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7feed406de00 0x7feed40702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:28.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.536+0000 7feeea7fc640 1 -- 172.21.15.170:0/2499938589 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7feedc0adbc0 con 0x7feeec100840 2024-09-04T16:23:28.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.536+0000 7feef0bd9640 1 --2- 172.21.15.170:0/2499938589 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7feed406de00 0x7feed40702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:28.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.537+0000 7feef0bd9640 1 --2- 172.21.15.170:0/2499938589 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7feed406de00 0x7feed40702c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feeec06a3a0 tx=0x7feee0005c70 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:28.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.540+0000 7feeea7fc640 1 -- 172.21.15.170:0/2499938589 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feedc07c8c0 con 0x7feeec100840 2024-09-04T16:23:28.019 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:27 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2686828832' entity='client.admin' 2024-09-04T16:23:28.019 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:27 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3143400373' entity='client.admin' 2024-09-04T16:23:28.019 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:27 smithi193 ceph-mon[36288]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:28.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.715+0000 7feef363e640 1 -- 172.21.15.170:0/2499938589 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7feeec062df0 con 0x7feeec100840 2024-09-04T16:23:28.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.718+0000 7feeea7fc640 1 -- 172.21.15.170:0/2499938589 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v20)=0 v20) ==== 119+0+0 (secure 0 0 0) 0x7feedc080570 con 0x7feeec100840 2024-09-04T16:23:28.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.721+0000 7feef363e640 1 -- 172.21.15.170:0/2499938589 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7feed406de00 msgr2=0x7feed40702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:28.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.721+0000 7feef363e640 1 --2- 172.21.15.170:0/2499938589 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7feed406de00 0x7feed40702c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feeec06a3a0 tx=0x7feee0005c70 comp rx=0 tx=0).stop 2024-09-04T16:23:28.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.721+0000 7feef363e640 1 -- 172.21.15.170:0/2499938589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec100840 msgr2=0x7feeec06a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:28.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.721+0000 7feef363e640 1 --2- 172.21.15.170:0/2499938589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec100840 0x7feeec06a620 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feedc030a10 tx=0x7feedc030a40 comp rx=0 tx=0).stop 2024-09-04T16:23:28.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.721+0000 7feef363e640 1 -- 172.21.15.170:0/2499938589 shutdown_connections 2024-09-04T16:23:28.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.721+0000 7feef363e640 1 --2- 172.21.15.170:0/2499938589 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7feed406de00 0x7feed40702c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:28.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.721+0000 7feef363e640 1 --2- 172.21.15.170:0/2499938589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feeec101a40 0x7feeec19c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:28.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.721+0000 7feef363e640 1 --2- 172.21.15.170:0/2499938589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec100840 0x7feeec06a620 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:28.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.721+0000 7feef363e640 1 -- 172.21.15.170:0/2499938589 >> 172.21.15.170:0/2499938589 conn(0x7feeec0fbff0 msgr2=0x7feeec104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:28.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.721+0000 7feef363e640 1 -- 172.21.15.170:0/2499938589 shutdown_connections 2024-09-04T16:23:28.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:27.721+0000 7feef363e640 1 -- 172.21.15.170:0/2499938589 wait complete. 2024-09-04T16:23:28.021 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:27 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2686828832' entity='client.admin' 2024-09-04T16:23:28.021 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:27 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3143400373' entity='client.admin' 2024-09-04T16:23:28.021 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:27 smithi170 ceph-mon[29272]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:28.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.321+0000 7f578cdca640 1 -- 172.21.15.170:0/3743145557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5788101e10 msgr2=0x7f5788102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:28.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.321+0000 7f578cdca640 1 --2- 172.21.15.170:0/3743145557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5788101e10 0x7f5788102210 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5778009880 tx=0x7f577802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:23:28.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.321+0000 7f578cdca640 1 -- 172.21.15.170:0/3743145557 shutdown_connections 2024-09-04T16:23:28.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.321+0000 7f578cdca640 1 --2- 172.21.15.170:0/3743145557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5788100b50 0x7f5788100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:28.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.321+0000 7f578cdca640 1 --2- 172.21.15.170:0/3743145557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5788101e10 0x7f5788102210 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:28.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.321+0000 7f578cdca640 1 -- 172.21.15.170:0/3743145557 >> 172.21.15.170:0/3743145557 conn(0x7f57880fb790 msgr2=0x7f57880fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:28.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.321+0000 7f578cdca640 1 -- 172.21.15.170:0/3743145557 shutdown_connections 2024-09-04T16:23:28.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.321+0000 7f578cdca640 1 -- 172.21.15.170:0/3743145557 wait complete. 2024-09-04T16:23:28.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.322+0000 7f578cdca640 1 Processor -- start 2024-09-04T16:23:28.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.322+0000 7f578cdca640 1 -- start start 2024-09-04T16:23:28.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.322+0000 7f578cdca640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5788100b50 0x7f5788104880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:28.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.322+0000 7f578cdca640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5788101e10 0x7f5788102f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:28.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.322+0000 7f578cdca640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5788109560 con 0x7f5788101e10 2024-09-04T16:23:28.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.322+0000 7f578cdca640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57881093e0 con 0x7f5788100b50 2024-09-04T16:23:28.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.322+0000 7f577ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5788101e10 0x7f5788102f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:28.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.322+0000 7f577ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5788101e10 0x7f5788102f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37494/0 (socket says 172.21.15.170:37494) 2024-09-04T16:23:28.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.322+0000 7f577ffff640 1 -- 172.21.15.170:0/2809410195 learned_addr learned my addr 172.21.15.170:0/2809410195 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:23:28.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.322+0000 7f578659c640 1 --2- 172.21.15.170:0/2809410195 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5788100b50 0x7f5788104880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:28.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.323+0000 7f577ffff640 1 -- 172.21.15.170:0/2809410195 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5788100b50 msgr2=0x7f5788104880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:28.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.323+0000 7f577ffff640 1 --2- 172.21.15.170:0/2809410195 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5788100b50 0x7f5788104880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:28.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.323+0000 7f577ffff640 1 -- 172.21.15.170:0/2809410195 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5788103480 con 0x7f5788101e10 2024-09-04T16:23:28.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.323+0000 7f577ffff640 1 --2- 172.21.15.170:0/2809410195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5788101e10 0x7f5788102f40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f577000c8a0 tx=0x7f577000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:28.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.323+0000 7f577f7fe640 1 -- 172.21.15.170:0/2809410195 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57700079b0 con 0x7f5788101e10 2024-09-04T16:23:28.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.323+0000 7f578cdca640 1 -- 172.21.15.170:0/2809410195 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5788103770 con 0x7f5788101e10 2024-09-04T16:23:28.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.323+0000 7f577f7fe640 1 -- 172.21.15.170:0/2809410195 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f577000f450 con 0x7f5788101e10 2024-09-04T16:23:28.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.323+0000 7f577f7fe640 1 -- 172.21.15.170:0/2809410195 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5770018630 con 0x7f5788101e10 2024-09-04T16:23:28.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.323+0000 7f578cdca640 1 -- 172.21.15.170:0/2809410195 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5788103d80 con 0x7f5788101e10 2024-09-04T16:23:28.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.324+0000 7f578cdca640 1 -- 172.21.15.170:0/2809410195 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5788100fd0 con 0x7f5788101e10 2024-09-04T16:23:28.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.325+0000 7f577f7fe640 1 -- 172.21.15.170:0/2809410195 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7f577000f600 con 0x7f5788101e10 2024-09-04T16:23:28.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.325+0000 7f577f7fe640 1 --2- 172.21.15.170:0/2809410195 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f577406ddb0 0x7f5774070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:28.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.325+0000 7f578659c640 1 --2- 172.21.15.170:0/2809410195 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f577406ddb0 0x7f5774070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:28.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.325+0000 7f577f7fe640 1 -- 172.21.15.170:0/2809410195 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f577008ce40 con 0x7f5788101e10 2024-09-04T16:23:28.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.326+0000 7f578659c640 1 --2- 172.21.15.170:0/2809410195 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f577406ddb0 0x7f5774070270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5778000c00 tx=0x7f5778004ea0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:28.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.329+0000 7f577f7fe640 1 -- 172.21.15.170:0/2809410195 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5770014030 con 0x7f5788101e10 2024-09-04T16:23:28.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.497+0000 7f578cdca640 1 -- 172.21.15.170:0/2809410195 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f578819f630 con 0x7f5788101e10 2024-09-04T16:23:28.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.500+0000 7f577f7fe640 1 -- 172.21.15.170:0/2809410195 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v21)=0 v21) ==== 120+0+0 (secure 0 0 0) 0x7f577005f770 con 0x7f5788101e10 2024-09-04T16:23:28.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.503+0000 7f578cdca640 1 -- 172.21.15.170:0/2809410195 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f577406ddb0 msgr2=0x7f5774070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:28.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.503+0000 7f578cdca640 1 --2- 172.21.15.170:0/2809410195 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f577406ddb0 0x7f5774070270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5778000c00 tx=0x7f5778004ea0 comp rx=0 tx=0).stop 2024-09-04T16:23:28.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.503+0000 7f578cdca640 1 -- 172.21.15.170:0/2809410195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5788101e10 msgr2=0x7f5788102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:28.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.503+0000 7f578cdca640 1 --2- 172.21.15.170:0/2809410195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5788101e10 0x7f5788102f40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f577000c8a0 tx=0x7f577000cd60 comp rx=0 tx=0).stop 2024-09-04T16:23:28.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.503+0000 7f578cdca640 1 -- 172.21.15.170:0/2809410195 shutdown_connections 2024-09-04T16:23:28.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.503+0000 7f578cdca640 1 --2- 172.21.15.170:0/2809410195 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f577406ddb0 0x7f5774070270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:28.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.503+0000 7f578cdca640 1 --2- 172.21.15.170:0/2809410195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5788101e10 0x7f5788102f40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:28.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.503+0000 7f578cdca640 1 --2- 172.21.15.170:0/2809410195 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5788100b50 0x7f5788104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:28.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.503+0000 7f578cdca640 1 -- 172.21.15.170:0/2809410195 >> 172.21.15.170:0/2809410195 conn(0x7f57880fb790 msgr2=0x7f57880ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:28.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.503+0000 7f578cdca640 1 -- 172.21.15.170:0/2809410195 shutdown_connections 2024-09-04T16:23:28.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:28.503+0000 7f578cdca640 1 -- 172.21.15.170:0/2809410195 wait complete. 2024-09-04T16:23:28.754 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi170') 2024-09-04T16:23:28.976 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:28 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2499938589' entity='client.admin' 2024-09-04T16:23:28.976 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:28 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:23:28.976 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:28 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2809410195' entity='client.admin' 2024-09-04T16:23:29.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:28 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2499938589' entity='client.admin' 2024-09-04T16:23:29.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:28 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:23:29.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:28 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2809410195' entity='client.admin' 2024-09-04T16:23:29.675 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:30.043 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:29 smithi170 ceph-mon[29272]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:30.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:29 smithi193 ceph-mon[36288]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.781+0000 7f1cea49e640 1 -- 172.21.15.170:0/2312865857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ce4101990 msgr2=0x7f1ce4101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.781+0000 7f1cea49e640 1 --2- 172.21.15.170:0/2312865857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ce4101990 0x7f1ce4101d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009880 tx=0x7f1cd402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:23:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.781+0000 7f1cea49e640 1 -- 172.21.15.170:0/2312865857 shutdown_connections 2024-09-04T16:23:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.781+0000 7f1cea49e640 1 --2- 172.21.15.170:0/2312865857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ce4102b90 0x7f1ce4103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.781+0000 7f1cea49e640 1 --2- 172.21.15.170:0/2312865857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ce4101990 0x7f1ce4101d90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.781+0000 7f1cea49e640 1 -- 172.21.15.170:0/2312865857 >> 172.21.15.170:0/2312865857 conn(0x7f1ce40fd140 msgr2=0x7f1ce40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.781+0000 7f1cea49e640 1 -- 172.21.15.170:0/2312865857 shutdown_connections 2024-09-04T16:23:30.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.781+0000 7f1cea49e640 1 -- 172.21.15.170:0/2312865857 wait complete. 2024-09-04T16:23:30.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.782+0000 7f1cea49e640 1 Processor -- start 2024-09-04T16:23:30.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.782+0000 7f1cea49e640 1 -- start start 2024-09-04T16:23:30.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.782+0000 7f1cea49e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ce4101990 0x7f1ce4197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:30.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.782+0000 7f1cea49e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ce4102b90 0x7f1ce4197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:30.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.782+0000 7f1cea49e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce410a690 con 0x7f1ce4101990 2024-09-04T16:23:30.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.782+0000 7f1cea49e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce410a510 con 0x7f1ce4102b90 2024-09-04T16:23:30.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.783+0000 7f1ce3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ce4101990 0x7f1ce4197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:30.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.783+0000 7f1ce3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ce4101990 0x7f1ce4197410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37510/0 (socket says 172.21.15.170:37510) 2024-09-04T16:23:30.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.783+0000 7f1ce3fff640 1 -- 172.21.15.170:0/3208130417 learned_addr learned my addr 172.21.15.170:0/3208130417 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:23:30.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.783+0000 7f1ce37fe640 1 --2- 172.21.15.170:0/3208130417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ce4102b90 0x7f1ce4197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:30.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.783+0000 7f1ce3fff640 1 -- 172.21.15.170:0/3208130417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ce4102b90 msgr2=0x7f1ce4197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:30.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.783+0000 7f1ce3fff640 1 --2- 172.21.15.170:0/3208130417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ce4102b90 0x7f1ce4197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:30.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.783+0000 7f1ce3fff640 1 -- 172.21.15.170:0/3208130417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce4197fd0 con 0x7f1ce4101990 2024-09-04T16:23:30.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.783+0000 7f1ce37fe640 1 --2- 172.21.15.170:0/3208130417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ce4102b90 0x7f1ce4197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:23:30.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.783+0000 7f1ce3fff640 1 --2- 172.21.15.170:0/3208130417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ce4101990 0x7f1ce4197410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009230 tx=0x7f1cd40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:30.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.783+0000 7f1ce17fa640 1 -- 172.21.15.170:0/3208130417 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cd403f070 con 0x7f1ce4101990 2024-09-04T16:23:30.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.783+0000 7f1ce17fa640 1 -- 172.21.15.170:0/3208130417 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f1cd4003a90 con 0x7f1ce4101990 2024-09-04T16:23:30.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.783+0000 7f1cea49e640 1 -- 172.21.15.170:0/3208130417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce419c9b0 con 0x7f1ce4101990 2024-09-04T16:23:30.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.783+0000 7f1ce17fa640 1 -- 172.21.15.170:0/3208130417 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cd4035030 con 0x7f1ce4101990 2024-09-04T16:23:30.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.783+0000 7f1cea49e640 1 -- 172.21.15.170:0/3208130417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce419cfc0 con 0x7f1ce4101990 2024-09-04T16:23:30.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.784+0000 7f1cea49e640 1 -- 172.21.15.170:0/3208130417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce4101d90 con 0x7f1ce4101990 2024-09-04T16:23:30.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.785+0000 7f1ce17fa640 1 -- 172.21.15.170:0/3208130417 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7f1cd4042070 con 0x7f1ce4101990 2024-09-04T16:23:30.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.785+0000 7f1ce17fa640 1 --2- 172.21.15.170:0/3208130417 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1ccc06ddb0 0x7f1ccc070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:30.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.785+0000 7f1ce37fe640 1 --2- 172.21.15.170:0/3208130417 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1ccc06ddb0 0x7f1ccc070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:30.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.785+0000 7f1ce17fa640 1 -- 172.21.15.170:0/3208130417 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f1cd40ad560 con 0x7f1ce4101990 2024-09-04T16:23:30.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.786+0000 7f1ce37fe640 1 --2- 172.21.15.170:0/3208130417 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1ccc06ddb0 0x7f1ccc070270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80058c0 tx=0x7f1cd8005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:30.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.790+0000 7f1ce17fa640 1 -- 172.21.15.170:0/3208130417 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1cd407c1e0 con 0x7f1ce4101990 2024-09-04T16:23:30.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.959+0000 7f1cea49e640 1 -- 172.21.15.170:0/3208130417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f1ce419d220 con 0x7f1ce4101990 2024-09-04T16:23:30.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.962+0000 7f1ce17fa640 1 -- 172.21.15.170:0/3208130417 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7f1cd407fe90 con 0x7f1ce4101990 2024-09-04T16:23:30.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.964+0000 7f1cea49e640 1 -- 172.21.15.170:0/3208130417 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1ccc06ddb0 msgr2=0x7f1ccc070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:30.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.964+0000 7f1cea49e640 1 --2- 172.21.15.170:0/3208130417 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1ccc06ddb0 0x7f1ccc070270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80058c0 tx=0x7f1cd8005850 comp rx=0 tx=0).stop 2024-09-04T16:23:30.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.964+0000 7f1cea49e640 1 -- 172.21.15.170:0/3208130417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ce4101990 msgr2=0x7f1ce4197410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:30.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.964+0000 7f1cea49e640 1 --2- 172.21.15.170:0/3208130417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ce4101990 0x7f1ce4197410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009230 tx=0x7f1cd40048f0 comp rx=0 tx=0).stop 2024-09-04T16:23:30.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.964+0000 7f1cea49e640 1 -- 172.21.15.170:0/3208130417 shutdown_connections 2024-09-04T16:23:30.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.964+0000 7f1cea49e640 1 --2- 172.21.15.170:0/3208130417 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1ccc06ddb0 0x7f1ccc070270 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:30.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.964+0000 7f1cea49e640 1 --2- 172.21.15.170:0/3208130417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ce4102b90 0x7f1ce4197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:30.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.964+0000 7f1cea49e640 1 --2- 172.21.15.170:0/3208130417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ce4101990 0x7f1ce4197410 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:30.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.964+0000 7f1cea49e640 1 -- 172.21.15.170:0/3208130417 >> 172.21.15.170:0/3208130417 conn(0x7f1ce40fd140 msgr2=0x7f1ce40ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:30.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.965+0000 7f1cea49e640 1 -- 172.21.15.170:0/3208130417 shutdown_connections 2024-09-04T16:23:30.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:30.965+0000 7f1cea49e640 1 -- 172.21.15.170:0/3208130417 wait complete. 2024-09-04T16:23:31.449 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi170') 2024-09-04T16:23:32.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:31 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3208130417' entity='client.admin' 2024-09-04T16:23:32.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:31 smithi170 ceph-mon[29272]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:32.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:31 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3208130417' entity='client.admin' 2024-09-04T16:23:32.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:31 smithi193 ceph-mon[36288]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:32.734 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:32.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.285+0000 7fb8e3900640 1 -- 172.21.15.170:0/379052574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8dc100880 msgr2=0x7fb8dc100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:32.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.285+0000 7fb8e3900640 1 --2- 172.21.15.170:0/379052574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8dc100880 0x7fb8dc100c80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8009880 tx=0x7fb8d802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:23:32.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.285+0000 7fb8e3900640 1 -- 172.21.15.170:0/379052574 shutdown_connections 2024-09-04T16:23:32.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.285+0000 7fb8e3900640 1 --2- 172.21.15.170:0/379052574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8dc101a80 0x7fb8dc101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:32.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.285+0000 7fb8e3900640 1 --2- 172.21.15.170:0/379052574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8dc100880 0x7fb8dc100c80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:32.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.285+0000 7fb8e3900640 1 -- 172.21.15.170:0/379052574 >> 172.21.15.170:0/379052574 conn(0x7fb8dc0fc010 msgr2=0x7fb8dc0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:32.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.285+0000 7fb8e3900640 1 -- 172.21.15.170:0/379052574 shutdown_connections 2024-09-04T16:23:32.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.285+0000 7fb8e3900640 1 -- 172.21.15.170:0/379052574 wait complete. 2024-09-04T16:23:32.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.286+0000 7fb8e3900640 1 Processor -- start 2024-09-04T16:23:32.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.286+0000 7fb8e3900640 1 -- start start 2024-09-04T16:23:32.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.286+0000 7fb8e3900640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8dc100880 0x7fb8dc06ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:32.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.286+0000 7fb8e3900640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8dc101a80 0x7fb8dc19c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:32.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.286+0000 7fb8e3900640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb8dc109580 con 0x7fb8dc100880 2024-09-04T16:23:32.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.286+0000 7fb8e3900640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb8dc109400 con 0x7fb8dc101a80 2024-09-04T16:23:32.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.286+0000 7fb8e169c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8dc100880 0x7fb8dc06ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:32.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.286+0000 7fb8e169c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8dc100880 0x7fb8dc06ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37520/0 (socket says 172.21.15.170:37520) 2024-09-04T16:23:32.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.286+0000 7fb8e169c640 1 -- 172.21.15.170:0/3329719257 learned_addr learned my addr 172.21.15.170:0/3329719257 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:23:32.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.286+0000 7fb8e169c640 1 -- 172.21.15.170:0/3329719257 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8dc101a80 msgr2=0x7fb8dc19c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:32.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.286+0000 7fb8e0e9b640 1 --2- 172.21.15.170:0/3329719257 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8dc101a80 0x7fb8dc19c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.286+0000 7fb8e169c640 1 --2- 172.21.15.170:0/3329719257 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8dc101a80 0x7fb8dc19c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.286+0000 7fb8e169c640 1 -- 172.21.15.170:0/3329719257 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8dc19c6e0 con 0x7fb8dc100880 2024-09-04T16:23:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.286+0000 7fb8e169c640 1 --2- 172.21.15.170:0/3329719257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8dc100880 0x7fb8dc06ae30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8009230 tx=0x7fb8d80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.287+0000 7fb8d27fc640 1 -- 172.21.15.170:0/3329719257 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb8d803f070 con 0x7fb8dc100880 2024-09-04T16:23:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.287+0000 7fb8d27fc640 1 -- 172.21.15.170:0/3329719257 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7fb8d8003a90 con 0x7fb8dc100880 2024-09-04T16:23:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.287+0000 7fb8e3900640 1 -- 172.21.15.170:0/3329719257 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8dc19c970 con 0x7fb8dc100880 2024-09-04T16:23:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.287+0000 7fb8d27fc640 1 -- 172.21.15.170:0/3329719257 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb8d8035030 con 0x7fb8dc100880 2024-09-04T16:23:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.287+0000 7fb8e3900640 1 -- 172.21.15.170:0/3329719257 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8dc19cf20 con 0x7fb8dc100880 2024-09-04T16:23:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.288+0000 7fb8e3900640 1 -- 172.21.15.170:0/3329719257 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8dc100c80 con 0x7fb8dc100880 2024-09-04T16:23:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.288+0000 7fb8d27fc640 1 -- 172.21.15.170:0/3329719257 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7fb8d8042070 con 0x7fb8dc100880 2024-09-04T16:23:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.288+0000 7fb8d27fc640 1 --2- 172.21.15.170:0/3329719257 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb8c806ddb0 0x7fb8c8070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.288+0000 7fb8d27fc640 1 -- 172.21.15.170:0/3329719257 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb8d80ad5f0 con 0x7fb8dc100880 2024-09-04T16:23:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.288+0000 7fb8e0e9b640 1 --2- 172.21.15.170:0/3329719257 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb8c806ddb0 0x7fb8c8070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.289+0000 7fb8e0e9b640 1 --2- 172.21.15.170:0/3329719257 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb8c806ddb0 0x7fb8c8070270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc005fd0 tx=0x7fb8cc005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:32.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.293+0000 7fb8d27fc640 1 -- 172.21.15.170:0/3329719257 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb8d807c1e0 con 0x7fb8dc100880 2024-09-04T16:23:32.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.464+0000 7fb8e3900640 1 -- 172.21.15.170:0/3329719257 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fb8dc190390 con 0x7fb8dc100880 2024-09-04T16:23:32.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.468+0000 7fb8d27fc640 1 -- 172.21.15.170:0/3329719257 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7fb8d807fe90 con 0x7fb8dc100880 2024-09-04T16:23:32.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.470+0000 7fb8e3900640 1 -- 172.21.15.170:0/3329719257 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb8c806ddb0 msgr2=0x7fb8c8070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:32.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.470+0000 7fb8e3900640 1 --2- 172.21.15.170:0/3329719257 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb8c806ddb0 0x7fb8c8070270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc005fd0 tx=0x7fb8cc005850 comp rx=0 tx=0).stop 2024-09-04T16:23:32.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.470+0000 7fb8e3900640 1 -- 172.21.15.170:0/3329719257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8dc100880 msgr2=0x7fb8dc06ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:32.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.470+0000 7fb8e3900640 1 --2- 172.21.15.170:0/3329719257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8dc100880 0x7fb8dc06ae30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8009230 tx=0x7fb8d80048f0 comp rx=0 tx=0).stop 2024-09-04T16:23:32.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.471+0000 7fb8e3900640 1 -- 172.21.15.170:0/3329719257 shutdown_connections 2024-09-04T16:23:32.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.471+0000 7fb8e3900640 1 --2- 172.21.15.170:0/3329719257 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb8c806ddb0 0x7fb8c8070270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:32.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.471+0000 7fb8e3900640 1 --2- 172.21.15.170:0/3329719257 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8dc101a80 0x7fb8dc19c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:32.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.471+0000 7fb8e3900640 1 --2- 172.21.15.170:0/3329719257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8dc100880 0x7fb8dc06ae30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:32.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.471+0000 7fb8e3900640 1 -- 172.21.15.170:0/3329719257 >> 172.21.15.170:0/3329719257 conn(0x7fb8dc0fc010 msgr2=0x7fb8dc104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:32.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.471+0000 7fb8e3900640 1 -- 172.21.15.170:0/3329719257 shutdown_connections 2024-09-04T16:23:32.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:32.471+0000 7fb8e3900640 1 -- 172.21.15.170:0/3329719257 wait complete. 2024-09-04T16:23:33.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.608+0000 7fcb77364640 1 -- 172.21.15.170:0/567034944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb701023d0 msgr2=0x7fcb701047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:33.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.608+0000 7fcb77364640 1 --2- 172.21.15.170:0/567034944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb701023d0 0x7fcb701047c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0098b0 tx=0x7fcb6c02a4d0 comp rx=0 tx=0).stop 2024-09-04T16:23:33.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.608+0000 7fcb77364640 1 -- 172.21.15.170:0/567034944 shutdown_connections 2024-09-04T16:23:33.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.608+0000 7fcb77364640 1 --2- 172.21.15.170:0/567034944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb70104d00 0x7fcb701070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:33.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.608+0000 7fcb77364640 1 --2- 172.21.15.170:0/567034944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb701023d0 0x7fcb701047c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:33.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.608+0000 7fcb77364640 1 -- 172.21.15.170:0/567034944 >> 172.21.15.170:0/567034944 conn(0x7fcb700fbff0 msgr2=0x7fcb700fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:33.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.608+0000 7fcb77364640 1 -- 172.21.15.170:0/567034944 shutdown_connections 2024-09-04T16:23:33.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.608+0000 7fcb77364640 1 -- 172.21.15.170:0/567034944 wait complete. 2024-09-04T16:23:33.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.609+0000 7fcb77364640 1 Processor -- start 2024-09-04T16:23:33.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.609+0000 7fcb77364640 1 -- start start 2024-09-04T16:23:33.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.609+0000 7fcb77364640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb701023d0 0x7fcb70197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:33.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.609+0000 7fcb77364640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb70104d00 0x7fcb70197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:33.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.609+0000 7fcb77364640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7010a6d0 con 0x7fcb70104d00 2024-09-04T16:23:33.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.609+0000 7fcb77364640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7010a550 con 0x7fcb701023d0 2024-09-04T16:23:33.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.609+0000 7fcb748ff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb70104d00 0x7fcb70197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:33.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.609+0000 7fcb748ff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb70104d00 0x7fcb70197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37546/0 (socket says 172.21.15.170:37546) 2024-09-04T16:23:33.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.609+0000 7fcb748ff640 1 -- 172.21.15.170:0/2770568854 learned_addr learned my addr 172.21.15.170:0/2770568854 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:23:33.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.610+0000 7fcb75100640 1 --2- 172.21.15.170:0/2770568854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb701023d0 0x7fcb70197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:33.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.610+0000 7fcb748ff640 1 -- 172.21.15.170:0/2770568854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb701023d0 msgr2=0x7fcb70197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:33.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.610+0000 7fcb748ff640 1 --2- 172.21.15.170:0/2770568854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb701023d0 0x7fcb70197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:33.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.610+0000 7fcb748ff640 1 -- 172.21.15.170:0/2770568854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb701980e0 con 0x7fcb70104d00 2024-09-04T16:23:33.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.610+0000 7fcb75100640 1 --2- 172.21.15.170:0/2770568854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb701023d0 0x7fcb70197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:23:33.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.610+0000 7fcb748ff640 1 --2- 172.21.15.170:0/2770568854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb70104d00 0x7fcb70197a60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000b3d0 tx=0x7fcb6000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:33.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.610+0000 7fcb667fc640 1 -- 172.21.15.170:0/2770568854 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb60015020 con 0x7fcb70104d00 2024-09-04T16:23:33.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.610+0000 7fcb667fc640 1 -- 172.21.15.170:0/2770568854 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7fcb60011ad0 con 0x7fcb70104d00 2024-09-04T16:23:33.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.610+0000 7fcb77364640 1 -- 172.21.15.170:0/2770568854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7019cb20 con 0x7fcb70104d00 2024-09-04T16:23:33.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.610+0000 7fcb667fc640 1 -- 172.21.15.170:0/2770568854 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb60010c70 con 0x7fcb70104d00 2024-09-04T16:23:33.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.610+0000 7fcb77364640 1 -- 172.21.15.170:0/2770568854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7019d130 con 0x7fcb70104d00 2024-09-04T16:23:33.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.611+0000 7fcb77364640 1 -- 172.21.15.170:0/2770568854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb70102830 con 0x7fcb70104d00 2024-09-04T16:23:33.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.611+0000 7fcb667fc640 1 -- 172.21.15.170:0/2770568854 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7fcb60018020 con 0x7fcb70104d00 2024-09-04T16:23:33.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.612+0000 7fcb667fc640 1 --2- 172.21.15.170:0/2770568854 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fcb5c06de00 0x7fcb5c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:33.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.612+0000 7fcb75100640 1 --2- 172.21.15.170:0/2770568854 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fcb5c06de00 0x7fcb5c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:33.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.612+0000 7fcb667fc640 1 -- 172.21.15.170:0/2770568854 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fcb6008c4e0 con 0x7fcb70104d00 2024-09-04T16:23:33.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.613+0000 7fcb75100640 1 --2- 172.21.15.170:0/2770568854 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fcb5c06de00 0x7fcb5c0702c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0096c0 tx=0x7fcb6c000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:33.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.616+0000 7fcb667fc640 1 -- 172.21.15.170:0/2770568854 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb6001f020 con 0x7fcb70104d00 2024-09-04T16:23:33.652 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:33 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3329719257' entity='client.admin' 2024-09-04T16:23:33.652 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:33 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:33.652 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:33 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:33.653 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:33 smithi170 ceph-mon[29272]: Reconfiguring crash.smithi170 (monmap changed)... 2024-09-04T16:23:33.653 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:33 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi170", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-04T16:23:33.653 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:33 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:33.653 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:33 smithi170 ceph-mon[29272]: Reconfiguring daemon crash.smithi170 on smithi170 2024-09-04T16:23:33.653 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:33 smithi170 ceph-mon[29272]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:33.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.793+0000 7fcb77364640 1 -- 172.21.15.170:0/2770568854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fcb7019d3c0 con 0x7fcb70104d00 2024-09-04T16:23:33.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.797+0000 7fcb667fc640 1 -- 172.21.15.170:0/2770568854 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v24)=0 v24) ==== 125+0+0 (secure 0 0 0) 0x7fcb6005b1e0 con 0x7fcb70104d00 2024-09-04T16:23:33.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.799+0000 7fcb77364640 1 -- 172.21.15.170:0/2770568854 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fcb5c06de00 msgr2=0x7fcb5c0702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:33.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.799+0000 7fcb77364640 1 --2- 172.21.15.170:0/2770568854 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fcb5c06de00 0x7fcb5c0702c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0096c0 tx=0x7fcb6c000bc0 comp rx=0 tx=0).stop 2024-09-04T16:23:33.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.799+0000 7fcb77364640 1 -- 172.21.15.170:0/2770568854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb70104d00 msgr2=0x7fcb70197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:33.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.799+0000 7fcb77364640 1 --2- 172.21.15.170:0/2770568854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb70104d00 0x7fcb70197a60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000b3d0 tx=0x7fcb6000b890 comp rx=0 tx=0).stop 2024-09-04T16:23:33.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.799+0000 7fcb77364640 1 -- 172.21.15.170:0/2770568854 shutdown_connections 2024-09-04T16:23:33.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.799+0000 7fcb77364640 1 --2- 172.21.15.170:0/2770568854 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fcb5c06de00 0x7fcb5c0702c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:33.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.799+0000 7fcb77364640 1 --2- 172.21.15.170:0/2770568854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb70104d00 0x7fcb70197a60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:33.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.799+0000 7fcb77364640 1 --2- 172.21.15.170:0/2770568854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb701023d0 0x7fcb70197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:33.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.799+0000 7fcb77364640 1 -- 172.21.15.170:0/2770568854 >> 172.21.15.170:0/2770568854 conn(0x7fcb700fbff0 msgr2=0x7fcb700fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:33.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.799+0000 7fcb77364640 1 -- 172.21.15.170:0/2770568854 shutdown_connections 2024-09-04T16:23:33.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:33.799+0000 7fcb77364640 1 -- 172.21.15.170:0/2770568854 wait complete. 2024-09-04T16:23:33.822 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:33 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3329719257' entity='client.admin' 2024-09-04T16:23:33.822 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:33 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:33.823 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:33 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:33.823 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:33 smithi193 ceph-mon[36288]: Reconfiguring crash.smithi170 (monmap changed)... 2024-09-04T16:23:33.823 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:33 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi170", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-04T16:23:33.823 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:33 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:33.823 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:33 smithi193 ceph-mon[36288]: Reconfiguring daemon crash.smithi170 on smithi170 2024-09-04T16:23:33.823 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:33 smithi193 ceph-mon[36288]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:34.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.439+0000 7fee71668640 1 -- 172.21.15.170:0/3819614203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee6c101990 msgr2=0x7fee6c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:34.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.439+0000 7fee71668640 1 --2- 172.21.15.170:0/3819614203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee6c101990 0x7fee6c101d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009880 tx=0x7fee5c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:23:34.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.440+0000 7fee71668640 1 -- 172.21.15.170:0/3819614203 shutdown_connections 2024-09-04T16:23:34.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.440+0000 7fee71668640 1 --2- 172.21.15.170:0/3819614203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee6c102b90 0x7fee6c103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:34.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.440+0000 7fee71668640 1 --2- 172.21.15.170:0/3819614203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee6c101990 0x7fee6c101d90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:34.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.440+0000 7fee71668640 1 -- 172.21.15.170:0/3819614203 >> 172.21.15.170:0/3819614203 conn(0x7fee6c0fd140 msgr2=0x7fee6c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:34.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.440+0000 7fee71668640 1 -- 172.21.15.170:0/3819614203 shutdown_connections 2024-09-04T16:23:34.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.440+0000 7fee71668640 1 -- 172.21.15.170:0/3819614203 wait complete. 2024-09-04T16:23:34.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.440+0000 7fee71668640 1 Processor -- start 2024-09-04T16:23:34.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee71668640 1 -- start start 2024-09-04T16:23:34.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee71668640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee6c101990 0x7fee6c1973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:34.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee71668640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee6c102b90 0x7fee6c197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:34.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee71668640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c10a670 con 0x7fee6c101990 2024-09-04T16:23:34.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee71668640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c10a4f0 con 0x7fee6c102b90 2024-09-04T16:23:34.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee6affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee6c101990 0x7fee6c1973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:34.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee6affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee6c101990 0x7fee6c1973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37572/0 (socket says 172.21.15.170:37572) 2024-09-04T16:23:34.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee6affd640 1 -- 172.21.15.170:0/1065406930 learned_addr learned my addr 172.21.15.170:0/1065406930 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:23:34.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee6a7fc640 1 --2- 172.21.15.170:0/1065406930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee6c102b90 0x7fee6c197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:34.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee6affd640 1 -- 172.21.15.170:0/1065406930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee6c102b90 msgr2=0x7fee6c197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:34.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee6affd640 1 --2- 172.21.15.170:0/1065406930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee6c102b90 0x7fee6c197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:34.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee6affd640 1 -- 172.21.15.170:0/1065406930 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c197f20 con 0x7fee6c101990 2024-09-04T16:23:34.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee6a7fc640 1 --2- 172.21.15.170:0/1065406930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee6c102b90 0x7fee6c197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:23:34.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee6affd640 1 --2- 172.21.15.170:0/1065406930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee6c101990 0x7fee6c1973f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009230 tx=0x7fee5c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:34.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee53fff640 1 -- 172.21.15.170:0/1065406930 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee5c03f070 con 0x7fee6c101990 2024-09-04T16:23:34.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee53fff640 1 -- 172.21.15.170:0/1065406930 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7fee5c003a90 con 0x7fee6c101990 2024-09-04T16:23:34.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee71668640 1 -- 172.21.15.170:0/1065406930 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6c19c930 con 0x7fee6c101990 2024-09-04T16:23:34.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.441+0000 7fee53fff640 1 -- 172.21.15.170:0/1065406930 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee5c035030 con 0x7fee6c101990 2024-09-04T16:23:34.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.442+0000 7fee71668640 1 -- 172.21.15.170:0/1065406930 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee6c19ceb0 con 0x7fee6c101990 2024-09-04T16:23:34.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.442+0000 7fee71668640 1 -- 172.21.15.170:0/1065406930 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee6c101d90 con 0x7fee6c101990 2024-09-04T16:23:34.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.443+0000 7fee53fff640 1 -- 172.21.15.170:0/1065406930 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7fee5c042070 con 0x7fee6c101990 2024-09-04T16:23:34.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.443+0000 7fee53fff640 1 --2- 172.21.15.170:0/1065406930 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fee5406ddb0 0x7fee54070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:34.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.443+0000 7fee53fff640 1 -- 172.21.15.170:0/1065406930 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fee5c0ad6a0 con 0x7fee6c101990 2024-09-04T16:23:34.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.443+0000 7fee6a7fc640 1 --2- 172.21.15.170:0/1065406930 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fee5406ddb0 0x7fee54070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:34.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.444+0000 7fee6a7fc640 1 --2- 172.21.15.170:0/1065406930 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fee5406ddb0 0x7fee54070270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee6c1988a0 tx=0x7fee60005d90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:34.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.448+0000 7fee53fff640 1 -- 172.21.15.170:0/1065406930 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee5c07c320 con 0x7fee6c101990 2024-09-04T16:23:34.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.618+0000 7fee71668640 1 -- 172.21.15.170:0/1065406930 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fee6c19d160 con 0x7fee6c101990 2024-09-04T16:23:34.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.622+0000 7fee53fff640 1 -- 172.21.15.170:0/1065406930 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v25)=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7fee5c07ffd0 con 0x7fee6c101990 2024-09-04T16:23:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.624+0000 7fee71668640 1 -- 172.21.15.170:0/1065406930 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fee5406ddb0 msgr2=0x7fee54070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.624+0000 7fee71668640 1 --2- 172.21.15.170:0/1065406930 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fee5406ddb0 0x7fee54070270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee6c1988a0 tx=0x7fee60005d90 comp rx=0 tx=0).stop 2024-09-04T16:23:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.624+0000 7fee71668640 1 -- 172.21.15.170:0/1065406930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee6c101990 msgr2=0x7fee6c1973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.624+0000 7fee71668640 1 --2- 172.21.15.170:0/1065406930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee6c101990 0x7fee6c1973f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009230 tx=0x7fee5c0048f0 comp rx=0 tx=0).stop 2024-09-04T16:23:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.624+0000 7fee71668640 1 -- 172.21.15.170:0/1065406930 shutdown_connections 2024-09-04T16:23:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.624+0000 7fee71668640 1 --2- 172.21.15.170:0/1065406930 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fee5406ddb0 0x7fee54070270 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:34.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.624+0000 7fee71668640 1 --2- 172.21.15.170:0/1065406930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee6c102b90 0x7fee6c197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:34.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.624+0000 7fee71668640 1 --2- 172.21.15.170:0/1065406930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee6c101990 0x7fee6c1973f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:34.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.624+0000 7fee71668640 1 -- 172.21.15.170:0/1065406930 >> 172.21.15.170:0/1065406930 conn(0x7fee6c0fd140 msgr2=0x7fee6c0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:34.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.624+0000 7fee71668640 1 -- 172.21.15.170:0/1065406930 shutdown_connections 2024-09-04T16:23:34.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:34.624+0000 7fee71668640 1 -- 172.21.15.170:0/1065406930 wait complete. 2024-09-04T16:23:34.884 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:34 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2770568854' entity='client.admin' 2024-09-04T16:23:34.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:34 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1065406930' entity='client.admin' 2024-09-04T16:23:35.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:34 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2770568854' entity='client.admin' 2024-09-04T16:23:35.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:34 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1065406930' entity='client.admin' 2024-09-04T16:23:35.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.142+0000 7f53fac35640 1 -- 172.21.15.170:0/217226401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53f4102430 msgr2=0x7f53f4104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.142+0000 7f53fac35640 1 --2- 172.21.15.170:0/217226401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53f4102430 0x7f53f4104820 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009c20 tx=0x7f53f002a970 comp rx=0 tx=0).stop 2024-09-04T16:23:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.142+0000 7f53fac35640 1 -- 172.21.15.170:0/217226401 shutdown_connections 2024-09-04T16:23:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.142+0000 7f53fac35640 1 --2- 172.21.15.170:0/217226401 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53f4104d60 0x7f53f4107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.142+0000 7f53fac35640 1 --2- 172.21.15.170:0/217226401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53f4102430 0x7f53f4104820 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.142+0000 7f53fac35640 1 -- 172.21.15.170:0/217226401 >> 172.21.15.170:0/217226401 conn(0x7f53f40fbff0 msgr2=0x7f53f40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.142+0000 7f53fac35640 1 -- 172.21.15.170:0/217226401 shutdown_connections 2024-09-04T16:23:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.142+0000 7f53fac35640 1 -- 172.21.15.170:0/217226401 wait complete. 2024-09-04T16:23:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.143+0000 7f53fac35640 1 Processor -- start 2024-09-04T16:23:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.143+0000 7f53fac35640 1 -- start start 2024-09-04T16:23:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.143+0000 7f53fac35640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53f4102430 0x7f53f4101d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.143+0000 7f53fac35640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53f4104d60 0x7f53f41003e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.143+0000 7f53fac35640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f53f410a660 con 0x7f53f4102430 2024-09-04T16:23:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.143+0000 7f53fac35640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f53f410a4e0 con 0x7f53f4104d60 2024-09-04T16:23:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.143+0000 7f53f89d1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53f4102430 0x7f53f4101d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:35.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.143+0000 7f53f89d1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53f4102430 0x7f53f4101d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35464/0 (socket says 172.21.15.170:35464) 2024-09-04T16:23:35.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.143+0000 7f53f89d1640 1 -- 172.21.15.170:0/2492840393 learned_addr learned my addr 172.21.15.170:0/2492840393 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:23:35.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.143+0000 7f53f89d1640 1 -- 172.21.15.170:0/2492840393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53f4104d60 msgr2=0x7f53f41003e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:35.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.143+0000 7f53f89d1640 1 --2- 172.21.15.170:0/2492840393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53f4104d60 0x7f53f41003e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:35.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.143+0000 7f53f89d1640 1 -- 172.21.15.170:0/2492840393 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f4100920 con 0x7f53f4102430 2024-09-04T16:23:35.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.143+0000 7f53f89d1640 1 --2- 172.21.15.170:0/2492840393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53f4102430 0x7f53f4101d20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009d40 tx=0x7f53f00309e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:35.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.144+0000 7f53e9ffb640 1 -- 172.21.15.170:0/2492840393 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53f0047070 con 0x7f53f4102430 2024-09-04T16:23:35.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.144+0000 7f53e9ffb640 1 -- 172.21.15.170:0/2492840393 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f53f0003e10 con 0x7f53f4102430 2024-09-04T16:23:35.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.144+0000 7f53fac35640 1 -- 172.21.15.170:0/2492840393 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f4100c10 con 0x7f53f4102430 2024-09-04T16:23:35.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.144+0000 7f53e9ffb640 1 -- 172.21.15.170:0/2492840393 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53f0034070 con 0x7f53f4102430 2024-09-04T16:23:35.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.144+0000 7f53fac35640 1 -- 172.21.15.170:0/2492840393 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f4101220 con 0x7f53f4102430 2024-09-04T16:23:35.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.145+0000 7f53fac35640 1 -- 172.21.15.170:0/2492840393 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f4102890 con 0x7f53f4102430 2024-09-04T16:23:35.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.145+0000 7f53e9ffb640 1 -- 172.21.15.170:0/2492840393 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7f53f004a070 con 0x7f53f4102430 2024-09-04T16:23:35.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.146+0000 7f53e9ffb640 1 --2- 172.21.15.170:0/2492840393 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f53dc06ddb0 0x7f53dc070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:35.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.146+0000 7f53e9ffb640 1 -- 172.21.15.170:0/2492840393 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f53f00ad970 con 0x7f53f4102430 2024-09-04T16:23:35.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.146+0000 7f53ebfff640 1 --2- 172.21.15.170:0/2492840393 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f53dc06ddb0 0x7f53dc070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:35.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.146+0000 7f53ebfff640 1 --2- 172.21.15.170:0/2492840393 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f53dc06ddb0 0x7f53dc070270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f53f4101aa0 tx=0x7f53e4006c90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:35.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.150+0000 7f53e9ffb640 1 -- 172.21.15.170:0/2492840393 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f53f003f070 con 0x7f53f4102430 2024-09-04T16:23:35.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.324+0000 7f53fac35640 1 -- 172.21.15.170:0/2492840393 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f53f419f610 con 0x7f53f4102430 2024-09-04T16:23:35.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.327+0000 7f53e9ffb640 1 -- 172.21.15.170:0/2492840393 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v26)=0 v26) ==== 123+0+0 (secure 0 0 0) 0x7f53f007c5f0 con 0x7f53f4102430 2024-09-04T16:23:35.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.327+0000 7f53e9ffb640 1 -- 172.21.15.170:0/2492840393 <== mon.0 v2:172.21.15.170:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53f00b3080 con 0x7f53f4102430 2024-09-04T16:23:35.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.329+0000 7f53fac35640 1 -- 172.21.15.170:0/2492840393 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f53dc06ddb0 msgr2=0x7f53dc070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:35.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.329+0000 7f53fac35640 1 --2- 172.21.15.170:0/2492840393 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f53dc06ddb0 0x7f53dc070270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f53f4101aa0 tx=0x7f53e4006c90 comp rx=0 tx=0).stop 2024-09-04T16:23:35.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.329+0000 7f53fac35640 1 -- 172.21.15.170:0/2492840393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53f4102430 msgr2=0x7f53f4101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:35.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.329+0000 7f53fac35640 1 --2- 172.21.15.170:0/2492840393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53f4102430 0x7f53f4101d20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009d40 tx=0x7f53f00309e0 comp rx=0 tx=0).stop 2024-09-04T16:23:35.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.329+0000 7f53fac35640 1 -- 172.21.15.170:0/2492840393 shutdown_connections 2024-09-04T16:23:35.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.329+0000 7f53fac35640 1 --2- 172.21.15.170:0/2492840393 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f53dc06ddb0 0x7f53dc070270 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:35.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.329+0000 7f53fac35640 1 --2- 172.21.15.170:0/2492840393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53f4104d60 0x7f53f41003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:35.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.329+0000 7f53fac35640 1 --2- 172.21.15.170:0/2492840393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53f4102430 0x7f53f4101d20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:35.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.329+0000 7f53fac35640 1 -- 172.21.15.170:0/2492840393 >> 172.21.15.170:0/2492840393 conn(0x7f53f40fbff0 msgr2=0x7f53f40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:35.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.329+0000 7f53fac35640 1 -- 172.21.15.170:0/2492840393 shutdown_connections 2024-09-04T16:23:35.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:35.329+0000 7f53fac35640 1 -- 172.21.15.170:0/2492840393 wait complete. 2024-09-04T16:23:35.928 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi170') 2024-09-04T16:23:35.928 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi170') 2024-09-04T16:23:36.334 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi170') 2024-09-04T16:23:36.335 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi170') 2024-09-04T16:23:36.597 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:36 smithi170 ceph-mon[29272]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:36.597 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:36 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2492840393' entity='client.admin' 2024-09-04T16:23:36.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:36 smithi193 ceph-mon[36288]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:36.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:36 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2492840393' entity='client.admin' 2024-09-04T16:23:37.292 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:38.083 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi170') 2024-09-04T16:23:38.083 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi170') 2024-09-04T16:23:38.083 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi170') 2024-09-04T16:23:38.083 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi170') 2024-09-04T16:23:38.083 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi170') 2024-09-04T16:23:38.084 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi170') 2024-09-04T16:23:38.084 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi170') 2024-09-04T16:23:38.214 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:37 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:38.214 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:37 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:38.214 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:37 smithi170 ceph-mon[29272]: Reconfiguring alertmanager.smithi170 (dependencies changed)... 2024-09-04T16:23:38.214 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:37 smithi170 ceph-mon[29272]: Reconfiguring daemon alertmanager.smithi170 on smithi170 2024-09-04T16:23:38.214 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:37 smithi170 ceph-mon[29272]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:38.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.295+0000 7f8c801f8640 1 -- 172.21.15.170:0/1899738533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c78102b90 msgr2=0x7f8c78103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:38.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.295+0000 7f8c801f8640 1 --2- 172.21.15.170:0/1899738533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c78102b90 0x7f8c78103010 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009880 tx=0x7f8c6802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:23:38.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.295+0000 7f8c801f8640 1 -- 172.21.15.170:0/1899738533 shutdown_connections 2024-09-04T16:23:38.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.295+0000 7f8c801f8640 1 --2- 172.21.15.170:0/1899738533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c78102b90 0x7f8c78103010 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:38.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.295+0000 7f8c801f8640 1 --2- 172.21.15.170:0/1899738533 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c78101990 0x7f8c78101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:38.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.295+0000 7f8c801f8640 1 -- 172.21.15.170:0/1899738533 >> 172.21.15.170:0/1899738533 conn(0x7f8c780fd140 msgr2=0x7f8c780ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:38.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.295+0000 7f8c801f8640 1 -- 172.21.15.170:0/1899738533 shutdown_connections 2024-09-04T16:23:38.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.295+0000 7f8c801f8640 1 -- 172.21.15.170:0/1899738533 wait complete. 2024-09-04T16:23:38.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.296+0000 7f8c801f8640 1 Processor -- start 2024-09-04T16:23:38.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.296+0000 7f8c801f8640 1 -- start start 2024-09-04T16:23:38.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.296+0000 7f8c801f8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c78101990 0x7f8c781974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:38.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.296+0000 7f8c801f8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c78102b90 0x7f8c781979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:38.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.296+0000 7f8c801f8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7810a7b0 con 0x7f8c78101990 2024-09-04T16:23:38.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.296+0000 7f8c801f8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7810a630 con 0x7f8c78102b90 2024-09-04T16:23:38.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.296+0000 7f8c7df94640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c78101990 0x7f8c781974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:38.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.296+0000 7f8c7df94640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c78101990 0x7f8c781974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35482/0 (socket says 172.21.15.170:35482) 2024-09-04T16:23:38.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.296+0000 7f8c7df94640 1 -- 172.21.15.170:0/1627216095 learned_addr learned my addr 172.21.15.170:0/1627216095 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:23:38.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.296+0000 7f8c7df94640 1 -- 172.21.15.170:0/1627216095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c78102b90 msgr2=0x7f8c781979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:38.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.296+0000 7f8c7df94640 1 --2- 172.21.15.170:0/1627216095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c78102b90 0x7f8c781979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:38.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.296+0000 7f8c7df94640 1 -- 172.21.15.170:0/1627216095 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c78197fd0 con 0x7f8c78101990 2024-09-04T16:23:38.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.296+0000 7f8c7df94640 1 --2- 172.21.15.170:0/1627216095 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c78101990 0x7f8c781974a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400c8f0 tx=0x7f8c7400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:38.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.296+0000 7f8c6effd640 1 -- 172.21.15.170:0/1627216095 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c74004020 con 0x7f8c78101990 2024-09-04T16:23:38.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.297+0000 7f8c801f8640 1 -- 172.21.15.170:0/1627216095 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c7819ca40 con 0x7f8c78101990 2024-09-04T16:23:38.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.297+0000 7f8c6effd640 1 -- 172.21.15.170:0/1627216095 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c74007e10 con 0x7f8c78101990 2024-09-04T16:23:38.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.297+0000 7f8c6effd640 1 -- 172.21.15.170:0/1627216095 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c74003e10 con 0x7f8c78101990 2024-09-04T16:23:38.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.297+0000 7f8c801f8640 1 -- 172.21.15.170:0/1627216095 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c7819cfa0 con 0x7f8c78101990 2024-09-04T16:23:38.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.298+0000 7f8c801f8640 1 -- 172.21.15.170:0/1627216095 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c78101d90 con 0x7f8c78101990 2024-09-04T16:23:38.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.298+0000 7f8c6effd640 1 -- 172.21.15.170:0/1627216095 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7f8c740041c0 con 0x7f8c78101990 2024-09-04T16:23:38.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.299+0000 7f8c6effd640 1 --2- 172.21.15.170:0/1627216095 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8c6406ddc0 0x7f8c64070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:38.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.299+0000 7f8c7d793640 1 --2- 172.21.15.170:0/1627216095 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8c6406ddc0 0x7f8c64070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:38.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.299+0000 7f8c6effd640 1 -- 172.21.15.170:0/1627216095 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8c7408cc00 con 0x7f8c78101990 2024-09-04T16:23:38.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.299+0000 7f8c7d793640 1 --2- 172.21.15.170:0/1627216095 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8c6406ddc0 0x7f8c64070280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8c6802a9c0 tx=0x7f8c68000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:38.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.303+0000 7f8c6effd640 1 -- 172.21.15.170:0/1627216095 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8c74093080 con 0x7f8c78101990 2024-09-04T16:23:38.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:37 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:38.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:37 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:38.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:37 smithi193 ceph-mon[36288]: Reconfiguring alertmanager.smithi170 (dependencies changed)... 2024-09-04T16:23:38.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:37 smithi193 ceph-mon[36288]: Reconfiguring daemon alertmanager.smithi170 on smithi170 2024-09-04T16:23:38.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:37 smithi193 ceph-mon[36288]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:38.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.477+0000 7f8c801f8640 1 -- 172.21.15.170:0/1627216095 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f8c7819d9e0 con 0x7f8c78101990 2024-09-04T16:23:38.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.481+0000 7f8c6effd640 1 -- 172.21.15.170:0/1627216095 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7f8c74015330 con 0x7f8c78101990 2024-09-04T16:23:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.483+0000 7f8c801f8640 1 -- 172.21.15.170:0/1627216095 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8c6406ddc0 msgr2=0x7f8c64070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.483+0000 7f8c801f8640 1 --2- 172.21.15.170:0/1627216095 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8c6406ddc0 0x7f8c64070280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8c6802a9c0 tx=0x7f8c68000bc0 comp rx=0 tx=0).stop 2024-09-04T16:23:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.483+0000 7f8c801f8640 1 -- 172.21.15.170:0/1627216095 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c78101990 msgr2=0x7f8c781974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.483+0000 7f8c801f8640 1 --2- 172.21.15.170:0/1627216095 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c78101990 0x7f8c781974a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400c8f0 tx=0x7f8c7400cdb0 comp rx=0 tx=0).stop 2024-09-04T16:23:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.483+0000 7f8c801f8640 1 -- 172.21.15.170:0/1627216095 shutdown_connections 2024-09-04T16:23:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.483+0000 7f8c801f8640 1 --2- 172.21.15.170:0/1627216095 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8c6406ddc0 0x7f8c64070280 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.483+0000 7f8c801f8640 1 --2- 172.21.15.170:0/1627216095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c78102b90 0x7f8c781979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.483+0000 7f8c801f8640 1 --2- 172.21.15.170:0/1627216095 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c78101990 0x7f8c781974a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.483+0000 7f8c801f8640 1 -- 172.21.15.170:0/1627216095 >> 172.21.15.170:0/1627216095 conn(0x7f8c780fd140 msgr2=0x7f8c780ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.483+0000 7f8c801f8640 1 -- 172.21.15.170:0/1627216095 shutdown_connections 2024-09-04T16:23:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:38.483+0000 7f8c801f8640 1 -- 172.21.15.170:0/1627216095 wait complete. 2024-09-04T16:23:39.772 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:39 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1627216095' entity='client.admin' 2024-09-04T16:23:39.773 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:39 smithi170 ceph-mon[29272]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:39.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:39 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1627216095' entity='client.admin' 2024-09-04T16:23:39.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:39 smithi193 ceph-mon[36288]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:41.406 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi170') 2024-09-04T16:23:41.406 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '89be7670-6ad9-11ef-bcd6-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi170') 2024-09-04T16:23:42.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.159+0000 7fdc78347640 1 -- 172.21.15.170:0/3719475909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc70101a80 msgr2=0x7fdc70101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:42.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.159+0000 7fdc78347640 1 --2- 172.21.15.170:0/3719475909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc70101a80 0x7fdc70101f00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdc60009880 tx=0x7fdc6002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:23:42.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.159+0000 7fdc78347640 1 -- 172.21.15.170:0/3719475909 shutdown_connections 2024-09-04T16:23:42.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.159+0000 7fdc78347640 1 --2- 172.21.15.170:0/3719475909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc70101a80 0x7fdc70101f00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:42.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.159+0000 7fdc78347640 1 --2- 172.21.15.170:0/3719475909 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc70100880 0x7fdc70100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:42.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.159+0000 7fdc78347640 1 -- 172.21.15.170:0/3719475909 >> 172.21.15.170:0/3719475909 conn(0x7fdc700fc010 msgr2=0x7fdc700fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:42.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.159+0000 7fdc78347640 1 -- 172.21.15.170:0/3719475909 shutdown_connections 2024-09-04T16:23:42.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.159+0000 7fdc78347640 1 -- 172.21.15.170:0/3719475909 wait complete. 2024-09-04T16:23:42.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.160+0000 7fdc78347640 1 Processor -- start 2024-09-04T16:23:42.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.160+0000 7fdc78347640 1 -- start start 2024-09-04T16:23:42.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.160+0000 7fdc78347640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc70100880 0x7fdc70196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:42.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.160+0000 7fdc78347640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc70101a80 0x7fdc701968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:42.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.160+0000 7fdc78347640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdc701096a0 con 0x7fdc70100880 2024-09-04T16:23:42.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.160+0000 7fdc78347640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdc70109520 con 0x7fdc70101a80 2024-09-04T16:23:42.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.160+0000 7fdc760e3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc70100880 0x7fdc70196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:42.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.160+0000 7fdc760e3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc70100880 0x7fdc70196380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35500/0 (socket says 172.21.15.170:35500) 2024-09-04T16:23:42.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.160+0000 7fdc760e3640 1 -- 172.21.15.170:0/2850509311 learned_addr learned my addr 172.21.15.170:0/2850509311 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:23:42.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.160+0000 7fdc758e2640 1 --2- 172.21.15.170:0/2850509311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc70101a80 0x7fdc701968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:42.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.160+0000 7fdc760e3640 1 -- 172.21.15.170:0/2850509311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc70101a80 msgr2=0x7fdc701968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:42.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.160+0000 7fdc760e3640 1 --2- 172.21.15.170:0/2850509311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc70101a80 0x7fdc701968c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:42.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.161+0000 7fdc760e3640 1 -- 172.21.15.170:0/2850509311 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc70196f40 con 0x7fdc70100880 2024-09-04T16:23:42.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.161+0000 7fdc760e3640 1 --2- 172.21.15.170:0/2850509311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc70100880 0x7fdc70196380 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c00c8f0 tx=0x7fdc6c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:42.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.161+0000 7fdc677fe640 1 -- 172.21.15.170:0/2850509311 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdc6c0079b0 con 0x7fdc70100880 2024-09-04T16:23:42.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.161+0000 7fdc78347640 1 -- 172.21.15.170:0/2850509311 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc7019b980 con 0x7fdc70100880 2024-09-04T16:23:42.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.161+0000 7fdc677fe640 1 -- 172.21.15.170:0/2850509311 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdc6c007b50 con 0x7fdc70100880 2024-09-04T16:23:42.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.161+0000 7fdc677fe640 1 -- 172.21.15.170:0/2850509311 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdc6c018610 con 0x7fdc70100880 2024-09-04T16:23:42.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.161+0000 7fdc78347640 1 -- 172.21.15.170:0/2850509311 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7019bf10 con 0x7fdc70100880 2024-09-04T16:23:42.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.162+0000 7fdc78347640 1 -- 172.21.15.170:0/2850509311 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc70100c80 con 0x7fdc70100880 2024-09-04T16:23:42.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.162+0000 7fdc677fe640 1 -- 172.21.15.170:0/2850509311 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7fdc6c007d00 con 0x7fdc70100880 2024-09-04T16:23:42.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.163+0000 7fdc677fe640 1 --2- 172.21.15.170:0/2850509311 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fdc5c06ddb0 0x7fdc5c070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:42.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.163+0000 7fdc677fe640 1 -- 172.21.15.170:0/2850509311 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdc6c08cd70 con 0x7fdc70100880 2024-09-04T16:23:42.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.163+0000 7fdc758e2640 1 --2- 172.21.15.170:0/2850509311 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fdc5c06ddb0 0x7fdc5c070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:42.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.163+0000 7fdc758e2640 1 --2- 172.21.15.170:0/2850509311 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fdc5c06ddb0 0x7fdc5c070270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdc60006010 tx=0x7fdc60000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:42.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.167+0000 7fdc677fe640 1 -- 172.21.15.170:0/2850509311 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdc6c014030 con 0x7fdc70100880 2024-09-04T16:23:42.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.360+0000 7fdc78347640 1 -- 172.21.15.170:0/2850509311 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fdc701904b0 con 0x7fdc70100880 2024-09-04T16:23:42.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.363+0000 7fdc677fe640 1 -- 172.21.15.170:0/2850509311 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7fdc701904b0 con 0x7fdc70100880 2024-09-04T16:23:42.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.365+0000 7fdc78347640 1 -- 172.21.15.170:0/2850509311 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fdc5c06ddb0 msgr2=0x7fdc5c070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:42.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.365+0000 7fdc78347640 1 --2- 172.21.15.170:0/2850509311 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fdc5c06ddb0 0x7fdc5c070270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdc60006010 tx=0x7fdc60000bc0 comp rx=0 tx=0).stop 2024-09-04T16:23:42.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.365+0000 7fdc78347640 1 -- 172.21.15.170:0/2850509311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc70100880 msgr2=0x7fdc70196380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:42.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.365+0000 7fdc78347640 1 --2- 172.21.15.170:0/2850509311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc70100880 0x7fdc70196380 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c00c8f0 tx=0x7fdc6c00cdb0 comp rx=0 tx=0).stop 2024-09-04T16:23:42.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.366+0000 7fdc78347640 1 -- 172.21.15.170:0/2850509311 shutdown_connections 2024-09-04T16:23:42.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.366+0000 7fdc78347640 1 --2- 172.21.15.170:0/2850509311 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fdc5c06ddb0 0x7fdc5c070270 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:42.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.366+0000 7fdc78347640 1 --2- 172.21.15.170:0/2850509311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc70101a80 0x7fdc701968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:42.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.366+0000 7fdc78347640 1 --2- 172.21.15.170:0/2850509311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc70100880 0x7fdc70196380 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:42.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.366+0000 7fdc78347640 1 -- 172.21.15.170:0/2850509311 >> 172.21.15.170:0/2850509311 conn(0x7fdc700fc010 msgr2=0x7fdc70104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:42.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.366+0000 7fdc78347640 1 -- 172.21.15.170:0/2850509311 shutdown_connections 2024-09-04T16:23:42.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:42.366+0000 7fdc78347640 1 -- 172.21.15.170:0/2850509311 wait complete. 2024-09-04T16:23:42.474 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:42 smithi170 ceph-mon[29272]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:42.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:42 smithi193 ceph-mon[36288]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:43.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:43 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2850509311' entity='client.admin' 2024-09-04T16:23:43.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:23:43.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:43 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2850509311' entity='client.admin' 2024-09-04T16:23:43.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:43 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:23:43.852 INFO:tasks.cephadm:Deploying OSDs... 2024-09-04T16:23:43.853 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:23:43.853 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2024-09-04T16:23:43.870 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-04T16:23:43.870 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2024-09-04T16:23:43.926 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-04T16:23:43.926 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-04T16:23:43.926 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-04T16:23:43.927 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-04T16:23:43.927 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-04T16:23:43.927 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-04 16:22:36.716220628 +0000 2024-09-04T16:23:43.927 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-04 16:17:25.065100345 +0000 2024-09-04T16:23:43.927 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-04 16:17:25.065100345 +0000 2024-09-04T16:23:43.927 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-04 16:17:25.065100345 +0000 2024-09-04T16:23:43.927 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-04T16:23:43.992 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-04T16:23:43.992 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-04T16:23:43.993 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000219583 s, 2.3 MB/s 2024-09-04T16:23:43.993 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-04T16:23:44.051 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2024-09-04T16:23:44.108 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-04T16:23:44.108 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-04T16:23:44.108 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-09-04T16:23:44.108 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-04T16:23:44.108 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-04T16:23:44.108 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-04 16:22:36.716220628 +0000 2024-09-04T16:23:44.108 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-04 16:17:25.382092394 +0000 2024-09-04T16:23:44.108 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-04 16:17:25.382092394 +0000 2024-09-04T16:23:44.109 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-04 16:17:25.382092394 +0000 2024-09-04T16:23:44.109 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-04T16:23:44.173 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-04T16:23:44.173 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-04T16:23:44.173 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 9.1216e-05 s, 5.6 MB/s 2024-09-04T16:23:44.174 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-04T16:23:44.230 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2024-09-04T16:23:44.285 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-04T16:23:44.285 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-04T16:23:44.286 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-04T16:23:44.286 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-04T16:23:44.286 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-04T16:23:44.286 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-04 16:22:36.717220603 +0000 2024-09-04T16:23:44.286 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-04 16:17:25.693084592 +0000 2024-09-04T16:23:44.286 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-04 16:17:25.693084592 +0000 2024-09-04T16:23:44.286 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-04 16:17:25.693084592 +0000 2024-09-04T16:23:44.286 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-04T16:23:44.349 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-04T16:23:44.349 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-04T16:23:44.349 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000108422 s, 4.7 MB/s 2024-09-04T16:23:44.350 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-04T16:23:44.406 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2024-09-04T16:23:44.461 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-04T16:23:44.462 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-04T16:23:44.462 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-04T16:23:44.462 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-04T16:23:44.462 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-04T16:23:44.462 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-04 16:22:36.717220603 +0000 2024-09-04T16:23:44.462 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-04 16:17:26.015076515 +0000 2024-09-04T16:23:44.462 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-04 16:17:26.015076515 +0000 2024-09-04T16:23:44.462 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-04 16:17:26.015076515 +0000 2024-09-04T16:23:44.462 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-04T16:23:44.524 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:44 smithi170 ceph-mon[29272]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:44.526 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-04T16:23:44.526 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-04T16:23:44.526 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 8.6973e-05 s, 5.9 MB/s 2024-09-04T16:23:44.527 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-04T16:23:44.584 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-04T16:23:44.584 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/scratch_devs of=/dev/stdout 2024-09-04T16:23:44.605 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-04T16:23:44.605 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_1 2024-09-04T16:23:44.655 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:44 smithi193 ceph-mon[36288]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:44.664 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-04T16:23:44.665 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-04T16:23:44.665 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 669 Links: 1 2024-09-04T16:23:44.665 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-04T16:23:44.665 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-04T16:23:44.665 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-04 16:23:07.600501643 +0000 2024-09-04T16:23:44.665 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-04 16:17:25.077141539 +0000 2024-09-04T16:23:44.665 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-04 16:17:25.077141539 +0000 2024-09-04T16:23:44.665 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-04 16:17:25.077141539 +0000 2024-09-04T16:23:44.665 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-04T16:23:44.735 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-04T16:23:44.735 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-04T16:23:44.735 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000293622 s, 1.7 MB/s 2024-09-04T16:23:44.736 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-04T16:23:44.795 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_2 2024-09-04T16:23:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-04T16:23:44.852 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-04T16:23:44.852 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-04T16:23:44.852 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-04T16:23:44.853 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-04T16:23:44.853 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-04 16:23:07.600501643 +0000 2024-09-04T16:23:44.853 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-04 16:17:25.402137053 +0000 2024-09-04T16:23:44.853 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-04 16:17:25.402137053 +0000 2024-09-04T16:23:44.853 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-04 16:17:25.402137053 +0000 2024-09-04T16:23:44.853 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-04T16:23:44.919 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-04T16:23:44.919 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-04T16:23:44.919 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000220697 s, 2.3 MB/s 2024-09-04T16:23:44.920 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-04T16:23:44.978 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_3 2024-09-04T16:23:45.034 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-04T16:23:45.035 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-04T16:23:45.035 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-04T16:23:45.035 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-04T16:23:45.035 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-04T16:23:45.035 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-04 16:23:07.601501628 +0000 2024-09-04T16:23:45.035 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-04 16:17:25.729132540 +0000 2024-09-04T16:23:45.035 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-04 16:17:25.729132540 +0000 2024-09-04T16:23:45.035 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-04 16:17:25.729132540 +0000 2024-09-04T16:23:45.035 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-04T16:23:45.100 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-04T16:23:45.100 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-04T16:23:45.100 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000220181 s, 2.3 MB/s 2024-09-04T16:23:45.101 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-04T16:23:45.158 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_4 2024-09-04T16:23:45.214 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-04T16:23:45.214 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-04T16:23:45.214 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-04T16:23:45.214 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-04T16:23:45.214 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-04T16:23:45.215 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-04 16:23:07.601501628 +0000 2024-09-04T16:23:45.215 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-04 16:17:26.041128234 +0000 2024-09-04T16:23:45.215 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-04 16:17:26.041128234 +0000 2024-09-04T16:23:45.215 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-04 16:17:26.041128234 +0000 2024-09-04T16:23:45.215 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-04T16:23:45.278 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-04T16:23:45.279 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-04T16:23:45.279 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000255652 s, 2.0 MB/s 2024-09-04T16:23:45.280 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-04T16:23:45.337 INFO:tasks.cephadm:Deploying osd.0 on smithi170 with /dev/vg_nvme/lv_4... 2024-09-04T16:23:45.337 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-04T16:23:46.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:45 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:46.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:45 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:46.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:45 smithi170 ceph-mon[29272]: Reconfiguring grafana.smithi170 (dependencies changed)... 2024-09-04T16:23:46.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:45 smithi170 ceph-mon[29272]: Reconfiguring daemon grafana.smithi170 on smithi170 2024-09-04T16:23:46.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:45 smithi170 ceph-mon[29272]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:46.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:45 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:46.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:45 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:46.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:45 smithi193 ceph-mon[36288]: Reconfiguring grafana.smithi170 (dependencies changed)... 2024-09-04T16:23:46.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:45 smithi193 ceph-mon[36288]: Reconfiguring daemon grafana.smithi170 on smithi170 2024-09-04T16:23:46.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:45 smithi193 ceph-mon[36288]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:47.045 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:48.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:48 smithi170 ceph-mon[29272]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:48.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:48 smithi193 ceph-mon[36288]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:50.413 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:50 smithi170 ceph-mon[29272]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:50.413 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:50.413 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:50 smithi193 ceph-mon[36288]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:50 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:50 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:51.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:51 smithi170 ceph-mon[29272]: Reconfiguring prometheus.smithi170 (dependencies changed)... 2024-09-04T16:23:51.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:51 smithi170 ceph-mon[29272]: Reconfiguring daemon prometheus.smithi170 on smithi170 2024-09-04T16:23:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:51 smithi193 ceph-mon[36288]: Reconfiguring prometheus.smithi170 (dependencies changed)... 2024-09-04T16:23:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:51 smithi193 ceph-mon[36288]: Reconfiguring daemon prometheus.smithi170 on smithi170 2024-09-04T16:23:51.696 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:23:51.721 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi170:vg_nvme/lv_4 2024-09-04T16:23:52.557 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:52 smithi193 ceph-mon[36288]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:52.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:52 smithi170 ceph-mon[29272]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:52.609 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:23:54.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:54 smithi170 ceph-mon[29272]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:54 smithi193 ceph-mon[36288]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.673+0000 7f8592787640 1 -- 172.21.15.170:0/4090014963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f858c101a40 msgr2=0x7f858c101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.673+0000 7f8592787640 1 --2- 172.21.15.170:0/4090014963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f858c101a40 0x7f858c101ec0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8574009880 tx=0x7f857402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:23:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.673+0000 7f8592787640 1 -- 172.21.15.170:0/4090014963 shutdown_connections 2024-09-04T16:23:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.673+0000 7f8592787640 1 --2- 172.21.15.170:0/4090014963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f858c101a40 0x7f858c101ec0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.673+0000 7f8592787640 1 --2- 172.21.15.170:0/4090014963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f858c100840 0x7f858c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.673+0000 7f8592787640 1 -- 172.21.15.170:0/4090014963 >> 172.21.15.170:0/4090014963 conn(0x7f858c0fbff0 msgr2=0x7f858c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:23:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.673+0000 7f8592787640 1 -- 172.21.15.170:0/4090014963 shutdown_connections 2024-09-04T16:23:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.673+0000 7f8592787640 1 -- 172.21.15.170:0/4090014963 wait complete. 2024-09-04T16:23:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.674+0000 7f8592787640 1 Processor -- start 2024-09-04T16:23:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.674+0000 7f8592787640 1 -- start start 2024-09-04T16:23:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.674+0000 7f8592787640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f858c100840 0x7f858c1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.674+0000 7f8592787640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f858c101a40 0x7f858c1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.674+0000 7f8592787640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f858c109660 con 0x7f858c101a40 2024-09-04T16:23:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.674+0000 7f8592787640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f858c1094e0 con 0x7f858c100840 2024-09-04T16:23:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.674+0000 7f8583fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f858c101a40 0x7f858c1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.674+0000 7f8583fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f858c101a40 0x7f858c1979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43106/0 (socket says 172.21.15.170:43106) 2024-09-04T16:23:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.674+0000 7f8583fff640 1 -- 172.21.15.170:0/3507497796 learned_addr learned my addr 172.21.15.170:0/3507497796 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:23:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.674+0000 7f858bfff640 1 --2- 172.21.15.170:0/3507497796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f858c100840 0x7f858c1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.675+0000 7f8583fff640 1 -- 172.21.15.170:0/3507497796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f858c100840 msgr2=0x7f858c1974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:23:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.675+0000 7f8583fff640 1 --2- 172.21.15.170:0/3507497796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f858c100840 0x7f858c1974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:23:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.675+0000 7f8583fff640 1 -- 172.21.15.170:0/3507497796 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858c198060 con 0x7f858c101a40 2024-09-04T16:23:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.675+0000 7f8583fff640 1 --2- 172.21.15.170:0/3507497796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f858c101a40 0x7f858c1979e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8574006010 tx=0x7f85740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.675+0000 7f8589ffb640 1 -- 172.21.15.170:0/3507497796 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f857403f070 con 0x7f858c101a40 2024-09-04T16:23:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.675+0000 7f8592787640 1 -- 172.21.15.170:0/3507497796 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858c19ca40 con 0x7f858c101a40 2024-09-04T16:23:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.675+0000 7f8589ffb640 1 -- 172.21.15.170:0/3507497796 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8574004ac0 con 0x7f858c101a40 2024-09-04T16:23:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.675+0000 7f8589ffb640 1 -- 172.21.15.170:0/3507497796 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8574035030 con 0x7f858c101a40 2024-09-04T16:23:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.676+0000 7f8592787640 1 -- 172.21.15.170:0/3507497796 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f858c19cfd0 con 0x7f858c101a40 2024-09-04T16:23:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.677+0000 7f8592787640 1 -- 172.21.15.170:0/3507497796 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f858c100c40 con 0x7f858c101a40 2024-09-04T16:23:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.677+0000 7f8589ffb640 1 -- 172.21.15.170:0/3507497796 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7f8574042070 con 0x7f858c101a40 2024-09-04T16:23:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.677+0000 7f8589ffb640 1 --2- 172.21.15.170:0/3507497796 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f857806ddb0 0x7f8578070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:23:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.677+0000 7f8589ffb640 1 -- 172.21.15.170:0/3507497796 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f85740ad630 con 0x7f858c101a40 2024-09-04T16:23:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.677+0000 7f858bfff640 1 --2- 172.21.15.170:0/3507497796 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f857806ddb0 0x7f8578070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:23:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.678+0000 7f858bfff640 1 --2- 172.21.15.170:0/3507497796 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f857806ddb0 0x7f8578070270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f858c1018a0 tx=0x7f857c00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:23:54.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.682+0000 7f8589ffb640 1 -- 172.21.15.170:0/3507497796 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f857407ff60 con 0x7f858c101a40 2024-09-04T16:23:54.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:23:54.863+0000 7f8592787640 1 -- 172.21.15.170:0/3507497796 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f858c0fde20 con 0x7f857806ddb0 2024-09-04T16:23:55.565 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:55 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-04T16:23:55.565 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:55 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-04T16:23:55.565 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:55 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:55.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:55 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-04T16:23:55.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:55 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-04T16:23:55.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:55 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:56.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:56 smithi170 ceph-mon[29272]: from='client.14332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:23:56.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:56 smithi170 ceph-mon[29272]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:56.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:56 smithi193 ceph-mon[36288]: from='client.14332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:23:56.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:56 smithi193 ceph-mon[36288]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:58.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:58 smithi170 ceph-mon[29272]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:58.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:58 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:58.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:58 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:58.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:58 smithi170 ceph-mon[29272]: Reconfiguring ceph-exporter.smithi193 (monmap changed)... 2024-09-04T16:23:58.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:58 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi193", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-04T16:23:58.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:58 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:58.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:58 smithi170 ceph-mon[29272]: Reconfiguring daemon ceph-exporter.smithi193 on smithi193 2024-09-04T16:23:58.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:58 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:23:58.612 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:58 smithi193 ceph-mon[36288]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:23:58.612 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:58 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:58.612 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:58 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:58.612 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:58 smithi193 ceph-mon[36288]: Reconfiguring ceph-exporter.smithi193 (monmap changed)... 2024-09-04T16:23:58.612 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:58 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi193", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-04T16:23:58.612 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:58 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:58.612 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:58 smithi193 ceph-mon[36288]: Reconfiguring daemon ceph-exporter.smithi193 on smithi193 2024-09-04T16:23:58.612 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:58 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:23:59.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:59 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/822267159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbba256a-288b-4bce-b9c0-5cebfc7c5a5a"}]: dispatch 2024-09-04T16:23:59.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:59 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/822267159' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbba256a-288b-4bce-b9c0-5cebfc7c5a5a"}]': finished 2024-09-04T16:23:59.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:59 smithi170 ceph-mon[29272]: osdmap e6: 1 total, 0 up, 1 in 2024-09-04T16:23:59.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:59 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-04T16:23:59.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:59 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:59.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:59 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:59.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:59 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi193", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-04T16:23:59.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:59 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:59.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:23:59 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/695502468' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-04T16:23:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:59 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/822267159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbba256a-288b-4bce-b9c0-5cebfc7c5a5a"}]: dispatch 2024-09-04T16:23:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:59 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/822267159' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbba256a-288b-4bce-b9c0-5cebfc7c5a5a"}]': finished 2024-09-04T16:23:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:59 smithi193 ceph-mon[36288]: osdmap e6: 1 total, 0 up, 1 in 2024-09-04T16:23:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:59 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-04T16:23:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:59 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:59 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:23:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:59 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi193", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-04T16:23:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:59 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:23:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:23:59 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/695502468' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-04T16:24:00.554 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:00 smithi193 ceph-mon[36288]: Reconfiguring crash.smithi193 (monmap changed)... 2024-09-04T16:24:00.555 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:00 smithi193 ceph-mon[36288]: Reconfiguring daemon crash.smithi193 on smithi193 2024-09-04T16:24:00.555 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:00 smithi193 ceph-mon[36288]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:00.555 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:00 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:00.555 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:00 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:00.555 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:00 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi193.gvfizn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-04T16:24:00.555 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:00 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-04T16:24:00.555 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:00 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:00.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:00 smithi170 ceph-mon[29272]: Reconfiguring crash.smithi193 (monmap changed)... 2024-09-04T16:24:00.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:00 smithi170 ceph-mon[29272]: Reconfiguring daemon crash.smithi193 on smithi193 2024-09-04T16:24:00.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:00 smithi170 ceph-mon[29272]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:00 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:00 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:00 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi193.gvfizn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-04T16:24:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:00 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-04T16:24:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:00 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:01.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:01 smithi170 ceph-mon[29272]: Reconfiguring mgr.smithi193.gvfizn (monmap changed)... 2024-09-04T16:24:01.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:01 smithi170 ceph-mon[29272]: Reconfiguring daemon mgr.smithi193.gvfizn on smithi193 2024-09-04T16:24:01.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:01 smithi193 ceph-mon[36288]: Reconfiguring mgr.smithi193.gvfizn (monmap changed)... 2024-09-04T16:24:01.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:01 smithi193 ceph-mon[36288]: Reconfiguring daemon mgr.smithi193.gvfizn on smithi193 2024-09-04T16:24:02.646 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:02 smithi170 ceph-mon[29272]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:02.646 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:02 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:02.646 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:02 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:02.646 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:02 smithi170 ceph-mon[29272]: Reconfiguring mon.smithi193 (monmap changed)... 2024-09-04T16:24:02.647 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:02 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-04T16:24:02.647 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:02 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-04T16:24:02.647 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:02 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:02.647 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:02 smithi170 ceph-mon[29272]: Reconfiguring daemon mon.smithi193 on smithi193 2024-09-04T16:24:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:02 smithi193 ceph-mon[36288]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:02 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:02 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:02 smithi193 ceph-mon[36288]: Reconfiguring mon.smithi193 (monmap changed)... 2024-09-04T16:24:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:02 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-04T16:24:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:02 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-04T16:24:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:02 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:02 smithi193 ceph-mon[36288]: Reconfiguring daemon mon.smithi193 on smithi193 2024-09-04T16:24:03.830 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:03.831 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:03.831 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-04T16:24:03.831 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-04T16:24:03.831 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi170:9093"}]: dispatch 2024-09-04T16:24:03.831 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi170:9093"}]: dispatch 2024-09-04T16:24:03.831 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:03.831 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-04T16:24:03.831 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-04T16:24:03.831 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi170:3000"}]: dispatch 2024-09-04T16:24:03.831 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi170:3000"}]: dispatch 2024-09-04T16:24:03.831 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:03.832 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-04T16:24:03.832 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-04T16:24:03.832 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi170:9095"}]: dispatch 2024-09-04T16:24:03.832 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi170:9095"}]: dispatch 2024-09-04T16:24:03.832 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:03.832 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:24:03.832 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:03 smithi170 ceph-mon[29272]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:03.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:03.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:03.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-04T16:24:03.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-04T16:24:03.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi170:9093"}]: dispatch 2024-09-04T16:24:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi170:9093"}]: dispatch 2024-09-04T16:24:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-04T16:24:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-04T16:24:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi170:3000"}]: dispatch 2024-09-04T16:24:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi170:3000"}]: dispatch 2024-09-04T16:24:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-04T16:24:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-04T16:24:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi170:9095"}]: dispatch 2024-09-04T16:24:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi170:9095"}]: dispatch 2024-09-04T16:24:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:24:03.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:03 smithi193 ceph-mon[36288]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:05.753 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:05 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:05.753 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:05 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:05.753 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:05 smithi170 ceph-mon[29272]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:05.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:05 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:05.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:05 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:05.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:05 smithi193 ceph-mon[36288]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:08.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:08 smithi170 ceph-mon[29272]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:08.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:08 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-04T16:24:08.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:08 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:08.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:08 smithi193 ceph-mon[36288]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:08.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:08 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-04T16:24:08.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:08 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:09.537 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:09 smithi170 ceph-mon[29272]: Deploying daemon osd.0 on smithi170 2024-09-04T16:24:09.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:09 smithi193 ceph-mon[36288]: Deploying daemon osd.0 on smithi170 2024-09-04T16:24:10.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:10 smithi170 ceph-mon[29272]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:10.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:10 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:10.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:10 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:10.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:10 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:10.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:10 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:24:10.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:10 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:10 smithi193 ceph-mon[36288]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:10 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:10 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:10 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:10 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:24:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:10 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:12.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:12 smithi193 ceph-mon[36288]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:12.661 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:12 smithi170 ceph-mon[29272]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:13 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:24:13.690 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:13 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:24:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:14 smithi193 ceph-mon[36288]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:24:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:14.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:14 smithi170 ceph-mon[29272]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:14.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:24:14.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:14.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:16.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:16 smithi170 ceph-mon[29272]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:16.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:16 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:16.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:16 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:16.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:16 smithi193 ceph-mon[36288]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:16.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:16 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:16.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:16 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:18.310 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 0 on host 'smithi170' 2024-09-04T16:24:18.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:18.309+0000 7f8589ffb640 1 -- 172.21.15.170:0/3507497796 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f858c0fde20 con 0x7f857806ddb0 2024-09-04T16:24:18.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:18.311+0000 7f8592787640 1 -- 172.21.15.170:0/3507497796 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f857806ddb0 msgr2=0x7f8578070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:24:18.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:18.311+0000 7f8592787640 1 --2- 172.21.15.170:0/3507497796 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f857806ddb0 0x7f8578070270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f858c1018a0 tx=0x7f857c00b390 comp rx=0 tx=0).stop 2024-09-04T16:24:18.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:18.311+0000 7f8592787640 1 -- 172.21.15.170:0/3507497796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f858c101a40 msgr2=0x7f858c1979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:24:18.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:18.311+0000 7f8592787640 1 --2- 172.21.15.170:0/3507497796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f858c101a40 0x7f858c1979e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8574006010 tx=0x7f85740046c0 comp rx=0 tx=0).stop 2024-09-04T16:24:18.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:18.312+0000 7f8592787640 1 -- 172.21.15.170:0/3507497796 shutdown_connections 2024-09-04T16:24:18.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:18.312+0000 7f8592787640 1 --2- 172.21.15.170:0/3507497796 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f857806ddb0 0x7f8578070270 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:24:18.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:18.312+0000 7f8592787640 1 --2- 172.21.15.170:0/3507497796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f858c101a40 0x7f858c1979e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:24:18.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:18.312+0000 7f8592787640 1 --2- 172.21.15.170:0/3507497796 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f858c100840 0x7f858c1974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:24:18.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:18.312+0000 7f8592787640 1 -- 172.21.15.170:0/3507497796 >> 172.21.15.170:0/3507497796 conn(0x7f858c0fbff0 msgr2=0x7f858c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:24:18.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:18.312+0000 7f8592787640 1 -- 172.21.15.170:0/3507497796 shutdown_connections 2024-09-04T16:24:18.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:18.312+0000 7f8592787640 1 -- 172.21.15.170:0/3507497796 wait complete. 2024-09-04T16:24:18.594 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:18 smithi170 ceph-mon[29272]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:18.595 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:18 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:18.595 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:18 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:18.825 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:18 smithi193 ceph-mon[36288]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:18.825 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:18 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:18.825 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:18 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:18.941 DEBUG:teuthology.orchestra.run.smithi170:osd.0> sudo journalctl -f -n 0 -u ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.0.service 2024-09-04T16:24:18.944 INFO:tasks.cephadm:Deploying osd.1 on smithi170 with /dev/vg_nvme/lv_3... 2024-09-04T16:24:18.944 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-04T16:24:19.343 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:24:20.586 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:20 smithi170 ceph-mon[29272]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:20.839 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:24:20 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0[50859]: 2024-09-04T16:24:20.583+0000 7fdb0ede9640 -1 osd.0 0 log_to_monitors true 2024-09-04T16:24:20.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:20 smithi193 ceph-mon[36288]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:21.750 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:21 smithi170 ceph-mon[29272]: from='osd.0 [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-04T16:24:21.751 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:21 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:21.751 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:21 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:21.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:21 smithi193 ceph-mon[36288]: from='osd.0 [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-04T16:24:21.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:21 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:21.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:21 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:22.599 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:22 smithi170 ceph-mon[29272]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:22.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:22 smithi170 ceph-mon[29272]: from='osd.0 [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-04T16:24:22.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:22 smithi170 ceph-mon[29272]: osdmap e7: 1 total, 0 up, 1 in 2024-09-04T16:24:22.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:22 smithi170 ceph-mon[29272]: from='osd.0 [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-04T16:24:22.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-04T16:24:22.807 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:22 smithi193 ceph-mon[36288]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:22.807 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:22 smithi193 ceph-mon[36288]: from='osd.0 [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-04T16:24:22.807 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:22 smithi193 ceph-mon[36288]: osdmap e7: 1 total, 0 up, 1 in 2024-09-04T16:24:22.807 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:22 smithi193 ceph-mon[36288]: from='osd.0 [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-04T16:24:22.807 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-04T16:24:23.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:24:23 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0[50859]: 2024-09-04T16:24:23.158+0000 7fdb0b580640 -1 osd.0 0 waiting for initial osdmap 2024-09-04T16:24:23.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:24:23 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0[50859]: 2024-09-04T16:24:23.162+0000 7fdb02b7b640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-04T16:24:23.808 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:23 smithi170 ceph-mon[29272]: from='osd.0 [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-04T16:24:23.808 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:23 smithi170 ceph-mon[29272]: osdmap e8: 1 total, 0 up, 1 in 2024-09-04T16:24:23.808 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:23 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-04T16:24:23.808 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:23 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-04T16:24:23.808 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:23 smithi170 ceph-mon[29272]: from='osd.0 [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556]' entity='osd.0' 2024-09-04T16:24:23.811 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:24:23.825 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:23 smithi193 ceph-mon[36288]: from='osd.0 [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-04T16:24:23.825 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:23 smithi193 ceph-mon[36288]: osdmap e8: 1 total, 0 up, 1 in 2024-09-04T16:24:23.825 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:23 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-04T16:24:23.825 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:23 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-04T16:24:23.826 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:23 smithi193 ceph-mon[36288]: from='osd.0 [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556]' entity='osd.0' 2024-09-04T16:24:23.836 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi170:vg_nvme/lv_3 2024-09-04T16:24:24.414 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:24:24.708 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:24 smithi170 ceph-mon[29272]: purged_snaps scrub starts 2024-09-04T16:24:24.708 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:24 smithi170 ceph-mon[29272]: purged_snaps scrub ok 2024-09-04T16:24:24.708 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:24 smithi170 ceph-mon[29272]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:24.708 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:24 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-04T16:24:24.708 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:24 smithi170 ceph-mon[29272]: osd.0 [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556] boot 2024-09-04T16:24:24.708 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:24 smithi170 ceph-mon[29272]: osdmap e9: 1 total, 1 up, 1 in 2024-09-04T16:24:24.708 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:24 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-04T16:24:24.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.899+0000 7fb4d14c7640 1 -- 172.21.15.170:0/1455539628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4cc104d60 msgr2=0x7fb4cc107150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:24:24.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.899+0000 7fb4d14c7640 1 --2- 172.21.15.170:0/1455539628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4cc104d60 0x7fb4cc107150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009880 tx=0x7fb4bc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:24:24.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.899+0000 7fb4d14c7640 1 -- 172.21.15.170:0/1455539628 shutdown_connections 2024-09-04T16:24:24.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.899+0000 7fb4d14c7640 1 --2- 172.21.15.170:0/1455539628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4cc104d60 0x7fb4cc107150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:24:24.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.899+0000 7fb4d14c7640 1 --2- 172.21.15.170:0/1455539628 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4cc102430 0x7fb4cc104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:24:24.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.899+0000 7fb4d14c7640 1 -- 172.21.15.170:0/1455539628 >> 172.21.15.170:0/1455539628 conn(0x7fb4cc0fbff0 msgr2=0x7fb4cc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:24:24.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.899+0000 7fb4d14c7640 1 -- 172.21.15.170:0/1455539628 shutdown_connections 2024-09-04T16:24:24.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.899+0000 7fb4d14c7640 1 -- 172.21.15.170:0/1455539628 wait complete. 2024-09-04T16:24:24.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.900+0000 7fb4d14c7640 1 Processor -- start 2024-09-04T16:24:24.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.900+0000 7fb4d14c7640 1 -- start start 2024-09-04T16:24:24.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.900+0000 7fb4d14c7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4cc102430 0x7fb4cc1974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:24:24.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.900+0000 7fb4d14c7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4cc104d60 0x7fb4cc197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:24:24.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.900+0000 7fb4d14c7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc10a7a0 con 0x7fb4cc102430 2024-09-04T16:24:24.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.900+0000 7fb4d14c7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc10a620 con 0x7fb4cc104d60 2024-09-04T16:24:24.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.900+0000 7fb4caffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4cc102430 0x7fb4cc1974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:24:24.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.901+0000 7fb4ca7fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4cc104d60 0x7fb4cc197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:24:24.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.901+0000 7fb4caffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4cc102430 0x7fb4cc1974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33148/0 (socket says 172.21.15.170:33148) 2024-09-04T16:24:24.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.901+0000 7fb4ca7fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4cc104d60 0x7fb4cc197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.170:45456/0 (socket says 172.21.15.170:45456) 2024-09-04T16:24:24.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.901+0000 7fb4caffd640 1 -- 172.21.15.170:0/3354343497 learned_addr learned my addr 172.21.15.170:0/3354343497 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:24:24.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.901+0000 7fb4caffd640 1 -- 172.21.15.170:0/3354343497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4cc104d60 msgr2=0x7fb4cc197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:24:24.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.901+0000 7fb4caffd640 1 --2- 172.21.15.170:0/3354343497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4cc104d60 0x7fb4cc197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:24:24.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.901+0000 7fb4caffd640 1 -- 172.21.15.170:0/3354343497 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc1980b0 con 0x7fb4cc102430 2024-09-04T16:24:24.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.901+0000 7fb4ca7fc640 1 --2- 172.21.15.170:0/3354343497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4cc104d60 0x7fb4cc197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:24:24.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.901+0000 7fb4caffd640 1 --2- 172.21.15.170:0/3354343497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4cc102430 0x7fb4cc1974f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000c8f0 tx=0x7fb4c000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:24:24.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.901+0000 7fb4b3fff640 1 -- 172.21.15.170:0/3354343497 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4c00079b0 con 0x7fb4cc102430 2024-09-04T16:24:24.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.901+0000 7fb4d14c7640 1 -- 172.21.15.170:0/3354343497 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4cc19caf0 con 0x7fb4cc102430 2024-09-04T16:24:24.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.901+0000 7fb4b3fff640 1 -- 172.21.15.170:0/3354343497 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb4c00054e0 con 0x7fb4cc102430 2024-09-04T16:24:24.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.901+0000 7fb4b3fff640 1 -- 172.21.15.170:0/3354343497 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4c0004dd0 con 0x7fb4cc102430 2024-09-04T16:24:24.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.901+0000 7fb4d14c7640 1 -- 172.21.15.170:0/3354343497 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4cc19d050 con 0x7fb4cc102430 2024-09-04T16:24:24.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.903+0000 7fb4d14c7640 1 -- 172.21.15.170:0/3354343497 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4cc10af80 con 0x7fb4cc102430 2024-09-04T16:24:24.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.903+0000 7fb4b3fff640 1 -- 172.21.15.170:0/3354343497 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7fb4c000f4c0 con 0x7fb4cc102430 2024-09-04T16:24:24.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.903+0000 7fb4b3fff640 1 --2- 172.21.15.170:0/3354343497 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb4b406dd40 0x7fb4b4070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:24:24.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.904+0000 7fb4b3fff640 1 -- 172.21.15.170:0/3354343497 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1982+0+0 (secure 0 0 0) 0x7fb4c008cc60 con 0x7fb4cc102430 2024-09-04T16:24:24.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.904+0000 7fb4ca7fc640 1 --2- 172.21.15.170:0/3354343497 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb4b406dd40 0x7fb4b4070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:24:24.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.904+0000 7fb4ca7fc640 1 --2- 172.21.15.170:0/3354343497 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb4b406dd40 0x7fb4b4070200 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009230 tx=0x7fb4bc0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:24:24.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:24 smithi193 ceph-mon[36288]: purged_snaps scrub starts 2024-09-04T16:24:24.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:24 smithi193 ceph-mon[36288]: purged_snaps scrub ok 2024-09-04T16:24:24.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:24 smithi193 ceph-mon[36288]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-04T16:24:24.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:24 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-04T16:24:24.911 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:24 smithi193 ceph-mon[36288]: osd.0 [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556] boot 2024-09-04T16:24:24.911 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:24 smithi193 ceph-mon[36288]: osdmap e9: 1 total, 1 up, 1 in 2024-09-04T16:24:24.911 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:24 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-04T16:24:24.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:24.908+0000 7fb4b3fff640 1 -- 172.21.15.170:0/3354343497 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb4c0014030 con 0x7fb4cc102430 2024-09-04T16:24:25.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:25.090+0000 7fb4d14c7640 1 -- 172.21.15.170:0/3354343497 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb4cc105720 con 0x7fb4b406dd40 2024-09-04T16:24:25.769 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:25 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-04T16:24:25.770 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:25 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-04T16:24:25.770 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:25 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:25.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:25 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-04T16:24:25.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:25 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-04T16:24:25.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:25 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:26.474 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:26 smithi170 ceph-mon[29272]: from='client.14350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:24:26.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:26 smithi170 ceph-mon[29272]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:26.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:26 smithi170 ceph-mon[29272]: osdmap e10: 1 total, 1 up, 1 in 2024-09-04T16:24:26.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:26.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:26.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:24:26.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:26.476 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:26.476 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:24:26.476 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:26.476 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:24:26.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:26 smithi193 ceph-mon[36288]: from='client.14350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:24:26.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:26 smithi193 ceph-mon[36288]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:26.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:26 smithi193 ceph-mon[36288]: osdmap e10: 1 total, 1 up, 1 in 2024-09-04T16:24:26.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:26.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:26.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:24:26.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:26.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:26.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:24:26.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:26.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:24:27.816 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:27 smithi170 ceph-mon[29272]: Detected new or changed devices on smithi170 2024-09-04T16:24:27.816 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:27 smithi170 ceph-mon[29272]: Adjusting osd_memory_target on smithi170 to 11840M 2024-09-04T16:24:27.816 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:27 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:27.816 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:27 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:27.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:27 smithi193 ceph-mon[36288]: Detected new or changed devices on smithi170 2024-09-04T16:24:27.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:27 smithi193 ceph-mon[36288]: Adjusting osd_memory_target on smithi170 to 11840M 2024-09-04T16:24:27.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:27 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:27.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:27 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:28.826 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:28 smithi193 ceph-mon[36288]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:28.826 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:28 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2611751034' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b106135-c381-4e8e-85f1-1f85100c1949"}]: dispatch 2024-09-04T16:24:28.826 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:28 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2611751034' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b106135-c381-4e8e-85f1-1f85100c1949"}]': finished 2024-09-04T16:24:28.826 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:28 smithi193 ceph-mon[36288]: osdmap e11: 2 total, 1 up, 2 in 2024-09-04T16:24:28.826 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:28 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-04T16:24:28.826 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:28 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3393036013' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-04T16:24:28.826 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:28 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:24:28.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:28 smithi170 ceph-mon[29272]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:28.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:28 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2611751034' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b106135-c381-4e8e-85f1-1f85100c1949"}]: dispatch 2024-09-04T16:24:28.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:28 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2611751034' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b106135-c381-4e8e-85f1-1f85100c1949"}]': finished 2024-09-04T16:24:28.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:28 smithi170 ceph-mon[29272]: osdmap e11: 2 total, 1 up, 2 in 2024-09-04T16:24:28.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:28 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-04T16:24:28.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:28 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3393036013' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-04T16:24:28.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:28 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:24:30.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:30 smithi170 ceph-mon[29272]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:30.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:30 smithi193 ceph-mon[36288]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:32.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:31 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:32.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:31 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:32.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:31 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:32.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:31 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:24:32.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:31 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:32.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:31 smithi170 ceph-mon[29272]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:32.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:31 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:32.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:31 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:32.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:31 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:32.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:31 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:24:32.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:31 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:32.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:31 smithi193 ceph-mon[36288]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:34.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:34 smithi193 ceph-mon[36288]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:34.468 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:34 smithi170 ceph-mon[29272]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:36.569 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:36 smithi170 ceph-mon[29272]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:36.569 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:36 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-04T16:24:36.569 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:36 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:36.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:36 smithi193 ceph-mon[36288]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:36.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:36 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-04T16:24:36.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:36 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:37.522 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:37 smithi170 ceph-mon[29272]: Deploying daemon osd.1 on smithi170 2024-09-04T16:24:37.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:37 smithi193 ceph-mon[36288]: Deploying daemon osd.1 on smithi170 2024-09-04T16:24:38.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:38 smithi170 ceph-mon[29272]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:38.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:38 smithi193 ceph-mon[36288]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:40.524 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:40 smithi170 ceph-mon[29272]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:40.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:40 smithi193 ceph-mon[36288]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:41.546 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:41 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:24:41.547 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:41 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:41.547 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:41 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:41.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:41 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:24:41.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:41 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:41.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:41 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:42.541 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:42 smithi170 ceph-mon[29272]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:42.614 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:42 smithi193 ceph-mon[36288]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:44.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:43 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:44.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:43 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:44.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:43 smithi193 ceph-mon[36288]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:44.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:43 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:24:44.296 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:44.296 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:44.296 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:43 smithi170 ceph-mon[29272]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:44.296 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:24:44.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:44.331+0000 7fb4b3fff640 1 -- 172.21.15.170:0/3354343497 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb4cc105720 con 0x7fb4b406dd40 2024-09-04T16:24:44.332 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 1 on host 'smithi170' 2024-09-04T16:24:44.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:44.333+0000 7fb4d14c7640 1 -- 172.21.15.170:0/3354343497 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb4b406dd40 msgr2=0x7fb4b4070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:24:44.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:44.333+0000 7fb4d14c7640 1 --2- 172.21.15.170:0/3354343497 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb4b406dd40 0x7fb4b4070200 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009230 tx=0x7fb4bc0058d0 comp rx=0 tx=0).stop 2024-09-04T16:24:44.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:44.333+0000 7fb4d14c7640 1 -- 172.21.15.170:0/3354343497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4cc102430 msgr2=0x7fb4cc1974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:24:44.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:44.333+0000 7fb4d14c7640 1 --2- 172.21.15.170:0/3354343497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4cc102430 0x7fb4cc1974f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000c8f0 tx=0x7fb4c000cdb0 comp rx=0 tx=0).stop 2024-09-04T16:24:44.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:44.333+0000 7fb4d14c7640 1 -- 172.21.15.170:0/3354343497 shutdown_connections 2024-09-04T16:24:44.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:44.333+0000 7fb4d14c7640 1 --2- 172.21.15.170:0/3354343497 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb4b406dd40 0x7fb4b4070200 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:24:44.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:44.333+0000 7fb4d14c7640 1 --2- 172.21.15.170:0/3354343497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4cc104d60 0x7fb4cc197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:24:44.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:44.333+0000 7fb4d14c7640 1 --2- 172.21.15.170:0/3354343497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4cc102430 0x7fb4cc1974f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:24:44.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:44.333+0000 7fb4d14c7640 1 -- 172.21.15.170:0/3354343497 >> 172.21.15.170:0/3354343497 conn(0x7fb4cc0fbff0 msgr2=0x7fb4cc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:24:44.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:44.333+0000 7fb4d14c7640 1 -- 172.21.15.170:0/3354343497 shutdown_connections 2024-09-04T16:24:44.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:44.333+0000 7fb4d14c7640 1 -- 172.21.15.170:0/3354343497 wait complete. 2024-09-04T16:24:45.022 DEBUG:teuthology.orchestra.run.smithi170:osd.1> sudo journalctl -f -n 0 -u ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.1.service 2024-09-04T16:24:45.024 INFO:tasks.cephadm:Deploying osd.2 on smithi170 with /dev/vg_nvme/lv_2... 2024-09-04T16:24:45.024 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-04T16:24:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:45 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:45 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:45.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:45 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:45.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:45 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:45.831 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:24:46.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:46 smithi170 ceph-mon[29272]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:46 smithi193 ceph-mon[36288]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:47.522 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:24:47 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1[58108]: 2024-09-04T16:24:47.417+0000 7fd8ff34c640 -1 osd.1 0 log_to_monitors true 2024-09-04T16:24:48.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:48 smithi170 ceph-mon[29272]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:48.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:48 smithi170 ceph-mon[29272]: from='osd.1 [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-04T16:24:48.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:48 smithi193 ceph-mon[36288]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:48.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:48 smithi193 ceph-mon[36288]: from='osd.1 [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-04T16:24:49.363 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:49 smithi170 ceph-mon[29272]: from='osd.1 [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-04T16:24:49.363 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:49 smithi170 ceph-mon[29272]: osdmap e12: 2 total, 1 up, 2 in 2024-09-04T16:24:49.363 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:49 smithi170 ceph-mon[29272]: from='osd.1 [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-04T16:24:49.363 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:49 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-04T16:24:49.363 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:49 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:49.363 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:49 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:49.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:49 smithi193 ceph-mon[36288]: from='osd.1 [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-04T16:24:49.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:49 smithi193 ceph-mon[36288]: osdmap e12: 2 total, 1 up, 2 in 2024-09-04T16:24:49.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:49 smithi193 ceph-mon[36288]: from='osd.1 [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-04T16:24:49.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:49 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-04T16:24:49.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:49 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:49.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:49 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:50.156 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:24:50 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1[58108]: 2024-09-04T16:24:50.023+0000 7fd8faaac640 -1 osd.1 0 waiting for initial osdmap 2024-09-04T16:24:50.156 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:24:50 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1[58108]: 2024-09-04T16:24:50.027+0000 7fd8f30de640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-04T16:24:50.157 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:24:50.191 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi170:vg_nvme/lv_2 2024-09-04T16:24:50.457 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:50 smithi170 ceph-mon[29272]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:50.457 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:50 smithi170 ceph-mon[29272]: from='osd.1 [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-04T16:24:50.457 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:50 smithi170 ceph-mon[29272]: osdmap e13: 2 total, 1 up, 2 in 2024-09-04T16:24:50.457 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-04T16:24:50.457 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:50 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-04T16:24:50.457 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:50 smithi170 ceph-mon[29272]: from='osd.1 [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441]' entity='osd.1' 2024-09-04T16:24:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:50 smithi193 ceph-mon[36288]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:50 smithi193 ceph-mon[36288]: from='osd.1 [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-04T16:24:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:50 smithi193 ceph-mon[36288]: osdmap e13: 2 total, 1 up, 2 in 2024-09-04T16:24:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:50 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-04T16:24:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:50 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-04T16:24:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:50 smithi193 ceph-mon[36288]: from='osd.1 [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441]' entity='osd.1' 2024-09-04T16:24:50.867 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:24:51.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.578+0000 7f64420be640 1 -- 172.21.15.170:0/1097620309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f643c100880 msgr2=0x7f643c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:24:51.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.579+0000 7f64420be640 1 --2- 172.21.15.170:0/1097620309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f643c100880 0x7f643c100c80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f642c009880 tx=0x7f642c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:24:51.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.579+0000 7f64420be640 1 -- 172.21.15.170:0/1097620309 shutdown_connections 2024-09-04T16:24:51.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.579+0000 7f64420be640 1 --2- 172.21.15.170:0/1097620309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f643c101a80 0x7f643c101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:24:51.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.579+0000 7f64420be640 1 --2- 172.21.15.170:0/1097620309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f643c100880 0x7f643c100c80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:24:51.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.579+0000 7f64420be640 1 -- 172.21.15.170:0/1097620309 >> 172.21.15.170:0/1097620309 conn(0x7f643c0fc010 msgr2=0x7f643c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:24:51.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.579+0000 7f64420be640 1 -- 172.21.15.170:0/1097620309 shutdown_connections 2024-09-04T16:24:51.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.579+0000 7f64420be640 1 -- 172.21.15.170:0/1097620309 wait complete. 2024-09-04T16:24:51.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.579+0000 7f64420be640 1 Processor -- start 2024-09-04T16:24:51.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.579+0000 7f64420be640 1 -- start start 2024-09-04T16:24:51.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.579+0000 7f64420be640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f643c100880 0x7f643c06adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:24:51.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.579+0000 7f64420be640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f643c101a80 0x7f643c19c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:24:51.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.579+0000 7f64420be640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f643c109720 con 0x7f643c100880 2024-09-04T16:24:51.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.579+0000 7f64420be640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f643c1095a0 con 0x7f643c101a80 2024-09-04T16:24:51.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.580+0000 7f643b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f643c100880 0x7f643c06adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:24:51.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.580+0000 7f643b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f643c100880 0x7f643c06adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51776/0 (socket says 172.21.15.170:51776) 2024-09-04T16:24:51.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.580+0000 7f643b7fe640 1 -- 172.21.15.170:0/3165716472 learned_addr learned my addr 172.21.15.170:0/3165716472 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:24:51.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.580+0000 7f643b7fe640 1 -- 172.21.15.170:0/3165716472 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f643c101a80 msgr2=0x7f643c19c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:24:51.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.580+0000 7f6433fff640 1 --2- 172.21.15.170:0/3165716472 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f643c101a80 0x7f643c19c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:24:51.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.580+0000 7f643b7fe640 1 --2- 172.21.15.170:0/3165716472 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f643c101a80 0x7f643c19c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:24:51.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.580+0000 7f643b7fe640 1 -- 172.21.15.170:0/3165716472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643c19c830 con 0x7f643c100880 2024-09-04T16:24:51.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.580+0000 7f6433fff640 1 --2- 172.21.15.170:0/3165716472 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f643c101a80 0x7f643c19c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:24:51.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.580+0000 7f643b7fe640 1 --2- 172.21.15.170:0/3165716472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f643c100880 0x7f643c06adf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f642c006010 tx=0x7f642c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:24:51.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.580+0000 7f64397fa640 1 -- 172.21.15.170:0/3165716472 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f642c03f070 con 0x7f643c100880 2024-09-04T16:24:51.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.580+0000 7f64420be640 1 -- 172.21.15.170:0/3165716472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643c19cac0 con 0x7f643c100880 2024-09-04T16:24:51.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.580+0000 7f64397fa640 1 -- 172.21.15.170:0/3165716472 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f642c0044d0 con 0x7f643c100880 2024-09-04T16:24:51.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.580+0000 7f64397fa640 1 -- 172.21.15.170:0/3165716472 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f642c035030 con 0x7f643c100880 2024-09-04T16:24:51.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.580+0000 7f64420be640 1 -- 172.21.15.170:0/3165716472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f643c19d070 con 0x7f643c100880 2024-09-04T16:24:51.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.581+0000 7f64420be640 1 -- 172.21.15.170:0/3165716472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f643c100c80 con 0x7f643c100880 2024-09-04T16:24:51.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.582+0000 7f64397fa640 1 -- 172.21.15.170:0/3165716472 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7f642c042070 con 0x7f643c100880 2024-09-04T16:24:51.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.582+0000 7f64397fa640 1 --2- 172.21.15.170:0/3165716472 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f642806ddb0 0x7f6428070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:24:51.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.582+0000 7f64397fa640 1 -- 172.21.15.170:0/3165716472 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2414+0+0 (secure 0 0 0) 0x7f642c0adbd0 con 0x7f643c100880 2024-09-04T16:24:51.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.582+0000 7f6433fff640 1 --2- 172.21.15.170:0/3165716472 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f642806ddb0 0x7f6428070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:24:51.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.583+0000 7f6433fff640 1 --2- 172.21.15.170:0/3165716472 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f642806ddb0 0x7f6428070270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6424006fd0 tx=0x7f6424008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:24:51.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.587+0000 7f64397fa640 1 -- 172.21.15.170:0/3165716472 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f642c07c3b0 con 0x7f643c100880 2024-09-04T16:24:51.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:51 smithi170 ceph-mon[29272]: purged_snaps scrub starts 2024-09-04T16:24:51.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:51 smithi170 ceph-mon[29272]: purged_snaps scrub ok 2024-09-04T16:24:51.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:51 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-04T16:24:51.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:51 smithi170 ceph-mon[29272]: osd.1 [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441] boot 2024-09-04T16:24:51.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:51 smithi170 ceph-mon[29272]: osdmap e14: 2 total, 2 up, 2 in 2024-09-04T16:24:51.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:51 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-04T16:24:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:51 smithi193 ceph-mon[36288]: purged_snaps scrub starts 2024-09-04T16:24:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:51 smithi193 ceph-mon[36288]: purged_snaps scrub ok 2024-09-04T16:24:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:51 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-04T16:24:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:51 smithi193 ceph-mon[36288]: osd.1 [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441] boot 2024-09-04T16:24:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:51 smithi193 ceph-mon[36288]: osdmap e14: 2 total, 2 up, 2 in 2024-09-04T16:24:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:51 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-04T16:24:51.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:24:51.772+0000 7f64420be640 1 -- 172.21.15.170:0/3165716472 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f643c106000 con 0x7f642806ddb0 2024-09-04T16:24:52.637 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:52 smithi170 ceph-mon[29272]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:52.637 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:52 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-04T16:24:52.637 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:52 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-04T16:24:52.637 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:52 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:52.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:52 smithi193 ceph-mon[36288]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-04T16:24:52.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:52 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-04T16:24:52.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:52 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-04T16:24:52.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:52 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:53.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:53 smithi193 ceph-mon[36288]: from='client.14368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:24:53.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:53 smithi193 ceph-mon[36288]: osdmap e15: 2 total, 2 up, 2 in 2024-09-04T16:24:53.720 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:53 smithi170 ceph-mon[29272]: from='client.14368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:24:53.720 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:53 smithi170 ceph-mon[29272]: osdmap e15: 2 total, 2 up, 2 in 2024-09-04T16:24:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:54 smithi170 ceph-mon[29272]: pgmap v68: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:24:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:54 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:54 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:54 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:24:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:54 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:24:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:54 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:54 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:54 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:24:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:54 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:54 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:24:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:54 smithi193 ceph-mon[36288]: pgmap v68: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:24:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:54 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:54 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:54 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:24:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:54 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:24:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:54 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:54 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:54 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:24:54.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:54 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:54.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:54 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:24:55.484 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:55 smithi170 ceph-mon[29272]: Detected new or changed devices on smithi170 2024-09-04T16:24:55.485 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:55 smithi170 ceph-mon[29272]: Adjusting osd_memory_target on smithi170 to 5920M 2024-09-04T16:24:55.485 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:55 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/270281381' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea5d3602-2f3f-40a4-a535-dd7f81cda237"}]: dispatch 2024-09-04T16:24:55.485 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:55 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/270281381' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea5d3602-2f3f-40a4-a535-dd7f81cda237"}]': finished 2024-09-04T16:24:55.485 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:55 smithi170 ceph-mon[29272]: osdmap e16: 3 total, 2 up, 3 in 2024-09-04T16:24:55.485 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:55 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-04T16:24:55.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:55 smithi193 ceph-mon[36288]: Detected new or changed devices on smithi170 2024-09-04T16:24:55.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:55 smithi193 ceph-mon[36288]: Adjusting osd_memory_target on smithi170 to 5920M 2024-09-04T16:24:55.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:55 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/270281381' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea5d3602-2f3f-40a4-a535-dd7f81cda237"}]: dispatch 2024-09-04T16:24:55.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:55 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/270281381' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea5d3602-2f3f-40a4-a535-dd7f81cda237"}]': finished 2024-09-04T16:24:55.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:55 smithi193 ceph-mon[36288]: osdmap e16: 3 total, 2 up, 3 in 2024-09-04T16:24:55.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:55 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-04T16:24:56.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:56 smithi170 ceph-mon[29272]: pgmap v70: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:24:56.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:56 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/415782040' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-04T16:24:56.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:56 smithi193 ceph-mon[36288]: pgmap v70: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:24:56.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:56 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/415782040' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-04T16:24:58.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:58 smithi193 ceph-mon[36288]: pgmap v71: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:24:58.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:58 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:24:58.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:58 smithi170 ceph-mon[29272]: pgmap v71: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:24:58.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:58 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:24:59.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:59 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:59 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:59 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:59 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:24:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:24:59 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:59 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:59 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:24:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:59 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:24:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:59 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:24:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:24:59 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:00.822 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:00 smithi170 ceph-mon[29272]: pgmap v72: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:00 smithi193 ceph-mon[36288]: pgmap v72: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:01.793 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:01 smithi170 ceph-mon[29272]: pgmap v73: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:01.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:01 smithi193 ceph-mon[36288]: pgmap v73: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:04.324 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:04 smithi170 ceph-mon[29272]: pgmap v74: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:04.325 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:04 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-04T16:25:04.325 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:04 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:04 smithi193 ceph-mon[36288]: pgmap v74: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:04.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:04 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-04T16:25:04.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:04 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:05.542 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:05 smithi170 ceph-mon[29272]: Deploying daemon osd.2 on smithi170 2024-09-04T16:25:05.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:05 smithi193 ceph-mon[36288]: Deploying daemon osd.2 on smithi170 2024-09-04T16:25:06.303 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:06 smithi170 ceph-mon[29272]: pgmap v75: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:06.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:06 smithi193 ceph-mon[36288]: pgmap v75: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:08.530 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:08 smithi170 ceph-mon[29272]: pgmap v76: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:08.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:08 smithi193 ceph-mon[36288]: pgmap v76: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:09.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:09 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:25:09.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:09 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:09.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:09 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:09.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:09 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:25:09.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:09 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:09.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:09 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:10.332 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:10 smithi170 ceph-mon[29272]: pgmap v77: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:10 smithi193 ceph-mon[36288]: pgmap v77: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:12.379 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:12 smithi170 ceph-mon[29272]: pgmap v78: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:12.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:12 smithi193 ceph-mon[36288]: pgmap v78: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:12.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:25:12.958+0000 7f64397fa640 1 -- 172.21.15.170:0/3165716472 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f643c106000 con 0x7f642806ddb0 2024-09-04T16:25:12.959 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 2 on host 'smithi170' 2024-09-04T16:25:12.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:25:12.961+0000 7f64420be640 1 -- 172.21.15.170:0/3165716472 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f642806ddb0 msgr2=0x7f6428070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:25:12.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:25:12.961+0000 7f64420be640 1 --2- 172.21.15.170:0/3165716472 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f642806ddb0 0x7f6428070270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6424006fd0 tx=0x7f6424008040 comp rx=0 tx=0).stop 2024-09-04T16:25:12.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:25:12.961+0000 7f64420be640 1 -- 172.21.15.170:0/3165716472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f643c100880 msgr2=0x7f643c06adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:25:12.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:25:12.961+0000 7f64420be640 1 --2- 172.21.15.170:0/3165716472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f643c100880 0x7f643c06adf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f642c006010 tx=0x7f642c0048f0 comp rx=0 tx=0).stop 2024-09-04T16:25:12.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:25:12.961+0000 7f64420be640 1 -- 172.21.15.170:0/3165716472 shutdown_connections 2024-09-04T16:25:12.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:25:12.961+0000 7f64420be640 1 --2- 172.21.15.170:0/3165716472 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f642806ddb0 0x7f6428070270 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:25:12.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:25:12.961+0000 7f64420be640 1 --2- 172.21.15.170:0/3165716472 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f643c101a80 0x7f643c19c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:25:12.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:25:12.961+0000 7f64420be640 1 --2- 172.21.15.170:0/3165716472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f643c100880 0x7f643c06adf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:25:12.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:25:12.961+0000 7f64420be640 1 -- 172.21.15.170:0/3165716472 >> 172.21.15.170:0/3165716472 conn(0x7f643c0fc010 msgr2=0x7f643c0fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:25:12.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:25:12.961+0000 7f64420be640 1 -- 172.21.15.170:0/3165716472 shutdown_connections 2024-09-04T16:25:12.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:25:12.961+0000 7f64420be640 1 -- 172.21.15.170:0/3165716472 wait complete. 2024-09-04T16:25:14.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:13 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:14.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:13 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:14.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:13 smithi193 ceph-mon[36288]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:14.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:13 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:25:14.324 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:13 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:14.324 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:13 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:14.324 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:13 smithi170 ceph-mon[29272]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:14.324 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:13 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:25:14.352 DEBUG:teuthology.orchestra.run.smithi170:osd.2> sudo journalctl -f -n 0 -u ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.2.service 2024-09-04T16:25:14.354 INFO:tasks.cephadm:Deploying osd.3 on smithi193 with /dev/vg_nvme/lv_4... 2024-09-04T16:25:14.355 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-04T16:25:14.611 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi193/config 2024-09-04T16:25:15.314 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:15 smithi170 ceph-mon[29272]: from='osd.2 [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-04T16:25:15.315 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:25:14 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2[65592]: 2024-09-04T16:25:14.974+0000 7fe229f40640 -1 osd.2 0 log_to_monitors true 2024-09-04T16:25:15.371 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:15 smithi193 ceph-mon[36288]: from='osd.2 [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-04T16:25:16.252 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:16 smithi193 ceph-mon[36288]: from='osd.2 [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-04T16:25:16.252 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:16 smithi193 ceph-mon[36288]: osdmap e17: 3 total, 2 up, 3 in 2024-09-04T16:25:16.253 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:16 smithi193 ceph-mon[36288]: from='osd.2 [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-04T16:25:16.253 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:16 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-04T16:25:16.253 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:16 smithi193 ceph-mon[36288]: pgmap v81: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:16.253 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:16 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:16.253 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:16 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:16.253 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:16 smithi193 ceph-mon[36288]: from='osd.2 [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-04T16:25:16.253 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:16 smithi193 ceph-mon[36288]: osdmap e18: 3 total, 2 up, 3 in 2024-09-04T16:25:16.253 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:16 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-04T16:25:16.351 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:25:16 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2[65592]: 2024-09-04T16:25:16.036+0000 7fe2256a0640 -1 osd.2 0 waiting for initial osdmap 2024-09-04T16:25:16.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:25:16 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2[65592]: 2024-09-04T16:25:16.042+0000 7fe221cda640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-04T16:25:16.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:16 smithi170 ceph-mon[29272]: from='osd.2 [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-04T16:25:16.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:16 smithi170 ceph-mon[29272]: osdmap e17: 3 total, 2 up, 3 in 2024-09-04T16:25:16.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:16 smithi170 ceph-mon[29272]: from='osd.2 [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-09-04T16:25:16.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:16 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-04T16:25:16.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:16 smithi170 ceph-mon[29272]: pgmap v81: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:16.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:16 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:16.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:16 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:16.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:16 smithi170 ceph-mon[29272]: from='osd.2 [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-09-04T16:25:16.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:16 smithi170 ceph-mon[29272]: osdmap e18: 3 total, 2 up, 3 in 2024-09-04T16:25:16.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:16 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-04T16:25:16.971 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:25:16.999 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi193:vg_nvme/lv_4 2024-09-04T16:25:17.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:17 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-04T16:25:17.249 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi193/config 2024-09-04T16:25:17.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:17 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-04T16:25:17.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.704+0000 7f26819b5640 1 -- 172.21.15.193:0/1612218021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f267c0ffc40 msgr2=0x7f267c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:25:17.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.704+0000 7f26819b5640 1 --2- 172.21.15.193:0/1612218021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f267c0ffc40 0x7f267c100040 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f266c009880 tx=0x7f266c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:25:17.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.704+0000 7f26819b5640 1 -- 172.21.15.193:0/1612218021 shutdown_connections 2024-09-04T16:25:17.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.704+0000 7f26819b5640 1 --2- 172.21.15.193:0/1612218021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f267c102c20 0x7f267c1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:25:17.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.704+0000 7f26819b5640 1 --2- 172.21.15.193:0/1612218021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f267c0ffc40 0x7f267c100040 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:25:17.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.704+0000 7f26819b5640 1 -- 172.21.15.193:0/1612218021 >> 172.21.15.193:0/1612218021 conn(0x7f267c0fb7b0 msgr2=0x7f267c0fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:25:17.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.704+0000 7f26819b5640 1 -- 172.21.15.193:0/1612218021 shutdown_connections 2024-09-04T16:25:17.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.704+0000 7f26819b5640 1 -- 172.21.15.193:0/1612218021 wait complete. 2024-09-04T16:25:17.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.705+0000 7f26819b5640 1 Processor -- start 2024-09-04T16:25:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.705+0000 7f26819b5640 1 -- start start 2024-09-04T16:25:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.705+0000 7f26819b5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f267c0ffc40 0x7f267c197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:25:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.705+0000 7f26819b5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f267c102c20 0x7f267c197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:25:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.705+0000 7f26819b5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f267c10a820 con 0x7f267c0ffc40 2024-09-04T16:25:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.705+0000 7f26819b5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f267c10a6a0 con 0x7f267c102c20 2024-09-04T16:25:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.705+0000 7f2673fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f267c102c20 0x7f267c197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:25:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.705+0000 7f2673fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f267c102c20 0x7f267c197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:36198/0 (socket says 172.21.15.193:36198) 2024-09-04T16:25:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.705+0000 7f2673fff640 1 -- 172.21.15.193:0/3922619948 learned_addr learned my addr 172.21.15.193:0/3922619948 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-04T16:25:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.705+0000 7f267affd640 1 --2- 172.21.15.193:0/3922619948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f267c0ffc40 0x7f267c197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:25:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.705+0000 7f2673fff640 1 -- 172.21.15.193:0/3922619948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f267c0ffc40 msgr2=0x7f267c197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:25:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.705+0000 7f2673fff640 1 --2- 172.21.15.193:0/3922619948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f267c0ffc40 0x7f267c197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:25:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.706+0000 7f2673fff640 1 -- 172.21.15.193:0/3922619948 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c1980c0 con 0x7f267c102c20 2024-09-04T16:25:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.706+0000 7f267affd640 1 --2- 172.21.15.193:0/3922619948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f267c0ffc40 0x7f267c197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:25:17.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.706+0000 7f2673fff640 1 --2- 172.21.15.193:0/3922619948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f267c102c20 0x7f267c197a40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f266400b420 tx=0x7f266400b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:25:17.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.706+0000 7f26809b3640 1 -- 172.21.15.193:0/3922619948 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2664011630 con 0x7f267c102c20 2024-09-04T16:25:17.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.706+0000 7f26809b3640 1 -- 172.21.15.193:0/3922619948 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2664016070 con 0x7f267c102c20 2024-09-04T16:25:17.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.706+0000 7f26819b5640 1 -- 172.21.15.193:0/3922619948 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f267c19cb00 con 0x7f267c102c20 2024-09-04T16:25:17.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.706+0000 7f26809b3640 1 -- 172.21.15.193:0/3922619948 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2664010d40 con 0x7f267c102c20 2024-09-04T16:25:17.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.706+0000 7f26819b5640 1 -- 172.21.15.193:0/3922619948 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f267c19d110 con 0x7f267c102c20 2024-09-04T16:25:17.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.707+0000 7f26819b5640 1 -- 172.21.15.193:0/3922619948 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f267c100040 con 0x7f267c102c20 2024-09-04T16:25:17.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.707+0000 7f26809b3640 1 -- 172.21.15.193:0/3922619948 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) ==== 92149+0+0 (secure 0 0 0) 0x7f266401b460 con 0x7f267c102c20 2024-09-04T16:25:17.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.708+0000 7f26809b3640 1 --2- 172.21.15.193:0/3922619948 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f266806ddb0 0x7f2668070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:25:17.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.708+0000 7f26809b3640 1 -- 172.21.15.193:0/3922619948 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2846+0+0 (secure 0 0 0) 0x7f266408c940 con 0x7f267c102c20 2024-09-04T16:25:17.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.709+0000 7f267affd640 1 --2- 172.21.15.193:0/3922619948 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f266806ddb0 0x7f2668070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:25:17.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.709+0000 7f267affd640 1 --2- 172.21.15.193:0/3922619948 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f266806ddb0 0x7f2668070270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f266c000c00 tx=0x7f266c005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:25:17.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.713+0000 7f26809b3640 1 -- 172.21.15.193:0/3922619948 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f266405b000 con 0x7f267c102c20 2024-09-04T16:25:17.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:17.884+0000 7f26819b5640 1 -- 172.21.15.193:0/3922619948 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f267c062630 con 0x7f266806ddb0 2024-09-04T16:25:18.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:18 smithi193 ceph-mon[36288]: purged_snaps scrub starts 2024-09-04T16:25:18.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:18 smithi193 ceph-mon[36288]: purged_snaps scrub ok 2024-09-04T16:25:18.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:18 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-04T16:25:18.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:18 smithi193 ceph-mon[36288]: osd.2 [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737] boot 2024-09-04T16:25:18.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:18 smithi193 ceph-mon[36288]: osdmap e19: 3 total, 3 up, 3 in 2024-09-04T16:25:18.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:18 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-04T16:25:18.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:18 smithi193 ceph-mon[36288]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:18.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:18 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-04T16:25:18.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:18 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-04T16:25:18.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:18 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-04T16:25:18.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:18 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:18.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:18 smithi170 ceph-mon[29272]: purged_snaps scrub starts 2024-09-04T16:25:18.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:18 smithi170 ceph-mon[29272]: purged_snaps scrub ok 2024-09-04T16:25:18.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:18 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-04T16:25:18.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:18 smithi170 ceph-mon[29272]: osd.2 [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737] boot 2024-09-04T16:25:18.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:18 smithi170 ceph-mon[29272]: osdmap e19: 3 total, 3 up, 3 in 2024-09-04T16:25:18.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:18 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-04T16:25:18.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:18 smithi170 ceph-mon[29272]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-04T16:25:18.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:18 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-04T16:25:18.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:18 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-04T16:25:18.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:18 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-04T16:25:18.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:18 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:19.222 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:19 smithi170 ceph-mon[29272]: from='client.24153 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:25:19.223 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:19 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-04T16:25:19.223 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:19 smithi170 ceph-mon[29272]: osdmap e20: 3 total, 3 up, 3 in 2024-09-04T16:25:19.223 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:19 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-04T16:25:19.308 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:19 smithi193 ceph-mon[36288]: from='client.24153 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:25:19.308 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:19 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-04T16:25:19.309 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:19 smithi193 ceph-mon[36288]: osdmap e20: 3 total, 3 up, 3 in 2024-09-04T16:25:19.309 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:19 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-04T16:25:20.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-04T16:25:20.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: osdmap e21: 3 total, 3 up, 3 in 2024-09-04T16:25:20.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-04T16:25:20.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: Detected new or changed devices on smithi170 2024-09-04T16:25:20.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:20.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:20.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:25:20.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:25:20.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:25:20.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: Adjusting osd_memory_target on smithi170 to 3946M 2024-09-04T16:25:20.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:20.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:20.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:25:20.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:20.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:25:20.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:20.158 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:25:20.158 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:20 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:20.189 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:25:19 smithi170 sudo[70389]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-04T16:25:20.189 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:25:19 smithi170 sudo[70389]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-04T16:25:20.189 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:25:19 smithi170 sudo[70389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-04T16:25:20.189 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:25:19 smithi170 sudo[70389]: pam_unix(sudo:session): session closed for user root 2024-09-04T16:25:20.190 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-04T16:25:20.190 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: osdmap e21: 3 total, 3 up, 3 in 2024-09-04T16:25:20.190 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-04T16:25:20.190 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: Detected new or changed devices on smithi170 2024-09-04T16:25:20.190 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:20.190 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:20.190 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:25:20.190 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:25:20.190 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:25:20.190 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: Adjusting osd_memory_target on smithi170 to 3946M 2024-09-04T16:25:20.190 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:20.190 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:20.190 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:25:20.191 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:20.191 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:25:20.191 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:20.191 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:25:20.191 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:20 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:20.459 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:25:20 smithi170 sudo[70392]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-04T16:25:20.459 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:25:20 smithi170 sudo[70392]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-04T16:25:20.459 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:25:20 smithi170 sudo[70392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-04T16:25:20.459 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:25:20 smithi170 sudo[70392]: pam_unix(sudo:session): session closed for user root 2024-09-04T16:25:20.714 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:25:20 smithi170 sudo[70395]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-04T16:25:20.714 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:25:20 smithi170 sudo[70395]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-04T16:25:20.715 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:25:20 smithi170 sudo[70395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-04T16:25:20.715 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:25:20 smithi170 sudo[70395]: pam_unix(sudo:session): session closed for user root 2024-09-04T16:25:20.976 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:25:20 smithi170 sudo[70398]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-04T16:25:21.085 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:25:20 smithi170 sudo[70398]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-04T16:25:21.085 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:25:20 smithi170 sudo[70398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-04T16:25:21.085 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:25:20 smithi170 sudo[70398]: pam_unix(sudo:session): session closed for user root 2024-09-04T16:25:21.086 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:25:20 smithi170 sudo[70401]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-04T16:25:21.086 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:25:20 smithi170 sudo[70401]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-04T16:25:21.086 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:25:20 smithi170 sudo[70401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-04T16:25:21.086 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:25:20 smithi170 sudo[70401]: pam_unix(sudo:session): session closed for user root 2024-09-04T16:25:21.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:21 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/3067582716' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ea70be0-d553-4669-adde-18aa1a04d81a"}]: dispatch 2024-09-04T16:25:21.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:21 smithi170 ceph-mon[29272]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ea70be0-d553-4669-adde-18aa1a04d81a"}]: dispatch 2024-09-04T16:25:21.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:21 smithi170 ceph-mon[29272]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ea70be0-d553-4669-adde-18aa1a04d81a"}]': finished 2024-09-04T16:25:21.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:21 smithi170 ceph-mon[29272]: osdmap e22: 4 total, 3 up, 4 in 2024-09-04T16:25:21.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:21 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-04T16:25:21.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:21 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:21.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:21 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/3265121561' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-04T16:25:21.353 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:25:21 smithi170 sudo[70404]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-04T16:25:21.353 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:25:21 smithi170 sudo[70404]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-04T16:25:21.353 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:25:21 smithi170 sudo[70404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-04T16:25:21.353 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:25:21 smithi170 sudo[70404]: pam_unix(sudo:session): session closed for user root 2024-09-04T16:25:21.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:21 smithi193 ceph-mon[36288]: from='client.? 172.21.15.193:0/3067582716' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ea70be0-d553-4669-adde-18aa1a04d81a"}]: dispatch 2024-09-04T16:25:21.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:21 smithi193 ceph-mon[36288]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ea70be0-d553-4669-adde-18aa1a04d81a"}]: dispatch 2024-09-04T16:25:21.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:21 smithi193 ceph-mon[36288]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ea70be0-d553-4669-adde-18aa1a04d81a"}]': finished 2024-09-04T16:25:21.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:21 smithi193 ceph-mon[36288]: osdmap e22: 4 total, 3 up, 4 in 2024-09-04T16:25:21.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:21 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-04T16:25:21.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:21 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:21.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:21 smithi193 ceph-mon[36288]: from='client.? 172.21.15.193:0/3265121561' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-04T16:25:21.717 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:21 smithi170 sudo[70407]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-04T16:25:21.717 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:21 smithi170 sudo[70407]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-04T16:25:21.717 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:21 smithi170 sudo[70407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-04T16:25:21.717 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:21 smithi170 sudo[70407]: pam_unix(sudo:session): session closed for user root 2024-09-04T16:25:22.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:21 smithi170 sudo[70410]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-04T16:25:22.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:21 smithi170 sudo[70410]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-04T16:25:22.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:21 smithi170 sudo[70410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-04T16:25:22.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:21 smithi170 sudo[70410]: pam_unix(sudo:session): session closed for user root 2024-09-04T16:25:22.221 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:21 smithi193 sudo[40231]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-04T16:25:22.221 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:21 smithi193 sudo[40231]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-04T16:25:22.221 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:21 smithi193 sudo[40231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-04T16:25:22.221 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:21 smithi193 sudo[40231]: pam_unix(sudo:session): session closed for user root 2024-09-04T16:25:22.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:22.234+0000 7f26809b3640 1 -- 172.21.15.193:0/3922619948 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f2664056f70 con 0x7f267c102c20 2024-09-04T16:25:22.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:22 smithi170 ceph-mon[29272]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-04T16:25:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:22 smithi170 ceph-mon[29272]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-04T16:25:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:22 smithi170 ceph-mon[29272]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-04T16:25:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-09-04T16:25:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:25:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-09-04T16:25:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:25:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:22 smithi193 sudo[40419]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-04T16:25:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:22 smithi193 sudo[40419]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-04T16:25:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:22 smithi193 sudo[40419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-04T16:25:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:22 smithi193 sudo[40419]: pam_unix(sudo:session): session closed for user root 2024-09-04T16:25:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:22 smithi193 ceph-mon[36288]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-04T16:25:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:22 smithi193 ceph-mon[36288]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-04T16:25:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:22 smithi193 ceph-mon[36288]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-04T16:25:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-09-04T16:25:22.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:25:22.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-09-04T16:25:22.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:25:23.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:23 smithi170 ceph-mon[29272]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-04T16:25:23.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:23 smithi170 ceph-mon[29272]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-04T16:25:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:23 smithi170 ceph-mon[29272]: mgrmap e19: smithi170.fbszap(active, since 2m), standbys: smithi193.gvfizn 2024-09-04T16:25:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:23 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:23.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:23 smithi193 ceph-mon[36288]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-04T16:25:23.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:23 smithi193 ceph-mon[36288]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-04T16:25:23.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:23 smithi193 ceph-mon[36288]: mgrmap e19: smithi170.fbszap(active, since 2m), standbys: smithi193.gvfizn 2024-09-04T16:25:23.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:23 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:24.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:24 smithi170 ceph-mon[29272]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-04T16:25:24.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:24 smithi193 ceph-mon[36288]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-04T16:25:26.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:26 smithi193 ceph-mon[36288]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail 2024-09-04T16:25:26.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:26 smithi170 ceph-mon[29272]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail 2024-09-04T16:25:28.509 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:28 smithi193 ceph-mon[36288]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-04T16:25:28.510 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:28 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:25:28.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:28 smithi170 ceph-mon[29272]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-04T16:25:28.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:28 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:25:29.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:29 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-04T16:25:29.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:29 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:29.621 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:29 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-04T16:25:29.621 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:29 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:30.506 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:30 smithi193 ceph-mon[36288]: Deploying daemon osd.3 on smithi193 2024-09-04T16:25:30.506 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:30 smithi193 ceph-mon[36288]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-04T16:25:30.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:30 smithi170 ceph-mon[29272]: Deploying daemon osd.3 on smithi193 2024-09-04T16:25:30.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:30 smithi170 ceph-mon[29272]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-04T16:25:32.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:32 smithi193 ceph-mon[36288]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-04T16:25:32.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:32 smithi170 ceph-mon[29272]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-04T16:25:34.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:34 smithi193 ceph-mon[36288]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-04T16:25:34.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:25:34.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:34.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:34.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:34 smithi170 ceph-mon[29272]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-04T16:25:34.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:25:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:36.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:36 smithi193 ceph-mon[36288]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-04T16:25:36.608 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:36 smithi170 ceph-mon[29272]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-04T16:25:37.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:37.405+0000 7f26809b3640 1 -- 172.21.15.193:0/3922619948 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f267c062630 con 0x7f266806ddb0 2024-09-04T16:25:37.406 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 3 on host 'smithi193' 2024-09-04T16:25:37.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:37.408+0000 7f26819b5640 1 -- 172.21.15.193:0/3922619948 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f266806ddb0 msgr2=0x7f2668070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:25:37.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:37.408+0000 7f26819b5640 1 --2- 172.21.15.193:0/3922619948 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f266806ddb0 0x7f2668070270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f266c000c00 tx=0x7f266c005a20 comp rx=0 tx=0).stop 2024-09-04T16:25:37.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:37.408+0000 7f26819b5640 1 -- 172.21.15.193:0/3922619948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f267c102c20 msgr2=0x7f267c197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:25:37.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:37.408+0000 7f26819b5640 1 --2- 172.21.15.193:0/3922619948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f267c102c20 0x7f267c197a40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f266400b420 tx=0x7f266400b8e0 comp rx=0 tx=0).stop 2024-09-04T16:25:37.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:37.408+0000 7f26819b5640 1 -- 172.21.15.193:0/3922619948 shutdown_connections 2024-09-04T16:25:37.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:37.408+0000 7f26819b5640 1 --2- 172.21.15.193:0/3922619948 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f266806ddb0 0x7f2668070270 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:25:37.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:37.408+0000 7f26819b5640 1 --2- 172.21.15.193:0/3922619948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f267c102c20 0x7f267c197a40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:25:37.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:37.408+0000 7f26819b5640 1 --2- 172.21.15.193:0/3922619948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f267c0ffc40 0x7f267c197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:25:37.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:37.408+0000 7f26819b5640 1 -- 172.21.15.193:0/3922619948 >> 172.21.15.193:0/3922619948 conn(0x7f267c0fb7b0 msgr2=0x7f267c1060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:25:37.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:37.408+0000 7f26819b5640 1 -- 172.21.15.193:0/3922619948 shutdown_connections 2024-09-04T16:25:37.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:37.408+0000 7f26819b5640 1 -- 172.21.15.193:0/3922619948 wait complete. 2024-09-04T16:25:38.341 DEBUG:teuthology.orchestra.run.smithi193:osd.3> sudo journalctl -f -n 0 -u ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.3.service 2024-09-04T16:25:38.344 INFO:tasks.cephadm:Deploying osd.4 on smithi193 with /dev/vg_nvme/lv_3... 2024-09-04T16:25:38.344 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-04T16:25:38.641 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi193/config 2024-09-04T16:25:38.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:38 smithi193 ceph-mon[36288]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-04T16:25:38.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:38 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:38.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:38 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:38.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:38 smithi170 ceph-mon[29272]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-04T16:25:38.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:38 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:38 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:39.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:39 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:39.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:39 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:39.902 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:39 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:39.902 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:39 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:40.156 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:25:39 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3[42182]: 2024-09-04T16:25:39.989+0000 7f7bd437a640 -1 osd.3 0 log_to_monitors true 2024-09-04T16:25:40.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:40 smithi193 ceph-mon[36288]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-04T16:25:40.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:40 smithi193 ceph-mon[36288]: from='osd.3 [v2:172.21.15.193:6800/3804134072,v1:172.21.15.193:6801/3804134072]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-04T16:25:40.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:40 smithi193 ceph-mon[36288]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-04T16:25:40.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:40 smithi170 ceph-mon[29272]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-04T16:25:40.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:40 smithi170 ceph-mon[29272]: from='osd.3 [v2:172.21.15.193:6800/3804134072,v1:172.21.15.193:6801/3804134072]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-04T16:25:40.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:40 smithi170 ceph-mon[29272]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-04T16:25:41.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:41 smithi193 ceph-mon[36288]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-04T16:25:41.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:41 smithi193 ceph-mon[36288]: from='osd.3 [v2:172.21.15.193:6800/3804134072,v1:172.21.15.193:6801/3804134072]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-04T16:25:41.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:41 smithi193 ceph-mon[36288]: osdmap e23: 4 total, 3 up, 4 in 2024-09-04T16:25:41.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:41 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-04T16:25:41.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:41 smithi193 ceph-mon[36288]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-04T16:25:41.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:41 smithi193 ceph-mon[36288]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-04T16:25:41.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:41 smithi170 ceph-mon[29272]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-04T16:25:41.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:41 smithi170 ceph-mon[29272]: from='osd.3 [v2:172.21.15.193:6800/3804134072,v1:172.21.15.193:6801/3804134072]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-04T16:25:41.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:41 smithi170 ceph-mon[29272]: osdmap e23: 4 total, 3 up, 4 in 2024-09-04T16:25:41.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:41 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-04T16:25:41.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:41 smithi170 ceph-mon[29272]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-04T16:25:41.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:41 smithi170 ceph-mon[29272]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-04T16:25:42.557 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:42 smithi193 ceph-mon[36288]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-04T16:25:42.557 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:42 smithi193 ceph-mon[36288]: osdmap e24: 4 total, 3 up, 4 in 2024-09-04T16:25:42.557 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:42 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-04T16:25:42.557 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:42 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-04T16:25:42.557 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:42 smithi193 ceph-mon[36288]: from='osd.3 ' entity='osd.3' 2024-09-04T16:25:42.557 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:25:42 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3[42182]: 2024-09-04T16:25:42.250+0000 7f7bd0b11640 -1 osd.3 0 waiting for initial osdmap 2024-09-04T16:25:42.557 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:25:42 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3[42182]: 2024-09-04T16:25:42.256+0000 7f7bc810c640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-04T16:25:42.559 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:25:42.585 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi193:vg_nvme/lv_3 2024-09-04T16:25:42.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:42 smithi170 ceph-mon[29272]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-04T16:25:42.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:42 smithi170 ceph-mon[29272]: osdmap e24: 4 total, 3 up, 4 in 2024-09-04T16:25:42.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:42 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-04T16:25:42.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:42 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-04T16:25:42.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:42 smithi170 ceph-mon[29272]: from='osd.3 ' entity='osd.3' 2024-09-04T16:25:43.085 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi193/config 2024-09-04T16:25:43.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.607+0000 7f4835dc2640 1 -- 172.21.15.193:0/1129143288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4830101980 msgr2=0x7f4830101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:25:43.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.607+0000 7f4835dc2640 1 --2- 172.21.15.193:0/1129143288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4830101980 0x7f4830101d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4820009880 tx=0x7f482002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:25:43.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.607+0000 7f4835dc2640 1 -- 172.21.15.193:0/1129143288 shutdown_connections 2024-09-04T16:25:43.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.607+0000 7f4835dc2640 1 --2- 172.21.15.193:0/1129143288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4830102b80 0x7f4830103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:25:43.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.607+0000 7f4835dc2640 1 --2- 172.21.15.193:0/1129143288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4830101980 0x7f4830101d80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:25:43.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.607+0000 7f4835dc2640 1 -- 172.21.15.193:0/1129143288 >> 172.21.15.193:0/1129143288 conn(0x7f48300fd110 msgr2=0x7f48300ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:25:43.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.607+0000 7f4835dc2640 1 -- 172.21.15.193:0/1129143288 shutdown_connections 2024-09-04T16:25:43.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.607+0000 7f4835dc2640 1 -- 172.21.15.193:0/1129143288 wait complete. 2024-09-04T16:25:43.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.607+0000 7f4835dc2640 1 Processor -- start 2024-09-04T16:25:43.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.608+0000 7f4835dc2640 1 -- start start 2024-09-04T16:25:43.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.608+0000 7f4835dc2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4830101980 0x7f4830075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:25:43.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.608+0000 7f4835dc2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4830102b80 0x7f48300745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:25:43.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.608+0000 7f4835dc2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f483010a820 con 0x7f4830102b80 2024-09-04T16:25:43.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.608+0000 7f4835dc2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f483010a6a0 con 0x7f4830101980 2024-09-04T16:25:43.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.608+0000 7f482f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4830101980 0x7f4830075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:25:43.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.608+0000 7f482f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4830101980 0x7f4830075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:57174/0 (socket says 172.21.15.193:57174) 2024-09-04T16:25:43.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.608+0000 7f482f7fe640 1 -- 172.21.15.193:0/285940236 learned_addr learned my addr 172.21.15.193:0/285940236 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-04T16:25:43.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.608+0000 7f482effd640 1 --2- 172.21.15.193:0/285940236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4830102b80 0x7f48300745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:25:43.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.608+0000 7f482f7fe640 1 -- 172.21.15.193:0/285940236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4830102b80 msgr2=0x7f48300745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:25:43.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.608+0000 7f482f7fe640 1 --2- 172.21.15.193:0/285940236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4830102b80 0x7f48300745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:25:43.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.608+0000 7f482f7fe640 1 -- 172.21.15.193:0/285940236 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4830074b20 con 0x7f4830101980 2024-09-04T16:25:43.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.608+0000 7f482f7fe640 1 --2- 172.21.15.193:0/285940236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4830101980 0x7f4830075f20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4820006010 tx=0x7f48200048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:25:43.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.608+0000 7f482cff9640 1 -- 172.21.15.193:0/285940236 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f482003f070 con 0x7f4830101980 2024-09-04T16:25:43.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.609+0000 7f4835dc2640 1 -- 172.21.15.193:0/285940236 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4830074db0 con 0x7f4830101980 2024-09-04T16:25:43.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.609+0000 7f482cff9640 1 -- 172.21.15.193:0/285940236 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f48200044d0 con 0x7f4830101980 2024-09-04T16:25:43.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.609+0000 7f482cff9640 1 -- 172.21.15.193:0/285940236 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4820035030 con 0x7f4830101980 2024-09-04T16:25:43.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.609+0000 7f4835dc2640 1 -- 172.21.15.193:0/285940236 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4830075360 con 0x7f4830101980 2024-09-04T16:25:43.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.609+0000 7f4835dc2640 1 -- 172.21.15.193:0/285940236 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4830101d80 con 0x7f4830101980 2024-09-04T16:25:43.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.610+0000 7f482cff9640 1 -- 172.21.15.193:0/285940236 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f4820042070 con 0x7f4830101980 2024-09-04T16:25:43.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.611+0000 7f482cff9640 1 --2- 172.21.15.193:0/285940236 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f481806de30 0x7f48180702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:25:43.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.611+0000 7f482cff9640 1 -- 172.21.15.193:0/285940236 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3803+0+0 (secure 0 0 0) 0x7f48200ae0d0 con 0x7f4830101980 2024-09-04T16:25:43.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.611+0000 7f482effd640 1 --2- 172.21.15.193:0/285940236 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f481806de30 0x7f48180702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:25:43.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.611+0000 7f482effd640 1 --2- 172.21.15.193:0/285940236 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f481806de30 0x7f48180702f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4830075ca0 tx=0x7f4824009110 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:25:43.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.615+0000 7f482cff9640 1 -- 172.21.15.193:0/285940236 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f482007c2f0 con 0x7f4830101980 2024-09-04T16:25:43.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:25:43.791+0000 7f4835dc2640 1 -- 172.21.15.193:0/285940236 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4830062630 con 0x7f481806de30 2024-09-04T16:25:43.792 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:43 smithi193 ceph-mon[36288]: purged_snaps scrub starts 2024-09-04T16:25:43.792 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:43 smithi193 ceph-mon[36288]: purged_snaps scrub ok 2024-09-04T16:25:43.792 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:43 smithi193 ceph-mon[36288]: osd.3 [v2:172.21.15.193:6800/3804134072,v1:172.21.15.193:6801/3804134072] boot 2024-09-04T16:25:43.792 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:43 smithi193 ceph-mon[36288]: osdmap e25: 4 total, 4 up, 4 in 2024-09-04T16:25:43.792 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:43 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-04T16:25:43.792 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:43 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:25:43.793 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:43 smithi193 ceph-mon[36288]: osdmap e26: 4 total, 4 up, 4 in 2024-09-04T16:25:43.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:43 smithi170 ceph-mon[29272]: purged_snaps scrub starts 2024-09-04T16:25:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:43 smithi170 ceph-mon[29272]: purged_snaps scrub ok 2024-09-04T16:25:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:43 smithi170 ceph-mon[29272]: osd.3 [v2:172.21.15.193:6800/3804134072,v1:172.21.15.193:6801/3804134072] boot 2024-09-04T16:25:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:43 smithi170 ceph-mon[29272]: osdmap e25: 4 total, 4 up, 4 in 2024-09-04T16:25:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-04T16:25:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:25:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:43 smithi170 ceph-mon[29272]: osdmap e26: 4 total, 4 up, 4 in 2024-09-04T16:25:44.645 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:44 smithi193 ceph-mon[36288]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 534 MiB used, 357 GiB / 358 GiB avail 2024-09-04T16:25:44.645 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-04T16:25:44.645 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-04T16:25:44.645 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:44.645 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:44.645 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:44.645 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:25:44.645 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:44.645 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:44.645 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:25:44.645 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:44.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:25:44.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:44.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:25:44.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:44.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:44 smithi193 ceph-mon[36288]: osdmap e27: 4 total, 4 up, 4 in 2024-09-04T16:25:44.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:44 smithi170 ceph-mon[29272]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 534 MiB used, 357 GiB / 358 GiB avail 2024-09-04T16:25:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-04T16:25:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-04T16:25:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:25:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:25:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:25:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:25:44.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:25:44.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:44 smithi170 ceph-mon[29272]: osdmap e27: 4 total, 4 up, 4 in 2024-09-04T16:25:45.750 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:45 smithi193 ceph-mon[36288]: from='client.24177 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:25:45.750 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:45 smithi193 ceph-mon[36288]: Detected new or changed devices on smithi193 2024-09-04T16:25:45.751 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:45 smithi193 ceph-mon[36288]: Adjusting osd_memory_target on smithi193 to 14912M 2024-09-04T16:25:45.751 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:45 smithi193 ceph-mon[36288]: osdmap e28: 4 total, 4 up, 4 in 2024-09-04T16:25:45.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:45 smithi170 ceph-mon[29272]: from='client.24177 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:25:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:45 smithi170 ceph-mon[29272]: Detected new or changed devices on smithi193 2024-09-04T16:25:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:45 smithi170 ceph-mon[29272]: Adjusting osd_memory_target on smithi193 to 14912M 2024-09-04T16:25:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:45 smithi170 ceph-mon[29272]: osdmap e28: 4 total, 4 up, 4 in 2024-09-04T16:25:46.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:46 smithi170 ceph-mon[29272]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 534 MiB used, 357 GiB / 358 GiB avail 2024-09-04T16:25:46.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:46 smithi170 ceph-mon[29272]: osdmap e29: 4 total, 4 up, 4 in 2024-09-04T16:25:46.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:46 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/3179652458' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cc6d07b-d898-4f15-ac87-d29cd36ef898"}]: dispatch 2024-09-04T16:25:46.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:46 smithi170 ceph-mon[29272]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cc6d07b-d898-4f15-ac87-d29cd36ef898"}]: dispatch 2024-09-04T16:25:46.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:46 smithi170 ceph-mon[29272]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5cc6d07b-d898-4f15-ac87-d29cd36ef898"}]': finished 2024-09-04T16:25:46.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:46 smithi170 ceph-mon[29272]: osdmap e30: 5 total, 4 up, 5 in 2024-09-04T16:25:46.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:46 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-04T16:25:46.893 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:46 smithi193 ceph-mon[36288]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 534 MiB used, 357 GiB / 358 GiB avail 2024-09-04T16:25:46.893 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:46 smithi193 ceph-mon[36288]: osdmap e29: 4 total, 4 up, 4 in 2024-09-04T16:25:46.893 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:46 smithi193 ceph-mon[36288]: from='client.? 172.21.15.193:0/3179652458' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cc6d07b-d898-4f15-ac87-d29cd36ef898"}]: dispatch 2024-09-04T16:25:46.893 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:46 smithi193 ceph-mon[36288]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cc6d07b-d898-4f15-ac87-d29cd36ef898"}]: dispatch 2024-09-04T16:25:46.893 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:46 smithi193 ceph-mon[36288]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5cc6d07b-d898-4f15-ac87-d29cd36ef898"}]': finished 2024-09-04T16:25:46.893 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:46 smithi193 ceph-mon[36288]: osdmap e30: 5 total, 4 up, 5 in 2024-09-04T16:25:46.893 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:46 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-04T16:25:47.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:47 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/2290574087' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-04T16:25:47.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:47 smithi193 ceph-mon[36288]: from='client.? 172.21.15.193:0/2290574087' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-04T16:25:48.834 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:48 smithi193 ceph-mon[36288]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 533 MiB used, 357 GiB / 358 GiB avail; 154 KiB/s, 0 objects/s recovering 2024-09-04T16:25:48.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:48 smithi170 ceph-mon[29272]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 533 MiB used, 357 GiB / 358 GiB avail; 154 KiB/s, 0 objects/s recovering 2024-09-04T16:25:49.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:49 smithi170 ceph-mon[29272]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-09-04T16:25:49.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:49 smithi193 ceph-mon[36288]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-09-04T16:25:52.364 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:52 smithi193 ceph-mon[36288]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-04T16:25:52.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:52 smithi170 ceph-mon[29272]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-04T16:25:54.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:54 smithi170 ceph-mon[29272]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-04T16:25:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:54 smithi193 ceph-mon[36288]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-04T16:25:55.484 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:55 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-04T16:25:55.484 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:55 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:55.578 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:55 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-04T16:25:55.578 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:55 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:25:56.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:56 smithi170 ceph-mon[29272]: Deploying daemon osd.4 on smithi193 2024-09-04T16:25:56.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:56 smithi170 ceph-mon[29272]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-04T16:25:56.625 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:56 smithi193 ceph-mon[36288]: Deploying daemon osd.4 on smithi193 2024-09-04T16:25:56.626 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:56 smithi193 ceph-mon[36288]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-04T16:25:58.544 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:58 smithi193 ceph-mon[36288]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-04T16:25:58.545 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:25:58 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:25:58.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:58 smithi170 ceph-mon[29272]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-04T16:25:58.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:25:58 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:26:00.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:00 smithi170 ceph-mon[29272]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-04T16:26:00.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:00 smithi193 ceph-mon[36288]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-04T16:26:01.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:01 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:26:01.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:01 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:01.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:01 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:01.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:01 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:26:01.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:01 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:01.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:01 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:02 smithi193 ceph-mon[36288]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-04T16:26:02.770 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:02 smithi170 ceph-mon[29272]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-04T16:26:04.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:04.371+0000 7f482cff9640 1 -- 172.21.15.193:0/285940236 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4830062630 con 0x7f481806de30 2024-09-04T16:26:04.372 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 4 on host 'smithi193' 2024-09-04T16:26:04.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:04.373+0000 7f4835dc2640 1 -- 172.21.15.193:0/285940236 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f481806de30 msgr2=0x7f48180702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:04.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:04.373+0000 7f4835dc2640 1 --2- 172.21.15.193:0/285940236 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f481806de30 0x7f48180702f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4830075ca0 tx=0x7f4824009110 comp rx=0 tx=0).stop 2024-09-04T16:26:04.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:04.373+0000 7f4835dc2640 1 -- 172.21.15.193:0/285940236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4830101980 msgr2=0x7f4830075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:04.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:04.373+0000 7f4835dc2640 1 --2- 172.21.15.193:0/285940236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4830101980 0x7f4830075f20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4820006010 tx=0x7f48200048f0 comp rx=0 tx=0).stop 2024-09-04T16:26:04.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:04.373+0000 7f4835dc2640 1 -- 172.21.15.193:0/285940236 shutdown_connections 2024-09-04T16:26:04.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:04.373+0000 7f4835dc2640 1 --2- 172.21.15.193:0/285940236 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f481806de30 0x7f48180702f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:04.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:04.373+0000 7f4835dc2640 1 --2- 172.21.15.193:0/285940236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4830102b80 0x7f48300745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:04.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:04.373+0000 7f4835dc2640 1 --2- 172.21.15.193:0/285940236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4830101980 0x7f4830075f20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:04.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:04.373+0000 7f4835dc2640 1 -- 172.21.15.193:0/285940236 >> 172.21.15.193:0/285940236 conn(0x7f48300fd110 msgr2=0x7f4830106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:04.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:04.373+0000 7f4835dc2640 1 -- 172.21.15.193:0/285940236 shutdown_connections 2024-09-04T16:26:04.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:04.373+0000 7f4835dc2640 1 -- 172.21.15.193:0/285940236 wait complete. 2024-09-04T16:26:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:04 smithi193 ceph-mon[36288]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-04T16:26:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:04 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:04 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:04.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:04 smithi170 ceph-mon[29272]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-04T16:26:04.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:04 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:04.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:04 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:05.026 DEBUG:teuthology.orchestra.run.smithi193:osd.4> sudo journalctl -f -n 0 -u ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.4.service 2024-09-04T16:26:05.029 INFO:tasks.cephadm:Deploying osd.5 on smithi193 with /dev/vg_nvme/lv_2... 2024-09-04T16:26:05.029 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-04T16:26:05.343 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi193/config 2024-09-04T16:26:06.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:06 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:06.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:06 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:06.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:06 smithi193 ceph-mon[36288]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-04T16:26:06.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:06 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:06.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:06 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:06.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:06 smithi170 ceph-mon[29272]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-04T16:26:06.724 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:26:06 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[48612]: 2024-09-04T16:26:06.421+0000 7fe5a7493640 -1 osd.4 0 log_to_monitors true 2024-09-04T16:26:07.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:07 smithi193 ceph-mon[36288]: from='osd.4 [v2:172.21.15.193:6808/2691165010,v1:172.21.15.193:6809/2691165010]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-04T16:26:07.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:07 smithi193 ceph-mon[36288]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-04T16:26:07.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:07 smithi170 ceph-mon[29272]: from='osd.4 [v2:172.21.15.193:6808/2691165010,v1:172.21.15.193:6809/2691165010]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-04T16:26:07.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:07 smithi170 ceph-mon[29272]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-04T16:26:08.158 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:26:08 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[48612]: 2024-09-04T16:26:08.151+0000 7fe5a2bf3640 -1 osd.4 0 waiting for initial osdmap 2024-09-04T16:26:08.159 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:26:08 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[48612]: 2024-09-04T16:26:08.158+0000 7fe59f22d640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-04T16:26:08.159 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:08 smithi193 ceph-mon[36288]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-04T16:26:08.159 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:08 smithi193 ceph-mon[36288]: osdmap e31: 5 total, 4 up, 5 in 2024-09-04T16:26:08.159 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:08 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-04T16:26:08.159 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:08 smithi193 ceph-mon[36288]: from='osd.4 [v2:172.21.15.193:6808/2691165010,v1:172.21.15.193:6809/2691165010]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-04T16:26:08.159 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:08 smithi193 ceph-mon[36288]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-04T16:26:08.159 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:08 smithi193 ceph-mon[36288]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-04T16:26:08.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:08 smithi170 ceph-mon[29272]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-04T16:26:08.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:08 smithi170 ceph-mon[29272]: osdmap e31: 5 total, 4 up, 5 in 2024-09-04T16:26:08.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:08 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-04T16:26:08.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:08 smithi170 ceph-mon[29272]: from='osd.4 [v2:172.21.15.193:6808/2691165010,v1:172.21.15.193:6809/2691165010]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-04T16:26:08.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:08 smithi170 ceph-mon[29272]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-04T16:26:08.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:08 smithi170 ceph-mon[29272]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-04T16:26:08.723 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-04T16:26:08.753 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi193:vg_nvme/lv_2 2024-09-04T16:26:09.322 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:09 smithi193 ceph-mon[36288]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-04T16:26:09.322 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:09 smithi193 ceph-mon[36288]: osdmap e32: 5 total, 4 up, 5 in 2024-09-04T16:26:09.322 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:09 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-04T16:26:09.322 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:09 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-04T16:26:09.357 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi193/config 2024-09-04T16:26:09.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:09 smithi170 ceph-mon[29272]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-04T16:26:09.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:09 smithi170 ceph-mon[29272]: osdmap e32: 5 total, 4 up, 5 in 2024-09-04T16:26:09.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:09 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-04T16:26:09.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:09 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-04T16:26:09.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.860+0000 7f22a07b7640 1 -- 172.21.15.193:0/3497933788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2298102b50 msgr2=0x7f2298104fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:09.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.860+0000 7f22a07b7640 1 --2- 172.21.15.193:0/3497933788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2298102b50 0x7f2298104fc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2288009880 tx=0x7f228802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:26:09.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.861+0000 7f22a07b7640 1 -- 172.21.15.193:0/3497933788 shutdown_connections 2024-09-04T16:26:09.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.861+0000 7f22a07b7640 1 --2- 172.21.15.193:0/3497933788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2298102b50 0x7f2298104fc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:09.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.861+0000 7f22a07b7640 1 --2- 172.21.15.193:0/3497933788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2298100200 0x7f2298102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:09.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.861+0000 7f22a07b7640 1 -- 172.21.15.193:0/3497933788 >> 172.21.15.193:0/3497933788 conn(0x7f22980fc010 msgr2=0x7f22980fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:09.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.861+0000 7f22a07b7640 1 -- 172.21.15.193:0/3497933788 shutdown_connections 2024-09-04T16:26:09.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.861+0000 7f22a07b7640 1 -- 172.21.15.193:0/3497933788 wait complete. 2024-09-04T16:26:09.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.861+0000 7f22a07b7640 1 Processor -- start 2024-09-04T16:26:09.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.861+0000 7f22a07b7640 1 -- start start 2024-09-04T16:26:09.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.861+0000 7f22a07b7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2298100200 0x7f229819da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:09.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.861+0000 7f22a07b7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2298102b50 0x7f229819dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:09.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.861+0000 7f22a07b7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2298110d90 con 0x7f2298102b50 2024-09-04T16:26:09.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.861+0000 7f22a07b7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2298110c10 con 0x7f2298100200 2024-09-04T16:26:09.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.861+0000 7f229e553640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2298100200 0x7f229819da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:09.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.861+0000 7f229e553640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2298100200 0x7f229819da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:45488/0 (socket says 172.21.15.193:45488) 2024-09-04T16:26:09.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.862+0000 7f229e553640 1 -- 172.21.15.193:0/2979466933 learned_addr learned my addr 172.21.15.193:0/2979466933 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-04T16:26:09.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.862+0000 7f229e553640 1 -- 172.21.15.193:0/2979466933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2298102b50 msgr2=0x7f229819dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:09.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.862+0000 7f229e553640 1 --2- 172.21.15.193:0/2979466933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2298102b50 0x7f229819dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:09.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.862+0000 7f229e553640 1 -- 172.21.15.193:0/2979466933 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229819e5b0 con 0x7f2298100200 2024-09-04T16:26:09.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.862+0000 7f229e553640 1 --2- 172.21.15.193:0/2979466933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2298100200 0x7f229819da80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f229400c8a0 tx=0x7f229400cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:09.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.862+0000 7f228f7fe640 1 -- 172.21.15.193:0/2979466933 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f22940079b0 con 0x7f2298100200 2024-09-04T16:26:09.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.862+0000 7f228f7fe640 1 -- 172.21.15.193:0/2979466933 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2294007b50 con 0x7f2298100200 2024-09-04T16:26:09.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.862+0000 7f228f7fe640 1 -- 172.21.15.193:0/2979466933 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2294018700 con 0x7f2298100200 2024-09-04T16:26:09.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.862+0000 7f22a07b7640 1 -- 172.21.15.193:0/2979466933 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22981a3020 con 0x7f2298100200 2024-09-04T16:26:09.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.862+0000 7f22a07b7640 1 -- 172.21.15.193:0/2979466933 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22981a3580 con 0x7f2298100200 2024-09-04T16:26:09.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.863+0000 7f22a07b7640 1 -- 172.21.15.193:0/2979466933 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2298100600 con 0x7f2298100200 2024-09-04T16:26:09.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.864+0000 7f228f7fe640 1 -- 172.21.15.193:0/2979466933 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f2294007d00 con 0x7f2298100200 2024-09-04T16:26:09.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.864+0000 7f228f7fe640 1 --2- 172.21.15.193:0/2979466933 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f228406de90 0x7f2284070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:09.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.864+0000 7f228f7fe640 1 -- 172.21.15.193:0/2979466933 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4206+0+0 (secure 0 0 0) 0x7f229408d8a0 con 0x7f2298100200 2024-09-04T16:26:09.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.864+0000 7f229dd52640 1 --2- 172.21.15.193:0/2979466933 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f228406de90 0x7f2284070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:09.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.865+0000 7f229dd52640 1 --2- 172.21.15.193:0/2979466933 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f228406de90 0x7f2284070350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f22880096c0 tx=0x7f2288000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:09.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:09.869+0000 7f228f7fe640 1 -- 172.21.15.193:0/2979466933 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2294014030 con 0x7f2298100200 2024-09-04T16:26:10.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:10.048+0000 7f22a07b7640 1 -- 172.21.15.193:0/2979466933 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2298103510 con 0x7f228406de90 2024-09-04T16:26:10.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:10 smithi193 ceph-mon[36288]: purged_snaps scrub starts 2024-09-04T16:26:10.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:10 smithi193 ceph-mon[36288]: purged_snaps scrub ok 2024-09-04T16:26:10.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:10 smithi193 ceph-mon[36288]: osd.4 [v2:172.21.15.193:6808/2691165010,v1:172.21.15.193:6809/2691165010] boot 2024-09-04T16:26:10.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:10 smithi193 ceph-mon[36288]: osdmap e33: 5 total, 5 up, 5 in 2024-09-04T16:26:10.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:10 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-04T16:26:10.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:10 smithi193 ceph-mon[36288]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:10.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:10 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-04T16:26:10.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:10 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-04T16:26:10.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:10 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:26:10.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:10 smithi170 ceph-mon[29272]: purged_snaps scrub starts 2024-09-04T16:26:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:10 smithi170 ceph-mon[29272]: purged_snaps scrub ok 2024-09-04T16:26:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:10 smithi170 ceph-mon[29272]: osd.4 [v2:172.21.15.193:6808/2691165010,v1:172.21.15.193:6809/2691165010] boot 2024-09-04T16:26:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:10 smithi170 ceph-mon[29272]: osdmap e33: 5 total, 5 up, 5 in 2024-09-04T16:26:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:10 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-04T16:26:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:10 smithi170 ceph-mon[29272]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:10 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-04T16:26:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:10 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-04T16:26:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:10 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:26:11.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:11 smithi193 ceph-mon[36288]: from='client.24195 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:26:11.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:11 smithi193 ceph-mon[36288]: osdmap e34: 5 total, 5 up, 5 in 2024-09-04T16:26:11.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:11.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:11.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:26:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:26:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:26:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:26:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:26:11.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:11 smithi170 ceph-mon[29272]: from='client.24195 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:26:11.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:11 smithi170 ceph-mon[29272]: osdmap e34: 5 total, 5 up, 5 in 2024-09-04T16:26:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:26:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:26:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:26:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:26:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:26:12.364 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:12 smithi193 ceph-mon[36288]: Detected new or changed devices on smithi193 2024-09-04T16:26:12.364 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:12 smithi193 ceph-mon[36288]: Adjusting osd_memory_target on smithi193 to 7456M 2024-09-04T16:26:12.364 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:12 smithi193 ceph-mon[36288]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:12.365 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:12 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:26:12.365 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:12 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:26:12.365 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:12 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:12 smithi170 ceph-mon[29272]: Detected new or changed devices on smithi193 2024-09-04T16:26:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:12 smithi170 ceph-mon[29272]: Adjusting osd_memory_target on smithi193 to 7456M 2024-09-04T16:26:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:12 smithi170 ceph-mon[29272]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:12 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:26:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:12 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:26:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:12 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:13.273 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:13 smithi193 ceph-mon[36288]: from='client.? 172.21.15.193:0/2520210488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edc27f67-a882-4b09-90a8-17b0060cb8ed"}]: dispatch 2024-09-04T16:26:13.273 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:13 smithi193 ceph-mon[36288]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edc27f67-a882-4b09-90a8-17b0060cb8ed"}]: dispatch 2024-09-04T16:26:13.273 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:13 smithi193 ceph-mon[36288]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edc27f67-a882-4b09-90a8-17b0060cb8ed"}]': finished 2024-09-04T16:26:13.273 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:13 smithi193 ceph-mon[36288]: osdmap e35: 6 total, 5 up, 6 in 2024-09-04T16:26:13.274 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:13 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-04T16:26:13.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:13 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/2520210488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edc27f67-a882-4b09-90a8-17b0060cb8ed"}]: dispatch 2024-09-04T16:26:13.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:13 smithi170 ceph-mon[29272]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edc27f67-a882-4b09-90a8-17b0060cb8ed"}]: dispatch 2024-09-04T16:26:13.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:13 smithi170 ceph-mon[29272]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edc27f67-a882-4b09-90a8-17b0060cb8ed"}]': finished 2024-09-04T16:26:13.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:13 smithi170 ceph-mon[29272]: osdmap e35: 6 total, 5 up, 6 in 2024-09-04T16:26:13.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:13 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-04T16:26:14.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:14 smithi170 ceph-mon[29272]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:14 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:26:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:14 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/1337058916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-04T16:26:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:14 smithi193 ceph-mon[36288]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:14 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:26:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:14 smithi193 ceph-mon[36288]: from='client.? 172.21.15.193:0/1337058916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-04T16:26:16.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:16 smithi170 ceph-mon[29272]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:16 smithi193 ceph-mon[36288]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:18.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:18 smithi193 ceph-mon[36288]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:18.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:18 smithi170 ceph-mon[29272]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:20.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:20 smithi193 ceph-mon[36288]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:20.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:20 smithi170 ceph-mon[29272]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:22.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:22 smithi193 ceph-mon[36288]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:22.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-04T16:26:22.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:26:22.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:22 smithi193 ceph-mon[36288]: Deploying daemon osd.5 on smithi193 2024-09-04T16:26:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:22 smithi170 ceph-mon[29272]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-04T16:26:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:26:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:22 smithi170 ceph-mon[29272]: Deploying daemon osd.5 on smithi193 2024-09-04T16:26:24.429 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:24 smithi193 ceph-mon[36288]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:24.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:24 smithi170 ceph-mon[29272]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:26.547 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:26 smithi193 ceph-mon[36288]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:26.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:26 smithi170 ceph-mon[29272]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:27.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:27 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:26:27.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:27 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:27.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:27 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:27.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:27 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:26:27.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:27 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:27.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:27 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:28.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:28 smithi193 ceph-mon[36288]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:28.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:28 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:26:28.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:28 smithi170 ceph-mon[29272]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:28.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:28 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:26:30.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:30 smithi193 ceph-mon[36288]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:30.488 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 5 on host 'smithi193' 2024-09-04T16:26:30.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:30.487+0000 7f228f7fe640 1 -- 172.21.15.193:0/2979466933 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2298103510 con 0x7f228406de90 2024-09-04T16:26:30.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:30.489+0000 7f22a07b7640 1 -- 172.21.15.193:0/2979466933 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f228406de90 msgr2=0x7f2284070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:30.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:30.489+0000 7f22a07b7640 1 --2- 172.21.15.193:0/2979466933 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f228406de90 0x7f2284070350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f22880096c0 tx=0x7f2288000bc0 comp rx=0 tx=0).stop 2024-09-04T16:26:30.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:30.489+0000 7f22a07b7640 1 -- 172.21.15.193:0/2979466933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2298100200 msgr2=0x7f229819da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:30.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:30.489+0000 7f22a07b7640 1 --2- 172.21.15.193:0/2979466933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2298100200 0x7f229819da80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f229400c8a0 tx=0x7f229400cd60 comp rx=0 tx=0).stop 2024-09-04T16:26:30.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:30.489+0000 7f22a07b7640 1 -- 172.21.15.193:0/2979466933 shutdown_connections 2024-09-04T16:26:30.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:30.489+0000 7f22a07b7640 1 --2- 172.21.15.193:0/2979466933 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f228406de90 0x7f2284070350 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:30.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:30.489+0000 7f22a07b7640 1 --2- 172.21.15.193:0/2979466933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2298102b50 0x7f229819dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:30.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:30.489+0000 7f22a07b7640 1 --2- 172.21.15.193:0/2979466933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2298100200 0x7f229819da80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:30.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:30.489+0000 7f22a07b7640 1 -- 172.21.15.193:0/2979466933 >> 172.21.15.193:0/2979466933 conn(0x7f22980fc010 msgr2=0x7f22980fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:30.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:30.489+0000 7f22a07b7640 1 -- 172.21.15.193:0/2979466933 shutdown_connections 2024-09-04T16:26:30.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:30.489+0000 7f22a07b7640 1 -- 172.21.15.193:0/2979466933 wait complete. 2024-09-04T16:26:30.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:30 smithi170 ceph-mon[29272]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:31.173 DEBUG:teuthology.orchestra.run.smithi193:osd.5> sudo journalctl -f -n 0 -u ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.5.service 2024-09-04T16:26:31.177 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-04T16:26:31.177 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph osd stat -f json 2024-09-04T16:26:31.440 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:31.756 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:31 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:31.756 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:31 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:31.756 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:31 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:31.756 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:31 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:31.780 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:31 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:31.780 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:31 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:31.780 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:31 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:31.780 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:31 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.860+0000 7fb119cbc640 1 -- 172.21.15.170:0/3900058867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb114101990 msgr2=0x7fb114101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.860+0000 7fb119cbc640 1 --2- 172.21.15.170:0/3900058867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb114101990 0x7fb114101d90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb104009880 tx=0x7fb10402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:26:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.860+0000 7fb119cbc640 1 -- 172.21.15.170:0/3900058867 shutdown_connections 2024-09-04T16:26:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.860+0000 7fb119cbc640 1 --2- 172.21.15.170:0/3900058867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb114102b90 0x7fb114103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.860+0000 7fb119cbc640 1 --2- 172.21.15.170:0/3900058867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb114101990 0x7fb114101d90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.860+0000 7fb119cbc640 1 -- 172.21.15.170:0/3900058867 >> 172.21.15.170:0/3900058867 conn(0x7fb1140fd140 msgr2=0x7fb1140ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.860+0000 7fb119cbc640 1 -- 172.21.15.170:0/3900058867 shutdown_connections 2024-09-04T16:26:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.860+0000 7fb119cbc640 1 -- 172.21.15.170:0/3900058867 wait complete. 2024-09-04T16:26:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.861+0000 7fb119cbc640 1 Processor -- start 2024-09-04T16:26:31.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.861+0000 7fb119cbc640 1 -- start start 2024-09-04T16:26:31.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.861+0000 7fb119cbc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb114101990 0x7fb114075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:31.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.861+0000 7fb119cbc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb114102b90 0x7fb1140745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:31.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.861+0000 7fb119cbc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb11410a7b0 con 0x7fb114101990 2024-09-04T16:26:31.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.861+0000 7fb119cbc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb11410a630 con 0x7fb114102b90 2024-09-04T16:26:31.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.861+0000 7fb1137fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb114101990 0x7fb114075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:31.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.861+0000 7fb1137fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb114101990 0x7fb114075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:40258/0 (socket says 172.21.15.170:40258) 2024-09-04T16:26:31.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.861+0000 7fb1137fe640 1 -- 172.21.15.170:0/3676207204 learned_addr learned my addr 172.21.15.170:0/3676207204 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:31.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.861+0000 7fb112ffd640 1 --2- 172.21.15.170:0/3676207204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb114102b90 0x7fb1140745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:31.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.862+0000 7fb1137fe640 1 -- 172.21.15.170:0/3676207204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb114102b90 msgr2=0x7fb1140745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:31.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.862+0000 7fb1137fe640 1 --2- 172.21.15.170:0/3676207204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb114102b90 0x7fb1140745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:31.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.862+0000 7fb1137fe640 1 -- 172.21.15.170:0/3676207204 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb114074b20 con 0x7fb114101990 2024-09-04T16:26:31.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.862+0000 7fb1137fe640 1 --2- 172.21.15.170:0/3676207204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb114101990 0x7fb114075f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb104006010 tx=0x7fb1040045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:31.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.862+0000 7fb110ff9640 1 -- 172.21.15.170:0/3676207204 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb10403f070 con 0x7fb114101990 2024-09-04T16:26:31.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.862+0000 7fb110ff9640 1 -- 172.21.15.170:0/3676207204 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb1040049d0 con 0x7fb114101990 2024-09-04T16:26:31.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.862+0000 7fb119cbc640 1 -- 172.21.15.170:0/3676207204 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb114074db0 con 0x7fb114101990 2024-09-04T16:26:31.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.862+0000 7fb110ff9640 1 -- 172.21.15.170:0/3676207204 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb104035030 con 0x7fb114101990 2024-09-04T16:26:31.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.862+0000 7fb119cbc640 1 -- 172.21.15.170:0/3676207204 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1140752e0 con 0x7fb114101990 2024-09-04T16:26:31.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.863+0000 7fb119cbc640 1 -- 172.21.15.170:0/3676207204 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb114101d90 con 0x7fb114101990 2024-09-04T16:26:31.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.864+0000 7fb110ff9640 1 -- 172.21.15.170:0/3676207204 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7fb104042070 con 0x7fb114101990 2024-09-04T16:26:31.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.864+0000 7fb110ff9640 1 --2- 172.21.15.170:0/3676207204 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb0fc06de30 0x7fb0fc0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:31.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.864+0000 7fb110ff9640 1 -- 172.21.15.170:0/3676207204 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4321+0+0 (secure 0 0 0) 0x7fb1040ae1c0 con 0x7fb114101990 2024-09-04T16:26:31.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.864+0000 7fb112ffd640 1 --2- 172.21.15.170:0/3676207204 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb0fc06de30 0x7fb0fc0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:31.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.864+0000 7fb112ffd640 1 --2- 172.21.15.170:0/3676207204 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb0fc06de30 0x7fb0fc0702f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb114075ca0 tx=0x7fb108005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:31.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:31.869+0000 7fb110ff9640 1 -- 172.21.15.170:0/3676207204 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb10407fe80 con 0x7fb114101990 2024-09-04T16:26:32.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:32.038+0000 7fb119cbc640 1 -- 172.21.15.170:0/3676207204 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb114062df0 con 0x7fb114101990 2024-09-04T16:26:32.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:32.039+0000 7fb110ff9640 1 -- 172.21.15.170:0/3676207204 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v35) ==== 74+0+130 (secure 0 0 0) 0x7fb1040846b0 con 0x7fb114101990 2024-09-04T16:26:32.040 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:26:32.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:32.041+0000 7fb119cbc640 1 -- 172.21.15.170:0/3676207204 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb0fc06de30 msgr2=0x7fb0fc0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:32.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:32.041+0000 7fb119cbc640 1 --2- 172.21.15.170:0/3676207204 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb0fc06de30 0x7fb0fc0702f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb114075ca0 tx=0x7fb108005f90 comp rx=0 tx=0).stop 2024-09-04T16:26:32.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:32.041+0000 7fb119cbc640 1 -- 172.21.15.170:0/3676207204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb114101990 msgr2=0x7fb114075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:32.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:32.041+0000 7fb119cbc640 1 --2- 172.21.15.170:0/3676207204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb114101990 0x7fb114075f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb104006010 tx=0x7fb1040045e0 comp rx=0 tx=0).stop 2024-09-04T16:26:32.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:32.041+0000 7fb119cbc640 1 -- 172.21.15.170:0/3676207204 shutdown_connections 2024-09-04T16:26:32.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:32.041+0000 7fb119cbc640 1 --2- 172.21.15.170:0/3676207204 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fb0fc06de30 0x7fb0fc0702f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:32.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:32.041+0000 7fb119cbc640 1 --2- 172.21.15.170:0/3676207204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb114102b90 0x7fb1140745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:32.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:32.041+0000 7fb119cbc640 1 --2- 172.21.15.170:0/3676207204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb114101990 0x7fb114075f20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:32.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:32.041+0000 7fb119cbc640 1 -- 172.21.15.170:0/3676207204 >> 172.21.15.170:0/3676207204 conn(0x7fb1140fd140 msgr2=0x7fb1141060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:32.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:32.041+0000 7fb119cbc640 1 -- 172.21.15.170:0/3676207204 shutdown_connections 2024-09-04T16:26:32.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:32.041+0000 7fb119cbc640 1 -- 172.21.15.170:0/3676207204 wait complete. 2024-09-04T16:26:32.586 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:32 smithi193 ceph-mon[36288]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:32.586 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:32 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3676207204' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-04T16:26:32.769 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:32 smithi170 ceph-mon[29272]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:32.769 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:32 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3676207204' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-04T16:26:32.797 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":35,"num_osds":6,"num_up_osds":5,"osd_up_since":1725467169,"num_in_osds":6,"osd_in_since":1725467172,"num_remapped_pgs":0} 2024-09-04T16:26:33.407 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:26:32 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[55171]: 2024-09-04T16:26:32.982+0000 7f790cc64640 -1 osd.5 0 log_to_monitors true 2024-09-04T16:26:33.798 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph osd stat -f json 2024-09-04T16:26:33.827 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:33 smithi170 ceph-mon[29272]: from='osd.5 [v2:172.21.15.193:6816/858863790,v1:172.21.15.193:6817/858863790]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-04T16:26:33.827 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:33 smithi170 ceph-mon[29272]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-04T16:26:33.838 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:33 smithi193 ceph-mon[36288]: from='osd.5 [v2:172.21.15.193:6816/858863790,v1:172.21.15.193:6817/858863790]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-04T16:26:33.838 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:33 smithi193 ceph-mon[36288]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-04T16:26:34.059 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:34.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.562+0000 7f9e58983640 1 -- 172.21.15.170:0/3057997293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e54100880 msgr2=0x7f9e54100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:34.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.562+0000 7f9e58983640 1 --2- 172.21.15.170:0/3057997293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e54100880 0x7f9e54100c80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009880 tx=0x7f9e4402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:26:34.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.562+0000 7f9e58983640 1 -- 172.21.15.170:0/3057997293 shutdown_connections 2024-09-04T16:26:34.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.562+0000 7f9e58983640 1 --2- 172.21.15.170:0/3057997293 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e54101a80 0x7f9e54101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:34.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.562+0000 7f9e58983640 1 --2- 172.21.15.170:0/3057997293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e54100880 0x7f9e54100c80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:34.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.562+0000 7f9e58983640 1 -- 172.21.15.170:0/3057997293 >> 172.21.15.170:0/3057997293 conn(0x7f9e540fc010 msgr2=0x7f9e540fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:34.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.562+0000 7f9e58983640 1 -- 172.21.15.170:0/3057997293 shutdown_connections 2024-09-04T16:26:34.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.562+0000 7f9e58983640 1 -- 172.21.15.170:0/3057997293 wait complete. 2024-09-04T16:26:34.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.563+0000 7f9e58983640 1 Processor -- start 2024-09-04T16:26:34.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.563+0000 7f9e58983640 1 -- start start 2024-09-04T16:26:34.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.563+0000 7f9e58983640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e54100880 0x7f9e5406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:34.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.563+0000 7f9e58983640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e54101a80 0x7f9e5419c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:34.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.563+0000 7f9e58983640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9e541096a0 con 0x7f9e54100880 2024-09-04T16:26:34.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.563+0000 7f9e58983640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9e54109520 con 0x7f9e54101a80 2024-09-04T16:26:34.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.563+0000 7f9e5259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e54100880 0x7f9e5406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:34.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.563+0000 7f9e5259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e54100880 0x7f9e5406adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:40274/0 (socket says 172.21.15.170:40274) 2024-09-04T16:26:34.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.563+0000 7f9e5259c640 1 -- 172.21.15.170:0/628678438 learned_addr learned my addr 172.21.15.170:0/628678438 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:34.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.563+0000 7f9e51d9b640 1 --2- 172.21.15.170:0/628678438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e54101a80 0x7f9e5419c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:34.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.564+0000 7f9e5259c640 1 -- 172.21.15.170:0/628678438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e54101a80 msgr2=0x7f9e5419c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:34.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.564+0000 7f9e5259c640 1 --2- 172.21.15.170:0/628678438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e54101a80 0x7f9e5419c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:34.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.564+0000 7f9e5259c640 1 -- 172.21.15.170:0/628678438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5419c7b0 con 0x7f9e54100880 2024-09-04T16:26:34.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.564+0000 7f9e5259c640 1 --2- 172.21.15.170:0/628678438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e54100880 0x7f9e5406adf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9e44006010 tx=0x7f9e440045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:34.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.564+0000 7f9e437fe640 1 -- 172.21.15.170:0/628678438 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e4403f070 con 0x7f9e54100880 2024-09-04T16:26:34.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.564+0000 7f9e437fe640 1 -- 172.21.15.170:0/628678438 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e440049d0 con 0x7f9e54100880 2024-09-04T16:26:34.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.564+0000 7f9e58983640 1 -- 172.21.15.170:0/628678438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e5419ca40 con 0x7f9e54100880 2024-09-04T16:26:34.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.564+0000 7f9e437fe640 1 -- 172.21.15.170:0/628678438 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e44035030 con 0x7f9e54100880 2024-09-04T16:26:34.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.564+0000 7f9e58983640 1 -- 172.21.15.170:0/628678438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e5419cf70 con 0x7f9e54100880 2024-09-04T16:26:34.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.565+0000 7f9e58983640 1 -- 172.21.15.170:0/628678438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e54100c80 con 0x7f9e54100880 2024-09-04T16:26:34.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.566+0000 7f9e437fe640 1 -- 172.21.15.170:0/628678438 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f9e44042070 con 0x7f9e54100880 2024-09-04T16:26:34.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.566+0000 7f9e437fe640 1 --2- 172.21.15.170:0/628678438 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f9e3c06de90 0x7f9e3c070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:34.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.566+0000 7f9e51d9b640 1 --2- 172.21.15.170:0/628678438 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f9e3c06de90 0x7f9e3c070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:34.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.566+0000 7f9e437fe640 1 -- 172.21.15.170:0/628678438 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4358+0+0 (secure 0 0 0) 0x7f9e440ae1a0 con 0x7f9e54100880 2024-09-04T16:26:34.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.567+0000 7f9e51d9b640 1 --2- 172.21.15.170:0/628678438 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f9e3c06de90 0x7f9e3c070350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9e5406ab70 tx=0x7f9e48005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:34.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.571+0000 7f9e437fe640 1 -- 172.21.15.170:0/628678438 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9e4407fe30 con 0x7f9e54100880 2024-09-04T16:26:34.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:34.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-04T16:26:34.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: osdmap e36: 6 total, 5 up, 6 in 2024-09-04T16:26:34.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-04T16:26:34.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='osd.5 [v2:172.21.15.193:6816/858863790,v1:172.21.15.193:6817/858863790]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-04T16:26:34.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-04T16:26:34.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:34.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:34.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:26:34.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:26:34.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:26:34.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:34.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:26:34.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:26:34.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:34.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:26:34.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:26:34.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:26:34.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:34.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.735+0000 7f9e58983640 1 -- 172.21.15.170:0/628678438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f9e5419d420 con 0x7f9e54100880 2024-09-04T16:26:34.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:34.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-04T16:26:34.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: osdmap e36: 6 total, 5 up, 6 in 2024-09-04T16:26:34.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-04T16:26:34.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='osd.5 [v2:172.21.15.193:6816/858863790,v1:172.21.15.193:6817/858863790]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-04T16:26:34.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-09-04T16:26:34.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:34.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:34.737 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:26:34.737 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:26:34.737 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:26:34.737 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:34.737 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:26:34.737 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:26:34.737 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:34.737 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:26:34.737 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:26:34.737 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:26:34.737 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:26:34.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.735+0000 7f9e437fe640 1 -- 172.21.15.170:0/628678438 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) ==== 74+0+130 (secure 0 0 0) 0x7f9e44084660 con 0x7f9e54100880 2024-09-04T16:26:34.738 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:26:34.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.737+0000 7f9e58983640 1 -- 172.21.15.170:0/628678438 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f9e3c06de90 msgr2=0x7f9e3c070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.737+0000 7f9e58983640 1 --2- 172.21.15.170:0/628678438 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f9e3c06de90 0x7f9e3c070350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9e5406ab70 tx=0x7f9e48005f90 comp rx=0 tx=0).stop 2024-09-04T16:26:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.737+0000 7f9e58983640 1 -- 172.21.15.170:0/628678438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e54100880 msgr2=0x7f9e5406adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.737+0000 7f9e58983640 1 --2- 172.21.15.170:0/628678438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e54100880 0x7f9e5406adf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9e44006010 tx=0x7f9e440045e0 comp rx=0 tx=0).stop 2024-09-04T16:26:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.738+0000 7f9e58983640 1 -- 172.21.15.170:0/628678438 shutdown_connections 2024-09-04T16:26:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.738+0000 7f9e58983640 1 --2- 172.21.15.170:0/628678438 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f9e3c06de90 0x7f9e3c070350 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.738+0000 7f9e58983640 1 --2- 172.21.15.170:0/628678438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e54101a80 0x7f9e5419c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.738+0000 7f9e58983640 1 --2- 172.21.15.170:0/628678438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e54100880 0x7f9e5406adf0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.738+0000 7f9e58983640 1 -- 172.21.15.170:0/628678438 >> 172.21.15.170:0/628678438 conn(0x7f9e540fc010 msgr2=0x7f9e540fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.738+0000 7f9e58983640 1 -- 172.21.15.170:0/628678438 shutdown_connections 2024-09-04T16:26:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:34.738+0000 7f9e58983640 1 -- 172.21.15.170:0/628678438 wait complete. 2024-09-04T16:26:35.513 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":37,"num_osds":6,"num_up_osds":5,"osd_up_since":1725467169,"num_in_osds":6,"osd_in_since":1725467172,"num_remapped_pgs":0} 2024-09-04T16:26:35.656 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:26:35 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[55171]: 2024-09-04T16:26:35.263+0000 7f79083c4640 -1 osd.5 0 waiting for initial osdmap 2024-09-04T16:26:35.656 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:26:35 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[55171]: 2024-09-04T16:26:35.274+0000 7f79009f6640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-04T16:26:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:35 smithi193 ceph-mon[36288]: Detected new or changed devices on smithi193 2024-09-04T16:26:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:35 smithi193 ceph-mon[36288]: Adjusting osd_memory_target on smithi193 to 4970M 2024-09-04T16:26:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:35 smithi193 ceph-mon[36288]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-04T16:26:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:35 smithi193 ceph-mon[36288]: osdmap e37: 6 total, 5 up, 6 in 2024-09-04T16:26:35.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:35 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-04T16:26:35.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:35 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-04T16:26:35.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:35 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/628678438' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-04T16:26:35.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:35 smithi193 ceph-mon[36288]: from='osd.5 ' entity='osd.5' 2024-09-04T16:26:35.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:35 smithi170 ceph-mon[29272]: Detected new or changed devices on smithi193 2024-09-04T16:26:35.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:35 smithi170 ceph-mon[29272]: Adjusting osd_memory_target on smithi193 to 4970M 2024-09-04T16:26:35.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:35 smithi170 ceph-mon[29272]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-09-04T16:26:35.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:35 smithi170 ceph-mon[29272]: osdmap e37: 6 total, 5 up, 6 in 2024-09-04T16:26:35.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:35 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-04T16:26:35.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:35 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-04T16:26:35.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:35 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/628678438' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-04T16:26:35.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:35 smithi170 ceph-mon[29272]: from='osd.5 ' entity='osd.5' 2024-09-04T16:26:36.514 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph osd stat -f json 2024-09-04T16:26:36.774 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:36.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:36 smithi170 ceph-mon[29272]: purged_snaps scrub starts 2024-09-04T16:26:36.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:36 smithi170 ceph-mon[29272]: purged_snaps scrub ok 2024-09-04T16:26:36.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:36 smithi170 ceph-mon[29272]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:36.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:36 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-04T16:26:36.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:36 smithi170 ceph-mon[29272]: osd.5 [v2:172.21.15.193:6816/858863790,v1:172.21.15.193:6817/858863790] boot 2024-09-04T16:26:36.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:36 smithi170 ceph-mon[29272]: osdmap e38: 6 total, 6 up, 6 in 2024-09-04T16:26:36.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:36 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-04T16:26:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:36 smithi193 ceph-mon[36288]: purged_snaps scrub starts 2024-09-04T16:26:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:36 smithi193 ceph-mon[36288]: purged_snaps scrub ok 2024-09-04T16:26:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:36 smithi193 ceph-mon[36288]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-04T16:26:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:36 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-04T16:26:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:36 smithi193 ceph-mon[36288]: osd.5 [v2:172.21.15.193:6816/858863790,v1:172.21.15.193:6817/858863790] boot 2024-09-04T16:26:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:36 smithi193 ceph-mon[36288]: osdmap e38: 6 total, 6 up, 6 in 2024-09-04T16:26:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:36 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-04T16:26:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.200+0000 7f3637f2e640 1 -- 172.21.15.170:0/1541517827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3630100200 msgr2=0x7f3630102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.200+0000 7f3637f2e640 1 --2- 172.21.15.170:0/1541517827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3630100200 0x7f3630102610 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f362c009880 tx=0x7f362c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:26:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.200+0000 7f3637f2e640 1 -- 172.21.15.170:0/1541517827 shutdown_connections 2024-09-04T16:26:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.200+0000 7f3637f2e640 1 --2- 172.21.15.170:0/1541517827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3630102b50 0x7f3630104fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.200+0000 7f3637f2e640 1 --2- 172.21.15.170:0/1541517827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3630100200 0x7f3630102610 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.200+0000 7f3637f2e640 1 -- 172.21.15.170:0/1541517827 >> 172.21.15.170:0/1541517827 conn(0x7f36300fc010 msgr2=0x7f36300fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.200+0000 7f3637f2e640 1 -- 172.21.15.170:0/1541517827 shutdown_connections 2024-09-04T16:26:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.200+0000 7f3637f2e640 1 -- 172.21.15.170:0/1541517827 wait complete. 2024-09-04T16:26:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.201+0000 7f3637f2e640 1 Processor -- start 2024-09-04T16:26:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.201+0000 7f3637f2e640 1 -- start start 2024-09-04T16:26:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.201+0000 7f3637f2e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3630100200 0x7f363019da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.201+0000 7f3637f2e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3630102b50 0x7f363019df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.201+0000 7f3637f2e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3630110d90 con 0x7f3630100200 2024-09-04T16:26:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.201+0000 7f3637f2e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3630110c10 con 0x7f3630102b50 2024-09-04T16:26:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.201+0000 7f3635cca640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3630100200 0x7f363019da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.201+0000 7f3635cca640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3630100200 0x7f363019da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43084/0 (socket says 172.21.15.170:43084) 2024-09-04T16:26:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.201+0000 7f3635cca640 1 -- 172.21.15.170:0/3782251242 learned_addr learned my addr 172.21.15.170:0/3782251242 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.201+0000 7f36354c9640 1 --2- 172.21.15.170:0/3782251242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3630102b50 0x7f363019df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.202+0000 7f3635cca640 1 -- 172.21.15.170:0/3782251242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3630102b50 msgr2=0x7f363019df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.202+0000 7f3635cca640 1 --2- 172.21.15.170:0/3782251242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3630102b50 0x7f363019df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.202+0000 7f3635cca640 1 -- 172.21.15.170:0/3782251242 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363019e560 con 0x7f3630100200 2024-09-04T16:26:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.202+0000 7f3635cca640 1 --2- 172.21.15.170:0/3782251242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3630100200 0x7f363019da30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f362c006010 tx=0x7f362c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.202+0000 7f3626ffd640 1 -- 172.21.15.170:0/3782251242 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f362c03f070 con 0x7f3630100200 2024-09-04T16:26:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.202+0000 7f3637f2e640 1 -- 172.21.15.170:0/3782251242 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36301a2f70 con 0x7f3630100200 2024-09-04T16:26:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.202+0000 7f3626ffd640 1 -- 172.21.15.170:0/3782251242 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f362c0044d0 con 0x7f3630100200 2024-09-04T16:26:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.202+0000 7f3626ffd640 1 -- 172.21.15.170:0/3782251242 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f362c035030 con 0x7f3630100200 2024-09-04T16:26:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.202+0000 7f3637f2e640 1 -- 172.21.15.170:0/3782251242 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36301a3420 con 0x7f3630100200 2024-09-04T16:26:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.203+0000 7f3637f2e640 1 -- 172.21.15.170:0/3782251242 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3630100600 con 0x7f3630100200 2024-09-04T16:26:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.204+0000 7f3626ffd640 1 -- 172.21.15.170:0/3782251242 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f362c042070 con 0x7f3630100200 2024-09-04T16:26:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.204+0000 7f3626ffd640 1 --2- 172.21.15.170:0/3782251242 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f361c06de30 0x7f361c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.204+0000 7f3626ffd640 1 -- 172.21.15.170:0/3782251242 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f362c0ae4e0 con 0x7f3630100200 2024-09-04T16:26:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.204+0000 7f36354c9640 1 --2- 172.21.15.170:0/3782251242 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f361c06de30 0x7f361c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.204+0000 7f36354c9640 1 --2- 172.21.15.170:0/3782251242 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f361c06de30 0x7f361c0702f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f363019eee0 tx=0x7f362000a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.208+0000 7f3626ffd640 1 -- 172.21.15.170:0/3782251242 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f362c07c3c0 con 0x7f3630100200 2024-09-04T16:26:37.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.373+0000 7f3637f2e640 1 -- 172.21.15.170:0/3782251242 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f36301a3d50 con 0x7f3630100200 2024-09-04T16:26:37.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.374+0000 7f3626ffd640 1 -- 172.21.15.170:0/3782251242 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) ==== 74+0+130 (secure 0 0 0) 0x7f362c0ae300 con 0x7f3630100200 2024-09-04T16:26:37.375 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:26:37.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.376+0000 7f3637f2e640 1 -- 172.21.15.170:0/3782251242 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f361c06de30 msgr2=0x7f361c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:37.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.376+0000 7f3637f2e640 1 --2- 172.21.15.170:0/3782251242 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f361c06de30 0x7f361c0702f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f363019eee0 tx=0x7f362000a2d0 comp rx=0 tx=0).stop 2024-09-04T16:26:37.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.376+0000 7f3637f2e640 1 -- 172.21.15.170:0/3782251242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3630100200 msgr2=0x7f363019da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:37.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.376+0000 7f3637f2e640 1 --2- 172.21.15.170:0/3782251242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3630100200 0x7f363019da30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f362c006010 tx=0x7f362c0048f0 comp rx=0 tx=0).stop 2024-09-04T16:26:37.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.376+0000 7f3637f2e640 1 -- 172.21.15.170:0/3782251242 shutdown_connections 2024-09-04T16:26:37.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.376+0000 7f3637f2e640 1 --2- 172.21.15.170:0/3782251242 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f361c06de30 0x7f361c0702f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:37.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.376+0000 7f3637f2e640 1 --2- 172.21.15.170:0/3782251242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3630102b50 0x7f363019df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:37.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.376+0000 7f3637f2e640 1 --2- 172.21.15.170:0/3782251242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3630100200 0x7f363019da30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:37.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.376+0000 7f3637f2e640 1 -- 172.21.15.170:0/3782251242 >> 172.21.15.170:0/3782251242 conn(0x7f36300fc010 msgr2=0x7f36300fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:37.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.376+0000 7f3637f2e640 1 -- 172.21.15.170:0/3782251242 shutdown_connections 2024-09-04T16:26:37.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:37.376+0000 7f3637f2e640 1 -- 172.21.15.170:0/3782251242 wait complete. 2024-09-04T16:26:37.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:37 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3782251242' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-04T16:26:37.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:37 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3782251242' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-04T16:26:38.172 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1725467196,"num_in_osds":6,"osd_in_since":1725467172,"num_remapped_pgs":0} 2024-09-04T16:26:38.173 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-04T16:26:38.420 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:38.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:38 smithi170 ceph-mon[29272]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:38.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:38 smithi170 ceph-mon[29272]: osdmap e39: 6 total, 6 up, 6 in 2024-09-04T16:26:38.838 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:38 smithi193 ceph-mon[36288]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:38.839 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:38 smithi193 ceph-mon[36288]: osdmap e39: 6 total, 6 up, 6 in 2024-09-04T16:26:38.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.840+0000 7f8e0a1df640 1 -- 172.21.15.170:0/2252037047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e04103400 msgr2=0x7f8e0410b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:38.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.840+0000 7f8e0a1df640 1 --2- 172.21.15.170:0/2252037047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e04103400 0x7f8e0410b8f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009880 tx=0x7f8df802a530 comp rx=0 tx=0).stop 2024-09-04T16:26:38.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.840+0000 7f8e0a1df640 1 -- 172.21.15.170:0/2252037047 shutdown_connections 2024-09-04T16:26:38.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.840+0000 7f8e0a1df640 1 --2- 172.21.15.170:0/2252037047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e04103400 0x7f8e0410b8f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:38.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.840+0000 7f8e0a1df640 1 --2- 172.21.15.170:0/2252037047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e04102ae0 0x7f8e04102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:38.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.840+0000 7f8e0a1df640 1 -- 172.21.15.170:0/2252037047 >> 172.21.15.170:0/2252037047 conn(0x7f8e040fc520 msgr2=0x7f8e040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:38.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.840+0000 7f8e0a1df640 1 -- 172.21.15.170:0/2252037047 shutdown_connections 2024-09-04T16:26:38.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.840+0000 7f8e0a1df640 1 -- 172.21.15.170:0/2252037047 wait complete. 2024-09-04T16:26:38.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.841+0000 7f8e0a1df640 1 Processor -- start 2024-09-04T16:26:38.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.841+0000 7f8e0a1df640 1 -- start start 2024-09-04T16:26:38.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.841+0000 7f8e0a1df640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e04102ae0 0x7f8e0419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:38.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.841+0000 7f8e0a1df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e04103400 0x7f8e0419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:38.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.841+0000 7f8e0a1df640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0410ee70 con 0x7f8e04102ae0 2024-09-04T16:26:38.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.841+0000 7f8e0a1df640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0410ecf0 con 0x7f8e04103400 2024-09-04T16:26:38.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.842+0000 7f8e037fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e04102ae0 0x7f8e0419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:38.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.842+0000 7f8e037fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e04102ae0 0x7f8e0419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43106/0 (socket says 172.21.15.170:43106) 2024-09-04T16:26:38.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.842+0000 7f8e037fe640 1 -- 172.21.15.170:0/4257119067 learned_addr learned my addr 172.21.15.170:0/4257119067 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:38.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.842+0000 7f8e02ffd640 1 --2- 172.21.15.170:0/4257119067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e04103400 0x7f8e0419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:38.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.842+0000 7f8e037fe640 1 -- 172.21.15.170:0/4257119067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e04103400 msgr2=0x7f8e0419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:38.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.842+0000 7f8e037fe640 1 --2- 172.21.15.170:0/4257119067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e04103400 0x7f8e0419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:38.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.842+0000 7f8e037fe640 1 -- 172.21.15.170:0/4257119067 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e04197880 con 0x7f8e04102ae0 2024-09-04T16:26:38.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.842+0000 7f8e037fe640 1 --2- 172.21.15.170:0/4257119067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e04102ae0 0x7f8e0419d6c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8df400b420 tx=0x7f8df400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:38.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.842+0000 7f8e00ff9640 1 -- 172.21.15.170:0/4257119067 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8df4011630 con 0x7f8e04102ae0 2024-09-04T16:26:38.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.842+0000 7f8e00ff9640 1 -- 172.21.15.170:0/4257119067 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8df4016070 con 0x7f8e04102ae0 2024-09-04T16:26:38.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.842+0000 7f8e0a1df640 1 -- 172.21.15.170:0/4257119067 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e04197b70 con 0x7f8e04102ae0 2024-09-04T16:26:38.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.842+0000 7f8e00ff9640 1 -- 172.21.15.170:0/4257119067 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8df4010d40 con 0x7f8e04102ae0 2024-09-04T16:26:38.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.842+0000 7f8e0a1df640 1 -- 172.21.15.170:0/4257119067 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e041980d0 con 0x7f8e04102ae0 2024-09-04T16:26:38.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.843+0000 7f8e0a1df640 1 -- 172.21.15.170:0/4257119067 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e0406abe0 con 0x7f8e04102ae0 2024-09-04T16:26:38.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.844+0000 7f8e00ff9640 1 -- 172.21.15.170:0/4257119067 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f8df401b460 con 0x7f8e04102ae0 2024-09-04T16:26:38.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.844+0000 7f8e00ff9640 1 --2- 172.21.15.170:0/4257119067 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8dec06de30 0x7f8dec0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:38.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.844+0000 7f8e02ffd640 1 --2- 172.21.15.170:0/4257119067 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8dec06de30 0x7f8dec0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:38.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.844+0000 7f8e00ff9640 1 -- 172.21.15.170:0/4257119067 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f8df408d010 con 0x7f8e04102ae0 2024-09-04T16:26:38.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.845+0000 7f8e02ffd640 1 --2- 172.21.15.170:0/4257119067 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8dec06de30 0x7f8dec0702f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8e04199070 tx=0x7f8df8031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:38.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:38.849+0000 7f8e00ff9640 1 -- 172.21.15.170:0/4257119067 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8df405aef0 con 0x7f8e04102ae0 2024-09-04T16:26:39.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:39.020+0000 7f8e0a1df640 1 -- 172.21.15.170:0/4257119067 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e04198db0 con 0x7f8e04102ae0 2024-09-04T16:26:39.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:39.021+0000 7f8e00ff9640 1 -- 172.21.15.170:0/4257119067 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11435 (secure 0 0 0) 0x7f8df405eba0 con 0x7f8e04102ae0 2024-09-04T16:26:39.022 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:26:39.022 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":39,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","created":"2024-09-04T16:20:45.301087+0000","modified":"2024-09-04T16:26:37.492790+0000","last_up_change":"2024-09-04T16:26:36.266450+0000","last_in_change":"2024-09-04T16:26:12.694342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-04T16:25:17.504686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbba256a-288b-4bce-b9c0-5cebfc7c5a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1158983556},{"type":"v1","addr":"172.21.15.170:6803","nonce":1158983556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1158983556},{"type":"v1","addr":"172.21.15.170:6805","nonce":1158983556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1158983556},{"type":"v1","addr":"172.21.15.170:6809","nonce":1158983556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1158983556},{"type":"v1","addr":"172.21.15.170:6807","nonce":1158983556}]},"public_addr":"172.21.15.170:6803/1158983556","cluster_addr":"172.21.15.170:6805/1158983556","heartbeat_back_addr":"172.21.15.170:6809/1158983556","heartbeat_front_addr":"172.21.15.170:6807/1158983556","state":["exists","up"]},{"osd":1,"uuid":"0b106135-c381-4e8e-85f1-1f85100c1949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":600576441},{"type":"v1","addr":"172.21.15.170:6811","nonce":600576441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":600576441},{"type":"v1","addr":"172.21.15.170:6813","nonce":600576441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":600576441},{"type":"v1","addr":"172.21.15.170:6817","nonce":600576441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":600576441},{"type":"v1","addr":"172.21.15.170:6815","nonce":600576441}]},"public_addr":"172.21.15.170:6811/600576441","cluster_addr":"172.21.15.170:6813/600576441","heartbeat_back_addr":"172.21.15.170:6817/600576441","heartbeat_front_addr":"172.21.15.170:6815/600576441","state":["exists","up"]},{"osd":2,"uuid":"ea5d3602-2f3f-40a4-a535-dd7f81cda237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3174568737},{"type":"v1","addr":"172.21.15.170:6819","nonce":3174568737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3174568737},{"type":"v1","addr":"172.21.15.170:6821","nonce":3174568737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3174568737},{"type":"v1","addr":"172.21.15.170:6825","nonce":3174568737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3174568737},{"type":"v1","addr":"172.21.15.170:6823","nonce":3174568737}]},"public_addr":"172.21.15.170:6819/3174568737","cluster_addr":"172.21.15.170:6821/3174568737","heartbeat_back_addr":"172.21.15.170:6825/3174568737","heartbeat_front_addr":"172.21.15.170:6823/3174568737","state":["exists","up"]},{"osd":3,"uuid":"9ea70be0-d553-4669-adde-18aa1a04d81a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":3804134072},{"type":"v1","addr":"172.21.15.193:6801","nonce":3804134072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":3804134072},{"type":"v1","addr":"172.21.15.193:6803","nonce":3804134072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":3804134072},{"type":"v1","addr":"172.21.15.193:6807","nonce":3804134072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":3804134072},{"type":"v1","addr":"172.21.15.193:6805","nonce":3804134072}]},"public_addr":"172.21.15.193:6801/3804134072","cluster_addr":"172.21.15.193:6803/3804134072","heartbeat_back_addr":"172.21.15.193:6807/3804134072","heartbeat_front_addr":"172.21.15.193:6805/3804134072","state":["exists","up"]},{"osd":4,"uuid":"5cc6d07b-d898-4f15-ac87-d29cd36ef898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":2691165010},{"type":"v1","addr":"172.21.15.193:6809","nonce":2691165010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":2691165010},{"type":"v1","addr":"172.21.15.193:6811","nonce":2691165010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":2691165010},{"type":"v1","addr":"172.21.15.193:6815","nonce":2691165010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2691165010},{"type":"v1","addr":"172.21.15.193:6813","nonce":2691165010}]},"public_addr":"172.21.15.193:6809/2691165010","cluster_addr":"172.21.15.193:6811/2691165010","heartbeat_back_addr":"172.21.15.193:6815/2691165010","heartbeat_front_addr":"172.21.15.193:6813/2691165010","state":["exists","up"]},{"osd":5,"uuid":"edc27f67-a882-4b09-90a8-17b0060cb8ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":858863790},{"type":"v1","addr":"172.21.15.193:6817","nonce":858863790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":858863790},{"type":"v1","addr":"172.21.15.193:6819","nonce":858863790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":858863790},{"type":"v1","addr":"172.21.15.193:6823","nonce":858863790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":858863790},{"type":"v1","addr":"172.21.15.193:6821","nonce":858863790}]},"public_addr":"172.21.15.193:6817/858863790","cluster_addr":"172.21.15.193:6819/858863790","heartbeat_back_addr":"172.21.15.193:6823/858863790","heartbeat_front_addr":"172.21.15.193:6821/858863790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:24:21.559987+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:24:48.437620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:25:16.000777+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:25:41.007303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:26:07.467201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:26:33.962617+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:6801/4082719191":"2024-09-05T16:22:43.188580+0000","172.21.15.170:6800/4082719191":"2024-09-05T16:22:43.188580+0000","172.21.15.170:6801/1344937001":"2024-09-05T16:21:12.676489+0000","172.21.15.170:0/2398984574":"2024-09-05T16:21:12.676489+0000","172.21.15.170:6801/1933182229":"2024-09-05T16:21:43.532674+0000","172.21.15.170:0/4140626365":"2024-09-05T16:21:12.676489+0000","172.21.15.170:6800/1933182229":"2024-09-05T16:21:43.532674+0000","172.21.15.170:0/3147587826":"2024-09-05T16:21:12.676489+0000","172.21.15.170:0/805677094":"2024-09-05T16:21:43.532674+0000","172.21.15.170:0/1110147744":"2024-09-05T16:21:43.532674+0000","172.21.15.170:0/3196924100":"2024-09-05T16:22:43.188580+0000","172.21.15.170:0/2639013592":"2024-09-05T16:21:43.532674+0000","172.21.15.170:0/2879400972":"2024-09-05T16:22:43.188580+0000","172.21.15.170:6800/1344937001":"2024-09-05T16:21:12.676489+0000","172.21.15.170:0/3495410490":"2024-09-05T16:22:43.188580+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-04T16:26:39.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:39.023+0000 7f8e0a1df640 1 -- 172.21.15.170:0/4257119067 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8dec06de30 msgr2=0x7f8dec0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:39.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:39.023+0000 7f8e0a1df640 1 --2- 172.21.15.170:0/4257119067 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8dec06de30 0x7f8dec0702f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8e04199070 tx=0x7f8df8031400 comp rx=0 tx=0).stop 2024-09-04T16:26:39.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:39.023+0000 7f8e0a1df640 1 -- 172.21.15.170:0/4257119067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e04102ae0 msgr2=0x7f8e0419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:39.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:39.023+0000 7f8e0a1df640 1 --2- 172.21.15.170:0/4257119067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e04102ae0 0x7f8e0419d6c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8df400b420 tx=0x7f8df400b8e0 comp rx=0 tx=0).stop 2024-09-04T16:26:39.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:39.023+0000 7f8e0a1df640 1 -- 172.21.15.170:0/4257119067 shutdown_connections 2024-09-04T16:26:39.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:39.023+0000 7f8e0a1df640 1 --2- 172.21.15.170:0/4257119067 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8dec06de30 0x7f8dec0702f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:39.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:39.023+0000 7f8e0a1df640 1 --2- 172.21.15.170:0/4257119067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e04103400 0x7f8e0419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:39.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:39.023+0000 7f8e0a1df640 1 --2- 172.21.15.170:0/4257119067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e04102ae0 0x7f8e0419d6c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:39.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:39.023+0000 7f8e0a1df640 1 -- 172.21.15.170:0/4257119067 >> 172.21.15.170:0/4257119067 conn(0x7f8e040fc520 msgr2=0x7f8e04108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:39.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:39.023+0000 7f8e0a1df640 1 -- 172.21.15.170:0/4257119067 shutdown_connections 2024-09-04T16:26:39.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:39.024+0000 7f8e0a1df640 1 -- 172.21.15.170:0/4257119067 wait complete. 2024-09-04T16:26:39.683 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:39 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/4257119067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-04T16:26:39.683 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:39 smithi170 ceph-mon[29272]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:39.713 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-04T16:25:17.504686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-04T16:26:39.713 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-04T16:26:39.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:39 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/4257119067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-04T16:26:39.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:39 smithi193 ceph-mon[36288]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:39.958 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:40.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.460+0000 7f417cdb2640 1 -- 172.21.15.170:0/379991173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4178100820 msgr2=0x7f4178100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:40.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.460+0000 7f417cdb2640 1 --2- 172.21.15.170:0/379991173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4178100820 0x7f4178100c80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f416c009880 tx=0x7f416c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:26:40.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.460+0000 7f417cdb2640 1 -- 172.21.15.170:0/379991173 shutdown_connections 2024-09-04T16:26:40.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.460+0000 7f417cdb2640 1 --2- 172.21.15.170:0/379991173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4178100820 0x7f4178100c80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:40.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.460+0000 7f417cdb2640 1 --2- 172.21.15.170:0/379991173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4178106820 0x7f4178106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:40.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.460+0000 7f417cdb2640 1 -- 172.21.15.170:0/379991173 >> 172.21.15.170:0/379991173 conn(0x7f41780fc520 msgr2=0x7f41780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:40.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.460+0000 7f417cdb2640 1 -- 172.21.15.170:0/379991173 shutdown_connections 2024-09-04T16:26:40.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.460+0000 7f417cdb2640 1 -- 172.21.15.170:0/379991173 wait complete. 2024-09-04T16:26:40.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.461+0000 7f417cdb2640 1 Processor -- start 2024-09-04T16:26:40.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.461+0000 7f417cdb2640 1 -- start start 2024-09-04T16:26:40.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.461+0000 7f417cdb2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4178100820 0x7f4178198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:40.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.461+0000 7f417cdb2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4178106820 0x7f4178198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:40.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.461+0000 7f417cdb2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f417810dd50 con 0x7f4178106820 2024-09-04T16:26:40.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.461+0000 7f417cdb2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f417810dbd0 con 0x7f4178100820 2024-09-04T16:26:40.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.461+0000 7f4175d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4178106820 0x7f4178198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:40.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.461+0000 7f4175d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4178106820 0x7f4178198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43134/0 (socket says 172.21.15.170:43134) 2024-09-04T16:26:40.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.461+0000 7f4175d9b640 1 -- 172.21.15.170:0/4140148770 learned_addr learned my addr 172.21.15.170:0/4140148770 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:40.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.461+0000 7f417659c640 1 --2- 172.21.15.170:0/4140148770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4178100820 0x7f4178198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:40.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.462+0000 7f4175d9b640 1 -- 172.21.15.170:0/4140148770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4178100820 msgr2=0x7f4178198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:40.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.462+0000 7f4175d9b640 1 --2- 172.21.15.170:0/4140148770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4178100820 0x7f4178198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:40.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.462+0000 7f4175d9b640 1 -- 172.21.15.170:0/4140148770 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41781993b0 con 0x7f4178106820 2024-09-04T16:26:40.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.462+0000 7f4175d9b640 1 --2- 172.21.15.170:0/4140148770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4178106820 0x7f4178198db0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f416c031460 tx=0x7f416c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:40.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.462+0000 7f41677fe640 1 -- 172.21.15.170:0/4140148770 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f416c03f070 con 0x7f4178106820 2024-09-04T16:26:40.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.462+0000 7f417cdb2640 1 -- 172.21.15.170:0/4140148770 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4178199640 con 0x7f4178106820 2024-09-04T16:26:40.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.462+0000 7f41677fe640 1 -- 172.21.15.170:0/4140148770 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f416c004cf0 con 0x7f4178106820 2024-09-04T16:26:40.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.462+0000 7f41677fe640 1 -- 172.21.15.170:0/4140148770 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f416c035030 con 0x7f4178106820 2024-09-04T16:26:40.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.462+0000 7f417cdb2640 1 -- 172.21.15.170:0/4140148770 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41781a1bf0 con 0x7f4178106820 2024-09-04T16:26:40.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.463+0000 7f417cdb2640 1 -- 172.21.15.170:0/4140148770 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4178101f60 con 0x7f4178106820 2024-09-04T16:26:40.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.464+0000 7f41677fe640 1 -- 172.21.15.170:0/4140148770 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f416c042070 con 0x7f4178106820 2024-09-04T16:26:40.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.464+0000 7f41677fe640 1 --2- 172.21.15.170:0/4140148770 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f416006de30 0x7f41600702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:40.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.464+0000 7f41677fe640 1 -- 172.21.15.170:0/4140148770 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f416c0ae2c0 con 0x7f4178106820 2024-09-04T16:26:40.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.464+0000 7f417659c640 1 --2- 172.21.15.170:0/4140148770 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f416006de30 0x7f41600702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:40.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.464+0000 7f417659c640 1 --2- 172.21.15.170:0/4140148770 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f416006de30 0x7f41600702f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4168009990 tx=0x7f4168009110 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:40.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.469+0000 7f41677fe640 1 -- 172.21.15.170:0/4140148770 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f416c07c1a0 con 0x7f4178106820 2024-09-04T16:26:40.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.634+0000 7f417cdb2640 1 -- 172.21.15.170:0/4140148770 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4178108db0 con 0x7f4178106820 2024-09-04T16:26:40.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.634+0000 7f41677fe640 1 -- 172.21.15.170:0/4140148770 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7f416c0ae0e0 con 0x7f4178106820 2024-09-04T16:26:40.635 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 1 2024-09-04T16:26:40.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.636+0000 7f417cdb2640 1 -- 172.21.15.170:0/4140148770 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f416006de30 msgr2=0x7f41600702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:40.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.636+0000 7f417cdb2640 1 --2- 172.21.15.170:0/4140148770 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f416006de30 0x7f41600702f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4168009990 tx=0x7f4168009110 comp rx=0 tx=0).stop 2024-09-04T16:26:40.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.636+0000 7f417cdb2640 1 -- 172.21.15.170:0/4140148770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4178106820 msgr2=0x7f4178198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:40.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.636+0000 7f417cdb2640 1 --2- 172.21.15.170:0/4140148770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4178106820 0x7f4178198db0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f416c031460 tx=0x7f416c0048f0 comp rx=0 tx=0).stop 2024-09-04T16:26:40.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.636+0000 7f417cdb2640 1 -- 172.21.15.170:0/4140148770 shutdown_connections 2024-09-04T16:26:40.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.636+0000 7f417cdb2640 1 --2- 172.21.15.170:0/4140148770 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f416006de30 0x7f41600702f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:40.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.636+0000 7f417cdb2640 1 --2- 172.21.15.170:0/4140148770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4178106820 0x7f4178198db0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:40.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.636+0000 7f417cdb2640 1 --2- 172.21.15.170:0/4140148770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4178100820 0x7f4178198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:40.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.636+0000 7f417cdb2640 1 -- 172.21.15.170:0/4140148770 >> 172.21.15.170:0/4140148770 conn(0x7f41780fc520 msgr2=0x7f41780fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:40.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.636+0000 7f417cdb2640 1 -- 172.21.15.170:0/4140148770 shutdown_connections 2024-09-04T16:26:40.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:40.636+0000 7f417cdb2640 1 -- 172.21.15.170:0/4140148770 wait complete. 2024-09-04T16:26:41.086 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:40 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/4140148770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-04T16:26:41.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:40 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/4140148770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-04T16:26:41.233 INFO:tasks.cephadm:Setting up client nodes... 2024-09-04T16:26:41.234 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-04T16:26:41.478 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:41.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:41 smithi170 ceph-mon[29272]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:41.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.889+0000 7fa190380640 1 -- 172.21.15.170:0/362196217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa188100880 msgr2=0x7fa188100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:41.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.889+0000 7fa190380640 1 --2- 172.21.15.170:0/362196217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa188100880 0x7fa188100c80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa184009880 tx=0x7fa18402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:26:41.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.889+0000 7fa190380640 1 -- 172.21.15.170:0/362196217 shutdown_connections 2024-09-04T16:26:41.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.889+0000 7fa190380640 1 --2- 172.21.15.170:0/362196217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa188101a80 0x7fa188101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:41.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.889+0000 7fa190380640 1 --2- 172.21.15.170:0/362196217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa188100880 0x7fa188100c80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:41.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.889+0000 7fa190380640 1 -- 172.21.15.170:0/362196217 >> 172.21.15.170:0/362196217 conn(0x7fa1880fc010 msgr2=0x7fa1880fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:41.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.889+0000 7fa190380640 1 -- 172.21.15.170:0/362196217 shutdown_connections 2024-09-04T16:26:41.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.889+0000 7fa190380640 1 -- 172.21.15.170:0/362196217 wait complete. 2024-09-04T16:26:41.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.890+0000 7fa190380640 1 Processor -- start 2024-09-04T16:26:41.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.890+0000 7fa190380640 1 -- start start 2024-09-04T16:26:41.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.890+0000 7fa190380640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa188100880 0x7fa1881974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:41.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.890+0000 7fa190380640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa188101a80 0x7fa1881979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:41.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.890+0000 7fa190380640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa18810a7a0 con 0x7fa188101a80 2024-09-04T16:26:41.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.890+0000 7fa190380640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa18810a620 con 0x7fa188100880 2024-09-04T16:26:41.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.890+0000 7fa18d91b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa188101a80 0x7fa1881979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:41.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.890+0000 7fa18d91b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa188101a80 0x7fa1881979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43148/0 (socket says 172.21.15.170:43148) 2024-09-04T16:26:41.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.890+0000 7fa18d91b640 1 -- 172.21.15.170:0/3100234692 learned_addr learned my addr 172.21.15.170:0/3100234692 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:41.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.890+0000 7fa18e11c640 1 --2- 172.21.15.170:0/3100234692 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa188100880 0x7fa1881974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:41.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.890+0000 7fa18d91b640 1 -- 172.21.15.170:0/3100234692 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa188100880 msgr2=0x7fa1881974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:41.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.890+0000 7fa18d91b640 1 --2- 172.21.15.170:0/3100234692 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa188100880 0x7fa1881974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:41.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.890+0000 7fa18d91b640 1 -- 172.21.15.170:0/3100234692 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa188198060 con 0x7fa188101a80 2024-09-04T16:26:41.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.890+0000 7fa18d91b640 1 --2- 172.21.15.170:0/3100234692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa188101a80 0x7fa1881979e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa17800d8d0 tx=0x7fa17800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:41.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.890+0000 7fa17f7fe640 1 -- 172.21.15.170:0/3100234692 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa178017070 con 0x7fa188101a80 2024-09-04T16:26:41.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.891+0000 7fa190380640 1 -- 172.21.15.170:0/3100234692 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa18819caa0 con 0x7fa188101a80 2024-09-04T16:26:41.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.891+0000 7fa17f7fe640 1 -- 172.21.15.170:0/3100234692 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa178010460 con 0x7fa188101a80 2024-09-04T16:26:41.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.891+0000 7fa17f7fe640 1 -- 172.21.15.170:0/3100234692 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa17800f5f0 con 0x7fa188101a80 2024-09-04T16:26:41.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.891+0000 7fa190380640 1 -- 172.21.15.170:0/3100234692 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa18819d030 con 0x7fa188101a80 2024-09-04T16:26:41.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.891+0000 7fa190380640 1 -- 172.21.15.170:0/3100234692 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa188100c80 con 0x7fa188101a80 2024-09-04T16:26:41.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.892+0000 7fa17f7fe640 1 -- 172.21.15.170:0/3100234692 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7fa178009a30 con 0x7fa188101a80 2024-09-04T16:26:41.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.893+0000 7fa17f7fe640 1 --2- 172.21.15.170:0/3100234692 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa17406de30 0x7fa1740702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:41.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.893+0000 7fa17f7fe640 1 -- 172.21.15.170:0/3100234692 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fa17808d720 con 0x7fa188101a80 2024-09-04T16:26:41.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.893+0000 7fa18e11c640 1 --2- 172.21.15.170:0/3100234692 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa17406de30 0x7fa1740702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:41.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.893+0000 7fa18e11c640 1 --2- 172.21.15.170:0/3100234692 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa17406de30 0x7fa1740702f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa184000c00 tx=0x7fa184005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:41.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:41.897+0000 7fa17f7fe640 1 -- 172.21.15.170:0/3100234692 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa17805b600 con 0x7fa188101a80 2024-09-04T16:26:42.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:42.127+0000 7fa190380640 1 -- 172.21.15.170:0/3100234692 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fa188062e90 con 0x7fa188101a80 2024-09-04T16:26:42.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:42.129+0000 7fa17f7fe640 1 -- 172.21.15.170:0/3100234692 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7fa17805f2b0 con 0x7fa188101a80 2024-09-04T16:26:42.129 INFO:teuthology.orchestra.run.smithi170.stdout:[client.0] 2024-09-04T16:26:42.129 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBCithm8WiqBxAAH18DhDRvJOKgE1kVYoeZvA== 2024-09-04T16:26:42.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:42.131+0000 7fa190380640 1 -- 172.21.15.170:0/3100234692 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa17406de30 msgr2=0x7fa1740702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:42.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:42.131+0000 7fa190380640 1 --2- 172.21.15.170:0/3100234692 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa17406de30 0x7fa1740702f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa184000c00 tx=0x7fa184005a20 comp rx=0 tx=0).stop 2024-09-04T16:26:42.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:42.131+0000 7fa190380640 1 -- 172.21.15.170:0/3100234692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa188101a80 msgr2=0x7fa1881979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:42.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:42.131+0000 7fa190380640 1 --2- 172.21.15.170:0/3100234692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa188101a80 0x7fa1881979e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa17800d8d0 tx=0x7fa17800dd90 comp rx=0 tx=0).stop 2024-09-04T16:26:42.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:42.131+0000 7fa190380640 1 -- 172.21.15.170:0/3100234692 shutdown_connections 2024-09-04T16:26:42.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:42.131+0000 7fa190380640 1 --2- 172.21.15.170:0/3100234692 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa17406de30 0x7fa1740702f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:42.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:42.131+0000 7fa190380640 1 --2- 172.21.15.170:0/3100234692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa188101a80 0x7fa1881979e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:42.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:42.131+0000 7fa190380640 1 --2- 172.21.15.170:0/3100234692 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa188100880 0x7fa1881974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:42.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:42.131+0000 7fa190380640 1 -- 172.21.15.170:0/3100234692 >> 172.21.15.170:0/3100234692 conn(0x7fa1880fc010 msgr2=0x7fa188104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:42.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:42.131+0000 7fa190380640 1 -- 172.21.15.170:0/3100234692 shutdown_connections 2024-09-04T16:26:42.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:42.131+0000 7fa190380640 1 -- 172.21.15.170:0/3100234692 wait complete. 2024-09-04T16:26:42.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:41 smithi193 ceph-mon[36288]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:42.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:42 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3100234692' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-04T16:26:42.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:42 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3100234692' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-04T16:26:42.883 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:26:42.883 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-04T16:26:42.883 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-04T16:26:42.920 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-04T16:26:42.949 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:42 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3100234692' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-04T16:26:42.949 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:42 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3100234692' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-04T16:26:43.181 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi193/config 2024-09-04T16:26:43.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.633+0000 7f1e25c27640 1 -- 172.21.15.193:0/985660918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e20101980 msgr2=0x7f1e20101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:43.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.633+0000 7f1e25c27640 1 --2- 172.21.15.193:0/985660918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e20101980 0x7f1e20101d80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009880 tx=0x7f1e1002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:26:43.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.633+0000 7f1e25c27640 1 -- 172.21.15.193:0/985660918 shutdown_connections 2024-09-04T16:26:43.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.633+0000 7f1e25c27640 1 --2- 172.21.15.193:0/985660918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e20102b80 0x7f1e20103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:43.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.633+0000 7f1e25c27640 1 --2- 172.21.15.193:0/985660918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e20101980 0x7f1e20101d80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:43.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.633+0000 7f1e25c27640 1 -- 172.21.15.193:0/985660918 >> 172.21.15.193:0/985660918 conn(0x7f1e200fd110 msgr2=0x7f1e200ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:43.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.634+0000 7f1e25c27640 1 -- 172.21.15.193:0/985660918 shutdown_connections 2024-09-04T16:26:43.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.634+0000 7f1e25c27640 1 -- 172.21.15.193:0/985660918 wait complete. 2024-09-04T16:26:43.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.634+0000 7f1e25c27640 1 Processor -- start 2024-09-04T16:26:43.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.634+0000 7f1e25c27640 1 -- start start 2024-09-04T16:26:43.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.634+0000 7f1e25c27640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e20101980 0x7f1e201974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:43.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.634+0000 7f1e25c27640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e20102b80 0x7f1e20197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:43.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.634+0000 7f1e25c27640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2010a7a0 con 0x7f1e20101980 2024-09-04T16:26:43.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.634+0000 7f1e25c27640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2010a620 con 0x7f1e20102b80 2024-09-04T16:26:43.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.635+0000 7f1e16ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e20102b80 0x7f1e20197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:43.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.635+0000 7f1e16ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e20102b80 0x7f1e20197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:51312/0 (socket says 172.21.15.193:51312) 2024-09-04T16:26:43.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.635+0000 7f1e16ffd640 1 -- 172.21.15.193:0/4218493277 learned_addr learned my addr 172.21.15.193:0/4218493277 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-04T16:26:43.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.635+0000 7f1e1f7fe640 1 --2- 172.21.15.193:0/4218493277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e20101980 0x7f1e201974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:43.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.635+0000 7f1e16ffd640 1 -- 172.21.15.193:0/4218493277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e20101980 msgr2=0x7f1e201974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:43.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.635+0000 7f1e16ffd640 1 --2- 172.21.15.193:0/4218493277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e20101980 0x7f1e201974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:43.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.635+0000 7f1e16ffd640 1 -- 172.21.15.193:0/4218493277 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e201980a0 con 0x7f1e20102b80 2024-09-04T16:26:43.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.635+0000 7f1e16ffd640 1 --2- 172.21.15.193:0/4218493277 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e20102b80 0x7f1e20197a20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800d8d0 tx=0x7f1e0800dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:43.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.635+0000 7f1e1d7fa640 1 -- 172.21.15.193:0/4218493277 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e08017070 con 0x7f1e20102b80 2024-09-04T16:26:43.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.635+0000 7f1e1d7fa640 1 -- 172.21.15.193:0/4218493277 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e08010460 con 0x7f1e20102b80 2024-09-04T16:26:43.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.635+0000 7f1e25c27640 1 -- 172.21.15.193:0/4218493277 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2019cae0 con 0x7f1e20102b80 2024-09-04T16:26:43.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.635+0000 7f1e1d7fa640 1 -- 172.21.15.193:0/4218493277 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e0800f5f0 con 0x7f1e20102b80 2024-09-04T16:26:43.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.635+0000 7f1e25c27640 1 -- 172.21.15.193:0/4218493277 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e2019d070 con 0x7f1e20102b80 2024-09-04T16:26:43.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.636+0000 7f1e25c27640 1 -- 172.21.15.193:0/4218493277 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e20101d80 con 0x7f1e20102b80 2024-09-04T16:26:43.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.637+0000 7f1e1d7fa640 1 -- 172.21.15.193:0/4218493277 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f1e0800f8b0 con 0x7f1e20102b80 2024-09-04T16:26:43.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.637+0000 7f1e1d7fa640 1 --2- 172.21.15.193:0/4218493277 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1e0c06de30 0x7f1e0c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:43.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.637+0000 7f1e1d7fa640 1 -- 172.21.15.193:0/4218493277 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f1e0808d720 con 0x7f1e20102b80 2024-09-04T16:26:43.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.637+0000 7f1e1f7fe640 1 --2- 172.21.15.193:0/4218493277 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1e0c06de30 0x7f1e0c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:43.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.638+0000 7f1e1f7fe640 1 --2- 172.21.15.193:0/4218493277 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1e0c06de30 0x7f1e0c0702f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1e10000c00 tx=0x7f1e10005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:43.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.641+0000 7f1e1d7fa640 1 -- 172.21.15.193:0/4218493277 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e0805b600 con 0x7f1e20102b80 2024-09-04T16:26:43.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.870+0000 7f1e25c27640 1 -- 172.21.15.193:0/4218493277 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f1e20062e90 con 0x7f1e20102b80 2024-09-04T16:26:43.871 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:43 smithi193 ceph-mon[36288]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:43.871 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:43 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:26:43.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.877+0000 7f1e1d7fa640 1 -- 172.21.15.193:0/4218493277 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7f1e0805f2b0 con 0x7f1e20102b80 2024-09-04T16:26:43.878 INFO:teuthology.orchestra.run.smithi193.stdout:[client.1] 2024-09-04T16:26:43.878 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBDithmg/3/MxAAmADG/D5u6tJ4RY5Uz0Jyfg== 2024-09-04T16:26:43.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.879+0000 7f1e25c27640 1 -- 172.21.15.193:0/4218493277 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1e0c06de30 msgr2=0x7f1e0c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:43.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.879+0000 7f1e25c27640 1 --2- 172.21.15.193:0/4218493277 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1e0c06de30 0x7f1e0c0702f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1e10000c00 tx=0x7f1e10005a20 comp rx=0 tx=0).stop 2024-09-04T16:26:43.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.879+0000 7f1e25c27640 1 -- 172.21.15.193:0/4218493277 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e20102b80 msgr2=0x7f1e20197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:43.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.879+0000 7f1e25c27640 1 --2- 172.21.15.193:0/4218493277 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e20102b80 0x7f1e20197a20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800d8d0 tx=0x7f1e0800dd90 comp rx=0 tx=0).stop 2024-09-04T16:26:43.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.880+0000 7f1e25c27640 1 -- 172.21.15.193:0/4218493277 shutdown_connections 2024-09-04T16:26:43.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.880+0000 7f1e25c27640 1 --2- 172.21.15.193:0/4218493277 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1e0c06de30 0x7f1e0c0702f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:43.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.880+0000 7f1e25c27640 1 --2- 172.21.15.193:0/4218493277 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e20102b80 0x7f1e20197a20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:43.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.880+0000 7f1e25c27640 1 --2- 172.21.15.193:0/4218493277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e20101980 0x7f1e201974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:43.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.880+0000 7f1e25c27640 1 -- 172.21.15.193:0/4218493277 >> 172.21.15.193:0/4218493277 conn(0x7f1e200fd110 msgr2=0x7f1e20106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:43.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.880+0000 7f1e25c27640 1 -- 172.21.15.193:0/4218493277 shutdown_connections 2024-09-04T16:26:43.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:26:43.880+0000 7f1e25c27640 1 -- 172.21.15.193:0/4218493277 wait complete. 2024-09-04T16:26:44.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:43 smithi170 ceph-mon[29272]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:44.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:26:44.568 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-04T16:26:44.568 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-04T16:26:44.568 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-04T16:26:44.646 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph config log 1 --format=json 2024-09-04T16:26:44.906 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:44 smithi193 ceph-mon[36288]: from='client.? 172.21.15.193:0/4218493277' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-04T16:26:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:44 smithi193 ceph-mon[36288]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-04T16:26:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:44 smithi193 ceph-mon[36288]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-04T16:26:45.026 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:44 smithi170 ceph-mon[29272]: from='client.? 172.21.15.193:0/4218493277' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-04T16:26:45.027 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:44 smithi170 ceph-mon[29272]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-04T16:26:45.027 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:44 smithi170 ceph-mon[29272]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-04T16:26:45.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.355+0000 7f51d9b5b640 1 -- 172.21.15.170:0/4141663887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51d4103400 msgr2=0x7f51d410b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:45.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.355+0000 7f51d9b5b640 1 --2- 172.21.15.170:0/4141663887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51d4103400 0x7f51d410b8f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f51bc009880 tx=0x7f51bc02a530 comp rx=0 tx=0).stop 2024-09-04T16:26:45.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.355+0000 7f51d9b5b640 1 -- 172.21.15.170:0/4141663887 shutdown_connections 2024-09-04T16:26:45.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.355+0000 7f51d9b5b640 1 --2- 172.21.15.170:0/4141663887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51d4103400 0x7f51d410b8f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:45.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.355+0000 7f51d9b5b640 1 --2- 172.21.15.170:0/4141663887 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51d4102ae0 0x7f51d4102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:45.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.355+0000 7f51d9b5b640 1 -- 172.21.15.170:0/4141663887 >> 172.21.15.170:0/4141663887 conn(0x7f51d40fc520 msgr2=0x7f51d40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:45.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.355+0000 7f51d9b5b640 1 -- 172.21.15.170:0/4141663887 shutdown_connections 2024-09-04T16:26:45.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.355+0000 7f51d9b5b640 1 -- 172.21.15.170:0/4141663887 wait complete. 2024-09-04T16:26:45.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.356+0000 7f51d9b5b640 1 Processor -- start 2024-09-04T16:26:45.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.356+0000 7f51d9b5b640 1 -- start start 2024-09-04T16:26:45.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.356+0000 7f51d9b5b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51d4102ae0 0x7f51d419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:45.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.356+0000 7f51d9b5b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51d4103400 0x7f51d419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:45.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.356+0000 7f51d9b5b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f51d410edf0 con 0x7f51d4102ae0 2024-09-04T16:26:45.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.356+0000 7f51d9b5b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f51d410ec70 con 0x7f51d4103400 2024-09-04T16:26:45.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.356+0000 7f51d37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51d4102ae0 0x7f51d419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:45.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.356+0000 7f51d37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51d4102ae0 0x7f51d419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38862/0 (socket says 172.21.15.170:38862) 2024-09-04T16:26:45.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.356+0000 7f51d37fe640 1 -- 172.21.15.170:0/915018859 learned_addr learned my addr 172.21.15.170:0/915018859 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:45.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.356+0000 7f51cbfff640 1 --2- 172.21.15.170:0/915018859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51d4103400 0x7f51d419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:45.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.357+0000 7f51d37fe640 1 -- 172.21.15.170:0/915018859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51d4103400 msgr2=0x7f51d419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:45.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.357+0000 7f51d37fe640 1 --2- 172.21.15.170:0/915018859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51d4103400 0x7f51d419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:45.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.357+0000 7f51d37fe640 1 -- 172.21.15.170:0/915018859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d4197800 con 0x7f51d4102ae0 2024-09-04T16:26:45.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.357+0000 7f51d37fe640 1 --2- 172.21.15.170:0/915018859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51d4102ae0 0x7f51d419d680 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f51c400c8a0 tx=0x7f51c400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:45.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.357+0000 7f51d17fa640 1 -- 172.21.15.170:0/915018859 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f51c40079b0 con 0x7f51d4102ae0 2024-09-04T16:26:45.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.357+0000 7f51d9b5b640 1 -- 172.21.15.170:0/915018859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d4197af0 con 0x7f51d4102ae0 2024-09-04T16:26:45.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.357+0000 7f51d17fa640 1 -- 172.21.15.170:0/915018859 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51c4007b50 con 0x7f51d4102ae0 2024-09-04T16:26:45.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.357+0000 7f51d17fa640 1 -- 172.21.15.170:0/915018859 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f51c4018700 con 0x7f51d4102ae0 2024-09-04T16:26:45.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.357+0000 7f51d9b5b640 1 -- 172.21.15.170:0/915018859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d4198050 con 0x7f51d4102ae0 2024-09-04T16:26:45.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.358+0000 7f51d9b5b640 1 -- 172.21.15.170:0/915018859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d406abe0 con 0x7f51d4102ae0 2024-09-04T16:26:45.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.358+0000 7f51d17fa640 1 -- 172.21.15.170:0/915018859 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f51c4007d00 con 0x7f51d4102ae0 2024-09-04T16:26:45.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.359+0000 7f51d17fa640 1 --2- 172.21.15.170:0/915018859 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f51c006de30 0x7f51c00702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:45.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.359+0000 7f51d17fa640 1 -- 172.21.15.170:0/915018859 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f51c408da30 con 0x7f51d4102ae0 2024-09-04T16:26:45.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.359+0000 7f51cbfff640 1 --2- 172.21.15.170:0/915018859 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f51c006de30 0x7f51c00702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:45.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.359+0000 7f51cbfff640 1 --2- 172.21.15.170:0/915018859 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f51c006de30 0x7f51c00702f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f51d4198b50 tx=0x7f51bc031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:45.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.363+0000 7f51d17fa640 1 -- 172.21.15.170:0/915018859 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51c4014030 con 0x7f51d4102ae0 2024-09-04T16:26:45.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.532+0000 7f51d9b5b640 1 -- 172.21.15.170:0/915018859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f51d4198d60 con 0x7f51d4102ae0 2024-09-04T16:26:45.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.532+0000 7f51d17fa640 1 -- 172.21.15.170:0/915018859 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v41) ==== 86+0+160 (secure 0 0 0) 0x7f51d4198d60 con 0x7f51d4102ae0 2024-09-04T16:26:45.533 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:26:45.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.535+0000 7f51d9b5b640 1 -- 172.21.15.170:0/915018859 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f51c006de30 msgr2=0x7f51c00702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:45.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.535+0000 7f51d9b5b640 1 --2- 172.21.15.170:0/915018859 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f51c006de30 0x7f51c00702f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f51d4198b50 tx=0x7f51bc031400 comp rx=0 tx=0).stop 2024-09-04T16:26:45.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.535+0000 7f51d9b5b640 1 -- 172.21.15.170:0/915018859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51d4102ae0 msgr2=0x7f51d419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:45.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.535+0000 7f51d9b5b640 1 --2- 172.21.15.170:0/915018859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51d4102ae0 0x7f51d419d680 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f51c400c8a0 tx=0x7f51c400cd60 comp rx=0 tx=0).stop 2024-09-04T16:26:45.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.536+0000 7f51d9b5b640 1 -- 172.21.15.170:0/915018859 shutdown_connections 2024-09-04T16:26:45.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.536+0000 7f51d9b5b640 1 --2- 172.21.15.170:0/915018859 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f51c006de30 0x7f51c00702f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.536+0000 7f51d9b5b640 1 --2- 172.21.15.170:0/915018859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51d4103400 0x7f51d419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.536+0000 7f51d9b5b640 1 --2- 172.21.15.170:0/915018859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51d4102ae0 0x7f51d419d680 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.536+0000 7f51d9b5b640 1 -- 172.21.15.170:0/915018859 >> 172.21.15.170:0/915018859 conn(0x7f51d40fc520 msgr2=0x7f51d4108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.536+0000 7f51d9b5b640 1 -- 172.21.15.170:0/915018859 shutdown_connections 2024-09-04T16:26:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:45.536+0000 7f51d9b5b640 1 -- 172.21.15.170:0/915018859 wait complete. 2024-09-04T16:26:45.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:45 smithi170 ceph-mon[29272]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:45 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/915018859' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-04T16:26:46.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:45 smithi193 ceph-mon[36288]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:46.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:45 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/915018859' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-04T16:26:46.281 INFO:teuthology.orchestra.run.smithi170.stdout:[{"version":41,"timestamp":"2024-09-04T16:26:35.265296+0000","name":"","changes":[{"name":"osd.5/osd_mclock_max_capacity_iops_ssd","new_value":"9100.912731"}]}] 2024-09-04T16:26:46.282 INFO:tasks.ceph_manager:config epoch is 41 2024-09-04T16:26:46.282 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-04T16:26:46.282 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-04T16:26:46.282 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph mgr dump --format=json 2024-09-04T16:26:46.528 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:46.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.952+0000 7f4b50743640 1 -- 172.21.15.170:0/1284595427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48100820 msgr2=0x7f4b48100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:46.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.952+0000 7f4b50743640 1 --2- 172.21.15.170:0/1284595427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48100820 0x7f4b48100c80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c009880 tx=0x7f4b3c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:26:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.952+0000 7f4b50743640 1 -- 172.21.15.170:0/1284595427 shutdown_connections 2024-09-04T16:26:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.952+0000 7f4b50743640 1 --2- 172.21.15.170:0/1284595427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48100820 0x7f4b48100c80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.952+0000 7f4b50743640 1 --2- 172.21.15.170:0/1284595427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b48106820 0x7f4b48106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.952+0000 7f4b50743640 1 -- 172.21.15.170:0/1284595427 >> 172.21.15.170:0/1284595427 conn(0x7f4b480fc520 msgr2=0x7f4b480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.952+0000 7f4b50743640 1 -- 172.21.15.170:0/1284595427 shutdown_connections 2024-09-04T16:26:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.952+0000 7f4b50743640 1 -- 172.21.15.170:0/1284595427 wait complete. 2024-09-04T16:26:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.952+0000 7f4b50743640 1 Processor -- start 2024-09-04T16:26:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.952+0000 7f4b50743640 1 -- start start 2024-09-04T16:26:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.953+0000 7f4b50743640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b48100820 0x7f4b4819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.953+0000 7f4b50743640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48106820 0x7f4b4819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.953+0000 7f4b50743640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4810dcd0 con 0x7f4b48106820 2024-09-04T16:26:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.953+0000 7f4b50743640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4810db50 con 0x7f4b48100820 2024-09-04T16:26:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.953+0000 7f4b4dcde640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48106820 0x7f4b4819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.953+0000 7f4b4dcde640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48106820 0x7f4b4819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38880/0 (socket says 172.21.15.170:38880) 2024-09-04T16:26:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.953+0000 7f4b4dcde640 1 -- 172.21.15.170:0/3764530169 learned_addr learned my addr 172.21.15.170:0/3764530169 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.953+0000 7f4b4e4df640 1 --2- 172.21.15.170:0/3764530169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b48100820 0x7f4b4819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.953+0000 7f4b4dcde640 1 -- 172.21.15.170:0/3764530169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b48100820 msgr2=0x7f4b4819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.953+0000 7f4b4dcde640 1 --2- 172.21.15.170:0/3764530169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b48100820 0x7f4b4819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.953+0000 7f4b4dcde640 1 -- 172.21.15.170:0/3764530169 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b481977b0 con 0x7f4b48106820 2024-09-04T16:26:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.953+0000 7f4b4dcde640 1 --2- 172.21.15.170:0/3764530169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48106820 0x7f4b4819db70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c031460 tx=0x7f4b3c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.953+0000 7f4b477fe640 1 -- 172.21.15.170:0/3764530169 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b3c03f070 con 0x7f4b48106820 2024-09-04T16:26:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.953+0000 7f4b477fe640 1 -- 172.21.15.170:0/3764530169 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b3c004cf0 con 0x7f4b48106820 2024-09-04T16:26:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.954+0000 7f4b50743640 1 -- 172.21.15.170:0/3764530169 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b48197a40 con 0x7f4b48106820 2024-09-04T16:26:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.954+0000 7f4b477fe640 1 -- 172.21.15.170:0/3764530169 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b3c035030 con 0x7f4b48106820 2024-09-04T16:26:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.954+0000 7f4b50743640 1 -- 172.21.15.170:0/3764530169 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b48197f70 con 0x7f4b48106820 2024-09-04T16:26:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.955+0000 7f4b50743640 1 -- 172.21.15.170:0/3764530169 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b48101f60 con 0x7f4b48106820 2024-09-04T16:26:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.955+0000 7f4b477fe640 1 -- 172.21.15.170:0/3764530169 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f4b3c042070 con 0x7f4b48106820 2024-09-04T16:26:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.955+0000 7f4b477fe640 1 --2- 172.21.15.170:0/3764530169 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f4b3006de30 0x7f4b300702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.956+0000 7f4b477fe640 1 -- 172.21.15.170:0/3764530169 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f4b3c0ae2c0 con 0x7f4b48106820 2024-09-04T16:26:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.956+0000 7f4b4e4df640 1 --2- 172.21.15.170:0/3764530169 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f4b3006de30 0x7f4b300702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:46.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.956+0000 7f4b4e4df640 1 --2- 172.21.15.170:0/3764530169 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f4b3006de30 0x7f4b300702f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4b40008d20 tx=0x7f4b400082b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:46.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:46.960+0000 7f4b477fe640 1 -- 172.21.15.170:0/3764530169 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b3c07c1a0 con 0x7f4b48106820 2024-09-04T16:26:47.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:47.171+0000 7f4b50743640 1 -- 172.21.15.170:0/3764530169 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4b48198d10 con 0x7f4b48106820 2024-09-04T16:26:47.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:47.174+0000 7f4b477fe640 1 -- 172.21.15.170:0/3764530169 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+176008 (secure 0 0 0) 0x7f4b48198d10 con 0x7f4b48106820 2024-09-04T16:26:47.178 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:26:47.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:47.177+0000 7f4b50743640 1 -- 172.21.15.170:0/3764530169 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f4b3006de30 msgr2=0x7f4b300702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:47.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:47.177+0000 7f4b50743640 1 --2- 172.21.15.170:0/3764530169 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f4b3006de30 0x7f4b300702f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4b40008d20 tx=0x7f4b400082b0 comp rx=0 tx=0).stop 2024-09-04T16:26:47.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:47.177+0000 7f4b50743640 1 -- 172.21.15.170:0/3764530169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48106820 msgr2=0x7f4b4819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:47.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:47.177+0000 7f4b50743640 1 --2- 172.21.15.170:0/3764530169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48106820 0x7f4b4819db70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c031460 tx=0x7f4b3c0048f0 comp rx=0 tx=0).stop 2024-09-04T16:26:47.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:47.177+0000 7f4b50743640 1 -- 172.21.15.170:0/3764530169 shutdown_connections 2024-09-04T16:26:47.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:47.177+0000 7f4b50743640 1 --2- 172.21.15.170:0/3764530169 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f4b3006de30 0x7f4b300702f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:47.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:47.177+0000 7f4b50743640 1 --2- 172.21.15.170:0/3764530169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48106820 0x7f4b4819db70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:47.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:47.177+0000 7f4b50743640 1 --2- 172.21.15.170:0/3764530169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b48100820 0x7f4b4819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:47.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:47.177+0000 7f4b50743640 1 -- 172.21.15.170:0/3764530169 >> 172.21.15.170:0/3764530169 conn(0x7f4b480fc520 msgr2=0x7f4b481045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:47.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:47.177+0000 7f4b50743640 1 -- 172.21.15.170:0/3764530169 shutdown_connections 2024-09-04T16:26:47.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:47.177+0000 7f4b50743640 1 -- 172.21.15.170:0/3764530169 wait complete. 2024-09-04T16:26:47.528 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:47 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3764530169' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-04T16:26:47.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:47 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3764530169' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-04T16:26:48.026 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":19,"flags":0,"active_gid":14217,"active_name":"smithi170.fbszap","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1415431517},{"type":"v1","addr":"172.21.15.170:6801","nonce":1415431517}]},"active_addr":"172.21.15.170:6801/1415431517","active_change":"2024-09-04T16:22:43.188734+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14244,"name":"smithi193.gvfizn","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.170:8443/","prometheus":"http://172.21.15.170:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":3694273822}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":3721031413}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":1792862708}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":715338811}]}]} 2024-09-04T16:26:48.037 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-04T16:26:48.037 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-04T16:26:48.038 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-04T16:26:48.286 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:48.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:48 smithi170 ceph-mon[29272]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:48.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:48 smithi193 ceph-mon[36288]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.701+0000 7fdb18d4e640 1 -- 172.21.15.170:0/3100371976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb141067e0 msgr2=0x7fdb14106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.701+0000 7fdb18d4e640 1 --2- 172.21.15.170:0/3100371976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb141067e0 0x7fdb14106bc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009880 tx=0x7fdb0402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:26:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.701+0000 7fdb18d4e640 1 -- 172.21.15.170:0/3100371976 shutdown_connections 2024-09-04T16:26:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.701+0000 7fdb18d4e640 1 --2- 172.21.15.170:0/3100371976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb141007e0 0x7fdb14100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.701+0000 7fdb18d4e640 1 --2- 172.21.15.170:0/3100371976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb141067e0 0x7fdb14106bc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.701+0000 7fdb18d4e640 1 -- 172.21.15.170:0/3100371976 >> 172.21.15.170:0/3100371976 conn(0x7fdb140fc4c0 msgr2=0x7fdb140fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.701+0000 7fdb18d4e640 1 -- 172.21.15.170:0/3100371976 shutdown_connections 2024-09-04T16:26:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.701+0000 7fdb18d4e640 1 -- 172.21.15.170:0/3100371976 wait complete. 2024-09-04T16:26:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.702+0000 7fdb18d4e640 1 Processor -- start 2024-09-04T16:26:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.702+0000 7fdb18d4e640 1 -- start start 2024-09-04T16:26:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.702+0000 7fdb18d4e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb141007e0 0x7fdb1419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.702+0000 7fdb18d4e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb141067e0 0x7fdb1419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.702+0000 7fdb18d4e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1410edb0 con 0x7fdb141007e0 2024-09-04T16:26:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.702+0000 7fdb18d4e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1410ec30 con 0x7fdb141067e0 2024-09-04T16:26:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.702+0000 7fdb1259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb141007e0 0x7fdb1419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.702+0000 7fdb1259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb141007e0 0x7fdb1419d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38904/0 (socket says 172.21.15.170:38904) 2024-09-04T16:26:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.702+0000 7fdb1259c640 1 -- 172.21.15.170:0/3351566079 learned_addr learned my addr 172.21.15.170:0/3351566079 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.702+0000 7fdb0bfff640 1 --2- 172.21.15.170:0/3351566079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb141067e0 0x7fdb1419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.702+0000 7fdb1259c640 1 -- 172.21.15.170:0/3351566079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb141067e0 msgr2=0x7fdb1419db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.702+0000 7fdb1259c640 1 --2- 172.21.15.170:0/3351566079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb141067e0 0x7fdb1419db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.702+0000 7fdb1259c640 1 -- 172.21.15.170:0/3351566079 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb141977a0 con 0x7fdb141007e0 2024-09-04T16:26:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.703+0000 7fdb1259c640 1 --2- 172.21.15.170:0/3351566079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb141007e0 0x7fdb1419d620 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdb04031460 tx=0x7fdb040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.703+0000 7fdb0b7fe640 1 -- 172.21.15.170:0/3351566079 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb0403f070 con 0x7fdb141007e0 2024-09-04T16:26:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.703+0000 7fdb0b7fe640 1 -- 172.21.15.170:0/3351566079 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb04004cf0 con 0x7fdb141007e0 2024-09-04T16:26:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.703+0000 7fdb18d4e640 1 -- 172.21.15.170:0/3351566079 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb14197a30 con 0x7fdb141007e0 2024-09-04T16:26:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.703+0000 7fdb0b7fe640 1 -- 172.21.15.170:0/3351566079 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb04035030 con 0x7fdb141007e0 2024-09-04T16:26:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.703+0000 7fdb18d4e640 1 -- 172.21.15.170:0/3351566079 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb14197f60 con 0x7fdb141007e0 2024-09-04T16:26:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.704+0000 7fdb18d4e640 1 -- 172.21.15.170:0/3351566079 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb14101f20 con 0x7fdb141007e0 2024-09-04T16:26:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.704+0000 7fdb0b7fe640 1 -- 172.21.15.170:0/3351566079 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7fdb04042070 con 0x7fdb141007e0 2024-09-04T16:26:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.705+0000 7fdb0b7fe640 1 --2- 172.21.15.170:0/3351566079 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fdb0006de90 0x7fdb00070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.705+0000 7fdb0bfff640 1 --2- 172.21.15.170:0/3351566079 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fdb0006de90 0x7fdb00070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.705+0000 7fdb0b7fe640 1 -- 172.21.15.170:0/3351566079 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fdb040ae110 con 0x7fdb141007e0 2024-09-04T16:26:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.705+0000 7fdb0bfff640 1 --2- 172.21.15.170:0/3351566079 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fdb0006de90 0x7fdb00070350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdb140ffc30 tx=0x7fdafc00a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:48.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.709+0000 7fdb0b7fe640 1 -- 172.21.15.170:0/3351566079 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb0407c070 con 0x7fdb141007e0 2024-09-04T16:26:48.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.875+0000 7fdb18d4e640 1 -- 172.21.15.170:0/3351566079 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb14198d00 con 0x7fdb141007e0 2024-09-04T16:26:48.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.876+0000 7fdb0b7fe640 1 -- 172.21.15.170:0/3351566079 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11435 (secure 0 0 0) 0x7fdb14198d00 con 0x7fdb141007e0 2024-09-04T16:26:48.879 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:26:48.879 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":39,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","created":"2024-09-04T16:20:45.301087+0000","modified":"2024-09-04T16:26:37.492790+0000","last_up_change":"2024-09-04T16:26:36.266450+0000","last_in_change":"2024-09-04T16:26:12.694342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-04T16:25:17.504686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbba256a-288b-4bce-b9c0-5cebfc7c5a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1158983556},{"type":"v1","addr":"172.21.15.170:6803","nonce":1158983556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1158983556},{"type":"v1","addr":"172.21.15.170:6805","nonce":1158983556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1158983556},{"type":"v1","addr":"172.21.15.170:6809","nonce":1158983556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1158983556},{"type":"v1","addr":"172.21.15.170:6807","nonce":1158983556}]},"public_addr":"172.21.15.170:6803/1158983556","cluster_addr":"172.21.15.170:6805/1158983556","heartbeat_back_addr":"172.21.15.170:6809/1158983556","heartbeat_front_addr":"172.21.15.170:6807/1158983556","state":["exists","up"]},{"osd":1,"uuid":"0b106135-c381-4e8e-85f1-1f85100c1949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":600576441},{"type":"v1","addr":"172.21.15.170:6811","nonce":600576441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":600576441},{"type":"v1","addr":"172.21.15.170:6813","nonce":600576441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":600576441},{"type":"v1","addr":"172.21.15.170:6817","nonce":600576441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":600576441},{"type":"v1","addr":"172.21.15.170:6815","nonce":600576441}]},"public_addr":"172.21.15.170:6811/600576441","cluster_addr":"172.21.15.170:6813/600576441","heartbeat_back_addr":"172.21.15.170:6817/600576441","heartbeat_front_addr":"172.21.15.170:6815/600576441","state":["exists","up"]},{"osd":2,"uuid":"ea5d3602-2f3f-40a4-a535-dd7f81cda237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3174568737},{"type":"v1","addr":"172.21.15.170:6819","nonce":3174568737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3174568737},{"type":"v1","addr":"172.21.15.170:6821","nonce":3174568737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3174568737},{"type":"v1","addr":"172.21.15.170:6825","nonce":3174568737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3174568737},{"type":"v1","addr":"172.21.15.170:6823","nonce":3174568737}]},"public_addr":"172.21.15.170:6819/3174568737","cluster_addr":"172.21.15.170:6821/3174568737","heartbeat_back_addr":"172.21.15.170:6825/3174568737","heartbeat_front_addr":"172.21.15.170:6823/3174568737","state":["exists","up"]},{"osd":3,"uuid":"9ea70be0-d553-4669-adde-18aa1a04d81a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":3804134072},{"type":"v1","addr":"172.21.15.193:6801","nonce":3804134072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":3804134072},{"type":"v1","addr":"172.21.15.193:6803","nonce":3804134072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":3804134072},{"type":"v1","addr":"172.21.15.193:6807","nonce":3804134072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":3804134072},{"type":"v1","addr":"172.21.15.193:6805","nonce":3804134072}]},"public_addr":"172.21.15.193:6801/3804134072","cluster_addr":"172.21.15.193:6803/3804134072","heartbeat_back_addr":"172.21.15.193:6807/3804134072","heartbeat_front_addr":"172.21.15.193:6805/3804134072","state":["exists","up"]},{"osd":4,"uuid":"5cc6d07b-d898-4f15-ac87-d29cd36ef898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":2691165010},{"type":"v1","addr":"172.21.15.193:6809","nonce":2691165010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":2691165010},{"type":"v1","addr":"172.21.15.193:6811","nonce":2691165010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":2691165010},{"type":"v1","addr":"172.21.15.193:6815","nonce":2691165010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2691165010},{"type":"v1","addr":"172.21.15.193:6813","nonce":2691165010}]},"public_addr":"172.21.15.193:6809/2691165010","cluster_addr":"172.21.15.193:6811/2691165010","heartbeat_back_addr":"172.21.15.193:6815/2691165010","heartbeat_front_addr":"172.21.15.193:6813/2691165010","state":["exists","up"]},{"osd":5,"uuid":"edc27f67-a882-4b09-90a8-17b0060cb8ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":858863790},{"type":"v1","addr":"172.21.15.193:6817","nonce":858863790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":858863790},{"type":"v1","addr":"172.21.15.193:6819","nonce":858863790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":858863790},{"type":"v1","addr":"172.21.15.193:6823","nonce":858863790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":858863790},{"type":"v1","addr":"172.21.15.193:6821","nonce":858863790}]},"public_addr":"172.21.15.193:6817/858863790","cluster_addr":"172.21.15.193:6819/858863790","heartbeat_back_addr":"172.21.15.193:6823/858863790","heartbeat_front_addr":"172.21.15.193:6821/858863790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:24:21.559987+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:24:48.437620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:25:16.000777+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:25:41.007303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:26:07.467201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:26:33.962617+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:6801/4082719191":"2024-09-05T16:22:43.188580+0000","172.21.15.170:6800/4082719191":"2024-09-05T16:22:43.188580+0000","172.21.15.170:6801/1344937001":"2024-09-05T16:21:12.676489+0000","172.21.15.170:0/2398984574":"2024-09-05T16:21:12.676489+0000","172.21.15.170:6801/1933182229":"2024-09-05T16:21:43.532674+0000","172.21.15.170:0/4140626365":"2024-09-05T16:21:12.676489+0000","172.21.15.170:6800/1933182229":"2024-09-05T16:21:43.532674+0000","172.21.15.170:0/3147587826":"2024-09-05T16:21:12.676489+0000","172.21.15.170:0/805677094":"2024-09-05T16:21:43.532674+0000","172.21.15.170:0/1110147744":"2024-09-05T16:21:43.532674+0000","172.21.15.170:0/3196924100":"2024-09-05T16:22:43.188580+0000","172.21.15.170:0/2639013592":"2024-09-05T16:21:43.532674+0000","172.21.15.170:0/2879400972":"2024-09-05T16:22:43.188580+0000","172.21.15.170:6800/1344937001":"2024-09-05T16:21:12.676489+0000","172.21.15.170:0/3495410490":"2024-09-05T16:22:43.188580+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-04T16:26:48.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.878+0000 7fdb18d4e640 1 -- 172.21.15.170:0/3351566079 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fdb0006de90 msgr2=0x7fdb00070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:48.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.878+0000 7fdb18d4e640 1 --2- 172.21.15.170:0/3351566079 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fdb0006de90 0x7fdb00070350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdb140ffc30 tx=0x7fdafc00a2d0 comp rx=0 tx=0).stop 2024-09-04T16:26:48.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.878+0000 7fdb18d4e640 1 -- 172.21.15.170:0/3351566079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb141007e0 msgr2=0x7fdb1419d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:48.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.878+0000 7fdb18d4e640 1 --2- 172.21.15.170:0/3351566079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb141007e0 0x7fdb1419d620 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdb04031460 tx=0x7fdb040048f0 comp rx=0 tx=0).stop 2024-09-04T16:26:48.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.878+0000 7fdb18d4e640 1 -- 172.21.15.170:0/3351566079 shutdown_connections 2024-09-04T16:26:48.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.878+0000 7fdb18d4e640 1 --2- 172.21.15.170:0/3351566079 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fdb0006de90 0x7fdb00070350 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:48.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.878+0000 7fdb18d4e640 1 --2- 172.21.15.170:0/3351566079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb141067e0 0x7fdb1419db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:48.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.878+0000 7fdb18d4e640 1 --2- 172.21.15.170:0/3351566079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb141007e0 0x7fdb1419d620 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:48.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.878+0000 7fdb18d4e640 1 -- 172.21.15.170:0/3351566079 >> 172.21.15.170:0/3351566079 conn(0x7fdb140fc4c0 msgr2=0x7fdb140fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:48.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.879+0000 7fdb18d4e640 1 -- 172.21.15.170:0/3351566079 shutdown_connections 2024-09-04T16:26:48.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:48.879+0000 7fdb18d4e640 1 -- 172.21.15.170:0/3351566079 wait complete. 2024-09-04T16:26:49.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:49 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3351566079' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-04T16:26:49.617 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-04T16:26:49.617 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-04T16:26:49.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:49 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3351566079' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-04T16:26:49.865 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:50.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.286+0000 7f4041c91640 1 -- 172.21.15.170:0/1564900771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f403c106820 msgr2=0x7f403c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:50.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.286+0000 7f4041c91640 1 --2- 172.21.15.170:0/1564900771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f403c106820 0x7f403c106c00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f402c009880 tx=0x7f402c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:26:50.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.286+0000 7f4041c91640 1 -- 172.21.15.170:0/1564900771 shutdown_connections 2024-09-04T16:26:50.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.286+0000 7f4041c91640 1 --2- 172.21.15.170:0/1564900771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f403c100820 0x7f403c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:50.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.286+0000 7f4041c91640 1 --2- 172.21.15.170:0/1564900771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f403c106820 0x7f403c106c00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:50.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.286+0000 7f4041c91640 1 -- 172.21.15.170:0/1564900771 >> 172.21.15.170:0/1564900771 conn(0x7f403c0fc520 msgr2=0x7f403c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:50.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.286+0000 7f4041c91640 1 -- 172.21.15.170:0/1564900771 shutdown_connections 2024-09-04T16:26:50.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.286+0000 7f4041c91640 1 -- 172.21.15.170:0/1564900771 wait complete. 2024-09-04T16:26:50.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.287+0000 7f4041c91640 1 Processor -- start 2024-09-04T16:26:50.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.287+0000 7f4041c91640 1 -- start start 2024-09-04T16:26:50.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.287+0000 7f4041c91640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f403c100820 0x7f403c19c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:50.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.287+0000 7f4041c91640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f403c106820 0x7f403c19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:50.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.287+0000 7f4041c91640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f403c10dcf0 con 0x7f403c100820 2024-09-04T16:26:50.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.287+0000 7f4041c91640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f403c10db70 con 0x7f403c106820 2024-09-04T16:26:50.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.287+0000 7f403b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f403c100820 0x7f403c19c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:50.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.287+0000 7f403b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f403c100820 0x7f403c19c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38928/0 (socket says 172.21.15.170:38928) 2024-09-04T16:26:50.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.287+0000 7f403b7fe640 1 -- 172.21.15.170:0/1495156291 learned_addr learned my addr 172.21.15.170:0/1495156291 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:50.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.288+0000 7f403affd640 1 --2- 172.21.15.170:0/1495156291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f403c106820 0x7f403c19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:50.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.288+0000 7f403b7fe640 1 -- 172.21.15.170:0/1495156291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f403c106820 msgr2=0x7f403c19cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:50.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.288+0000 7f403b7fe640 1 --2- 172.21.15.170:0/1495156291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f403c106820 0x7f403c19cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.288+0000 7f403b7fe640 1 -- 172.21.15.170:0/1495156291 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403c196700 con 0x7f403c100820 2024-09-04T16:26:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.288+0000 7f403b7fe640 1 --2- 172.21.15.170:0/1495156291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f403c100820 0x7f403c19c630 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f402c031460 tx=0x7f402c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.288+0000 7f4038ff9640 1 -- 172.21.15.170:0/1495156291 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f402c03f070 con 0x7f403c100820 2024-09-04T16:26:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.288+0000 7f4038ff9640 1 -- 172.21.15.170:0/1495156291 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f402c004a90 con 0x7f403c100820 2024-09-04T16:26:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.288+0000 7f4041c91640 1 -- 172.21.15.170:0/1495156291 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f403c196990 con 0x7f403c100820 2024-09-04T16:26:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.288+0000 7f4038ff9640 1 -- 172.21.15.170:0/1495156291 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f402c035030 con 0x7f403c100820 2024-09-04T16:26:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.288+0000 7f4041c91640 1 -- 172.21.15.170:0/1495156291 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f403c196e90 con 0x7f403c100820 2024-09-04T16:26:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.289+0000 7f4041c91640 1 -- 172.21.15.170:0/1495156291 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f403c101f60 con 0x7f403c100820 2024-09-04T16:26:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.290+0000 7f4038ff9640 1 -- 172.21.15.170:0/1495156291 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f402c042070 con 0x7f403c100820 2024-09-04T16:26:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.290+0000 7f4038ff9640 1 --2- 172.21.15.170:0/1495156291 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f402406de30 0x7f40240702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.290+0000 7f4038ff9640 1 -- 172.21.15.170:0/1495156291 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f402c0ae2a0 con 0x7f403c100820 2024-09-04T16:26:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.290+0000 7f403affd640 1 --2- 172.21.15.170:0/1495156291 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f402406de30 0x7f40240702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:50.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.291+0000 7f403affd640 1 --2- 172.21.15.170:0/1495156291 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f402406de30 0x7f40240702f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f403c197f50 tx=0x7f4030009500 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:50.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.294+0000 7f4038ff9640 1 -- 172.21.15.170:0/1495156291 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f402c07fe30 con 0x7f403c100820 2024-09-04T16:26:50.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.462+0000 7f4041c91640 1 -- 172.21.15.170:0/1495156291 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f403c108d90 con 0x7f403c100820 2024-09-04T16:26:50.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.463+0000 7f4038ff9640 1 -- 172.21.15.170:0/1495156291 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11435 (secure 0 0 0) 0x7f402c084660 con 0x7f403c100820 2024-09-04T16:26:50.464 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:26:50.464 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":39,"fsid":"89be7670-6ad9-11ef-bcd6-c7b262605968","created":"2024-09-04T16:20:45.301087+0000","modified":"2024-09-04T16:26:37.492790+0000","last_up_change":"2024-09-04T16:26:36.266450+0000","last_in_change":"2024-09-04T16:26:12.694342+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-04T16:25:17.504686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbba256a-288b-4bce-b9c0-5cebfc7c5a5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1158983556},{"type":"v1","addr":"172.21.15.170:6803","nonce":1158983556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1158983556},{"type":"v1","addr":"172.21.15.170:6805","nonce":1158983556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1158983556},{"type":"v1","addr":"172.21.15.170:6809","nonce":1158983556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1158983556},{"type":"v1","addr":"172.21.15.170:6807","nonce":1158983556}]},"public_addr":"172.21.15.170:6803/1158983556","cluster_addr":"172.21.15.170:6805/1158983556","heartbeat_back_addr":"172.21.15.170:6809/1158983556","heartbeat_front_addr":"172.21.15.170:6807/1158983556","state":["exists","up"]},{"osd":1,"uuid":"0b106135-c381-4e8e-85f1-1f85100c1949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":600576441},{"type":"v1","addr":"172.21.15.170:6811","nonce":600576441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":600576441},{"type":"v1","addr":"172.21.15.170:6813","nonce":600576441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":600576441},{"type":"v1","addr":"172.21.15.170:6817","nonce":600576441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":600576441},{"type":"v1","addr":"172.21.15.170:6815","nonce":600576441}]},"public_addr":"172.21.15.170:6811/600576441","cluster_addr":"172.21.15.170:6813/600576441","heartbeat_back_addr":"172.21.15.170:6817/600576441","heartbeat_front_addr":"172.21.15.170:6815/600576441","state":["exists","up"]},{"osd":2,"uuid":"ea5d3602-2f3f-40a4-a535-dd7f81cda237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3174568737},{"type":"v1","addr":"172.21.15.170:6819","nonce":3174568737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3174568737},{"type":"v1","addr":"172.21.15.170:6821","nonce":3174568737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3174568737},{"type":"v1","addr":"172.21.15.170:6825","nonce":3174568737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3174568737},{"type":"v1","addr":"172.21.15.170:6823","nonce":3174568737}]},"public_addr":"172.21.15.170:6819/3174568737","cluster_addr":"172.21.15.170:6821/3174568737","heartbeat_back_addr":"172.21.15.170:6825/3174568737","heartbeat_front_addr":"172.21.15.170:6823/3174568737","state":["exists","up"]},{"osd":3,"uuid":"9ea70be0-d553-4669-adde-18aa1a04d81a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":3804134072},{"type":"v1","addr":"172.21.15.193:6801","nonce":3804134072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":3804134072},{"type":"v1","addr":"172.21.15.193:6803","nonce":3804134072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":3804134072},{"type":"v1","addr":"172.21.15.193:6807","nonce":3804134072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":3804134072},{"type":"v1","addr":"172.21.15.193:6805","nonce":3804134072}]},"public_addr":"172.21.15.193:6801/3804134072","cluster_addr":"172.21.15.193:6803/3804134072","heartbeat_back_addr":"172.21.15.193:6807/3804134072","heartbeat_front_addr":"172.21.15.193:6805/3804134072","state":["exists","up"]},{"osd":4,"uuid":"5cc6d07b-d898-4f15-ac87-d29cd36ef898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":2691165010},{"type":"v1","addr":"172.21.15.193:6809","nonce":2691165010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":2691165010},{"type":"v1","addr":"172.21.15.193:6811","nonce":2691165010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":2691165010},{"type":"v1","addr":"172.21.15.193:6815","nonce":2691165010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2691165010},{"type":"v1","addr":"172.21.15.193:6813","nonce":2691165010}]},"public_addr":"172.21.15.193:6809/2691165010","cluster_addr":"172.21.15.193:6811/2691165010","heartbeat_back_addr":"172.21.15.193:6815/2691165010","heartbeat_front_addr":"172.21.15.193:6813/2691165010","state":["exists","up"]},{"osd":5,"uuid":"edc27f67-a882-4b09-90a8-17b0060cb8ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":858863790},{"type":"v1","addr":"172.21.15.193:6817","nonce":858863790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":858863790},{"type":"v1","addr":"172.21.15.193:6819","nonce":858863790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":858863790},{"type":"v1","addr":"172.21.15.193:6823","nonce":858863790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":858863790},{"type":"v1","addr":"172.21.15.193:6821","nonce":858863790}]},"public_addr":"172.21.15.193:6817/858863790","cluster_addr":"172.21.15.193:6819/858863790","heartbeat_back_addr":"172.21.15.193:6823/858863790","heartbeat_front_addr":"172.21.15.193:6821/858863790","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:24:21.559987+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:24:48.437620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:25:16.000777+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:25:41.007303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:26:07.467201+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-04T16:26:33.962617+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:6801/4082719191":"2024-09-05T16:22:43.188580+0000","172.21.15.170:6800/4082719191":"2024-09-05T16:22:43.188580+0000","172.21.15.170:6801/1344937001":"2024-09-05T16:21:12.676489+0000","172.21.15.170:0/2398984574":"2024-09-05T16:21:12.676489+0000","172.21.15.170:6801/1933182229":"2024-09-05T16:21:43.532674+0000","172.21.15.170:0/4140626365":"2024-09-05T16:21:12.676489+0000","172.21.15.170:6800/1933182229":"2024-09-05T16:21:43.532674+0000","172.21.15.170:0/3147587826":"2024-09-05T16:21:12.676489+0000","172.21.15.170:0/805677094":"2024-09-05T16:21:43.532674+0000","172.21.15.170:0/1110147744":"2024-09-05T16:21:43.532674+0000","172.21.15.170:0/3196924100":"2024-09-05T16:22:43.188580+0000","172.21.15.170:0/2639013592":"2024-09-05T16:21:43.532674+0000","172.21.15.170:0/2879400972":"2024-09-05T16:22:43.188580+0000","172.21.15.170:6800/1344937001":"2024-09-05T16:21:12.676489+0000","172.21.15.170:0/3495410490":"2024-09-05T16:22:43.188580+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-04T16:26:50.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.466+0000 7f4041c91640 1 -- 172.21.15.170:0/1495156291 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f402406de30 msgr2=0x7f40240702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:50.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.466+0000 7f4041c91640 1 --2- 172.21.15.170:0/1495156291 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f402406de30 0x7f40240702f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f403c197f50 tx=0x7f4030009500 comp rx=0 tx=0).stop 2024-09-04T16:26:50.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.466+0000 7f4041c91640 1 -- 172.21.15.170:0/1495156291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f403c100820 msgr2=0x7f403c19c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:50.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.466+0000 7f4041c91640 1 --2- 172.21.15.170:0/1495156291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f403c100820 0x7f403c19c630 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f402c031460 tx=0x7f402c004530 comp rx=0 tx=0).stop 2024-09-04T16:26:50.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.466+0000 7f4041c91640 1 -- 172.21.15.170:0/1495156291 shutdown_connections 2024-09-04T16:26:50.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.466+0000 7f4041c91640 1 --2- 172.21.15.170:0/1495156291 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f402406de30 0x7f40240702f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:50.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.466+0000 7f4041c91640 1 --2- 172.21.15.170:0/1495156291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f403c106820 0x7f403c19cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:50.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.466+0000 7f4041c91640 1 --2- 172.21.15.170:0/1495156291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f403c100820 0x7f403c19c630 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:50.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.466+0000 7f4041c91640 1 -- 172.21.15.170:0/1495156291 >> 172.21.15.170:0/1495156291 conn(0x7f403c0fc520 msgr2=0x7f403c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:50.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.466+0000 7f4041c91640 1 -- 172.21.15.170:0/1495156291 shutdown_connections 2024-09-04T16:26:50.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:50.466+0000 7f4041c91640 1 -- 172.21.15.170:0/1495156291 wait complete. 2024-09-04T16:26:50.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:50 smithi170 ceph-mon[29272]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:50 smithi193 ceph-mon[36288]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:51.145 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-04T16:26:51.146 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-04T16:26:51.146 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-04T16:26:51.146 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-04T16:26:51.147 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-04T16:26:51.147 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-04T16:26:51.285 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:51 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1495156291' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-04T16:26:51.443 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:51.451 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:51 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1495156291' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-04T16:26:51.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.918+0000 7fd678c60640 1 -- 172.21.15.170:0/1339889667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd674100810 msgr2=0x7fd674100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.918+0000 7fd678c60640 1 --2- 172.21.15.170:0/1339889667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd674100810 0x7fd674100c70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd668009880 tx=0x7fd66802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:26:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.918+0000 7fd678c60640 1 -- 172.21.15.170:0/1339889667 shutdown_connections 2024-09-04T16:26:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.918+0000 7fd678c60640 1 --2- 172.21.15.170:0/1339889667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd674100810 0x7fd674100c70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.918+0000 7fd678c60640 1 --2- 172.21.15.170:0/1339889667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd674106810 0x7fd674106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.918+0000 7fd678c60640 1 -- 172.21.15.170:0/1339889667 >> 172.21.15.170:0/1339889667 conn(0x7fd6740fc510 msgr2=0x7fd6740fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.918+0000 7fd678c60640 1 -- 172.21.15.170:0/1339889667 shutdown_connections 2024-09-04T16:26:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.918+0000 7fd678c60640 1 -- 172.21.15.170:0/1339889667 wait complete. 2024-09-04T16:26:51.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.918+0000 7fd678c60640 1 Processor -- start 2024-09-04T16:26:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.918+0000 7fd678c60640 1 -- start start 2024-09-04T16:26:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.919+0000 7fd678c60640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd674100810 0x7fd67419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.919+0000 7fd678c60640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd674106810 0x7fd67419dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.919+0000 7fd678c60640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd67410dd40 con 0x7fd674100810 2024-09-04T16:26:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.919+0000 7fd678c60640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd67410dbc0 con 0x7fd674106810 2024-09-04T16:26:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.919+0000 7fd67259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd674100810 0x7fd67419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.919+0000 7fd67259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd674100810 0x7fd67419d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38954/0 (socket says 172.21.15.170:38954) 2024-09-04T16:26:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.919+0000 7fd67259c640 1 -- 172.21.15.170:0/2159721837 learned_addr learned my addr 172.21.15.170:0/2159721837 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.919+0000 7fd671d9b640 1 --2- 172.21.15.170:0/2159721837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd674106810 0x7fd67419dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.919+0000 7fd67259c640 1 -- 172.21.15.170:0/2159721837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd674106810 msgr2=0x7fd67419dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.919+0000 7fd67259c640 1 --2- 172.21.15.170:0/2159721837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd674106810 0x7fd67419dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.919+0000 7fd67259c640 1 -- 172.21.15.170:0/2159721837 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd674197850 con 0x7fd674100810 2024-09-04T16:26:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.919+0000 7fd67259c640 1 --2- 172.21.15.170:0/2159721837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd674100810 0x7fd67419d6d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd66400b420 tx=0x7fd66400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:51.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.919+0000 7fd6637fe640 1 -- 172.21.15.170:0/2159721837 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd664011630 con 0x7fd674100810 2024-09-04T16:26:51.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.919+0000 7fd6637fe640 1 -- 172.21.15.170:0/2159721837 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd664016070 con 0x7fd674100810 2024-09-04T16:26:51.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.919+0000 7fd678c60640 1 -- 172.21.15.170:0/2159721837 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd674197b40 con 0x7fd674100810 2024-09-04T16:26:51.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.919+0000 7fd6637fe640 1 -- 172.21.15.170:0/2159721837 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd664010d40 con 0x7fd674100810 2024-09-04T16:26:51.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.920+0000 7fd678c60640 1 -- 172.21.15.170:0/2159721837 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6741980a0 con 0x7fd674100810 2024-09-04T16:26:51.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.920+0000 7fd678c60640 1 -- 172.21.15.170:0/2159721837 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6741986c0 con 0x7fd674100810 2024-09-04T16:26:51.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.921+0000 7fd6637fe640 1 -- 172.21.15.170:0/2159721837 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7fd66401b460 con 0x7fd674100810 2024-09-04T16:26:51.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.921+0000 7fd6637fe640 1 --2- 172.21.15.170:0/2159721837 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fd65c06de30 0x7fd65c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:51.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.922+0000 7fd6637fe640 1 -- 172.21.15.170:0/2159721837 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fd66408d0a0 con 0x7fd674100810 2024-09-04T16:26:51.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.922+0000 7fd671d9b640 1 --2- 172.21.15.170:0/2159721837 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fd65c06de30 0x7fd65c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:51.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.922+0000 7fd6637fe640 1 --2- 172.21.15.170:0/2159721837 >> [v2:172.21.15.193:6816/858863790,v1:172.21.15.193:6817/858863790] conn(0x7fd65c073c20 0x7fd65c076040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:51.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.922+0000 7fd6637fe640 1 -- 172.21.15.170:0/2159721837 --> [v2:172.21.15.193:6816/858863790,v1:172.21.15.193:6817/858863790] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd65c0766f0 con 0x7fd65c073c20 2024-09-04T16:26:51.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.922+0000 7fd6637fe640 1 -- 172.21.15.170:0/2159721837 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fd664094050 con 0x7fd674100810 2024-09-04T16:26:51.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.922+0000 7fd672d9d640 1 --2- 172.21.15.170:0/2159721837 >> [v2:172.21.15.193:6816/858863790,v1:172.21.15.193:6817/858863790] conn(0x7fd65c073c20 0x7fd65c076040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:51.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.922+0000 7fd671d9b640 1 --2- 172.21.15.170:0/2159721837 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fd65c06de30 0x7fd65c0702f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd674198ba0 tx=0x7fd668031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:51.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.922+0000 7fd672d9d640 1 --2- 172.21.15.170:0/2159721837 >> [v2:172.21.15.193:6816/858863790,v1:172.21.15.193:6817/858863790] conn(0x7fd65c073c20 0x7fd65c076040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:51.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.923+0000 7fd6637fe640 1 -- 172.21.15.170:0/2159721837 <== osd.5 v2:172.21.15.193:6816/858863790 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd65c0766f0 con 0x7fd65c073c20 2024-09-04T16:26:51.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.944+0000 7fd678c60640 1 -- 172.21.15.170:0/2159721837 --> [v2:172.21.15.193:6816/858863790,v1:172.21.15.193:6817/858863790] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd674062880 con 0x7fd65c073c20 2024-09-04T16:26:51.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.945+0000 7fd6637fe640 1 -- 172.21.15.170:0/2159721837 <== osd.5 v2:172.21.15.193:6816/858863790 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd674062880 con 0x7fd65c073c20 2024-09-04T16:26:51.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.945+0000 7fd678c60640 1 -- 172.21.15.170:0/2159721837 >> [v2:172.21.15.193:6816/858863790,v1:172.21.15.193:6817/858863790] conn(0x7fd65c073c20 msgr2=0x7fd65c076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:51.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.945+0000 7fd678c60640 1 --2- 172.21.15.170:0/2159721837 >> [v2:172.21.15.193:6816/858863790,v1:172.21.15.193:6817/858863790] conn(0x7fd65c073c20 0x7fd65c076040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:51.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.945+0000 7fd678c60640 1 -- 172.21.15.170:0/2159721837 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fd65c06de30 msgr2=0x7fd65c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:51.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.945+0000 7fd678c60640 1 --2- 172.21.15.170:0/2159721837 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fd65c06de30 0x7fd65c0702f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd674198ba0 tx=0x7fd668031400 comp rx=0 tx=0).stop 2024-09-04T16:26:51.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.945+0000 7fd678c60640 1 -- 172.21.15.170:0/2159721837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd674100810 msgr2=0x7fd67419d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:51.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.945+0000 7fd678c60640 1 --2- 172.21.15.170:0/2159721837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd674100810 0x7fd67419d6d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd66400b420 tx=0x7fd66400b8e0 comp rx=0 tx=0).stop 2024-09-04T16:26:51.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.945+0000 7fd678c60640 1 -- 172.21.15.170:0/2159721837 shutdown_connections 2024-09-04T16:26:51.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.945+0000 7fd678c60640 1 --2- 172.21.15.170:0/2159721837 >> [v2:172.21.15.193:6816/858863790,v1:172.21.15.193:6817/858863790] conn(0x7fd65c073c20 0x7fd65c076040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:51.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.945+0000 7fd678c60640 1 --2- 172.21.15.170:0/2159721837 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fd65c06de30 0x7fd65c0702f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:51.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.945+0000 7fd678c60640 1 --2- 172.21.15.170:0/2159721837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd674106810 0x7fd67419dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:51.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.945+0000 7fd678c60640 1 --2- 172.21.15.170:0/2159721837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd674100810 0x7fd67419d6d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:51.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.945+0000 7fd678c60640 1 -- 172.21.15.170:0/2159721837 >> 172.21.15.170:0/2159721837 conn(0x7fd6740fc510 msgr2=0x7fd67406a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:51.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.945+0000 7fd678c60640 1 -- 172.21.15.170:0/2159721837 shutdown_connections 2024-09-04T16:26:51.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:51.945+0000 7fd678c60640 1 -- 172.21.15.170:0/2159721837 wait complete. 2024-09-04T16:26:52.433 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:52 smithi170 ceph-mon[29272]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:52.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.514+0000 7f78df94c640 1 -- 172.21.15.170:0/676606672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78d8106810 msgr2=0x7f78d8106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:52.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.514+0000 7f78df94c640 1 --2- 172.21.15.170:0/676606672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78d8106810 0x7f78d8106bf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f78cc009880 tx=0x7f78cc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:26:52.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.514+0000 7f78df94c640 1 -- 172.21.15.170:0/676606672 shutdown_connections 2024-09-04T16:26:52.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.514+0000 7f78df94c640 1 --2- 172.21.15.170:0/676606672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78d8100810 0x7f78d8100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:52.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.514+0000 7f78df94c640 1 --2- 172.21.15.170:0/676606672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78d8106810 0x7f78d8106bf0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:52.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.514+0000 7f78df94c640 1 -- 172.21.15.170:0/676606672 >> 172.21.15.170:0/676606672 conn(0x7f78d80fc510 msgr2=0x7f78d80fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:52.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.514+0000 7f78df94c640 1 -- 172.21.15.170:0/676606672 shutdown_connections 2024-09-04T16:26:52.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.514+0000 7f78df94c640 1 -- 172.21.15.170:0/676606672 wait complete. 2024-09-04T16:26:52.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.515+0000 7f78df94c640 1 Processor -- start 2024-09-04T16:26:52.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.515+0000 7f78df94c640 1 -- start start 2024-09-04T16:26:52.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.515+0000 7f78df94c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78d8100810 0x7f78d8198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:52.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.515+0000 7f78df94c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78d8106810 0x7f78d8198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:52.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.515+0000 7f78df94c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f78d810dd40 con 0x7f78d8106810 2024-09-04T16:26:52.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.515+0000 7f78df94c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f78d810dbc0 con 0x7f78d8100810 2024-09-04T16:26:52.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.515+0000 7f78dcee7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78d8106810 0x7f78d8198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:52.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.515+0000 7f78dcee7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78d8106810 0x7f78d8198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38978/0 (socket says 172.21.15.170:38978) 2024-09-04T16:26:52.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.515+0000 7f78dcee7640 1 -- 172.21.15.170:0/2280175246 learned_addr learned my addr 172.21.15.170:0/2280175246 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:52.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.515+0000 7f78dd6e8640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78d8100810 0x7f78d8198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:52.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.515+0000 7f78dcee7640 1 -- 172.21.15.170:0/2280175246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78d8100810 msgr2=0x7f78d8198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:52.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.515+0000 7f78dcee7640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78d8100810 0x7f78d8198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:52.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.515+0000 7f78dcee7640 1 -- 172.21.15.170:0/2280175246 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d81993d0 con 0x7f78d8106810 2024-09-04T16:26:52.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.515+0000 7f78dd6e8640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78d8100810 0x7f78d8198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:26:52.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.515+0000 7f78dcee7640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78d8106810 0x7f78d8198dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f78d400b420 tx=0x7f78d400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:52.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.516+0000 7f78ca7fc640 1 -- 172.21.15.170:0/2280175246 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f78d4011630 con 0x7f78d8106810 2024-09-04T16:26:52.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.516+0000 7f78df94c640 1 -- 172.21.15.170:0/2280175246 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d81996c0 con 0x7f78d8106810 2024-09-04T16:26:52.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.516+0000 7f78ca7fc640 1 -- 172.21.15.170:0/2280175246 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f78d4016070 con 0x7f78d8106810 2024-09-04T16:26:52.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.516+0000 7f78ca7fc640 1 -- 172.21.15.170:0/2280175246 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f78d4010d40 con 0x7f78d8106810 2024-09-04T16:26:52.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.516+0000 7f78df94c640 1 -- 172.21.15.170:0/2280175246 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d81a1cc0 con 0x7f78d8106810 2024-09-04T16:26:52.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.517+0000 7f78df94c640 1 -- 172.21.15.170:0/2280175246 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f78d80628c0 con 0x7f78d8106810 2024-09-04T16:26:52.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.517+0000 7f78ca7fc640 1 -- 172.21.15.170:0/2280175246 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f78d401b460 con 0x7f78d8106810 2024-09-04T16:26:52.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.518+0000 7f78ca7fc640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f78c406de90 0x7f78c4070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:52.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.518+0000 7f78dd6e8640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f78c406de90 0x7f78c4070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:52.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.518+0000 7f78ca7fc640 1 -- 172.21.15.170:0/2280175246 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f78d408d010 con 0x7f78d8106810 2024-09-04T16:26:52.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.518+0000 7f78ca7fc640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556] conn(0x7f78c4073c80 0x7f78c40760a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:52.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.518+0000 7f78ca7fc640 1 -- 172.21.15.170:0/2280175246 --> [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78c4076750 con 0x7f78c4073c80 2024-09-04T16:26:52.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.518+0000 7f78ca7fc640 1 -- 172.21.15.170:0/2280175246 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f78d4094050 con 0x7f78d8106810 2024-09-04T16:26:52.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.518+0000 7f78ddee9640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556] conn(0x7f78c4073c80 0x7f78c40760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:52.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.518+0000 7f78dd6e8640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f78c406de90 0x7f78c4070350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f78cc000c00 tx=0x7f78cc031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:52.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.518+0000 7f78ddee9640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556] conn(0x7f78c4073c80 0x7f78c40760a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:52.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.519+0000 7f78ca7fc640 1 -- 172.21.15.170:0/2280175246 <== osd.0 v2:172.21.15.170:6802/1158983556 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f78c4076750 con 0x7f78c4073c80 2024-09-04T16:26:52.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.532+0000 7f78df94c640 1 -- 172.21.15.170:0/2280175246 --> [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f78d8062d40 con 0x7f78c4073c80 2024-09-04T16:26:52.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.533+0000 7f78ca7fc640 1 -- 172.21.15.170:0/2280175246 <== osd.0 v2:172.21.15.170:6802/1158983556 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f78d8062d40 con 0x7f78c4073c80 2024-09-04T16:26:52.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.533+0000 7f78df94c640 1 -- 172.21.15.170:0/2280175246 >> [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556] conn(0x7f78c4073c80 msgr2=0x7f78c40760a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:52.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.533+0000 7f78df94c640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556] conn(0x7f78c4073c80 0x7f78c40760a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:52.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.533+0000 7f78df94c640 1 -- 172.21.15.170:0/2280175246 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f78c406de90 msgr2=0x7f78c4070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:52.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.533+0000 7f78df94c640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f78c406de90 0x7f78c4070350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f78cc000c00 tx=0x7f78cc031400 comp rx=0 tx=0).stop 2024-09-04T16:26:52.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.533+0000 7f78df94c640 1 -- 172.21.15.170:0/2280175246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78d8106810 msgr2=0x7f78d8198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:52.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.533+0000 7f78df94c640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78d8106810 0x7f78d8198dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f78d400b420 tx=0x7f78d400b8e0 comp rx=0 tx=0).stop 2024-09-04T16:26:52.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.533+0000 7f78df94c640 1 -- 172.21.15.170:0/2280175246 shutdown_connections 2024-09-04T16:26:52.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.533+0000 7f78df94c640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.170:6802/1158983556,v1:172.21.15.170:6803/1158983556] conn(0x7f78c4073c80 0x7f78c40760a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:52.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.533+0000 7f78df94c640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f78c406de90 0x7f78c4070350 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:52.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.533+0000 7f78df94c640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78d8106810 0x7f78d8198dd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:52.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.533+0000 7f78df94c640 1 --2- 172.21.15.170:0/2280175246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78d8100810 0x7f78d8198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:52.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.533+0000 7f78df94c640 1 -- 172.21.15.170:0/2280175246 >> 172.21.15.170:0/2280175246 conn(0x7f78d80fc510 msgr2=0x7f78d80fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:52.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.533+0000 7f78df94c640 1 -- 172.21.15.170:0/2280175246 shutdown_connections 2024-09-04T16:26:52.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:52.533+0000 7f78df94c640 1 -- 172.21.15.170:0/2280175246 wait complete. 2024-09-04T16:26:52.557 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:52 smithi193 ceph-mon[36288]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:53.382 INFO:teuthology.orchestra.run.smithi170.stdout:38654705697 2024-09-04T16:26:53.382 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-04T16:26:53.422 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:53.807 INFO:teuthology.orchestra.run.smithi170.stdout:163208757255 2024-09-04T16:26:53.808 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-04T16:26:54.032 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:54.032 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:54.035 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:54.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.224+0000 7f1f9eaf4640 1 -- 172.21.15.170:0/1400363948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f981011f0 msgr2=0x7f1f981056c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.224+0000 7f1f9eaf4640 1 --2- 172.21.15.170:0/1400363948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f981011f0 0x7f1f981056c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009880 tx=0x7f1f8402a530 comp rx=0 tx=0).stop 2024-09-04T16:26:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.224+0000 7f1f9eaf4640 1 -- 172.21.15.170:0/1400363948 shutdown_connections 2024-09-04T16:26:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.224+0000 7f1f9eaf4640 1 --2- 172.21.15.170:0/1400363948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f981011f0 0x7f1f981056c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.224+0000 7f1f9eaf4640 1 --2- 172.21.15.170:0/1400363948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f981008d0 0x7f1f98100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.224+0000 7f1f9eaf4640 1 -- 172.21.15.170:0/1400363948 >> 172.21.15.170:0/1400363948 conn(0x7f1f980fc520 msgr2=0x7f1f980fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.224+0000 7f1f9eaf4640 1 -- 172.21.15.170:0/1400363948 shutdown_connections 2024-09-04T16:26:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.224+0000 7f1f9eaf4640 1 -- 172.21.15.170:0/1400363948 wait complete. 2024-09-04T16:26:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.225+0000 7f1f9eaf4640 1 Processor -- start 2024-09-04T16:26:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.225+0000 7f1f9eaf4640 1 -- start start 2024-09-04T16:26:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.225+0000 7f1f9eaf4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f981008d0 0x7f1f9819e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.225+0000 7f1f9eaf4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f981011f0 0x7f1f9819e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.225+0000 7f1f9eaf4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1f98115470 con 0x7f1f981008d0 2024-09-04T16:26:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.225+0000 7f1f9eaf4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1f981152f0 con 0x7f1f981011f0 2024-09-04T16:26:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.225+0000 7f1f9c890640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f981008d0 0x7f1f9819e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.225+0000 7f1f9c890640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f981008d0 0x7f1f9819e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38984/0 (socket says 172.21.15.170:38984) 2024-09-04T16:26:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.225+0000 7f1f9c890640 1 -- 172.21.15.170:0/1049727093 learned_addr learned my addr 172.21.15.170:0/1049727093 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.226+0000 7f1f97fff640 1 --2- 172.21.15.170:0/1049727093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f981011f0 0x7f1f9819e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.226+0000 7f1f9c890640 1 -- 172.21.15.170:0/1049727093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f981011f0 msgr2=0x7f1f9819e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.226+0000 7f1f9c890640 1 --2- 172.21.15.170:0/1049727093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f981011f0 0x7f1f9819e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.226+0000 7f1f9c890640 1 -- 172.21.15.170:0/1049727093 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f981a2920 con 0x7f1f981008d0 2024-09-04T16:26:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.226+0000 7f1f9c890640 1 --2- 172.21.15.170:0/1049727093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f981008d0 0x7f1f9819e050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00b420 tx=0x7f1f8c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.226+0000 7f1f95ffb640 1 -- 172.21.15.170:0/1049727093 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1f8c011630 con 0x7f1f981008d0 2024-09-04T16:26:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.226+0000 7f1f9eaf4640 1 -- 172.21.15.170:0/1049727093 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f981a2c10 con 0x7f1f981008d0 2024-09-04T16:26:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.226+0000 7f1f95ffb640 1 -- 172.21.15.170:0/1049727093 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1f8c016070 con 0x7f1f981008d0 2024-09-04T16:26:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.226+0000 7f1f95ffb640 1 -- 172.21.15.170:0/1049727093 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1f8c010d40 con 0x7f1f981008d0 2024-09-04T16:26:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.226+0000 7f1f9eaf4640 1 -- 172.21.15.170:0/1049727093 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f981a31a0 con 0x7f1f981008d0 2024-09-04T16:26:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.227+0000 7f1f9eaf4640 1 -- 172.21.15.170:0/1049727093 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f9819ecd0 con 0x7f1f981008d0 2024-09-04T16:26:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.227+0000 7f1f95ffb640 1 -- 172.21.15.170:0/1049727093 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f1f8c01b460 con 0x7f1f981008d0 2024-09-04T16:26:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.228+0000 7f1f95ffb640 1 --2- 172.21.15.170:0/1049727093 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1f8806de30 0x7f1f880702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.228+0000 7f1f97fff640 1 --2- 172.21.15.170:0/1049727093 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1f8806de30 0x7f1f880702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.228+0000 7f1f95ffb640 1 -- 172.21.15.170:0/1049727093 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f1f8c08d0a0 con 0x7f1f981008d0 2024-09-04T16:26:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.228+0000 7f1f95ffb640 1 --2- 172.21.15.170:0/1049727093 >> [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737] conn(0x7f1f88073c20 0x7f1f88076040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.228+0000 7f1f95ffb640 1 -- 172.21.15.170:0/1049727093 --> [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f880766f0 con 0x7f1f88073c20 2024-09-04T16:26:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.228+0000 7f1f95ffb640 1 -- 172.21.15.170:0/1049727093 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1f8c094050 con 0x7f1f981008d0 2024-09-04T16:26:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.228+0000 7f1f9d091640 1 --2- 172.21.15.170:0/1049727093 >> [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737] conn(0x7f1f88073c20 0x7f1f88076040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.228+0000 7f1f97fff640 1 --2- 172.21.15.170:0/1049727093 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1f8806de30 0x7f1f880702f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1f98112510 tx=0x7f1f84031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.229+0000 7f1f9d091640 1 --2- 172.21.15.170:0/1049727093 >> [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737] conn(0x7f1f88073c20 0x7f1f88076040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:54.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.229+0000 7f1f95ffb640 1 -- 172.21.15.170:0/1049727093 <== osd.2 v2:172.21.15.170:6818/3174568737 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1f880766f0 con 0x7f1f88073c20 2024-09-04T16:26:54.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.244+0000 7f1f9eaf4640 1 -- 172.21.15.170:0/1049727093 --> [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1f98062880 con 0x7f1f88073c20 2024-09-04T16:26:54.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.244+0000 7f1f95ffb640 1 -- 172.21.15.170:0/1049727093 <== osd.2 v2:172.21.15.170:6818/3174568737 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1f98062880 con 0x7f1f88073c20 2024-09-04T16:26:54.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.244+0000 7f1f9eaf4640 1 -- 172.21.15.170:0/1049727093 >> [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737] conn(0x7f1f88073c20 msgr2=0x7f1f88076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:54.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.244+0000 7f1f9eaf4640 1 --2- 172.21.15.170:0/1049727093 >> [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737] conn(0x7f1f88073c20 0x7f1f88076040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:54.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.245+0000 7f1f9eaf4640 1 -- 172.21.15.170:0/1049727093 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1f8806de30 msgr2=0x7f1f880702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:54.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.245+0000 7f1f9eaf4640 1 --2- 172.21.15.170:0/1049727093 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1f8806de30 0x7f1f880702f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1f98112510 tx=0x7f1f84031400 comp rx=0 tx=0).stop 2024-09-04T16:26:54.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.245+0000 7f1f9eaf4640 1 -- 172.21.15.170:0/1049727093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f981008d0 msgr2=0x7f1f9819e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:54.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.245+0000 7f1f9eaf4640 1 --2- 172.21.15.170:0/1049727093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f981008d0 0x7f1f9819e050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00b420 tx=0x7f1f8c00b8e0 comp rx=0 tx=0).stop 2024-09-04T16:26:54.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.245+0000 7f1f9eaf4640 1 -- 172.21.15.170:0/1049727093 shutdown_connections 2024-09-04T16:26:54.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.245+0000 7f1f9eaf4640 1 --2- 172.21.15.170:0/1049727093 >> [v2:172.21.15.170:6818/3174568737,v1:172.21.15.170:6819/3174568737] conn(0x7f1f88073c20 0x7f1f88076040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:54.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.245+0000 7f1f9eaf4640 1 --2- 172.21.15.170:0/1049727093 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1f8806de30 0x7f1f880702f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:54.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.245+0000 7f1f9eaf4640 1 --2- 172.21.15.170:0/1049727093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f981011f0 0x7f1f9819e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:54.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.245+0000 7f1f9eaf4640 1 --2- 172.21.15.170:0/1049727093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f981008d0 0x7f1f9819e050 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:54.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.245+0000 7f1f9eaf4640 1 -- 172.21.15.170:0/1049727093 >> 172.21.15.170:0/1049727093 conn(0x7f1f980fc520 msgr2=0x7f1f98112c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:54.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.245+0000 7f1f9eaf4640 1 -- 172.21.15.170:0/1049727093 shutdown_connections 2024-09-04T16:26:54.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:54.245+0000 7f1f9eaf4640 1 -- 172.21.15.170:0/1049727093 wait complete. 2024-09-04T16:26:54.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:54 smithi170 ceph-mon[29272]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:54 smithi193 ceph-mon[36288]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:54.952 INFO:teuthology.orchestra.run.smithi170.stdout:81604378647 2024-09-04T16:26:54.953 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-04T16:26:55.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.431+0000 7fa02e573640 1 -- 172.21.15.170:0/818772814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa028103400 msgr2=0x7fa02810b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:55.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.431+0000 7fa02e573640 1 --2- 172.21.15.170:0/818772814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa028103400 0x7fa02810b8f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009880 tx=0x7fa01c02a530 comp rx=0 tx=0).stop 2024-09-04T16:26:55.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.431+0000 7fa02e573640 1 -- 172.21.15.170:0/818772814 shutdown_connections 2024-09-04T16:26:55.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.431+0000 7fa02e573640 1 --2- 172.21.15.170:0/818772814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa028103400 0x7fa02810b8f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:55.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.431+0000 7fa02e573640 1 --2- 172.21.15.170:0/818772814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa028102ae0 0x7fa028102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:55.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.431+0000 7fa02e573640 1 -- 172.21.15.170:0/818772814 >> 172.21.15.170:0/818772814 conn(0x7fa0280fc520 msgr2=0x7fa0280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:55.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.431+0000 7fa02e573640 1 -- 172.21.15.170:0/818772814 shutdown_connections 2024-09-04T16:26:55.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.431+0000 7fa02e573640 1 -- 172.21.15.170:0/818772814 wait complete. 2024-09-04T16:26:55.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.432+0000 7fa02e573640 1 Processor -- start 2024-09-04T16:26:55.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.432+0000 7fa02e573640 1 -- start start 2024-09-04T16:26:55.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.432+0000 7fa02e573640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa028102ae0 0x7fa02819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:55.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.432+0000 7fa02e573640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa028103400 0x7fa02819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:55.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.432+0000 7fa02e573640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa02810ee70 con 0x7fa028102ae0 2024-09-04T16:26:55.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.432+0000 7fa02e573640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa02810ecf0 con 0x7fa028103400 2024-09-04T16:26:55.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.433+0000 7fa027fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa028102ae0 0x7fa02819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:55.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.433+0000 7fa027fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa028102ae0 0x7fa02819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50236/0 (socket says 172.21.15.170:50236) 2024-09-04T16:26:55.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.433+0000 7fa027fff640 1 -- 172.21.15.170:0/3543778888 learned_addr learned my addr 172.21.15.170:0/3543778888 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:55.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.433+0000 7fa0277fe640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa028103400 0x7fa02819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:55.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.433+0000 7fa027fff640 1 -- 172.21.15.170:0/3543778888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa028103400 msgr2=0x7fa02819dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:55.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.433+0000 7fa027fff640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa028103400 0x7fa02819dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:55.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.433+0000 7fa027fff640 1 -- 172.21.15.170:0/3543778888 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa028197880 con 0x7fa028102ae0 2024-09-04T16:26:55.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.433+0000 7fa0277fe640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa028103400 0x7fa02819dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:26:55.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.433+0000 7fa027fff640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa028102ae0 0x7fa02819d6c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa01800b420 tx=0x7fa01800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:55.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.433+0000 7fa0257fa640 1 -- 172.21.15.170:0/3543778888 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa018011630 con 0x7fa028102ae0 2024-09-04T16:26:55.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.433+0000 7fa0257fa640 1 -- 172.21.15.170:0/3543778888 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa018016070 con 0x7fa028102ae0 2024-09-04T16:26:55.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.433+0000 7fa02e573640 1 -- 172.21.15.170:0/3543778888 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa028197b70 con 0x7fa028102ae0 2024-09-04T16:26:55.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.433+0000 7fa0257fa640 1 -- 172.21.15.170:0/3543778888 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa018010d40 con 0x7fa028102ae0 2024-09-04T16:26:55.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.433+0000 7fa02e573640 1 -- 172.21.15.170:0/3543778888 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0281980d0 con 0x7fa028102ae0 2024-09-04T16:26:55.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.434+0000 7fa02e573640 1 -- 172.21.15.170:0/3543778888 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa02806abe0 con 0x7fa028102ae0 2024-09-04T16:26:55.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.436+0000 7fa0257fa640 1 -- 172.21.15.170:0/3543778888 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7fa0180117d0 con 0x7fa028102ae0 2024-09-04T16:26:55.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.436+0000 7fa0257fa640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa01006de30 0x7fa0100702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:55.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.436+0000 7fa0257fa640 1 -- 172.21.15.170:0/3543778888 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fa01808dd80 con 0x7fa028102ae0 2024-09-04T16:26:55.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.436+0000 7fa0277fe640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa01006de30 0x7fa0100702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:55.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.436+0000 7fa0257fa640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.193:6800/3804134072,v1:172.21.15.193:6801/3804134072] conn(0x7fa010073c20 0x7fa010076040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:55.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.436+0000 7fa0257fa640 1 -- 172.21.15.170:0/3543778888 --> [v2:172.21.15.193:6800/3804134072,v1:172.21.15.193:6801/3804134072] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa018024e50 con 0x7fa010073c20 2024-09-04T16:26:55.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.436+0000 7fa0257fa640 1 -- 172.21.15.170:0/3543778888 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa01808e220 con 0x7fa028102ae0 2024-09-04T16:26:55.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.436+0000 7fa02cb10640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.193:6800/3804134072,v1:172.21.15.193:6801/3804134072] conn(0x7fa010073c20 0x7fa010076040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:55.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.437+0000 7fa0277fe640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa01006de30 0x7fa0100702f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa028199070 tx=0x7fa01c031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:55.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.437+0000 7fa02cb10640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.193:6800/3804134072,v1:172.21.15.193:6801/3804134072] conn(0x7fa010073c20 0x7fa010076040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:55.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.438+0000 7fa0257fa640 1 -- 172.21.15.170:0/3543778888 <== osd.3 v2:172.21.15.193:6800/3804134072 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa018024e50 con 0x7fa010073c20 2024-09-04T16:26:55.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.452+0000 7fa02e573640 1 -- 172.21.15.170:0/3543778888 --> [v2:172.21.15.193:6800/3804134072,v1:172.21.15.193:6801/3804134072] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa028062880 con 0x7fa010073c20 2024-09-04T16:26:55.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.453+0000 7fa0257fa640 1 -- 172.21.15.170:0/3543778888 <== osd.3 v2:172.21.15.193:6800/3804134072 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa028062880 con 0x7fa010073c20 2024-09-04T16:26:55.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.453+0000 7fa02e573640 1 -- 172.21.15.170:0/3543778888 >> [v2:172.21.15.193:6800/3804134072,v1:172.21.15.193:6801/3804134072] conn(0x7fa010073c20 msgr2=0x7fa010076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:55.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.453+0000 7fa02e573640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.193:6800/3804134072,v1:172.21.15.193:6801/3804134072] conn(0x7fa010073c20 0x7fa010076040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:55.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.453+0000 7fa02e573640 1 -- 172.21.15.170:0/3543778888 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa01006de30 msgr2=0x7fa0100702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:55.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.453+0000 7fa02e573640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa01006de30 0x7fa0100702f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa028199070 tx=0x7fa01c031400 comp rx=0 tx=0).stop 2024-09-04T16:26:55.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.453+0000 7fa02e573640 1 -- 172.21.15.170:0/3543778888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa028102ae0 msgr2=0x7fa02819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:55.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.453+0000 7fa02e573640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa028102ae0 0x7fa02819d6c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa01800b420 tx=0x7fa01800b8e0 comp rx=0 tx=0).stop 2024-09-04T16:26:55.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.453+0000 7fa02e573640 1 -- 172.21.15.170:0/3543778888 shutdown_connections 2024-09-04T16:26:55.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.453+0000 7fa02e573640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.193:6800/3804134072,v1:172.21.15.193:6801/3804134072] conn(0x7fa010073c20 0x7fa010076040 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:55.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.453+0000 7fa02e573640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa01006de30 0x7fa0100702f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:55.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.453+0000 7fa02e573640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa028103400 0x7fa02819dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:55.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.453+0000 7fa02e573640 1 --2- 172.21.15.170:0/3543778888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa028102ae0 0x7fa02819d6c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:55.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.453+0000 7fa02e573640 1 -- 172.21.15.170:0/3543778888 >> 172.21.15.170:0/3543778888 conn(0x7fa0280fc520 msgr2=0x7fa028108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:55.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.454+0000 7fa02e573640 1 -- 172.21.15.170:0/3543778888 shutdown_connections 2024-09-04T16:26:55.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:55.454+0000 7fa02e573640 1 -- 172.21.15.170:0/3543778888 wait complete. 2024-09-04T16:26:55.466 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:56.122 INFO:teuthology.orchestra.run.smithi170.stdout:107374182417 2024-09-04T16:26:56.123 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-04T16:26:56.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:56 smithi170 ceph-mon[29272]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:56.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:56 smithi193 ceph-mon[36288]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:56.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.740+0000 7f54fe267640 1 -- 172.21.15.170:0/4281298423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54f8101910 msgr2=0x7f54f8101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:56.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.740+0000 7f54fe267640 1 --2- 172.21.15.170:0/4281298423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54f8101910 0x7f54f8101d70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009880 tx=0x7f54e002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:26:56.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.740+0000 7f54fe267640 1 -- 172.21.15.170:0/4281298423 shutdown_connections 2024-09-04T16:26:56.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.740+0000 7f54fe267640 1 --2- 172.21.15.170:0/4281298423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54f8101910 0x7f54f8101d70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:56.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.740+0000 7f54fe267640 1 --2- 172.21.15.170:0/4281298423 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54f8107910 0x7f54f8107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:56.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.740+0000 7f54fe267640 1 -- 172.21.15.170:0/4281298423 >> 172.21.15.170:0/4281298423 conn(0x7f54f80fd5f0 msgr2=0x7f54f80ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:56.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.740+0000 7f54fe267640 1 -- 172.21.15.170:0/4281298423 shutdown_connections 2024-09-04T16:26:56.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.740+0000 7f54fe267640 1 -- 172.21.15.170:0/4281298423 wait complete. 2024-09-04T16:26:56.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.741+0000 7f54fe267640 1 Processor -- start 2024-09-04T16:26:56.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.741+0000 7f54fe267640 1 -- start start 2024-09-04T16:26:56.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.741+0000 7f54fe267640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54f8101910 0x7f54f80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:56.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.741+0000 7f54fe267640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54f8107910 0x7f54f8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:56.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.741+0000 7f54fe267640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f54f810ee40 con 0x7f54f8107910 2024-09-04T16:26:56.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.741+0000 7f54fe267640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f54f810ecc0 con 0x7f54f8101910 2024-09-04T16:26:56.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.742+0000 7f54effff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54f8107910 0x7f54f8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:56.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.742+0000 7f54effff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54f8107910 0x7f54f8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50258/0 (socket says 172.21.15.170:50258) 2024-09-04T16:26:56.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.742+0000 7f54effff640 1 -- 172.21.15.170:0/2355035348 learned_addr learned my addr 172.21.15.170:0/2355035348 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:56.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.742+0000 7f54f7fff640 1 --2- 172.21.15.170:0/2355035348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54f8101910 0x7f54f80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:56.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.742+0000 7f54effff640 1 -- 172.21.15.170:0/2355035348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54f8101910 msgr2=0x7f54f80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:56.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.742+0000 7f54effff640 1 --2- 172.21.15.170:0/2355035348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54f8101910 0x7f54f80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:56.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.742+0000 7f54effff640 1 -- 172.21.15.170:0/2355035348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f8074f70 con 0x7f54f8107910 2024-09-04T16:26:56.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.742+0000 7f54effff640 1 --2- 172.21.15.170:0/2355035348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54f8107910 0x7f54f8074a30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f54e0031460 tx=0x7f54e00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:56.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.742+0000 7f54f5ffb640 1 -- 172.21.15.170:0/2355035348 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f54e003f070 con 0x7f54f8107910 2024-09-04T16:26:56.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.742+0000 7f54fe267640 1 -- 172.21.15.170:0/2355035348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f8075200 con 0x7f54f8107910 2024-09-04T16:26:56.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.742+0000 7f54f5ffb640 1 -- 172.21.15.170:0/2355035348 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f54e0004cf0 con 0x7f54f8107910 2024-09-04T16:26:56.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.742+0000 7f54f5ffb640 1 -- 172.21.15.170:0/2355035348 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f54e0035030 con 0x7f54f8107910 2024-09-04T16:26:56.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.742+0000 7f54fe267640 1 -- 172.21.15.170:0/2355035348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f81a3e10 con 0x7f54f8107910 2024-09-04T16:26:56.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.743+0000 7f54fe267640 1 -- 172.21.15.170:0/2355035348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54f8062880 con 0x7f54f8107910 2024-09-04T16:26:56.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.744+0000 7f54f5ffb640 1 -- 172.21.15.170:0/2355035348 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f54e0042070 con 0x7f54f8107910 2024-09-04T16:26:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.744+0000 7f54f5ffb640 1 --2- 172.21.15.170:0/2355035348 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f54e406de30 0x7f54e40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.744+0000 7f54f5ffb640 1 -- 172.21.15.170:0/2355035348 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f54e00ae280 con 0x7f54f8107910 2024-09-04T16:26:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.744+0000 7f54f7fff640 1 --2- 172.21.15.170:0/2355035348 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f54e406de30 0x7f54e40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.744+0000 7f54f5ffb640 1 --2- 172.21.15.170:0/2355035348 >> [v2:172.21.15.193:6808/2691165010,v1:172.21.15.193:6809/2691165010] conn(0x7f54e4073c20 0x7f54e4076040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.744+0000 7f54f5ffb640 1 -- 172.21.15.170:0/2355035348 --> [v2:172.21.15.193:6808/2691165010,v1:172.21.15.193:6809/2691165010] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54e004ce50 con 0x7f54e4073c20 2024-09-04T16:26:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.744+0000 7f54f5ffb640 1 -- 172.21.15.170:0/2355035348 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f54e00b5050 con 0x7f54f8107910 2024-09-04T16:26:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.745+0000 7f54fc804640 1 --2- 172.21.15.170:0/2355035348 >> [v2:172.21.15.193:6808/2691165010,v1:172.21.15.193:6809/2691165010] conn(0x7f54e4073c20 0x7f54e4076040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.745+0000 7f54f7fff640 1 --2- 172.21.15.170:0/2355035348 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f54e406de30 0x7f54e40702f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009990 tx=0x7f54e8009110 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.745+0000 7f54fc804640 1 --2- 172.21.15.170:0/2355035348 >> [v2:172.21.15.193:6808/2691165010,v1:172.21.15.193:6809/2691165010] conn(0x7f54e4073c20 0x7f54e4076040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.746+0000 7f54f5ffb640 1 -- 172.21.15.170:0/2355035348 <== osd.4 v2:172.21.15.193:6808/2691165010 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f54e004ce50 con 0x7f54e4073c20 2024-09-04T16:26:56.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.770+0000 7f54fe267640 1 -- 172.21.15.170:0/2355035348 --> [v2:172.21.15.193:6808/2691165010,v1:172.21.15.193:6809/2691165010] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f54f8062c80 con 0x7f54e4073c20 2024-09-04T16:26:56.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.771+0000 7f54f5ffb640 1 -- 172.21.15.170:0/2355035348 <== osd.4 v2:172.21.15.193:6808/2691165010 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f54f8062c80 con 0x7f54e4073c20 2024-09-04T16:26:56.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.771+0000 7f54fe267640 1 -- 172.21.15.170:0/2355035348 >> [v2:172.21.15.193:6808/2691165010,v1:172.21.15.193:6809/2691165010] conn(0x7f54e4073c20 msgr2=0x7f54e4076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:56.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.771+0000 7f54fe267640 1 --2- 172.21.15.170:0/2355035348 >> [v2:172.21.15.193:6808/2691165010,v1:172.21.15.193:6809/2691165010] conn(0x7f54e4073c20 0x7f54e4076040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:56.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.771+0000 7f54fe267640 1 -- 172.21.15.170:0/2355035348 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f54e406de30 msgr2=0x7f54e40702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:56.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.771+0000 7f54fe267640 1 --2- 172.21.15.170:0/2355035348 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f54e406de30 0x7f54e40702f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009990 tx=0x7f54e8009110 comp rx=0 tx=0).stop 2024-09-04T16:26:56.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.771+0000 7f54fe267640 1 -- 172.21.15.170:0/2355035348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54f8107910 msgr2=0x7f54f8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:56.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.771+0000 7f54fe267640 1 --2- 172.21.15.170:0/2355035348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54f8107910 0x7f54f8074a30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f54e0031460 tx=0x7f54e00048f0 comp rx=0 tx=0).stop 2024-09-04T16:26:56.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.771+0000 7f54fe267640 1 -- 172.21.15.170:0/2355035348 shutdown_connections 2024-09-04T16:26:56.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.771+0000 7f54fe267640 1 --2- 172.21.15.170:0/2355035348 >> [v2:172.21.15.193:6808/2691165010,v1:172.21.15.193:6809/2691165010] conn(0x7f54e4073c20 0x7f54e4076040 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:56.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.771+0000 7f54fe267640 1 --2- 172.21.15.170:0/2355035348 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f54e406de30 0x7f54e40702f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:56.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.771+0000 7f54fe267640 1 --2- 172.21.15.170:0/2355035348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54f8107910 0x7f54f8074a30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:56.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.771+0000 7f54fe267640 1 --2- 172.21.15.170:0/2355035348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54f8101910 0x7f54f80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:56.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.771+0000 7f54fe267640 1 -- 172.21.15.170:0/2355035348 >> 172.21.15.170:0/2355035348 conn(0x7f54f80fd5f0 msgr2=0x7f54f80fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:56.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.771+0000 7f54fe267640 1 -- 172.21.15.170:0/2355035348 shutdown_connections 2024-09-04T16:26:56.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.771+0000 7f54fe267640 1 -- 172.21.15.170:0/2355035348 wait complete. 2024-09-04T16:26:56.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.948+0000 7f7befffc640 1 -- 172.21.15.170:0/3328278420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7be8102ae0 msgr2=0x7f7be8102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:56.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.948+0000 7f7befffc640 1 --2- 172.21.15.170:0/3328278420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7be8102ae0 0x7f7be8102ec0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009880 tx=0x7f7be402a530 comp rx=0 tx=0).stop 2024-09-04T16:26:56.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.948+0000 7f7befffc640 1 -- 172.21.15.170:0/3328278420 shutdown_connections 2024-09-04T16:26:56.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.948+0000 7f7befffc640 1 --2- 172.21.15.170:0/3328278420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7be8103400 0x7f7be810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:56.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.948+0000 7f7befffc640 1 --2- 172.21.15.170:0/3328278420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7be8102ae0 0x7f7be8102ec0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:56.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.948+0000 7f7befffc640 1 -- 172.21.15.170:0/3328278420 >> 172.21.15.170:0/3328278420 conn(0x7f7be80fc520 msgr2=0x7f7be80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:56.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.948+0000 7f7befffc640 1 -- 172.21.15.170:0/3328278420 shutdown_connections 2024-09-04T16:26:56.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.948+0000 7f7befffc640 1 -- 172.21.15.170:0/3328278420 wait complete. 2024-09-04T16:26:56.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.948+0000 7f7befffc640 1 Processor -- start 2024-09-04T16:26:56.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.949+0000 7f7befffc640 1 -- start start 2024-09-04T16:26:56.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.949+0000 7f7befffc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7be8102ae0 0x7f7be819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:56.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.949+0000 7f7befffc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7be8103400 0x7f7be819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:56.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.949+0000 7f7befffc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7be810ee70 con 0x7f7be8103400 2024-09-04T16:26:56.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.949+0000 7f7befffc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7be810ecf0 con 0x7f7be8102ae0 2024-09-04T16:26:56.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.949+0000 7f7bed597640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7be8103400 0x7f7be819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:56.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.949+0000 7f7bed597640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7be8103400 0x7f7be819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50284/0 (socket says 172.21.15.170:50284) 2024-09-04T16:26:56.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.949+0000 7f7bed597640 1 -- 172.21.15.170:0/1261040151 learned_addr learned my addr 172.21.15.170:0/1261040151 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:56.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.949+0000 7f7bedd98640 1 --2- 172.21.15.170:0/1261040151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7be8102ae0 0x7f7be819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:56.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.949+0000 7f7bed597640 1 -- 172.21.15.170:0/1261040151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7be8102ae0 msgr2=0x7f7be819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:56.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.949+0000 7f7bed597640 1 --2- 172.21.15.170:0/1261040151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7be8102ae0 0x7f7be819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:56.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.949+0000 7f7bed597640 1 -- 172.21.15.170:0/1261040151 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be8197860 con 0x7f7be8103400 2024-09-04T16:26:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.949+0000 7f7bed597640 1 --2- 172.21.15.170:0/1261040151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7be8103400 0x7f7be819dbe0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800b370 tx=0x7f7bd800b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.949+0000 7f7bdeffd640 1 -- 172.21.15.170:0/1261040151 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7bd8015020 con 0x7f7be8103400 2024-09-04T16:26:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.950+0000 7f7befffc640 1 -- 172.21.15.170:0/1261040151 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be8197b50 con 0x7f7be8103400 2024-09-04T16:26:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.950+0000 7f7bdeffd640 1 -- 172.21.15.170:0/1261040151 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7bd8011af0 con 0x7f7be8103400 2024-09-04T16:26:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.950+0000 7f7bdeffd640 1 -- 172.21.15.170:0/1261040151 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7bd8010d60 con 0x7f7be8103400 2024-09-04T16:26:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.950+0000 7f7befffc640 1 -- 172.21.15.170:0/1261040151 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be81980e0 con 0x7f7be8103400 2024-09-04T16:26:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.951+0000 7f7befffc640 1 -- 172.21.15.170:0/1261040151 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be806abe0 con 0x7f7be8103400 2024-09-04T16:26:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.951+0000 7f7bdeffd640 1 -- 172.21.15.170:0/1261040151 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f7bd8018020 con 0x7f7be8103400 2024-09-04T16:26:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.952+0000 7f7bdeffd640 1 --2- 172.21.15.170:0/1261040151 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f7bd406de30 0x7f7bd40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.952+0000 7f7bdeffd640 1 -- 172.21.15.170:0/1261040151 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f7bd808d2b0 con 0x7f7be8103400 2024-09-04T16:26:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.952+0000 7f7bedd98640 1 --2- 172.21.15.170:0/1261040151 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f7bd406de30 0x7f7bd40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.952+0000 7f7bedd98640 1 --2- 172.21.15.170:0/1261040151 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f7bd406de30 0x7f7bd40702f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7be4031460 tx=0x7f7be4009560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:56.956+0000 7f7bdeffd640 1 -- 172.21.15.170:0/1261040151 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7bd801f020 con 0x7f7be8103400 2024-09-04T16:26:57.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.130+0000 7f7befffc640 1 -- 172.21.15.170:0/1261040151 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7be8198d90 con 0x7f7be8103400 2024-09-04T16:26:57.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.130+0000 7f7bdeffd640 1 -- 172.21.15.170:0/1261040151 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7bd805b190 con 0x7f7be8103400 2024-09-04T16:26:57.131 INFO:teuthology.orchestra.run.smithi170.stdout:81604378647 2024-09-04T16:26:57.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.132+0000 7f7befffc640 1 -- 172.21.15.170:0/1261040151 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f7bd406de30 msgr2=0x7f7bd40702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:57.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.132+0000 7f7befffc640 1 --2- 172.21.15.170:0/1261040151 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f7bd406de30 0x7f7bd40702f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7be4031460 tx=0x7f7be4009560 comp rx=0 tx=0).stop 2024-09-04T16:26:57.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.132+0000 7f7befffc640 1 -- 172.21.15.170:0/1261040151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7be8103400 msgr2=0x7f7be819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:57.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.132+0000 7f7befffc640 1 --2- 172.21.15.170:0/1261040151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7be8103400 0x7f7be819dbe0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800b370 tx=0x7f7bd800b830 comp rx=0 tx=0).stop 2024-09-04T16:26:57.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.132+0000 7f7befffc640 1 -- 172.21.15.170:0/1261040151 shutdown_connections 2024-09-04T16:26:57.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.132+0000 7f7befffc640 1 --2- 172.21.15.170:0/1261040151 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f7bd406de30 0x7f7bd40702f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:57.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.132+0000 7f7befffc640 1 --2- 172.21.15.170:0/1261040151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7be8103400 0x7f7be819dbe0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:57.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.132+0000 7f7befffc640 1 --2- 172.21.15.170:0/1261040151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7be8102ae0 0x7f7be819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:57.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.132+0000 7f7befffc640 1 -- 172.21.15.170:0/1261040151 >> 172.21.15.170:0/1261040151 conn(0x7f7be80fc520 msgr2=0x7f7be8108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:57.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.132+0000 7f7befffc640 1 -- 172.21.15.170:0/1261040151 shutdown_connections 2024-09-04T16:26:57.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.132+0000 7f7befffc640 1 -- 172.21.15.170:0/1261040151 wait complete. 2024-09-04T16:26:57.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:57 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1261040151' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-04T16:26:57.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:57 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1261040151' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-04T16:26:57.881 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378647 got 81604378647 for osd.2 2024-09-04T16:26:57.881 DEBUG:teuthology.parallel:result is None 2024-09-04T16:26:58.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:58 smithi170 ceph-mon[29272]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:58.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:26:58 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:26:58.634 INFO:teuthology.orchestra.run.smithi170.stdout:141733920780 2024-09-04T16:26:58.635 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-04T16:26:58.637 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:58.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:58 smithi193 ceph-mon[36288]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:26:58.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:26:58 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:26:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.991+0000 7f5396353640 1 -- 172.21.15.170:0/573184576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53901034a0 msgr2=0x7f539010b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.991+0000 7f5396353640 1 --2- 172.21.15.170:0/573184576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53901034a0 0x7f539010b990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5378009880 tx=0x7f537802a530 comp rx=0 tx=0).stop 2024-09-04T16:26:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.991+0000 7f5396353640 1 -- 172.21.15.170:0/573184576 shutdown_connections 2024-09-04T16:26:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.991+0000 7f5396353640 1 --2- 172.21.15.170:0/573184576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53901034a0 0x7f539010b990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.991+0000 7f5396353640 1 --2- 172.21.15.170:0/573184576 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5390102b80 0x7f5390102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.991+0000 7f5396353640 1 -- 172.21.15.170:0/573184576 >> 172.21.15.170:0/573184576 conn(0x7f53900fc520 msgr2=0x7f53900fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.991+0000 7f5396353640 1 -- 172.21.15.170:0/573184576 shutdown_connections 2024-09-04T16:26:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.991+0000 7f5396353640 1 -- 172.21.15.170:0/573184576 wait complete. 2024-09-04T16:26:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.992+0000 7f5396353640 1 Processor -- start 2024-09-04T16:26:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.992+0000 7f5396353640 1 -- start start 2024-09-04T16:26:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.992+0000 7f5396353640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5390102b80 0x7f53901007e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.992+0000 7f5396353640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53901034a0 0x7f5390100d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.992+0000 7f5396353640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f539010ee70 con 0x7f53901034a0 2024-09-04T16:26:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.992+0000 7f5396353640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f539010ecf0 con 0x7f5390102b80 2024-09-04T16:26:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.992+0000 7f538f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53901034a0 0x7f5390100d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.992+0000 7f538f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53901034a0 0x7f5390100d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50312/0 (socket says 172.21.15.170:50312) 2024-09-04T16:26:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.992+0000 7f538f7fe640 1 -- 172.21.15.170:0/3681845398 learned_addr learned my addr 172.21.15.170:0/3681845398 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.992+0000 7f538ffff640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5390102b80 0x7f53901007e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.993+0000 7f538f7fe640 1 -- 172.21.15.170:0/3681845398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5390102b80 msgr2=0x7f53901007e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.993+0000 7f538f7fe640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5390102b80 0x7f53901007e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.993+0000 7f538f7fe640 1 -- 172.21.15.170:0/3681845398 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5390101260 con 0x7f53901034a0 2024-09-04T16:26:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.993+0000 7f538ffff640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5390102b80 0x7f53901007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:26:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.993+0000 7f538f7fe640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53901034a0 0x7f5390100d20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5378004f90 tx=0x7f53780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:58.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.993+0000 7f538d7fa640 1 -- 172.21.15.170:0/3681845398 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f537803f070 con 0x7f53901034a0 2024-09-04T16:26:58.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.993+0000 7f538d7fa640 1 -- 172.21.15.170:0/3681845398 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5378004cf0 con 0x7f53901034a0 2024-09-04T16:26:58.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.993+0000 7f5396353640 1 -- 172.21.15.170:0/3681845398 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53901014f0 con 0x7f53901034a0 2024-09-04T16:26:58.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.993+0000 7f538d7fa640 1 -- 172.21.15.170:0/3681845398 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5378035030 con 0x7f53901034a0 2024-09-04T16:26:58.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.993+0000 7f5396353640 1 -- 172.21.15.170:0/3681845398 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53901a3e20 con 0x7f53901034a0 2024-09-04T16:26:58.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.994+0000 7f5396353640 1 -- 172.21.15.170:0/3681845398 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5390062880 con 0x7f53901034a0 2024-09-04T16:26:58.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.995+0000 7f538d7fa640 1 -- 172.21.15.170:0/3681845398 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f5378042070 con 0x7f53901034a0 2024-09-04T16:26:58.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.995+0000 7f538d7fa640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f537c06de30 0x7f537c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:58.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.995+0000 7f538d7fa640 1 -- 172.21.15.170:0/3681845398 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f53780ae320 con 0x7f53901034a0 2024-09-04T16:26:58.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.995+0000 7f538ffff640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f537c06de30 0x7f537c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:58.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.995+0000 7f538d7fa640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441] conn(0x7f537c073c20 0x7f537c076040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:58.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.995+0000 7f538d7fa640 1 -- 172.21.15.170:0/3681845398 --> [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53780054e0 con 0x7f537c073c20 2024-09-04T16:26:58.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.995+0000 7f538d7fa640 1 -- 172.21.15.170:0/3681845398 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f53780b5050 con 0x7f53901034a0 2024-09-04T16:26:58.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.995+0000 7f53948f0640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441] conn(0x7f537c073c20 0x7f537c076040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:58.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.996+0000 7f538ffff640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f537c06de30 0x7f537c0702f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5380009930 tx=0x7f5380008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:58.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.996+0000 7f53948f0640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441] conn(0x7f537c073c20 0x7f537c076040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:58.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:57.996+0000 7f538d7fa640 1 -- 172.21.15.170:0/3681845398 <== osd.1 v2:172.21.15.170:6810/600576441 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53780054e0 con 0x7f537c073c20 2024-09-04T16:26:58.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:58.010+0000 7f5396353640 1 -- 172.21.15.170:0/3681845398 --> [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5390062cd0 con 0x7f537c073c20 2024-09-04T16:26:58.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:58.010+0000 7f538d7fa640 1 -- 172.21.15.170:0/3681845398 <== osd.1 v2:172.21.15.170:6810/600576441 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5390062cd0 con 0x7f537c073c20 2024-09-04T16:26:58.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:58.010+0000 7f5396353640 1 -- 172.21.15.170:0/3681845398 >> [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441] conn(0x7f537c073c20 msgr2=0x7f537c076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:58.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:58.010+0000 7f5396353640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441] conn(0x7f537c073c20 0x7f537c076040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:58.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:58.010+0000 7f5396353640 1 -- 172.21.15.170:0/3681845398 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f537c06de30 msgr2=0x7f537c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:58.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:58.010+0000 7f5396353640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f537c06de30 0x7f537c0702f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5380009930 tx=0x7f5380008040 comp rx=0 tx=0).stop 2024-09-04T16:26:58.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:58.010+0000 7f5396353640 1 -- 172.21.15.170:0/3681845398 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53901034a0 msgr2=0x7f5390100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:58.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:58.010+0000 7f5396353640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53901034a0 0x7f5390100d20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5378004f90 tx=0x7f53780048f0 comp rx=0 tx=0).stop 2024-09-04T16:26:58.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:58.010+0000 7f5396353640 1 -- 172.21.15.170:0/3681845398 shutdown_connections 2024-09-04T16:26:58.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:58.010+0000 7f5396353640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.170:6810/600576441,v1:172.21.15.170:6811/600576441] conn(0x7f537c073c20 0x7f537c076040 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:58.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:58.010+0000 7f5396353640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f537c06de30 0x7f537c0702f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:58.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:58.010+0000 7f5396353640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53901034a0 0x7f5390100d20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:58.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:58.010+0000 7f5396353640 1 --2- 172.21.15.170:0/3681845398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5390102b80 0x7f53901007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:58.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:58.010+0000 7f5396353640 1 -- 172.21.15.170:0/3681845398 >> 172.21.15.170:0/3681845398 conn(0x7f53900fc520 msgr2=0x7f5390103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:58.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:58.010+0000 7f5396353640 1 -- 172.21.15.170:0/3681845398 shutdown_connections 2024-09-04T16:26:58.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:58.010+0000 7f5396353640 1 -- 172.21.15.170:0/3681845398 wait complete. 2024-09-04T16:26:58.906 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:59.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.308+0000 7f1e4427b640 1 -- 172.21.15.170:0/3160027505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3c074510 msgr2=0x7f1e3c0748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:59.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.308+0000 7f1e4427b640 1 --2- 172.21.15.170:0/3160027505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3c074510 0x7f1e3c0748f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009880 tx=0x7f1e3402a530 comp rx=0 tx=0).stop 2024-09-04T16:26:59.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.308+0000 7f1e4427b640 1 -- 172.21.15.170:0/3160027505 shutdown_connections 2024-09-04T16:26:59.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.308+0000 7f1e4427b640 1 --2- 172.21.15.170:0/3160027505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e3c074e30 0x7f1e3c10dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:59.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.308+0000 7f1e4427b640 1 --2- 172.21.15.170:0/3160027505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3c074510 0x7f1e3c0748f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:59.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.308+0000 7f1e4427b640 1 -- 172.21.15.170:0/3160027505 >> 172.21.15.170:0/3160027505 conn(0x7f1e3c0fd630 msgr2=0x7f1e3c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:59.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.308+0000 7f1e4427b640 1 -- 172.21.15.170:0/3160027505 shutdown_connections 2024-09-04T16:26:59.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.308+0000 7f1e4427b640 1 -- 172.21.15.170:0/3160027505 wait complete. 2024-09-04T16:26:59.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.309+0000 7f1e4427b640 1 Processor -- start 2024-09-04T16:26:59.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.309+0000 7f1e4427b640 1 -- start start 2024-09-04T16:26:59.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.309+0000 7f1e4427b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3c074510 0x7f1e3c19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:59.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.309+0000 7f1e4427b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e3c074e30 0x7f1e3c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:59.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.309+0000 7f1e4427b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3c110ff0 con 0x7f1e3c074510 2024-09-04T16:26:59.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.309+0000 7f1e4427b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3c110e70 con 0x7f1e3c074e30 2024-09-04T16:26:59.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.309+0000 7f1e42017640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3c074510 0x7f1e3c19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:59.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.309+0000 7f1e42017640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3c074510 0x7f1e3c19f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50336/0 (socket says 172.21.15.170:50336) 2024-09-04T16:26:59.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.309+0000 7f1e42017640 1 -- 172.21.15.170:0/1869669758 learned_addr learned my addr 172.21.15.170:0/1869669758 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:26:59.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.309+0000 7f1e41816640 1 --2- 172.21.15.170:0/1869669758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e3c074e30 0x7f1e3c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:59.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.309+0000 7f1e42017640 1 -- 172.21.15.170:0/1869669758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e3c074e30 msgr2=0x7f1e3c19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:59.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.309+0000 7f1e42017640 1 --2- 172.21.15.170:0/1869669758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e3c074e30 0x7f1e3c19fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:59.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.309+0000 7f1e42017640 1 -- 172.21.15.170:0/1869669758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e3c1999c0 con 0x7f1e3c074510 2024-09-04T16:26:59.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.309+0000 7f1e42017640 1 --2- 172.21.15.170:0/1869669758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3c074510 0x7f1e3c19f800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1e34031460 tx=0x7f1e340045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:59.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.310+0000 7f1e3b7fe640 1 -- 172.21.15.170:0/1869669758 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e3403f070 con 0x7f1e3c074510 2024-09-04T16:26:59.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.310+0000 7f1e3b7fe640 1 -- 172.21.15.170:0/1869669758 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e340035f0 con 0x7f1e3c074510 2024-09-04T16:26:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.310+0000 7f1e4427b640 1 -- 172.21.15.170:0/1869669758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e3c199c50 con 0x7f1e3c074510 2024-09-04T16:26:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.310+0000 7f1e3b7fe640 1 -- 172.21.15.170:0/1869669758 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e34035030 con 0x7f1e3c074510 2024-09-04T16:26:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.310+0000 7f1e4427b640 1 -- 172.21.15.170:0/1869669758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e3c19a180 con 0x7f1e3c074510 2024-09-04T16:26:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.311+0000 7f1e4427b640 1 -- 172.21.15.170:0/1869669758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e3c075c50 con 0x7f1e3c074510 2024-09-04T16:26:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.311+0000 7f1e3b7fe640 1 -- 172.21.15.170:0/1869669758 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f1e34042070 con 0x7f1e3c074510 2024-09-04T16:26:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.311+0000 7f1e3b7fe640 1 --2- 172.21.15.170:0/1869669758 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1e2406de30 0x7f1e240702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:26:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.312+0000 7f1e3b7fe640 1 -- 172.21.15.170:0/1869669758 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f1e340ae240 con 0x7f1e3c074510 2024-09-04T16:26:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.312+0000 7f1e41816640 1 --2- 172.21.15.170:0/1869669758 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1e2406de30 0x7f1e240702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:26:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.312+0000 7f1e41816640 1 --2- 172.21.15.170:0/1869669758 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1e2406de30 0x7f1e240702f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c10ace0 tx=0x7f1e30009870 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:26:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.316+0000 7f1e3b7fe640 1 -- 172.21.15.170:0/1869669758 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e3407c120 con 0x7f1e3c074510 2024-09-04T16:26:59.371 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:26:59.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.508+0000 7f1e4427b640 1 -- 172.21.15.170:0/1869669758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1e3c19a430 con 0x7f1e3c074510 2024-09-04T16:26:59.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.508+0000 7f1e3b7fe640 1 -- 172.21.15.170:0/1869669758 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1e3407fdd0 con 0x7f1e3c074510 2024-09-04T16:26:59.510 INFO:teuthology.orchestra.run.smithi170.stdout:38654705698 2024-09-04T16:26:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.511+0000 7f1e4427b640 1 -- 172.21.15.170:0/1869669758 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1e2406de30 msgr2=0x7f1e240702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.511+0000 7f1e4427b640 1 --2- 172.21.15.170:0/1869669758 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1e2406de30 0x7f1e240702f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c10ace0 tx=0x7f1e30009870 comp rx=0 tx=0).stop 2024-09-04T16:26:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.511+0000 7f1e4427b640 1 -- 172.21.15.170:0/1869669758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3c074510 msgr2=0x7f1e3c19f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:26:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.511+0000 7f1e4427b640 1 --2- 172.21.15.170:0/1869669758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3c074510 0x7f1e3c19f800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1e34031460 tx=0x7f1e340045e0 comp rx=0 tx=0).stop 2024-09-04T16:26:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.511+0000 7f1e4427b640 1 -- 172.21.15.170:0/1869669758 shutdown_connections 2024-09-04T16:26:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.511+0000 7f1e4427b640 1 --2- 172.21.15.170:0/1869669758 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1e2406de30 0x7f1e240702f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.511+0000 7f1e4427b640 1 --2- 172.21.15.170:0/1869669758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e3c074e30 0x7f1e3c19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.511+0000 7f1e4427b640 1 --2- 172.21.15.170:0/1869669758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3c074510 0x7f1e3c19f800 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:26:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.511+0000 7f1e4427b640 1 -- 172.21.15.170:0/1869669758 >> 172.21.15.170:0/1869669758 conn(0x7f1e3c0fd630 msgr2=0x7f1e3c10d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:26:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.511+0000 7f1e4427b640 1 -- 172.21.15.170:0/1869669758 shutdown_connections 2024-09-04T16:26:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:26:59.511+0000 7f1e4427b640 1 -- 172.21.15.170:0/1869669758 wait complete. 2024-09-04T16:26:59.825 INFO:teuthology.orchestra.run.smithi170.stdout:60129542172 2024-09-04T16:26:59.826 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-04T16:27:00.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.223+0000 7f1b26597640 1 -- 172.21.15.170:0/3828015384 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b20102ad0 msgr2=0x7f1b20102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:00.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.223+0000 7f1b26597640 1 --2- 172.21.15.170:0/3828015384 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b20102ad0 0x7f1b20102eb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009880 tx=0x7f1b1002a530 comp rx=0 tx=0).stop 2024-09-04T16:27:00.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.223+0000 7f1b26597640 1 -- 172.21.15.170:0/3828015384 shutdown_connections 2024-09-04T16:27:00.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.223+0000 7f1b26597640 1 --2- 172.21.15.170:0/3828015384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b201033f0 0x7f1b2010b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:00.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.223+0000 7f1b26597640 1 --2- 172.21.15.170:0/3828015384 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b20102ad0 0x7f1b20102eb0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:00.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.223+0000 7f1b26597640 1 -- 172.21.15.170:0/3828015384 >> 172.21.15.170:0/3828015384 conn(0x7f1b200fc510 msgr2=0x7f1b200fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:00.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.223+0000 7f1b26597640 1 -- 172.21.15.170:0/3828015384 shutdown_connections 2024-09-04T16:27:00.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.223+0000 7f1b26597640 1 -- 172.21.15.170:0/3828015384 wait complete. 2024-09-04T16:27:00.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.224+0000 7f1b26597640 1 Processor -- start 2024-09-04T16:27:00.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.224+0000 7f1b26597640 1 -- start start 2024-09-04T16:27:00.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.224+0000 7f1b26597640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b20102ad0 0x7f1b2019d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:00.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.224+0000 7f1b26597640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b201033f0 0x7f1b2019dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:00.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.224+0000 7f1b26597640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2010ede0 con 0x7f1b20102ad0 2024-09-04T16:27:00.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.224+0000 7f1b26597640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2010ec60 con 0x7f1b201033f0 2024-09-04T16:27:00.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.224+0000 7f1b1ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b20102ad0 0x7f1b2019d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:00.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.224+0000 7f1b1ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b20102ad0 0x7f1b2019d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50354/0 (socket says 172.21.15.170:50354) 2024-09-04T16:27:00.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.224+0000 7f1b1ffff640 1 -- 172.21.15.170:0/2803811755 learned_addr learned my addr 172.21.15.170:0/2803811755 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:00.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.224+0000 7f1b1f7fe640 1 --2- 172.21.15.170:0/2803811755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b201033f0 0x7f1b2019dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:00.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.225+0000 7f1b1ffff640 1 -- 172.21.15.170:0/2803811755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b201033f0 msgr2=0x7f1b2019dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:00.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.225+0000 7f1b1ffff640 1 --2- 172.21.15.170:0/2803811755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b201033f0 0x7f1b2019dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:00.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.225+0000 7f1b1ffff640 1 -- 172.21.15.170:0/2803811755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b201978f0 con 0x7f1b20102ad0 2024-09-04T16:27:00.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.225+0000 7f1b1ffff640 1 --2- 172.21.15.170:0/2803811755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b20102ad0 0x7f1b2019d730 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1b10031460 tx=0x7f1b100045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:00.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.225+0000 7f1b1d7fa640 1 -- 172.21.15.170:0/2803811755 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b1003f070 con 0x7f1b20102ad0 2024-09-04T16:27:00.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.225+0000 7f1b1d7fa640 1 -- 172.21.15.170:0/2803811755 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b100035f0 con 0x7f1b20102ad0 2024-09-04T16:27:00.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.225+0000 7f1b26597640 1 -- 172.21.15.170:0/2803811755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b20197b80 con 0x7f1b20102ad0 2024-09-04T16:27:00.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.225+0000 7f1b1d7fa640 1 -- 172.21.15.170:0/2803811755 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b10035030 con 0x7f1b20102ad0 2024-09-04T16:27:00.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.225+0000 7f1b26597640 1 -- 172.21.15.170:0/2803811755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b201980b0 con 0x7f1b20102ad0 2024-09-04T16:27:00.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.226+0000 7f1b26597640 1 -- 172.21.15.170:0/2803811755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b2006abe0 con 0x7f1b20102ad0 2024-09-04T16:27:00.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.226+0000 7f1b1d7fa640 1 -- 172.21.15.170:0/2803811755 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f1b10042070 con 0x7f1b20102ad0 2024-09-04T16:27:00.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.227+0000 7f1b1d7fa640 1 --2- 172.21.15.170:0/2803811755 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1b0806de90 0x7f1b08070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:00.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.227+0000 7f1b1d7fa640 1 -- 172.21.15.170:0/2803811755 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f1b100ae090 con 0x7f1b20102ad0 2024-09-04T16:27:00.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.227+0000 7f1b1f7fe640 1 --2- 172.21.15.170:0/2803811755 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1b0806de90 0x7f1b08070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:00.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.227+0000 7f1b1f7fe640 1 --2- 172.21.15.170:0/2803811755 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1b0806de90 0x7f1b08070350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1b200feeb0 tx=0x7f1b1400b360 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:00.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.231+0000 7f1b1d7fa640 1 -- 172.21.15.170:0/2803811755 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b1007fca0 con 0x7f1b20102ad0 2024-09-04T16:27:00.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.403+0000 7f1b26597640 1 -- 172.21.15.170:0/2803811755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1b20105fd0 con 0x7f1b20102ad0 2024-09-04T16:27:00.404 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:00 smithi170 ceph-mon[29272]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:00.404 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:00 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1869669758' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-04T16:27:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.403+0000 7f1b1d7fa640 1 -- 172.21.15.170:0/2803811755 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1b100844d0 con 0x7f1b20102ad0 2024-09-04T16:27:00.405 INFO:teuthology.orchestra.run.smithi170.stdout:107374182418 2024-09-04T16:27:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.405+0000 7f1b26597640 1 -- 172.21.15.170:0/2803811755 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1b0806de90 msgr2=0x7f1b08070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.405+0000 7f1b26597640 1 --2- 172.21.15.170:0/2803811755 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1b0806de90 0x7f1b08070350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1b200feeb0 tx=0x7f1b1400b360 comp rx=0 tx=0).stop 2024-09-04T16:27:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.405+0000 7f1b26597640 1 -- 172.21.15.170:0/2803811755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b20102ad0 msgr2=0x7f1b2019d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.405+0000 7f1b26597640 1 --2- 172.21.15.170:0/2803811755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b20102ad0 0x7f1b2019d730 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1b10031460 tx=0x7f1b100045e0 comp rx=0 tx=0).stop 2024-09-04T16:27:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.405+0000 7f1b26597640 1 -- 172.21.15.170:0/2803811755 shutdown_connections 2024-09-04T16:27:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.406+0000 7f1b26597640 1 --2- 172.21.15.170:0/2803811755 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f1b0806de90 0x7f1b08070350 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.406+0000 7f1b26597640 1 --2- 172.21.15.170:0/2803811755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b201033f0 0x7f1b2019dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.406+0000 7f1b26597640 1 --2- 172.21.15.170:0/2803811755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b20102ad0 0x7f1b2019d730 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.406+0000 7f1b26597640 1 -- 172.21.15.170:0/2803811755 >> 172.21.15.170:0/2803811755 conn(0x7f1b200fc510 msgr2=0x7f1b20108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.406+0000 7f1b26597640 1 -- 172.21.15.170:0/2803811755 shutdown_connections 2024-09-04T16:27:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:00.406+0000 7f1b26597640 1 -- 172.21.15.170:0/2803811755 wait complete. 2024-09-04T16:27:00.417 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:00.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:00 smithi193 ceph-mon[36288]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:00.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:00 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1869669758' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-04T16:27:01.320 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:01 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2803811755' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-04T16:27:01.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.316+0000 7f49e2b81640 1 -- 172.21.15.170:0/3582193816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49dc1067e0 msgr2=0x7f49dc106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:01.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.316+0000 7f49e2b81640 1 --2- 172.21.15.170:0/3582193816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49dc1067e0 0x7f49dc106bc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009880 tx=0x7f49d002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:01.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.316+0000 7f49e2b81640 1 -- 172.21.15.170:0/3582193816 shutdown_connections 2024-09-04T16:27:01.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.316+0000 7f49e2b81640 1 --2- 172.21.15.170:0/3582193816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49dc1007e0 0x7f49dc100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:01.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.316+0000 7f49e2b81640 1 --2- 172.21.15.170:0/3582193816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49dc1067e0 0x7f49dc106bc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:01.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.316+0000 7f49e2b81640 1 -- 172.21.15.170:0/3582193816 >> 172.21.15.170:0/3582193816 conn(0x7f49dc0fc4c0 msgr2=0x7f49dc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:01.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.317+0000 7f49e2b81640 1 -- 172.21.15.170:0/3582193816 shutdown_connections 2024-09-04T16:27:01.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.317+0000 7f49e2b81640 1 -- 172.21.15.170:0/3582193816 wait complete. 2024-09-04T16:27:01.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.317+0000 7f49e2b81640 1 Processor -- start 2024-09-04T16:27:01.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.317+0000 7f49e2b81640 1 -- start start 2024-09-04T16:27:01.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.317+0000 7f49e2b81640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49dc1007e0 0x7f49dc198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.317+0000 7f49e2b81640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49dc1067e0 0x7f49dc198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.317+0000 7f49e2b81640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc10dcb0 con 0x7f49dc1067e0 2024-09-04T16:27:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.317+0000 7f49e2b81640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc10db30 con 0x7f49dc1007e0 2024-09-04T16:27:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.317+0000 7f49dbfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49dc1067e0 0x7f49dc198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.317+0000 7f49dbfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49dc1067e0 0x7f49dc198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50380/0 (socket says 172.21.15.170:50380) 2024-09-04T16:27:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.317+0000 7f49dbfff640 1 -- 172.21.15.170:0/2559965931 learned_addr learned my addr 172.21.15.170:0/2559965931 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.318+0000 7f49e091d640 1 --2- 172.21.15.170:0/2559965931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49dc1007e0 0x7f49dc198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.318+0000 7f49dbfff640 1 -- 172.21.15.170:0/2559965931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49dc1007e0 msgr2=0x7f49dc198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.318+0000 7f49dbfff640 1 --2- 172.21.15.170:0/2559965931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49dc1007e0 0x7f49dc198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.318+0000 7f49dbfff640 1 -- 172.21.15.170:0/2559965931 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49dc199360 con 0x7f49dc1067e0 2024-09-04T16:27:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.318+0000 7f49dbfff640 1 --2- 172.21.15.170:0/2559965931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49dc1067e0 0x7f49dc198d60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f49c800d6f0 tx=0x7f49c800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.318+0000 7f49d9ffb640 1 -- 172.21.15.170:0/2559965931 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f49c8017070 con 0x7f49dc1067e0 2024-09-04T16:27:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.318+0000 7f49d9ffb640 1 -- 172.21.15.170:0/2559965931 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f49c800de00 con 0x7f49dc1067e0 2024-09-04T16:27:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.318+0000 7f49e2b81640 1 -- 172.21.15.170:0/2559965931 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49dc199650 con 0x7f49dc1067e0 2024-09-04T16:27:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.318+0000 7f49d9ffb640 1 -- 172.21.15.170:0/2559965931 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f49c8004bb0 con 0x7f49dc1067e0 2024-09-04T16:27:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.318+0000 7f49e2b81640 1 -- 172.21.15.170:0/2559965931 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49dc1a1c50 con 0x7f49dc1067e0 2024-09-04T16:27:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.319+0000 7f49e2b81640 1 -- 172.21.15.170:0/2559965931 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49dc101f20 con 0x7f49dc1067e0 2024-09-04T16:27:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.320+0000 7f49d9ffb640 1 -- 172.21.15.170:0/2559965931 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f49c8004e60 con 0x7f49dc1067e0 2024-09-04T16:27:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.320+0000 7f49d9ffb640 1 --2- 172.21.15.170:0/2559965931 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f49cc06de30 0x7f49cc0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.320+0000 7f49d9ffb640 1 -- 172.21.15.170:0/2559965931 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f49c808d390 con 0x7f49dc1067e0 2024-09-04T16:27:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.320+0000 7f49e091d640 1 --2- 172.21.15.170:0/2559965931 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f49cc06de30 0x7f49cc0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.321+0000 7f49e091d640 1 --2- 172.21.15.170:0/2559965931 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f49cc06de30 0x7f49cc0702f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f49d00096c0 tx=0x7f49d0031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.325+0000 7f49d9ffb640 1 -- 172.21.15.170:0/2559965931 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f49dc199650 con 0x7f49dc1067e0 2024-09-04T16:27:01.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.494+0000 7f49e2b81640 1 -- 172.21.15.170:0/2559965931 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f49dc108d50 con 0x7f49dc1067e0 2024-09-04T16:27:01.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.495+0000 7f49d9ffb640 1 -- 172.21.15.170:0/2559965931 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f49c805ef20 con 0x7f49dc1067e0 2024-09-04T16:27:01.496 INFO:teuthology.orchestra.run.smithi170.stdout:141733920781 2024-09-04T16:27:01.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.497+0000 7f49e2b81640 1 -- 172.21.15.170:0/2559965931 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f49cc06de30 msgr2=0x7f49cc0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:01.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.497+0000 7f49e2b81640 1 --2- 172.21.15.170:0/2559965931 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f49cc06de30 0x7f49cc0702f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f49d00096c0 tx=0x7f49d0031400 comp rx=0 tx=0).stop 2024-09-04T16:27:01.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.497+0000 7f49e2b81640 1 -- 172.21.15.170:0/2559965931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49dc1067e0 msgr2=0x7f49dc198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:01.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.497+0000 7f49e2b81640 1 --2- 172.21.15.170:0/2559965931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49dc1067e0 0x7f49dc198d60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f49c800d6f0 tx=0x7f49c800dbb0 comp rx=0 tx=0).stop 2024-09-04T16:27:01.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.497+0000 7f49e2b81640 1 -- 172.21.15.170:0/2559965931 shutdown_connections 2024-09-04T16:27:01.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.497+0000 7f49e2b81640 1 --2- 172.21.15.170:0/2559965931 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f49cc06de30 0x7f49cc0702f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:01.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.497+0000 7f49e2b81640 1 --2- 172.21.15.170:0/2559965931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49dc1067e0 0x7f49dc198d60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:01.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.497+0000 7f49e2b81640 1 --2- 172.21.15.170:0/2559965931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49dc1007e0 0x7f49dc198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:01.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.497+0000 7f49e2b81640 1 -- 172.21.15.170:0/2559965931 >> 172.21.15.170:0/2559965931 conn(0x7f49dc0fc4c0 msgr2=0x7f49dc0fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:01.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.497+0000 7f49e2b81640 1 -- 172.21.15.170:0/2559965931 shutdown_connections 2024-09-04T16:27:01.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.497+0000 7f49e2b81640 1 -- 172.21.15.170:0/2559965931 wait complete. 2024-09-04T16:27:01.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:01 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2803811755' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-04T16:27:01.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.672+0000 7f7b2defd640 1 -- 172.21.15.170:0/4223870239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b28102b40 msgr2=0x7f7b28102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:01.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.672+0000 7f7b2defd640 1 --2- 172.21.15.170:0/4223870239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b28102b40 0x7f7b28102f20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7b180098b0 tx=0x7f7b1802a560 comp rx=0 tx=0).stop 2024-09-04T16:27:01.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.672+0000 7f7b2defd640 1 -- 172.21.15.170:0/4223870239 shutdown_connections 2024-09-04T16:27:01.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.672+0000 7f7b2defd640 1 --2- 172.21.15.170:0/4223870239 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b28103460 0x7f7b2810b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:01.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.672+0000 7f7b2defd640 1 --2- 172.21.15.170:0/4223870239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b28102b40 0x7f7b28102f20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:01.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.672+0000 7f7b2defd640 1 -- 172.21.15.170:0/4223870239 >> 172.21.15.170:0/4223870239 conn(0x7f7b280fc520 msgr2=0x7f7b280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.672+0000 7f7b2defd640 1 -- 172.21.15.170:0/4223870239 shutdown_connections 2024-09-04T16:27:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.672+0000 7f7b2defd640 1 -- 172.21.15.170:0/4223870239 wait complete. 2024-09-04T16:27:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.673+0000 7f7b2defd640 1 Processor -- start 2024-09-04T16:27:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.673+0000 7f7b2defd640 1 -- start start 2024-09-04T16:27:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.673+0000 7f7b2defd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b28102b40 0x7f7b2819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.673+0000 7f7b2defd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b28103460 0x7f7b2819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.673+0000 7f7b2defd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2810edf0 con 0x7f7b28102b40 2024-09-04T16:27:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.673+0000 7f7b2defd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2810ec70 con 0x7f7b28103460 2024-09-04T16:27:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.673+0000 7f7b277fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b28102b40 0x7f7b2819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.673+0000 7f7b277fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b28102b40 0x7f7b2819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50394/0 (socket says 172.21.15.170:50394) 2024-09-04T16:27:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.673+0000 7f7b277fe640 1 -- 172.21.15.170:0/1631919749 learned_addr learned my addr 172.21.15.170:0/1631919749 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.673+0000 7f7b1ffff640 1 --2- 172.21.15.170:0/1631919749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b28103460 0x7f7b2819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.674+0000 7f7b277fe640 1 -- 172.21.15.170:0/1631919749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b28103460 msgr2=0x7f7b2819dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.674+0000 7f7b277fe640 1 --2- 172.21.15.170:0/1631919749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b28103460 0x7f7b2819dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.674+0000 7f7b277fe640 1 -- 172.21.15.170:0/1631919749 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b28197840 con 0x7f7b28102b40 2024-09-04T16:27:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.674+0000 7f7b277fe640 1 --2- 172.21.15.170:0/1631919749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b28102b40 0x7f7b2819d6c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7b18031460 tx=0x7f7b180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.674+0000 7f7b257fa640 1 -- 172.21.15.170:0/1631919749 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b1803f070 con 0x7f7b28102b40 2024-09-04T16:27:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.674+0000 7f7b257fa640 1 -- 172.21.15.170:0/1631919749 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b180044d0 con 0x7f7b28102b40 2024-09-04T16:27:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.674+0000 7f7b2defd640 1 -- 172.21.15.170:0/1631919749 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b28197ad0 con 0x7f7b28102b40 2024-09-04T16:27:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.674+0000 7f7b257fa640 1 -- 172.21.15.170:0/1631919749 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b18035030 con 0x7f7b28102b40 2024-09-04T16:27:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.674+0000 7f7b2defd640 1 -- 172.21.15.170:0/1631919749 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b28198000 con 0x7f7b28102b40 2024-09-04T16:27:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.675+0000 7f7b2defd640 1 -- 172.21.15.170:0/1631919749 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b2806ab80 con 0x7f7b28102b40 2024-09-04T16:27:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.675+0000 7f7b257fa640 1 -- 172.21.15.170:0/1631919749 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f7b18042070 con 0x7f7b28102b40 2024-09-04T16:27:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.676+0000 7f7b257fa640 1 --2- 172.21.15.170:0/1631919749 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f7b1406de30 0x7f7b140702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.676+0000 7f7b1ffff640 1 --2- 172.21.15.170:0/1631919749 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f7b1406de30 0x7f7b140702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.676+0000 7f7b257fa640 1 -- 172.21.15.170:0/1631919749 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f7b180ae230 con 0x7f7b28102b40 2024-09-04T16:27:01.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.676+0000 7f7b1ffff640 1 --2- 172.21.15.170:0/1631919749 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f7b1406de30 0x7f7b140702f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7b10005e10 tx=0x7f7b10005da0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:01.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.680+0000 7f7b257fa640 1 -- 172.21.15.170:0/1631919749 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7b1807c110 con 0x7f7b28102b40 2024-09-04T16:27:01.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.849+0000 7f7b2defd640 1 -- 172.21.15.170:0/1631919749 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7b28198d70 con 0x7f7b28102b40 2024-09-04T16:27:01.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.850+0000 7f7b257fa640 1 -- 172.21.15.170:0/1631919749 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7b18004cf0 con 0x7f7b28102b40 2024-09-04T16:27:01.851 INFO:teuthology.orchestra.run.smithi170.stdout:163208757256 2024-09-04T16:27:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.852+0000 7f7b2defd640 1 -- 172.21.15.170:0/1631919749 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f7b1406de30 msgr2=0x7f7b140702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.852+0000 7f7b2defd640 1 --2- 172.21.15.170:0/1631919749 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f7b1406de30 0x7f7b140702f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7b10005e10 tx=0x7f7b10005da0 comp rx=0 tx=0).stop 2024-09-04T16:27:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.852+0000 7f7b2defd640 1 -- 172.21.15.170:0/1631919749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b28102b40 msgr2=0x7f7b2819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.852+0000 7f7b2defd640 1 --2- 172.21.15.170:0/1631919749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b28102b40 0x7f7b2819d6c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7b18031460 tx=0x7f7b180048f0 comp rx=0 tx=0).stop 2024-09-04T16:27:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.852+0000 7f7b2defd640 1 -- 172.21.15.170:0/1631919749 shutdown_connections 2024-09-04T16:27:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.852+0000 7f7b2defd640 1 --2- 172.21.15.170:0/1631919749 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f7b1406de30 0x7f7b140702f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.852+0000 7f7b2defd640 1 --2- 172.21.15.170:0/1631919749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b28103460 0x7f7b2819dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.852+0000 7f7b2defd640 1 --2- 172.21.15.170:0/1631919749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b28102b40 0x7f7b2819d6c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.852+0000 7f7b2defd640 1 -- 172.21.15.170:0/1631919749 >> 172.21.15.170:0/1631919749 conn(0x7f7b280fc520 msgr2=0x7f7b28107e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.852+0000 7f7b2defd640 1 -- 172.21.15.170:0/1631919749 shutdown_connections 2024-09-04T16:27:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:01.852+0000 7f7b2defd640 1 -- 172.21.15.170:0/1631919749 wait complete. 2024-09-04T16:27:02.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:02 smithi170 ceph-mon[29272]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:02.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:02 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2559965931' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-04T16:27:02.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:02 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1631919749' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-04T16:27:02.628 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757255 got 163208757256 for osd.5 2024-09-04T16:27:02.629 DEBUG:teuthology.parallel:result is None 2024-09-04T16:27:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:02 smithi193 ceph-mon[36288]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:02 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2559965931' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-04T16:27:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:02 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1631919749' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-04T16:27:03.007 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182417 got 107374182418 for osd.3 2024-09-04T16:27:03.008 DEBUG:teuthology.parallel:result is None 2024-09-04T16:27:03.457 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705697 got 38654705698 for osd.0 2024-09-04T16:27:03.457 DEBUG:teuthology.parallel:result is None 2024-09-04T16:27:03.903 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920780 got 141733920781 for osd.4 2024-09-04T16:27:03.903 DEBUG:teuthology.parallel:result is None 2024-09-04T16:27:03.929 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:04.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.410+0000 7f9034038640 1 -- 172.21.15.170:0/2218162514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f902c100820 msgr2=0x7f902c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:04.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.410+0000 7f9034038640 1 --2- 172.21.15.170:0/2218162514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f902c100820 0x7f902c100c80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9028009880 tx=0x7f902802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:04.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.410+0000 7f9034038640 1 -- 172.21.15.170:0/2218162514 shutdown_connections 2024-09-04T16:27:04.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.410+0000 7f9034038640 1 --2- 172.21.15.170:0/2218162514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f902c100820 0x7f902c100c80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:04.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.410+0000 7f9034038640 1 --2- 172.21.15.170:0/2218162514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f902c106820 0x7f902c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:04.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.410+0000 7f9034038640 1 -- 172.21.15.170:0/2218162514 >> 172.21.15.170:0/2218162514 conn(0x7f902c0fc520 msgr2=0x7f902c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:04.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.410+0000 7f9034038640 1 -- 172.21.15.170:0/2218162514 shutdown_connections 2024-09-04T16:27:04.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.410+0000 7f9034038640 1 -- 172.21.15.170:0/2218162514 wait complete. 2024-09-04T16:27:04.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.411+0000 7f9034038640 1 Processor -- start 2024-09-04T16:27:04.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.411+0000 7f9034038640 1 -- start start 2024-09-04T16:27:04.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.411+0000 7f9034038640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f902c100820 0x7f902c19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:04.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.411+0000 7f9034038640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f902c106820 0x7f902c19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:04.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.411+0000 7f9034038640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f902c10dd50 con 0x7f902c100820 2024-09-04T16:27:04.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.411+0000 7f9034038640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f902c10dbd0 con 0x7f902c106820 2024-09-04T16:27:04.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.411+0000 7f9031dd4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f902c100820 0x7f902c19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:04.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.411+0000 7f9031dd4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f902c100820 0x7f902c19c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50414/0 (socket says 172.21.15.170:50414) 2024-09-04T16:27:04.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.411+0000 7f9031dd4640 1 -- 172.21.15.170:0/1107804528 learned_addr learned my addr 172.21.15.170:0/1107804528 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:04.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.411+0000 7f90315d3640 1 --2- 172.21.15.170:0/1107804528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f902c106820 0x7f902c19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:04.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.412+0000 7f9031dd4640 1 -- 172.21.15.170:0/1107804528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f902c106820 msgr2=0x7f902c19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:04.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.412+0000 7f9031dd4640 1 --2- 172.21.15.170:0/1107804528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f902c106820 0x7f902c19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:04.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.412+0000 7f9031dd4640 1 -- 172.21.15.170:0/1107804528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c196740 con 0x7f902c100820 2024-09-04T16:27:04.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.412+0000 7f9031dd4640 1 --2- 172.21.15.170:0/1107804528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f902c100820 0x7f902c19c670 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f902000b420 tx=0x7f902000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:04.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.412+0000 7f901effd640 1 -- 172.21.15.170:0/1107804528 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9020011630 con 0x7f902c100820 2024-09-04T16:27:04.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.412+0000 7f9034038640 1 -- 172.21.15.170:0/1107804528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902c196a30 con 0x7f902c100820 2024-09-04T16:27:04.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.412+0000 7f901effd640 1 -- 172.21.15.170:0/1107804528 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9020016070 con 0x7f902c100820 2024-09-04T16:27:04.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.412+0000 7f901effd640 1 -- 172.21.15.170:0/1107804528 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9020010d40 con 0x7f902c100820 2024-09-04T16:27:04.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.412+0000 7f9034038640 1 -- 172.21.15.170:0/1107804528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f902c196f90 con 0x7f902c100820 2024-09-04T16:27:04.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.413+0000 7f9034038640 1 -- 172.21.15.170:0/1107804528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f902c101f60 con 0x7f902c100820 2024-09-04T16:27:04.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.414+0000 7f901effd640 1 -- 172.21.15.170:0/1107804528 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f902001b460 con 0x7f902c100820 2024-09-04T16:27:04.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.414+0000 7f901effd640 1 --2- 172.21.15.170:0/1107804528 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f901806de30 0x7f90180702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:04.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.414+0000 7f901effd640 1 -- 172.21.15.170:0/1107804528 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f902008d0c0 con 0x7f902c100820 2024-09-04T16:27:04.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.414+0000 7f90315d3640 1 --2- 172.21.15.170:0/1107804528 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f901806de30 0x7f90180702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:04.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.415+0000 7f90315d3640 1 --2- 172.21.15.170:0/1107804528 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f901806de30 0x7f90180702f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f902c197f90 tx=0x7f9028031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:04.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.418+0000 7f901effd640 1 -- 172.21.15.170:0/1107804528 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f902005afa0 con 0x7f902c100820 2024-09-04T16:27:04.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.585+0000 7f9034038640 1 -- 172.21.15.170:0/1107804528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f902c108db0 con 0x7f902c100820 2024-09-04T16:27:04.586 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:04 smithi170 ceph-mon[29272]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:04.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.585+0000 7f901effd640 1 -- 172.21.15.170:0/1107804528 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f902005ec50 con 0x7f902c100820 2024-09-04T16:27:04.587 INFO:teuthology.orchestra.run.smithi170.stdout:60129542173 2024-09-04T16:27:04.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.587+0000 7f9034038640 1 -- 172.21.15.170:0/1107804528 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f901806de30 msgr2=0x7f90180702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:04.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.587+0000 7f9034038640 1 --2- 172.21.15.170:0/1107804528 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f901806de30 0x7f90180702f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f902c197f90 tx=0x7f9028031400 comp rx=0 tx=0).stop 2024-09-04T16:27:04.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.587+0000 7f9034038640 1 -- 172.21.15.170:0/1107804528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f902c100820 msgr2=0x7f902c19c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:04.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.587+0000 7f9034038640 1 --2- 172.21.15.170:0/1107804528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f902c100820 0x7f902c19c670 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f902000b420 tx=0x7f902000b8e0 comp rx=0 tx=0).stop 2024-09-04T16:27:04.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.587+0000 7f9034038640 1 -- 172.21.15.170:0/1107804528 shutdown_connections 2024-09-04T16:27:04.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.587+0000 7f9034038640 1 --2- 172.21.15.170:0/1107804528 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f901806de30 0x7f90180702f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:04.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.587+0000 7f9034038640 1 --2- 172.21.15.170:0/1107804528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f902c106820 0x7f902c19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:04.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.587+0000 7f9034038640 1 --2- 172.21.15.170:0/1107804528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f902c100820 0x7f902c19c670 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:04.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.587+0000 7f9034038640 1 -- 172.21.15.170:0/1107804528 >> 172.21.15.170:0/1107804528 conn(0x7f902c0fc520 msgr2=0x7f902c0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:04.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.587+0000 7f9034038640 1 -- 172.21.15.170:0/1107804528 shutdown_connections 2024-09-04T16:27:04.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:04.587+0000 7f9034038640 1 -- 172.21.15.170:0/1107804528 wait complete. 2024-09-04T16:27:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:04 smithi193 ceph-mon[36288]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:05.317 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542172 got 60129542173 for osd.1 2024-09-04T16:27:05.318 DEBUG:teuthology.parallel:result is None 2024-09-04T16:27:05.318 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-04T16:27:05.318 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph pg dump --format=json 2024-09-04T16:27:05.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:05 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1107804528' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-04T16:27:05.603 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:05.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:05 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1107804528' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-04T16:27:06.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.029+0000 7f096a104640 1 -- 172.21.15.170:0/3046964346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09641007f0 msgr2=0x7f0964100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:06.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.029+0000 7f096a104640 1 --2- 172.21.15.170:0/3046964346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09641007f0 0x7f0964100c50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f094c009880 tx=0x7f094c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:06.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.029+0000 7f096a104640 1 -- 172.21.15.170:0/3046964346 shutdown_connections 2024-09-04T16:27:06.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.029+0000 7f096a104640 1 --2- 172.21.15.170:0/3046964346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09641007f0 0x7f0964100c50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:06.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.029+0000 7f096a104640 1 --2- 172.21.15.170:0/3046964346 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09641067f0 0x7f0964106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:06.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.029+0000 7f096a104640 1 -- 172.21.15.170:0/3046964346 >> 172.21.15.170:0/3046964346 conn(0x7f09640fc4f0 msgr2=0x7f09640fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:06.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.029+0000 7f096a104640 1 -- 172.21.15.170:0/3046964346 shutdown_connections 2024-09-04T16:27:06.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.029+0000 7f096a104640 1 -- 172.21.15.170:0/3046964346 wait complete. 2024-09-04T16:27:06.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.029+0000 7f096a104640 1 Processor -- start 2024-09-04T16:27:06.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.030+0000 7f096a104640 1 -- start start 2024-09-04T16:27:06.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.030+0000 7f096a104640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09641007f0 0x7f096419f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:06.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.030+0000 7f096a104640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09641067f0 0x7f096419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:06.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.030+0000 7f096a104640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f096410dd20 con 0x7f09641067f0 2024-09-04T16:27:06.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.030+0000 7f096a104640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f096410dba0 con 0x7f09641007f0 2024-09-04T16:27:06.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.030+0000 7f0962ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09641067f0 0x7f096419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:06.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.030+0000 7f0962ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09641067f0 0x7f096419fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49110/0 (socket says 172.21.15.170:49110) 2024-09-04T16:27:06.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.030+0000 7f0962ffd640 1 -- 172.21.15.170:0/3908539382 learned_addr learned my addr 172.21.15.170:0/3908539382 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:06.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.030+0000 7f09637fe640 1 --2- 172.21.15.170:0/3908539382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09641007f0 0x7f096419f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:06.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.030+0000 7f0962ffd640 1 -- 172.21.15.170:0/3908539382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09641007f0 msgr2=0x7f096419f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:06.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.030+0000 7f0962ffd640 1 --2- 172.21.15.170:0/3908539382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09641007f0 0x7f096419f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:06.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.030+0000 7f0962ffd640 1 -- 172.21.15.170:0/3908539382 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0964199a10 con 0x7f09641067f0 2024-09-04T16:27:06.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.030+0000 7f09637fe640 1 --2- 172.21.15.170:0/3908539382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09641007f0 0x7f096419f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:27:06.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.031+0000 7f0962ffd640 1 --2- 172.21.15.170:0/3908539382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09641067f0 0x7f096419fd90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f094c031460 tx=0x7f094c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:06.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.031+0000 7f0960ff9640 1 -- 172.21.15.170:0/3908539382 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f094c03f070 con 0x7f09641067f0 2024-09-04T16:27:06.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.031+0000 7f096a104640 1 -- 172.21.15.170:0/3908539382 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0964199ca0 con 0x7f09641067f0 2024-09-04T16:27:06.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.031+0000 7f0960ff9640 1 -- 172.21.15.170:0/3908539382 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f094c004cf0 con 0x7f09641067f0 2024-09-04T16:27:06.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.031+0000 7f0960ff9640 1 -- 172.21.15.170:0/3908539382 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f094c035030 con 0x7f09641067f0 2024-09-04T16:27:06.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.031+0000 7f096a104640 1 -- 172.21.15.170:0/3908539382 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f096419a1d0 con 0x7f09641067f0 2024-09-04T16:27:06.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.032+0000 7f096a104640 1 -- 172.21.15.170:0/3908539382 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0964101f30 con 0x7f09641067f0 2024-09-04T16:27:06.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.032+0000 7f0960ff9640 1 -- 172.21.15.170:0/3908539382 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f094c042070 con 0x7f09641067f0 2024-09-04T16:27:06.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.033+0000 7f0960ff9640 1 --2- 172.21.15.170:0/3908539382 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f095006de30 0x7f09500702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:06.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.033+0000 7f0960ff9640 1 -- 172.21.15.170:0/3908539382 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f094c0ae330 con 0x7f09641067f0 2024-09-04T16:27:06.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.033+0000 7f09637fe640 1 --2- 172.21.15.170:0/3908539382 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f095006de30 0x7f09500702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:06.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.033+0000 7f09637fe640 1 --2- 172.21.15.170:0/3908539382 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f095006de30 0x7f09500702f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f096419ab50 tx=0x7f095c009570 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:06.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.037+0000 7f0960ff9640 1 -- 172.21.15.170:0/3908539382 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f094c07c210 con 0x7f09641067f0 2024-09-04T16:27:06.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.220+0000 7f096a104640 1 -- 172.21.15.170:0/3908539382 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f096419afe0 con 0x7f095006de30 2024-09-04T16:27:06.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.220+0000 7f0960ff9640 1 -- 172.21.15.170:0/3908539382 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f096419afe0 con 0x7f095006de30 2024-09-04T16:27:06.221 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:27:06.222 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2024-09-04T16:27:06.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.223+0000 7f096a104640 1 -- 172.21.15.170:0/3908539382 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f095006de30 msgr2=0x7f09500702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:06.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.223+0000 7f096a104640 1 --2- 172.21.15.170:0/3908539382 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f095006de30 0x7f09500702f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f096419ab50 tx=0x7f095c009570 comp rx=0 tx=0).stop 2024-09-04T16:27:06.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.223+0000 7f096a104640 1 -- 172.21.15.170:0/3908539382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09641067f0 msgr2=0x7f096419fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:06.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.223+0000 7f096a104640 1 --2- 172.21.15.170:0/3908539382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09641067f0 0x7f096419fd90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f094c031460 tx=0x7f094c0048f0 comp rx=0 tx=0).stop 2024-09-04T16:27:06.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.223+0000 7f096a104640 1 -- 172.21.15.170:0/3908539382 shutdown_connections 2024-09-04T16:27:06.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.223+0000 7f096a104640 1 --2- 172.21.15.170:0/3908539382 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f095006de30 0x7f09500702f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:06.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.223+0000 7f096a104640 1 --2- 172.21.15.170:0/3908539382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09641067f0 0x7f096419fd90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:06.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.223+0000 7f096a104640 1 --2- 172.21.15.170:0/3908539382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09641007f0 0x7f096419f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:06.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.223+0000 7f096a104640 1 -- 172.21.15.170:0/3908539382 >> 172.21.15.170:0/3908539382 conn(0x7f09640fc4f0 msgr2=0x7f09640fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:06.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.223+0000 7f096a104640 1 -- 172.21.15.170:0/3908539382 shutdown_connections 2024-09-04T16:27:06.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:06.223+0000 7f096a104640 1 -- 172.21.15.170:0/3908539382 wait complete. 2024-09-04T16:27:06.580 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:06 smithi170 ceph-mon[29272]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:06.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:06 smithi193 ceph-mon[36288]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:06.899 INFO:teuthology.orchestra.run.smithi170.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-04T16:27:05.263717+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":199284,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":195318,"kb_avail":562271628,"statfs":{"total":575970213888,"available":575766147072,"internally_reserved":0,"allocated":3919872,"data_stored":2589270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":200006304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.031534"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":191,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-04T16:26:37.503121+0000","last_change":"2024-09-04T16:26:09.152880+0000","last_active":"2024-09-04T16:26:37.503121+0000","last_peered":"2024-09-04T16:26:37.503121+0000","last_clean":"2024-09-04T16:26:37.503121+0000","last_became_active":"2024-09-04T16:26:09.152459+0000","last_became_peered":"2024-09-04T16:26:09.152459+0000","last_unstale":"2024-09-04T16:26:37.503121+0000","last_undegraded":"2024-09-04T16:26:37.503121+0000","last_fullsized":"2024-09-04T16:26:37.503121+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-04T16:25:18.041530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-04T16:25:18.041530+0000","last_clean_scrub_stamp":"2024-09-04T16:25:18.041530+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-05T22:03:33.855916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713616,"statfs":{"total":95995035648,"available":95962742784,"internally_reserved":0,"allocated":356352,"data_stored":136361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920782,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":356352,"data_stored":136361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182419,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":950272,"data_stored":726729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717772,"statfs":{"total":95995035648,"available":95966998528,"internally_reserved":0,"allocated":356352,"data_stored":136361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542173,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40436,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704716,"statfs":{"total":95995035648,"available":95953629184,"internally_reserved":0,"allocated":950272,"data_stored":726729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40436,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704716,"statfs":{"total":95995035648,"available":95953629184,"internally_reserved":0,"allocated":950272,"data_stored":726729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-04T16:27:06.900 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph pg dump --format=json 2024-09-04T16:27:07.148 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:07.583 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:07 smithi170 ceph-mon[29272]: from='client.14518 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-04T16:27:07.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.587+0000 7f01a7f19640 1 -- 172.21.15.170:0/2553615360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01a0101930 msgr2=0x7f01a0101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:07.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.587+0000 7f01a7f19640 1 --2- 172.21.15.170:0/2553615360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01a0101930 0x7f01a0101d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0194009c20 tx=0x7f019402a970 comp rx=0 tx=0).stop 2024-09-04T16:27:07.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.587+0000 7f01a7f19640 1 -- 172.21.15.170:0/2553615360 shutdown_connections 2024-09-04T16:27:07.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.587+0000 7f01a7f19640 1 --2- 172.21.15.170:0/2553615360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01a0101930 0x7f01a0101d90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:07.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.587+0000 7f01a7f19640 1 --2- 172.21.15.170:0/2553615360 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01a0107930 0x7f01a0107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:07.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.587+0000 7f01a7f19640 1 -- 172.21.15.170:0/2553615360 >> 172.21.15.170:0/2553615360 conn(0x7f01a00fd630 msgr2=0x7f01a00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:07.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.587+0000 7f01a7f19640 1 -- 172.21.15.170:0/2553615360 shutdown_connections 2024-09-04T16:27:07.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.587+0000 7f01a7f19640 1 -- 172.21.15.170:0/2553615360 wait complete. 2024-09-04T16:27:07.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.587+0000 7f01a7f19640 1 Processor -- start 2024-09-04T16:27:07.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.587+0000 7f01a7f19640 1 -- start start 2024-09-04T16:27:07.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.588+0000 7f01a7f19640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01a0101930 0x7f01a019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:07.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.588+0000 7f01a7f19640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01a0107930 0x7f01a019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:07.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.588+0000 7f01a7f19640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f01a010ee00 con 0x7f01a0107930 2024-09-04T16:27:07.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.588+0000 7f01a7f19640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f01a010ec80 con 0x7f01a0101930 2024-09-04T16:27:07.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.588+0000 7f01a54b4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01a0107930 0x7f01a019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:07.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.588+0000 7f01a54b4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01a0107930 0x7f01a019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49118/0 (socket says 172.21.15.170:49118) 2024-09-04T16:27:07.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.588+0000 7f01a54b4640 1 -- 172.21.15.170:0/2789436404 learned_addr learned my addr 172.21.15.170:0/2789436404 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:07.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.588+0000 7f01a54b4640 1 -- 172.21.15.170:0/2789436404 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01a0101930 msgr2=0x7f01a019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:07.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.588+0000 7f01a5cb5640 1 --2- 172.21.15.170:0/2789436404 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01a0101930 0x7f01a019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:07.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.588+0000 7f01a54b4640 1 --2- 172.21.15.170:0/2789436404 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01a0101930 0x7f01a019d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:07.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.588+0000 7f01a54b4640 1 -- 172.21.15.170:0/2789436404 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a0197810 con 0x7f01a0107930 2024-09-04T16:27:07.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.588+0000 7f01a54b4640 1 --2- 172.21.15.170:0/2789436404 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01a0107930 0x7f01a019dbd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f019402ae90 tx=0x7f019402f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:07.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.588+0000 7f019effd640 1 -- 172.21.15.170:0/2789436404 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0194047070 con 0x7f01a0107930 2024-09-04T16:27:07.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.588+0000 7f01a7f19640 1 -- 172.21.15.170:0/2789436404 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a0197aa0 con 0x7f01a0107930 2024-09-04T16:27:07.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.588+0000 7f019effd640 1 -- 172.21.15.170:0/2789436404 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f019402f7e0 con 0x7f01a0107930 2024-09-04T16:27:07.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.588+0000 7f019effd640 1 -- 172.21.15.170:0/2789436404 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0194034070 con 0x7f01a0107930 2024-09-04T16:27:07.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.589+0000 7f01a7f19640 1 -- 172.21.15.170:0/2789436404 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a0197fd0 con 0x7f01a0107930 2024-09-04T16:27:07.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.590+0000 7f01a7f19640 1 -- 172.21.15.170:0/2789436404 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a0103070 con 0x7f01a0107930 2024-09-04T16:27:07.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.590+0000 7f019effd640 1 -- 172.21.15.170:0/2789436404 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f019404a070 con 0x7f01a0107930 2024-09-04T16:27:07.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.590+0000 7f019effd640 1 --2- 172.21.15.170:0/2789436404 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f018806de30 0x7f01880702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:07.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.590+0000 7f019effd640 1 -- 172.21.15.170:0/2789436404 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f01940ae6b0 con 0x7f01a0107930 2024-09-04T16:27:07.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.590+0000 7f01a5cb5640 1 --2- 172.21.15.170:0/2789436404 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f018806de30 0x7f01880702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:07.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.591+0000 7f01a5cb5640 1 --2- 172.21.15.170:0/2789436404 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f018806de30 0x7f01880702f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0198005fd0 tx=0x7f0198005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:07.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.595+0000 7f019effd640 1 -- 172.21.15.170:0/2789436404 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f019403f070 con 0x7f01a0107930 2024-09-04T16:27:07.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:07 smithi193 ceph-mon[36288]: from='client.14518 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-04T16:27:07.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.757+0000 7f01a7f19640 1 -- 172.21.15.170:0/2789436404 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01a0198280 con 0x7f018806de30 2024-09-04T16:27:07.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.758+0000 7f019effd640 1 -- 172.21.15.170:0/2789436404 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f01a0198280 con 0x7f018806de30 2024-09-04T16:27:07.759 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:27:07.759 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2024-09-04T16:27:07.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.760+0000 7f01a7f19640 1 -- 172.21.15.170:0/2789436404 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f018806de30 msgr2=0x7f01880702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:07.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.760+0000 7f01a7f19640 1 --2- 172.21.15.170:0/2789436404 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f018806de30 0x7f01880702f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0198005fd0 tx=0x7f0198005850 comp rx=0 tx=0).stop 2024-09-04T16:27:07.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.760+0000 7f01a7f19640 1 -- 172.21.15.170:0/2789436404 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01a0107930 msgr2=0x7f01a019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:07.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.760+0000 7f01a7f19640 1 --2- 172.21.15.170:0/2789436404 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01a0107930 0x7f01a019dbd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f019402ae90 tx=0x7f019402f5f0 comp rx=0 tx=0).stop 2024-09-04T16:27:07.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.760+0000 7f01a7f19640 1 -- 172.21.15.170:0/2789436404 shutdown_connections 2024-09-04T16:27:07.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.760+0000 7f01a7f19640 1 --2- 172.21.15.170:0/2789436404 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f018806de30 0x7f01880702f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:07.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.760+0000 7f01a7f19640 1 --2- 172.21.15.170:0/2789436404 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01a0107930 0x7f01a019dbd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:07.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.760+0000 7f01a7f19640 1 --2- 172.21.15.170:0/2789436404 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01a0101930 0x7f01a019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:07.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.760+0000 7f01a7f19640 1 -- 172.21.15.170:0/2789436404 >> 172.21.15.170:0/2789436404 conn(0x7f01a00fd630 msgr2=0x7f01a00fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:07.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.760+0000 7f01a7f19640 1 -- 172.21.15.170:0/2789436404 shutdown_connections 2024-09-04T16:27:07.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:07.760+0000 7f01a7f19640 1 -- 172.21.15.170:0/2789436404 wait complete. 2024-09-04T16:27:08.392 INFO:teuthology.orchestra.run.smithi170.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-04T16:27:07.264122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":199284,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":195318,"kb_avail":562271628,"statfs":{"total":575970213888,"available":575766147072,"internally_reserved":0,"allocated":3919872,"data_stored":2589270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":200006304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.017491"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":191,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-04T16:26:37.503121+0000","last_change":"2024-09-04T16:26:09.152880+0000","last_active":"2024-09-04T16:26:37.503121+0000","last_peered":"2024-09-04T16:26:37.503121+0000","last_clean":"2024-09-04T16:26:37.503121+0000","last_became_active":"2024-09-04T16:26:09.152459+0000","last_became_peered":"2024-09-04T16:26:09.152459+0000","last_unstale":"2024-09-04T16:26:37.503121+0000","last_undegraded":"2024-09-04T16:26:37.503121+0000","last_fullsized":"2024-09-04T16:26:37.503121+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-04T16:25:18.041530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-04T16:25:18.041530+0000","last_clean_scrub_stamp":"2024-09-04T16:25:18.041530+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-05T22:03:33.855916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713616,"statfs":{"total":95995035648,"available":95962742784,"internally_reserved":0,"allocated":356352,"data_stored":136361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920782,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":356352,"data_stored":136361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182419,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":950272,"data_stored":726729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717772,"statfs":{"total":95995035648,"available":95966998528,"internally_reserved":0,"allocated":356352,"data_stored":136361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40436,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704716,"statfs":{"total":95995035648,"available":95953629184,"internally_reserved":0,"allocated":950272,"data_stored":726729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40436,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704716,"statfs":{"total":95995035648,"available":95953629184,"internally_reserved":0,"allocated":950272,"data_stored":726729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-04T16:27:08.393 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-04T16:27:08.393 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-04T16:27:08.393 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-04T16:27:08.393 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph health --format=json 2024-09-04T16:27:08.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:08 smithi170 ceph-mon[29272]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:08.641 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:08.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:08 smithi193 ceph-mon[36288]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:09.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.094+0000 7f067ca1b640 1 -- 172.21.15.170:0/2203780143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0678106800 msgr2=0x7f0678106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:09.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.094+0000 7f067ca1b640 1 --2- 172.21.15.170:0/2203780143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0678106800 0x7f0678106be0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0670009c20 tx=0x7f067002a970 comp rx=0 tx=0).stop 2024-09-04T16:27:09.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.095+0000 7f067ca1b640 1 -- 172.21.15.170:0/2203780143 shutdown_connections 2024-09-04T16:27:09.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.095+0000 7f067ca1b640 1 --2- 172.21.15.170:0/2203780143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0678100800 0x7f0678100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:09.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.095+0000 7f067ca1b640 1 --2- 172.21.15.170:0/2203780143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0678106800 0x7f0678106be0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:09.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.095+0000 7f067ca1b640 1 -- 172.21.15.170:0/2203780143 >> 172.21.15.170:0/2203780143 conn(0x7f06780fc4e0 msgr2=0x7f06780fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:09.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.095+0000 7f067ca1b640 1 -- 172.21.15.170:0/2203780143 shutdown_connections 2024-09-04T16:27:09.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.095+0000 7f067ca1b640 1 -- 172.21.15.170:0/2203780143 wait complete. 2024-09-04T16:27:09.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.095+0000 7f067ca1b640 1 Processor -- start 2024-09-04T16:27:09.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f067ca1b640 1 -- start start 2024-09-04T16:27:09.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f067ca1b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0678100800 0x7f0678198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:09.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f067ca1b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0678106800 0x7f0678198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:09.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f067ca1b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f067810dcd0 con 0x7f0678106800 2024-09-04T16:27:09.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f067ca1b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f067810db50 con 0x7f0678100800 2024-09-04T16:27:09.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f0675d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0678106800 0x7f0678198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:09.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f0675d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0678106800 0x7f0678198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49128/0 (socket says 172.21.15.170:49128) 2024-09-04T16:27:09.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f0675d9b640 1 -- 172.21.15.170:0/3670681226 learned_addr learned my addr 172.21.15.170:0/3670681226 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:09.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f067659c640 1 --2- 172.21.15.170:0/3670681226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0678100800 0x7f0678198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:09.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f0675d9b640 1 -- 172.21.15.170:0/3670681226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0678100800 msgr2=0x7f0678198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:09.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f0675d9b640 1 --2- 172.21.15.170:0/3670681226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0678100800 0x7f0678198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:09.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f0675d9b640 1 -- 172.21.15.170:0/3670681226 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0678199350 con 0x7f0678106800 2024-09-04T16:27:09.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f067659c640 1 --2- 172.21.15.170:0/3670681226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0678100800 0x7f0678198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:27:09.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f0675d9b640 1 --2- 172.21.15.170:0/3670681226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0678106800 0x7f0678198d50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f066000d6f0 tx=0x7f066000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:09.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f066f7fe640 1 -- 172.21.15.170:0/3670681226 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0660017070 con 0x7f0678106800 2024-09-04T16:27:09.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f066f7fe640 1 -- 172.21.15.170:0/3670681226 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f066000de00 con 0x7f0678106800 2024-09-04T16:27:09.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f067ca1b640 1 -- 172.21.15.170:0/3670681226 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0678199640 con 0x7f0678106800 2024-09-04T16:27:09.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.096+0000 7f066f7fe640 1 -- 172.21.15.170:0/3670681226 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0660004bb0 con 0x7f0678106800 2024-09-04T16:27:09.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.097+0000 7f067ca1b640 1 -- 172.21.15.170:0/3670681226 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06781a1c40 con 0x7f0678106800 2024-09-04T16:27:09.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.097+0000 7f067ca1b640 1 -- 172.21.15.170:0/3670681226 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0678101f40 con 0x7f0678106800 2024-09-04T16:27:09.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.098+0000 7f066f7fe640 1 -- 172.21.15.170:0/3670681226 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f0660004e60 con 0x7f0678106800 2024-09-04T16:27:09.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.099+0000 7f066f7fe640 1 --2- 172.21.15.170:0/3670681226 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f066406de30 0x7f06640702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:09.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.099+0000 7f066f7fe640 1 -- 172.21.15.170:0/3670681226 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f066008d440 con 0x7f0678106800 2024-09-04T16:27:09.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.099+0000 7f067659c640 1 --2- 172.21.15.170:0/3670681226 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f066406de30 0x7f06640702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:09.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.099+0000 7f067659c640 1 --2- 172.21.15.170:0/3670681226 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f066406de30 0x7f06640702f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0670006010 tx=0x7f067002f9d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:09.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.103+0000 7f066f7fe640 1 -- 172.21.15.170:0/3670681226 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0678199640 con 0x7f0678106800 2024-09-04T16:27:09.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.307+0000 7f067ca1b640 1 -- 172.21.15.170:0/3670681226 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0678108d70 con 0x7f0678106800 2024-09-04T16:27:09.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.308+0000 7f066f7fe640 1 -- 172.21.15.170:0/3670681226 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f066005b320 con 0x7f0678106800 2024-09-04T16:27:09.309 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:27:09.309 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-04T16:27:09.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.310+0000 7f067ca1b640 1 -- 172.21.15.170:0/3670681226 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f066406de30 msgr2=0x7f06640702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:09.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.310+0000 7f067ca1b640 1 --2- 172.21.15.170:0/3670681226 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f066406de30 0x7f06640702f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0670006010 tx=0x7f067002f9d0 comp rx=0 tx=0).stop 2024-09-04T16:27:09.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.310+0000 7f067ca1b640 1 -- 172.21.15.170:0/3670681226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0678106800 msgr2=0x7f0678198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:09.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.310+0000 7f067ca1b640 1 --2- 172.21.15.170:0/3670681226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0678106800 0x7f0678198d50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f066000d6f0 tx=0x7f066000dbb0 comp rx=0 tx=0).stop 2024-09-04T16:27:09.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.310+0000 7f067ca1b640 1 -- 172.21.15.170:0/3670681226 shutdown_connections 2024-09-04T16:27:09.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.310+0000 7f067ca1b640 1 --2- 172.21.15.170:0/3670681226 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f066406de30 0x7f06640702f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:09.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.310+0000 7f067ca1b640 1 --2- 172.21.15.170:0/3670681226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0678106800 0x7f0678198d50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:09.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.310+0000 7f067ca1b640 1 --2- 172.21.15.170:0/3670681226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0678100800 0x7f0678198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:09.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.310+0000 7f067ca1b640 1 -- 172.21.15.170:0/3670681226 >> 172.21.15.170:0/3670681226 conn(0x7f06780fc4e0 msgr2=0x7f06780fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:09.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.310+0000 7f067ca1b640 1 -- 172.21.15.170:0/3670681226 shutdown_connections 2024-09-04T16:27:09.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:09.310+0000 7f067ca1b640 1 -- 172.21.15.170:0/3670681226 wait complete. 2024-09-04T16:27:09.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:09 smithi170 ceph-mon[29272]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-04T16:27:09.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:09 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3670681226' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-04T16:27:09.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:09 smithi193 ceph-mon[36288]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-04T16:27:09.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:09 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3670681226' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-04T16:27:09.946 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-04T16:27:09.946 INFO:tasks.cephadm:Setup complete, yielding 2024-09-04T16:27:09.946 INFO:teuthology.run_tasks:Running task print... 2024-09-04T16:27:09.955 INFO:teuthology.task.print:**** done end installing squid cephadm ... 2024-09-04T16:27:09.955 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-04T16:27:10.082 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi170.front.sepia.ceph.com 2024-09-04T16:27:10.082 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-04T16:27:10.344 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:10.583 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:10 smithi170 ceph-mon[29272]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:10 smithi193 ceph-mon[36288]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:10.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.785+0000 7fbb31105640 1 -- 172.21.15.170:0/1467487709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb2c102b90 msgr2=0x7fbb2c103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:10.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.785+0000 7fbb31105640 1 --2- 172.21.15.170:0/1467487709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb2c102b90 0x7fbb2c103010 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009880 tx=0x7fbb2002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:10.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.785+0000 7fbb31105640 1 -- 172.21.15.170:0/1467487709 shutdown_connections 2024-09-04T16:27:10.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.785+0000 7fbb31105640 1 --2- 172.21.15.170:0/1467487709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb2c102b90 0x7fbb2c103010 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:10.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.785+0000 7fbb31105640 1 --2- 172.21.15.170:0/1467487709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb2c101990 0x7fbb2c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:10.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.785+0000 7fbb31105640 1 -- 172.21.15.170:0/1467487709 >> 172.21.15.170:0/1467487709 conn(0x7fbb2c0fd140 msgr2=0x7fbb2c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:10.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.785+0000 7fbb31105640 1 -- 172.21.15.170:0/1467487709 shutdown_connections 2024-09-04T16:27:10.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.785+0000 7fbb31105640 1 -- 172.21.15.170:0/1467487709 wait complete. 2024-09-04T16:27:10.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.786+0000 7fbb31105640 1 Processor -- start 2024-09-04T16:27:10.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.786+0000 7fbb31105640 1 -- start start 2024-09-04T16:27:10.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.786+0000 7fbb31105640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb2c101990 0x7fbb2c1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:10.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.786+0000 7fbb31105640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb2c102b90 0x7fbb2c1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:10.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.786+0000 7fbb31105640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c10a7d0 con 0x7fbb2c101990 2024-09-04T16:27:10.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.786+0000 7fbb31105640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c10a650 con 0x7fbb2c102b90 2024-09-04T16:27:10.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.786+0000 7fbb2ad9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb2c101990 0x7fbb2c1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:10.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.786+0000 7fbb2ad9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb2c101990 0x7fbb2c1974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49144/0 (socket says 172.21.15.170:49144) 2024-09-04T16:27:10.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.786+0000 7fbb2ad9d640 1 -- 172.21.15.170:0/4100362755 learned_addr learned my addr 172.21.15.170:0/4100362755 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:10.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.786+0000 7fbb2a59c640 1 --2- 172.21.15.170:0/4100362755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb2c102b90 0x7fbb2c1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:10.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.787+0000 7fbb2ad9d640 1 -- 172.21.15.170:0/4100362755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb2c102b90 msgr2=0x7fbb2c1979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:10.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.787+0000 7fbb2ad9d640 1 --2- 172.21.15.170:0/4100362755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb2c102b90 0x7fbb2c1979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:10.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.787+0000 7fbb2ad9d640 1 -- 172.21.15.170:0/4100362755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2c198060 con 0x7fbb2c101990 2024-09-04T16:27:10.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.787+0000 7fbb2ad9d640 1 --2- 172.21.15.170:0/4100362755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb2c101990 0x7fbb2c1974a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00d8d0 tx=0x7fbb1c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:10.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.787+0000 7fbb13fff640 1 -- 172.21.15.170:0/4100362755 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb1c017070 con 0x7fbb2c101990 2024-09-04T16:27:10.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.787+0000 7fbb31105640 1 -- 172.21.15.170:0/4100362755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb2c19caa0 con 0x7fbb2c101990 2024-09-04T16:27:10.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.787+0000 7fbb13fff640 1 -- 172.21.15.170:0/4100362755 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb1c00be10 con 0x7fbb2c101990 2024-09-04T16:27:10.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.787+0000 7fbb13fff640 1 -- 172.21.15.170:0/4100362755 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb1c00f3c0 con 0x7fbb2c101990 2024-09-04T16:27:10.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.787+0000 7fbb31105640 1 -- 172.21.15.170:0/4100362755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb2c19d030 con 0x7fbb2c101990 2024-09-04T16:27:10.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.788+0000 7fbb31105640 1 -- 172.21.15.170:0/4100362755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb2c101d90 con 0x7fbb2c101990 2024-09-04T16:27:10.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.789+0000 7fbb13fff640 1 -- 172.21.15.170:0/4100362755 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7fbb1c01a070 con 0x7fbb2c101990 2024-09-04T16:27:10.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.789+0000 7fbb13fff640 1 --2- 172.21.15.170:0/4100362755 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fbb1406de30 0x7fbb140702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:10.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.789+0000 7fbb13fff640 1 -- 172.21.15.170:0/4100362755 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fbb1c08d4a0 con 0x7fbb2c101990 2024-09-04T16:27:10.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.789+0000 7fbb2a59c640 1 --2- 172.21.15.170:0/4100362755 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fbb1406de30 0x7fbb140702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:10.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.790+0000 7fbb2a59c640 1 --2- 172.21.15.170:0/4100362755 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fbb1406de30 0x7fbb140702f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbb2002a9c0 tx=0x7fbb20000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:10.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.794+0000 7fbb13fff640 1 -- 172.21.15.170:0/4100362755 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb1c05b380 con 0x7fbb2c101990 2024-09-04T16:27:10.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.960+0000 7fbb31105640 1 -- 172.21.15.170:0/4100362755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) -- 0x7fbb2c1915e0 con 0x7fbb2c101990 2024-09-04T16:27:10.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.964+0000 7fbb13fff640 1 -- 172.21.15.170:0/4100362755 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v42)=0 v42) ==== 143+0+0 (secure 0 0 0) 0x7fbb2c1915e0 con 0x7fbb2c101990 2024-09-04T16:27:10.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.966+0000 7fbb31105640 1 -- 172.21.15.170:0/4100362755 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fbb1406de30 msgr2=0x7fbb140702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:10.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.966+0000 7fbb31105640 1 --2- 172.21.15.170:0/4100362755 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fbb1406de30 0x7fbb140702f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbb2002a9c0 tx=0x7fbb20000bc0 comp rx=0 tx=0).stop 2024-09-04T16:27:10.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.966+0000 7fbb31105640 1 -- 172.21.15.170:0/4100362755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb2c101990 msgr2=0x7fbb2c1974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:10.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.966+0000 7fbb31105640 1 --2- 172.21.15.170:0/4100362755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb2c101990 0x7fbb2c1974a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00d8d0 tx=0x7fbb1c00dd90 comp rx=0 tx=0).stop 2024-09-04T16:27:10.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.966+0000 7fbb31105640 1 -- 172.21.15.170:0/4100362755 shutdown_connections 2024-09-04T16:27:10.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.966+0000 7fbb31105640 1 --2- 172.21.15.170:0/4100362755 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fbb1406de30 0x7fbb140702f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:10.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.966+0000 7fbb31105640 1 --2- 172.21.15.170:0/4100362755 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb2c102b90 0x7fbb2c1979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:10.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.966+0000 7fbb31105640 1 --2- 172.21.15.170:0/4100362755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb2c101990 0x7fbb2c1974a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:10.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.966+0000 7fbb31105640 1 -- 172.21.15.170:0/4100362755 >> 172.21.15.170:0/4100362755 conn(0x7fbb2c0fd140 msgr2=0x7fbb2c106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:10.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.966+0000 7fbb31105640 1 -- 172.21.15.170:0/4100362755 shutdown_connections 2024-09-04T16:27:10.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:10.966+0000 7fbb31105640 1 -- 172.21.15.170:0/4100362755 wait complete. 2024-09-04T16:27:11.731 INFO:teuthology.run_tasks:Running task print... 2024-09-04T16:27:11.740 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-04T16:27:11.741 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-04T16:27:11.832 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi170.front.sepia.ceph.com 2024-09-04T16:27:11.833 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch status' 2024-09-04T16:27:12.089 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:12.238 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:11 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/4100362755' entity='client.admin' 2024-09-04T16:27:12.239 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:27:12.239 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:27:12.239 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:27:12.239 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:12.239 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:11 smithi170 ceph-mon[29272]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:12.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:11 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/4100362755' entity='client.admin' 2024-09-04T16:27:12.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:27:12.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:27:12.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:27:12.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:11 smithi193 ceph-mon[36288]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:12.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.546+0000 7f944211b640 1 -- 172.21.15.170:0/271208407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f943c101a80 msgr2=0x7f943c101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:12.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.546+0000 7f944211b640 1 --2- 172.21.15.170:0/271208407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f943c101a80 0x7f943c101f00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9430009880 tx=0x7f943002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:12.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.546+0000 7f944211b640 1 -- 172.21.15.170:0/271208407 shutdown_connections 2024-09-04T16:27:12.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.546+0000 7f944211b640 1 --2- 172.21.15.170:0/271208407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f943c101a80 0x7f943c101f00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:12.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.546+0000 7f944211b640 1 --2- 172.21.15.170:0/271208407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f943c100880 0x7f943c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:12.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.546+0000 7f944211b640 1 -- 172.21.15.170:0/271208407 >> 172.21.15.170:0/271208407 conn(0x7f943c0fc010 msgr2=0x7f943c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:12.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.546+0000 7f944211b640 1 -- 172.21.15.170:0/271208407 shutdown_connections 2024-09-04T16:27:12.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.546+0000 7f944211b640 1 -- 172.21.15.170:0/271208407 wait complete. 2024-09-04T16:27:12.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.546+0000 7f944211b640 1 Processor -- start 2024-09-04T16:27:12.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.547+0000 7f944211b640 1 -- start start 2024-09-04T16:27:12.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.547+0000 7f944211b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f943c100880 0x7f943c06adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:12.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.547+0000 7f944211b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f943c101a80 0x7f943c19c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:12.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.547+0000 7f944211b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1096a0 con 0x7f943c101a80 2024-09-04T16:27:12.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.547+0000 7f944211b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f943c109520 con 0x7f943c100880 2024-09-04T16:27:12.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.547+0000 7f943affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f943c101a80 0x7f943c19c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:12.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.547+0000 7f943affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f943c101a80 0x7f943c19c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49160/0 (socket says 172.21.15.170:49160) 2024-09-04T16:27:12.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.547+0000 7f943affd640 1 -- 172.21.15.170:0/375298965 learned_addr learned my addr 172.21.15.170:0/375298965 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:12.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.547+0000 7f943b7fe640 1 --2- 172.21.15.170:0/375298965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f943c100880 0x7f943c06adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:12.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.547+0000 7f943affd640 1 -- 172.21.15.170:0/375298965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f943c100880 msgr2=0x7f943c06adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:12.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.547+0000 7f943affd640 1 --2- 172.21.15.170:0/375298965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f943c100880 0x7f943c06adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:12.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.547+0000 7f943affd640 1 -- 172.21.15.170:0/375298965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943c19c7a0 con 0x7f943c101a80 2024-09-04T16:27:12.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.548+0000 7f943affd640 1 --2- 172.21.15.170:0/375298965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f943c101a80 0x7f943c19c1e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9430006010 tx=0x7f94300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:12.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.548+0000 7f9438ff9640 1 -- 172.21.15.170:0/375298965 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f943003f070 con 0x7f943c101a80 2024-09-04T16:27:12.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.548+0000 7f944211b640 1 -- 172.21.15.170:0/375298965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f943c19ca30 con 0x7f943c101a80 2024-09-04T16:27:12.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.548+0000 7f9438ff9640 1 -- 172.21.15.170:0/375298965 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94300044d0 con 0x7f943c101a80 2024-09-04T16:27:12.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.548+0000 7f9438ff9640 1 -- 172.21.15.170:0/375298965 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9430035030 con 0x7f943c101a80 2024-09-04T16:27:12.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.548+0000 7f944211b640 1 -- 172.21.15.170:0/375298965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f943c19cf60 con 0x7f943c101a80 2024-09-04T16:27:12.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.549+0000 7f944211b640 1 -- 172.21.15.170:0/375298965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f943c100c80 con 0x7f943c101a80 2024-09-04T16:27:12.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.549+0000 7f9438ff9640 1 -- 172.21.15.170:0/375298965 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f9430042070 con 0x7f943c101a80 2024-09-04T16:27:12.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.550+0000 7f9438ff9640 1 --2- 172.21.15.170:0/375298965 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f942406de30 0x7f94240702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:12.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.550+0000 7f9438ff9640 1 -- 172.21.15.170:0/375298965 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f94300ae560 con 0x7f943c101a80 2024-09-04T16:27:12.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.550+0000 7f943b7fe640 1 --2- 172.21.15.170:0/375298965 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f942406de30 0x7f94240702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:12.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.550+0000 7f943b7fe640 1 --2- 172.21.15.170:0/375298965 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f942406de30 0x7f94240702f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f943c1018e0 tx=0x7f942c00a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:12.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.554+0000 7f9438ff9640 1 -- 172.21.15.170:0/375298965 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9430080060 con 0x7f943c101a80 2024-09-04T16:27:12.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.733+0000 7f944211b640 1 -- 172.21.15.170:0/375298965 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f943c062630 con 0x7f942406de30 2024-09-04T16:27:12.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.734+0000 7f9438ff9640 1 -- 172.21.15.170:0/375298965 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f943c062630 con 0x7f942406de30 2024-09-04T16:27:12.734 INFO:teuthology.orchestra.run.smithi170.stdout:Backend: cephadm 2024-09-04T16:27:12.734 INFO:teuthology.orchestra.run.smithi170.stdout:Available: Yes 2024-09-04T16:27:12.734 INFO:teuthology.orchestra.run.smithi170.stdout:Paused: No 2024-09-04T16:27:12.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.736+0000 7f944211b640 1 -- 172.21.15.170:0/375298965 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f942406de30 msgr2=0x7f94240702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:12.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.736+0000 7f944211b640 1 --2- 172.21.15.170:0/375298965 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f942406de30 0x7f94240702f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f943c1018e0 tx=0x7f942c00a2d0 comp rx=0 tx=0).stop 2024-09-04T16:27:12.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.736+0000 7f944211b640 1 -- 172.21.15.170:0/375298965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f943c101a80 msgr2=0x7f943c19c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:12.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.736+0000 7f944211b640 1 --2- 172.21.15.170:0/375298965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f943c101a80 0x7f943c19c1e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9430006010 tx=0x7f94300048f0 comp rx=0 tx=0).stop 2024-09-04T16:27:12.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.736+0000 7f944211b640 1 -- 172.21.15.170:0/375298965 shutdown_connections 2024-09-04T16:27:12.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.736+0000 7f944211b640 1 --2- 172.21.15.170:0/375298965 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f942406de30 0x7f94240702f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:12.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.736+0000 7f944211b640 1 --2- 172.21.15.170:0/375298965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f943c101a80 0x7f943c19c1e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:12.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.736+0000 7f944211b640 1 --2- 172.21.15.170:0/375298965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f943c100880 0x7f943c06adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:12.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.736+0000 7f944211b640 1 -- 172.21.15.170:0/375298965 >> 172.21.15.170:0/375298965 conn(0x7f943c0fc010 msgr2=0x7f943c104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:12.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.736+0000 7f944211b640 1 -- 172.21.15.170:0/375298965 shutdown_connections 2024-09-04T16:27:12.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:12.736+0000 7f944211b640 1 -- 172.21.15.170:0/375298965 wait complete. 2024-09-04T16:27:13.400 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-04T16:27:13.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:13 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:27:13.646 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:13 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:27:14.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.090+0000 7f2e8c6bd640 1 -- 172.21.15.170:0/2443622992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e84104da0 msgr2=0x7f2e84107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:14.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.090+0000 7f2e8c6bd640 1 --2- 172.21.15.170:0/2443622992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e84104da0 0x7f2e84107190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009880 tx=0x7f2e7402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:14.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.090+0000 7f2e8c6bd640 1 -- 172.21.15.170:0/2443622992 shutdown_connections 2024-09-04T16:27:14.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.090+0000 7f2e8c6bd640 1 --2- 172.21.15.170:0/2443622992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e84104da0 0x7f2e84107190 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:14.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.090+0000 7f2e8c6bd640 1 --2- 172.21.15.170:0/2443622992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e84102470 0x7f2e84104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:14.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.090+0000 7f2e8c6bd640 1 -- 172.21.15.170:0/2443622992 >> 172.21.15.170:0/2443622992 conn(0x7f2e840fc010 msgr2=0x7f2e840fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:14.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.090+0000 7f2e8c6bd640 1 -- 172.21.15.170:0/2443622992 shutdown_connections 2024-09-04T16:27:14.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.090+0000 7f2e8c6bd640 1 -- 172.21.15.170:0/2443622992 wait complete. 2024-09-04T16:27:14.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.091+0000 7f2e8c6bd640 1 Processor -- start 2024-09-04T16:27:14.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.091+0000 7f2e8c6bd640 1 -- start start 2024-09-04T16:27:14.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.091+0000 7f2e8c6bd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e84102470 0x7f2e84101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:14.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.091+0000 7f2e8c6bd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e84104da0 0x7f2e84100420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:14.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.091+0000 7f2e8c6bd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8410a760 con 0x7f2e84102470 2024-09-04T16:27:14.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.091+0000 7f2e8c6bd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8410a5e0 con 0x7f2e84104da0 2024-09-04T16:27:14.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.091+0000 7f2e8a459640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e84102470 0x7f2e84101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:14.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.091+0000 7f2e8a459640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e84102470 0x7f2e84101d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49178/0 (socket says 172.21.15.170:49178) 2024-09-04T16:27:14.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.091+0000 7f2e8a459640 1 -- 172.21.15.170:0/2418920389 learned_addr learned my addr 172.21.15.170:0/2418920389 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:14.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.091+0000 7f2e89c58640 1 --2- 172.21.15.170:0/2418920389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e84104da0 0x7f2e84100420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:14.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.091+0000 7f2e8a459640 1 -- 172.21.15.170:0/2418920389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e84104da0 msgr2=0x7f2e84100420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:14.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.091+0000 7f2e8a459640 1 --2- 172.21.15.170:0/2418920389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e84104da0 0x7f2e84100420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:14.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.091+0000 7f2e8a459640 1 -- 172.21.15.170:0/2418920389 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8419b0b0 con 0x7f2e84102470 2024-09-04T16:27:14.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.092+0000 7f2e8a459640 1 --2- 172.21.15.170:0/2418920389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e84102470 0x7f2e84101d60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000d6f0 tx=0x7f2e8000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:14.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.092+0000 7f2e7b7fe640 1 -- 172.21.15.170:0/2418920389 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e80017070 con 0x7f2e84102470 2024-09-04T16:27:14.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.092+0000 7f2e7b7fe640 1 -- 172.21.15.170:0/2418920389 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e8000de00 con 0x7f2e84102470 2024-09-04T16:27:14.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.092+0000 7f2e8c6bd640 1 -- 172.21.15.170:0/2418920389 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e84100960 con 0x7f2e84102470 2024-09-04T16:27:14.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.092+0000 7f2e7b7fe640 1 -- 172.21.15.170:0/2418920389 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e80004bb0 con 0x7f2e84102470 2024-09-04T16:27:14.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.092+0000 7f2e8c6bd640 1 -- 172.21.15.170:0/2418920389 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e84100ec0 con 0x7f2e84102470 2024-09-04T16:27:14.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.093+0000 7f2e8c6bd640 1 -- 172.21.15.170:0/2418920389 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e8410af40 con 0x7f2e84102470 2024-09-04T16:27:14.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.093+0000 7f2e7b7fe640 1 -- 172.21.15.170:0/2418920389 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f2e80009a30 con 0x7f2e84102470 2024-09-04T16:27:14.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.094+0000 7f2e7b7fe640 1 --2- 172.21.15.170:0/2418920389 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f2e7006de90 0x7f2e70070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:14.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.094+0000 7f2e89c58640 1 --2- 172.21.15.170:0/2418920389 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f2e7006de90 0x7f2e70070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:14.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.094+0000 7f2e7b7fe640 1 -- 172.21.15.170:0/2418920389 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f2e8008d2f0 con 0x7f2e84102470 2024-09-04T16:27:14.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.094+0000 7f2e89c58640 1 --2- 172.21.15.170:0/2418920389 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f2e7006de90 0x7f2e70070350 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009230 tx=0x7f2e740058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:14.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.098+0000 7f2e7b7fe640 1 -- 172.21.15.170:0/2418920389 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e8005ef00 con 0x7f2e84102470 2024-09-04T16:27:14.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.272+0000 7f2e8c6bd640 1 -- 172.21.15.170:0/2418920389 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2e84105720 con 0x7f2e7006de90 2024-09-04T16:27:14.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.281+0000 7f2e7b7fe640 1 -- 172.21.15.170:0/2418920389 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3120 (secure 0 0 0) 0x7f2e84105720 con 0x7f2e7006de90 2024-09-04T16:27:14.282 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:27:14.282 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (3m) 118s ago 5m 26.0M - 0.25.0 c8568f914cd2 e85db6a2e731 2024-09-04T16:27:14.282 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (5m) 118s ago 5m 7746k - 19.1.1-252-g48920dab b708f9119ac7 8499640d7363 2024-09-04T16:27:14.282 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (4m) 43s ago 4m 5268k - 19.1.1-252-g48920dab b708f9119ac7 f9a24a1cb9dd 2024-09-04T16:27:14.282 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (5m) 118s ago 5m 6891k - 19.1.1-252-g48920dab b708f9119ac7 aa2ec5c5776a 2024-09-04T16:27:14.282 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (4m) 43s ago 4m 6895k - 19.1.1-252-g48920dab b708f9119ac7 a24f0ce3b3fb 2024-09-04T16:27:14.282 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (3m) 118s ago 4m 72.6M - 9.4.12 2bacad6d85d8 5bffd3332aba 2024-09-04T16:27:14.282 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:9283,8765,8443 running (6m) 118s ago 6m 489M - 19.1.1-252-g48920dab b708f9119ac7 3f0663652a64 2024-09-04T16:27:14.283 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (4m) 43s ago 4m 439M - 19.1.1-252-g48920dab b708f9119ac7 1a44816379f1 2024-09-04T16:27:14.283 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (6m) 118s ago 6m 46.5M 2048M 19.1.1-252-g48920dab b708f9119ac7 194ff39cc041 2024-09-04T16:27:14.283 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (4m) 43s ago 4m 40.1M 2048M 19.1.1-252-g48920dab b708f9119ac7 38c8e99ca323 2024-09-04T16:27:14.283 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (5m) 118s ago 5m 15.6M - 1.5.0 0da6a335fe13 e311ba1b18bc 2024-09-04T16:27:14.283 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (4m) 43s ago 4m 16.0M - 1.5.0 0da6a335fe13 09fd1aa1fdb6 2024-09-04T16:27:14.283 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (3m) 118s ago 3m 45.0M 3946M 19.1.1-252-g48920dab b708f9119ac7 6c2ea484615d 2024-09-04T16:27:14.283 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (2m) 118s ago 2m 47.2M 3946M 19.1.1-252-g48920dab b708f9119ac7 20469ba5727b 2024-09-04T16:27:14.283 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (2m) 118s ago 2m 14.4M 3946M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:27:14.283 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (101s) 43s ago 100s 47.8M 4970M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:27:14.283 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (74s) 43s ago 73s 38.2M 4970M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:27:14.283 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (48s) 43s ago 47s 12.1M 4970M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:27:14.284 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (3m) 118s ago 4m 42.7M - 2.43.0 a07b618ecd1d 58faf9d631cd 2024-09-04T16:27:14.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.283+0000 7f2e8c6bd640 1 -- 172.21.15.170:0/2418920389 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f2e7006de90 msgr2=0x7f2e70070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:14.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.283+0000 7f2e8c6bd640 1 --2- 172.21.15.170:0/2418920389 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f2e7006de90 0x7f2e70070350 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009230 tx=0x7f2e740058d0 comp rx=0 tx=0).stop 2024-09-04T16:27:14.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.283+0000 7f2e8c6bd640 1 -- 172.21.15.170:0/2418920389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e84102470 msgr2=0x7f2e84101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:14.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.283+0000 7f2e8c6bd640 1 --2- 172.21.15.170:0/2418920389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e84102470 0x7f2e84101d60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000d6f0 tx=0x7f2e8000dbb0 comp rx=0 tx=0).stop 2024-09-04T16:27:14.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.283+0000 7f2e8c6bd640 1 -- 172.21.15.170:0/2418920389 shutdown_connections 2024-09-04T16:27:14.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.283+0000 7f2e8c6bd640 1 --2- 172.21.15.170:0/2418920389 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f2e7006de90 0x7f2e70070350 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:14.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.283+0000 7f2e8c6bd640 1 --2- 172.21.15.170:0/2418920389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e84104da0 0x7f2e84100420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:14.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.283+0000 7f2e8c6bd640 1 --2- 172.21.15.170:0/2418920389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e84102470 0x7f2e84101d60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:14.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.283+0000 7f2e8c6bd640 1 -- 172.21.15.170:0/2418920389 >> 172.21.15.170:0/2418920389 conn(0x7f2e840fc010 msgr2=0x7f2e840fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:14.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.283+0000 7f2e8c6bd640 1 -- 172.21.15.170:0/2418920389 shutdown_connections 2024-09-04T16:27:14.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:14.283+0000 7f2e8c6bd640 1 -- 172.21.15.170:0/2418920389 wait complete. 2024-09-04T16:27:14.573 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:14 smithi170 ceph-mon[29272]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:27:14.573 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:14 smithi170 ceph-mon[29272]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:14 smithi193 ceph-mon[36288]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:27:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:14 smithi193 ceph-mon[36288]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:14.893 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-04T16:27:15.147 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:15.551 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:15 smithi170 ceph-mon[29272]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:27:15.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.631+0000 7f0f57164640 1 -- 172.21.15.170:0/2555514135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f50102b90 msgr2=0x7f0f50103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:15.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.631+0000 7f0f57164640 1 --2- 172.21.15.170:0/2555514135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f50102b90 0x7f0f50103010 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0f40009c20 tx=0x7f0f4002a970 comp rx=0 tx=0).stop 2024-09-04T16:27:15.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.631+0000 7f0f57164640 1 -- 172.21.15.170:0/2555514135 shutdown_connections 2024-09-04T16:27:15.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.631+0000 7f0f57164640 1 --2- 172.21.15.170:0/2555514135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f50102b90 0x7f0f50103010 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:15.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.631+0000 7f0f57164640 1 --2- 172.21.15.170:0/2555514135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f50101990 0x7f0f50101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:15.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.631+0000 7f0f57164640 1 -- 172.21.15.170:0/2555514135 >> 172.21.15.170:0/2555514135 conn(0x7f0f500fd140 msgr2=0x7f0f500ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:15.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.631+0000 7f0f57164640 1 -- 172.21.15.170:0/2555514135 shutdown_connections 2024-09-04T16:27:15.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.631+0000 7f0f57164640 1 -- 172.21.15.170:0/2555514135 wait complete. 2024-09-04T16:27:15.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.632+0000 7f0f57164640 1 Processor -- start 2024-09-04T16:27:15.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.632+0000 7f0f57164640 1 -- start start 2024-09-04T16:27:15.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.632+0000 7f0f57164640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f50101990 0x7f0f501974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:15.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.632+0000 7f0f57164640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f50102b90 0x7f0f501979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:15.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.632+0000 7f0f57164640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5010a7b0 con 0x7f0f50101990 2024-09-04T16:27:15.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.632+0000 7f0f57164640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5010a630 con 0x7f0f50102b90 2024-09-04T16:27:15.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.632+0000 7f0f54f00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f50101990 0x7f0f501974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:15.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.632+0000 7f0f54f00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f50101990 0x7f0f501974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:52434/0 (socket says 172.21.15.170:52434) 2024-09-04T16:27:15.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.632+0000 7f0f54f00640 1 -- 172.21.15.170:0/1658205545 learned_addr learned my addr 172.21.15.170:0/1658205545 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:15.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.632+0000 7f0f4ffff640 1 --2- 172.21.15.170:0/1658205545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f50102b90 0x7f0f501979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:15.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.632+0000 7f0f54f00640 1 -- 172.21.15.170:0/1658205545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f50102b90 msgr2=0x7f0f501979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:15.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.632+0000 7f0f54f00640 1 --2- 172.21.15.170:0/1658205545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f50102b90 0x7f0f501979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:15.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.632+0000 7f0f54f00640 1 -- 172.21.15.170:0/1658205545 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f50198060 con 0x7f0f50101990 2024-09-04T16:27:15.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.632+0000 7f0f54f00640 1 --2- 172.21.15.170:0/1658205545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f50101990 0x7f0f501974a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0f4800c8f0 tx=0x7f0f4800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:15.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.632+0000 7f0f4dffb640 1 -- 172.21.15.170:0/1658205545 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f480079b0 con 0x7f0f50101990 2024-09-04T16:27:15.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.633+0000 7f0f4dffb640 1 -- 172.21.15.170:0/1658205545 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f48007b50 con 0x7f0f50101990 2024-09-04T16:27:15.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.633+0000 7f0f57164640 1 -- 172.21.15.170:0/1658205545 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5019caa0 con 0x7f0f50101990 2024-09-04T16:27:15.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.633+0000 7f0f4dffb640 1 -- 172.21.15.170:0/1658205545 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f48018610 con 0x7f0f50101990 2024-09-04T16:27:15.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.633+0000 7f0f57164640 1 -- 172.21.15.170:0/1658205545 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5019d030 con 0x7f0f50101990 2024-09-04T16:27:15.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.634+0000 7f0f57164640 1 -- 172.21.15.170:0/1658205545 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f50101d90 con 0x7f0f50101990 2024-09-04T16:27:15.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.634+0000 7f0f4dffb640 1 -- 172.21.15.170:0/1658205545 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f0f48007d00 con 0x7f0f50101990 2024-09-04T16:27:15.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.634+0000 7f0f4dffb640 1 --2- 172.21.15.170:0/1658205545 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f0f3c06de30 0x7f0f3c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:15.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.635+0000 7f0f4dffb640 1 -- 172.21.15.170:0/1658205545 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f0f4808db40 con 0x7f0f50101990 2024-09-04T16:27:15.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.635+0000 7f0f4ffff640 1 --2- 172.21.15.170:0/1658205545 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f0f3c06de30 0x7f0f3c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:15.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.635+0000 7f0f4ffff640 1 --2- 172.21.15.170:0/1658205545 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f0f3c06de30 0x7f0f3c0702f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f50198950 tx=0x7f0f4002f9f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:15.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.639+0000 7f0f4dffb640 1 -- 172.21.15.170:0/1658205545 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f48014030 con 0x7f0f50101990 2024-09-04T16:27:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:15 smithi193 ceph-mon[36288]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:27:15.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.810+0000 7f0f57164640 1 -- 172.21.15.170:0/1658205545 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f0f50107110 con 0x7f0f3c06de30 2024-09-04T16:27:15.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.816+0000 7f0f4dffb640 1 -- 172.21.15.170:0/1658205545 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1310 (secure 0 0 0) 0x7f0f50107110 con 0x7f0f3c06de30 2024-09-04T16:27:15.816 INFO:teuthology.orchestra.run.smithi170.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-04T16:27:15.816 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager ?:9093,9094 1/1 119s ago 5m count:1 2024-09-04T16:27:15.816 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter 2/2 119s ago 5m * 2024-09-04T16:27:15.816 INFO:teuthology.orchestra.run.smithi170.stdout:crash 2/2 119s ago 5m * 2024-09-04T16:27:15.816 INFO:teuthology.orchestra.run.smithi170.stdout:grafana ?:3000 1/1 119s ago 5m count:1 2024-09-04T16:27:15.817 INFO:teuthology.orchestra.run.smithi170.stdout:mgr 2/2 119s ago 5m count:2 2024-09-04T16:27:15.817 INFO:teuthology.orchestra.run.smithi170.stdout:mon 2/2 119s ago 5m smithi170:172.21.15.170=smithi170;smithi193:172.21.15.193=smithi193;count:2 2024-09-04T16:27:15.817 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter ?:9100 2/2 119s ago 5m * 2024-09-04T16:27:15.817 INFO:teuthology.orchestra.run.smithi170.stdout:osd 6 119s ago - 2024-09-04T16:27:15.817 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus ?:9095 1/1 119s ago 5m count:1 2024-09-04T16:27:15.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.818+0000 7f0f57164640 1 -- 172.21.15.170:0/1658205545 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f0f3c06de30 msgr2=0x7f0f3c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:15.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.818+0000 7f0f57164640 1 --2- 172.21.15.170:0/1658205545 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f0f3c06de30 0x7f0f3c0702f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f50198950 tx=0x7f0f4002f9f0 comp rx=0 tx=0).stop 2024-09-04T16:27:15.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.818+0000 7f0f57164640 1 -- 172.21.15.170:0/1658205545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f50101990 msgr2=0x7f0f501974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:15.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.818+0000 7f0f57164640 1 --2- 172.21.15.170:0/1658205545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f50101990 0x7f0f501974a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0f4800c8f0 tx=0x7f0f4800cdb0 comp rx=0 tx=0).stop 2024-09-04T16:27:15.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.818+0000 7f0f57164640 1 -- 172.21.15.170:0/1658205545 shutdown_connections 2024-09-04T16:27:15.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.818+0000 7f0f57164640 1 --2- 172.21.15.170:0/1658205545 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f0f3c06de30 0x7f0f3c0702f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:15.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.818+0000 7f0f57164640 1 --2- 172.21.15.170:0/1658205545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f50102b90 0x7f0f501979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:15.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.818+0000 7f0f57164640 1 --2- 172.21.15.170:0/1658205545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f50101990 0x7f0f501974a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:15.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.818+0000 7f0f57164640 1 -- 172.21.15.170:0/1658205545 >> 172.21.15.170:0/1658205545 conn(0x7f0f500fd140 msgr2=0x7f0f500ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:15.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.818+0000 7f0f57164640 1 -- 172.21.15.170:0/1658205545 shutdown_connections 2024-09-04T16:27:15.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:15.818+0000 7f0f57164640 1 -- 172.21.15.170:0/1658205545 wait complete. 2024-09-04T16:27:16.416 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-04T16:27:16.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:16 smithi170 ceph-mon[29272]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:16 smithi193 ceph-mon[36288]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:16.662 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:17.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.130+0000 7f07f5a6c640 1 -- 172.21.15.170:0/2024143169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07f0100880 msgr2=0x7f07f0100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:17.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.130+0000 7f07f5a6c640 1 --2- 172.21.15.170:0/2024143169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07f0100880 0x7f07f0100c80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009c20 tx=0x7f07e002a970 comp rx=0 tx=0).stop 2024-09-04T16:27:17.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.130+0000 7f07f5a6c640 1 -- 172.21.15.170:0/2024143169 shutdown_connections 2024-09-04T16:27:17.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.130+0000 7f07f5a6c640 1 --2- 172.21.15.170:0/2024143169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07f0101a80 0x7f07f0101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:17.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.130+0000 7f07f5a6c640 1 --2- 172.21.15.170:0/2024143169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07f0100880 0x7f07f0100c80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:17.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.130+0000 7f07f5a6c640 1 -- 172.21.15.170:0/2024143169 >> 172.21.15.170:0/2024143169 conn(0x7f07f00fc010 msgr2=0x7f07f00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:17.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.130+0000 7f07f5a6c640 1 -- 172.21.15.170:0/2024143169 shutdown_connections 2024-09-04T16:27:17.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.130+0000 7f07f5a6c640 1 -- 172.21.15.170:0/2024143169 wait complete. 2024-09-04T16:27:17.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.131+0000 7f07f5a6c640 1 Processor -- start 2024-09-04T16:27:17.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.131+0000 7f07f5a6c640 1 -- start start 2024-09-04T16:27:17.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.131+0000 7f07f5a6c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07f0100880 0x7f07f01963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:17.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.131+0000 7f07f5a6c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07f0101a80 0x7f07f0196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:17.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.131+0000 7f07f5a6c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f07f01096c0 con 0x7f07f0100880 2024-09-04T16:27:17.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.131+0000 7f07f5a6c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f07f0109540 con 0x7f07f0101a80 2024-09-04T16:27:17.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.131+0000 7f07ef7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07f0100880 0x7f07f01963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:17.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.131+0000 7f07ef7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07f0100880 0x7f07f01963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:52444/0 (socket says 172.21.15.170:52444) 2024-09-04T16:27:17.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.131+0000 7f07ef7fe640 1 -- 172.21.15.170:0/2755940942 learned_addr learned my addr 172.21.15.170:0/2755940942 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:17.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.132+0000 7f07eeffd640 1 --2- 172.21.15.170:0/2755940942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07f0101a80 0x7f07f0196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:17.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.132+0000 7f07ef7fe640 1 -- 172.21.15.170:0/2755940942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07f0101a80 msgr2=0x7f07f0196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:17.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.132+0000 7f07ef7fe640 1 --2- 172.21.15.170:0/2755940942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07f0101a80 0x7f07f0196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:17.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.132+0000 7f07ef7fe640 1 -- 172.21.15.170:0/2755940942 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f0196fa0 con 0x7f07f0100880 2024-09-04T16:27:17.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.132+0000 7f07eeffd640 1 --2- 172.21.15.170:0/2755940942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07f0101a80 0x7f07f0196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:27:17.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.132+0000 7f07ef7fe640 1 --2- 172.21.15.170:0/2755940942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07f0100880 0x7f07f01963e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f07e0006010 tx=0x7f07e002f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:17.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.132+0000 7f07ecff9640 1 -- 172.21.15.170:0/2755940942 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07e0049070 con 0x7f07f0100880 2024-09-04T16:27:17.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.132+0000 7f07ecff9640 1 -- 172.21.15.170:0/2755940942 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07e0003e30 con 0x7f07f0100880 2024-09-04T16:27:17.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.132+0000 7f07f5a6c640 1 -- 172.21.15.170:0/2755940942 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f006a300 con 0x7f07f0100880 2024-09-04T16:27:17.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.132+0000 7f07ecff9640 1 -- 172.21.15.170:0/2755940942 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07e0034050 con 0x7f07f0100880 2024-09-04T16:27:17.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.132+0000 7f07f5a6c640 1 -- 172.21.15.170:0/2755940942 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f006a910 con 0x7f07f0100880 2024-09-04T16:27:17.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.133+0000 7f07f5a6c640 1 -- 172.21.15.170:0/2755940942 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f0109ea0 con 0x7f07f0100880 2024-09-04T16:27:17.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.134+0000 7f07ecff9640 1 -- 172.21.15.170:0/2755940942 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f07e004c070 con 0x7f07f0100880 2024-09-04T16:27:17.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.134+0000 7f07ecff9640 1 --2- 172.21.15.170:0/2755940942 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f07d806de30 0x7f07d80702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:17.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.134+0000 7f07ecff9640 1 -- 172.21.15.170:0/2755940942 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f07e0040030 con 0x7f07f0100880 2024-09-04T16:27:17.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.134+0000 7f07eeffd640 1 --2- 172.21.15.170:0/2755940942 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f07d806de30 0x7f07d80702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:17.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.134+0000 7f07eeffd640 1 --2- 172.21.15.170:0/2755940942 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f07d806de30 0x7f07d80702f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f07f0197890 tx=0x7f07e4005d30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:17.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.138+0000 7f07ecff9640 1 -- 172.21.15.170:0/2755940942 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f07e007e800 con 0x7f07f0100880 2024-09-04T16:27:17.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.310+0000 7f07f5a6c640 1 -- 172.21.15.170:0/2755940942 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f07f01904b0 con 0x7f07d806de30 2024-09-04T16:27:17.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.312+0000 7f07ecff9640 1 -- 172.21.15.170:0/2755940942 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+148 (secure 0 0 0) 0x7f07f01904b0 con 0x7f07d806de30 2024-09-04T16:27:17.312 INFO:teuthology.orchestra.run.smithi170.stdout:HOST ADDR LABELS STATUS 2024-09-04T16:27:17.313 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170 172.21.15.170 2024-09-04T16:27:17.313 INFO:teuthology.orchestra.run.smithi170.stdout:smithi193 172.21.15.193 2024-09-04T16:27:17.313 INFO:teuthology.orchestra.run.smithi170.stdout:2 hosts in cluster 2024-09-04T16:27:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.314+0000 7f07f5a6c640 1 -- 172.21.15.170:0/2755940942 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f07d806de30 msgr2=0x7f07d80702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.314+0000 7f07f5a6c640 1 --2- 172.21.15.170:0/2755940942 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f07d806de30 0x7f07d80702f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f07f0197890 tx=0x7f07e4005d30 comp rx=0 tx=0).stop 2024-09-04T16:27:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.314+0000 7f07f5a6c640 1 -- 172.21.15.170:0/2755940942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07f0100880 msgr2=0x7f07f01963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.314+0000 7f07f5a6c640 1 --2- 172.21.15.170:0/2755940942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07f0100880 0x7f07f01963e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f07e0006010 tx=0x7f07e002f730 comp rx=0 tx=0).stop 2024-09-04T16:27:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.314+0000 7f07f5a6c640 1 -- 172.21.15.170:0/2755940942 shutdown_connections 2024-09-04T16:27:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.314+0000 7f07f5a6c640 1 --2- 172.21.15.170:0/2755940942 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f07d806de30 0x7f07d80702f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.314+0000 7f07f5a6c640 1 --2- 172.21.15.170:0/2755940942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07f0101a80 0x7f07f0196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.314+0000 7f07f5a6c640 1 --2- 172.21.15.170:0/2755940942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07f0100880 0x7f07f01963e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.314+0000 7f07f5a6c640 1 -- 172.21.15.170:0/2755940942 >> 172.21.15.170:0/2755940942 conn(0x7f07f00fc010 msgr2=0x7f07f0104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.314+0000 7f07f5a6c640 1 -- 172.21.15.170:0/2755940942 shutdown_connections 2024-09-04T16:27:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:17.314+0000 7f07f5a6c640 1 -- 172.21.15.170:0/2755940942 wait complete. 2024-09-04T16:27:17.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:17 smithi170 ceph-mon[29272]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:27:17.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:17 smithi193 ceph-mon[36288]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:27:17.883 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-04T16:27:18.132 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:18.580 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:18 smithi170 ceph-mon[29272]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:18.580 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:18 smithi170 ceph-mon[29272]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:27:18.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.579+0000 7f05df944640 1 -- 172.21.15.170:0/15391612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05d8102b90 msgr2=0x7f05d8103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:18.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.579+0000 7f05df944640 1 --2- 172.21.15.170:0/15391612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05d8102b90 0x7f05d8103010 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009880 tx=0x7f05c802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.579+0000 7f05df944640 1 -- 172.21.15.170:0/15391612 shutdown_connections 2024-09-04T16:27:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.579+0000 7f05df944640 1 --2- 172.21.15.170:0/15391612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05d8102b90 0x7f05d8103010 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.579+0000 7f05df944640 1 --2- 172.21.15.170:0/15391612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05d8101990 0x7f05d8101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.579+0000 7f05df944640 1 -- 172.21.15.170:0/15391612 >> 172.21.15.170:0/15391612 conn(0x7f05d80fd140 msgr2=0x7f05d80ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.579+0000 7f05df944640 1 -- 172.21.15.170:0/15391612 shutdown_connections 2024-09-04T16:27:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.579+0000 7f05df944640 1 -- 172.21.15.170:0/15391612 wait complete. 2024-09-04T16:27:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.580+0000 7f05df944640 1 Processor -- start 2024-09-04T16:27:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.580+0000 7f05df944640 1 -- start start 2024-09-04T16:27:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.580+0000 7f05df944640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05d8101990 0x7f05d81974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.580+0000 7f05df944640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05d8102b90 0x7f05d81979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:18.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.580+0000 7f05df944640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f05d810a7b0 con 0x7f05d8101990 2024-09-04T16:27:18.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.580+0000 7f05df944640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05d810a630 con 0x7f05d8102b90 2024-09-04T16:27:18.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.580+0000 7f05dd6e0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05d8101990 0x7f05d81974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:18.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.580+0000 7f05dd6e0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05d8101990 0x7f05d81974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:52462/0 (socket says 172.21.15.170:52462) 2024-09-04T16:27:18.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.580+0000 7f05dd6e0640 1 -- 172.21.15.170:0/357200252 learned_addr learned my addr 172.21.15.170:0/357200252 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:18.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.580+0000 7f05dcedf640 1 --2- 172.21.15.170:0/357200252 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05d8102b90 0x7f05d81979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:18.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.580+0000 7f05dd6e0640 1 -- 172.21.15.170:0/357200252 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05d8102b90 msgr2=0x7f05d81979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:18.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.580+0000 7f05dd6e0640 1 --2- 172.21.15.170:0/357200252 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05d8102b90 0x7f05d81979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:18.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.580+0000 7f05dd6e0640 1 -- 172.21.15.170:0/357200252 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d8198060 con 0x7f05d8101990 2024-09-04T16:27:18.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.580+0000 7f05dcedf640 1 --2- 172.21.15.170:0/357200252 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05d8102b90 0x7f05d81979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:27:18.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.581+0000 7f05dd6e0640 1 --2- 172.21.15.170:0/357200252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05d8101990 0x7f05d81974a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f05d400cc30 tx=0x7f05d400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:18.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.581+0000 7f05ce7fc640 1 -- 172.21.15.170:0/357200252 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05d400cd20 con 0x7f05d8101990 2024-09-04T16:27:18.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.581+0000 7f05ce7fc640 1 -- 172.21.15.170:0/357200252 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05d400f910 con 0x7f05d8101990 2024-09-04T16:27:18.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.581+0000 7f05df944640 1 -- 172.21.15.170:0/357200252 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d819caa0 con 0x7f05d8101990 2024-09-04T16:27:18.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.581+0000 7f05ce7fc640 1 -- 172.21.15.170:0/357200252 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05d4018960 con 0x7f05d8101990 2024-09-04T16:27:18.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.581+0000 7f05df944640 1 -- 172.21.15.170:0/357200252 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d819d030 con 0x7f05d8101990 2024-09-04T16:27:18.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.582+0000 7f05df944640 1 -- 172.21.15.170:0/357200252 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05d8101d90 con 0x7f05d8101990 2024-09-04T16:27:18.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.582+0000 7f05ce7fc640 1 -- 172.21.15.170:0/357200252 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f05d400f450 con 0x7f05d8101990 2024-09-04T16:27:18.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.583+0000 7f05ce7fc640 1 --2- 172.21.15.170:0/357200252 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f05c406de90 0x7f05c4070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:18.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.583+0000 7f05ce7fc640 1 -- 172.21.15.170:0/357200252 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f05d408dda0 con 0x7f05d8101990 2024-09-04T16:27:18.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.583+0000 7f05dcedf640 1 --2- 172.21.15.170:0/357200252 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f05c406de90 0x7f05c4070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:18.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.583+0000 7f05dcedf640 1 --2- 172.21.15.170:0/357200252 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f05c406de90 0x7f05c4070350 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f05c80096c0 tx=0x7f05c8009650 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:18.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.587+0000 7f05ce7fc640 1 -- 172.21.15.170:0/357200252 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05d4014030 con 0x7f05d8101990 2024-09-04T16:27:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:18 smithi193 ceph-mon[36288]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:18 smithi193 ceph-mon[36288]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:27:18.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.758+0000 7f05df944640 1 -- 172.21.15.170:0/357200252 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f05d8062630 con 0x7f05c406de90 2024-09-04T16:27:18.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.760+0000 7f05ce7fc640 1 -- 172.21.15.170:0/357200252 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+399 (secure 0 0 0) 0x7f05d8062630 con 0x7f05c406de90 2024-09-04T16:27:18.760 INFO:teuthology.orchestra.run.smithi170.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-04T16:27:18.760 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002R480DGN 447G No 119s ago Has a FileSystem, LVM detected 2024-09-04T16:27:18.761 INFO:teuthology.orchestra.run.smithi170.stdout:smithi193 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500HB400BGN 372G No 44s ago Has a FileSystem, LVM detected 2024-09-04T16:27:18.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.762+0000 7f05df944640 1 -- 172.21.15.170:0/357200252 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f05c406de90 msgr2=0x7f05c4070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:18.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.762+0000 7f05df944640 1 --2- 172.21.15.170:0/357200252 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f05c406de90 0x7f05c4070350 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f05c80096c0 tx=0x7f05c8009650 comp rx=0 tx=0).stop 2024-09-04T16:27:18.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.762+0000 7f05df944640 1 -- 172.21.15.170:0/357200252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05d8101990 msgr2=0x7f05d81974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:18.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.762+0000 7f05df944640 1 --2- 172.21.15.170:0/357200252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05d8101990 0x7f05d81974a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f05d400cc30 tx=0x7f05d400a620 comp rx=0 tx=0).stop 2024-09-04T16:27:18.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.762+0000 7f05df944640 1 -- 172.21.15.170:0/357200252 shutdown_connections 2024-09-04T16:27:18.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.762+0000 7f05df944640 1 --2- 172.21.15.170:0/357200252 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f05c406de90 0x7f05c4070350 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:18.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.762+0000 7f05df944640 1 --2- 172.21.15.170:0/357200252 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05d8102b90 0x7f05d81979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:18.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.762+0000 7f05df944640 1 --2- 172.21.15.170:0/357200252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05d8101990 0x7f05d81974a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:18.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.762+0000 7f05df944640 1 -- 172.21.15.170:0/357200252 >> 172.21.15.170:0/357200252 conn(0x7f05d80fd140 msgr2=0x7f05d8106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:18.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.762+0000 7f05df944640 1 -- 172.21.15.170:0/357200252 shutdown_connections 2024-09-04T16:27:18.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:18.762+0000 7f05df944640 1 -- 172.21.15.170:0/357200252 wait complete. 2024-09-04T16:27:19.290 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-04T16:27:19.300 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi170.front.sepia.ceph.com 2024-09-04T16:27:19.300 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-04T16:27:19.545 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:20.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.022+0000 7fe16f96c640 1 -- 172.21.15.170:0/1527760944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe168101990 msgr2=0x7fe168101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:20.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.022+0000 7fe16f96c640 1 --2- 172.21.15.170:0/1527760944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe168101990 0x7fe168101d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe164009880 tx=0x7fe16402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:20.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.022+0000 7fe16f96c640 1 -- 172.21.15.170:0/1527760944 shutdown_connections 2024-09-04T16:27:20.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.022+0000 7fe16f96c640 1 --2- 172.21.15.170:0/1527760944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe168102b90 0x7fe168103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:20.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.022+0000 7fe16f96c640 1 --2- 172.21.15.170:0/1527760944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe168101990 0x7fe168101d90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:20.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.022+0000 7fe16f96c640 1 -- 172.21.15.170:0/1527760944 >> 172.21.15.170:0/1527760944 conn(0x7fe1680fd140 msgr2=0x7fe1680ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:20.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.022+0000 7fe16f96c640 1 -- 172.21.15.170:0/1527760944 shutdown_connections 2024-09-04T16:27:20.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.022+0000 7fe16f96c640 1 -- 172.21.15.170:0/1527760944 wait complete. 2024-09-04T16:27:20.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.023+0000 7fe16f96c640 1 Processor -- start 2024-09-04T16:27:20.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.023+0000 7fe16f96c640 1 -- start start 2024-09-04T16:27:20.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.023+0000 7fe16f96c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe168101990 0x7fe1681996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:20.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.023+0000 7fe16f96c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe168102b90 0x7fe168199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:20.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.023+0000 7fe16f96c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe16810a7b0 con 0x7fe168101990 2024-09-04T16:27:20.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.023+0000 7fe16f96c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe16810a630 con 0x7fe168102b90 2024-09-04T16:27:20.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.023+0000 7fe16d708640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe168101990 0x7fe1681996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:20.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.023+0000 7fe16d708640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe168101990 0x7fe1681996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:52484/0 (socket says 172.21.15.170:52484) 2024-09-04T16:27:20.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.023+0000 7fe16d708640 1 -- 172.21.15.170:0/1609825913 learned_addr learned my addr 172.21.15.170:0/1609825913 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:20.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.023+0000 7fe16d708640 1 -- 172.21.15.170:0/1609825913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe168102b90 msgr2=0x7fe168199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:20.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.023+0000 7fe16d708640 1 --2- 172.21.15.170:0/1609825913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe168102b90 0x7fe168199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:20.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.023+0000 7fe16d708640 1 -- 172.21.15.170:0/1609825913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16819a200 con 0x7fe168101990 2024-09-04T16:27:20.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.024+0000 7fe16d708640 1 --2- 172.21.15.170:0/1609825913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe168101990 0x7fe1681996d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe164006010 tx=0x7fe1640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:20.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.024+0000 7fe15e7fc640 1 -- 172.21.15.170:0/1609825913 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe16403f070 con 0x7fe168101990 2024-09-04T16:27:20.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.024+0000 7fe15e7fc640 1 -- 172.21.15.170:0/1609825913 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe1640044d0 con 0x7fe168101990 2024-09-04T16:27:20.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.024+0000 7fe16f96c640 1 -- 172.21.15.170:0/1609825913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16819ec10 con 0x7fe168101990 2024-09-04T16:27:20.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.024+0000 7fe16f96c640 1 -- 172.21.15.170:0/1609825913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe16819f110 con 0x7fe168101990 2024-09-04T16:27:20.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.024+0000 7fe15e7fc640 1 -- 172.21.15.170:0/1609825913 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe164035030 con 0x7fe168101990 2024-09-04T16:27:20.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.025+0000 7fe16f96c640 1 -- 172.21.15.170:0/1609825913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe168101d90 con 0x7fe168101990 2024-09-04T16:27:20.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.025+0000 7fe15e7fc640 1 -- 172.21.15.170:0/1609825913 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7fe164042070 con 0x7fe168101990 2024-09-04T16:27:20.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.026+0000 7fe15e7fc640 1 --2- 172.21.15.170:0/1609825913 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fe15406de30 0x7fe1540702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:20.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.026+0000 7fe15e7fc640 1 -- 172.21.15.170:0/1609825913 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fe1640ae4d0 con 0x7fe168101990 2024-09-04T16:27:20.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.026+0000 7fe16cf07640 1 --2- 172.21.15.170:0/1609825913 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fe15406de30 0x7fe1540702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:20.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.026+0000 7fe16cf07640 1 --2- 172.21.15.170:0/1609825913 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fe15406de30 0x7fe1540702f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe16819ab80 tx=0x7fe158005c70 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:20.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.030+0000 7fe15e7fc640 1 -- 172.21.15.170:0/1609825913 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe16407c3b0 con 0x7fe168101990 2024-09-04T16:27:20.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:20.220+0000 7fe16f96c640 1 -- 172.21.15.170:0/1609825913 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) -- 0x7fe168075d80 con 0x7fe15406de30 2024-09-04T16:27:20.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:20 smithi170 ceph-mon[29272]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:27:20.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:20 smithi170 ceph-mon[29272]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:20.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:20 smithi193 ceph-mon[36288]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:27:20.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:20 smithi193 ceph-mon[36288]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:21.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:21.530+0000 7fe15e7fc640 1 -- 172.21.15.170:0/1609825913 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe168075d80 con 0x7fe15406de30 2024-09-04T16:27:21.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:21.533+0000 7fe16f96c640 1 -- 172.21.15.170:0/1609825913 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fe15406de30 msgr2=0x7fe1540702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:21.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:21.533+0000 7fe16f96c640 1 --2- 172.21.15.170:0/1609825913 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fe15406de30 0x7fe1540702f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe16819ab80 tx=0x7fe158005c70 comp rx=0 tx=0).stop 2024-09-04T16:27:21.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:21.533+0000 7fe16f96c640 1 -- 172.21.15.170:0/1609825913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe168101990 msgr2=0x7fe1681996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:21.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:21.533+0000 7fe16f96c640 1 --2- 172.21.15.170:0/1609825913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe168101990 0x7fe1681996d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe164006010 tx=0x7fe1640048f0 comp rx=0 tx=0).stop 2024-09-04T16:27:21.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:21.534+0000 7fe16f96c640 1 -- 172.21.15.170:0/1609825913 shutdown_connections 2024-09-04T16:27:21.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:21.534+0000 7fe16f96c640 1 --2- 172.21.15.170:0/1609825913 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fe15406de30 0x7fe1540702f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:21.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:21.534+0000 7fe16f96c640 1 --2- 172.21.15.170:0/1609825913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe168102b90 0x7fe168199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:21.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:21.534+0000 7fe16f96c640 1 --2- 172.21.15.170:0/1609825913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe168101990 0x7fe1681996d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:21.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:21.534+0000 7fe16f96c640 1 -- 172.21.15.170:0/1609825913 >> 172.21.15.170:0/1609825913 conn(0x7fe1680fd140 msgr2=0x7fe168074660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:21.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:21.534+0000 7fe16f96c640 1 -- 172.21.15.170:0/1609825913 shutdown_connections 2024-09-04T16:27:21.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:21.534+0000 7fe16f96c640 1 -- 172.21.15.170:0/1609825913 wait complete. 2024-09-04T16:27:21.834 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:21 smithi170 ceph-mon[29272]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:27:21.834 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:21 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-04T16:27:21.834 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:21 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-04T16:27:21.835 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:21 smithi170 ceph-mon[29272]: osdmap e40: 6 total, 6 up, 6 in 2024-09-04T16:27:21.835 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:21 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-04T16:27:21.835 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:21 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170[29268]: 2024-09-04T16:27:21.511+0000 7f8b9fda9640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-04T16:27:21.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:21 smithi193 ceph-mon[36288]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:27:21.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:21 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-04T16:27:21.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:21 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-04T16:27:21.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:21 smithi193 ceph-mon[36288]: osdmap e40: 6 total, 6 up, 6 in 2024-09-04T16:27:21.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:21 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-04T16:27:22.253 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-04T16:27:22.486 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: pgmap v167: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:22.486 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-04T16:27:22.486 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: osdmap e41: 6 total, 6 up, 6 in 2024-09-04T16:27:22.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-04T16:27:22.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-04T16:27:22.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-04T16:27:22.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-04T16:27:22.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: osdmap e42: 6 total, 6 up, 6 in 2024-09-04T16:27:22.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: fsmap cephfs:0 2024-09-04T16:27:22.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:22.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:27:22.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-04T16:27:22.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:27:22.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:27:22.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:22.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.zkhdil", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-04T16:27:22.488 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.zkhdil", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-04T16:27:22.488 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:27:22.808 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: pgmap v167: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:22.808 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-04T16:27:22.808 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: osdmap e41: 6 total, 6 up, 6 in 2024-09-04T16:27:22.808 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-04T16:27:22.808 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-04T16:27:22.808 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-04T16:27:22.808 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-04T16:27:22.808 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: osdmap e42: 6 total, 6 up, 6 in 2024-09-04T16:27:22.808 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: fsmap cephfs:0 2024-09-04T16:27:22.808 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:22.809 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:27:22.809 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-04T16:27:22.809 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:27:22.809 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:27:22.809 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:22.809 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.zkhdil", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-04T16:27:22.809 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.zkhdil", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-04T16:27:22.809 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:27:23.586 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:23.731 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:23 smithi170 ceph-mon[29272]: Saving service mds.cephfs spec with placement count:4 2024-09-04T16:27:23.731 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:23 smithi170 ceph-mon[29272]: Deploying daemon mds.cephfs.smithi170.zkhdil on smithi170 2024-09-04T16:27:23.731 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:23 smithi170 ceph-mon[29272]: osdmap e43: 6 total, 6 up, 6 in 2024-09-04T16:27:23.841 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:23 smithi193 ceph-mon[36288]: Saving service mds.cephfs spec with placement count:4 2024-09-04T16:27:23.968 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:23 smithi193 ceph-mon[36288]: Deploying daemon mds.cephfs.smithi170.zkhdil on smithi170 2024-09-04T16:27:23.968 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:23 smithi193 ceph-mon[36288]: osdmap e43: 6 total, 6 up, 6 in 2024-09-04T16:27:24.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.137+0000 7f6ad1dd0640 1 -- 172.21.15.170:0/3905065916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6acc100000 msgr2=0x7f6acc100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:24.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.137+0000 7f6ad1dd0640 1 --2- 172.21.15.170:0/3905065916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6acc100000 0x7f6acc100400 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009880 tx=0x7f6abc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:24.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.137+0000 7f6ad1dd0640 1 -- 172.21.15.170:0/3905065916 shutdown_connections 2024-09-04T16:27:24.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.137+0000 7f6ad1dd0640 1 --2- 172.21.15.170:0/3905065916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6acc101200 0x7f6acc101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:24.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.137+0000 7f6ad1dd0640 1 --2- 172.21.15.170:0/3905065916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6acc100000 0x7f6acc100400 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:24.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.137+0000 7f6ad1dd0640 1 -- 172.21.15.170:0/3905065916 >> 172.21.15.170:0/3905065916 conn(0x7f6acc0fb790 msgr2=0x7f6acc0fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:24.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.137+0000 7f6ad1dd0640 1 -- 172.21.15.170:0/3905065916 shutdown_connections 2024-09-04T16:27:24.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.137+0000 7f6ad1dd0640 1 -- 172.21.15.170:0/3905065916 wait complete. 2024-09-04T16:27:24.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.138+0000 7f6ad1dd0640 1 Processor -- start 2024-09-04T16:27:24.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.138+0000 7f6ad1dd0640 1 -- start start 2024-09-04T16:27:24.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.138+0000 7f6ad1dd0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6acc100000 0x7f6acc1974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:24.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.138+0000 7f6ad1dd0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6acc101200 0x7f6acc197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:24.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.138+0000 7f6ad1dd0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc1096c0 con 0x7f6acc101200 2024-09-04T16:27:24.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.138+0000 7f6ad1dd0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc109540 con 0x7f6acc100000 2024-09-04T16:27:24.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.138+0000 7f6acaffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6acc101200 0x7f6acc197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:24.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.138+0000 7f6acaffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6acc101200 0x7f6acc197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:52500/0 (socket says 172.21.15.170:52500) 2024-09-04T16:27:24.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.138+0000 7f6acaffd640 1 -- 172.21.15.170:0/1207610395 learned_addr learned my addr 172.21.15.170:0/1207610395 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:24.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.138+0000 7f6acb7fe640 1 --2- 172.21.15.170:0/1207610395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6acc100000 0x7f6acc1974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:24.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.139+0000 7f6acb7fe640 1 -- 172.21.15.170:0/1207610395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6acc101200 msgr2=0x7f6acc197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:24.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.139+0000 7f6acb7fe640 1 --2- 172.21.15.170:0/1207610395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6acc101200 0x7f6acc197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:24.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.139+0000 7f6acb7fe640 1 -- 172.21.15.170:0/1207610395 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6acc198080 con 0x7f6acc100000 2024-09-04T16:27:24.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.139+0000 7f6acb7fe640 1 --2- 172.21.15.170:0/1207610395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6acc100000 0x7f6acc1974c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6abc006010 tx=0x7f6abc0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:24.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.139+0000 7f6ac8ff9640 1 -- 172.21.15.170:0/1207610395 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6abc03f070 con 0x7f6acc100000 2024-09-04T16:27:24.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.139+0000 7f6ad1dd0640 1 -- 172.21.15.170:0/1207610395 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6acc19ca60 con 0x7f6acc100000 2024-09-04T16:27:24.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.139+0000 7f6ac8ff9640 1 -- 172.21.15.170:0/1207610395 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6abc0049d0 con 0x7f6acc100000 2024-09-04T16:27:24.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.139+0000 7f6ac8ff9640 1 -- 172.21.15.170:0/1207610395 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6abc035030 con 0x7f6acc100000 2024-09-04T16:27:24.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.139+0000 7f6ad1dd0640 1 -- 172.21.15.170:0/1207610395 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6acc19cff0 con 0x7f6acc100000 2024-09-04T16:27:24.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.140+0000 7f6ad1dd0640 1 -- 172.21.15.170:0/1207610395 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6acc100400 con 0x7f6acc100000 2024-09-04T16:27:24.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.141+0000 7f6ac8ff9640 1 -- 172.21.15.170:0/1207610395 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f6abc042070 con 0x7f6acc100000 2024-09-04T16:27:24.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.141+0000 7f6ac8ff9640 1 --2- 172.21.15.170:0/1207610395 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f6ab406de90 0x7f6ab4070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:24.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.141+0000 7f6ac8ff9640 1 -- 172.21.15.170:0/1207610395 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f6abc0ae4c0 con 0x7f6acc100000 2024-09-04T16:27:24.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.141+0000 7f6acaffd640 1 --2- 172.21.15.170:0/1207610395 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f6ab406de90 0x7f6ab4070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:24.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.142+0000 7f6acaffd640 1 --2- 172.21.15.170:0/1207610395 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f6ab406de90 0x7f6ab4070350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6acc198970 tx=0x7f6ac0005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:24.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.146+0000 7f6ac8ff9640 1 -- 172.21.15.170:0/1207610395 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6abc07fd30 con 0x7f6acc100000 2024-09-04T16:27:24.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.361+0000 7f6ad1dd0640 1 -- 172.21.15.170:0/1207610395 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6acc1914e0 con 0x7f6acc100000 2024-09-04T16:27:24.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.362+0000 7f6ac8ff9640 1 -- 172.21.15.170:0/1207610395 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) ==== 75+0+1272 (secure 0 0 0) 0x7f6abc084560 con 0x7f6acc100000 2024-09-04T16:27:24.363 INFO:teuthology.orchestra.run.smithi170.stdout:e2 2024-09-04T16:27:24.363 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:27:21:512536+0000 2024-09-04T16:27:24.363 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:27:24.363 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:27:24.363 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:27:24.363 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:27:24.363 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:27:24.363 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:27:24.363 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 2 2024-09-04T16:27:24.364 INFO:teuthology.orchestra.run.smithi170.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-04T16:27:24.364 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:27:24.364 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:27:21.512483+0000 2024-09-04T16:27:24.364 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:27:24.364 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:27:24.364 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:27:24.364 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:27:24.364 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:27:24.364 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:27:24.364 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:27:24.364 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:27:24.364 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 0 2024-09-04T16:27:24.364 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:27:24.365 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 1 2024-09-04T16:27:24.365 INFO:teuthology.orchestra.run.smithi170.stdout:in 2024-09-04T16:27:24.365 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:27:24.365 INFO:teuthology.orchestra.run.smithi170.stdout:failed 2024-09-04T16:27:24.365 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:27:24.365 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:27:24.365 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:27:24.365 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:27:24.365 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data disabled 2024-09-04T16:27:24.365 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:27:24.365 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:27:24.365 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 0 2024-09-04T16:27:24.365 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:27:24.365 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:27:24.366 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:27:24.366 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 2 2024-09-04T16:27:24.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.364+0000 7f6ad1dd0640 1 -- 172.21.15.170:0/1207610395 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f6ab406de90 msgr2=0x7f6ab4070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:24.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.364+0000 7f6ad1dd0640 1 --2- 172.21.15.170:0/1207610395 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f6ab406de90 0x7f6ab4070350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6acc198970 tx=0x7f6ac0005f90 comp rx=0 tx=0).stop 2024-09-04T16:27:24.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.364+0000 7f6ad1dd0640 1 -- 172.21.15.170:0/1207610395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6acc100000 msgr2=0x7f6acc1974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:24.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.364+0000 7f6ad1dd0640 1 --2- 172.21.15.170:0/1207610395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6acc100000 0x7f6acc1974c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6abc006010 tx=0x7f6abc0045e0 comp rx=0 tx=0).stop 2024-09-04T16:27:24.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.364+0000 7f6ad1dd0640 1 -- 172.21.15.170:0/1207610395 shutdown_connections 2024-09-04T16:27:24.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.364+0000 7f6ad1dd0640 1 --2- 172.21.15.170:0/1207610395 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f6ab406de90 0x7f6ab4070350 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:24.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.364+0000 7f6ad1dd0640 1 --2- 172.21.15.170:0/1207610395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6acc101200 0x7f6acc197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:24.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.364+0000 7f6ad1dd0640 1 --2- 172.21.15.170:0/1207610395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6acc100000 0x7f6acc1974c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:24.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.364+0000 7f6ad1dd0640 1 -- 172.21.15.170:0/1207610395 >> 172.21.15.170:0/1207610395 conn(0x7f6acc0fb790 msgr2=0x7f6acc106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:24.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.364+0000 7f6ad1dd0640 1 -- 172.21.15.170:0/1207610395 shutdown_connections 2024-09-04T16:27:24.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:24.364+0000 7f6ad1dd0640 1 -- 172.21.15.170:0/1207610395 wait complete. 2024-09-04T16:27:24.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:24 smithi170 ceph-mon[29272]: pgmap v171: 65 pgs: 19 active+clean, 18 creating+peering, 28 unknown; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:24.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:24 smithi170 ceph-mon[29272]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-04T16:27:24.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:24 smithi170 ceph-mon[29272]: osdmap e44: 6 total, 6 up, 6 in 2024-09-04T16:27:24.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:24 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1207610395' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-04T16:27:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:24 smithi193 ceph-mon[36288]: pgmap v171: 65 pgs: 19 active+clean, 18 creating+peering, 28 unknown; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:24 smithi193 ceph-mon[36288]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-04T16:27:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:24 smithi193 ceph-mon[36288]: osdmap e44: 6 total, 6 up, 6 in 2024-09-04T16:27:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:24 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1207610395' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-04T16:27:25.039 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-04T16:27:25.051 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi170.front.sepia.ceph.com 2024-09-04T16:27:25.051 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-04T16:27:25.314 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:25.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.893+0000 7fc155c1d640 1 -- 172.21.15.170:0/1406916896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc150102b90 msgr2=0x7fc150103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:25.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.893+0000 7fc155c1d640 1 --2- 172.21.15.170:0/1406916896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc150102b90 0x7fc150103010 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc144009880 tx=0x7fc14402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:25.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.893+0000 7fc155c1d640 1 -- 172.21.15.170:0/1406916896 shutdown_connections 2024-09-04T16:27:25.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.893+0000 7fc155c1d640 1 --2- 172.21.15.170:0/1406916896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc150102b90 0x7fc150103010 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:25.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.893+0000 7fc155c1d640 1 --2- 172.21.15.170:0/1406916896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc150101990 0x7fc150101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:25.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.893+0000 7fc155c1d640 1 -- 172.21.15.170:0/1406916896 >> 172.21.15.170:0/1406916896 conn(0x7fc1500fd140 msgr2=0x7fc1500ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:25.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.893+0000 7fc155c1d640 1 -- 172.21.15.170:0/1406916896 shutdown_connections 2024-09-04T16:27:25.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.893+0000 7fc155c1d640 1 -- 172.21.15.170:0/1406916896 wait complete. 2024-09-04T16:27:25.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.894+0000 7fc155c1d640 1 Processor -- start 2024-09-04T16:27:25.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.894+0000 7fc155c1d640 1 -- start start 2024-09-04T16:27:25.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.894+0000 7fc155c1d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc150101990 0x7fc1501974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:25.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.894+0000 7fc155c1d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc150102b90 0x7fc1501979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:25.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.894+0000 7fc155c1d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc15010a7b0 con 0x7fc150102b90 2024-09-04T16:27:25.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.894+0000 7fc155c1d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc15010a630 con 0x7fc150101990 2024-09-04T16:27:25.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.894+0000 7fc14effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc150102b90 0x7fc1501979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:25.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.894+0000 7fc14effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc150102b90 0x7fc1501979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51310/0 (socket says 172.21.15.170:51310) 2024-09-04T16:27:25.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.894+0000 7fc14effd640 1 -- 172.21.15.170:0/412440372 learned_addr learned my addr 172.21.15.170:0/412440372 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:25.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.894+0000 7fc14f7fe640 1 --2- 172.21.15.170:0/412440372 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc150101990 0x7fc1501974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:25.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.894+0000 7fc14effd640 1 -- 172.21.15.170:0/412440372 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc150101990 msgr2=0x7fc1501974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:25.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.894+0000 7fc14effd640 1 --2- 172.21.15.170:0/412440372 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc150101990 0x7fc1501974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:25.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.894+0000 7fc14effd640 1 -- 172.21.15.170:0/412440372 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc150197fd0 con 0x7fc150102b90 2024-09-04T16:27:25.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.895+0000 7fc14effd640 1 --2- 172.21.15.170:0/412440372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc150102b90 0x7fc1501979e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc144006010 tx=0x7fc1440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:25.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.895+0000 7fc14cff9640 1 -- 172.21.15.170:0/412440372 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc14403f070 con 0x7fc150102b90 2024-09-04T16:27:25.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.895+0000 7fc155c1d640 1 -- 172.21.15.170:0/412440372 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc15019c9e0 con 0x7fc150102b90 2024-09-04T16:27:25.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.895+0000 7fc14cff9640 1 -- 172.21.15.170:0/412440372 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc1440044d0 con 0x7fc150102b90 2024-09-04T16:27:25.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.895+0000 7fc14cff9640 1 -- 172.21.15.170:0/412440372 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc144035030 con 0x7fc150102b90 2024-09-04T16:27:25.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.895+0000 7fc155c1d640 1 -- 172.21.15.170:0/412440372 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc15019cee0 con 0x7fc150102b90 2024-09-04T16:27:25.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.896+0000 7fc155c1d640 1 -- 172.21.15.170:0/412440372 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc150101d90 con 0x7fc150102b90 2024-09-04T16:27:25.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.896+0000 7fc14cff9640 1 -- 172.21.15.170:0/412440372 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7fc144042070 con 0x7fc150102b90 2024-09-04T16:27:25.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.897+0000 7fc14cff9640 1 --2- 172.21.15.170:0/412440372 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fc13806de30 0x7fc1380702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:25.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.897+0000 7fc14cff9640 1 -- 172.21.15.170:0/412440372 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fc1440ae850 con 0x7fc150102b90 2024-09-04T16:27:25.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.897+0000 7fc14f7fe640 1 --2- 172.21.15.170:0/412440372 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fc13806de30 0x7fc1380702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:25.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.897+0000 7fc14f7fe640 1 --2- 172.21.15.170:0/412440372 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fc13806de30 0x7fc1380702f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc1501029f0 tx=0x7fc140005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:25.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:25.901+0000 7fc14cff9640 1 -- 172.21.15.170:0/412440372 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1440800a0 con 0x7fc150102b90 2024-09-04T16:27:26.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:26.103+0000 7fc155c1d640 1 -- 172.21.15.170:0/412440372 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) -- 0x7fc15019d190 con 0x7fc150102b90 2024-09-04T16:27:26.435 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: pgmap v173: 65 pgs: 34 active+clean, 18 creating+peering, 13 unknown; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:26.435 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:26.435 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:26.435 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:26.435 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi193.xostco", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-04T16:27:26.435 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi193.xostco", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-04T16:27:26.435 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:27:26.435 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: Deploying daemon mds.cephfs.smithi193.xostco on smithi193 2024-09-04T16:27:26.435 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: mds.? [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] up:boot 2024-09-04T16:27:26.436 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: daemon mds.cephfs.smithi170.zkhdil assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-04T16:27:26.436 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-04T16:27:26.436 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-04T16:27:26.436 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: Cluster is now healthy 2024-09-04T16:27:26.436 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: fsmap cephfs:0 1 up:standby 2024-09-04T16:27:26.436 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.zkhdil"}]: dispatch 2024-09-04T16:27:26.436 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: fsmap cephfs:1 {0=cephfs.smithi170.zkhdil=up:creating} 2024-09-04T16:27:26.436 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: daemon mds.cephfs.smithi170.zkhdil is now active in filesystem cephfs as rank 0 2024-09-04T16:27:26.436 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:26 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/412440372' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-04T16:27:26.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:26.468+0000 7fc14cff9640 1 -- 172.21.15.170:0/412440372 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v5) ==== 105+0+0 (secure 0 0 0) 0x7fc1440848d0 con 0x7fc150102b90 2024-09-04T16:27:26.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:26.471+0000 7fc155c1d640 1 -- 172.21.15.170:0/412440372 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fc13806de30 msgr2=0x7fc1380702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:26.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:26.471+0000 7fc155c1d640 1 --2- 172.21.15.170:0/412440372 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fc13806de30 0x7fc1380702f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc1501029f0 tx=0x7fc140005f90 comp rx=0 tx=0).stop 2024-09-04T16:27:26.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:26.471+0000 7fc155c1d640 1 -- 172.21.15.170:0/412440372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc150102b90 msgr2=0x7fc1501979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:26.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:26.471+0000 7fc155c1d640 1 --2- 172.21.15.170:0/412440372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc150102b90 0x7fc1501979e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc144006010 tx=0x7fc1440048f0 comp rx=0 tx=0).stop 2024-09-04T16:27:26.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:26.471+0000 7fc155c1d640 1 -- 172.21.15.170:0/412440372 shutdown_connections 2024-09-04T16:27:26.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:26.471+0000 7fc155c1d640 1 --2- 172.21.15.170:0/412440372 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fc13806de30 0x7fc1380702f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:26.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:26.471+0000 7fc155c1d640 1 --2- 172.21.15.170:0/412440372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc150102b90 0x7fc1501979e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:26.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:26.471+0000 7fc155c1d640 1 --2- 172.21.15.170:0/412440372 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc150101990 0x7fc1501974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:26.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:26.471+0000 7fc155c1d640 1 -- 172.21.15.170:0/412440372 >> 172.21.15.170:0/412440372 conn(0x7fc1500fd140 msgr2=0x7fc1500ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:26.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:26.471+0000 7fc155c1d640 1 -- 172.21.15.170:0/412440372 shutdown_connections 2024-09-04T16:27:26.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:26.471+0000 7fc155c1d640 1 -- 172.21.15.170:0/412440372 wait complete. 2024-09-04T16:27:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: pgmap v173: 65 pgs: 34 active+clean, 18 creating+peering, 13 unknown; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:27:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi193.xostco", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-04T16:27:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi193.xostco", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-04T16:27:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:27:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: Deploying daemon mds.cephfs.smithi193.xostco on smithi193 2024-09-04T16:27:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: mds.? [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] up:boot 2024-09-04T16:27:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: daemon mds.cephfs.smithi170.zkhdil assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-04T16:27:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-04T16:27:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-04T16:27:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: Cluster is now healthy 2024-09-04T16:27:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: fsmap cephfs:0 1 up:standby 2024-09-04T16:27:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.zkhdil"}]: dispatch 2024-09-04T16:27:26.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: fsmap cephfs:1 {0=cephfs.smithi170.zkhdil=up:creating} 2024-09-04T16:27:26.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: daemon mds.cephfs.smithi170.zkhdil is now active in filesystem cephfs as rank 0 2024-09-04T16:27:26.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:26 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/412440372' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-04T16:27:27.043 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-04T16:27:27.053 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi170.front.sepia.ceph.com 2024-09-04T16:27:27.053 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-04T16:27:27.303 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:27.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:27 smithi193 ceph-mon[36288]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-04T16:27:27.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:27 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/412440372' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-04T16:27:27.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:27 smithi193 ceph-mon[36288]: mds.? [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] up:active 2024-09-04T16:27:27.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:27 smithi193 ceph-mon[36288]: fsmap cephfs:1 {0=cephfs.smithi170.zkhdil=up:active} 2024-09-04T16:27:27.553 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:27 smithi170 ceph-mon[29272]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-04T16:27:27.553 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:27 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/412440372' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-04T16:27:27.554 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:27 smithi170 ceph-mon[29272]: mds.? [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] up:active 2024-09-04T16:27:27.554 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:27 smithi170 ceph-mon[29272]: fsmap cephfs:1 {0=cephfs.smithi170.zkhdil=up:active} 2024-09-04T16:27:27.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.740+0000 7ff68d635640 1 -- 172.21.15.170:0/2328566005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff688100880 msgr2=0x7ff688100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:27.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.740+0000 7ff68d635640 1 --2- 172.21.15.170:0/2328566005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff688100880 0x7ff688100c80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff678009880 tx=0x7ff67802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:27.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.740+0000 7ff68d635640 1 -- 172.21.15.170:0/2328566005 shutdown_connections 2024-09-04T16:27:27.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.740+0000 7ff68d635640 1 --2- 172.21.15.170:0/2328566005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff688101a80 0x7ff688101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:27.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.740+0000 7ff68d635640 1 --2- 172.21.15.170:0/2328566005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff688100880 0x7ff688100c80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:27.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.740+0000 7ff68d635640 1 -- 172.21.15.170:0/2328566005 >> 172.21.15.170:0/2328566005 conn(0x7ff6880fc010 msgr2=0x7ff6880fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:27.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.740+0000 7ff68d635640 1 -- 172.21.15.170:0/2328566005 shutdown_connections 2024-09-04T16:27:27.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.740+0000 7ff68d635640 1 -- 172.21.15.170:0/2328566005 wait complete. 2024-09-04T16:27:27.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.741+0000 7ff68d635640 1 Processor -- start 2024-09-04T16:27:27.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.741+0000 7ff68d635640 1 -- start start 2024-09-04T16:27:27.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.741+0000 7ff68d635640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff688100880 0x7ff6881047a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:27.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.741+0000 7ff68d635640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff688101a80 0x7ff688102e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:27.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.741+0000 7ff68d635640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff6881096a0 con 0x7ff688100880 2024-09-04T16:27:27.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.741+0000 7ff68d635640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff688109520 con 0x7ff688101a80 2024-09-04T16:27:27.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.741+0000 7ff686ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff688100880 0x7ff6881047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:27.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.741+0000 7ff686ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff688100880 0x7ff6881047a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51336/0 (socket says 172.21.15.170:51336) 2024-09-04T16:27:27.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.741+0000 7ff686ffd640 1 -- 172.21.15.170:0/2515109441 learned_addr learned my addr 172.21.15.170:0/2515109441 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:27.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.741+0000 7ff6867fc640 1 --2- 172.21.15.170:0/2515109441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff688101a80 0x7ff688102e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:27.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.742+0000 7ff686ffd640 1 -- 172.21.15.170:0/2515109441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff688101a80 msgr2=0x7ff688102e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:27.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.742+0000 7ff686ffd640 1 --2- 172.21.15.170:0/2515109441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff688101a80 0x7ff688102e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:27.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.742+0000 7ff686ffd640 1 -- 172.21.15.170:0/2515109441 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6881033a0 con 0x7ff688100880 2024-09-04T16:27:27.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.742+0000 7ff686ffd640 1 --2- 172.21.15.170:0/2515109441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff688100880 0x7ff6881047a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff678006010 tx=0x7ff6780045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:27.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.742+0000 7ff66ffff640 1 -- 172.21.15.170:0/2515109441 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff67803f070 con 0x7ff688100880 2024-09-04T16:27:27.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.742+0000 7ff68d635640 1 -- 172.21.15.170:0/2515109441 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff688103630 con 0x7ff688100880 2024-09-04T16:27:27.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.742+0000 7ff66ffff640 1 -- 172.21.15.170:0/2515109441 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff678004a50 con 0x7ff688100880 2024-09-04T16:27:27.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.742+0000 7ff66ffff640 1 -- 172.21.15.170:0/2515109441 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff678035030 con 0x7ff688100880 2024-09-04T16:27:27.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.742+0000 7ff68d635640 1 -- 172.21.15.170:0/2515109441 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff688103b60 con 0x7ff688100880 2024-09-04T16:27:27.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.743+0000 7ff68d635640 1 -- 172.21.15.170:0/2515109441 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff688100c60 con 0x7ff688100880 2024-09-04T16:27:27.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.743+0000 7ff66ffff640 1 -- 172.21.15.170:0/2515109441 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7ff678042070 con 0x7ff688100880 2024-09-04T16:27:27.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.744+0000 7ff66ffff640 1 --2- 172.21.15.170:0/2515109441 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff67006de30 0x7ff6700702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:27.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.744+0000 7ff66ffff640 1 -- 172.21.15.170:0/2515109441 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7ff6780ae6d0 con 0x7ff688100880 2024-09-04T16:27:27.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.744+0000 7ff6867fc640 1 --2- 172.21.15.170:0/2515109441 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff67006de30 0x7ff6700702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:27.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.744+0000 7ff6867fc640 1 --2- 172.21.15.170:0/2515109441 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff67006de30 0x7ff6700702f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff688104520 tx=0x7ff67c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:27.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.748+0000 7ff66ffff640 1 -- 172.21.15.170:0/2515109441 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff678004c00 con 0x7ff688100880 2024-09-04T16:27:27.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:27.958+0000 7ff68d635640 1 -- 172.21.15.170:0/2515109441 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff68819f4f0 con 0x7ff688100880 2024-09-04T16:27:28.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:28.474+0000 7ff66ffff640 1 -- 172.21.15.170:0/2515109441 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7ff67807fe80 con 0x7ff688100880 2024-09-04T16:27:28.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:28.478+0000 7ff68d635640 1 -- 172.21.15.170:0/2515109441 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff67006de30 msgr2=0x7ff6700702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:28.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:28.478+0000 7ff68d635640 1 --2- 172.21.15.170:0/2515109441 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff67006de30 0x7ff6700702f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff688104520 tx=0x7ff67c00b410 comp rx=0 tx=0).stop 2024-09-04T16:27:28.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:28.478+0000 7ff68d635640 1 -- 172.21.15.170:0/2515109441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff688100880 msgr2=0x7ff6881047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:28.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:28.478+0000 7ff68d635640 1 --2- 172.21.15.170:0/2515109441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff688100880 0x7ff6881047a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff678006010 tx=0x7ff6780045e0 comp rx=0 tx=0).stop 2024-09-04T16:27:28.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:28.478+0000 7ff68d635640 1 -- 172.21.15.170:0/2515109441 shutdown_connections 2024-09-04T16:27:28.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:28.478+0000 7ff68d635640 1 --2- 172.21.15.170:0/2515109441 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff67006de30 0x7ff6700702f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:28.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:28.478+0000 7ff68d635640 1 --2- 172.21.15.170:0/2515109441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff688101a80 0x7ff688102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:28.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:28.478+0000 7ff68d635640 1 --2- 172.21.15.170:0/2515109441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff688100880 0x7ff6881047a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:28.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:28.478+0000 7ff68d635640 1 -- 172.21.15.170:0/2515109441 >> 172.21.15.170:0/2515109441 conn(0x7ff6880fc010 msgr2=0x7ff6880fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:28.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:28.478+0000 7ff68d635640 1 -- 172.21.15.170:0/2515109441 shutdown_connections 2024-09-04T16:27:28.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:28.478+0000 7ff68d635640 1 -- 172.21.15.170:0/2515109441 wait complete. 2024-09-04T16:27:28.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:28 smithi170 ceph-mon[29272]: pgmap v174: 65 pgs: 59 active+clean, 6 creating+peering; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 355 B/s wr, 0 op/s 2024-09-04T16:27:28.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:28 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:28.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:28 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:28.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:28 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:28.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:28 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.rzbrux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-04T16:27:28.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:28 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.rzbrux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-04T16:27:28.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:28 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:27:28.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:28 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2515109441' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-04T16:27:28.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:28 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:28.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:28 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:27:28.842 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:28 smithi193 ceph-mon[36288]: pgmap v174: 65 pgs: 59 active+clean, 6 creating+peering; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 355 B/s wr, 0 op/s 2024-09-04T16:27:28.842 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:28 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:28.842 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:28 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:28.842 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:28 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:28.842 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:28 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.rzbrux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-04T16:27:28.843 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:28 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.rzbrux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-04T16:27:28.843 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:28 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:27:28.843 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:28 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2515109441' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-04T16:27:28.843 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:28 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:28.843 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:28 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:27:29.729 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:29 smithi170 ceph-mon[29272]: Deploying daemon mds.cephfs.smithi170.rzbrux on smithi170 2024-09-04T16:27:29.729 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:29 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2515109441' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-04T16:27:29.729 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:29 smithi170 ceph-mon[29272]: mds.? [v2:172.21.15.193:6824/1755428205,v1:172.21.15.193:6825/1755428205] up:boot 2024-09-04T16:27:29.729 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:29 smithi170 ceph-mon[29272]: daemon mds.cephfs.smithi193.xostco assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-04T16:27:29.730 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:29 smithi170 ceph-mon[29272]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-04T16:27:29.730 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:29 smithi170 ceph-mon[29272]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-04T16:27:29.730 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:29 smithi170 ceph-mon[29272]: fsmap cephfs:1 {0=cephfs.smithi170.zkhdil=up:active} 1 up:standby 2024-09-04T16:27:29.730 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:29 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi193.xostco"}]: dispatch 2024-09-04T16:27:29.730 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:29 smithi170 ceph-mon[29272]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi193.xostco=up:creating} 2024-09-04T16:27:29.730 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:29 smithi170 ceph-mon[29272]: daemon mds.cephfs.smithi193.xostco is now active in filesystem cephfs as rank 1 2024-09-04T16:27:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:29 smithi193 ceph-mon[36288]: Deploying daemon mds.cephfs.smithi170.rzbrux on smithi170 2024-09-04T16:27:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:29 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2515109441' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-04T16:27:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:29 smithi193 ceph-mon[36288]: mds.? [v2:172.21.15.193:6824/1755428205,v1:172.21.15.193:6825/1755428205] up:boot 2024-09-04T16:27:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:29 smithi193 ceph-mon[36288]: daemon mds.cephfs.smithi193.xostco assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-04T16:27:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:29 smithi193 ceph-mon[36288]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-04T16:27:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:29 smithi193 ceph-mon[36288]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-04T16:27:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:29 smithi193 ceph-mon[36288]: fsmap cephfs:1 {0=cephfs.smithi170.zkhdil=up:active} 1 up:standby 2024-09-04T16:27:29.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:29 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi193.xostco"}]: dispatch 2024-09-04T16:27:29.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:29 smithi193 ceph-mon[36288]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi193.xostco=up:creating} 2024-09-04T16:27:29.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:29 smithi193 ceph-mon[36288]: daemon mds.cephfs.smithi193.xostco is now active in filesystem cephfs as rank 1 2024-09-04T16:27:30.117 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-04T16:27:30.129 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi170.front.sepia.ceph.com 2024-09-04T16:27:30.129 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-04T16:27:30.640 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:30.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:30 smithi170 ceph-mon[29272]: pgmap v175: 65 pgs: 65 active+clean; 578 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 792 B/s wr, 4 op/s 2024-09-04T16:27:30.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:30 smithi170 ceph-mon[29272]: mds.? [v2:172.21.15.193:6824/1755428205,v1:172.21.15.193:6825/1755428205] up:active 2024-09-04T16:27:30.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:30 smithi170 ceph-mon[29272]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi193.xostco=up:active} 2024-09-04T16:27:30.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:30 smithi193 ceph-mon[36288]: pgmap v175: 65 pgs: 65 active+clean; 578 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 792 B/s wr, 4 op/s 2024-09-04T16:27:30.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:30 smithi193 ceph-mon[36288]: mds.? [v2:172.21.15.193:6824/1755428205,v1:172.21.15.193:6825/1755428205] up:active 2024-09-04T16:27:30.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:30 smithi193 ceph-mon[36288]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi193.xostco=up:active} 2024-09-04T16:27:31.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.113+0000 7ff69a3bb640 1 -- 172.21.15.170:0/1549355206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff694102b90 msgr2=0x7ff694103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:31.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.113+0000 7ff69a3bb640 1 --2- 172.21.15.170:0/1549355206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff694102b90 0x7ff694103010 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff688009880 tx=0x7ff68802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:31.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.113+0000 7ff69a3bb640 1 -- 172.21.15.170:0/1549355206 shutdown_connections 2024-09-04T16:27:31.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.113+0000 7ff69a3bb640 1 --2- 172.21.15.170:0/1549355206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff694102b90 0x7ff694103010 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:31.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.113+0000 7ff69a3bb640 1 --2- 172.21.15.170:0/1549355206 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff694101990 0x7ff694101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:31.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.113+0000 7ff69a3bb640 1 -- 172.21.15.170:0/1549355206 >> 172.21.15.170:0/1549355206 conn(0x7ff6940fd140 msgr2=0x7ff6940ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:31.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.113+0000 7ff69a3bb640 1 -- 172.21.15.170:0/1549355206 shutdown_connections 2024-09-04T16:27:31.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.113+0000 7ff69a3bb640 1 -- 172.21.15.170:0/1549355206 wait complete. 2024-09-04T16:27:31.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.114+0000 7ff69a3bb640 1 Processor -- start 2024-09-04T16:27:31.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.114+0000 7ff69a3bb640 1 -- start start 2024-09-04T16:27:31.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.114+0000 7ff69a3bb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff694101990 0x7ff694197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:31.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.114+0000 7ff69a3bb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff694102b90 0x7ff694197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:31.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.114+0000 7ff69a3bb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff69410a850 con 0x7ff694102b90 2024-09-04T16:27:31.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.114+0000 7ff69a3bb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff69410a6d0 con 0x7ff694101990 2024-09-04T16:27:31.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.114+0000 7ff6937fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff694102b90 0x7ff694197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:31.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.114+0000 7ff6937fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff694102b90 0x7ff694197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51370/0 (socket says 172.21.15.170:51370) 2024-09-04T16:27:31.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.114+0000 7ff6937fe640 1 -- 172.21.15.170:0/3964588691 learned_addr learned my addr 172.21.15.170:0/3964588691 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:31.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.114+0000 7ff693fff640 1 --2- 172.21.15.170:0/3964588691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff694101990 0x7ff694197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:31.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.115+0000 7ff6937fe640 1 -- 172.21.15.170:0/3964588691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff694101990 msgr2=0x7ff694197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:31.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.115+0000 7ff6937fe640 1 --2- 172.21.15.170:0/3964588691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff694101990 0x7ff694197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:31.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.115+0000 7ff6937fe640 1 -- 172.21.15.170:0/3964588691 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff694198100 con 0x7ff694102b90 2024-09-04T16:27:31.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.115+0000 7ff693fff640 1 --2- 172.21.15.170:0/3964588691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff694101990 0x7ff694197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:27:31.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.115+0000 7ff6937fe640 1 --2- 172.21.15.170:0/3964588691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff694102b90 0x7ff694197a80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff688006010 tx=0x7ff6880048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:31.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.115+0000 7ff6917fa640 1 -- 172.21.15.170:0/3964588691 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff68803f070 con 0x7ff694102b90 2024-09-04T16:27:31.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.115+0000 7ff6917fa640 1 -- 172.21.15.170:0/3964588691 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6880044d0 con 0x7ff694102b90 2024-09-04T16:27:31.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.115+0000 7ff69a3bb640 1 -- 172.21.15.170:0/3964588691 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69419cae0 con 0x7ff694102b90 2024-09-04T16:27:31.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.115+0000 7ff6917fa640 1 -- 172.21.15.170:0/3964588691 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff688035030 con 0x7ff694102b90 2024-09-04T16:27:31.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.115+0000 7ff69a3bb640 1 -- 172.21.15.170:0/3964588691 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff69419d0f0 con 0x7ff694102b90 2024-09-04T16:27:31.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.116+0000 7ff69a3bb640 1 -- 172.21.15.170:0/3964588691 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff694101d70 con 0x7ff694102b90 2024-09-04T16:27:31.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.116+0000 7ff6917fa640 1 -- 172.21.15.170:0/3964588691 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7ff688042070 con 0x7ff694102b90 2024-09-04T16:27:31.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.117+0000 7ff6917fa640 1 --2- 172.21.15.170:0/3964588691 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff67c06de30 0x7ff67c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:31.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.117+0000 7ff6917fa640 1 -- 172.21.15.170:0/3964588691 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7ff6880ae900 con 0x7ff694102b90 2024-09-04T16:27:31.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.117+0000 7ff693fff640 1 --2- 172.21.15.170:0/3964588691 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff67c06de30 0x7ff67c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:31.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.117+0000 7ff693fff640 1 --2- 172.21.15.170:0/3964588691 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff67c06de30 0x7ff67c0702f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff6941029f0 tx=0x7ff684008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:31.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.121+0000 7ff6917fa640 1 -- 172.21.15.170:0/3964588691 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff68807c4a0 con 0x7ff694102b90 2024-09-04T16:27:31.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.325+0000 7ff69a3bb640 1 -- 172.21.15.170:0/3964588691 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff69419d3c0 con 0x7ff694102b90 2024-09-04T16:27:31.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.486+0000 7ff6917fa640 1 -- 172.21.15.170:0/3964588691 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v9) ==== 168+0+0 (secure 0 0 0) 0x7ff688080150 con 0x7ff694102b90 2024-09-04T16:27:31.486 INFO:teuthology.orchestra.run.smithi170.stderr:inline data enabled 2024-09-04T16:27:31.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.487+0000 7ff69a3bb640 1 -- 172.21.15.170:0/3964588691 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff67c06de30 msgr2=0x7ff67c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:31.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.487+0000 7ff69a3bb640 1 --2- 172.21.15.170:0/3964588691 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff67c06de30 0x7ff67c0702f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff6941029f0 tx=0x7ff684008040 comp rx=0 tx=0).stop 2024-09-04T16:27:31.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.487+0000 7ff69a3bb640 1 -- 172.21.15.170:0/3964588691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff694102b90 msgr2=0x7ff694197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:31.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.487+0000 7ff69a3bb640 1 --2- 172.21.15.170:0/3964588691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff694102b90 0x7ff694197a80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff688006010 tx=0x7ff6880048f0 comp rx=0 tx=0).stop 2024-09-04T16:27:31.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.487+0000 7ff69a3bb640 1 -- 172.21.15.170:0/3964588691 shutdown_connections 2024-09-04T16:27:31.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.487+0000 7ff69a3bb640 1 --2- 172.21.15.170:0/3964588691 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff67c06de30 0x7ff67c0702f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:31.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.487+0000 7ff69a3bb640 1 --2- 172.21.15.170:0/3964588691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff694102b90 0x7ff694197a80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:31.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.487+0000 7ff69a3bb640 1 --2- 172.21.15.170:0/3964588691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff694101990 0x7ff694197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:31.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.487+0000 7ff69a3bb640 1 -- 172.21.15.170:0/3964588691 >> 172.21.15.170:0/3964588691 conn(0x7ff6940fd140 msgr2=0x7ff6940ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:31.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.488+0000 7ff69a3bb640 1 -- 172.21.15.170:0/3964588691 shutdown_connections 2024-09-04T16:27:31.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:31.488+0000 7ff69a3bb640 1 -- 172.21.15.170:0/3964588691 wait complete. 2024-09-04T16:27:31.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:31 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:31.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:31 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:31.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:31 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:31.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:31 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi193.kabapr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-04T16:27:31.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:31 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi193.kabapr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-04T16:27:31.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:31 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:27:31.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:31 smithi193 ceph-mon[36288]: Deploying daemon mds.cephfs.smithi193.kabapr on smithi193 2024-09-04T16:27:31.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:31 smithi193 ceph-mon[36288]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-04T16:27:31.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:31 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3964588691' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-04T16:27:31.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:31 smithi193 ceph-mon[36288]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-04T16:27:31.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:31 smithi193 ceph-mon[36288]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-04T16:27:31.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:31 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3964588691' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-04T16:27:31.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:31 smithi193 ceph-mon[36288]: mds.? [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] up:boot 2024-09-04T16:27:31.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:31 smithi193 ceph-mon[36288]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi193.xostco=up:active} 1 up:standby 2024-09-04T16:27:31.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:31 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.rzbrux"}]: dispatch 2024-09-04T16:27:31.982 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:31 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:31.982 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:31 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:31.982 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:31 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:31.982 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:31 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi193.kabapr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-04T16:27:31.982 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:31 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi193.kabapr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-04T16:27:31.982 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:31 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:27:31.983 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:31 smithi170 ceph-mon[29272]: Deploying daemon mds.cephfs.smithi193.kabapr on smithi193 2024-09-04T16:27:31.983 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:31 smithi170 ceph-mon[29272]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-04T16:27:31.983 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:31 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3964588691' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-04T16:27:31.983 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:31 smithi170 ceph-mon[29272]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-04T16:27:31.983 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:31 smithi170 ceph-mon[29272]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-04T16:27:31.983 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:31 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3964588691' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-04T16:27:31.983 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:31 smithi170 ceph-mon[29272]: mds.? [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] up:boot 2024-09-04T16:27:31.983 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:31 smithi170 ceph-mon[29272]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi193.xostco=up:active} 1 up:standby 2024-09-04T16:27:31.983 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:31 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.rzbrux"}]: dispatch 2024-09-04T16:27:32.171 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-04T16:27:32.181 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi170.front.sepia.ceph.com 2024-09-04T16:27:32.182 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-04T16:27:32.449 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:32.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.960+0000 7f36f147d640 1 -- 172.21.15.170:0/920423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36ec100840 msgr2=0x7f36ec100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:32.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.960+0000 7f36f147d640 1 --2- 172.21.15.170:0/920423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36ec100840 0x7f36ec100c40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f36dc009880 tx=0x7f36dc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:32.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.960+0000 7f36f147d640 1 -- 172.21.15.170:0/920423 shutdown_connections 2024-09-04T16:27:32.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.960+0000 7f36f147d640 1 --2- 172.21.15.170:0/920423 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36ec101a40 0x7f36ec101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:32.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.960+0000 7f36f147d640 1 --2- 172.21.15.170:0/920423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36ec100840 0x7f36ec100c40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:32.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.960+0000 7f36f147d640 1 -- 172.21.15.170:0/920423 >> 172.21.15.170:0/920423 conn(0x7f36ec0fbff0 msgr2=0x7f36ec0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:32.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.960+0000 7f36f147d640 1 -- 172.21.15.170:0/920423 shutdown_connections 2024-09-04T16:27:32.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.960+0000 7f36f147d640 1 -- 172.21.15.170:0/920423 wait complete. 2024-09-04T16:27:32.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.960+0000 7f36f147d640 1 Processor -- start 2024-09-04T16:27:32.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.960+0000 7f36f147d640 1 -- start start 2024-09-04T16:27:32.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36f147d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36ec100840 0x7f36ec1996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:32.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36f147d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36ec101a40 0x7f36ec199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:32.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36f147d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec109680 con 0x7f36ec100840 2024-09-04T16:27:32.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36f147d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec109500 con 0x7f36ec101a40 2024-09-04T16:27:32.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36eaffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36ec100840 0x7f36ec1996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:32.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36eaffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36ec100840 0x7f36ec1996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51390/0 (socket says 172.21.15.170:51390) 2024-09-04T16:27:32.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36eaffd640 1 -- 172.21.15.170:0/1587944143 learned_addr learned my addr 172.21.15.170:0/1587944143 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:32.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36e27fc640 1 --2- 172.21.15.170:0/1587944143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36ec101a40 0x7f36ec199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:32.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36eaffd640 1 -- 172.21.15.170:0/1587944143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36ec101a40 msgr2=0x7f36ec199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:32.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36eaffd640 1 --2- 172.21.15.170:0/1587944143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36ec101a40 0x7f36ec199bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:32.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36eaffd640 1 -- 172.21.15.170:0/1587944143 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ec19a270 con 0x7f36ec100840 2024-09-04T16:27:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36eaffd640 1 --2- 172.21.15.170:0/1587944143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36ec100840 0x7f36ec1996b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f36dc006010 tx=0x7f36dc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36e8ff9640 1 -- 172.21.15.170:0/1587944143 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36dc03f070 con 0x7f36ec100840 2024-09-04T16:27:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36f147d640 1 -- 172.21.15.170:0/1587944143 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ec19ec50 con 0x7f36ec100840 2024-09-04T16:27:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36e8ff9640 1 -- 172.21.15.170:0/1587944143 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f36dc004a50 con 0x7f36ec100840 2024-09-04T16:27:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36e8ff9640 1 -- 172.21.15.170:0/1587944143 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36dc035030 con 0x7f36ec100840 2024-09-04T16:27:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.961+0000 7f36f147d640 1 -- 172.21.15.170:0/1587944143 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ec19f190 con 0x7f36ec100840 2024-09-04T16:27:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.962+0000 7f36f147d640 1 -- 172.21.15.170:0/1587944143 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ec100c40 con 0x7f36ec100840 2024-09-04T16:27:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.963+0000 7f36e8ff9640 1 -- 172.21.15.170:0/1587944143 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f36dc042070 con 0x7f36ec100840 2024-09-04T16:27:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.963+0000 7f36e8ff9640 1 --2- 172.21.15.170:0/1587944143 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f36d806de30 0x7f36d80702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.963+0000 7f36e8ff9640 1 -- 172.21.15.170:0/1587944143 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f36dc0ae690 con 0x7f36ec100840 2024-09-04T16:27:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.963+0000 7f36e27fc640 1 --2- 172.21.15.170:0/1587944143 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f36d806de30 0x7f36d80702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.964+0000 7f36e27fc640 1 --2- 172.21.15.170:0/1587944143 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f36d806de30 0x7f36d80702f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f36ec19ab60 tx=0x7f36d400b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:32.968+0000 7f36e8ff9640 1 -- 172.21.15.170:0/1587944143 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f36dc004c00 con 0x7f36ec100840 2024-09-04T16:27:33.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:33.168+0000 7f36f147d640 1 -- 172.21.15.170:0/1587944143 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f36ec19f640 con 0x7f36ec100840 2024-09-04T16:27:33.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:33.168+0000 7f36e8ff9640 1 -- 172.21.15.170:0/1587944143 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 9 v9) ==== 75+0+1817 (secure 0 0 0) 0x7f36dc07fee0 con 0x7f36ec100840 2024-09-04T16:27:33.169 INFO:teuthology.orchestra.run.smithi170.stdout:e9 2024-09-04T16:27:33.169 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:27:31:484967+0000 2024-09-04T16:27:33.169 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:27:33.169 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:27:33.169 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:27:33.169 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:27:33.169 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:27:33.169 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:27:33.169 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 9 2024-09-04T16:27:33.169 INFO:teuthology.orchestra.run.smithi170.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-04T16:27:33.169 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:27:33.169 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:27:31.326566+0000 2024-09-04T16:27:33.170 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:27:33.170 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:27:33.170 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:27:33.170 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:27:33.170 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:27:33.170 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:27:33.170 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:27:33.170 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:27:33.170 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 0 2024-09-04T16:27:33.171 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:27:33.171 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:27:33.171 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:27:33.171 INFO:teuthology.orchestra.run.smithi170.stdout:up {0=14562,1=24301} 2024-09-04T16:27:33.171 INFO:teuthology.orchestra.run.smithi170.stdout:failed 2024-09-04T16:27:33.171 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:27:33.171 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:27:33.171 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:27:33.171 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:27:33.171 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:27:33.171 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:27:33.171 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:27:33.171 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:27:33.171 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 14562 members: 24301,14562 2024-09-04T16:27:33.171 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{0:14562} state up:active seq 2 addr [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:27:33.172 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{1:24301} state up:active seq 2 addr [v2:172.21.15.193:6824/1755428205,v1:172.21.15.193:6825/1755428205] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:27:33.172 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:27:33.172 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:27:33.172 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:27:33.172 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:27:33.172 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:14578} state up:standby seq 1 addr [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:27:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 9 2024-09-04T16:27:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:33.171+0000 7f36f147d640 1 -- 172.21.15.170:0/1587944143 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f36d806de30 msgr2=0x7f36d80702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:33.171+0000 7f36f147d640 1 --2- 172.21.15.170:0/1587944143 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f36d806de30 0x7f36d80702f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f36ec19ab60 tx=0x7f36d400b390 comp rx=0 tx=0).stop 2024-09-04T16:27:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:33.171+0000 7f36f147d640 1 -- 172.21.15.170:0/1587944143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36ec100840 msgr2=0x7f36ec1996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:33.171+0000 7f36f147d640 1 --2- 172.21.15.170:0/1587944143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36ec100840 0x7f36ec1996b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f36dc006010 tx=0x7f36dc0045e0 comp rx=0 tx=0).stop 2024-09-04T16:27:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:33.171+0000 7f36f147d640 1 -- 172.21.15.170:0/1587944143 shutdown_connections 2024-09-04T16:27:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:33.171+0000 7f36f147d640 1 --2- 172.21.15.170:0/1587944143 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f36d806de30 0x7f36d80702f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:33.171+0000 7f36f147d640 1 --2- 172.21.15.170:0/1587944143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36ec101a40 0x7f36ec199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:33.171+0000 7f36f147d640 1 --2- 172.21.15.170:0/1587944143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36ec100840 0x7f36ec1996b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:33.171+0000 7f36f147d640 1 -- 172.21.15.170:0/1587944143 >> 172.21.15.170:0/1587944143 conn(0x7f36ec0fbff0 msgr2=0x7f36ec069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:33.171+0000 7f36f147d640 1 -- 172.21.15.170:0/1587944143 shutdown_connections 2024-09-04T16:27:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:33.171+0000 7f36f147d640 1 -- 172.21.15.170:0/1587944143 wait complete. 2024-09-04T16:27:33.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:33 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1587944143' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-04T16:27:33.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:33 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1587944143' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-04T16:27:33.933 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-04T16:27:34.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:34.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:34 smithi193 ceph-mon[36288]: pgmap v177: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-04T16:27:34.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:34.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:34.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:34.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:34.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:34.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:27:34.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:34 smithi193 ceph-mon[36288]: mds.? [v2:172.21.15.193:6826/288890560,v1:172.21.15.193:6827/288890560] up:boot 2024-09-04T16:27:34.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:34 smithi193 ceph-mon[36288]: mds.? [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] up:active 2024-09-04T16:27:34.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:34 smithi193 ceph-mon[36288]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi193.xostco=up:active} 2 up:standby 2024-09-04T16:27:34.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi193.kabapr"}]: dispatch 2024-09-04T16:27:34.523 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:34.523 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:34 smithi170 ceph-mon[29272]: pgmap v177: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-04T16:27:34.523 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:34.523 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:34.523 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:34.524 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:34.524 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:34.524 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:27:34.524 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:34 smithi170 ceph-mon[29272]: mds.? [v2:172.21.15.193:6826/288890560,v1:172.21.15.193:6827/288890560] up:boot 2024-09-04T16:27:34.524 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:34 smithi170 ceph-mon[29272]: mds.? [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] up:active 2024-09-04T16:27:34.524 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:34 smithi170 ceph-mon[29272]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi193.xostco=up:active} 2 up:standby 2024-09-04T16:27:34.524 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi193.kabapr"}]: dispatch 2024-09-04T16:27:34.877 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.359+0000 7f4517e92640 1 -- 172.21.15.170:0/1670721722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510102b80 msgr2=0x7f4510103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.359+0000 7f4517e92640 1 --2- 172.21.15.170:0/1670721722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510102b80 0x7f4510103000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4504009880 tx=0x7f450402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.359+0000 7f4517e92640 1 -- 172.21.15.170:0/1670721722 shutdown_connections 2024-09-04T16:27:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.359+0000 7f4517e92640 1 --2- 172.21.15.170:0/1670721722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510102b80 0x7f4510103000 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.359+0000 7f4517e92640 1 --2- 172.21.15.170:0/1670721722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4510101980 0x7f4510101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.359+0000 7f4517e92640 1 -- 172.21.15.170:0/1670721722 >> 172.21.15.170:0/1670721722 conn(0x7f45100fd110 msgr2=0x7f45100ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.359+0000 7f4517e92640 1 -- 172.21.15.170:0/1670721722 shutdown_connections 2024-09-04T16:27:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.359+0000 7f4517e92640 1 -- 172.21.15.170:0/1670721722 wait complete. 2024-09-04T16:27:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.360+0000 7f4517e92640 1 Processor -- start 2024-09-04T16:27:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.360+0000 7f4517e92640 1 -- start start 2024-09-04T16:27:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.360+0000 7f4517e92640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510101980 0x7f45101974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.360+0000 7f4517e92640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4510102b80 0x7f45101979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.360+0000 7f4517e92640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f451010a7c0 con 0x7f4510101980 2024-09-04T16:27:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.360+0000 7f4517e92640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f451010a640 con 0x7f4510102b80 2024-09-04T16:27:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.360+0000 7f4515c2e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510101980 0x7f45101974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.360+0000 7f4515c2e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510101980 0x7f45101974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35622/0 (socket says 172.21.15.170:35622) 2024-09-04T16:27:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.360+0000 7f4515c2e640 1 -- 172.21.15.170:0/536018009 learned_addr learned my addr 172.21.15.170:0/536018009 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:35.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.360+0000 7f451542d640 1 --2- 172.21.15.170:0/536018009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4510102b80 0x7f45101979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:35.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.361+0000 7f4515c2e640 1 -- 172.21.15.170:0/536018009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4510102b80 msgr2=0x7f45101979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:35.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.361+0000 7f4515c2e640 1 --2- 172.21.15.170:0/536018009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4510102b80 0x7f45101979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:35.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.361+0000 7f4515c2e640 1 -- 172.21.15.170:0/536018009 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4510198060 con 0x7f4510101980 2024-09-04T16:27:35.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.361+0000 7f4515c2e640 1 --2- 172.21.15.170:0/536018009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510101980 0x7f45101974a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f450800e940 tx=0x7f450800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:35.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.361+0000 7f450effd640 1 -- 172.21.15.170:0/536018009 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f450800cac0 con 0x7f4510101980 2024-09-04T16:27:35.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.361+0000 7f4517e92640 1 -- 172.21.15.170:0/536018009 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451019caa0 con 0x7f4510101980 2024-09-04T16:27:35.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.361+0000 7f450effd640 1 -- 172.21.15.170:0/536018009 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f450800cc60 con 0x7f4510101980 2024-09-04T16:27:35.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.361+0000 7f450effd640 1 -- 172.21.15.170:0/536018009 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4508003e30 con 0x7f4510101980 2024-09-04T16:27:35.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.361+0000 7f4517e92640 1 -- 172.21.15.170:0/536018009 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f451019d000 con 0x7f4510101980 2024-09-04T16:27:35.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.362+0000 7f4517e92640 1 -- 172.21.15.170:0/536018009 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f451010afa0 con 0x7f4510101980 2024-09-04T16:27:35.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.362+0000 7f450effd640 1 -- 172.21.15.170:0/536018009 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f4508004000 con 0x7f4510101980 2024-09-04T16:27:35.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.363+0000 7f450effd640 1 --2- 172.21.15.170:0/536018009 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f44f806de30 0x7f44f80702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:35.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.363+0000 7f450effd640 1 -- 172.21.15.170:0/536018009 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f450808e170 con 0x7f4510101980 2024-09-04T16:27:35.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.363+0000 7f451542d640 1 --2- 172.21.15.170:0/536018009 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f44f806de30 0x7f44f80702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:35.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.364+0000 7f451542d640 1 --2- 172.21.15.170:0/536018009 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f44f806de30 0x7f44f80702f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4504000c00 tx=0x7f45040058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:35.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.368+0000 7f450effd640 1 -- 172.21.15.170:0/536018009 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f450805bcb0 con 0x7f4510101980 2024-09-04T16:27:35.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.584+0000 7f4517e92640 1 -- 172.21.15.170:0/536018009 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4510062df0 con 0x7f4510101980 2024-09-04T16:27:35.585 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:35 smithi170 ceph-mon[29272]: Dropping low affinity active daemon mds.cephfs.smithi193.xostco in favor of higher affinity standby. 2024-09-04T16:27:35.586 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:35 smithi170 ceph-mon[29272]: Replacing daemon mds.cephfs.smithi193.xostco as rank 1 with standby daemon mds.cephfs.smithi170.rzbrux 2024-09-04T16:27:35.586 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:35 smithi170 ceph-mon[29272]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-04T16:27:35.586 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:35 smithi170 ceph-mon[29272]: osdmap e45: 6 total, 6 up, 6 in 2024-09-04T16:27:35.586 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:35 smithi170 ceph-mon[29272]: mds.? [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] up:standby 2024-09-04T16:27:35.586 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:35 smithi170 ceph-mon[29272]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:replay} 1 up:standby 2024-09-04T16:27:35.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.585+0000 7f450effd640 1 -- 172.21.15.170:0/536018009 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+4491 (secure 0 0 0) 0x7f450805f960 con 0x7f4510101980 2024-09-04T16:27:35.586 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2024-09-04T16:27:35.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.587+0000 7f4517e92640 1 -- 172.21.15.170:0/536018009 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f44f806de30 msgr2=0x7f44f80702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:35.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.587+0000 7f4517e92640 1 --2- 172.21.15.170:0/536018009 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f44f806de30 0x7f44f80702f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4504000c00 tx=0x7f45040058d0 comp rx=0 tx=0).stop 2024-09-04T16:27:35.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.587+0000 7f4517e92640 1 -- 172.21.15.170:0/536018009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510101980 msgr2=0x7f45101974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:35.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.587+0000 7f4517e92640 1 --2- 172.21.15.170:0/536018009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510101980 0x7f45101974a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f450800e940 tx=0x7f450800ee00 comp rx=0 tx=0).stop 2024-09-04T16:27:35.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.587+0000 7f4517e92640 1 -- 172.21.15.170:0/536018009 shutdown_connections 2024-09-04T16:27:35.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.587+0000 7f4517e92640 1 --2- 172.21.15.170:0/536018009 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f44f806de30 0x7f44f80702f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:35.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.587+0000 7f4517e92640 1 --2- 172.21.15.170:0/536018009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4510102b80 0x7f45101979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:35.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.587+0000 7f4517e92640 1 --2- 172.21.15.170:0/536018009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510101980 0x7f45101974a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:35.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.587+0000 7f4517e92640 1 -- 172.21.15.170:0/536018009 >> 172.21.15.170:0/536018009 conn(0x7f45100fd110 msgr2=0x7f4510106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:35.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.587+0000 7f4517e92640 1 -- 172.21.15.170:0/536018009 shutdown_connections 2024-09-04T16:27:35.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:35.587+0000 7f4517e92640 1 -- 172.21.15.170:0/536018009 wait complete. 2024-09-04T16:27:35.596 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:27:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:35 smithi193 ceph-mon[36288]: Dropping low affinity active daemon mds.cephfs.smithi193.xostco in favor of higher affinity standby. 2024-09-04T16:27:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:35 smithi193 ceph-mon[36288]: Replacing daemon mds.cephfs.smithi193.xostco as rank 1 with standby daemon mds.cephfs.smithi170.rzbrux 2024-09-04T16:27:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:35 smithi193 ceph-mon[36288]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-04T16:27:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:35 smithi193 ceph-mon[36288]: osdmap e45: 6 total, 6 up, 6 in 2024-09-04T16:27:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:35 smithi193 ceph-mon[36288]: mds.? [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] up:standby 2024-09-04T16:27:35.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:35 smithi193 ceph-mon[36288]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:replay} 1 up:standby 2024-09-04T16:27:36.373 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-04T16:27:36.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:36 smithi170 ceph-mon[29272]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-04T16:27:36.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:36 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:36.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:36 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:36.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:36 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/536018009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-04T16:27:36.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:36 smithi170 ceph-mon[29272]: mds.? [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] up:resolve 2024-09-04T16:27:36.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:36 smithi170 ceph-mon[29272]: mds.? [v2:172.21.15.193:6824/1128257367,v1:172.21.15.193:6825/1128257367] up:boot 2024-09-04T16:27:36.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:36 smithi170 ceph-mon[29272]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:resolve} 2 up:standby 2024-09-04T16:27:36.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:36 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi193.xostco"}]: dispatch 2024-09-04T16:27:36.816 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:36 smithi193 ceph-mon[36288]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-04T16:27:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:36 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:36 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:36 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/536018009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-04T16:27:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:36 smithi193 ceph-mon[36288]: mds.? [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] up:resolve 2024-09-04T16:27:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:36 smithi193 ceph-mon[36288]: mds.? [v2:172.21.15.193:6824/1128257367,v1:172.21.15.193:6825/1128257367] up:boot 2024-09-04T16:27:36.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:36 smithi193 ceph-mon[36288]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:resolve} 2 up:standby 2024-09-04T16:27:36.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:36 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi193.xostco"}]: dispatch 2024-09-04T16:27:37.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.909+0000 7ff9dd01e640 1 -- 172.21.15.170:0/922375623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9d8101a80 msgr2=0x7ff9d8101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:37.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.909+0000 7ff9dd01e640 1 --2- 172.21.15.170:0/922375623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9d8101a80 0x7ff9d8101f00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0009880 tx=0x7ff9c002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:37.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.909+0000 7ff9dd01e640 1 -- 172.21.15.170:0/922375623 shutdown_connections 2024-09-04T16:27:37.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.909+0000 7ff9dd01e640 1 --2- 172.21.15.170:0/922375623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9d8101a80 0x7ff9d8101f00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:37.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.909+0000 7ff9dd01e640 1 --2- 172.21.15.170:0/922375623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9d8100880 0x7ff9d8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:37.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.909+0000 7ff9dd01e640 1 -- 172.21.15.170:0/922375623 >> 172.21.15.170:0/922375623 conn(0x7ff9d80fc010 msgr2=0x7ff9d80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:37.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.909+0000 7ff9dd01e640 1 -- 172.21.15.170:0/922375623 shutdown_connections 2024-09-04T16:27:37.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.909+0000 7ff9dd01e640 1 -- 172.21.15.170:0/922375623 wait complete. 2024-09-04T16:27:37.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.910+0000 7ff9dd01e640 1 Processor -- start 2024-09-04T16:27:37.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.910+0000 7ff9dd01e640 1 -- start start 2024-09-04T16:27:37.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.910+0000 7ff9dd01e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9d8100880 0x7ff9d8197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:37.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.910+0000 7ff9dd01e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9d8101a80 0x7ff9d81979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:37.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.910+0000 7ff9dd01e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81096a0 con 0x7ff9d8100880 2024-09-04T16:27:37.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.910+0000 7ff9dd01e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d8109520 con 0x7ff9d8101a80 2024-09-04T16:27:37.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.910+0000 7ff9d6d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9d8100880 0x7ff9d8197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:37.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.910+0000 7ff9d6d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9d8100880 0x7ff9d8197470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35644/0 (socket says 172.21.15.170:35644) 2024-09-04T16:27:37.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.911+0000 7ff9d6d9d640 1 -- 172.21.15.170:0/2771432579 learned_addr learned my addr 172.21.15.170:0/2771432579 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:37.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.911+0000 7ff9d659c640 1 --2- 172.21.15.170:0/2771432579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9d8101a80 0x7ff9d81979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:37.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.911+0000 7ff9d6d9d640 1 -- 172.21.15.170:0/2771432579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9d8101a80 msgr2=0x7ff9d81979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:37.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.911+0000 7ff9d6d9d640 1 --2- 172.21.15.170:0/2771432579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9d8101a80 0x7ff9d81979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:37.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.911+0000 7ff9d6d9d640 1 -- 172.21.15.170:0/2771432579 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d8198030 con 0x7ff9d8100880 2024-09-04T16:27:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.911+0000 7ff9d6d9d640 1 --2- 172.21.15.170:0/2771432579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9d8100880 0x7ff9d8197470 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000cc30 tx=0x7ff9d000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.911+0000 7ff9cffff640 1 -- 172.21.15.170:0/2771432579 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9d000cd20 con 0x7ff9d8100880 2024-09-04T16:27:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.911+0000 7ff9cffff640 1 -- 172.21.15.170:0/2771432579 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9d000f910 con 0x7ff9d8100880 2024-09-04T16:27:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.911+0000 7ff9dd01e640 1 -- 172.21.15.170:0/2771432579 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d819ca70 con 0x7ff9d8100880 2024-09-04T16:27:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.911+0000 7ff9cffff640 1 -- 172.21.15.170:0/2771432579 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9d0018960 con 0x7ff9d8100880 2024-09-04T16:27:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.911+0000 7ff9dd01e640 1 -- 172.21.15.170:0/2771432579 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d81030a0 con 0x7ff9d8100880 2024-09-04T16:27:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.912+0000 7ff9dd01e640 1 -- 172.21.15.170:0/2771432579 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d8100c80 con 0x7ff9d8100880 2024-09-04T16:27:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.913+0000 7ff9cffff640 1 -- 172.21.15.170:0/2771432579 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7ff9d000f450 con 0x7ff9d8100880 2024-09-04T16:27:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.913+0000 7ff9cffff640 1 --2- 172.21.15.170:0/2771432579 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff9c4072240 0x7ff9c4074700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.913+0000 7ff9cffff640 1 -- 172.21.15.170:0/2771432579 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7ff9d008e220 con 0x7ff9d8100880 2024-09-04T16:27:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.913+0000 7ff9d659c640 1 --2- 172.21.15.170:0/2771432579 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff9c4072240 0x7ff9c4074700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.914+0000 7ff9d659c640 1 --2- 172.21.15.170:0/2771432579 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff9c4072240 0x7ff9c4074700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8198920 tx=0x7ff9c0005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:37.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:37.917+0000 7ff9cffff640 1 -- 172.21.15.170:0/2771432579 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff9d0014030 con 0x7ff9d8100880 2024-09-04T16:27:38.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:38.154+0000 7ff9dd01e640 1 -- 172.21.15.170:0/2771432579 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) -- 0x7ff9d8062df0 con 0x7ff9d8100880 2024-09-04T16:27:38.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:38.154+0000 7ff9cffff640 1 -- 172.21.15.170:0/2771432579 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) ==== 78+0+98 (secure 0 0 0) 0x7ff9d005fa10 con 0x7ff9d8100880 2024-09-04T16:27:38.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:38.156+0000 7ff9dd01e640 1 -- 172.21.15.170:0/2771432579 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff9c4072240 msgr2=0x7ff9c4074700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:38.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:38.156+0000 7ff9dd01e640 1 --2- 172.21.15.170:0/2771432579 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff9c4072240 0x7ff9c4074700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8198920 tx=0x7ff9c0005a20 comp rx=0 tx=0).stop 2024-09-04T16:27:38.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:38.156+0000 7ff9dd01e640 1 -- 172.21.15.170:0/2771432579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9d8100880 msgr2=0x7ff9d8197470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:38.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:38.156+0000 7ff9dd01e640 1 --2- 172.21.15.170:0/2771432579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9d8100880 0x7ff9d8197470 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000cc30 tx=0x7ff9d000a620 comp rx=0 tx=0).stop 2024-09-04T16:27:38.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:38.157+0000 7ff9dd01e640 1 -- 172.21.15.170:0/2771432579 shutdown_connections 2024-09-04T16:27:38.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:38.157+0000 7ff9dd01e640 1 --2- 172.21.15.170:0/2771432579 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff9c4072240 0x7ff9c4074700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:38.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:38.157+0000 7ff9dd01e640 1 --2- 172.21.15.170:0/2771432579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9d8101a80 0x7ff9d81979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:38.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:38.157+0000 7ff9dd01e640 1 --2- 172.21.15.170:0/2771432579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9d8100880 0x7ff9d8197470 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:38.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:38.157+0000 7ff9dd01e640 1 -- 172.21.15.170:0/2771432579 >> 172.21.15.170:0/2771432579 conn(0x7ff9d80fc010 msgr2=0x7ff9d80fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:38.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:38.157+0000 7ff9dd01e640 1 -- 172.21.15.170:0/2771432579 shutdown_connections 2024-09-04T16:27:38.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:38.157+0000 7ff9dd01e640 1 -- 172.21.15.170:0/2771432579 wait complete. 2024-09-04T16:27:38.167 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:27:38.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:38 smithi193 ceph-mon[36288]: mds.? [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] up:reconnect 2024-09-04T16:27:38.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:38 smithi193 ceph-mon[36288]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:reconnect} 2 up:standby 2024-09-04T16:27:38.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:38 smithi193 ceph-mon[36288]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 921 B/s rd, 2.4 KiB/s wr, 8 op/s 2024-09-04T16:27:38.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:38 smithi170 ceph-mon[29272]: mds.? [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] up:reconnect 2024-09-04T16:27:38.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:38 smithi170 ceph-mon[29272]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:reconnect} 2 up:standby 2024-09-04T16:27:38.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:38 smithi170 ceph-mon[29272]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 921 B/s rd, 2.4 KiB/s wr, 8 op/s 2024-09-04T16:27:38.844 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-04T16:27:38.858 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-04T16:27:39.343 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:39.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:39 smithi193 ceph-mon[36288]: mds.? [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] up:rejoin 2024-09-04T16:27:39.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:39 smithi193 ceph-mon[36288]: mds.? [v2:172.21.15.193:6826/288890560,v1:172.21.15.193:6827/288890560] up:standby 2024-09-04T16:27:39.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:39 smithi193 ceph-mon[36288]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:rejoin} 2 up:standby 2024-09-04T16:27:39.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:39 smithi193 ceph-mon[36288]: daemon mds.cephfs.smithi170.rzbrux is now active in filesystem cephfs as rank 1 2024-09-04T16:27:39.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:39 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2771432579' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-04T16:27:39.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:39 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:39.466 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:39 smithi170 ceph-mon[29272]: mds.? [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] up:rejoin 2024-09-04T16:27:39.467 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:39 smithi170 ceph-mon[29272]: mds.? [v2:172.21.15.193:6826/288890560,v1:172.21.15.193:6827/288890560] up:standby 2024-09-04T16:27:39.467 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:39 smithi170 ceph-mon[29272]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:rejoin} 2 up:standby 2024-09-04T16:27:39.467 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:39 smithi170 ceph-mon[29272]: daemon mds.cephfs.smithi170.rzbrux is now active in filesystem cephfs as rank 1 2024-09-04T16:27:39.467 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:39 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2771432579' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-04T16:27:39.467 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:39 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:40.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:40 smithi193 ceph-mon[36288]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-04T16:27:40.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:40 smithi193 ceph-mon[36288]: mds.? [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] up:active 2024-09-04T16:27:40.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:40 smithi193 ceph-mon[36288]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:active} 2 up:standby 2024-09-04T16:27:40.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:40 smithi193 ceph-mon[36288]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-04T16:27:40.407 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:40 smithi170 ceph-mon[29272]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-04T16:27:40.407 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:40 smithi170 ceph-mon[29272]: mds.? [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] up:active 2024-09-04T16:27:40.407 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:40 smithi170 ceph-mon[29272]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:active} 2 up:standby 2024-09-04T16:27:40.407 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:40 smithi170 ceph-mon[29272]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-04T16:27:40.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.482+0000 7f8c876b7640 1 -- 172.21.15.170:0/575587686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c80101910 msgr2=0x7f8c80101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:40.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.482+0000 7f8c876b7640 1 --2- 172.21.15.170:0/575587686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c80101910 0x7f8c80101d70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8c70009880 tx=0x7f8c7002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:40.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.482+0000 7f8c876b7640 1 -- 172.21.15.170:0/575587686 shutdown_connections 2024-09-04T16:27:40.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.482+0000 7f8c876b7640 1 --2- 172.21.15.170:0/575587686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c80101910 0x7f8c80101d70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:40.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.482+0000 7f8c876b7640 1 --2- 172.21.15.170:0/575587686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c80107910 0x7f8c80107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:40.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.482+0000 7f8c876b7640 1 -- 172.21.15.170:0/575587686 >> 172.21.15.170:0/575587686 conn(0x7f8c800fd5f0 msgr2=0x7f8c800ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:40.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.482+0000 7f8c876b7640 1 -- 172.21.15.170:0/575587686 shutdown_connections 2024-09-04T16:27:40.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.482+0000 7f8c876b7640 1 -- 172.21.15.170:0/575587686 wait complete. 2024-09-04T16:27:40.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.482+0000 7f8c876b7640 1 Processor -- start 2024-09-04T16:27:40.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.482+0000 7f8c876b7640 1 -- start start 2024-09-04T16:27:40.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c876b7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c80101910 0x7f8c8019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:40.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c876b7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c80107910 0x7f8c8019dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:40.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c876b7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8010ee40 con 0x7f8c80107910 2024-09-04T16:27:40.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c876b7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8010ecc0 con 0x7f8c80101910 2024-09-04T16:27:40.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c84c52640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c80107910 0x7f8c8019dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:40.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c84c52640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c80107910 0x7f8c8019dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35666/0 (socket says 172.21.15.170:35666) 2024-09-04T16:27:40.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c84c52640 1 -- 172.21.15.170:0/2477115958 learned_addr learned my addr 172.21.15.170:0/2477115958 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:40.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c84c52640 1 -- 172.21.15.170:0/2477115958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c80101910 msgr2=0x7f8c8019d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:40.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c85453640 1 --2- 172.21.15.170:0/2477115958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c80101910 0x7f8c8019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:40.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c84c52640 1 --2- 172.21.15.170:0/2477115958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c80101910 0x7f8c8019d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:40.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c84c52640 1 -- 172.21.15.170:0/2477115958 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c80197850 con 0x7f8c80107910 2024-09-04T16:27:40.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c84c52640 1 --2- 172.21.15.170:0/2477115958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c80107910 0x7f8c8019dc10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8c70031460 tx=0x7f8c700048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:40.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c767fc640 1 -- 172.21.15.170:0/2477115958 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c7003f070 con 0x7f8c80107910 2024-09-04T16:27:40.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c767fc640 1 -- 172.21.15.170:0/2477115958 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c70004cf0 con 0x7f8c80107910 2024-09-04T16:27:40.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c876b7640 1 -- 172.21.15.170:0/2477115958 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c80197ae0 con 0x7f8c80107910 2024-09-04T16:27:40.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c767fc640 1 -- 172.21.15.170:0/2477115958 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c70035030 con 0x7f8c80107910 2024-09-04T16:27:40.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.483+0000 7f8c876b7640 1 -- 172.21.15.170:0/2477115958 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c80198010 con 0x7f8c80107910 2024-09-04T16:27:40.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.484+0000 7f8c876b7640 1 -- 172.21.15.170:0/2477115958 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c80103050 con 0x7f8c80107910 2024-09-04T16:27:40.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.485+0000 7f8c767fc640 1 -- 172.21.15.170:0/2477115958 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f8c70042070 con 0x7f8c80107910 2024-09-04T16:27:40.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.485+0000 7f8c767fc640 1 --2- 172.21.15.170:0/2477115958 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8c6c06de30 0x7f8c6c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:40.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.485+0000 7f8c767fc640 1 -- 172.21.15.170:0/2477115958 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f8c700ae6d0 con 0x7f8c80107910 2024-09-04T16:27:40.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.485+0000 7f8c85453640 1 --2- 172.21.15.170:0/2477115958 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8c6c06de30 0x7f8c6c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:40.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.486+0000 7f8c85453640 1 --2- 172.21.15.170:0/2477115958 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8c6c06de30 0x7f8c6c0702f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00a810 tx=0x7f8c7c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:40.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.490+0000 7f8c767fc640 1 -- 172.21.15.170:0/2477115958 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8c7007c210 con 0x7f8c80107910 2024-09-04T16:27:40.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.704+0000 7f8c876b7640 1 -- 172.21.15.170:0/2477115958 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c80198d80 con 0x7f8c80107910 2024-09-04T16:27:40.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.704+0000 7f8c767fc640 1 -- 172.21.15.170:0/2477115958 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5346 (secure 0 0 0) 0x7f8c7007fec0 con 0x7f8c80107910 2024-09-04T16:27:40.705 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:27:40.705 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":15,"btime":"2024-09-04T16:27:39:151187+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24315,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.193:6827/288890560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":288890560},{"type":"v1","addr":"172.21.15.193:6827","nonce":288890560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":24319,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1128257367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1128257367},{"type":"v1","addr":"172.21.15.193:6825","nonce":1128257367}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:27:39.151182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14562,"mds_1":14578},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14562":{"gid":14562,"name":"cephfs.smithi170.zkhdil","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6827/3443400311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3443400311},{"type":"v1","addr":"172.21.15.170:6827","nonce":3443400311}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14578":{"gid":14578,"name":"cephfs.smithi170.rzbrux","rank":1,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.170:6829/3937288624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3937288624},{"type":"v1","addr":"172.21.15.170:6829","nonce":3937288624}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14562,"qdb_cluster":[14562,14578]},"id":1}]} 2024-09-04T16:27:40.705 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 15 2024-09-04T16:27:40.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.708+0000 7f8c876b7640 1 -- 172.21.15.170:0/2477115958 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8c6c06de30 msgr2=0x7f8c6c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:40.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.708+0000 7f8c876b7640 1 --2- 172.21.15.170:0/2477115958 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8c6c06de30 0x7f8c6c0702f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00a810 tx=0x7f8c7c008040 comp rx=0 tx=0).stop 2024-09-04T16:27:40.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.708+0000 7f8c876b7640 1 -- 172.21.15.170:0/2477115958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c80107910 msgr2=0x7f8c8019dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:40.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.708+0000 7f8c876b7640 1 --2- 172.21.15.170:0/2477115958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c80107910 0x7f8c8019dc10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8c70031460 tx=0x7f8c700048f0 comp rx=0 tx=0).stop 2024-09-04T16:27:40.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.708+0000 7f8c876b7640 1 -- 172.21.15.170:0/2477115958 shutdown_connections 2024-09-04T16:27:40.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.708+0000 7f8c876b7640 1 --2- 172.21.15.170:0/2477115958 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f8c6c06de30 0x7f8c6c0702f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:40.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.708+0000 7f8c876b7640 1 --2- 172.21.15.170:0/2477115958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c80107910 0x7f8c8019dc10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:40.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.708+0000 7f8c876b7640 1 --2- 172.21.15.170:0/2477115958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c80101910 0x7f8c8019d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:40.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.708+0000 7f8c876b7640 1 -- 172.21.15.170:0/2477115958 >> 172.21.15.170:0/2477115958 conn(0x7f8c800fd5f0 msgr2=0x7f8c800fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:40.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.708+0000 7f8c876b7640 1 -- 172.21.15.170:0/2477115958 shutdown_connections 2024-09-04T16:27:40.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:40.708+0000 7f8c876b7640 1 -- 172.21.15.170:0/2477115958 wait complete. 2024-09-04T16:27:41.386 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 2, 'flags': 18} 2024-09-04T16:27:41.386 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-04T16:27:41.444 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-04T16:27:41.445 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-04T16:27:41.445 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-04T16:27:41.445 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-04T16:27:41.445 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-04T16:27:41.445 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-04T16:27:41.445 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-04T16:27:41.445 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-04T16:27:41.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:41.446 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list 2024-09-04T16:27:41.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:41.463 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link delete ceph-brx 2024-09-04T16:27:41.533 INFO:teuthology.orchestra.run.smithi193.stderr:Cannot find device "ceph-brx" 2024-09-04T16:27:41.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-04T16:27:41.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:41.535 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-09-04T16:27:41.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:41.551 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link delete ceph-brx 2024-09-04T16:27:41.623 INFO:teuthology.orchestra.run.smithi170.stderr:Cannot find device "ceph-brx" 2024-09-04T16:27:41.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-04T16:27:41.625 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-04T16:27:41.625 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-04T16:27:41.625 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs ls 2024-09-04T16:27:41.804 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:41 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:41.804 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:41 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2477115958' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-04T16:27:41.804 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:41 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:41.804 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:41 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:27:41.804 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:41 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:27:41.804 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:41 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:41.804 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:41 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:27:41.804 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:41 smithi193 ceph-mon[36288]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-04T16:27:41.989 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:41 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:41.989 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:41 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2477115958' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-04T16:27:41.989 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:41 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:41.989 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:41 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:27:41.989 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:41 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:27:41.989 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:41 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:41.989 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:41 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:27:41.989 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:41 smithi170 ceph-mon[29272]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-04T16:27:42.315 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:42.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.759+0000 7fba197ff640 1 -- 172.21.15.170:0/2850340359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba14107930 msgr2=0x7fba14107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:42.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.759+0000 7fba197ff640 1 --2- 172.21.15.170:0/2850340359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba14107930 0x7fba14107d10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009880 tx=0x7fb9fc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:42.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.759+0000 7fba197ff640 1 -- 172.21.15.170:0/2850340359 shutdown_connections 2024-09-04T16:27:42.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.759+0000 7fba197ff640 1 --2- 172.21.15.170:0/2850340359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba14101930 0x7fba14101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:42.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.759+0000 7fba197ff640 1 --2- 172.21.15.170:0/2850340359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba14107930 0x7fba14107d10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:42.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.759+0000 7fba197ff640 1 -- 172.21.15.170:0/2850340359 >> 172.21.15.170:0/2850340359 conn(0x7fba140fd630 msgr2=0x7fba140ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:42.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.759+0000 7fba197ff640 1 -- 172.21.15.170:0/2850340359 shutdown_connections 2024-09-04T16:27:42.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.759+0000 7fba197ff640 1 -- 172.21.15.170:0/2850340359 wait complete. 2024-09-04T16:27:42.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.759+0000 7fba197ff640 1 Processor -- start 2024-09-04T16:27:42.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.760+0000 7fba197ff640 1 -- start start 2024-09-04T16:27:42.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.760+0000 7fba197ff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba14101930 0x7fba140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:42.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.760+0000 7fba197ff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba14107930 0x7fba14074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:42.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.760+0000 7fba197ff640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fba1410ee00 con 0x7fba14101930 2024-09-04T16:27:42.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.760+0000 7fba197ff640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fba1410ec80 con 0x7fba14107930 2024-09-04T16:27:42.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.760+0000 7fba12ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba14101930 0x7fba140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:42.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.760+0000 7fba12ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba14101930 0x7fba140744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35684/0 (socket says 172.21.15.170:35684) 2024-09-04T16:27:42.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.760+0000 7fba12ffd640 1 -- 172.21.15.170:0/3763088926 learned_addr learned my addr 172.21.15.170:0/3763088926 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:42.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.760+0000 7fba127fc640 1 --2- 172.21.15.170:0/3763088926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba14107930 0x7fba14074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:42.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.760+0000 7fba12ffd640 1 -- 172.21.15.170:0/3763088926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba14107930 msgr2=0x7fba14074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:42.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.760+0000 7fba12ffd640 1 --2- 172.21.15.170:0/3763088926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba14107930 0x7fba14074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:42.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.760+0000 7fba12ffd640 1 -- 172.21.15.170:0/3763088926 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba14074f70 con 0x7fba14101930 2024-09-04T16:27:42.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.760+0000 7fba12ffd640 1 --2- 172.21.15.170:0/3763088926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba14101930 0x7fba140744f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc031460 tx=0x7fb9fc004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:42.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.761+0000 7fba0bfff640 1 -- 172.21.15.170:0/3763088926 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9fc03f070 con 0x7fba14101930 2024-09-04T16:27:42.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.761+0000 7fba0bfff640 1 -- 172.21.15.170:0/3763088926 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb9fc0035f0 con 0x7fba14101930 2024-09-04T16:27:42.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.761+0000 7fba197ff640 1 -- 172.21.15.170:0/3763088926 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba14075200 con 0x7fba14101930 2024-09-04T16:27:42.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.761+0000 7fba0bfff640 1 -- 172.21.15.170:0/3763088926 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9fc035030 con 0x7fba14101930 2024-09-04T16:27:42.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.761+0000 7fba197ff640 1 -- 172.21.15.170:0/3763088926 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba141a3db0 con 0x7fba14101930 2024-09-04T16:27:42.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.762+0000 7fba197ff640 1 -- 172.21.15.170:0/3763088926 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba14103070 con 0x7fba14101930 2024-09-04T16:27:42.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.762+0000 7fba0bfff640 1 -- 172.21.15.170:0/3763088926 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7fb9fc042070 con 0x7fba14101930 2024-09-04T16:27:42.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.763+0000 7fba0bfff640 1 --2- 172.21.15.170:0/3763088926 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fba0006de30 0x7fba000702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:42.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.763+0000 7fba127fc640 1 --2- 172.21.15.170:0/3763088926 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fba0006de30 0x7fba000702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:42.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.763+0000 7fba0bfff640 1 -- 172.21.15.170:0/3763088926 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fb9fc0ae590 con 0x7fba14101930 2024-09-04T16:27:42.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.763+0000 7fba127fc640 1 --2- 172.21.15.170:0/3763088926 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fba0006de30 0x7fba000702f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fba14075f80 tx=0x7fba04005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:42.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.767+0000 7fba0bfff640 1 -- 172.21.15.170:0/3763088926 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb9fc07c0d0 con 0x7fba14101930 2024-09-04T16:27:42.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.989+0000 7fba197ff640 1 -- 172.21.15.170:0/3763088926 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fba14109ea0 con 0x7fba14101930 2024-09-04T16:27:42.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.989+0000 7fba0bfff640 1 -- 172.21.15.170:0/3763088926 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+83 (secure 0 0 0) 0x7fb9fc07fd80 con 0x7fba14101930 2024-09-04T16:27:42.990 INFO:teuthology.orchestra.run.smithi170.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-04T16:27:42.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.991+0000 7fba197ff640 1 -- 172.21.15.170:0/3763088926 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fba0006de30 msgr2=0x7fba000702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:42.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.991+0000 7fba197ff640 1 --2- 172.21.15.170:0/3763088926 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fba0006de30 0x7fba000702f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fba14075f80 tx=0x7fba04005f90 comp rx=0 tx=0).stop 2024-09-04T16:27:42.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.991+0000 7fba197ff640 1 -- 172.21.15.170:0/3763088926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba14101930 msgr2=0x7fba140744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:42.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.991+0000 7fba197ff640 1 --2- 172.21.15.170:0/3763088926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba14101930 0x7fba140744f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc031460 tx=0x7fb9fc004530 comp rx=0 tx=0).stop 2024-09-04T16:27:42.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.991+0000 7fba197ff640 1 -- 172.21.15.170:0/3763088926 shutdown_connections 2024-09-04T16:27:42.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.991+0000 7fba197ff640 1 --2- 172.21.15.170:0/3763088926 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fba0006de30 0x7fba000702f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:42.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.991+0000 7fba197ff640 1 --2- 172.21.15.170:0/3763088926 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba14107930 0x7fba14074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:42.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.991+0000 7fba197ff640 1 --2- 172.21.15.170:0/3763088926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba14101930 0x7fba140744f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:42.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.991+0000 7fba197ff640 1 -- 172.21.15.170:0/3763088926 >> 172.21.15.170:0/3763088926 conn(0x7fba140fd630 msgr2=0x7fba140fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:42.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.991+0000 7fba197ff640 1 -- 172.21.15.170:0/3763088926 shutdown_connections 2024-09-04T16:27:42.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:42.991+0000 7fba197ff640 1 -- 172.21.15.170:0/3763088926 wait complete. 2024-09-04T16:27:43.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:43 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3763088926' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-04T16:27:43.441 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:43 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3763088926' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-04T16:27:44.136 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-04T16:27:44.136 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-04T16:27:44.137 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi170.front.sepia.ceph.com 2024-09-04T16:27:44.137 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-04T16:27:44.137 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-04T16:27:44.137 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-04T16:27:44.137 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-04T16:27:44.137 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-04T16:27:44.137 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-04T16:27:44.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:44.137 DEBUG:teuthology.orchestra.run.smithi170:> ip addr 2024-09-04T16:27:44.155 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-04T16:27:44.155 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-04T16:27:44.155 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2024-09-04T16:27:44.155 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-09-04T16:27:44.155 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2024-09-04T16:27:44.155 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-09-04T16:27:44.155 INFO:teuthology.orchestra.run.smithi170.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-04T16:27:44.155 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:54 brd ff:ff:ff:ff:ff:ff 2024-09-04T16:27:44.155 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f0 2024-09-04T16:27:44.155 INFO:teuthology.orchestra.run.smithi170.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-04T16:27:44.155 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:55 brd ff:ff:ff:ff:ff:ff 2024-09-04T16:27:44.155 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f1 2024-09-04T16:27:44.156 INFO:teuthology.orchestra.run.smithi170.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-04T16:27:44.156 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:54 brd ff:ff:ff:ff:ff:ff 2024-09-04T16:27:44.156 INFO:teuthology.orchestra.run.smithi170.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-04T16:27:44.156 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:55 brd ff:ff:ff:ff:ff:ff 2024-09-04T16:27:44.156 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.21.15.170/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-04T16:27:44.156 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft 42311sec preferred_lft 42311sec 2024-09-04T16:27:44.156 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::ec4:7aff:fe88:7255/64 scope link noprefixroute 2024-09-04T16:27:44.156 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-09-04T16:27:44.156 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-04T16:27:44.157 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-04T16:27:44.157 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-09-04T16:27:44.157 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add name ceph-brx type bridge 2024-09-04T16:27:44.157 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip addr flush dev ceph-brx 2024-09-04T16:27:44.157 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set ceph-brx up 2024-09-04T16:27:44.157 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-04T16:27:44.157 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-09-04T16:27:44.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-04T16:27:44.363 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:44.363 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:44.363 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:44.363 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:44 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:27:44.363 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:44 smithi170 ceph-mon[29272]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-04T16:27:44.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-04T16:27:44.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:44.404 DEBUG:teuthology.orchestra.run.smithi170:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-04T16:27:44.429 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-09-04T16:27:44.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:44.431 DEBUG:teuthology.orchestra.run.smithi170:> route 2024-09-04T16:27:44.529 INFO:teuthology.orchestra.run.smithi170.stdout:Kernel IP routing table 2024-09-04T16:27:44.529 INFO:teuthology.orchestra.run.smithi170.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-04T16:27:44.529 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-04T16:27:44.529 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-04T16:27:44.529 INFO:teuthology.orchestra.run.smithi170.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-04T16:27:44.530 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-04T16:27:44.530 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-09-04T16:27:44.530 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-04T16:27:44.530 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-04T16:27:44.530 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-04T16:27:44.530 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-09-04T16:27:44.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-04T16:27:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:44 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:27:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:44 smithi193 ceph-mon[36288]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-04T16:27:45.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-04T16:27:45.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:45.008 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-09-04T16:27:45.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:45.024 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list-id 2024-09-04T16:27:45.081 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-04T16:27:45.081 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-09-04T16:27:45.081 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-04T16:27:45.082 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-04T16:27:45.082 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-09-04T16:27:45.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-04T16:27:45.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-04T16:27:45.205 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-04T16:27:45.205 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-04T16:27:45.205 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-09-04T16:27:45.205 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-04T16:27:45.205 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-04T16:27:45.205 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-04T16:27:45.205 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-04T16:27:45.206 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-04T16:27:45.206 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-09-04T16:27:45.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-04T16:27:45.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-04T16:27:45.350 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-04T16:27:45.350 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-09-04T16:27:45.350 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set brx.0 up 2024-09-04T16:27:45.350 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set dev brx.0 master ceph-brx 2024-09-04T16:27:45.350 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-09-04T16:27:45.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-04T16:27:45.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-04T16:27:45.427 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-04T16:27:45.427 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-04T16:27:45.427 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-04T16:27:45.442 INFO:teuthology.orchestra.run.smithi170.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-04T16:27:45.442 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-04T16:27:45.443 DEBUG:teuthology.orchestra.run.smithi170:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-04T16:27:45.498 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2024-09-04T16:27:45.566 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2024-09-04T16:27:45.623 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2024-09-04T16:27:45.624 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2024-09-04T16:27:45.624 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2024-09-04T16:27:45.624 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2024-09-04T16:27:45.624 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2024-09-04T16:27:45.624 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2024-09-04T16:27:45.624 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2024-09-04T16:27:45.624 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2024-09-04T16:27:45.625 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2024-09-04T16:27:45.625 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2024-09-04T16:27:45.625 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2024-09-04T16:27:45.625 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/selinux 2024-09-04T16:27:45.626 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-09-04T16:27:45.626 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2024-09-04T16:27:45.626 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2024-09-04T16:27:45.626 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2024-09-04T16:27:45.626 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2024-09-04T16:27:45.626 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysusers.service 2024-09-04T16:27:45.626 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2024-09-04T16:27:45.627 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2024-09-04T16:27:45.627 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysctl.service 2024-09-04T16:27:45.627 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-04T16:27:45.627 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-04T16:27:45.627 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/nfs/rpc_pipefs 2024-09-04T16:27:45.627 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2024-09-04T16:27:45.628 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2024-09-04T16:27:45.628 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay 2024-09-04T16:27:45.628 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/7afeb87b29e772a3859b197cc9347eb707bf98cb96e4a5d310c6d8c8a48d945f/merged 2024-09-04T16:27:45.628 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/c1bac8bd6cd69ddec7c1abcbd75c52e08938a466a92e8a74baf5558cfe7c2b24/merged 2024-09-04T16:27:45.628 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/0 2024-09-04T16:27:45.628 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-09-04T16:27:45.628 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/a180af28aaa89097068dabf7041c873cd2511f4f0b31085d307636b3cd27ac55/merged 2024-09-04T16:27:45.629 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/97d0dbf8ee9f55d9188ab226ab1034ebba5ebaad718067d0255d1dd839640228/merged 2024-09-04T16:27:45.629 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/b84bf7abead1a2eecc3394ad3a9191624e7f5424b832a4acd22fa76fc60f285a/merged 2024-09-04T16:27:45.629 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/912ad7a29dcb97b65195936f3d188432a82460b69d1780d1154c04cd2b0f9586/merged 2024-09-04T16:27:45.629 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/b0eadbfc8c336af44fffbd18584ccc45fee0b4d72a7fdf8305c1dafd835c5f31/merged 2024-09-04T16:27:45.629 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/febb94b685b131b5e417128a65a3e75c7c722178aede681a82b6c3d61debb969/merged 2024-09-04T16:27:45.629 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/2357f40cb7ae280f5311fed67cb6caac4bdf7b4c8e5d518591d4e11b2359e988/merged 2024-09-04T16:27:45.630 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/f2a81ca8fecc621aac9f263cbb31bca50d6a25f310b97576dc02b8a5dc1ccc53/merged 2024-09-04T16:27:45.630 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/faf750e6a363db491b6ec8c32922056e5d2c2ab674f3d6cd3d104a9d52f9856e/merged 2024-09-04T16:27:45.630 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/07129b181e0ae1f25e3485129f5545213db426e42c66283112a324c06aadda4c/merged 2024-09-04T16:27:45.630 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/67c49f7540463ea42227ac10451a973de0a930e8d3b866f919d16fa176104700/merged 2024-09-04T16:27:45.630 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2024-09-04T16:27:45.630 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-04T16:27:45.630 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-04T16:27:45.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:45.631 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2024-09-04T16:27:45.678 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-04T16:27:45.679 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-04T16:27:45.721 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2024-09-04T16:27:45.745 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2024-09-04T16:27:45.801 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2024-09-04T16:27:45.802 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2024-09-04T16:27:45.802 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2024-09-04T16:27:45.802 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2024-09-04T16:27:45.802 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2024-09-04T16:27:45.802 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2024-09-04T16:27:45.802 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2024-09-04T16:27:45.802 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2024-09-04T16:27:45.802 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2024-09-04T16:27:45.802 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2024-09-04T16:27:45.803 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2024-09-04T16:27:45.803 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/selinux 2024-09-04T16:27:45.803 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-09-04T16:27:45.803 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2024-09-04T16:27:45.803 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2024-09-04T16:27:45.803 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2024-09-04T16:27:45.803 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2024-09-04T16:27:45.803 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysusers.service 2024-09-04T16:27:45.803 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2024-09-04T16:27:45.803 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2024-09-04T16:27:45.803 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysctl.service 2024-09-04T16:27:45.803 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-04T16:27:45.803 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-04T16:27:45.804 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/nfs/rpc_pipefs 2024-09-04T16:27:45.804 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2024-09-04T16:27:45.804 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2024-09-04T16:27:45.804 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay 2024-09-04T16:27:45.804 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/7afeb87b29e772a3859b197cc9347eb707bf98cb96e4a5d310c6d8c8a48d945f/merged 2024-09-04T16:27:45.804 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/c1bac8bd6cd69ddec7c1abcbd75c52e08938a466a92e8a74baf5558cfe7c2b24/merged 2024-09-04T16:27:45.804 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/0 2024-09-04T16:27:45.804 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-09-04T16:27:45.804 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/a180af28aaa89097068dabf7041c873cd2511f4f0b31085d307636b3cd27ac55/merged 2024-09-04T16:27:45.804 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/97d0dbf8ee9f55d9188ab226ab1034ebba5ebaad718067d0255d1dd839640228/merged 2024-09-04T16:27:45.804 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/b84bf7abead1a2eecc3394ad3a9191624e7f5424b832a4acd22fa76fc60f285a/merged 2024-09-04T16:27:45.804 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/912ad7a29dcb97b65195936f3d188432a82460b69d1780d1154c04cd2b0f9586/merged 2024-09-04T16:27:45.805 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/b0eadbfc8c336af44fffbd18584ccc45fee0b4d72a7fdf8305c1dafd835c5f31/merged 2024-09-04T16:27:45.805 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/febb94b685b131b5e417128a65a3e75c7c722178aede681a82b6c3d61debb969/merged 2024-09-04T16:27:45.805 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/2357f40cb7ae280f5311fed67cb6caac4bdf7b4c8e5d518591d4e11b2359e988/merged 2024-09-04T16:27:45.805 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/f2a81ca8fecc621aac9f263cbb31bca50d6a25f310b97576dc02b8a5dc1ccc53/merged 2024-09-04T16:27:45.805 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/faf750e6a363db491b6ec8c32922056e5d2c2ab674f3d6cd3d104a9d52f9856e/merged 2024-09-04T16:27:45.805 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/07129b181e0ae1f25e3485129f5545213db426e42c66283112a324c06aadda4c/merged 2024-09-04T16:27:45.805 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/67c49f7540463ea42227ac10451a973de0a930e8d3b866f919d16fa176104700/merged 2024-09-04T16:27:45.805 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2024-09-04T16:27:45.805 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-04T16:27:45.806 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-04T16:27:45.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:45.806 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2024-09-04T16:27:45.901 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi170.stderr:2024-09-04T16:27:45.900+0000 7fb6c5bc6480 -1 init, newargv = 0x556658b02020 newargc=15 2024-09-04T16:27:45.901 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi170.stderr:ceph-fuse[77750]: starting ceph client 2024-09-04T16:27:45.908 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi170.stderr:ceph-fuse[77750]: starting fuse 2024-09-04T16:27:46.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:46 smithi170 ceph-mon[29272]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 7.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-04T16:27:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:46 smithi193 ceph-mon[36288]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 7.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-04T16:27:46.959 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2024-09-04T16:27:46.986 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2024-09-04T16:27:47.043 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2024-09-04T16:27:47.043 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2024-09-04T16:27:47.043 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2024-09-04T16:27:47.043 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2024-09-04T16:27:47.043 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2024-09-04T16:27:47.043 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2024-09-04T16:27:47.043 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2024-09-04T16:27:47.043 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2024-09-04T16:27:47.043 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2024-09-04T16:27:47.043 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2024-09-04T16:27:47.044 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2024-09-04T16:27:47.044 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/selinux 2024-09-04T16:27:47.044 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-09-04T16:27:47.044 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2024-09-04T16:27:47.044 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2024-09-04T16:27:47.044 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2024-09-04T16:27:47.044 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2024-09-04T16:27:47.044 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysusers.service 2024-09-04T16:27:47.044 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2024-09-04T16:27:47.044 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2024-09-04T16:27:47.044 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysctl.service 2024-09-04T16:27:47.044 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-04T16:27:47.044 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-04T16:27:47.045 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/nfs/rpc_pipefs 2024-09-04T16:27:47.045 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2024-09-04T16:27:47.045 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2024-09-04T16:27:47.045 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay 2024-09-04T16:27:47.045 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/7afeb87b29e772a3859b197cc9347eb707bf98cb96e4a5d310c6d8c8a48d945f/merged 2024-09-04T16:27:47.045 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/c1bac8bd6cd69ddec7c1abcbd75c52e08938a466a92e8a74baf5558cfe7c2b24/merged 2024-09-04T16:27:47.045 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/0 2024-09-04T16:27:47.045 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2024-09-04T16:27:47.045 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/a180af28aaa89097068dabf7041c873cd2511f4f0b31085d307636b3cd27ac55/merged 2024-09-04T16:27:47.045 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/97d0dbf8ee9f55d9188ab226ab1034ebba5ebaad718067d0255d1dd839640228/merged 2024-09-04T16:27:47.045 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/b84bf7abead1a2eecc3394ad3a9191624e7f5424b832a4acd22fa76fc60f285a/merged 2024-09-04T16:27:47.045 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/912ad7a29dcb97b65195936f3d188432a82460b69d1780d1154c04cd2b0f9586/merged 2024-09-04T16:27:47.045 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/b0eadbfc8c336af44fffbd18584ccc45fee0b4d72a7fdf8305c1dafd835c5f31/merged 2024-09-04T16:27:47.045 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/febb94b685b131b5e417128a65a3e75c7c722178aede681a82b6c3d61debb969/merged 2024-09-04T16:27:47.046 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/2357f40cb7ae280f5311fed67cb6caac4bdf7b4c8e5d518591d4e11b2359e988/merged 2024-09-04T16:27:47.046 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/f2a81ca8fecc621aac9f263cbb31bca50d6a25f310b97576dc02b8a5dc1ccc53/merged 2024-09-04T16:27:47.046 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/faf750e6a363db491b6ec8c32922056e5d2c2ab674f3d6cd3d104a9d52f9856e/merged 2024-09-04T16:27:47.046 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/07129b181e0ae1f25e3485129f5545213db426e42c66283112a324c06aadda4c/merged 2024-09-04T16:27:47.046 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/containers/storage/overlay/67c49f7540463ea42227ac10451a973de0a930e8d3b866f919d16fa176104700/merged 2024-09-04T16:27:47.046 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2024-09-04T16:27:47.046 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-04T16:27:47.046 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-04T16:27:47.046 INFO:teuthology.orchestra.run.smithi170.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-04T16:27:47.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:47.046 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2024-09-04T16:27:47.099 INFO:teuthology.orchestra.run.smithi170.stdout:166 2024-09-04T16:27:47.099 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [166] 2024-09-04T16:27:47.099 DEBUG:teuthology.orchestra.run.smithi170:> sudo stdin-killer -- python3 -c ' 2024-09-04T16:27:47.099 DEBUG:teuthology.orchestra.run.smithi170:> import glob 2024-09-04T16:27:47.099 DEBUG:teuthology.orchestra.run.smithi170:> import re 2024-09-04T16:27:47.099 DEBUG:teuthology.orchestra.run.smithi170:> import os 2024-09-04T16:27:47.100 DEBUG:teuthology.orchestra.run.smithi170:> import subprocess 2024-09-04T16:27:47.100 DEBUG:teuthology.orchestra.run.smithi170:> 2024-09-04T16:27:47.100 DEBUG:teuthology.orchestra.run.smithi170:> def _find_admin_socket(client_name): 2024-09-04T16:27:47.100 DEBUG:teuthology.orchestra.run.smithi170:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-04T16:27:47.100 DEBUG:teuthology.orchestra.run.smithi170:> files = glob.glob(asok_path) 2024-09-04T16:27:47.100 DEBUG:teuthology.orchestra.run.smithi170:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-04T16:27:47.100 DEBUG:teuthology.orchestra.run.smithi170:> 2024-09-04T16:27:47.100 DEBUG:teuthology.orchestra.run.smithi170:> # Given a non-glob path, it better be there 2024-09-04T16:27:47.100 DEBUG:teuthology.orchestra.run.smithi170:> if "*" not in asok_path: 2024-09-04T16:27:47.100 DEBUG:teuthology.orchestra.run.smithi170:> assert(len(files) == 1) 2024-09-04T16:27:47.100 DEBUG:teuthology.orchestra.run.smithi170:> return files[0] 2024-09-04T16:27:47.100 DEBUG:teuthology.orchestra.run.smithi170:> 2024-09-04T16:27:47.100 DEBUG:teuthology.orchestra.run.smithi170:> for f in files: 2024-09-04T16:27:47.100 DEBUG:teuthology.orchestra.run.smithi170:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-04T16:27:47.100 DEBUG:teuthology.orchestra.run.smithi170:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-04T16:27:47.101 DEBUG:teuthology.orchestra.run.smithi170:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-04T16:27:47.101 DEBUG:teuthology.orchestra.run.smithi170:> contents = proc_f.read() 2024-09-04T16:27:47.101 DEBUG:teuthology.orchestra.run.smithi170:> if mountpoint in contents: 2024-09-04T16:27:47.101 DEBUG:teuthology.orchestra.run.smithi170:> return f 2024-09-04T16:27:47.101 DEBUG:teuthology.orchestra.run.smithi170:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-04T16:27:47.101 DEBUG:teuthology.orchestra.run.smithi170:> 2024-09-04T16:27:47.101 DEBUG:teuthology.orchestra.run.smithi170:> print(_find_admin_socket("client.0")) 2024-09-04T16:27:47.101 DEBUG:teuthology.orchestra.run.smithi170:> ' 2024-09-04T16:27:47.217 INFO:teuthology.orchestra.run.smithi170.stdout:/var/run/ceph/ceph-client.0.77750.asok 2024-09-04T16:27:47.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-04T16:27:47.227 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.77750.asok 2024-09-04T16:27:47.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:47.227 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.77750.asok status 2024-09-04T16:27:47.360 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:27:47.360 INFO:teuthology.orchestra.run.smithi170.stdout: "metadata": { 2024-09-04T16:27:47.360 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_sha1": "48920dabc954a29bdb7dd91079363a020369bbff", 2024-09-04T16:27:47.360 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)", 2024-09-04T16:27:47.361 INFO:teuthology.orchestra.run.smithi170.stdout: "entity_id": "0", 2024-09-04T16:27:47.361 INFO:teuthology.orchestra.run.smithi170.stdout: "hostname": "smithi170", 2024-09-04T16:27:47.361 INFO:teuthology.orchestra.run.smithi170.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-04T16:27:47.361 INFO:teuthology.orchestra.run.smithi170.stdout: "pid": "77750", 2024-09-04T16:27:47.361 INFO:teuthology.orchestra.run.smithi170.stdout: "root": "/" 2024-09-04T16:27:47.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:27:47.361 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_count": 0, 2024-09-04T16:27:47.361 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_pinned_count": 0, 2024-09-04T16:27:47.361 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 14614, 2024-09-04T16:27:47.361 INFO:teuthology.orchestra.run.smithi170.stdout: "inst": { 2024-09-04T16:27:47.361 INFO:teuthology.orchestra.run.smithi170.stdout: "name": { 2024-09-04T16:27:47.361 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "client", 2024-09-04T16:27:47.361 INFO:teuthology.orchestra.run.smithi170.stdout: "num": 14614 2024-09-04T16:27:47.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:27:47.362 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2024-09-04T16:27:47.362 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2024-09-04T16:27:47.362 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.1:0", 2024-09-04T16:27:47.362 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 1095769706 2024-09-04T16:27:47.362 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:27:47.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:27:47.362 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2024-09-04T16:27:47.362 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2024-09-04T16:27:47.362 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.1:0", 2024-09-04T16:27:47.362 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 1095769706 2024-09-04T16:27:47.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:27:47.362 INFO:teuthology.orchestra.run.smithi170.stdout: "inst_str": "client.14614 192.168.0.1:0/1095769706", 2024-09-04T16:27:47.363 INFO:teuthology.orchestra.run.smithi170.stdout: "addr_str": "192.168.0.1:0/1095769706", 2024-09-04T16:27:47.363 INFO:teuthology.orchestra.run.smithi170.stdout: "inode_count": 1, 2024-09-04T16:27:47.363 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_epoch": 15, 2024-09-04T16:27:47.363 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch": 45, 2024-09-04T16:27:47.363 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch_barrier": 0, 2024-09-04T16:27:47.363 INFO:teuthology.orchestra.run.smithi170.stdout: "blocklisted": false, 2024-09-04T16:27:47.363 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs" 2024-09-04T16:27:47.363 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:27:47.368 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-04T16:27:47.368 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs ls 2024-09-04T16:27:47.616 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:48.053 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:47 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:48.053 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:47 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:48.053 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:47 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:27:48.053 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:47 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:27:48.054 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:47 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:48.054 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:47 smithi170 ceph-mon[29272]: pgmap v185: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 6.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-04T16:27:48.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.064+0000 7f58ef3ce640 1 -- 172.21.15.170:0/347731039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58e8101930 msgr2=0x7f58e8101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:48.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.064+0000 7f58ef3ce640 1 --2- 172.21.15.170:0/347731039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58e8101930 0x7f58e8101d90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009c20 tx=0x7f58dc02a970 comp rx=0 tx=0).stop 2024-09-04T16:27:48.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.064+0000 7f58ef3ce640 1 -- 172.21.15.170:0/347731039 shutdown_connections 2024-09-04T16:27:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.064+0000 7f58ef3ce640 1 --2- 172.21.15.170:0/347731039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58e8101930 0x7f58e8101d90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.064+0000 7f58ef3ce640 1 --2- 172.21.15.170:0/347731039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58e8107930 0x7f58e8107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.064+0000 7f58ef3ce640 1 -- 172.21.15.170:0/347731039 >> 172.21.15.170:0/347731039 conn(0x7f58e80fd630 msgr2=0x7f58e80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.064+0000 7f58ef3ce640 1 -- 172.21.15.170:0/347731039 shutdown_connections 2024-09-04T16:27:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.064+0000 7f58ef3ce640 1 -- 172.21.15.170:0/347731039 wait complete. 2024-09-04T16:27:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.065+0000 7f58ef3ce640 1 Processor -- start 2024-09-04T16:27:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.065+0000 7f58ef3ce640 1 -- start start 2024-09-04T16:27:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.065+0000 7f58ef3ce640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58e8101930 0x7f58e819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.065+0000 7f58ef3ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58e8107930 0x7f58e819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.065+0000 7f58ef3ce640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f58e810ee00 con 0x7f58e8107930 2024-09-04T16:27:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.065+0000 7f58ef3ce640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f58e810ec80 con 0x7f58e8101930 2024-09-04T16:27:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.065+0000 7f58ec969640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58e8107930 0x7f58e819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.065+0000 7f58ec969640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58e8107930 0x7f58e819dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53674/0 (socket says 172.21.15.170:53674) 2024-09-04T16:27:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.065+0000 7f58ec969640 1 -- 172.21.15.170:0/4209842689 learned_addr learned my addr 172.21.15.170:0/4209842689 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.066+0000 7f58ed16a640 1 --2- 172.21.15.170:0/4209842689 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58e8101930 0x7f58e819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.066+0000 7f58ec969640 1 -- 172.21.15.170:0/4209842689 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58e8101930 msgr2=0x7f58e819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.066+0000 7f58ec969640 1 --2- 172.21.15.170:0/4209842689 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58e8101930 0x7f58e819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.066+0000 7f58ec969640 1 -- 172.21.15.170:0/4209842689 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e8197810 con 0x7f58e8107930 2024-09-04T16:27:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.066+0000 7f58ed16a640 1 --2- 172.21.15.170:0/4209842689 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58e8101930 0x7f58e819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:27:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.066+0000 7f58ec969640 1 --2- 172.21.15.170:0/4209842689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58e8107930 0x7f58e819dbd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f58dc005cc0 tx=0x7f58dc02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.066+0000 7f58e67fc640 1 -- 172.21.15.170:0/4209842689 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58dc047070 con 0x7f58e8107930 2024-09-04T16:27:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.066+0000 7f58ef3ce640 1 -- 172.21.15.170:0/4209842689 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e8197aa0 con 0x7f58e8107930 2024-09-04T16:27:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.066+0000 7f58e67fc640 1 -- 172.21.15.170:0/4209842689 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f58dc02f7e0 con 0x7f58e8107930 2024-09-04T16:27:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.066+0000 7f58e67fc640 1 -- 172.21.15.170:0/4209842689 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58dc034070 con 0x7f58e8107930 2024-09-04T16:27:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.066+0000 7f58ef3ce640 1 -- 172.21.15.170:0/4209842689 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e8197fd0 con 0x7f58e8107930 2024-09-04T16:27:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.067+0000 7f58ef3ce640 1 -- 172.21.15.170:0/4209842689 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e8103070 con 0x7f58e8107930 2024-09-04T16:27:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.068+0000 7f58e67fc640 1 -- 172.21.15.170:0/4209842689 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f58dc04a070 con 0x7f58e8107930 2024-09-04T16:27:48.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.068+0000 7f58e67fc640 1 --2- 172.21.15.170:0/4209842689 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f58d006de30 0x7f58d00702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:48.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.068+0000 7f58e67fc640 1 -- 172.21.15.170:0/4209842689 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f58dc0aeb80 con 0x7f58e8107930 2024-09-04T16:27:48.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.068+0000 7f58ed16a640 1 --2- 172.21.15.170:0/4209842689 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f58d006de30 0x7f58d00702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:48.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.068+0000 7f58ed16a640 1 --2- 172.21.15.170:0/4209842689 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f58d006de30 0x7f58d00702f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f58d8005fd0 tx=0x7f58d8005ea0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:48.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.072+0000 7f58e67fc640 1 -- 172.21.15.170:0/4209842689 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f58dc03f070 con 0x7f58e8107930 2024-09-04T16:27:48.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:47 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:48.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:47 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:48.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:47 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:27:48.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:47 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:27:48.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:47 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:27:48.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:47 smithi193 ceph-mon[36288]: pgmap v185: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 6.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-04T16:27:48.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.273+0000 7f58ef3ce640 1 -- 172.21.15.170:0/4209842689 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f58e8198d40 con 0x7f58e8107930 2024-09-04T16:27:48.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.273+0000 7f58e67fc640 1 -- 172.21.15.170:0/4209842689 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+83 (secure 0 0 0) 0x7f58dc07c7e0 con 0x7f58e8107930 2024-09-04T16:27:48.274 INFO:teuthology.orchestra.run.smithi170.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-04T16:27:48.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.275+0000 7f58ef3ce640 1 -- 172.21.15.170:0/4209842689 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f58d006de30 msgr2=0x7f58d00702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:48.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.275+0000 7f58ef3ce640 1 --2- 172.21.15.170:0/4209842689 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f58d006de30 0x7f58d00702f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f58d8005fd0 tx=0x7f58d8005ea0 comp rx=0 tx=0).stop 2024-09-04T16:27:48.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.276+0000 7f58ef3ce640 1 -- 172.21.15.170:0/4209842689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58e8107930 msgr2=0x7f58e819dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:48.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.276+0000 7f58ef3ce640 1 --2- 172.21.15.170:0/4209842689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58e8107930 0x7f58e819dbd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f58dc005cc0 tx=0x7f58dc02f5f0 comp rx=0 tx=0).stop 2024-09-04T16:27:48.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.276+0000 7f58ef3ce640 1 -- 172.21.15.170:0/4209842689 shutdown_connections 2024-09-04T16:27:48.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.276+0000 7f58ef3ce640 1 --2- 172.21.15.170:0/4209842689 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f58d006de30 0x7f58d00702f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:48.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.276+0000 7f58ef3ce640 1 --2- 172.21.15.170:0/4209842689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58e8107930 0x7f58e819dbd0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:48.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.276+0000 7f58ef3ce640 1 --2- 172.21.15.170:0/4209842689 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58e8101930 0x7f58e819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:48.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.276+0000 7f58ef3ce640 1 -- 172.21.15.170:0/4209842689 >> 172.21.15.170:0/4209842689 conn(0x7f58e80fd630 msgr2=0x7f58e80fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:48.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.276+0000 7f58ef3ce640 1 -- 172.21.15.170:0/4209842689 shutdown_connections 2024-09-04T16:27:48.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:48.276+0000 7f58ef3ce640 1 -- 172.21.15.170:0/4209842689 wait complete. 2024-09-04T16:27:48.944 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-04T16:27:48.944 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-04T16:27:48.944 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi193.front.sepia.ceph.com 2024-09-04T16:27:48.944 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-04T16:27:48.945 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-04T16:27:48.945 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-04T16:27:48.945 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-04T16:27:48.945 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-04T16:27:48.945 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-04T16:27:48.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:48.945 DEBUG:teuthology.orchestra.run.smithi193:> ip addr 2024-09-04T16:27:48.964 INFO:teuthology.orchestra.run.smithi193.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-04T16:27:48.964 INFO:teuthology.orchestra.run.smithi193.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-04T16:27:48.964 INFO:teuthology.orchestra.run.smithi193.stdout: inet 127.0.0.1/8 scope host lo 2024-09-04T16:27:48.964 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-04T16:27:48.964 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 ::1/128 scope host 2024-09-04T16:27:48.964 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-04T16:27:48.964 INFO:teuthology.orchestra.run.smithi193.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-04T16:27:48.965 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:d9:38:b6 brd ff:ff:ff:ff:ff:ff 2024-09-04T16:27:48.965 INFO:teuthology.orchestra.run.smithi193.stdout: altname enp7s0f0 2024-09-04T16:27:48.965 INFO:teuthology.orchestra.run.smithi193.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-04T16:27:48.965 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:d9:38:b7 brd ff:ff:ff:ff:ff:ff 2024-09-04T16:27:48.965 INFO:teuthology.orchestra.run.smithi193.stdout: altname enp7s0f1 2024-09-04T16:27:48.965 INFO:teuthology.orchestra.run.smithi193.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-04T16:27:48.965 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:88:72:52 brd ff:ff:ff:ff:ff:ff 2024-09-04T16:27:48.965 INFO:teuthology.orchestra.run.smithi193.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-04T16:27:48.965 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:88:72:53 brd ff:ff:ff:ff:ff:ff 2024-09-04T16:27:48.965 INFO:teuthology.orchestra.run.smithi193.stdout: inet 172.21.15.193/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-04T16:27:48.965 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft 42315sec preferred_lft 42315sec 2024-09-04T16:27:48.965 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 fe80::ec4:7aff:fe88:7253/64 scope link noprefixroute 2024-09-04T16:27:48.965 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-04T16:27:48.966 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-04T16:27:48.966 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-04T16:27:48.966 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-09-04T16:27:48.966 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link add name ceph-brx type bridge 2024-09-04T16:27:48.966 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip addr flush dev ceph-brx 2024-09-04T16:27:48.966 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link set ceph-brx up 2024-09-04T16:27:48.966 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-04T16:27:48.966 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-09-04T16:27:49.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:27:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-04T16:27:49.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:48 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/4209842689' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-04T16:27:49.115 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:48 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/4209842689' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-04T16:27:49.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:27:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-04T16:27:49.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:49.169 DEBUG:teuthology.orchestra.run.smithi193:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-04T16:27:49.195 INFO:teuthology.orchestra.run.smithi193.stdout:1 2024-09-04T16:27:49.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:49.196 DEBUG:teuthology.orchestra.run.smithi193:> route 2024-09-04T16:27:49.262 INFO:teuthology.orchestra.run.smithi193.stdout:Kernel IP routing table 2024-09-04T16:27:49.262 INFO:teuthology.orchestra.run.smithi193.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-04T16:27:49.262 INFO:teuthology.orchestra.run.smithi193.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-04T16:27:49.263 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-04T16:27:49.263 INFO:teuthology.orchestra.run.smithi193.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-04T16:27:49.263 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-04T16:27:49.263 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-09-04T16:27:49.263 DEBUG:teuthology.orchestra.run.smithi193:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-04T16:27:49.263 DEBUG:teuthology.orchestra.run.smithi193:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-04T16:27:49.263 DEBUG:teuthology.orchestra.run.smithi193:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-04T16:27:49.263 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-09-04T16:27:49.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:27:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-04T16:27:49.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:27:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-04T16:27:49.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:49.531 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list 2024-09-04T16:27:49.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:49.547 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list-id 2024-09-04T16:27:49.603 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-04T16:27:49.603 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-09-04T16:27:49.603 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-04T16:27:49.603 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-04T16:27:49.603 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-09-04T16:27:49.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:27:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-04T16:27:49.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:27:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-04T16:27:49.720 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-04T16:27:49.721 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-04T16:27:49.721 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-09-04T16:27:49.721 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-04T16:27:49.721 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-04T16:27:49.721 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-04T16:27:49.721 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-04T16:27:49.721 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-04T16:27:49.721 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-09-04T16:27:49.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:27:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-04T16:27:49.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:27:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-04T16:27:49.848 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-04T16:27:49.848 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-09-04T16:27:49.848 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link set brx.0 up 2024-09-04T16:27:49.848 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link set dev brx.0 master ceph-brx 2024-09-04T16:27:49.849 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-09-04T16:27:49.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:27:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-04T16:27:49.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:27:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-04T16:27:49.926 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-04T16:27:49.926 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-04T16:27:49.926 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-04T16:27:49.941 INFO:teuthology.orchestra.run.smithi193.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-04T16:27:49.941 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-04T16:27:49.941 DEBUG:teuthology.orchestra.run.smithi193:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-04T16:27:49.996 DEBUG:teuthology.orchestra.run.smithi193:> sudo modprobe fuse 2024-09-04T16:27:50.057 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:49 smithi193 ceph-mon[36288]: pgmap v186: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 5.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-04T16:27:50.061 DEBUG:teuthology.orchestra.run.smithi193:> cat /proc/self/mounts | awk '{print $2}' 2024-09-04T16:27:50.117 INFO:teuthology.orchestra.run.smithi193.stdout:/proc 2024-09-04T16:27:50.117 INFO:teuthology.orchestra.run.smithi193.stdout:/sys 2024-09-04T16:27:50.117 INFO:teuthology.orchestra.run.smithi193.stdout:/dev 2024-09-04T16:27:50.117 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/kernel/security 2024-09-04T16:27:50.117 INFO:teuthology.orchestra.run.smithi193.stdout:/dev/shm 2024-09-04T16:27:50.118 INFO:teuthology.orchestra.run.smithi193.stdout:/dev/pts 2024-09-04T16:27:50.118 INFO:teuthology.orchestra.run.smithi193.stdout:/run 2024-09-04T16:27:50.118 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/fs/cgroup 2024-09-04T16:27:50.118 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/fs/pstore 2024-09-04T16:27:50.118 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/fs/bpf 2024-09-04T16:27:50.118 INFO:teuthology.orchestra.run.smithi193.stdout:/ 2024-09-04T16:27:50.118 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/fs/selinux 2024-09-04T16:27:50.118 INFO:teuthology.orchestra.run.smithi193.stdout:/proc/sys/fs/binfmt_misc 2024-09-04T16:27:50.118 INFO:teuthology.orchestra.run.smithi193.stdout:/dev/hugepages 2024-09-04T16:27:50.118 INFO:teuthology.orchestra.run.smithi193.stdout:/dev/mqueue 2024-09-04T16:27:50.118 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/kernel/debug 2024-09-04T16:27:50.118 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/kernel/tracing 2024-09-04T16:27:50.118 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/kernel/config 2024-09-04T16:27:50.118 INFO:teuthology.orchestra.run.smithi193.stdout:/run/credentials/systemd-sysusers.service 2024-09-04T16:27:50.119 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/fs/fuse/connections 2024-09-04T16:27:50.119 INFO:teuthology.orchestra.run.smithi193.stdout:/run/credentials/systemd-sysctl.service 2024-09-04T16:27:50.119 INFO:teuthology.orchestra.run.smithi193.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-04T16:27:50.119 INFO:teuthology.orchestra.run.smithi193.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-04T16:27:50.119 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/nfs/rpc_pipefs 2024-09-04T16:27:50.119 INFO:teuthology.orchestra.run.smithi193.stdout:/run/user/1000 2024-09-04T16:27:50.119 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/ceph 2024-09-04T16:27:50.119 INFO:teuthology.orchestra.run.smithi193.stdout:/run/user/0 2024-09-04T16:27:50.119 INFO:teuthology.orchestra.run.smithi193.stdout:/proc/sys/fs/binfmt_misc 2024-09-04T16:27:50.119 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay 2024-09-04T16:27:50.119 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/7e1450f9264d01de6315ade79c2c4f636bf7aac9aa8eea0c95cd74f92ee5e34c/merged 2024-09-04T16:27:50.119 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/badc021f0123f1780712153c4ff023b60006011e64e5924c5190f02c3f9c7d49/merged 2024-09-04T16:27:50.119 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/95a9b60931da5fba59e3d682dee91e4bd018084d6c0bb5a0c8dc8914a8dda84d/merged 2024-09-04T16:27:50.120 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/94c58d1071795cbff24e4b0baa2fa7576a90b6c80072783675422c1a58d93267/merged 2024-09-04T16:27:50.120 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/a49e163543e4a2611c8017453809799c06e45d226f7ce3632d6c74856fdd97cf/merged 2024-09-04T16:27:50.120 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/24dd9c8c09b4ec44b407da7e1c1f61bff298bc77bdaebb71e151a88e11ec2691/merged 2024-09-04T16:27:50.120 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/59bdc511b8970ff3942ff2d45c0d51098bf76204ce93c9f33bed3d1c8ca5ecb0/merged 2024-09-04T16:27:50.120 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/f76bacd958cd2bd9bee29c83bc8dad6ebfda52a62295189be71c3d59a24bedbc/merged 2024-09-04T16:27:50.120 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/198a79e71e3f8b932c7b4259b477bf9fa641ef2d2effc5087068ed171e3b71e3/merged 2024-09-04T16:27:50.120 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/1881c3ae33cd1b398d5c0a091523a8d730bbef98d8045aa25b232ce2fa7794d3/merged 2024-09-04T16:27:50.120 INFO:teuthology.orchestra.run.smithi193.stdout:/run/netns 2024-09-04T16:27:50.120 INFO:teuthology.orchestra.run.smithi193.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-04T16:27:50.120 INFO:teuthology.orchestra.run.smithi193.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-04T16:27:50.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:50.121 DEBUG:teuthology.orchestra.run.smithi193:> ls /sys/fs/fuse/connections 2024-09-04T16:27:50.172 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-04T16:27:50.172 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-04T16:27:50.215 DEBUG:teuthology.orchestra.run.smithi193:> sudo modprobe fuse 2024-09-04T16:27:50.239 DEBUG:teuthology.orchestra.run.smithi193:> cat /proc/self/mounts | awk '{print $2}' 2024-09-04T16:27:50.295 INFO:teuthology.orchestra.run.smithi193.stdout:/proc 2024-09-04T16:27:50.295 INFO:teuthology.orchestra.run.smithi193.stdout:/sys 2024-09-04T16:27:50.295 INFO:teuthology.orchestra.run.smithi193.stdout:/dev 2024-09-04T16:27:50.295 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/kernel/security 2024-09-04T16:27:50.295 INFO:teuthology.orchestra.run.smithi193.stdout:/dev/shm 2024-09-04T16:27:50.295 INFO:teuthology.orchestra.run.smithi193.stdout:/dev/pts 2024-09-04T16:27:50.295 INFO:teuthology.orchestra.run.smithi193.stdout:/run 2024-09-04T16:27:50.296 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/fs/cgroup 2024-09-04T16:27:50.296 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/fs/pstore 2024-09-04T16:27:50.296 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/fs/bpf 2024-09-04T16:27:50.296 INFO:teuthology.orchestra.run.smithi193.stdout:/ 2024-09-04T16:27:50.296 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/fs/selinux 2024-09-04T16:27:50.296 INFO:teuthology.orchestra.run.smithi193.stdout:/proc/sys/fs/binfmt_misc 2024-09-04T16:27:50.296 INFO:teuthology.orchestra.run.smithi193.stdout:/dev/hugepages 2024-09-04T16:27:50.296 INFO:teuthology.orchestra.run.smithi193.stdout:/dev/mqueue 2024-09-04T16:27:50.296 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/kernel/debug 2024-09-04T16:27:50.296 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/kernel/tracing 2024-09-04T16:27:50.296 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/kernel/config 2024-09-04T16:27:50.296 INFO:teuthology.orchestra.run.smithi193.stdout:/run/credentials/systemd-sysusers.service 2024-09-04T16:27:50.296 INFO:teuthology.orchestra.run.smithi193.stdout:/sys/fs/fuse/connections 2024-09-04T16:27:50.297 INFO:teuthology.orchestra.run.smithi193.stdout:/run/credentials/systemd-sysctl.service 2024-09-04T16:27:50.297 INFO:teuthology.orchestra.run.smithi193.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-04T16:27:50.297 INFO:teuthology.orchestra.run.smithi193.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-04T16:27:50.297 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/nfs/rpc_pipefs 2024-09-04T16:27:50.297 INFO:teuthology.orchestra.run.smithi193.stdout:/run/user/1000 2024-09-04T16:27:50.297 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/ceph 2024-09-04T16:27:50.297 INFO:teuthology.orchestra.run.smithi193.stdout:/run/user/0 2024-09-04T16:27:50.297 INFO:teuthology.orchestra.run.smithi193.stdout:/proc/sys/fs/binfmt_misc 2024-09-04T16:27:50.297 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay 2024-09-04T16:27:50.297 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/7e1450f9264d01de6315ade79c2c4f636bf7aac9aa8eea0c95cd74f92ee5e34c/merged 2024-09-04T16:27:50.297 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/badc021f0123f1780712153c4ff023b60006011e64e5924c5190f02c3f9c7d49/merged 2024-09-04T16:27:50.297 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/95a9b60931da5fba59e3d682dee91e4bd018084d6c0bb5a0c8dc8914a8dda84d/merged 2024-09-04T16:27:50.297 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/94c58d1071795cbff24e4b0baa2fa7576a90b6c80072783675422c1a58d93267/merged 2024-09-04T16:27:50.298 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/a49e163543e4a2611c8017453809799c06e45d226f7ce3632d6c74856fdd97cf/merged 2024-09-04T16:27:50.298 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/24dd9c8c09b4ec44b407da7e1c1f61bff298bc77bdaebb71e151a88e11ec2691/merged 2024-09-04T16:27:50.298 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/59bdc511b8970ff3942ff2d45c0d51098bf76204ce93c9f33bed3d1c8ca5ecb0/merged 2024-09-04T16:27:50.298 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/f76bacd958cd2bd9bee29c83bc8dad6ebfda52a62295189be71c3d59a24bedbc/merged 2024-09-04T16:27:50.298 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/198a79e71e3f8b932c7b4259b477bf9fa641ef2d2effc5087068ed171e3b71e3/merged 2024-09-04T16:27:50.298 INFO:teuthology.orchestra.run.smithi193.stdout:/var/lib/containers/storage/overlay/1881c3ae33cd1b398d5c0a091523a8d730bbef98d8045aa25b232ce2fa7794d3/merged 2024-09-04T16:27:50.298 INFO:teuthology.orchestra.run.smithi193.stdout:/run/netns 2024-09-04T16:27:50.298 INFO:teuthology.orchestra.run.smithi193.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-04T16:27:50.298 INFO:teuthology.orchestra.run.smithi193.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-04T16:27:50.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:50.299 DEBUG:teuthology.orchestra.run.smithi193:> ls /sys/fs/fuse/connections 2024-09-04T16:27:50.315 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi193.stderr:2024-09-04T16:27:50.314+0000 7fda4d50f480 -1 init, newargv = 0x556acd9ae110 newargc=15 2024-09-04T16:27:50.315 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi193.stderr:ceph-fuse[61606]: starting ceph client 2024-09-04T16:27:50.322 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi193.stderr:ceph-fuse[61606]: starting fuse 2024-09-04T16:27:50.330 INFO:teuthology.orchestra.run.smithi193.stdout:130 2024-09-04T16:27:50.331 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [130] 2024-09-04T16:27:50.331 DEBUG:teuthology.orchestra.run.smithi193:> sudo stdin-killer -- python3 -c ' 2024-09-04T16:27:50.331 DEBUG:teuthology.orchestra.run.smithi193:> import glob 2024-09-04T16:27:50.331 DEBUG:teuthology.orchestra.run.smithi193:> import re 2024-09-04T16:27:50.331 DEBUG:teuthology.orchestra.run.smithi193:> import os 2024-09-04T16:27:50.331 DEBUG:teuthology.orchestra.run.smithi193:> import subprocess 2024-09-04T16:27:50.331 DEBUG:teuthology.orchestra.run.smithi193:> 2024-09-04T16:27:50.331 DEBUG:teuthology.orchestra.run.smithi193:> def _find_admin_socket(client_name): 2024-09-04T16:27:50.331 DEBUG:teuthology.orchestra.run.smithi193:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-04T16:27:50.331 DEBUG:teuthology.orchestra.run.smithi193:> files = glob.glob(asok_path) 2024-09-04T16:27:50.331 DEBUG:teuthology.orchestra.run.smithi193:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-04T16:27:50.332 DEBUG:teuthology.orchestra.run.smithi193:> 2024-09-04T16:27:50.332 DEBUG:teuthology.orchestra.run.smithi193:> # Given a non-glob path, it better be there 2024-09-04T16:27:50.332 DEBUG:teuthology.orchestra.run.smithi193:> if "*" not in asok_path: 2024-09-04T16:27:50.332 DEBUG:teuthology.orchestra.run.smithi193:> assert(len(files) == 1) 2024-09-04T16:27:50.332 DEBUG:teuthology.orchestra.run.smithi193:> return files[0] 2024-09-04T16:27:50.332 DEBUG:teuthology.orchestra.run.smithi193:> 2024-09-04T16:27:50.332 DEBUG:teuthology.orchestra.run.smithi193:> for f in files: 2024-09-04T16:27:50.332 DEBUG:teuthology.orchestra.run.smithi193:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-04T16:27:50.332 DEBUG:teuthology.orchestra.run.smithi193:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-04T16:27:50.332 DEBUG:teuthology.orchestra.run.smithi193:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-04T16:27:50.332 DEBUG:teuthology.orchestra.run.smithi193:> contents = proc_f.read() 2024-09-04T16:27:50.332 DEBUG:teuthology.orchestra.run.smithi193:> if mountpoint in contents: 2024-09-04T16:27:50.332 DEBUG:teuthology.orchestra.run.smithi193:> return f 2024-09-04T16:27:50.332 DEBUG:teuthology.orchestra.run.smithi193:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-04T16:27:50.333 DEBUG:teuthology.orchestra.run.smithi193:> 2024-09-04T16:27:50.333 DEBUG:teuthology.orchestra.run.smithi193:> print(_find_admin_socket("client.1")) 2024-09-04T16:27:50.333 DEBUG:teuthology.orchestra.run.smithi193:> ' 2024-09-04T16:27:50.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:49 smithi170 ceph-mon[29272]: pgmap v186: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 5.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-04T16:27:50.449 INFO:teuthology.orchestra.run.smithi193.stdout:/var/run/ceph/ceph-client.1.61606.asok 2024-09-04T16:27:50.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-04T16:27:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-04T16:27:50.459 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61606.asok 2024-09-04T16:27:50.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:50.460 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61606.asok status 2024-09-04T16:27:50.592 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-09-04T16:27:50.592 INFO:teuthology.orchestra.run.smithi193.stdout: "metadata": { 2024-09-04T16:27:50.593 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_sha1": "48920dabc954a29bdb7dd91079363a020369bbff", 2024-09-04T16:27:50.593 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_version": "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)", 2024-09-04T16:27:50.593 INFO:teuthology.orchestra.run.smithi193.stdout: "entity_id": "1", 2024-09-04T16:27:50.593 INFO:teuthology.orchestra.run.smithi193.stdout: "hostname": "smithi193", 2024-09-04T16:27:50.593 INFO:teuthology.orchestra.run.smithi193.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-04T16:27:50.593 INFO:teuthology.orchestra.run.smithi193.stdout: "pid": "61606", 2024-09-04T16:27:50.593 INFO:teuthology.orchestra.run.smithi193.stdout: "root": "/" 2024-09-04T16:27:50.593 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-04T16:27:50.593 INFO:teuthology.orchestra.run.smithi193.stdout: "dentry_count": 0, 2024-09-04T16:27:50.593 INFO:teuthology.orchestra.run.smithi193.stdout: "dentry_pinned_count": 0, 2024-09-04T16:27:50.593 INFO:teuthology.orchestra.run.smithi193.stdout: "id": 24339, 2024-09-04T16:27:50.594 INFO:teuthology.orchestra.run.smithi193.stdout: "inst": { 2024-09-04T16:27:50.594 INFO:teuthology.orchestra.run.smithi193.stdout: "name": { 2024-09-04T16:27:50.594 INFO:teuthology.orchestra.run.smithi193.stdout: "type": "client", 2024-09-04T16:27:50.594 INFO:teuthology.orchestra.run.smithi193.stdout: "num": 24339 2024-09-04T16:27:50.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-04T16:27:50.594 INFO:teuthology.orchestra.run.smithi193.stdout: "addr": { 2024-09-04T16:27:50.594 INFO:teuthology.orchestra.run.smithi193.stdout: "type": "v1", 2024-09-04T16:27:50.594 INFO:teuthology.orchestra.run.smithi193.stdout: "addr": "192.168.0.1:0", 2024-09-04T16:27:50.594 INFO:teuthology.orchestra.run.smithi193.stdout: "nonce": 3752787761 2024-09-04T16:27:50.594 INFO:teuthology.orchestra.run.smithi193.stdout: } 2024-09-04T16:27:50.594 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-04T16:27:50.594 INFO:teuthology.orchestra.run.smithi193.stdout: "addr": { 2024-09-04T16:27:50.594 INFO:teuthology.orchestra.run.smithi193.stdout: "type": "v1", 2024-09-04T16:27:50.595 INFO:teuthology.orchestra.run.smithi193.stdout: "addr": "192.168.0.1:0", 2024-09-04T16:27:50.595 INFO:teuthology.orchestra.run.smithi193.stdout: "nonce": 3752787761 2024-09-04T16:27:50.595 INFO:teuthology.orchestra.run.smithi193.stdout: }, 2024-09-04T16:27:50.595 INFO:teuthology.orchestra.run.smithi193.stdout: "inst_str": "client.24339 192.168.0.1:0/3752787761", 2024-09-04T16:27:50.595 INFO:teuthology.orchestra.run.smithi193.stdout: "addr_str": "192.168.0.1:0/3752787761", 2024-09-04T16:27:50.595 INFO:teuthology.orchestra.run.smithi193.stdout: "inode_count": 1, 2024-09-04T16:27:50.595 INFO:teuthology.orchestra.run.smithi193.stdout: "mds_epoch": 15, 2024-09-04T16:27:50.595 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_epoch": 45, 2024-09-04T16:27:50.595 INFO:teuthology.orchestra.run.smithi193.stdout: "osd_epoch_barrier": 0, 2024-09-04T16:27:50.595 INFO:teuthology.orchestra.run.smithi193.stdout: "blocklisted": false, 2024-09-04T16:27:50.595 INFO:teuthology.orchestra.run.smithi193.stdout: "fs_name": "cephfs" 2024-09-04T16:27:50.595 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-09-04T16:27:50.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:50.601 DEBUG:teuthology.orchestra.run.smithi170:> stat --file-system '--printf=%T 2024-09-04T16:27:50.601 DEBUG:teuthology.orchestra.run.smithi170:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-04T16:27:50.622 INFO:teuthology.orchestra.run.smithi170.stdout:fuseblk 2024-09-04T16:27:50.622 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-04T16:27:50.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:50.622 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-04T16:27:50.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:50.698 DEBUG:teuthology.orchestra.run.smithi193:> stat --file-system '--printf=%T 2024-09-04T16:27:50.698 DEBUG:teuthology.orchestra.run.smithi193:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-04T16:27:50.714 INFO:teuthology.orchestra.run.smithi193.stdout:fuseblk 2024-09-04T16:27:50.714 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-04T16:27:50.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:27:50.714 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-04T16:27:52.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:52 smithi170 ceph-mon[29272]: pgmap v187: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 5.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-04T16:27:52.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:52 smithi193 ceph-mon[36288]: pgmap v187: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 5.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-04T16:27:54.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:54 smithi170 ceph-mon[29272]: pgmap v188: 65 pgs: 65 active+clean; 582 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 5.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-04T16:27:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:54 smithi193 ceph-mon[36288]: pgmap v188: 65 pgs: 65 active+clean; 582 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 5.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-04T16:27:55.191 INFO:teuthology.run_tasks:Running task print... 2024-09-04T16:27:55.202 INFO:teuthology.task.print:**** done client 2024-09-04T16:27:55.202 INFO:teuthology.run_tasks:Running task parallel... 2024-09-04T16:27:55.256 INFO:teuthology.task.parallel:starting parallel... 2024-09-04T16:27:55.256 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-04T16:27:55.257 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-04T16:27:55.258 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi170.front.sepia.ceph.com 2024-09-04T16:27:55.259 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-04T16:27:55.260 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-04T16:27:55.260 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-04T16:27:55.265 INFO:tasks.workunit:Pulling workunits from ref f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:27:55.265 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-04T16:27:55.265 INFO:tasks.workunit:timeout=3h 2024-09-04T16:27:55.265 INFO:tasks.workunit:cleanup=True 2024-09-04T16:27:55.266 DEBUG:teuthology.orchestra.run.smithi170:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-04T16:27:55.286 INFO:teuthology.orchestra.run.smithi170.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-04T16:27:55.286 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-04T16:27:55.286 INFO:teuthology.orchestra.run.smithi170.stdout:Device: a6h/166d Inode: 1 Links: 2 2024-09-04T16:27:55.286 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-04T16:27:55.286 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-04T16:27:55.287 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-04T16:27:55.287 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-04 16:27:25.471956576 +0000 2024-09-04T16:27:55.287 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-04 16:27:50.694937629 +0000 2024-09-04T16:27:55.287 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: - 2024-09-04T16:27:55.287 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-04T16:27:55.287 DEBUG:teuthology.orchestra.run.smithi170:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-04T16:27:55.358 DEBUG:teuthology.orchestra.run.smithi193:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-04T16:27:55.377 INFO:teuthology.orchestra.run.smithi193.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-04T16:27:55.377 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-04T16:27:55.377 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 82h/130d Inode: 1 Links: 3 2024-09-04T16:27:55.377 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-04T16:27:55.377 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-04T16:27:55.377 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-04T16:27:55.377 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-04 16:27:55.353319281 +0000 2024-09-04T16:27:55.378 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-04 16:27:55.353319281 +0000 2024-09-04T16:27:55.378 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: - 2024-09-04T16:27:55.378 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-04T16:27:55.378 DEBUG:teuthology.orchestra.run.smithi193:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-04T16:27:55.450 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:27:55.451 DEBUG:teuthology.orchestra.run.smithi193:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:27:55.467 INFO:tasks.workunit.client.0.smithi170.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-04T16:27:55.507 INFO:tasks.workunit.client.1.smithi193.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-04T16:27:55.533 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:56.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.012+0000 7f6450eb2640 1 -- 172.21.15.170:0/3490290111 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f644c104da0 msgr2=0x7f644c107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:56.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.012+0000 7f6450eb2640 1 --2- 172.21.15.170:0/3490290111 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f644c104da0 0x7f644c107190 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6440009880 tx=0x7f644002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:56.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.012+0000 7f6450eb2640 1 -- 172.21.15.170:0/3490290111 shutdown_connections 2024-09-04T16:27:56.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.012+0000 7f6450eb2640 1 --2- 172.21.15.170:0/3490290111 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f644c104da0 0x7f644c107190 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:56.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.012+0000 7f6450eb2640 1 --2- 172.21.15.170:0/3490290111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f644c102470 0x7f644c104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:56.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.012+0000 7f6450eb2640 1 -- 172.21.15.170:0/3490290111 >> 172.21.15.170:0/3490290111 conn(0x7f644c0fc010 msgr2=0x7f644c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:56.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.012+0000 7f6450eb2640 1 -- 172.21.15.170:0/3490290111 shutdown_connections 2024-09-04T16:27:56.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.012+0000 7f6450eb2640 1 -- 172.21.15.170:0/3490290111 wait complete. 2024-09-04T16:27:56.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.013+0000 7f6450eb2640 1 Processor -- start 2024-09-04T16:27:56.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.013+0000 7f6450eb2640 1 -- start start 2024-09-04T16:27:56.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.013+0000 7f6450eb2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f644c102470 0x7f644c197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:56.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.013+0000 7f6450eb2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f644c104da0 0x7f644c1979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:56.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.013+0000 7f6450eb2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f644c10a740 con 0x7f644c104da0 2024-09-04T16:27:56.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.013+0000 7f6450eb2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f644c10a5c0 con 0x7f644c102470 2024-09-04T16:27:56.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.013+0000 7f6449d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f644c104da0 0x7f644c1979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:56.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.013+0000 7f6449d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f644c104da0 0x7f644c1979a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57058/0 (socket says 172.21.15.170:57058) 2024-09-04T16:27:56.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.013+0000 7f6449d9b640 1 -- 172.21.15.170:0/3884861103 learned_addr learned my addr 172.21.15.170:0/3884861103 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:56.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.013+0000 7f644a59c640 1 --2- 172.21.15.170:0/3884861103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f644c102470 0x7f644c197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:56.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.014+0000 7f6449d9b640 1 -- 172.21.15.170:0/3884861103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f644c102470 msgr2=0x7f644c197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:56.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.014+0000 7f6449d9b640 1 --2- 172.21.15.170:0/3884861103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f644c102470 0x7f644c197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:56.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.014+0000 7f6449d9b640 1 -- 172.21.15.170:0/3884861103 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c198020 con 0x7f644c104da0 2024-09-04T16:27:56.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.014+0000 7f6449d9b640 1 --2- 172.21.15.170:0/3884861103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f644c104da0 0x7f644c1979a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6440006010 tx=0x7f64400045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:56.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.014+0000 7f643b7fe640 1 -- 172.21.15.170:0/3884861103 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f644003f070 con 0x7f644c104da0 2024-09-04T16:27:56.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.014+0000 7f643b7fe640 1 -- 172.21.15.170:0/3884861103 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6440004a50 con 0x7f644c104da0 2024-09-04T16:27:56.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.014+0000 7f6450eb2640 1 -- 172.21.15.170:0/3884861103 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c19ca60 con 0x7f644c104da0 2024-09-04T16:27:56.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.014+0000 7f643b7fe640 1 -- 172.21.15.170:0/3884861103 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6440035030 con 0x7f644c104da0 2024-09-04T16:27:56.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.014+0000 7f6450eb2640 1 -- 172.21.15.170:0/3884861103 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c19cff0 con 0x7f644c104da0 2024-09-04T16:27:56.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.015+0000 7f6450eb2640 1 -- 172.21.15.170:0/3884861103 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644c102850 con 0x7f644c104da0 2024-09-04T16:27:56.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.015+0000 7f643b7fe640 1 -- 172.21.15.170:0/3884861103 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f6440042070 con 0x7f644c104da0 2024-09-04T16:27:56.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.016+0000 7f643b7fe640 1 --2- 172.21.15.170:0/3884861103 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f643406de30 0x7f64340702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:56.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.016+0000 7f643b7fe640 1 -- 172.21.15.170:0/3884861103 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f64400ae6b0 con 0x7f644c104da0 2024-09-04T16:27:56.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.016+0000 7f644a59c640 1 --2- 172.21.15.170:0/3884861103 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f643406de30 0x7f64340702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:56.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.016+0000 7f644a59c640 1 --2- 172.21.15.170:0/3884861103 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f643406de30 0x7f64340702f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f643c00bbe0 tx=0x7f643c00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:56.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.020+0000 7f643b7fe640 1 -- 172.21.15.170:0/3884861103 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6440004c00 con 0x7f644c104da0 2024-09-04T16:27:56.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.187+0000 7f6450eb2640 1 -- 172.21.15.170:0/3884861103 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7f644c19d860 con 0x7f644c104da0 2024-09-04T16:27:56.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.187+0000 7f643b7fe640 1 -- 172.21.15.170:0/3884861103 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v43)=0 v43) ==== 155+0+0 (secure 0 0 0) 0x7f644007fea0 con 0x7f644c104da0 2024-09-04T16:27:56.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.189+0000 7f6450eb2640 1 -- 172.21.15.170:0/3884861103 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f643406de30 msgr2=0x7f64340702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:56.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.189+0000 7f6450eb2640 1 --2- 172.21.15.170:0/3884861103 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f643406de30 0x7f64340702f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f643c00bbe0 tx=0x7f643c00b390 comp rx=0 tx=0).stop 2024-09-04T16:27:56.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.189+0000 7f6450eb2640 1 -- 172.21.15.170:0/3884861103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f644c104da0 msgr2=0x7f644c1979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:56.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.189+0000 7f6450eb2640 1 --2- 172.21.15.170:0/3884861103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f644c104da0 0x7f644c1979a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6440006010 tx=0x7f64400045e0 comp rx=0 tx=0).stop 2024-09-04T16:27:56.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.190+0000 7f6450eb2640 1 -- 172.21.15.170:0/3884861103 shutdown_connections 2024-09-04T16:27:56.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.190+0000 7f6450eb2640 1 --2- 172.21.15.170:0/3884861103 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f643406de30 0x7f64340702f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:56.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.190+0000 7f6450eb2640 1 --2- 172.21.15.170:0/3884861103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f644c104da0 0x7f644c1979a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:56.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.190+0000 7f6450eb2640 1 --2- 172.21.15.170:0/3884861103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f644c102470 0x7f644c197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:56.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.190+0000 7f6450eb2640 1 -- 172.21.15.170:0/3884861103 >> 172.21.15.170:0/3884861103 conn(0x7f644c0fc010 msgr2=0x7f644c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:56.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.190+0000 7f6450eb2640 1 -- 172.21.15.170:0/3884861103 shutdown_connections 2024-09-04T16:27:56.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:56.190+0000 7f6450eb2640 1 -- 172.21.15.170:0/3884861103 wait complete. 2024-09-04T16:27:56.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:56 smithi170 ceph-mon[29272]: pgmap v189: 65 pgs: 65 active+clean; 582 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-04T16:27:56.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:56 smithi193 ceph-mon[36288]: pgmap v189: 65 pgs: 65 active+clean; 582 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-04T16:27:56.852 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-04T16:27:57.161 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:57.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.594+0000 7f3a1f27a640 1 -- 172.21.15.170:0/4040793099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a18102b90 msgr2=0x7f3a18103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:57.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.594+0000 7f3a1f27a640 1 --2- 172.21.15.170:0/4040793099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a18102b90 0x7f3a18103010 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3a08009880 tx=0x7f3a0802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:57.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.594+0000 7f3a1f27a640 1 -- 172.21.15.170:0/4040793099 shutdown_connections 2024-09-04T16:27:57.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.594+0000 7f3a1f27a640 1 --2- 172.21.15.170:0/4040793099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a18102b90 0x7f3a18103010 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:57.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.594+0000 7f3a1f27a640 1 --2- 172.21.15.170:0/4040793099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a18101990 0x7f3a18101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:57.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.594+0000 7f3a1f27a640 1 -- 172.21.15.170:0/4040793099 >> 172.21.15.170:0/4040793099 conn(0x7f3a180fd140 msgr2=0x7f3a180ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:57.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.594+0000 7f3a1f27a640 1 -- 172.21.15.170:0/4040793099 shutdown_connections 2024-09-04T16:27:57.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.594+0000 7f3a1f27a640 1 -- 172.21.15.170:0/4040793099 wait complete. 2024-09-04T16:27:57.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.594+0000 7f3a1f27a640 1 Processor -- start 2024-09-04T16:27:57.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.594+0000 7f3a1f27a640 1 -- start start 2024-09-04T16:27:57.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.594+0000 7f3a1f27a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a18101990 0x7f3a18197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:57.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.594+0000 7f3a1f27a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a18102b90 0x7f3a18197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:57.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.594+0000 7f3a1f27a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1810a850 con 0x7f3a18102b90 2024-09-04T16:27:57.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.594+0000 7f3a1f27a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1810a6d0 con 0x7f3a18101990 2024-09-04T16:27:57.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.595+0000 7f3a1c815640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a18102b90 0x7f3a18197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:57.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.595+0000 7f3a1c815640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a18102b90 0x7f3a18197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57078/0 (socket says 172.21.15.170:57078) 2024-09-04T16:27:57.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.595+0000 7f3a1c815640 1 -- 172.21.15.170:0/3158820693 learned_addr learned my addr 172.21.15.170:0/3158820693 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:57.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.595+0000 7f3a1d016640 1 --2- 172.21.15.170:0/3158820693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a18101990 0x7f3a18197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:57.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.595+0000 7f3a1c815640 1 -- 172.21.15.170:0/3158820693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a18101990 msgr2=0x7f3a18197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:57.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.595+0000 7f3a1c815640 1 --2- 172.21.15.170:0/3158820693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a18101990 0x7f3a18197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:57.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.595+0000 7f3a1c815640 1 -- 172.21.15.170:0/3158820693 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a18198100 con 0x7f3a18102b90 2024-09-04T16:27:57.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.595+0000 7f3a1d016640 1 --2- 172.21.15.170:0/3158820693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a18101990 0x7f3a18197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:27:57.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.595+0000 7f3a1c815640 1 --2- 172.21.15.170:0/3158820693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a18102b90 0x7f3a18197a80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3a08006010 tx=0x7f3a080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:57.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.595+0000 7f3a0e7fc640 1 -- 172.21.15.170:0/3158820693 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a0803f070 con 0x7f3a18102b90 2024-09-04T16:27:57.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.595+0000 7f3a1f27a640 1 -- 172.21.15.170:0/3158820693 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a1819cae0 con 0x7f3a18102b90 2024-09-04T16:27:57.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.595+0000 7f3a0e7fc640 1 -- 172.21.15.170:0/3158820693 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a080044d0 con 0x7f3a18102b90 2024-09-04T16:27:57.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.595+0000 7f3a0e7fc640 1 -- 172.21.15.170:0/3158820693 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a08035030 con 0x7f3a18102b90 2024-09-04T16:27:57.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.595+0000 7f3a1f27a640 1 -- 172.21.15.170:0/3158820693 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a1819d0f0 con 0x7f3a18102b90 2024-09-04T16:27:57.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.596+0000 7f3a1f27a640 1 -- 172.21.15.170:0/3158820693 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a18101d70 con 0x7f3a18102b90 2024-09-04T16:27:57.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.597+0000 7f3a0e7fc640 1 -- 172.21.15.170:0/3158820693 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f3a08042070 con 0x7f3a18102b90 2024-09-04T16:27:57.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.597+0000 7f3a0e7fc640 1 --2- 172.21.15.170:0/3158820693 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f3a0406de30 0x7f3a040702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:57.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.597+0000 7f3a0e7fc640 1 -- 172.21.15.170:0/3158820693 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f3a080ae990 con 0x7f3a18102b90 2024-09-04T16:27:57.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.597+0000 7f3a1d016640 1 --2- 172.21.15.170:0/3158820693 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f3a0406de30 0x7f3a040702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:57.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.598+0000 7f3a1d016640 1 --2- 172.21.15.170:0/3158820693 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f3a0406de30 0x7f3a040702f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3a14006fd0 tx=0x7f3a14008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:57.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.602+0000 7f3a0e7fc640 1 -- 172.21.15.170:0/3158820693 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3a0807c4d0 con 0x7f3a18102b90 2024-09-04T16:27:57.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.768+0000 7f3a1f27a640 1 -- 172.21.15.170:0/3158820693 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7f3a1819d900 con 0x7f3a18102b90 2024-09-04T16:27:57.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.768+0000 7f3a0e7fc640 1 -- 172.21.15.170:0/3158820693 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v43)=0 v43) ==== 163+0+0 (secure 0 0 0) 0x7f3a08080180 con 0x7f3a18102b90 2024-09-04T16:27:57.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.771+0000 7f3a1f27a640 1 -- 172.21.15.170:0/3158820693 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f3a0406de30 msgr2=0x7f3a040702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:57.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.771+0000 7f3a1f27a640 1 --2- 172.21.15.170:0/3158820693 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f3a0406de30 0x7f3a040702f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3a14006fd0 tx=0x7f3a14008040 comp rx=0 tx=0).stop 2024-09-04T16:27:57.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.771+0000 7f3a1f27a640 1 -- 172.21.15.170:0/3158820693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a18102b90 msgr2=0x7f3a18197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:57.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.771+0000 7f3a1f27a640 1 --2- 172.21.15.170:0/3158820693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a18102b90 0x7f3a18197a80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3a08006010 tx=0x7f3a080048f0 comp rx=0 tx=0).stop 2024-09-04T16:27:57.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.771+0000 7f3a1f27a640 1 -- 172.21.15.170:0/3158820693 shutdown_connections 2024-09-04T16:27:57.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.771+0000 7f3a1f27a640 1 --2- 172.21.15.170:0/3158820693 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f3a0406de30 0x7f3a040702f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:57.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.771+0000 7f3a1f27a640 1 --2- 172.21.15.170:0/3158820693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a18102b90 0x7f3a18197a80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:57.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.771+0000 7f3a1f27a640 1 --2- 172.21.15.170:0/3158820693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a18101990 0x7f3a18197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:57.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.771+0000 7f3a1f27a640 1 -- 172.21.15.170:0/3158820693 >> 172.21.15.170:0/3158820693 conn(0x7f3a180fd140 msgr2=0x7f3a180ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:57.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.771+0000 7f3a1f27a640 1 -- 172.21.15.170:0/3158820693 shutdown_connections 2024-09-04T16:27:57.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:57.771+0000 7f3a1f27a640 1 -- 172.21.15.170:0/3158820693 wait complete. 2024-09-04T16:27:58.455 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:58 smithi170 ceph-mon[29272]: pgmap v190: 65 pgs: 65 active+clean; 582 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 1 op/s 2024-09-04T16:27:58.455 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:27:58 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:27:58.484 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-04T16:27:58.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:58 smithi193 ceph-mon[36288]: pgmap v190: 65 pgs: 65 active+clean; 582 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 1 op/s 2024-09-04T16:27:58.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:27:58 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:27:58.733 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:27:59.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.177+0000 7f47b501b640 1 -- 172.21.15.170:0/1029024274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b0104d90 msgr2=0x7f47b0105210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:59.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.177+0000 7f47b501b640 1 --2- 172.21.15.170:0/1029024274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b0104d90 0x7f47b0105210 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009880 tx=0x7f47a402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:27:59.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.177+0000 7f47b501b640 1 -- 172.21.15.170:0/1029024274 shutdown_connections 2024-09-04T16:27:59.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.177+0000 7f47b501b640 1 --2- 172.21.15.170:0/1029024274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b0104d90 0x7f47b0105210 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:59.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.177+0000 7f47b501b640 1 --2- 172.21.15.170:0/1029024274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47b0103b90 0x7f47b0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:59.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.177+0000 7f47b501b640 1 -- 172.21.15.170:0/1029024274 >> 172.21.15.170:0/1029024274 conn(0x7f47b00ff320 msgr2=0x7f47b0101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:59.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.177+0000 7f47b501b640 1 -- 172.21.15.170:0/1029024274 shutdown_connections 2024-09-04T16:27:59.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.177+0000 7f47b501b640 1 -- 172.21.15.170:0/1029024274 wait complete. 2024-09-04T16:27:59.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.178+0000 7f47b501b640 1 Processor -- start 2024-09-04T16:27:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.178+0000 7f47b501b640 1 -- start start 2024-09-04T16:27:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.178+0000 7f47b501b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b0103b90 0x7f47b0199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.178+0000 7f47b501b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47b0104d90 0x7f47b0199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.178+0000 7f47b501b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f47b010ca50 con 0x7f47b0103b90 2024-09-04T16:27:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.178+0000 7f47b501b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f47b010c8d0 con 0x7f47b0104d90 2024-09-04T16:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.178+0000 7f47aed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b0103b90 0x7f47b0199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.178+0000 7f47aed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b0103b90 0x7f47b0199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57098/0 (socket says 172.21.15.170:57098) 2024-09-04T16:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.178+0000 7f47aed9d640 1 -- 172.21.15.170:0/3416795762 learned_addr learned my addr 172.21.15.170:0/3416795762 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.178+0000 7f47aed9d640 1 -- 172.21.15.170:0/3416795762 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47b0104d90 msgr2=0x7f47b0199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.178+0000 7f47aed9d640 1 --2- 172.21.15.170:0/3416795762 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47b0104d90 0x7f47b0199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.178+0000 7f47aed9d640 1 -- 172.21.15.170:0/3416795762 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b019a300 con 0x7f47b0103b90 2024-09-04T16:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.179+0000 7f47aed9d640 1 --2- 172.21.15.170:0/3416795762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b0103b90 0x7f47b0199740 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f47a000b3d0 tx=0x7f47a000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.179+0000 7f4797fff640 1 -- 172.21.15.170:0/3416795762 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47a0015020 con 0x7f47b0103b90 2024-09-04T16:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.179+0000 7f47b501b640 1 -- 172.21.15.170:0/3416795762 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b019ed40 con 0x7f47b0103b90 2024-09-04T16:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.179+0000 7f4797fff640 1 -- 172.21.15.170:0/3416795762 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f47a0011af0 con 0x7f47b0103b90 2024-09-04T16:27:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.179+0000 7f4797fff640 1 -- 172.21.15.170:0/3416795762 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47a0010da0 con 0x7f47b0103b90 2024-09-04T16:27:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.179+0000 7f47b501b640 1 -- 172.21.15.170:0/3416795762 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b019f2f0 con 0x7f47b0103b90 2024-09-04T16:27:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.180+0000 7f47b501b640 1 -- 172.21.15.170:0/3416795762 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b0103f90 con 0x7f47b0103b90 2024-09-04T16:27:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.180+0000 7f4797fff640 1 -- 172.21.15.170:0/3416795762 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f47a0018020 con 0x7f47b0103b90 2024-09-04T16:27:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.181+0000 7f4797fff640 1 --2- 172.21.15.170:0/3416795762 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f479806de30 0x7f47980702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:27:59.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.181+0000 7f47ae59c640 1 --2- 172.21.15.170:0/3416795762 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f479806de30 0x7f47980702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:27:59.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.181+0000 7f4797fff640 1 -- 172.21.15.170:0/3416795762 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f47a008d7d0 con 0x7f47b0103b90 2024-09-04T16:27:59.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.181+0000 7f47ae59c640 1 --2- 172.21.15.170:0/3416795762 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f479806de30 0x7f47980702f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f47a40096c0 tx=0x7f47a4000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:27:59.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.185+0000 7f4797fff640 1 -- 172.21.15.170:0/3416795762 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47a001f020 con 0x7f47b0103b90 2024-09-04T16:27:59.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.354+0000 7f47b501b640 1 -- 172.21.15.170:0/3416795762 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7f47b0193860 con 0x7f47b0103b90 2024-09-04T16:27:59.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.355+0000 7f4797fff640 1 -- 172.21.15.170:0/3416795762 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v43)=0 v43) ==== 135+0+0 (secure 0 0 0) 0x7f47a008d020 con 0x7f47b0103b90 2024-09-04T16:27:59.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.357+0000 7f47b501b640 1 -- 172.21.15.170:0/3416795762 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f479806de30 msgr2=0x7f47980702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:59.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.357+0000 7f47b501b640 1 --2- 172.21.15.170:0/3416795762 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f479806de30 0x7f47980702f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f47a40096c0 tx=0x7f47a4000bc0 comp rx=0 tx=0).stop 2024-09-04T16:27:59.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.357+0000 7f47b501b640 1 -- 172.21.15.170:0/3416795762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b0103b90 msgr2=0x7f47b0199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:27:59.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.357+0000 7f47b501b640 1 --2- 172.21.15.170:0/3416795762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b0103b90 0x7f47b0199740 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f47a000b3d0 tx=0x7f47a000b890 comp rx=0 tx=0).stop 2024-09-04T16:27:59.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.357+0000 7f47b501b640 1 -- 172.21.15.170:0/3416795762 shutdown_connections 2024-09-04T16:27:59.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.357+0000 7f47b501b640 1 --2- 172.21.15.170:0/3416795762 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f479806de30 0x7f47980702f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:59.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.357+0000 7f47b501b640 1 --2- 172.21.15.170:0/3416795762 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47b0104d90 0x7f47b0199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:59.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.357+0000 7f47b501b640 1 --2- 172.21.15.170:0/3416795762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47b0103b90 0x7f47b0199740 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:27:59.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.357+0000 7f47b501b640 1 -- 172.21.15.170:0/3416795762 >> 172.21.15.170:0/3416795762 conn(0x7f47b00ff320 msgr2=0x7f47b0108270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:27:59.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.357+0000 7f47b501b640 1 -- 172.21.15.170:0/3416795762 shutdown_connections 2024-09-04T16:27:59.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:27:59.357+0000 7f47b501b640 1 -- 172.21.15.170:0/3416795762 wait complete. 2024-09-04T16:27:59.993 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-04T16:28:00.248 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:28:00.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:00 smithi170 ceph-mon[29272]: pgmap v191: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 1 op/s 2024-09-04T16:28:00.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:00 smithi193 ceph-mon[36288]: pgmap v191: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 1 op/s 2024-09-04T16:28:00.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.717+0000 7f9820033640 1 -- 172.21.15.170:0/3644936252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9818104d40 msgr2=0x7f9818107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:00.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.717+0000 7f9820033640 1 --2- 172.21.15.170:0/3644936252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9818104d40 0x7f9818107130 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f98080098b0 tx=0x7f980802a4d0 comp rx=0 tx=0).stop 2024-09-04T16:28:00.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.717+0000 7f9820033640 1 -- 172.21.15.170:0/3644936252 shutdown_connections 2024-09-04T16:28:00.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.717+0000 7f9820033640 1 --2- 172.21.15.170:0/3644936252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9818104d40 0x7f9818107130 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:00.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.717+0000 7f9820033640 1 --2- 172.21.15.170:0/3644936252 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9818102410 0x7f9818104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:00.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.717+0000 7f9820033640 1 -- 172.21.15.170:0/3644936252 >> 172.21.15.170:0/3644936252 conn(0x7f98180fc010 msgr2=0x7f98180fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:28:00.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.717+0000 7f9820033640 1 -- 172.21.15.170:0/3644936252 shutdown_connections 2024-09-04T16:28:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.717+0000 7f9820033640 1 -- 172.21.15.170:0/3644936252 wait complete. 2024-09-04T16:28:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.718+0000 7f9820033640 1 Processor -- start 2024-09-04T16:28:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.718+0000 7f9820033640 1 -- start start 2024-09-04T16:28:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.718+0000 7f9820033640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9818102410 0x7f98181997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.718+0000 7f9820033640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9818104d40 0x7f9818199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.718+0000 7f9820033640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f981810a830 con 0x7f9818104d40 2024-09-04T16:28:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.718+0000 7f9820033640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f981810a6b0 con 0x7f9818102410 2024-09-04T16:28:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.718+0000 7f981d5ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9818104d40 0x7f9818199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.718+0000 7f981d5ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9818104d40 0x7f9818199d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57108/0 (socket says 172.21.15.170:57108) 2024-09-04T16:28:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.718+0000 7f981d5ce640 1 -- 172.21.15.170:0/1682724325 learned_addr learned my addr 172.21.15.170:0/1682724325 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.718+0000 7f981ddcf640 1 --2- 172.21.15.170:0/1682724325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9818102410 0x7f98181997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.718+0000 7f981d5ce640 1 -- 172.21.15.170:0/1682724325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9818102410 msgr2=0x7f98181997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.718+0000 7f981d5ce640 1 --2- 172.21.15.170:0/1682724325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9818102410 0x7f98181997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.718+0000 7f981d5ce640 1 -- 172.21.15.170:0/1682724325 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981819a3a0 con 0x7f9818104d40 2024-09-04T16:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.719+0000 7f981d5ce640 1 --2- 172.21.15.170:0/1682724325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9818104d40 0x7f9818199d20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9808009880 tx=0x7f98080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.719+0000 7f980effd640 1 -- 172.21.15.170:0/1682724325 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f980803f070 con 0x7f9818104d40 2024-09-04T16:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.719+0000 7f980effd640 1 -- 172.21.15.170:0/1682724325 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f98080044d0 con 0x7f9818104d40 2024-09-04T16:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.719+0000 7f9820033640 1 -- 172.21.15.170:0/1682724325 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981819ed80 con 0x7f9818104d40 2024-09-04T16:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.719+0000 7f980effd640 1 -- 172.21.15.170:0/1682724325 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9808035030 con 0x7f9818104d40 2024-09-04T16:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.719+0000 7f9820033640 1 -- 172.21.15.170:0/1682724325 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f981819f310 con 0x7f9818104d40 2024-09-04T16:28:00.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.720+0000 7f9820033640 1 -- 172.21.15.170:0/1682724325 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98181027f0 con 0x7f9818104d40 2024-09-04T16:28:00.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.720+0000 7f980effd640 1 -- 172.21.15.170:0/1682724325 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f9808042070 con 0x7f9818104d40 2024-09-04T16:28:00.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.721+0000 7f980effd640 1 --2- 172.21.15.170:0/1682724325 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f980406de30 0x7f98040702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:00.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.721+0000 7f980effd640 1 -- 172.21.15.170:0/1682724325 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f98080ae7c0 con 0x7f9818104d40 2024-09-04T16:28:00.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.721+0000 7f981ddcf640 1 --2- 172.21.15.170:0/1682724325 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f980406de30 0x7f98040702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:00.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.721+0000 7f981ddcf640 1 --2- 172.21.15.170:0/1682724325 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f980406de30 0x7f98040702f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9814009890 tx=0x7f9814008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:28:00.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.725+0000 7f980effd640 1 -- 172.21.15.170:0/1682724325 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f980807c300 con 0x7f9818104d40 2024-09-04T16:28:00.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:00.905+0000 7f9820033640 1 -- 172.21.15.170:0/1682724325 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) -- 0x7f98180627a0 con 0x7f980406de30 2024-09-04T16:28:02.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:02 smithi170 ceph-mon[29272]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:28:02.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:02 smithi170 ceph-mon[29272]: pgmap v192: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 1 op/s 2024-09-04T16:28:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:02 smithi193 ceph-mon[36288]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:28:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:02 smithi193 ceph-mon[36288]: pgmap v192: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 1 op/s 2024-09-04T16:28:04.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:04 smithi170 ceph-mon[29272]: pgmap v193: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 1 op/s 2024-09-04T16:28:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:04 smithi193 ceph-mon[36288]: pgmap v193: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 1 op/s 2024-09-04T16:28:06.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:06 smithi170 ceph-mon[29272]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-04T16:28:06.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:06 smithi193 ceph-mon[36288]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-04T16:28:08.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:08 smithi170 ceph-mon[29272]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-09-04T16:28:08.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:08 smithi193 ceph-mon[36288]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-09-04T16:28:10.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:10 smithi170 ceph-mon[29272]: pgmap v196: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-04T16:28:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:10 smithi193 ceph-mon[36288]: pgmap v196: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-04T16:28:12.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:12 smithi170 ceph-mon[29272]: pgmap v197: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:28:12.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:12 smithi193 ceph-mon[36288]: pgmap v197: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:28:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:13 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:28:13.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:13 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:28:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:14 smithi193 ceph-mon[36288]: pgmap v198: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:28:14.682 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:14 smithi170 ceph-mon[29272]: pgmap v198: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:28:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:16 smithi193 ceph-mon[36288]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:28:16.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:16 smithi170 ceph-mon[29272]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:28:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:18 smithi193 ceph-mon[36288]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:28:18.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:18 smithi170 ceph-mon[29272]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:28:20.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:20 smithi193 ceph-mon[36288]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-04T16:28:20.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:20 smithi170 ceph-mon[29272]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-04T16:28:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:22 smithi193 ceph-mon[36288]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:22.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:22 smithi170 ceph-mon[29272]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:24.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:24 smithi193 ceph-mon[36288]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:24.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:24 smithi170 ceph-mon[29272]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:26 smithi193 ceph-mon[36288]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:26.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:26 smithi170 ceph-mon[29272]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:28 smithi193 ceph-mon[36288]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:28 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:28:28.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:28 smithi170 ceph-mon[29272]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:28.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:28 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:28:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:30 smithi193 ceph-mon[36288]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:30.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:30 smithi170 ceph-mon[29272]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:32.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:32 smithi170 ceph-mon[29272]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:32.655 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:32 smithi193 ceph-mon[36288]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:33.802 INFO:teuthology.orchestra.run.smithi170.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:28:33.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:33.801+0000 7f980effd640 1 -- 172.21.15.170:0/1682724325 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f98180627a0 con 0x7f980406de30 2024-09-04T16:28:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:33.806+0000 7f9820033640 1 -- 172.21.15.170:0/1682724325 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f980406de30 msgr2=0x7f98040702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:33.806+0000 7f9820033640 1 --2- 172.21.15.170:0/1682724325 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f980406de30 0x7f98040702f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9814009890 tx=0x7f9814008040 comp rx=0 tx=0).stop 2024-09-04T16:28:33.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:33.806+0000 7f9820033640 1 -- 172.21.15.170:0/1682724325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9818104d40 msgr2=0x7f9818199d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:33.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:33.806+0000 7f9820033640 1 --2- 172.21.15.170:0/1682724325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9818104d40 0x7f9818199d20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9808009880 tx=0x7f98080048f0 comp rx=0 tx=0).stop 2024-09-04T16:28:33.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:33.806+0000 7f9820033640 1 -- 172.21.15.170:0/1682724325 shutdown_connections 2024-09-04T16:28:33.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:33.806+0000 7f9820033640 1 --2- 172.21.15.170:0/1682724325 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f980406de30 0x7f98040702f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:33.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:33.806+0000 7f9820033640 1 --2- 172.21.15.170:0/1682724325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9818104d40 0x7f9818199d20 secure :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9808009880 tx=0x7f98080048f0 comp rx=0 tx=0).stop 2024-09-04T16:28:33.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:33.806+0000 7f9820033640 1 --2- 172.21.15.170:0/1682724325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9818102410 0x7f98181997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:33.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:33.806+0000 7f9820033640 1 -- 172.21.15.170:0/1682724325 >> 172.21.15.170:0/1682724325 conn(0x7f98180fc010 msgr2=0x7f9818101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:28:33.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:33.807+0000 7f9820033640 1 -- 172.21.15.170:0/1682724325 shutdown_connections 2024-09-04T16:28:33.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:33.807+0000 7f9820033640 1 -- 172.21.15.170:0/1682724325 wait complete. 2024-09-04T16:28:34.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:34 smithi170 ceph-mon[29272]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:28:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:28:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:28:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:28:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:34 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:28:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:34 smithi193 ceph-mon[36288]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:28:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:28:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:28:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:28:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:34 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:28:34.689 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-04T16:28:35.014 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:28:35.395 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:35 smithi170 ceph-mon[29272]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:28:35.395 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:35 smithi170 ceph-mon[29272]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:28:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:35 smithi193 ceph-mon[36288]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:28:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:35 smithi193 ceph-mon[36288]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:28:35.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.679+0000 7f061680c640 1 -- 172.21.15.170:0/3840233815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0610104d00 msgr2=0x7f06101070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:35.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.679+0000 7f061680c640 1 --2- 172.21.15.170:0/3840233815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0610104d00 0x7f06101070f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f06040098b0 tx=0x7f060402a4d0 comp rx=0 tx=0).stop 2024-09-04T16:28:35.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.679+0000 7f061680c640 1 -- 172.21.15.170:0/3840233815 shutdown_connections 2024-09-04T16:28:35.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.679+0000 7f061680c640 1 --2- 172.21.15.170:0/3840233815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0610104d00 0x7f06101070f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:35.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.679+0000 7f061680c640 1 --2- 172.21.15.170:0/3840233815 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06101023d0 0x7f06101047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:35.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.679+0000 7f061680c640 1 -- 172.21.15.170:0/3840233815 >> 172.21.15.170:0/3840233815 conn(0x7f06100fbff0 msgr2=0x7f06100fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:28:35.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.679+0000 7f061680c640 1 -- 172.21.15.170:0/3840233815 shutdown_connections 2024-09-04T16:28:35.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.679+0000 7f061680c640 1 -- 172.21.15.170:0/3840233815 wait complete. 2024-09-04T16:28:35.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.680+0000 7f061680c640 1 Processor -- start 2024-09-04T16:28:35.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.680+0000 7f061680c640 1 -- start start 2024-09-04T16:28:35.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.680+0000 7f061680c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06101023d0 0x7f0610197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:35.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.680+0000 7f061680c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0610104d00 0x7f0610197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:35.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.680+0000 7f061680c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f061010a770 con 0x7f06101023d0 2024-09-04T16:28:35.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.680+0000 7f061680c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f061010a5f0 con 0x7f0610104d00 2024-09-04T16:28:35.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.680+0000 7f060ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06101023d0 0x7f0610197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:35.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.680+0000 7f060ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06101023d0 0x7f0610197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47882/0 (socket says 172.21.15.170:47882) 2024-09-04T16:28:35.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.680+0000 7f060f7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0610104d00 0x7f0610197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:35.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.680+0000 7f060ffff640 1 -- 172.21.15.170:0/3384704771 learned_addr learned my addr 172.21.15.170:0/3384704771 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:28:35.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.681+0000 7f060ffff640 1 -- 172.21.15.170:0/3384704771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0610104d00 msgr2=0x7f0610197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:35.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.681+0000 7f060ffff640 1 --2- 172.21.15.170:0/3384704771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0610104d00 0x7f0610197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:35.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.681+0000 7f060ffff640 1 -- 172.21.15.170:0/3384704771 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06101980c0 con 0x7f06101023d0 2024-09-04T16:28:35.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.681+0000 7f060ffff640 1 --2- 172.21.15.170:0/3384704771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06101023d0 0x7f0610197500 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f060000d8d0 tx=0x7f060000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:28:35.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.681+0000 7f060d7fa640 1 -- 172.21.15.170:0/3384704771 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0600017030 con 0x7f06101023d0 2024-09-04T16:28:35.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.681+0000 7f060d7fa640 1 -- 172.21.15.170:0/3384704771 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0600004020 con 0x7f06101023d0 2024-09-04T16:28:35.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.681+0000 7f061680c640 1 -- 172.21.15.170:0/3384704771 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f061019cb00 con 0x7f06101023d0 2024-09-04T16:28:35.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.681+0000 7f060d7fa640 1 -- 172.21.15.170:0/3384704771 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06000047a0 con 0x7f06101023d0 2024-09-04T16:28:35.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.682+0000 7f061680c640 1 -- 172.21.15.170:0/3384704771 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f061019d060 con 0x7f06101023d0 2024-09-04T16:28:35.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.683+0000 7f061680c640 1 -- 172.21.15.170:0/3384704771 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f061010af50 con 0x7f06101023d0 2024-09-04T16:28:35.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.683+0000 7f060d7fa640 1 -- 172.21.15.170:0/3384704771 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f0600004940 con 0x7f06101023d0 2024-09-04T16:28:35.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.684+0000 7f060d7fa640 1 --2- 172.21.15.170:0/3384704771 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f05f806ded0 0x7f05f8070390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:35.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.684+0000 7f060d7fa640 1 -- 172.21.15.170:0/3384704771 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f0600018070 con 0x7f06101023d0 2024-09-04T16:28:35.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.687+0000 7f060f7fe640 1 --2- 172.21.15.170:0/3384704771 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f05f806ded0 0x7f05f8070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:35.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.687+0000 7f060f7fe640 1 --2- 172.21.15.170:0/3384704771 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f05f806ded0 0x7f05f8070390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0604005ab0 tx=0x7f0604005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:28:35.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.692+0000 7f060d7fa640 1 -- 172.21.15.170:0/3384704771 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f060005b500 con 0x7f06101023d0 2024-09-04T16:28:35.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.911+0000 7f061680c640 1 -- 172.21.15.170:0/3384704771 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f06101056e0 con 0x7f05f806ded0 2024-09-04T16:28:35.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.912+0000 7f060d7fa640 1 -- 172.21.15.170:0/3384704771 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f06101056e0 con 0x7f05f806ded0 2024-09-04T16:28:35.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.914+0000 7f061680c640 1 -- 172.21.15.170:0/3384704771 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f05f806ded0 msgr2=0x7f05f8070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:35.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.914+0000 7f061680c640 1 --2- 172.21.15.170:0/3384704771 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f05f806ded0 0x7f05f8070390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0604005ab0 tx=0x7f0604005a20 comp rx=0 tx=0).stop 2024-09-04T16:28:35.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.914+0000 7f061680c640 1 -- 172.21.15.170:0/3384704771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06101023d0 msgr2=0x7f0610197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:35.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.914+0000 7f061680c640 1 --2- 172.21.15.170:0/3384704771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06101023d0 0x7f0610197500 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f060000d8d0 tx=0x7f060000dd90 comp rx=0 tx=0).stop 2024-09-04T16:28:35.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.915+0000 7f061680c640 1 -- 172.21.15.170:0/3384704771 shutdown_connections 2024-09-04T16:28:35.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.915+0000 7f061680c640 1 --2- 172.21.15.170:0/3384704771 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f05f806ded0 0x7f05f8070390 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:35.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.915+0000 7f061680c640 1 --2- 172.21.15.170:0/3384704771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0610104d00 0x7f0610197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:35.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.915+0000 7f061680c640 1 --2- 172.21.15.170:0/3384704771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06101023d0 0x7f0610197500 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:35.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.915+0000 7f061680c640 1 -- 172.21.15.170:0/3384704771 >> 172.21.15.170:0/3384704771 conn(0x7f06100fbff0 msgr2=0x7f06100fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:28:35.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.916+0000 7f061680c640 1 -- 172.21.15.170:0/3384704771 shutdown_connections 2024-09-04T16:28:35.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:35.916+0000 7f061680c640 1 -- 172.21.15.170:0/3384704771 wait complete. 2024-09-04T16:28:35.930 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:28:36.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.008+0000 7f90694a1640 1 -- 172.21.15.170:0/1806185431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9064101a40 msgr2=0x7f9064101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:36.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.008+0000 7f90694a1640 1 --2- 172.21.15.170:0/1806185431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9064101a40 0x7f9064101ec0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9058009880 tx=0x7f905802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.009+0000 7f90694a1640 1 -- 172.21.15.170:0/1806185431 shutdown_connections 2024-09-04T16:28:36.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.009+0000 7f90694a1640 1 --2- 172.21.15.170:0/1806185431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9064101a40 0x7f9064101ec0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.009+0000 7f90694a1640 1 --2- 172.21.15.170:0/1806185431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9064100840 0x7f9064100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.009+0000 7f90694a1640 1 -- 172.21.15.170:0/1806185431 >> 172.21.15.170:0/1806185431 conn(0x7f90640fbff0 msgr2=0x7f90640fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:28:36.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.009+0000 7f90694a1640 1 -- 172.21.15.170:0/1806185431 shutdown_connections 2024-09-04T16:28:36.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.009+0000 7f90694a1640 1 -- 172.21.15.170:0/1806185431 wait complete. 2024-09-04T16:28:36.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.009+0000 7f90694a1640 1 Processor -- start 2024-09-04T16:28:36.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.010+0000 7f90694a1640 1 -- start start 2024-09-04T16:28:36.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.010+0000 7f90694a1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9064100840 0x7f906406a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:36.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.010+0000 7f90694a1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9064101a40 0x7f906419c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:36.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.010+0000 7f90694a1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9064109680 con 0x7f9064100840 2024-09-04T16:28:36.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.010+0000 7f90694a1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9064109500 con 0x7f9064101a40 2024-09-04T16:28:36.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.010+0000 7f9062ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9064100840 0x7f906406a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:36.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.010+0000 7f9062ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9064100840 0x7f906406a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47902/0 (socket says 172.21.15.170:47902) 2024-09-04T16:28:36.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.010+0000 7f90627fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9064101a40 0x7f906419c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:36.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.010+0000 7f9062ffd640 1 -- 172.21.15.170:0/2053542933 learned_addr learned my addr 172.21.15.170:0/2053542933 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:28:36.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.011+0000 7f9062ffd640 1 -- 172.21.15.170:0/2053542933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9064101a40 msgr2=0x7f906419c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:36.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.011+0000 7f9062ffd640 1 --2- 172.21.15.170:0/2053542933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9064101a40 0x7f906419c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.011+0000 7f9062ffd640 1 -- 172.21.15.170:0/2053542933 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906419c7b0 con 0x7f9064100840 2024-09-04T16:28:36.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.011+0000 7f90627fc640 1 --2- 172.21.15.170:0/2053542933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9064101a40 0x7f906419c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:28:36.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.011+0000 7f9062ffd640 1 --2- 172.21.15.170:0/2053542933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9064100840 0x7f906406a620 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f905400d8d0 tx=0x7f905400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:28:36.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.011+0000 7f904bfff640 1 -- 172.21.15.170:0/2053542933 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9054017070 con 0x7f9064100840 2024-09-04T16:28:36.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.011+0000 7f90694a1640 1 -- 172.21.15.170:0/2053542933 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f906419caa0 con 0x7f9064100840 2024-09-04T16:28:36.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.011+0000 7f904bfff640 1 -- 172.21.15.170:0/2053542933 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f905400be10 con 0x7f9064100840 2024-09-04T16:28:36.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.011+0000 7f90694a1640 1 -- 172.21.15.170:0/2053542933 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f906419d000 con 0x7f9064100840 2024-09-04T16:28:36.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.012+0000 7f904bfff640 1 -- 172.21.15.170:0/2053542933 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9054009a30 con 0x7f9064100840 2024-09-04T16:28:36.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.013+0000 7f90694a1640 1 -- 172.21.15.170:0/2053542933 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9064100c40 con 0x7f9064100840 2024-09-04T16:28:36.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.014+0000 7f904bfff640 1 -- 172.21.15.170:0/2053542933 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f905401a070 con 0x7f9064100840 2024-09-04T16:28:36.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.015+0000 7f904bfff640 1 --2- 172.21.15.170:0/2053542933 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f904c06de30 0x7f904c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:36.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.015+0000 7f904bfff640 1 -- 172.21.15.170:0/2053542933 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f905408d1d0 con 0x7f9064100840 2024-09-04T16:28:36.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.015+0000 7f90627fc640 1 --2- 172.21.15.170:0/2053542933 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f904c06de30 0x7f904c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:36.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.015+0000 7f90627fc640 1 --2- 172.21.15.170:0/2053542933 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f904c06de30 0x7f904c0702f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9058000c00 tx=0x7f90580058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:28:36.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.022+0000 7f904bfff640 1 -- 172.21.15.170:0/2053542933 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f905405ada0 con 0x7f9064100840 2024-09-04T16:28:36.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.302+0000 7f90694a1640 1 -- 172.21.15.170:0/2053542933 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f90640626f0 con 0x7f904c06de30 2024-09-04T16:28:36.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.303+0000 7f904bfff640 1 -- 172.21.15.170:0/2053542933 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f90640626f0 con 0x7f904c06de30 2024-09-04T16:28:36.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.306+0000 7f90694a1640 1 -- 172.21.15.170:0/2053542933 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f904c06de30 msgr2=0x7f904c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:36.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.306+0000 7f90694a1640 1 --2- 172.21.15.170:0/2053542933 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f904c06de30 0x7f904c0702f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9058000c00 tx=0x7f90580058d0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.306+0000 7f90694a1640 1 -- 172.21.15.170:0/2053542933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9064100840 msgr2=0x7f906406a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:36.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.306+0000 7f90694a1640 1 --2- 172.21.15.170:0/2053542933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9064100840 0x7f906406a620 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f905400d8d0 tx=0x7f905400dd90 comp rx=0 tx=0).stop 2024-09-04T16:28:36.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.306+0000 7f90694a1640 1 -- 172.21.15.170:0/2053542933 shutdown_connections 2024-09-04T16:28:36.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.306+0000 7f90694a1640 1 --2- 172.21.15.170:0/2053542933 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f904c06de30 0x7f904c0702f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.306+0000 7f90694a1640 1 --2- 172.21.15.170:0/2053542933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9064101a40 0x7f906419c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.306+0000 7f90694a1640 1 --2- 172.21.15.170:0/2053542933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9064100840 0x7f906406a620 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.306+0000 7f90694a1640 1 -- 172.21.15.170:0/2053542933 >> 172.21.15.170:0/2053542933 conn(0x7f90640fbff0 msgr2=0x7f9064104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:28:36.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.306+0000 7f90694a1640 1 -- 172.21.15.170:0/2053542933 shutdown_connections 2024-09-04T16:28:36.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.306+0000 7f90694a1640 1 -- 172.21.15.170:0/2053542933 wait complete. 2024-09-04T16:28:36.433 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:36 smithi170 ceph-mon[29272]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.432+0000 7ff9465a2640 1 -- 172.21.15.170:0/3912605044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff940100860 msgr2=0x7ff940100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.432+0000 7ff9465a2640 1 --2- 172.21.15.170:0/3912605044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff940100860 0x7ff940100c60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff930009880 tx=0x7ff93002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.433+0000 7ff9465a2640 1 -- 172.21.15.170:0/3912605044 shutdown_connections 2024-09-04T16:28:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.433+0000 7ff9465a2640 1 --2- 172.21.15.170:0/3912605044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff940101a60 0x7ff940101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.433+0000 7ff9465a2640 1 --2- 172.21.15.170:0/3912605044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff940100860 0x7ff940100c60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.433+0000 7ff9465a2640 1 -- 172.21.15.170:0/3912605044 >> 172.21.15.170:0/3912605044 conn(0x7ff9400fbff0 msgr2=0x7ff9400fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:28:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.433+0000 7ff9465a2640 1 -- 172.21.15.170:0/3912605044 shutdown_connections 2024-09-04T16:28:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.433+0000 7ff9465a2640 1 -- 172.21.15.170:0/3912605044 wait complete. 2024-09-04T16:28:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.434+0000 7ff9465a2640 1 Processor -- start 2024-09-04T16:28:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.434+0000 7ff9465a2640 1 -- start start 2024-09-04T16:28:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.435+0000 7ff9465a2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff940100860 0x7ff940104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.435+0000 7ff9465a2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff940101a60 0x7ff940102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.435+0000 7ff9465a2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff9401096a0 con 0x7ff940100860 2024-09-04T16:28:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.435+0000 7ff9465a2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff940109520 con 0x7ff940101a60 2024-09-04T16:28:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.435+0000 7ff93ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff940100860 0x7ff940104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.435+0000 7ff93ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff940100860 0x7ff940104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47926/0 (socket says 172.21.15.170:47926) 2024-09-04T16:28:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.435+0000 7ff93ffff640 1 -- 172.21.15.170:0/3970030643 learned_addr learned my addr 172.21.15.170:0/3970030643 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:28:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.435+0000 7ff93f7fe640 1 --2- 172.21.15.170:0/3970030643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff940101a60 0x7ff940102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.435+0000 7ff93ffff640 1 -- 172.21.15.170:0/3970030643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff940101a60 msgr2=0x7ff940102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.435+0000 7ff93ffff640 1 --2- 172.21.15.170:0/3970030643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff940101a60 0x7ff940102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.435+0000 7ff93ffff640 1 -- 172.21.15.170:0/3970030643 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff940103380 con 0x7ff940100860 2024-09-04T16:28:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.435+0000 7ff93ffff640 1 --2- 172.21.15.170:0/3970030643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff940100860 0x7ff940104780 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff930006010 tx=0x7ff9300045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:28:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.436+0000 7ff93d7fa640 1 -- 172.21.15.170:0/3970030643 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff93003f070 con 0x7ff940100860 2024-09-04T16:28:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.436+0000 7ff93d7fa640 1 -- 172.21.15.170:0/3970030643 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9300049d0 con 0x7ff940100860 2024-09-04T16:28:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.436+0000 7ff9465a2640 1 -- 172.21.15.170:0/3970030643 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff940103610 con 0x7ff940100860 2024-09-04T16:28:36.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.436+0000 7ff9465a2640 1 -- 172.21.15.170:0/3970030643 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff940103a80 con 0x7ff940100860 2024-09-04T16:28:36.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.437+0000 7ff93d7fa640 1 -- 172.21.15.170:0/3970030643 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff930035030 con 0x7ff940100860 2024-09-04T16:28:36.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.438+0000 7ff9465a2640 1 -- 172.21.15.170:0/3970030643 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff92c005290 con 0x7ff940100860 2024-09-04T16:28:36.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.438+0000 7ff93d7fa640 1 -- 172.21.15.170:0/3970030643 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7ff930042070 con 0x7ff940100860 2024-09-04T16:28:36.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.439+0000 7ff93d7fa640 1 --2- 172.21.15.170:0/3970030643 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff92806ded0 0x7ff928070390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:36.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.439+0000 7ff93d7fa640 1 -- 172.21.15.170:0/3970030643 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7ff9300ae4b0 con 0x7ff940100860 2024-09-04T16:28:36.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.439+0000 7ff93f7fe640 1 --2- 172.21.15.170:0/3970030643 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff92806ded0 0x7ff928070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:36.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.440+0000 7ff93f7fe640 1 --2- 172.21.15.170:0/3970030643 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff92806ded0 0x7ff928070390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff940104500 tx=0x7ff934005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:28:36.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.448+0000 7ff93d7fa640 1 -- 172.21.15.170:0/3970030643 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff930080e10 con 0x7ff940100860 2024-09-04T16:28:36.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:36 smithi193 ceph-mon[36288]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:36.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.710+0000 7ff9465a2640 1 -- 172.21.15.170:0/3970030643 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff92c000bc0 con 0x7ff92806ded0 2024-09-04T16:28:36.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.720+0000 7ff93d7fa640 1 -- 172.21.15.170:0/3970030643 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3792 (secure 0 0 0) 0x7ff92c000bc0 con 0x7ff92806ded0 2024-09-04T16:28:36.721 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:28:36.721 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (4m) 49s ago 6m 26.0M - 0.25.0 c8568f914cd2 e85db6a2e731 2024-09-04T16:28:36.721 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (6m) 49s ago 6m 8358k - 19.1.1-252-g48920dab b708f9119ac7 8499640d7363 2024-09-04T16:28:36.721 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (5m) 53s ago 5m 5268k - 19.1.1-252-g48920dab b708f9119ac7 f9a24a1cb9dd 2024-09-04T16:28:36.721 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (6m) 49s ago 6m 6891k - 19.1.1-252-g48920dab b708f9119ac7 aa2ec5c5776a 2024-09-04T16:28:36.721 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (5m) 53s ago 5m 6895k - 19.1.1-252-g48920dab b708f9119ac7 a24f0ce3b3fb 2024-09-04T16:28:36.721 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (4m) 49s ago 6m 76.3M - 9.4.12 2bacad6d85d8 5bffd3332aba 2024-09-04T16:28:36.721 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (66s) 49s ago 66s 16.3M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:28:36.721 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (72s) 49s ago 71s 17.3M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:28:36.721 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (63s) 53s ago 63s 12.1M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:28:36.722 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (69s) 53s ago 68s 11.3M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:28:36.722 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:9283,8765,8443 running (7m) 49s ago 7m 498M - 19.1.1-252-g48920dab b708f9119ac7 3f0663652a64 2024-09-04T16:28:36.722 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (5m) 53s ago 5m 440M - 19.1.1-252-g48920dab b708f9119ac7 1a44816379f1 2024-09-04T16:28:36.722 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (7m) 49s ago 7m 49.0M 2048M 19.1.1-252-g48920dab b708f9119ac7 194ff39cc041 2024-09-04T16:28:36.722 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (5m) 53s ago 5m 35.1M 2048M 19.1.1-252-g48920dab b708f9119ac7 38c8e99ca323 2024-09-04T16:28:36.722 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (6m) 49s ago 6m 15.7M - 1.5.0 0da6a335fe13 e311ba1b18bc 2024-09-04T16:28:36.722 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (5m) 53s ago 5m 15.9M - 1.5.0 0da6a335fe13 09fd1aa1fdb6 2024-09-04T16:28:36.722 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (4m) 49s ago 4m 54.5M 3946M 19.1.1-252-g48920dab b708f9119ac7 6c2ea484615d 2024-09-04T16:28:36.722 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (3m) 49s ago 3m 56.7M 3946M 19.1.1-252-g48920dab b708f9119ac7 20469ba5727b 2024-09-04T16:28:36.722 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (3m) 49s ago 3m 48.4M 3946M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:28:36.722 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (3m) 53s ago 3m 52.4M 4970M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:28:36.722 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (2m) 53s ago 2m 43.0M 4970M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:28:36.722 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (2m) 53s ago 2m 49.6M 4970M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:28:36.722 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (4m) 49s ago 5m 55.7M - 2.43.0 a07b618ecd1d 58faf9d631cd 2024-09-04T16:28:36.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.723+0000 7ff9465a2640 1 -- 172.21.15.170:0/3970030643 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff92806ded0 msgr2=0x7ff928070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:36.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.723+0000 7ff9465a2640 1 --2- 172.21.15.170:0/3970030643 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff92806ded0 0x7ff928070390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff940104500 tx=0x7ff934005f90 comp rx=0 tx=0).stop 2024-09-04T16:28:36.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.723+0000 7ff9465a2640 1 -- 172.21.15.170:0/3970030643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff940100860 msgr2=0x7ff940104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:36.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.723+0000 7ff9465a2640 1 --2- 172.21.15.170:0/3970030643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff940100860 0x7ff940104780 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff930006010 tx=0x7ff9300045e0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.723+0000 7ff9465a2640 1 -- 172.21.15.170:0/3970030643 shutdown_connections 2024-09-04T16:28:36.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.723+0000 7ff9465a2640 1 --2- 172.21.15.170:0/3970030643 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ff92806ded0 0x7ff928070390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.723+0000 7ff9465a2640 1 --2- 172.21.15.170:0/3970030643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff940101a60 0x7ff940102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.723+0000 7ff9465a2640 1 --2- 172.21.15.170:0/3970030643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff940100860 0x7ff940104780 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.723+0000 7ff9465a2640 1 -- 172.21.15.170:0/3970030643 >> 172.21.15.170:0/3970030643 conn(0x7ff9400fbff0 msgr2=0x7ff94006a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:28:36.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.723+0000 7ff9465a2640 1 -- 172.21.15.170:0/3970030643 shutdown_connections 2024-09-04T16:28:36.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.723+0000 7ff9465a2640 1 -- 172.21.15.170:0/3970030643 wait complete. 2024-09-04T16:28:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.809+0000 7f5caf7c8640 1 -- 172.21.15.170:0/1373992194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ca81023d0 msgr2=0x7f5ca81047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.809+0000 7f5caf7c8640 1 --2- 172.21.15.170:0/1373992194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ca81023d0 0x7f5ca81047c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40098b0 tx=0x7f5ca402a4d0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.809+0000 7f5caf7c8640 1 -- 172.21.15.170:0/1373992194 shutdown_connections 2024-09-04T16:28:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.809+0000 7f5caf7c8640 1 --2- 172.21.15.170:0/1373992194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ca8104d00 0x7f5ca81070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.809+0000 7f5caf7c8640 1 --2- 172.21.15.170:0/1373992194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ca81023d0 0x7f5ca81047c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.809+0000 7f5caf7c8640 1 -- 172.21.15.170:0/1373992194 >> 172.21.15.170:0/1373992194 conn(0x7f5ca80fbff0 msgr2=0x7f5ca80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:28:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.809+0000 7f5caf7c8640 1 -- 172.21.15.170:0/1373992194 shutdown_connections 2024-09-04T16:28:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.809+0000 7f5caf7c8640 1 -- 172.21.15.170:0/1373992194 wait complete. 2024-09-04T16:28:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.810+0000 7f5caf7c8640 1 Processor -- start 2024-09-04T16:28:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.810+0000 7f5caf7c8640 1 -- start start 2024-09-04T16:28:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.810+0000 7f5caf7c8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ca81023d0 0x7f5ca8197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.810+0000 7f5caf7c8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ca8104d00 0x7f5ca8197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.810+0000 7f5caf7c8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca810a7c0 con 0x7f5ca81023d0 2024-09-04T16:28:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.810+0000 7f5caf7c8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca810a640 con 0x7f5ca8104d00 2024-09-04T16:28:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.811+0000 7f5cad564640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ca81023d0 0x7f5ca8197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.811+0000 7f5cad564640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ca81023d0 0x7f5ca8197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47940/0 (socket says 172.21.15.170:47940) 2024-09-04T16:28:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.811+0000 7f5cacd63640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ca8104d00 0x7f5ca8197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.811+0000 7f5cad564640 1 -- 172.21.15.170:0/4143827301 learned_addr learned my addr 172.21.15.170:0/4143827301 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:28:36.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.811+0000 7f5cacd63640 1 -- 172.21.15.170:0/4143827301 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ca81023d0 msgr2=0x7f5ca8197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:36.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.811+0000 7f5cacd63640 1 --2- 172.21.15.170:0/4143827301 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ca81023d0 0x7f5ca8197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:36.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.811+0000 7f5cacd63640 1 -- 172.21.15.170:0/4143827301 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca81980e0 con 0x7f5ca8104d00 2024-09-04T16:28:36.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.811+0000 7f5cad564640 1 --2- 172.21.15.170:0/4143827301 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ca81023d0 0x7f5ca8197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:28:36.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.811+0000 7f5cacd63640 1 --2- 172.21.15.170:0/4143827301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ca8104d00 0x7f5ca8197a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800e940 tx=0x7f5c9800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:28:36.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.812+0000 7f5c9e7fc640 1 -- 172.21.15.170:0/4143827301 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c9800cac0 con 0x7f5ca8104d00 2024-09-04T16:28:36.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.812+0000 7f5caf7c8640 1 -- 172.21.15.170:0/4143827301 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca819cb20 con 0x7f5ca8104d00 2024-09-04T16:28:36.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.812+0000 7f5c9e7fc640 1 -- 172.21.15.170:0/4143827301 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c9800cc60 con 0x7f5ca8104d00 2024-09-04T16:28:36.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.812+0000 7f5caf7c8640 1 -- 172.21.15.170:0/4143827301 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca81001c0 con 0x7f5ca8104d00 2024-09-04T16:28:36.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.812+0000 7f5c9e7fc640 1 -- 172.21.15.170:0/4143827301 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c980047a0 con 0x7f5ca8104d00 2024-09-04T16:28:36.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.813+0000 7f5c93fff640 1 -- 172.21.15.170:0/4143827301 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c88005290 con 0x7f5ca8104d00 2024-09-04T16:28:36.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.814+0000 7f5c9e7fc640 1 -- 172.21.15.170:0/4143827301 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f5c98004a20 con 0x7f5ca8104d00 2024-09-04T16:28:36.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.815+0000 7f5c9e7fc640 1 --2- 172.21.15.170:0/4143827301 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f5c9406de90 0x7f5c94070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:36.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.815+0000 7f5c9e7fc640 1 -- 172.21.15.170:0/4143827301 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f5c9808dfc0 con 0x7f5ca8104d00 2024-09-04T16:28:36.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.815+0000 7f5cad564640 1 --2- 172.21.15.170:0/4143827301 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f5c9406de90 0x7f5c94070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:36.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.816+0000 7f5cad564640 1 --2- 172.21.15.170:0/4143827301 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f5c9406de90 0x7f5c94070350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40096c0 tx=0x7f5ca4005e50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:28:36.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:36.823+0000 7f5c9e7fc640 1 -- 172.21.15.170:0/4143827301 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5c9805bb20 con 0x7f5ca8104d00 2024-09-04T16:28:37.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.073+0000 7f5c93fff640 1 -- 172.21.15.170:0/4143827301 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5c88005d90 con 0x7f5ca8104d00 2024-09-04T16:28:37.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.074+0000 7f5c9e7fc640 1 -- 172.21.15.170:0/4143827301 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7f5c9805f7d0 con 0x7f5ca8104d00 2024-09-04T16:28:37.075 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:28:37.075 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:28:37.075 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 2 2024-09-04T16:28:37.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:28:37.075 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:28:37.075 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 2 2024-09-04T16:28:37.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:28:37.075 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:28:37.075 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 6 2024-09-04T16:28:37.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:28:37.076 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:28:37.076 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:28:37.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:28:37.076 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:28:37.076 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 14 2024-09-04T16:28:37.076 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:28:37.076 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:28:37.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.076+0000 7f5c93fff640 1 -- 172.21.15.170:0/4143827301 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f5c9406de90 msgr2=0x7f5c94070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:37.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.076+0000 7f5c93fff640 1 --2- 172.21.15.170:0/4143827301 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f5c9406de90 0x7f5c94070350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40096c0 tx=0x7f5ca4005e50 comp rx=0 tx=0).stop 2024-09-04T16:28:37.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.076+0000 7f5c93fff640 1 -- 172.21.15.170:0/4143827301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ca8104d00 msgr2=0x7f5ca8197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:37.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.076+0000 7f5c93fff640 1 --2- 172.21.15.170:0/4143827301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ca8104d00 0x7f5ca8197a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800e940 tx=0x7f5c9800ee00 comp rx=0 tx=0).stop 2024-09-04T16:28:37.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.077+0000 7f5c93fff640 1 -- 172.21.15.170:0/4143827301 shutdown_connections 2024-09-04T16:28:37.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.077+0000 7f5c93fff640 1 --2- 172.21.15.170:0/4143827301 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f5c9406de90 0x7f5c94070350 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:37.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.077+0000 7f5c93fff640 1 --2- 172.21.15.170:0/4143827301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ca8104d00 0x7f5ca8197a60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:37.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.077+0000 7f5c93fff640 1 --2- 172.21.15.170:0/4143827301 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ca81023d0 0x7f5ca8197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:37.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.077+0000 7f5c93fff640 1 -- 172.21.15.170:0/4143827301 >> 172.21.15.170:0/4143827301 conn(0x7f5ca80fbff0 msgr2=0x7f5ca80fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:28:37.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.077+0000 7f5c93fff640 1 -- 172.21.15.170:0/4143827301 shutdown_connections 2024-09-04T16:28:37.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.077+0000 7f5c93fff640 1 -- 172.21.15.170:0/4143827301 wait complete. 2024-09-04T16:28:37.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.163+0000 7ffa84c27640 1 -- 172.21.15.170:0/1813435126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa80103910 msgr2=0x7ffa800ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:37.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.163+0000 7ffa84c27640 1 --2- 172.21.15.170:0/1813435126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa80103910 0x7ffa800ff9c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009880 tx=0x7ffa7402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:28:37.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.163+0000 7ffa84c27640 1 -- 172.21.15.170:0/1813435126 shutdown_connections 2024-09-04T16:28:37.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.163+0000 7ffa84c27640 1 --2- 172.21.15.170:0/1813435126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa80103910 0x7ffa800ff9c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:37.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.163+0000 7ffa84c27640 1 --2- 172.21.15.170:0/1813435126 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa80102f40 0x7ffa80103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:37.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.163+0000 7ffa84c27640 1 -- 172.21.15.170:0/1813435126 >> 172.21.15.170:0/1813435126 conn(0x7ffa800fb750 msgr2=0x7ffa800fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:28:37.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.163+0000 7ffa84c27640 1 -- 172.21.15.170:0/1813435126 shutdown_connections 2024-09-04T16:28:37.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.163+0000 7ffa84c27640 1 -- 172.21.15.170:0/1813435126 wait complete. 2024-09-04T16:28:37.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.164+0000 7ffa84c27640 1 Processor -- start 2024-09-04T16:28:37.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.164+0000 7ffa84c27640 1 -- start start 2024-09-04T16:28:37.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.164+0000 7ffa84c27640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa80102f40 0x7ffa80073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.164+0000 7ffa84c27640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa80103910 0x7ffa80073750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.164+0000 7ffa84c27640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8010a7a0 con 0x7ffa80102f40 2024-09-04T16:28:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.164+0000 7ffa84c27640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8010a620 con 0x7ffa80103910 2024-09-04T16:28:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.165+0000 7ffa7dd9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa80103910 0x7ffa80073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.165+0000 7ffa7e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa80102f40 0x7ffa80073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.165+0000 7ffa7dd9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa80103910 0x7ffa80073750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.170:37884/0 (socket says 172.21.15.170:37884) 2024-09-04T16:28:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.165+0000 7ffa7dd9b640 1 -- 172.21.15.170:0/225415899 learned_addr learned my addr 172.21.15.170:0/225415899 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:28:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.165+0000 7ffa7dd9b640 1 -- 172.21.15.170:0/225415899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa80102f40 msgr2=0x7ffa80073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.165+0000 7ffa7dd9b640 1 --2- 172.21.15.170:0/225415899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa80102f40 0x7ffa80073210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.165+0000 7ffa7dd9b640 1 -- 172.21.15.170:0/225415899 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa80073dd0 con 0x7ffa80103910 2024-09-04T16:28:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.165+0000 7ffa7dd9b640 1 --2- 172.21.15.170:0/225415899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa80103910 0x7ffa80073750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009230 tx=0x7ffa740045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:28:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.165+0000 7ffa6f7fe640 1 -- 172.21.15.170:0/225415899 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa7403f070 con 0x7ffa80103910 2024-09-04T16:28:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.166+0000 7ffa84c27640 1 -- 172.21.15.170:0/225415899 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa801a4f30 con 0x7ffa80103910 2024-09-04T16:28:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.166+0000 7ffa6f7fe640 1 -- 172.21.15.170:0/225415899 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa740049d0 con 0x7ffa80103910 2024-09-04T16:28:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.166+0000 7ffa6f7fe640 1 -- 172.21.15.170:0/225415899 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa74035030 con 0x7ffa80103910 2024-09-04T16:28:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.166+0000 7ffa84c27640 1 -- 172.21.15.170:0/225415899 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa80101000 con 0x7ffa80103910 2024-09-04T16:28:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.167+0000 7ffa84c27640 1 -- 172.21.15.170:0/225415899 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa80103340 con 0x7ffa80103910 2024-09-04T16:28:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.167+0000 7ffa6f7fe640 1 -- 172.21.15.170:0/225415899 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7ffa74042070 con 0x7ffa80103910 2024-09-04T16:28:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.168+0000 7ffa6f7fe640 1 --2- 172.21.15.170:0/225415899 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ffa6806de30 0x7ffa680702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:28:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.168+0000 7ffa6f7fe640 1 -- 172.21.15.170:0/225415899 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7ffa740ae740 con 0x7ffa80103910 2024-09-04T16:28:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.168+0000 7ffa7e59c640 1 --2- 172.21.15.170:0/225415899 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ffa6806de30 0x7ffa680702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:28:37.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.169+0000 7ffa7e59c640 1 --2- 172.21.15.170:0/225415899 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ffa6806de30 0x7ffa680702f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffa80069830 tx=0x7ffa70005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:28:37.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.177+0000 7ffa6f7fe640 1 -- 172.21.15.170:0/225415899 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa7407c280 con 0x7ffa80103910 2024-09-04T16:28:37.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.383+0000 7ffa84c27640 1 -- 172.21.15.170:0/225415899 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ffa8002db90 con 0x7ffa6806de30 2024-09-04T16:28:37.385 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:28:37.385 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:28:37.385 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:28:37.385 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-04T16:28:37.385 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [], 2024-09-04T16:28:37.385 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "0/2 daemons upgraded", 2024-09-04T16:28:37.385 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mgr daemons", 2024-09-04T16:28:37.386 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:28:37.386 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:28:37.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.384+0000 7ffa6f7fe640 1 -- 172.21.15.170:0/225415899 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7ffa70011b80 con 0x7ffa6806de30 2024-09-04T16:28:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.386+0000 7ffa84c27640 1 -- 172.21.15.170:0/225415899 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ffa6806de30 msgr2=0x7ffa680702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.386+0000 7ffa84c27640 1 --2- 172.21.15.170:0/225415899 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ffa6806de30 0x7ffa680702f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffa80069830 tx=0x7ffa70005f90 comp rx=0 tx=0).stop 2024-09-04T16:28:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.386+0000 7ffa84c27640 1 -- 172.21.15.170:0/225415899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa80103910 msgr2=0x7ffa80073750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:28:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.386+0000 7ffa84c27640 1 --2- 172.21.15.170:0/225415899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa80103910 0x7ffa80073750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009230 tx=0x7ffa740045e0 comp rx=0 tx=0).stop 2024-09-04T16:28:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.387+0000 7ffa84c27640 1 -- 172.21.15.170:0/225415899 shutdown_connections 2024-09-04T16:28:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.387+0000 7ffa84c27640 1 --2- 172.21.15.170:0/225415899 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7ffa6806de30 0x7ffa680702f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.387+0000 7ffa84c27640 1 --2- 172.21.15.170:0/225415899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa80103910 0x7ffa80073750 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.387+0000 7ffa84c27640 1 --2- 172.21.15.170:0/225415899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa80102f40 0x7ffa80073210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:28:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.387+0000 7ffa84c27640 1 -- 172.21.15.170:0/225415899 >> 172.21.15.170:0/225415899 conn(0x7ffa800fb750 msgr2=0x7ffa801061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:28:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.387+0000 7ffa84c27640 1 -- 172.21.15.170:0/225415899 shutdown_connections 2024-09-04T16:28:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:28:37.387+0000 7ffa84c27640 1 -- 172.21.15.170:0/225415899 wait complete. 2024-09-04T16:28:37.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:37 smithi193 ceph-mon[36288]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:28:37.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:37 smithi193 ceph-mon[36288]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:28:37.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:37 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:28:37.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:37 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:28:37.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:37 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/4143827301' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:28:37.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:37 smithi170 ceph-mon[29272]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:28:37.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:37 smithi170 ceph-mon[29272]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:28:37.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:37 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:28:37.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:37 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:28:37.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:37 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/4143827301' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:28:38.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:38 smithi193 ceph-mon[36288]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:28:38.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:38 smithi193 ceph-mon[36288]: Upgrade: Target is version 19.3.0-4702-gf9fcca52 (squid) 2024-09-04T16:28:38.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:38 smithi193 ceph-mon[36288]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, digests ['quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4'] 2024-09-04T16:28:38.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:38 smithi193 ceph-mon[36288]: Upgrade: Need to upgrade myself (mgr.smithi170.fbszap) 2024-09-04T16:28:38.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:38 smithi193 ceph-mon[36288]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:38.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:38 smithi193 ceph-mon[36288]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:28:38.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:38 smithi193 ceph-mon[36288]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 on smithi193 2024-09-04T16:28:38.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:38 smithi170 ceph-mon[29272]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:28:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:38 smithi170 ceph-mon[29272]: Upgrade: Target is version 19.3.0-4702-gf9fcca52 (squid) 2024-09-04T16:28:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:38 smithi170 ceph-mon[29272]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, digests ['quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4'] 2024-09-04T16:28:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:38 smithi170 ceph-mon[29272]: Upgrade: Need to upgrade myself (mgr.smithi170.fbszap) 2024-09-04T16:28:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:38 smithi170 ceph-mon[29272]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:38 smithi170 ceph-mon[29272]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:28:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:38 smithi170 ceph-mon[29272]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 on smithi193 2024-09-04T16:28:40.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:40 smithi193 ceph-mon[36288]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:40.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:40 smithi170 ceph-mon[29272]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:42.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:42 smithi193 ceph-mon[36288]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:42.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:42 smithi170 ceph-mon[29272]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:43.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:43 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:28:43.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:43 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:28:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:44 smithi193 ceph-mon[36288]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:44.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:44 smithi170 ceph-mon[29272]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:46 smithi193 ceph-mon[36288]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:46.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:46 smithi170 ceph-mon[29272]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:48.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:48 smithi193 ceph-mon[36288]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:48.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:48 smithi170 ceph-mon[29272]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:50 smithi193 ceph-mon[36288]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:50.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:50 smithi170 ceph-mon[29272]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:52.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:52 smithi193 ceph-mon[36288]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:52.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:52 smithi170 ceph-mon[29272]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:54.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:54 smithi170 ceph-mon[29272]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:54 smithi193 ceph-mon[36288]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:56.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:56 smithi170 ceph-mon[29272]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:56.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:56 smithi193 ceph-mon[36288]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:58.605 INFO:tasks.workunit.client.0.smithi170.stderr:Updating files: 99% (12666/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-04T16:28:58.746 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:58 smithi170 ceph-mon[29272]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:58.746 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:28:58 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:28:58.848 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:58 smithi193 ceph-mon[36288]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:28:58.848 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:28:58 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:28:59.439 INFO:tasks.workunit.client.0.smithi170.stderr:Note: switching to 'f9fcca5273b6971f640393d33a94730179073754'. 2024-09-04T16:28:59.439 INFO:tasks.workunit.client.0.smithi170.stderr: 2024-09-04T16:28:59.440 INFO:tasks.workunit.client.0.smithi170.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-04T16:28:59.440 INFO:tasks.workunit.client.0.smithi170.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-04T16:28:59.440 INFO:tasks.workunit.client.0.smithi170.stderr:state without impacting any branches by switching back to a branch. 2024-09-04T16:28:59.440 INFO:tasks.workunit.client.0.smithi170.stderr: 2024-09-04T16:28:59.440 INFO:tasks.workunit.client.0.smithi170.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-04T16:28:59.440 INFO:tasks.workunit.client.0.smithi170.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-04T16:28:59.440 INFO:tasks.workunit.client.0.smithi170.stderr: 2024-09-04T16:28:59.440 INFO:tasks.workunit.client.0.smithi170.stderr: git switch -c 2024-09-04T16:28:59.440 INFO:tasks.workunit.client.0.smithi170.stderr: 2024-09-04T16:28:59.440 INFO:tasks.workunit.client.0.smithi170.stderr:Or undo this operation with: 2024-09-04T16:28:59.440 INFO:tasks.workunit.client.0.smithi170.stderr: 2024-09-04T16:28:59.440 INFO:tasks.workunit.client.0.smithi170.stderr: git switch - 2024-09-04T16:28:59.440 INFO:tasks.workunit.client.0.smithi170.stderr: 2024-09-04T16:28:59.440 INFO:tasks.workunit.client.0.smithi170.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-04T16:28:59.441 INFO:tasks.workunit.client.0.smithi170.stderr: 2024-09-04T16:28:59.441 INFO:tasks.workunit.client.0.smithi170.stderr:HEAD is now at f9fcca5273b Merge branch 'wip-osd-id-raw' of https://github.com/guits/ceph into wip-guits-main-2024-09-04-1323 2024-09-04T16:28:59.446 DEBUG:teuthology.orchestra.run.smithi170:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-04T16:28:59.489 INFO:tasks.workunit.client.0.smithi170.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-04T16:28:59.491 INFO:tasks.workunit.client.0.smithi170.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-04T16:28:59.492 INFO:tasks.workunit.client.0.smithi170.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-04T16:29:00.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:00 smithi170 ceph-mon[29272]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:29:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:00 smithi193 ceph-mon[36288]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:29:01.661 INFO:tasks.workunit.client.1.smithi193.stderr:Updating files: 79% (10107/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-04T16:29:02.560 INFO:tasks.workunit.client.1.smithi193.stderr:Note: switching to 'f9fcca5273b6971f640393d33a94730179073754'. 2024-09-04T16:29:02.560 INFO:tasks.workunit.client.1.smithi193.stderr: 2024-09-04T16:29:02.561 INFO:tasks.workunit.client.1.smithi193.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-04T16:29:02.561 INFO:tasks.workunit.client.1.smithi193.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-04T16:29:02.561 INFO:tasks.workunit.client.1.smithi193.stderr:state without impacting any branches by switching back to a branch. 2024-09-04T16:29:02.561 INFO:tasks.workunit.client.1.smithi193.stderr: 2024-09-04T16:29:02.561 INFO:tasks.workunit.client.1.smithi193.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-04T16:29:02.561 INFO:tasks.workunit.client.1.smithi193.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-04T16:29:02.561 INFO:tasks.workunit.client.1.smithi193.stderr: 2024-09-04T16:29:02.561 INFO:tasks.workunit.client.1.smithi193.stderr: git switch -c 2024-09-04T16:29:02.561 INFO:tasks.workunit.client.1.smithi193.stderr: 2024-09-04T16:29:02.561 INFO:tasks.workunit.client.1.smithi193.stderr:Or undo this operation with: 2024-09-04T16:29:02.561 INFO:tasks.workunit.client.1.smithi193.stderr: 2024-09-04T16:29:02.561 INFO:tasks.workunit.client.1.smithi193.stderr: git switch - 2024-09-04T16:29:02.561 INFO:tasks.workunit.client.1.smithi193.stderr: 2024-09-04T16:29:02.561 INFO:tasks.workunit.client.1.smithi193.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-04T16:29:02.561 INFO:tasks.workunit.client.1.smithi193.stderr: 2024-09-04T16:29:02.562 INFO:tasks.workunit.client.1.smithi193.stderr:HEAD is now at f9fcca5273b Merge branch 'wip-osd-id-raw' of https://github.com/guits/ceph into wip-guits-main-2024-09-04-1323 2024-09-04T16:29:02.566 DEBUG:teuthology.orchestra.run.smithi193:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-04T16:29:02.631 INFO:tasks.workunit.client.1.smithi193.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-04T16:29:02.634 INFO:tasks.workunit.client.1.smithi193.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-04T16:29:02.634 INFO:tasks.workunit.client.1.smithi193.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-04T16:29:02.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:02 smithi170 ceph-mon[29272]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:29:02.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:02 smithi193 ceph-mon[36288]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:29:03.243 INFO:tasks.workunit.client.1.smithi193.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-04T16:29:03.317 INFO:tasks.workunit.client.1.smithi193.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-04T16:29:03.364 INFO:tasks.workunit.client.1.smithi193.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-04T16:29:03.365 INFO:tasks.workunit.client.1.smithi193.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-04T16:29:03.366 INFO:tasks.workunit.client.1.smithi193.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-04T16:29:03.414 INFO:tasks.workunit.client.1.smithi193.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-04T16:29:03.418 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-04T16:29:03.418 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-04T16:29:03.476 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-04T16:29:03.478 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-04T16:29:03.478 DEBUG:teuthology.orchestra.run.smithi193:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f9fcca5273b6971f640393d33a94730179073754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-04T16:29:03.546 INFO:tasks.workunit.client.1.smithi193.stderr:+ mkdir -p fsstress 2024-09-04T16:29:03.549 INFO:tasks.workunit.client.1.smithi193.stderr:+ pushd fsstress 2024-09-04T16:29:03.550 INFO:tasks.workunit.client.1.smithi193.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-04T16:29:03.551 INFO:tasks.workunit.client.1.smithi193.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-04T16:29:04.165 INFO:tasks.workunit.client.1.smithi193.stderr:+ tar xzf ltp-full.tgz 2024-09-04T16:29:04.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:04 smithi170 ceph-mon[29272]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:29:04.905 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:04 smithi193 ceph-mon[36288]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:29:05.170 INFO:tasks.workunit.client.0.smithi170.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-04T16:29:05.466 INFO:tasks.workunit.client.0.smithi170.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-04T16:29:05.626 INFO:tasks.workunit.client.0.smithi170.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-04T16:29:05.627 INFO:tasks.workunit.client.0.smithi170.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-04T16:29:05.627 INFO:tasks.workunit.client.0.smithi170.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-04T16:29:05.705 INFO:tasks.workunit.client.0.smithi170.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-04T16:29:05.724 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:29:05.724 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-04T16:29:05.740 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-04T16:29:05.742 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-04T16:29:05.742 DEBUG:teuthology.orchestra.run.smithi170:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f9fcca5273b6971f640393d33a94730179073754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-04T16:29:05.805 INFO:tasks.workunit.client.0.smithi170.stderr:+ mkdir -p fsstress 2024-09-04T16:29:05.807 INFO:tasks.workunit.client.0.smithi170.stderr:+ pushd fsstress 2024-09-04T16:29:05.808 INFO:tasks.workunit.client.0.smithi170.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-04T16:29:05.809 INFO:tasks.workunit.client.0.smithi170.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-04T16:29:06.682 INFO:tasks.workunit.client.0.smithi170.stderr:+ tar xzf ltp-full.tgz 2024-09-04T16:29:06.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:06 smithi170 ceph-mon[29272]: pgmap v224: 65 pgs: 65 active+clean; 605 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 0 op/s 2024-09-04T16:29:06.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:06 smithi193 ceph-mon[36288]: pgmap v224: 65 pgs: 65 active+clean; 605 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 0 op/s 2024-09-04T16:29:07.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.490+0000 7f698dd9b640 1 -- 172.21.15.170:0/3458874832 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6980035020 con 0x7f6990100840 2024-09-04T16:29:07.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.490+0000 7f6994f03640 1 -- 172.21.15.170:0/3458874832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6990100840 msgr2=0x7f6990100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:07.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.490+0000 7f6994f03640 1 --2- 172.21.15.170:0/3458874832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6990100840 0x7f6990100c40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6980009880 tx=0x7f698002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:29:07.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.490+0000 7f6994f03640 1 -- 172.21.15.170:0/3458874832 shutdown_connections 2024-09-04T16:29:07.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.491+0000 7f6994f03640 1 --2- 172.21.15.170:0/3458874832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6990101a40 0x7f6990101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:07.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.491+0000 7f6994f03640 1 --2- 172.21.15.170:0/3458874832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6990100840 0x7f6990100c40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:07.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.491+0000 7f6994f03640 1 -- 172.21.15.170:0/3458874832 >> 172.21.15.170:0/3458874832 conn(0x7f69900fbff0 msgr2=0x7f69900fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:07.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.491+0000 7f6994f03640 1 -- 172.21.15.170:0/3458874832 shutdown_connections 2024-09-04T16:29:07.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.491+0000 7f6994f03640 1 -- 172.21.15.170:0/3458874832 wait complete. 2024-09-04T16:29:07.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.492+0000 7f6994f03640 1 Processor -- start 2024-09-04T16:29:07.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.492+0000 7f6994f03640 1 -- start start 2024-09-04T16:29:07.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.492+0000 7f6994f03640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6990100840 0x7f699019da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:07.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.492+0000 7f6994f03640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6990101a40 0x7f699019dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:07.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.492+0000 7f6994f03640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6990108550 con 0x7f6990100840 2024-09-04T16:29:07.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.492+0000 7f6994f03640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f69901083d0 con 0x7f6990101a40 2024-09-04T16:29:07.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.493+0000 7f698e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6990100840 0x7f699019da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:07.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.493+0000 7f6987fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6990101a40 0x7f699019dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:07.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.493+0000 7f6987fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6990101a40 0x7f699019dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.170:60762/0 (socket says 172.21.15.170:60762) 2024-09-04T16:29:07.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.493+0000 7f6987fff640 1 -- 172.21.15.170:0/1237840014 learned_addr learned my addr 172.21.15.170:0/1237840014 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:29:07.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.493+0000 7f6987fff640 1 -- 172.21.15.170:0/1237840014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6990100840 msgr2=0x7f699019da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:07.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.493+0000 7f6987fff640 1 --2- 172.21.15.170:0/1237840014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6990100840 0x7f699019da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:07.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.493+0000 7f6987fff640 1 -- 172.21.15.170:0/1237840014 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699019e650 con 0x7f6990101a40 2024-09-04T16:29:07.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.493+0000 7f6987fff640 1 --2- 172.21.15.170:0/1237840014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6990101a40 0x7f699019dfd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f697800e9e0 tx=0x7f697800eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:07.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.494+0000 7f69877fe640 1 -- 172.21.15.170:0/1237840014 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f697800cb50 con 0x7f6990101a40 2024-09-04T16:29:07.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.494+0000 7f69877fe640 1 -- 172.21.15.170:0/1237840014 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f697800ccf0 con 0x7f6990101a40 2024-09-04T16:29:07.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.494+0000 7f6994f03640 1 -- 172.21.15.170:0/1237840014 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69901a3090 con 0x7f6990101a40 2024-09-04T16:29:07.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.494+0000 7f69877fe640 1 -- 172.21.15.170:0/1237840014 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69780049d0 con 0x7f6990101a40 2024-09-04T16:29:07.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.494+0000 7f6994f03640 1 -- 172.21.15.170:0/1237840014 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69901a3620 con 0x7f6990101a40 2024-09-04T16:29:07.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.496+0000 7f6994f03640 1 -- 172.21.15.170:0/1237840014 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69700052c0 con 0x7f6990101a40 2024-09-04T16:29:07.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.496+0000 7f69877fe640 1 -- 172.21.15.170:0/1237840014 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f6978004b90 con 0x7f6990101a40 2024-09-04T16:29:07.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.497+0000 7f69877fe640 1 --2- 172.21.15.170:0/1237840014 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f697c06de90 0x7f697c070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:07.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.497+0000 7f69877fe640 1 -- 172.21.15.170:0/1237840014 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f697808dbc0 con 0x7f6990101a40 2024-09-04T16:29:07.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.497+0000 7f698e59c640 1 --2- 172.21.15.170:0/1237840014 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f697c06de90 0x7f697c070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:07.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.497+0000 7f698e59c640 1 --2- 172.21.15.170:0/1237840014 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f697c06de90 0x7f697c070350 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6980006010 tx=0x7f6980004f20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:07.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.502+0000 7f69877fe640 1 -- 172.21.15.170:0/1237840014 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f697805b780 con 0x7f6990101a40 2024-09-04T16:29:07.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.739+0000 7f6994f03640 1 -- 172.21.15.170:0/1237840014 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6970000bf0 con 0x7f697c06de90 2024-09-04T16:29:07.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.740+0000 7f69877fe640 1 -- 172.21.15.170:0/1237840014 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f6970000bf0 con 0x7f697c06de90 2024-09-04T16:29:07.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.743+0000 7f6994f03640 1 -- 172.21.15.170:0/1237840014 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f697c06de90 msgr2=0x7f697c070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:07.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.743+0000 7f6994f03640 1 --2- 172.21.15.170:0/1237840014 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f697c06de90 0x7f697c070350 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6980006010 tx=0x7f6980004f20 comp rx=0 tx=0).stop 2024-09-04T16:29:07.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.743+0000 7f6994f03640 1 -- 172.21.15.170:0/1237840014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6990101a40 msgr2=0x7f699019dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:07.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.743+0000 7f6994f03640 1 --2- 172.21.15.170:0/1237840014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6990101a40 0x7f699019dfd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f697800e9e0 tx=0x7f697800eea0 comp rx=0 tx=0).stop 2024-09-04T16:29:07.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.743+0000 7f6994f03640 1 -- 172.21.15.170:0/1237840014 shutdown_connections 2024-09-04T16:29:07.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.743+0000 7f6994f03640 1 --2- 172.21.15.170:0/1237840014 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f697c06de90 0x7f697c070350 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:07.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.743+0000 7f6994f03640 1 --2- 172.21.15.170:0/1237840014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6990101a40 0x7f699019dfd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:07.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.743+0000 7f6994f03640 1 --2- 172.21.15.170:0/1237840014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6990100840 0x7f699019da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:07.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.743+0000 7f6994f03640 1 -- 172.21.15.170:0/1237840014 >> 172.21.15.170:0/1237840014 conn(0x7f69900fbff0 msgr2=0x7f6990104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:07.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.744+0000 7f6994f03640 1 -- 172.21.15.170:0/1237840014 shutdown_connections 2024-09-04T16:29:07.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.744+0000 7f6994f03640 1 -- 172.21.15.170:0/1237840014 wait complete. 2024-09-04T16:29:07.754 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:29:07.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.852+0000 7f11183bc640 1 -- 172.21.15.170:0/1955925311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1110100b40 msgr2=0x7f1110100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:07.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.852+0000 7f11183bc640 1 --2- 172.21.15.170:0/1955925311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1110100b40 0x7f1110100fa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1100009880 tx=0x7f110002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:29:07.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.852+0000 7f11183bc640 1 -- 172.21.15.170:0/1955925311 shutdown_connections 2024-09-04T16:29:07.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.852+0000 7f11183bc640 1 --2- 172.21.15.170:0/1955925311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1110100b40 0x7f1110100fa0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:07.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.852+0000 7f11183bc640 1 --2- 172.21.15.170:0/1955925311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1110100200 0x7f1110100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:07.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.852+0000 7f11183bc640 1 -- 172.21.15.170:0/1955925311 >> 172.21.15.170:0/1955925311 conn(0x7f11100fbff0 msgr2=0x7f11100fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:07.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.852+0000 7f11183bc640 1 -- 172.21.15.170:0/1955925311 shutdown_connections 2024-09-04T16:29:07.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.852+0000 7f11183bc640 1 -- 172.21.15.170:0/1955925311 wait complete. 2024-09-04T16:29:07.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.853+0000 7f11183bc640 1 Processor -- start 2024-09-04T16:29:07.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.853+0000 7f11183bc640 1 -- start start 2024-09-04T16:29:07.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.853+0000 7f11183bc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1110100200 0x7f1110199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:07.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.853+0000 7f11183bc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1110100b40 0x7f1110199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:07.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.853+0000 7f11183bc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f111010c950 con 0x7f1110100200 2024-09-04T16:29:07.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.853+0000 7f11183bc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f111010c7d0 con 0x7f1110100b40 2024-09-04T16:29:07.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.853+0000 7f1116158640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1110100200 0x7f1110199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:07.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.853+0000 7f1116158640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1110100200 0x7f1110199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:34360/0 (socket says 172.21.15.170:34360) 2024-09-04T16:29:07.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.853+0000 7f1116158640 1 -- 172.21.15.170:0/540140135 learned_addr learned my addr 172.21.15.170:0/540140135 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:29:07.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.853+0000 7f1115957640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1110100b40 0x7f1110199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:07.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.853+0000 7f1115957640 1 -- 172.21.15.170:0/540140135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1110100200 msgr2=0x7f1110199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:07.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.853+0000 7f1115957640 1 --2- 172.21.15.170:0/540140135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1110100200 0x7f1110199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:07.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.853+0000 7f1115957640 1 -- 172.21.15.170:0/540140135 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111019a210 con 0x7f1110100b40 2024-09-04T16:29:07.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.853+0000 7f1116158640 1 --2- 172.21.15.170:0/540140135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1110100200 0x7f1110199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:29:07.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.854+0000 7f1115957640 1 --2- 172.21.15.170:0/540140135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1110100b40 0x7f1110199b90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1100009230 tx=0x7f11000045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:07.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.854+0000 7f11077fe640 1 -- 172.21.15.170:0/540140135 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f110003f070 con 0x7f1110100b40 2024-09-04T16:29:07.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.854+0000 7f11077fe640 1 -- 172.21.15.170:0/540140135 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f11000049d0 con 0x7f1110100b40 2024-09-04T16:29:07.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.854+0000 7f11183bc640 1 -- 172.21.15.170:0/540140135 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111019ebf0 con 0x7f1110100b40 2024-09-04T16:29:07.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.854+0000 7f11077fe640 1 -- 172.21.15.170:0/540140135 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1100035030 con 0x7f1110100b40 2024-09-04T16:29:07.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.854+0000 7f11183bc640 1 -- 172.21.15.170:0/540140135 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f111019f180 con 0x7f1110100b40 2024-09-04T16:29:07.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.855+0000 7f11183bc640 1 -- 172.21.15.170:0/540140135 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1110100600 con 0x7f1110100b40 2024-09-04T16:29:07.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.855+0000 7f11077fe640 1 -- 172.21.15.170:0/540140135 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f1100042070 con 0x7f1110100b40 2024-09-04T16:29:07.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.856+0000 7f11077fe640 1 --2- 172.21.15.170:0/540140135 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f10fc06de30 0x7f10fc0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:07.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.856+0000 7f11077fe640 1 -- 172.21.15.170:0/540140135 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f11000ae5b0 con 0x7f1110100b40 2024-09-04T16:29:07.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.856+0000 7f1116158640 1 --2- 172.21.15.170:0/540140135 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f10fc06de30 0x7f10fc0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:07.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.857+0000 7f1116158640 1 --2- 172.21.15.170:0/540140135 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f10fc06de30 0x7f10fc0702f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f110c011550 tx=0x7f110c005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:07.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:07.860+0000 7f11077fe640 1 -- 172.21.15.170:0/540140135 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f110007fd40 con 0x7f1110100b40 2024-09-04T16:29:08.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.142+0000 7f11183bc640 1 -- 172.21.15.170:0/540140135 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1110109ba0 con 0x7f10fc06de30 2024-09-04T16:29:08.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.143+0000 7f11077fe640 1 -- 172.21.15.170:0/540140135 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f1110109ba0 con 0x7f10fc06de30 2024-09-04T16:29:08.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.146+0000 7f11183bc640 1 -- 172.21.15.170:0/540140135 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f10fc06de30 msgr2=0x7f10fc0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:08.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.146+0000 7f11183bc640 1 --2- 172.21.15.170:0/540140135 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f10fc06de30 0x7f10fc0702f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f110c011550 tx=0x7f110c005f90 comp rx=0 tx=0).stop 2024-09-04T16:29:08.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.146+0000 7f11183bc640 1 -- 172.21.15.170:0/540140135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1110100b40 msgr2=0x7f1110199b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:08.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.146+0000 7f11183bc640 1 --2- 172.21.15.170:0/540140135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1110100b40 0x7f1110199b90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1100009230 tx=0x7f11000045e0 comp rx=0 tx=0).stop 2024-09-04T16:29:08.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.146+0000 7f11183bc640 1 -- 172.21.15.170:0/540140135 shutdown_connections 2024-09-04T16:29:08.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.146+0000 7f11183bc640 1 --2- 172.21.15.170:0/540140135 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f10fc06de30 0x7f10fc0702f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:08.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.146+0000 7f11183bc640 1 --2- 172.21.15.170:0/540140135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1110100b40 0x7f1110199b90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:08.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.146+0000 7f11183bc640 1 --2- 172.21.15.170:0/540140135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1110100200 0x7f1110199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:08.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.146+0000 7f11183bc640 1 -- 172.21.15.170:0/540140135 >> 172.21.15.170:0/540140135 conn(0x7f11100fbff0 msgr2=0x7f11100fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:08.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.147+0000 7f11183bc640 1 -- 172.21.15.170:0/540140135 shutdown_connections 2024-09-04T16:29:08.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.147+0000 7f11183bc640 1 -- 172.21.15.170:0/540140135 wait complete. 2024-09-04T16:29:08.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.261+0000 7fa1e5b00640 1 -- 172.21.15.170:0/42079514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1e0100840 msgr2=0x7fa1e0100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:08.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.261+0000 7fa1e5b00640 1 --2- 172.21.15.170:0/42079514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1e0100840 0x7fa1e0100c40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009880 tx=0x7fa1d002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:29:08.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.261+0000 7fa1e5b00640 1 -- 172.21.15.170:0/42079514 shutdown_connections 2024-09-04T16:29:08.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.261+0000 7fa1e5b00640 1 --2- 172.21.15.170:0/42079514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1e0101a40 0x7fa1e0101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:08.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.261+0000 7fa1e5b00640 1 --2- 172.21.15.170:0/42079514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1e0100840 0x7fa1e0100c40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:08.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.261+0000 7fa1e5b00640 1 -- 172.21.15.170:0/42079514 >> 172.21.15.170:0/42079514 conn(0x7fa1e00fbff0 msgr2=0x7fa1e00fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:08.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.262+0000 7fa1e5b00640 1 -- 172.21.15.170:0/42079514 shutdown_connections 2024-09-04T16:29:08.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.262+0000 7fa1e5b00640 1 -- 172.21.15.170:0/42079514 wait complete. 2024-09-04T16:29:08.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.263+0000 7fa1e5b00640 1 Processor -- start 2024-09-04T16:29:08.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.263+0000 7fa1e5b00640 1 -- start start 2024-09-04T16:29:08.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.263+0000 7fa1e5b00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1e0100840 0x7fa1e0104760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:08.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.263+0000 7fa1e5b00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1e0101a40 0x7fa1e0102e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:08.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.263+0000 7fa1e5b00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e0109660 con 0x7fa1e0100840 2024-09-04T16:29:08.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.263+0000 7fa1e5b00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e01094e0 con 0x7fa1e0101a40 2024-09-04T16:29:08.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.263+0000 7fa1df7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1e0100840 0x7fa1e0104760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:08.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.263+0000 7fa1df7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1e0100840 0x7fa1e0104760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:34366/0 (socket says 172.21.15.170:34366) 2024-09-04T16:29:08.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.263+0000 7fa1df7fe640 1 -- 172.21.15.170:0/1354034758 learned_addr learned my addr 172.21.15.170:0/1354034758 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:29:08.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.263+0000 7fa1deffd640 1 --2- 172.21.15.170:0/1354034758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1e0101a40 0x7fa1e0102e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:08.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.263+0000 7fa1df7fe640 1 -- 172.21.15.170:0/1354034758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1e0101a40 msgr2=0x7fa1e0102e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:08.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.263+0000 7fa1df7fe640 1 --2- 172.21.15.170:0/1354034758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1e0101a40 0x7fa1e0102e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:08.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.263+0000 7fa1df7fe640 1 -- 172.21.15.170:0/1354034758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e0103360 con 0x7fa1e0100840 2024-09-04T16:29:08.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.264+0000 7fa1deffd640 1 --2- 172.21.15.170:0/1354034758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1e0101a40 0x7fa1e0102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:29:08.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.264+0000 7fa1df7fe640 1 --2- 172.21.15.170:0/1354034758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1e0100840 0x7fa1e0104760 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00045e0 tx=0x7fa1d0004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:08.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.264+0000 7fa1dcff9640 1 -- 172.21.15.170:0/1354034758 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa1d003f070 con 0x7fa1e0100840 2024-09-04T16:29:08.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.264+0000 7fa1dcff9640 1 -- 172.21.15.170:0/1354034758 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa1d0004a90 con 0x7fa1e0100840 2024-09-04T16:29:08.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.264+0000 7fa1dcff9640 1 -- 172.21.15.170:0/1354034758 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa1d0035030 con 0x7fa1e0100840 2024-09-04T16:29:08.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.264+0000 7fa1e5b00640 1 -- 172.21.15.170:0/1354034758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e01035f0 con 0x7fa1e0100840 2024-09-04T16:29:08.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.264+0000 7fa1e5b00640 1 -- 172.21.15.170:0/1354034758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e0103b20 con 0x7fa1e0100840 2024-09-04T16:29:08.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.265+0000 7fa1e5b00640 1 -- 172.21.15.170:0/1354034758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e0100c40 con 0x7fa1e0100840 2024-09-04T16:29:08.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.266+0000 7fa1dcff9640 1 -- 172.21.15.170:0/1354034758 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7fa1d0042070 con 0x7fa1e0100840 2024-09-04T16:29:08.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.267+0000 7fa1dcff9640 1 --2- 172.21.15.170:0/1354034758 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa1c806de90 0x7fa1c8070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:08.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.267+0000 7fa1dcff9640 1 -- 172.21.15.170:0/1354034758 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fa1d00ae520 con 0x7fa1e0100840 2024-09-04T16:29:08.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.267+0000 7fa1deffd640 1 --2- 172.21.15.170:0/1354034758 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa1c806de90 0x7fa1c8070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:08.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.268+0000 7fa1deffd640 1 --2- 172.21.15.170:0/1354034758 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa1c806de90 0x7fa1c8070350 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa1e01044e0 tx=0x7fa1d4005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:08.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.272+0000 7fa1dcff9640 1 -- 172.21.15.170:0/1354034758 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1d007fd90 con 0x7fa1e0100840 2024-09-04T16:29:08.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.553+0000 7fa1e5b00640 1 -- 172.21.15.170:0/1354034758 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa1e006a2d0 con 0x7fa1c806de90 2024-09-04T16:29:08.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.569+0000 7fa1dcff9640 1 -- 172.21.15.170:0/1354034758 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fa1e006a2d0 con 0x7fa1c806de90 2024-09-04T16:29:08.569 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:29:08.569 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (5m) 81s ago 6m 26.0M - 0.25.0 c8568f914cd2 e85db6a2e731 2024-09-04T16:29:08.569 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (7m) 81s ago 7m 8358k - 19.1.1-252-g48920dab b708f9119ac7 8499640d7363 2024-09-04T16:29:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (6m) 85s ago 6m 5268k - 19.1.1-252-g48920dab b708f9119ac7 f9a24a1cb9dd 2024-09-04T16:29:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (7m) 81s ago 7m 6891k - 19.1.1-252-g48920dab b708f9119ac7 aa2ec5c5776a 2024-09-04T16:29:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (6m) 85s ago 6m 6895k - 19.1.1-252-g48920dab b708f9119ac7 a24f0ce3b3fb 2024-09-04T16:29:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (5m) 81s ago 6m 76.3M - 9.4.12 2bacad6d85d8 5bffd3332aba 2024-09-04T16:29:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (98s) 81s ago 97s 16.3M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:29:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (104s) 81s ago 103s 17.3M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:29:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (95s) 85s ago 95s 12.1M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:29:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (101s) 85s ago 100s 11.3M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:29:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:9283,8765,8443 running (8m) 81s ago 8m 498M - 19.1.1-252-g48920dab b708f9119ac7 3f0663652a64 2024-09-04T16:29:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (6m) 85s ago 6m 440M - 19.1.1-252-g48920dab b708f9119ac7 1a44816379f1 2024-09-04T16:29:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (8m) 81s ago 8m 49.0M 2048M 19.1.1-252-g48920dab b708f9119ac7 194ff39cc041 2024-09-04T16:29:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (6m) 85s ago 5m 35.1M 2048M 19.1.1-252-g48920dab b708f9119ac7 38c8e99ca323 2024-09-04T16:29:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (7m) 81s ago 7m 15.7M - 1.5.0 0da6a335fe13 e311ba1b18bc 2024-09-04T16:29:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (6m) 85s ago 6m 15.9M - 1.5.0 0da6a335fe13 09fd1aa1fdb6 2024-09-04T16:29:08.571 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (4m) 81s ago 4m 54.5M 3946M 19.1.1-252-g48920dab b708f9119ac7 6c2ea484615d 2024-09-04T16:29:08.571 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (4m) 81s ago 4m 56.7M 3946M 19.1.1-252-g48920dab b708f9119ac7 20469ba5727b 2024-09-04T16:29:08.571 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (4m) 81s ago 3m 48.4M 3946M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:29:08.571 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (3m) 85s ago 3m 52.4M 4970M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:29:08.571 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (3m) 85s ago 3m 43.0M 4970M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:29:08.571 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (2m) 85s ago 2m 49.6M 4970M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:29:08.571 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (5m) 81s ago 6m 55.7M - 2.43.0 a07b618ecd1d 58faf9d631cd 2024-09-04T16:29:08.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.571+0000 7fa1e5b00640 1 -- 172.21.15.170:0/1354034758 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa1c806de90 msgr2=0x7fa1c8070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:08.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.571+0000 7fa1e5b00640 1 --2- 172.21.15.170:0/1354034758 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa1c806de90 0x7fa1c8070350 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa1e01044e0 tx=0x7fa1d4005f90 comp rx=0 tx=0).stop 2024-09-04T16:29:08.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.571+0000 7fa1e5b00640 1 -- 172.21.15.170:0/1354034758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1e0100840 msgr2=0x7fa1e0104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:08.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.571+0000 7fa1e5b00640 1 --2- 172.21.15.170:0/1354034758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1e0100840 0x7fa1e0104760 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00045e0 tx=0x7fa1d0004610 comp rx=0 tx=0).stop 2024-09-04T16:29:08.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.571+0000 7fa1e5b00640 1 -- 172.21.15.170:0/1354034758 shutdown_connections 2024-09-04T16:29:08.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.571+0000 7fa1e5b00640 1 --2- 172.21.15.170:0/1354034758 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7fa1c806de90 0x7fa1c8070350 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:08.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.571+0000 7fa1e5b00640 1 --2- 172.21.15.170:0/1354034758 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1e0101a40 0x7fa1e0102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:08.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.571+0000 7fa1e5b00640 1 --2- 172.21.15.170:0/1354034758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1e0100840 0x7fa1e0104760 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:08.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.571+0000 7fa1e5b00640 1 -- 172.21.15.170:0/1354034758 >> 172.21.15.170:0/1354034758 conn(0x7fa1e00fbff0 msgr2=0x7fa1e0069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:08.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.572+0000 7fa1e5b00640 1 -- 172.21.15.170:0/1354034758 shutdown_connections 2024-09-04T16:29:08.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.572+0000 7fa1e5b00640 1 -- 172.21.15.170:0/1354034758 wait complete. 2024-09-04T16:29:08.683 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:08 smithi170 ceph-mon[29272]: pgmap v225: 65 pgs: 65 active+clean; 12 MiB data, 214 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 963 KiB/s wr, 16 op/s 2024-09-04T16:29:08.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.683+0000 7f01c5469640 1 -- 172.21.15.170:0/3273657189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c0101980 msgr2=0x7f01c0101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:08.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.683+0000 7f01c5469640 1 --2- 172.21.15.170:0/3273657189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c0101980 0x7f01c0101d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f01b0009880 tx=0x7f01b002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:29:08.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.683+0000 7f01c5469640 1 -- 172.21.15.170:0/3273657189 shutdown_connections 2024-09-04T16:29:08.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.683+0000 7f01c5469640 1 --2- 172.21.15.170:0/3273657189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01c0102b80 0x7f01c0103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:08.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.683+0000 7f01c5469640 1 --2- 172.21.15.170:0/3273657189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c0101980 0x7f01c0101d80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:08.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.683+0000 7f01c5469640 1 -- 172.21.15.170:0/3273657189 >> 172.21.15.170:0/3273657189 conn(0x7f01c00fd110 msgr2=0x7f01c00ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:08.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.683+0000 7f01c5469640 1 -- 172.21.15.170:0/3273657189 shutdown_connections 2024-09-04T16:29:08.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.683+0000 7f01c5469640 1 -- 172.21.15.170:0/3273657189 wait complete. 2024-09-04T16:29:08.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.684+0000 7f01c5469640 1 Processor -- start 2024-09-04T16:29:08.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.685+0000 7f01c5469640 1 -- start start 2024-09-04T16:29:08.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.685+0000 7f01c5469640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c0101980 0x7f01c0195300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:08.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.685+0000 7f01c5469640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01c0102b80 0x7f01c0195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:08.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.685+0000 7f01c5469640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f01c010a7a0 con 0x7f01c0101980 2024-09-04T16:29:08.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.685+0000 7f01c5469640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f01c010a620 con 0x7f01c0102b80 2024-09-04T16:29:08.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.685+0000 7f01beffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c0101980 0x7f01c0195300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:08.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.685+0000 7f01beffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c0101980 0x7f01c0195300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:34382/0 (socket says 172.21.15.170:34382) 2024-09-04T16:29:08.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.685+0000 7f01beffd640 1 -- 172.21.15.170:0/1634652804 learned_addr learned my addr 172.21.15.170:0/1634652804 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:29:08.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.685+0000 7f01b7fff640 1 --2- 172.21.15.170:0/1634652804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01c0102b80 0x7f01c0195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:08.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.686+0000 7f01b7fff640 1 -- 172.21.15.170:0/1634652804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c0101980 msgr2=0x7f01c0195300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:08.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.686+0000 7f01b7fff640 1 --2- 172.21.15.170:0/1634652804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c0101980 0x7f01c0195300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:08.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.686+0000 7f01b7fff640 1 -- 172.21.15.170:0/1634652804 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c0195ec0 con 0x7f01c0102b80 2024-09-04T16:29:08.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.686+0000 7f01b7fff640 1 --2- 172.21.15.170:0/1634652804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01c0102b80 0x7f01c0195840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f01a800e970 tx=0x7f01a800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:08.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.686+0000 7f01bcff9640 1 -- 172.21.15.170:0/1634652804 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01a800cac0 con 0x7f01c0102b80 2024-09-04T16:29:08.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.686+0000 7f01c5469640 1 -- 172.21.15.170:0/1634652804 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c019a900 con 0x7f01c0102b80 2024-09-04T16:29:08.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.686+0000 7f01c5469640 1 -- 172.21.15.170:0/1634652804 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c019ae90 con 0x7f01c0102b80 2024-09-04T16:29:08.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.686+0000 7f01bcff9640 1 -- 172.21.15.170:0/1634652804 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f01a800cc60 con 0x7f01c0102b80 2024-09-04T16:29:08.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.686+0000 7f01bcff9640 1 -- 172.21.15.170:0/1634652804 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01a8010430 con 0x7f01c0102b80 2024-09-04T16:29:08.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.687+0000 7f01c5469640 1 -- 172.21.15.170:0/1634652804 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a0005290 con 0x7f01c0102b80 2024-09-04T16:29:08.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.688+0000 7f01bcff9640 1 -- 172.21.15.170:0/1634652804 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f01a80106e0 con 0x7f01c0102b80 2024-09-04T16:29:08.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.688+0000 7f01bcff9640 1 --2- 172.21.15.170:0/1634652804 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f01ac06de90 0x7f01ac070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:08.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.689+0000 7f01beffd640 1 --2- 172.21.15.170:0/1634652804 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f01ac06de90 0x7f01ac070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:08.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.689+0000 7f01bcff9640 1 -- 172.21.15.170:0/1634652804 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f01a808dff0 con 0x7f01c0102b80 2024-09-04T16:29:08.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.689+0000 7f01beffd640 1 --2- 172.21.15.170:0/1634652804 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f01ac06de90 0x7f01ac070350 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f01b0000c00 tx=0x7f01b00058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:08.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:08.694+0000 7f01bcff9640 1 -- 172.21.15.170:0/1634652804 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01a805f800 con 0x7f01c0102b80 2024-09-04T16:29:08.849 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:08 smithi193 ceph-mon[36288]: pgmap v225: 65 pgs: 65 active+clean; 12 MiB data, 214 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 963 KiB/s wr, 16 op/s 2024-09-04T16:29:09.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.049+0000 7f01c5469640 1 -- 172.21.15.170:0/1634652804 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f01a0005d90 con 0x7f01c0102b80 2024-09-04T16:29:09.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.050+0000 7f01bcff9640 1 -- 172.21.15.170:0/1634652804 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7f01a8064030 con 0x7f01c0102b80 2024-09-04T16:29:09.050 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:29:09.051 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:29:09.051 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 2 2024-09-04T16:29:09.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:29:09.051 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:29:09.051 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 2 2024-09-04T16:29:09.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:29:09.051 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:29:09.051 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 6 2024-09-04T16:29:09.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:29:09.051 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:29:09.051 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:29:09.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:29:09.052 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:29:09.052 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 14 2024-09-04T16:29:09.052 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:29:09.052 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:29:09.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.052+0000 7f01c5469640 1 -- 172.21.15.170:0/1634652804 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f01ac06de90 msgr2=0x7f01ac070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:09.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.052+0000 7f01c5469640 1 --2- 172.21.15.170:0/1634652804 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f01ac06de90 0x7f01ac070350 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f01b0000c00 tx=0x7f01b00058d0 comp rx=0 tx=0).stop 2024-09-04T16:29:09.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.052+0000 7f01c5469640 1 -- 172.21.15.170:0/1634652804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01c0102b80 msgr2=0x7f01c0195840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:09.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.052+0000 7f01c5469640 1 --2- 172.21.15.170:0/1634652804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01c0102b80 0x7f01c0195840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f01a800e970 tx=0x7f01a800ee30 comp rx=0 tx=0).stop 2024-09-04T16:29:09.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.053+0000 7f01c5469640 1 -- 172.21.15.170:0/1634652804 shutdown_connections 2024-09-04T16:29:09.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.053+0000 7f01c5469640 1 --2- 172.21.15.170:0/1634652804 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f01ac06de90 0x7f01ac070350 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:09.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.053+0000 7f01c5469640 1 --2- 172.21.15.170:0/1634652804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01c0102b80 0x7f01c0195840 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:09.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.053+0000 7f01c5469640 1 --2- 172.21.15.170:0/1634652804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c0101980 0x7f01c0195300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:09.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.053+0000 7f01c5469640 1 -- 172.21.15.170:0/1634652804 >> 172.21.15.170:0/1634652804 conn(0x7f01c00fd110 msgr2=0x7f01c00746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:09.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.053+0000 7f01c5469640 1 -- 172.21.15.170:0/1634652804 shutdown_connections 2024-09-04T16:29:09.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.053+0000 7f01c5469640 1 -- 172.21.15.170:0/1634652804 wait complete. 2024-09-04T16:29:09.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.168+0000 7f10f46e3640 1 -- 172.21.15.170:0/153482193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10ec104d60 msgr2=0x7f10ec107150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:09.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.168+0000 7f10f46e3640 1 --2- 172.21.15.170:0/153482193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10ec104d60 0x7f10ec107150 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009880 tx=0x7f10dc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:29:09.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.168+0000 7f10f46e3640 1 -- 172.21.15.170:0/153482193 shutdown_connections 2024-09-04T16:29:09.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.168+0000 7f10f46e3640 1 --2- 172.21.15.170:0/153482193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10ec104d60 0x7f10ec107150 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:09.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.168+0000 7f10f46e3640 1 --2- 172.21.15.170:0/153482193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10ec102430 0x7f10ec104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:09.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.168+0000 7f10f46e3640 1 -- 172.21.15.170:0/153482193 >> 172.21.15.170:0/153482193 conn(0x7f10ec0fbff0 msgr2=0x7f10ec0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:09.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.168+0000 7f10f46e3640 1 -- 172.21.15.170:0/153482193 shutdown_connections 2024-09-04T16:29:09.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.168+0000 7f10f46e3640 1 -- 172.21.15.170:0/153482193 wait complete. 2024-09-04T16:29:09.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.169+0000 7f10f46e3640 1 Processor -- start 2024-09-04T16:29:09.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.169+0000 7f10f46e3640 1 -- start start 2024-09-04T16:29:09.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.170+0000 7f10f46e3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10ec102430 0x7f10ec197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:09.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.170+0000 7f10f46e3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10ec104d60 0x7f10ec1979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:09.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.170+0000 7f10f46e3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec10a720 con 0x7f10ec102430 2024-09-04T16:29:09.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.170+0000 7f10f46e3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec10a5a0 con 0x7f10ec104d60 2024-09-04T16:29:09.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.170+0000 7f10f247f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10ec102430 0x7f10ec197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:09.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.170+0000 7f10f247f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10ec102430 0x7f10ec197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:34398/0 (socket says 172.21.15.170:34398) 2024-09-04T16:29:09.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.170+0000 7f10f247f640 1 -- 172.21.15.170:0/150530198 learned_addr learned my addr 172.21.15.170:0/150530198 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:29:09.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.170+0000 7f10f1c7e640 1 --2- 172.21.15.170:0/150530198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10ec104d60 0x7f10ec1979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:09.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.170+0000 7f10f1c7e640 1 -- 172.21.15.170:0/150530198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10ec102430 msgr2=0x7f10ec197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:09.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.170+0000 7f10f1c7e640 1 --2- 172.21.15.170:0/150530198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10ec102430 0x7f10ec197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:09.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.170+0000 7f10f1c7e640 1 -- 172.21.15.170:0/150530198 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ec198040 con 0x7f10ec104d60 2024-09-04T16:29:09.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.170+0000 7f10f1c7e640 1 --2- 172.21.15.170:0/150530198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10ec104d60 0x7f10ec1979c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f10dc006010 tx=0x7f10dc0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:09.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.171+0000 7f10e37fe640 1 -- 172.21.15.170:0/150530198 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10dc03f070 con 0x7f10ec104d60 2024-09-04T16:29:09.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.171+0000 7f10e37fe640 1 -- 172.21.15.170:0/150530198 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f10dc0049d0 con 0x7f10ec104d60 2024-09-04T16:29:09.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.171+0000 7f10f46e3640 1 -- 172.21.15.170:0/150530198 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10ec19ca80 con 0x7f10ec104d60 2024-09-04T16:29:09.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.171+0000 7f10f46e3640 1 -- 172.21.15.170:0/150530198 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10ec19d010 con 0x7f10ec104d60 2024-09-04T16:29:09.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.171+0000 7f10e37fe640 1 -- 172.21.15.170:0/150530198 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10dc035030 con 0x7f10ec104d60 2024-09-04T16:29:09.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.172+0000 7f10f46e3640 1 -- 172.21.15.170:0/150530198 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10ec102810 con 0x7f10ec104d60 2024-09-04T16:29:09.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.172+0000 7f10e37fe640 1 -- 172.21.15.170:0/150530198 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 19) ==== 92205+0+0 (secure 0 0 0) 0x7f10dc042070 con 0x7f10ec104d60 2024-09-04T16:29:09.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.173+0000 7f10e37fe640 1 --2- 172.21.15.170:0/150530198 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f10d806de30 0x7f10d80702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:09.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.173+0000 7f10f247f640 1 --2- 172.21.15.170:0/150530198 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f10d806de30 0x7f10d80702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:09.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.173+0000 7f10e37fe640 1 -- 172.21.15.170:0/150530198 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f10dc0ae520 con 0x7f10ec104d60 2024-09-04T16:29:09.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.174+0000 7f10f247f640 1 --2- 172.21.15.170:0/150530198 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f10d806de30 0x7f10d80702f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009cd0 tx=0x7f10e8005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:09.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.177+0000 7f10e37fe640 1 -- 172.21.15.170:0/150530198 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f10dc07fd10 con 0x7f10ec104d60 2024-09-04T16:29:09.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.443+0000 7f10f46e3640 1 -- 172.21.15.170:0/150530198 --> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f10ec105740 con 0x7f10d806de30 2024-09-04T16:29:09.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.444+0000 7f10e37fe640 1 -- 172.21.15.170:0/150530198 <== mgr.14217 v2:172.21.15.170:6800/1415431517 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f10ec105740 con 0x7f10d806de30 2024-09-04T16:29:09.445 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:29:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:29:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:29:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-04T16:29:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [], 2024-09-04T16:29:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "0/2 daemons upgraded", 2024-09-04T16:29:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 image on host smithi193", 2024-09-04T16:29:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:29:09.445 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:29:09.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.447+0000 7f10f46e3640 1 -- 172.21.15.170:0/150530198 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f10d806de30 msgr2=0x7f10d80702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:09.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.447+0000 7f10f46e3640 1 --2- 172.21.15.170:0/150530198 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f10d806de30 0x7f10d80702f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009cd0 tx=0x7f10e8005f90 comp rx=0 tx=0).stop 2024-09-04T16:29:09.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.447+0000 7f10f46e3640 1 -- 172.21.15.170:0/150530198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10ec104d60 msgr2=0x7f10ec1979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:09.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.447+0000 7f10f46e3640 1 --2- 172.21.15.170:0/150530198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10ec104d60 0x7f10ec1979c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f10dc006010 tx=0x7f10dc0045e0 comp rx=0 tx=0).stop 2024-09-04T16:29:09.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.447+0000 7f10f46e3640 1 -- 172.21.15.170:0/150530198 shutdown_connections 2024-09-04T16:29:09.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.447+0000 7f10f46e3640 1 --2- 172.21.15.170:0/150530198 >> [v2:172.21.15.170:6800/1415431517,v1:172.21.15.170:6801/1415431517] conn(0x7f10d806de30 0x7f10d80702f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:09.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.447+0000 7f10f46e3640 1 --2- 172.21.15.170:0/150530198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10ec104d60 0x7f10ec1979c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:09.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.447+0000 7f10f46e3640 1 --2- 172.21.15.170:0/150530198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10ec102430 0x7f10ec197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:09.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.447+0000 7f10f46e3640 1 -- 172.21.15.170:0/150530198 >> 172.21.15.170:0/150530198 conn(0x7f10ec0fbff0 msgr2=0x7f10ec0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:09.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.447+0000 7f10f46e3640 1 -- 172.21.15.170:0/150530198 shutdown_connections 2024-09-04T16:29:09.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:09.447+0000 7f10f46e3640 1 -- 172.21.15.170:0/150530198 wait complete. 2024-09-04T16:29:09.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:09 smithi170 ceph-mon[29272]: from='client.24369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:29:09.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:09 smithi170 ceph-mon[29272]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:29:09.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:09 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1634652804' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:29:09.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:09 smithi193 ceph-mon[36288]: from='client.24369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:29:09.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:09 smithi193 ceph-mon[36288]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:29:09.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:09 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1634652804' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:29:10.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:10 smithi170 ceph-mon[29272]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:29:10.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:10 smithi170 ceph-mon[29272]: pgmap v226: 65 pgs: 65 active+clean; 18 MiB data, 245 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 37 op/s 2024-09-04T16:29:10.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:10 smithi170 ceph-mon[29272]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:29:10.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:10 smithi193 ceph-mon[36288]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:29:10.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:10 smithi193 ceph-mon[36288]: pgmap v226: 65 pgs: 65 active+clean; 18 MiB data, 245 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 37 op/s 2024-09-04T16:29:10.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:10 smithi193 ceph-mon[36288]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:29:11.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:11 smithi170 ceph-mon[29272]: Upgrade: Updating mgr.smithi193.gvfizn 2024-09-04T16:29:11.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:11.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi193.gvfizn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-04T16:29:11.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-04T16:29:11.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:11 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:29:11.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:11 smithi170 ceph-mon[29272]: Deploying daemon mgr.smithi193.gvfizn on smithi193 2024-09-04T16:29:11.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:11 smithi170 ceph-mon[29272]: pgmap v227: 65 pgs: 65 active+clean; 23 MiB data, 260 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 54 op/s 2024-09-04T16:29:11.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:11 smithi193 ceph-mon[36288]: Upgrade: Updating mgr.smithi193.gvfizn 2024-09-04T16:29:11.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:11.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi193.gvfizn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-04T16:29:11.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-04T16:29:11.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:11 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:29:11.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:11 smithi193 ceph-mon[36288]: Deploying daemon mgr.smithi193.gvfizn on smithi193 2024-09-04T16:29:11.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:11 smithi193 ceph-mon[36288]: pgmap v227: 65 pgs: 65 active+clean; 23 MiB data, 260 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 54 op/s 2024-09-04T16:29:13.547 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:13 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:29:13.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:13 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:29:14.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:14 smithi170 ceph-mon[29272]: pgmap v228: 65 pgs: 65 active+clean; 36 MiB data, 305 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 113 op/s 2024-09-04T16:29:14.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:14 smithi193 ceph-mon[36288]: pgmap v228: 65 pgs: 65 active+clean; 36 MiB data, 305 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 113 op/s 2024-09-04T16:29:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:15 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:15 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:15 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:29:15.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:15 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:15.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:15 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:15.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:15 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:29:16.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:16 smithi170 ceph-mon[29272]: pgmap v229: 65 pgs: 65 active+clean; 41 MiB data, 326 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.4 MiB/s wr, 128 op/s 2024-09-04T16:29:16.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:16 smithi193 ceph-mon[36288]: pgmap v229: 65 pgs: 65 active+clean; 41 MiB data, 326 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.4 MiB/s wr, 128 op/s 2024-09-04T16:29:18.850 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:18 smithi193 ceph-mon[36288]: pgmap v230: 65 pgs: 65 active+clean; 43 MiB data, 341 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.6 MiB/s wr, 150 op/s 2024-09-04T16:29:18.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:18 smithi170 ceph-mon[29272]: pgmap v230: 65 pgs: 65 active+clean; 43 MiB data, 341 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.6 MiB/s wr, 150 op/s 2024-09-04T16:29:20.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:20 smithi193 ceph-mon[36288]: pgmap v231: 65 pgs: 65 active+clean; 60 MiB data, 385 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.1 MiB/s wr, 168 op/s 2024-09-04T16:29:20.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:20 smithi193 ceph-mon[36288]: Standby manager daemon smithi193.gvfizn restarted 2024-09-04T16:29:20.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:20 smithi193 ceph-mon[36288]: Standby manager daemon smithi193.gvfizn started 2024-09-04T16:29:20.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:20 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi193.gvfizn/crt"}]: dispatch 2024-09-04T16:29:20.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:20 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-04T16:29:20.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:20 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi193.gvfizn/key"}]: dispatch 2024-09-04T16:29:20.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:20 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-04T16:29:20.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:20 smithi170 ceph-mon[29272]: pgmap v231: 65 pgs: 65 active+clean; 60 MiB data, 385 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.1 MiB/s wr, 168 op/s 2024-09-04T16:29:20.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:20 smithi170 ceph-mon[29272]: Standby manager daemon smithi193.gvfizn restarted 2024-09-04T16:29:20.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:20 smithi170 ceph-mon[29272]: Standby manager daemon smithi193.gvfizn started 2024-09-04T16:29:20.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:20 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi193.gvfizn/crt"}]: dispatch 2024-09-04T16:29:20.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:20 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-04T16:29:20.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:20 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi193.gvfizn/key"}]: dispatch 2024-09-04T16:29:20.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:20 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-04T16:29:21.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:21 smithi193 ceph-mon[36288]: mgrmap e20: smithi170.fbszap(active, since 6m), standbys: smithi193.gvfizn 2024-09-04T16:29:21.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:21 smithi170 ceph-mon[29272]: mgrmap e20: smithi170.fbszap(active, since 6m), standbys: smithi193.gvfizn 2024-09-04T16:29:22.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:22 smithi170 ceph-mon[29272]: pgmap v232: 65 pgs: 65 active+clean; 63 MiB data, 389 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.8 MiB/s wr, 163 op/s 2024-09-04T16:29:22.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:22.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:22 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:22 smithi193 ceph-mon[36288]: pgmap v232: 65 pgs: 65 active+clean; 63 MiB data, 389 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.8 MiB/s wr, 163 op/s 2024-09-04T16:29:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:22 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:23.851 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:23 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:23.851 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:23 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:23.851 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:23 smithi193 ceph-mon[36288]: pgmap v233: 65 pgs: 65 active+clean; 84 MiB data, 434 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.2 MiB/s wr, 207 op/s 2024-09-04T16:29:23.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:23 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:23.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:23 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:23.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:23 smithi170 ceph-mon[29272]: pgmap v233: 65 pgs: 65 active+clean; 84 MiB data, 434 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.2 MiB/s wr, 207 op/s 2024-09-04T16:29:26.440 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: pgmap v234: 65 pgs: 65 active+clean; 90 MiB data, 462 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.6 MiB/s wr, 169 op/s 2024-09-04T16:29:26.440 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:26.441 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:26.441 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:29:26.441 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:29:26.441 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:26.441 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:29:26.441 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr fail", "who": "smithi170.fbszap"}]: dispatch 2024-09-04T16:29:26.441 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: Activating manager daemon smithi193.gvfizn 2024-09-04T16:29:26.441 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "mgr fail", "who": "smithi170.fbszap"}]': finished 2024-09-04T16:29:26.441 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-09-04T16:29:26.441 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: osdmap e46: 6 total, 6 up, 6 in 2024-09-04T16:29:26.441 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:29:26.441 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: mgrmap e21: smithi193.gvfizn(active, starting, since 0.00968763s) 2024-09-04T16:29:26.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.zkhdil"}]: dispatch 2024-09-04T16:29:26.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.rzbrux"}]: dispatch 2024-09-04T16:29:26.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi193.kabapr"}]: dispatch 2024-09-04T16:29:26.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi193.xostco"}]: dispatch 2024-09-04T16:29:26.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mgr metadata", "who": "smithi193.gvfizn", "id": "smithi193.gvfizn"}]: dispatch 2024-09-04T16:29:26.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-04T16:29:26.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-04T16:29:26.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-04T16:29:26.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-04T16:29:26.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-04T16:29:26.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-04T16:29:26.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-04T16:29:26.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-04T16:29:26.443 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:26 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-04T16:29:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: pgmap v234: 65 pgs: 65 active+clean; 90 MiB data, 462 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.6 MiB/s wr, 169 op/s 2024-09-04T16:29:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:29:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:29:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' 2024-09-04T16:29:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:29:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr fail", "who": "smithi170.fbszap"}]: dispatch 2024-09-04T16:29:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: Activating manager daemon smithi193.gvfizn 2024-09-04T16:29:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14217 172.21.15.170:0/2370101587' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "mgr fail", "who": "smithi170.fbszap"}]': finished 2024-09-04T16:29:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-09-04T16:29:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: osdmap e46: 6 total, 6 up, 6 in 2024-09-04T16:29:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:29:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: mgrmap e21: smithi193.gvfizn(active, starting, since 0.00968763s) 2024-09-04T16:29:26.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.zkhdil"}]: dispatch 2024-09-04T16:29:26.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.rzbrux"}]: dispatch 2024-09-04T16:29:26.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi193.kabapr"}]: dispatch 2024-09-04T16:29:26.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi193.xostco"}]: dispatch 2024-09-04T16:29:26.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mgr metadata", "who": "smithi193.gvfizn", "id": "smithi193.gvfizn"}]: dispatch 2024-09-04T16:29:26.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-04T16:29:26.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-04T16:29:26.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-04T16:29:26.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-04T16:29:26.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-04T16:29:26.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-04T16:29:26.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-04T16:29:26.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-04T16:29:26.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:26 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-04T16:29:27.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:27 smithi170 ceph-mon[29272]: Manager daemon smithi193.gvfizn is now available 2024-09-04T16:29:27.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:27 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:27.488 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:27 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:27.488 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:27 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:27.488 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:27 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:29:27.488 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:27 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:29:27.488 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:27 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-04T16:29:27.488 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:27 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi193.gvfizn/mirror_snapshot_schedule"}]: dispatch 2024-09-04T16:29:27.488 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:27 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi193.gvfizn/mirror_snapshot_schedule"}]: dispatch 2024-09-04T16:29:27.488 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:27 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi193.gvfizn/trash_purge_schedule"}]: dispatch 2024-09-04T16:29:27.488 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:27 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi193.gvfizn/trash_purge_schedule"}]: dispatch 2024-09-04T16:29:27.551 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:27 smithi193 ceph-mon[36288]: Manager daemon smithi193.gvfizn is now available 2024-09-04T16:29:27.551 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:27 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:27.552 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:27 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:27.552 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:27 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:27.552 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:27 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:29:27.552 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:27 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:29:27.552 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:27 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-04T16:29:27.552 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:27 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi193.gvfizn/mirror_snapshot_schedule"}]: dispatch 2024-09-04T16:29:27.552 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:27 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi193.gvfizn/mirror_snapshot_schedule"}]: dispatch 2024-09-04T16:29:27.552 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:27 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi193.gvfizn/trash_purge_schedule"}]: dispatch 2024-09-04T16:29:27.552 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:27 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi193.gvfizn/trash_purge_schedule"}]: dispatch 2024-09-04T16:29:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:28 smithi193 ceph-mon[36288]: mgrmap e22: smithi193.gvfizn(active, since 1.18753s) 2024-09-04T16:29:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:28 smithi193 ceph-mon[36288]: Deploying cephadm binary to smithi193 2024-09-04T16:29:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:28 smithi193 ceph-mon[36288]: Deploying cephadm binary to smithi170 2024-09-04T16:29:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:28 smithi193 ceph-mon[36288]: pgmap v4: 65 pgs: 65 active+clean; 105 MiB data, 518 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:29:28.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:28 smithi170 ceph-mon[29272]: mgrmap e22: smithi193.gvfizn(active, since 1.18753s) 2024-09-04T16:29:28.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:28 smithi170 ceph-mon[29272]: Deploying cephadm binary to smithi193 2024-09-04T16:29:28.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:28 smithi170 ceph-mon[29272]: Deploying cephadm binary to smithi170 2024-09-04T16:29:28.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:28 smithi170 ceph-mon[29272]: pgmap v4: 65 pgs: 65 active+clean; 105 MiB data, 518 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:29:29.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:29 smithi170 ceph-mon[29272]: [04/Sep/2024:16:29:28] ENGINE Bus STARTING 2024-09-04T16:29:29.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:29 smithi170 ceph-mon[29272]: [04/Sep/2024:16:29:28] ENGINE Serving on http://172.21.15.193:8765 2024-09-04T16:29:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:29 smithi170 ceph-mon[29272]: [04/Sep/2024:16:29:28] ENGINE Serving on https://172.21.15.193:7150 2024-09-04T16:29:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:29 smithi170 ceph-mon[29272]: [04/Sep/2024:16:29:28] ENGINE Bus STARTED 2024-09-04T16:29:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:29 smithi170 ceph-mon[29272]: [04/Sep/2024:16:29:28] ENGINE Error in HTTPServer.serve 2024-09-04T16:29:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Traceback (most recent call last): 2024-09-04T16:29:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-04T16:29:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self._connections.run(self.expiration_interval) 2024-09-04T16:29:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-04T16:29:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self._run(expiration_interval) 2024-09-04T16:29:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-04T16:29:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-04T16:29:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-04T16:29:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-04T16:29:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-04T16:29:29.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: s = self.context.wrap_socket( 2024-09-04T16:29:29.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-04T16:29:29.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: return self.sslsocket_class._create( 2024-09-04T16:29:29.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-04T16:29:29.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self.do_handshake() 2024-09-04T16:29:29.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-04T16:29:29.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self._sslobj.do_handshake() 2024-09-04T16:29:29.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-04T16:29:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:29 smithi193 ceph-mon[36288]: [04/Sep/2024:16:29:28] ENGINE Bus STARTING 2024-09-04T16:29:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:29 smithi193 ceph-mon[36288]: [04/Sep/2024:16:29:28] ENGINE Serving on http://172.21.15.193:8765 2024-09-04T16:29:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:29 smithi193 ceph-mon[36288]: [04/Sep/2024:16:29:28] ENGINE Serving on https://172.21.15.193:7150 2024-09-04T16:29:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:29 smithi193 ceph-mon[36288]: [04/Sep/2024:16:29:28] ENGINE Bus STARTED 2024-09-04T16:29:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:29 smithi193 ceph-mon[36288]: [04/Sep/2024:16:29:28] ENGINE Error in HTTPServer.serve 2024-09-04T16:29:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Traceback (most recent call last): 2024-09-04T16:29:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-04T16:29:29.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: self._connections.run(self.expiration_interval) 2024-09-04T16:29:29.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-04T16:29:29.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: self._run(expiration_interval) 2024-09-04T16:29:29.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-04T16:29:29.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-04T16:29:29.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-04T16:29:29.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-04T16:29:29.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-04T16:29:29.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: s = self.context.wrap_socket( 2024-09-04T16:29:29.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-04T16:29:29.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: return self.sslsocket_class._create( 2024-09-04T16:29:29.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-04T16:29:29.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: self.do_handshake() 2024-09-04T16:29:29.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-04T16:29:29.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: self._sslobj.do_handshake() 2024-09-04T16:29:29.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-04T16:29:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:30 smithi193 ceph-mon[36288]: mgrmap e23: smithi193.gvfizn(active, since 3s) 2024-09-04T16:29:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:30 smithi193 ceph-mon[36288]: pgmap v5: 65 pgs: 65 active+clean; 105 MiB data, 518 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:29:30.702 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:30 smithi170 ceph-mon[29272]: mgrmap e23: smithi193.gvfizn(active, since 3s) 2024-09-04T16:29:30.702 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:30 smithi170 ceph-mon[29272]: pgmap v5: 65 pgs: 65 active+clean; 105 MiB data, 518 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:29:32.635 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:32 smithi193 ceph-mon[36288]: mgrmap e24: smithi193.gvfizn(active, since 5s) 2024-09-04T16:29:32.635 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:32 smithi193 ceph-mon[36288]: pgmap v6: 65 pgs: 65 active+clean; 105 MiB data, 518 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:29:32.721 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:32 smithi170 ceph-mon[29272]: mgrmap e24: smithi193.gvfizn(active, since 5s) 2024-09-04T16:29:32.721 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:32 smithi170 ceph-mon[29272]: pgmap v6: 65 pgs: 65 active+clean; 105 MiB data, 518 MiB used, 536 GiB / 536 GiB avail 2024-09-04T16:29:33.637 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:33 smithi170 ceph-mon[29272]: Standby manager daemon smithi170.fbszap started 2024-09-04T16:29:33.637 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:33 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.170:0/550177974' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.fbszap/crt"}]: dispatch 2024-09-04T16:29:33.637 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:33 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.170:0/550177974' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-04T16:29:33.637 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:33 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.170:0/550177974' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.fbszap/key"}]: dispatch 2024-09-04T16:29:33.637 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:33 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.170:0/550177974' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-04T16:29:33.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:33 smithi193 ceph-mon[36288]: Standby manager daemon smithi170.fbszap started 2024-09-04T16:29:33.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:33 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.170:0/550177974' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.fbszap/crt"}]: dispatch 2024-09-04T16:29:33.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:33 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.170:0/550177974' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-04T16:29:33.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:33 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.170:0/550177974' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.fbszap/key"}]: dispatch 2024-09-04T16:29:33.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:33 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.170:0/550177974' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-04T16:29:34.684 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:34 smithi170 ceph-mon[29272]: mgrmap e25: smithi193.gvfizn(active, since 7s), standbys: smithi170.fbszap 2024-09-04T16:29:34.684 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:34 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mgr metadata", "who": "smithi170.fbszap", "id": "smithi170.fbszap"}]: dispatch 2024-09-04T16:29:34.684 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:34 smithi170 ceph-mon[29272]: pgmap v7: 65 pgs: 65 active+clean; 117 MiB data, 572 MiB used, 536 GiB / 536 GiB avail; 26 KiB/s rd, 1.7 MiB/s wr, 96 op/s 2024-09-04T16:29:34.707 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:34 smithi193 ceph-mon[36288]: mgrmap e25: smithi193.gvfizn(active, since 7s), standbys: smithi170.fbszap 2024-09-04T16:29:34.707 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:34 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mgr metadata", "who": "smithi170.fbszap", "id": "smithi170.fbszap"}]: dispatch 2024-09-04T16:29:34.707 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:34 smithi193 ceph-mon[36288]: pgmap v7: 65 pgs: 65 active+clean; 117 MiB data, 572 MiB used, 536 GiB / 536 GiB avail; 26 KiB/s rd, 1.7 MiB/s wr, 96 op/s 2024-09-04T16:29:36.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:36 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:36.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:36 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:36.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:36 smithi170 ceph-mon[29272]: pgmap v8: 65 pgs: 65 active+clean; 117 MiB data, 572 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 1.4 MiB/s wr, 74 op/s 2024-09-04T16:29:36.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:36 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:36.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:36 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:36.854 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:36 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:36.854 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:36 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:36.855 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:36 smithi193 ceph-mon[36288]: pgmap v8: 65 pgs: 65 active+clean; 117 MiB data, 572 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 1.4 MiB/s wr, 74 op/s 2024-09-04T16:29:36.855 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:36 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:36.855 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:36 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:39.565 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:39 smithi170 ceph-mon[29272]: pgmap v9: 65 pgs: 65 active+clean; 130 MiB data, 618 MiB used, 536 GiB / 536 GiB avail; 16 KiB/s rd, 2.4 MiB/s wr, 145 op/s 2024-09-04T16:29:39.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.563+0000 7f03f5fe1640 1 -- 172.21.15.170:0/226064091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0101a40 msgr2=0x7f03f0101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:39.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.563+0000 7f03f5fe1640 1 --2- 172.21.15.170:0/226064091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0101a40 0x7f03f0101ec0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009880 tx=0x7f03e402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:29:39.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.563+0000 7f03f5fe1640 1 -- 172.21.15.170:0/226064091 shutdown_connections 2024-09-04T16:29:39.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.563+0000 7f03f5fe1640 1 --2- 172.21.15.170:0/226064091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0101a40 0x7f03f0101ec0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:39.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.563+0000 7f03f5fe1640 1 --2- 172.21.15.170:0/226064091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03f0100840 0x7f03f0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:39.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.563+0000 7f03f5fe1640 1 -- 172.21.15.170:0/226064091 >> 172.21.15.170:0/226064091 conn(0x7f03f00fbff0 msgr2=0x7f03f00fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:39.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.564+0000 7f03f5fe1640 1 -- 172.21.15.170:0/226064091 shutdown_connections 2024-09-04T16:29:39.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.564+0000 7f03f5fe1640 1 -- 172.21.15.170:0/226064091 wait complete. 2024-09-04T16:29:39.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.564+0000 7f03f5fe1640 1 Processor -- start 2024-09-04T16:29:39.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.565+0000 7f03f5fe1640 1 -- start start 2024-09-04T16:29:39.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.565+0000 7f03f5fe1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0100840 0x7f03f006a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:39.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.565+0000 7f03f5fe1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03f0101a40 0x7f03f019e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:39.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.565+0000 7f03f5fe1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f03f0109660 con 0x7f03f0100840 2024-09-04T16:29:39.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.565+0000 7f03f5fe1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f03f01094e0 con 0x7f03f0101a40 2024-09-04T16:29:39.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.565+0000 7f03ef7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0100840 0x7f03f006a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:39.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.565+0000 7f03ef7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0100840 0x7f03f006a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57308/0 (socket says 172.21.15.170:57308) 2024-09-04T16:29:39.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.565+0000 7f03ef7fe640 1 -- 172.21.15.170:0/3256303355 learned_addr learned my addr 172.21.15.170:0/3256303355 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:29:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.565+0000 7f03eeffd640 1 --2- 172.21.15.170:0/3256303355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03f0101a40 0x7f03f019e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.565+0000 7f03ef7fe640 1 -- 172.21.15.170:0/3256303355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03f0101a40 msgr2=0x7f03f019e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.565+0000 7f03ef7fe640 1 --2- 172.21.15.170:0/3256303355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03f0101a40 0x7f03f019e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.565+0000 7f03ef7fe640 1 -- 172.21.15.170:0/3256303355 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f019eb10 con 0x7f03f0100840 2024-09-04T16:29:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.566+0000 7f03ef7fe640 1 --2- 172.21.15.170:0/3256303355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0100840 0x7f03f006a620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f03e000e940 tx=0x7f03e000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.566+0000 7f03ecff9640 1 -- 172.21.15.170:0/3256303355 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03e000cac0 con 0x7f03f0100840 2024-09-04T16:29:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.566+0000 7f03f5fe1640 1 -- 172.21.15.170:0/3256303355 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03f019ece0 con 0x7f03f0100840 2024-09-04T16:29:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.566+0000 7f03ecff9640 1 -- 172.21.15.170:0/3256303355 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03e000cc60 con 0x7f03f0100840 2024-09-04T16:29:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.566+0000 7f03ecff9640 1 -- 172.21.15.170:0/3256303355 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03e0003dd0 con 0x7f03f0100840 2024-09-04T16:29:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.566+0000 7f03f5fe1640 1 -- 172.21.15.170:0/3256303355 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f019f190 con 0x7f03f0100840 2024-09-04T16:29:39.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.567+0000 7f03f5fe1640 1 -- 172.21.15.170:0/3256303355 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03f0100c40 con 0x7f03f0100840 2024-09-04T16:29:39.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.568+0000 7f03ecff9640 1 -- 172.21.15.170:0/3256303355 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 25) ==== 97250+0+0 (secure 0 0 0) 0x7f03e0004000 con 0x7f03f0100840 2024-09-04T16:29:39.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.569+0000 7f03ecff9640 1 --2- 172.21.15.170:0/3256303355 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f03d8073f70 0x7f03d8076430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:39.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.569+0000 7f03ecff9640 1 -- 172.21.15.170:0/3256303355 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f03e0095b70 con 0x7f03f0100840 2024-09-04T16:29:39.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.569+0000 7f03eeffd640 1 --2- 172.21.15.170:0/3256303355 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f03d8073f70 0x7f03d8076430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:39.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.569+0000 7f03eeffd640 1 --2- 172.21.15.170:0/3256303355 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f03d8073f70 0x7f03d8076430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f03e4000c00 tx=0x7f03e40058d0 comp rx=0 tx=0).ready entity=mgr.14682 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:39.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.574+0000 7f03ecff9640 1 -- 172.21.15.170:0/3256303355 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f03e005d550 con 0x7f03f0100840 2024-09-04T16:29:39.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:39 smithi193 ceph-mon[36288]: pgmap v9: 65 pgs: 65 active+clean; 130 MiB data, 618 MiB used, 536 GiB / 536 GiB avail; 16 KiB/s rd, 2.4 MiB/s wr, 145 op/s 2024-09-04T16:29:39.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.911+0000 7f03f5fe1640 1 -- 172.21.15.170:0/3256303355 --> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f03f0062630 con 0x7f03d8073f70 2024-09-04T16:29:39.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.913+0000 7f03ecff9640 1 -- 172.21.15.170:0/3256303355 <== mgr.14682 v2:172.21.15.193:6828/4218378172 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f03f0062630 con 0x7f03d8073f70 2024-09-04T16:29:39.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.916+0000 7f03f5fe1640 1 -- 172.21.15.170:0/3256303355 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f03d8073f70 msgr2=0x7f03d8076430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:39.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.916+0000 7f03f5fe1640 1 --2- 172.21.15.170:0/3256303355 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f03d8073f70 0x7f03d8076430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f03e4000c00 tx=0x7f03e40058d0 comp rx=0 tx=0).stop 2024-09-04T16:29:39.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.916+0000 7f03f5fe1640 1 -- 172.21.15.170:0/3256303355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0100840 msgr2=0x7f03f006a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:39.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.916+0000 7f03f5fe1640 1 --2- 172.21.15.170:0/3256303355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0100840 0x7f03f006a620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f03e000e940 tx=0x7f03e000ee00 comp rx=0 tx=0).stop 2024-09-04T16:29:39.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.916+0000 7f03f5fe1640 1 -- 172.21.15.170:0/3256303355 shutdown_connections 2024-09-04T16:29:39.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.916+0000 7f03f5fe1640 1 --2- 172.21.15.170:0/3256303355 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f03d8073f70 0x7f03d8076430 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:39.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.916+0000 7f03f5fe1640 1 --2- 172.21.15.170:0/3256303355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03f0101a40 0x7f03f019e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:39.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.916+0000 7f03f5fe1640 1 --2- 172.21.15.170:0/3256303355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03f0100840 0x7f03f006a620 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:39.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.916+0000 7f03f5fe1640 1 -- 172.21.15.170:0/3256303355 >> 172.21.15.170:0/3256303355 conn(0x7f03f00fbff0 msgr2=0x7f03f0104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:39.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.916+0000 7f03f5fe1640 1 -- 172.21.15.170:0/3256303355 shutdown_connections 2024-09-04T16:29:39.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:39.917+0000 7f03f5fe1640 1 -- 172.21.15.170:0/3256303355 wait complete. 2024-09-04T16:29:39.929 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:29:40.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.038+0000 7f34debaf640 1 -- 172.21.15.170:0/3070211642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d8101a40 msgr2=0x7f34d8101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:40.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.038+0000 7f34debaf640 1 --2- 172.21.15.170:0/3070211642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d8101a40 0x7f34d8101ec0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009880 tx=0x7f34c402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.038+0000 7f34debaf640 1 -- 172.21.15.170:0/3070211642 shutdown_connections 2024-09-04T16:29:40.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.038+0000 7f34debaf640 1 --2- 172.21.15.170:0/3070211642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d8101a40 0x7f34d8101ec0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.038+0000 7f34debaf640 1 --2- 172.21.15.170:0/3070211642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34d8100840 0x7f34d8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.038+0000 7f34debaf640 1 -- 172.21.15.170:0/3070211642 >> 172.21.15.170:0/3070211642 conn(0x7f34d80fbff0 msgr2=0x7f34d80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:40.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.038+0000 7f34debaf640 1 -- 172.21.15.170:0/3070211642 shutdown_connections 2024-09-04T16:29:40.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.038+0000 7f34debaf640 1 -- 172.21.15.170:0/3070211642 wait complete. 2024-09-04T16:29:40.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.039+0000 7f34debaf640 1 Processor -- start 2024-09-04T16:29:40.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.039+0000 7f34debaf640 1 -- start start 2024-09-04T16:29:40.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.039+0000 7f34debaf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34d8100840 0x7f34d8197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:40.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.039+0000 7f34debaf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d8101a40 0x7f34d8197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:40.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.039+0000 7f34debaf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f34d8109660 con 0x7f34d8101a40 2024-09-04T16:29:40.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.039+0000 7f34debaf640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f34d81094e0 con 0x7f34d8100840 2024-09-04T16:29:40.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.039+0000 7f34d7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d8101a40 0x7f34d8197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:40.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.039+0000 7f34dc94b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34d8100840 0x7f34d8197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:40.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.039+0000 7f34dc94b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34d8100840 0x7f34d8197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.170:54328/0 (socket says 172.21.15.170:54328) 2024-09-04T16:29:40.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.039+0000 7f34dc94b640 1 -- 172.21.15.170:0/3540542262 learned_addr learned my addr 172.21.15.170:0/3540542262 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:29:40.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.040+0000 7f34d7fff640 1 -- 172.21.15.170:0/3540542262 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34d8100840 msgr2=0x7f34d8197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:40.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.040+0000 7f34d7fff640 1 --2- 172.21.15.170:0/3540542262 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34d8100840 0x7f34d8197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.040+0000 7f34d7fff640 1 -- 172.21.15.170:0/3540542262 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d81980f0 con 0x7f34d8101a40 2024-09-04T16:29:40.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.040+0000 7f34dc94b640 1 --2- 172.21.15.170:0/3540542262 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34d8100840 0x7f34d8197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:29:40.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.040+0000 7f34d7fff640 1 --2- 172.21.15.170:0/3540542262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d8101a40 0x7f34d8197a70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f34c402a9c0 tx=0x7f34c40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:40.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.040+0000 7f34d5ffb640 1 -- 172.21.15.170:0/3540542262 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34c403f070 con 0x7f34d8101a40 2024-09-04T16:29:40.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.040+0000 7f34d5ffb640 1 -- 172.21.15.170:0/3540542262 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f34c40049d0 con 0x7f34d8101a40 2024-09-04T16:29:40.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.040+0000 7f34debaf640 1 -- 172.21.15.170:0/3540542262 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d819cad0 con 0x7f34d8101a40 2024-09-04T16:29:40.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.040+0000 7f34d5ffb640 1 -- 172.21.15.170:0/3540542262 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34c4035030 con 0x7f34d8101a40 2024-09-04T16:29:40.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.040+0000 7f34debaf640 1 -- 172.21.15.170:0/3540542262 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d819d060 con 0x7f34d8101a40 2024-09-04T16:29:40.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.041+0000 7f34debaf640 1 -- 172.21.15.170:0/3540542262 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d8100c40 con 0x7f34d8101a40 2024-09-04T16:29:40.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.042+0000 7f34d5ffb640 1 -- 172.21.15.170:0/3540542262 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 25) ==== 97250+0+0 (secure 0 0 0) 0x7f34c4042070 con 0x7f34d8101a40 2024-09-04T16:29:40.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.043+0000 7f34d5ffb640 1 --2- 172.21.15.170:0/3540542262 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f34c8073f70 0x7f34c8076430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:40.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.043+0000 7f34d5ffb640 1 -- 172.21.15.170:0/3540542262 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f34c40b5ee0 con 0x7f34d8101a40 2024-09-04T16:29:40.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.043+0000 7f34dc94b640 1 --2- 172.21.15.170:0/3540542262 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f34c8073f70 0x7f34c8076430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:40.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.043+0000 7f34dc94b640 1 --2- 172.21.15.170:0/3540542262 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f34c8073f70 0x7f34c8076430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0095f0 tx=0x7f34cc005f90 comp rx=0 tx=0).ready entity=mgr.14682 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:40.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.048+0000 7f34d5ffb640 1 -- 172.21.15.170:0/3540542262 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f34c4081a40 con 0x7f34d8101a40 2024-09-04T16:29:40.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.380+0000 7f34debaf640 1 -- 172.21.15.170:0/3540542262 --> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f34d819d350 con 0x7f34c8073f70 2024-09-04T16:29:40.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.381+0000 7f34d5ffb640 1 -- 172.21.15.170:0/3540542262 <== mgr.14682 v2:172.21.15.193:6828/4218378172 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f34d819d350 con 0x7f34c8073f70 2024-09-04T16:29:40.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.384+0000 7f34debaf640 1 -- 172.21.15.170:0/3540542262 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f34c8073f70 msgr2=0x7f34c8076430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:40.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.384+0000 7f34debaf640 1 --2- 172.21.15.170:0/3540542262 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f34c8073f70 0x7f34c8076430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0095f0 tx=0x7f34cc005f90 comp rx=0 tx=0).stop 2024-09-04T16:29:40.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.384+0000 7f34debaf640 1 -- 172.21.15.170:0/3540542262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d8101a40 msgr2=0x7f34d8197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:40.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.384+0000 7f34debaf640 1 --2- 172.21.15.170:0/3540542262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d8101a40 0x7f34d8197a70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f34c402a9c0 tx=0x7f34c40045e0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.384+0000 7f34debaf640 1 -- 172.21.15.170:0/3540542262 shutdown_connections 2024-09-04T16:29:40.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.384+0000 7f34debaf640 1 --2- 172.21.15.170:0/3540542262 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f34c8073f70 0x7f34c8076430 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.384+0000 7f34debaf640 1 --2- 172.21.15.170:0/3540542262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d8101a40 0x7f34d8197a70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.384+0000 7f34debaf640 1 --2- 172.21.15.170:0/3540542262 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34d8100840 0x7f34d8197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.384+0000 7f34debaf640 1 -- 172.21.15.170:0/3540542262 >> 172.21.15.170:0/3540542262 conn(0x7f34d80fbff0 msgr2=0x7f34d8069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:40.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.384+0000 7f34debaf640 1 -- 172.21.15.170:0/3540542262 shutdown_connections 2024-09-04T16:29:40.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.384+0000 7f34debaf640 1 -- 172.21.15.170:0/3540542262 wait complete. 2024-09-04T16:29:40.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.476+0000 7f02690eb640 1 -- 172.21.15.170:0/424559206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0264100840 msgr2=0x7f0264100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:40.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.476+0000 7f02690eb640 1 --2- 172.21.15.170:0/424559206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0264100840 0x7f0264100c40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0254009880 tx=0x7f025402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.476+0000 7f02690eb640 1 -- 172.21.15.170:0/424559206 shutdown_connections 2024-09-04T16:29:40.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.476+0000 7f02690eb640 1 --2- 172.21.15.170:0/424559206 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0264101a40 0x7f0264101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.476+0000 7f02690eb640 1 --2- 172.21.15.170:0/424559206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0264100840 0x7f0264100c40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.476+0000 7f02690eb640 1 -- 172.21.15.170:0/424559206 >> 172.21.15.170:0/424559206 conn(0x7f02640fbff0 msgr2=0x7f02640fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:40.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.476+0000 7f02690eb640 1 -- 172.21.15.170:0/424559206 shutdown_connections 2024-09-04T16:29:40.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.476+0000 7f02690eb640 1 -- 172.21.15.170:0/424559206 wait complete. 2024-09-04T16:29:40.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.477+0000 7f02690eb640 1 Processor -- start 2024-09-04T16:29:40.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.477+0000 7f02690eb640 1 -- start start 2024-09-04T16:29:40.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.477+0000 7f02690eb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0264100840 0x7f026406a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:40.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.477+0000 7f02690eb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0264101a40 0x7f026419c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:40.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.477+0000 7f02690eb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0264109660 con 0x7f0264100840 2024-09-04T16:29:40.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.477+0000 7f02690eb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f02641094e0 con 0x7f0264101a40 2024-09-04T16:29:40.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.478+0000 7f026259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0264101a40 0x7f026419c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:40.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.478+0000 7f026259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0264101a40 0x7f026419c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.170:54346/0 (socket says 172.21.15.170:54346) 2024-09-04T16:29:40.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.478+0000 7f026259c640 1 -- 172.21.15.170:0/229492033 learned_addr learned my addr 172.21.15.170:0/229492033 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:29:40.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.478+0000 7f0262d9d640 1 --2- 172.21.15.170:0/229492033 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0264100840 0x7f026406a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:40.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.478+0000 7f026259c640 1 -- 172.21.15.170:0/229492033 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0264100840 msgr2=0x7f026406a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:40.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.478+0000 7f026259c640 1 --2- 172.21.15.170:0/229492033 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0264100840 0x7f026406a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.478+0000 7f026259c640 1 -- 172.21.15.170:0/229492033 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026419c7b0 con 0x7f0264101a40 2024-09-04T16:29:40.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.478+0000 7f026259c640 1 --2- 172.21.15.170:0/229492033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0264101a40 0x7f026419c1f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f025800e9a0 tx=0x7f025800ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:40.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.478+0000 7f024bfff640 1 -- 172.21.15.170:0/229492033 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f025800cac0 con 0x7f0264101a40 2024-09-04T16:29:40.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.479+0000 7f02690eb640 1 -- 172.21.15.170:0/229492033 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026419caa0 con 0x7f0264101a40 2024-09-04T16:29:40.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.479+0000 7f024bfff640 1 -- 172.21.15.170:0/229492033 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f025800cc60 con 0x7f0264101a40 2024-09-04T16:29:40.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.479+0000 7f024bfff640 1 -- 172.21.15.170:0/229492033 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0258018750 con 0x7f0264101a40 2024-09-04T16:29:40.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.479+0000 7f02690eb640 1 -- 172.21.15.170:0/229492033 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026419d030 con 0x7f0264101a40 2024-09-04T16:29:40.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.480+0000 7f02690eb640 1 -- 172.21.15.170:0/229492033 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0264100c40 con 0x7f0264101a40 2024-09-04T16:29:40.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.481+0000 7f024bfff640 1 -- 172.21.15.170:0/229492033 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 97250+0+0 (secure 0 0 0) 0x7f0258018930 con 0x7f0264101a40 2024-09-04T16:29:40.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.481+0000 7f024bfff640 1 --2- 172.21.15.170:0/229492033 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f024c073f70 0x7f024c076430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:40.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.481+0000 7f024bfff640 1 -- 172.21.15.170:0/229492033 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f0258095ab0 con 0x7f0264101a40 2024-09-04T16:29:40.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.481+0000 7f0262d9d640 1 --2- 172.21.15.170:0/229492033 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f024c073f70 0x7f024c076430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:40.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.482+0000 7f0262d9d640 1 --2- 172.21.15.170:0/229492033 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f024c073f70 0x7f024c076430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0254009230 tx=0x7f02540058d0 comp rx=0 tx=0).ready entity=mgr.14682 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:40.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.486+0000 7f024bfff640 1 -- 172.21.15.170:0/229492033 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f025800ce10 con 0x7f0264101a40 2024-09-04T16:29:40.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.773+0000 7f02690eb640 1 -- 172.21.15.170:0/229492033 --> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0264062630 con 0x7f024c073f70 2024-09-04T16:29:40.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.783+0000 7f024bfff640 1 -- 172.21.15.170:0/229492033 <== mgr.14682 v2:172.21.15.193:6828/4218378172 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f0264062630 con 0x7f024c073f70 2024-09-04T16:29:40.784 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:29:40.784 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (5m) 113s ago 7m 26.0M - 0.25.0 c8568f914cd2 e85db6a2e731 2024-09-04T16:29:40.784 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (7m) 113s ago 7m 8358k - 19.1.1-252-g48920dab b708f9119ac7 8499640d7363 2024-09-04T16:29:40.784 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (6m) 5s ago 6m 5268k - 19.1.1-252-g48920dab b708f9119ac7 f9a24a1cb9dd 2024-09-04T16:29:40.784 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (7m) 113s ago 7m 6891k - 19.1.1-252-g48920dab b708f9119ac7 aa2ec5c5776a 2024-09-04T16:29:40.784 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (6m) 5s ago 6m 6895k - 19.1.1-252-g48920dab b708f9119ac7 a24f0ce3b3fb 2024-09-04T16:29:40.784 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (5m) 113s ago 7m 76.3M - 9.4.12 2bacad6d85d8 5bffd3332aba 2024-09-04T16:29:40.784 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (2m) 113s ago 2m 16.3M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:29:40.785 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (2m) 113s ago 2m 17.3M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:29:40.785 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (2m) 5s ago 2m 13.1M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:29:40.785 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (2m) 5s ago 2m 12.4M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:29:40.785 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:9283,8765,8443 running (8m) 113s ago 8m 498M - 19.1.1-252-g48920dab b708f9119ac7 3f0663652a64 2024-09-04T16:29:40.785 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (26s) 5s ago 6m 496M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 5d9c73a5a6dd 2024-09-04T16:29:40.785 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (8m) 113s ago 8m 49.0M 2048M 19.1.1-252-g48920dab b708f9119ac7 194ff39cc041 2024-09-04T16:29:40.785 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (6m) 5s ago 6m 41.0M 2048M 19.1.1-252-g48920dab b708f9119ac7 38c8e99ca323 2024-09-04T16:29:40.785 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (7m) 113s ago 7m 15.7M - 1.5.0 0da6a335fe13 e311ba1b18bc 2024-09-04T16:29:40.785 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (6m) 5s ago 6m 16.2M - 1.5.0 0da6a335fe13 09fd1aa1fdb6 2024-09-04T16:29:40.785 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (5m) 113s ago 5m 54.5M 3946M 19.1.1-252-g48920dab b708f9119ac7 6c2ea484615d 2024-09-04T16:29:40.785 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (5m) 113s ago 4m 56.7M 3946M 19.1.1-252-g48920dab b708f9119ac7 20469ba5727b 2024-09-04T16:29:40.785 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (4m) 113s ago 4m 48.4M 3946M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:29:40.785 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (4m) 5s ago 4m 88.2M 2240M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:29:40.786 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (3m) 5s ago 3m 78.7M 2240M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:29:40.786 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (3m) 5s ago 3m 80.3M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:29:40.786 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (5m) 113s ago 7m 55.7M - 2.43.0 a07b618ecd1d 58faf9d631cd 2024-09-04T16:29:40.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.786+0000 7f02690eb640 1 -- 172.21.15.170:0/229492033 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f024c073f70 msgr2=0x7f024c076430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:40.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.786+0000 7f02690eb640 1 --2- 172.21.15.170:0/229492033 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f024c073f70 0x7f024c076430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0254009230 tx=0x7f02540058d0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.786+0000 7f02690eb640 1 -- 172.21.15.170:0/229492033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0264101a40 msgr2=0x7f026419c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:40.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.786+0000 7f02690eb640 1 --2- 172.21.15.170:0/229492033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0264101a40 0x7f026419c1f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f025800e9a0 tx=0x7f025800ee60 comp rx=0 tx=0).stop 2024-09-04T16:29:40.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.786+0000 7f02690eb640 1 -- 172.21.15.170:0/229492033 shutdown_connections 2024-09-04T16:29:40.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.786+0000 7f02690eb640 1 --2- 172.21.15.170:0/229492033 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f024c073f70 0x7f024c076430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.786+0000 7f02690eb640 1 --2- 172.21.15.170:0/229492033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0264101a40 0x7f026419c1f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.786+0000 7f02690eb640 1 --2- 172.21.15.170:0/229492033 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0264100840 0x7f026406a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.786+0000 7f02690eb640 1 -- 172.21.15.170:0/229492033 >> 172.21.15.170:0/229492033 conn(0x7f02640fbff0 msgr2=0x7f0264104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:40.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.786+0000 7f02690eb640 1 -- 172.21.15.170:0/229492033 shutdown_connections 2024-09-04T16:29:40.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.786+0000 7f02690eb640 1 -- 172.21.15.170:0/229492033 wait complete. 2024-09-04T16:29:40.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.897+0000 7f0883abd640 1 -- 172.21.15.170:0/426060525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f087c101a40 msgr2=0x7f087c101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:40.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.897+0000 7f0883abd640 1 --2- 172.21.15.170:0/426060525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f087c101a40 0x7f087c101ec0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f086c00d8e0 tx=0x7f086c02a150 comp rx=0 tx=0).stop 2024-09-04T16:29:40.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.898+0000 7f0883abd640 1 -- 172.21.15.170:0/426060525 shutdown_connections 2024-09-04T16:29:40.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.898+0000 7f0883abd640 1 --2- 172.21.15.170:0/426060525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f087c101a40 0x7f087c101ec0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.898+0000 7f0883abd640 1 --2- 172.21.15.170:0/426060525 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f087c100840 0x7f087c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.898+0000 7f0883abd640 1 -- 172.21.15.170:0/426060525 >> 172.21.15.170:0/426060525 conn(0x7f087c0fbff0 msgr2=0x7f087c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:40.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.898+0000 7f0883abd640 1 -- 172.21.15.170:0/426060525 shutdown_connections 2024-09-04T16:29:40.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.898+0000 7f0883abd640 1 -- 172.21.15.170:0/426060525 wait complete. 2024-09-04T16:29:40.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.899+0000 7f0883abd640 1 Processor -- start 2024-09-04T16:29:40.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.899+0000 7f0883abd640 1 -- start start 2024-09-04T16:29:40.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.899+0000 7f0883abd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f087c100840 0x7f087c195250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:40.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.899+0000 7f0883abd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f087c101a40 0x7f087c195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:40.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.899+0000 7f0883abd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f087c108550 con 0x7f087c100840 2024-09-04T16:29:40.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.899+0000 7f0883abd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f087c1083d0 con 0x7f087c101a40 2024-09-04T16:29:40.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.899+0000 7f0881859640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f087c100840 0x7f087c195250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:40.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.899+0000 7f0881058640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f087c101a40 0x7f087c195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:40.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.899+0000 7f0881859640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f087c100840 0x7f087c195250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57370/0 (socket says 172.21.15.170:57370) 2024-09-04T16:29:40.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.899+0000 7f0881859640 1 -- 172.21.15.170:0/3722830585 learned_addr learned my addr 172.21.15.170:0/3722830585 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:29:40.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.900+0000 7f0881058640 1 -- 172.21.15.170:0/3722830585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f087c100840 msgr2=0x7f087c195250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:40.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.900+0000 7f0881058640 1 --2- 172.21.15.170:0/3722830585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f087c100840 0x7f087c195250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:40.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.900+0000 7f0881058640 1 -- 172.21.15.170:0/3722830585 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087c195e10 con 0x7f087c101a40 2024-09-04T16:29:40.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.900+0000 7f0881058640 1 --2- 172.21.15.170:0/3722830585 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f087c101a40 0x7f087c195790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f086c032e90 tx=0x7f086c004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:40.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.900+0000 7f0872ffd640 1 -- 172.21.15.170:0/3722830585 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f086c037040 con 0x7f087c101a40 2024-09-04T16:29:40.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.900+0000 7f0872ffd640 1 -- 172.21.15.170:0/3722830585 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f086c004460 con 0x7f087c101a40 2024-09-04T16:29:40.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.900+0000 7f0883abd640 1 -- 172.21.15.170:0/3722830585 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f087c19a7f0 con 0x7f087c101a40 2024-09-04T16:29:40.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.900+0000 7f0872ffd640 1 -- 172.21.15.170:0/3722830585 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f086c0035f0 con 0x7f087c101a40 2024-09-04T16:29:40.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.900+0000 7f0883abd640 1 -- 172.21.15.170:0/3722830585 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f087c19ae00 con 0x7f087c101a40 2024-09-04T16:29:40.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.902+0000 7f0883abd640 1 -- 172.21.15.170:0/3722830585 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f087c100c40 con 0x7f087c101a40 2024-09-04T16:29:40.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.902+0000 7f0872ffd640 1 -- 172.21.15.170:0/3722830585 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 97250+0+0 (secure 0 0 0) 0x7f086c042020 con 0x7f087c101a40 2024-09-04T16:29:40.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.903+0000 7f0872ffd640 1 --2- 172.21.15.170:0/3722830585 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f0868073fc0 0x7f0868076480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:40.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.903+0000 7f0872ffd640 1 -- 172.21.15.170:0/3722830585 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f086c040020 con 0x7f087c101a40 2024-09-04T16:29:40.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.903+0000 7f0881859640 1 --2- 172.21.15.170:0/3722830585 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f0868073fc0 0x7f0868076480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:40.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.904+0000 7f0881859640 1 --2- 172.21.15.170:0/3722830585 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f0868073fc0 0x7f0868076480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f087800ff50 tx=0x7f0878009260 comp rx=0 tx=0).ready entity=mgr.14682 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:40.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:40.908+0000 7f0872ffd640 1 -- 172.21.15.170:0/3722830585 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f086c049020 con 0x7f087c101a40 2024-09-04T16:29:41.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:40 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:41.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:40 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:41.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:40 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:41.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:40 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:41.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:40 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:41.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:40 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:41.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:40 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:41.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:40 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:41.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:40 smithi170 ceph-mon[29272]: Adjusting osd_memory_target on smithi193 to 2240M 2024-09-04T16:29:41.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:40 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:41.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:40 smithi170 ceph-mon[29272]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:29:41.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:40 smithi170 ceph-mon[29272]: pgmap v10: 65 pgs: 65 active+clean; 130 MiB data, 618 MiB used, 536 GiB / 536 GiB avail; 15 KiB/s rd, 2.1 MiB/s wr, 130 op/s 2024-09-04T16:29:41.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:40 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:41.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:40 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:41.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:40 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:41.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:40 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:41.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:40 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:41.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:40 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:41.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:40 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:41.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:40 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:41.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:40 smithi193 ceph-mon[36288]: Adjusting osd_memory_target on smithi193 to 2240M 2024-09-04T16:29:41.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:40 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:41.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:40 smithi193 ceph-mon[36288]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:29:41.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:40 smithi193 ceph-mon[36288]: pgmap v10: 65 pgs: 65 active+clean; 130 MiB data, 618 MiB used, 536 GiB / 536 GiB avail; 15 KiB/s rd, 2.1 MiB/s wr, 130 op/s 2024-09-04T16:29:41.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.290+0000 7f0883abd640 1 -- 172.21.15.170:0/3722830585 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f087c062df0 con 0x7f087c101a40 2024-09-04T16:29:41.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.290+0000 7f0872ffd640 1 -- 172.21.15.170:0/3722830585 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f086c07d570 con 0x7f087c101a40 2024-09-04T16:29:41.291 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:29:41.291 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:29:41.291 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 2 2024-09-04T16:29:41.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:29:41.292 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:29:41.292 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 1, 2024-09-04T16:29:41.292 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 1 2024-09-04T16:29:41.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:29:41.292 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:29:41.292 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 6 2024-09-04T16:29:41.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:29:41.292 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:29:41.292 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:29:41.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:29:41.292 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:29:41.292 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 13, 2024-09-04T16:29:41.293 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 1 2024-09-04T16:29:41.293 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:29:41.293 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:29:41.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.294+0000 7f0883abd640 1 -- 172.21.15.170:0/3722830585 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f0868073fc0 msgr2=0x7f0868076480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:41.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.294+0000 7f0883abd640 1 --2- 172.21.15.170:0/3722830585 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f0868073fc0 0x7f0868076480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f087800ff50 tx=0x7f0878009260 comp rx=0 tx=0).stop 2024-09-04T16:29:41.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.294+0000 7f0883abd640 1 -- 172.21.15.170:0/3722830585 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f087c101a40 msgr2=0x7f087c195790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:41.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.294+0000 7f0883abd640 1 --2- 172.21.15.170:0/3722830585 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f087c101a40 0x7f087c195790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f086c032e90 tx=0x7f086c004270 comp rx=0 tx=0).stop 2024-09-04T16:29:41.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.294+0000 7f0883abd640 1 -- 172.21.15.170:0/3722830585 shutdown_connections 2024-09-04T16:29:41.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.294+0000 7f0883abd640 1 --2- 172.21.15.170:0/3722830585 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f0868073fc0 0x7f0868076480 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:41.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.294+0000 7f0883abd640 1 --2- 172.21.15.170:0/3722830585 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f087c101a40 0x7f087c195790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:41.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.294+0000 7f0883abd640 1 --2- 172.21.15.170:0/3722830585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f087c100840 0x7f087c195250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:41.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.294+0000 7f0883abd640 1 -- 172.21.15.170:0/3722830585 >> 172.21.15.170:0/3722830585 conn(0x7f087c0fbff0 msgr2=0x7f087c104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:41.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.294+0000 7f0883abd640 1 -- 172.21.15.170:0/3722830585 shutdown_connections 2024-09-04T16:29:41.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.295+0000 7f0883abd640 1 -- 172.21.15.170:0/3722830585 wait complete. 2024-09-04T16:29:41.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.420+0000 7ff529691640 1 -- 172.21.15.170:0/2921240352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff524100b50 msgr2=0x7ff524100fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:41.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.420+0000 7ff529691640 1 --2- 172.21.15.170:0/2921240352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff524100b50 0x7ff524100fd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009880 tx=0x7ff50c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:29:41.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.420+0000 7ff529691640 1 -- 172.21.15.170:0/2921240352 shutdown_connections 2024-09-04T16:29:41.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.420+0000 7ff529691640 1 --2- 172.21.15.170:0/2921240352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff524100b50 0x7ff524100fd0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:41.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.420+0000 7ff529691640 1 --2- 172.21.15.170:0/2921240352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff524101e10 0x7ff524102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:41.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.420+0000 7ff529691640 1 -- 172.21.15.170:0/2921240352 >> 172.21.15.170:0/2921240352 conn(0x7ff5240fb7b0 msgr2=0x7ff5240fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:41.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.420+0000 7ff529691640 1 -- 172.21.15.170:0/2921240352 shutdown_connections 2024-09-04T16:29:41.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.420+0000 7ff529691640 1 -- 172.21.15.170:0/2921240352 wait complete. 2024-09-04T16:29:41.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.420+0000 7ff529691640 1 Processor -- start 2024-09-04T16:29:41.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.421+0000 7ff529691640 1 -- start start 2024-09-04T16:29:41.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.421+0000 7ff529691640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff524100b50 0x7ff52419da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:41.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.421+0000 7ff529691640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff524101e10 0x7ff52419dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:41.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.421+0000 7ff529691640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff5241096c0 con 0x7ff524101e10 2024-09-04T16:29:41.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.421+0000 7ff529691640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff524109540 con 0x7ff524100b50 2024-09-04T16:29:41.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.421+0000 7ff522ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff524100b50 0x7ff52419da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:41.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.421+0000 7ff522ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff524100b50 0x7ff52419da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.170:54386/0 (socket says 172.21.15.170:54386) 2024-09-04T16:29:41.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.421+0000 7ff522ffd640 1 -- 172.21.15.170:0/247553993 learned_addr learned my addr 172.21.15.170:0/247553993 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:29:41.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.421+0000 7ff51bfff640 1 --2- 172.21.15.170:0/247553993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff524101e10 0x7ff52419dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:41.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.421+0000 7ff522ffd640 1 -- 172.21.15.170:0/247553993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff524101e10 msgr2=0x7ff52419dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:41.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.421+0000 7ff522ffd640 1 --2- 172.21.15.170:0/247553993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff524101e10 0x7ff52419dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:41.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.421+0000 7ff522ffd640 1 -- 172.21.15.170:0/247553993 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52419e630 con 0x7ff524100b50 2024-09-04T16:29:41.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.422+0000 7ff522ffd640 1 --2- 172.21.15.170:0/247553993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff524100b50 0x7ff52419da70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff51400e940 tx=0x7ff51400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:41.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.422+0000 7ff520ff9640 1 -- 172.21.15.170:0/247553993 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff51400cac0 con 0x7ff524100b50 2024-09-04T16:29:41.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.422+0000 7ff529691640 1 -- 172.21.15.170:0/247553993 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5241a3070 con 0x7ff524100b50 2024-09-04T16:29:41.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.422+0000 7ff520ff9640 1 -- 172.21.15.170:0/247553993 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff51400cc60 con 0x7ff524100b50 2024-09-04T16:29:41.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.422+0000 7ff520ff9640 1 -- 172.21.15.170:0/247553993 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff514003e30 con 0x7ff524100b50 2024-09-04T16:29:41.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.422+0000 7ff529691640 1 -- 172.21.15.170:0/247553993 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5241a3600 con 0x7ff524100b50 2024-09-04T16:29:41.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.423+0000 7ff529691640 1 -- 172.21.15.170:0/247553993 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff524100fd0 con 0x7ff524100b50 2024-09-04T16:29:41.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.423+0000 7ff520ff9640 1 -- 172.21.15.170:0/247553993 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 97250+0+0 (secure 0 0 0) 0x7ff514004030 con 0x7ff524100b50 2024-09-04T16:29:41.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.424+0000 7ff520ff9640 1 --2- 172.21.15.170:0/247553993 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7ff510073fc0 0x7ff510076480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:29:41.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.424+0000 7ff520ff9640 1 -- 172.21.15.170:0/247553993 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7ff514095ae0 con 0x7ff524100b50 2024-09-04T16:29:41.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.424+0000 7ff51bfff640 1 --2- 172.21.15.170:0/247553993 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7ff510073fc0 0x7ff510076480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:29:41.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.425+0000 7ff51bfff640 1 --2- 172.21.15.170:0/247553993 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7ff510073fc0 0x7ff510076480 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff52419ef20 tx=0x7ff50c005b50 comp rx=0 tx=0).ready entity=mgr.14682 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:29:41.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.429+0000 7ff520ff9640 1 -- 172.21.15.170:0/247553993 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7ff51405d4b0 con 0x7ff524100b50 2024-09-04T16:29:41.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.733+0000 7ff529691640 1 -- 172.21.15.170:0/247553993 --> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff5241001c0 con 0x7ff510073fc0 2024-09-04T16:29:41.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.734+0000 7ff520ff9640 1 -- 172.21.15.170:0/247553993 <== mgr.14682 v2:172.21.15.193:6828/4218378172 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7ff5241001c0 con 0x7ff510073fc0 2024-09-04T16:29:41.735 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:29:41.735 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:29:41.735 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:29:41.735 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-04T16:29:41.735 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [], 2024-09-04T16:29:41.736 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "1/2 daemons upgraded", 2024-09-04T16:29:41.736 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "", 2024-09-04T16:29:41.736 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:29:41.736 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:29:41.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.737+0000 7ff529691640 1 -- 172.21.15.170:0/247553993 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7ff510073fc0 msgr2=0x7ff510076480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:41.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.737+0000 7ff529691640 1 --2- 172.21.15.170:0/247553993 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7ff510073fc0 0x7ff510076480 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff52419ef20 tx=0x7ff50c005b50 comp rx=0 tx=0).stop 2024-09-04T16:29:41.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.737+0000 7ff529691640 1 -- 172.21.15.170:0/247553993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff524100b50 msgr2=0x7ff52419da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:29:41.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.737+0000 7ff529691640 1 --2- 172.21.15.170:0/247553993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff524100b50 0x7ff52419da70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff51400e940 tx=0x7ff51400ee00 comp rx=0 tx=0).stop 2024-09-04T16:29:41.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.737+0000 7ff529691640 1 -- 172.21.15.170:0/247553993 shutdown_connections 2024-09-04T16:29:41.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.737+0000 7ff529691640 1 --2- 172.21.15.170:0/247553993 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7ff510073fc0 0x7ff510076480 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:41.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.737+0000 7ff529691640 1 --2- 172.21.15.170:0/247553993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff524101e10 0x7ff52419dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:41.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.737+0000 7ff529691640 1 --2- 172.21.15.170:0/247553993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff524100b50 0x7ff52419da70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:29:41.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.738+0000 7ff529691640 1 -- 172.21.15.170:0/247553993 >> 172.21.15.170:0/247553993 conn(0x7ff5240fb7b0 msgr2=0x7ff5240ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:29:41.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.738+0000 7ff529691640 1 -- 172.21.15.170:0/247553993 shutdown_connections 2024-09-04T16:29:41.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:29:41.738+0000 7ff529691640 1 -- 172.21.15.170:0/247553993 wait complete. 2024-09-04T16:29:42.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:41 smithi170 ceph-mon[29272]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:29:42.139 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:41 smithi170 ceph-mon[29272]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:29:42.139 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:41 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:42.139 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:41 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:42.139 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:41 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3722830585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:29:42.139 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:41 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:42.139 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:41 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:42.139 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:41 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:42.139 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:41 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:42.139 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:41 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:42.140 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:41 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:42.140 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:41 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:42.140 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:41 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:42.140 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:41 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:42.140 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:41 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:29:42.140 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:41 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:29:42.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:41 smithi193 ceph-mon[36288]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:29:42.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:41 smithi193 ceph-mon[36288]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:29:42.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:41 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:42.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:41 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:42.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:41 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3722830585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:29:42.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:41 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:42.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:41 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:42.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:41 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:42.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:41 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:42.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:41 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:42.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:41 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:42.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:41 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:42.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:41 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-04T16:29:42.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:41 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:42.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:41 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:29:42.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:41 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:29:43.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:42 smithi193 ceph-mon[36288]: Adjusting osd_memory_target on smithi170 to 1216M 2024-09-04T16:29:43.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:42 smithi193 ceph-mon[36288]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-04T16:29:43.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:42 smithi193 ceph-mon[36288]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-04T16:29:43.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:42 smithi193 ceph-mon[36288]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:29:43.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:42 smithi193 ceph-mon[36288]: Updating smithi170:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:29:43.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:42 smithi193 ceph-mon[36288]: Updating smithi193:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:29:43.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:42 smithi193 ceph-mon[36288]: pgmap v11: 65 pgs: 65 active+clean; 130 MiB data, 618 MiB used, 536 GiB / 536 GiB avail; 15 KiB/s rd, 2.1 MiB/s wr, 130 op/s 2024-09-04T16:29:43.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:42 smithi193 ceph-mon[36288]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-04T16:29:43.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:42 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:29:43.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:42 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:43.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:42 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:43.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:42 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:43.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:42 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:43.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:42 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:43.328 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:42 smithi170 ceph-mon[29272]: Adjusting osd_memory_target on smithi170 to 1216M 2024-09-04T16:29:43.328 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:42 smithi170 ceph-mon[29272]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-04T16:29:43.328 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:42 smithi170 ceph-mon[29272]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-04T16:29:43.328 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:42 smithi170 ceph-mon[29272]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:29:43.328 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:42 smithi170 ceph-mon[29272]: Updating smithi170:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:29:43.328 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:42 smithi170 ceph-mon[29272]: Updating smithi193:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:29:43.329 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:42 smithi170 ceph-mon[29272]: pgmap v11: 65 pgs: 65 active+clean; 130 MiB data, 618 MiB used, 536 GiB / 536 GiB avail; 15 KiB/s rd, 2.1 MiB/s wr, 130 op/s 2024-09-04T16:29:43.329 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:42 smithi170 ceph-mon[29272]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-04T16:29:43.329 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:42 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:29:43.329 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:42 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:43.329 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:42 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:43.329 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:42 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:43.329 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:42 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:43.329 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:42 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:44.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:43 smithi193 ceph-mon[36288]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-09-04T16:29:44.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:43 smithi193 ceph-mon[36288]: Updating smithi193:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-04T16:29:44.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:43 smithi193 ceph-mon[36288]: Updating smithi170:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-04T16:29:44.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:43 smithi193 ceph-mon[36288]: Reconfiguring ceph-exporter.smithi170 (dependencies changed)... 2024-09-04T16:29:44.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:43 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-04T16:29:44.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:43 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-04T16:29:44.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:43 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:29:44.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:43 smithi193 ceph-mon[36288]: Deploying daemon ceph-exporter.smithi170 on smithi170 2024-09-04T16:29:44.254 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:43 smithi170 ceph-mon[29272]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-09-04T16:29:44.255 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:43 smithi170 ceph-mon[29272]: Updating smithi193:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-04T16:29:44.255 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:43 smithi170 ceph-mon[29272]: Updating smithi170:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-04T16:29:44.255 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:43 smithi170 ceph-mon[29272]: Reconfiguring ceph-exporter.smithi170 (dependencies changed)... 2024-09-04T16:29:44.255 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:43 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-04T16:29:44.255 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:43 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-04T16:29:44.255 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:43 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:29:44.255 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:43 smithi170 ceph-mon[29272]: Deploying daemon ceph-exporter.smithi170 on smithi170 2024-09-04T16:29:45.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:44 smithi170 ceph-mon[29272]: pgmap v12: 65 pgs: 65 active+clean; 153 MiB data, 678 MiB used, 536 GiB / 536 GiB avail; 15 KiB/s rd, 4.1 MiB/s wr, 245 op/s 2024-09-04T16:29:45.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:44 smithi193 ceph-mon[36288]: pgmap v12: 65 pgs: 65 active+clean; 153 MiB data, 678 MiB used, 536 GiB / 536 GiB avail; 15 KiB/s rd, 4.1 MiB/s wr, 245 op/s 2024-09-04T16:29:47.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:47 smithi170 ceph-mon[29272]: pgmap v13: 65 pgs: 65 active+clean; 153 MiB data, 678 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.1 MiB/s wr, 190 op/s 2024-09-04T16:29:47.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:47 smithi193 ceph-mon[36288]: pgmap v13: 65 pgs: 65 active+clean; 153 MiB data, 678 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.1 MiB/s wr, 190 op/s 2024-09-04T16:29:49.423 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:49 smithi170 ceph-mon[29272]: pgmap v14: 65 pgs: 65 active+clean; 168 MiB data, 721 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.4 MiB/s wr, 333 op/s 2024-09-04T16:29:49.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:49 smithi193 ceph-mon[36288]: pgmap v14: 65 pgs: 65 active+clean; 168 MiB data, 721 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.4 MiB/s wr, 333 op/s 2024-09-04T16:29:51.438 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:51 smithi170 ceph-mon[29272]: pgmap v15: 65 pgs: 65 active+clean; 168 MiB data, 721 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 256 op/s 2024-09-04T16:29:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:51 smithi193 ceph-mon[36288]: pgmap v15: 65 pgs: 65 active+clean; 168 MiB data, 721 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 256 op/s 2024-09-04T16:29:52.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:52 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:52.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:52 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:52.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:52 smithi170 ceph-mon[29272]: Reconfiguring prometheus.smithi170 (dependencies changed)... 2024-09-04T16:29:52.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:52 smithi170 ceph-mon[29272]: Reconfiguring daemon prometheus.smithi170 on smithi170 2024-09-04T16:29:52.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:52 smithi170 ceph-mon[29272]: pgmap v16: 65 pgs: 65 active+clean; 168 MiB data, 721 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 256 op/s 2024-09-04T16:29:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:52 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:52 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:29:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:52 smithi193 ceph-mon[36288]: Reconfiguring prometheus.smithi170 (dependencies changed)... 2024-09-04T16:29:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:52 smithi193 ceph-mon[36288]: Reconfiguring daemon prometheus.smithi170 on smithi170 2024-09-04T16:29:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:52 smithi193 ceph-mon[36288]: pgmap v16: 65 pgs: 65 active+clean; 168 MiB data, 721 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 256 op/s 2024-09-04T16:29:55.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:55 smithi170 ceph-mon[29272]: pgmap v17: 65 pgs: 65 active+clean; 191 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.2 MiB/s wr, 447 op/s 2024-09-04T16:29:55.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:55 smithi193 ceph-mon[36288]: pgmap v17: 65 pgs: 65 active+clean; 191 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.2 MiB/s wr, 447 op/s 2024-09-04T16:29:55.714 INFO:tasks.workunit.client.1.smithi193.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-04T16:29:55.720 INFO:tasks.workunit.client.1.smithi193.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-04T16:29:55.720 INFO:tasks.workunit.client.1.smithi193.stderr:+ make 2024-09-04T16:29:55.981 INFO:tasks.workunit.client.1.smithi193.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-04T16:29:56.356 INFO:tasks.workunit.client.1.smithi193.stderr:++ readlink -f fsstress 2024-09-04T16:29:56.357 INFO:tasks.workunit.client.1.smithi193.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-04T16:29:56.357 INFO:tasks.workunit.client.1.smithi193.stderr:+ popd 2024-09-04T16:29:56.358 INFO:tasks.workunit.client.1.smithi193.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-04T16:29:56.359 INFO:tasks.workunit.client.1.smithi193.stderr:+ popd 2024-09-04T16:29:56.359 INFO:tasks.workunit.client.1.smithi193.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-04T16:29:56.359 INFO:tasks.workunit.client.1.smithi193.stderr:++ mktemp -d -p . 2024-09-04T16:29:56.361 INFO:tasks.workunit.client.1.smithi193.stderr:+ T=./tmp.OXhN2ZnmDj 2024-09-04T16:29:56.361 INFO:tasks.workunit.client.1.smithi193.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.OXhN2ZnmDj -l 1 -n 1000 -p 10 -v 2024-09-04T16:29:56.364 INFO:tasks.workunit.client.1.smithi193.stdout:seed = 1725765657 2024-09-04T16:29:56.368 INFO:tasks.workunit.client.1.smithi193.stdout:0/0: dwrite - no filename 2024-09-04T16:29:56.371 INFO:tasks.workunit.client.1.smithi193.stdout:0/1: creat f0 x:0 0 0 2024-09-04T16:29:56.372 INFO:tasks.workunit.client.1.smithi193.stdout:1/0: symlink l0 0 2024-09-04T16:29:56.374 INFO:tasks.workunit.client.1.smithi193.stdout:0/2: creat f1 x:0 0 0 2024-09-04T16:29:56.374 INFO:tasks.workunit.client.1.smithi193.stdout:1/1: mkdir d1 0 2024-09-04T16:29:56.374 INFO:tasks.workunit.client.1.smithi193.stdout:1/2: readlink l0 0 2024-09-04T16:29:56.374 INFO:tasks.workunit.client.1.smithi193.stdout:1/3: dwrite - no filename 2024-09-04T16:29:56.374 INFO:tasks.workunit.client.1.smithi193.stdout:1/4: write - no filename 2024-09-04T16:29:56.375 INFO:tasks.workunit.client.1.smithi193.stdout:1/5: dwrite - no filename 2024-09-04T16:29:56.375 INFO:tasks.workunit.client.1.smithi193.stdout:2/0: creat f0 x:0 0 0 2024-09-04T16:29:56.431 INFO:tasks.workunit.client.1.smithi193.stdout:0/3: creat f2 x:0 0 0 2024-09-04T16:29:56.431 INFO:tasks.workunit.client.1.smithi193.stdout:0/4: write f1 [208460,58440] 0 2024-09-04T16:29:56.432 INFO:tasks.workunit.client.1.smithi193.stdout:1/6: rename l0 to d1/l2 0 2024-09-04T16:29:56.433 INFO:tasks.workunit.client.1.smithi193.stdout:2/1: creat f1 x:0 0 0 2024-09-04T16:29:56.433 INFO:tasks.workunit.client.1.smithi193.stdout:3/0: mkdir d0 0 2024-09-04T16:29:56.433 INFO:tasks.workunit.client.1.smithi193.stdout:0/5: fdatasync f1 0 2024-09-04T16:29:56.437 INFO:tasks.workunit.client.1.smithi193.stdout:1/7: rmdir d1 39 2024-09-04T16:29:56.437 INFO:tasks.workunit.client.1.smithi193.stdout:2/2: unlink f0 0 2024-09-04T16:29:56.438 INFO:tasks.workunit.client.1.smithi193.stdout:2/3: rmdir - no directory 2024-09-04T16:29:56.438 INFO:tasks.workunit.client.1.smithi193.stdout:2/4: chown f1 14385 1 2024-09-04T16:29:56.438 INFO:tasks.workunit.client.1.smithi193.stdout:2/5: write f1 [938205,10882] 0 2024-09-04T16:29:56.440 INFO:tasks.workunit.client.1.smithi193.stdout:0/6: rename f0 to f3 0 2024-09-04T16:29:56.443 INFO:tasks.workunit.client.1.smithi193.stdout:3/1: symlink d0/l1 0 2024-09-04T16:29:56.443 INFO:tasks.workunit.client.1.smithi193.stdout:3/2: read - no filename 2024-09-04T16:29:56.446 INFO:tasks.workunit.client.1.smithi193.stdout:7/0: dread - no filename 2024-09-04T16:29:56.446 INFO:tasks.workunit.client.1.smithi193.stdout:7/1: rmdir - no directory 2024-09-04T16:29:56.446 INFO:tasks.workunit.client.1.smithi193.stdout:7/2: write - no filename 2024-09-04T16:29:56.446 INFO:tasks.workunit.client.1.smithi193.stdout:7/3: read - no filename 2024-09-04T16:29:56.446 INFO:tasks.workunit.client.1.smithi193.stdout:7/4: read - no filename 2024-09-04T16:29:56.446 INFO:tasks.workunit.client.1.smithi193.stdout:7/5: dread - no filename 2024-09-04T16:29:56.446 INFO:tasks.workunit.client.1.smithi193.stdout:7/6: write - no filename 2024-09-04T16:29:56.446 INFO:tasks.workunit.client.1.smithi193.stdout:7/7: write - no filename 2024-09-04T16:29:56.447 INFO:tasks.workunit.client.1.smithi193.stdout:5/0: mkdir d0 0 2024-09-04T16:29:56.451 INFO:tasks.workunit.client.1.smithi193.stdout:6/0: creat f0 x:0 0 0 2024-09-04T16:29:56.463 INFO:tasks.workunit.client.1.smithi193.stdout:6/1: creat f1 x:0 0 0 2024-09-04T16:29:56.463 INFO:tasks.workunit.client.1.smithi193.stdout:7/8: symlink l0 0 2024-09-04T16:29:56.472 INFO:tasks.workunit.client.1.smithi193.stdout:8/0: creat f0 x:0 0 0 2024-09-04T16:29:56.474 INFO:tasks.workunit.client.1.smithi193.stdout:6/2: rename f0 to f2 0 2024-09-04T16:29:56.475 INFO:tasks.workunit.client.1.smithi193.stdout:7/9: creat f1 x:0 0 0 2024-09-04T16:29:56.477 INFO:tasks.workunit.client.1.smithi193.stdout:5/1: rmdir d0 0 2024-09-04T16:29:56.479 INFO:tasks.workunit.client.1.smithi193.stdout:9/0: creat f0 x:0 0 0 2024-09-04T16:29:56.480 INFO:tasks.workunit.client.1.smithi193.stdout:8/1: dwrite f0 [0,4194304] 0 2024-09-04T16:29:56.482 INFO:tasks.workunit.client.1.smithi193.stdout:6/3: rename f1 to f3 0 2024-09-04T16:29:56.484 INFO:tasks.workunit.client.1.smithi193.stdout:7/10: dwrite f1 [0,4194304] 0 2024-09-04T16:29:56.485 INFO:tasks.workunit.client.1.smithi193.stdout:7/11: stat l0 0 2024-09-04T16:29:56.487 INFO:tasks.workunit.client.1.smithi193.stdout:5/2: mkdir d1 0 2024-09-04T16:29:56.493 INFO:tasks.workunit.client.1.smithi193.stdout:8/2: symlink l1 0 2024-09-04T16:29:56.497 INFO:tasks.workunit.client.1.smithi193.stdout:6/4: symlink l4 0 2024-09-04T16:29:56.498 INFO:tasks.workunit.client.1.smithi193.stdout:6/5: dread - f3 zero size 2024-09-04T16:29:56.498 INFO:tasks.workunit.client.1.smithi193.stdout:6/6: dread - f3 zero size 2024-09-04T16:29:56.498 INFO:tasks.workunit.client.1.smithi193.stdout:7/12: symlink l2 0 2024-09-04T16:29:56.499 INFO:tasks.workunit.client.1.smithi193.stdout:7/13: chown l2 771318 1 2024-09-04T16:29:56.499 INFO:tasks.workunit.client.1.smithi193.stdout:6/7: chown f2 2885451 1 2024-09-04T16:29:56.503 INFO:tasks.workunit.client.1.smithi193.stdout:9/1: link f0 f1 0 2024-09-04T16:29:56.504 INFO:tasks.workunit.client.1.smithi193.stdout:8/3: mkdir d2 0 2024-09-04T16:29:56.504 INFO:tasks.workunit.client.1.smithi193.stdout:5/3: getdents d1 0 2024-09-04T16:29:56.504 INFO:tasks.workunit.client.1.smithi193.stdout:5/4: write - no filename 2024-09-04T16:29:56.505 INFO:tasks.workunit.client.1.smithi193.stdout:7/14: dread f1 [0,4194304] 0 2024-09-04T16:29:56.505 INFO:tasks.workunit.client.1.smithi193.stdout:5/5: rename d1 to d1/d2 22 2024-09-04T16:29:56.507 INFO:tasks.workunit.client.1.smithi193.stdout:6/8: mkdir d5 0 2024-09-04T16:29:56.508 INFO:tasks.workunit.client.1.smithi193.stdout:8/4: dread f0 [0,4194304] 0 2024-09-04T16:29:56.509 INFO:tasks.workunit.client.1.smithi193.stdout:9/2: mkdir d2 0 2024-09-04T16:29:56.509 INFO:tasks.workunit.client.1.smithi193.stdout:9/3: truncate f0 279099 0 2024-09-04T16:29:56.514 INFO:tasks.workunit.client.1.smithi193.stdout:6/9: write f2 [37335,15303] 0 2024-09-04T16:29:56.515 INFO:tasks.workunit.client.1.smithi193.stdout:6/10: truncate f3 632988 0 2024-09-04T16:29:56.515 INFO:tasks.workunit.client.1.smithi193.stdout:6/11: readlink l4 0 2024-09-04T16:29:56.515 INFO:tasks.workunit.client.1.smithi193.stdout:6/12: readlink l4 0 2024-09-04T16:29:56.519 INFO:tasks.workunit.client.1.smithi193.stdout:5/6: creat d1/f3 x:0 0 0 2024-09-04T16:29:56.519 INFO:tasks.workunit.client.1.smithi193.stdout:5/7: rename d1 to d1/d4 22 2024-09-04T16:29:56.520 INFO:tasks.workunit.client.1.smithi193.stdout:8/5: creat d2/f3 x:0 0 0 2024-09-04T16:29:56.522 INFO:tasks.workunit.client.1.smithi193.stdout:9/4: mknod d2/c3 0 2024-09-04T16:29:56.523 INFO:tasks.workunit.client.1.smithi193.stdout:5/8: mknod d1/c5 0 2024-09-04T16:29:56.524 INFO:tasks.workunit.client.1.smithi193.stdout:8/6: fdatasync f0 0 2024-09-04T16:29:56.526 INFO:tasks.workunit.client.1.smithi193.stdout:6/13: creat d5/f6 x:0 0 0 2024-09-04T16:29:56.527 INFO:tasks.workunit.client.1.smithi193.stdout:9/5: mkdir d2/d4 0 2024-09-04T16:29:56.528 INFO:tasks.workunit.client.1.smithi193.stdout:9/6: chown d2/d4 982606729 1 2024-09-04T16:29:56.531 INFO:tasks.workunit.client.1.smithi193.stdout:5/9: dwrite d1/f3 [0,4194304] 0 2024-09-04T16:29:56.534 INFO:tasks.workunit.client.1.smithi193.stdout:5/10: rename d1/c5 to d1/c6 0 2024-09-04T16:29:56.540 INFO:tasks.workunit.client.1.smithi193.stdout:9/7: dwrite f1 [0,4194304] 0 2024-09-04T16:29:56.546 INFO:tasks.workunit.client.1.smithi193.stdout:1/8: mkdir d1/d3 0 2024-09-04T16:29:56.546 INFO:tasks.workunit.client.1.smithi193.stdout:1/9: read - no filename 2024-09-04T16:29:56.547 INFO:tasks.workunit.client.1.smithi193.stdout:5/11: dwrite d1/f3 [0,4194304] 0 2024-09-04T16:29:56.550 INFO:tasks.workunit.client.1.smithi193.stdout:9/8: dwrite f0 [0,4194304] 0 2024-09-04T16:29:56.555 INFO:tasks.workunit.client.1.smithi193.stdout:9/9: creat d2/d4/f5 x:0 0 0 2024-09-04T16:29:56.556 INFO:tasks.workunit.client.1.smithi193.stdout:5/12: dwrite d1/f3 [0,4194304] 0 2024-09-04T16:29:56.559 INFO:tasks.workunit.client.1.smithi193.stdout:0/7: getdents . 0 2024-09-04T16:29:56.559 INFO:tasks.workunit.client.1.smithi193.stdout:9/10: creat d2/f6 x:0 0 0 2024-09-04T16:29:56.562 INFO:tasks.workunit.client.1.smithi193.stdout:0/8: symlink l4 0 2024-09-04T16:29:56.563 INFO:tasks.workunit.client.1.smithi193.stdout:3/3: getdents d0 0 2024-09-04T16:29:56.563 INFO:tasks.workunit.client.1.smithi193.stdout:0/9: write f2 [172971,93437] 0 2024-09-04T16:29:56.568 INFO:tasks.workunit.client.1.smithi193.stdout:0/10: symlink l5 0 2024-09-04T16:29:56.571 INFO:tasks.workunit.client.1.smithi193.stdout:0/11: creat f6 x:0 0 0 2024-09-04T16:29:56.573 INFO:tasks.workunit.client.1.smithi193.stdout:0/12: dread f1 [0,4194304] 0 2024-09-04T16:29:56.576 INFO:tasks.workunit.client.1.smithi193.stdout:0/13: link l4 l7 0 2024-09-04T16:29:56.578 INFO:tasks.workunit.client.1.smithi193.stdout:0/14: write f3 [70792,68309] 0 2024-09-04T16:29:56.580 INFO:tasks.workunit.client.1.smithi193.stdout:5/13: fdatasync d1/f3 0 2024-09-04T16:29:56.580 INFO:tasks.workunit.client.1.smithi193.stdout:8/7: fsync f0 0 2024-09-04T16:29:56.581 INFO:tasks.workunit.client.1.smithi193.stdout:6/14: rename f2 to d5/f7 0 2024-09-04T16:29:56.581 INFO:tasks.workunit.client.1.smithi193.stdout:1/10: rename d1 to d1/d4 22 2024-09-04T16:29:56.581 INFO:tasks.workunit.client.1.smithi193.stdout:3/4: rename d0 to d0/d2 22 2024-09-04T16:29:56.581 INFO:tasks.workunit.client.1.smithi193.stdout:3/5: dwrite - no filename 2024-09-04T16:29:56.581 INFO:tasks.workunit.client.1.smithi193.stdout:3/6: chown d0 9114 1 2024-09-04T16:29:56.582 INFO:tasks.workunit.client.1.smithi193.stdout:8/8: mknod d2/c4 0 2024-09-04T16:29:56.582 INFO:tasks.workunit.client.1.smithi193.stdout:6/15: dread f3 [0,4194304] 0 2024-09-04T16:29:56.586 INFO:tasks.workunit.client.1.smithi193.stdout:3/7: creat d0/f3 x:0 0 0 2024-09-04T16:29:56.588 INFO:tasks.workunit.client.1.smithi193.stdout:6/16: dwrite d5/f6 [0,4194304] 0 2024-09-04T16:29:56.589 INFO:tasks.workunit.client.1.smithi193.stdout:1/11: symlink d1/d3/l5 0 2024-09-04T16:29:56.591 INFO:tasks.workunit.client.1.smithi193.stdout:7/15: write f1 [4222168,55210] 0 2024-09-04T16:29:56.595 INFO:tasks.workunit.client.1.smithi193.stdout:1/12: rmdir d1/d3 39 2024-09-04T16:29:56.598 INFO:tasks.workunit.client.1.smithi193.stdout:7/16: creat f3 x:0 0 0 2024-09-04T16:29:56.601 INFO:tasks.workunit.client.1.smithi193.stdout:7/17: rename l2 to l4 0 2024-09-04T16:29:56.602 INFO:tasks.workunit.client.1.smithi193.stdout:7/18: truncate f3 17017 0 2024-09-04T16:29:56.616 INFO:tasks.workunit.client.1.smithi193.stdout:9/11: write f0 [4114043,107568] 0 2024-09-04T16:29:56.617 INFO:tasks.workunit.client.1.smithi193.stdout:5/14: dwrite d1/f3 [4194304,4194304] 0 2024-09-04T16:29:56.617 INFO:tasks.workunit.client.1.smithi193.stdout:5/15: rename d1 to d1/d7 22 2024-09-04T16:29:56.621 INFO:tasks.workunit.client.1.smithi193.stdout:9/12: dread f1 [0,4194304] 0 2024-09-04T16:29:56.621 INFO:tasks.workunit.client.1.smithi193.stdout:1/13: chown d1/d3 2099060 1 2024-09-04T16:29:56.623 INFO:tasks.workunit.client.1.smithi193.stdout:1/14: rmdir d1/d3 39 2024-09-04T16:29:56.623 INFO:tasks.workunit.client.1.smithi193.stdout:1/15: write - no filename 2024-09-04T16:29:56.628 INFO:tasks.workunit.client.1.smithi193.stdout:9/13: link d2/f6 d2/d4/f7 0 2024-09-04T16:29:56.632 INFO:tasks.workunit.client.1.smithi193.stdout:9/14: mkdir d2/d8 0 2024-09-04T16:29:56.632 INFO:tasks.workunit.client.1.smithi193.stdout:5/16: fsync d1/f3 0 2024-09-04T16:29:56.633 INFO:tasks.workunit.client.1.smithi193.stdout:9/15: stat d2/d8 0 2024-09-04T16:29:56.633 INFO:tasks.workunit.client.1.smithi193.stdout:9/16: readlink - no filename 2024-09-04T16:29:56.636 INFO:tasks.workunit.client.1.smithi193.stdout:9/17: rmdir d2/d4 39 2024-09-04T16:29:56.638 INFO:tasks.workunit.client.1.smithi193.stdout:1/16: link d1/l2 d1/d3/l6 0 2024-09-04T16:29:56.638 INFO:tasks.workunit.client.1.smithi193.stdout:1/17: dread - no filename 2024-09-04T16:29:56.638 INFO:tasks.workunit.client.1.smithi193.stdout:1/18: dwrite - no filename 2024-09-04T16:29:56.639 INFO:tasks.workunit.client.1.smithi193.stdout:9/18: stat d2/d4/f5 0 2024-09-04T16:29:56.640 INFO:tasks.workunit.client.1.smithi193.stdout:9/19: read - d2/d4/f7 zero size 2024-09-04T16:29:56.641 INFO:tasks.workunit.client.1.smithi193.stdout:6/17: fsync d5/f7 0 2024-09-04T16:29:56.714 INFO:tasks.workunit.client.1.smithi193.stdout:5/17: getdents d1 0 2024-09-04T16:29:56.719 INFO:tasks.workunit.client.1.smithi193.stdout:5/18: dwrite d1/f3 [4194304,4194304] 0 2024-09-04T16:29:56.723 INFO:tasks.workunit.client.1.smithi193.stdout:8/9: truncate f0 1437214 0 2024-09-04T16:29:56.724 INFO:tasks.workunit.client.1.smithi193.stdout:8/10: stat l1 0 2024-09-04T16:29:56.729 INFO:tasks.workunit.client.1.smithi193.stdout:1/19: creat d1/f7 x:0 0 0 2024-09-04T16:29:56.729 INFO:tasks.workunit.client.1.smithi193.stdout:9/20: dwrite f1 [0,4194304] 0 2024-09-04T16:29:56.730 INFO:tasks.workunit.client.1.smithi193.stdout:5/19: dwrite d1/f3 [0,4194304] 0 2024-09-04T16:29:56.736 INFO:tasks.workunit.client.1.smithi193.stdout:1/20: mknod d1/d3/c8 0 2024-09-04T16:29:56.738 INFO:tasks.workunit.client.1.smithi193.stdout:6/18: dwrite f3 [0,4194304] 0 2024-09-04T16:29:56.742 INFO:tasks.workunit.client.1.smithi193.stdout:9/21: dwrite d2/d4/f5 [0,4194304] 0 2024-09-04T16:29:56.747 INFO:tasks.workunit.client.1.smithi193.stdout:1/21: rename d1/d3/l5 to d1/d3/l9 0 2024-09-04T16:29:56.751 INFO:tasks.workunit.client.1.smithi193.stdout:5/20: fdatasync d1/f3 0 2024-09-04T16:29:56.753 INFO:tasks.workunit.client.1.smithi193.stdout:8/11: link l1 d2/l5 0 2024-09-04T16:29:56.756 INFO:tasks.workunit.client.1.smithi193.stdout:5/21: mkdir d1/d8 0 2024-09-04T16:29:56.760 INFO:tasks.workunit.client.1.smithi193.stdout:5/22: dread d1/f3 [4194304,4194304] 0 2024-09-04T16:29:56.764 INFO:tasks.workunit.client.1.smithi193.stdout:1/22: symlink d1/la 0 2024-09-04T16:29:56.765 INFO:tasks.workunit.client.1.smithi193.stdout:1/23: truncate d1/f7 940963 0 2024-09-04T16:29:56.765 INFO:tasks.workunit.client.1.smithi193.stdout:1/24: fdatasync d1/f7 0 2024-09-04T16:29:56.767 INFO:tasks.workunit.client.1.smithi193.stdout:1/25: dread d1/f7 [0,4194304] 0 2024-09-04T16:29:56.768 INFO:tasks.workunit.client.1.smithi193.stdout:5/23: unlink d1/c6 0 2024-09-04T16:29:56.772 INFO:tasks.workunit.client.1.smithi193.stdout:5/24: dread d1/f3 [4194304,4194304] 0 2024-09-04T16:29:56.772 INFO:tasks.workunit.client.1.smithi193.stdout:5/25: rename d1 to d1/d8/d9 22 2024-09-04T16:29:56.773 INFO:tasks.workunit.client.1.smithi193.stdout:1/26: chown d1/l2 1970 1 2024-09-04T16:29:56.773 INFO:tasks.workunit.client.1.smithi193.stdout:1/27: read d1/f7 [611125,52617] 0 2024-09-04T16:29:56.777 INFO:tasks.workunit.client.1.smithi193.stdout:5/26: creat d1/fa x:0 0 0 2024-09-04T16:29:56.777 INFO:tasks.workunit.client.1.smithi193.stdout:5/27: chown d1/f3 218118 1 2024-09-04T16:29:56.778 INFO:tasks.workunit.client.1.smithi193.stdout:5/28: write d1/fa [429582,94037] 0 2024-09-04T16:29:56.779 INFO:tasks.workunit.client.1.smithi193.stdout:1/28: mkdir d1/d3/db 0 2024-09-04T16:29:56.779 INFO:tasks.workunit.client.1.smithi193.stdout:1/29: fdatasync d1/f7 0 2024-09-04T16:29:56.780 INFO:tasks.workunit.client.1.smithi193.stdout:1/30: chown d1/d3 1097 1 2024-09-04T16:29:56.784 INFO:tasks.workunit.client.1.smithi193.stdout:5/29: mkdir d1/d8/db 0 2024-09-04T16:29:56.784 INFO:tasks.workunit.client.1.smithi193.stdout:5/30: write d1/fa [87094,106504] 0 2024-09-04T16:29:56.786 INFO:tasks.workunit.client.1.smithi193.stdout:1/31: mknod d1/cc 0 2024-09-04T16:29:56.786 INFO:tasks.workunit.client.1.smithi193.stdout:1/32: read d1/f7 [100237,62335] 0 2024-09-04T16:29:56.789 INFO:tasks.workunit.client.1.smithi193.stdout:9/22: truncate f0 1784598 0 2024-09-04T16:29:56.790 INFO:tasks.workunit.client.1.smithi193.stdout:5/31: unlink d1/fa 0 2024-09-04T16:29:56.793 INFO:tasks.workunit.client.1.smithi193.stdout:1/33: dwrite d1/f7 [0,4194304] 0 2024-09-04T16:29:56.798 INFO:tasks.workunit.client.1.smithi193.stdout:5/32: dwrite d1/f3 [0,4194304] 0 2024-09-04T16:29:56.799 INFO:tasks.workunit.client.1.smithi193.stdout:5/33: chown d1/d8 18337 1 2024-09-04T16:29:56.800 INFO:tasks.workunit.client.1.smithi193.stdout:5/34: truncate d1/f3 8753614 0 2024-09-04T16:29:56.801 INFO:tasks.workunit.client.1.smithi193.stdout:1/34: mkdir d1/d3/dd 0 2024-09-04T16:29:56.807 INFO:tasks.workunit.client.1.smithi193.stdout:9/23: link d2/f6 d2/d8/f9 0 2024-09-04T16:29:56.815 INFO:tasks.workunit.client.1.smithi193.stdout:9/24: read f0 [1043843,14363] 0 2024-09-04T16:29:56.816 INFO:tasks.workunit.client.1.smithi193.stdout:1/35: link d1/d3/c8 d1/d3/ce 0 2024-09-04T16:29:56.820 INFO:tasks.workunit.client.1.smithi193.stdout:8/12: dread f0 [0,4194304] 0 2024-09-04T16:29:56.820 INFO:tasks.workunit.client.1.smithi193.stdout:9/25: mknod d2/d8/ca 0 2024-09-04T16:29:56.821 INFO:tasks.workunit.client.1.smithi193.stdout:9/26: write d2/d4/f5 [5154367,115179] 0 2024-09-04T16:29:56.822 INFO:tasks.workunit.client.1.smithi193.stdout:9/27: truncate d2/d4/f5 5574638 0 2024-09-04T16:29:56.824 INFO:tasks.workunit.client.1.smithi193.stdout:8/13: chown d2/l5 2 1 2024-09-04T16:29:56.825 INFO:tasks.workunit.client.1.smithi193.stdout:8/14: write d2/f3 [872389,37882] 0 2024-09-04T16:29:56.826 INFO:tasks.workunit.client.1.smithi193.stdout:5/35: truncate d1/f3 247677 0 2024-09-04T16:29:56.827 INFO:tasks.workunit.client.1.smithi193.stdout:9/28: mknod d2/d8/cb 0 2024-09-04T16:29:56.828 INFO:tasks.workunit.client.1.smithi193.stdout:9/29: truncate f0 2253766 0 2024-09-04T16:29:56.829 INFO:tasks.workunit.client.1.smithi193.stdout:1/36: rmdir d1/d3/dd 0 2024-09-04T16:29:56.830 INFO:tasks.workunit.client.1.smithi193.stdout:1/37: write d1/f7 [2967837,5538] 0 2024-09-04T16:29:56.830 INFO:tasks.workunit.client.1.smithi193.stdout:1/38: chown d1/f7 951 1 2024-09-04T16:29:56.831 INFO:tasks.workunit.client.1.smithi193.stdout:8/15: fdatasync f0 0 2024-09-04T16:29:56.835 INFO:tasks.workunit.client.1.smithi193.stdout:9/30: write f1 [1390690,13789] 0 2024-09-04T16:29:56.836 INFO:tasks.workunit.client.1.smithi193.stdout:9/31: write f1 [1164160,16925] 0 2024-09-04T16:29:56.836 INFO:tasks.workunit.client.1.smithi193.stdout:1/39: dwrite d1/f7 [0,4194304] 0 2024-09-04T16:29:56.840 INFO:tasks.workunit.client.1.smithi193.stdout:5/36: write d1/f3 [424364,17139] 0 2024-09-04T16:29:56.843 INFO:tasks.workunit.client.1.smithi193.stdout:8/16: creat d2/f6 x:0 0 0 2024-09-04T16:29:56.843 INFO:tasks.workunit.client.1.smithi193.stdout:5/37: truncate d1/f3 949623 0 2024-09-04T16:29:56.846 INFO:tasks.workunit.client.1.smithi193.stdout:1/40: dwrite d1/f7 [0,4194304] 0 2024-09-04T16:29:56.846 INFO:tasks.workunit.client.1.smithi193.stdout:9/32: symlink d2/d8/lc 0 2024-09-04T16:29:56.849 INFO:tasks.workunit.client.1.smithi193.stdout:5/38: creat d1/d8/fc x:0 0 0 2024-09-04T16:29:56.851 INFO:tasks.workunit.client.1.smithi193.stdout:5/39: chown d1/d8 63115 1 2024-09-04T16:29:56.851 INFO:tasks.workunit.client.1.smithi193.stdout:9/33: dread f1 [0,4194304] 0 2024-09-04T16:29:56.851 INFO:tasks.workunit.client.1.smithi193.stdout:8/17: rename d2/f6 to d2/f7 0 2024-09-04T16:29:56.853 INFO:tasks.workunit.client.1.smithi193.stdout:5/40: dread - d1/d8/fc zero size 2024-09-04T16:29:56.854 INFO:tasks.workunit.client.1.smithi193.stdout:9/34: rmdir d2/d4 39 2024-09-04T16:29:56.855 INFO:tasks.workunit.client.1.smithi193.stdout:5/41: write d1/d8/fc [428333,90547] 0 2024-09-04T16:29:56.856 INFO:tasks.workunit.client.1.smithi193.stdout:1/41: dwrite d1/f7 [0,4194304] 0 2024-09-04T16:29:56.857 INFO:tasks.workunit.client.1.smithi193.stdout:8/18: write d2/f7 [674779,13830] 0 2024-09-04T16:29:56.859 INFO:tasks.workunit.client.1.smithi193.stdout:5/42: creat d1/d8/fd x:0 0 0 2024-09-04T16:29:56.860 INFO:tasks.workunit.client.1.smithi193.stdout:8/19: dread f0 [0,4194304] 0 2024-09-04T16:29:56.863 INFO:tasks.workunit.client.1.smithi193.stdout:1/42: symlink d1/d3/db/lf 0 2024-09-04T16:29:56.864 INFO:tasks.workunit.client.1.smithi193.stdout:8/20: write f0 [504048,33497] 0 2024-09-04T16:29:56.867 INFO:tasks.workunit.client.1.smithi193.stdout:1/43: dread d1/f7 [0,4194304] 0 2024-09-04T16:29:56.869 INFO:tasks.workunit.client.1.smithi193.stdout:1/44: mkdir d1/d3/d10 0 2024-09-04T16:29:56.873 INFO:tasks.workunit.client.1.smithi193.stdout:1/45: link d1/la d1/d3/d10/l11 0 2024-09-04T16:29:56.873 INFO:tasks.workunit.client.1.smithi193.stdout:1/46: chown d1 5 1 2024-09-04T16:29:56.880 INFO:tasks.workunit.client.1.smithi193.stdout:1/47: rename d1/d3/db/lf to d1/l12 0 2024-09-04T16:29:56.887 INFO:tasks.workunit.client.1.smithi193.stdout:1/48: dwrite d1/f7 [4194304,4194304] 0 2024-09-04T16:29:56.887 INFO:tasks.workunit.client.1.smithi193.stdout:1/49: stat d1 0 2024-09-04T16:29:56.904 INFO:tasks.workunit.client.1.smithi193.stdout:9/35: dwrite d2/f6 [0,4194304] 0 2024-09-04T16:29:56.909 INFO:tasks.workunit.client.1.smithi193.stdout:5/43: truncate d1/d8/fc 56299 0 2024-09-04T16:29:56.909 INFO:tasks.workunit.client.1.smithi193.stdout:5/44: fdatasync d1/d8/fd 0 2024-09-04T16:29:56.915 INFO:tasks.workunit.client.1.smithi193.stdout:5/45: dwrite d1/d8/fd [0,4194304] 0 2024-09-04T16:29:56.980 INFO:tasks.workunit.client.1.smithi193.stdout:1/50: truncate d1/f7 4562447 0 2024-09-04T16:29:56.993 INFO:tasks.workunit.client.1.smithi193.stdout:5/46: dread d1/d8/fc [0,4194304] 0 2024-09-04T16:29:56.996 INFO:tasks.workunit.client.1.smithi193.stdout:9/36: truncate d2/d4/f5 122456 0 2024-09-04T16:29:56.998 INFO:tasks.workunit.client.1.smithi193.stdout:5/47: dwrite d1/f3 [0,4194304] 0 2024-09-04T16:29:57.078 INFO:tasks.workunit.client.1.smithi193.stdout:9/37: creat d2/d4/fd x:0 0 0 2024-09-04T16:29:57.079 INFO:tasks.workunit.client.1.smithi193.stdout:5/48: mknod d1/d8/ce 0 2024-09-04T16:29:57.081 INFO:tasks.workunit.client.1.smithi193.stdout:1/51: symlink d1/l13 0 2024-09-04T16:29:57.081 INFO:tasks.workunit.client.1.smithi193.stdout:9/38: truncate f1 1441010 0 2024-09-04T16:29:57.082 INFO:tasks.workunit.client.1.smithi193.stdout:5/49: write d1/d8/fc [339551,94695] 0 2024-09-04T16:29:57.082 INFO:tasks.workunit.client.1.smithi193.stdout:1/52: write d1/f7 [2408130,64552] 0 2024-09-04T16:29:57.083 INFO:tasks.workunit.client.1.smithi193.stdout:5/50: write d1/f3 [175327,20978] 0 2024-09-04T16:29:57.084 INFO:tasks.workunit.client.1.smithi193.stdout:9/39: creat d2/d8/fe x:0 0 0 2024-09-04T16:29:57.085 INFO:tasks.workunit.client.1.smithi193.stdout:1/53: fdatasync d1/f7 0 2024-09-04T16:29:57.085 INFO:tasks.workunit.client.1.smithi193.stdout:9/40: truncate d2/d4/fd 89320 0 2024-09-04T16:29:57.086 INFO:tasks.workunit.client.1.smithi193.stdout:1/54: write d1/f7 [5066133,117899] 0 2024-09-04T16:29:57.091 INFO:tasks.workunit.client.1.smithi193.stdout:1/55: getdents d1/d3 0 2024-09-04T16:29:57.094 INFO:tasks.workunit.client.1.smithi193.stdout:1/56: creat d1/d3/f14 x:0 0 0 2024-09-04T16:29:57.095 INFO:tasks.workunit.client.1.smithi193.stdout:1/57: symlink d1/d3/db/l15 0 2024-09-04T16:29:57.098 INFO:tasks.workunit.client.1.smithi193.stdout:1/58: creat d1/d3/f16 x:0 0 0 2024-09-04T16:29:57.099 INFO:tasks.workunit.client.1.smithi193.stdout:1/59: write d1/f7 [743288,30231] 0 2024-09-04T16:29:57.104 INFO:tasks.workunit.client.1.smithi193.stdout:1/60: dwrite d1/d3/f14 [0,4194304] 0 2024-09-04T16:29:57.112 INFO:tasks.workunit.client.1.smithi193.stdout:1/61: dwrite d1/d3/f14 [0,4194304] 0 2024-09-04T16:29:57.116 INFO:tasks.workunit.client.1.smithi193.stdout:1/62: dread d1/d3/f14 [0,4194304] 0 2024-09-04T16:29:57.119 INFO:tasks.workunit.client.1.smithi193.stdout:1/63: dread d1/d3/f14 [0,4194304] 0 2024-09-04T16:29:57.123 INFO:tasks.workunit.client.1.smithi193.stdout:1/64: creat d1/d3/d10/f17 x:0 0 0 2024-09-04T16:29:57.126 INFO:tasks.workunit.client.1.smithi193.stdout:1/65: mknod d1/d3/db/c18 0 2024-09-04T16:29:57.126 INFO:tasks.workunit.client.1.smithi193.stdout:1/66: read d1/d3/f14 [2802947,14851] 0 2024-09-04T16:29:57.133 INFO:tasks.workunit.client.1.smithi193.stdout:1/67: dwrite d1/d3/f16 [0,4194304] 0 2024-09-04T16:29:57.137 INFO:tasks.workunit.client.1.smithi193.stdout:1/68: dread d1/d3/f16 [0,4194304] 0 2024-09-04T16:29:57.141 INFO:tasks.workunit.client.1.smithi193.stdout:1/69: unlink d1/l12 0 2024-09-04T16:29:57.144 INFO:tasks.workunit.client.1.smithi193.stdout:1/70: creat d1/d3/d10/f19 x:0 0 0 2024-09-04T16:29:57.145 INFO:tasks.workunit.client.1.smithi193.stdout:1/71: truncate d1/d3/d10/f17 808510 0 2024-09-04T16:29:57.177 INFO:tasks.workunit.client.1.smithi193.stdout:1/72: truncate d1/d3/d10/f17 210639 0 2024-09-04T16:29:57.179 INFO:tasks.workunit.client.1.smithi193.stdout:1/73: mknod d1/d3/d10/c1a 0 2024-09-04T16:29:57.182 INFO:tasks.workunit.client.1.smithi193.stdout:1/74: mkdir d1/d3/d1b 0 2024-09-04T16:29:57.183 INFO:tasks.workunit.client.1.smithi193.stdout:9/41: truncate f0 663275 0 2024-09-04T16:29:57.184 INFO:tasks.workunit.client.1.smithi193.stdout:9/42: chown d2/d8/cb 82388 1 2024-09-04T16:29:57.185 INFO:tasks.workunit.client.1.smithi193.stdout:1/75: dread d1/f7 [4194304,4194304] 0 2024-09-04T16:29:57.189 INFO:tasks.workunit.client.1.smithi193.stdout:9/43: dwrite d2/d4/f7 [0,4194304] 0 2024-09-04T16:29:57.221 INFO:tasks.workunit.client.1.smithi193.stdout:1/76: creat d1/f1c x:0 0 0 2024-09-04T16:29:57.250 INFO:tasks.workunit.client.1.smithi193.stdout:1/77: link d1/d3/db/c18 d1/c1d 0 2024-09-04T16:29:57.258 INFO:tasks.workunit.client.1.smithi193.stdout:9/44: write d2/d4/f5 [596613,79686] 0 2024-09-04T16:29:57.261 INFO:tasks.workunit.client.1.smithi193.stdout:1/78: getdents d1 0 2024-09-04T16:29:57.262 INFO:tasks.workunit.client.1.smithi193.stdout:1/79: fsync d1/f7 0 2024-09-04T16:29:57.263 INFO:tasks.workunit.client.1.smithi193.stdout:1/80: read d1/f7 [3346563,116944] 0 2024-09-04T16:29:57.268 INFO:tasks.workunit.client.1.smithi193.stdout:1/81: dread d1/d3/d10/f17 [0,4194304] 0 2024-09-04T16:29:57.270 INFO:tasks.workunit.client.1.smithi193.stdout:1/82: symlink d1/d3/l1e 0 2024-09-04T16:29:57.271 INFO:tasks.workunit.client.1.smithi193.stdout:9/45: truncate d2/d4/f7 1991302 0 2024-09-04T16:29:57.275 INFO:tasks.workunit.client.1.smithi193.stdout:1/83: dwrite d1/f1c [0,4194304] 0 2024-09-04T16:29:57.283 INFO:tasks.workunit.client.1.smithi193.stdout:1/84: dwrite d1/d3/f16 [0,4194304] 0 2024-09-04T16:29:57.285 INFO:tasks.workunit.client.1.smithi193.stdout:9/46: write d2/f6 [474238,16356] 0 2024-09-04T16:29:57.288 INFO:tasks.workunit.client.1.smithi193.stdout:1/85: creat d1/d3/d10/f1f x:0 0 0 2024-09-04T16:29:57.296 INFO:tasks.workunit.client.1.smithi193.stdout:9/47: dwrite d2/d4/f5 [0,4194304] 0 2024-09-04T16:29:57.298 INFO:tasks.workunit.client.1.smithi193.stdout:1/86: dwrite d1/f7 [0,4194304] 0 2024-09-04T16:29:57.306 INFO:tasks.workunit.client.1.smithi193.stdout:9/48: dwrite d2/d4/fd [0,4194304] 0 2024-09-04T16:29:57.310 INFO:tasks.workunit.client.1.smithi193.stdout:9/49: dread d2/d4/f7 [0,4194304] 0 2024-09-04T16:29:57.312 INFO:tasks.workunit.client.1.smithi193.stdout:9/50: mknod d2/d8/cf 0 2024-09-04T16:29:57.314 INFO:tasks.workunit.client.1.smithi193.stdout:9/51: write d2/d4/f7 [1959659,75386] 0 2024-09-04T16:29:57.328 INFO:tasks.workunit.client.1.smithi193.stdout:9/52: fsync d2/d8/f9 0 2024-09-04T16:29:57.329 INFO:tasks.workunit.client.1.smithi193.stdout:9/53: write d2/d4/f7 [1577884,20758] 0 2024-09-04T16:29:57.332 INFO:tasks.workunit.client.1.smithi193.stdout:9/54: truncate f1 1450862 0 2024-09-04T16:29:57.338 INFO:tasks.workunit.client.1.smithi193.stdout:9/55: dwrite d2/d8/fe [0,4194304] 0 2024-09-04T16:29:57.340 INFO:tasks.workunit.client.1.smithi193.stdout:9/56: symlink d2/d8/l10 0 2024-09-04T16:29:57.341 INFO:tasks.workunit.client.1.smithi193.stdout:9/57: write d2/d4/f7 [2995473,92546] 0 2024-09-04T16:29:57.343 INFO:tasks.workunit.client.1.smithi193.stdout:9/58: rmdir d2 39 2024-09-04T16:29:57.350 INFO:tasks.workunit.client.1.smithi193.stdout:9/59: symlink d2/d4/l11 0 2024-09-04T16:29:57.358 INFO:tasks.workunit.client.1.smithi193.stdout:9/60: write f0 [845364,60291] 0 2024-09-04T16:29:57.359 INFO:tasks.workunit.client.1.smithi193.stdout:9/61: mknod d2/d4/c12 0 2024-09-04T16:29:57.366 INFO:tasks.workunit.client.1.smithi193.stdout:9/62: dwrite f0 [0,4194304] 0 2024-09-04T16:29:57.367 INFO:tasks.workunit.client.1.smithi193.stdout:9/63: rmdir d2/d8 39 2024-09-04T16:29:57.368 INFO:tasks.workunit.client.1.smithi193.stdout:9/64: write d2/f6 [1708072,29397] 0 2024-09-04T16:29:57.381 INFO:tasks.workunit.client.1.smithi193.stdout:9/65: truncate d2/f6 467605 0 2024-09-04T16:29:57.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:57 smithi170 ceph-mon[29272]: pgmap v18: 65 pgs: 65 active+clean; 191 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 333 op/s 2024-09-04T16:29:57.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:57 smithi193 ceph-mon[36288]: pgmap v18: 65 pgs: 65 active+clean; 191 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 333 op/s 2024-09-04T16:29:58.383 INFO:tasks.workunit.client.1.smithi193.stdout:4/0: sync 2024-09-04T16:29:58.390 INFO:tasks.workunit.client.1.smithi193.stdout:4/1: creat f0 x:0 0 0 2024-09-04T16:29:58.391 INFO:tasks.workunit.client.1.smithi193.stdout:4/2: creat f1 x:0 0 0 2024-09-04T16:29:58.392 INFO:tasks.workunit.client.1.smithi193.stdout:4/3: write f0 [461861,38435] 0 2024-09-04T16:29:58.425 INFO:tasks.workunit.client.1.smithi193.stdout:4/4: creat f2 x:0 0 0 2024-09-04T16:29:58.432 INFO:tasks.workunit.client.1.smithi193.stdout:5/51: sync 2024-09-04T16:29:58.432 INFO:tasks.workunit.client.1.smithi193.stdout:6/19: sync 2024-09-04T16:29:58.432 INFO:tasks.workunit.client.1.smithi193.stdout:2/6: sync 2024-09-04T16:29:58.433 INFO:tasks.workunit.client.1.smithi193.stdout:0/15: sync 2024-09-04T16:29:58.433 INFO:tasks.workunit.client.1.smithi193.stdout:3/8: sync 2024-09-04T16:29:58.433 INFO:tasks.workunit.client.1.smithi193.stdout:7/19: sync 2024-09-04T16:29:58.433 INFO:tasks.workunit.client.1.smithi193.stdout:8/21: sync 2024-09-04T16:29:58.433 INFO:tasks.workunit.client.1.smithi193.stdout:1/87: sync 2024-09-04T16:29:58.433 INFO:tasks.workunit.client.1.smithi193.stdout:9/66: sync 2024-09-04T16:29:58.435 INFO:tasks.workunit.client.1.smithi193.stdout:7/20: write f3 [397618,120099] 0 2024-09-04T16:29:58.435 INFO:tasks.workunit.client.1.smithi193.stdout:7/21: rmdir - no directory 2024-09-04T16:29:58.435 INFO:tasks.workunit.client.1.smithi193.stdout:9/67: read d2/d4/fd [1705525,100925] 0 2024-09-04T16:29:58.436 INFO:tasks.workunit.client.1.smithi193.stdout:8/22: creat d2/f8 x:0 0 0 2024-09-04T16:29:58.440 INFO:tasks.workunit.client.1.smithi193.stdout:2/7: mkdir d2 0 2024-09-04T16:29:58.442 INFO:tasks.workunit.client.1.smithi193.stdout:9/68: mknod d2/d4/c13 0 2024-09-04T16:29:58.443 INFO:tasks.workunit.client.1.smithi193.stdout:8/23: symlink d2/l9 0 2024-09-04T16:29:58.445 INFO:tasks.workunit.client.1.smithi193.stdout:0/16: truncate f1 158320 0 2024-09-04T16:29:58.449 INFO:tasks.workunit.client.1.smithi193.stdout:8/24: write d2/f8 [695429,39587] 0 2024-09-04T16:29:58.449 INFO:tasks.workunit.client.1.smithi193.stdout:6/20: dread f3 [0,4194304] 0 2024-09-04T16:29:58.449 INFO:tasks.workunit.client.1.smithi193.stdout:9/69: chown d2/d8 875069789 1 2024-09-04T16:29:58.449 INFO:tasks.workunit.client.1.smithi193.stdout:0/17: write f6 [255400,102855] 0 2024-09-04T16:29:58.453 INFO:tasks.workunit.client.1.smithi193.stdout:2/8: mknod d2/c3 0 2024-09-04T16:29:58.454 INFO:tasks.workunit.client.1.smithi193.stdout:6/21: chown l4 0 1 2024-09-04T16:29:58.454 INFO:tasks.workunit.client.1.smithi193.stdout:7/22: dwrite f1 [0,4194304] 0 2024-09-04T16:29:58.455 INFO:tasks.workunit.client.1.smithi193.stdout:3/9: dwrite d0/f3 [0,4194304] 0 2024-09-04T16:29:58.456 INFO:tasks.workunit.client.1.smithi193.stdout:5/52: dwrite d1/f3 [0,4194304] 0 2024-09-04T16:29:58.457 INFO:tasks.workunit.client.1.smithi193.stdout:7/23: write f3 [245,88275] 0 2024-09-04T16:29:58.459 INFO:tasks.workunit.client.1.smithi193.stdout:9/70: mknod d2/d8/c14 0 2024-09-04T16:29:58.461 INFO:tasks.workunit.client.1.smithi193.stdout:0/18: dread f2 [0,4194304] 0 2024-09-04T16:29:58.461 INFO:tasks.workunit.client.1.smithi193.stdout:9/71: write f1 [2841857,31940] 0 2024-09-04T16:29:58.463 INFO:tasks.workunit.client.1.smithi193.stdout:0/19: fdatasync f6 0 2024-09-04T16:29:58.469 INFO:tasks.workunit.client.1.smithi193.stdout:3/10: creat d0/f4 x:0 0 0 2024-09-04T16:29:58.469 INFO:tasks.workunit.client.1.smithi193.stdout:6/22: write f3 [3534793,20622] 0 2024-09-04T16:29:58.470 INFO:tasks.workunit.client.1.smithi193.stdout:7/24: mknod c5 0 2024-09-04T16:29:58.473 INFO:tasks.workunit.client.1.smithi193.stdout:3/11: chown d0/f3 185320 1 2024-09-04T16:29:58.473 INFO:tasks.workunit.client.1.smithi193.stdout:2/9: dwrite f1 [0,4194304] 0 2024-09-04T16:29:58.477 INFO:tasks.workunit.client.1.smithi193.stdout:0/20: symlink l8 0 2024-09-04T16:29:58.477 INFO:tasks.workunit.client.1.smithi193.stdout:0/21: stat f1 0 2024-09-04T16:29:58.477 INFO:tasks.workunit.client.1.smithi193.stdout:0/22: rmdir - no directory 2024-09-04T16:29:58.477 INFO:tasks.workunit.client.1.smithi193.stdout:9/72: dwrite d2/d8/fe [0,4194304] 0 2024-09-04T16:29:58.479 INFO:tasks.workunit.client.1.smithi193.stdout:6/23: mknod d5/c8 0 2024-09-04T16:29:58.479 INFO:tasks.workunit.client.1.smithi193.stdout:5/53: creat d1/d8/db/ff x:0 0 0 2024-09-04T16:29:58.481 INFO:tasks.workunit.client.1.smithi193.stdout:7/25: dread f1 [0,4194304] 0 2024-09-04T16:29:58.488 INFO:tasks.workunit.client.1.smithi193.stdout:6/24: dread d5/f6 [0,4194304] 0 2024-09-04T16:29:58.495 INFO:tasks.workunit.client.1.smithi193.stdout:5/54: getdents d1 0 2024-09-04T16:29:58.495 INFO:tasks.workunit.client.1.smithi193.stdout:9/73: dwrite d2/d4/fd [0,4194304] 0 2024-09-04T16:29:58.498 INFO:tasks.workunit.client.1.smithi193.stdout:7/26: dwrite f1 [0,4194304] 0 2024-09-04T16:29:58.501 INFO:tasks.workunit.client.1.smithi193.stdout:5/55: unlink d1/d8/db/ff 0 2024-09-04T16:29:58.501 INFO:tasks.workunit.client.1.smithi193.stdout:6/25: dwrite d5/f6 [0,4194304] 0 2024-09-04T16:29:58.502 INFO:tasks.workunit.client.1.smithi193.stdout:5/56: chown d1/d8/db 208 1 2024-09-04T16:29:58.503 INFO:tasks.workunit.client.1.smithi193.stdout:9/74: mkdir d2/d8/d15 0 2024-09-04T16:29:58.504 INFO:tasks.workunit.client.1.smithi193.stdout:7/27: creat f6 x:0 0 0 2024-09-04T16:29:58.509 INFO:tasks.workunit.client.1.smithi193.stdout:9/75: dread d2/d8/fe [0,4194304] 0 2024-09-04T16:29:58.512 INFO:tasks.workunit.client.1.smithi193.stdout:7/28: creat f7 x:0 0 0 2024-09-04T16:29:58.517 INFO:tasks.workunit.client.1.smithi193.stdout:7/29: creat f8 x:0 0 0 2024-09-04T16:29:58.517 INFO:tasks.workunit.client.1.smithi193.stdout:9/76: creat d2/d8/d15/f16 x:0 0 0 2024-09-04T16:29:58.520 INFO:tasks.workunit.client.1.smithi193.stdout:9/77: write d2/d8/f9 [642178,33976] 0 2024-09-04T16:29:58.523 INFO:tasks.workunit.client.1.smithi193.stdout:7/30: dwrite f8 [0,4194304] 0 2024-09-04T16:29:58.527 INFO:tasks.workunit.client.1.smithi193.stdout:7/31: mkdir d9 0 2024-09-04T16:29:58.528 INFO:tasks.workunit.client.1.smithi193.stdout:9/78: dwrite d2/d8/fe [0,4194304] 0 2024-09-04T16:29:58.530 INFO:tasks.workunit.client.1.smithi193.stdout:7/32: creat d9/fa x:0 0 0 2024-09-04T16:29:58.537 INFO:tasks.workunit.client.1.smithi193.stdout:1/88: sync 2024-09-04T16:29:58.541 INFO:tasks.workunit.client.1.smithi193.stdout:1/89: creat d1/d3/f20 x:0 0 0 2024-09-04T16:29:58.541 INFO:tasks.workunit.client.1.smithi193.stdout:9/79: fdatasync d2/d8/f9 0 2024-09-04T16:29:58.543 INFO:tasks.workunit.client.1.smithi193.stdout:1/90: creat d1/d3/d10/f21 x:0 0 0 2024-09-04T16:29:58.545 INFO:tasks.workunit.client.1.smithi193.stdout:9/80: rename f1 to d2/d4/f17 0 2024-09-04T16:29:58.546 INFO:tasks.workunit.client.1.smithi193.stdout:9/81: stat d2/d8/f9 0 2024-09-04T16:29:58.546 INFO:tasks.workunit.client.1.smithi193.stdout:9/82: stat d2/d8/lc 0 2024-09-04T16:29:58.549 INFO:tasks.workunit.client.1.smithi193.stdout:1/91: rename d1/f7 to d1/d3/d10/f22 0 2024-09-04T16:29:58.549 INFO:tasks.workunit.client.1.smithi193.stdout:9/83: dread d2/d4/fd [0,4194304] 0 2024-09-04T16:29:58.555 INFO:tasks.workunit.client.1.smithi193.stdout:9/84: mkdir d2/d18 0 2024-09-04T16:29:58.561 INFO:tasks.workunit.client.1.smithi193.stdout:9/85: dwrite d2/d8/f9 [0,4194304] 0 2024-09-04T16:29:58.562 INFO:tasks.workunit.client.1.smithi193.stdout:9/86: chown d2/d4/l11 1665397 1 2024-09-04T16:29:58.563 INFO:tasks.workunit.client.1.smithi193.stdout:9/87: read - d2/d8/d15/f16 zero size 2024-09-04T16:29:58.567 INFO:tasks.workunit.client.1.smithi193.stdout:9/88: link d2/c3 d2/d18/c19 0 2024-09-04T16:29:58.568 INFO:tasks.workunit.client.1.smithi193.stdout:9/89: chown d2/d8/d15/f16 91776622 1 2024-09-04T16:29:58.571 INFO:tasks.workunit.client.1.smithi193.stdout:9/90: mknod d2/c1a 0 2024-09-04T16:29:58.574 INFO:tasks.workunit.client.1.smithi193.stdout:9/91: creat d2/d8/d15/f1b x:0 0 0 2024-09-04T16:29:58.577 INFO:tasks.workunit.client.1.smithi193.stdout:9/92: creat d2/f1c x:0 0 0 2024-09-04T16:29:58.577 INFO:tasks.workunit.client.1.smithi193.stdout:9/93: read d2/f6 [2906419,14390] 0 2024-09-04T16:29:58.578 INFO:tasks.workunit.client.1.smithi193.stdout:9/94: read d2/d8/fe [712341,74498] 0 2024-09-04T16:29:58.579 INFO:tasks.workunit.client.1.smithi193.stdout:9/95: truncate d2/d4/fd 4817971 0 2024-09-04T16:29:58.582 INFO:tasks.workunit.client.1.smithi193.stdout:9/96: dread d2/d4/fd [0,4194304] 0 2024-09-04T16:29:58.584 INFO:tasks.workunit.client.1.smithi193.stdout:9/97: mkdir d2/d4/d1d 0 2024-09-04T16:29:58.587 INFO:tasks.workunit.client.1.smithi193.stdout:9/98: rename d2/d4/c12 to d2/d4/d1d/c1e 0 2024-09-04T16:29:58.587 INFO:tasks.workunit.client.1.smithi193.stdout:9/99: chown d2/d4/f5 4 1 2024-09-04T16:29:58.587 INFO:tasks.workunit.client.1.smithi193.stdout:9/100: chown d2/d8/f9 0 1 2024-09-04T16:29:58.589 INFO:tasks.workunit.client.1.smithi193.stdout:9/101: rmdir d2/d8/d15 39 2024-09-04T16:29:58.589 INFO:tasks.workunit.client.1.smithi193.stdout:9/102: readlink d2/d8/lc 0 2024-09-04T16:29:58.593 INFO:tasks.workunit.client.1.smithi193.stdout:9/103: rename d2/d8/cb to d2/c1f 0 2024-09-04T16:29:58.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:58 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:29:58.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:58 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:29:58.662 INFO:tasks.workunit.client.1.smithi193.stdout:7/33: sync 2024-09-04T16:29:58.662 INFO:tasks.workunit.client.1.smithi193.stdout:8/25: sync 2024-09-04T16:29:58.663 INFO:tasks.workunit.client.1.smithi193.stdout:3/12: sync 2024-09-04T16:29:58.663 INFO:tasks.workunit.client.1.smithi193.stdout:5/57: sync 2024-09-04T16:29:58.663 INFO:tasks.workunit.client.1.smithi193.stdout:8/26: chown d2/f7 2566075 1 2024-09-04T16:29:58.667 INFO:tasks.workunit.client.1.smithi193.stdout:3/13: dwrite d0/f3 [0,4194304] 0 2024-09-04T16:29:58.670 INFO:tasks.workunit.client.1.smithi193.stdout:5/58: symlink d1/l10 0 2024-09-04T16:29:58.671 INFO:tasks.workunit.client.1.smithi193.stdout:8/27: mkdir d2/da 0 2024-09-04T16:29:58.672 INFO:tasks.workunit.client.1.smithi193.stdout:5/59: write d1/d8/fd [211591,86283] 0 2024-09-04T16:29:58.675 INFO:tasks.workunit.client.1.smithi193.stdout:8/28: symlink d2/lb 0 2024-09-04T16:29:58.678 INFO:tasks.workunit.client.1.smithi193.stdout:3/14: dwrite d0/f4 [0,4194304] 0 2024-09-04T16:29:58.679 INFO:tasks.workunit.client.1.smithi193.stdout:5/60: link d1/f3 d1/f11 0 2024-09-04T16:29:58.683 INFO:tasks.workunit.client.1.smithi193.stdout:8/29: mkdir d2/da/dc 0 2024-09-04T16:29:58.683 INFO:tasks.workunit.client.1.smithi193.stdout:3/15: dread d0/f4 [0,4194304] 0 2024-09-04T16:29:58.686 INFO:tasks.workunit.client.1.smithi193.stdout:3/16: symlink d0/l5 0 2024-09-04T16:29:58.688 INFO:tasks.workunit.client.1.smithi193.stdout:8/30: creat d2/da/dc/fd x:0 0 0 2024-09-04T16:29:58.689 INFO:tasks.workunit.client.1.smithi193.stdout:3/17: symlink d0/l6 0 2024-09-04T16:29:58.689 INFO:tasks.workunit.client.1.smithi193.stdout:5/61: dwrite d1/d8/fc [0,4194304] 0 2024-09-04T16:29:58.689 INFO:tasks.workunit.client.1.smithi193.stdout:8/31: chown l1 523361028 1 2024-09-04T16:29:58.691 INFO:tasks.workunit.client.1.smithi193.stdout:5/62: chown d1/l10 5473055 1 2024-09-04T16:29:58.692 INFO:tasks.workunit.client.1.smithi193.stdout:5/63: stat d1/f3 0 2024-09-04T16:29:58.694 INFO:tasks.workunit.client.1.smithi193.stdout:3/18: dread d0/f4 [0,4194304] 0 2024-09-04T16:29:58.699 INFO:tasks.workunit.client.1.smithi193.stdout:3/19: write d0/f4 [3026793,74218] 0 2024-09-04T16:29:58.702 INFO:tasks.workunit.client.1.smithi193.stdout:3/20: unlink d0/l5 0 2024-09-04T16:29:58.703 INFO:tasks.workunit.client.1.smithi193.stdout:3/21: mkdir d0/d7 0 2024-09-04T16:29:58.705 INFO:tasks.workunit.client.1.smithi193.stdout:3/22: unlink d0/l1 0 2024-09-04T16:29:59.220 INFO:tasks.workunit.client.1.smithi193.stdout:4/5: fsync f0 0 2024-09-04T16:29:59.246 INFO:tasks.workunit.client.1.smithi193.stdout:2/10: getdents d2 0 2024-09-04T16:29:59.249 INFO:tasks.workunit.client.1.smithi193.stdout:2/11: dread f1 [0,4194304] 0 2024-09-04T16:29:59.254 INFO:tasks.workunit.client.1.smithi193.stdout:2/12: dwrite f1 [0,4194304] 0 2024-09-04T16:29:59.261 INFO:tasks.workunit.client.1.smithi193.stdout:2/13: dwrite f1 [0,4194304] 0 2024-09-04T16:29:59.273 INFO:tasks.workunit.client.1.smithi193.stdout:6/26: dwrite d5/f7 [0,4194304] 0 2024-09-04T16:29:59.274 INFO:tasks.workunit.client.1.smithi193.stdout:6/27: chown d5/f7 96877 1 2024-09-04T16:29:59.274 INFO:tasks.workunit.client.1.smithi193.stdout:6/28: chown d5 30686 1 2024-09-04T16:29:59.322 INFO:tasks.workunit.client.1.smithi193.stdout:4/6: sync 2024-09-04T16:29:59.366 INFO:tasks.workunit.client.1.smithi193.stdout:5/64: truncate d1/d8/fc 1834408 0 2024-09-04T16:29:59.368 INFO:tasks.workunit.client.1.smithi193.stdout:5/65: dread d1/f11 [0,4194304] 0 2024-09-04T16:29:59.369 INFO:tasks.workunit.client.1.smithi193.stdout:3/23: getdents d0 0 2024-09-04T16:29:59.372 INFO:tasks.workunit.client.1.smithi193.stdout:5/66: dread d1/d8/fd [0,4194304] 0 2024-09-04T16:29:59.372 INFO:tasks.workunit.client.1.smithi193.stdout:5/67: readlink d1/l10 0 2024-09-04T16:29:59.372 INFO:tasks.workunit.client.1.smithi193.stdout:3/24: dread d0/f3 [0,4194304] 0 2024-09-04T16:29:59.373 INFO:tasks.workunit.client.1.smithi193.stdout:5/68: read d1/f11 [1577042,48392] 0 2024-09-04T16:29:59.406 INFO:tasks.workunit.client.1.smithi193.stdout:2/14: creat d2/f4 x:0 0 0 2024-09-04T16:29:59.406 INFO:tasks.workunit.client.1.smithi193.stdout:2/15: stat d2/f4 0 2024-09-04T16:29:59.410 INFO:tasks.workunit.client.1.smithi193.stdout:4/7: mkdir d3 0 2024-09-04T16:29:59.410 INFO:tasks.workunit.client.1.smithi193.stdout:4/8: stat f2 0 2024-09-04T16:29:59.411 INFO:tasks.workunit.client.1.smithi193.stdout:9/104: rename d2/c1f to d2/d4/c20 0 2024-09-04T16:29:59.418 INFO:tasks.workunit.client.1.smithi193.stdout:5/69: creat d1/d8/f12 x:0 0 0 2024-09-04T16:29:59.420 INFO:tasks.workunit.client.1.smithi193.stdout:2/16: write f1 [1180514,51494] 0 2024-09-04T16:29:59.423 INFO:tasks.workunit.client.1.smithi193.stdout:1/92: creat d1/d3/db/f23 x:0 0 0 2024-09-04T16:29:59.424 INFO:tasks.workunit.client.1.smithi193.stdout:7/34: rename l0 to d9/lb 0 2024-09-04T16:29:59.429 INFO:tasks.workunit.client.1.smithi193.stdout:3/25: creat d0/d7/f8 x:0 0 0 2024-09-04T16:29:59.432 INFO:tasks.workunit.client.1.smithi193.stdout:2/17: creat d2/f5 x:0 0 0 2024-09-04T16:29:59.434 INFO:tasks.workunit.client.1.smithi193.stdout:7/35: mknod d9/cc 0 2024-09-04T16:29:59.435 INFO:tasks.workunit.client.1.smithi193.stdout:8/32: rename d2/f7 to d2/da/dc/fe 0 2024-09-04T16:29:59.436 INFO:tasks.workunit.client.1.smithi193.stdout:8/33: write f0 [89649,65321] 0 2024-09-04T16:29:59.436 INFO:tasks.workunit.client.1.smithi193.stdout:9/105: symlink d2/d18/l21 0 2024-09-04T16:29:59.437 INFO:tasks.workunit.client.1.smithi193.stdout:9/106: chown d2/f6 0 1 2024-09-04T16:29:59.437 INFO:tasks.workunit.client.1.smithi193.stdout:8/34: fdatasync d2/da/dc/fd 0 2024-09-04T16:29:59.437 INFO:tasks.workunit.client.1.smithi193.stdout:8/35: chown d2/da/dc/fe 39 1 2024-09-04T16:29:59.438 INFO:tasks.workunit.client.1.smithi193.stdout:8/36: read d2/f8 [143347,10666] 0 2024-09-04T16:29:59.439 INFO:tasks.workunit.client.1.smithi193.stdout:8/37: truncate f0 1682108 0 2024-09-04T16:29:59.440 INFO:tasks.workunit.client.1.smithi193.stdout:2/18: symlink d2/l6 0 2024-09-04T16:29:59.440 INFO:tasks.workunit.client.1.smithi193.stdout:8/38: truncate f0 2101975 0 2024-09-04T16:29:59.441 INFO:tasks.workunit.client.1.smithi193.stdout:1/93: link d1/d3/f16 d1/d3/d10/f24 0 2024-09-04T16:29:59.442 INFO:tasks.workunit.client.1.smithi193.stdout:8/39: fsync d2/f3 0 2024-09-04T16:29:59.443 INFO:tasks.workunit.client.1.smithi193.stdout:1/94: fsync d1/d3/d10/f1f 0 2024-09-04T16:29:59.444 INFO:tasks.workunit.client.1.smithi193.stdout:8/40: chown d2/f3 10079 1 2024-09-04T16:29:59.445 INFO:tasks.workunit.client.1.smithi193.stdout:3/26: dwrite d0/f3 [4194304,4194304] 0 2024-09-04T16:29:59.446 INFO:tasks.workunit.client.1.smithi193.stdout:8/41: write d2/f3 [497003,66427] 0 2024-09-04T16:29:59.446 INFO:tasks.workunit.client.1.smithi193.stdout:4/9: rename f2 to d3/f4 0 2024-09-04T16:29:59.447 INFO:tasks.workunit.client.1.smithi193.stdout:2/19: dread f1 [0,4194304] 0 2024-09-04T16:29:59.449 INFO:tasks.workunit.client.1.smithi193.stdout:4/10: truncate d3/f4 99571 0 2024-09-04T16:29:59.456 INFO:tasks.workunit.client.1.smithi193.stdout:1/95: write d1/d3/d10/f24 [683558,104116] 0 2024-09-04T16:29:59.460 INFO:tasks.workunit.client.1.smithi193.stdout:3/27: dwrite d0/d7/f8 [0,4194304] 0 2024-09-04T16:29:59.462 INFO:tasks.workunit.client.1.smithi193.stdout:8/42: dwrite d2/f8 [0,4194304] 0 2024-09-04T16:29:59.462 INFO:tasks.workunit.client.1.smithi193.stdout:9/107: dwrite f0 [0,4194304] 0 2024-09-04T16:29:59.463 INFO:tasks.workunit.client.1.smithi193.stdout:3/28: stat d0/d7 0 2024-09-04T16:29:59.463 INFO:tasks.workunit.client.1.smithi193.stdout:2/20: rename f1 to d2/f7 0 2024-09-04T16:29:59.470 INFO:tasks.workunit.client.1.smithi193.stdout:3/29: dread d0/f3 [4194304,4194304] 0 2024-09-04T16:29:59.472 INFO:tasks.workunit.client.1.smithi193.stdout:8/43: rename d2/lb to d2/da/dc/lf 0 2024-09-04T16:29:59.472 INFO:tasks.workunit.client.1.smithi193.stdout:3/30: chown d0/l6 1662 1 2024-09-04T16:29:59.474 INFO:tasks.workunit.client.1.smithi193.stdout:9/108: dread d2/d8/f9 [0,4194304] 0 2024-09-04T16:29:59.476 INFO:tasks.workunit.client.1.smithi193.stdout:8/44: dread f0 [0,4194304] 0 2024-09-04T16:29:59.477 INFO:tasks.workunit.client.1.smithi193.stdout:8/45: write d2/da/dc/fd [996060,56981] 0 2024-09-04T16:29:59.477 INFO:tasks.workunit.client.1.smithi193.stdout:9/109: mkdir d2/d4/d1d/d22 0 2024-09-04T16:29:59.478 INFO:tasks.workunit.client.1.smithi193.stdout:9/110: fdatasync d2/d4/f5 0 2024-09-04T16:29:59.479 INFO:tasks.workunit.client.1.smithi193.stdout:9/111: chown d2/d8/ca 3 1 2024-09-04T16:29:59.479 INFO:tasks.workunit.client.1.smithi193.stdout:8/46: mknod d2/c10 0 2024-09-04T16:29:59.480 INFO:tasks.workunit.client.1.smithi193.stdout:8/47: truncate d2/f8 4546962 0 2024-09-04T16:29:59.592 INFO:tasks.workunit.client.1.smithi193.stdout:1/96: sync 2024-09-04T16:29:59.593 INFO:tasks.workunit.client.1.smithi193.stdout:1/97: fdatasync d1/d3/d10/f19 0 2024-09-04T16:29:59.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:29:59 smithi170 ceph-mon[29272]: pgmap v19: 65 pgs: 65 active+clean; 271 MiB data, 927 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s rd, 16 MiB/s wr, 451 op/s 2024-09-04T16:29:59.607 INFO:tasks.workunit.client.1.smithi193.stdout:1/98: fdatasync d1/d3/d10/f17 0 2024-09-04T16:29:59.610 INFO:tasks.workunit.client.1.smithi193.stdout:1/99: dread d1/d3/f16 [0,4194304] 0 2024-09-04T16:29:59.616 INFO:tasks.workunit.client.1.smithi193.stdout:1/100: dwrite d1/d3/d10/f19 [0,4194304] 0 2024-09-04T16:29:59.619 INFO:tasks.workunit.client.1.smithi193.stdout:1/101: creat d1/d3/d10/f25 x:0 0 0 2024-09-04T16:29:59.621 INFO:tasks.workunit.client.1.smithi193.stdout:1/102: rmdir d1/d3 39 2024-09-04T16:29:59.628 INFO:tasks.workunit.client.1.smithi193.stdout:1/103: rmdir d1/d3 39 2024-09-04T16:29:59.635 INFO:tasks.workunit.client.1.smithi193.stdout:1/104: dwrite d1/f1c [0,4194304] 0 2024-09-04T16:29:59.637 INFO:tasks.workunit.client.1.smithi193.stdout:3/31: sync 2024-09-04T16:29:59.638 INFO:tasks.workunit.client.1.smithi193.stdout:8/48: sync 2024-09-04T16:29:59.638 INFO:tasks.workunit.client.1.smithi193.stdout:8/49: readlink d2/l9 0 2024-09-04T16:29:59.645 INFO:tasks.workunit.client.1.smithi193.stdout:8/50: dwrite d2/f3 [0,4194304] 0 2024-09-04T16:29:59.645 INFO:tasks.workunit.client.1.smithi193.stdout:8/51: chown d2/da 70 1 2024-09-04T16:29:59.655 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:29:59 smithi193 ceph-mon[36288]: pgmap v19: 65 pgs: 65 active+clean; 271 MiB data, 927 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s rd, 16 MiB/s wr, 451 op/s 2024-09-04T16:29:59.724 INFO:tasks.workunit.client.1.smithi193.stdout:0/23: dwrite f1 [0,4194304] 0 2024-09-04T16:29:59.725 INFO:tasks.workunit.client.1.smithi193.stdout:0/24: fdatasync f2 0 2024-09-04T16:29:59.728 INFO:tasks.workunit.client.1.smithi193.stdout:0/25: creat f9 x:0 0 0 2024-09-04T16:29:59.730 INFO:tasks.workunit.client.1.smithi193.stdout:0/26: mknod ca 0 2024-09-04T16:29:59.736 INFO:tasks.workunit.client.1.smithi193.stdout:0/27: dwrite f6 [0,4194304] 0 2024-09-04T16:29:59.737 INFO:tasks.workunit.client.1.smithi193.stdout:0/28: chown ca 10 1 2024-09-04T16:29:59.741 INFO:tasks.workunit.client.1.smithi193.stdout:0/29: creat fb x:0 0 0 2024-09-04T16:29:59.743 INFO:tasks.workunit.client.1.smithi193.stdout:0/30: symlink lc 0 2024-09-04T16:29:59.746 INFO:tasks.workunit.client.1.smithi193.stdout:0/31: symlink ld 0 2024-09-04T16:29:59.747 INFO:tasks.workunit.client.1.smithi193.stdout:0/32: readlink l4 0 2024-09-04T16:29:59.749 INFO:tasks.workunit.client.1.smithi193.stdout:0/33: unlink f2 0 2024-09-04T16:29:59.755 INFO:tasks.workunit.client.1.smithi193.stdout:0/34: dwrite fb [0,4194304] 0 2024-09-04T16:29:59.759 INFO:tasks.workunit.client.1.smithi193.stdout:0/35: creat fe x:0 0 0 2024-09-04T16:29:59.903 INFO:tasks.workunit.client.1.smithi193.stdout:9/112: unlink d2/d4/c20 0 2024-09-04T16:29:59.908 INFO:tasks.workunit.client.1.smithi193.stdout:6/29: truncate d5/f7 2620020 0 2024-09-04T16:29:59.912 INFO:tasks.workunit.client.1.smithi193.stdout:6/30: symlink d5/l9 0 2024-09-04T16:29:59.912 INFO:tasks.workunit.client.1.smithi193.stdout:6/31: chown d5 6 1 2024-09-04T16:29:59.913 INFO:tasks.workunit.client.1.smithi193.stdout:3/32: getdents d0/d7 0 2024-09-04T16:29:59.915 INFO:tasks.workunit.client.1.smithi193.stdout:2/21: fsync d2/f5 0 2024-09-04T16:29:59.917 INFO:tasks.workunit.client.1.smithi193.stdout:7/36: getdents d9 0 2024-09-04T16:29:59.917 INFO:tasks.workunit.client.1.smithi193.stdout:7/37: readlink d9/lb 0 2024-09-04T16:29:59.918 INFO:tasks.workunit.client.1.smithi193.stdout:7/38: truncate f7 156099 0 2024-09-04T16:29:59.920 INFO:tasks.workunit.client.1.smithi193.stdout:7/39: dread f1 [0,4194304] 0 2024-09-04T16:29:59.921 INFO:tasks.workunit.client.1.smithi193.stdout:7/40: dread - d9/fa zero size 2024-09-04T16:29:59.922 INFO:tasks.workunit.client.1.smithi193.stdout:7/41: fdatasync d9/fa 0 2024-09-04T16:29:59.922 INFO:tasks.workunit.client.1.smithi193.stdout:2/22: rename d2/f5 to d2/f8 0 2024-09-04T16:29:59.926 INFO:tasks.workunit.client.1.smithi193.stdout:7/42: chown l4 0 1 2024-09-04T16:29:59.926 INFO:tasks.workunit.client.1.smithi193.stdout:4/11: rename d3/f4 to d3/f5 0 2024-09-04T16:29:59.928 INFO:tasks.workunit.client.1.smithi193.stdout:2/23: mkdir d2/d9 0 2024-09-04T16:29:59.930 INFO:tasks.workunit.client.1.smithi193.stdout:7/43: symlink d9/ld 0 2024-09-04T16:29:59.931 INFO:tasks.workunit.client.1.smithi193.stdout:3/33: write d0/d7/f8 [4084144,119313] 0 2024-09-04T16:29:59.931 INFO:tasks.workunit.client.1.smithi193.stdout:7/44: dread f7 [0,4194304] 0 2024-09-04T16:29:59.932 INFO:tasks.workunit.client.1.smithi193.stdout:4/12: creat d3/f6 x:0 0 0 2024-09-04T16:29:59.933 INFO:tasks.workunit.client.1.smithi193.stdout:4/13: fsync f0 0 2024-09-04T16:29:59.934 INFO:tasks.workunit.client.1.smithi193.stdout:2/24: mknod d2/ca 0 2024-09-04T16:29:59.935 INFO:tasks.workunit.client.1.smithi193.stdout:2/25: truncate d2/f8 516865 0 2024-09-04T16:29:59.937 INFO:tasks.workunit.client.1.smithi193.stdout:7/45: dwrite f8 [0,4194304] 0 2024-09-04T16:29:59.938 INFO:tasks.workunit.client.1.smithi193.stdout:3/34: mkdir d0/d9 0 2024-09-04T16:29:59.941 INFO:tasks.workunit.client.1.smithi193.stdout:4/14: rename f1 to d3/f7 0 2024-09-04T16:29:59.942 INFO:tasks.workunit.client.1.smithi193.stdout:4/15: fdatasync d3/f6 0 2024-09-04T16:29:59.947 INFO:tasks.workunit.client.1.smithi193.stdout:8/52: chown d2/da/dc/lf 41297008 1 2024-09-04T16:29:59.950 INFO:tasks.workunit.client.1.smithi193.stdout:7/46: mkdir d9/de 0 2024-09-04T16:29:59.950 INFO:tasks.workunit.client.1.smithi193.stdout:7/47: write d9/fa [1032654,30677] 0 2024-09-04T16:29:59.951 INFO:tasks.workunit.client.1.smithi193.stdout:7/48: truncate f6 1018606 0 2024-09-04T16:29:59.953 INFO:tasks.workunit.client.1.smithi193.stdout:3/35: rename d0/d7/f8 to d0/fa 0 2024-09-04T16:29:59.954 INFO:tasks.workunit.client.1.smithi193.stdout:7/49: dread f3 [0,4194304] 0 2024-09-04T16:29:59.956 INFO:tasks.workunit.client.1.smithi193.stdout:8/53: mknod d2/da/dc/c11 0 2024-09-04T16:29:59.957 INFO:tasks.workunit.client.1.smithi193.stdout:8/54: truncate d2/da/dc/fe 1002014 0 2024-09-04T16:29:59.957 INFO:tasks.workunit.client.1.smithi193.stdout:1/105: getdents d1/d3/d10 0 2024-09-04T16:29:59.958 INFO:tasks.workunit.client.1.smithi193.stdout:8/55: fdatasync d2/da/dc/fd 0 2024-09-04T16:29:59.967 INFO:tasks.workunit.client.1.smithi193.stdout:1/106: mkdir d1/d3/db/d26 0 2024-09-04T16:29:59.967 INFO:tasks.workunit.client.1.smithi193.stdout:1/107: write d1/d3/d10/f21 [402154,34950] 0 2024-09-04T16:29:59.976 INFO:tasks.workunit.client.1.smithi193.stdout:3/36: creat d0/d9/fb x:0 0 0 2024-09-04T16:29:59.976 INFO:tasks.workunit.client.1.smithi193.stdout:3/37: chown d0/f4 1 1 2024-09-04T16:30:00.000 INFO:tasks.workunit.client.1.smithi193.stdout:0/36: getdents . 0 2024-09-04T16:30:00.000 INFO:tasks.workunit.client.1.smithi193.stdout:0/37: dread - fe zero size 2024-09-04T16:30:00.002 INFO:tasks.workunit.client.1.smithi193.stdout:0/38: dread f6 [0,4194304] 0 2024-09-04T16:30:00.002 INFO:tasks.workunit.client.1.smithi193.stdout:0/39: rmdir - no directory 2024-09-04T16:30:00.003 INFO:tasks.workunit.client.1.smithi193.stdout:0/40: truncate f1 4633242 0 2024-09-04T16:30:00.022 INFO:tasks.workunit.client.1.smithi193.stdout:4/16: sync 2024-09-04T16:30:00.082 INFO:tasks.workunit.client.1.smithi193.stdout:9/113: dwrite d2/d8/f9 [0,4194304] 0 2024-09-04T16:30:00.083 INFO:tasks.workunit.client.1.smithi193.stdout:9/114: fsync d2/d4/f17 0 2024-09-04T16:30:00.084 INFO:tasks.workunit.client.1.smithi193.stdout:6/32: dread d5/f7 [0,4194304] 0 2024-09-04T16:30:00.100 INFO:tasks.workunit.client.1.smithi193.stdout:7/50: truncate f1 4943753 0 2024-09-04T16:30:00.117 INFO:tasks.workunit.client.1.smithi193.stdout:2/26: dwrite d2/f7 [0,4194304] 0 2024-09-04T16:30:00.118 INFO:tasks.workunit.client.1.smithi193.stdout:2/27: chown d2 425 1 2024-09-04T16:30:00.125 INFO:tasks.workunit.client.1.smithi193.stdout:8/56: rename d2/da/dc to d2/d12 0 2024-09-04T16:30:00.137 INFO:tasks.workunit.client.1.smithi193.stdout:5/70: truncate d1/d8/fc 193346 0 2024-09-04T16:30:00.158 INFO:tasks.workunit.client.1.smithi193.stdout:3/38: creat d0/d7/fc x:0 0 0 2024-09-04T16:30:00.158 INFO:tasks.workunit.client.1.smithi193.stdout:3/39: chown d0/d7 25623 1 2024-09-04T16:30:00.161 INFO:tasks.workunit.client.1.smithi193.stdout:0/41: mknod cf 0 2024-09-04T16:30:00.161 INFO:tasks.workunit.client.1.smithi193.stdout:0/42: fdatasync fb 0 2024-09-04T16:30:00.162 INFO:tasks.workunit.client.1.smithi193.stdout:0/43: fsync fb 0 2024-09-04T16:30:00.162 INFO:tasks.workunit.client.1.smithi193.stdout:0/44: rmdir - no directory 2024-09-04T16:30:00.162 INFO:tasks.workunit.client.1.smithi193.stdout:4/17: unlink d3/f5 0 2024-09-04T16:30:00.162 INFO:tasks.workunit.client.1.smithi193.stdout:0/45: stat l8 0 2024-09-04T16:30:00.164 INFO:tasks.workunit.client.1.smithi193.stdout:9/115: creat d2/d4/f23 x:0 0 0 2024-09-04T16:30:00.165 INFO:tasks.workunit.client.1.smithi193.stdout:9/116: chown d2/d8 178281978 1 2024-09-04T16:30:00.166 INFO:tasks.workunit.client.1.smithi193.stdout:6/33: mknod d5/ca 0 2024-09-04T16:30:00.166 INFO:tasks.workunit.client.1.smithi193.stdout:9/117: read d2/d4/f5 [2462025,87177] 0 2024-09-04T16:30:00.168 INFO:tasks.workunit.client.1.smithi193.stdout:0/46: dwrite fe [0,4194304] 0 2024-09-04T16:30:00.170 INFO:tasks.workunit.client.1.smithi193.stdout:5/71: mkdir d1/d8/db/d13 0 2024-09-04T16:30:00.171 INFO:tasks.workunit.client.1.smithi193.stdout:5/72: chown d1/d8/fd 342925 1 2024-09-04T16:30:00.174 INFO:tasks.workunit.client.1.smithi193.stdout:3/40: creat d0/d9/fd x:0 0 0 2024-09-04T16:30:00.175 INFO:tasks.workunit.client.1.smithi193.stdout:0/47: dwrite fe [0,4194304] 0 2024-09-04T16:30:00.177 INFO:tasks.workunit.client.1.smithi193.stdout:4/18: mknod d3/c8 0 2024-09-04T16:30:00.181 INFO:tasks.workunit.client.1.smithi193.stdout:2/28: mkdir d2/d9/db 0 2024-09-04T16:30:00.185 INFO:tasks.workunit.client.1.smithi193.stdout:1/108: link d1/l2 d1/d3/d1b/l27 0 2024-09-04T16:30:00.186 INFO:tasks.workunit.client.1.smithi193.stdout:1/109: readlink d1/d3/db/l15 0 2024-09-04T16:30:00.187 INFO:tasks.workunit.client.1.smithi193.stdout:1/110: write d1/f1c [4449420,41622] 0 2024-09-04T16:30:00.187 INFO:tasks.workunit.client.1.smithi193.stdout:3/41: mkdir d0/d7/de 0 2024-09-04T16:30:00.188 INFO:tasks.workunit.client.1.smithi193.stdout:3/42: write d0/d7/fc [199690,76430] 0 2024-09-04T16:30:00.189 INFO:tasks.workunit.client.1.smithi193.stdout:3/43: chown d0/f3 3 1 2024-09-04T16:30:00.189 INFO:tasks.workunit.client.1.smithi193.stdout:4/19: creat d3/f9 x:0 0 0 2024-09-04T16:30:00.190 INFO:tasks.workunit.client.1.smithi193.stdout:9/118: symlink d2/d8/l24 0 2024-09-04T16:30:00.190 INFO:tasks.workunit.client.1.smithi193.stdout:4/20: dread - d3/f7 zero size 2024-09-04T16:30:00.191 INFO:tasks.workunit.client.1.smithi193.stdout:2/29: creat d2/fc x:0 0 0 2024-09-04T16:30:00.192 INFO:tasks.workunit.client.1.smithi193.stdout:4/21: chown f0 41244 1 2024-09-04T16:30:00.193 INFO:tasks.workunit.client.1.smithi193.stdout:0/48: dread f6 [0,4194304] 0 2024-09-04T16:30:00.194 INFO:tasks.workunit.client.1.smithi193.stdout:4/22: chown d3/c8 77068639 1 2024-09-04T16:30:00.194 INFO:tasks.workunit.client.1.smithi193.stdout:2/30: write d2/fc [153060,20095] 0 2024-09-04T16:30:00.198 INFO:tasks.workunit.client.1.smithi193.stdout:3/44: dwrite d0/f4 [4194304,4194304] 0 2024-09-04T16:30:00.198 INFO:tasks.workunit.client.1.smithi193.stdout:3/45: stat d0 0 2024-09-04T16:30:00.207 INFO:tasks.workunit.client.1.smithi193.stdout:3/46: dwrite d0/d9/fb [0,4194304] 0 2024-09-04T16:30:00.213 INFO:tasks.workunit.client.1.smithi193.stdout:9/119: dread - d2/d8/d15/f16 zero size 2024-09-04T16:30:00.213 INFO:tasks.workunit.client.1.smithi193.stdout:5/73: link d1/d8/ce d1/c14 0 2024-09-04T16:30:00.213 INFO:tasks.workunit.client.1.smithi193.stdout:9/120: dread - d2/d8/d15/f16 zero size 2024-09-04T16:30:00.215 INFO:tasks.workunit.client.1.smithi193.stdout:0/49: mknod c10 0 2024-09-04T16:30:00.217 INFO:tasks.workunit.client.1.smithi193.stdout:2/31: write d2/f8 [1409447,17342] 0 2024-09-04T16:30:00.218 INFO:tasks.workunit.client.1.smithi193.stdout:4/23: creat d3/fa x:0 0 0 2024-09-04T16:30:00.218 INFO:tasks.workunit.client.1.smithi193.stdout:2/32: chown d2 0 1 2024-09-04T16:30:00.220 INFO:tasks.workunit.client.1.smithi193.stdout:1/111: mkdir d1/d3/d1b/d28 0 2024-09-04T16:30:00.223 INFO:tasks.workunit.client.1.smithi193.stdout:5/74: truncate d1/f3 929824 0 2024-09-04T16:30:00.223 INFO:tasks.workunit.client.1.smithi193.stdout:0/50: unlink c10 0 2024-09-04T16:30:00.225 INFO:tasks.workunit.client.1.smithi193.stdout:1/112: dread - d1/d3/d10/f25 zero size 2024-09-04T16:30:00.226 INFO:tasks.workunit.client.1.smithi193.stdout:3/47: creat d0/d7/de/ff x:0 0 0 2024-09-04T16:30:00.228 INFO:tasks.workunit.client.1.smithi193.stdout:2/33: creat d2/d9/db/fd x:0 0 0 2024-09-04T16:30:00.228 INFO:tasks.workunit.client.1.smithi193.stdout:9/121: dwrite d2/d8/d15/f1b [0,4194304] 0 2024-09-04T16:30:00.228 INFO:tasks.workunit.client.1.smithi193.stdout:1/113: fsync d1/d3/d10/f25 0 2024-09-04T16:30:00.231 INFO:tasks.workunit.client.1.smithi193.stdout:0/51: mknod c11 0 2024-09-04T16:30:00.236 INFO:tasks.workunit.client.1.smithi193.stdout:0/52: fdatasync fe 0 2024-09-04T16:30:00.236 INFO:tasks.workunit.client.1.smithi193.stdout:4/24: dwrite d3/f9 [0,4194304] 0 2024-09-04T16:30:00.240 INFO:tasks.workunit.client.1.smithi193.stdout:0/53: mknod c12 0 2024-09-04T16:30:00.247 INFO:tasks.workunit.client.1.smithi193.stdout:3/48: dwrite d0/f4 [4194304,4194304] 0 2024-09-04T16:30:00.247 INFO:tasks.workunit.client.1.smithi193.stdout:2/34: dwrite d2/fc [0,4194304] 0 2024-09-04T16:30:00.249 INFO:tasks.workunit.client.1.smithi193.stdout:9/122: dread d2/d4/fd [0,4194304] 0 2024-09-04T16:30:00.253 INFO:tasks.workunit.client.1.smithi193.stdout:3/49: mkdir d0/d10 0 2024-09-04T16:30:00.257 INFO:tasks.workunit.client.1.smithi193.stdout:2/35: creat d2/fe x:0 0 0 2024-09-04T16:30:00.258 INFO:tasks.workunit.client.1.smithi193.stdout:4/25: dwrite f0 [0,4194304] 0 2024-09-04T16:30:00.258 INFO:tasks.workunit.client.1.smithi193.stdout:0/54: dwrite fb [0,4194304] 0 2024-09-04T16:30:00.259 INFO:tasks.workunit.client.1.smithi193.stdout:3/50: symlink d0/d7/l11 0 2024-09-04T16:30:00.264 INFO:tasks.workunit.client.1.smithi193.stdout:2/36: rename d2/ca to d2/d9/cf 0 2024-09-04T16:30:00.267 INFO:tasks.workunit.client.1.smithi193.stdout:9/123: dwrite d2/d4/f5 [0,4194304] 0 2024-09-04T16:30:00.271 INFO:tasks.workunit.client.1.smithi193.stdout:0/55: dwrite f1 [0,4194304] 0 2024-09-04T16:30:00.272 INFO:tasks.workunit.client.1.smithi193.stdout:2/37: mkdir d2/d9/db/d10 0 2024-09-04T16:30:00.274 INFO:tasks.workunit.client.1.smithi193.stdout:9/124: chown d2/d18/c19 295964832 1 2024-09-04T16:30:00.275 INFO:tasks.workunit.client.1.smithi193.stdout:3/51: mknod d0/d10/c12 0 2024-09-04T16:30:00.276 INFO:tasks.workunit.client.1.smithi193.stdout:3/52: write d0/f4 [6901037,59349] 0 2024-09-04T16:30:00.276 INFO:tasks.workunit.client.1.smithi193.stdout:3/53: chown d0/l6 21543560 1 2024-09-04T16:30:00.280 INFO:tasks.workunit.client.1.smithi193.stdout:0/56: rename l4 to l13 0 2024-09-04T16:30:00.280 INFO:tasks.workunit.client.1.smithi193.stdout:0/57: rmdir - no directory 2024-09-04T16:30:00.285 INFO:tasks.workunit.client.1.smithi193.stdout:3/54: unlink d0/d9/fd 0 2024-09-04T16:30:00.285 INFO:tasks.workunit.client.1.smithi193.stdout:0/58: dwrite f9 [0,4194304] 0 2024-09-04T16:30:00.288 INFO:tasks.workunit.client.1.smithi193.stdout:9/125: mkdir d2/d8/d25 0 2024-09-04T16:30:00.291 INFO:tasks.workunit.client.1.smithi193.stdout:0/59: dread fe [0,4194304] 0 2024-09-04T16:30:00.291 INFO:tasks.workunit.client.1.smithi193.stdout:3/55: mknod d0/d7/de/c13 0 2024-09-04T16:30:00.296 INFO:tasks.workunit.client.1.smithi193.stdout:3/56: symlink d0/d7/l14 0 2024-09-04T16:30:00.299 INFO:tasks.workunit.client.1.smithi193.stdout:0/60: link lc l14 0 2024-09-04T16:30:00.300 INFO:tasks.workunit.client.1.smithi193.stdout:9/126: fsync d2/d4/f5 0 2024-09-04T16:30:00.302 INFO:tasks.workunit.client.1.smithi193.stdout:0/61: rename f9 to f15 0 2024-09-04T16:30:00.305 INFO:tasks.workunit.client.1.smithi193.stdout:3/57: dwrite d0/f3 [4194304,4194304] 0 2024-09-04T16:30:00.305 INFO:tasks.workunit.client.1.smithi193.stdout:0/62: symlink l16 0 2024-09-04T16:30:00.306 INFO:tasks.workunit.client.1.smithi193.stdout:3/58: write d0/f4 [8657660,23850] 0 2024-09-04T16:30:00.307 INFO:tasks.workunit.client.1.smithi193.stdout:0/63: creat f17 x:0 0 0 2024-09-04T16:30:00.308 INFO:tasks.workunit.client.1.smithi193.stdout:3/59: truncate d0/d7/de/ff 109236 0 2024-09-04T16:30:00.308 INFO:tasks.workunit.client.1.smithi193.stdout:9/127: creat d2/d8/f26 x:0 0 0 2024-09-04T16:30:00.309 INFO:tasks.workunit.client.1.smithi193.stdout:9/128: dread - d2/d8/f26 zero size 2024-09-04T16:30:00.310 INFO:tasks.workunit.client.1.smithi193.stdout:0/64: mkdir d18 0 2024-09-04T16:30:00.310 INFO:tasks.workunit.client.1.smithi193.stdout:9/129: fdatasync d2/d8/d15/f1b 0 2024-09-04T16:30:00.311 INFO:tasks.workunit.client.1.smithi193.stdout:0/65: write f1 [3314945,20949] 0 2024-09-04T16:30:00.312 INFO:tasks.workunit.client.1.smithi193.stdout:3/60: creat d0/d10/f15 x:0 0 0 2024-09-04T16:30:00.316 INFO:tasks.workunit.client.1.smithi193.stdout:3/61: rmdir d0/d7/de 39 2024-09-04T16:30:00.318 INFO:tasks.workunit.client.1.smithi193.stdout:9/130: mknod d2/d4/d1d/d22/c27 0 2024-09-04T16:30:00.318 INFO:tasks.workunit.client.1.smithi193.stdout:9/131: read - d2/d4/f23 zero size 2024-09-04T16:30:00.318 INFO:tasks.workunit.client.1.smithi193.stdout:9/132: write d2/d4/f5 [4492142,10910] 0 2024-09-04T16:30:00.319 INFO:tasks.workunit.client.1.smithi193.stdout:9/133: dread - d2/d8/f26 zero size 2024-09-04T16:30:00.320 INFO:tasks.workunit.client.1.smithi193.stdout:0/66: creat d18/f19 x:0 0 0 2024-09-04T16:30:00.322 INFO:tasks.workunit.client.1.smithi193.stdout:9/134: rmdir d2/d4 39 2024-09-04T16:30:00.325 INFO:tasks.workunit.client.1.smithi193.stdout:9/135: creat d2/f28 x:0 0 0 2024-09-04T16:30:00.329 INFO:tasks.workunit.client.1.smithi193.stdout:9/136: creat d2/d4/d1d/f29 x:0 0 0 2024-09-04T16:30:00.331 INFO:tasks.workunit.client.1.smithi193.stdout:9/137: symlink d2/d4/d1d/l2a 0 2024-09-04T16:30:00.332 INFO:tasks.workunit.client.1.smithi193.stdout:1/114: sync 2024-09-04T16:30:00.334 INFO:tasks.workunit.client.1.smithi193.stdout:9/138: rename d2/d4/c13 to d2/d8/d15/c2b 0 2024-09-04T16:30:00.334 INFO:tasks.workunit.client.1.smithi193.stdout:9/139: chown d2/d8/c14 3058 1 2024-09-04T16:30:00.336 INFO:tasks.workunit.client.1.smithi193.stdout:9/140: mknod d2/d8/d25/c2c 0 2024-09-04T16:30:00.337 INFO:tasks.workunit.client.1.smithi193.stdout:9/141: chown d2/d18 11 1 2024-09-04T16:30:00.337 INFO:tasks.workunit.client.1.smithi193.stdout:1/115: dread d1/d3/d10/f24 [0,4194304] 0 2024-09-04T16:30:00.341 INFO:tasks.workunit.client.1.smithi193.stdout:1/116: creat d1/d3/d1b/d28/f29 x:0 0 0 2024-09-04T16:30:00.343 INFO:tasks.workunit.client.1.smithi193.stdout:1/117: fsync d1/d3/f16 0 2024-09-04T16:30:00.353 INFO:tasks.workunit.client.1.smithi193.stdout:1/118: dwrite d1/d3/f14 [0,4194304] 0 2024-09-04T16:30:00.354 INFO:tasks.workunit.client.1.smithi193.stdout:1/119: truncate d1/d3/db/f23 202538 0 2024-09-04T16:30:00.355 INFO:tasks.workunit.client.1.smithi193.stdout:1/120: write d1/d3/f20 [650937,67436] 0 2024-09-04T16:30:00.357 INFO:tasks.workunit.client.1.smithi193.stdout:6/34: getdents d5 0 2024-09-04T16:30:00.358 INFO:tasks.workunit.client.1.smithi193.stdout:1/121: rmdir d1/d3/db 39 2024-09-04T16:30:00.358 INFO:tasks.workunit.client.1.smithi193.stdout:7/51: write f3 [222528,123787] 0 2024-09-04T16:30:00.359 INFO:tasks.workunit.client.1.smithi193.stdout:6/35: chown d5/f6 845430 1 2024-09-04T16:30:00.359 INFO:tasks.workunit.client.1.smithi193.stdout:6/36: readlink d5/l9 0 2024-09-04T16:30:00.360 INFO:tasks.workunit.client.1.smithi193.stdout:1/122: write d1/d3/d1b/d28/f29 [148813,60734] 0 2024-09-04T16:30:00.361 INFO:tasks.workunit.client.1.smithi193.stdout:7/52: dread f6 [0,4194304] 0 2024-09-04T16:30:00.362 INFO:tasks.workunit.client.1.smithi193.stdout:6/37: creat d5/fb x:0 0 0 2024-09-04T16:30:00.365 INFO:tasks.workunit.client.1.smithi193.stdout:7/53: creat d9/ff x:0 0 0 2024-09-04T16:30:00.367 INFO:tasks.workunit.client.1.smithi193.stdout:1/123: mkdir d1/d3/d10/d2a 0 2024-09-04T16:30:00.368 INFO:tasks.workunit.client.1.smithi193.stdout:6/38: dwrite f3 [0,4194304] 0 2024-09-04T16:30:00.371 INFO:tasks.workunit.client.1.smithi193.stdout:8/57: truncate d2/f3 3436207 0 2024-09-04T16:30:00.373 INFO:tasks.workunit.client.1.smithi193.stdout:3/62: write d0/d7/de/ff [725968,74114] 0 2024-09-04T16:30:00.374 INFO:tasks.workunit.client.1.smithi193.stdout:6/39: dwrite f3 [0,4194304] 0 2024-09-04T16:30:00.375 INFO:tasks.workunit.client.1.smithi193.stdout:6/40: read d5/f6 [2509944,109867] 0 2024-09-04T16:30:00.376 INFO:tasks.workunit.client.1.smithi193.stdout:6/41: read f3 [1773157,104138] 0 2024-09-04T16:30:00.377 INFO:tasks.workunit.client.1.smithi193.stdout:6/42: chown d5 416596 1 2024-09-04T16:30:00.381 INFO:tasks.workunit.client.1.smithi193.stdout:3/63: dwrite d0/f3 [4194304,4194304] 0 2024-09-04T16:30:00.389 INFO:tasks.workunit.client.1.smithi193.stdout:7/54: link c5 d9/c10 0 2024-09-04T16:30:00.390 INFO:tasks.workunit.client.1.smithi193.stdout:7/55: dread f6 [0,4194304] 0 2024-09-04T16:30:00.394 INFO:tasks.workunit.client.1.smithi193.stdout:3/64: creat d0/d10/f16 x:0 0 0 2024-09-04T16:30:00.396 INFO:tasks.workunit.client.1.smithi193.stdout:7/56: mkdir d9/d11 0 2024-09-04T16:30:00.397 INFO:tasks.workunit.client.1.smithi193.stdout:6/43: link d5/fb d5/fc 0 2024-09-04T16:30:00.397 INFO:tasks.workunit.client.1.smithi193.stdout:3/65: dread d0/fa [0,4194304] 0 2024-09-04T16:30:00.398 INFO:tasks.workunit.client.1.smithi193.stdout:7/57: symlink d9/l12 0 2024-09-04T16:30:00.398 INFO:tasks.workunit.client.1.smithi193.stdout:7/58: chown d9/de 904108230 1 2024-09-04T16:30:00.399 INFO:tasks.workunit.client.1.smithi193.stdout:7/59: readlink d9/lb 0 2024-09-04T16:30:00.399 INFO:tasks.workunit.client.1.smithi193.stdout:6/44: creat d5/fd x:0 0 0 2024-09-04T16:30:00.400 INFO:tasks.workunit.client.1.smithi193.stdout:3/66: symlink d0/l17 0 2024-09-04T16:30:00.402 INFO:tasks.workunit.client.1.smithi193.stdout:6/45: mkdir d5/de 0 2024-09-04T16:30:00.404 INFO:tasks.workunit.client.1.smithi193.stdout:7/60: mknod d9/de/c13 0 2024-09-04T16:30:00.405 INFO:tasks.workunit.client.1.smithi193.stdout:6/46: write f3 [4187499,119946] 0 2024-09-04T16:30:00.407 INFO:tasks.workunit.client.1.smithi193.stdout:6/47: write d5/f6 [672800,65096] 0 2024-09-04T16:30:00.409 INFO:tasks.workunit.client.1.smithi193.stdout:7/61: unlink f1 0 2024-09-04T16:30:00.411 INFO:tasks.workunit.client.1.smithi193.stdout:6/48: creat d5/ff x:0 0 0 2024-09-04T16:30:00.411 INFO:tasks.workunit.client.1.smithi193.stdout:6/49: stat d5/ff 0 2024-09-04T16:30:00.412 INFO:tasks.workunit.client.1.smithi193.stdout:7/62: rename d9/ff to d9/f14 0 2024-09-04T16:30:00.412 INFO:tasks.workunit.client.1.smithi193.stdout:7/63: readlink l4 0 2024-09-04T16:30:00.415 INFO:tasks.workunit.client.1.smithi193.stdout:6/50: creat d5/f10 x:0 0 0 2024-09-04T16:30:00.415 INFO:tasks.workunit.client.1.smithi193.stdout:7/64: mknod d9/de/c15 0 2024-09-04T16:30:00.417 INFO:tasks.workunit.client.1.smithi193.stdout:6/51: write d5/fc [464784,85867] 0 2024-09-04T16:30:00.417 INFO:tasks.workunit.client.1.smithi193.stdout:6/52: dread - d5/fd zero size 2024-09-04T16:30:00.417 INFO:tasks.workunit.client.1.smithi193.stdout:7/65: mknod d9/d11/c16 0 2024-09-04T16:30:00.420 INFO:tasks.workunit.client.1.smithi193.stdout:6/53: creat d5/f11 x:0 0 0 2024-09-04T16:30:00.421 INFO:tasks.workunit.client.1.smithi193.stdout:6/54: chown d5/f7 277601084 1 2024-09-04T16:30:00.421 INFO:tasks.workunit.client.1.smithi193.stdout:6/55: stat d5/l9 0 2024-09-04T16:30:00.421 INFO:tasks.workunit.client.1.smithi193.stdout:7/66: creat d9/d11/f17 x:0 0 0 2024-09-04T16:30:00.421 INFO:tasks.workunit.client.1.smithi193.stdout:6/56: read - d5/fd zero size 2024-09-04T16:30:00.423 INFO:tasks.workunit.client.1.smithi193.stdout:7/67: write d9/f14 [551436,61951] 0 2024-09-04T16:30:00.427 INFO:tasks.workunit.client.1.smithi193.stdout:7/68: unlink d9/c10 0 2024-09-04T16:30:00.438 INFO:tasks.workunit.client.1.smithi193.stdout:4/26: truncate f0 699188 0 2024-09-04T16:30:00.439 INFO:tasks.workunit.client.1.smithi193.stdout:4/27: truncate d3/f6 81192 0 2024-09-04T16:30:00.439 INFO:tasks.workunit.client.1.smithi193.stdout:0/67: readlink l13 0 2024-09-04T16:30:00.441 INFO:tasks.workunit.client.1.smithi193.stdout:0/68: fdatasync f15 0 2024-09-04T16:30:00.441 INFO:tasks.workunit.client.1.smithi193.stdout:2/38: write d2/fc [4252958,120653] 0 2024-09-04T16:30:00.444 INFO:tasks.workunit.client.1.smithi193.stdout:0/69: link fe d18/f1a 0 2024-09-04T16:30:00.445 INFO:tasks.workunit.client.1.smithi193.stdout:0/70: write fe [4128907,32902] 0 2024-09-04T16:30:00.445 INFO:tasks.workunit.client.1.smithi193.stdout:0/71: chown l8 41892 1 2024-09-04T16:30:00.533 INFO:tasks.workunit.client.1.smithi193.stdout:8/58: sync 2024-09-04T16:30:00.534 INFO:tasks.workunit.client.1.smithi193.stdout:8/59: creat d2/f13 x:0 0 0 2024-09-04T16:30:00.535 INFO:tasks.workunit.client.1.smithi193.stdout:8/60: readlink d2/l5 0 2024-09-04T16:30:00.536 INFO:tasks.workunit.client.1.smithi193.stdout:9/142: getdents d2/d4 0 2024-09-04T16:30:00.537 INFO:tasks.workunit.client.1.smithi193.stdout:8/61: mknod d2/da/c14 0 2024-09-04T16:30:00.538 INFO:tasks.workunit.client.1.smithi193.stdout:8/62: chown d2/f8 1 1 2024-09-04T16:30:00.539 INFO:tasks.workunit.client.1.smithi193.stdout:8/63: rmdir d2/da 39 2024-09-04T16:30:00.540 INFO:tasks.workunit.client.1.smithi193.stdout:8/64: chown d2/f8 177042 1 2024-09-04T16:30:00.541 INFO:tasks.workunit.client.1.smithi193.stdout:9/143: dread d2/d4/f17 [0,4194304] 0 2024-09-04T16:30:00.543 INFO:tasks.workunit.client.1.smithi193.stdout:8/65: symlink d2/da/l15 0 2024-09-04T16:30:00.544 INFO:tasks.workunit.client.1.smithi193.stdout:9/144: symlink d2/l2d 0 2024-09-04T16:30:00.546 INFO:tasks.workunit.client.1.smithi193.stdout:8/66: creat d2/da/f16 x:0 0 0 2024-09-04T16:30:00.550 INFO:tasks.workunit.client.1.smithi193.stdout:8/67: rmdir d2/d12 39 2024-09-04T16:30:00.551 INFO:tasks.workunit.client.1.smithi193.stdout:9/145: symlink d2/l2e 0 2024-09-04T16:30:00.552 INFO:tasks.workunit.client.1.smithi193.stdout:9/146: write d2/d4/f17 [279734,56836] 0 2024-09-04T16:30:00.552 INFO:tasks.workunit.client.1.smithi193.stdout:9/147: readlink d2/d4/d1d/l2a 0 2024-09-04T16:30:00.554 INFO:tasks.workunit.client.1.smithi193.stdout:9/148: truncate d2/d8/d15/f1b 5151848 0 2024-09-04T16:30:00.554 INFO:tasks.workunit.client.1.smithi193.stdout:8/68: mknod d2/d12/c17 0 2024-09-04T16:30:00.555 INFO:tasks.workunit.client.1.smithi193.stdout:8/69: fdatasync d2/f13 0 2024-09-04T16:30:00.555 INFO:tasks.workunit.client.1.smithi193.stdout:1/124: rename d1/d3 to d1/d2b 0 2024-09-04T16:30:00.556 INFO:tasks.workunit.client.1.smithi193.stdout:1/125: read - d1/d2b/d10/f25 zero size 2024-09-04T16:30:00.563 INFO:tasks.workunit.client.1.smithi193.stdout:9/149: dwrite d2/d4/fd [0,4194304] 0 2024-09-04T16:30:00.563 INFO:tasks.workunit.client.1.smithi193.stdout:1/126: link d1/d2b/d10/f1f d1/d2b/f2c 0 2024-09-04T16:30:00.564 INFO:tasks.workunit.client.1.smithi193.stdout:8/70: dwrite d2/d12/fe [0,4194304] 0 2024-09-04T16:30:00.569 INFO:tasks.workunit.client.1.smithi193.stdout:9/150: rename d2/d4/d1d to d2/d18/d2f 0 2024-09-04T16:30:00.577 INFO:tasks.workunit.client.1.smithi193.stdout:9/151: mkdir d2/d18/d2f/d22/d30 0 2024-09-04T16:30:00.582 INFO:tasks.workunit.client.1.smithi193.stdout:9/152: creat d2/d8/d15/f31 x:0 0 0 2024-09-04T16:30:00.583 INFO:tasks.workunit.client.1.smithi193.stdout:1/127: link d1/d2b/d1b/l27 d1/d2b/d10/d2a/l2d 0 2024-09-04T16:30:00.591 INFO:tasks.workunit.client.1.smithi193.stdout:1/128: getdents d1/d2b/db 0 2024-09-04T16:30:00.595 INFO:tasks.workunit.client.1.smithi193.stdout:1/129: creat d1/d2b/f2e x:0 0 0 2024-09-04T16:30:00.595 INFO:tasks.workunit.client.1.smithi193.stdout:1/130: read d1/f1c [2738714,9001] 0 2024-09-04T16:30:00.598 INFO:tasks.workunit.client.1.smithi193.stdout:1/131: creat d1/d2b/d10/f2f x:0 0 0 2024-09-04T16:30:00.600 INFO:tasks.workunit.client.1.smithi193.stdout:1/132: chown d1/d2b/ce 1881 1 2024-09-04T16:30:00.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:00 smithi170 ceph-mon[29272]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-04T16:30:00.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:00 smithi170 ceph-mon[29272]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:30:00.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:00 smithi170 ceph-mon[29272]: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:30:00.604 INFO:tasks.workunit.client.1.smithi193.stdout:1/133: dread d1/d2b/f20 [0,4194304] 0 2024-09-04T16:30:00.606 INFO:tasks.workunit.client.1.smithi193.stdout:1/134: mknod d1/d2b/d10/d2a/c30 0 2024-09-04T16:30:00.609 INFO:tasks.workunit.client.1.smithi193.stdout:6/57: getdents d5 0 2024-09-04T16:30:00.610 INFO:tasks.workunit.client.1.smithi193.stdout:7/69: getdents d9/d11 0 2024-09-04T16:30:00.612 INFO:tasks.workunit.client.1.smithi193.stdout:5/75: write d1/f3 [1091617,73859] 0 2024-09-04T16:30:00.612 INFO:tasks.workunit.client.1.smithi193.stdout:7/70: mkdir d9/d18 0 2024-09-04T16:30:00.614 INFO:tasks.workunit.client.1.smithi193.stdout:5/76: write d1/f3 [723003,38310] 0 2024-09-04T16:30:00.616 INFO:tasks.workunit.client.1.smithi193.stdout:5/77: write d1/f3 [851901,55800] 0 2024-09-04T16:30:00.617 INFO:tasks.workunit.client.1.smithi193.stdout:6/58: dwrite d5/f10 [0,4194304] 0 2024-09-04T16:30:00.617 INFO:tasks.workunit.client.1.smithi193.stdout:6/59: chown d5/fb 229319882 1 2024-09-04T16:30:00.619 INFO:tasks.workunit.client.1.smithi193.stdout:6/60: readlink d5/l9 0 2024-09-04T16:30:00.619 INFO:tasks.workunit.client.1.smithi193.stdout:5/78: write d1/f11 [120661,10237] 0 2024-09-04T16:30:00.620 INFO:tasks.workunit.client.1.smithi193.stdout:7/71: link f8 d9/f19 0 2024-09-04T16:30:00.621 INFO:tasks.workunit.client.1.smithi193.stdout:4/28: fsync f0 0 2024-09-04T16:30:00.622 INFO:tasks.workunit.client.1.smithi193.stdout:3/67: sync 2024-09-04T16:30:00.624 INFO:tasks.workunit.client.1.smithi193.stdout:0/72: getdents d18 0 2024-09-04T16:30:00.627 INFO:tasks.workunit.client.1.smithi193.stdout:3/68: dread d0/d7/fc [0,4194304] 0 2024-09-04T16:30:00.627 INFO:tasks.workunit.client.1.smithi193.stdout:7/72: creat d9/de/f1a x:0 0 0 2024-09-04T16:30:00.629 INFO:tasks.workunit.client.1.smithi193.stdout:7/73: chown d9/d11 17458 1 2024-09-04T16:30:00.629 INFO:tasks.workunit.client.1.smithi193.stdout:3/69: stat d0/l17 0 2024-09-04T16:30:00.630 INFO:tasks.workunit.client.1.smithi193.stdout:4/29: dwrite d3/f6 [0,4194304] 0 2024-09-04T16:30:00.630 INFO:tasks.workunit.client.1.smithi193.stdout:7/74: stat d9/d18 0 2024-09-04T16:30:00.630 INFO:tasks.workunit.client.1.smithi193.stdout:6/61: mknod d5/de/c12 0 2024-09-04T16:30:00.635 INFO:tasks.workunit.client.1.smithi193.stdout:0/73: mknod d18/c1b 0 2024-09-04T16:30:00.635 INFO:tasks.workunit.client.1.smithi193.stdout:6/62: dwrite d5/f10 [0,4194304] 0 2024-09-04T16:30:00.641 INFO:tasks.workunit.client.1.smithi193.stdout:4/30: mkdir d3/db 0 2024-09-04T16:30:00.643 INFO:tasks.workunit.client.1.smithi193.stdout:7/75: symlink d9/de/l1b 0 2024-09-04T16:30:00.647 INFO:tasks.workunit.client.1.smithi193.stdout:0/74: creat d18/f1c x:0 0 0 2024-09-04T16:30:00.649 INFO:tasks.workunit.client.1.smithi193.stdout:7/76: dwrite d9/d11/f17 [0,4194304] 0 2024-09-04T16:30:00.653 INFO:tasks.workunit.client.1.smithi193.stdout:8/71: write d2/d12/fe [4798769,84143] 0 2024-09-04T16:30:00.654 INFO:tasks.workunit.client.1.smithi193.stdout:0/75: readlink lc 0 2024-09-04T16:30:00.655 INFO:tasks.workunit.client.1.smithi193.stdout:7/77: dread d9/d11/f17 [0,4194304] 0 2024-09-04T16:30:00.655 INFO:tasks.workunit.client.1.smithi193.stdout:0/76: readlink l14 0 2024-09-04T16:30:00.655 INFO:tasks.workunit.client.1.smithi193.stdout:7/78: chown d9/cc 3 1 2024-09-04T16:30:00.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:00 smithi193 ceph-mon[36288]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-04T16:30:00.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:00 smithi193 ceph-mon[36288]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:30:00.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:00 smithi193 ceph-mon[36288]: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:30:00.661 INFO:tasks.workunit.client.1.smithi193.stdout:4/31: getdents d3/db 0 2024-09-04T16:30:00.663 INFO:tasks.workunit.client.1.smithi193.stdout:0/77: dwrite d18/f19 [0,4194304] 0 2024-09-04T16:30:00.664 INFO:tasks.workunit.client.1.smithi193.stdout:7/79: creat d9/de/f1c x:0 0 0 2024-09-04T16:30:00.666 INFO:tasks.workunit.client.1.smithi193.stdout:3/70: getdents d0/d9 0 2024-09-04T16:30:00.667 INFO:tasks.workunit.client.1.smithi193.stdout:9/153: truncate d2/d8/d15/f1b 4718133 0 2024-09-04T16:30:00.672 INFO:tasks.workunit.client.1.smithi193.stdout:0/78: creat d18/f1d x:0 0 0 2024-09-04T16:30:00.673 INFO:tasks.workunit.client.1.smithi193.stdout:2/39: sync 2024-09-04T16:30:00.673 INFO:tasks.workunit.client.1.smithi193.stdout:9/154: rmdir d2/d4 39 2024-09-04T16:30:00.674 INFO:tasks.workunit.client.1.smithi193.stdout:0/79: chown f6 68762391 1 2024-09-04T16:30:00.674 INFO:tasks.workunit.client.1.smithi193.stdout:3/71: dwrite d0/d10/f16 [0,4194304] 0 2024-09-04T16:30:00.677 INFO:tasks.workunit.client.1.smithi193.stdout:7/80: rename c5 to d9/de/c1d 0 2024-09-04T16:30:00.677 INFO:tasks.workunit.client.1.smithi193.stdout:4/32: rmdir d3/db 0 2024-09-04T16:30:00.679 INFO:tasks.workunit.client.1.smithi193.stdout:4/33: dread f0 [0,4194304] 0 2024-09-04T16:30:00.679 INFO:tasks.workunit.client.1.smithi193.stdout:0/80: dread d18/f19 [0,4194304] 0 2024-09-04T16:30:00.681 INFO:tasks.workunit.client.1.smithi193.stdout:3/72: mkdir d0/d18 0 2024-09-04T16:30:00.682 INFO:tasks.workunit.client.1.smithi193.stdout:9/155: mknod d2/d8/c32 0 2024-09-04T16:30:00.683 INFO:tasks.workunit.client.1.smithi193.stdout:2/40: symlink d2/d9/db/d10/l11 0 2024-09-04T16:30:00.685 INFO:tasks.workunit.client.1.smithi193.stdout:7/81: dread d9/f19 [0,4194304] 0 2024-09-04T16:30:00.685 INFO:tasks.workunit.client.1.smithi193.stdout:0/81: mknod d18/c1e 0 2024-09-04T16:30:00.687 INFO:tasks.workunit.client.1.smithi193.stdout:7/82: stat l4 0 2024-09-04T16:30:00.692 INFO:tasks.workunit.client.1.smithi193.stdout:0/82: fdatasync fe 0 2024-09-04T16:30:00.693 INFO:tasks.workunit.client.1.smithi193.stdout:9/156: write d2/d4/f23 [381821,72879] 0 2024-09-04T16:30:00.695 INFO:tasks.workunit.client.1.smithi193.stdout:1/135: dwrite d1/d2b/d10/f17 [0,4194304] 0 2024-09-04T16:30:00.696 INFO:tasks.workunit.client.1.smithi193.stdout:5/79: truncate d1/f11 821503 0 2024-09-04T16:30:00.701 INFO:tasks.workunit.client.1.smithi193.stdout:4/34: dwrite d3/fa [0,4194304] 0 2024-09-04T16:30:00.704 INFO:tasks.workunit.client.1.smithi193.stdout:6/63: dwrite d5/f10 [4194304,4194304] 0 2024-09-04T16:30:00.706 INFO:tasks.workunit.client.1.smithi193.stdout:2/41: dwrite d2/f4 [0,4194304] 0 2024-09-04T16:30:00.707 INFO:tasks.workunit.client.1.smithi193.stdout:2/42: dread - d2/fe zero size 2024-09-04T16:30:00.709 INFO:tasks.workunit.client.1.smithi193.stdout:9/157: dread d2/d4/f5 [0,4194304] 0 2024-09-04T16:30:00.789 INFO:tasks.workunit.client.1.smithi193.stdout:0/83: mknod d18/c1f 0 2024-09-04T16:30:00.790 INFO:tasks.workunit.client.1.smithi193.stdout:3/73: link d0/d7/l14 d0/d9/l19 0 2024-09-04T16:30:00.791 INFO:tasks.workunit.client.1.smithi193.stdout:3/74: readlink d0/d7/l11 0 2024-09-04T16:30:00.796 INFO:tasks.workunit.client.1.smithi193.stdout:8/72: write f0 [1962214,99278] 0 2024-09-04T16:30:00.798 INFO:tasks.workunit.client.1.smithi193.stdout:0/84: dread f6 [0,4194304] 0 2024-09-04T16:30:00.800 INFO:tasks.workunit.client.1.smithi193.stdout:4/35: creat d3/fc x:0 0 0 2024-09-04T16:30:00.802 INFO:tasks.workunit.client.1.smithi193.stdout:6/64: mknod d5/de/c13 0 2024-09-04T16:30:00.804 INFO:tasks.workunit.client.1.smithi193.stdout:2/43: rename d2/f8 to d2/d9/db/d10/f12 0 2024-09-04T16:30:00.806 INFO:tasks.workunit.client.1.smithi193.stdout:0/85: dwrite f3 [0,4194304] 0 2024-09-04T16:30:00.807 INFO:tasks.workunit.client.1.smithi193.stdout:4/36: fsync d3/fa 0 2024-09-04T16:30:00.807 INFO:tasks.workunit.client.1.smithi193.stdout:7/83: truncate d9/f19 1757223 0 2024-09-04T16:30:00.808 INFO:tasks.workunit.client.1.smithi193.stdout:0/86: stat d18/c1f 0 2024-09-04T16:30:00.808 INFO:tasks.workunit.client.1.smithi193.stdout:4/37: stat d3/f7 0 2024-09-04T16:30:00.809 INFO:tasks.workunit.client.1.smithi193.stdout:0/87: chown f15 54 1 2024-09-04T16:30:00.809 INFO:tasks.workunit.client.1.smithi193.stdout:6/65: dread d5/f6 [0,4194304] 0 2024-09-04T16:30:00.812 INFO:tasks.workunit.client.1.smithi193.stdout:5/80: fsync d1/d8/fc 0 2024-09-04T16:30:00.813 INFO:tasks.workunit.client.1.smithi193.stdout:5/81: dread - d1/d8/f12 zero size 2024-09-04T16:30:00.824 INFO:tasks.workunit.client.1.smithi193.stdout:4/38: rmdir d3 39 2024-09-04T16:30:00.824 INFO:tasks.workunit.client.1.smithi193.stdout:9/158: sync 2024-09-04T16:30:00.825 INFO:tasks.workunit.client.1.smithi193.stdout:4/39: write f0 [1209649,3272] 0 2024-09-04T16:30:00.826 INFO:tasks.workunit.client.1.smithi193.stdout:0/88: creat d18/f20 x:0 0 0 2024-09-04T16:30:00.829 INFO:tasks.workunit.client.1.smithi193.stdout:6/66: creat d5/f14 x:0 0 0 2024-09-04T16:30:00.830 INFO:tasks.workunit.client.1.smithi193.stdout:3/75: rename d0/d10/f16 to d0/d10/f1a 0 2024-09-04T16:30:00.831 INFO:tasks.workunit.client.1.smithi193.stdout:3/76: fdatasync d0/f4 0 2024-09-04T16:30:00.832 INFO:tasks.workunit.client.1.smithi193.stdout:0/89: dread f6 [0,4194304] 0 2024-09-04T16:30:00.832 INFO:tasks.workunit.client.1.smithi193.stdout:9/159: dwrite d2/d8/f9 [0,4194304] 0 2024-09-04T16:30:00.833 INFO:tasks.workunit.client.1.smithi193.stdout:1/136: rename d1/d2b/f20 to d1/d2b/f31 0 2024-09-04T16:30:00.834 INFO:tasks.workunit.client.1.smithi193.stdout:8/73: symlink d2/l18 0 2024-09-04T16:30:00.834 INFO:tasks.workunit.client.1.smithi193.stdout:9/160: dread - d2/d18/d2f/f29 zero size 2024-09-04T16:30:00.835 INFO:tasks.workunit.client.1.smithi193.stdout:8/74: fsync d2/d12/fe 0 2024-09-04T16:30:00.836 INFO:tasks.workunit.client.1.smithi193.stdout:5/82: mkdir d1/d8/db/d15 0 2024-09-04T16:30:00.838 INFO:tasks.workunit.client.1.smithi193.stdout:3/77: dread d0/f3 [0,4194304] 0 2024-09-04T16:30:00.839 INFO:tasks.workunit.client.1.smithi193.stdout:2/44: rename d2/d9/cf to d2/d9/db/d10/c13 0 2024-09-04T16:30:00.840 INFO:tasks.workunit.client.1.smithi193.stdout:2/45: readlink d2/l6 0 2024-09-04T16:30:00.841 INFO:tasks.workunit.client.1.smithi193.stdout:7/84: mkdir d9/d18/d1e 0 2024-09-04T16:30:00.842 INFO:tasks.workunit.client.1.smithi193.stdout:2/46: truncate d2/fe 873545 0 2024-09-04T16:30:00.843 INFO:tasks.workunit.client.1.smithi193.stdout:8/75: dwrite d2/d12/fd [0,4194304] 0 2024-09-04T16:30:00.843 INFO:tasks.workunit.client.1.smithi193.stdout:4/40: chown d3/f6 1086634301 1 2024-09-04T16:30:00.846 INFO:tasks.workunit.client.1.smithi193.stdout:6/67: rmdir d5/de 39 2024-09-04T16:30:00.848 INFO:tasks.workunit.client.1.smithi193.stdout:4/41: dread d3/f9 [0,4194304] 0 2024-09-04T16:30:00.849 INFO:tasks.workunit.client.1.smithi193.stdout:4/42: write f0 [2016508,91805] 0 2024-09-04T16:30:00.850 INFO:tasks.workunit.client.1.smithi193.stdout:1/137: write d1/d2b/f31 [813776,80104] 0 2024-09-04T16:30:00.852 INFO:tasks.workunit.client.1.smithi193.stdout:9/161: unlink d2/d8/l24 0 2024-09-04T16:30:00.853 INFO:tasks.workunit.client.1.smithi193.stdout:5/83: creat d1/f16 x:0 0 0 2024-09-04T16:30:00.853 INFO:tasks.workunit.client.1.smithi193.stdout:5/84: dread - d1/f16 zero size 2024-09-04T16:30:00.855 INFO:tasks.workunit.client.1.smithi193.stdout:7/85: creat d9/de/f1f x:0 0 0 2024-09-04T16:30:00.855 INFO:tasks.workunit.client.1.smithi193.stdout:2/47: mkdir d2/d14 0 2024-09-04T16:30:00.856 INFO:tasks.workunit.client.1.smithi193.stdout:5/85: chown d1/l10 230733 1 2024-09-04T16:30:00.857 INFO:tasks.workunit.client.1.smithi193.stdout:8/76: creat d2/d12/f19 x:0 0 0 2024-09-04T16:30:00.860 INFO:tasks.workunit.client.1.smithi193.stdout:0/90: truncate d18/f1a 3150748 0 2024-09-04T16:30:00.861 INFO:tasks.workunit.client.1.smithi193.stdout:4/43: creat d3/fd x:0 0 0 2024-09-04T16:30:00.863 INFO:tasks.workunit.client.1.smithi193.stdout:9/162: dwrite d2/d4/fd [0,4194304] 0 2024-09-04T16:30:00.863 INFO:tasks.workunit.client.1.smithi193.stdout:5/86: rmdir d1 39 2024-09-04T16:30:00.864 INFO:tasks.workunit.client.1.smithi193.stdout:9/163: dread - d2/f1c zero size 2024-09-04T16:30:00.864 INFO:tasks.workunit.client.1.smithi193.stdout:2/48: rmdir d2 39 2024-09-04T16:30:00.868 INFO:tasks.workunit.client.1.smithi193.stdout:6/68: mkdir d5/de/d15 0 2024-09-04T16:30:00.870 INFO:tasks.workunit.client.1.smithi193.stdout:6/69: write d5/fd [586775,9534] 0 2024-09-04T16:30:00.871 INFO:tasks.workunit.client.1.smithi193.stdout:9/164: dwrite d2/f1c [0,4194304] 0 2024-09-04T16:30:00.878 INFO:tasks.workunit.client.1.smithi193.stdout:2/49: stat d2/d9/db 0 2024-09-04T16:30:00.880 INFO:tasks.workunit.client.1.smithi193.stdout:8/77: mknod d2/c1a 0 2024-09-04T16:30:00.880 INFO:tasks.workunit.client.1.smithi193.stdout:8/78: chown d2/f8 3847 1 2024-09-04T16:30:00.883 INFO:tasks.workunit.client.1.smithi193.stdout:7/86: mknod d9/d18/d1e/c20 0 2024-09-04T16:30:00.886 INFO:tasks.workunit.client.1.smithi193.stdout:0/91: link fb d18/f21 0 2024-09-04T16:30:00.890 INFO:tasks.workunit.client.1.smithi193.stdout:4/44: link d3/f6 d3/fe 0 2024-09-04T16:30:00.893 INFO:tasks.workunit.client.1.smithi193.stdout:8/79: mkdir d2/da/d1b 0 2024-09-04T16:30:00.894 INFO:tasks.workunit.client.1.smithi193.stdout:1/138: getdents d1 0 2024-09-04T16:30:00.895 INFO:tasks.workunit.client.1.smithi193.stdout:1/139: read d1/f1c [716245,84081] 0 2024-09-04T16:30:00.896 INFO:tasks.workunit.client.1.smithi193.stdout:6/70: symlink d5/de/d15/l16 0 2024-09-04T16:30:00.901 INFO:tasks.workunit.client.1.smithi193.stdout:0/92: symlink d18/l22 0 2024-09-04T16:30:00.901 INFO:tasks.workunit.client.1.smithi193.stdout:9/165: symlink d2/d18/d2f/d22/d30/l33 0 2024-09-04T16:30:00.901 INFO:tasks.workunit.client.1.smithi193.stdout:3/78: dwrite d0/d10/f1a [0,4194304] 0 2024-09-04T16:30:00.901 INFO:tasks.workunit.client.1.smithi193.stdout:9/166: write d2/d4/f23 [565748,96876] 0 2024-09-04T16:30:00.901 INFO:tasks.workunit.client.1.smithi193.stdout:3/79: write d0/f4 [424406,128497] 0 2024-09-04T16:30:00.901 INFO:tasks.workunit.client.1.smithi193.stdout:4/45: creat d3/ff x:0 0 0 2024-09-04T16:30:00.901 INFO:tasks.workunit.client.1.smithi193.stdout:3/80: write d0/d10/f15 [35261,64607] 0 2024-09-04T16:30:00.907 INFO:tasks.workunit.client.1.smithi193.stdout:8/80: symlink d2/da/l1c 0 2024-09-04T16:30:00.910 INFO:tasks.workunit.client.1.smithi193.stdout:6/71: creat d5/de/f17 x:0 0 0 2024-09-04T16:30:00.911 INFO:tasks.workunit.client.1.smithi193.stdout:6/72: chown d5/ff 0 1 2024-09-04T16:30:00.911 INFO:tasks.workunit.client.1.smithi193.stdout:6/73: dread - d5/f14 zero size 2024-09-04T16:30:00.917 INFO:tasks.workunit.client.1.smithi193.stdout:4/46: rmdir d3 39 2024-09-04T16:30:00.918 INFO:tasks.workunit.client.1.smithi193.stdout:4/47: read f0 [41535,124597] 0 2024-09-04T16:30:00.920 INFO:tasks.workunit.client.1.smithi193.stdout:8/81: rmdir d2/d12 39 2024-09-04T16:30:00.922 INFO:tasks.workunit.client.1.smithi193.stdout:6/74: creat d5/de/f18 x:0 0 0 2024-09-04T16:30:00.923 INFO:tasks.workunit.client.1.smithi193.stdout:0/93: fsync fb 0 2024-09-04T16:30:00.924 INFO:tasks.workunit.client.1.smithi193.stdout:0/94: write f1 [3460197,30358] 0 2024-09-04T16:30:00.925 INFO:tasks.workunit.client.1.smithi193.stdout:0/95: fsync f15 0 2024-09-04T16:30:00.925 INFO:tasks.workunit.client.1.smithi193.stdout:9/167: link d2/d8/f9 d2/d8/d15/f34 0 2024-09-04T16:30:00.928 INFO:tasks.workunit.client.1.smithi193.stdout:0/96: dread f15 [0,4194304] 0 2024-09-04T16:30:00.929 INFO:tasks.workunit.client.1.smithi193.stdout:0/97: stat d18/c1e 0 2024-09-04T16:30:00.929 INFO:tasks.workunit.client.1.smithi193.stdout:3/81: mkdir d0/d18/d1b 0 2024-09-04T16:30:00.931 INFO:tasks.workunit.client.1.smithi193.stdout:2/50: getdents d2/d9/db 0 2024-09-04T16:30:00.933 INFO:tasks.workunit.client.1.smithi193.stdout:8/82: chown d2/f3 2246 1 2024-09-04T16:30:00.934 INFO:tasks.workunit.client.1.smithi193.stdout:5/87: write d1/f3 [810890,108800] 0 2024-09-04T16:30:00.938 INFO:tasks.workunit.client.1.smithi193.stdout:9/168: creat d2/d8/d15/f35 x:0 0 0 2024-09-04T16:30:00.941 INFO:tasks.workunit.client.1.smithi193.stdout:3/82: mkdir d0/d18/d1c 0 2024-09-04T16:30:00.941 INFO:tasks.workunit.client.1.smithi193.stdout:1/140: dwrite d1/d2b/f2c [0,4194304] 0 2024-09-04T16:30:00.943 INFO:tasks.workunit.client.1.smithi193.stdout:2/51: rmdir d2/d9/db 39 2024-09-04T16:30:00.945 INFO:tasks.workunit.client.1.smithi193.stdout:8/83: chown d2/d12/fd 111690 1 2024-09-04T16:30:00.948 INFO:tasks.workunit.client.1.smithi193.stdout:5/88: dread d1/d8/fc [0,4194304] 0 2024-09-04T16:30:00.949 INFO:tasks.workunit.client.1.smithi193.stdout:9/169: creat d2/d18/d2f/f36 x:0 0 0 2024-09-04T16:30:00.952 INFO:tasks.workunit.client.1.smithi193.stdout:0/98: link d18/f21 d18/f23 0 2024-09-04T16:30:00.952 INFO:tasks.workunit.client.1.smithi193.stdout:0/99: dread - f17 zero size 2024-09-04T16:30:00.953 INFO:tasks.workunit.client.1.smithi193.stdout:3/83: mknod d0/c1d 0 2024-09-04T16:30:00.955 INFO:tasks.workunit.client.1.smithi193.stdout:1/141: unlink d1/d2b/d10/f24 0 2024-09-04T16:30:00.957 INFO:tasks.workunit.client.1.smithi193.stdout:2/52: chown d2/d9/db/d10/l11 243 1 2024-09-04T16:30:00.958 INFO:tasks.workunit.client.1.smithi193.stdout:6/75: rename d5/fc to d5/f19 0 2024-09-04T16:30:00.960 INFO:tasks.workunit.client.1.smithi193.stdout:4/48: write d3/fe [4013699,14441] 0 2024-09-04T16:30:00.963 INFO:tasks.workunit.client.1.smithi193.stdout:5/89: truncate d1/d8/fd 417689 0 2024-09-04T16:30:00.967 INFO:tasks.workunit.client.1.smithi193.stdout:1/142: mknod d1/d2b/d1b/d28/c32 0 2024-09-04T16:30:00.968 INFO:tasks.workunit.client.1.smithi193.stdout:2/53: mkdir d2/d15 0 2024-09-04T16:30:00.971 INFO:tasks.workunit.client.1.smithi193.stdout:8/84: write d2/f8 [4810001,8535] 0 2024-09-04T16:30:00.972 INFO:tasks.workunit.client.1.smithi193.stdout:8/85: write d2/f13 [293870,2310] 0 2024-09-04T16:30:00.974 INFO:tasks.workunit.client.1.smithi193.stdout:5/90: mknod d1/c17 0 2024-09-04T16:30:00.974 INFO:tasks.workunit.client.1.smithi193.stdout:0/100: write fb [1898380,81893] 0 2024-09-04T16:30:00.975 INFO:tasks.workunit.client.1.smithi193.stdout:5/91: chown d1/d8 0 1 2024-09-04T16:30:00.983 INFO:tasks.workunit.client.1.smithi193.stdout:2/54: rmdir d2/d9 39 2024-09-04T16:30:00.985 INFO:tasks.workunit.client.1.smithi193.stdout:0/101: creat d18/f24 x:0 0 0 2024-09-04T16:30:00.986 INFO:tasks.workunit.client.1.smithi193.stdout:6/76: truncate d5/f10 605037 0 2024-09-04T16:30:00.987 INFO:tasks.workunit.client.1.smithi193.stdout:1/143: truncate d1/d2b/f14 1640308 0 2024-09-04T16:30:00.987 INFO:tasks.workunit.client.1.smithi193.stdout:0/102: dread - d18/f20 zero size 2024-09-04T16:30:00.993 INFO:tasks.workunit.client.1.smithi193.stdout:3/84: dwrite d0/f3 [0,4194304] 0 2024-09-04T16:30:00.993 INFO:tasks.workunit.client.1.smithi193.stdout:8/86: dwrite d2/da/f16 [0,4194304] 0 2024-09-04T16:30:00.995 INFO:tasks.workunit.client.1.smithi193.stdout:4/49: dwrite f0 [0,4194304] 0 2024-09-04T16:30:01.003 INFO:tasks.workunit.client.1.smithi193.stdout:0/103: dwrite d18/f24 [0,4194304] 0 2024-09-04T16:30:01.005 INFO:tasks.workunit.client.1.smithi193.stdout:0/104: chown d18/f23 1757659650 1 2024-09-04T16:30:01.005 INFO:tasks.workunit.client.1.smithi193.stdout:7/87: sync 2024-09-04T16:30:01.006 INFO:tasks.workunit.client.1.smithi193.stdout:3/85: dwrite d0/f3 [0,4194304] 0 2024-09-04T16:30:01.007 INFO:tasks.workunit.client.1.smithi193.stdout:0/105: write f3 [2091943,86265] 0 2024-09-04T16:30:01.008 INFO:tasks.workunit.client.1.smithi193.stdout:3/86: read d0/d7/de/ff [730281,40206] 0 2024-09-04T16:30:01.072 INFO:tasks.workunit.client.1.smithi193.stdout:9/170: sync 2024-09-04T16:30:01.098 INFO:tasks.workunit.client.1.smithi193.stdout:6/77: symlink d5/de/l1a 0 2024-09-04T16:30:01.099 INFO:tasks.workunit.client.1.smithi193.stdout:1/144: mkdir d1/d2b/db/d33 0 2024-09-04T16:30:01.099 INFO:tasks.workunit.client.1.smithi193.stdout:7/88: sync 2024-09-04T16:30:01.102 INFO:tasks.workunit.client.1.smithi193.stdout:8/87: creat d2/da/f1d x:0 0 0 2024-09-04T16:30:01.103 INFO:tasks.workunit.client.1.smithi193.stdout:4/50: creat d3/f10 x:0 0 0 2024-09-04T16:30:01.103 INFO:tasks.workunit.client.1.smithi193.stdout:8/88: stat d2/da/c14 0 2024-09-04T16:30:01.109 INFO:tasks.workunit.client.1.smithi193.stdout:0/106: mkdir d18/d25 0 2024-09-04T16:30:01.109 INFO:tasks.workunit.client.1.smithi193.stdout:1/145: dwrite d1/d2b/d1b/d28/f29 [0,4194304] 0 2024-09-04T16:30:01.109 INFO:tasks.workunit.client.1.smithi193.stdout:3/87: mknod d0/d10/c1e 0 2024-09-04T16:30:01.109 INFO:tasks.workunit.client.1.smithi193.stdout:9/171: creat d2/d8/d25/f37 x:0 0 0 2024-09-04T16:30:01.110 INFO:tasks.workunit.client.1.smithi193.stdout:3/88: write d0/f3 [2118729,122927] 0 2024-09-04T16:30:01.111 INFO:tasks.workunit.client.1.smithi193.stdout:2/55: creat d2/d9/db/f16 x:0 0 0 2024-09-04T16:30:01.111 INFO:tasks.workunit.client.1.smithi193.stdout:5/92: mkdir d1/d8/db/d13/d18 0 2024-09-04T16:30:01.112 INFO:tasks.workunit.client.1.smithi193.stdout:2/56: chown d2/fc 1 1 2024-09-04T16:30:01.112 INFO:tasks.workunit.client.1.smithi193.stdout:5/93: fdatasync d1/f11 0 2024-09-04T16:30:01.115 INFO:tasks.workunit.client.1.smithi193.stdout:6/78: write d5/fb [164439,32517] 0 2024-09-04T16:30:01.119 INFO:tasks.workunit.client.1.smithi193.stdout:2/57: dwrite d2/fe [0,4194304] 0 2024-09-04T16:30:01.121 INFO:tasks.workunit.client.1.smithi193.stdout:4/51: creat d3/f11 x:0 0 0 2024-09-04T16:30:01.122 INFO:tasks.workunit.client.1.smithi193.stdout:8/89: rmdir d2/da 39 2024-09-04T16:30:01.123 INFO:tasks.workunit.client.1.smithi193.stdout:0/107: rmdir d18 39 2024-09-04T16:30:01.135 INFO:tasks.workunit.client.1.smithi193.stdout:4/52: rename d3/f11 to d3/f12 0 2024-09-04T16:30:01.138 INFO:tasks.workunit.client.1.smithi193.stdout:1/146: link d1/d2b/f2e d1/f34 0 2024-09-04T16:30:01.139 INFO:tasks.workunit.client.1.smithi193.stdout:9/172: symlink d2/d8/l38 0 2024-09-04T16:30:01.140 INFO:tasks.workunit.client.1.smithi193.stdout:3/89: mknod d0/d18/d1c/c1f 0 2024-09-04T16:30:01.144 INFO:tasks.workunit.client.1.smithi193.stdout:4/53: symlink d3/l13 0 2024-09-04T16:30:01.147 INFO:tasks.workunit.client.1.smithi193.stdout:3/90: rename d0/l17 to d0/l20 0 2024-09-04T16:30:01.150 INFO:tasks.workunit.client.1.smithi193.stdout:0/108: link d18/f24 d18/f26 0 2024-09-04T16:30:01.150 INFO:tasks.workunit.client.1.smithi193.stdout:6/79: getdents d5/de/d15 0 2024-09-04T16:30:01.153 INFO:tasks.workunit.client.1.smithi193.stdout:3/91: dread d0/d7/fc [0,4194304] 0 2024-09-04T16:30:01.154 INFO:tasks.workunit.client.1.smithi193.stdout:0/109: dread d18/f24 [0,4194304] 0 2024-09-04T16:30:01.154 INFO:tasks.workunit.client.1.smithi193.stdout:6/80: mkdir d5/de/d15/d1b 0 2024-09-04T16:30:01.155 INFO:tasks.workunit.client.1.smithi193.stdout:6/81: readlink d5/l9 0 2024-09-04T16:30:01.155 INFO:tasks.workunit.client.1.smithi193.stdout:6/82: chown d5/ff 497864 1 2024-09-04T16:30:01.157 INFO:tasks.workunit.client.1.smithi193.stdout:3/92: creat d0/d10/f21 x:0 0 0 2024-09-04T16:30:01.162 INFO:tasks.workunit.client.1.smithi193.stdout:3/93: readlink d0/d7/l14 0 2024-09-04T16:30:01.164 INFO:tasks.workunit.client.1.smithi193.stdout:3/94: dread d0/d10/f15 [0,4194304] 0 2024-09-04T16:30:01.164 INFO:tasks.workunit.client.1.smithi193.stdout:0/110: symlink d18/d25/l27 0 2024-09-04T16:30:01.165 INFO:tasks.workunit.client.1.smithi193.stdout:6/83: mknod d5/c1c 0 2024-09-04T16:30:01.167 INFO:tasks.workunit.client.1.smithi193.stdout:3/95: rmdir d0/d7 39 2024-09-04T16:30:01.168 INFO:tasks.workunit.client.1.smithi193.stdout:6/84: dread d5/f19 [0,4194304] 0 2024-09-04T16:30:01.169 INFO:tasks.workunit.client.1.smithi193.stdout:0/111: chown l7 126552270 1 2024-09-04T16:30:01.173 INFO:tasks.workunit.client.1.smithi193.stdout:3/96: dread d0/d7/fc [0,4194304] 0 2024-09-04T16:30:01.175 INFO:tasks.workunit.client.1.smithi193.stdout:6/85: dwrite f3 [0,4194304] 0 2024-09-04T16:30:01.176 INFO:tasks.workunit.client.1.smithi193.stdout:0/112: rename fe to d18/f28 0 2024-09-04T16:30:01.176 INFO:tasks.workunit.client.1.smithi193.stdout:0/113: fdatasync f17 0 2024-09-04T16:30:01.179 INFO:tasks.workunit.client.1.smithi193.stdout:3/97: creat d0/d7/de/f22 x:0 0 0 2024-09-04T16:30:01.181 INFO:tasks.workunit.client.1.smithi193.stdout:0/114: creat d18/d25/f29 x:0 0 0 2024-09-04T16:30:01.184 INFO:tasks.workunit.client.1.smithi193.stdout:3/98: unlink d0/d10/f21 0 2024-09-04T16:30:01.189 INFO:tasks.workunit.client.1.smithi193.stdout:6/86: creat d5/f1d x:0 0 0 2024-09-04T16:30:01.191 INFO:tasks.workunit.client.1.smithi193.stdout:3/99: dwrite d0/f4 [4194304,4194304] 0 2024-09-04T16:30:01.195 INFO:tasks.workunit.client.1.smithi193.stdout:3/100: write d0/fa [4525459,72957] 0 2024-09-04T16:30:01.195 INFO:tasks.workunit.client.1.smithi193.stdout:0/115: dwrite d18/f24 [0,4194304] 0 2024-09-04T16:30:01.196 INFO:tasks.workunit.client.1.smithi193.stdout:6/87: creat d5/de/d15/d1b/f1e x:0 0 0 2024-09-04T16:30:01.200 INFO:tasks.workunit.client.1.smithi193.stdout:9/173: sync 2024-09-04T16:30:01.201 INFO:tasks.workunit.client.1.smithi193.stdout:9/174: chown d2/c1a 325908 1 2024-09-04T16:30:01.201 INFO:tasks.workunit.client.1.smithi193.stdout:0/116: creat d18/d25/f2a x:0 0 0 2024-09-04T16:30:01.202 INFO:tasks.workunit.client.1.smithi193.stdout:0/117: chown d18/f23 2 1 2024-09-04T16:30:01.205 INFO:tasks.workunit.client.1.smithi193.stdout:0/118: symlink d18/d25/l2b 0 2024-09-04T16:30:01.207 INFO:tasks.workunit.client.1.smithi193.stdout:6/88: rename d5/f14 to d5/f1f 0 2024-09-04T16:30:01.211 INFO:tasks.workunit.client.1.smithi193.stdout:9/175: rename d2/d8/d15/c2b to d2/d8/c39 0 2024-09-04T16:30:01.213 INFO:tasks.workunit.client.1.smithi193.stdout:9/176: creat d2/d4/f3a x:0 0 0 2024-09-04T16:30:01.214 INFO:tasks.workunit.client.1.smithi193.stdout:3/101: fdatasync d0/f4 0 2024-09-04T16:30:01.214 INFO:tasks.workunit.client.1.smithi193.stdout:6/89: dwrite d5/de/f18 [0,4194304] 0 2024-09-04T16:30:01.215 INFO:tasks.workunit.client.1.smithi193.stdout:6/90: dread - d5/de/f17 zero size 2024-09-04T16:30:01.216 INFO:tasks.workunit.client.1.smithi193.stdout:6/91: dread - d5/de/d15/d1b/f1e zero size 2024-09-04T16:30:01.216 INFO:tasks.workunit.client.1.smithi193.stdout:3/102: mknod d0/d18/d1c/c23 0 2024-09-04T16:30:01.222 INFO:tasks.workunit.client.1.smithi193.stdout:6/92: dread d5/f6 [0,4194304] 0 2024-09-04T16:30:01.223 INFO:tasks.workunit.client.1.smithi193.stdout:9/177: getdents d2/d18/d2f/d22/d30 0 2024-09-04T16:30:01.224 INFO:tasks.workunit.client.1.smithi193.stdout:6/93: dread - d5/de/f17 zero size 2024-09-04T16:30:01.224 INFO:tasks.workunit.client.1.smithi193.stdout:6/94: chown d5/de/f18 55364211 1 2024-09-04T16:30:01.225 INFO:tasks.workunit.client.1.smithi193.stdout:3/103: dread d0/d7/de/ff [0,4194304] 0 2024-09-04T16:30:01.228 INFO:tasks.workunit.client.1.smithi193.stdout:3/104: mkdir d0/d10/d24 0 2024-09-04T16:30:01.230 INFO:tasks.workunit.client.1.smithi193.stdout:3/105: fsync d0/d10/f1a 0 2024-09-04T16:30:01.230 INFO:tasks.workunit.client.1.smithi193.stdout:9/178: link d2/d4/l11 d2/d18/l3b 0 2024-09-04T16:30:01.231 INFO:tasks.workunit.client.1.smithi193.stdout:3/106: chown d0/d7/de 1567 1 2024-09-04T16:30:01.232 INFO:tasks.workunit.client.1.smithi193.stdout:3/107: readlink d0/d7/l14 0 2024-09-04T16:30:01.232 INFO:tasks.workunit.client.1.smithi193.stdout:6/95: dwrite d5/f11 [0,4194304] 0 2024-09-04T16:30:01.233 INFO:tasks.workunit.client.1.smithi193.stdout:3/108: write d0/f3 [566616,57581] 0 2024-09-04T16:30:01.236 INFO:tasks.workunit.client.1.smithi193.stdout:3/109: dread d0/d7/fc [0,4194304] 0 2024-09-04T16:30:01.243 INFO:tasks.workunit.client.1.smithi193.stdout:3/110: getdents d0/d18/d1b 0 2024-09-04T16:30:01.244 INFO:tasks.workunit.client.1.smithi193.stdout:7/89: dwrite f6 [0,4194304] 0 2024-09-04T16:30:01.249 INFO:tasks.workunit.client.1.smithi193.stdout:3/111: mkdir d0/d18/d1c/d25 0 2024-09-04T16:30:01.250 INFO:tasks.workunit.client.1.smithi193.stdout:3/112: chown d0/d7 478064 1 2024-09-04T16:30:01.252 INFO:tasks.workunit.client.1.smithi193.stdout:8/90: dwrite d2/f3 [0,4194304] 0 2024-09-04T16:30:01.254 INFO:tasks.workunit.client.1.smithi193.stdout:2/58: truncate d2/d9/db/d10/f12 515013 0 2024-09-04T16:30:01.254 INFO:tasks.workunit.client.1.smithi193.stdout:1/147: chown d1/d2b/db/c18 22 1 2024-09-04T16:30:01.257 INFO:tasks.workunit.client.1.smithi193.stdout:7/90: dwrite d9/de/f1a [0,4194304] 0 2024-09-04T16:30:01.257 INFO:tasks.workunit.client.1.smithi193.stdout:4/54: getdents d3 0 2024-09-04T16:30:01.258 INFO:tasks.workunit.client.1.smithi193.stdout:4/55: readlink d3/l13 0 2024-09-04T16:30:01.258 INFO:tasks.workunit.client.1.smithi193.stdout:7/91: write d9/de/f1a [2779419,43109] 0 2024-09-04T16:30:01.262 INFO:tasks.workunit.client.1.smithi193.stdout:8/91: mkdir d2/da/d1e 0 2024-09-04T16:30:01.275 INFO:tasks.workunit.client.1.smithi193.stdout:2/59: fdatasync d2/d9/db/d10/f12 0 2024-09-04T16:30:01.276 INFO:tasks.workunit.client.1.smithi193.stdout:2/60: chown d2/d14 424730 1 2024-09-04T16:30:01.276 INFO:tasks.workunit.client.1.smithi193.stdout:2/61: chown d2/d14 1 1 2024-09-04T16:30:01.276 INFO:tasks.workunit.client.1.smithi193.stdout:2/62: fsync d2/fc 0 2024-09-04T16:30:01.279 INFO:tasks.workunit.client.1.smithi193.stdout:4/56: link d3/fe d3/f14 0 2024-09-04T16:30:01.286 INFO:tasks.workunit.client.1.smithi193.stdout:4/57: mknod d3/c15 0 2024-09-04T16:30:01.292 INFO:tasks.workunit.client.1.smithi193.stdout:4/58: creat d3/f16 x:0 0 0 2024-09-04T16:30:01.295 INFO:tasks.workunit.client.1.smithi193.stdout:2/63: creat d2/f17 x:0 0 0 2024-09-04T16:30:01.296 INFO:tasks.workunit.client.1.smithi193.stdout:3/113: truncate d0/f4 7462236 0 2024-09-04T16:30:01.297 INFO:tasks.workunit.client.1.smithi193.stdout:4/59: dwrite f0 [0,4194304] 0 2024-09-04T16:30:01.299 INFO:tasks.workunit.client.1.smithi193.stdout:3/114: unlink d0/d10/f15 0 2024-09-04T16:30:01.300 INFO:tasks.workunit.client.1.smithi193.stdout:2/64: mkdir d2/d9/d18 0 2024-09-04T16:30:01.302 INFO:tasks.workunit.client.1.smithi193.stdout:6/96: getdents d5 0 2024-09-04T16:30:01.305 INFO:tasks.workunit.client.1.smithi193.stdout:4/60: write d3/fe [1867194,122181] 0 2024-09-04T16:30:01.307 INFO:tasks.workunit.client.1.smithi193.stdout:4/61: chown d3/f12 1910654314 1 2024-09-04T16:30:01.308 INFO:tasks.workunit.client.1.smithi193.stdout:6/97: creat d5/f20 x:0 0 0 2024-09-04T16:30:01.309 INFO:tasks.workunit.client.1.smithi193.stdout:2/65: dwrite d2/d9/db/fd [0,4194304] 0 2024-09-04T16:30:01.312 INFO:tasks.workunit.client.1.smithi193.stdout:5/94: write d1/d8/fd [1037051,57358] 0 2024-09-04T16:30:01.314 INFO:tasks.workunit.client.1.smithi193.stdout:3/115: link d0/d10/c1e d0/d10/c26 0 2024-09-04T16:30:01.316 INFO:tasks.workunit.client.1.smithi193.stdout:5/95: write d1/f16 [842679,90226] 0 2024-09-04T16:30:01.320 INFO:tasks.workunit.client.1.smithi193.stdout:5/96: fdatasync d1/f3 0 2024-09-04T16:30:01.320 INFO:tasks.workunit.client.1.smithi193.stdout:3/116: creat d0/d18/f27 x:0 0 0 2024-09-04T16:30:01.323 INFO:tasks.workunit.client.1.smithi193.stdout:8/92: rename d2/da to d2/d1f 0 2024-09-04T16:30:01.323 INFO:tasks.workunit.client.1.smithi193.stdout:4/62: dwrite d3/f10 [0,4194304] 0 2024-09-04T16:30:01.324 INFO:tasks.workunit.client.1.smithi193.stdout:6/98: dread f3 [0,4194304] 0 2024-09-04T16:30:01.325 INFO:tasks.workunit.client.1.smithi193.stdout:8/93: readlink d2/d1f/l15 0 2024-09-04T16:30:01.325 INFO:tasks.workunit.client.1.smithi193.stdout:4/63: rename d3 to d3/d17 22 2024-09-04T16:30:01.326 INFO:tasks.workunit.client.1.smithi193.stdout:5/97: creat d1/d8/f19 x:0 0 0 2024-09-04T16:30:01.327 INFO:tasks.workunit.client.1.smithi193.stdout:9/179: dwrite d2/d8/fe [0,4194304] 0 2024-09-04T16:30:01.328 INFO:tasks.workunit.client.1.smithi193.stdout:1/148: truncate d1/d2b/d10/f1f 3305492 0 2024-09-04T16:30:01.329 INFO:tasks.workunit.client.1.smithi193.stdout:5/98: write d1/f16 [1932668,26812] 0 2024-09-04T16:30:01.329 INFO:tasks.workunit.client.1.smithi193.stdout:4/64: write d3/fd [918301,33913] 0 2024-09-04T16:30:01.331 INFO:tasks.workunit.client.1.smithi193.stdout:4/65: chown d3/l13 8564 1 2024-09-04T16:30:01.333 INFO:tasks.workunit.client.1.smithi193.stdout:7/92: truncate d9/de/f1a 2178162 0 2024-09-04T16:30:01.335 INFO:tasks.workunit.client.1.smithi193.stdout:9/180: dread d2/d4/f23 [0,4194304] 0 2024-09-04T16:30:01.338 INFO:tasks.workunit.client.1.smithi193.stdout:9/181: chown d2/f28 852 1 2024-09-04T16:30:01.338 INFO:tasks.workunit.client.1.smithi193.stdout:8/94: mkdir d2/d20 0 2024-09-04T16:30:01.340 INFO:tasks.workunit.client.1.smithi193.stdout:1/149: creat d1/d2b/d1b/d28/f35 x:0 0 0 2024-09-04T16:30:01.341 INFO:tasks.workunit.client.1.smithi193.stdout:6/99: dwrite d5/fd [0,4194304] 0 2024-09-04T16:30:01.343 INFO:tasks.workunit.client.1.smithi193.stdout:4/66: dwrite d3/ff [0,4194304] 0 2024-09-04T16:30:01.343 INFO:tasks.workunit.client.1.smithi193.stdout:3/117: link d0/d18/d1c/c1f d0/d7/de/c28 0 2024-09-04T16:30:01.346 INFO:tasks.workunit.client.1.smithi193.stdout:0/119: write d18/f28 [161668,36431] 0 2024-09-04T16:30:01.347 INFO:tasks.workunit.client.1.smithi193.stdout:5/99: creat d1/d8/db/f1a x:0 0 0 2024-09-04T16:30:01.347 INFO:tasks.workunit.client.1.smithi193.stdout:0/120: chown d18/f23 33834284 1 2024-09-04T16:30:01.348 INFO:tasks.workunit.client.1.smithi193.stdout:7/93: symlink d9/d11/l21 0 2024-09-04T16:30:01.348 INFO:tasks.workunit.client.1.smithi193.stdout:5/100: fdatasync d1/f3 0 2024-09-04T16:30:01.352 INFO:tasks.workunit.client.1.smithi193.stdout:8/95: rmdir d2 39 2024-09-04T16:30:01.354 INFO:tasks.workunit.client.1.smithi193.stdout:9/182: dwrite d2/d8/f26 [0,4194304] 0 2024-09-04T16:30:01.356 INFO:tasks.workunit.client.1.smithi193.stdout:1/150: symlink d1/d2b/d10/d2a/l36 0 2024-09-04T16:30:01.358 INFO:tasks.workunit.client.1.smithi193.stdout:9/183: write d2/d8/d15/f16 [127373,129675] 0 2024-09-04T16:30:01.360 INFO:tasks.workunit.client.1.smithi193.stdout:0/121: dwrite d18/f20 [0,4194304] 0 2024-09-04T16:30:01.360 INFO:tasks.workunit.client.1.smithi193.stdout:4/67: creat d3/f18 x:0 0 0 2024-09-04T16:30:01.361 INFO:tasks.workunit.client.1.smithi193.stdout:3/118: mknod d0/d10/c29 0 2024-09-04T16:30:01.362 INFO:tasks.workunit.client.1.smithi193.stdout:4/68: readlink d3/l13 0 2024-09-04T16:30:01.364 INFO:tasks.workunit.client.1.smithi193.stdout:7/94: mkdir d9/d18/d22 0 2024-09-04T16:30:01.368 INFO:tasks.workunit.client.1.smithi193.stdout:7/95: read d9/fa [921545,32915] 0 2024-09-04T16:30:01.371 INFO:tasks.workunit.client.1.smithi193.stdout:9/184: dread d2/d4/f7 [0,4194304] 0 2024-09-04T16:30:01.371 INFO:tasks.workunit.client.1.smithi193.stdout:1/151: dwrite d1/d2b/f31 [0,4194304] 0 2024-09-04T16:30:01.371 INFO:tasks.workunit.client.1.smithi193.stdout:6/100: write d5/f1f [698511,69062] 0 2024-09-04T16:30:01.373 INFO:tasks.workunit.client.1.smithi193.stdout:0/122: dread d18/f1a [0,4194304] 0 2024-09-04T16:30:01.374 INFO:tasks.workunit.client.1.smithi193.stdout:9/185: rename d2/d18/d2f/d22 to d2/d18/d2f/d22/d3c 22 2024-09-04T16:30:01.375 INFO:tasks.workunit.client.1.smithi193.stdout:4/69: creat d3/f19 x:0 0 0 2024-09-04T16:30:01.376 INFO:tasks.workunit.client.1.smithi193.stdout:9/186: write d2/d8/d15/f31 [478230,118489] 0 2024-09-04T16:30:01.378 INFO:tasks.workunit.client.1.smithi193.stdout:9/187: write d2/d4/fd [1317914,54353] 0 2024-09-04T16:30:01.379 INFO:tasks.workunit.client.1.smithi193.stdout:9/188: truncate d2/f1c 4750839 0 2024-09-04T16:30:01.379 INFO:tasks.workunit.client.1.smithi193.stdout:7/96: stat d9/f19 0 2024-09-04T16:30:01.380 INFO:tasks.workunit.client.1.smithi193.stdout:7/97: fsync d9/de/f1c 0 2024-09-04T16:30:01.385 INFO:tasks.workunit.client.1.smithi193.stdout:6/101: write f3 [349554,40203] 0 2024-09-04T16:30:01.386 INFO:tasks.workunit.client.1.smithi193.stdout:9/189: dwrite d2/f28 [0,4194304] 0 2024-09-04T16:30:01.387 INFO:tasks.workunit.client.1.smithi193.stdout:0/123: mknod d18/c2c 0 2024-09-04T16:30:01.388 INFO:tasks.workunit.client.1.smithi193.stdout:9/190: chown d2/d18/d2f/d22/c27 23917 1 2024-09-04T16:30:01.389 INFO:tasks.workunit.client.1.smithi193.stdout:9/191: read d2/d4/f17 [3937483,95937] 0 2024-09-04T16:30:01.391 INFO:tasks.workunit.client.1.smithi193.stdout:5/101: link d1/c17 d1/d8/db/c1b 0 2024-09-04T16:30:01.391 INFO:tasks.workunit.client.1.smithi193.stdout:5/102: fsync d1/f3 0 2024-09-04T16:30:01.393 INFO:tasks.workunit.client.1.smithi193.stdout:8/96: creat d2/d1f/d1b/f21 x:0 0 0 2024-09-04T16:30:01.396 INFO:tasks.workunit.client.1.smithi193.stdout:6/102: unlink d5/fd 0 2024-09-04T16:30:01.396 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:01 smithi170 ceph-mon[29272]: pgmap v20: 65 pgs: 65 active+clean; 271 MiB data, 927 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s rd, 15 MiB/s wr, 308 op/s 2024-09-04T16:30:01.397 INFO:tasks.workunit.client.1.smithi193.stdout:0/124: symlink d18/l2d 0 2024-09-04T16:30:01.398 INFO:tasks.workunit.client.1.smithi193.stdout:5/103: dwrite d1/d8/fd [0,4194304] 0 2024-09-04T16:30:01.400 INFO:tasks.workunit.client.1.smithi193.stdout:5/104: read d1/f16 [96718,41117] 0 2024-09-04T16:30:01.401 INFO:tasks.workunit.client.1.smithi193.stdout:5/105: write d1/f16 [2435740,79085] 0 2024-09-04T16:30:01.403 INFO:tasks.workunit.client.1.smithi193.stdout:1/152: rename d1/d2b/d10/l11 to d1/d2b/d10/l37 0 2024-09-04T16:30:01.410 INFO:tasks.workunit.client.1.smithi193.stdout:6/103: dread d5/fb [0,4194304] 0 2024-09-04T16:30:01.410 INFO:tasks.workunit.client.1.smithi193.stdout:0/125: mknod d18/d25/c2e 0 2024-09-04T16:30:01.410 INFO:tasks.workunit.client.1.smithi193.stdout:3/119: write d0/d7/de/ff [894216,14783] 0 2024-09-04T16:30:01.411 INFO:tasks.workunit.client.1.smithi193.stdout:0/126: stat d18/c1f 0 2024-09-04T16:30:01.411 INFO:tasks.workunit.client.1.smithi193.stdout:0/127: write f17 [845703,71364] 0 2024-09-04T16:30:01.415 INFO:tasks.workunit.client.1.smithi193.stdout:5/106: mknod d1/d8/db/d13/c1c 0 2024-09-04T16:30:01.419 INFO:tasks.workunit.client.1.smithi193.stdout:8/97: mknod d2/d20/c22 0 2024-09-04T16:30:01.419 INFO:tasks.workunit.client.1.smithi193.stdout:6/104: readlink d5/l9 0 2024-09-04T16:30:01.421 INFO:tasks.workunit.client.1.smithi193.stdout:0/128: symlink d18/l2f 0 2024-09-04T16:30:01.424 INFO:tasks.workunit.client.1.smithi193.stdout:4/70: dwrite d3/f9 [4194304,4194304] 0 2024-09-04T16:30:01.426 INFO:tasks.workunit.client.1.smithi193.stdout:5/107: fsync d1/f16 0 2024-09-04T16:30:01.428 INFO:tasks.workunit.client.1.smithi193.stdout:7/98: getdents d9 0 2024-09-04T16:30:01.431 INFO:tasks.workunit.client.1.smithi193.stdout:3/120: rename d0/f4 to d0/d7/de/f2a 0 2024-09-04T16:30:01.432 INFO:tasks.workunit.client.1.smithi193.stdout:0/129: mknod d18/d25/c30 0 2024-09-04T16:30:01.435 INFO:tasks.workunit.client.1.smithi193.stdout:4/71: mkdir d3/d1a 0 2024-09-04T16:30:01.437 INFO:tasks.workunit.client.1.smithi193.stdout:1/153: creat d1/d2b/f38 x:0 0 0 2024-09-04T16:30:01.439 INFO:tasks.workunit.client.1.smithi193.stdout:4/72: dread d3/f6 [0,4194304] 0 2024-09-04T16:30:01.440 INFO:tasks.workunit.client.1.smithi193.stdout:4/73: dread - d3/fc zero size 2024-09-04T16:30:01.443 INFO:tasks.workunit.client.1.smithi193.stdout:7/99: creat d9/de/f23 x:0 0 0 2024-09-04T16:30:01.444 INFO:tasks.workunit.client.1.smithi193.stdout:6/105: unlink d5/de/l1a 0 2024-09-04T16:30:01.446 INFO:tasks.workunit.client.1.smithi193.stdout:0/130: write d18/f1a [289759,102357] 0 2024-09-04T16:30:01.450 INFO:tasks.workunit.client.1.smithi193.stdout:8/98: rmdir d2/d1f/d1e 0 2024-09-04T16:30:01.451 INFO:tasks.workunit.client.1.smithi193.stdout:5/108: link d1/f16 d1/d8/db/d13/f1d 0 2024-09-04T16:30:01.452 INFO:tasks.workunit.client.1.smithi193.stdout:5/109: readlink d1/l10 0 2024-09-04T16:30:01.454 INFO:tasks.workunit.client.1.smithi193.stdout:4/74: rename d3/f19 to d3/d1a/f1b 0 2024-09-04T16:30:01.454 INFO:tasks.workunit.client.1.smithi193.stdout:4/75: readlink d3/l13 0 2024-09-04T16:30:01.455 INFO:tasks.workunit.client.1.smithi193.stdout:7/100: symlink d9/d11/l24 0 2024-09-04T16:30:01.457 INFO:tasks.workunit.client.1.smithi193.stdout:6/106: rmdir d5/de/d15/d1b 39 2024-09-04T16:30:01.457 INFO:tasks.workunit.client.1.smithi193.stdout:4/76: write d3/f16 [3654,88065] 0 2024-09-04T16:30:01.459 INFO:tasks.workunit.client.1.smithi193.stdout:3/121: unlink d0/d18/d1c/c1f 0 2024-09-04T16:30:01.460 INFO:tasks.workunit.client.1.smithi193.stdout:0/131: symlink d18/l31 0 2024-09-04T16:30:01.460 INFO:tasks.workunit.client.1.smithi193.stdout:0/132: chown d18/f21 0 1 2024-09-04T16:30:01.462 INFO:tasks.workunit.client.1.smithi193.stdout:1/154: mkdir d1/d39 0 2024-09-04T16:30:01.462 INFO:tasks.workunit.client.1.smithi193.stdout:5/110: mkdir d1/d8/db/d13/d1e 0 2024-09-04T16:30:01.463 INFO:tasks.workunit.client.1.smithi193.stdout:5/111: truncate d1/d8/db/f1a 222654 0 2024-09-04T16:30:01.465 INFO:tasks.workunit.client.1.smithi193.stdout:7/101: mknod d9/d18/c25 0 2024-09-04T16:30:01.466 INFO:tasks.workunit.client.1.smithi193.stdout:4/77: creat d3/f1c x:0 0 0 2024-09-04T16:30:01.466 INFO:tasks.workunit.client.1.smithi193.stdout:3/122: creat d0/d18/f2b x:0 0 0 2024-09-04T16:30:01.468 INFO:tasks.workunit.client.1.smithi193.stdout:0/133: unlink d18/f26 0 2024-09-04T16:30:01.471 INFO:tasks.workunit.client.1.smithi193.stdout:5/112: write d1/d8/db/d13/f1d [71973,20984] 0 2024-09-04T16:30:01.472 INFO:tasks.workunit.client.1.smithi193.stdout:7/102: unlink d9/lb 0 2024-09-04T16:30:01.473 INFO:tasks.workunit.client.1.smithi193.stdout:6/107: dwrite d5/de/d15/d1b/f1e [0,4194304] 0 2024-09-04T16:30:01.473 INFO:tasks.workunit.client.1.smithi193.stdout:4/78: rmdir d3 39 2024-09-04T16:30:01.476 INFO:tasks.workunit.client.1.smithi193.stdout:0/134: dwrite d18/f21 [0,4194304] 0 2024-09-04T16:30:01.476 INFO:tasks.workunit.client.1.smithi193.stdout:8/99: rename d2/d1f to d2/d20/d23 0 2024-09-04T16:30:01.477 INFO:tasks.workunit.client.1.smithi193.stdout:0/135: write d18/f20 [2871670,125520] 0 2024-09-04T16:30:01.478 INFO:tasks.workunit.client.1.smithi193.stdout:3/123: creat d0/d9/f2c x:0 0 0 2024-09-04T16:30:01.478 INFO:tasks.workunit.client.1.smithi193.stdout:0/136: write fb [185102,36172] 0 2024-09-04T16:30:01.490 INFO:tasks.workunit.client.1.smithi193.stdout:4/79: dread d3/ff [0,4194304] 0 2024-09-04T16:30:01.491 INFO:tasks.workunit.client.1.smithi193.stdout:7/103: creat d9/d18/d1e/f26 x:0 0 0 2024-09-04T16:30:01.493 INFO:tasks.workunit.client.1.smithi193.stdout:2/66: sync 2024-09-04T16:30:01.496 INFO:tasks.workunit.client.1.smithi193.stdout:8/100: mkdir d2/d20/d23/d24 0 2024-09-04T16:30:01.497 INFO:tasks.workunit.client.1.smithi193.stdout:0/137: mkdir d18/d25/d32 0 2024-09-04T16:30:01.497 INFO:tasks.workunit.client.1.smithi193.stdout:8/101: write d2/d20/d23/f1d [105368,12822] 0 2024-09-04T16:30:01.499 INFO:tasks.workunit.client.1.smithi193.stdout:1/155: symlink d1/d2b/db/d26/l3a 0 2024-09-04T16:30:01.499 INFO:tasks.workunit.client.1.smithi193.stdout:1/156: dread - d1/d2b/f38 zero size 2024-09-04T16:30:01.505 INFO:tasks.workunit.client.1.smithi193.stdout:6/108: mknod d5/c21 0 2024-09-04T16:30:01.505 INFO:tasks.workunit.client.1.smithi193.stdout:6/109: fsync f3 0 2024-09-04T16:30:01.506 INFO:tasks.workunit.client.1.smithi193.stdout:4/80: rmdir d3/d1a 39 2024-09-04T16:30:01.506 INFO:tasks.workunit.client.1.smithi193.stdout:4/81: dread - d3/f1c zero size 2024-09-04T16:30:01.509 INFO:tasks.workunit.client.1.smithi193.stdout:7/104: mkdir d9/de/d27 0 2024-09-04T16:30:01.512 INFO:tasks.workunit.client.1.smithi193.stdout:3/124: creat d0/d18/d1b/f2d x:0 0 0 2024-09-04T16:30:01.513 INFO:tasks.workunit.client.1.smithi193.stdout:0/138: symlink d18/d25/l33 0 2024-09-04T16:30:01.513 INFO:tasks.workunit.client.1.smithi193.stdout:0/139: stat ca 0 2024-09-04T16:30:01.522 INFO:tasks.workunit.client.1.smithi193.stdout:4/82: dread d3/f6 [0,4194304] 0 2024-09-04T16:30:01.522 INFO:tasks.workunit.client.1.smithi193.stdout:2/67: symlink d2/d9/d18/l19 0 2024-09-04T16:30:01.525 INFO:tasks.workunit.client.1.smithi193.stdout:1/157: write d1/d2b/f2e [911162,59705] 0 2024-09-04T16:30:01.526 INFO:tasks.workunit.client.1.smithi193.stdout:8/102: mkdir d2/d20/d23/d24/d25 0 2024-09-04T16:30:01.527 INFO:tasks.workunit.client.1.smithi193.stdout:5/113: getdents d1 0 2024-09-04T16:30:01.529 INFO:tasks.workunit.client.1.smithi193.stdout:6/110: symlink d5/l22 0 2024-09-04T16:30:01.530 INFO:tasks.workunit.client.1.smithi193.stdout:6/111: write f3 [3394372,42204] 0 2024-09-04T16:30:01.532 INFO:tasks.workunit.client.1.smithi193.stdout:3/125: dread - d0/d7/de/f22 zero size 2024-09-04T16:30:01.533 INFO:tasks.workunit.client.1.smithi193.stdout:1/158: unlink d1/d2b/d1b/d28/f29 0 2024-09-04T16:30:01.533 INFO:tasks.workunit.client.1.smithi193.stdout:0/140: getdents d18/d25/d32 0 2024-09-04T16:30:01.534 INFO:tasks.workunit.client.1.smithi193.stdout:9/192: sync 2024-09-04T16:30:01.537 INFO:tasks.workunit.client.1.smithi193.stdout:4/83: rename d3/f7 to d3/d1a/f1d 0 2024-09-04T16:30:01.539 INFO:tasks.workunit.client.1.smithi193.stdout:1/159: dwrite d1/d2b/f31 [0,4194304] 0 2024-09-04T16:30:01.540 INFO:tasks.workunit.client.1.smithi193.stdout:3/126: rmdir d0/d7 39 2024-09-04T16:30:01.542 INFO:tasks.workunit.client.1.smithi193.stdout:5/114: symlink d1/d8/db/d13/d18/l1f 0 2024-09-04T16:30:01.543 INFO:tasks.workunit.client.1.smithi193.stdout:9/193: rmdir d2/d8 39 2024-09-04T16:30:01.545 INFO:tasks.workunit.client.1.smithi193.stdout:7/105: getdents d9/d18/d1e 0 2024-09-04T16:30:01.547 INFO:tasks.workunit.client.1.smithi193.stdout:6/112: rename d5 to d5/d23 22 2024-09-04T16:30:01.552 INFO:tasks.workunit.client.1.smithi193.stdout:2/68: getdents d2 0 2024-09-04T16:30:01.554 INFO:tasks.workunit.client.1.smithi193.stdout:7/106: truncate f8 314215 0 2024-09-04T16:30:01.557 INFO:tasks.workunit.client.1.smithi193.stdout:0/141: rename ld to d18/l34 0 2024-09-04T16:30:01.558 INFO:tasks.workunit.client.1.smithi193.stdout:6/113: truncate d5/fb 1147562 0 2024-09-04T16:30:01.559 INFO:tasks.workunit.client.1.smithi193.stdout:8/103: truncate f0 1805979 0 2024-09-04T16:30:01.561 INFO:tasks.workunit.client.1.smithi193.stdout:5/115: mknod d1/d8/db/d13/d1e/c20 0 2024-09-04T16:30:01.562 INFO:tasks.workunit.client.1.smithi193.stdout:4/84: creat d3/f1e x:0 0 0 2024-09-04T16:30:01.562 INFO:tasks.workunit.client.1.smithi193.stdout:7/107: dread f7 [0,4194304] 0 2024-09-04T16:30:01.564 INFO:tasks.workunit.client.1.smithi193.stdout:9/194: creat d2/f3d x:0 0 0 2024-09-04T16:30:01.566 INFO:tasks.workunit.client.1.smithi193.stdout:8/104: dwrite d2/d12/fe [0,4194304] 0 2024-09-04T16:30:01.567 INFO:tasks.workunit.client.1.smithi193.stdout:5/116: mkdir d1/d8/d21 0 2024-09-04T16:30:01.568 INFO:tasks.workunit.client.1.smithi193.stdout:0/142: mknod d18/d25/d32/c35 0 2024-09-04T16:30:01.570 INFO:tasks.workunit.client.1.smithi193.stdout:3/127: rename d0/d7/de/ff to d0/d10/d24/f2e 0 2024-09-04T16:30:01.571 INFO:tasks.workunit.client.1.smithi193.stdout:1/160: getdents d1/d2b/d1b 0 2024-09-04T16:30:01.571 INFO:tasks.workunit.client.1.smithi193.stdout:0/143: dread f3 [0,4194304] 0 2024-09-04T16:30:01.578 INFO:tasks.workunit.client.1.smithi193.stdout:8/105: symlink d2/d20/l26 0 2024-09-04T16:30:01.579 INFO:tasks.workunit.client.1.smithi193.stdout:8/106: write d2/f3 [1379796,78169] 0 2024-09-04T16:30:01.581 INFO:tasks.workunit.client.1.smithi193.stdout:5/117: creat d1/d8/f22 x:0 0 0 2024-09-04T16:30:01.586 INFO:tasks.workunit.client.1.smithi193.stdout:2/69: write d2/d9/db/d10/f12 [1296227,75085] 0 2024-09-04T16:30:01.587 INFO:tasks.workunit.client.1.smithi193.stdout:7/108: rename f7 to d9/de/d27/f28 0 2024-09-04T16:30:01.588 INFO:tasks.workunit.client.1.smithi193.stdout:3/128: mkdir d0/d10/d2f 0 2024-09-04T16:30:01.592 INFO:tasks.workunit.client.1.smithi193.stdout:6/114: creat d5/de/d15/f24 x:0 0 0 2024-09-04T16:30:01.596 INFO:tasks.workunit.client.1.smithi193.stdout:9/195: creat d2/d8/d25/f3e x:0 0 0 2024-09-04T16:30:01.597 INFO:tasks.workunit.client.1.smithi193.stdout:8/107: dread d2/f8 [0,4194304] 0 2024-09-04T16:30:01.599 INFO:tasks.workunit.client.1.smithi193.stdout:4/85: creat d3/f1f x:0 0 0 2024-09-04T16:30:01.601 INFO:tasks.workunit.client.1.smithi193.stdout:5/118: mkdir d1/d8/db/d23 0 2024-09-04T16:30:01.605 INFO:tasks.workunit.client.1.smithi193.stdout:7/109: creat d9/d18/d1e/f29 x:0 0 0 2024-09-04T16:30:01.606 INFO:tasks.workunit.client.1.smithi193.stdout:3/129: mkdir d0/d18/d1c/d30 0 2024-09-04T16:30:01.608 INFO:tasks.workunit.client.1.smithi193.stdout:3/130: dread d0/f3 [4194304,4194304] 0 2024-09-04T16:30:01.609 INFO:tasks.workunit.client.1.smithi193.stdout:9/196: mkdir d2/d18/d3f 0 2024-09-04T16:30:01.612 INFO:tasks.workunit.client.0.smithi170.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-04T16:30:01.612 INFO:tasks.workunit.client.1.smithi193.stdout:8/108: creat d2/d20/d23/f27 x:0 0 0 2024-09-04T16:30:01.614 INFO:tasks.workunit.client.1.smithi193.stdout:2/70: mknod d2/d15/c1a 0 2024-09-04T16:30:01.615 INFO:tasks.workunit.client.1.smithi193.stdout:7/110: creat d9/d18/f2a x:0 0 0 2024-09-04T16:30:01.617 INFO:tasks.workunit.client.0.smithi170.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-04T16:30:01.617 INFO:tasks.workunit.client.0.smithi170.stderr:+ make 2024-09-04T16:30:01.618 INFO:tasks.workunit.client.1.smithi193.stdout:8/109: creat d2/d20/d23/d1b/f28 x:0 0 0 2024-09-04T16:30:01.619 INFO:tasks.workunit.client.1.smithi193.stdout:2/71: dwrite d2/fc [0,4194304] 0 2024-09-04T16:30:01.619 INFO:tasks.workunit.client.1.smithi193.stdout:1/161: link d1/d2b/f2c d1/d2b/db/f3b 0 2024-09-04T16:30:01.620 INFO:tasks.workunit.client.1.smithi193.stdout:2/72: chown d2/f17 87 1 2024-09-04T16:30:01.621 INFO:tasks.workunit.client.1.smithi193.stdout:1/162: chown d1/d2b/d1b/d28/c32 4 1 2024-09-04T16:30:01.621 INFO:tasks.workunit.client.1.smithi193.stdout:2/73: chown d2/fe 1 1 2024-09-04T16:30:01.621 INFO:tasks.workunit.client.1.smithi193.stdout:6/115: link d5/de/d15/f24 d5/f25 0 2024-09-04T16:30:01.622 INFO:tasks.workunit.client.1.smithi193.stdout:3/131: link d0/d10/f1a d0/d9/f31 0 2024-09-04T16:30:01.625 INFO:tasks.workunit.client.1.smithi193.stdout:8/110: creat d2/d20/d23/f29 x:0 0 0 2024-09-04T16:30:01.628 INFO:tasks.workunit.client.1.smithi193.stdout:8/111: fdatasync d2/d20/d23/f29 0 2024-09-04T16:30:01.630 INFO:tasks.workunit.client.1.smithi193.stdout:9/197: rename d2/l2e to d2/d8/l40 0 2024-09-04T16:30:01.631 INFO:tasks.workunit.client.1.smithi193.stdout:1/163: dwrite d1/d2b/f38 [0,4194304] 0 2024-09-04T16:30:01.631 INFO:tasks.workunit.client.1.smithi193.stdout:4/86: getdents d3/d1a 0 2024-09-04T16:30:01.633 INFO:tasks.workunit.client.1.smithi193.stdout:3/132: dwrite d0/d9/f2c [0,4194304] 0 2024-09-04T16:30:01.634 INFO:tasks.workunit.client.1.smithi193.stdout:8/112: truncate d2/d20/d23/d1b/f21 743111 0 2024-09-04T16:30:01.634 INFO:tasks.workunit.client.1.smithi193.stdout:3/133: stat d0/d9 0 2024-09-04T16:30:01.635 INFO:tasks.workunit.client.1.smithi193.stdout:5/119: getdents d1/d8/db/d13/d18 0 2024-09-04T16:30:01.639 INFO:tasks.workunit.client.1.smithi193.stdout:9/198: dread d2/d4/fd [0,4194304] 0 2024-09-04T16:30:01.641 INFO:tasks.workunit.client.1.smithi193.stdout:2/74: mknod d2/d14/c1b 0 2024-09-04T16:30:01.642 INFO:tasks.workunit.client.1.smithi193.stdout:4/87: dwrite d3/fc [0,4194304] 0 2024-09-04T16:30:01.645 INFO:tasks.workunit.client.1.smithi193.stdout:4/88: dread d3/f16 [0,4194304] 0 2024-09-04T16:30:01.647 INFO:tasks.workunit.client.1.smithi193.stdout:1/164: readlink d1/d2b/l6 0 2024-09-04T16:30:01.647 INFO:tasks.workunit.client.1.smithi193.stdout:2/75: read d2/f7 [3644535,86124] 0 2024-09-04T16:30:01.649 INFO:tasks.workunit.client.1.smithi193.stdout:0/144: sync 2024-09-04T16:30:01.651 INFO:tasks.workunit.client.1.smithi193.stdout:6/116: creat d5/f26 x:0 0 0 2024-09-04T16:30:01.652 INFO:tasks.workunit.client.1.smithi193.stdout:0/145: dread f15 [0,4194304] 0 2024-09-04T16:30:01.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:01 smithi193 ceph-mon[36288]: pgmap v20: 65 pgs: 65 active+clean; 271 MiB data, 927 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s rd, 15 MiB/s wr, 308 op/s 2024-09-04T16:30:01.657 INFO:tasks.workunit.client.1.smithi193.stdout:3/134: fsync d0/d10/f1a 0 2024-09-04T16:30:01.659 INFO:tasks.workunit.client.1.smithi193.stdout:5/120: fdatasync d1/d8/fc 0 2024-09-04T16:30:01.660 INFO:tasks.workunit.client.1.smithi193.stdout:6/117: dwrite d5/de/d15/d1b/f1e [0,4194304] 0 2024-09-04T16:30:01.667 INFO:tasks.workunit.client.1.smithi193.stdout:7/111: write f8 [404705,103117] 0 2024-09-04T16:30:01.668 INFO:tasks.workunit.client.1.smithi193.stdout:8/113: mknod d2/c2a 0 2024-09-04T16:30:01.669 INFO:tasks.workunit.client.1.smithi193.stdout:7/112: readlink d9/l12 0 2024-09-04T16:30:01.671 INFO:tasks.workunit.client.1.smithi193.stdout:0/146: rename d18/d25/l33 to d18/d25/l36 0 2024-09-04T16:30:01.671 INFO:tasks.workunit.client.1.smithi193.stdout:7/113: fsync d9/f14 0 2024-09-04T16:30:01.673 INFO:tasks.workunit.client.1.smithi193.stdout:8/114: truncate d2/d12/f19 226614 0 2024-09-04T16:30:01.675 INFO:tasks.workunit.client.1.smithi193.stdout:4/89: dwrite d3/d1a/f1b [0,4194304] 0 2024-09-04T16:30:01.675 INFO:tasks.workunit.client.1.smithi193.stdout:9/199: link d2/d8/d15/f35 d2/d18/d2f/f41 0 2024-09-04T16:30:01.678 INFO:tasks.workunit.client.1.smithi193.stdout:3/135: mknod d0/d18/d1c/d30/c32 0 2024-09-04T16:30:01.680 INFO:tasks.workunit.client.0.smithi170.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-04T16:30:01.681 INFO:tasks.workunit.client.1.smithi193.stdout:6/118: dread d5/f11 [0,4194304] 0 2024-09-04T16:30:01.681 INFO:tasks.workunit.client.1.smithi193.stdout:5/121: getdents d1/d8/db/d15 0 2024-09-04T16:30:01.682 INFO:tasks.workunit.client.1.smithi193.stdout:4/90: mknod d3/d1a/c20 0 2024-09-04T16:30:01.683 INFO:tasks.workunit.client.1.smithi193.stdout:7/114: mkdir d9/d18/d22/d2b 0 2024-09-04T16:30:01.684 INFO:tasks.workunit.client.1.smithi193.stdout:3/136: creat d0/d18/d1c/d30/f33 x:0 0 0 2024-09-04T16:30:01.685 INFO:tasks.workunit.client.1.smithi193.stdout:5/122: symlink d1/d8/l24 0 2024-09-04T16:30:01.685 INFO:tasks.workunit.client.1.smithi193.stdout:8/115: dwrite d2/d20/d23/d1b/f21 [0,4194304] 0 2024-09-04T16:30:01.687 INFO:tasks.workunit.client.1.smithi193.stdout:1/165: getdents d1/d2b/d10/d2a 0 2024-09-04T16:30:01.690 INFO:tasks.workunit.client.1.smithi193.stdout:4/91: unlink d3/d1a/f1b 0 2024-09-04T16:30:01.691 INFO:tasks.workunit.client.1.smithi193.stdout:7/115: mknod d9/de/c2c 0 2024-09-04T16:30:01.694 INFO:tasks.workunit.client.1.smithi193.stdout:6/119: dwrite d5/de/d15/d1b/f1e [0,4194304] 0 2024-09-04T16:30:01.695 INFO:tasks.workunit.client.1.smithi193.stdout:9/200: rename d2/d8/fe to d2/f42 0 2024-09-04T16:30:01.696 INFO:tasks.workunit.client.1.smithi193.stdout:5/123: dwrite d1/d8/f12 [0,4194304] 0 2024-09-04T16:30:01.697 INFO:tasks.workunit.client.1.smithi193.stdout:0/147: getdents d18 0 2024-09-04T16:30:01.699 INFO:tasks.workunit.client.1.smithi193.stdout:8/116: symlink d2/d20/d23/l2b 0 2024-09-04T16:30:01.700 INFO:tasks.workunit.client.1.smithi193.stdout:6/120: truncate d5/de/f18 5053796 0 2024-09-04T16:30:01.700 INFO:tasks.workunit.client.1.smithi193.stdout:1/166: rmdir d1/d2b/db 39 2024-09-04T16:30:01.702 INFO:tasks.workunit.client.1.smithi193.stdout:5/124: write d1/d8/f12 [1975796,2892] 0 2024-09-04T16:30:01.702 INFO:tasks.workunit.client.1.smithi193.stdout:4/92: mkdir d3/d1a/d21 0 2024-09-04T16:30:01.704 INFO:tasks.workunit.client.1.smithi193.stdout:7/116: mknod d9/c2d 0 2024-09-04T16:30:01.705 INFO:tasks.workunit.client.1.smithi193.stdout:5/125: chown d1/d8/f12 154 1 2024-09-04T16:30:01.706 INFO:tasks.workunit.client.1.smithi193.stdout:9/201: dread d2/f1c [0,4194304] 0 2024-09-04T16:30:01.708 INFO:tasks.workunit.client.1.smithi193.stdout:0/148: dwrite f1 [0,4194304] 0 2024-09-04T16:30:01.710 INFO:tasks.workunit.client.1.smithi193.stdout:3/137: mknod d0/d7/de/c34 0 2024-09-04T16:30:01.715 INFO:tasks.workunit.client.1.smithi193.stdout:8/117: rmdir d2 39 2024-09-04T16:30:01.717 INFO:tasks.workunit.client.1.smithi193.stdout:4/93: rename d3/ff to d3/d1a/d21/f22 0 2024-09-04T16:30:01.718 INFO:tasks.workunit.client.1.smithi193.stdout:9/202: rmdir d2/d8 39 2024-09-04T16:30:01.719 INFO:tasks.workunit.client.1.smithi193.stdout:9/203: chown d2/d18/d2f/d22 20 1 2024-09-04T16:30:01.722 INFO:tasks.workunit.client.1.smithi193.stdout:6/121: fsync d5/f6 0 2024-09-04T16:30:01.723 INFO:tasks.workunit.client.1.smithi193.stdout:1/167: symlink d1/l3c 0 2024-09-04T16:30:01.724 INFO:tasks.workunit.client.1.smithi193.stdout:7/117: link d9/de/f1a d9/d18/d1e/f2e 0 2024-09-04T16:30:01.725 INFO:tasks.workunit.client.1.smithi193.stdout:1/168: chown d1/d2b/l6 2 1 2024-09-04T16:30:01.726 INFO:tasks.workunit.client.1.smithi193.stdout:8/118: symlink d2/d12/l2c 0 2024-09-04T16:30:01.727 INFO:tasks.workunit.client.1.smithi193.stdout:4/94: dwrite d3/fc [0,4194304] 0 2024-09-04T16:30:01.727 INFO:tasks.workunit.client.1.smithi193.stdout:3/138: rename d0/d7/de/c28 to d0/d9/c35 0 2024-09-04T16:30:01.728 INFO:tasks.workunit.client.1.smithi193.stdout:8/119: readlink d2/d20/d23/l2b 0 2024-09-04T16:30:01.728 INFO:tasks.workunit.client.1.smithi193.stdout:6/122: chown d5/f1d 4 1 2024-09-04T16:30:01.730 INFO:tasks.workunit.client.1.smithi193.stdout:6/123: fdatasync d5/f1f 0 2024-09-04T16:30:01.730 INFO:tasks.workunit.client.1.smithi193.stdout:1/169: fdatasync d1/d2b/f2c 0 2024-09-04T16:30:01.731 INFO:tasks.workunit.client.1.smithi193.stdout:8/120: dread d2/d20/d23/f1d [0,4194304] 0 2024-09-04T16:30:01.732 INFO:tasks.workunit.client.1.smithi193.stdout:7/118: mknod d9/d18/d22/d2b/c2f 0 2024-09-04T16:30:01.732 INFO:tasks.workunit.client.1.smithi193.stdout:1/170: fsync d1/f34 0 2024-09-04T16:30:01.733 INFO:tasks.workunit.client.1.smithi193.stdout:7/119: write f6 [3355257,104918] 0 2024-09-04T16:30:01.734 INFO:tasks.workunit.client.1.smithi193.stdout:3/139: creat d0/d18/d1b/f36 x:0 0 0 2024-09-04T16:30:01.735 INFO:tasks.workunit.client.1.smithi193.stdout:4/95: mknod d3/c23 0 2024-09-04T16:30:01.736 INFO:tasks.workunit.client.1.smithi193.stdout:6/124: rmdir d5 39 2024-09-04T16:30:01.739 INFO:tasks.workunit.client.1.smithi193.stdout:8/121: dwrite d2/d20/d23/d1b/f21 [0,4194304] 0 2024-09-04T16:30:01.740 INFO:tasks.workunit.client.1.smithi193.stdout:0/149: truncate f1 2017861 0 2024-09-04T16:30:01.741 INFO:tasks.workunit.client.1.smithi193.stdout:8/122: dread d2/d12/f19 [0,4194304] 0 2024-09-04T16:30:01.741 INFO:tasks.workunit.client.1.smithi193.stdout:0/150: fsync d18/f1a 0 2024-09-04T16:30:01.742 INFO:tasks.workunit.client.1.smithi193.stdout:8/123: truncate d2/f13 444643 0 2024-09-04T16:30:01.742 INFO:tasks.workunit.client.1.smithi193.stdout:0/151: chown d18/l2f 15405 1 2024-09-04T16:30:01.745 INFO:tasks.workunit.client.1.smithi193.stdout:1/171: mknod d1/d2b/d1b/c3d 0 2024-09-04T16:30:01.749 INFO:tasks.workunit.client.1.smithi193.stdout:9/204: link d2/d8/d25/c2c d2/d18/d2f/d22/c43 0 2024-09-04T16:30:01.749 INFO:tasks.workunit.client.1.smithi193.stdout:6/125: dread - d5/f25 zero size 2024-09-04T16:30:01.752 INFO:tasks.workunit.client.1.smithi193.stdout:8/124: creat d2/d20/f2d x:0 0 0 2024-09-04T16:30:01.752 INFO:tasks.workunit.client.1.smithi193.stdout:8/125: readlink d2/d20/d23/l1c 0 2024-09-04T16:30:01.753 INFO:tasks.workunit.client.1.smithi193.stdout:0/152: symlink d18/d25/l37 0 2024-09-04T16:30:01.757 INFO:tasks.workunit.client.1.smithi193.stdout:6/126: rmdir d5/de 39 2024-09-04T16:30:01.757 INFO:tasks.workunit.client.1.smithi193.stdout:2/76: sync 2024-09-04T16:30:01.758 INFO:tasks.workunit.client.1.smithi193.stdout:6/127: fsync d5/f20 0 2024-09-04T16:30:01.758 INFO:tasks.workunit.client.1.smithi193.stdout:0/153: chown d18/d25/l36 992 1 2024-09-04T16:30:01.759 INFO:tasks.workunit.client.1.smithi193.stdout:1/172: fsync d1/d2b/db/f3b 0 2024-09-04T16:30:01.759 INFO:tasks.workunit.client.1.smithi193.stdout:1/173: fsync d1/f34 0 2024-09-04T16:30:01.760 INFO:tasks.workunit.client.1.smithi193.stdout:4/96: link d3/f12 d3/f24 0 2024-09-04T16:30:01.760 INFO:tasks.workunit.client.1.smithi193.stdout:9/205: mknod d2/d8/c44 0 2024-09-04T16:30:01.761 INFO:tasks.workunit.client.1.smithi193.stdout:1/174: fsync d1/d2b/d10/f25 0 2024-09-04T16:30:01.761 INFO:tasks.workunit.client.1.smithi193.stdout:4/97: dread - d3/d1a/f1d zero size 2024-09-04T16:30:01.761 INFO:tasks.workunit.client.1.smithi193.stdout:6/128: dread - d5/ff zero size 2024-09-04T16:30:01.762 INFO:tasks.workunit.client.1.smithi193.stdout:3/140: getdents d0/d9 0 2024-09-04T16:30:01.762 INFO:tasks.workunit.client.1.smithi193.stdout:9/206: dread - d2/d18/d2f/f41 zero size 2024-09-04T16:30:01.764 INFO:tasks.workunit.client.1.smithi193.stdout:1/175: read d1/d2b/d10/f19 [3660888,125703] 0 2024-09-04T16:30:01.764 INFO:tasks.workunit.client.1.smithi193.stdout:8/126: rename d2/f13 to d2/f2e 0 2024-09-04T16:30:01.764 INFO:tasks.workunit.client.1.smithi193.stdout:4/98: truncate d3/f1e 129974 0 2024-09-04T16:30:01.765 INFO:tasks.workunit.client.1.smithi193.stdout:9/207: dread - d2/d18/d2f/f29 zero size 2024-09-04T16:30:01.774 INFO:tasks.workunit.client.1.smithi193.stdout:6/129: readlink d5/de/d15/l16 0 2024-09-04T16:30:01.775 INFO:tasks.workunit.client.1.smithi193.stdout:7/120: dwrite d9/de/d27/f28 [0,4194304] 0 2024-09-04T16:30:01.778 INFO:tasks.workunit.client.1.smithi193.stdout:0/154: rename d18/f24 to d18/f38 0 2024-09-04T16:30:01.781 INFO:tasks.workunit.client.1.smithi193.stdout:2/77: truncate d2/fe 1548886 0 2024-09-04T16:30:01.783 INFO:tasks.workunit.client.1.smithi193.stdout:3/141: rename d0/d10/d24/f2e to d0/d18/d1b/f37 0 2024-09-04T16:30:01.784 INFO:tasks.workunit.client.1.smithi193.stdout:5/126: sync 2024-09-04T16:30:01.784 INFO:tasks.workunit.client.1.smithi193.stdout:0/155: dwrite d18/f28 [0,4194304] 0 2024-09-04T16:30:01.785 INFO:tasks.workunit.client.1.smithi193.stdout:3/142: write d0/d9/f2c [4709463,28038] 0 2024-09-04T16:30:01.786 INFO:tasks.workunit.client.1.smithi193.stdout:4/99: creat d3/d1a/f25 x:0 0 0 2024-09-04T16:30:01.787 INFO:tasks.workunit.client.1.smithi193.stdout:4/100: chown d3/f12 278902557 1 2024-09-04T16:30:01.791 INFO:tasks.workunit.client.1.smithi193.stdout:9/208: creat d2/d18/d2f/f45 x:0 0 0 2024-09-04T16:30:01.796 INFO:tasks.workunit.client.1.smithi193.stdout:7/121: unlink d9/f14 0 2024-09-04T16:30:01.801 INFO:tasks.workunit.client.1.smithi193.stdout:0/156: symlink d18/l39 0 2024-09-04T16:30:01.801 INFO:tasks.workunit.client.1.smithi193.stdout:7/122: dread d9/de/d27/f28 [0,4194304] 0 2024-09-04T16:30:01.802 INFO:tasks.workunit.client.1.smithi193.stdout:7/123: truncate d9/d18/d1e/f26 717585 0 2024-09-04T16:30:01.802 INFO:tasks.workunit.client.1.smithi193.stdout:7/124: chown d9/d18 121178 1 2024-09-04T16:30:01.804 INFO:tasks.workunit.client.1.smithi193.stdout:3/143: creat d0/d10/f38 x:0 0 0 2024-09-04T16:30:01.807 INFO:tasks.workunit.client.1.smithi193.stdout:8/127: creat d2/d20/d23/d24/d25/f2f x:0 0 0 2024-09-04T16:30:01.811 INFO:tasks.workunit.client.1.smithi193.stdout:6/130: mkdir d5/d27 0 2024-09-04T16:30:01.817 INFO:tasks.workunit.client.1.smithi193.stdout:0/157: creat d18/f3a x:0 0 0 2024-09-04T16:30:01.819 INFO:tasks.workunit.client.1.smithi193.stdout:5/127: creat d1/d8/db/d23/f25 x:0 0 0 2024-09-04T16:30:01.820 INFO:tasks.workunit.client.1.smithi193.stdout:5/128: readlink d1/d8/db/d13/d18/l1f 0 2024-09-04T16:30:01.821 INFO:tasks.workunit.client.1.smithi193.stdout:7/125: creat d9/d18/d22/f30 x:0 0 0 2024-09-04T16:30:01.822 INFO:tasks.workunit.client.1.smithi193.stdout:5/129: write d1/d8/f19 [375461,93852] 0 2024-09-04T16:30:01.823 INFO:tasks.workunit.client.1.smithi193.stdout:5/130: fdatasync d1/d8/db/d13/f1d 0 2024-09-04T16:30:01.824 INFO:tasks.workunit.client.1.smithi193.stdout:1/176: dwrite d1/d2b/f14 [0,4194304] 0 2024-09-04T16:30:01.826 INFO:tasks.workunit.client.1.smithi193.stdout:8/128: rename d2/d20/d23/c14 to d2/d12/c30 0 2024-09-04T16:30:01.833 INFO:tasks.workunit.client.1.smithi193.stdout:0/158: unlink d18/l2f 0 2024-09-04T16:30:01.836 INFO:tasks.workunit.client.1.smithi193.stdout:3/144: mkdir d0/d18/d1c/d25/d39 0 2024-09-04T16:30:01.841 INFO:tasks.workunit.client.1.smithi193.stdout:5/131: creat d1/d8/db/d23/f26 x:0 0 0 2024-09-04T16:30:01.843 INFO:tasks.workunit.client.1.smithi193.stdout:1/177: write d1/d2b/d10/f22 [3578714,11197] 0 2024-09-04T16:30:01.845 INFO:tasks.workunit.client.1.smithi193.stdout:4/101: rename d3/c15 to d3/c26 0 2024-09-04T16:30:01.848 INFO:tasks.workunit.client.1.smithi193.stdout:7/126: rename d9/fa to d9/de/d27/f31 0 2024-09-04T16:30:01.849 INFO:tasks.workunit.client.1.smithi193.stdout:7/127: chown d9/ld 17365905 1 2024-09-04T16:30:01.849 INFO:tasks.workunit.client.1.smithi193.stdout:7/128: readlink l4 0 2024-09-04T16:30:01.853 INFO:tasks.workunit.client.1.smithi193.stdout:6/131: truncate d5/f7 1430086 0 2024-09-04T16:30:01.853 INFO:tasks.workunit.client.1.smithi193.stdout:6/132: write d5/ff [345174,71934] 0 2024-09-04T16:30:01.857 INFO:tasks.workunit.client.1.smithi193.stdout:0/159: rmdir d18 39 2024-09-04T16:30:01.858 INFO:tasks.workunit.client.1.smithi193.stdout:5/132: mknod d1/d8/db/d13/d18/c27 0 2024-09-04T16:30:01.860 INFO:tasks.workunit.client.1.smithi193.stdout:1/178: creat d1/d2b/db/f3e x:0 0 0 2024-09-04T16:30:01.862 INFO:tasks.workunit.client.1.smithi193.stdout:4/102: creat d3/d1a/d21/f27 x:0 0 0 2024-09-04T16:30:01.865 INFO:tasks.workunit.client.1.smithi193.stdout:7/129: mknod d9/c32 0 2024-09-04T16:30:01.865 INFO:tasks.workunit.client.1.smithi193.stdout:7/130: read - d9/d18/d22/f30 zero size 2024-09-04T16:30:01.866 INFO:tasks.workunit.client.1.smithi193.stdout:9/209: link d2/d18/d2f/c1e d2/d4/c46 0 2024-09-04T16:30:01.870 INFO:tasks.workunit.client.1.smithi193.stdout:0/160: readlink d18/l2d 0 2024-09-04T16:30:01.871 INFO:tasks.workunit.client.1.smithi193.stdout:5/133: creat d1/f28 x:0 0 0 2024-09-04T16:30:01.874 INFO:tasks.workunit.client.1.smithi193.stdout:7/131: rmdir d9/d18/d22/d2b 39 2024-09-04T16:30:01.875 INFO:tasks.workunit.client.1.smithi193.stdout:0/161: dwrite d18/f23 [0,4194304] 0 2024-09-04T16:30:01.877 INFO:tasks.workunit.client.1.smithi193.stdout:4/103: dread d3/d1a/d21/f22 [0,4194304] 0 2024-09-04T16:30:01.880 INFO:tasks.workunit.client.1.smithi193.stdout:2/78: truncate d2/fe 2449064 0 2024-09-04T16:30:01.882 INFO:tasks.workunit.client.1.smithi193.stdout:8/129: rename d2/d20/d23/f27 to d2/f31 0 2024-09-04T16:30:01.882 INFO:tasks.workunit.client.1.smithi193.stdout:0/162: dwrite d18/d25/f2a [0,4194304] 0 2024-09-04T16:30:01.883 INFO:tasks.workunit.client.1.smithi193.stdout:8/130: fdatasync d2/f3 0 2024-09-04T16:30:01.883 INFO:tasks.workunit.client.1.smithi193.stdout:0/163: write d18/f20 [3055252,26278] 0 2024-09-04T16:30:01.910 INFO:tasks.workunit.client.1.smithi193.stdout:9/210: write d2/d4/f17 [4382186,79632] 0 2024-09-04T16:30:01.912 INFO:tasks.workunit.client.1.smithi193.stdout:2/79: unlink d2/d14/c1b 0 2024-09-04T16:30:01.916 INFO:tasks.workunit.client.1.smithi193.stdout:3/145: rename d0/d9/f31 to d0/d18/f3a 0 2024-09-04T16:30:01.918 INFO:tasks.workunit.client.1.smithi193.stdout:2/80: dwrite d2/fc [4194304,4194304] 0 2024-09-04T16:30:01.920 INFO:tasks.workunit.client.1.smithi193.stdout:8/131: creat d2/d20/f32 x:0 0 0 2024-09-04T16:30:01.921 INFO:tasks.workunit.client.1.smithi193.stdout:8/132: chown d2/d12/f19 1663130652 1 2024-09-04T16:30:01.922 INFO:tasks.workunit.client.1.smithi193.stdout:7/132: creat d9/d18/d22/d2b/f33 x:0 0 0 2024-09-04T16:30:01.924 INFO:tasks.workunit.client.1.smithi193.stdout:6/133: rename d5/ca to d5/c28 0 2024-09-04T16:30:01.924 INFO:tasks.workunit.client.1.smithi193.stdout:6/134: dread - d5/f20 zero size 2024-09-04T16:30:01.929 INFO:tasks.workunit.client.1.smithi193.stdout:5/134: rename d1/d8/db/d13 to d1/d29 0 2024-09-04T16:30:01.930 INFO:tasks.workunit.client.1.smithi193.stdout:3/146: rmdir d0/d7/de 39 2024-09-04T16:30:01.932 INFO:tasks.workunit.client.1.smithi193.stdout:2/81: mknod d2/d9/db/c1c 0 2024-09-04T16:30:01.934 INFO:tasks.workunit.client.1.smithi193.stdout:5/135: dwrite d1/d8/db/d23/f26 [0,4194304] 0 2024-09-04T16:30:01.937 INFO:tasks.workunit.client.1.smithi193.stdout:7/133: creat d9/de/d27/f34 x:0 0 0 2024-09-04T16:30:01.937 INFO:tasks.workunit.client.1.smithi193.stdout:5/136: read d1/f3 [760851,114734] 0 2024-09-04T16:30:01.949 INFO:tasks.workunit.client.1.smithi193.stdout:7/134: creat d9/de/d27/f35 x:0 0 0 2024-09-04T16:30:01.949 INFO:tasks.workunit.client.1.smithi193.stdout:7/135: chown d9/c2d 1 1 2024-09-04T16:30:01.950 INFO:tasks.workunit.client.1.smithi193.stdout:7/136: chown d9/d11/l21 28468734 1 2024-09-04T16:30:01.951 INFO:tasks.workunit.client.1.smithi193.stdout:5/137: creat d1/d29/d18/f2a x:0 0 0 2024-09-04T16:30:01.951 INFO:tasks.workunit.client.1.smithi193.stdout:7/137: truncate d9/de/f1a 2347280 0 2024-09-04T16:30:01.952 INFO:tasks.workunit.client.1.smithi193.stdout:5/138: read - d1/d29/d18/f2a zero size 2024-09-04T16:30:01.953 INFO:tasks.workunit.client.1.smithi193.stdout:5/139: write d1/d8/f22 [791900,53165] 0 2024-09-04T16:30:01.956 INFO:tasks.workunit.client.1.smithi193.stdout:4/104: getdents d3 0 2024-09-04T16:30:01.959 INFO:tasks.workunit.client.1.smithi193.stdout:7/138: mknod d9/de/c36 0 2024-09-04T16:30:01.961 INFO:tasks.workunit.client.1.smithi193.stdout:7/139: chown d9/d18/d1e/f29 3178 1 2024-09-04T16:30:01.961 INFO:tasks.workunit.client.1.smithi193.stdout:0/164: truncate d18/f28 3887421 0 2024-09-04T16:30:01.962 INFO:tasks.workunit.client.1.smithi193.stdout:2/82: dread d2/f7 [0,4194304] 0 2024-09-04T16:30:01.962 INFO:tasks.workunit.client.1.smithi193.stdout:4/105: dwrite d3/d1a/d21/f27 [0,4194304] 0 2024-09-04T16:30:01.964 INFO:tasks.workunit.client.1.smithi193.stdout:3/147: rename d0/d10/d2f to d0/d3b 0 2024-09-04T16:30:01.965 INFO:tasks.workunit.client.1.smithi193.stdout:3/148: truncate d0/d18/f2b 697596 0 2024-09-04T16:30:01.966 INFO:tasks.workunit.client.1.smithi193.stdout:2/83: dread d2/fc [0,4194304] 0 2024-09-04T16:30:01.968 INFO:tasks.workunit.client.1.smithi193.stdout:5/140: mkdir d1/d8/db/d15/d2b 0 2024-09-04T16:30:01.969 INFO:tasks.workunit.client.1.smithi193.stdout:9/211: write d2/d8/d15/f1b [386619,11091] 0 2024-09-04T16:30:01.970 INFO:tasks.workunit.client.1.smithi193.stdout:5/141: write d1/d8/f22 [487879,125714] 0 2024-09-04T16:30:01.971 INFO:tasks.workunit.client.1.smithi193.stdout:0/165: write d18/f19 [5240975,101026] 0 2024-09-04T16:30:01.972 INFO:tasks.workunit.client.1.smithi193.stdout:2/84: dread d2/d9/db/d10/f12 [0,4194304] 0 2024-09-04T16:30:01.974 INFO:tasks.workunit.client.1.smithi193.stdout:7/140: creat d9/de/d27/f37 x:0 0 0 2024-09-04T16:30:01.976 INFO:tasks.workunit.client.1.smithi193.stdout:4/106: creat d3/f28 x:0 0 0 2024-09-04T16:30:01.978 INFO:tasks.workunit.client.1.smithi193.stdout:6/135: write d5/fb [1383840,127407] 0 2024-09-04T16:30:01.979 INFO:tasks.workunit.client.1.smithi193.stdout:5/142: dwrite d1/d8/db/d23/f25 [0,4194304] 0 2024-09-04T16:30:01.980 INFO:tasks.workunit.client.1.smithi193.stdout:6/136: chown d5/de/d15 334 1 2024-09-04T16:30:01.980 INFO:tasks.workunit.client.1.smithi193.stdout:6/137: dread - d5/de/f17 zero size 2024-09-04T16:30:01.981 INFO:tasks.workunit.client.1.smithi193.stdout:6/138: fdatasync d5/f26 0 2024-09-04T16:30:01.985 INFO:tasks.workunit.client.1.smithi193.stdout:1/179: sync 2024-09-04T16:30:01.989 INFO:tasks.workunit.client.1.smithi193.stdout:1/180: write d1/d2b/db/f3e [406232,13761] 0 2024-09-04T16:30:01.996 INFO:tasks.workunit.client.1.smithi193.stdout:3/149: link d0/d18/f27 d0/d18/d1b/f3c 0 2024-09-04T16:30:02.000 INFO:tasks.workunit.client.1.smithi193.stdout:6/139: mknod d5/de/d15/d1b/c29 0 2024-09-04T16:30:02.000 INFO:tasks.workunit.client.1.smithi193.stdout:3/150: dwrite d0/d9/fb [0,4194304] 0 2024-09-04T16:30:02.010 INFO:tasks.workunit.client.1.smithi193.stdout:7/141: link d9/de/d27/f28 d9/de/d27/f38 0 2024-09-04T16:30:02.015 INFO:tasks.workunit.client.1.smithi193.stdout:5/143: mknod d1/d8/db/d15/d2b/c2c 0 2024-09-04T16:30:02.016 INFO:tasks.workunit.client.1.smithi193.stdout:5/144: write d1/f3 [1357131,4311] 0 2024-09-04T16:30:02.018 INFO:tasks.workunit.client.1.smithi193.stdout:6/140: unlink d5/f1f 0 2024-09-04T16:30:02.020 INFO:tasks.workunit.client.1.smithi193.stdout:3/151: chown d0/d10/c1e 6165 1 2024-09-04T16:30:02.020 INFO:tasks.workunit.client.1.smithi193.stdout:9/212: truncate d2/d8/f26 3100301 0 2024-09-04T16:30:02.027 INFO:tasks.workunit.client.1.smithi193.stdout:2/85: dwrite d2/fe [0,4194304] 0 2024-09-04T16:30:02.027 INFO:tasks.workunit.client.1.smithi193.stdout:7/142: unlink d9/ld 0 2024-09-04T16:30:02.027 INFO:tasks.workunit.client.1.smithi193.stdout:2/86: chown d2/f17 50 1 2024-09-04T16:30:02.033 INFO:tasks.workunit.client.1.smithi193.stdout:5/145: rmdir d1/d8/db/d15 39 2024-09-04T16:30:02.033 INFO:tasks.workunit.client.1.smithi193.stdout:8/133: sync 2024-09-04T16:30:02.035 INFO:tasks.workunit.client.1.smithi193.stdout:8/134: chown d2/d20/d23/d24 64334757 1 2024-09-04T16:30:02.036 INFO:tasks.workunit.client.1.smithi193.stdout:6/141: write d5/f11 [1323340,29715] 0 2024-09-04T16:30:02.036 INFO:tasks.workunit.client.1.smithi193.stdout:2/87: dwrite d2/d9/db/f16 [0,4194304] 0 2024-09-04T16:30:02.038 INFO:tasks.workunit.client.1.smithi193.stdout:3/152: mkdir d0/d18/d1b/d3d 0 2024-09-04T16:30:02.040 INFO:tasks.workunit.client.1.smithi193.stdout:9/213: creat d2/d18/d2f/f47 x:0 0 0 2024-09-04T16:30:02.042 INFO:tasks.workunit.client.1.smithi193.stdout:1/181: rmdir d1/d2b/db/d33 0 2024-09-04T16:30:02.043 INFO:tasks.workunit.client.1.smithi193.stdout:8/135: dread d2/d12/fe [0,4194304] 0 2024-09-04T16:30:02.044 INFO:tasks.workunit.client.1.smithi193.stdout:7/143: mkdir d9/d39 0 2024-09-04T16:30:02.044 INFO:tasks.workunit.client.1.smithi193.stdout:7/144: stat d9 0 2024-09-04T16:30:02.046 INFO:tasks.workunit.client.1.smithi193.stdout:2/88: dwrite d2/f17 [0,4194304] 0 2024-09-04T16:30:02.047 INFO:tasks.workunit.client.1.smithi193.stdout:2/89: chown d2/d9/db/d10/l11 1882032625 1 2024-09-04T16:30:02.053 INFO:tasks.workunit.client.1.smithi193.stdout:6/142: rename d5/f25 to d5/de/f2a 0 2024-09-04T16:30:02.055 INFO:tasks.workunit.client.1.smithi193.stdout:4/107: dwrite d3/f24 [0,4194304] 0 2024-09-04T16:30:02.055 INFO:tasks.workunit.client.1.smithi193.stdout:0/166: truncate d18/f28 838553 0 2024-09-04T16:30:02.058 INFO:tasks.workunit.client.1.smithi193.stdout:9/214: creat d2/d8/d15/f48 x:0 0 0 2024-09-04T16:30:02.074 INFO:tasks.workunit.client.1.smithi193.stdout:3/153: rename d0/d10/c1e to d0/d18/d1b/d3d/c3e 0 2024-09-04T16:30:02.078 INFO:tasks.workunit.client.1.smithi193.stdout:0/167: mkdir d18/d25/d3b 0 2024-09-04T16:30:02.079 INFO:tasks.workunit.client.1.smithi193.stdout:5/146: truncate d1/d8/db/d23/f25 1371890 0 2024-09-04T16:30:02.079 INFO:tasks.workunit.client.1.smithi193.stdout:7/145: dwrite d9/de/d27/f28 [0,4194304] 0 2024-09-04T16:30:02.081 INFO:tasks.workunit.client.1.smithi193.stdout:5/147: write d1/f28 [926195,83306] 0 2024-09-04T16:30:02.082 INFO:tasks.workunit.client.1.smithi193.stdout:7/146: dread - d9/de/d27/f35 zero size 2024-09-04T16:30:02.086 INFO:tasks.workunit.client.1.smithi193.stdout:1/182: rename d1/d2b/d10/f22 to d1/d2b/db/f3f 0 2024-09-04T16:30:02.088 INFO:tasks.workunit.client.1.smithi193.stdout:3/154: creat d0/d18/d1b/f3f x:0 0 0 2024-09-04T16:30:02.089 INFO:tasks.workunit.client.1.smithi193.stdout:3/155: truncate d0/d18/d1b/f2d 539044 0 2024-09-04T16:30:02.090 INFO:tasks.workunit.client.1.smithi193.stdout:3/156: write d0/d18/f2b [937858,97796] 0 2024-09-04T16:30:02.092 INFO:tasks.workunit.client.1.smithi193.stdout:0/168: creat d18/d25/f3c x:0 0 0 2024-09-04T16:30:02.093 INFO:tasks.workunit.client.1.smithi193.stdout:0/169: truncate d18/f1c 943109 0 2024-09-04T16:30:02.093 INFO:tasks.workunit.client.1.smithi193.stdout:0/170: readlink l5 0 2024-09-04T16:30:02.095 INFO:tasks.workunit.client.1.smithi193.stdout:0/171: chown d18/f20 930100773 1 2024-09-04T16:30:02.097 INFO:tasks.workunit.client.1.smithi193.stdout:8/136: write f0 [2778938,128783] 0 2024-09-04T16:30:02.098 INFO:tasks.workunit.client.1.smithi193.stdout:3/157: dwrite d0/d9/fb [0,4194304] 0 2024-09-04T16:30:02.098 INFO:tasks.workunit.client.1.smithi193.stdout:2/90: link d2/f7 d2/d9/d18/f1d 0 2024-09-04T16:30:02.101 INFO:tasks.workunit.client.1.smithi193.stdout:5/148: dread d1/f3 [0,4194304] 0 2024-09-04T16:30:02.102 INFO:tasks.workunit.client.1.smithi193.stdout:8/137: chown d2/d20/d23/d24/d25/f2f 9 1 2024-09-04T16:30:02.103 INFO:tasks.workunit.client.1.smithi193.stdout:9/215: dwrite d2/d4/f7 [0,4194304] 0 2024-09-04T16:30:02.104 INFO:tasks.workunit.client.1.smithi193.stdout:8/138: dread - d2/d20/d23/d24/d25/f2f zero size 2024-09-04T16:30:02.105 INFO:tasks.workunit.client.1.smithi193.stdout:7/147: symlink d9/d18/l3a 0 2024-09-04T16:30:02.107 INFO:tasks.workunit.client.1.smithi193.stdout:7/148: read - d9/de/d27/f37 zero size 2024-09-04T16:30:02.110 INFO:tasks.workunit.client.1.smithi193.stdout:4/108: creat d3/f29 x:0 0 0 2024-09-04T16:30:02.110 INFO:tasks.workunit.client.1.smithi193.stdout:2/91: dwrite d2/d9/db/f16 [0,4194304] 0 2024-09-04T16:30:02.111 INFO:tasks.workunit.client.1.smithi193.stdout:2/92: chown d2/d14 898361891 1 2024-09-04T16:30:02.114 INFO:tasks.workunit.client.1.smithi193.stdout:0/172: symlink d18/d25/l3d 0 2024-09-04T16:30:02.117 INFO:tasks.workunit.client.1.smithi193.stdout:5/149: creat d1/d8/f2d x:0 0 0 2024-09-04T16:30:02.118 INFO:tasks.workunit.client.1.smithi193.stdout:8/139: creat d2/d20/d23/d1b/f33 x:0 0 0 2024-09-04T16:30:02.119 INFO:tasks.workunit.client.1.smithi193.stdout:8/140: chown d2/d20/d23/d24/d25 14465 1 2024-09-04T16:30:02.120 INFO:tasks.workunit.client.1.smithi193.stdout:6/143: rename d5/f7 to d5/f2b 0 2024-09-04T16:30:02.120 INFO:tasks.workunit.client.1.smithi193.stdout:4/109: chown d3/c23 129 1 2024-09-04T16:30:02.122 INFO:tasks.workunit.client.1.smithi193.stdout:0/173: creat d18/f3e x:0 0 0 2024-09-04T16:30:02.124 INFO:tasks.workunit.client.1.smithi193.stdout:8/141: mkdir d2/d20/d23/d34 0 2024-09-04T16:30:02.125 INFO:tasks.workunit.client.1.smithi193.stdout:7/149: link d9/d18/d1e/f26 d9/d39/f3b 0 2024-09-04T16:30:02.126 INFO:tasks.workunit.client.1.smithi193.stdout:6/144: rename d5/f1d to d5/de/f2c 0 2024-09-04T16:30:02.127 INFO:tasks.workunit.client.1.smithi193.stdout:9/216: rmdir d2/d18/d3f 0 2024-09-04T16:30:02.127 INFO:tasks.workunit.client.1.smithi193.stdout:4/110: dread d3/f1e [0,4194304] 0 2024-09-04T16:30:02.128 INFO:tasks.workunit.client.1.smithi193.stdout:0/174: mkdir d18/d3f 0 2024-09-04T16:30:02.134 INFO:tasks.workunit.client.1.smithi193.stdout:0/175: dread - d18/f3a zero size 2024-09-04T16:30:02.134 INFO:tasks.workunit.client.1.smithi193.stdout:7/150: dread f6 [0,4194304] 0 2024-09-04T16:30:02.134 INFO:tasks.workunit.client.1.smithi193.stdout:5/150: link d1/d8/f19 d1/d8/db/f2e 0 2024-09-04T16:30:02.134 INFO:tasks.workunit.client.1.smithi193.stdout:5/151: stat d1/d8/f12 0 2024-09-04T16:30:02.134 INFO:tasks.workunit.client.1.smithi193.stdout:6/145: rename d5/de/c12 to d5/de/c2d 0 2024-09-04T16:30:02.134 INFO:tasks.workunit.client.1.smithi193.stdout:6/146: chown d5/de/f18 0 1 2024-09-04T16:30:02.134 INFO:tasks.workunit.client.1.smithi193.stdout:6/147: write d5/ff [1168663,6146] 0 2024-09-04T16:30:02.137 INFO:tasks.workunit.client.1.smithi193.stdout:4/111: mkdir d3/d1a/d2a 0 2024-09-04T16:30:02.139 INFO:tasks.workunit.client.1.smithi193.stdout:9/217: rename d2/d4/l11 to d2/d18/l49 0 2024-09-04T16:30:02.140 INFO:tasks.workunit.client.1.smithi193.stdout:9/218: truncate d2/f3d 111138 0 2024-09-04T16:30:02.141 INFO:tasks.workunit.client.1.smithi193.stdout:7/151: mknod d9/d18/d22/c3c 0 2024-09-04T16:30:02.142 INFO:tasks.workunit.client.1.smithi193.stdout:7/152: write d9/de/d27/f37 [160092,98950] 0 2024-09-04T16:30:02.144 INFO:tasks.workunit.client.1.smithi193.stdout:6/148: symlink d5/de/d15/l2e 0 2024-09-04T16:30:02.148 INFO:tasks.workunit.client.1.smithi193.stdout:9/219: dwrite d2/f28 [4194304,4194304] 0 2024-09-04T16:30:02.148 INFO:tasks.workunit.client.1.smithi193.stdout:7/153: write d9/d18/d1e/f26 [1401026,44805] 0 2024-09-04T16:30:02.153 INFO:tasks.workunit.client.1.smithi193.stdout:8/142: write d2/d20/d23/f1d [572556,50404] 0 2024-09-04T16:30:02.156 INFO:tasks.workunit.client.1.smithi193.stdout:7/154: creat d9/de/d27/f3d x:0 0 0 2024-09-04T16:30:02.159 INFO:tasks.workunit.client.1.smithi193.stdout:0/176: write f6 [2870517,127044] 0 2024-09-04T16:30:02.162 INFO:tasks.workunit.client.1.smithi193.stdout:3/158: dwrite d0/d7/fc [0,4194304] 0 2024-09-04T16:30:02.162 INFO:tasks.workunit.client.1.smithi193.stdout:5/152: truncate d1/d8/fd 615640 0 2024-09-04T16:30:02.163 INFO:tasks.workunit.client.1.smithi193.stdout:6/149: dwrite d5/de/f17 [0,4194304] 0 2024-09-04T16:30:02.163 INFO:tasks.workunit.client.1.smithi193.stdout:7/155: mkdir d9/d39/d3e 0 2024-09-04T16:30:02.165 INFO:tasks.workunit.client.1.smithi193.stdout:0/177: fdatasync f6 0 2024-09-04T16:30:02.165 INFO:tasks.workunit.client.1.smithi193.stdout:8/143: mknod d2/c35 0 2024-09-04T16:30:02.166 INFO:tasks.workunit.client.1.smithi193.stdout:2/93: dwrite d2/fc [0,4194304] 0 2024-09-04T16:30:02.166 INFO:tasks.workunit.client.1.smithi193.stdout:3/159: rename d0/d18 to d0/d18/d1c/d25/d40 22 2024-09-04T16:30:02.169 INFO:tasks.workunit.client.1.smithi193.stdout:9/220: dread d2/f6 [0,4194304] 0 2024-09-04T16:30:02.170 INFO:tasks.workunit.client.1.smithi193.stdout:0/178: chown d18/l39 0 1 2024-09-04T16:30:02.173 INFO:tasks.workunit.client.1.smithi193.stdout:5/153: rename d1/d8/db/f2e to d1/d29/d18/f2f 0 2024-09-04T16:30:02.177 INFO:tasks.workunit.client.1.smithi193.stdout:7/156: link d9/de/f1c d9/d39/d3e/f3f 0 2024-09-04T16:30:02.177 INFO:tasks.workunit.client.1.smithi193.stdout:5/154: fdatasync d1/d8/f2d 0 2024-09-04T16:30:02.178 INFO:tasks.workunit.client.1.smithi193.stdout:2/94: rename d2/d15 to d2/d9/db/d10/d1e 0 2024-09-04T16:30:02.178 INFO:tasks.workunit.client.1.smithi193.stdout:7/157: stat d9/d11/l24 0 2024-09-04T16:30:02.178 INFO:tasks.workunit.client.1.smithi193.stdout:4/112: dwrite d3/fe [0,4194304] 0 2024-09-04T16:30:02.178 INFO:tasks.workunit.client.1.smithi193.stdout:3/160: creat d0/d18/d1c/d30/f41 x:0 0 0 2024-09-04T16:30:02.179 INFO:tasks.workunit.client.1.smithi193.stdout:6/150: creat d5/de/d15/f2f x:0 0 0 2024-09-04T16:30:02.179 INFO:tasks.workunit.client.1.smithi193.stdout:2/95: read d2/fc [1244365,17214] 0 2024-09-04T16:30:02.180 INFO:tasks.workunit.client.1.smithi193.stdout:7/158: dread - d9/de/d27/f34 zero size 2024-09-04T16:30:02.180 INFO:tasks.workunit.client.1.smithi193.stdout:9/221: symlink d2/d18/d2f/d22/d30/l4a 0 2024-09-04T16:30:02.181 INFO:tasks.workunit.client.1.smithi193.stdout:5/155: truncate d1/d8/f2d 839071 0 2024-09-04T16:30:02.181 INFO:tasks.workunit.client.1.smithi193.stdout:3/161: dread - d0/d10/f38 zero size 2024-09-04T16:30:02.181 INFO:tasks.workunit.client.1.smithi193.stdout:1/183: sync 2024-09-04T16:30:02.182 INFO:tasks.workunit.client.1.smithi193.stdout:0/179: creat d18/d25/d3b/f40 x:0 0 0 2024-09-04T16:30:02.182 INFO:tasks.workunit.client.1.smithi193.stdout:6/151: chown d5/f26 1801507298 1 2024-09-04T16:30:02.190 INFO:tasks.workunit.client.1.smithi193.stdout:0/180: creat d18/d25/d3b/f41 x:0 0 0 2024-09-04T16:30:02.192 INFO:tasks.workunit.client.1.smithi193.stdout:7/159: mknod d9/de/c40 0 2024-09-04T16:30:02.192 INFO:tasks.workunit.client.1.smithi193.stdout:8/144: write d2/d12/fe [2865141,120518] 0 2024-09-04T16:30:02.193 INFO:tasks.workunit.client.1.smithi193.stdout:9/222: mknod d2/d18/d2f/d22/c4b 0 2024-09-04T16:30:02.194 INFO:tasks.workunit.client.1.smithi193.stdout:2/96: dwrite d2/d9/db/fd [4194304,4194304] 0 2024-09-04T16:30:02.195 INFO:tasks.workunit.client.1.smithi193.stdout:6/152: rmdir d5 39 2024-09-04T16:30:02.195 INFO:tasks.workunit.client.1.smithi193.stdout:4/113: dwrite d3/f6 [0,4194304] 0 2024-09-04T16:30:02.197 INFO:tasks.workunit.client.1.smithi193.stdout:1/184: fsync d1/d2b/f16 0 2024-09-04T16:30:02.197 INFO:tasks.workunit.client.1.smithi193.stdout:2/97: write d2/f4 [3019043,62392] 0 2024-09-04T16:30:02.199 INFO:tasks.workunit.client.1.smithi193.stdout:3/162: creat d0/d18/d1c/d25/f42 x:0 0 0 2024-09-04T16:30:02.199 INFO:tasks.workunit.client.1.smithi193.stdout:5/156: creat d1/d8/db/d15/f30 x:0 0 0 2024-09-04T16:30:02.201 INFO:tasks.workunit.client.1.smithi193.stdout:2/98: read d2/d9/db/fd [2897152,25436] 0 2024-09-04T16:30:02.203 INFO:tasks.workunit.client.1.smithi193.stdout:0/181: dread d18/f20 [0,4194304] 0 2024-09-04T16:30:02.206 INFO:tasks.workunit.client.1.smithi193.stdout:9/223: symlink d2/l4c 0 2024-09-04T16:30:02.207 INFO:tasks.workunit.client.1.smithi193.stdout:9/224: write d2/d18/d2f/f47 [891241,49949] 0 2024-09-04T16:30:02.208 INFO:tasks.workunit.client.1.smithi193.stdout:1/185: symlink d1/d2b/d10/d2a/l40 0 2024-09-04T16:30:02.212 INFO:tasks.workunit.client.1.smithi193.stdout:5/157: unlink d1/d29/d18/f2a 0 2024-09-04T16:30:02.215 INFO:tasks.workunit.client.1.smithi193.stdout:4/114: symlink d3/d1a/d2a/l2b 0 2024-09-04T16:30:02.216 INFO:tasks.workunit.client.1.smithi193.stdout:2/99: mkdir d2/d9/db/d10/d1f 0 2024-09-04T16:30:02.217 INFO:tasks.workunit.client.1.smithi193.stdout:0/182: rmdir d18/d25/d3b 39 2024-09-04T16:30:02.218 INFO:tasks.workunit.client.1.smithi193.stdout:9/225: fdatasync d2/d8/f9 0 2024-09-04T16:30:02.219 INFO:tasks.workunit.client.1.smithi193.stdout:5/158: dwrite d1/d8/f12 [0,4194304] 0 2024-09-04T16:30:02.219 INFO:tasks.workunit.client.1.smithi193.stdout:1/186: truncate d1/d2b/db/f3b 3454971 0 2024-09-04T16:30:02.221 INFO:tasks.workunit.client.1.smithi193.stdout:6/153: creat d5/d27/f30 x:0 0 0 2024-09-04T16:30:02.221 INFO:tasks.workunit.client.1.smithi193.stdout:9/226: write d2/d18/d2f/f29 [483877,46201] 0 2024-09-04T16:30:02.222 INFO:tasks.workunit.client.1.smithi193.stdout:6/154: dread - d5/d27/f30 zero size 2024-09-04T16:30:02.222 INFO:tasks.workunit.client.1.smithi193.stdout:9/227: chown d2/d8/l38 323735 1 2024-09-04T16:30:02.225 INFO:tasks.workunit.client.1.smithi193.stdout:2/100: dread d2/d9/db/d10/f12 [0,4194304] 0 2024-09-04T16:30:02.225 INFO:tasks.workunit.client.1.smithi193.stdout:0/183: write d18/d25/d3b/f41 [373631,111840] 0 2024-09-04T16:30:02.225 INFO:tasks.workunit.client.1.smithi193.stdout:7/160: truncate d9/de/f1a 1581238 0 2024-09-04T16:30:02.228 INFO:tasks.workunit.client.1.smithi193.stdout:1/187: symlink d1/d2b/db/d26/l41 0 2024-09-04T16:30:02.230 INFO:tasks.workunit.client.1.smithi193.stdout:8/145: truncate d2/d20/d23/f16 778597 0 2024-09-04T16:30:02.231 INFO:tasks.workunit.client.1.smithi193.stdout:9/228: truncate d2/d4/fd 4576571 0 2024-09-04T16:30:02.231 INFO:tasks.workunit.client.1.smithi193.stdout:9/229: stat d2/d8/c32 0 2024-09-04T16:30:02.232 INFO:tasks.workunit.client.1.smithi193.stdout:9/230: write d2/d4/f7 [2336213,56904] 0 2024-09-04T16:30:02.232 INFO:tasks.workunit.client.1.smithi193.stdout:2/101: mknod d2/d9/db/d10/c20 0 2024-09-04T16:30:02.235 INFO:tasks.workunit.client.1.smithi193.stdout:0/184: rename d18/f3e to d18/d25/d32/f42 0 2024-09-04T16:30:02.236 INFO:tasks.workunit.client.1.smithi193.stdout:3/163: truncate d0/d18/d1b/f2d 400093 0 2024-09-04T16:30:02.236 INFO:tasks.workunit.client.1.smithi193.stdout:0/185: readlink d18/l39 0 2024-09-04T16:30:02.238 INFO:tasks.workunit.client.1.smithi193.stdout:6/155: mkdir d5/d31 0 2024-09-04T16:30:02.242 INFO:tasks.workunit.client.1.smithi193.stdout:2/102: dwrite d2/d9/db/f16 [0,4194304] 0 2024-09-04T16:30:02.246 INFO:tasks.workunit.client.1.smithi193.stdout:0/186: rmdir d18 39 2024-09-04T16:30:02.246 INFO:tasks.workunit.client.1.smithi193.stdout:5/159: truncate d1/d8/f12 2414454 0 2024-09-04T16:30:02.249 INFO:tasks.workunit.client.1.smithi193.stdout:8/146: link d2/d20/d23/d1b/f28 d2/d20/f36 0 2024-09-04T16:30:02.249 INFO:tasks.workunit.client.1.smithi193.stdout:9/231: dread d2/d8/d15/f1b [0,4194304] 0 2024-09-04T16:30:02.250 INFO:tasks.workunit.client.1.smithi193.stdout:8/147: chown d2/d12 254 1 2024-09-04T16:30:02.252 INFO:tasks.workunit.client.1.smithi193.stdout:2/103: creat d2/d9/db/f21 x:0 0 0 2024-09-04T16:30:02.255 INFO:tasks.workunit.client.1.smithi193.stdout:3/164: link d0/fa d0/d18/d1c/f43 0 2024-09-04T16:30:02.255 INFO:tasks.workunit.client.1.smithi193.stdout:0/187: write d18/d25/d3b/f41 [558251,4152] 0 2024-09-04T16:30:02.257 INFO:tasks.workunit.client.1.smithi193.stdout:8/148: symlink d2/d20/d23/d24/d25/l37 0 2024-09-04T16:30:02.259 INFO:tasks.workunit.client.1.smithi193.stdout:1/188: truncate d1/d2b/db/f3f 2672460 0 2024-09-04T16:30:02.259 INFO:tasks.workunit.client.1.smithi193.stdout:8/149: stat d2/d20/d23/d1b/f21 0 2024-09-04T16:30:02.260 INFO:tasks.workunit.client.1.smithi193.stdout:5/160: fdatasync d1/d8/db/d23/f25 0 2024-09-04T16:30:02.261 INFO:tasks.workunit.client.1.smithi193.stdout:7/161: dwrite d9/de/f1a [0,4194304] 0 2024-09-04T16:30:02.263 INFO:tasks.workunit.client.1.smithi193.stdout:8/150: fsync d2/d20/d23/d1b/f33 0 2024-09-04T16:30:02.264 INFO:tasks.workunit.client.1.smithi193.stdout:8/151: fdatasync d2/d20/d23/d24/d25/f2f 0 2024-09-04T16:30:02.265 INFO:tasks.workunit.client.1.smithi193.stdout:0/188: read d18/f38 [2463683,49985] 0 2024-09-04T16:30:02.267 INFO:tasks.workunit.client.1.smithi193.stdout:0/189: truncate f17 1226783 0 2024-09-04T16:30:02.267 INFO:tasks.workunit.client.1.smithi193.stdout:7/162: unlink d9/cc 0 2024-09-04T16:30:02.268 INFO:tasks.workunit.client.1.smithi193.stdout:8/152: write d2/d20/d23/d1b/f33 [849927,51346] 0 2024-09-04T16:30:02.269 INFO:tasks.workunit.client.1.smithi193.stdout:5/161: creat d1/d8/f31 x:0 0 0 2024-09-04T16:30:02.272 INFO:tasks.workunit.client.1.smithi193.stdout:8/153: read - d2/d20/f2d zero size 2024-09-04T16:30:02.275 INFO:tasks.workunit.client.1.smithi193.stdout:9/232: dwrite d2/d4/f5 [0,4194304] 0 2024-09-04T16:30:02.278 INFO:tasks.workunit.client.1.smithi193.stdout:3/165: creat d0/d7/de/f44 x:0 0 0 2024-09-04T16:30:02.281 INFO:tasks.workunit.client.1.smithi193.stdout:2/104: dread d2/f4 [0,4194304] 0 2024-09-04T16:30:02.283 INFO:tasks.workunit.client.1.smithi193.stdout:9/233: write d2/d8/d25/f3e [733173,112560] 0 2024-09-04T16:30:02.284 INFO:tasks.workunit.client.1.smithi193.stdout:1/189: getdents d1 0 2024-09-04T16:30:02.289 INFO:tasks.workunit.client.1.smithi193.stdout:3/166: mkdir d0/d7/de/d45 0 2024-09-04T16:30:02.289 INFO:tasks.workunit.client.1.smithi193.stdout:7/163: dwrite d9/d18/d22/d2b/f33 [0,4194304] 0 2024-09-04T16:30:02.289 INFO:tasks.workunit.client.1.smithi193.stdout:5/162: dread d1/d29/f1d [0,4194304] 0 2024-09-04T16:30:02.291 INFO:tasks.workunit.client.1.smithi193.stdout:8/154: rename d2/d20/d23/l15 to d2/l38 0 2024-09-04T16:30:02.292 INFO:tasks.workunit.client.1.smithi193.stdout:0/190: dwrite f1 [0,4194304] 0 2024-09-04T16:30:02.292 INFO:tasks.workunit.client.1.smithi193.stdout:1/190: write d1/d2b/d10/f2f [488033,15885] 0 2024-09-04T16:30:02.295 INFO:tasks.workunit.client.1.smithi193.stdout:2/105: mkdir d2/d9/db/d10/d1f/d22 0 2024-09-04T16:30:02.295 INFO:tasks.workunit.client.1.smithi193.stdout:8/155: write d2/d12/fd [3006522,102358] 0 2024-09-04T16:30:02.296 INFO:tasks.workunit.client.1.smithi193.stdout:0/191: chown d18/f20 292 1 2024-09-04T16:30:02.296 INFO:tasks.workunit.client.1.smithi193.stdout:7/164: chown d9/de/c2c 6238 1 2024-09-04T16:30:02.298 INFO:tasks.workunit.client.1.smithi193.stdout:8/156: dread - d2/d20/f36 zero size 2024-09-04T16:30:02.299 INFO:tasks.workunit.client.1.smithi193.stdout:5/163: mkdir d1/d8/db/d15/d32 0 2024-09-04T16:30:02.301 INFO:tasks.workunit.client.1.smithi193.stdout:9/234: dread d2/d8/f9 [0,4194304] 0 2024-09-04T16:30:02.301 INFO:tasks.workunit.client.1.smithi193.stdout:1/191: unlink d1/d2b/f16 0 2024-09-04T16:30:02.302 INFO:tasks.workunit.client.1.smithi193.stdout:1/192: stat d1/d2b/db/d26 0 2024-09-04T16:30:02.302 INFO:tasks.workunit.client.1.smithi193.stdout:8/157: read d2/f3 [2795365,115528] 0 2024-09-04T16:30:02.305 INFO:tasks.workunit.client.1.smithi193.stdout:7/165: mkdir d9/de/d41 0 2024-09-04T16:30:02.305 INFO:tasks.workunit.client.1.smithi193.stdout:0/192: dread fb [0,4194304] 0 2024-09-04T16:30:02.306 INFO:tasks.workunit.client.1.smithi193.stdout:8/158: truncate d2/d20/f2d 365541 0 2024-09-04T16:30:02.307 INFO:tasks.workunit.client.1.smithi193.stdout:3/167: link d0/d18/d1c/d25/f42 d0/d7/de/d45/f46 0 2024-09-04T16:30:02.309 INFO:tasks.workunit.client.1.smithi193.stdout:5/164: mknod d1/d29/d18/c33 0 2024-09-04T16:30:02.309 INFO:tasks.workunit.client.1.smithi193.stdout:1/193: mknod d1/d2b/d10/c42 0 2024-09-04T16:30:02.311 INFO:tasks.workunit.client.1.smithi193.stdout:5/165: read d1/f28 [582658,128331] 0 2024-09-04T16:30:02.312 INFO:tasks.workunit.client.1.smithi193.stdout:0/193: dread d18/f23 [0,4194304] 0 2024-09-04T16:30:02.312 INFO:tasks.workunit.client.1.smithi193.stdout:8/159: symlink d2/d20/d23/d24/d25/l39 0 2024-09-04T16:30:02.312 INFO:tasks.workunit.client.1.smithi193.stdout:5/166: chown d1/l10 258805 1 2024-09-04T16:30:02.312 INFO:tasks.workunit.client.1.smithi193.stdout:9/235: mkdir d2/d8/d4d 0 2024-09-04T16:30:02.313 INFO:tasks.workunit.client.1.smithi193.stdout:7/166: symlink d9/d39/d3e/l42 0 2024-09-04T16:30:02.314 INFO:tasks.workunit.client.1.smithi193.stdout:7/167: dread - d9/de/f1f zero size 2024-09-04T16:30:02.314 INFO:tasks.workunit.client.1.smithi193.stdout:0/194: symlink d18/d25/d32/l43 0 2024-09-04T16:30:02.315 INFO:tasks.workunit.client.1.smithi193.stdout:9/236: readlink d2/d8/l40 0 2024-09-04T16:30:02.316 INFO:tasks.workunit.client.1.smithi193.stdout:3/168: rename d0/d18/f2b to d0/f47 0 2024-09-04T16:30:02.317 INFO:tasks.workunit.client.1.smithi193.stdout:3/169: stat d0/d18/d1c/d25/f42 0 2024-09-04T16:30:02.318 INFO:tasks.workunit.client.1.smithi193.stdout:9/237: rmdir d2 39 2024-09-04T16:30:02.319 INFO:tasks.workunit.client.1.smithi193.stdout:0/195: creat d18/d25/d32/f44 x:0 0 0 2024-09-04T16:30:02.319 INFO:tasks.workunit.client.1.smithi193.stdout:7/168: dread d9/de/d27/f28 [0,4194304] 0 2024-09-04T16:30:02.320 INFO:tasks.workunit.client.1.smithi193.stdout:0/196: fdatasync d18/f1c 0 2024-09-04T16:30:02.322 INFO:tasks.workunit.client.1.smithi193.stdout:7/169: dread - d9/de/f1c zero size 2024-09-04T16:30:02.322 INFO:tasks.workunit.client.1.smithi193.stdout:3/170: creat d0/d18/d1c/d25/f48 x:0 0 0 2024-09-04T16:30:02.322 INFO:tasks.workunit.client.1.smithi193.stdout:5/167: getdents d1/d8 0 2024-09-04T16:30:02.325 INFO:tasks.workunit.client.1.smithi193.stdout:9/238: symlink d2/d4/l4e 0 2024-09-04T16:30:02.328 INFO:tasks.workunit.client.1.smithi193.stdout:7/170: creat d9/d18/d1e/f43 x:0 0 0 2024-09-04T16:30:02.328 INFO:tasks.workunit.client.1.smithi193.stdout:2/106: truncate d2/fe 1420938 0 2024-09-04T16:30:02.329 INFO:tasks.workunit.client.1.smithi193.stdout:3/171: dwrite d0/d18/d1c/d30/f33 [0,4194304] 0 2024-09-04T16:30:02.333 INFO:tasks.workunit.client.1.smithi193.stdout:7/171: fdatasync d9/de/d27/f28 0 2024-09-04T16:30:02.333 INFO:tasks.workunit.client.1.smithi193.stdout:5/168: dread d1/f28 [0,4194304] 0 2024-09-04T16:30:02.337 INFO:tasks.workunit.client.1.smithi193.stdout:2/107: creat d2/d9/db/f23 x:0 0 0 2024-09-04T16:30:02.337 INFO:tasks.workunit.client.1.smithi193.stdout:2/108: chown d2/d9/db/f16 1786 1 2024-09-04T16:30:02.337 INFO:tasks.workunit.client.1.smithi193.stdout:9/239: fdatasync d2/d4/fd 0 2024-09-04T16:30:02.338 INFO:tasks.workunit.client.1.smithi193.stdout:9/240: chown d2/d4/f3a 3828 1 2024-09-04T16:30:02.339 INFO:tasks.workunit.client.1.smithi193.stdout:5/169: rmdir d1/d8 39 2024-09-04T16:30:02.339 INFO:tasks.workunit.client.1.smithi193.stdout:4/115: sync 2024-09-04T16:30:02.339 INFO:tasks.workunit.client.1.smithi193.stdout:7/172: rename d9/d18/d22 to d9/d18/d22/d44 22 2024-09-04T16:30:02.340 INFO:tasks.workunit.client.1.smithi193.stdout:8/160: truncate d2/d12/fe 1183648 0 2024-09-04T16:30:02.340 INFO:tasks.workunit.client.1.smithi193.stdout:9/241: truncate d2/d18/d2f/f45 290347 0 2024-09-04T16:30:02.341 INFO:tasks.workunit.client.1.smithi193.stdout:9/242: fdatasync d2/d8/d15/f31 0 2024-09-04T16:30:02.344 INFO:tasks.workunit.client.1.smithi193.stdout:2/109: rename d2/l6 to d2/d9/db/d10/l24 0 2024-09-04T16:30:02.345 INFO:tasks.workunit.client.1.smithi193.stdout:7/173: dread d9/de/d27/f38 [0,4194304] 0 2024-09-04T16:30:02.346 INFO:tasks.workunit.client.1.smithi193.stdout:7/174: chown d9/c32 29779 1 2024-09-04T16:30:02.346 INFO:tasks.workunit.client.1.smithi193.stdout:8/161: creat d2/d20/d23/d24/d25/f3a x:0 0 0 2024-09-04T16:30:02.348 INFO:tasks.workunit.client.1.smithi193.stdout:9/243: unlink f0 0 2024-09-04T16:30:02.349 INFO:tasks.workunit.client.1.smithi193.stdout:2/110: dread d2/f17 [0,4194304] 0 2024-09-04T16:30:02.349 INFO:tasks.workunit.client.1.smithi193.stdout:3/172: dread d0/fa [0,4194304] 0 2024-09-04T16:30:02.349 INFO:tasks.workunit.client.1.smithi193.stdout:5/170: creat d1/d8/f34 x:0 0 0 2024-09-04T16:30:02.352 INFO:tasks.workunit.client.1.smithi193.stdout:0/197: write d18/f1a [1098234,122366] 0 2024-09-04T16:30:02.352 INFO:tasks.workunit.client.1.smithi193.stdout:7/175: mknod d9/d18/c45 0 2024-09-04T16:30:02.352 INFO:tasks.workunit.client.1.smithi193.stdout:8/162: symlink d2/d20/d23/l3b 0 2024-09-04T16:30:02.353 INFO:tasks.workunit.client.1.smithi193.stdout:0/198: stat f6 0 2024-09-04T16:30:02.354 INFO:tasks.workunit.client.1.smithi193.stdout:7/176: dread - d9/de/f1f zero size 2024-09-04T16:30:02.354 INFO:tasks.workunit.client.1.smithi193.stdout:9/244: readlink d2/d18/l3b 0 2024-09-04T16:30:02.355 INFO:tasks.workunit.client.1.smithi193.stdout:8/163: fdatasync d2/d20/d23/f29 0 2024-09-04T16:30:02.356 INFO:tasks.workunit.client.1.smithi193.stdout:7/177: truncate d9/de/d27/f35 921381 0 2024-09-04T16:30:02.356 INFO:tasks.workunit.client.1.smithi193.stdout:5/171: symlink d1/d8/l35 0 2024-09-04T16:30:02.359 INFO:tasks.workunit.client.1.smithi193.stdout:0/199: rmdir d18/d25/d3b 39 2024-09-04T16:30:02.361 INFO:tasks.workunit.client.1.smithi193.stdout:8/164: mkdir d2/d20/d23/d24/d3c 0 2024-09-04T16:30:02.367 INFO:tasks.workunit.client.1.smithi193.stdout:2/111: link d2/d9/db/f21 d2/d9/db/d10/f25 0 2024-09-04T16:30:02.367 INFO:tasks.workunit.client.1.smithi193.stdout:7/178: dread d9/de/d27/f31 [0,4194304] 0 2024-09-04T16:30:02.419 INFO:tasks.workunit.client.1.smithi193.stdout:8/165: mknod d2/d20/d23/d24/c3d 0 2024-09-04T16:30:02.419 INFO:tasks.workunit.client.1.smithi193.stdout:5/172: mkdir d1/d8/db/d36 0 2024-09-04T16:30:02.419 INFO:tasks.workunit.client.1.smithi193.stdout:3/173: truncate d0/d18/d1c/d30/f33 3900743 0 2024-09-04T16:30:02.420 INFO:tasks.workunit.client.1.smithi193.stdout:7/179: fsync d9/de/d27/f37 0 2024-09-04T16:30:02.420 INFO:tasks.workunit.client.1.smithi193.stdout:2/112: readlink d2/d9/db/d10/l11 0 2024-09-04T16:30:02.421 INFO:tasks.workunit.client.1.smithi193.stdout:5/173: write d1/d29/f1d [2251379,129272] 0 2024-09-04T16:30:02.422 INFO:tasks.workunit.client.1.smithi193.stdout:0/200: rename d18/d25/d32/c35 to d18/d25/c45 0 2024-09-04T16:30:02.422 INFO:tasks.workunit.client.1.smithi193.stdout:8/166: chown d2/d20/d23/f16 208 1 2024-09-04T16:30:02.423 INFO:tasks.workunit.client.1.smithi193.stdout:2/113: stat d2/d9/db/d10/d1f/d22 0 2024-09-04T16:30:02.427 INFO:tasks.workunit.client.1.smithi193.stdout:8/167: dread - d2/d20/d23/d1b/f28 zero size 2024-09-04T16:30:02.428 INFO:tasks.workunit.client.1.smithi193.stdout:3/174: getdents d0/d7/de/d45 0 2024-09-04T16:30:02.428 INFO:tasks.workunit.client.1.smithi193.stdout:5/174: write d1/d8/db/f1a [224724,109560] 0 2024-09-04T16:30:02.428 INFO:tasks.workunit.client.1.smithi193.stdout:2/114: stat d2/d9/db/d10/d1f 0 2024-09-04T16:30:02.432 INFO:tasks.workunit.client.1.smithi193.stdout:9/245: dwrite d2/d4/f17 [0,4194304] 0 2024-09-04T16:30:02.433 INFO:tasks.workunit.client.1.smithi193.stdout:3/175: mkdir d0/d9/d49 0 2024-09-04T16:30:02.434 INFO:tasks.workunit.client.1.smithi193.stdout:5/175: unlink d1/d8/f19 0 2024-09-04T16:30:02.435 INFO:tasks.workunit.client.1.smithi193.stdout:3/176: chown d0/d18/d1c 7116 1 2024-09-04T16:30:02.439 INFO:tasks.workunit.client.1.smithi193.stdout:7/180: dwrite d9/d18/d1e/f29 [0,4194304] 0 2024-09-04T16:30:02.439 INFO:tasks.workunit.client.1.smithi193.stdout:2/115: fdatasync d2/d9/d18/f1d 0 2024-09-04T16:30:02.440 INFO:tasks.workunit.client.1.smithi193.stdout:8/168: mkdir d2/d20/d23/d34/d3e 0 2024-09-04T16:30:02.441 INFO:tasks.workunit.client.1.smithi193.stdout:5/176: truncate d1/d8/db/f1a 335084 0 2024-09-04T16:30:02.442 INFO:tasks.workunit.client.1.smithi193.stdout:7/181: write f8 [331743,83355] 0 2024-09-04T16:30:02.443 INFO:tasks.workunit.client.1.smithi193.stdout:0/201: dwrite d18/d25/d3b/f40 [0,4194304] 0 2024-09-04T16:30:02.443 INFO:tasks.workunit.client.1.smithi193.stdout:9/246: write d2/f1c [2885971,15243] 0 2024-09-04T16:30:02.445 INFO:tasks.workunit.client.1.smithi193.stdout:8/169: fdatasync d2/d20/d23/f16 0 2024-09-04T16:30:02.447 INFO:tasks.workunit.client.1.smithi193.stdout:0/202: chown d18/c1e 0 1 2024-09-04T16:30:02.448 INFO:tasks.workunit.client.1.smithi193.stdout:0/203: write f15 [2053333,18319] 0 2024-09-04T16:30:02.449 INFO:tasks.workunit.client.1.smithi193.stdout:2/116: mkdir d2/d9/db/d10/d1e/d26 0 2024-09-04T16:30:02.449 INFO:tasks.workunit.client.1.smithi193.stdout:9/247: write d2/d18/d2f/f45 [100470,50514] 0 2024-09-04T16:30:02.449 INFO:tasks.workunit.client.1.smithi193.stdout:7/182: readlink d9/l12 0 2024-09-04T16:30:02.451 INFO:tasks.workunit.client.1.smithi193.stdout:8/170: rmdir d2/d20/d23/d24 39 2024-09-04T16:30:02.452 INFO:tasks.workunit.client.1.smithi193.stdout:7/183: dread - d9/de/f1c zero size 2024-09-04T16:30:02.453 INFO:tasks.workunit.client.1.smithi193.stdout:2/117: fdatasync d2/fc 0 2024-09-04T16:30:02.456 INFO:tasks.workunit.client.1.smithi193.stdout:0/204: getdents d18 0 2024-09-04T16:30:02.457 INFO:tasks.workunit.client.1.smithi193.stdout:8/171: write d2/d20/d23/f29 [110612,49807] 0 2024-09-04T16:30:02.457 INFO:tasks.workunit.client.1.smithi193.stdout:7/184: unlink d9/de/d27/f31 0 2024-09-04T16:30:02.457 INFO:tasks.workunit.client.1.smithi193.stdout:6/156: sync 2024-09-04T16:30:02.461 INFO:tasks.workunit.client.1.smithi193.stdout:2/118: write d2/d9/db/fd [8516230,81404] 0 2024-09-04T16:30:02.461 INFO:tasks.workunit.client.1.smithi193.stdout:7/185: dread - d9/de/d27/f34 zero size 2024-09-04T16:30:02.463 INFO:tasks.workunit.client.1.smithi193.stdout:3/177: truncate d0/fa 2506262 0 2024-09-04T16:30:02.465 INFO:tasks.workunit.client.1.smithi193.stdout:6/157: write d5/de/d15/d1b/f1e [5178753,39079] 0 2024-09-04T16:30:02.465 INFO:tasks.workunit.client.1.smithi193.stdout:0/205: symlink d18/d25/d32/l46 0 2024-09-04T16:30:02.465 INFO:tasks.workunit.client.1.smithi193.stdout:9/248: dwrite d2/d18/d2f/f47 [0,4194304] 0 2024-09-04T16:30:02.465 INFO:tasks.workunit.client.1.smithi193.stdout:5/177: dwrite d1/d8/db/d15/f30 [0,4194304] 0 2024-09-04T16:30:02.466 INFO:tasks.workunit.client.1.smithi193.stdout:3/178: readlink d0/l6 0 2024-09-04T16:30:02.467 INFO:tasks.workunit.client.1.smithi193.stdout:0/206: fsync d18/f3a 0 2024-09-04T16:30:02.470 INFO:tasks.workunit.client.1.smithi193.stdout:0/207: stat d18/d25/l27 0 2024-09-04T16:30:02.470 INFO:tasks.workunit.client.1.smithi193.stdout:5/178: mkdir d1/d29/d1e/d37 0 2024-09-04T16:30:02.471 INFO:tasks.workunit.client.1.smithi193.stdout:6/158: chown d5/c28 6205571 1 2024-09-04T16:30:02.471 INFO:tasks.workunit.client.1.smithi193.stdout:8/172: getdents d2/d20 0 2024-09-04T16:30:02.475 INFO:tasks.workunit.client.1.smithi193.stdout:8/173: fdatasync d2/f3 0 2024-09-04T16:30:02.478 INFO:tasks.workunit.client.1.smithi193.stdout:2/119: dread d2/f7 [0,4194304] 0 2024-09-04T16:30:02.478 INFO:tasks.workunit.client.1.smithi193.stdout:6/159: write d5/de/d15/f2f [183341,6939] 0 2024-09-04T16:30:02.480 INFO:tasks.workunit.client.1.smithi193.stdout:7/186: dwrite d9/d39/f3b [0,4194304] 0 2024-09-04T16:30:02.486 INFO:tasks.workunit.client.1.smithi193.stdout:3/179: write d0/d18/d1c/f43 [1454270,9634] 0 2024-09-04T16:30:02.486 INFO:tasks.workunit.client.1.smithi193.stdout:9/249: rename d2/d8/f9 to d2/d8/f4f 0 2024-09-04T16:30:02.487 INFO:tasks.workunit.client.1.smithi193.stdout:6/160: dread - d5/d27/f30 zero size 2024-09-04T16:30:02.488 INFO:tasks.workunit.client.1.smithi193.stdout:7/187: write d9/d39/f3b [1944406,40047] 0 2024-09-04T16:30:02.490 INFO:tasks.workunit.client.1.smithi193.stdout:2/120: fsync d2/d9/db/f21 0 2024-09-04T16:30:02.493 INFO:tasks.workunit.client.1.smithi193.stdout:6/161: stat d5/c8 0 2024-09-04T16:30:02.494 INFO:tasks.workunit.client.1.smithi193.stdout:7/188: mknod d9/de/d27/c46 0 2024-09-04T16:30:02.496 INFO:tasks.workunit.client.1.smithi193.stdout:2/121: readlink d2/d9/d18/l19 0 2024-09-04T16:30:02.496 INFO:tasks.workunit.client.1.smithi193.stdout:3/180: dread - d0/d7/de/f44 zero size 2024-09-04T16:30:02.496 INFO:tasks.workunit.client.1.smithi193.stdout:5/179: dwrite d1/d8/f31 [0,4194304] 0 2024-09-04T16:30:02.499 INFO:tasks.workunit.client.1.smithi193.stdout:7/189: mknod d9/d18/c47 0 2024-09-04T16:30:02.499 INFO:tasks.workunit.client.1.smithi193.stdout:2/122: fdatasync d2/fc 0 2024-09-04T16:30:02.501 INFO:tasks.workunit.client.1.smithi193.stdout:8/174: dwrite d2/d20/d23/f1d [0,4194304] 0 2024-09-04T16:30:02.502 INFO:tasks.workunit.client.1.smithi193.stdout:0/208: dwrite f3 [0,4194304] 0 2024-09-04T16:30:02.503 INFO:tasks.workunit.client.1.smithi193.stdout:7/190: stat d9/de/c1d 0 2024-09-04T16:30:02.505 INFO:tasks.workunit.client.1.smithi193.stdout:0/209: dread - d18/f3a zero size 2024-09-04T16:30:02.509 INFO:tasks.workunit.client.1.smithi193.stdout:2/123: rename d2/d9/db/d10/d1e/c1a to d2/d14/c27 0 2024-09-04T16:30:02.509 INFO:tasks.workunit.client.1.smithi193.stdout:3/181: dread d0/d18/d1b/f37 [0,4194304] 0 2024-09-04T16:30:02.510 INFO:tasks.workunit.client.1.smithi193.stdout:0/210: symlink d18/d25/d32/l47 0 2024-09-04T16:30:02.513 INFO:tasks.workunit.client.1.smithi193.stdout:7/191: rename d9/de/c1d to d9/de/d27/c48 0 2024-09-04T16:30:02.513 INFO:tasks.workunit.client.1.smithi193.stdout:0/211: creat d18/f48 x:0 0 0 2024-09-04T16:30:02.513 INFO:tasks.workunit.client.1.smithi193.stdout:5/180: link d1/d29/c1c d1/d8/db/d15/c38 0 2024-09-04T16:30:02.514 INFO:tasks.workunit.client.1.smithi193.stdout:2/124: dread d2/fe [0,4194304] 0 2024-09-04T16:30:02.515 INFO:tasks.workunit.client.1.smithi193.stdout:0/212: dread - d18/d25/d32/f44 zero size 2024-09-04T16:30:02.517 INFO:tasks.workunit.client.1.smithi193.stdout:3/182: getdents d0/d10 0 2024-09-04T16:30:02.518 INFO:tasks.workunit.client.1.smithi193.stdout:3/183: chown d0/d3b 7355996 1 2024-09-04T16:30:02.518 INFO:tasks.workunit.client.1.smithi193.stdout:2/125: creat d2/d9/d18/f28 x:0 0 0 2024-09-04T16:30:02.520 INFO:tasks.workunit.client.1.smithi193.stdout:0/213: creat d18/d3f/f49 x:0 0 0 2024-09-04T16:30:02.521 INFO:tasks.workunit.client.1.smithi193.stdout:7/192: dwrite d9/d18/d1e/f29 [0,4194304] 0 2024-09-04T16:30:02.523 INFO:tasks.workunit.client.1.smithi193.stdout:2/126: symlink d2/d9/db/d10/d1f/l29 0 2024-09-04T16:30:02.523 INFO:tasks.workunit.client.1.smithi193.stdout:3/184: mkdir d0/d4a 0 2024-09-04T16:30:02.523 INFO:tasks.workunit.client.1.smithi193.stdout:5/181: getdents d1/d8/db 0 2024-09-04T16:30:02.527 INFO:tasks.workunit.client.1.smithi193.stdout:3/185: symlink d0/d7/de/d45/l4b 0 2024-09-04T16:30:02.528 INFO:tasks.workunit.client.1.smithi193.stdout:3/186: readlink d0/d7/l14 0 2024-09-04T16:30:02.531 INFO:tasks.workunit.client.1.smithi193.stdout:5/182: dread d1/d8/f31 [0,4194304] 0 2024-09-04T16:30:02.531 INFO:tasks.workunit.client.1.smithi193.stdout:5/183: fsync d1/d8/f22 0 2024-09-04T16:30:02.531 INFO:tasks.workunit.client.1.smithi193.stdout:3/187: truncate d0/d18/d1c/d30/f41 639111 0 2024-09-04T16:30:02.536 INFO:tasks.workunit.client.1.smithi193.stdout:5/184: mkdir d1/d29/d1e/d37/d39 0 2024-09-04T16:30:02.541 INFO:tasks.workunit.client.1.smithi193.stdout:8/175: truncate d2/d12/fd 1681042 0 2024-09-04T16:30:02.541 INFO:tasks.workunit.client.1.smithi193.stdout:8/176: unlink d2/c10 0 2024-09-04T16:30:02.542 INFO:tasks.workunit.client.1.smithi193.stdout:8/177: stat f0 0 2024-09-04T16:30:02.542 INFO:tasks.workunit.client.1.smithi193.stdout:7/193: write d9/d39/d3e/f3f [1043251,118685] 0 2024-09-04T16:30:02.543 INFO:tasks.workunit.client.1.smithi193.stdout:3/188: dwrite d0/d18/d1c/f43 [0,4194304] 0 2024-09-04T16:30:02.543 INFO:tasks.workunit.client.1.smithi193.stdout:2/127: write d2/fe [178454,71446] 0 2024-09-04T16:30:02.546 INFO:tasks.workunit.client.1.smithi193.stdout:7/194: chown d9/de/d27/f34 45425 1 2024-09-04T16:30:02.547 INFO:tasks.workunit.client.1.smithi193.stdout:8/178: fsync d2/d20/d23/d24/d25/f3a 0 2024-09-04T16:30:02.548 INFO:tasks.workunit.client.1.smithi193.stdout:3/189: symlink d0/d7/de/d45/l4c 0 2024-09-04T16:30:02.550 INFO:tasks.workunit.client.1.smithi193.stdout:7/195: chown d9/d18/c25 378 1 2024-09-04T16:30:02.551 INFO:tasks.workunit.client.1.smithi193.stdout:5/185: dwrite d1/d8/db/f1a [0,4194304] 0 2024-09-04T16:30:02.555 INFO:tasks.workunit.client.1.smithi193.stdout:8/179: symlink d2/d20/d23/d1b/l3f 0 2024-09-04T16:30:02.555 INFO:tasks.workunit.client.1.smithi193.stdout:0/214: dread f6 [0,4194304] 0 2024-09-04T16:30:02.556 INFO:tasks.workunit.client.1.smithi193.stdout:7/196: rename f6 to d9/de/f49 0 2024-09-04T16:30:02.557 INFO:tasks.workunit.client.1.smithi193.stdout:5/186: write d1/d8/f12 [1975108,16215] 0 2024-09-04T16:30:02.560 INFO:tasks.workunit.client.1.smithi193.stdout:1/194: sync 2024-09-04T16:30:02.561 INFO:tasks.workunit.client.1.smithi193.stdout:3/190: link d0/d18/d1b/d3d/c3e d0/d18/d1c/d30/c4d 0 2024-09-04T16:30:02.563 INFO:tasks.workunit.client.1.smithi193.stdout:8/180: creat d2/d20/d23/d24/d3c/f40 x:0 0 0 2024-09-04T16:30:02.665 INFO:tasks.workunit.client.0.smithi170.stderr:++ readlink -f fsstress 2024-09-04T16:30:02.666 INFO:tasks.workunit.client.0.smithi170.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-04T16:30:02.666 INFO:tasks.workunit.client.0.smithi170.stderr:+ popd 2024-09-04T16:30:02.666 INFO:tasks.workunit.client.0.smithi170.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-04T16:30:02.667 INFO:tasks.workunit.client.0.smithi170.stderr:+ popd 2024-09-04T16:30:02.667 INFO:tasks.workunit.client.0.smithi170.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-04T16:30:02.668 INFO:tasks.workunit.client.0.smithi170.stderr:++ mktemp -d -p . 2024-09-04T16:30:02.668 INFO:tasks.workunit.client.0.smithi170.stderr:+ T=./tmp.x118SjEil0 2024-09-04T16:30:02.668 INFO:tasks.workunit.client.0.smithi170.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.x118SjEil0 -l 1 -n 1000 -p 10 -v 2024-09-04T16:30:02.670 INFO:tasks.workunit.client.0.smithi170.stdout:seed = 1724994424 2024-09-04T16:30:02.671 INFO:tasks.workunit.client.0.smithi170.stdout:0/0: creat f0 x:0 0 0 2024-09-04T16:30:02.671 INFO:tasks.workunit.client.0.smithi170.stdout:0/1: dread - f0 zero size 2024-09-04T16:30:02.671 INFO:tasks.workunit.client.0.smithi170.stdout:2/0: stat - no entries 2024-09-04T16:30:02.671 INFO:tasks.workunit.client.0.smithi170.stdout:3/0: chown . 348533 1 2024-09-04T16:30:02.671 INFO:tasks.workunit.client.0.smithi170.stdout:0/2: mknod c1 0 2024-09-04T16:30:02.671 INFO:tasks.workunit.client.0.smithi170.stdout:1/0: creat f0 x:0 0 0 2024-09-04T16:30:02.671 INFO:tasks.workunit.client.0.smithi170.stdout:4/0: unlink - no file 2024-09-04T16:30:02.671 INFO:tasks.workunit.client.0.smithi170.stdout:0/3: creat f2 x:0 0 0 2024-09-04T16:30:02.671 INFO:tasks.workunit.client.0.smithi170.stdout:0/4: dread - f0 zero size 2024-09-04T16:30:02.671 INFO:tasks.workunit.client.0.smithi170.stdout:1/1: unlink f0 0 2024-09-04T16:30:02.671 INFO:tasks.workunit.client.0.smithi170.stdout:1/2: dread - no filename 2024-09-04T16:30:02.671 INFO:tasks.workunit.client.0.smithi170.stdout:1/3: truncate - no filename 2024-09-04T16:30:02.671 INFO:tasks.workunit.client.0.smithi170.stdout:1/4: link - no file 2024-09-04T16:30:02.672 INFO:tasks.workunit.client.0.smithi170.stdout:2/1: getdents . 0 2024-09-04T16:30:02.676 INFO:tasks.workunit.client.1.smithi193.stdout:3/191: creat d0/d18/d1c/d30/f4e x:0 0 0 2024-09-04T16:30:02.676 INFO:tasks.workunit.client.1.smithi193.stdout:2/128: dwrite d2/d9/d18/f1d [4194304,4194304] 0 2024-09-04T16:30:02.676 INFO:tasks.workunit.client.1.smithi193.stdout:7/197: dread d9/d18/d1e/f29 [0,4194304] 0 2024-09-04T16:30:02.676 INFO:tasks.workunit.client.1.smithi193.stdout:0/215: dwrite d18/f23 [0,4194304] 0 2024-09-04T16:30:02.676 INFO:tasks.workunit.client.1.smithi193.stdout:2/129: write d2/d9/d18/f1d [7268055,122729] 0 2024-09-04T16:30:02.676 INFO:tasks.workunit.client.1.smithi193.stdout:5/187: dwrite d1/f28 [0,4194304] 0 2024-09-04T16:30:02.676 INFO:tasks.workunit.client.1.smithi193.stdout:2/130: fsync d2/d9/db/d10/f25 0 2024-09-04T16:30:02.676 INFO:tasks.workunit.client.1.smithi193.stdout:1/195: write d1/d2b/db/f3b [1169684,110132] 0 2024-09-04T16:30:02.676 INFO:tasks.workunit.client.1.smithi193.stdout:3/192: dread d0/d18/d1c/f43 [0,4194304] 0 2024-09-04T16:30:02.676 INFO:tasks.workunit.client.1.smithi193.stdout:5/188: truncate d1/d8/f22 615005 0 2024-09-04T16:30:02.676 INFO:tasks.workunit.client.1.smithi193.stdout:3/193: read d0/d18/d1c/d30/f41 [112049,20668] 0 2024-09-04T16:30:02.677 INFO:tasks.workunit.client.1.smithi193.stdout:2/131: creat d2/f2a x:0 0 0 2024-09-04T16:30:02.677 INFO:tasks.workunit.client.1.smithi193.stdout:0/216: dread d18/f20 [0,4194304] 0 2024-09-04T16:30:02.677 INFO:tasks.workunit.client.1.smithi193.stdout:5/189: symlink d1/d8/l3a 0 2024-09-04T16:30:02.677 INFO:tasks.workunit.client.1.smithi193.stdout:7/198: dwrite d9/de/d27/f28 [0,4194304] 0 2024-09-04T16:30:02.677 INFO:tasks.workunit.client.1.smithi193.stdout:0/217: truncate d18/f3a 279620 0 2024-09-04T16:30:02.677 INFO:tasks.workunit.client.1.smithi193.stdout:5/190: write d1/d8/f34 [19276,41673] 0 2024-09-04T16:30:02.677 INFO:tasks.workunit.client.1.smithi193.stdout:3/194: unlink d0/d18/f27 0 2024-09-04T16:30:02.677 INFO:tasks.workunit.client.1.smithi193.stdout:8/181: dwrite d2/d20/d23/d1b/f28 [0,4194304] 0 2024-09-04T16:30:02.677 INFO:tasks.workunit.client.1.smithi193.stdout:7/199: mkdir d9/d39/d3e/d4a 0 2024-09-04T16:30:02.677 INFO:tasks.workunit.client.1.smithi193.stdout:4/116: sync 2024-09-04T16:30:02.677 INFO:tasks.workunit.client.1.smithi193.stdout:3/195: write d0/f47 [1893548,28405] 0 2024-09-04T16:30:02.677 INFO:tasks.workunit.client.1.smithi193.stdout:2/132: dread d2/f17 [0,4194304] 0 2024-09-04T16:30:02.677 INFO:tasks.workunit.client.1.smithi193.stdout:3/196: write d0/d7/fc [1999897,113575] 0 2024-09-04T16:30:02.678 INFO:tasks.workunit.client.1.smithi193.stdout:8/182: creat d2/d20/d23/d34/d3e/f41 x:0 0 0 2024-09-04T16:30:02.678 INFO:tasks.workunit.client.1.smithi193.stdout:8/183: chown d2/d20/d23 5575392 1 2024-09-04T16:30:02.678 INFO:tasks.workunit.client.1.smithi193.stdout:8/184: readlink d2/d12/l2c 0 2024-09-04T16:30:02.678 INFO:tasks.workunit.client.1.smithi193.stdout:5/191: link d1/d29/d1e/c20 d1/d8/db/d36/c3b 0 2024-09-04T16:30:02.678 INFO:tasks.workunit.client.1.smithi193.stdout:8/185: write d2/d20/d23/d1b/f33 [172940,92329] 0 2024-09-04T16:30:02.678 INFO:tasks.workunit.client.1.smithi193.stdout:7/200: link d9/de/d27/f37 d9/d39/d3e/d4a/f4b 0 2024-09-04T16:30:02.678 INFO:tasks.workunit.client.1.smithi193.stdout:3/197: dread d0/d18/d1c/f43 [0,4194304] 0 2024-09-04T16:30:02.678 INFO:tasks.workunit.client.1.smithi193.stdout:2/133: mknod d2/d9/d18/c2b 0 2024-09-04T16:30:02.678 INFO:tasks.workunit.client.1.smithi193.stdout:3/198: fdatasync d0/f47 0 2024-09-04T16:30:02.678 INFO:tasks.workunit.client.1.smithi193.stdout:7/201: creat d9/d18/f4c x:0 0 0 2024-09-04T16:30:02.678 INFO:tasks.workunit.client.1.smithi193.stdout:8/186: write d2/f2e [1187202,25913] 0 2024-09-04T16:30:02.678 INFO:tasks.workunit.client.1.smithi193.stdout:7/202: dread - d9/de/f23 zero size 2024-09-04T16:30:02.678 INFO:tasks.workunit.client.1.smithi193.stdout:5/192: symlink d1/d8/db/d36/l3c 0 2024-09-04T16:30:02.678 INFO:tasks.workunit.client.1.smithi193.stdout:1/196: dread d1/f1c [0,4194304] 0 2024-09-04T16:30:02.679 INFO:tasks.workunit.client.1.smithi193.stdout:5/193: fsync d1/d29/f1d 0 2024-09-04T16:30:02.679 INFO:tasks.workunit.client.1.smithi193.stdout:3/199: creat d0/d9/f4f x:0 0 0 2024-09-04T16:30:02.679 INFO:tasks.workunit.client.1.smithi193.stdout:8/187: creat d2/d20/d23/d1b/f42 x:0 0 0 2024-09-04T16:30:02.679 INFO:tasks.workunit.client.1.smithi193.stdout:7/203: mkdir d9/d39/d3e/d4d 0 2024-09-04T16:30:02.679 INFO:tasks.workunit.client.1.smithi193.stdout:2/134: dwrite d2/f4 [4194304,4194304] 0 2024-09-04T16:30:02.679 INFO:tasks.workunit.client.1.smithi193.stdout:3/200: creat d0/d18/f50 x:0 0 0 2024-09-04T16:30:02.679 INFO:tasks.workunit.client.1.smithi193.stdout:2/135: mkdir d2/d14/d2c 0 2024-09-04T16:30:02.679 INFO:tasks.workunit.client.1.smithi193.stdout:5/194: dwrite d1/f3 [0,4194304] 0 2024-09-04T16:30:02.679 INFO:tasks.workunit.client.1.smithi193.stdout:5/195: fsync d1/d8/f2d 0 2024-09-04T16:30:02.679 INFO:tasks.workunit.client.1.smithi193.stdout:8/188: write d2/d12/f19 [1234918,98579] 0 2024-09-04T16:30:02.679 INFO:tasks.workunit.client.1.smithi193.stdout:3/201: write d0/d18/d1c/d30/f41 [636742,92952] 0 2024-09-04T16:30:02.679 INFO:tasks.workunit.client.1.smithi193.stdout:1/197: write d1/d2b/db/f3f [1134439,34744] 0 2024-09-04T16:30:02.679 INFO:tasks.workunit.client.1.smithi193.stdout:1/198: stat d1 0 2024-09-04T16:30:02.679 INFO:tasks.workunit.client.1.smithi193.stdout:7/204: getdents d9/d18/d1e 0 2024-09-04T16:30:02.680 INFO:tasks.workunit.client.1.smithi193.stdout:8/189: write d2/d20/d23/d1b/f33 [25012,112194] 0 2024-09-04T16:30:02.680 INFO:tasks.workunit.client.1.smithi193.stdout:5/196: dread d1/d8/db/d23/f26 [0,4194304] 0 2024-09-04T16:30:02.680 INFO:tasks.workunit.client.1.smithi193.stdout:1/199: write d1/d2b/db/f23 [1158898,107731] 0 2024-09-04T16:30:02.680 INFO:tasks.workunit.client.1.smithi193.stdout:7/205: chown d9/de/f49 872623804 1 2024-09-04T16:30:02.680 INFO:tasks.workunit.client.1.smithi193.stdout:2/136: getdents d2/d9/db/d10/d1e 0 2024-09-04T16:30:02.680 INFO:tasks.workunit.client.1.smithi193.stdout:8/190: write d2/d20/d23/d1b/f42 [792211,60282] 0 2024-09-04T16:30:02.680 INFO:tasks.workunit.client.1.smithi193.stdout:2/137: chown d2/d14 1798 1 2024-09-04T16:30:02.680 INFO:tasks.workunit.client.1.smithi193.stdout:7/206: creat d9/d11/f4e x:0 0 0 2024-09-04T16:30:02.680 INFO:tasks.workunit.client.1.smithi193.stdout:5/197: dread d1/d8/fc [0,4194304] 0 2024-09-04T16:30:02.680 INFO:tasks.workunit.client.1.smithi193.stdout:7/207: truncate d9/de/f1f 966314 0 2024-09-04T16:30:02.680 INFO:tasks.workunit.client.1.smithi193.stdout:3/202: dwrite d0/f47 [0,4194304] 0 2024-09-04T16:30:02.680 INFO:tasks.workunit.client.1.smithi193.stdout:7/208: chown d9/d39/f3b 47723 1 2024-09-04T16:30:02.680 INFO:tasks.workunit.client.1.smithi193.stdout:8/191: link f0 d2/d12/f43 0 2024-09-04T16:30:02.680 INFO:tasks.workunit.client.1.smithi193.stdout:3/203: dread d0/d18/d1c/f43 [0,4194304] 0 2024-09-04T16:30:02.681 INFO:tasks.workunit.client.1.smithi193.stdout:7/209: unlink d9/d18/l3a 0 2024-09-04T16:30:02.681 INFO:tasks.workunit.client.1.smithi193.stdout:8/192: write d2/d12/f43 [3607944,36000] 0 2024-09-04T16:30:02.681 INFO:tasks.workunit.client.1.smithi193.stdout:8/193: write d2/f2e [584611,59191] 0 2024-09-04T16:30:02.681 INFO:tasks.workunit.client.1.smithi193.stdout:3/204: unlink d0/d9/f4f 0 2024-09-04T16:30:02.681 INFO:tasks.workunit.client.1.smithi193.stdout:3/205: chown d0/d10 3598 1 2024-09-04T16:30:02.681 INFO:tasks.workunit.client.1.smithi193.stdout:8/194: readlink d2/d20/d23/d24/d25/l39 0 2024-09-04T16:30:02.681 INFO:tasks.workunit.client.1.smithi193.stdout:7/210: unlink d9/de/f23 0 2024-09-04T16:30:02.682 INFO:tasks.workunit.client.1.smithi193.stdout:1/200: dread d1/d2b/d10/f17 [0,4194304] 0 2024-09-04T16:30:02.682 INFO:tasks.workunit.client.1.smithi193.stdout:8/195: mknod d2/d20/d23/d24/d25/c44 0 2024-09-04T16:30:02.682 INFO:tasks.workunit.client.0.smithi170.stdout:5/0: write - no filename 2024-09-04T16:30:02.682 INFO:tasks.workunit.client.0.smithi170.stdout:3/1: mknod c0 0 2024-09-04T16:30:02.682 INFO:tasks.workunit.client.0.smithi170.stdout:3/2: dwrite - no filename 2024-09-04T16:30:02.682 INFO:tasks.workunit.client.0.smithi170.stdout:3/3: fsync - no filename 2024-09-04T16:30:02.683 INFO:tasks.workunit.client.0.smithi170.stdout:3/4: fdatasync - no filename 2024-09-04T16:30:02.683 INFO:tasks.workunit.client.0.smithi170.stdout:0/5: creat f3 x:0 0 0 2024-09-04T16:30:02.683 INFO:tasks.workunit.client.0.smithi170.stdout:0/6: write f3 [586938,21350] 0 2024-09-04T16:30:02.683 INFO:tasks.workunit.client.1.smithi193.stdout:2/138: dwrite d2/f17 [0,4194304] 0 2024-09-04T16:30:02.684 INFO:tasks.workunit.client.1.smithi193.stdout:5/198: write d1/d8/fd [398257,9561] 0 2024-09-04T16:30:02.685 INFO:tasks.workunit.client.0.smithi170.stdout:1/5: mknod c1 0 2024-09-04T16:30:02.685 INFO:tasks.workunit.client.0.smithi170.stdout:1/6: dwrite - no filename 2024-09-04T16:30:02.685 INFO:tasks.workunit.client.0.smithi170.stdout:1/7: dwrite - no filename 2024-09-04T16:30:02.687 INFO:tasks.workunit.client.1.smithi193.stdout:5/199: truncate d1/f28 5137947 0 2024-09-04T16:30:02.687 INFO:tasks.workunit.client.1.smithi193.stdout:1/201: rename d1/d2b/ce to d1/d2b/d10/d2a/c43 0 2024-09-04T16:30:02.688 INFO:tasks.workunit.client.1.smithi193.stdout:7/211: mkdir d9/d39/d3e/d4d/d4f 0 2024-09-04T16:30:02.690 INFO:tasks.workunit.client.1.smithi193.stdout:8/196: dwrite d2/d20/f32 [0,4194304] 0 2024-09-04T16:30:02.690 INFO:tasks.workunit.client.0.smithi170.stdout:6/0: chown . 128384 1 2024-09-04T16:30:02.690 INFO:tasks.workunit.client.1.smithi193.stdout:1/202: read d1/f34 [690083,106881] 0 2024-09-04T16:30:02.692 INFO:tasks.workunit.client.1.smithi193.stdout:8/197: chown d2/d20/d23/l1c 2177 1 2024-09-04T16:30:02.694 INFO:tasks.workunit.client.0.smithi170.stdout:4/1: mknod c0 0 2024-09-04T16:30:02.694 INFO:tasks.workunit.client.0.smithi170.stdout:4/2: read - no filename 2024-09-04T16:30:02.695 INFO:tasks.workunit.client.0.smithi170.stdout:4/3: chown c0 0 1 2024-09-04T16:30:02.695 INFO:tasks.workunit.client.1.smithi193.stdout:5/200: dread d1/f3 [0,4194304] 0 2024-09-04T16:30:02.695 INFO:tasks.workunit.client.0.smithi170.stdout:4/4: chown c0 31711389 1 2024-09-04T16:30:02.695 INFO:tasks.workunit.client.0.smithi170.stdout:4/5: chown c0 2513 1 2024-09-04T16:30:02.696 INFO:tasks.workunit.client.0.smithi170.stdout:3/5: creat f1 x:0 0 0 2024-09-04T16:30:02.696 INFO:tasks.workunit.client.0.smithi170.stdout:3/6: fdatasync f1 0 2024-09-04T16:30:02.697 INFO:tasks.workunit.client.0.smithi170.stdout:3/7: stat f1 0 2024-09-04T16:30:02.697 INFO:tasks.workunit.client.1.smithi193.stdout:7/212: rmdir d9/d11 39 2024-09-04T16:30:02.697 INFO:tasks.workunit.client.0.smithi170.stdout:3/8: dread - f1 zero size 2024-09-04T16:30:02.700 INFO:tasks.workunit.client.0.smithi170.stdout:1/8: mknod c2 0 2024-09-04T16:30:02.702 INFO:tasks.workunit.client.0.smithi170.stdout:2/2: creat f0 x:0 0 0 2024-09-04T16:30:02.702 INFO:tasks.workunit.client.0.smithi170.stdout:2/3: stat f0 0 2024-09-04T16:30:02.702 INFO:tasks.workunit.client.0.smithi170.stdout:2/4: stat f0 0 2024-09-04T16:30:02.703 INFO:tasks.workunit.client.0.smithi170.stdout:2/5: write f0 [973978,54367] 0 2024-09-04T16:30:02.704 INFO:tasks.workunit.client.1.smithi193.stdout:8/198: creat d2/d20/d23/d24/d3c/f45 x:0 0 0 2024-09-04T16:30:02.704 INFO:tasks.workunit.client.1.smithi193.stdout:8/199: readlink d2/d20/d23/d24/d25/l37 0 2024-09-04T16:30:02.705 INFO:tasks.workunit.client.0.smithi170.stdout:7/0: write - no filename 2024-09-04T16:30:02.705 INFO:tasks.workunit.client.0.smithi170.stdout:7/1: rmdir - no directory 2024-09-04T16:30:02.706 INFO:tasks.workunit.client.1.smithi193.stdout:8/200: write d2/d20/d23/d1b/f28 [4127141,42409] 0 2024-09-04T16:30:02.707 INFO:tasks.workunit.client.0.smithi170.stdout:5/1: creat f0 x:0 0 0 2024-09-04T16:30:02.708 INFO:tasks.workunit.client.0.smithi170.stdout:5/2: chown f0 509925 1 2024-09-04T16:30:02.709 INFO:tasks.workunit.client.0.smithi170.stdout:4/6: mkdir d1 0 2024-09-04T16:30:02.710 INFO:tasks.workunit.client.0.smithi170.stdout:4/7: fsync - no filename 2024-09-04T16:30:02.711 INFO:tasks.workunit.client.1.smithi193.stdout:2/139: write d2/d9/db/d10/f12 [1176217,50326] 0 2024-09-04T16:30:02.712 INFO:tasks.workunit.client.1.smithi193.stdout:2/140: chown d2 443902 1 2024-09-04T16:30:02.712 INFO:tasks.workunit.client.0.smithi170.stdout:3/9: rename f1 to f2 0 2024-09-04T16:30:02.714 INFO:tasks.workunit.client.0.smithi170.stdout:3/10: dread - f2 zero size 2024-09-04T16:30:02.714 INFO:tasks.workunit.client.0.smithi170.stdout:0/7: rename f2 to f4 0 2024-09-04T16:30:02.715 INFO:tasks.workunit.client.1.smithi193.stdout:1/203: dread d1/d2b/d10/f1f [0,4194304] 0 2024-09-04T16:30:02.715 INFO:tasks.workunit.client.0.smithi170.stdout:3/11: dread - f2 zero size 2024-09-04T16:30:02.716 INFO:tasks.workunit.client.0.smithi170.stdout:1/9: symlink l3 0 2024-09-04T16:30:02.717 INFO:tasks.workunit.client.0.smithi170.stdout:1/10: stat c1 0 2024-09-04T16:30:02.717 INFO:tasks.workunit.client.0.smithi170.stdout:1/11: dwrite - no filename 2024-09-04T16:30:02.717 INFO:tasks.workunit.client.0.smithi170.stdout:1/12: write - no filename 2024-09-04T16:30:02.717 INFO:tasks.workunit.client.0.smithi170.stdout:1/13: dwrite - no filename 2024-09-04T16:30:02.718 INFO:tasks.workunit.client.1.smithi193.stdout:7/213: rmdir d9/d11 39 2024-09-04T16:30:02.718 INFO:tasks.workunit.client.1.smithi193.stdout:7/214: dread - d9/d18/f4c zero size 2024-09-04T16:30:02.718 INFO:tasks.workunit.client.0.smithi170.stdout:5/3: dwrite f0 [0,4194304] 0 2024-09-04T16:30:02.718 INFO:tasks.workunit.client.0.smithi170.stdout:3/12: truncate f2 40003 0 2024-09-04T16:30:02.718 INFO:tasks.workunit.client.0.smithi170.stdout:2/6: creat f1 x:0 0 0 2024-09-04T16:30:02.719 INFO:tasks.workunit.client.0.smithi170.stdout:2/7: fdatasync f0 0 2024-09-04T16:30:02.723 INFO:tasks.workunit.client.0.smithi170.stdout:2/8: dread - f1 zero size 2024-09-04T16:30:02.723 INFO:tasks.workunit.client.1.smithi193.stdout:5/201: rmdir d1/d8/d21 0 2024-09-04T16:30:02.724 INFO:tasks.workunit.client.0.smithi170.stdout:2/9: chown f1 1 1 2024-09-04T16:30:02.725 INFO:tasks.workunit.client.0.smithi170.stdout:6/1: mkdir d0 0 2024-09-04T16:30:02.725 INFO:tasks.workunit.client.0.smithi170.stdout:6/2: write - no filename 2024-09-04T16:30:02.725 INFO:tasks.workunit.client.0.smithi170.stdout:6/3: chown d0 202340793 1 2024-09-04T16:30:02.727 INFO:tasks.workunit.client.1.smithi193.stdout:1/204: unlink d1/d2b/db/d26/l3a 0 2024-09-04T16:30:02.729 INFO:tasks.workunit.client.1.smithi193.stdout:7/215: creat d9/d39/d3e/d4d/f50 x:0 0 0 2024-09-04T16:30:02.733 INFO:tasks.workunit.client.0.smithi170.stdout:5/4: dwrite f0 [0,4194304] 0 2024-09-04T16:30:02.734 INFO:tasks.workunit.client.1.smithi193.stdout:1/205: rename d1/c1d to d1/d39/c44 0 2024-09-04T16:30:02.736 INFO:tasks.workunit.client.0.smithi170.stdout:2/10: dwrite f1 [0,4194304] 0 2024-09-04T16:30:02.736 INFO:tasks.workunit.client.0.smithi170.stdout:0/8: creat f5 x:0 0 0 2024-09-04T16:30:02.736 INFO:tasks.workunit.client.1.smithi193.stdout:2/141: dwrite d2/d9/db/f21 [0,4194304] 0 2024-09-04T16:30:02.738 INFO:tasks.workunit.client.0.smithi170.stdout:0/9: read - f0 zero size 2024-09-04T16:30:02.738 INFO:tasks.workunit.client.0.smithi170.stdout:2/11: chown f1 1607752 1 2024-09-04T16:30:02.739 INFO:tasks.workunit.client.0.smithi170.stdout:1/14: creat f4 x:0 0 0 2024-09-04T16:30:02.740 INFO:tasks.workunit.client.0.smithi170.stdout:0/10: write f3 [1446890,97394] 0 2024-09-04T16:30:02.741 INFO:tasks.workunit.client.1.smithi193.stdout:9/250: sync 2024-09-04T16:30:02.741 INFO:tasks.workunit.client.1.smithi193.stdout:6/162: sync 2024-09-04T16:30:02.742 INFO:tasks.workunit.client.0.smithi170.stdout:3/13: creat f3 x:0 0 0 2024-09-04T16:30:02.746 INFO:tasks.workunit.client.1.smithi193.stdout:7/216: rename d9/d18/f2a to d9/d39/f51 0 2024-09-04T16:30:02.748 INFO:tasks.workunit.client.1.smithi193.stdout:7/217: fdatasync f8 0 2024-09-04T16:30:02.752 INFO:tasks.workunit.client.0.smithi170.stdout:7/2: symlink l0 0 2024-09-04T16:30:02.753 INFO:tasks.workunit.client.1.smithi193.stdout:7/218: dread d9/de/f1a [0,4194304] 0 2024-09-04T16:30:02.753 INFO:tasks.workunit.client.1.smithi193.stdout:2/142: unlink d2/f4 0 2024-09-04T16:30:02.755 INFO:tasks.workunit.client.0.smithi170.stdout:3/14: dwrite f3 [0,4194304] 0 2024-09-04T16:30:02.756 INFO:tasks.workunit.client.0.smithi170.stdout:4/8: mknod d1/c2 0 2024-09-04T16:30:02.757 INFO:tasks.workunit.client.0.smithi170.stdout:4/9: readlink - no filename 2024-09-04T16:30:02.757 INFO:tasks.workunit.client.1.smithi193.stdout:7/219: dwrite d9/d18/d1e/f2e [0,4194304] 0 2024-09-04T16:30:02.759 INFO:tasks.workunit.client.1.smithi193.stdout:7/220: write d9/de/d27/f28 [4910096,56619] 0 2024-09-04T16:30:02.760 INFO:tasks.workunit.client.1.smithi193.stdout:7/221: chown d9/de/f1a 124814076 1 2024-09-04T16:30:02.762 INFO:tasks.workunit.client.0.smithi170.stdout:1/15: mkdir d5 0 2024-09-04T16:30:02.763 INFO:tasks.workunit.client.1.smithi193.stdout:2/143: fdatasync d2/d9/db/f21 0 2024-09-04T16:30:02.763 INFO:tasks.workunit.client.1.smithi193.stdout:7/222: dread d9/d39/d3e/d4a/f4b [0,4194304] 0 2024-09-04T16:30:02.764 INFO:tasks.workunit.client.0.smithi170.stdout:1/16: truncate f4 527220 0 2024-09-04T16:30:02.765 INFO:tasks.workunit.client.1.smithi193.stdout:7/223: chown d9/de/f49 0 1 2024-09-04T16:30:02.765 INFO:tasks.workunit.client.1.smithi193.stdout:7/224: truncate d9/d39/f51 566094 0 2024-09-04T16:30:02.766 INFO:tasks.workunit.client.0.smithi170.stdout:0/11: creat f6 x:0 0 0 2024-09-04T16:30:02.766 INFO:tasks.workunit.client.0.smithi170.stdout:1/17: chown c1 213 1 2024-09-04T16:30:02.767 INFO:tasks.workunit.client.0.smithi170.stdout:1/18: fdatasync f4 0 2024-09-04T16:30:02.772 INFO:tasks.workunit.client.0.smithi170.stdout:7/3: creat f1 x:0 0 0 2024-09-04T16:30:02.772 INFO:tasks.workunit.client.0.smithi170.stdout:7/4: chown l0 1055422007 1 2024-09-04T16:30:02.773 INFO:tasks.workunit.client.0.smithi170.stdout:6/4: creat d0/f1 x:0 0 0 2024-09-04T16:30:02.774 INFO:tasks.workunit.client.0.smithi170.stdout:7/5: write f1 [197631,95204] 0 2024-09-04T16:30:02.785 INFO:tasks.workunit.client.0.smithi170.stdout:3/15: unlink f2 0 2024-09-04T16:30:02.786 INFO:tasks.workunit.client.0.smithi170.stdout:4/10: rmdir d1 39 2024-09-04T16:30:02.786 INFO:tasks.workunit.client.0.smithi170.stdout:6/5: read - d0/f1 zero size 2024-09-04T16:30:02.786 INFO:tasks.workunit.client.1.smithi193.stdout:1/206: dread d1/d2b/f38 [0,4194304] 0 2024-09-04T16:30:02.787 INFO:tasks.workunit.client.1.smithi193.stdout:1/207: chown d1/d2b/d1b/d28 1 1 2024-09-04T16:30:02.787 INFO:tasks.workunit.client.0.smithi170.stdout:5/5: rename f0 to f1 0 2024-09-04T16:30:02.787 INFO:tasks.workunit.client.0.smithi170.stdout:2/12: link f1 f2 0 2024-09-04T16:30:02.787 INFO:tasks.workunit.client.1.smithi193.stdout:1/208: fsync d1/d2b/f31 0 2024-09-04T16:30:02.787 INFO:tasks.workunit.client.0.smithi170.stdout:3/16: write f3 [2597540,87758] 0 2024-09-04T16:30:02.788 INFO:tasks.workunit.client.0.smithi170.stdout:0/12: creat f7 x:0 0 0 2024-09-04T16:30:02.788 INFO:tasks.workunit.client.1.smithi193.stdout:2/144: symlink d2/l2d 0 2024-09-04T16:30:02.790 INFO:tasks.workunit.client.0.smithi170.stdout:3/17: fsync f3 0 2024-09-04T16:30:02.790 INFO:tasks.workunit.client.0.smithi170.stdout:9/0: mknod c0 0 2024-09-04T16:30:02.790 INFO:tasks.workunit.client.0.smithi170.stdout:9/1: dread - no filename 2024-09-04T16:30:02.791 INFO:tasks.workunit.client.1.smithi193.stdout:5/202: link d1/d8/l3a d1/d29/d18/l3d 0 2024-09-04T16:30:02.794 INFO:tasks.workunit.client.1.smithi193.stdout:7/225: creat d9/de/d27/f52 x:0 0 0 2024-09-04T16:30:02.797 INFO:tasks.workunit.client.1.smithi193.stdout:6/163: rmdir d5/d31 0 2024-09-04T16:30:02.801 INFO:tasks.workunit.client.1.smithi193.stdout:2/145: creat d2/d9/db/f2e x:0 0 0 2024-09-04T16:30:02.803 INFO:tasks.workunit.client.1.smithi193.stdout:5/203: read d1/d8/f22 [272713,60296] 0 2024-09-04T16:30:02.803 INFO:tasks.workunit.client.1.smithi193.stdout:7/226: mkdir d9/d39/d3e/d53 0 2024-09-04T16:30:02.806 INFO:tasks.workunit.client.1.smithi193.stdout:6/164: symlink d5/de/d15/d1b/l32 0 2024-09-04T16:30:02.807 INFO:tasks.workunit.client.1.smithi193.stdout:6/165: write d5/de/f18 [2721874,50535] 0 2024-09-04T16:30:02.810 INFO:tasks.workunit.client.1.smithi193.stdout:9/251: link d2/d4/c46 d2/d18/d2f/c50 0 2024-09-04T16:30:02.810 INFO:tasks.workunit.client.1.smithi193.stdout:7/227: dwrite d9/de/f1f [0,4194304] 0 2024-09-04T16:30:02.810 INFO:tasks.workunit.client.1.smithi193.stdout:0/218: sync 2024-09-04T16:30:02.810 INFO:tasks.workunit.client.1.smithi193.stdout:4/117: sync 2024-09-04T16:30:02.811 INFO:tasks.workunit.client.1.smithi193.stdout:1/209: creat d1/d2b/f45 x:0 0 0 2024-09-04T16:30:02.815 INFO:tasks.workunit.client.1.smithi193.stdout:5/204: mkdir d1/d29/d1e/d37/d39/d3e 0 2024-09-04T16:30:02.816 INFO:tasks.workunit.client.1.smithi193.stdout:5/205: chown d1/d8/db/d36 973557 1 2024-09-04T16:30:02.817 INFO:tasks.workunit.client.1.smithi193.stdout:2/146: dread d2/fc [4194304,4194304] 0 2024-09-04T16:30:02.819 INFO:tasks.workunit.client.1.smithi193.stdout:7/228: creat d9/de/f54 x:0 0 0 2024-09-04T16:30:02.819 INFO:tasks.workunit.client.1.smithi193.stdout:5/206: read d1/d8/db/d23/f25 [354954,113536] 0 2024-09-04T16:30:02.820 INFO:tasks.workunit.client.1.smithi193.stdout:5/207: fsync d1/f28 0 2024-09-04T16:30:02.821 INFO:tasks.workunit.client.1.smithi193.stdout:7/229: read d9/d39/d3e/f3f [644543,90270] 0 2024-09-04T16:30:02.823 INFO:tasks.workunit.client.1.smithi193.stdout:7/230: truncate d9/d18/d1e/f43 430108 0 2024-09-04T16:30:02.823 INFO:tasks.workunit.client.1.smithi193.stdout:6/166: mkdir d5/d33 0 2024-09-04T16:30:02.825 INFO:tasks.workunit.client.1.smithi193.stdout:4/118: unlink d3/l13 0 2024-09-04T16:30:02.825 INFO:tasks.workunit.client.1.smithi193.stdout:5/208: dread d1/d8/db/f1a [0,4194304] 0 2024-09-04T16:30:02.826 INFO:tasks.workunit.client.1.smithi193.stdout:2/147: symlink d2/l2f 0 2024-09-04T16:30:02.837 INFO:tasks.workunit.client.1.smithi193.stdout:6/167: mkdir d5/de/d15/d1b/d34 0 2024-09-04T16:30:02.839 INFO:tasks.workunit.client.1.smithi193.stdout:7/231: rename d9/de/d27/f28 to d9/d18/d22/d2b/f55 0 2024-09-04T16:30:02.843 INFO:tasks.workunit.client.1.smithi193.stdout:8/201: sync 2024-09-04T16:30:02.843 INFO:tasks.workunit.client.1.smithi193.stdout:3/206: sync 2024-09-04T16:30:02.844 INFO:tasks.workunit.client.1.smithi193.stdout:8/202: dread - d2/d20/d23/d24/d25/f2f zero size 2024-09-04T16:30:02.846 INFO:tasks.workunit.client.1.smithi193.stdout:8/203: dread d2/d20/d23/f29 [0,4194304] 0 2024-09-04T16:30:02.847 INFO:tasks.workunit.client.1.smithi193.stdout:1/210: link d1/d2b/d1b/d28/f35 d1/d39/f46 0 2024-09-04T16:30:02.849 INFO:tasks.workunit.client.1.smithi193.stdout:6/168: dread - d5/de/f2a zero size 2024-09-04T16:30:02.849 INFO:tasks.workunit.client.1.smithi193.stdout:8/204: dread d2/d20/f32 [0,4194304] 0 2024-09-04T16:30:02.850 INFO:tasks.workunit.client.1.smithi193.stdout:8/205: chown d2/d20/d23/d24/d25/f3a 0 1 2024-09-04T16:30:02.853 INFO:tasks.workunit.client.1.smithi193.stdout:4/119: link f0 d3/d1a/d21/f2c 0 2024-09-04T16:30:02.857 INFO:tasks.workunit.client.1.smithi193.stdout:0/219: truncate f17 492793 0 2024-09-04T16:30:02.857 INFO:tasks.workunit.client.1.smithi193.stdout:0/220: fdatasync d18/f23 0 2024-09-04T16:30:02.857 INFO:tasks.workunit.client.1.smithi193.stdout:0/221: stat l8 0 2024-09-04T16:30:02.858 INFO:tasks.workunit.client.1.smithi193.stdout:3/207: truncate d0/f3 3451945 0 2024-09-04T16:30:02.860 INFO:tasks.workunit.client.1.smithi193.stdout:9/252: truncate d2/d8/f4f 711911 0 2024-09-04T16:30:02.862 INFO:tasks.workunit.client.1.smithi193.stdout:1/211: symlink d1/d2b/db/d26/l47 0 2024-09-04T16:30:02.863 INFO:tasks.workunit.client.1.smithi193.stdout:6/169: rename f3 to d5/d27/f35 0 2024-09-04T16:30:02.865 INFO:tasks.workunit.client.1.smithi193.stdout:8/206: mkdir d2/d20/d23/d34/d46 0 2024-09-04T16:30:02.869 INFO:tasks.workunit.client.1.smithi193.stdout:5/209: rmdir d1/d8/db/d15/d32 0 2024-09-04T16:30:02.871 INFO:tasks.workunit.client.1.smithi193.stdout:2/148: rmdir d2/d14/d2c 0 2024-09-04T16:30:02.871 INFO:tasks.workunit.client.1.smithi193.stdout:2/149: stat d2/d9/db/d10/d1e 0 2024-09-04T16:30:02.874 INFO:tasks.workunit.client.1.smithi193.stdout:0/222: mknod d18/d3f/c4a 0 2024-09-04T16:30:02.876 INFO:tasks.workunit.client.1.smithi193.stdout:9/253: mkdir d2/d18/d2f/d51 0 2024-09-04T16:30:02.881 INFO:tasks.workunit.client.1.smithi193.stdout:3/208: rename d0/d4a to d0/d18/d1c/d51 0 2024-09-04T16:30:02.886 INFO:tasks.workunit.client.1.smithi193.stdout:7/232: link d9/c32 d9/d18/d1e/c56 0 2024-09-04T16:30:02.887 INFO:tasks.workunit.client.1.smithi193.stdout:7/233: truncate d9/d18/f4c 721826 0 2024-09-04T16:30:02.888 INFO:tasks.workunit.client.1.smithi193.stdout:4/120: link d3/d1a/d21/f2c d3/d1a/d2a/f2d 0 2024-09-04T16:30:02.891 INFO:tasks.workunit.client.1.smithi193.stdout:5/210: rmdir d1/d8/db 39 2024-09-04T16:30:02.891 INFO:tasks.workunit.client.1.smithi193.stdout:8/207: dwrite d2/d20/d23/f29 [0,4194304] 0 2024-09-04T16:30:02.894 INFO:tasks.workunit.client.1.smithi193.stdout:9/254: unlink d2/d8/c32 0 2024-09-04T16:30:02.899 INFO:tasks.workunit.client.1.smithi193.stdout:2/150: rename d2/d9/db/d10/d1f/l29 to d2/l30 0 2024-09-04T16:30:02.901 INFO:tasks.workunit.client.1.smithi193.stdout:3/209: stat d0/d18/d1c/d30/c4d 0 2024-09-04T16:30:02.902 INFO:tasks.workunit.client.1.smithi193.stdout:6/170: mknod d5/de/d15/d1b/d34/c36 0 2024-09-04T16:30:02.906 INFO:tasks.workunit.client.1.smithi193.stdout:7/234: mknod d9/de/d27/c57 0 2024-09-04T16:30:02.907 INFO:tasks.workunit.client.1.smithi193.stdout:7/235: write d9/de/d27/f34 [156511,22305] 0 2024-09-04T16:30:02.909 INFO:tasks.workunit.client.1.smithi193.stdout:5/211: unlink d1/d8/f31 0 2024-09-04T16:30:02.909 INFO:tasks.workunit.client.1.smithi193.stdout:5/212: readlink d1/d8/l3a 0 2024-09-04T16:30:02.913 INFO:tasks.workunit.client.1.smithi193.stdout:9/255: mkdir d2/d18/d2f/d22/d30/d52 0 2024-09-04T16:30:02.914 INFO:tasks.workunit.client.1.smithi193.stdout:2/151: creat d2/d9/d18/f31 x:0 0 0 2024-09-04T16:30:02.917 INFO:tasks.workunit.client.1.smithi193.stdout:8/208: dread d2/d12/fd [0,4194304] 0 2024-09-04T16:30:02.919 INFO:tasks.workunit.client.1.smithi193.stdout:9/256: dwrite d2/d8/d15/f31 [0,4194304] 0 2024-09-04T16:30:02.919 INFO:tasks.workunit.client.1.smithi193.stdout:7/236: mknod d9/d18/d1e/c58 0 2024-09-04T16:30:02.921 INFO:tasks.workunit.client.1.smithi193.stdout:5/213: mkdir d1/d29/d1e/d37/d3f 0 2024-09-04T16:30:02.924 INFO:tasks.workunit.client.1.smithi193.stdout:2/152: symlink d2/d9/db/d10/l32 0 2024-09-04T16:30:02.925 INFO:tasks.workunit.client.1.smithi193.stdout:3/210: dread - d0/d18/d1b/f3c zero size 2024-09-04T16:30:02.931 INFO:tasks.workunit.client.1.smithi193.stdout:8/209: creat d2/d20/f47 x:0 0 0 2024-09-04T16:30:02.934 INFO:tasks.workunit.client.1.smithi193.stdout:7/237: symlink d9/de/d27/l59 0 2024-09-04T16:30:02.934 INFO:tasks.workunit.client.1.smithi193.stdout:8/210: dread d2/d12/f19 [0,4194304] 0 2024-09-04T16:30:02.938 INFO:tasks.workunit.client.1.smithi193.stdout:0/223: link c11 d18/d25/c4b 0 2024-09-04T16:30:02.940 INFO:tasks.workunit.client.1.smithi193.stdout:7/238: dwrite d9/de/d27/f35 [0,4194304] 0 2024-09-04T16:30:02.941 INFO:tasks.workunit.client.1.smithi193.stdout:7/239: chown d9/d39/d3e/d4d/f50 25787 1 2024-09-04T16:30:02.944 INFO:tasks.workunit.client.1.smithi193.stdout:1/212: sync 2024-09-04T16:30:02.948 INFO:tasks.workunit.client.1.smithi193.stdout:4/121: link d3/f9 d3/f2e 0 2024-09-04T16:30:02.952 INFO:tasks.workunit.client.1.smithi193.stdout:9/257: mknod d2/d8/d4d/c53 0 2024-09-04T16:30:02.952 INFO:tasks.workunit.client.1.smithi193.stdout:9/258: write d2/f1c [1840107,109293] 0 2024-09-04T16:30:02.954 INFO:tasks.workunit.client.1.smithi193.stdout:8/211: unlink d2/d20/d23/d24/d3c/f40 0 2024-09-04T16:30:02.957 INFO:tasks.workunit.client.1.smithi193.stdout:5/214: mkdir d1/d8/db/d36/d40 0 2024-09-04T16:30:02.962 INFO:tasks.workunit.client.1.smithi193.stdout:7/240: creat d9/de/f5a x:0 0 0 2024-09-04T16:30:02.963 INFO:tasks.workunit.client.1.smithi193.stdout:7/241: chown d9/de/d27/f35 2433835 1 2024-09-04T16:30:02.964 INFO:tasks.workunit.client.1.smithi193.stdout:2/153: creat d2/d9/db/d10/d1f/d22/f33 x:0 0 0 2024-09-04T16:30:02.967 INFO:tasks.workunit.client.1.smithi193.stdout:6/171: getdents d5/de/d15/d1b 0 2024-09-04T16:30:02.967 INFO:tasks.workunit.client.1.smithi193.stdout:6/172: fsync d5/f20 0 2024-09-04T16:30:02.970 INFO:tasks.workunit.client.1.smithi193.stdout:1/213: rename d1/d2b/db/d26 to d1/d39/d48 0 2024-09-04T16:30:02.971 INFO:tasks.workunit.client.1.smithi193.stdout:1/214: chown d1/d2b/d1b/d28/f35 198 1 2024-09-04T16:30:02.972 INFO:tasks.workunit.client.1.smithi193.stdout:6/173: dwrite d5/d27/f30 [0,4194304] 0 2024-09-04T16:30:02.973 INFO:tasks.workunit.client.1.smithi193.stdout:4/122: stat d3/c8 0 2024-09-04T16:30:02.974 INFO:tasks.workunit.client.1.smithi193.stdout:4/123: readlink d3/d1a/d2a/l2b 0 2024-09-04T16:30:02.975 INFO:tasks.workunit.client.1.smithi193.stdout:4/124: read - d3/f28 zero size 2024-09-04T16:30:02.979 INFO:tasks.workunit.client.1.smithi193.stdout:3/211: dwrite d0/d7/de/d45/f46 [0,4194304] 0 2024-09-04T16:30:02.981 INFO:tasks.workunit.client.1.smithi193.stdout:8/212: truncate d2/f8 5307200 0 2024-09-04T16:30:02.984 INFO:tasks.workunit.client.1.smithi193.stdout:9/259: dwrite d2/d8/d15/f1b [0,4194304] 0 2024-09-04T16:30:02.985 INFO:tasks.workunit.client.1.smithi193.stdout:4/125: dread d3/fe [0,4194304] 0 2024-09-04T16:30:02.987 INFO:tasks.workunit.client.1.smithi193.stdout:0/224: link d18/f19 d18/f4c 0 2024-09-04T16:30:02.992 INFO:tasks.workunit.client.1.smithi193.stdout:2/154: mknod d2/d9/db/d10/d1f/c34 0 2024-09-04T16:30:02.992 INFO:tasks.workunit.client.1.smithi193.stdout:1/215: mknod d1/d2b/db/c49 0 2024-09-04T16:30:02.994 INFO:tasks.workunit.client.1.smithi193.stdout:2/155: truncate d2/d9/d18/f31 900404 0 2024-09-04T16:30:02.995 INFO:tasks.workunit.client.1.smithi193.stdout:8/213: creat d2/d20/d23/d1b/f48 x:0 0 0 2024-09-04T16:30:02.995 INFO:tasks.workunit.client.1.smithi193.stdout:3/212: truncate d0/d18/d1b/f3f 616983 0 2024-09-04T16:30:02.996 INFO:tasks.workunit.client.1.smithi193.stdout:5/215: unlink d1/d29/d18/l3d 0 2024-09-04T16:30:02.999 INFO:tasks.workunit.client.1.smithi193.stdout:7/242: fdatasync d9/d11/f17 0 2024-09-04T16:30:03.000 INFO:tasks.workunit.client.1.smithi193.stdout:7/243: write d9/d18/d22/d2b/f33 [1168992,25286] 0 2024-09-04T16:30:03.002 INFO:tasks.workunit.client.1.smithi193.stdout:1/216: mknod d1/d2b/db/c4a 0 2024-09-04T16:30:03.003 INFO:tasks.workunit.client.1.smithi193.stdout:2/156: creat d2/f35 x:0 0 0 2024-09-04T16:30:03.004 INFO:tasks.workunit.client.1.smithi193.stdout:1/217: write d1/d2b/f14 [2043657,21520] 0 2024-09-04T16:30:03.004 INFO:tasks.workunit.client.1.smithi193.stdout:1/218: read - d1/d39/f46 zero size 2024-09-04T16:30:03.005 INFO:tasks.workunit.client.1.smithi193.stdout:8/214: creat d2/d20/d23/d24/f49 x:0 0 0 2024-09-04T16:30:03.007 INFO:tasks.workunit.client.1.smithi193.stdout:8/215: write d2/d20/d23/f29 [5141355,123091] 0 2024-09-04T16:30:03.009 INFO:tasks.workunit.client.1.smithi193.stdout:9/260: creat d2/d18/d2f/d51/f54 x:0 0 0 2024-09-04T16:30:03.012 INFO:tasks.workunit.client.1.smithi193.stdout:2/157: dwrite d2/d9/db/f2e [0,4194304] 0 2024-09-04T16:30:03.016 INFO:tasks.workunit.client.1.smithi193.stdout:6/174: creat d5/de/d15/f37 x:0 0 0 2024-09-04T16:30:03.017 INFO:tasks.workunit.client.1.smithi193.stdout:8/216: dwrite f0 [4194304,4194304] 0 2024-09-04T16:30:03.017 INFO:tasks.workunit.client.1.smithi193.stdout:6/175: readlink d5/l22 0 2024-09-04T16:30:03.025 INFO:tasks.workunit.client.1.smithi193.stdout:1/219: rmdir d1/d2b/d10 39 2024-09-04T16:30:03.027 INFO:tasks.workunit.client.1.smithi193.stdout:2/158: dwrite d2/d9/db/f23 [0,4194304] 0 2024-09-04T16:30:03.030 INFO:tasks.workunit.client.1.smithi193.stdout:7/244: dwrite d9/d18/d22/d2b/f55 [4194304,4194304] 0 2024-09-04T16:30:03.030 INFO:tasks.workunit.client.1.smithi193.stdout:3/213: rename d0/d18/d1b/f2d to d0/d7/de/d45/f52 0 2024-09-04T16:30:03.034 INFO:tasks.workunit.client.1.smithi193.stdout:5/216: creat d1/d29/d1e/d37/d39/d3e/f41 x:0 0 0 2024-09-04T16:30:03.040 INFO:tasks.workunit.client.1.smithi193.stdout:4/126: write d3/d1a/d21/f22 [4696576,59885] 0 2024-09-04T16:30:03.041 INFO:tasks.workunit.client.1.smithi193.stdout:2/159: dwrite d2/d9/db/fd [4194304,4194304] 0 2024-09-04T16:30:03.042 INFO:tasks.workunit.client.1.smithi193.stdout:2/160: readlink d2/l2f 0 2024-09-04T16:30:03.043 INFO:tasks.workunit.client.1.smithi193.stdout:6/176: dread d5/de/d15/d1b/f1e [0,4194304] 0 2024-09-04T16:30:03.044 INFO:tasks.workunit.client.1.smithi193.stdout:8/217: chown d2/d12/fe 4913 1 2024-09-04T16:30:03.045 INFO:tasks.workunit.client.1.smithi193.stdout:8/218: fsync d2/f3 0 2024-09-04T16:30:03.046 INFO:tasks.workunit.client.1.smithi193.stdout:8/219: truncate d2/d20/f2d 1042295 0 2024-09-04T16:30:03.049 INFO:tasks.workunit.client.1.smithi193.stdout:2/161: dwrite d2/d9/db/d10/d1f/d22/f33 [0,4194304] 0 2024-09-04T16:30:03.052 INFO:tasks.workunit.client.1.smithi193.stdout:3/214: mknod d0/d3b/c53 0 2024-09-04T16:30:03.052 INFO:tasks.workunit.client.1.smithi193.stdout:3/215: chown d0/d18/f50 28076821 1 2024-09-04T16:30:03.053 INFO:tasks.workunit.client.1.smithi193.stdout:3/216: chown d0/d7/de/d45/f46 12 1 2024-09-04T16:30:03.058 INFO:tasks.workunit.client.1.smithi193.stdout:0/225: write f17 [1302450,20020] 0 2024-09-04T16:30:03.058 INFO:tasks.workunit.client.1.smithi193.stdout:5/217: chown d1/c14 575 1 2024-09-04T16:30:03.061 INFO:tasks.workunit.client.1.smithi193.stdout:4/127: write f0 [3650413,79429] 0 2024-09-04T16:30:03.065 INFO:tasks.workunit.client.1.smithi193.stdout:0/226: dwrite f3 [0,4194304] 0 2024-09-04T16:30:03.067 INFO:tasks.workunit.client.1.smithi193.stdout:0/227: write d18/d25/d3b/f41 [1241358,27462] 0 2024-09-04T16:30:03.067 INFO:tasks.workunit.client.1.smithi193.stdout:8/220: fdatasync d2/d12/f19 0 2024-09-04T16:30:03.068 INFO:tasks.workunit.client.1.smithi193.stdout:0/228: chown l7 9 1 2024-09-04T16:30:03.069 INFO:tasks.workunit.client.1.smithi193.stdout:8/221: truncate d2/d20/d23/d1b/f42 1195890 0 2024-09-04T16:30:03.073 INFO:tasks.workunit.client.1.smithi193.stdout:3/217: mknod d0/d18/d1c/c54 0 2024-09-04T16:30:03.074 INFO:tasks.workunit.client.1.smithi193.stdout:3/218: write d0/d7/de/f22 [863571,17140] 0 2024-09-04T16:30:03.075 INFO:tasks.workunit.client.1.smithi193.stdout:3/219: read - d0/d10/f38 zero size 2024-09-04T16:30:03.076 INFO:tasks.workunit.client.1.smithi193.stdout:7/245: creat d9/d39/d3e/d4a/f5b x:0 0 0 2024-09-04T16:30:03.076 INFO:tasks.workunit.client.1.smithi193.stdout:7/246: readlink d9/d11/l24 0 2024-09-04T16:30:03.086 INFO:tasks.workunit.client.1.smithi193.stdout:8/222: mkdir d2/d20/d23/d34/d3e/d4a 0 2024-09-04T16:30:03.088 INFO:tasks.workunit.client.1.smithi193.stdout:3/220: mkdir d0/d10/d24/d55 0 2024-09-04T16:30:03.089 INFO:tasks.workunit.client.1.smithi193.stdout:3/221: stat d0/d10/d24/d55 0 2024-09-04T16:30:03.090 INFO:tasks.workunit.client.1.smithi193.stdout:7/247: truncate d9/d39/d3e/f3f 1713737 0 2024-09-04T16:30:03.091 INFO:tasks.workunit.client.1.smithi193.stdout:9/261: getdents d2/d8/d25 0 2024-09-04T16:30:03.092 INFO:tasks.workunit.client.1.smithi193.stdout:7/248: stat d9/d39/f51 0 2024-09-04T16:30:03.093 INFO:tasks.workunit.client.0.smithi170.stdout:5/6: write f1 [3159635,18436] 0 2024-09-04T16:30:03.094 INFO:tasks.workunit.client.1.smithi193.stdout:1/220: truncate d1/d2b/db/f3f 2653383 0 2024-09-04T16:30:03.095 INFO:tasks.workunit.client.1.smithi193.stdout:8/223: dwrite d2/d20/d23/d24/d3c/f45 [0,4194304] 0 2024-09-04T16:30:03.096 INFO:tasks.workunit.client.1.smithi193.stdout:2/162: creat d2/d9/f36 x:0 0 0 2024-09-04T16:30:03.097 INFO:tasks.workunit.client.0.smithi170.stdout:6/6: creat d0/f2 x:0 0 0 2024-09-04T16:30:03.097 INFO:tasks.workunit.client.0.smithi170.stdout:6/7: stat d0 0 2024-09-04T16:30:03.098 INFO:tasks.workunit.client.1.smithi193.stdout:1/221: read d1/f34 [502456,30970] 0 2024-09-04T16:30:03.098 INFO:tasks.workunit.client.1.smithi193.stdout:6/177: dwrite d5/de/f2a [0,4194304] 0 2024-09-04T16:30:03.099 INFO:tasks.workunit.client.1.smithi193.stdout:6/178: dread - d5/de/d15/f37 zero size 2024-09-04T16:30:03.099 INFO:tasks.workunit.client.1.smithi193.stdout:1/222: read d1/f34 [712714,115395] 0 2024-09-04T16:30:03.100 INFO:tasks.workunit.client.1.smithi193.stdout:5/218: mkdir d1/d29/d18/d42 0 2024-09-04T16:30:03.102 INFO:tasks.workunit.client.0.smithi170.stdout:2/13: dread f1 [0,4194304] 0 2024-09-04T16:30:03.103 INFO:tasks.workunit.client.1.smithi193.stdout:0/229: creat d18/d25/f4d x:0 0 0 2024-09-04T16:30:03.104 INFO:tasks.workunit.client.1.smithi193.stdout:0/230: write d18/d25/d32/f44 [466181,70546] 0 2024-09-04T16:30:03.104 INFO:tasks.workunit.client.1.smithi193.stdout:0/231: dread - d18/d25/f4d zero size 2024-09-04T16:30:03.104 INFO:tasks.workunit.client.0.smithi170.stdout:0/13: mknod c8 0 2024-09-04T16:30:03.105 INFO:tasks.workunit.client.1.smithi193.stdout:0/232: chown lc 43 1 2024-09-04T16:30:03.108 INFO:tasks.workunit.client.0.smithi170.stdout:9/2: unlink c0 0 2024-09-04T16:30:03.108 INFO:tasks.workunit.client.0.smithi170.stdout:9/3: write - no filename 2024-09-04T16:30:03.108 INFO:tasks.workunit.client.0.smithi170.stdout:9/4: chown . 0 1 2024-09-04T16:30:03.108 INFO:tasks.workunit.client.0.smithi170.stdout:9/5: rename - no filename 2024-09-04T16:30:03.111 INFO:tasks.workunit.client.0.smithi170.stdout:3/18: unlink f3 0 2024-09-04T16:30:03.113 INFO:tasks.workunit.client.1.smithi193.stdout:3/222: rename d0/d18/d1c/f43 to d0/d18/d1c/d51/f56 0 2024-09-04T16:30:03.114 INFO:tasks.workunit.client.1.smithi193.stdout:8/224: mkdir d2/d20/d23/d34/d4b 0 2024-09-04T16:30:03.115 INFO:tasks.workunit.client.1.smithi193.stdout:8/225: write d2/d20/f47 [255393,7115] 0 2024-09-04T16:30:03.116 INFO:tasks.workunit.client.1.smithi193.stdout:2/163: creat d2/d9/d18/f37 x:0 0 0 2024-09-04T16:30:03.116 INFO:tasks.workunit.client.0.smithi170.stdout:4/11: rmdir d1 39 2024-09-04T16:30:03.116 INFO:tasks.workunit.client.0.smithi170.stdout:4/12: dread - no filename 2024-09-04T16:30:03.117 INFO:tasks.workunit.client.1.smithi193.stdout:6/179: mknod d5/d27/c38 0 2024-09-04T16:30:03.119 INFO:tasks.workunit.client.1.smithi193.stdout:5/219: creat d1/d29/d1e/d37/f43 x:0 0 0 2024-09-04T16:30:03.120 INFO:tasks.workunit.client.0.smithi170.stdout:6/8: symlink d0/l3 0 2024-09-04T16:30:03.120 INFO:tasks.workunit.client.0.smithi170.stdout:6/9: read - d0/f2 zero size 2024-09-04T16:30:03.121 INFO:tasks.workunit.client.1.smithi193.stdout:5/220: dread - d1/d29/d1e/d37/d39/d3e/f41 zero size 2024-09-04T16:30:03.121 INFO:tasks.workunit.client.1.smithi193.stdout:0/233: creat d18/d3f/f4e x:0 0 0 2024-09-04T16:30:03.122 INFO:tasks.workunit.client.1.smithi193.stdout:2/164: dwrite d2/fe [0,4194304] 0 2024-09-04T16:30:03.123 INFO:tasks.workunit.client.1.smithi193.stdout:0/234: dread - d18/d25/f29 zero size 2024-09-04T16:30:03.124 INFO:tasks.workunit.client.0.smithi170.stdout:0/14: rename f7 to f9 0 2024-09-04T16:30:03.124 INFO:tasks.workunit.client.0.smithi170.stdout:0/15: dread - f5 zero size 2024-09-04T16:30:03.126 INFO:tasks.workunit.client.0.smithi170.stdout:9/6: creat f1 x:0 0 0 2024-09-04T16:30:03.130 INFO:tasks.workunit.client.0.smithi170.stdout:3/19: creat f4 x:0 0 0 2024-09-04T16:30:03.131 INFO:tasks.workunit.client.0.smithi170.stdout:3/20: rmdir - no directory 2024-09-04T16:30:03.132 INFO:tasks.workunit.client.1.smithi193.stdout:5/221: dwrite d1/d8/f12 [0,4194304] 0 2024-09-04T16:30:03.133 INFO:tasks.workunit.client.0.smithi170.stdout:1/19: rmdir d5 0 2024-09-04T16:30:03.134 INFO:tasks.workunit.client.1.smithi193.stdout:2/165: dwrite d2/d9/d18/f1d [0,4194304] 0 2024-09-04T16:30:03.136 INFO:tasks.workunit.client.1.smithi193.stdout:8/226: unlink d2/d20/d23/d1b/f42 0 2024-09-04T16:30:03.137 INFO:tasks.workunit.client.1.smithi193.stdout:8/227: chown d2/d20/d23/d34/d3e/d4a 253 1 2024-09-04T16:30:03.141 INFO:tasks.workunit.client.0.smithi170.stdout:5/7: link f1 f2 0 2024-09-04T16:30:03.143 INFO:tasks.workunit.client.0.smithi170.stdout:6/10: creat d0/f4 x:0 0 0 2024-09-04T16:30:03.148 INFO:tasks.workunit.client.1.smithi193.stdout:0/235: mknod d18/c4f 0 2024-09-04T16:30:03.149 INFO:tasks.workunit.client.1.smithi193.stdout:7/249: rmdir d9/de/d41 0 2024-09-04T16:30:03.149 INFO:tasks.workunit.client.1.smithi193.stdout:0/236: chown d18/d25/l3d 13447 1 2024-09-04T16:30:03.149 INFO:tasks.workunit.client.1.smithi193.stdout:6/180: dread d5/f11 [0,4194304] 0 2024-09-04T16:30:03.150 INFO:tasks.workunit.client.0.smithi170.stdout:9/7: mkdir d2 0 2024-09-04T16:30:03.150 INFO:tasks.workunit.client.1.smithi193.stdout:6/181: chown d5/c21 9817887 1 2024-09-04T16:30:03.151 INFO:tasks.workunit.client.0.smithi170.stdout:9/8: write f1 [175361,36794] 0 2024-09-04T16:30:03.151 INFO:tasks.workunit.client.1.smithi193.stdout:7/250: read - d9/d11/f4e zero size 2024-09-04T16:30:03.151 INFO:tasks.workunit.client.0.smithi170.stdout:1/20: symlink l6 0 2024-09-04T16:30:03.152 INFO:tasks.workunit.client.0.smithi170.stdout:1/21: fdatasync f4 0 2024-09-04T16:30:03.152 INFO:tasks.workunit.client.1.smithi193.stdout:7/251: write d9/d11/f4e [402796,33452] 0 2024-09-04T16:30:03.153 INFO:tasks.workunit.client.0.smithi170.stdout:1/22: read f4 [379299,110476] 0 2024-09-04T16:30:03.153 INFO:tasks.workunit.client.1.smithi193.stdout:7/252: dread - d9/d39/d3e/d4d/f50 zero size 2024-09-04T16:30:03.153 INFO:tasks.workunit.client.1.smithi193.stdout:5/222: symlink d1/d8/db/d15/d2b/l44 0 2024-09-04T16:30:03.154 INFO:tasks.workunit.client.0.smithi170.stdout:4/13: creat d1/f3 x:0 0 0 2024-09-04T16:30:03.156 INFO:tasks.workunit.client.0.smithi170.stdout:5/8: write f1 [5188342,89564] 0 2024-09-04T16:30:03.157 INFO:tasks.workunit.client.1.smithi193.stdout:2/166: mkdir d2/d9/db/d10/d38 0 2024-09-04T16:30:03.161 INFO:tasks.workunit.client.0.smithi170.stdout:5/9: write f2 [2998129,97262] 0 2024-09-04T16:30:03.161 INFO:tasks.workunit.client.0.smithi170.stdout:6/11: creat d0/f5 x:0 0 0 2024-09-04T16:30:03.161 INFO:tasks.workunit.client.0.smithi170.stdout:5/10: fdatasync f2 0 2024-09-04T16:30:03.161 INFO:tasks.workunit.client.0.smithi170.stdout:6/12: truncate d0/f2 910499 0 2024-09-04T16:30:03.161 INFO:tasks.workunit.client.0.smithi170.stdout:6/13: fsync d0/f1 0 2024-09-04T16:30:03.161 INFO:tasks.workunit.client.0.smithi170.stdout:6/14: chown d0/f5 5551837 1 2024-09-04T16:30:03.165 INFO:tasks.workunit.client.0.smithi170.stdout:0/16: write f4 [501914,74308] 0 2024-09-04T16:30:03.165 INFO:tasks.workunit.client.0.smithi170.stdout:0/17: fdatasync f0 0 2024-09-04T16:30:03.167 INFO:tasks.workunit.client.0.smithi170.stdout:1/23: rename c2 to c7 0 2024-09-04T16:30:03.168 INFO:tasks.workunit.client.1.smithi193.stdout:0/237: symlink d18/l50 0 2024-09-04T16:30:03.174 INFO:tasks.workunit.client.0.smithi170.stdout:5/11: creat f3 x:0 0 0 2024-09-04T16:30:03.175 INFO:tasks.workunit.client.0.smithi170.stdout:2/14: getdents . 0 2024-09-04T16:30:03.176 INFO:tasks.workunit.client.0.smithi170.stdout:6/15: creat d0/f6 x:0 0 0 2024-09-04T16:30:03.178 INFO:tasks.workunit.client.1.smithi193.stdout:9/262: rename d2/d4/f17 to d2/d8/f55 0 2024-09-04T16:30:03.178 INFO:tasks.workunit.client.0.smithi170.stdout:3/21: link c0 c5 0 2024-09-04T16:30:03.178 INFO:tasks.workunit.client.0.smithi170.stdout:3/22: fsync f4 0 2024-09-04T16:30:03.179 INFO:tasks.workunit.client.1.smithi193.stdout:3/223: getdents d0 0 2024-09-04T16:30:03.179 INFO:tasks.workunit.client.0.smithi170.stdout:3/23: stat f4 0 2024-09-04T16:30:03.180 INFO:tasks.workunit.client.0.smithi170.stdout:3/24: dread - f4 zero size 2024-09-04T16:30:03.180 INFO:tasks.workunit.client.0.smithi170.stdout:9/9: link f1 d2/f3 0 2024-09-04T16:30:03.180 INFO:tasks.workunit.client.1.smithi193.stdout:0/238: fsync d18/f4c 0 2024-09-04T16:30:03.183 INFO:tasks.workunit.client.0.smithi170.stdout:1/24: rename l6 to l8 0 2024-09-04T16:30:03.183 INFO:tasks.workunit.client.1.smithi193.stdout:4/128: sync 2024-09-04T16:30:03.184 INFO:tasks.workunit.client.0.smithi170.stdout:1/25: read f4 [278824,20744] 0 2024-09-04T16:30:03.185 INFO:tasks.workunit.client.1.smithi193.stdout:5/223: truncate d1/f28 4428370 0 2024-09-04T16:30:03.185 INFO:tasks.workunit.client.0.smithi170.stdout:6/16: dwrite d0/f4 [0,4194304] 0 2024-09-04T16:30:03.186 INFO:tasks.workunit.client.0.smithi170.stdout:5/12: mkdir d4 0 2024-09-04T16:30:03.187 INFO:tasks.workunit.client.0.smithi170.stdout:5/13: chown f2 683022581 1 2024-09-04T16:30:03.187 INFO:tasks.workunit.client.0.smithi170.stdout:5/14: write f2 [3164232,43616] 0 2024-09-04T16:30:03.187 INFO:tasks.workunit.client.1.smithi193.stdout:5/224: write d1/d29/d1e/d37/f43 [225827,30361] 0 2024-09-04T16:30:03.188 INFO:tasks.workunit.client.1.smithi193.stdout:5/225: chown d1/d8/db/d15/d2b 2331689 1 2024-09-04T16:30:03.188 INFO:tasks.workunit.client.1.smithi193.stdout:8/228: rmdir d2/d20/d23/d34/d3e/d4a 0 2024-09-04T16:30:03.192 INFO:tasks.workunit.client.0.smithi170.stdout:3/25: creat f6 x:0 0 0 2024-09-04T16:30:03.192 INFO:tasks.workunit.client.0.smithi170.stdout:3/26: write f4 [354083,30597] 0 2024-09-04T16:30:03.194 INFO:tasks.workunit.client.0.smithi170.stdout:0/18: link f4 fa 0 2024-09-04T16:30:03.199 INFO:tasks.workunit.client.1.smithi193.stdout:7/253: write d9/de/f1c [419718,36572] 0 2024-09-04T16:30:03.200 INFO:tasks.workunit.client.1.smithi193.stdout:0/239: creat d18/d25/d3b/f51 x:0 0 0 2024-09-04T16:30:03.201 INFO:tasks.workunit.client.1.smithi193.stdout:0/240: fsync d18/f21 0 2024-09-04T16:30:03.202 INFO:tasks.workunit.client.1.smithi193.stdout:0/241: write f3 [1459269,126317] 0 2024-09-04T16:30:03.202 INFO:tasks.workunit.client.0.smithi170.stdout:6/17: mkdir d0/d7 0 2024-09-04T16:30:03.203 INFO:tasks.workunit.client.1.smithi193.stdout:7/254: read d9/f19 [160616,10177] 0 2024-09-04T16:30:03.203 INFO:tasks.workunit.client.1.smithi193.stdout:1/223: sync 2024-09-04T16:30:03.205 INFO:tasks.workunit.client.1.smithi193.stdout:4/129: write d3/fc [4120409,15645] 0 2024-09-04T16:30:03.207 INFO:tasks.workunit.client.1.smithi193.stdout:2/167: creat d2/d9/f39 x:0 0 0 2024-09-04T16:30:03.211 INFO:tasks.workunit.client.0.smithi170.stdout:0/19: unlink fa 0 2024-09-04T16:30:03.211 INFO:tasks.workunit.client.0.smithi170.stdout:0/20: dread - f6 zero size 2024-09-04T16:30:03.211 INFO:tasks.workunit.client.0.smithi170.stdout:0/21: chown f3 175 1 2024-09-04T16:30:03.212 INFO:tasks.workunit.client.1.smithi193.stdout:9/263: mkdir d2/d56 0 2024-09-04T16:30:03.213 INFO:tasks.workunit.client.0.smithi170.stdout:9/10: creat d2/f4 x:0 0 0 2024-09-04T16:30:03.214 INFO:tasks.workunit.client.1.smithi193.stdout:3/224: mknod d0/d7/de/c57 0 2024-09-04T16:30:03.215 INFO:tasks.workunit.client.0.smithi170.stdout:4/14: getdents d1 0 2024-09-04T16:30:03.217 INFO:tasks.workunit.client.0.smithi170.stdout:2/15: truncate f1 2731377 0 2024-09-04T16:30:03.219 INFO:tasks.workunit.client.0.smithi170.stdout:4/15: chown d1/f3 70399 1 2024-09-04T16:30:03.219 INFO:tasks.workunit.client.0.smithi170.stdout:1/26: unlink c7 0 2024-09-04T16:30:03.219 INFO:tasks.workunit.client.1.smithi193.stdout:0/242: unlink d18/d25/d32/l47 0 2024-09-04T16:30:03.220 INFO:tasks.workunit.client.1.smithi193.stdout:0/243: chown d18/d3f 2164194 1 2024-09-04T16:30:03.220 INFO:tasks.workunit.client.1.smithi193.stdout:0/244: dread d18/f3a [0,4194304] 0 2024-09-04T16:30:03.221 INFO:tasks.workunit.client.0.smithi170.stdout:5/15: mknod d4/c5 0 2024-09-04T16:30:03.222 INFO:tasks.workunit.client.1.smithi193.stdout:7/255: creat d9/d39/d3e/f5c x:0 0 0 2024-09-04T16:30:03.222 INFO:tasks.workunit.client.0.smithi170.stdout:0/22: dwrite f5 [0,4194304] 0 2024-09-04T16:30:03.224 INFO:tasks.workunit.client.1.smithi193.stdout:0/245: dread d18/f23 [0,4194304] 0 2024-09-04T16:30:03.224 INFO:tasks.workunit.client.1.smithi193.stdout:1/224: fsync d1/d2b/f2c 0 2024-09-04T16:30:03.224 INFO:tasks.workunit.client.0.smithi170.stdout:3/27: rename c5 to c7 0 2024-09-04T16:30:03.226 INFO:tasks.workunit.client.1.smithi193.stdout:9/264: dread d2/d8/f55 [0,4194304] 0 2024-09-04T16:30:03.227 INFO:tasks.workunit.client.0.smithi170.stdout:2/16: mkdir d3 0 2024-09-04T16:30:03.227 INFO:tasks.workunit.client.0.smithi170.stdout:9/11: dwrite d2/f4 [0,4194304] 0 2024-09-04T16:30:03.227 INFO:tasks.workunit.client.0.smithi170.stdout:9/12: readlink - no filename 2024-09-04T16:30:03.229 INFO:tasks.workunit.client.0.smithi170.stdout:6/18: mknod d0/d7/c8 0 2024-09-04T16:30:03.233 INFO:tasks.workunit.client.0.smithi170.stdout:1/27: mkdir d9 0 2024-09-04T16:30:03.233 INFO:tasks.workunit.client.0.smithi170.stdout:1/28: fsync f4 0 2024-09-04T16:30:03.234 INFO:tasks.workunit.client.0.smithi170.stdout:9/13: dread d2/f4 [0,4194304] 0 2024-09-04T16:30:03.235 INFO:tasks.workunit.client.0.smithi170.stdout:1/29: fdatasync f4 0 2024-09-04T16:30:03.235 INFO:tasks.workunit.client.1.smithi193.stdout:6/182: rename d5/l9 to d5/de/d15/l39 0 2024-09-04T16:30:03.235 INFO:tasks.workunit.client.0.smithi170.stdout:4/16: creat d1/f4 x:0 0 0 2024-09-04T16:30:03.237 INFO:tasks.workunit.client.0.smithi170.stdout:9/14: dread f1 [0,4194304] 0 2024-09-04T16:30:03.237 INFO:tasks.workunit.client.0.smithi170.stdout:9/15: readlink - no filename 2024-09-04T16:30:03.423 INFO:tasks.workunit.client.0.smithi170.stdout:6/19: dwrite d0/f6 [0,4194304] 0 2024-09-04T16:30:03.424 INFO:tasks.workunit.client.1.smithi193.stdout:3/225: truncate d0/d18/d1b/f37 1606258 0 2024-09-04T16:30:03.424 INFO:tasks.workunit.client.0.smithi170.stdout:6/20: write d0/f4 [1478591,26603] 0 2024-09-04T16:30:03.427 INFO:tasks.workunit.client.0.smithi170.stdout:0/23: creat fb x:0 0 0 2024-09-04T16:30:03.427 INFO:tasks.workunit.client.0.smithi170.stdout:0/24: write f0 [153421,120989] 0 2024-09-04T16:30:03.428 INFO:tasks.workunit.client.0.smithi170.stdout:0/25: dread - fb zero size 2024-09-04T16:30:03.429 INFO:tasks.workunit.client.1.smithi193.stdout:7/256: dread d9/d18/d22/d2b/f33 [0,4194304] 0 2024-09-04T16:30:03.435 INFO:tasks.workunit.client.0.smithi170.stdout:5/16: rename f3 to d4/f6 0 2024-09-04T16:30:03.436 INFO:tasks.workunit.client.0.smithi170.stdout:5/17: chown d4/f6 104 1 2024-09-04T16:30:03.436 INFO:tasks.workunit.client.0.smithi170.stdout:5/18: dread - d4/f6 zero size 2024-09-04T16:30:03.439 INFO:tasks.workunit.client.1.smithi193.stdout:0/246: fsync d18/f4c 0 2024-09-04T16:30:03.444 INFO:tasks.workunit.client.1.smithi193.stdout:0/247: dread f3 [0,4194304] 0 2024-09-04T16:30:03.448 INFO:tasks.workunit.client.0.smithi170.stdout:4/17: unlink d1/c2 0 2024-09-04T16:30:03.449 INFO:tasks.workunit.client.1.smithi193.stdout:8/229: rename d2/d12/c17 to d2/d20/d23/d34/d4b/c4c 0 2024-09-04T16:30:03.450 INFO:tasks.workunit.client.1.smithi193.stdout:8/230: chown d2/d20/d23/d24/d25 21589 1 2024-09-04T16:30:03.453 INFO:tasks.workunit.client.0.smithi170.stdout:9/16: unlink d2/f3 0 2024-09-04T16:30:03.454 INFO:tasks.workunit.client.1.smithi193.stdout:3/226: creat d0/d9/f58 x:0 0 0 2024-09-04T16:30:03.455 INFO:tasks.workunit.client.1.smithi193.stdout:3/227: readlink d0/d7/de/d45/l4b 0 2024-09-04T16:30:03.456 INFO:tasks.workunit.client.0.smithi170.stdout:4/18: dwrite d1/f4 [0,4194304] 0 2024-09-04T16:30:03.457 INFO:tasks.workunit.client.0.smithi170.stdout:6/21: rename d0/f1 to d0/f9 0 2024-09-04T16:30:03.457 INFO:tasks.workunit.client.1.smithi193.stdout:2/168: truncate d2/d9/d18/f31 149058 0 2024-09-04T16:30:03.458 INFO:tasks.workunit.client.0.smithi170.stdout:6/22: write d0/f2 [1914934,35897] 0 2024-09-04T16:30:03.460 INFO:tasks.workunit.client.0.smithi170.stdout:0/26: symlink lc 0 2024-09-04T16:30:03.461 INFO:tasks.workunit.client.1.smithi193.stdout:2/169: dread d2/fe [0,4194304] 0 2024-09-04T16:30:03.463 INFO:tasks.workunit.client.0.smithi170.stdout:5/19: symlink d4/l7 0 2024-09-04T16:30:03.464 INFO:tasks.workunit.client.0.smithi170.stdout:4/19: dwrite d1/f4 [0,4194304] 0 2024-09-04T16:30:03.465 INFO:tasks.workunit.client.0.smithi170.stdout:5/20: truncate d4/f6 916285 0 2024-09-04T16:30:03.466 INFO:tasks.workunit.client.0.smithi170.stdout:3/28: rename c7 to c8 0 2024-09-04T16:30:03.466 INFO:tasks.workunit.client.1.smithi193.stdout:1/225: mknod d1/d2b/d10/c4b 0 2024-09-04T16:30:03.467 INFO:tasks.workunit.client.0.smithi170.stdout:2/17: mkdir d3/d4 0 2024-09-04T16:30:03.467 INFO:tasks.workunit.client.0.smithi170.stdout:2/18: chown d3 5758501 1 2024-09-04T16:30:03.468 INFO:tasks.workunit.client.1.smithi193.stdout:4/130: rename d3/f9 to d3/f2f 0 2024-09-04T16:30:03.468 INFO:tasks.workunit.client.1.smithi193.stdout:4/131: fdatasync d3/d1a/f25 0 2024-09-04T16:30:03.469 INFO:tasks.workunit.client.0.smithi170.stdout:1/30: mknod d9/ca 0 2024-09-04T16:30:03.471 INFO:tasks.workunit.client.0.smithi170.stdout:9/17: mknod d2/c5 0 2024-09-04T16:30:03.472 INFO:tasks.workunit.client.1.smithi193.stdout:5/226: rename d1/d8/db/d15/d2b/l44 to d1/d29/d1e/d37/d39/l45 0 2024-09-04T16:30:03.473 INFO:tasks.workunit.client.1.smithi193.stdout:6/183: creat d5/d33/f3a x:0 0 0 2024-09-04T16:30:03.474 INFO:tasks.workunit.client.0.smithi170.stdout:9/18: dread d2/f4 [0,4194304] 0 2024-09-04T16:30:03.475 INFO:tasks.workunit.client.0.smithi170.stdout:9/19: read d2/f4 [3526582,56241] 0 2024-09-04T16:30:03.475 INFO:tasks.workunit.client.1.smithi193.stdout:7/257: creat d9/d39/d3e/d4d/d4f/f5d x:0 0 0 2024-09-04T16:30:03.476 INFO:tasks.workunit.client.0.smithi170.stdout:6/23: creat d0/d7/fa x:0 0 0 2024-09-04T16:30:03.477 INFO:tasks.workunit.client.0.smithi170.stdout:0/27: creat fd x:0 0 0 2024-09-04T16:30:03.478 INFO:tasks.workunit.client.1.smithi193.stdout:2/170: rmdir d2/d9/db/d10/d1f/d22 39 2024-09-04T16:30:03.478 INFO:tasks.workunit.client.0.smithi170.stdout:0/28: truncate f0 1277863 0 2024-09-04T16:30:03.479 INFO:tasks.workunit.client.0.smithi170.stdout:4/20: mknod d1/c5 0 2024-09-04T16:30:03.479 INFO:tasks.workunit.client.1.smithi193.stdout:2/171: fdatasync d2/d9/db/f2e 0 2024-09-04T16:30:03.480 INFO:tasks.workunit.client.0.smithi170.stdout:5/21: mkdir d4/d8 0 2024-09-04T16:30:03.482 INFO:tasks.workunit.client.1.smithi193.stdout:7/258: dwrite d9/de/d27/f3d [0,4194304] 0 2024-09-04T16:30:03.482 INFO:tasks.workunit.client.0.smithi170.stdout:3/29: mknod c9 0 2024-09-04T16:30:03.483 INFO:tasks.workunit.client.1.smithi193.stdout:7/259: chown d9/d18/c25 55106248 1 2024-09-04T16:30:03.484 INFO:tasks.workunit.client.1.smithi193.stdout:1/226: creat d1/d2b/d1b/f4c x:0 0 0 2024-09-04T16:30:03.485 INFO:tasks.workunit.client.0.smithi170.stdout:1/31: readlink l8 0 2024-09-04T16:30:03.486 INFO:tasks.workunit.client.0.smithi170.stdout:1/32: readlink l3 0 2024-09-04T16:30:03.486 INFO:tasks.workunit.client.1.smithi193.stdout:9/265: link d2/d4/f3a d2/d18/d2f/d22/d30/d52/f57 0 2024-09-04T16:30:03.487 INFO:tasks.workunit.client.0.smithi170.stdout:1/33: write f4 [126194,18192] 0 2024-09-04T16:30:03.487 INFO:tasks.workunit.client.1.smithi193.stdout:1/227: readlink d1/d2b/d10/d2a/l2d 0 2024-09-04T16:30:03.488 INFO:tasks.workunit.client.0.smithi170.stdout:1/34: chown f4 24 1 2024-09-04T16:30:03.488 INFO:tasks.workunit.client.1.smithi193.stdout:2/172: dwrite d2/fc [0,4194304] 0 2024-09-04T16:30:03.489 INFO:tasks.workunit.client.0.smithi170.stdout:1/35: write f4 [581176,66385] 0 2024-09-04T16:30:03.489 INFO:tasks.workunit.client.1.smithi193.stdout:2/173: fsync d2/f35 0 2024-09-04T16:30:03.489 INFO:tasks.workunit.client.1.smithi193.stdout:0/248: link d18/d25/f2a d18/d25/d32/f52 0 2024-09-04T16:30:03.490 INFO:tasks.workunit.client.0.smithi170.stdout:6/24: fdatasync d0/f9 0 2024-09-04T16:30:03.490 INFO:tasks.workunit.client.1.smithi193.stdout:2/174: chown d2/d9/db/f16 5898 1 2024-09-04T16:30:03.490 INFO:tasks.workunit.client.0.smithi170.stdout:1/36: write f4 [696735,47003] 0 2024-09-04T16:30:03.491 INFO:tasks.workunit.client.0.smithi170.stdout:6/25: chown d0/f9 39856 1 2024-09-04T16:30:03.491 INFO:tasks.workunit.client.0.smithi170.stdout:6/26: chown d0 1605856 1 2024-09-04T16:30:03.492 INFO:tasks.workunit.client.0.smithi170.stdout:6/27: stat d0/d7/fa 0 2024-09-04T16:30:03.494 INFO:tasks.workunit.client.0.smithi170.stdout:0/29: creat fe x:0 0 0 2024-09-04T16:30:03.496 INFO:tasks.workunit.client.1.smithi193.stdout:8/231: rename d2/d20/d23/l2b to d2/d20/d23/d34/l4d 0 2024-09-04T16:30:03.496 INFO:tasks.workunit.client.1.smithi193.stdout:1/228: dwrite d1/d2b/d10/f1f [0,4194304] 0 2024-09-04T16:30:03.497 INFO:tasks.workunit.client.0.smithi170.stdout:4/21: mkdir d1/d6 0 2024-09-04T16:30:03.498 INFO:tasks.workunit.client.0.smithi170.stdout:4/22: fdatasync d1/f4 0 2024-09-04T16:30:03.501 INFO:tasks.workunit.client.1.smithi193.stdout:3/228: symlink d0/d7/de/l59 0 2024-09-04T16:30:03.503 INFO:tasks.workunit.client.0.smithi170.stdout:3/30: creat fa x:0 0 0 2024-09-04T16:30:03.513 INFO:tasks.workunit.client.1.smithi193.stdout:7/260: rmdir d9/d18/d22 39 2024-09-04T16:30:03.514 INFO:tasks.workunit.client.1.smithi193.stdout:7/261: chown d9/d39/d3e/l42 489 1 2024-09-04T16:30:03.514 INFO:tasks.workunit.client.0.smithi170.stdout:1/37: rename f4 to d9/fb 0 2024-09-04T16:30:03.516 INFO:tasks.workunit.client.0.smithi170.stdout:6/28: creat d0/d7/fb x:0 0 0 2024-09-04T16:30:03.520 INFO:tasks.workunit.client.0.smithi170.stdout:0/30: creat ff x:0 0 0 2024-09-04T16:30:03.521 INFO:tasks.workunit.client.0.smithi170.stdout:0/31: write f0 [2229068,112099] 0 2024-09-04T16:30:03.521 INFO:tasks.workunit.client.1.smithi193.stdout:7/262: dwrite d9/d39/d3e/d4a/f5b [0,4194304] 0 2024-09-04T16:30:03.521 INFO:tasks.workunit.client.1.smithi193.stdout:7/263: dread - d9/de/d27/f52 zero size 2024-09-04T16:30:03.521 INFO:tasks.workunit.client.1.smithi193.stdout:0/249: creat d18/d25/d32/f53 x:0 0 0 2024-09-04T16:30:03.522 INFO:tasks.workunit.client.0.smithi170.stdout:4/23: mknod d1/c7 0 2024-09-04T16:30:03.523 INFO:tasks.workunit.client.0.smithi170.stdout:4/24: dread - d1/f3 zero size 2024-09-04T16:30:03.523 INFO:tasks.workunit.client.0.smithi170.stdout:4/25: chown d1/f3 116636526 1 2024-09-04T16:30:03.524 INFO:tasks.workunit.client.1.smithi193.stdout:5/227: chown d1/d29/d18/c33 6 1 2024-09-04T16:30:03.524 INFO:tasks.workunit.client.1.smithi193.stdout:7/264: dread d9/d18/d1e/f29 [0,4194304] 0 2024-09-04T16:30:03.527 INFO:tasks.workunit.client.0.smithi170.stdout:3/31: creat fb x:0 0 0 2024-09-04T16:30:03.528 INFO:tasks.workunit.client.1.smithi193.stdout:8/232: mkdir d2/d20/d23/d1b/d4e 0 2024-09-04T16:30:03.532 INFO:tasks.workunit.client.0.smithi170.stdout:4/26: dwrite d1/f4 [4194304,4194304] 0 2024-09-04T16:30:03.532 INFO:tasks.workunit.client.0.smithi170.stdout:4/27: readlink - no filename 2024-09-04T16:30:03.532 INFO:tasks.workunit.client.1.smithi193.stdout:5/228: dwrite d1/d29/d1e/d37/d39/d3e/f41 [0,4194304] 0 2024-09-04T16:30:03.533 INFO:tasks.workunit.client.1.smithi193.stdout:3/229: chown d0/d7/de/c13 45764 1 2024-09-04T16:30:03.533 INFO:tasks.workunit.client.1.smithi193.stdout:7/265: dwrite d9/d11/f17 [0,4194304] 0 2024-09-04T16:30:03.534 INFO:tasks.workunit.client.1.smithi193.stdout:3/230: stat d0/d10/d24 0 2024-09-04T16:30:03.535 INFO:tasks.workunit.client.1.smithi193.stdout:4/132: creat d3/f30 x:0 0 0 2024-09-04T16:30:03.535 INFO:tasks.workunit.client.1.smithi193.stdout:3/231: truncate d0/d9/f58 207655 0 2024-09-04T16:30:03.537 INFO:tasks.workunit.client.0.smithi170.stdout:1/38: mkdir d9/dc 0 2024-09-04T16:30:03.539 INFO:tasks.workunit.client.0.smithi170.stdout:6/29: symlink d0/lc 0 2024-09-04T16:30:03.540 INFO:tasks.workunit.client.0.smithi170.stdout:3/32: fsync fa 0 2024-09-04T16:30:03.540 INFO:tasks.workunit.client.0.smithi170.stdout:3/33: readlink - no filename 2024-09-04T16:30:03.545 INFO:tasks.workunit.client.1.smithi193.stdout:2/175: creat d2/d9/db/d10/d1e/d26/f3a x:0 0 0 2024-09-04T16:30:03.547 INFO:tasks.workunit.client.0.smithi170.stdout:0/32: symlink l10 0 2024-09-04T16:30:03.548 INFO:tasks.workunit.client.1.smithi193.stdout:0/250: fdatasync d18/d25/d32/f52 0 2024-09-04T16:30:03.550 INFO:tasks.workunit.client.1.smithi193.stdout:1/229: mknod d1/c4d 0 2024-09-04T16:30:03.551 INFO:tasks.workunit.client.0.smithi170.stdout:9/20: dwrite f1 [0,4194304] 0 2024-09-04T16:30:03.556 INFO:tasks.workunit.client.1.smithi193.stdout:8/233: creat d2/d20/d23/d34/d4b/f4f x:0 0 0 2024-09-04T16:30:03.557 INFO:tasks.workunit.client.0.smithi170.stdout:5/22: truncate d4/f6 4578 0 2024-09-04T16:30:03.558 INFO:tasks.workunit.client.0.smithi170.stdout:6/30: creat d0/fd x:0 0 0 2024-09-04T16:30:03.561 INFO:tasks.workunit.client.0.smithi170.stdout:2/19: write f2 [2785874,70395] 0 2024-09-04T16:30:03.563 INFO:tasks.workunit.client.0.smithi170.stdout:1/39: dwrite d9/fb [0,4194304] 0 2024-09-04T16:30:03.567 INFO:tasks.workunit.client.1.smithi193.stdout:7/266: dwrite d9/d18/d22/d2b/f55 [8388608,4194304] 0 2024-09-04T16:30:03.567 INFO:tasks.workunit.client.0.smithi170.stdout:9/21: mknod d2/c6 0 2024-09-04T16:30:03.571 INFO:tasks.workunit.client.0.smithi170.stdout:4/28: mkdir d1/d6/d8 0 2024-09-04T16:30:03.573 INFO:tasks.workunit.client.0.smithi170.stdout:5/23: mknod d4/c9 0 2024-09-04T16:30:03.574 INFO:tasks.workunit.client.0.smithi170.stdout:1/40: dread d9/fb [0,4194304] 0 2024-09-04T16:30:03.574 INFO:tasks.workunit.client.1.smithi193.stdout:7/267: dwrite d9/d39/f3b [0,4194304] 0 2024-09-04T16:30:03.575 INFO:tasks.workunit.client.0.smithi170.stdout:6/31: mknod d0/ce 0 2024-09-04T16:30:03.576 INFO:tasks.workunit.client.0.smithi170.stdout:0/33: dwrite f9 [0,4194304] 0 2024-09-04T16:30:03.578 INFO:tasks.workunit.client.0.smithi170.stdout:6/32: write d0/f4 [729397,21261] 0 2024-09-04T16:30:03.580 INFO:tasks.workunit.client.1.smithi193.stdout:0/251: rmdir d18/d3f 39 2024-09-04T16:30:03.581 INFO:tasks.workunit.client.1.smithi193.stdout:7/268: dwrite d9/de/d27/f52 [0,4194304] 0 2024-09-04T16:30:03.582 INFO:tasks.workunit.client.1.smithi193.stdout:0/252: fsync d18/d25/d32/f44 0 2024-09-04T16:30:03.582 INFO:tasks.workunit.client.1.smithi193.stdout:7/269: fdatasync d9/d11/f4e 0 2024-09-04T16:30:03.586 INFO:tasks.workunit.client.0.smithi170.stdout:1/41: dwrite d9/fb [0,4194304] 0 2024-09-04T16:30:03.587 INFO:tasks.workunit.client.1.smithi193.stdout:8/234: rmdir d2/d12 39 2024-09-04T16:30:03.587 INFO:tasks.workunit.client.0.smithi170.stdout:1/42: chown c1 26215732 1 2024-09-04T16:30:03.589 INFO:tasks.workunit.client.0.smithi170.stdout:9/22: mkdir d2/d7 0 2024-09-04T16:30:03.592 INFO:tasks.workunit.client.1.smithi193.stdout:5/229: mkdir d1/d8/db/d36/d40/d46 0 2024-09-04T16:30:03.593 INFO:tasks.workunit.client.0.smithi170.stdout:1/43: dread d9/fb [0,4194304] 0 2024-09-04T16:30:03.594 INFO:tasks.workunit.client.1.smithi193.stdout:7/270: dwrite d9/d39/d3e/f3f [0,4194304] 0 2024-09-04T16:30:03.596 INFO:tasks.workunit.client.0.smithi170.stdout:9/23: dread f1 [0,4194304] 0 2024-09-04T16:30:03.596 INFO:tasks.workunit.client.0.smithi170.stdout:0/34: mkdir d11 0 2024-09-04T16:30:03.597 INFO:tasks.workunit.client.1.smithi193.stdout:3/232: truncate d0/d18/d1c/d30/f33 3662551 0 2024-09-04T16:30:03.599 INFO:tasks.workunit.client.1.smithi193.stdout:1/230: dwrite d1/d2b/f2e [0,4194304] 0 2024-09-04T16:30:03.599 INFO:tasks.workunit.client.1.smithi193.stdout:9/266: getdents d2/d18/d2f/d22 0 2024-09-04T16:30:03.599 INFO:tasks.workunit.client.0.smithi170.stdout:3/34: link c9 cc 0 2024-09-04T16:30:03.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:03 smithi170 ceph-mon[29272]: pgmap v21: 65 pgs: 65 active+clean; 271 MiB data, 927 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s rd, 15 MiB/s wr, 308 op/s 2024-09-04T16:30:03.602 INFO:tasks.workunit.client.1.smithi193.stdout:2/176: link d2/d9/d18/f37 d2/d9/db/d10/d38/f3b 0 2024-09-04T16:30:03.603 INFO:tasks.workunit.client.1.smithi193.stdout:2/177: read - d2/d9/f39 zero size 2024-09-04T16:30:03.604 INFO:tasks.workunit.client.0.smithi170.stdout:6/33: rename d0/d7 to d0/df 0 2024-09-04T16:30:03.604 INFO:tasks.workunit.client.0.smithi170.stdout:6/34: truncate d0/f9 117890 0 2024-09-04T16:30:03.605 INFO:tasks.workunit.client.0.smithi170.stdout:2/20: mknod d3/d4/c5 0 2024-09-04T16:30:03.606 INFO:tasks.workunit.client.0.smithi170.stdout:6/35: write d0/f6 [4689931,37897] 0 2024-09-04T16:30:03.606 INFO:tasks.workunit.client.1.smithi193.stdout:9/267: dread d2/d8/d25/f3e [0,4194304] 0 2024-09-04T16:30:03.609 INFO:tasks.workunit.client.0.smithi170.stdout:2/21: dread f2 [0,4194304] 0 2024-09-04T16:30:03.612 INFO:tasks.workunit.client.0.smithi170.stdout:4/29: creat d1/d6/d8/f9 x:0 0 0 2024-09-04T16:30:03.613 INFO:tasks.workunit.client.1.smithi193.stdout:0/253: mknod d18/d25/d32/c54 0 2024-09-04T16:30:03.613 INFO:tasks.workunit.client.1.smithi193.stdout:6/184: link d5/c1c d5/c3b 0 2024-09-04T16:30:03.614 INFO:tasks.workunit.client.1.smithi193.stdout:6/185: fdatasync d5/fb 0 2024-09-04T16:30:03.615 INFO:tasks.workunit.client.1.smithi193.stdout:8/235: creat d2/d20/d23/d34/d3e/f50 x:0 0 0 2024-09-04T16:30:03.617 INFO:tasks.workunit.client.0.smithi170.stdout:3/35: rename f4 to fd 0 2024-09-04T16:30:03.618 INFO:tasks.workunit.client.1.smithi193.stdout:7/271: dread d9/de/f49 [0,4194304] 0 2024-09-04T16:30:03.620 INFO:tasks.workunit.client.1.smithi193.stdout:1/231: chown d1/cc 85 1 2024-09-04T16:30:03.621 INFO:tasks.workunit.client.0.smithi170.stdout:6/36: creat d0/df/f10 x:0 0 0 2024-09-04T16:30:03.621 INFO:tasks.workunit.client.0.smithi170.stdout:6/37: fsync d0/fd 0 2024-09-04T16:30:03.622 INFO:tasks.workunit.client.1.smithi193.stdout:7/272: dread d9/d18/d22/d2b/f55 [4194304,4194304] 0 2024-09-04T16:30:03.623 INFO:tasks.workunit.client.1.smithi193.stdout:9/268: rename d2/d18/d2f/d22/c4b to d2/d18/d2f/d51/c58 0 2024-09-04T16:30:03.624 INFO:tasks.workunit.client.0.smithi170.stdout:2/22: creat d3/d4/f6 x:0 0 0 2024-09-04T16:30:03.625 INFO:tasks.workunit.client.1.smithi193.stdout:9/269: write d2/d8/d15/f31 [5187704,68974] 0 2024-09-04T16:30:03.625 INFO:tasks.workunit.client.0.smithi170.stdout:2/23: chown f2 441904 1 2024-09-04T16:30:03.625 INFO:tasks.workunit.client.0.smithi170.stdout:4/30: rmdir d1/d6 39 2024-09-04T16:30:03.625 INFO:tasks.workunit.client.1.smithi193.stdout:0/254: write d18/d3f/f4e [464588,48587] 0 2024-09-04T16:30:03.629 INFO:tasks.workunit.client.0.smithi170.stdout:4/31: dread d1/f4 [4194304,4194304] 0 2024-09-04T16:30:03.631 INFO:tasks.workunit.client.1.smithi193.stdout:4/133: getdents d3/d1a 0 2024-09-04T16:30:03.632 INFO:tasks.workunit.client.1.smithi193.stdout:0/255: dwrite d18/f48 [0,4194304] 0 2024-09-04T16:30:03.633 INFO:tasks.workunit.client.1.smithi193.stdout:5/230: unlink d1/f28 0 2024-09-04T16:30:03.634 INFO:tasks.workunit.client.0.smithi170.stdout:9/24: creat d2/d7/f8 x:0 0 0 2024-09-04T16:30:03.636 INFO:tasks.workunit.client.0.smithi170.stdout:0/35: creat d11/f12 x:0 0 0 2024-09-04T16:30:03.643 INFO:tasks.workunit.client.0.smithi170.stdout:3/36: unlink fd 0 2024-09-04T16:30:03.643 INFO:tasks.workunit.client.0.smithi170.stdout:3/37: chown fb 3382 1 2024-09-04T16:30:03.644 INFO:tasks.workunit.client.0.smithi170.stdout:3/38: fsync fb 0 2024-09-04T16:30:03.645 INFO:tasks.workunit.client.1.smithi193.stdout:2/178: mkdir d2/d9/db/d10/d1f/d3c 0 2024-09-04T16:30:03.645 INFO:tasks.workunit.client.1.smithi193.stdout:2/179: stat d2/d14 0 2024-09-04T16:30:03.645 INFO:tasks.workunit.client.1.smithi193.stdout:2/180: chown d2/d9 92649 1 2024-09-04T16:30:03.646 INFO:tasks.workunit.client.0.smithi170.stdout:6/38: creat d0/f11 x:0 0 0 2024-09-04T16:30:03.647 INFO:tasks.workunit.client.0.smithi170.stdout:2/24: mkdir d3/d7 0 2024-09-04T16:30:03.650 INFO:tasks.workunit.client.0.smithi170.stdout:3/39: dwrite fa [0,4194304] 0 2024-09-04T16:30:03.652 INFO:tasks.workunit.client.0.smithi170.stdout:3/40: truncate fb 107549 0 2024-09-04T16:30:03.653 INFO:tasks.workunit.client.1.smithi193.stdout:6/186: mknod d5/c3c 0 2024-09-04T16:30:03.655 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:03 smithi193 ceph-mon[36288]: pgmap v21: 65 pgs: 65 active+clean; 271 MiB data, 927 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s rd, 15 MiB/s wr, 308 op/s 2024-09-04T16:30:03.656 INFO:tasks.workunit.client.0.smithi170.stdout:1/44: rmdir d9/dc 0 2024-09-04T16:30:03.658 INFO:tasks.workunit.client.1.smithi193.stdout:8/236: fsync d2/d12/f19 0 2024-09-04T16:30:03.660 INFO:tasks.workunit.client.1.smithi193.stdout:8/237: truncate d2/d20/f36 5105612 0 2024-09-04T16:30:03.660 INFO:tasks.workunit.client.0.smithi170.stdout:0/36: mkdir d11/d13 0 2024-09-04T16:30:03.661 INFO:tasks.workunit.client.0.smithi170.stdout:9/25: dread f1 [0,4194304] 0 2024-09-04T16:30:03.662 INFO:tasks.workunit.client.1.smithi193.stdout:4/134: unlink d3/d1a/d21/f27 0 2024-09-04T16:30:03.663 INFO:tasks.workunit.client.0.smithi170.stdout:6/39: symlink d0/df/l12 0 2024-09-04T16:30:03.664 INFO:tasks.workunit.client.0.smithi170.stdout:6/40: dread - d0/df/fa zero size 2024-09-04T16:30:03.664 INFO:tasks.workunit.client.0.smithi170.stdout:6/41: chown d0/df/fa 0 1 2024-09-04T16:30:03.665 INFO:tasks.workunit.client.0.smithi170.stdout:6/42: write d0/f6 [5200744,1788] 0 2024-09-04T16:30:03.666 INFO:tasks.workunit.client.1.smithi193.stdout:5/231: creat d1/d8/db/d15/f47 x:0 0 0 2024-09-04T16:30:03.666 INFO:tasks.workunit.client.0.smithi170.stdout:6/43: write d0/f9 [515312,31484] 0 2024-09-04T16:30:03.668 INFO:tasks.workunit.client.1.smithi193.stdout:3/233: dwrite d0/d18/f3a [0,4194304] 0 2024-09-04T16:30:03.669 INFO:tasks.workunit.client.1.smithi193.stdout:3/234: fsync d0/d18/d1c/d25/f48 0 2024-09-04T16:30:03.671 INFO:tasks.workunit.client.0.smithi170.stdout:4/32: creat d1/d6/d8/fa x:0 0 0 2024-09-04T16:30:03.673 INFO:tasks.workunit.client.0.smithi170.stdout:3/41: creat fe x:0 0 0 2024-09-04T16:30:03.675 INFO:tasks.workunit.client.0.smithi170.stdout:1/45: fdatasync d9/fb 0 2024-09-04T16:30:03.676 INFO:tasks.workunit.client.0.smithi170.stdout:6/44: dwrite d0/f11 [0,4194304] 0 2024-09-04T16:30:03.677 INFO:tasks.workunit.client.1.smithi193.stdout:7/273: mknod d9/d18/d22/c5e 0 2024-09-04T16:30:03.678 INFO:tasks.workunit.client.0.smithi170.stdout:6/45: write d0/f2 [2178285,48135] 0 2024-09-04T16:30:03.680 INFO:tasks.workunit.client.0.smithi170.stdout:5/24: truncate d4/f6 367182 0 2024-09-04T16:30:03.681 INFO:tasks.workunit.client.1.smithi193.stdout:9/270: fsync d2/d8/f26 0 2024-09-04T16:30:03.682 INFO:tasks.workunit.client.0.smithi170.stdout:0/37: mkdir d11/d14 0 2024-09-04T16:30:03.685 INFO:tasks.workunit.client.1.smithi193.stdout:6/187: rename d5/de/f2a to d5/de/d15/d1b/d34/f3d 0 2024-09-04T16:30:03.685 INFO:tasks.workunit.client.1.smithi193.stdout:2/181: rename d2/d9/db/d10 to d2/d9/db/d10/d1f/d22/d3d 22 2024-09-04T16:30:03.686 INFO:tasks.workunit.client.1.smithi193.stdout:6/188: write d5/d33/f3a [168419,587] 0 2024-09-04T16:30:03.687 INFO:tasks.workunit.client.1.smithi193.stdout:2/182: chown d2/d9/db/d10/d1f/d22 0 1 2024-09-04T16:30:03.687 INFO:tasks.workunit.client.0.smithi170.stdout:5/25: dwrite f1 [0,4194304] 0 2024-09-04T16:30:03.688 INFO:tasks.workunit.client.1.smithi193.stdout:2/183: write d2/d9/db/fd [7056558,115481] 0 2024-09-04T16:30:03.695 INFO:tasks.workunit.client.1.smithi193.stdout:2/184: dwrite d2/f2a [0,4194304] 0 2024-09-04T16:30:03.696 INFO:tasks.workunit.client.0.smithi170.stdout:2/25: mknod d3/d7/c8 0 2024-09-04T16:30:03.696 INFO:tasks.workunit.client.1.smithi193.stdout:2/185: truncate d2/d9/d18/f28 1012093 0 2024-09-04T16:30:03.697 INFO:tasks.workunit.client.0.smithi170.stdout:6/46: dread d0/f2 [0,4194304] 0 2024-09-04T16:30:03.699 INFO:tasks.workunit.client.0.smithi170.stdout:4/33: symlink d1/d6/lb 0 2024-09-04T16:30:03.700 INFO:tasks.workunit.client.0.smithi170.stdout:1/46: unlink d9/ca 0 2024-09-04T16:30:03.702 INFO:tasks.workunit.client.1.smithi193.stdout:5/232: creat d1/d8/db/d36/f48 x:0 0 0 2024-09-04T16:30:03.703 INFO:tasks.workunit.client.1.smithi193.stdout:5/233: chown d1/d8/db/d36/d40/d46 55627 1 2024-09-04T16:30:03.703 INFO:tasks.workunit.client.1.smithi193.stdout:4/135: dwrite d3/d1a/f1d [0,4194304] 0 2024-09-04T16:30:03.704 INFO:tasks.workunit.client.1.smithi193.stdout:4/136: readlink d3/d1a/d2a/l2b 0 2024-09-04T16:30:03.709 INFO:tasks.workunit.client.0.smithi170.stdout:1/47: dread d9/fb [0,4194304] 0 2024-09-04T16:30:03.710 INFO:tasks.workunit.client.0.smithi170.stdout:4/34: dwrite d1/d6/d8/f9 [0,4194304] 0 2024-09-04T16:30:03.712 INFO:tasks.workunit.client.0.smithi170.stdout:0/38: stat f4 0 2024-09-04T16:30:03.716 INFO:tasks.workunit.client.0.smithi170.stdout:5/26: rename d4/l7 to d4/d8/la 0 2024-09-04T16:30:03.722 INFO:tasks.workunit.client.0.smithi170.stdout:5/27: dwrite f1 [0,4194304] 0 2024-09-04T16:30:03.726 INFO:tasks.workunit.client.0.smithi170.stdout:1/48: unlink c1 0 2024-09-04T16:30:03.727 INFO:tasks.workunit.client.0.smithi170.stdout:1/49: chown d9 15344 1 2024-09-04T16:30:03.729 INFO:tasks.workunit.client.1.smithi193.stdout:7/274: fsync d9/d39/d3e/d4a/f4b 0 2024-09-04T16:30:03.729 INFO:tasks.workunit.client.1.smithi193.stdout:6/189: mkdir d5/d27/d3e 0 2024-09-04T16:30:03.730 INFO:tasks.workunit.client.1.smithi193.stdout:8/238: mkdir d2/d20/d23/d51 0 2024-09-04T16:30:03.730 INFO:tasks.workunit.client.0.smithi170.stdout:4/35: read d1/f4 [4916933,10400] 0 2024-09-04T16:30:03.730 INFO:tasks.workunit.client.1.smithi193.stdout:0/256: rename d18/f28 to d18/f55 0 2024-09-04T16:30:03.732 INFO:tasks.workunit.client.0.smithi170.stdout:0/39: creat d11/f15 x:0 0 0 2024-09-04T16:30:03.732 INFO:tasks.workunit.client.0.smithi170.stdout:9/26: truncate d2/f4 323675 0 2024-09-04T16:30:03.733 INFO:tasks.workunit.client.0.smithi170.stdout:0/40: stat f6 0 2024-09-04T16:30:03.733 INFO:tasks.workunit.client.1.smithi193.stdout:5/234: symlink d1/d8/db/d23/l49 0 2024-09-04T16:30:03.734 INFO:tasks.workunit.client.1.smithi193.stdout:4/137: dwrite d3/d1a/f25 [0,4194304] 0 2024-09-04T16:30:03.735 INFO:tasks.workunit.client.0.smithi170.stdout:9/27: chown d2/d7/f8 4 1 2024-09-04T16:30:03.735 INFO:tasks.workunit.client.0.smithi170.stdout:1/50: dwrite d9/fb [0,4194304] 0 2024-09-04T16:30:03.735 INFO:tasks.workunit.client.0.smithi170.stdout:0/41: truncate d11/f15 807086 0 2024-09-04T16:30:03.735 INFO:tasks.workunit.client.1.smithi193.stdout:4/138: truncate d3/f29 253905 0 2024-09-04T16:30:03.735 INFO:tasks.workunit.client.1.smithi193.stdout:6/190: read d5/ff [1111798,115916] 0 2024-09-04T16:30:03.736 INFO:tasks.workunit.client.1.smithi193.stdout:6/191: chown d5/de/f2c 185308138 1 2024-09-04T16:30:03.736 INFO:tasks.workunit.client.0.smithi170.stdout:0/42: write d11/f15 [849023,98462] 0 2024-09-04T16:30:03.741 INFO:tasks.workunit.client.1.smithi193.stdout:1/232: link d1/d39/d48/l41 d1/d2b/db/l4e 0 2024-09-04T16:30:03.742 INFO:tasks.workunit.client.1.smithi193.stdout:1/233: read d1/d2b/d10/f17 [1212564,69391] 0 2024-09-04T16:30:03.745 INFO:tasks.workunit.client.0.smithi170.stdout:2/26: dwrite f1 [0,4194304] 0 2024-09-04T16:30:03.746 INFO:tasks.workunit.client.0.smithi170.stdout:5/28: unlink f2 0 2024-09-04T16:30:03.746 INFO:tasks.workunit.client.0.smithi170.stdout:2/27: fdatasync d3/d4/f6 0 2024-09-04T16:30:03.750 INFO:tasks.workunit.client.0.smithi170.stdout:9/28: mknod d2/c9 0 2024-09-04T16:30:03.754 INFO:tasks.workunit.client.0.smithi170.stdout:1/51: creat d9/fd x:0 0 0 2024-09-04T16:30:03.754 INFO:tasks.workunit.client.0.smithi170.stdout:1/52: write d9/fb [2987091,42254] 0 2024-09-04T16:30:03.755 INFO:tasks.workunit.client.1.smithi193.stdout:3/235: truncate d0/d9/fb 3782695 0 2024-09-04T16:30:03.757 INFO:tasks.workunit.client.0.smithi170.stdout:6/47: link d0/ce d0/df/c13 0 2024-09-04T16:30:03.761 INFO:tasks.workunit.client.0.smithi170.stdout:5/29: mkdir d4/db 0 2024-09-04T16:30:03.761 INFO:tasks.workunit.client.1.smithi193.stdout:8/239: fdatasync d2/d12/f19 0 2024-09-04T16:30:03.763 INFO:tasks.workunit.client.1.smithi193.stdout:4/139: chown d3/c26 16957227 1 2024-09-04T16:30:03.764 INFO:tasks.workunit.client.1.smithi193.stdout:7/275: dwrite d9/de/d27/f38 [4194304,4194304] 0 2024-09-04T16:30:03.764 INFO:tasks.workunit.client.1.smithi193.stdout:6/192: write d5/de/f2c [633751,110980] 0 2024-09-04T16:30:03.765 INFO:tasks.workunit.client.0.smithi170.stdout:9/29: creat d2/fa x:0 0 0 2024-09-04T16:30:03.765 INFO:tasks.workunit.client.0.smithi170.stdout:6/48: dwrite d0/f11 [0,4194304] 0 2024-09-04T16:30:03.766 INFO:tasks.workunit.client.1.smithi193.stdout:6/193: chown d5/de/f18 81 1 2024-09-04T16:30:03.766 INFO:tasks.workunit.client.1.smithi193.stdout:1/234: mknod d1/d39/d48/c4f 0 2024-09-04T16:30:03.768 INFO:tasks.workunit.client.0.smithi170.stdout:1/53: creat d9/fe x:0 0 0 2024-09-04T16:30:03.770 INFO:tasks.workunit.client.1.smithi193.stdout:8/240: dread d2/f2e [0,4194304] 0 2024-09-04T16:30:03.772 INFO:tasks.workunit.client.1.smithi193.stdout:1/235: dread d1/d2b/db/f3b [0,4194304] 0 2024-09-04T16:30:03.773 INFO:tasks.workunit.client.1.smithi193.stdout:1/236: chown d1/d2b/l6 1 1 2024-09-04T16:30:03.775 INFO:tasks.workunit.client.1.smithi193.stdout:8/241: dread d2/d20/f47 [0,4194304] 0 2024-09-04T16:30:03.775 INFO:tasks.workunit.client.1.smithi193.stdout:7/276: dread d9/d11/f4e [0,4194304] 0 2024-09-04T16:30:03.777 INFO:tasks.workunit.client.0.smithi170.stdout:4/36: creat d1/fc x:0 0 0 2024-09-04T16:30:03.779 INFO:tasks.workunit.client.0.smithi170.stdout:9/30: symlink d2/lb 0 2024-09-04T16:30:03.779 INFO:tasks.workunit.client.0.smithi170.stdout:9/31: chown d2 1612887 1 2024-09-04T16:30:03.781 INFO:tasks.workunit.client.1.smithi193.stdout:0/257: write d18/d25/f2a [1963480,130713] 0 2024-09-04T16:30:03.781 INFO:tasks.workunit.client.1.smithi193.stdout:7/277: dwrite d9/d18/d22/f30 [0,4194304] 0 2024-09-04T16:30:03.781 INFO:tasks.workunit.client.1.smithi193.stdout:0/258: fsync d18/f1d 0 2024-09-04T16:30:03.782 INFO:tasks.workunit.client.1.smithi193.stdout:0/259: stat d18/f23 0 2024-09-04T16:30:03.782 INFO:tasks.workunit.client.0.smithi170.stdout:6/49: creat d0/f14 x:0 0 0 2024-09-04T16:30:03.784 INFO:tasks.workunit.client.0.smithi170.stdout:5/30: dread f1 [0,4194304] 0 2024-09-04T16:30:03.787 INFO:tasks.workunit.client.1.smithi193.stdout:6/194: write d5/f19 [1968133,26953] 0 2024-09-04T16:30:03.788 INFO:tasks.workunit.client.1.smithi193.stdout:7/278: dread d9/f19 [0,4194304] 0 2024-09-04T16:30:03.795 INFO:tasks.workunit.client.1.smithi193.stdout:9/271: link d2/d18/c19 d2/d4/c59 0 2024-09-04T16:30:03.795 INFO:tasks.workunit.client.1.smithi193.stdout:9/272: chown d2/d8/d15/f16 34014556 1 2024-09-04T16:30:03.796 INFO:tasks.workunit.client.1.smithi193.stdout:3/236: getdents d0/d9/d49 0 2024-09-04T16:30:03.799 INFO:tasks.workunit.client.0.smithi170.stdout:1/54: symlink d9/lf 0 2024-09-04T16:30:03.801 INFO:tasks.workunit.client.0.smithi170.stdout:6/50: mkdir d0/d15 0 2024-09-04T16:30:03.801 INFO:tasks.workunit.client.0.smithi170.stdout:6/51: dread - d0/df/fa zero size 2024-09-04T16:30:03.802 INFO:tasks.workunit.client.1.smithi193.stdout:1/237: chown d1/l2 13230 1 2024-09-04T16:30:03.802 INFO:tasks.workunit.client.0.smithi170.stdout:6/52: truncate d0/f4 4285580 0 2024-09-04T16:30:03.802 INFO:tasks.workunit.client.1.smithi193.stdout:1/238: stat d1/d39/f46 0 2024-09-04T16:30:03.803 INFO:tasks.workunit.client.1.smithi193.stdout:8/242: creat d2/d20/d23/d24/d3c/f52 x:0 0 0 2024-09-04T16:30:03.809 INFO:tasks.workunit.client.0.smithi170.stdout:9/32: dread d2/f4 [0,4194304] 0 2024-09-04T16:30:03.809 INFO:tasks.workunit.client.0.smithi170.stdout:9/33: chown d2/f4 30953 1 2024-09-04T16:30:03.813 INFO:tasks.workunit.client.1.smithi193.stdout:7/279: creat d9/d18/d22/d2b/f5f x:0 0 0 2024-09-04T16:30:03.815 INFO:tasks.workunit.client.1.smithi193.stdout:9/273: creat d2/d18/d2f/d51/f5a x:0 0 0 2024-09-04T16:30:03.820 INFO:tasks.workunit.client.1.smithi193.stdout:1/239: mkdir d1/d2b/d1b/d28/d50 0 2024-09-04T16:30:03.820 INFO:tasks.workunit.client.1.smithi193.stdout:8/243: fdatasync d2/d12/fd 0 2024-09-04T16:30:03.824 INFO:tasks.workunit.client.1.smithi193.stdout:4/140: creat d3/f31 x:0 0 0 2024-09-04T16:30:03.825 INFO:tasks.workunit.client.1.smithi193.stdout:4/141: readlink d3/d1a/d2a/l2b 0 2024-09-04T16:30:03.831 INFO:tasks.workunit.client.1.smithi193.stdout:1/240: mkdir d1/d2b/d1b/d51 0 2024-09-04T16:30:03.864 INFO:tasks.workunit.client.1.smithi193.stdout:2/186: sync 2024-09-04T16:30:03.864 INFO:tasks.workunit.client.1.smithi193.stdout:2/187: chown d2/d9/db 186 1 2024-09-04T16:30:03.868 INFO:tasks.workunit.client.1.smithi193.stdout:2/188: dwrite d2/d9/db/f2e [0,4194304] 0 2024-09-04T16:30:03.912 INFO:tasks.workunit.client.1.smithi193.stdout:4/142: read - d3/f1f zero size 2024-09-04T16:30:03.912 INFO:tasks.workunit.client.1.smithi193.stdout:4/143: write d3/d1a/d21/f22 [1207206,36346] 0 2024-09-04T16:30:03.914 INFO:tasks.workunit.client.1.smithi193.stdout:1/241: symlink d1/d2b/d1b/l52 0 2024-09-04T16:30:03.915 INFO:tasks.workunit.client.1.smithi193.stdout:2/189: mknod d2/d9/db/d10/c3e 0 2024-09-04T16:30:03.916 INFO:tasks.workunit.client.1.smithi193.stdout:2/190: write d2/d9/db/f21 [2227569,83977] 0 2024-09-04T16:30:03.917 INFO:tasks.workunit.client.1.smithi193.stdout:0/260: getdents d18/d25 0 2024-09-04T16:30:03.917 INFO:tasks.workunit.client.1.smithi193.stdout:0/261: readlink d18/l50 0 2024-09-04T16:30:03.918 INFO:tasks.workunit.client.1.smithi193.stdout:8/244: getdents d2/d20/d23/d1b/d4e 0 2024-09-04T16:30:03.919 INFO:tasks.workunit.client.1.smithi193.stdout:2/191: read d2/d9/db/d10/f25 [571458,35644] 0 2024-09-04T16:30:03.919 INFO:tasks.workunit.client.1.smithi193.stdout:8/245: write d2/d20/d23/d1b/f33 [1663886,49186] 0 2024-09-04T16:30:03.920 INFO:tasks.workunit.client.1.smithi193.stdout:6/195: getdents d5/de/d15/d1b/d34 0 2024-09-04T16:30:03.920 INFO:tasks.workunit.client.1.smithi193.stdout:8/246: chown d2/d20/d23/d1b/f28 3554 1 2024-09-04T16:30:03.921 INFO:tasks.workunit.client.1.smithi193.stdout:7/280: rename d9/de/l1b to d9/d18/d22/l60 0 2024-09-04T16:30:03.924 INFO:tasks.workunit.client.1.smithi193.stdout:4/144: mknod d3/d1a/d21/c32 0 2024-09-04T16:30:03.925 INFO:tasks.workunit.client.1.smithi193.stdout:4/145: write d3/f30 [133337,19887] 0 2024-09-04T16:30:03.926 INFO:tasks.workunit.client.1.smithi193.stdout:1/242: unlink d1/d2b/d1b/d28/c32 0 2024-09-04T16:30:03.930 INFO:tasks.workunit.client.1.smithi193.stdout:2/192: mkdir d2/d9/d18/d3f 0 2024-09-04T16:30:03.932 INFO:tasks.workunit.client.1.smithi193.stdout:3/237: truncate d0/d9/f2c 1934266 0 2024-09-04T16:30:03.933 INFO:tasks.workunit.client.1.smithi193.stdout:7/281: creat d9/d39/d3e/f61 x:0 0 0 2024-09-04T16:30:03.934 INFO:tasks.workunit.client.1.smithi193.stdout:7/282: chown d9/d18/d1e/f2e 109321 1 2024-09-04T16:30:03.935 INFO:tasks.workunit.client.1.smithi193.stdout:7/283: dread d9/d18/d1e/f43 [0,4194304] 0 2024-09-04T16:30:03.939 INFO:tasks.workunit.client.1.smithi193.stdout:4/146: dwrite d3/f10 [0,4194304] 0 2024-09-04T16:30:03.939 INFO:tasks.workunit.client.1.smithi193.stdout:9/274: write d2/d8/d15/f34 [482941,105718] 0 2024-09-04T16:30:03.941 INFO:tasks.workunit.client.1.smithi193.stdout:8/247: mkdir d2/d20/d23/d34/d46/d53 0 2024-09-04T16:30:03.942 INFO:tasks.workunit.client.1.smithi193.stdout:3/238: write d0/fa [1060641,105002] 0 2024-09-04T16:30:03.946 INFO:tasks.workunit.client.1.smithi193.stdout:6/196: creat d5/f3f x:0 0 0 2024-09-04T16:30:03.951 INFO:tasks.workunit.client.1.smithi193.stdout:9/275: mknod d2/d8/d4d/c5b 0 2024-09-04T16:30:03.955 INFO:tasks.workunit.client.1.smithi193.stdout:4/147: dwrite d3/f1c [0,4194304] 0 2024-09-04T16:30:03.955 INFO:tasks.workunit.client.1.smithi193.stdout:1/243: creat d1/f53 x:0 0 0 2024-09-04T16:30:03.956 INFO:tasks.workunit.client.1.smithi193.stdout:4/148: read d3/f29 [240937,74473] 0 2024-09-04T16:30:03.957 INFO:tasks.workunit.client.1.smithi193.stdout:1/244: readlink d1/d39/d48/l41 0 2024-09-04T16:30:03.959 INFO:tasks.workunit.client.1.smithi193.stdout:8/248: symlink d2/d20/d23/d34/d3e/l54 0 2024-09-04T16:30:03.961 INFO:tasks.workunit.client.1.smithi193.stdout:7/284: dread d9/d18/d22/d2b/f55 [0,4194304] 0 2024-09-04T16:30:03.961 INFO:tasks.workunit.client.1.smithi193.stdout:6/197: write d5/de/d15/f24 [2956604,43134] 0 2024-09-04T16:30:03.962 INFO:tasks.workunit.client.1.smithi193.stdout:7/285: fsync d9/de/d27/f3d 0 2024-09-04T16:30:03.962 INFO:tasks.workunit.client.1.smithi193.stdout:7/286: dread - d9/d39/d3e/f61 zero size 2024-09-04T16:30:03.963 INFO:tasks.workunit.client.1.smithi193.stdout:2/193: rmdir d2/d9/db/d10/d1f/d3c 0 2024-09-04T16:30:03.964 INFO:tasks.workunit.client.1.smithi193.stdout:7/287: write d9/d39/d3e/f61 [27469,125446] 0 2024-09-04T16:30:03.964 INFO:tasks.workunit.client.1.smithi193.stdout:7/288: chown d9/d18 2020 1 2024-09-04T16:30:03.965 INFO:tasks.workunit.client.1.smithi193.stdout:2/194: fsync d2/d9/db/f16 0 2024-09-04T16:30:03.966 INFO:tasks.workunit.client.1.smithi193.stdout:2/195: write d2/f17 [242467,23450] 0 2024-09-04T16:30:03.967 INFO:tasks.workunit.client.1.smithi193.stdout:9/276: fsync d2/d18/d2f/f41 0 2024-09-04T16:30:03.968 INFO:tasks.workunit.client.1.smithi193.stdout:2/196: chown d2/d9/db/d10/c20 1 1 2024-09-04T16:30:03.969 INFO:tasks.workunit.client.1.smithi193.stdout:9/277: chown d2/d18/d2f/d51/f54 490783941 1 2024-09-04T16:30:03.972 INFO:tasks.workunit.client.1.smithi193.stdout:4/149: rmdir d3/d1a/d21 39 2024-09-04T16:30:03.973 INFO:tasks.workunit.client.1.smithi193.stdout:4/150: read d3/d1a/f1d [3277332,19816] 0 2024-09-04T16:30:03.974 INFO:tasks.workunit.client.1.smithi193.stdout:1/245: mkdir d1/d2b/db/d54 0 2024-09-04T16:30:03.982 INFO:tasks.workunit.client.1.smithi193.stdout:7/289: dread d9/d39/d3e/d4a/f4b [0,4194304] 0 2024-09-04T16:30:03.983 INFO:tasks.workunit.client.1.smithi193.stdout:7/290: chown d9/de 64494668 1 2024-09-04T16:30:03.985 INFO:tasks.workunit.client.1.smithi193.stdout:2/197: symlink d2/d9/db/d10/l40 0 2024-09-04T16:30:03.990 INFO:tasks.workunit.client.1.smithi193.stdout:4/151: write d3/f24 [3637324,91135] 0 2024-09-04T16:30:03.991 INFO:tasks.workunit.client.1.smithi193.stdout:1/246: fsync d1/d2b/d10/f1f 0 2024-09-04T16:30:03.995 INFO:tasks.workunit.client.1.smithi193.stdout:7/291: mkdir d9/de/d27/d62 0 2024-09-04T16:30:03.997 INFO:tasks.workunit.client.1.smithi193.stdout:7/292: read d9/d18/d1e/f29 [2924307,118866] 0 2024-09-04T16:30:03.997 INFO:tasks.workunit.client.1.smithi193.stdout:2/198: stat d2/d14/c27 0 2024-09-04T16:30:03.997 INFO:tasks.workunit.client.1.smithi193.stdout:3/239: write d0/d7/de/f2a [1988978,37326] 0 2024-09-04T16:30:03.998 INFO:tasks.workunit.client.1.smithi193.stdout:2/199: chown d2/d9/db/d10/c20 118 1 2024-09-04T16:30:03.998 INFO:tasks.workunit.client.1.smithi193.stdout:3/240: stat d0/d7/l11 0 2024-09-04T16:30:03.999 INFO:tasks.workunit.client.1.smithi193.stdout:1/247: dwrite d1/d2b/f2c [0,4194304] 0 2024-09-04T16:30:04.000 INFO:tasks.workunit.client.1.smithi193.stdout:1/248: chown d1/d39/d48/l41 1638274 1 2024-09-04T16:30:04.001 INFO:tasks.workunit.client.1.smithi193.stdout:1/249: fdatasync d1/f53 0 2024-09-04T16:30:04.005 INFO:tasks.workunit.client.1.smithi193.stdout:5/235: sync 2024-09-04T16:30:04.006 INFO:tasks.workunit.client.1.smithi193.stdout:3/241: mkdir d0/d18/d1c/d51/d5a 0 2024-09-04T16:30:04.007 INFO:tasks.workunit.client.1.smithi193.stdout:4/152: symlink d3/l33 0 2024-09-04T16:30:04.009 INFO:tasks.workunit.client.1.smithi193.stdout:5/236: write d1/f16 [115120,90680] 0 2024-09-04T16:30:04.009 INFO:tasks.workunit.client.1.smithi193.stdout:3/242: dread - d0/d10/f38 zero size 2024-09-04T16:30:04.010 INFO:tasks.workunit.client.1.smithi193.stdout:8/249: getdents d2/d20 0 2024-09-04T16:30:04.011 INFO:tasks.workunit.client.1.smithi193.stdout:6/198: dwrite d5/ff [0,4194304] 0 2024-09-04T16:30:04.013 INFO:tasks.workunit.client.1.smithi193.stdout:1/250: dread d1/d2b/f2e [0,4194304] 0 2024-09-04T16:30:04.014 INFO:tasks.workunit.client.1.smithi193.stdout:9/278: write d2/d18/d2f/d22/d30/d52/f57 [102908,113929] 0 2024-09-04T16:30:04.015 INFO:tasks.workunit.client.1.smithi193.stdout:7/293: dread d9/d18/d22/d2b/f33 [0,4194304] 0 2024-09-04T16:30:04.015 INFO:tasks.workunit.client.1.smithi193.stdout:3/243: write d0/d18/d1c/d51/f56 [1233258,14894] 0 2024-09-04T16:30:04.017 INFO:tasks.workunit.client.1.smithi193.stdout:4/153: chown d3/d1a/d21/f2c 7278715 1 2024-09-04T16:30:04.020 INFO:tasks.workunit.client.1.smithi193.stdout:7/294: read d9/de/f1c [3899152,42147] 0 2024-09-04T16:30:04.020 INFO:tasks.workunit.client.1.smithi193.stdout:9/279: write d2/d8/d15/f31 [5583728,52869] 0 2024-09-04T16:30:04.021 INFO:tasks.workunit.client.1.smithi193.stdout:9/280: stat d2/d18 0 2024-09-04T16:30:04.023 INFO:tasks.workunit.client.1.smithi193.stdout:7/295: read d9/de/d27/f35 [1931258,81316] 0 2024-09-04T16:30:04.023 INFO:tasks.workunit.client.1.smithi193.stdout:8/250: rename d2/d20/d23/d24/d3c/f52 to d2/d20/d23/d1b/d4e/f55 0 2024-09-04T16:30:04.024 INFO:tasks.workunit.client.1.smithi193.stdout:9/281: write d2/d18/d2f/f29 [902286,112532] 0 2024-09-04T16:30:04.026 INFO:tasks.workunit.client.1.smithi193.stdout:6/199: dwrite d5/f20 [0,4194304] 0 2024-09-04T16:30:04.029 INFO:tasks.workunit.client.1.smithi193.stdout:4/154: creat d3/d1a/d21/f34 x:0 0 0 2024-09-04T16:30:04.032 INFO:tasks.workunit.client.1.smithi193.stdout:4/155: write d3/d1a/d21/f34 [633574,58678] 0 2024-09-04T16:30:04.034 INFO:tasks.workunit.client.1.smithi193.stdout:7/296: dwrite d9/d39/d3e/f61 [0,4194304] 0 2024-09-04T16:30:04.035 INFO:tasks.workunit.client.1.smithi193.stdout:7/297: fsync d9/de/d27/f52 0 2024-09-04T16:30:04.036 INFO:tasks.workunit.client.1.smithi193.stdout:7/298: readlink d9/de/d27/l59 0 2024-09-04T16:30:04.036 INFO:tasks.workunit.client.1.smithi193.stdout:1/251: rename d1/d2b/db/c49 to d1/d2b/db/d54/c55 0 2024-09-04T16:30:04.038 INFO:tasks.workunit.client.1.smithi193.stdout:5/237: write d1/d8/f22 [1296151,15293] 0 2024-09-04T16:30:04.042 INFO:tasks.workunit.client.1.smithi193.stdout:7/299: dread d9/de/d27/f52 [0,4194304] 0 2024-09-04T16:30:04.044 INFO:tasks.workunit.client.1.smithi193.stdout:8/251: unlink d2/d20/d23/d24/d25/l37 0 2024-09-04T16:30:04.047 INFO:tasks.workunit.client.1.smithi193.stdout:3/244: mknod d0/d9/d49/c5b 0 2024-09-04T16:30:04.047 INFO:tasks.workunit.client.1.smithi193.stdout:1/252: dwrite d1/d2b/f14 [0,4194304] 0 2024-09-04T16:30:04.048 INFO:tasks.workunit.client.1.smithi193.stdout:8/252: truncate d2/d20/d23/d24/d3c/f45 4523494 0 2024-09-04T16:30:04.050 INFO:tasks.workunit.client.1.smithi193.stdout:1/253: chown d1/d2b/l9 0 1 2024-09-04T16:30:04.054 INFO:tasks.workunit.client.1.smithi193.stdout:7/300: dwrite d9/d39/d3e/f5c [0,4194304] 0 2024-09-04T16:30:04.060 INFO:tasks.workunit.client.1.smithi193.stdout:6/200: getdents d5/de/d15/d1b/d34 0 2024-09-04T16:30:04.061 INFO:tasks.workunit.client.1.smithi193.stdout:9/282: write d2/d8/d25/f3e [738767,24444] 0 2024-09-04T16:30:04.062 INFO:tasks.workunit.client.1.smithi193.stdout:6/201: dread d5/de/f18 [4194304,4194304] 0 2024-09-04T16:30:04.063 INFO:tasks.workunit.client.1.smithi193.stdout:9/283: write d2/d8/d25/f37 [526909,19109] 0 2024-09-04T16:30:04.066 INFO:tasks.workunit.client.1.smithi193.stdout:1/254: mkdir d1/d2b/d10/d56 0 2024-09-04T16:30:04.066 INFO:tasks.workunit.client.1.smithi193.stdout:1/255: dread - d1/d39/f46 zero size 2024-09-04T16:30:04.069 INFO:tasks.workunit.client.1.smithi193.stdout:9/284: dread d2/d18/d2f/f29 [0,4194304] 0 2024-09-04T16:30:04.069 INFO:tasks.workunit.client.1.smithi193.stdout:4/156: write d3/d1a/f1d [4521055,35579] 0 2024-09-04T16:30:04.070 INFO:tasks.workunit.client.1.smithi193.stdout:7/301: write d9/de/d27/f38 [8249335,76552] 0 2024-09-04T16:30:04.070 INFO:tasks.workunit.client.1.smithi193.stdout:4/157: stat d3/d1a/d2a 0 2024-09-04T16:30:04.071 INFO:tasks.workunit.client.1.smithi193.stdout:4/158: readlink d3/l33 0 2024-09-04T16:30:04.072 INFO:tasks.workunit.client.1.smithi193.stdout:5/238: link d1/d29/d1e/d37/d39/d3e/f41 d1/d29/d1e/d37/d39/f4a 0 2024-09-04T16:30:04.074 INFO:tasks.workunit.client.1.smithi193.stdout:3/245: creat d0/d18/d1c/d51/d5a/f5c x:0 0 0 2024-09-04T16:30:04.074 INFO:tasks.workunit.client.1.smithi193.stdout:3/246: chown d0/d18/d1c/d25/d39 3152682 1 2024-09-04T16:30:04.075 INFO:tasks.workunit.client.1.smithi193.stdout:3/247: chown d0/d7/de/d45/f46 232279206 1 2024-09-04T16:30:04.078 INFO:tasks.workunit.client.1.smithi193.stdout:8/253: getdents d2/d20/d23/d34/d46/d53 0 2024-09-04T16:30:04.080 INFO:tasks.workunit.client.1.smithi193.stdout:9/285: symlink d2/d18/d2f/d22/d30/l5c 0 2024-09-04T16:30:04.080 INFO:tasks.workunit.client.1.smithi193.stdout:9/286: readlink d2/d8/l40 0 2024-09-04T16:30:04.081 INFO:tasks.workunit.client.1.smithi193.stdout:7/302: creat d9/d39/d3e/f63 x:0 0 0 2024-09-04T16:30:04.082 INFO:tasks.workunit.client.1.smithi193.stdout:7/303: dread d9/d11/f4e [0,4194304] 0 2024-09-04T16:30:04.083 INFO:tasks.workunit.client.1.smithi193.stdout:5/239: rename d1/d8/db/f1a to d1/d29/d1e/f4b 0 2024-09-04T16:30:04.088 INFO:tasks.workunit.client.1.smithi193.stdout:3/248: dread d0/fa [0,4194304] 0 2024-09-04T16:30:04.091 INFO:tasks.workunit.client.1.smithi193.stdout:9/287: symlink d2/d8/d4d/l5d 0 2024-09-04T16:30:04.096 INFO:tasks.workunit.client.1.smithi193.stdout:9/288: dwrite d2/f28 [4194304,4194304] 0 2024-09-04T16:30:04.098 INFO:tasks.workunit.client.1.smithi193.stdout:3/249: symlink d0/d10/l5d 0 2024-09-04T16:30:04.101 INFO:tasks.workunit.client.1.smithi193.stdout:8/254: truncate d2/f3 1640900 0 2024-09-04T16:30:04.107 INFO:tasks.workunit.client.1.smithi193.stdout:4/159: link f0 d3/f35 0 2024-09-04T16:30:04.109 INFO:tasks.workunit.client.1.smithi193.stdout:7/304: mknod d9/de/d27/d62/c64 0 2024-09-04T16:30:04.109 INFO:tasks.workunit.client.1.smithi193.stdout:6/202: write d5/f2b [510987,40847] 0 2024-09-04T16:30:04.109 INFO:tasks.workunit.client.1.smithi193.stdout:7/305: stat d9/de/f1c 0 2024-09-04T16:30:04.111 INFO:tasks.workunit.client.1.smithi193.stdout:9/289: symlink d2/d8/d25/l5e 0 2024-09-04T16:30:04.112 INFO:tasks.workunit.client.1.smithi193.stdout:2/200: sync 2024-09-04T16:30:04.112 INFO:tasks.workunit.client.1.smithi193.stdout:0/262: sync 2024-09-04T16:30:04.113 INFO:tasks.workunit.client.1.smithi193.stdout:3/250: mkdir d0/d18/d1c/d25/d5e 0 2024-09-04T16:30:04.114 INFO:tasks.workunit.client.1.smithi193.stdout:3/251: chown d0/d18/d1c/d25/d5e 21714 1 2024-09-04T16:30:04.115 INFO:tasks.workunit.client.1.smithi193.stdout:1/256: truncate d1/d2b/f14 892595 0 2024-09-04T16:30:04.115 INFO:tasks.workunit.client.1.smithi193.stdout:1/257: dread - d1/d2b/d1b/f4c zero size 2024-09-04T16:30:04.116 INFO:tasks.workunit.client.1.smithi193.stdout:8/255: fsync d2/d20/f47 0 2024-09-04T16:30:04.118 INFO:tasks.workunit.client.1.smithi193.stdout:5/240: dread - d1/d8/db/d15/f47 zero size 2024-09-04T16:30:04.121 INFO:tasks.workunit.client.1.smithi193.stdout:5/241: dread d1/d29/d1e/d37/f43 [0,4194304] 0 2024-09-04T16:30:04.134 INFO:tasks.workunit.client.1.smithi193.stdout:8/256: fdatasync d2/d20/d23/d1b/d4e/f55 0 2024-09-04T16:30:04.141 INFO:tasks.workunit.client.1.smithi193.stdout:5/242: write d1/d8/db/d36/f48 [905075,70518] 0 2024-09-04T16:30:04.142 INFO:tasks.workunit.client.1.smithi193.stdout:7/306: symlink d9/d39/d3e/d53/l65 0 2024-09-04T16:30:04.146 INFO:tasks.workunit.client.1.smithi193.stdout:2/201: link d2/d9/d18/f1d d2/d9/d18/d3f/f41 0 2024-09-04T16:30:04.147 INFO:tasks.workunit.client.1.smithi193.stdout:1/258: dread d1/f1c [0,4194304] 0 2024-09-04T16:30:04.151 INFO:tasks.workunit.client.1.smithi193.stdout:9/290: dwrite d2/d18/d2f/f29 [0,4194304] 0 2024-09-04T16:30:04.153 INFO:tasks.workunit.client.1.smithi193.stdout:4/160: creat d3/f36 x:0 0 0 2024-09-04T16:30:04.153 INFO:tasks.workunit.client.1.smithi193.stdout:7/307: dwrite d9/d11/f4e [0,4194304] 0 2024-09-04T16:30:04.154 INFO:tasks.workunit.client.1.smithi193.stdout:6/203: rename d5/c1c to d5/c40 0 2024-09-04T16:30:04.154 INFO:tasks.workunit.client.1.smithi193.stdout:0/263: dwrite d18/f19 [0,4194304] 0 2024-09-04T16:30:04.155 INFO:tasks.workunit.client.1.smithi193.stdout:4/161: stat d3/c26 0 2024-09-04T16:30:04.155 INFO:tasks.workunit.client.1.smithi193.stdout:6/204: chown d5 1 1 2024-09-04T16:30:04.163 INFO:tasks.workunit.client.1.smithi193.stdout:3/252: truncate d0/d18/f3a 718088 0 2024-09-04T16:30:04.164 INFO:tasks.workunit.client.1.smithi193.stdout:3/253: readlink d0/d9/l19 0 2024-09-04T16:30:04.169 INFO:tasks.workunit.client.1.smithi193.stdout:4/162: read - d3/f18 zero size 2024-09-04T16:30:04.170 INFO:tasks.workunit.client.1.smithi193.stdout:6/205: write d5/f11 [4525260,35431] 0 2024-09-04T16:30:04.171 INFO:tasks.workunit.client.1.smithi193.stdout:7/308: mkdir d9/d39/d3e/d4a/d66 0 2024-09-04T16:30:04.171 INFO:tasks.workunit.client.0.smithi170.stdout:2/28: getdents d3 0 2024-09-04T16:30:04.173 INFO:tasks.workunit.client.1.smithi193.stdout:5/243: truncate d1/d29/d1e/f4b 2404495 0 2024-09-04T16:30:04.174 INFO:tasks.workunit.client.1.smithi193.stdout:8/257: link d2/d12/f19 d2/d20/d23/d1b/d4e/f56 0 2024-09-04T16:30:04.180 INFO:tasks.workunit.client.0.smithi170.stdout:1/55: rename d9/fe to d9/f10 0 2024-09-04T16:30:04.180 INFO:tasks.workunit.client.0.smithi170.stdout:1/56: read - d9/fd zero size 2024-09-04T16:30:04.181 INFO:tasks.workunit.client.0.smithi170.stdout:6/53: creat d0/f16 x:0 0 0 2024-09-04T16:30:04.181 INFO:tasks.workunit.client.1.smithi193.stdout:3/254: mknod d0/d18/d1c/d51/d5a/c5f 0 2024-09-04T16:30:04.181 INFO:tasks.workunit.client.1.smithi193.stdout:9/291: dread d2/f42 [0,4194304] 0 2024-09-04T16:30:04.182 INFO:tasks.workunit.client.0.smithi170.stdout:2/29: creat d3/d4/f9 x:0 0 0 2024-09-04T16:30:04.183 INFO:tasks.workunit.client.1.smithi193.stdout:6/206: unlink d5/c21 0 2024-09-04T16:30:04.184 INFO:tasks.workunit.client.1.smithi193.stdout:6/207: stat d5/c28 0 2024-09-04T16:30:04.184 INFO:tasks.workunit.client.1.smithi193.stdout:7/309: creat d9/de/d27/f67 x:0 0 0 2024-09-04T16:30:04.186 INFO:tasks.workunit.client.0.smithi170.stdout:1/57: rmdir d9 39 2024-09-04T16:30:04.187 INFO:tasks.workunit.client.1.smithi193.stdout:2/202: creat d2/d9/db/d10/d1f/f42 x:0 0 0 2024-09-04T16:30:04.188 INFO:tasks.workunit.client.1.smithi193.stdout:5/244: dread d1/d29/d18/f2f [0,4194304] 0 2024-09-04T16:30:04.189 INFO:tasks.workunit.client.0.smithi170.stdout:2/30: creat d3/d4/fa x:0 0 0 2024-09-04T16:30:04.190 INFO:tasks.workunit.client.0.smithi170.stdout:4/37: getdents d1/d6 0 2024-09-04T16:30:04.191 INFO:tasks.workunit.client.0.smithi170.stdout:4/38: readlink d1/d6/lb 0 2024-09-04T16:30:04.191 INFO:tasks.workunit.client.1.smithi193.stdout:4/163: truncate f0 2078153 0 2024-09-04T16:30:04.191 INFO:tasks.workunit.client.0.smithi170.stdout:5/31: link f1 d4/db/fc 0 2024-09-04T16:30:04.192 INFO:tasks.workunit.client.0.smithi170.stdout:4/39: fdatasync d1/d6/d8/fa 0 2024-09-04T16:30:04.192 INFO:tasks.workunit.client.0.smithi170.stdout:5/32: chown d4/db 65 1 2024-09-04T16:30:04.193 INFO:tasks.workunit.client.0.smithi170.stdout:5/33: rename d4 to d4/dd 22 2024-09-04T16:30:04.193 INFO:tasks.workunit.client.0.smithi170.stdout:4/40: dread - d1/d6/d8/fa zero size 2024-09-04T16:30:04.194 INFO:tasks.workunit.client.0.smithi170.stdout:2/31: dread f2 [0,4194304] 0 2024-09-04T16:30:04.195 INFO:tasks.workunit.client.0.smithi170.stdout:2/32: chown d3/d7 0 1 2024-09-04T16:30:04.196 INFO:tasks.workunit.client.0.smithi170.stdout:6/54: getdents d0/d15 0 2024-09-04T16:30:04.196 INFO:tasks.workunit.client.0.smithi170.stdout:6/55: stat d0/df/l12 0 2024-09-04T16:30:04.198 INFO:tasks.workunit.client.0.smithi170.stdout:6/56: truncate d0/f9 943701 0 2024-09-04T16:30:04.199 INFO:tasks.workunit.client.0.smithi170.stdout:9/34: link d2/f4 d2/d7/fc 0 2024-09-04T16:30:04.200 INFO:tasks.workunit.client.1.smithi193.stdout:3/255: dread d0/d9/fb [0,4194304] 0 2024-09-04T16:30:04.200 INFO:tasks.workunit.client.1.smithi193.stdout:8/258: mkdir d2/d57 0 2024-09-04T16:30:04.202 INFO:tasks.workunit.client.0.smithi170.stdout:2/33: dwrite f2 [4194304,4194304] 0 2024-09-04T16:30:04.205 INFO:tasks.workunit.client.1.smithi193.stdout:9/292: symlink d2/d18/d2f/d22/d30/d52/l5f 0 2024-09-04T16:30:04.208 INFO:tasks.workunit.client.1.smithi193.stdout:5/245: dwrite d1/f3 [0,4194304] 0 2024-09-04T16:30:04.211 INFO:tasks.workunit.client.1.smithi193.stdout:1/259: getdents d1/d2b/d10/d2a 0 2024-09-04T16:30:04.211 INFO:tasks.workunit.client.0.smithi170.stdout:6/57: fdatasync d0/f2 0 2024-09-04T16:30:04.213 INFO:tasks.workunit.client.1.smithi193.stdout:4/164: creat d3/d1a/d21/f37 x:0 0 0 2024-09-04T16:30:04.215 INFO:tasks.workunit.client.0.smithi170.stdout:2/34: dwrite d3/d4/fa [0,4194304] 0 2024-09-04T16:30:04.216 INFO:tasks.workunit.client.0.smithi170.stdout:1/58: dwrite d9/f10 [0,4194304] 0 2024-09-04T16:30:04.229 INFO:tasks.workunit.client.1.smithi193.stdout:5/246: chown d1/d8/db/c1b 64331 1 2024-09-04T16:30:04.230 INFO:tasks.workunit.client.1.smithi193.stdout:1/260: mknod d1/d2b/d1b/d28/c57 0 2024-09-04T16:30:04.230 INFO:tasks.workunit.client.0.smithi170.stdout:6/58: unlink d0/lc 0 2024-09-04T16:30:04.231 INFO:tasks.workunit.client.0.smithi170.stdout:6/59: write d0/f6 [927687,53276] 0 2024-09-04T16:30:04.232 INFO:tasks.workunit.client.1.smithi193.stdout:4/165: symlink d3/d1a/d2a/l38 0 2024-09-04T16:30:04.232 INFO:tasks.workunit.client.0.smithi170.stdout:9/35: chown d2/d7/fc 1236246 1 2024-09-04T16:30:04.234 INFO:tasks.workunit.client.1.smithi193.stdout:5/247: chown d1/d29/d1e/d37/d39 42 1 2024-09-04T16:30:04.234 INFO:tasks.workunit.client.1.smithi193.stdout:6/208: dwrite d5/f6 [0,4194304] 0 2024-09-04T16:30:04.234 INFO:tasks.workunit.client.1.smithi193.stdout:9/293: dread d2/d18/d2f/f47 [0,4194304] 0 2024-09-04T16:30:04.235 INFO:tasks.workunit.client.0.smithi170.stdout:1/59: mkdir d9/d11 0 2024-09-04T16:30:04.236 INFO:tasks.workunit.client.1.smithi193.stdout:4/166: write d3/f31 [888239,46639] 0 2024-09-04T16:30:04.236 INFO:tasks.workunit.client.0.smithi170.stdout:1/60: rename d9 to d9/d12 22 2024-09-04T16:30:04.237 INFO:tasks.workunit.client.1.smithi193.stdout:8/259: mknod d2/d20/d23/d51/c58 0 2024-09-04T16:30:04.238 INFO:tasks.workunit.client.0.smithi170.stdout:4/41: rename d1/f4 to d1/fd 0 2024-09-04T16:30:04.238 INFO:tasks.workunit.client.1.smithi193.stdout:7/310: dwrite d9/de/d27/f35 [4194304,4194304] 0 2024-09-04T16:30:04.239 INFO:tasks.workunit.client.0.smithi170.stdout:6/60: mkdir d0/d17 0 2024-09-04T16:30:04.240 INFO:tasks.workunit.client.1.smithi193.stdout:5/248: read d1/d29/f1d [547237,69556] 0 2024-09-04T16:30:04.242 INFO:tasks.workunit.client.0.smithi170.stdout:1/61: creat d9/f13 x:0 0 0 2024-09-04T16:30:04.242 INFO:tasks.workunit.client.0.smithi170.stdout:1/62: stat d9/fb 0 2024-09-04T16:30:04.242 INFO:tasks.workunit.client.0.smithi170.stdout:1/63: readlink l3 0 2024-09-04T16:30:04.243 INFO:tasks.workunit.client.0.smithi170.stdout:4/42: mknod d1/d6/ce 0 2024-09-04T16:30:04.244 INFO:tasks.workunit.client.0.smithi170.stdout:1/64: chown d9/f10 394 1 2024-09-04T16:30:04.244 INFO:tasks.workunit.client.0.smithi170.stdout:4/43: readlink d1/d6/lb 0 2024-09-04T16:30:04.245 INFO:tasks.workunit.client.0.smithi170.stdout:4/44: write d1/fc [846841,56744] 0 2024-09-04T16:30:04.249 INFO:tasks.workunit.client.0.smithi170.stdout:6/61: creat d0/d17/f18 x:0 0 0 2024-09-04T16:30:04.251 INFO:tasks.workunit.client.0.smithi170.stdout:6/62: write d0/f11 [1822237,99066] 0 2024-09-04T16:30:04.252 INFO:tasks.workunit.client.0.smithi170.stdout:5/34: dwrite f1 [0,4194304] 0 2024-09-04T16:30:04.257 INFO:tasks.workunit.client.0.smithi170.stdout:6/63: dwrite d0/f6 [0,4194304] 0 2024-09-04T16:30:04.257 INFO:tasks.workunit.client.1.smithi193.stdout:0/264: sync 2024-09-04T16:30:04.260 INFO:tasks.workunit.client.0.smithi170.stdout:6/64: dread d0/f11 [0,4194304] 0 2024-09-04T16:30:04.268 INFO:tasks.workunit.client.1.smithi193.stdout:7/311: rename d9/d39/d3e/f61 to d9/d39/d3e/f68 0 2024-09-04T16:30:04.269 INFO:tasks.workunit.client.0.smithi170.stdout:1/65: creat d9/d11/f14 x:0 0 0 2024-09-04T16:30:04.277 INFO:tasks.workunit.client.1.smithi193.stdout:6/209: rename d5/f10 to d5/de/f41 0 2024-09-04T16:30:04.278 INFO:tasks.workunit.client.0.smithi170.stdout:5/35: readlink d4/d8/la 0 2024-09-04T16:30:04.278 INFO:tasks.workunit.client.1.smithi193.stdout:6/210: chown d5/de/d15/l16 0 1 2024-09-04T16:30:04.279 INFO:tasks.workunit.client.1.smithi193.stdout:4/167: mkdir d3/d39 0 2024-09-04T16:30:04.280 INFO:tasks.workunit.client.0.smithi170.stdout:9/36: write d2/d7/fc [631742,71463] 0 2024-09-04T16:30:04.281 INFO:tasks.workunit.client.1.smithi193.stdout:6/211: write d5/f11 [1377349,72957] 0 2024-09-04T16:30:04.281 INFO:tasks.workunit.client.1.smithi193.stdout:8/260: dread d2/d20/f36 [0,4194304] 0 2024-09-04T16:30:04.281 INFO:tasks.workunit.client.1.smithi193.stdout:6/212: stat l4 0 2024-09-04T16:30:04.281 INFO:tasks.workunit.client.0.smithi170.stdout:9/37: chown d2/fa 20192 1 2024-09-04T16:30:04.282 INFO:tasks.workunit.client.0.smithi170.stdout:9/38: write d2/f4 [1662181,117963] 0 2024-09-04T16:30:04.282 INFO:tasks.workunit.client.1.smithi193.stdout:6/213: write d5/de/d15/f2f [638205,39239] 0 2024-09-04T16:30:04.283 INFO:tasks.workunit.client.0.smithi170.stdout:1/66: rmdir d9 39 2024-09-04T16:30:04.283 INFO:tasks.workunit.client.0.smithi170.stdout:9/39: write d2/f4 [755312,60897] 0 2024-09-04T16:30:04.285 INFO:tasks.workunit.client.1.smithi193.stdout:0/265: rename d18/d3f/f49 to d18/d3f/f56 0 2024-09-04T16:30:04.286 INFO:tasks.workunit.client.1.smithi193.stdout:0/266: write d18/f19 [6202282,11270] 0 2024-09-04T16:30:04.287 INFO:tasks.workunit.client.0.smithi170.stdout:4/45: dread d1/fd [4194304,4194304] 0 2024-09-04T16:30:04.287 INFO:tasks.workunit.client.1.smithi193.stdout:0/267: write d18/d25/f4d [874994,117329] 0 2024-09-04T16:30:04.288 INFO:tasks.workunit.client.0.smithi170.stdout:4/46: read - d1/d6/d8/fa zero size 2024-09-04T16:30:04.290 INFO:tasks.workunit.client.1.smithi193.stdout:7/312: mkdir d9/d39/d3e/d69 0 2024-09-04T16:30:04.290 INFO:tasks.workunit.client.0.smithi170.stdout:6/65: mkdir d0/d15/d19 0 2024-09-04T16:30:04.295 INFO:tasks.workunit.client.1.smithi193.stdout:5/249: dwrite d1/d29/d1e/d37/d39/f4a [0,4194304] 0 2024-09-04T16:30:04.295 INFO:tasks.workunit.client.1.smithi193.stdout:3/256: truncate d0/d10/f1a 45549 0 2024-09-04T16:30:04.296 INFO:tasks.workunit.client.0.smithi170.stdout:9/40: creat d2/fd x:0 0 0 2024-09-04T16:30:04.298 INFO:tasks.workunit.client.0.smithi170.stdout:9/41: write d2/fd [970758,102804] 0 2024-09-04T16:30:04.298 INFO:tasks.workunit.client.0.smithi170.stdout:5/36: creat d4/db/fe x:0 0 0 2024-09-04T16:30:04.299 INFO:tasks.workunit.client.0.smithi170.stdout:5/37: chown f1 189 1 2024-09-04T16:30:04.301 INFO:tasks.workunit.client.0.smithi170.stdout:4/47: rename d1/fd to d1/d6/ff 0 2024-09-04T16:30:04.302 INFO:tasks.workunit.client.0.smithi170.stdout:1/67: dwrite d9/fb [0,4194304] 0 2024-09-04T16:30:04.303 INFO:tasks.workunit.client.1.smithi193.stdout:1/261: getdents d1/d2b 0 2024-09-04T16:30:04.304 INFO:tasks.workunit.client.1.smithi193.stdout:1/262: write d1/d2b/d10/f21 [125704,75132] 0 2024-09-04T16:30:04.305 INFO:tasks.workunit.client.1.smithi193.stdout:8/261: mkdir d2/d20/d23/d51/d59 0 2024-09-04T16:30:04.307 INFO:tasks.workunit.client.1.smithi193.stdout:8/262: write f0 [5708668,74738] 0 2024-09-04T16:30:04.313 INFO:tasks.workunit.client.0.smithi170.stdout:9/42: rename f1 to d2/fe 0 2024-09-04T16:30:04.313 INFO:tasks.workunit.client.0.smithi170.stdout:4/48: rename d1 to d1/d6/d10 22 2024-09-04T16:30:04.314 INFO:tasks.workunit.client.0.smithi170.stdout:9/43: readlink d2/lb 0 2024-09-04T16:30:04.314 INFO:tasks.workunit.client.0.smithi170.stdout:4/49: chown d1/d6 674749368 1 2024-09-04T16:30:04.314 INFO:tasks.workunit.client.0.smithi170.stdout:9/44: chown d2/d7/f8 195 1 2024-09-04T16:30:04.315 INFO:tasks.workunit.client.0.smithi170.stdout:1/68: creat d9/f15 x:0 0 0 2024-09-04T16:30:04.316 INFO:tasks.workunit.client.1.smithi193.stdout:0/268: rmdir d18/d3f 39 2024-09-04T16:30:04.317 INFO:tasks.workunit.client.1.smithi193.stdout:4/168: dwrite d3/f2e [4194304,4194304] 0 2024-09-04T16:30:04.317 INFO:tasks.workunit.client.0.smithi170.stdout:5/38: truncate d4/f6 906546 0 2024-09-04T16:30:04.318 INFO:tasks.workunit.client.1.smithi193.stdout:7/313: creat d9/d39/d3e/d4d/f6a x:0 0 0 2024-09-04T16:30:04.320 INFO:tasks.workunit.client.0.smithi170.stdout:4/50: mknod d1/d6/c11 0 2024-09-04T16:30:04.322 INFO:tasks.workunit.client.1.smithi193.stdout:9/294: rename d2/d8/c39 to d2/d18/c60 0 2024-09-04T16:30:04.322 INFO:tasks.workunit.client.0.smithi170.stdout:9/45: dwrite d2/fa [0,4194304] 0 2024-09-04T16:30:04.323 INFO:tasks.workunit.client.0.smithi170.stdout:9/46: fdatasync d2/d7/f8 0 2024-09-04T16:30:04.324 INFO:tasks.workunit.client.0.smithi170.stdout:1/69: symlink d9/l16 0 2024-09-04T16:30:04.324 INFO:tasks.workunit.client.1.smithi193.stdout:3/257: rmdir d0/d18/d1c/d25 39 2024-09-04T16:30:04.325 INFO:tasks.workunit.client.0.smithi170.stdout:9/47: write d2/fa [3366613,76676] 0 2024-09-04T16:30:04.329 INFO:tasks.workunit.client.1.smithi193.stdout:2/203: sync 2024-09-04T16:30:04.329 INFO:tasks.workunit.client.0.smithi170.stdout:4/51: unlink d1/f3 0 2024-09-04T16:30:04.330 INFO:tasks.workunit.client.1.smithi193.stdout:2/204: dread - d2/d9/d18/f37 zero size 2024-09-04T16:30:04.331 INFO:tasks.workunit.client.1.smithi193.stdout:2/205: truncate d2/d9/f39 294852 0 2024-09-04T16:30:04.331 INFO:tasks.workunit.client.0.smithi170.stdout:6/66: dwrite d0/f11 [0,4194304] 0 2024-09-04T16:30:04.334 INFO:tasks.workunit.client.0.smithi170.stdout:6/67: truncate d0/df/f10 565083 0 2024-09-04T16:30:04.336 INFO:tasks.workunit.client.1.smithi193.stdout:6/214: symlink d5/de/d15/l42 0 2024-09-04T16:30:04.336 INFO:tasks.workunit.client.0.smithi170.stdout:6/68: dread - d0/f16 zero size 2024-09-04T16:30:04.336 INFO:tasks.workunit.client.0.smithi170.stdout:9/48: dwrite d2/fd [0,4194304] 0 2024-09-04T16:30:04.337 INFO:tasks.workunit.client.1.smithi193.stdout:4/169: stat d3/f16 0 2024-09-04T16:30:04.337 INFO:tasks.workunit.client.0.smithi170.stdout:9/49: stat d2/f4 0 2024-09-04T16:30:04.338 INFO:tasks.workunit.client.0.smithi170.stdout:4/52: creat d1/d6/f12 x:0 0 0 2024-09-04T16:30:04.339 INFO:tasks.workunit.client.0.smithi170.stdout:4/53: dread - d1/d6/f12 zero size 2024-09-04T16:30:04.340 INFO:tasks.workunit.client.1.smithi193.stdout:7/314: symlink d9/d39/d3e/d4d/l6b 0 2024-09-04T16:30:04.340 INFO:tasks.workunit.client.0.smithi170.stdout:9/50: rmdir d2/d7 39 2024-09-04T16:30:04.341 INFO:tasks.workunit.client.1.smithi193.stdout:7/315: chown d9/d18/d22/c3c 80790 1 2024-09-04T16:30:04.343 INFO:tasks.workunit.client.1.smithi193.stdout:3/258: read d0/d7/de/d45/f52 [309408,105673] 0 2024-09-04T16:30:04.345 INFO:tasks.workunit.client.0.smithi170.stdout:4/54: mknod d1/d6/d8/c13 0 2024-09-04T16:30:04.346 INFO:tasks.workunit.client.0.smithi170.stdout:6/69: dwrite d0/f6 [0,4194304] 0 2024-09-04T16:30:04.346 INFO:tasks.workunit.client.0.smithi170.stdout:6/70: stat d0/fd 0 2024-09-04T16:30:04.351 INFO:tasks.workunit.client.0.smithi170.stdout:4/55: creat d1/d6/f14 x:0 0 0 2024-09-04T16:30:04.357 INFO:tasks.workunit.client.0.smithi170.stdout:9/51: rename d2/c5 to d2/d7/cf 0 2024-09-04T16:30:04.360 INFO:tasks.workunit.client.1.smithi193.stdout:1/263: symlink d1/l58 0 2024-09-04T16:30:04.360 INFO:tasks.workunit.client.1.smithi193.stdout:1/264: readlink d1/d2b/d1b/l27 0 2024-09-04T16:30:04.361 INFO:tasks.workunit.client.1.smithi193.stdout:1/265: readlink d1/d2b/l1e 0 2024-09-04T16:30:04.361 INFO:tasks.workunit.client.1.smithi193.stdout:1/266: fdatasync d1/d2b/d1b/f4c 0 2024-09-04T16:30:04.362 INFO:tasks.workunit.client.0.smithi170.stdout:4/56: creat d1/d6/f15 x:0 0 0 2024-09-04T16:30:04.362 INFO:tasks.workunit.client.1.smithi193.stdout:9/295: dread d2/d4/f5 [0,4194304] 0 2024-09-04T16:30:04.363 INFO:tasks.workunit.client.1.smithi193.stdout:1/267: write d1/d2b/f2c [2258207,109895] 0 2024-09-04T16:30:04.363 INFO:tasks.workunit.client.0.smithi170.stdout:1/70: truncate d9/f10 2929222 0 2024-09-04T16:30:04.363 INFO:tasks.workunit.client.1.smithi193.stdout:9/296: chown d2/d18/d2f/d51 99984 1 2024-09-04T16:30:04.366 INFO:tasks.workunit.client.0.smithi170.stdout:6/71: getdents d0/d15/d19 0 2024-09-04T16:30:04.366 INFO:tasks.workunit.client.0.smithi170.stdout:4/57: dread d1/fc [0,4194304] 0 2024-09-04T16:30:04.367 INFO:tasks.workunit.client.0.smithi170.stdout:4/58: stat d1/d6/lb 0 2024-09-04T16:30:04.369 INFO:tasks.workunit.client.1.smithi193.stdout:6/215: rename d5/de/d15/d1b/d34 to d5/d27/d3e/d43 0 2024-09-04T16:30:04.369 INFO:tasks.workunit.client.1.smithi193.stdout:6/216: truncate d5/d33/f3a 292397 0 2024-09-04T16:30:04.370 INFO:tasks.workunit.client.0.smithi170.stdout:6/72: dread d0/f11 [0,4194304] 0 2024-09-04T16:30:04.370 INFO:tasks.workunit.client.1.smithi193.stdout:6/217: readlink d5/de/d15/l16 0 2024-09-04T16:30:04.371 INFO:tasks.workunit.client.1.smithi193.stdout:5/250: truncate d1/d8/db/d36/f48 579359 0 2024-09-04T16:30:04.372 INFO:tasks.workunit.client.0.smithi170.stdout:1/71: creat d9/f17 x:0 0 0 2024-09-04T16:30:04.372 INFO:tasks.workunit.client.0.smithi170.stdout:1/72: dread - d9/f15 zero size 2024-09-04T16:30:04.373 INFO:tasks.workunit.client.1.smithi193.stdout:0/269: truncate d18/f23 2656496 0 2024-09-04T16:30:04.375 INFO:tasks.workunit.client.0.smithi170.stdout:9/52: link d2/d7/fc d2/d7/f10 0 2024-09-04T16:30:04.376 INFO:tasks.workunit.client.1.smithi193.stdout:7/316: readlink d9/d18/d22/l60 0 2024-09-04T16:30:04.376 INFO:tasks.workunit.client.0.smithi170.stdout:1/73: dread d9/fb [0,4194304] 0 2024-09-04T16:30:04.377 INFO:tasks.workunit.client.1.smithi193.stdout:5/251: dwrite d1/d8/f22 [0,4194304] 0 2024-09-04T16:30:04.377 INFO:tasks.workunit.client.1.smithi193.stdout:7/317: stat d9/de/c36 0 2024-09-04T16:30:04.377 INFO:tasks.workunit.client.0.smithi170.stdout:1/74: fdatasync d9/f15 0 2024-09-04T16:30:04.377 INFO:tasks.workunit.client.0.smithi170.stdout:1/75: dread - d9/f15 zero size 2024-09-04T16:30:04.378 INFO:tasks.workunit.client.1.smithi193.stdout:7/318: chown d9/d39/d3e/d4d/l6b 15375 1 2024-09-04T16:30:04.379 INFO:tasks.workunit.client.0.smithi170.stdout:4/59: mknod d1/d6/d8/c16 0 2024-09-04T16:30:04.381 INFO:tasks.workunit.client.1.smithi193.stdout:3/259: creat d0/d3b/f60 x:0 0 0 2024-09-04T16:30:04.386 INFO:tasks.workunit.client.0.smithi170.stdout:9/53: dread d2/d7/f10 [0,4194304] 0 2024-09-04T16:30:04.386 INFO:tasks.workunit.client.0.smithi170.stdout:6/73: mknod d0/d17/c1a 0 2024-09-04T16:30:04.386 INFO:tasks.workunit.client.1.smithi193.stdout:8/263: link d2/l5 d2/d20/d23/d1b/l5a 0 2024-09-04T16:30:04.387 INFO:tasks.workunit.client.0.smithi170.stdout:4/60: dwrite d1/d6/d8/fa [0,4194304] 0 2024-09-04T16:30:04.387 INFO:tasks.workunit.client.1.smithi193.stdout:1/268: write d1/d2b/d10/f17 [1771512,58557] 0 2024-09-04T16:30:04.390 INFO:tasks.workunit.client.1.smithi193.stdout:4/170: truncate d3/f35 2007666 0 2024-09-04T16:30:04.393 INFO:tasks.workunit.client.0.smithi170.stdout:1/76: creat d9/f18 x:0 0 0 2024-09-04T16:30:04.394 INFO:tasks.workunit.client.1.smithi193.stdout:1/269: dwrite d1/d2b/f2c [0,4194304] 0 2024-09-04T16:30:04.397 INFO:tasks.workunit.client.1.smithi193.stdout:6/218: unlink d5/d27/d3e/d43/f3d 0 2024-09-04T16:30:04.397 INFO:tasks.workunit.client.1.smithi193.stdout:6/219: chown d5/de/d15/l42 383 1 2024-09-04T16:30:04.399 INFO:tasks.workunit.client.1.smithi193.stdout:9/297: dread d2/d4/f7 [0,4194304] 0 2024-09-04T16:30:04.402 INFO:tasks.workunit.client.1.smithi193.stdout:5/252: chown d1/d29/d1e/f4b 1558 1 2024-09-04T16:30:04.405 INFO:tasks.workunit.client.0.smithi170.stdout:4/61: rename d1/d6/c11 to d1/d6/d8/c17 0 2024-09-04T16:30:04.405 INFO:tasks.workunit.client.1.smithi193.stdout:6/220: dwrite d5/f2b [0,4194304] 0 2024-09-04T16:30:04.407 INFO:tasks.workunit.client.0.smithi170.stdout:1/77: write d9/fb [3774447,94059] 0 2024-09-04T16:30:04.407 INFO:tasks.workunit.client.1.smithi193.stdout:7/319: mkdir d9/d18/d22/d2b/d6c 0 2024-09-04T16:30:04.409 INFO:tasks.workunit.client.0.smithi170.stdout:9/54: mkdir d2/d11 0 2024-09-04T16:30:04.415 INFO:tasks.workunit.client.1.smithi193.stdout:1/270: creat d1/d2b/d10/f59 x:0 0 0 2024-09-04T16:30:04.415 INFO:tasks.workunit.client.1.smithi193.stdout:2/206: sync 2024-09-04T16:30:04.415 INFO:tasks.workunit.client.1.smithi193.stdout:1/271: write d1/d2b/d10/f1f [3272874,51602] 0 2024-09-04T16:30:04.416 INFO:tasks.workunit.client.1.smithi193.stdout:1/272: readlink d1/d2b/db/l4e 0 2024-09-04T16:30:04.419 INFO:tasks.workunit.client.0.smithi170.stdout:1/78: mknod d9/c19 0 2024-09-04T16:30:04.423 INFO:tasks.workunit.client.1.smithi193.stdout:0/270: rename d18/d3f to d18/d25/d32/d57 0 2024-09-04T16:30:04.423 INFO:tasks.workunit.client.1.smithi193.stdout:3/260: dread d0/d18/d1c/d30/f33 [0,4194304] 0 2024-09-04T16:30:04.424 INFO:tasks.workunit.client.0.smithi170.stdout:6/74: rmdir d0/d15/d19 0 2024-09-04T16:30:04.425 INFO:tasks.workunit.client.1.smithi193.stdout:9/298: truncate d2/d18/d2f/f41 939376 0 2024-09-04T16:30:04.426 INFO:tasks.workunit.client.0.smithi170.stdout:6/75: write d0/f6 [3370073,91582] 0 2024-09-04T16:30:04.426 INFO:tasks.workunit.client.1.smithi193.stdout:9/299: truncate d2/d8/d15/f48 712500 0 2024-09-04T16:30:04.427 INFO:tasks.workunit.client.0.smithi170.stdout:1/79: dwrite d9/f18 [0,4194304] 0 2024-09-04T16:30:04.428 INFO:tasks.workunit.client.0.smithi170.stdout:6/76: write d0/f9 [1282243,112214] 0 2024-09-04T16:30:04.429 INFO:tasks.workunit.client.0.smithi170.stdout:9/55: creat d2/d11/f12 x:0 0 0 2024-09-04T16:30:04.436 INFO:tasks.workunit.client.1.smithi193.stdout:2/207: unlink d2/d9/db/f23 0 2024-09-04T16:30:04.437 INFO:tasks.workunit.client.1.smithi193.stdout:2/208: write d2/d9/db/f16 [4753370,101811] 0 2024-09-04T16:30:04.438 INFO:tasks.workunit.client.0.smithi170.stdout:6/77: rmdir d0 39 2024-09-04T16:30:04.438 INFO:tasks.workunit.client.0.smithi170.stdout:1/80: dread d9/f10 [0,4194304] 0 2024-09-04T16:30:04.439 INFO:tasks.workunit.client.1.smithi193.stdout:2/209: write d2/d9/f39 [452927,10731] 0 2024-09-04T16:30:04.440 INFO:tasks.workunit.client.0.smithi170.stdout:1/81: dread - d9/f17 zero size 2024-09-04T16:30:04.440 INFO:tasks.workunit.client.0.smithi170.stdout:1/82: stat d9/lf 0 2024-09-04T16:30:04.440 INFO:tasks.workunit.client.0.smithi170.stdout:1/83: dread - d9/f17 zero size 2024-09-04T16:30:04.441 INFO:tasks.workunit.client.0.smithi170.stdout:1/84: stat d9/f13 0 2024-09-04T16:30:04.441 INFO:tasks.workunit.client.0.smithi170.stdout:1/85: dread - d9/f13 zero size 2024-09-04T16:30:04.441 INFO:tasks.workunit.client.0.smithi170.stdout:1/86: readlink d9/l16 0 2024-09-04T16:30:04.442 INFO:tasks.workunit.client.1.smithi193.stdout:1/273: unlink d1/d2b/d10/f2f 0 2024-09-04T16:30:04.443 INFO:tasks.workunit.client.0.smithi170.stdout:4/62: write d1/d6/ff [4129009,86460] 0 2024-09-04T16:30:04.446 INFO:tasks.workunit.client.1.smithi193.stdout:8/264: rename d2/d20/d23/l1c to d2/d20/l5b 0 2024-09-04T16:30:04.447 INFO:tasks.workunit.client.1.smithi193.stdout:8/265: chown d2/d12/lf 104 1 2024-09-04T16:30:04.448 INFO:tasks.workunit.client.1.smithi193.stdout:3/261: chown d0/d18/f3a 38784 1 2024-09-04T16:30:04.448 INFO:tasks.workunit.client.0.smithi170.stdout:6/78: mkdir d0/df/d1b 0 2024-09-04T16:30:04.449 INFO:tasks.workunit.client.1.smithi193.stdout:8/266: write d2/d12/f43 [1428257,25449] 0 2024-09-04T16:30:04.449 INFO:tasks.workunit.client.0.smithi170.stdout:1/87: dwrite d9/fd [0,4194304] 0 2024-09-04T16:30:04.450 INFO:tasks.workunit.client.0.smithi170.stdout:6/79: fdatasync d0/d17/f18 0 2024-09-04T16:30:04.450 INFO:tasks.workunit.client.0.smithi170.stdout:9/56: creat d2/f13 x:0 0 0 2024-09-04T16:30:04.450 INFO:tasks.workunit.client.1.smithi193.stdout:5/253: creat d1/d29/d18/d42/f4c x:0 0 0 2024-09-04T16:30:04.451 INFO:tasks.workunit.client.0.smithi170.stdout:1/88: dread - d9/f13 zero size 2024-09-04T16:30:04.452 INFO:tasks.workunit.client.0.smithi170.stdout:4/63: unlink d1/d6/f15 0 2024-09-04T16:30:04.453 INFO:tasks.workunit.client.0.smithi170.stdout:4/64: write d1/d6/d8/f9 [2511078,15224] 0 2024-09-04T16:30:04.455 INFO:tasks.workunit.client.0.smithi170.stdout:6/80: creat d0/d17/f1c x:0 0 0 2024-09-04T16:30:04.458 INFO:tasks.workunit.client.0.smithi170.stdout:1/89: rename d9/f17 to d9/d11/f1a 0 2024-09-04T16:30:04.458 INFO:tasks.workunit.client.0.smithi170.stdout:4/65: rename d1 to d1/d6/d8/d18 22 2024-09-04T16:30:04.459 INFO:tasks.workunit.client.0.smithi170.stdout:1/90: dread - d9/f15 zero size 2024-09-04T16:30:04.459 INFO:tasks.workunit.client.0.smithi170.stdout:4/66: stat d1/d6/ff 0 2024-09-04T16:30:04.460 INFO:tasks.workunit.client.0.smithi170.stdout:1/91: read - d9/d11/f14 zero size 2024-09-04T16:30:04.460 INFO:tasks.workunit.client.0.smithi170.stdout:4/67: chown d1/d6/ce 285570572 1 2024-09-04T16:30:04.462 INFO:tasks.workunit.client.0.smithi170.stdout:9/57: symlink d2/l14 0 2024-09-04T16:30:04.464 INFO:tasks.workunit.client.0.smithi170.stdout:6/81: creat d0/d17/f1d x:0 0 0 2024-09-04T16:30:04.465 INFO:tasks.workunit.client.1.smithi193.stdout:1/274: mknod d1/d2b/d1b/d28/c5a 0 2024-09-04T16:30:04.467 INFO:tasks.workunit.client.0.smithi170.stdout:1/92: dwrite d9/f18 [0,4194304] 0 2024-09-04T16:30:04.467 INFO:tasks.workunit.client.0.smithi170.stdout:1/93: readlink l3 0 2024-09-04T16:30:04.469 INFO:tasks.workunit.client.1.smithi193.stdout:4/171: rename d3/f1e to d3/d1a/d21/f3a 0 2024-09-04T16:30:04.470 INFO:tasks.workunit.client.1.smithi193.stdout:2/210: rename d2/d9/d18/d3f to d2/d9/d18/d3f/d43 22 2024-09-04T16:30:04.473 INFO:tasks.workunit.client.0.smithi170.stdout:9/58: chown d2/fe 96 1 2024-09-04T16:30:04.473 INFO:tasks.workunit.client.0.smithi170.stdout:9/59: dread - d2/f13 zero size 2024-09-04T16:30:04.474 INFO:tasks.workunit.client.1.smithi193.stdout:7/320: truncate d9/d18/d22/f30 3835073 0 2024-09-04T16:30:04.474 INFO:tasks.workunit.client.0.smithi170.stdout:9/60: dread - d2/d11/f12 zero size 2024-09-04T16:30:04.475 INFO:tasks.workunit.client.1.smithi193.stdout:7/321: fsync d9/de/d27/f34 0 2024-09-04T16:30:04.475 INFO:tasks.workunit.client.1.smithi193.stdout:7/322: dread - d9/de/f54 zero size 2024-09-04T16:30:04.476 INFO:tasks.workunit.client.0.smithi170.stdout:1/94: symlink d9/l1b 0 2024-09-04T16:30:04.477 INFO:tasks.workunit.client.1.smithi193.stdout:9/300: mkdir d2/d8/d61 0 2024-09-04T16:30:04.478 INFO:tasks.workunit.client.1.smithi193.stdout:8/267: chown d2/l38 1029563221 1 2024-09-04T16:30:04.481 INFO:tasks.workunit.client.0.smithi170.stdout:1/95: mknod d9/c1c 0 2024-09-04T16:30:04.482 INFO:tasks.workunit.client.0.smithi170.stdout:1/96: write d9/f13 [424273,36143] 0 2024-09-04T16:30:04.482 INFO:tasks.workunit.client.1.smithi193.stdout:6/221: creat d5/f44 x:0 0 0 2024-09-04T16:30:04.484 INFO:tasks.workunit.client.0.smithi170.stdout:4/68: creat d1/f19 x:0 0 0 2024-09-04T16:30:04.489 INFO:tasks.workunit.client.1.smithi193.stdout:4/172: unlink d3/d1a/f1d 0 2024-09-04T16:30:04.491 INFO:tasks.workunit.client.0.smithi170.stdout:1/97: symlink d9/l1d 0 2024-09-04T16:30:04.491 INFO:tasks.workunit.client.0.smithi170.stdout:1/98: chown d9/d11 78319 1 2024-09-04T16:30:04.492 INFO:tasks.workunit.client.1.smithi193.stdout:5/254: dread d1/d8/db/d15/f30 [0,4194304] 0 2024-09-04T16:30:04.532 INFO:tasks.workunit.client.0.smithi170.stdout:4/69: fsync d1/fc 0 2024-09-04T16:30:04.532 INFO:tasks.workunit.client.1.smithi193.stdout:3/262: mknod d0/d18/d1b/d3d/c61 0 2024-09-04T16:30:04.533 INFO:tasks.workunit.client.1.smithi193.stdout:3/263: readlink d0/d9/l19 0 2024-09-04T16:30:04.537 INFO:tasks.workunit.client.0.smithi170.stdout:9/61: truncate d2/fa 2429410 0 2024-09-04T16:30:04.538 INFO:tasks.workunit.client.1.smithi193.stdout:9/301: chown d2/d4/fd 6 1 2024-09-04T16:30:04.539 INFO:tasks.workunit.client.0.smithi170.stdout:1/99: dwrite d9/d11/f1a [0,4194304] 0 2024-09-04T16:30:04.540 INFO:tasks.workunit.client.0.smithi170.stdout:4/70: symlink d1/l1a 0 2024-09-04T16:30:04.540 INFO:tasks.workunit.client.0.smithi170.stdout:1/100: stat l8 0 2024-09-04T16:30:04.541 INFO:tasks.workunit.client.1.smithi193.stdout:7/323: dread d9/de/f1c [0,4194304] 0 2024-09-04T16:30:04.541 INFO:tasks.workunit.client.1.smithi193.stdout:1/275: dwrite d1/d39/f46 [0,4194304] 0 2024-09-04T16:30:04.541 INFO:tasks.workunit.client.0.smithi170.stdout:1/101: write d9/d11/f14 [856338,7781] 0 2024-09-04T16:30:04.543 INFO:tasks.workunit.client.0.smithi170.stdout:9/62: rmdir d2/d11 39 2024-09-04T16:30:04.545 INFO:tasks.workunit.client.0.smithi170.stdout:4/71: creat d1/d6/f1b x:0 0 0 2024-09-04T16:30:04.546 INFO:tasks.workunit.client.0.smithi170.stdout:4/72: readlink d1/l1a 0 2024-09-04T16:30:04.546 INFO:tasks.workunit.client.1.smithi193.stdout:0/271: link l16 d18/l58 0 2024-09-04T16:30:04.547 INFO:tasks.workunit.client.0.smithi170.stdout:4/73: dread - d1/d6/f12 zero size 2024-09-04T16:30:04.548 INFO:tasks.workunit.client.0.smithi170.stdout:1/102: dread d9/d11/f1a [0,4194304] 0 2024-09-04T16:30:04.548 INFO:tasks.workunit.client.0.smithi170.stdout:1/103: stat d9/d11 0 2024-09-04T16:30:04.549 INFO:tasks.workunit.client.0.smithi170.stdout:9/63: fdatasync d2/f4 0 2024-09-04T16:30:04.553 INFO:tasks.workunit.client.1.smithi193.stdout:4/173: rename d3/f2e to d3/d1a/d2a/f3b 0 2024-09-04T16:30:04.555 INFO:tasks.workunit.client.1.smithi193.stdout:3/264: dread d0/d7/de/f2a [4194304,4194304] 0 2024-09-04T16:30:04.557 INFO:tasks.workunit.client.1.smithi193.stdout:2/211: link d2/d9/d18/f28 d2/d9/d18/d3f/f44 0 2024-09-04T16:30:04.558 INFO:tasks.workunit.client.0.smithi170.stdout:1/104: dwrite d9/f18 [4194304,4194304] 0 2024-09-04T16:30:04.562 INFO:tasks.workunit.client.0.smithi170.stdout:9/64: write d2/d7/fc [643197,87474] 0 2024-09-04T16:30:04.563 INFO:tasks.workunit.client.0.smithi170.stdout:1/105: creat d9/d11/f1e x:0 0 0 2024-09-04T16:30:04.564 INFO:tasks.workunit.client.0.smithi170.stdout:1/106: readlink d9/l16 0 2024-09-04T16:30:04.565 INFO:tasks.workunit.client.1.smithi193.stdout:9/302: unlink d2/d18/d2f/d51/f54 0 2024-09-04T16:30:04.566 INFO:tasks.workunit.client.0.smithi170.stdout:4/74: rename d1/d6/lb to d1/l1c 0 2024-09-04T16:30:04.566 INFO:tasks.workunit.client.1.smithi193.stdout:9/303: truncate d2/d8/d25/f3e 1053414 0 2024-09-04T16:30:04.567 INFO:tasks.workunit.client.0.smithi170.stdout:9/65: chown d2/d11/f12 21043 1 2024-09-04T16:30:04.568 INFO:tasks.workunit.client.1.smithi193.stdout:9/304: chown d2/d18/d2f/d51/f5a 5893 1 2024-09-04T16:30:04.568 INFO:tasks.workunit.client.0.smithi170.stdout:1/107: mknod d9/c1f 0 2024-09-04T16:30:04.569 INFO:tasks.workunit.client.0.smithi170.stdout:9/66: dread - d2/d11/f12 zero size 2024-09-04T16:30:04.569 INFO:tasks.workunit.client.1.smithi193.stdout:1/276: creat d1/d2b/db/f5b x:0 0 0 2024-09-04T16:30:04.571 INFO:tasks.workunit.client.1.smithi193.stdout:0/272: mknod d18/d25/d3b/c59 0 2024-09-04T16:30:04.571 INFO:tasks.workunit.client.0.smithi170.stdout:4/75: dread d1/d6/d8/f9 [0,4194304] 0 2024-09-04T16:30:04.573 INFO:tasks.workunit.client.0.smithi170.stdout:1/108: unlink d9/fd 0 2024-09-04T16:30:04.578 INFO:tasks.workunit.client.1.smithi193.stdout:3/265: creat d0/d18/d1c/d51/d5a/f62 x:0 0 0 2024-09-04T16:30:04.579 INFO:tasks.workunit.client.1.smithi193.stdout:2/212: symlink d2/d9/d18/l45 0 2024-09-04T16:30:04.579 INFO:tasks.workunit.client.0.smithi170.stdout:4/76: symlink d1/d6/l1d 0 2024-09-04T16:30:04.581 INFO:tasks.workunit.client.0.smithi170.stdout:1/109: symlink d9/l20 0 2024-09-04T16:30:04.584 INFO:tasks.workunit.client.0.smithi170.stdout:9/67: creat d2/f15 x:0 0 0 2024-09-04T16:30:04.589 INFO:tasks.workunit.client.0.smithi170.stdout:1/110: rename d9/fb to d9/d11/f21 0 2024-09-04T16:30:04.589 INFO:tasks.workunit.client.0.smithi170.stdout:9/68: unlink d2/l14 0 2024-09-04T16:30:04.589 INFO:tasks.workunit.client.1.smithi193.stdout:9/305: creat d2/d8/d15/f62 x:0 0 0 2024-09-04T16:30:04.589 INFO:tasks.workunit.client.1.smithi193.stdout:7/324: dwrite d9/de/f1c [0,4194304] 0 2024-09-04T16:30:04.591 INFO:tasks.workunit.client.1.smithi193.stdout:0/273: mknod d18/d25/d32/c5a 0 2024-09-04T16:30:04.591 INFO:tasks.workunit.client.1.smithi193.stdout:5/255: link d1/d8/fc d1/d29/d1e/d37/f4d 0 2024-09-04T16:30:04.592 INFO:tasks.workunit.client.0.smithi170.stdout:9/69: rmdir d2/d7 39 2024-09-04T16:30:04.593 INFO:tasks.workunit.client.1.smithi193.stdout:4/174: mkdir d3/d3c 0 2024-09-04T16:30:04.593 INFO:tasks.workunit.client.0.smithi170.stdout:4/77: creat d1/f1e x:0 0 0 2024-09-04T16:30:04.595 INFO:tasks.workunit.client.1.smithi193.stdout:8/268: link d2/d20/d23/d34/d4b/c4c d2/d20/c5c 0 2024-09-04T16:30:04.595 INFO:tasks.workunit.client.0.smithi170.stdout:4/78: mknod d1/d6/d8/c1f 0 2024-09-04T16:30:04.596 INFO:tasks.workunit.client.1.smithi193.stdout:6/222: getdents d5/d27/d3e 0 2024-09-04T16:30:04.598 INFO:tasks.workunit.client.0.smithi170.stdout:4/79: rmdir d1 39 2024-09-04T16:30:04.600 INFO:tasks.workunit.client.1.smithi193.stdout:7/325: dwrite f8 [0,4194304] 0 2024-09-04T16:30:04.602 INFO:tasks.workunit.client.0.smithi170.stdout:4/80: write d1/d6/ff [6264980,60457] 0 2024-09-04T16:30:04.612 INFO:tasks.workunit.client.1.smithi193.stdout:0/274: dread f15 [0,4194304] 0 2024-09-04T16:30:04.614 INFO:tasks.workunit.client.1.smithi193.stdout:8/269: creat d2/d20/d23/d24/f5d x:0 0 0 2024-09-04T16:30:04.614 INFO:tasks.workunit.client.1.smithi193.stdout:4/175: dread d3/d1a/d21/f22 [0,4194304] 0 2024-09-04T16:30:04.617 INFO:tasks.workunit.client.1.smithi193.stdout:7/326: symlink d9/d18/d1e/l6d 0 2024-09-04T16:30:04.618 INFO:tasks.workunit.client.1.smithi193.stdout:7/327: chown d9/d39/d3e 5802 1 2024-09-04T16:30:04.618 INFO:tasks.workunit.client.1.smithi193.stdout:2/213: dread d2/d9/db/f21 [0,4194304] 0 2024-09-04T16:30:04.618 INFO:tasks.workunit.client.1.smithi193.stdout:7/328: stat d9/d18/d22/l60 0 2024-09-04T16:30:04.619 INFO:tasks.workunit.client.0.smithi170.stdout:4/81: getdents d1/d6 0 2024-09-04T16:30:04.619 INFO:tasks.workunit.client.1.smithi193.stdout:7/329: write d9/de/d27/f34 [874898,33716] 0 2024-09-04T16:30:04.620 INFO:tasks.workunit.client.1.smithi193.stdout:7/330: write f8 [557679,123218] 0 2024-09-04T16:30:04.621 INFO:tasks.workunit.client.1.smithi193.stdout:3/266: mknod d0/d18/d1c/d25/d39/c63 0 2024-09-04T16:30:04.624 INFO:tasks.workunit.client.1.smithi193.stdout:1/277: getdents d1/d2b/d10 0 2024-09-04T16:30:04.625 INFO:tasks.workunit.client.0.smithi170.stdout:1/111: dwrite d9/f10 [0,4194304] 0 2024-09-04T16:30:04.626 INFO:tasks.workunit.client.1.smithi193.stdout:6/223: dread d5/de/d15/f24 [0,4194304] 0 2024-09-04T16:30:04.627 INFO:tasks.workunit.client.1.smithi193.stdout:5/256: creat d1/d8/db/f4e x:0 0 0 2024-09-04T16:30:04.627 INFO:tasks.workunit.client.1.smithi193.stdout:8/270: fsync d2/f2e 0 2024-09-04T16:30:04.628 INFO:tasks.workunit.client.0.smithi170.stdout:4/82: getdents d1/d6 0 2024-09-04T16:30:04.630 INFO:tasks.workunit.client.1.smithi193.stdout:9/306: dwrite d2/d4/fd [0,4194304] 0 2024-09-04T16:30:04.632 INFO:tasks.workunit.client.0.smithi170.stdout:1/112: unlink d9/c1c 0 2024-09-04T16:30:04.632 INFO:tasks.workunit.client.0.smithi170.stdout:9/70: write d2/fa [2152425,111447] 0 2024-09-04T16:30:04.633 INFO:tasks.workunit.client.0.smithi170.stdout:1/113: readlink d9/l16 0 2024-09-04T16:30:04.633 INFO:tasks.workunit.client.1.smithi193.stdout:2/214: mknod d2/d9/db/c46 0 2024-09-04T16:30:04.634 INFO:tasks.workunit.client.0.smithi170.stdout:9/71: write d2/fa [892815,27931] 0 2024-09-04T16:30:04.635 INFO:tasks.workunit.client.0.smithi170.stdout:4/83: mkdir d1/d6/d8/d20 0 2024-09-04T16:30:04.639 INFO:tasks.workunit.client.0.smithi170.stdout:1/114: creat d9/f22 x:0 0 0 2024-09-04T16:30:04.640 INFO:tasks.workunit.client.0.smithi170.stdout:9/72: dread d2/fa [0,4194304] 0 2024-09-04T16:30:04.640 INFO:tasks.workunit.client.1.smithi193.stdout:7/331: mknod d9/d18/d22/d2b/c6e 0 2024-09-04T16:30:04.641 INFO:tasks.workunit.client.0.smithi170.stdout:9/73: readlink d2/lb 0 2024-09-04T16:30:04.643 INFO:tasks.workunit.client.0.smithi170.stdout:9/74: dread - d2/d11/f12 zero size 2024-09-04T16:30:04.644 INFO:tasks.workunit.client.1.smithi193.stdout:3/267: write d0/d18/d1b/f36 [468426,96261] 0 2024-09-04T16:30:04.646 INFO:tasks.workunit.client.0.smithi170.stdout:4/84: dwrite d1/f1e [0,4194304] 0 2024-09-04T16:30:04.647 INFO:tasks.workunit.client.0.smithi170.stdout:9/75: truncate d2/d11/f12 452987 0 2024-09-04T16:30:04.648 INFO:tasks.workunit.client.0.smithi170.stdout:1/115: mknod d9/d11/c23 0 2024-09-04T16:30:04.649 INFO:tasks.workunit.client.1.smithi193.stdout:1/278: creat d1/d2b/db/f5c x:0 0 0 2024-09-04T16:30:04.650 INFO:tasks.workunit.client.0.smithi170.stdout:9/76: rmdir d2 39 2024-09-04T16:30:04.653 INFO:tasks.workunit.client.1.smithi193.stdout:4/176: dread d3/fa [0,4194304] 0 2024-09-04T16:30:04.653 INFO:tasks.workunit.client.0.smithi170.stdout:1/116: mknod d9/c24 0 2024-09-04T16:30:04.654 INFO:tasks.workunit.client.1.smithi193.stdout:2/215: readlink d2/d9/db/d10/l24 0 2024-09-04T16:30:04.655 INFO:tasks.workunit.client.1.smithi193.stdout:4/177: chown d3/d1a/d21 178319 1 2024-09-04T16:30:04.656 INFO:tasks.workunit.client.1.smithi193.stdout:7/332: mknod d9/d18/d1e/c6f 0 2024-09-04T16:30:04.657 INFO:tasks.workunit.client.1.smithi193.stdout:2/216: write d2/f2a [4635645,122824] 0 2024-09-04T16:30:04.657 INFO:tasks.workunit.client.1.smithi193.stdout:8/271: dread d2/f8 [4194304,4194304] 0 2024-09-04T16:30:04.658 INFO:tasks.workunit.client.1.smithi193.stdout:0/275: link l13 d18/d25/d32/l5b 0 2024-09-04T16:30:04.658 INFO:tasks.workunit.client.0.smithi170.stdout:4/85: dwrite d1/d6/d8/f9 [0,4194304] 0 2024-09-04T16:30:04.659 INFO:tasks.workunit.client.0.smithi170.stdout:1/117: mknod d9/d11/c25 0 2024-09-04T16:30:04.661 INFO:tasks.workunit.client.1.smithi193.stdout:9/307: dwrite d2/d18/d2f/f47 [4194304,4194304] 0 2024-09-04T16:30:04.664 INFO:tasks.workunit.client.1.smithi193.stdout:9/308: dread d2/d18/d2f/d22/d30/d52/f57 [0,4194304] 0 2024-09-04T16:30:04.664 INFO:tasks.workunit.client.0.smithi170.stdout:9/77: symlink d2/d7/l16 0 2024-09-04T16:30:04.665 INFO:tasks.workunit.client.1.smithi193.stdout:1/279: rmdir d1 39 2024-09-04T16:30:04.666 INFO:tasks.workunit.client.0.smithi170.stdout:9/78: fsync d2/f4 0 2024-09-04T16:30:04.666 INFO:tasks.workunit.client.0.smithi170.stdout:1/118: mkdir d9/d26 0 2024-09-04T16:30:04.668 INFO:tasks.workunit.client.1.smithi193.stdout:6/224: link d5/de/d15/d1b/f1e d5/de/f45 0 2024-09-04T16:30:04.670 INFO:tasks.workunit.client.0.smithi170.stdout:4/86: dwrite d1/f19 [0,4194304] 0 2024-09-04T16:30:04.672 INFO:tasks.workunit.client.0.smithi170.stdout:1/119: creat d9/f27 x:0 0 0 2024-09-04T16:30:04.672 INFO:tasks.workunit.client.0.smithi170.stdout:1/120: chown d9 50344018 1 2024-09-04T16:30:04.673 INFO:tasks.workunit.client.0.smithi170.stdout:1/121: read - d9/d11/f1e zero size 2024-09-04T16:30:04.674 INFO:tasks.workunit.client.0.smithi170.stdout:4/87: creat d1/d6/d8/f21 x:0 0 0 2024-09-04T16:30:04.674 INFO:tasks.workunit.client.1.smithi193.stdout:5/257: dwrite d1/d29/d18/f2f [0,4194304] 0 2024-09-04T16:30:04.675 INFO:tasks.workunit.client.1.smithi193.stdout:6/225: dread d5/f20 [0,4194304] 0 2024-09-04T16:30:04.677 INFO:tasks.workunit.client.1.smithi193.stdout:2/217: mknod d2/d9/db/d10/d1f/d22/c47 0 2024-09-04T16:30:04.678 INFO:tasks.workunit.client.0.smithi170.stdout:4/88: dread d1/d6/d8/fa [0,4194304] 0 2024-09-04T16:30:04.679 INFO:tasks.workunit.client.0.smithi170.stdout:1/122: mkdir d9/d26/d28 0 2024-09-04T16:30:04.680 INFO:tasks.workunit.client.0.smithi170.stdout:4/89: write d1/d6/ff [4948132,55510] 0 2024-09-04T16:30:04.681 INFO:tasks.workunit.client.1.smithi193.stdout:6/226: dread d5/f2b [0,4194304] 0 2024-09-04T16:30:04.682 INFO:tasks.workunit.client.1.smithi193.stdout:9/309: mknod d2/d18/d2f/d22/d30/d52/c63 0 2024-09-04T16:30:04.688 INFO:tasks.workunit.client.0.smithi170.stdout:4/90: mkdir d1/d6/d22 0 2024-09-04T16:30:04.689 INFO:tasks.workunit.client.1.smithi193.stdout:7/333: mkdir d9/d18/d22/d2b/d6c/d70 0 2024-09-04T16:30:04.689 INFO:tasks.workunit.client.0.smithi170.stdout:4/91: dread d1/fc [0,4194304] 0 2024-09-04T16:30:04.690 INFO:tasks.workunit.client.1.smithi193.stdout:0/276: symlink d18/l5c 0 2024-09-04T16:30:04.691 INFO:tasks.workunit.client.1.smithi193.stdout:0/277: stat d18/d25/d32/l43 0 2024-09-04T16:30:04.692 INFO:tasks.workunit.client.1.smithi193.stdout:0/278: dread - d18/f1d zero size 2024-09-04T16:30:04.692 INFO:tasks.workunit.client.1.smithi193.stdout:0/279: chown d18/d25/d32 353682129 1 2024-09-04T16:30:04.693 INFO:tasks.workunit.client.1.smithi193.stdout:0/280: fdatasync d18/f4c 0 2024-09-04T16:30:04.693 INFO:tasks.workunit.client.1.smithi193.stdout:2/218: creat d2/d9/db/d10/d1e/d26/f48 x:0 0 0 2024-09-04T16:30:04.694 INFO:tasks.workunit.client.1.smithi193.stdout:2/219: chown d2/f7 2669 1 2024-09-04T16:30:04.695 INFO:tasks.workunit.client.0.smithi170.stdout:4/92: symlink d1/d6/d8/d20/l23 0 2024-09-04T16:30:04.695 INFO:tasks.workunit.client.1.smithi193.stdout:1/280: chown d1/d2b/c8 750 1 2024-09-04T16:30:04.697 INFO:tasks.workunit.client.1.smithi193.stdout:9/310: mknod d2/d18/d2f/d22/d30/c64 0 2024-09-04T16:30:04.698 INFO:tasks.workunit.client.0.smithi170.stdout:4/93: symlink d1/d6/d8/d20/l24 0 2024-09-04T16:30:04.700 INFO:tasks.workunit.client.1.smithi193.stdout:7/334: creat d9/d18/d1e/f71 x:0 0 0 2024-09-04T16:30:04.701 INFO:tasks.workunit.client.0.smithi170.stdout:4/94: creat d1/d6/d8/d20/f25 x:0 0 0 2024-09-04T16:30:04.703 INFO:tasks.workunit.client.0.smithi170.stdout:9/79: truncate d2/d7/fc 468494 0 2024-09-04T16:30:04.703 INFO:tasks.workunit.client.0.smithi170.stdout:9/80: dread - d2/f13 zero size 2024-09-04T16:30:04.704 INFO:tasks.workunit.client.0.smithi170.stdout:9/81: chown d2/f13 1664 1 2024-09-04T16:30:04.704 INFO:tasks.workunit.client.1.smithi193.stdout:0/281: mknod d18/d25/d32/d57/c5d 0 2024-09-04T16:30:04.705 INFO:tasks.workunit.client.0.smithi170.stdout:9/82: truncate d2/d11/f12 964187 0 2024-09-04T16:30:04.706 INFO:tasks.workunit.client.1.smithi193.stdout:2/220: unlink d2/f17 0 2024-09-04T16:30:04.707 INFO:tasks.workunit.client.0.smithi170.stdout:4/95: mkdir d1/d26 0 2024-09-04T16:30:04.707 INFO:tasks.workunit.client.0.smithi170.stdout:4/96: chown d1/d6/d22 61189 1 2024-09-04T16:30:04.708 INFO:tasks.workunit.client.1.smithi193.stdout:1/281: chown d1/l3c 29815616 1 2024-09-04T16:30:04.708 INFO:tasks.workunit.client.1.smithi193.stdout:8/272: write d2/d20/d23/d1b/f28 [2911454,107219] 0 2024-09-04T16:30:04.710 INFO:tasks.workunit.client.1.smithi193.stdout:2/221: dread d2/d9/db/d10/f25 [0,4194304] 0 2024-09-04T16:30:04.710 INFO:tasks.workunit.client.1.smithi193.stdout:1/282: write d1/d2b/d1b/d28/f35 [966257,57910] 0 2024-09-04T16:30:04.711 INFO:tasks.workunit.client.0.smithi170.stdout:1/123: getdents d9/d26 0 2024-09-04T16:30:04.716 INFO:tasks.workunit.client.0.smithi170.stdout:9/83: rename d2/fa to d2/f17 0 2024-09-04T16:30:04.716 INFO:tasks.workunit.client.0.smithi170.stdout:1/124: dread d9/d11/f14 [0,4194304] 0 2024-09-04T16:30:04.716 INFO:tasks.workunit.client.1.smithi193.stdout:4/178: truncate d3/f1c 332951 0 2024-09-04T16:30:04.717 INFO:tasks.workunit.client.1.smithi193.stdout:4/179: read - d3/f28 zero size 2024-09-04T16:30:04.717 INFO:tasks.workunit.client.1.smithi193.stdout:0/282: mknod d18/d25/d32/c5e 0 2024-09-04T16:30:04.723 INFO:tasks.workunit.client.0.smithi170.stdout:4/97: link c0 d1/c27 0 2024-09-04T16:30:04.723 INFO:tasks.workunit.client.1.smithi193.stdout:9/311: mknod d2/c65 0 2024-09-04T16:30:04.724 INFO:tasks.workunit.client.1.smithi193.stdout:2/222: creat d2/d9/db/d10/d1e/d26/f49 x:0 0 0 2024-09-04T16:30:04.725 INFO:tasks.workunit.client.1.smithi193.stdout:4/180: dwrite d3/f18 [0,4194304] 0 2024-09-04T16:30:04.726 INFO:tasks.workunit.client.1.smithi193.stdout:1/283: rename d1/d2b/f38 to d1/d2b/d1b/d28/d50/f5d 0 2024-09-04T16:30:04.727 INFO:tasks.workunit.client.1.smithi193.stdout:8/273: dread d2/d20/d23/f29 [0,4194304] 0 2024-09-04T16:30:04.729 INFO:tasks.workunit.client.1.smithi193.stdout:0/283: mkdir d18/d25/d5f 0 2024-09-04T16:30:04.729 INFO:tasks.workunit.client.1.smithi193.stdout:5/258: dwrite d1/d29/f1d [0,4194304] 0 2024-09-04T16:30:04.731 INFO:tasks.workunit.client.0.smithi170.stdout:4/98: dwrite d1/d6/f14 [0,4194304] 0 2024-09-04T16:30:04.734 INFO:tasks.workunit.client.1.smithi193.stdout:0/284: chown d18 2 1 2024-09-04T16:30:04.734 INFO:tasks.workunit.client.1.smithi193.stdout:8/274: chown d2/c1a 38 1 2024-09-04T16:30:04.735 INFO:tasks.workunit.client.0.smithi170.stdout:4/99: unlink d1/c5 0 2024-09-04T16:30:04.736 INFO:tasks.workunit.client.0.smithi170.stdout:4/100: truncate d1/d6/d8/fa 4965843 0 2024-09-04T16:30:04.737 INFO:tasks.workunit.client.1.smithi193.stdout:6/227: link d5/de/d15/l39 d5/de/l46 0 2024-09-04T16:30:04.739 INFO:tasks.workunit.client.1.smithi193.stdout:6/228: rename d5/de to d5/de/d47 22 2024-09-04T16:30:04.740 INFO:tasks.workunit.client.1.smithi193.stdout:1/284: dread d1/d39/f46 [0,4194304] 0 2024-09-04T16:30:04.740 INFO:tasks.workunit.client.1.smithi193.stdout:4/181: dread d3/fa [0,4194304] 0 2024-09-04T16:30:04.743 INFO:tasks.workunit.client.1.smithi193.stdout:7/335: write d9/d18/d22/d2b/f33 [4446619,80514] 0 2024-09-04T16:30:04.743 INFO:tasks.workunit.client.1.smithi193.stdout:4/182: write d3/f18 [1618500,52584] 0 2024-09-04T16:30:04.744 INFO:tasks.workunit.client.0.smithi170.stdout:4/101: dwrite d1/f1e [0,4194304] 0 2024-09-04T16:30:04.746 INFO:tasks.workunit.client.0.smithi170.stdout:9/84: link d2/f4 d2/d7/f18 0 2024-09-04T16:30:04.747 INFO:tasks.workunit.client.1.smithi193.stdout:1/285: dread d1/f34 [0,4194304] 0 2024-09-04T16:30:04.749 INFO:tasks.workunit.client.1.smithi193.stdout:1/286: readlink d1/d2b/db/l15 0 2024-09-04T16:30:04.749 INFO:tasks.workunit.client.0.smithi170.stdout:4/102: fdatasync d1/fc 0 2024-09-04T16:30:04.750 INFO:tasks.workunit.client.1.smithi193.stdout:1/287: dread - d1/f53 zero size 2024-09-04T16:30:04.753 INFO:tasks.workunit.client.0.smithi170.stdout:4/103: fdatasync d1/fc 0 2024-09-04T16:30:04.758 INFO:tasks.workunit.client.1.smithi193.stdout:7/336: mkdir d9/de/d27/d62/d72 0 2024-09-04T16:30:04.759 INFO:tasks.workunit.client.1.smithi193.stdout:7/337: write d9/d18/d22/d2b/f55 [8625800,119007] 0 2024-09-04T16:30:04.761 INFO:tasks.workunit.client.0.smithi170.stdout:4/104: dwrite d1/d6/d8/d20/f25 [0,4194304] 0 2024-09-04T16:30:04.761 INFO:tasks.workunit.client.1.smithi193.stdout:9/312: getdents d2/d8/d25 0 2024-09-04T16:30:04.764 INFO:tasks.workunit.client.1.smithi193.stdout:6/229: mkdir d5/de/d15/d48 0 2024-09-04T16:30:04.771 INFO:tasks.workunit.client.0.smithi170.stdout:4/105: getdents d1 0 2024-09-04T16:30:04.772 INFO:tasks.workunit.client.0.smithi170.stdout:4/106: chown d1/d6/d8/f21 1209467 1 2024-09-04T16:30:04.773 INFO:tasks.workunit.client.0.smithi170.stdout:4/107: dread - d1/d6/f12 zero size 2024-09-04T16:30:04.774 INFO:tasks.workunit.client.1.smithi193.stdout:4/183: creat d3/d1a/f3d x:0 0 0 2024-09-04T16:30:04.774 INFO:tasks.workunit.client.1.smithi193.stdout:0/285: dwrite d18/d25/d3b/f40 [0,4194304] 0 2024-09-04T16:30:04.776 INFO:tasks.workunit.client.1.smithi193.stdout:1/288: link d1/l3c d1/d2b/d10/l5e 0 2024-09-04T16:30:04.776 INFO:tasks.workunit.client.0.smithi170.stdout:9/85: dwrite d2/f17 [0,4194304] 0 2024-09-04T16:30:04.777 INFO:tasks.workunit.client.1.smithi193.stdout:8/275: getdents d2/d20/d23/d24 0 2024-09-04T16:30:04.778 INFO:tasks.workunit.client.0.smithi170.stdout:9/86: chown d2/d7/fc 290483031 1 2024-09-04T16:30:04.779 INFO:tasks.workunit.client.1.smithi193.stdout:4/184: rename d3/d1a/f25 to d3/d1a/d21/f3e 0 2024-09-04T16:30:04.782 INFO:tasks.workunit.client.1.smithi193.stdout:1/289: symlink d1/d2b/d10/d56/l5f 0 2024-09-04T16:30:04.783 INFO:tasks.workunit.client.1.smithi193.stdout:8/276: dread d2/d20/f36 [0,4194304] 0 2024-09-04T16:30:04.783 INFO:tasks.workunit.client.1.smithi193.stdout:1/290: dread - d1/d2b/d10/f25 zero size 2024-09-04T16:30:04.785 INFO:tasks.workunit.client.0.smithi170.stdout:9/87: mknod d2/d7/c19 0 2024-09-04T16:30:04.785 INFO:tasks.workunit.client.1.smithi193.stdout:0/286: dread d18/d25/f4d [0,4194304] 0 2024-09-04T16:30:04.786 INFO:tasks.workunit.client.0.smithi170.stdout:4/108: dwrite d1/d6/f1b [0,4194304] 0 2024-09-04T16:30:04.786 INFO:tasks.workunit.client.0.smithi170.stdout:9/88: stat d2/f17 0 2024-09-04T16:30:04.787 INFO:tasks.workunit.client.1.smithi193.stdout:8/277: truncate d2/d20/d23/d24/f5d 492368 0 2024-09-04T16:30:04.789 INFO:tasks.workunit.client.0.smithi170.stdout:9/89: chown d2/f15 3 1 2024-09-04T16:30:04.792 INFO:tasks.workunit.client.0.smithi170.stdout:4/109: write d1/d6/d8/f21 [96789,105455] 0 2024-09-04T16:30:04.793 INFO:tasks.workunit.client.0.smithi170.stdout:9/90: readlink d2/lb 0 2024-09-04T16:30:04.793 INFO:tasks.workunit.client.0.smithi170.stdout:9/91: chown d2/d7/fc 0 1 2024-09-04T16:30:04.793 INFO:tasks.workunit.client.1.smithi193.stdout:4/185: rmdir d3/d1a 39 2024-09-04T16:30:04.793 INFO:tasks.workunit.client.1.smithi193.stdout:6/230: write d5/de/d15/d1b/f1e [145478,57092] 0 2024-09-04T16:30:04.793 INFO:tasks.workunit.client.1.smithi193.stdout:3/268: sync 2024-09-04T16:30:04.794 INFO:tasks.workunit.client.1.smithi193.stdout:1/291: truncate d1/d2b/f14 1440543 0 2024-09-04T16:30:04.795 INFO:tasks.workunit.client.1.smithi193.stdout:9/313: dwrite d2/d8/f26 [0,4194304] 0 2024-09-04T16:30:04.796 INFO:tasks.workunit.client.0.smithi170.stdout:4/110: dread d1/f19 [0,4194304] 0 2024-09-04T16:30:04.797 INFO:tasks.workunit.client.0.smithi170.stdout:9/92: dread d2/fe [0,4194304] 0 2024-09-04T16:30:04.799 INFO:tasks.workunit.client.1.smithi193.stdout:7/338: truncate d9/de/f1a 392635 0 2024-09-04T16:30:04.801 INFO:tasks.workunit.client.1.smithi193.stdout:7/339: chown d9/d18/d22/c5e 20133789 1 2024-09-04T16:30:04.802 INFO:tasks.workunit.client.1.smithi193.stdout:8/278: creat d2/d20/d23/d34/d46/f5e x:0 0 0 2024-09-04T16:30:04.802 INFO:tasks.workunit.client.1.smithi193.stdout:6/231: dwrite d5/de/d15/f2f [0,4194304] 0 2024-09-04T16:30:04.804 INFO:tasks.workunit.client.1.smithi193.stdout:6/232: stat d5/c3c 0 2024-09-04T16:30:04.805 INFO:tasks.workunit.client.1.smithi193.stdout:6/233: chown d5/d27 1 1 2024-09-04T16:30:04.807 INFO:tasks.workunit.client.1.smithi193.stdout:0/287: dwrite d18/f55 [0,4194304] 0 2024-09-04T16:30:04.807 INFO:tasks.workunit.client.1.smithi193.stdout:6/234: fsync d5/d27/f30 0 2024-09-04T16:30:04.810 INFO:tasks.workunit.client.1.smithi193.stdout:0/288: write d18/f1c [231384,57491] 0 2024-09-04T16:30:04.810 INFO:tasks.workunit.client.1.smithi193.stdout:3/269: unlink d0/d7/de/d45/l4c 0 2024-09-04T16:30:04.813 INFO:tasks.workunit.client.1.smithi193.stdout:1/292: rename d1/d2b/l1e to d1/d2b/d1b/l60 0 2024-09-04T16:30:04.813 INFO:tasks.workunit.client.1.smithi193.stdout:3/270: dread - d0/d18/d1c/d30/f4e zero size 2024-09-04T16:30:04.814 INFO:tasks.workunit.client.1.smithi193.stdout:9/314: dread d2/d18/d2f/d22/d30/d52/f57 [0,4194304] 0 2024-09-04T16:30:04.820 INFO:tasks.workunit.client.1.smithi193.stdout:7/340: rename d9/c2d to d9/d39/d3e/d53/c73 0 2024-09-04T16:30:04.821 INFO:tasks.workunit.client.1.smithi193.stdout:0/289: rename d18/d25/d3b to d18/d25/d3b/d60 22 2024-09-04T16:30:04.824 INFO:tasks.workunit.client.1.smithi193.stdout:8/279: mkdir d2/d20/d23/d34/d46/d53/d5f 0 2024-09-04T16:30:04.825 INFO:tasks.workunit.client.1.smithi193.stdout:9/315: mkdir d2/d18/d66 0 2024-09-04T16:30:04.827 INFO:tasks.workunit.client.1.smithi193.stdout:7/341: write d9/d18/d22/d2b/f55 [2533383,107976] 0 2024-09-04T16:30:04.827 INFO:tasks.workunit.client.1.smithi193.stdout:1/293: dwrite d1/d2b/d10/f1f [4194304,4194304] 0 2024-09-04T16:30:04.828 INFO:tasks.workunit.client.1.smithi193.stdout:6/235: dread d5/de/f41 [0,4194304] 0 2024-09-04T16:30:04.831 INFO:tasks.workunit.client.1.smithi193.stdout:2/223: sync 2024-09-04T16:30:04.832 INFO:tasks.workunit.client.1.smithi193.stdout:3/271: dwrite d0/d18/d1c/d51/d5a/f62 [0,4194304] 0 2024-09-04T16:30:04.832 INFO:tasks.workunit.client.1.smithi193.stdout:8/280: write d2/d20/d23/d34/d46/f5e [693634,52286] 0 2024-09-04T16:30:04.832 INFO:tasks.workunit.client.1.smithi193.stdout:4/186: dread d3/f10 [0,4194304] 0 2024-09-04T16:30:04.832 INFO:tasks.workunit.client.1.smithi193.stdout:9/316: rmdir d2/d18/d2f/d51 39 2024-09-04T16:30:04.835 INFO:tasks.workunit.client.0.smithi170.stdout:4/111: write d1/fc [1208020,42264] 0 2024-09-04T16:30:04.836 INFO:tasks.workunit.client.1.smithi193.stdout:1/294: truncate d1/d2b/f31 4857344 0 2024-09-04T16:30:04.838 INFO:tasks.workunit.client.1.smithi193.stdout:6/236: mkdir d5/d27/d3e/d49 0 2024-09-04T16:30:04.844 INFO:tasks.workunit.client.0.smithi170.stdout:4/112: dwrite d1/d6/ff [0,4194304] 0 2024-09-04T16:30:04.845 INFO:tasks.workunit.client.1.smithi193.stdout:0/290: dread d18/f48 [0,4194304] 0 2024-09-04T16:30:04.846 INFO:tasks.workunit.client.1.smithi193.stdout:8/281: rmdir d2/d20/d23 39 2024-09-04T16:30:04.847 INFO:tasks.workunit.client.1.smithi193.stdout:0/291: write d18/d25/d3b/f51 [335321,55179] 0 2024-09-04T16:30:04.852 INFO:tasks.workunit.client.1.smithi193.stdout:2/224: truncate d2/d9/db/d10/f25 1793866 0 2024-09-04T16:30:04.853 INFO:tasks.workunit.client.1.smithi193.stdout:2/225: fdatasync d2/f35 0 2024-09-04T16:30:04.854 INFO:tasks.workunit.client.1.smithi193.stdout:1/295: fsync d1/d2b/d1b/d28/d50/f5d 0 2024-09-04T16:30:04.856 INFO:tasks.workunit.client.1.smithi193.stdout:4/187: creat d3/d1a/d2a/f3f x:0 0 0 2024-09-04T16:30:04.857 INFO:tasks.workunit.client.1.smithi193.stdout:8/282: mknod d2/d12/c60 0 2024-09-04T16:30:04.857 INFO:tasks.workunit.client.1.smithi193.stdout:4/188: read d3/d1a/d21/f22 [189153,48498] 0 2024-09-04T16:30:04.857 INFO:tasks.workunit.client.1.smithi193.stdout:4/189: stat d3/d1a/d21/c32 0 2024-09-04T16:30:04.866 INFO:tasks.workunit.client.1.smithi193.stdout:1/296: dread d1/d2b/f14 [0,4194304] 0 2024-09-04T16:30:04.866 INFO:tasks.workunit.client.1.smithi193.stdout:0/292: rename d18/c2c to d18/d25/d32/c61 0 2024-09-04T16:30:04.867 INFO:tasks.workunit.client.1.smithi193.stdout:4/190: creat d3/d1a/d2a/f40 x:0 0 0 2024-09-04T16:30:04.869 INFO:tasks.workunit.client.1.smithi193.stdout:7/342: getdents d9/d18/d1e 0 2024-09-04T16:30:04.870 INFO:tasks.workunit.client.1.smithi193.stdout:2/226: mkdir d2/d9/db/d10/d1f/d4a 0 2024-09-04T16:30:04.872 INFO:tasks.workunit.client.1.smithi193.stdout:8/283: mknod d2/d20/d23/d24/c61 0 2024-09-04T16:30:04.875 INFO:tasks.workunit.client.1.smithi193.stdout:4/191: creat d3/d1a/d2a/f41 x:0 0 0 2024-09-04T16:30:04.880 INFO:tasks.workunit.client.1.smithi193.stdout:8/284: mkdir d2/d20/d23/d1b/d4e/d62 0 2024-09-04T16:30:04.883 INFO:tasks.workunit.client.1.smithi193.stdout:0/293: mknod d18/d25/c62 0 2024-09-04T16:30:04.885 INFO:tasks.workunit.client.1.smithi193.stdout:3/272: dwrite d0/d7/de/d45/f52 [0,4194304] 0 2024-09-04T16:30:04.888 INFO:tasks.workunit.client.1.smithi193.stdout:4/192: dread d3/f24 [0,4194304] 0 2024-09-04T16:30:04.889 INFO:tasks.workunit.client.1.smithi193.stdout:9/317: write d2/d8/d15/f35 [1047043,130223] 0 2024-09-04T16:30:04.890 INFO:tasks.workunit.client.1.smithi193.stdout:9/318: write d2/f1c [3575603,10209] 0 2024-09-04T16:30:04.890 INFO:tasks.workunit.client.1.smithi193.stdout:7/343: symlink d9/de/d27/d62/d72/l74 0 2024-09-04T16:30:04.892 INFO:tasks.workunit.client.1.smithi193.stdout:9/319: write d2/d8/d15/f1b [5203806,30595] 0 2024-09-04T16:30:04.892 INFO:tasks.workunit.client.1.smithi193.stdout:7/344: write d9/de/d27/f34 [1207880,114972] 0 2024-09-04T16:30:04.898 INFO:tasks.workunit.client.1.smithi193.stdout:8/285: dread d2/d12/f43 [0,4194304] 0 2024-09-04T16:30:04.899 INFO:tasks.workunit.client.1.smithi193.stdout:0/294: dread - d18/d25/d32/f42 zero size 2024-09-04T16:30:04.900 INFO:tasks.workunit.client.1.smithi193.stdout:3/273: write d0/d18/d1b/f37 [1959136,22880] 0 2024-09-04T16:30:04.910 INFO:tasks.workunit.client.1.smithi193.stdout:9/320: symlink d2/d18/d2f/d22/d30/l67 0 2024-09-04T16:30:04.915 INFO:tasks.workunit.client.1.smithi193.stdout:1/297: truncate d1/d2b/f31 4763791 0 2024-09-04T16:30:04.915 INFO:tasks.workunit.client.1.smithi193.stdout:8/286: creat d2/d20/d23/d51/f63 x:0 0 0 2024-09-04T16:30:04.917 INFO:tasks.workunit.client.1.smithi193.stdout:4/193: creat d3/d39/f42 x:0 0 0 2024-09-04T16:30:04.918 INFO:tasks.workunit.client.1.smithi193.stdout:1/298: dread d1/d2b/f2e [0,4194304] 0 2024-09-04T16:30:04.918 INFO:tasks.workunit.client.1.smithi193.stdout:1/299: fdatasync d1/f53 0 2024-09-04T16:30:04.920 INFO:tasks.workunit.client.1.smithi193.stdout:2/227: write d2/d9/d18/f31 [249191,19408] 0 2024-09-04T16:30:04.922 INFO:tasks.workunit.client.1.smithi193.stdout:8/287: creat d2/d20/d23/d34/d46/d53/f64 x:0 0 0 2024-09-04T16:30:04.924 INFO:tasks.workunit.client.1.smithi193.stdout:3/274: symlink d0/d7/l64 0 2024-09-04T16:30:04.925 INFO:tasks.workunit.client.1.smithi193.stdout:3/275: chown d0 949 1 2024-09-04T16:30:04.925 INFO:tasks.workunit.client.1.smithi193.stdout:1/300: dwrite d1/d2b/d1b/f4c [0,4194304] 0 2024-09-04T16:30:04.926 INFO:tasks.workunit.client.1.smithi193.stdout:4/194: fsync d3/d1a/d21/f3e 0 2024-09-04T16:30:04.928 INFO:tasks.workunit.client.1.smithi193.stdout:9/321: mkdir d2/d8/d68 0 2024-09-04T16:30:04.930 INFO:tasks.workunit.client.1.smithi193.stdout:8/288: dread d2/d20/d23/d1b/f33 [0,4194304] 0 2024-09-04T16:30:04.933 INFO:tasks.workunit.client.1.smithi193.stdout:3/276: rmdir d0/d18/d1c 39 2024-09-04T16:30:04.933 INFO:tasks.workunit.client.1.smithi193.stdout:3/277: stat d0/f3 0 2024-09-04T16:30:04.935 INFO:tasks.workunit.client.1.smithi193.stdout:1/301: creat d1/d2b/f61 x:0 0 0 2024-09-04T16:30:04.940 INFO:tasks.workunit.client.1.smithi193.stdout:8/289: mkdir d2/d20/d23/d24/d3c/d65 0 2024-09-04T16:30:04.940 INFO:tasks.workunit.client.1.smithi193.stdout:1/302: dwrite d1/d2b/d1b/d28/d50/f5d [0,4194304] 0 2024-09-04T16:30:04.941 INFO:tasks.workunit.client.1.smithi193.stdout:7/345: truncate d9/de/f49 1340349 0 2024-09-04T16:30:04.941 INFO:tasks.workunit.client.1.smithi193.stdout:1/303: chown d1/d2b/d10/f21 45215408 1 2024-09-04T16:30:04.945 INFO:tasks.workunit.client.1.smithi193.stdout:4/195: mknod d3/c43 0 2024-09-04T16:30:04.948 INFO:tasks.workunit.client.1.smithi193.stdout:8/290: read d2/f2e [486064,92382] 0 2024-09-04T16:30:04.948 INFO:tasks.workunit.client.1.smithi193.stdout:4/196: dread d3/f24 [0,4194304] 0 2024-09-04T16:30:04.949 INFO:tasks.workunit.client.1.smithi193.stdout:7/346: symlink d9/de/l75 0 2024-09-04T16:30:04.950 INFO:tasks.workunit.client.1.smithi193.stdout:1/304: symlink d1/d39/l62 0 2024-09-04T16:30:04.952 INFO:tasks.workunit.client.1.smithi193.stdout:3/278: unlink d0/d18/d1c/d51/d5a/f62 0 2024-09-04T16:30:04.954 INFO:tasks.workunit.client.1.smithi193.stdout:3/279: chown d0/d18/d1b/d3d/c3e 0 1 2024-09-04T16:30:04.954 INFO:tasks.workunit.client.1.smithi193.stdout:4/197: mkdir d3/d39/d44 0 2024-09-04T16:30:04.954 INFO:tasks.workunit.client.1.smithi193.stdout:2/228: dwrite d2/d9/d18/f37 [0,4194304] 0 2024-09-04T16:30:04.955 INFO:tasks.workunit.client.1.smithi193.stdout:3/280: readlink d0/d7/l11 0 2024-09-04T16:30:04.957 INFO:tasks.workunit.client.1.smithi193.stdout:7/347: rename d9/de/f54 to d9/d39/f76 0 2024-09-04T16:30:04.958 INFO:tasks.workunit.client.1.smithi193.stdout:9/322: write d2/d4/f3a [421582,42957] 0 2024-09-04T16:30:04.969 INFO:tasks.workunit.client.1.smithi193.stdout:7/348: mkdir d9/d18/d22/d2b/d6c/d77 0 2024-09-04T16:30:04.971 INFO:tasks.workunit.client.1.smithi193.stdout:9/323: creat d2/d8/d4d/f69 x:0 0 0 2024-09-04T16:30:04.973 INFO:tasks.workunit.client.1.smithi193.stdout:3/281: dread d0/f47 [0,4194304] 0 2024-09-04T16:30:04.973 INFO:tasks.workunit.client.1.smithi193.stdout:4/198: creat d3/d3c/f45 x:0 0 0 2024-09-04T16:30:04.976 INFO:tasks.workunit.client.1.smithi193.stdout:5/259: sync 2024-09-04T16:30:04.979 INFO:tasks.workunit.client.1.smithi193.stdout:9/324: mkdir d2/d18/d2f/d22/d30/d6a 0 2024-09-04T16:30:04.979 INFO:tasks.workunit.client.1.smithi193.stdout:9/325: chown d2/d18/d2f/d22/d30/d52 573 1 2024-09-04T16:30:04.980 INFO:tasks.workunit.client.1.smithi193.stdout:8/291: getdents d2/d20/d23/d24/d25 0 2024-09-04T16:30:04.981 INFO:tasks.workunit.client.1.smithi193.stdout:3/282: stat d0/d9/f2c 0 2024-09-04T16:30:04.983 INFO:tasks.workunit.client.1.smithi193.stdout:4/199: write d3/fd [1218448,58148] 0 2024-09-04T16:30:04.983 INFO:tasks.workunit.client.1.smithi193.stdout:4/200: readlink d3/l33 0 2024-09-04T16:30:04.988 INFO:tasks.workunit.client.1.smithi193.stdout:3/283: dwrite d0/d18/d1b/f3f [0,4194304] 0 2024-09-04T16:30:04.991 INFO:tasks.workunit.client.1.smithi193.stdout:8/292: truncate d2/d12/fe 310934 0 2024-09-04T16:30:05.001 INFO:tasks.workunit.client.1.smithi193.stdout:7/349: rmdir d9/d18/d22/d2b/d6c/d77 0 2024-09-04T16:30:05.003 INFO:tasks.workunit.client.1.smithi193.stdout:5/260: write d1/d29/d1e/f4b [3314830,27038] 0 2024-09-04T16:30:05.004 INFO:tasks.workunit.client.1.smithi193.stdout:2/229: dwrite d2/d9/db/f21 [0,4194304] 0 2024-09-04T16:30:05.004 INFO:tasks.workunit.client.1.smithi193.stdout:9/326: creat d2/d8/d61/f6b x:0 0 0 2024-09-04T16:30:05.007 INFO:tasks.workunit.client.1.smithi193.stdout:5/261: write d1/d29/d1e/f4b [4156228,12655] 0 2024-09-04T16:30:05.014 INFO:tasks.workunit.client.1.smithi193.stdout:5/262: dwrite d1/f16 [4194304,4194304] 0 2024-09-04T16:30:05.015 INFO:tasks.workunit.client.1.smithi193.stdout:5/263: fsync d1/d8/f12 0 2024-09-04T16:30:05.016 INFO:tasks.workunit.client.1.smithi193.stdout:7/350: symlink d9/d18/d22/d2b/l78 0 2024-09-04T16:30:05.017 INFO:tasks.workunit.client.1.smithi193.stdout:7/351: dread - d9/d39/d3e/f63 zero size 2024-09-04T16:30:05.018 INFO:tasks.workunit.client.1.smithi193.stdout:2/230: stat d2/d9/db/d10/c13 0 2024-09-04T16:30:05.018 INFO:tasks.workunit.client.1.smithi193.stdout:8/293: dread d2/d20/d23/d24/d3c/f45 [0,4194304] 0 2024-09-04T16:30:05.019 INFO:tasks.workunit.client.1.smithi193.stdout:8/294: readlink d2/d12/lf 0 2024-09-04T16:30:05.020 INFO:tasks.workunit.client.1.smithi193.stdout:8/295: chown d2/d20/d23/d24/c3d 9 1 2024-09-04T16:30:05.024 INFO:tasks.workunit.client.1.smithi193.stdout:9/327: mkdir d2/d18/d2f/d22/d6c 0 2024-09-04T16:30:05.030 INFO:tasks.workunit.client.1.smithi193.stdout:4/201: truncate d3/f10 2639904 0 2024-09-04T16:30:05.031 INFO:tasks.workunit.client.1.smithi193.stdout:9/328: dread d2/d4/fd [0,4194304] 0 2024-09-04T16:30:05.031 INFO:tasks.workunit.client.1.smithi193.stdout:3/284: truncate d0/fa 43549 0 2024-09-04T16:30:05.032 INFO:tasks.workunit.client.1.smithi193.stdout:3/285: chown d0/d18/d1c/d25/f48 20615 1 2024-09-04T16:30:05.037 INFO:tasks.workunit.client.1.smithi193.stdout:3/286: dread d0/d18/d1c/d30/f41 [0,4194304] 0 2024-09-04T16:30:05.037 INFO:tasks.workunit.client.1.smithi193.stdout:8/296: dwrite d2/d12/f43 [0,4194304] 0 2024-09-04T16:30:05.039 INFO:tasks.workunit.client.0.smithi170.stdout:9/93: creat d2/d7/f1a x:0 0 0 2024-09-04T16:30:05.040 INFO:tasks.workunit.client.1.smithi193.stdout:7/352: mkdir d9/d18/d22/d2b/d6c/d70/d79 0 2024-09-04T16:30:05.041 INFO:tasks.workunit.client.1.smithi193.stdout:2/231: creat d2/d9/db/d10/d38/f4b x:0 0 0 2024-09-04T16:30:05.042 INFO:tasks.workunit.client.1.smithi193.stdout:5/264: write d1/d29/d1e/d37/f43 [477844,45567] 0 2024-09-04T16:30:05.043 INFO:tasks.workunit.client.1.smithi193.stdout:9/329: rmdir d2/d8/d4d 39 2024-09-04T16:30:05.044 INFO:tasks.workunit.client.1.smithi193.stdout:5/265: read d1/d29/f1d [2597662,52194] 0 2024-09-04T16:30:05.045 INFO:tasks.workunit.client.0.smithi170.stdout:9/94: rmdir d2/d7 39 2024-09-04T16:30:05.048 INFO:tasks.workunit.client.1.smithi193.stdout:7/353: dwrite d9/d18/d1e/f26 [0,4194304] 0 2024-09-04T16:30:05.049 INFO:tasks.workunit.client.0.smithi170.stdout:4/113: creat d1/d26/f28 x:0 0 0 2024-09-04T16:30:05.052 INFO:tasks.workunit.client.0.smithi170.stdout:4/114: rmdir d1/d6/d8/d20 39 2024-09-04T16:30:05.054 INFO:tasks.workunit.client.0.smithi170.stdout:9/95: truncate d2/d7/fc 284115 0 2024-09-04T16:30:05.056 INFO:tasks.workunit.client.0.smithi170.stdout:4/115: fdatasync d1/f19 0 2024-09-04T16:30:05.059 INFO:tasks.workunit.client.0.smithi170.stdout:9/96: dread d2/fe [0,4194304] 0 2024-09-04T16:30:05.062 INFO:tasks.workunit.client.1.smithi193.stdout:4/202: write d3/fe [1202570,40097] 0 2024-09-04T16:30:05.063 INFO:tasks.workunit.client.1.smithi193.stdout:5/266: rename d1/d29/d1e/d37/d39 to d1/d29/d1e/d37/d3f/d4f 0 2024-09-04T16:30:05.064 INFO:tasks.workunit.client.0.smithi170.stdout:4/116: symlink d1/d6/d8/l29 0 2024-09-04T16:30:05.067 INFO:tasks.workunit.client.0.smithi170.stdout:4/117: symlink d1/d26/l2a 0 2024-09-04T16:30:05.067 INFO:tasks.workunit.client.1.smithi193.stdout:9/330: dread d2/f1c [0,4194304] 0 2024-09-04T16:30:05.068 INFO:tasks.workunit.client.0.smithi170.stdout:4/118: write d1/d6/f1b [5194157,86311] 0 2024-09-04T16:30:05.071 INFO:tasks.workunit.client.0.smithi170.stdout:9/97: fsync d2/f4 0 2024-09-04T16:30:05.071 INFO:tasks.workunit.client.0.smithi170.stdout:9/98: readlink d2/lb 0 2024-09-04T16:30:05.074 INFO:tasks.workunit.client.1.smithi193.stdout:1/305: sync 2024-09-04T16:30:05.074 INFO:tasks.workunit.client.1.smithi193.stdout:6/237: sync 2024-09-04T16:30:05.074 INFO:tasks.workunit.client.1.smithi193.stdout:0/295: sync 2024-09-04T16:30:05.074 INFO:tasks.workunit.client.0.smithi170.stdout:9/99: creat d2/d11/f1b x:0 0 0 2024-09-04T16:30:05.075 INFO:tasks.workunit.client.1.smithi193.stdout:0/296: chown d18/d25/c62 255547 1 2024-09-04T16:30:05.075 INFO:tasks.workunit.client.1.smithi193.stdout:4/203: mknod d3/d1a/d21/c46 0 2024-09-04T16:30:05.076 INFO:tasks.workunit.client.1.smithi193.stdout:1/306: write d1/d2b/db/f3b [9416055,90928] 0 2024-09-04T16:30:05.076 INFO:tasks.workunit.client.1.smithi193.stdout:4/204: readlink d3/l33 0 2024-09-04T16:30:05.077 INFO:tasks.workunit.client.1.smithi193.stdout:4/205: write d3/fd [1805642,24659] 0 2024-09-04T16:30:05.079 INFO:tasks.workunit.client.1.smithi193.stdout:7/354: mknod d9/d18/d22/c7a 0 2024-09-04T16:30:05.081 INFO:tasks.workunit.client.1.smithi193.stdout:9/331: write d2/d8/f55 [2306749,49130] 0 2024-09-04T16:30:05.082 INFO:tasks.workunit.client.1.smithi193.stdout:9/332: chown d2/d18/d2f/d22/d30/l67 450 1 2024-09-04T16:30:05.083 INFO:tasks.workunit.client.0.smithi170.stdout:9/100: write d2/fe [3540348,120943] 0 2024-09-04T16:30:05.084 INFO:tasks.workunit.client.1.smithi193.stdout:2/232: creat d2/d9/db/d10/d1f/f4c x:0 0 0 2024-09-04T16:30:05.085 INFO:tasks.workunit.client.1.smithi193.stdout:2/233: chown d2/d9/d18/f37 144288225 1 2024-09-04T16:30:05.085 INFO:tasks.workunit.client.1.smithi193.stdout:6/238: symlink d5/de/d15/d1b/l4a 0 2024-09-04T16:30:05.086 INFO:tasks.workunit.client.0.smithi170.stdout:9/101: rmdir d2 39 2024-09-04T16:30:05.086 INFO:tasks.workunit.client.1.smithi193.stdout:2/234: stat d2/d9/db/d10/c13 0 2024-09-04T16:30:05.087 INFO:tasks.workunit.client.1.smithi193.stdout:0/297: fsync d18/d25/d3b/f41 0 2024-09-04T16:30:05.087 INFO:tasks.workunit.client.1.smithi193.stdout:1/307: mkdir d1/d2b/db/d54/d63 0 2024-09-04T16:30:05.088 INFO:tasks.workunit.client.1.smithi193.stdout:1/308: readlink d1/d2b/db/l15 0 2024-09-04T16:30:05.090 INFO:tasks.workunit.client.1.smithi193.stdout:5/267: dread d1/d8/db/d23/f26 [0,4194304] 0 2024-09-04T16:30:05.091 INFO:tasks.workunit.client.0.smithi170.stdout:9/102: dread d2/f17 [0,4194304] 0 2024-09-04T16:30:05.092 INFO:tasks.workunit.client.1.smithi193.stdout:5/268: read d1/d8/db/d23/f25 [704442,96035] 0 2024-09-04T16:30:05.092 INFO:tasks.workunit.client.1.smithi193.stdout:3/287: getdents d0/d18/d1c/d25 0 2024-09-04T16:30:05.093 INFO:tasks.workunit.client.1.smithi193.stdout:3/288: readlink d0/d9/l19 0 2024-09-04T16:30:05.093 INFO:tasks.workunit.client.1.smithi193.stdout:8/297: getdents d2/d20/d23/d51 0 2024-09-04T16:30:05.094 INFO:tasks.workunit.client.1.smithi193.stdout:3/289: write d0/d7/de/d45/f46 [4371201,100853] 0 2024-09-04T16:30:05.095 INFO:tasks.workunit.client.0.smithi170.stdout:9/103: mknod d2/c1c 0 2024-09-04T16:30:05.097 INFO:tasks.workunit.client.1.smithi193.stdout:2/235: symlink d2/d9/d18/l4d 0 2024-09-04T16:30:05.097 INFO:tasks.workunit.client.1.smithi193.stdout:1/309: mknod d1/d2b/d1b/d28/d50/c64 0 2024-09-04T16:30:05.098 INFO:tasks.workunit.client.1.smithi193.stdout:1/310: fdatasync d1/d2b/d1b/f4c 0 2024-09-04T16:30:05.098 INFO:tasks.workunit.client.1.smithi193.stdout:2/236: read d2/d9/db/fd [2419083,110235] 0 2024-09-04T16:30:05.099 INFO:tasks.workunit.client.0.smithi170.stdout:9/104: rename d2/d7/f18 to d2/d11/f1d 0 2024-09-04T16:30:05.101 INFO:tasks.workunit.client.1.smithi193.stdout:1/311: read d1/d2b/db/f23 [1056178,84192] 0 2024-09-04T16:30:05.101 INFO:tasks.workunit.client.0.smithi170.stdout:9/105: unlink d2/f15 0 2024-09-04T16:30:05.102 INFO:tasks.workunit.client.1.smithi193.stdout:9/333: creat d2/d18/d66/f6d x:0 0 0 2024-09-04T16:30:05.104 INFO:tasks.workunit.client.1.smithi193.stdout:8/298: fsync d2/d20/d23/d1b/f33 0 2024-09-04T16:30:05.109 INFO:tasks.workunit.client.1.smithi193.stdout:7/355: rename d9/d11/c16 to d9/d18/d22/c7b 0 2024-09-04T16:30:05.109 INFO:tasks.workunit.client.0.smithi170.stdout:9/106: getdents d2/d11 0 2024-09-04T16:30:05.111 INFO:tasks.workunit.client.0.smithi170.stdout:9/107: mknod d2/d7/c1e 0 2024-09-04T16:30:05.112 INFO:tasks.workunit.client.1.smithi193.stdout:2/237: mkdir d2/d9/db/d10/d4e 0 2024-09-04T16:30:05.113 INFO:tasks.workunit.client.0.smithi170.stdout:9/108: write d2/f17 [1340392,110998] 0 2024-09-04T16:30:05.114 INFO:tasks.workunit.client.0.smithi170.stdout:9/109: write d2/d7/f1a [770055,61807] 0 2024-09-04T16:30:05.115 INFO:tasks.workunit.client.1.smithi193.stdout:4/206: dwrite f0 [0,4194304] 0 2024-09-04T16:30:05.116 INFO:tasks.workunit.client.0.smithi170.stdout:9/110: getdents d2/d11 0 2024-09-04T16:30:05.116 INFO:tasks.workunit.client.1.smithi193.stdout:1/312: dwrite d1/d2b/f61 [0,4194304] 0 2024-09-04T16:30:05.119 INFO:tasks.workunit.client.1.smithi193.stdout:5/269: dread d1/f3 [0,4194304] 0 2024-09-04T16:30:05.120 INFO:tasks.workunit.client.0.smithi170.stdout:9/111: truncate d2/d7/f10 741762 0 2024-09-04T16:30:05.124 INFO:tasks.workunit.client.1.smithi193.stdout:3/290: truncate d0/d7/de/d45/f52 2999914 0 2024-09-04T16:30:05.129 INFO:tasks.workunit.client.1.smithi193.stdout:0/298: dread f3 [0,4194304] 0 2024-09-04T16:30:05.130 INFO:tasks.workunit.client.1.smithi193.stdout:3/291: mkdir d0/d18/d65 0 2024-09-04T16:30:05.133 INFO:tasks.workunit.client.1.smithi193.stdout:9/334: dwrite d2/f1c [0,4194304] 0 2024-09-04T16:30:05.136 INFO:tasks.workunit.client.1.smithi193.stdout:8/299: dwrite d2/d20/d23/d34/d46/d53/f64 [0,4194304] 0 2024-09-04T16:30:05.139 INFO:tasks.workunit.client.1.smithi193.stdout:5/270: dread d1/d8/fd [0,4194304] 0 2024-09-04T16:30:05.140 INFO:tasks.workunit.client.1.smithi193.stdout:4/207: dwrite d3/f6 [0,4194304] 0 2024-09-04T16:30:05.148 INFO:tasks.workunit.client.1.smithi193.stdout:3/292: dwrite d0/d18/d1b/f3f [0,4194304] 0 2024-09-04T16:30:05.148 INFO:tasks.workunit.client.1.smithi193.stdout:1/313: truncate d1/d2b/d1b/d28/f35 4072138 0 2024-09-04T16:30:05.149 INFO:tasks.workunit.client.1.smithi193.stdout:7/356: dread d9/d18/d22/f30 [0,4194304] 0 2024-09-04T16:30:05.151 INFO:tasks.workunit.client.1.smithi193.stdout:5/271: symlink d1/d8/db/d23/l50 0 2024-09-04T16:30:05.152 INFO:tasks.workunit.client.1.smithi193.stdout:0/299: link d18/d25/d3b/c59 d18/c63 0 2024-09-04T16:30:05.154 INFO:tasks.workunit.client.1.smithi193.stdout:3/293: creat d0/f66 x:0 0 0 2024-09-04T16:30:05.155 INFO:tasks.workunit.client.1.smithi193.stdout:2/238: dread d2/d9/d18/d3f/f41 [4194304,4194304] 0 2024-09-04T16:30:05.156 INFO:tasks.workunit.client.1.smithi193.stdout:9/335: rename d2/d18/d2f/d51 to d2/d18/d2f/d22/d30/d6a/d6e 0 2024-09-04T16:30:05.159 INFO:tasks.workunit.client.1.smithi193.stdout:0/300: mkdir d18/d25/d3b/d64 0 2024-09-04T16:30:05.159 INFO:tasks.workunit.client.1.smithi193.stdout:9/336: read d2/d8/d15/f35 [379079,60487] 0 2024-09-04T16:30:05.161 INFO:tasks.workunit.client.1.smithi193.stdout:2/239: creat d2/d9/d18/f4f x:0 0 0 2024-09-04T16:30:05.163 INFO:tasks.workunit.client.1.smithi193.stdout:5/272: dwrite d1/d8/f2d [0,4194304] 0 2024-09-04T16:30:05.163 INFO:tasks.workunit.client.1.smithi193.stdout:4/208: getdents d3/d3c 0 2024-09-04T16:30:05.164 INFO:tasks.workunit.client.1.smithi193.stdout:1/314: getdents d1/d2b/d10/d56 0 2024-09-04T16:30:05.165 INFO:tasks.workunit.client.1.smithi193.stdout:4/209: fdatasync d3/d1a/f3d 0 2024-09-04T16:30:05.165 INFO:tasks.workunit.client.1.smithi193.stdout:0/301: mkdir d18/d25/d5f/d65 0 2024-09-04T16:30:05.168 INFO:tasks.workunit.client.1.smithi193.stdout:5/273: stat d1/d29/d18/f2f 0 2024-09-04T16:30:05.168 INFO:tasks.workunit.client.1.smithi193.stdout:2/240: fdatasync d2/d9/db/fd 0 2024-09-04T16:30:05.174 INFO:tasks.workunit.client.1.smithi193.stdout:9/337: dwrite d2/d18/d2f/d22/d30/d6a/d6e/f5a [0,4194304] 0 2024-09-04T16:30:05.175 INFO:tasks.workunit.client.1.smithi193.stdout:4/210: mkdir d3/d3c/d47 0 2024-09-04T16:30:05.176 INFO:tasks.workunit.client.1.smithi193.stdout:4/211: chown d3/fa 3 1 2024-09-04T16:30:05.177 INFO:tasks.workunit.client.1.smithi193.stdout:9/338: dread - d2/d8/d61/f6b zero size 2024-09-04T16:30:05.180 INFO:tasks.workunit.client.1.smithi193.stdout:2/241: rename d2/d9/db/d10/f12 to d2/d14/f50 0 2024-09-04T16:30:05.183 INFO:tasks.workunit.client.1.smithi193.stdout:1/315: truncate d1/f34 914504 0 2024-09-04T16:30:05.184 INFO:tasks.workunit.client.1.smithi193.stdout:2/242: readlink d2/d9/db/d10/l11 0 2024-09-04T16:30:05.186 INFO:tasks.workunit.client.1.smithi193.stdout:7/357: dread d9/de/d27/f3d [0,4194304] 0 2024-09-04T16:30:05.188 INFO:tasks.workunit.client.1.smithi193.stdout:0/302: dwrite d18/d25/f3c [0,4194304] 0 2024-09-04T16:30:05.188 INFO:tasks.workunit.client.1.smithi193.stdout:4/212: link d3/c23 d3/c48 0 2024-09-04T16:30:05.188 INFO:tasks.workunit.client.1.smithi193.stdout:1/316: symlink d1/d2b/d10/d56/l65 0 2024-09-04T16:30:05.189 INFO:tasks.workunit.client.1.smithi193.stdout:3/294: link d0/d9/l19 d0/d18/d1c/d25/d39/l67 0 2024-09-04T16:30:05.190 INFO:tasks.workunit.client.1.smithi193.stdout:1/317: write d1/f53 [576182,5716] 0 2024-09-04T16:30:05.192 INFO:tasks.workunit.client.1.smithi193.stdout:2/243: mkdir d2/d9/db/d10/d51 0 2024-09-04T16:30:05.194 INFO:tasks.workunit.client.1.smithi193.stdout:7/358: rename d9/d39/f76 to d9/d39/d3e/f7c 0 2024-09-04T16:30:05.195 INFO:tasks.workunit.client.1.smithi193.stdout:5/274: dread d1/d29/d1e/d37/d3f/d4f/f4a [0,4194304] 0 2024-09-04T16:30:05.197 INFO:tasks.workunit.client.1.smithi193.stdout:5/275: write d1/d8/f12 [698042,20110] 0 2024-09-04T16:30:05.209 INFO:tasks.workunit.client.1.smithi193.stdout:2/244: unlink d2/d9/f39 0 2024-09-04T16:30:05.213 INFO:tasks.workunit.client.1.smithi193.stdout:3/295: rename d0/d18/d1c/d25/d39 to d0/d18/d1c/d25/d5e/d68 0 2024-09-04T16:30:05.213 INFO:tasks.workunit.client.1.smithi193.stdout:3/296: chown d0/d9 64044 1 2024-09-04T16:30:05.214 INFO:tasks.workunit.client.1.smithi193.stdout:7/359: mkdir d9/d39/d3e/d7d 0 2024-09-04T16:30:05.215 INFO:tasks.workunit.client.1.smithi193.stdout:5/276: creat d1/d29/d18/d42/f51 x:0 0 0 2024-09-04T16:30:05.219 INFO:tasks.workunit.client.1.smithi193.stdout:3/297: readlink d0/l6 0 2024-09-04T16:30:05.220 INFO:tasks.workunit.client.1.smithi193.stdout:0/303: getdents d18/d25/d32/d57 0 2024-09-04T16:30:05.221 INFO:tasks.workunit.client.1.smithi193.stdout:2/245: symlink d2/d9/l52 0 2024-09-04T16:30:05.222 INFO:tasks.workunit.client.1.smithi193.stdout:0/304: readlink d18/d25/d32/l46 0 2024-09-04T16:30:05.223 INFO:tasks.workunit.client.1.smithi193.stdout:3/298: stat d0/d3b/f60 0 2024-09-04T16:30:05.224 INFO:tasks.workunit.client.1.smithi193.stdout:7/360: dwrite d9/de/d27/f3d [0,4194304] 0 2024-09-04T16:30:05.224 INFO:tasks.workunit.client.1.smithi193.stdout:5/277: creat d1/d8/db/d36/f52 x:0 0 0 2024-09-04T16:30:05.227 INFO:tasks.workunit.client.1.smithi193.stdout:0/305: rmdir d18/d25 39 2024-09-04T16:30:05.230 INFO:tasks.workunit.client.1.smithi193.stdout:2/246: mknod d2/d9/d18/d3f/c53 0 2024-09-04T16:30:05.231 INFO:tasks.workunit.client.1.smithi193.stdout:7/361: rename d9/d18/d22/d2b/c6e to d9/d18/d22/d2b/d6c/c7e 0 2024-09-04T16:30:05.232 INFO:tasks.workunit.client.1.smithi193.stdout:5/278: symlink d1/d29/d1e/d37/d3f/d4f/l53 0 2024-09-04T16:30:05.235 INFO:tasks.workunit.client.1.smithi193.stdout:3/299: dwrite d0/d18/d1c/d51/d5a/f5c [0,4194304] 0 2024-09-04T16:30:05.242 INFO:tasks.workunit.client.1.smithi193.stdout:3/300: dread d0/d18/d1c/d30/f41 [0,4194304] 0 2024-09-04T16:30:05.244 INFO:tasks.workunit.client.1.smithi193.stdout:5/279: dwrite d1/d29/d1e/f4b [4194304,4194304] 0 2024-09-04T16:30:05.254 INFO:tasks.workunit.client.1.smithi193.stdout:0/306: dread d18/f20 [0,4194304] 0 2024-09-04T16:30:05.256 INFO:tasks.workunit.client.1.smithi193.stdout:1/318: dwrite d1/d2b/f14 [0,4194304] 0 2024-09-04T16:30:05.261 INFO:tasks.workunit.client.1.smithi193.stdout:0/307: mknod d18/d25/d32/c66 0 2024-09-04T16:30:05.261 INFO:tasks.workunit.client.1.smithi193.stdout:1/319: symlink d1/d39/l66 0 2024-09-04T16:30:05.263 INFO:tasks.workunit.client.1.smithi193.stdout:0/308: mknod d18/d25/d32/c67 0 2024-09-04T16:30:05.264 INFO:tasks.workunit.client.1.smithi193.stdout:1/320: creat d1/d39/f67 x:0 0 0 2024-09-04T16:30:05.265 INFO:tasks.workunit.client.1.smithi193.stdout:0/309: truncate d18/f1d 561868 0 2024-09-04T16:30:05.266 INFO:tasks.workunit.client.1.smithi193.stdout:1/321: read - d1/d2b/db/f5c zero size 2024-09-04T16:30:05.267 INFO:tasks.workunit.client.1.smithi193.stdout:0/310: write d18/f48 [1342306,63637] 0 2024-09-04T16:30:05.269 INFO:tasks.workunit.client.1.smithi193.stdout:0/311: fdatasync f3 0 2024-09-04T16:30:05.280 INFO:tasks.workunit.client.1.smithi193.stdout:3/301: write d0/d7/de/f2a [620932,18810] 0 2024-09-04T16:30:05.281 INFO:tasks.workunit.client.1.smithi193.stdout:6/239: sync 2024-09-04T16:30:05.281 INFO:tasks.workunit.client.1.smithi193.stdout:7/362: dwrite d9/d18/d1e/f2e [0,4194304] 0 2024-09-04T16:30:05.282 INFO:tasks.workunit.client.1.smithi193.stdout:6/240: chown d5/d27/d3e/d43 2616300 1 2024-09-04T16:30:05.286 INFO:tasks.workunit.client.1.smithi193.stdout:7/363: symlink d9/d39/d3e/d4a/l7f 0 2024-09-04T16:30:05.287 INFO:tasks.workunit.client.1.smithi193.stdout:0/312: dread fb [0,4194304] 0 2024-09-04T16:30:05.287 INFO:tasks.workunit.client.1.smithi193.stdout:3/302: symlink d0/d18/d1c/d25/d5e/d68/l69 0 2024-09-04T16:30:05.290 INFO:tasks.workunit.client.1.smithi193.stdout:5/280: truncate d1/d8/db/d23/f26 1864510 0 2024-09-04T16:30:05.292 INFO:tasks.workunit.client.1.smithi193.stdout:3/303: mknod d0/d18/d1c/c6a 0 2024-09-04T16:30:05.294 INFO:tasks.workunit.client.1.smithi193.stdout:1/322: rename d1/d2b/l6 to d1/d2b/d10/d2a/l68 0 2024-09-04T16:30:05.295 INFO:tasks.workunit.client.1.smithi193.stdout:5/281: mknod d1/d29/d1e/d37/d3f/c54 0 2024-09-04T16:30:05.297 INFO:tasks.workunit.client.1.smithi193.stdout:1/323: read d1/f53 [455520,8947] 0 2024-09-04T16:30:05.298 INFO:tasks.workunit.client.1.smithi193.stdout:7/364: rmdir d9/d39/d3e/d4a/d66 0 2024-09-04T16:30:05.300 INFO:tasks.workunit.client.1.smithi193.stdout:3/304: dwrite d0/d18/d1c/d25/f42 [0,4194304] 0 2024-09-04T16:30:05.300 INFO:tasks.workunit.client.1.smithi193.stdout:5/282: mkdir d1/d29/d1e/d37/d3f/d4f/d3e/d55 0 2024-09-04T16:30:05.305 INFO:tasks.workunit.client.1.smithi193.stdout:7/365: creat d9/d39/d3e/d69/f80 x:0 0 0 2024-09-04T16:30:05.313 INFO:tasks.workunit.client.1.smithi193.stdout:0/313: dwrite fb [0,4194304] 0 2024-09-04T16:30:05.315 INFO:tasks.workunit.client.1.smithi193.stdout:1/324: dread d1/d2b/d10/f19 [0,4194304] 0 2024-09-04T16:30:05.316 INFO:tasks.workunit.client.1.smithi193.stdout:7/366: dread d9/de/d27/f37 [0,4194304] 0 2024-09-04T16:30:05.317 INFO:tasks.workunit.client.1.smithi193.stdout:0/314: mknod d18/d25/d5f/c68 0 2024-09-04T16:30:05.321 INFO:tasks.workunit.client.1.smithi193.stdout:7/367: unlink d9/d18/d22/c7a 0 2024-09-04T16:30:05.326 INFO:tasks.workunit.client.1.smithi193.stdout:3/305: dwrite d0/fa [0,4194304] 0 2024-09-04T16:30:05.327 INFO:tasks.workunit.client.1.smithi193.stdout:5/283: dread d1/d8/f22 [0,4194304] 0 2024-09-04T16:30:05.332 INFO:tasks.workunit.client.1.smithi193.stdout:3/306: write d0/d7/de/f44 [115193,37710] 0 2024-09-04T16:30:05.336 INFO:tasks.workunit.client.1.smithi193.stdout:5/284: creat d1/d8/db/f56 x:0 0 0 2024-09-04T16:30:05.338 INFO:tasks.workunit.client.1.smithi193.stdout:0/315: dwrite d18/f38 [4194304,4194304] 0 2024-09-04T16:30:05.342 INFO:tasks.workunit.client.1.smithi193.stdout:7/368: dwrite d9/d18/d22/d2b/f5f [0,4194304] 0 2024-09-04T16:30:05.343 INFO:tasks.workunit.client.1.smithi193.stdout:1/325: dwrite d1/d2b/d1b/d28/f35 [0,4194304] 0 2024-09-04T16:30:05.346 INFO:tasks.workunit.client.1.smithi193.stdout:5/285: rename d1/d29/d1e/d37/d3f/c54 to d1/d29/d1e/d37/c57 0 2024-09-04T16:30:05.346 INFO:tasks.workunit.client.1.smithi193.stdout:1/326: stat d1/d2b 0 2024-09-04T16:30:05.347 INFO:tasks.workunit.client.1.smithi193.stdout:3/307: write d0/f3 [1833488,109028] 0 2024-09-04T16:30:05.348 INFO:tasks.workunit.client.1.smithi193.stdout:1/327: fsync d1/d2b/f14 0 2024-09-04T16:30:05.350 INFO:tasks.workunit.client.1.smithi193.stdout:3/308: write d0/d7/de/d45/f46 [3393842,46960] 0 2024-09-04T16:30:05.356 INFO:tasks.workunit.client.1.smithi193.stdout:3/309: read d0/d7/de/f22 [453929,7968] 0 2024-09-04T16:30:05.358 INFO:tasks.workunit.client.1.smithi193.stdout:7/369: dread d9/d18/d22/d2b/f5f [0,4194304] 0 2024-09-04T16:30:05.359 INFO:tasks.workunit.client.1.smithi193.stdout:5/286: dwrite d1/d29/d18/d42/f4c [0,4194304] 0 2024-09-04T16:30:05.360 INFO:tasks.workunit.client.1.smithi193.stdout:3/310: write d0/f66 [306608,52712] 0 2024-09-04T16:30:05.361 INFO:tasks.workunit.client.1.smithi193.stdout:1/328: read d1/d2b/d10/f21 [181232,72902] 0 2024-09-04T16:30:05.362 INFO:tasks.workunit.client.1.smithi193.stdout:7/370: mknod d9/d18/d22/d2b/c81 0 2024-09-04T16:30:05.363 INFO:tasks.workunit.client.1.smithi193.stdout:1/329: write d1/d2b/f2c [3703368,12816] 0 2024-09-04T16:30:05.367 INFO:tasks.workunit.client.1.smithi193.stdout:5/287: truncate d1/d8/db/d36/f48 1553283 0 2024-09-04T16:30:05.371 INFO:tasks.workunit.client.1.smithi193.stdout:3/311: rename d0/d7/de/d45/f52 to d0/d7/f6b 0 2024-09-04T16:30:05.371 INFO:tasks.workunit.client.1.smithi193.stdout:5/288: fdatasync d1/d29/d1e/d37/d3f/d4f/d3e/f41 0 2024-09-04T16:30:05.375 INFO:tasks.workunit.client.1.smithi193.stdout:7/371: rename d9/d18/d1e/f26 to d9/d39/d3e/d69/f82 0 2024-09-04T16:30:05.375 INFO:tasks.workunit.client.1.smithi193.stdout:1/330: dwrite d1/d2b/f61 [0,4194304] 0 2024-09-04T16:30:05.378 INFO:tasks.workunit.client.1.smithi193.stdout:7/372: write f8 [3557727,63986] 0 2024-09-04T16:30:05.379 INFO:tasks.workunit.client.1.smithi193.stdout:5/289: mkdir d1/d29/d1e/d37/d58 0 2024-09-04T16:30:05.385 INFO:tasks.workunit.client.1.smithi193.stdout:7/373: unlink d9/d18/d22/d2b/l78 0 2024-09-04T16:30:05.387 INFO:tasks.workunit.client.1.smithi193.stdout:5/290: write d1/d8/db/d15/f30 [2204112,129239] 0 2024-09-04T16:30:05.387 INFO:tasks.workunit.client.1.smithi193.stdout:0/316: dread d18/d25/f2a [0,4194304] 0 2024-09-04T16:30:05.391 INFO:tasks.workunit.client.1.smithi193.stdout:0/317: fdatasync d18/d25/d3b/f51 0 2024-09-04T16:30:05.391 INFO:tasks.workunit.client.1.smithi193.stdout:3/312: dwrite d0/d18/d1c/d51/d5a/f5c [0,4194304] 0 2024-09-04T16:30:05.391 INFO:tasks.workunit.client.1.smithi193.stdout:5/291: chown d1/d8/l35 0 1 2024-09-04T16:30:05.391 INFO:tasks.workunit.client.1.smithi193.stdout:1/331: dwrite d1/d2b/f61 [4194304,4194304] 0 2024-09-04T16:30:05.392 INFO:tasks.workunit.client.1.smithi193.stdout:7/374: rename d9/d39/f3b to d9/d39/d3e/d69/f83 0 2024-09-04T16:30:05.393 INFO:tasks.workunit.client.1.smithi193.stdout:7/375: stat d9/d18/d1e/c6f 0 2024-09-04T16:30:05.394 INFO:tasks.workunit.client.1.smithi193.stdout:5/292: creat d1/d29/f59 x:0 0 0 2024-09-04T16:30:05.395 INFO:tasks.workunit.client.1.smithi193.stdout:3/313: mkdir d0/d18/d1c/d51/d6c 0 2024-09-04T16:30:05.395 INFO:tasks.workunit.client.1.smithi193.stdout:1/332: symlink d1/d2b/d1b/l69 0 2024-09-04T16:30:05.397 INFO:tasks.workunit.client.1.smithi193.stdout:0/318: creat d18/f69 x:0 0 0 2024-09-04T16:30:05.398 INFO:tasks.workunit.client.1.smithi193.stdout:5/293: write d1/d29/d1e/d37/f43 [1097843,5638] 0 2024-09-04T16:30:05.401 INFO:tasks.workunit.client.1.smithi193.stdout:1/333: creat d1/d2b/f6a x:0 0 0 2024-09-04T16:30:05.402 INFO:tasks.workunit.client.1.smithi193.stdout:5/294: write d1/d8/fd [102433,88241] 0 2024-09-04T16:30:05.403 INFO:tasks.workunit.client.1.smithi193.stdout:0/319: rename d18/d25/d3b/d64 to d18/d25/d5f/d6a 0 2024-09-04T16:30:05.407 INFO:tasks.workunit.client.1.smithi193.stdout:7/376: dwrite d9/d39/f51 [0,4194304] 0 2024-09-04T16:30:05.409 INFO:tasks.workunit.client.1.smithi193.stdout:3/314: dwrite d0/d7/de/f22 [0,4194304] 0 2024-09-04T16:30:05.410 INFO:tasks.workunit.client.1.smithi193.stdout:5/295: dread d1/d8/f34 [0,4194304] 0 2024-09-04T16:30:05.410 INFO:tasks.workunit.client.1.smithi193.stdout:1/334: rename d1/d2b/db/f5c to d1/d2b/d10/d56/f6b 0 2024-09-04T16:30:05.411 INFO:tasks.workunit.client.1.smithi193.stdout:0/320: symlink d18/d25/d3b/l6b 0 2024-09-04T16:30:05.412 INFO:tasks.workunit.client.1.smithi193.stdout:5/296: stat d1/d8/db/d23/l49 0 2024-09-04T16:30:05.412 INFO:tasks.workunit.client.1.smithi193.stdout:0/321: chown d18/l50 3215218 1 2024-09-04T16:30:05.414 INFO:tasks.workunit.client.1.smithi193.stdout:3/315: symlink d0/d7/l6d 0 2024-09-04T16:30:05.418 INFO:tasks.workunit.client.1.smithi193.stdout:1/335: dwrite d1/d2b/d1b/d28/f35 [0,4194304] 0 2024-09-04T16:30:05.418 INFO:tasks.workunit.client.1.smithi193.stdout:0/322: mkdir d18/d25/d32/d57/d6c 0 2024-09-04T16:30:05.419 INFO:tasks.workunit.client.1.smithi193.stdout:9/339: sync 2024-09-04T16:30:05.419 INFO:tasks.workunit.client.1.smithi193.stdout:2/247: sync 2024-09-04T16:30:05.419 INFO:tasks.workunit.client.1.smithi193.stdout:8/300: sync 2024-09-04T16:30:05.420 INFO:tasks.workunit.client.1.smithi193.stdout:4/213: sync 2024-09-04T16:30:05.420 INFO:tasks.workunit.client.1.smithi193.stdout:6/241: sync 2024-09-04T16:30:05.420 INFO:tasks.workunit.client.1.smithi193.stdout:9/340: fdatasync d2/d18/d2f/f29 0 2024-09-04T16:30:05.422 INFO:tasks.workunit.client.1.smithi193.stdout:3/316: unlink d0/d18/d1c/c54 0 2024-09-04T16:30:05.423 INFO:tasks.workunit.client.1.smithi193.stdout:8/301: dread d2/d20/d23/d1b/f28 [4194304,4194304] 0 2024-09-04T16:30:05.424 INFO:tasks.workunit.client.1.smithi193.stdout:0/323: write d18/d25/d32/f52 [4233778,50067] 0 2024-09-04T16:30:05.428 INFO:tasks.workunit.client.1.smithi193.stdout:2/248: rename d2/d9/l52 to d2/d14/l54 0 2024-09-04T16:30:05.429 INFO:tasks.workunit.client.1.smithi193.stdout:7/377: truncate d9/de/d27/f3d 3741741 0 2024-09-04T16:30:05.434 INFO:tasks.workunit.client.1.smithi193.stdout:4/214: mknod d3/d3c/d47/c49 0 2024-09-04T16:30:05.435 INFO:tasks.workunit.client.1.smithi193.stdout:6/242: creat d5/de/d15/d48/f4b x:0 0 0 2024-09-04T16:30:05.436 INFO:tasks.workunit.client.1.smithi193.stdout:7/378: rename d9/d39/d3e/f63 to d9/de/d27/f84 0 2024-09-04T16:30:05.436 INFO:tasks.workunit.client.1.smithi193.stdout:4/215: write d3/d1a/d2a/f2d [4375110,93201] 0 2024-09-04T16:30:05.437 INFO:tasks.workunit.client.1.smithi193.stdout:7/379: stat d9/d39/d3e/d53 0 2024-09-04T16:30:05.439 INFO:tasks.workunit.client.1.smithi193.stdout:9/341: getdents d2/d56 0 2024-09-04T16:30:05.439 INFO:tasks.workunit.client.1.smithi193.stdout:3/317: mkdir d0/d18/d1c/d6e 0 2024-09-04T16:30:05.440 INFO:tasks.workunit.client.1.smithi193.stdout:8/302: write d2/d20/f47 [1113051,12802] 0 2024-09-04T16:30:05.440 INFO:tasks.workunit.client.1.smithi193.stdout:2/249: symlink d2/d9/db/d10/d4e/l55 0 2024-09-04T16:30:05.443 INFO:tasks.workunit.client.1.smithi193.stdout:0/324: dwrite f15 [4194304,4194304] 0 2024-09-04T16:30:05.443 INFO:tasks.workunit.client.1.smithi193.stdout:6/243: unlink d5/d27/f30 0 2024-09-04T16:30:05.443 INFO:tasks.workunit.client.1.smithi193.stdout:9/342: chown d2/d18/d2f/d22 5085249 1 2024-09-04T16:30:05.444 INFO:tasks.workunit.client.1.smithi193.stdout:2/250: stat d2/d9/d18/f4f 0 2024-09-04T16:30:05.444 INFO:tasks.workunit.client.1.smithi193.stdout:1/336: link d1/d2b/d1b/l69 d1/d2b/db/d54/d63/l6c 0 2024-09-04T16:30:05.448 INFO:tasks.workunit.client.1.smithi193.stdout:3/318: mknod d0/d7/de/d45/c6f 0 2024-09-04T16:30:05.449 INFO:tasks.workunit.client.1.smithi193.stdout:7/380: mkdir d9/d85 0 2024-09-04T16:30:05.450 INFO:tasks.workunit.client.1.smithi193.stdout:9/343: write d2/d8/d15/f1b [5820172,1149] 0 2024-09-04T16:30:05.450 INFO:tasks.workunit.client.1.smithi193.stdout:0/325: mkdir d18/d25/d32/d57/d6d 0 2024-09-04T16:30:05.452 INFO:tasks.workunit.client.1.smithi193.stdout:2/251: mkdir d2/d9/db/d10/d1e/d56 0 2024-09-04T16:30:05.452 INFO:tasks.workunit.client.1.smithi193.stdout:4/216: dwrite d3/d1a/d21/f3e [4194304,4194304] 0 2024-09-04T16:30:05.454 INFO:tasks.workunit.client.1.smithi193.stdout:3/319: stat d0/d18/d1c/d30/f4e 0 2024-09-04T16:30:05.455 INFO:tasks.workunit.client.1.smithi193.stdout:2/252: write d2/fc [3821229,655] 0 2024-09-04T16:30:05.455 INFO:tasks.workunit.client.1.smithi193.stdout:9/344: symlink d2/d18/l6f 0 2024-09-04T16:30:05.457 INFO:tasks.workunit.client.1.smithi193.stdout:4/217: mknod d3/d3c/c4a 0 2024-09-04T16:30:05.459 INFO:tasks.workunit.client.1.smithi193.stdout:1/337: getdents d1/d2b/d1b/d28/d50 0 2024-09-04T16:30:05.459 INFO:tasks.workunit.client.1.smithi193.stdout:7/381: rename d9/d11/f17 to d9/d39/d3e/d4d/d4f/f86 0 2024-09-04T16:30:05.461 INFO:tasks.workunit.client.1.smithi193.stdout:3/320: symlink d0/d3b/l70 0 2024-09-04T16:30:05.461 INFO:tasks.workunit.client.1.smithi193.stdout:2/253: chown d2/d9/db/d10/d1f/c34 10398 1 2024-09-04T16:30:05.462 INFO:tasks.workunit.client.1.smithi193.stdout:6/244: dread d5/fb [0,4194304] 0 2024-09-04T16:30:05.462 INFO:tasks.workunit.client.1.smithi193.stdout:0/326: symlink d18/d25/d5f/d6a/l6e 0 2024-09-04T16:30:05.465 INFO:tasks.workunit.client.1.smithi193.stdout:7/382: read d9/de/f1c [2769675,87980] 0 2024-09-04T16:30:05.465 INFO:tasks.workunit.client.1.smithi193.stdout:3/321: chown d0/d18/d1b/f3f 56 1 2024-09-04T16:30:05.465 INFO:tasks.workunit.client.1.smithi193.stdout:2/254: rmdir d2 39 2024-09-04T16:30:05.467 INFO:tasks.workunit.client.1.smithi193.stdout:6/245: chown d5/de/d15/d48/f4b 1901 1 2024-09-04T16:30:05.469 INFO:tasks.workunit.client.1.smithi193.stdout:0/327: creat d18/d25/d5f/d65/f6f x:0 0 0 2024-09-04T16:30:05.472 INFO:tasks.workunit.client.1.smithi193.stdout:9/345: dwrite d2/d8/d25/f37 [0,4194304] 0 2024-09-04T16:30:05.472 INFO:tasks.workunit.client.1.smithi193.stdout:6/246: stat d5/de/d15/d1b/l4a 0 2024-09-04T16:30:05.472 INFO:tasks.workunit.client.1.smithi193.stdout:4/218: dwrite d3/fa [0,4194304] 0 2024-09-04T16:30:05.475 INFO:tasks.workunit.client.1.smithi193.stdout:2/255: symlink d2/d9/db/d10/d4e/l57 0 2024-09-04T16:30:05.476 INFO:tasks.workunit.client.1.smithi193.stdout:6/247: chown d5/d27/d3e/d49 183 1 2024-09-04T16:30:05.478 INFO:tasks.workunit.client.1.smithi193.stdout:9/346: mkdir d2/d8/d15/d70 0 2024-09-04T16:30:05.479 INFO:tasks.workunit.client.1.smithi193.stdout:4/219: write d3/d3c/f45 [936024,18807] 0 2024-09-04T16:30:05.482 INFO:tasks.workunit.client.1.smithi193.stdout:2/256: mknod d2/d14/c58 0 2024-09-04T16:30:05.484 INFO:tasks.workunit.client.1.smithi193.stdout:6/248: creat d5/d33/f4c x:0 0 0 2024-09-04T16:30:05.485 INFO:tasks.workunit.client.1.smithi193.stdout:2/257: readlink d2/l2d 0 2024-09-04T16:30:05.485 INFO:tasks.workunit.client.1.smithi193.stdout:4/220: readlink d3/d1a/d2a/l2b 0 2024-09-04T16:30:05.485 INFO:tasks.workunit.client.1.smithi193.stdout:7/383: dwrite d9/f19 [0,4194304] 0 2024-09-04T16:30:05.486 INFO:tasks.workunit.client.1.smithi193.stdout:9/347: unlink d2/d18/d2f/f41 0 2024-09-04T16:30:05.489 INFO:tasks.workunit.client.1.smithi193.stdout:3/322: dwrite d0/d18/d1c/d25/f42 [0,4194304] 0 2024-09-04T16:30:05.494 INFO:tasks.workunit.client.1.smithi193.stdout:1/338: dwrite d1/d2b/db/f3f [0,4194304] 0 2024-09-04T16:30:05.494 INFO:tasks.workunit.client.1.smithi193.stdout:6/249: mknod d5/d27/d3e/c4d 0 2024-09-04T16:30:05.494 INFO:tasks.workunit.client.1.smithi193.stdout:4/221: chown d3/c43 954 1 2024-09-04T16:30:05.495 INFO:tasks.workunit.client.1.smithi193.stdout:7/384: fdatasync d9/de/d27/f34 0 2024-09-04T16:30:05.496 INFO:tasks.workunit.client.1.smithi193.stdout:2/258: unlink d2/l2d 0 2024-09-04T16:30:05.497 INFO:tasks.workunit.client.1.smithi193.stdout:6/250: mkdir d5/d33/d4e 0 2024-09-04T16:30:05.499 INFO:tasks.workunit.client.1.smithi193.stdout:2/259: rmdir d2 39 2024-09-04T16:30:05.499 INFO:tasks.workunit.client.1.smithi193.stdout:4/222: chown d3/d1a/d21/f22 74146 1 2024-09-04T16:30:05.501 INFO:tasks.workunit.client.1.smithi193.stdout:4/223: chown d3/d1a/d2a/f41 25 1 2024-09-04T16:30:05.501 INFO:tasks.workunit.client.1.smithi193.stdout:3/323: unlink d0/d10/c29 0 2024-09-04T16:30:05.503 INFO:tasks.workunit.client.1.smithi193.stdout:9/348: dread - d2/d18/d2f/f36 zero size 2024-09-04T16:30:05.506 INFO:tasks.workunit.client.1.smithi193.stdout:0/328: dread d18/f48 [0,4194304] 0 2024-09-04T16:30:05.508 INFO:tasks.workunit.client.1.smithi193.stdout:2/260: mkdir d2/d9/db/d10/d1e/d56/d59 0 2024-09-04T16:30:05.509 INFO:tasks.workunit.client.1.smithi193.stdout:7/385: read d9/d39/d3e/d4a/f5b [2858722,4397] 0 2024-09-04T16:30:05.509 INFO:tasks.workunit.client.1.smithi193.stdout:9/349: creat d2/d8/d15/f71 x:0 0 0 2024-09-04T16:30:05.512 INFO:tasks.workunit.client.1.smithi193.stdout:7/386: chown d9/de/d27 693615715 1 2024-09-04T16:30:05.514 INFO:tasks.workunit.client.1.smithi193.stdout:1/339: dwrite d1/d2b/d10/d56/f6b [0,4194304] 0 2024-09-04T16:30:05.514 INFO:tasks.workunit.client.1.smithi193.stdout:2/261: chown d2/d9/db/d10/d1f/c34 493 1 2024-09-04T16:30:05.515 INFO:tasks.workunit.client.1.smithi193.stdout:7/387: dread - d9/d18/d1e/f71 zero size 2024-09-04T16:30:05.518 INFO:tasks.workunit.client.1.smithi193.stdout:2/262: read d2/d9/d18/f1d [6661660,120934] 0 2024-09-04T16:30:05.521 INFO:tasks.workunit.client.1.smithi193.stdout:3/324: dwrite d0/d10/f38 [0,4194304] 0 2024-09-04T16:30:05.526 INFO:tasks.workunit.client.1.smithi193.stdout:9/350: dwrite d2/d8/d15/f71 [0,4194304] 0 2024-09-04T16:30:05.527 INFO:tasks.workunit.client.1.smithi193.stdout:9/351: dread - d2/d8/d61/f6b zero size 2024-09-04T16:30:05.529 INFO:tasks.workunit.client.1.smithi193.stdout:9/352: write d2/d18/d2f/d22/d30/d52/f57 [269085,65157] 0 2024-09-04T16:30:05.540 INFO:tasks.workunit.client.1.smithi193.stdout:6/251: dread d5/f6 [0,4194304] 0 2024-09-04T16:30:05.553 INFO:tasks.workunit.client.1.smithi193.stdout:7/388: dread d9/d18/d1e/f29 [0,4194304] 0 2024-09-04T16:30:05.557 INFO:tasks.workunit.client.1.smithi193.stdout:7/389: dwrite f3 [0,4194304] 0 2024-09-04T16:30:05.565 INFO:tasks.workunit.client.1.smithi193.stdout:5/297: sync 2024-09-04T16:30:05.591 INFO:tasks.workunit.client.1.smithi193.stdout:8/303: sync 2024-09-04T16:30:05.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:05 smithi170 ceph-mon[29272]: pgmap v22: 65 pgs: 65 active+clean; 571 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 64 MiB/s wr, 420 op/s 2024-09-04T16:30:05.609 INFO:tasks.workunit.client.1.smithi193.stdout:0/329: mknod d18/d25/d32/d57/d6d/c70 0 2024-09-04T16:30:05.609 INFO:tasks.workunit.client.1.smithi193.stdout:0/330: chown d18/d25/d32/d57/f4e 3736450 1 2024-09-04T16:30:05.614 INFO:tasks.workunit.client.1.smithi193.stdout:2/263: creat d2/d9/db/d10/d1e/f5a x:0 0 0 2024-09-04T16:30:05.616 INFO:tasks.workunit.client.1.smithi193.stdout:2/264: write d2/d9/db/d10/d38/f3b [377745,33517] 0 2024-09-04T16:30:05.616 INFO:tasks.workunit.client.1.smithi193.stdout:2/265: chown d2/d9/d18 2625471 1 2024-09-04T16:30:05.617 INFO:tasks.workunit.client.1.smithi193.stdout:2/266: write d2/d9/d18/f31 [139914,93024] 0 2024-09-04T16:30:05.618 INFO:tasks.workunit.client.1.smithi193.stdout:6/252: creat d5/d27/d3e/f4f x:0 0 0 2024-09-04T16:30:05.622 INFO:tasks.workunit.client.1.smithi193.stdout:5/298: unlink d1/d8/db/d15/d2b/c2c 0 2024-09-04T16:30:05.623 INFO:tasks.workunit.client.1.smithi193.stdout:5/299: write d1/d29/d18/d42/f51 [668251,84906] 0 2024-09-04T16:30:05.624 INFO:tasks.workunit.client.1.smithi193.stdout:8/304: rename d2/d20/d23/d34/d46/d53/d5f to d2/d20/d23/d34/d46/d66 0 2024-09-04T16:30:05.624 INFO:tasks.workunit.client.1.smithi193.stdout:5/300: chown d1/d8/db/d36 1 1 2024-09-04T16:30:05.624 INFO:tasks.workunit.client.1.smithi193.stdout:0/331: mknod d18/d25/d32/d57/c71 0 2024-09-04T16:30:05.625 INFO:tasks.workunit.client.1.smithi193.stdout:1/340: mkdir d1/d2b/d1b/d51/d6d 0 2024-09-04T16:30:05.628 INFO:tasks.workunit.client.1.smithi193.stdout:4/224: truncate d3/f2f 987185 0 2024-09-04T16:30:05.632 INFO:tasks.workunit.client.1.smithi193.stdout:6/253: fsync d5/f20 0 2024-09-04T16:30:05.633 INFO:tasks.workunit.client.1.smithi193.stdout:7/390: creat d9/d18/d22/d2b/d6c/d70/d79/f87 x:0 0 0 2024-09-04T16:30:05.634 INFO:tasks.workunit.client.1.smithi193.stdout:5/301: fdatasync d1/d8/f34 0 2024-09-04T16:30:05.634 INFO:tasks.workunit.client.1.smithi193.stdout:5/302: write d1/d8/f34 [21597,24822] 0 2024-09-04T16:30:05.635 INFO:tasks.workunit.client.1.smithi193.stdout:8/305: rename d2/d20/d23/d24/d25 to d2/d20/d23/d24/d3c/d65/d67 0 2024-09-04T16:30:05.638 INFO:tasks.workunit.client.1.smithi193.stdout:1/341: dread d1/d2b/f31 [4194304,4194304] 0 2024-09-04T16:30:05.639 INFO:tasks.workunit.client.1.smithi193.stdout:4/225: dread d3/f29 [0,4194304] 0 2024-09-04T16:30:05.639 INFO:tasks.workunit.client.1.smithi193.stdout:9/353: rmdir d2/d8/d68 0 2024-09-04T16:30:05.641 INFO:tasks.workunit.client.1.smithi193.stdout:5/303: dread d1/d8/f2d [0,4194304] 0 2024-09-04T16:30:05.641 INFO:tasks.workunit.client.1.smithi193.stdout:9/354: fsync d2/f1c 0 2024-09-04T16:30:05.642 INFO:tasks.workunit.client.1.smithi193.stdout:6/254: unlink d5/f2b 0 2024-09-04T16:30:05.644 INFO:tasks.workunit.client.1.smithi193.stdout:8/306: dwrite d2/d20/d23/d1b/f48 [0,4194304] 0 2024-09-04T16:30:05.646 INFO:tasks.workunit.client.1.smithi193.stdout:0/332: rename d18/f23 to d18/d25/d32/d57/d6d/f72 0 2024-09-04T16:30:05.646 INFO:tasks.workunit.client.1.smithi193.stdout:3/325: link d0/d9/l19 d0/d18/d1c/d6e/l71 0 2024-09-04T16:30:05.647 INFO:tasks.workunit.client.1.smithi193.stdout:8/307: chown d2/c35 195470 1 2024-09-04T16:30:05.650 INFO:tasks.workunit.client.1.smithi193.stdout:5/304: read d1/d29/f1d [1857497,115843] 0 2024-09-04T16:30:05.650 INFO:tasks.workunit.client.1.smithi193.stdout:8/308: read - d2/d20/d23/d51/f63 zero size 2024-09-04T16:30:05.651 INFO:tasks.workunit.client.1.smithi193.stdout:6/255: unlink d5/c8 0 2024-09-04T16:30:05.654 INFO:tasks.workunit.client.1.smithi193.stdout:2/267: dwrite d2/d9/d18/f28 [0,4194304] 0 2024-09-04T16:30:05.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:05 smithi193 ceph-mon[36288]: pgmap v22: 65 pgs: 65 active+clean; 571 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 64 MiB/s wr, 420 op/s 2024-09-04T16:30:05.657 INFO:tasks.workunit.client.1.smithi193.stdout:0/333: mknod d18/d25/d32/d57/c73 0 2024-09-04T16:30:05.659 INFO:tasks.workunit.client.1.smithi193.stdout:6/256: chown d5/de/c2d 522027 1 2024-09-04T16:30:05.660 INFO:tasks.workunit.client.1.smithi193.stdout:1/342: creat d1/f6e x:0 0 0 2024-09-04T16:30:05.665 INFO:tasks.workunit.client.1.smithi193.stdout:6/257: dwrite d5/f11 [0,4194304] 0 2024-09-04T16:30:05.671 INFO:tasks.workunit.client.1.smithi193.stdout:8/309: dread d2/d20/d23/d1b/f28 [0,4194304] 0 2024-09-04T16:30:05.717 INFO:tasks.workunit.client.1.smithi193.stdout:7/391: sync 2024-09-04T16:30:05.718 INFO:tasks.workunit.client.1.smithi193.stdout:7/392: read d9/de/d27/f35 [6773927,23076] 0 2024-09-04T16:30:05.718 INFO:tasks.workunit.client.1.smithi193.stdout:7/393: read - d9/de/d27/f84 zero size 2024-09-04T16:30:05.750 INFO:tasks.workunit.client.1.smithi193.stdout:3/326: unlink d0/c1d 0 2024-09-04T16:30:05.751 INFO:tasks.workunit.client.1.smithi193.stdout:4/226: rename d3/d3c/c4a to d3/d1a/c4b 0 2024-09-04T16:30:05.757 INFO:tasks.workunit.client.1.smithi193.stdout:4/227: dwrite d3/d39/f42 [0,4194304] 0 2024-09-04T16:30:05.757 INFO:tasks.workunit.client.1.smithi193.stdout:4/228: dread - d3/d1a/d21/f37 zero size 2024-09-04T16:30:05.758 INFO:tasks.workunit.client.1.smithi193.stdout:4/229: chown d3/f35 58 1 2024-09-04T16:30:05.802 INFO:tasks.workunit.client.1.smithi193.stdout:1/343: chown d1/d2b/db/c18 19 1 2024-09-04T16:30:05.805 INFO:tasks.workunit.client.1.smithi193.stdout:9/355: getdents d2/d18/d2f/d22/d30/d52 0 2024-09-04T16:30:05.806 INFO:tasks.workunit.client.1.smithi193.stdout:5/305: truncate d1/d29/d18/d42/f51 353724 0 2024-09-04T16:30:05.807 INFO:tasks.workunit.client.1.smithi193.stdout:5/306: chown d1/d8/db/d15 1020 1 2024-09-04T16:30:05.808 INFO:tasks.workunit.client.1.smithi193.stdout:8/310: rename d2/d20/f32 to d2/d20/d23/d24/d3c/d65/d67/f68 0 2024-09-04T16:30:05.808 INFO:tasks.workunit.client.1.smithi193.stdout:9/356: dread d2/d18/d2f/f45 [0,4194304] 0 2024-09-04T16:30:05.809 INFO:tasks.workunit.client.1.smithi193.stdout:4/230: creat d3/d1a/d21/f4c x:0 0 0 2024-09-04T16:30:05.809 INFO:tasks.workunit.client.1.smithi193.stdout:0/334: symlink d18/d25/d32/d57/d6c/l74 0 2024-09-04T16:30:05.810 INFO:tasks.workunit.client.1.smithi193.stdout:6/258: creat d5/d27/d3e/d49/f50 x:0 0 0 2024-09-04T16:30:05.810 INFO:tasks.workunit.client.1.smithi193.stdout:1/344: rmdir d1/d39 39 2024-09-04T16:30:05.811 INFO:tasks.workunit.client.1.smithi193.stdout:0/335: chown d18/l5c 90034 1 2024-09-04T16:30:05.813 INFO:tasks.workunit.client.1.smithi193.stdout:3/327: creat d0/d18/d1c/d51/f72 x:0 0 0 2024-09-04T16:30:05.815 INFO:tasks.workunit.client.1.smithi193.stdout:2/268: getdents d2/d9 0 2024-09-04T16:30:05.821 INFO:tasks.workunit.client.1.smithi193.stdout:5/307: dwrite d1/d29/d1e/d37/f43 [0,4194304] 0 2024-09-04T16:30:05.822 INFO:tasks.workunit.client.1.smithi193.stdout:9/357: creat d2/d18/d2f/d22/d30/f72 x:0 0 0 2024-09-04T16:30:05.822 INFO:tasks.workunit.client.1.smithi193.stdout:7/394: dread d9/de/f1c [0,4194304] 0 2024-09-04T16:30:05.823 INFO:tasks.workunit.client.0.smithi170.stdout:8/0: sync 2024-09-04T16:30:05.823 INFO:tasks.workunit.client.0.smithi170.stdout:8/1: fsync - no filename 2024-09-04T16:30:05.824 INFO:tasks.workunit.client.0.smithi170.stdout:8/2: rename - no filename 2024-09-04T16:30:05.825 INFO:tasks.workunit.client.1.smithi193.stdout:9/358: dread - d2/d18/d2f/f36 zero size 2024-09-04T16:30:05.826 INFO:tasks.workunit.client.1.smithi193.stdout:6/259: chown d5/c3b 695226 1 2024-09-04T16:30:05.826 INFO:tasks.workunit.client.1.smithi193.stdout:8/311: mkdir d2/d20/d23/d34/d46/d69 0 2024-09-04T16:30:05.828 INFO:tasks.workunit.client.1.smithi193.stdout:9/359: fdatasync d2/d18/d2f/f29 0 2024-09-04T16:30:05.829 INFO:tasks.workunit.client.1.smithi193.stdout:3/328: rename d0/d10/d24 to d0/d10/d24/d73 22 2024-09-04T16:30:05.829 INFO:tasks.workunit.client.1.smithi193.stdout:1/345: creat d1/d2b/d10/d2a/f6f x:0 0 0 2024-09-04T16:30:05.831 INFO:tasks.workunit.client.1.smithi193.stdout:2/269: dwrite d2/d9/db/d10/d1f/f4c [0,4194304] 0 2024-09-04T16:30:05.831 INFO:tasks.workunit.client.1.smithi193.stdout:3/329: fdatasync d0/d18/d1c/d30/f4e 0 2024-09-04T16:30:05.833 INFO:tasks.workunit.client.1.smithi193.stdout:9/360: write d2/d8/d15/f1b [632351,78832] 0 2024-09-04T16:30:05.834 INFO:tasks.workunit.client.1.smithi193.stdout:5/308: rmdir d1/d29/d1e/d37/d3f 39 2024-09-04T16:30:05.835 INFO:tasks.workunit.client.1.smithi193.stdout:9/361: fdatasync d2/d8/d15/f16 0 2024-09-04T16:30:05.837 INFO:tasks.workunit.client.1.smithi193.stdout:7/395: mknod d9/d18/d22/d2b/d6c/d70/c88 0 2024-09-04T16:30:05.839 INFO:tasks.workunit.client.1.smithi193.stdout:7/396: stat d9/de/d27/c46 0 2024-09-04T16:30:05.840 INFO:tasks.workunit.client.1.smithi193.stdout:4/231: dread d3/d1a/d21/f3e [0,4194304] 0 2024-09-04T16:30:05.840 INFO:tasks.workunit.client.1.smithi193.stdout:1/346: creat d1/d2b/db/d54/f70 x:0 0 0 2024-09-04T16:30:05.841 INFO:tasks.workunit.client.1.smithi193.stdout:1/347: readlink d1/d2b/d10/d56/l65 0 2024-09-04T16:30:05.842 INFO:tasks.workunit.client.1.smithi193.stdout:1/348: chown d1/d2b/d1b/d28 44968330 1 2024-09-04T16:30:05.842 INFO:tasks.workunit.client.1.smithi193.stdout:2/270: symlink d2/d9/db/d10/d4e/l5b 0 2024-09-04T16:30:05.843 INFO:tasks.workunit.client.1.smithi193.stdout:2/271: readlink d2/d9/db/d10/l32 0 2024-09-04T16:30:05.844 INFO:tasks.workunit.client.1.smithi193.stdout:0/336: dread f6 [0,4194304] 0 2024-09-04T16:30:05.845 INFO:tasks.workunit.client.1.smithi193.stdout:2/272: write d2/d9/db/d10/d1e/d26/f48 [739527,88008] 0 2024-09-04T16:30:05.845 INFO:tasks.workunit.client.1.smithi193.stdout:9/362: write d2/f42 [1454244,45096] 0 2024-09-04T16:30:05.847 INFO:tasks.workunit.client.1.smithi193.stdout:5/309: truncate d1/d29/f1d 9228491 0 2024-09-04T16:30:05.848 INFO:tasks.workunit.client.1.smithi193.stdout:6/260: mkdir d5/d33/d4e/d51 0 2024-09-04T16:30:05.849 INFO:tasks.workunit.client.1.smithi193.stdout:6/261: write d5/f3f [922236,32246] 0 2024-09-04T16:30:05.849 INFO:tasks.workunit.client.1.smithi193.stdout:6/262: stat d5/d27/c38 0 2024-09-04T16:30:05.853 INFO:tasks.workunit.client.1.smithi193.stdout:3/330: chown d0/d9/c35 171542367 1 2024-09-04T16:30:05.854 INFO:tasks.workunit.client.1.smithi193.stdout:3/331: read d0/d18/d1c/d25/f42 [2991218,106253] 0 2024-09-04T16:30:05.857 INFO:tasks.workunit.client.1.smithi193.stdout:8/312: creat d2/d20/f6a x:0 0 0 2024-09-04T16:30:05.857 INFO:tasks.workunit.client.1.smithi193.stdout:8/313: readlink d2/d12/l2c 0 2024-09-04T16:30:05.859 INFO:tasks.workunit.client.1.smithi193.stdout:5/310: dread d1/d8/db/d15/f30 [0,4194304] 0 2024-09-04T16:30:05.862 INFO:tasks.workunit.client.1.smithi193.stdout:2/273: unlink d2/d9/d18/f1d 0 2024-09-04T16:30:05.862 INFO:tasks.workunit.client.1.smithi193.stdout:2/274: stat d2 0 2024-09-04T16:30:05.864 INFO:tasks.workunit.client.1.smithi193.stdout:9/363: creat d2/d8/d61/f73 x:0 0 0 2024-09-04T16:30:05.867 INFO:tasks.workunit.client.1.smithi193.stdout:6/263: mknod d5/d33/c52 0 2024-09-04T16:30:05.868 INFO:tasks.workunit.client.1.smithi193.stdout:7/397: mknod d9/d18/d22/c89 0 2024-09-04T16:30:05.869 INFO:tasks.workunit.client.1.smithi193.stdout:7/398: write d9/de/d27/f67 [895432,95204] 0 2024-09-04T16:30:05.871 INFO:tasks.workunit.client.1.smithi193.stdout:4/232: symlink d3/l4d 0 2024-09-04T16:30:05.872 INFO:tasks.workunit.client.1.smithi193.stdout:3/332: chown d0/d7/fc 690425226 1 2024-09-04T16:30:05.875 INFO:tasks.workunit.client.1.smithi193.stdout:3/333: dread d0/d18/d1c/d51/f56 [0,4194304] 0 2024-09-04T16:30:05.875 INFO:tasks.workunit.client.1.smithi193.stdout:1/349: unlink d1/d2b/d10/d2a/l68 0 2024-09-04T16:30:05.880 INFO:tasks.workunit.client.1.smithi193.stdout:3/334: dwrite d0/d18/f50 [0,4194304] 0 2024-09-04T16:30:05.881 INFO:tasks.workunit.client.1.smithi193.stdout:2/275: creat d2/d9/db/d10/f5c x:0 0 0 2024-09-04T16:30:05.883 INFO:tasks.workunit.client.1.smithi193.stdout:3/335: write d0/d10/f38 [2356346,96539] 0 2024-09-04T16:30:05.885 INFO:tasks.workunit.client.1.smithi193.stdout:2/276: rename d2/d9/db/d10/d1e to d2/d9/db/d10/d1e/d26/d5d 22 2024-09-04T16:30:05.887 INFO:tasks.workunit.client.1.smithi193.stdout:6/264: unlink d5/de/f2c 0 2024-09-04T16:30:05.887 INFO:tasks.workunit.client.1.smithi193.stdout:2/277: write d2/f35 [706609,20768] 0 2024-09-04T16:30:05.887 INFO:tasks.workunit.client.1.smithi193.stdout:0/337: dwrite d18/d25/f4d [0,4194304] 0 2024-09-04T16:30:05.891 INFO:tasks.workunit.client.1.smithi193.stdout:7/399: mknod d9/d11/c8a 0 2024-09-04T16:30:05.891 INFO:tasks.workunit.client.1.smithi193.stdout:7/400: readlink d9/d39/d3e/l42 0 2024-09-04T16:30:05.893 INFO:tasks.workunit.client.1.smithi193.stdout:3/336: dwrite d0/d18/d1b/f36 [0,4194304] 0 2024-09-04T16:30:05.896 INFO:tasks.workunit.client.1.smithi193.stdout:1/350: unlink d1/d2b/db/c4a 0 2024-09-04T16:30:05.897 INFO:tasks.workunit.client.1.smithi193.stdout:1/351: chown d1/d2b/d10/d56/f6b 0 1 2024-09-04T16:30:05.899 INFO:tasks.workunit.client.1.smithi193.stdout:5/311: creat d1/d29/d1e/d37/d3f/f5a x:0 0 0 2024-09-04T16:30:05.903 INFO:tasks.workunit.client.1.smithi193.stdout:7/401: dread d9/de/d27/f34 [0,4194304] 0 2024-09-04T16:30:05.904 INFO:tasks.workunit.client.1.smithi193.stdout:1/352: dwrite d1/d2b/f45 [0,4194304] 0 2024-09-04T16:30:05.905 INFO:tasks.workunit.client.1.smithi193.stdout:1/353: stat d1/d2b/db/f3e 0 2024-09-04T16:30:05.905 INFO:tasks.workunit.client.1.smithi193.stdout:9/364: unlink d2/d18/d2f/c50 0 2024-09-04T16:30:05.917 INFO:tasks.workunit.client.1.smithi193.stdout:8/314: dwrite d2/d20/d23/f16 [0,4194304] 0 2024-09-04T16:30:05.918 INFO:tasks.workunit.client.1.smithi193.stdout:2/278: rename d2/d9/db/d10/d38/f4b to d2/f5e 0 2024-09-04T16:30:05.919 INFO:tasks.workunit.client.1.smithi193.stdout:2/279: read d2/d9/db/d10/f25 [2822363,98520] 0 2024-09-04T16:30:05.921 INFO:tasks.workunit.client.1.smithi193.stdout:2/280: chown d2/d9/db/d10/d1e/d26/f49 277 1 2024-09-04T16:30:05.922 INFO:tasks.workunit.client.1.smithi193.stdout:5/312: rmdir d1/d29/d1e/d37/d3f/d4f 39 2024-09-04T16:30:05.924 INFO:tasks.workunit.client.1.smithi193.stdout:3/337: truncate d0/d18/d1c/d25/f42 2537786 0 2024-09-04T16:30:05.926 INFO:tasks.workunit.client.1.smithi193.stdout:7/402: creat d9/d39/f8b x:0 0 0 2024-09-04T16:30:05.927 INFO:tasks.workunit.client.1.smithi193.stdout:7/403: fsync d9/f19 0 2024-09-04T16:30:05.928 INFO:tasks.workunit.client.1.smithi193.stdout:1/354: symlink d1/d2b/d10/d2a/l71 0 2024-09-04T16:30:05.938 INFO:tasks.workunit.client.1.smithi193.stdout:3/338: dread d0/d9/fb [0,4194304] 0 2024-09-04T16:30:05.938 INFO:tasks.workunit.client.0.smithi170.stdout:3/42: sync 2024-09-04T16:30:05.938 INFO:tasks.workunit.client.0.smithi170.stdout:7/6: sync 2024-09-04T16:30:05.938 INFO:tasks.workunit.client.0.smithi170.stdout:0/43: sync 2024-09-04T16:30:05.939 INFO:tasks.workunit.client.0.smithi170.stdout:2/35: sync 2024-09-04T16:30:05.939 INFO:tasks.workunit.client.0.smithi170.stdout:7/7: truncate f1 992104 0 2024-09-04T16:30:05.942 INFO:tasks.workunit.client.1.smithi193.stdout:4/233: rename d3/l4d to d3/l4e 0 2024-09-04T16:30:05.944 INFO:tasks.workunit.client.1.smithi193.stdout:8/315: rename d2/d20/c22 to d2/d20/d23/d34/c6b 0 2024-09-04T16:30:05.945 INFO:tasks.workunit.client.0.smithi170.stdout:3/43: dwrite fb [0,4194304] 0 2024-09-04T16:30:05.945 INFO:tasks.workunit.client.0.smithi170.stdout:3/44: write f6 [435683,5586] 0 2024-09-04T16:30:05.946 INFO:tasks.workunit.client.1.smithi193.stdout:4/234: dwrite f0 [0,4194304] 0 2024-09-04T16:30:05.947 INFO:tasks.workunit.client.1.smithi193.stdout:2/281: unlink d2/d9/db/fd 0 2024-09-04T16:30:05.947 INFO:tasks.workunit.client.1.smithi193.stdout:2/282: stat d2/d9/db/c46 0 2024-09-04T16:30:05.955 INFO:tasks.workunit.client.0.smithi170.stdout:3/45: dwrite fa [0,4194304] 0 2024-09-04T16:30:05.963 INFO:tasks.workunit.client.1.smithi193.stdout:7/404: dwrite d9/d39/d3e/f7c [0,4194304] 0 2024-09-04T16:30:05.965 INFO:tasks.workunit.client.0.smithi170.stdout:3/46: dwrite fa [0,4194304] 0 2024-09-04T16:30:05.971 INFO:tasks.workunit.client.1.smithi193.stdout:9/365: write d2/d8/f4f [630335,22684] 0 2024-09-04T16:30:05.972 INFO:tasks.workunit.client.1.smithi193.stdout:3/339: chown d0/d9/l19 1038059 1 2024-09-04T16:30:05.981 INFO:tasks.workunit.client.1.smithi193.stdout:2/283: fsync d2/d9/db/d10/f25 0 2024-09-04T16:30:05.987 INFO:tasks.workunit.client.1.smithi193.stdout:1/355: mknod d1/d39/c72 0 2024-09-04T16:30:05.988 INFO:tasks.workunit.client.1.smithi193.stdout:1/356: read d1/d2b/d10/f19 [4129501,115291] 0 2024-09-04T16:30:05.988 INFO:tasks.workunit.client.1.smithi193.stdout:1/357: chown d1/d2b/d1b/d28/d50 64248445 1 2024-09-04T16:30:05.989 INFO:tasks.workunit.client.1.smithi193.stdout:6/265: getdents d5/d27/d3e 0 2024-09-04T16:30:05.990 INFO:tasks.workunit.client.1.smithi193.stdout:0/338: getdents d18/d25/d5f/d65 0 2024-09-04T16:30:05.990 INFO:tasks.workunit.client.1.smithi193.stdout:0/339: chown d18/d25/d32/f42 4804 1 2024-09-04T16:30:05.993 INFO:tasks.workunit.client.1.smithi193.stdout:3/340: symlink d0/d9/d49/l74 0 2024-09-04T16:30:05.995 INFO:tasks.workunit.client.1.smithi193.stdout:8/316: mkdir d2/d20/d23/d51/d59/d6c 0 2024-09-04T16:30:05.996 INFO:tasks.workunit.client.1.smithi193.stdout:4/235: mknod d3/d1a/c4f 0 2024-09-04T16:30:06.000 INFO:tasks.workunit.client.1.smithi193.stdout:2/284: creat d2/d9/db/d10/d38/f5f x:0 0 0 2024-09-04T16:30:06.001 INFO:tasks.workunit.client.1.smithi193.stdout:5/313: creat d1/f5b x:0 0 0 2024-09-04T16:30:06.001 INFO:tasks.workunit.client.0.smithi170.stdout:3/47: creat ff x:0 0 0 2024-09-04T16:30:06.001 INFO:tasks.workunit.client.1.smithi193.stdout:5/314: stat d1/l10 0 2024-09-04T16:30:06.002 INFO:tasks.workunit.client.1.smithi193.stdout:7/405: symlink d9/d18/l8c 0 2024-09-04T16:30:06.002 INFO:tasks.workunit.client.1.smithi193.stdout:7/406: readlink d9/d18/d1e/l6d 0 2024-09-04T16:30:06.003 INFO:tasks.workunit.client.1.smithi193.stdout:0/340: dread d18/f21 [0,4194304] 0 2024-09-04T16:30:06.003 INFO:tasks.workunit.client.0.smithi170.stdout:8/3: creat f0 x:0 0 0 2024-09-04T16:30:06.003 INFO:tasks.workunit.client.1.smithi193.stdout:0/341: dread - d18/d25/d5f/d65/f6f zero size 2024-09-04T16:30:06.003 INFO:tasks.workunit.client.0.smithi170.stdout:1/125: sync 2024-09-04T16:30:06.004 INFO:tasks.workunit.client.0.smithi170.stdout:4/119: sync 2024-09-04T16:30:06.004 INFO:tasks.workunit.client.0.smithi170.stdout:6/82: sync 2024-09-04T16:30:06.004 INFO:tasks.workunit.client.0.smithi170.stdout:5/39: sync 2024-09-04T16:30:06.004 INFO:tasks.workunit.client.0.smithi170.stdout:9/112: sync 2024-09-04T16:30:06.004 INFO:tasks.workunit.client.1.smithi193.stdout:0/342: chown d18/f48 3663 1 2024-09-04T16:30:06.004 INFO:tasks.workunit.client.0.smithi170.stdout:5/40: chown d4/d8 11 1 2024-09-04T16:30:06.005 INFO:tasks.workunit.client.1.smithi193.stdout:1/358: unlink d1/d2b/f14 0 2024-09-04T16:30:06.005 INFO:tasks.workunit.client.0.smithi170.stdout:9/113: write d2/fd [2258216,84048] 0 2024-09-04T16:30:06.006 INFO:tasks.workunit.client.0.smithi170.stdout:6/83: write d0/df/f10 [807036,64134] 0 2024-09-04T16:30:06.007 INFO:tasks.workunit.client.0.smithi170.stdout:9/114: chown d2/d7 1 1 2024-09-04T16:30:06.011 INFO:tasks.workunit.client.1.smithi193.stdout:6/266: rename d5/de/d15/f37 to d5/de/d15/d1b/f53 0 2024-09-04T16:30:06.012 INFO:tasks.workunit.client.1.smithi193.stdout:9/366: symlink d2/l74 0 2024-09-04T16:30:06.014 INFO:tasks.workunit.client.0.smithi170.stdout:5/41: dread d4/db/fc [0,4194304] 0 2024-09-04T16:30:06.015 INFO:tasks.workunit.client.0.smithi170.stdout:4/120: dwrite d1/fc [0,4194304] 0 2024-09-04T16:30:06.016 INFO:tasks.workunit.client.0.smithi170.stdout:5/42: chown d4/db 5841120 1 2024-09-04T16:30:06.017 INFO:tasks.workunit.client.0.smithi170.stdout:3/48: unlink f6 0 2024-09-04T16:30:06.017 INFO:tasks.workunit.client.0.smithi170.stdout:5/43: fdatasync f1 0 2024-09-04T16:30:06.020 INFO:tasks.workunit.client.0.smithi170.stdout:8/4: symlink l1 0 2024-09-04T16:30:06.020 INFO:tasks.workunit.client.0.smithi170.stdout:9/115: dwrite d2/d7/f1a [0,4194304] 0 2024-09-04T16:30:06.021 INFO:tasks.workunit.client.0.smithi170.stdout:8/5: dread - f0 zero size 2024-09-04T16:30:06.023 INFO:tasks.workunit.client.1.smithi193.stdout:4/236: dwrite d3/d1a/d21/f3e [0,4194304] 0 2024-09-04T16:30:06.023 INFO:tasks.workunit.client.0.smithi170.stdout:8/6: dread - f0 zero size 2024-09-04T16:30:06.023 INFO:tasks.workunit.client.1.smithi193.stdout:4/237: stat d3/d3c 0 2024-09-04T16:30:06.027 INFO:tasks.workunit.client.0.smithi170.stdout:2/36: truncate d3/d4/fa 2173142 0 2024-09-04T16:30:06.027 INFO:tasks.workunit.client.0.smithi170.stdout:8/7: truncate f0 1045704 0 2024-09-04T16:30:06.029 INFO:tasks.workunit.client.0.smithi170.stdout:4/121: dwrite d1/fc [0,4194304] 0 2024-09-04T16:30:06.032 INFO:tasks.workunit.client.1.smithi193.stdout:1/359: rename d1/d2b/d1b/d28/d50/c64 to d1/d2b/d1b/d28/d50/c73 0 2024-09-04T16:30:06.036 INFO:tasks.workunit.client.1.smithi193.stdout:6/267: unlink d5/de/c2d 0 2024-09-04T16:30:06.036 INFO:tasks.workunit.client.0.smithi170.stdout:7/8: link l0 l2 0 2024-09-04T16:30:06.042 INFO:tasks.workunit.client.1.smithi193.stdout:8/317: link d2/d20/d23/f1d d2/d20/d23/d51/d59/f6d 0 2024-09-04T16:30:06.042 INFO:tasks.workunit.client.1.smithi193.stdout:8/318: chown d2/d20/f2d 4418808 1 2024-09-04T16:30:06.043 INFO:tasks.workunit.client.1.smithi193.stdout:8/319: write d2/d12/f43 [6522806,2583] 0 2024-09-04T16:30:06.044 INFO:tasks.workunit.client.1.smithi193.stdout:2/285: mknod d2/d9/db/d10/d1f/c60 0 2024-09-04T16:30:06.044 INFO:tasks.workunit.client.0.smithi170.stdout:7/9: dwrite f1 [0,4194304] 0 2024-09-04T16:30:06.046 INFO:tasks.workunit.client.0.smithi170.stdout:3/49: creat f10 x:0 0 0 2024-09-04T16:30:06.048 INFO:tasks.workunit.client.1.smithi193.stdout:7/407: fsync d9/de/d27/f3d 0 2024-09-04T16:30:06.049 INFO:tasks.workunit.client.1.smithi193.stdout:7/408: readlink d9/d18/l8c 0 2024-09-04T16:30:06.049 INFO:tasks.workunit.client.0.smithi170.stdout:1/126: write d9/d11/f14 [968965,25684] 0 2024-09-04T16:30:06.051 INFO:tasks.workunit.client.0.smithi170.stdout:5/44: creat d4/ff x:0 0 0 2024-09-04T16:30:06.051 INFO:tasks.workunit.client.0.smithi170.stdout:5/45: chown d4/d8 16352005 1 2024-09-04T16:30:06.053 INFO:tasks.workunit.client.1.smithi193.stdout:0/343: link d18/f38 d18/d25/d3b/f75 0 2024-09-04T16:30:06.055 INFO:tasks.workunit.client.0.smithi170.stdout:9/116: creat d2/d7/f1f x:0 0 0 2024-09-04T16:30:06.055 INFO:tasks.workunit.client.0.smithi170.stdout:3/50: dwrite f10 [0,4194304] 0 2024-09-04T16:30:06.056 INFO:tasks.workunit.client.1.smithi193.stdout:1/360: symlink d1/d2b/d10/d56/l74 0 2024-09-04T16:30:06.057 INFO:tasks.workunit.client.0.smithi170.stdout:9/117: truncate d2/d7/f1f 902567 0 2024-09-04T16:30:06.058 INFO:tasks.workunit.client.0.smithi170.stdout:2/37: mkdir d3/db 0 2024-09-04T16:30:06.058 INFO:tasks.workunit.client.0.smithi170.stdout:2/38: write f0 [1682880,11417] 0 2024-09-04T16:30:06.061 INFO:tasks.workunit.client.0.smithi170.stdout:4/122: rmdir d1/d26 39 2024-09-04T16:30:06.063 INFO:tasks.workunit.client.0.smithi170.stdout:2/39: dread f2 [0,4194304] 0 2024-09-04T16:30:06.064 INFO:tasks.workunit.client.1.smithi193.stdout:9/367: creat d2/d56/f75 x:0 0 0 2024-09-04T16:30:06.065 INFO:tasks.workunit.client.1.smithi193.stdout:9/368: readlink d2/d8/l10 0 2024-09-04T16:30:06.067 INFO:tasks.workunit.client.0.smithi170.stdout:0/44: getdents d11 0 2024-09-04T16:30:06.068 INFO:tasks.workunit.client.0.smithi170.stdout:0/45: truncate fb 694735 0 2024-09-04T16:30:06.069 INFO:tasks.workunit.client.1.smithi193.stdout:6/268: dwrite d5/fb [0,4194304] 0 2024-09-04T16:30:06.069 INFO:tasks.workunit.client.0.smithi170.stdout:0/46: stat c8 0 2024-09-04T16:30:06.069 INFO:tasks.workunit.client.0.smithi170.stdout:6/84: symlink d0/df/d1b/l1e 0 2024-09-04T16:30:06.069 INFO:tasks.workunit.client.0.smithi170.stdout:0/47: fsync ff 0 2024-09-04T16:30:06.070 INFO:tasks.workunit.client.0.smithi170.stdout:7/10: mknod c3 0 2024-09-04T16:30:06.072 INFO:tasks.workunit.client.1.smithi193.stdout:5/315: rename d1/c17 to d1/d29/d18/c5c 0 2024-09-04T16:30:06.072 INFO:tasks.workunit.client.1.smithi193.stdout:8/320: rename d2 to d2/d20/d23/d24/d3c/d65/d67/d6e 22 2024-09-04T16:30:06.072 INFO:tasks.workunit.client.0.smithi170.stdout:1/127: mknod d9/d11/c29 0 2024-09-04T16:30:06.073 INFO:tasks.workunit.client.0.smithi170.stdout:1/128: chown d9/d11/c25 450 1 2024-09-04T16:30:06.073 INFO:tasks.workunit.client.1.smithi193.stdout:9/369: creat d2/d56/f76 x:0 0 0 2024-09-04T16:30:06.074 INFO:tasks.workunit.client.1.smithi193.stdout:9/370: chown d2/d8/d25 2 1 2024-09-04T16:30:06.075 INFO:tasks.workunit.client.1.smithi193.stdout:9/371: write d2/d8/f55 [1284349,31920] 0 2024-09-04T16:30:06.078 INFO:tasks.workunit.client.0.smithi170.stdout:5/46: symlink d4/l10 0 2024-09-04T16:30:06.078 INFO:tasks.workunit.client.1.smithi193.stdout:5/316: dwrite d1/d29/d1e/d37/d3f/f5a [0,4194304] 0 2024-09-04T16:30:06.079 INFO:tasks.workunit.client.0.smithi170.stdout:3/51: symlink l11 0 2024-09-04T16:30:06.079 INFO:tasks.workunit.client.0.smithi170.stdout:9/118: creat d2/d7/f20 x:0 0 0 2024-09-04T16:30:06.080 INFO:tasks.workunit.client.1.smithi193.stdout:0/344: symlink d18/l76 0 2024-09-04T16:30:06.086 INFO:tasks.workunit.client.0.smithi170.stdout:1/129: dwrite d9/f13 [0,4194304] 0 2024-09-04T16:30:06.089 INFO:tasks.workunit.client.1.smithi193.stdout:8/321: unlink d2/d20/d23/d24/d3c/d65/d67/f2f 0 2024-09-04T16:30:06.093 INFO:tasks.workunit.client.0.smithi170.stdout:6/85: mkdir d0/df/d1f 0 2024-09-04T16:30:06.096 INFO:tasks.workunit.client.0.smithi170.stdout:0/48: rename d11/f12 to d11/f16 0 2024-09-04T16:30:06.096 INFO:tasks.workunit.client.0.smithi170.stdout:0/49: chown f5 62 1 2024-09-04T16:30:06.098 INFO:tasks.workunit.client.0.smithi170.stdout:7/11: mknod c4 0 2024-09-04T16:30:06.098 INFO:tasks.workunit.client.0.smithi170.stdout:7/12: chown c3 3673437 1 2024-09-04T16:30:06.099 INFO:tasks.workunit.client.1.smithi193.stdout:5/317: mknod d1/d29/d1e/c5d 0 2024-09-04T16:30:06.101 INFO:tasks.workunit.client.0.smithi170.stdout:5/47: fsync d4/db/fc 0 2024-09-04T16:30:06.103 INFO:tasks.workunit.client.1.smithi193.stdout:6/269: link d5/f6 d5/d33/d4e/d51/f54 0 2024-09-04T16:30:06.104 INFO:tasks.workunit.client.0.smithi170.stdout:3/52: rename fe to f12 0 2024-09-04T16:30:06.105 INFO:tasks.workunit.client.0.smithi170.stdout:3/53: write fa [4515244,107691] 0 2024-09-04T16:30:06.108 INFO:tasks.workunit.client.0.smithi170.stdout:4/123: chown d1/d6/d8/f21 0 1 2024-09-04T16:30:06.110 INFO:tasks.workunit.client.0.smithi170.stdout:1/130: mkdir d9/d26/d2a 0 2024-09-04T16:30:06.111 INFO:tasks.workunit.client.1.smithi193.stdout:1/361: dwrite d1/d2b/f2e [0,4194304] 0 2024-09-04T16:30:06.112 INFO:tasks.workunit.client.0.smithi170.stdout:4/124: dread d1/d6/d8/f9 [0,4194304] 0 2024-09-04T16:30:06.112 INFO:tasks.workunit.client.0.smithi170.stdout:8/8: link l1 l2 0 2024-09-04T16:30:06.113 INFO:tasks.workunit.client.1.smithi193.stdout:1/362: truncate d1/d2b/d1b/d28/f35 4977971 0 2024-09-04T16:30:06.113 INFO:tasks.workunit.client.0.smithi170.stdout:8/9: truncate f0 1837312 0 2024-09-04T16:30:06.113 INFO:tasks.workunit.client.0.smithi170.stdout:4/125: chown d1/d6/d8/c1f 17105 1 2024-09-04T16:30:06.113 INFO:tasks.workunit.client.1.smithi193.stdout:1/363: fsync d1/d2b/d1b/d28/f35 0 2024-09-04T16:30:06.116 INFO:tasks.workunit.client.1.smithi193.stdout:2/286: truncate d2/f7 7770713 0 2024-09-04T16:30:06.117 INFO:tasks.workunit.client.1.smithi193.stdout:9/372: rmdir d2/d8/d15/d70 0 2024-09-04T16:30:06.120 INFO:tasks.workunit.client.0.smithi170.stdout:0/50: mkdir d11/d17 0 2024-09-04T16:30:06.121 INFO:tasks.workunit.client.0.smithi170.stdout:7/13: creat f5 x:0 0 0 2024-09-04T16:30:06.121 INFO:tasks.workunit.client.0.smithi170.stdout:7/14: rmdir - no directory 2024-09-04T16:30:06.121 INFO:tasks.workunit.client.0.smithi170.stdout:7/15: fdatasync f5 0 2024-09-04T16:30:06.122 INFO:tasks.workunit.client.1.smithi193.stdout:3/341: sync 2024-09-04T16:30:06.122 INFO:tasks.workunit.client.1.smithi193.stdout:0/345: rename d18/f3a to d18/d25/f77 0 2024-09-04T16:30:06.123 INFO:tasks.workunit.client.1.smithi193.stdout:9/373: dwrite d2/d8/d15/f34 [0,4194304] 0 2024-09-04T16:30:06.125 INFO:tasks.workunit.client.0.smithi170.stdout:5/48: write f1 [2093536,12712] 0 2024-09-04T16:30:06.126 INFO:tasks.workunit.client.1.smithi193.stdout:1/364: creat d1/d2b/d1b/d28/f75 x:0 0 0 2024-09-04T16:30:06.132 INFO:tasks.workunit.client.0.smithi170.stdout:9/119: symlink d2/l21 0 2024-09-04T16:30:06.133 INFO:tasks.workunit.client.0.smithi170.stdout:9/120: readlink d2/d7/l16 0 2024-09-04T16:30:06.133 INFO:tasks.workunit.client.0.smithi170.stdout:2/40: dwrite d3/d4/fa [0,4194304] 0 2024-09-04T16:30:06.133 INFO:tasks.workunit.client.0.smithi170.stdout:9/121: fdatasync d2/f13 0 2024-09-04T16:30:06.134 INFO:tasks.workunit.client.0.smithi170.stdout:2/41: rename d3/d4 to d3/d4/dc 22 2024-09-04T16:30:06.134 INFO:tasks.workunit.client.0.smithi170.stdout:9/122: read - d2/d7/f8 zero size 2024-09-04T16:30:06.135 INFO:tasks.workunit.client.0.smithi170.stdout:3/54: mkdir d13 0 2024-09-04T16:30:06.137 INFO:tasks.workunit.client.1.smithi193.stdout:5/318: creat d1/d29/d18/f5e x:0 0 0 2024-09-04T16:30:06.140 INFO:tasks.workunit.client.1.smithi193.stdout:3/342: mknod d0/d18/d1c/d30/c75 0 2024-09-04T16:30:06.140 INFO:tasks.workunit.client.0.smithi170.stdout:3/55: dread fa [4194304,4194304] 0 2024-09-04T16:30:06.141 INFO:tasks.workunit.client.1.smithi193.stdout:3/343: readlink d0/d10/l5d 0 2024-09-04T16:30:06.143 INFO:tasks.workunit.client.0.smithi170.stdout:1/131: creat d9/f2b x:0 0 0 2024-09-04T16:30:06.143 INFO:tasks.workunit.client.0.smithi170.stdout:3/56: write fb [204549,71911] 0 2024-09-04T16:30:06.144 INFO:tasks.workunit.client.1.smithi193.stdout:0/346: rename f1 to d18/d25/d32/d57/f78 0 2024-09-04T16:30:06.145 INFO:tasks.workunit.client.0.smithi170.stdout:8/10: mknod c3 0 2024-09-04T16:30:06.146 INFO:tasks.workunit.client.0.smithi170.stdout:9/123: dwrite d2/d7/f20 [0,4194304] 0 2024-09-04T16:30:06.146 INFO:tasks.workunit.client.0.smithi170.stdout:1/132: truncate d9/f27 827064 0 2024-09-04T16:30:06.147 INFO:tasks.workunit.client.1.smithi193.stdout:9/374: symlink d2/d18/d2f/d22/l77 0 2024-09-04T16:30:06.147 INFO:tasks.workunit.client.1.smithi193.stdout:3/344: dwrite d0/d18/d1c/d51/f72 [0,4194304] 0 2024-09-04T16:30:06.148 INFO:tasks.workunit.client.0.smithi170.stdout:9/124: readlink d2/d7/l16 0 2024-09-04T16:30:06.148 INFO:tasks.workunit.client.0.smithi170.stdout:8/11: write f0 [2856283,106339] 0 2024-09-04T16:30:06.148 INFO:tasks.workunit.client.1.smithi193.stdout:9/375: write d2/f42 [1597750,89321] 0 2024-09-04T16:30:06.149 INFO:tasks.workunit.client.1.smithi193.stdout:3/345: write d0/f66 [1289405,108574] 0 2024-09-04T16:30:06.149 INFO:tasks.workunit.client.1.smithi193.stdout:1/365: symlink d1/d2b/d10/d2a/l76 0 2024-09-04T16:30:06.150 INFO:tasks.workunit.client.0.smithi170.stdout:4/126: mkdir d1/d6/d2b 0 2024-09-04T16:30:06.151 INFO:tasks.workunit.client.0.smithi170.stdout:6/86: symlink d0/df/d1f/l20 0 2024-09-04T16:30:06.152 INFO:tasks.workunit.client.1.smithi193.stdout:2/287: unlink d2/d14/l54 0 2024-09-04T16:30:06.153 INFO:tasks.workunit.client.0.smithi170.stdout:9/125: chown d2/d7/c19 19053 1 2024-09-04T16:30:06.155 INFO:tasks.workunit.client.1.smithi193.stdout:5/319: dread d1/d8/f12 [0,4194304] 0 2024-09-04T16:30:06.156 INFO:tasks.workunit.client.0.smithi170.stdout:7/16: mknod c6 0 2024-09-04T16:30:06.156 INFO:tasks.workunit.client.1.smithi193.stdout:5/320: chown d1/d29/d1e 599064 1 2024-09-04T16:30:06.157 INFO:tasks.workunit.client.0.smithi170.stdout:7/17: fsync f5 0 2024-09-04T16:30:06.158 INFO:tasks.workunit.client.1.smithi193.stdout:4/238: sync 2024-09-04T16:30:06.159 INFO:tasks.workunit.client.0.smithi170.stdout:5/49: symlink d4/d8/l11 0 2024-09-04T16:30:06.159 INFO:tasks.workunit.client.1.smithi193.stdout:4/239: readlink d3/d1a/d2a/l2b 0 2024-09-04T16:30:06.159 INFO:tasks.workunit.client.0.smithi170.stdout:3/57: dwrite ff [0,4194304] 0 2024-09-04T16:30:06.160 INFO:tasks.workunit.client.0.smithi170.stdout:2/42: rmdir d3 39 2024-09-04T16:30:06.165 INFO:tasks.workunit.client.0.smithi170.stdout:8/12: dwrite f0 [0,4194304] 0 2024-09-04T16:30:06.166 INFO:tasks.workunit.client.1.smithi193.stdout:6/270: getdents d5/d27/d3e 0 2024-09-04T16:30:06.167 INFO:tasks.workunit.client.1.smithi193.stdout:6/271: fdatasync d5/f3f 0 2024-09-04T16:30:06.169 INFO:tasks.workunit.client.1.smithi193.stdout:6/272: read d5/f3f [598320,98069] 0 2024-09-04T16:30:06.169 INFO:tasks.workunit.client.1.smithi193.stdout:9/376: rmdir d2/d4 39 2024-09-04T16:30:06.170 INFO:tasks.workunit.client.1.smithi193.stdout:9/377: write d2/d8/d15/f62 [1023216,120171] 0 2024-09-04T16:30:06.171 INFO:tasks.workunit.client.1.smithi193.stdout:3/346: fsync d0/d10/f1a 0 2024-09-04T16:30:06.171 INFO:tasks.workunit.client.1.smithi193.stdout:9/378: fdatasync d2/f3d 0 2024-09-04T16:30:06.172 INFO:tasks.workunit.client.0.smithi170.stdout:1/133: symlink d9/d11/l2c 0 2024-09-04T16:30:06.173 INFO:tasks.workunit.client.1.smithi193.stdout:9/379: write d2/d8/d15/f31 [1567886,85608] 0 2024-09-04T16:30:06.174 INFO:tasks.workunit.client.1.smithi193.stdout:1/366: creat d1/d2b/d1b/d28/f77 x:0 0 0 2024-09-04T16:30:06.175 INFO:tasks.workunit.client.1.smithi193.stdout:1/367: readlink d1/l58 0 2024-09-04T16:30:06.177 INFO:tasks.workunit.client.1.smithi193.stdout:2/288: mkdir d2/d9/d61 0 2024-09-04T16:30:06.177 INFO:tasks.workunit.client.1.smithi193.stdout:2/289: readlink d2/l2f 0 2024-09-04T16:30:06.180 INFO:tasks.workunit.client.1.smithi193.stdout:5/321: stat d1/d29/d1e/d37/d3f/d4f/d3e/f41 0 2024-09-04T16:30:06.181 INFO:tasks.workunit.client.1.smithi193.stdout:4/240: symlink d3/d3c/d47/l50 0 2024-09-04T16:30:06.182 INFO:tasks.workunit.client.0.smithi170.stdout:6/87: rmdir d0/df 39 2024-09-04T16:30:06.183 INFO:tasks.workunit.client.1.smithi193.stdout:0/347: mkdir d18/d79 0 2024-09-04T16:30:06.183 INFO:tasks.workunit.client.1.smithi193.stdout:4/241: read d3/d1a/d21/f2c [993093,121595] 0 2024-09-04T16:30:06.185 INFO:tasks.workunit.client.0.smithi170.stdout:9/126: creat d2/d11/f22 x:0 0 0 2024-09-04T16:30:06.185 INFO:tasks.workunit.client.0.smithi170.stdout:9/127: chown d2 210216184 1 2024-09-04T16:30:06.186 INFO:tasks.workunit.client.1.smithi193.stdout:5/322: dwrite d1/d29/d18/f5e [0,4194304] 0 2024-09-04T16:30:06.186 INFO:tasks.workunit.client.0.smithi170.stdout:9/128: write d2/d7/f8 [627996,103560] 0 2024-09-04T16:30:06.187 INFO:tasks.workunit.client.0.smithi170.stdout:7/18: readlink l0 0 2024-09-04T16:30:06.187 INFO:tasks.workunit.client.0.smithi170.stdout:7/19: stat c3 0 2024-09-04T16:30:06.188 INFO:tasks.workunit.client.1.smithi193.stdout:6/273: rename d5/c3b to d5/d27/c55 0 2024-09-04T16:30:06.189 INFO:tasks.workunit.client.0.smithi170.stdout:5/50: mknod d4/d8/c12 0 2024-09-04T16:30:06.193 INFO:tasks.workunit.client.0.smithi170.stdout:3/58: stat c9 0 2024-09-04T16:30:06.194 INFO:tasks.workunit.client.0.smithi170.stdout:3/59: dread - f12 zero size 2024-09-04T16:30:06.198 INFO:tasks.workunit.client.0.smithi170.stdout:8/13: symlink l4 0 2024-09-04T16:30:06.198 INFO:tasks.workunit.client.0.smithi170.stdout:2/43: truncate d3/d4/f6 684640 0 2024-09-04T16:30:06.199 INFO:tasks.workunit.client.0.smithi170.stdout:5/51: dwrite f1 [4194304,4194304] 0 2024-09-04T16:30:06.200 INFO:tasks.workunit.client.1.smithi193.stdout:1/368: dread d1/d2b/d1b/f4c [0,4194304] 0 2024-09-04T16:30:06.201 INFO:tasks.workunit.client.1.smithi193.stdout:4/242: chown d3/c48 1124773 1 2024-09-04T16:30:06.202 INFO:tasks.workunit.client.0.smithi170.stdout:4/127: mknod d1/c2c 0 2024-09-04T16:30:06.205 INFO:tasks.workunit.client.0.smithi170.stdout:0/51: rmdir d11/d17 0 2024-09-04T16:30:06.205 INFO:tasks.workunit.client.1.smithi193.stdout:6/274: dread d5/d27/f35 [0,4194304] 0 2024-09-04T16:30:06.205 INFO:tasks.workunit.client.0.smithi170.stdout:0/52: read - f6 zero size 2024-09-04T16:30:06.206 INFO:tasks.workunit.client.0.smithi170.stdout:0/53: chown d11/d13 47768 1 2024-09-04T16:30:06.206 INFO:tasks.workunit.client.0.smithi170.stdout:0/54: write f3 [2061854,109442] 0 2024-09-04T16:30:06.207 INFO:tasks.workunit.client.1.smithi193.stdout:5/323: unlink d1/f3 0 2024-09-04T16:30:06.210 INFO:tasks.workunit.client.1.smithi193.stdout:3/347: rename d0/d18/d1b/f3c to d0/d18/d1c/d30/f76 0 2024-09-04T16:30:06.210 INFO:tasks.workunit.client.0.smithi170.stdout:9/129: mkdir d2/d11/d23 0 2024-09-04T16:30:06.211 INFO:tasks.workunit.client.1.smithi193.stdout:9/380: rename d2/d18/d2f/d22 to d2/d18/d2f/d22/d6c/d78 22 2024-09-04T16:30:06.213 INFO:tasks.workunit.client.0.smithi170.stdout:7/20: creat f7 x:0 0 0 2024-09-04T16:30:06.215 INFO:tasks.workunit.client.1.smithi193.stdout:0/348: mknod d18/c7a 0 2024-09-04T16:30:06.217 INFO:tasks.workunit.client.0.smithi170.stdout:8/14: symlink l5 0 2024-09-04T16:30:06.217 INFO:tasks.workunit.client.0.smithi170.stdout:8/15: stat f0 0 2024-09-04T16:30:06.217 INFO:tasks.workunit.client.1.smithi193.stdout:4/243: mknod d3/d3c/d47/c51 0 2024-09-04T16:30:06.218 INFO:tasks.workunit.client.0.smithi170.stdout:8/16: write f0 [1784238,56110] 0 2024-09-04T16:30:06.218 INFO:tasks.workunit.client.0.smithi170.stdout:8/17: rmdir - no directory 2024-09-04T16:30:06.218 INFO:tasks.workunit.client.0.smithi170.stdout:8/18: rmdir - no directory 2024-09-04T16:30:06.219 INFO:tasks.workunit.client.0.smithi170.stdout:2/44: symlink d3/ld 0 2024-09-04T16:30:06.219 INFO:tasks.workunit.client.0.smithi170.stdout:8/19: write f0 [1536880,86463] 0 2024-09-04T16:30:06.220 INFO:tasks.workunit.client.0.smithi170.stdout:2/45: dread - d3/d4/f9 zero size 2024-09-04T16:30:06.221 INFO:tasks.workunit.client.1.smithi193.stdout:1/369: creat d1/d2b/d1b/d51/d6d/f78 x:0 0 0 2024-09-04T16:30:06.222 INFO:tasks.workunit.client.0.smithi170.stdout:4/128: write d1/d6/d8/d20/f25 [2050393,14216] 0 2024-09-04T16:30:06.222 INFO:tasks.workunit.client.1.smithi193.stdout:0/349: mkdir d18/d25/d5f/d6a/d7b 0 2024-09-04T16:30:06.222 INFO:tasks.workunit.client.0.smithi170.stdout:0/55: fsync d11/f16 0 2024-09-04T16:30:06.223 INFO:tasks.workunit.client.1.smithi193.stdout:1/370: write d1/d39/f67 [482966,92226] 0 2024-09-04T16:30:06.223 INFO:tasks.workunit.client.0.smithi170.stdout:0/56: fdatasync f0 0 2024-09-04T16:30:06.223 INFO:tasks.workunit.client.1.smithi193.stdout:4/244: mkdir d3/d1a/d21/d52 0 2024-09-04T16:30:06.223 INFO:tasks.workunit.client.1.smithi193.stdout:5/324: dread d1/d29/d1e/d37/d3f/d4f/d3e/f41 [0,4194304] 0 2024-09-04T16:30:06.224 INFO:tasks.workunit.client.1.smithi193.stdout:3/348: fdatasync d0/d7/f6b 0 2024-09-04T16:30:06.229 INFO:tasks.workunit.client.1.smithi193.stdout:1/371: truncate d1/d2b/d1b/d51/d6d/f78 844330 0 2024-09-04T16:30:06.229 INFO:tasks.workunit.client.1.smithi193.stdout:9/381: read d2/d4/f5 [3988566,54536] 0 2024-09-04T16:30:06.229 INFO:tasks.workunit.client.0.smithi170.stdout:7/21: rename c4 to c8 0 2024-09-04T16:30:06.229 INFO:tasks.workunit.client.0.smithi170.stdout:7/22: truncate f7 252534 0 2024-09-04T16:30:06.229 INFO:tasks.workunit.client.0.smithi170.stdout:3/60: mkdir d13/d14 0 2024-09-04T16:30:06.230 INFO:tasks.workunit.client.1.smithi193.stdout:0/350: dread d18/d25/f77 [0,4194304] 0 2024-09-04T16:30:06.233 INFO:tasks.workunit.client.1.smithi193.stdout:4/245: creat d3/d3c/f53 x:0 0 0 2024-09-04T16:30:06.233 INFO:tasks.workunit.client.1.smithi193.stdout:4/246: chown d3/d3c/d47 7 1 2024-09-04T16:30:06.234 INFO:tasks.workunit.client.1.smithi193.stdout:4/247: write d3/fe [264957,90879] 0 2024-09-04T16:30:06.234 INFO:tasks.workunit.client.1.smithi193.stdout:4/248: write d3/fa [2239697,48604] 0 2024-09-04T16:30:06.235 INFO:tasks.workunit.client.1.smithi193.stdout:4/249: dread - d3/d1a/d2a/f40 zero size 2024-09-04T16:30:06.236 INFO:tasks.workunit.client.1.smithi193.stdout:3/349: rename d0/d7/de/f2a to d0/d18/d1c/d51/d5a/f77 0 2024-09-04T16:30:06.237 INFO:tasks.workunit.client.0.smithi170.stdout:8/20: mkdir d6 0 2024-09-04T16:30:06.238 INFO:tasks.workunit.client.1.smithi193.stdout:3/350: stat d0/d18/d1c/d51/d6c 0 2024-09-04T16:30:06.238 INFO:tasks.workunit.client.1.smithi193.stdout:1/372: symlink d1/d39/d48/l79 0 2024-09-04T16:30:06.239 INFO:tasks.workunit.client.1.smithi193.stdout:3/351: write d0/d7/de/f44 [725037,22233] 0 2024-09-04T16:30:06.240 INFO:tasks.workunit.client.1.smithi193.stdout:9/382: creat d2/d18/d2f/d22/d30/d6a/f79 x:0 0 0 2024-09-04T16:30:06.241 INFO:tasks.workunit.client.1.smithi193.stdout:3/352: dread d0/d9/f58 [0,4194304] 0 2024-09-04T16:30:06.242 INFO:tasks.workunit.client.1.smithi193.stdout:4/250: dwrite d3/f36 [0,4194304] 0 2024-09-04T16:30:06.242 INFO:tasks.workunit.client.1.smithi193.stdout:2/290: creat d2/d9/db/d10/d1f/f62 x:0 0 0 2024-09-04T16:30:06.244 INFO:tasks.workunit.client.0.smithi170.stdout:2/46: dread f2 [4194304,4194304] 0 2024-09-04T16:30:06.244 INFO:tasks.workunit.client.1.smithi193.stdout:4/251: dread d3/f16 [0,4194304] 0 2024-09-04T16:30:06.245 INFO:tasks.workunit.client.1.smithi193.stdout:4/252: stat d3/f30 0 2024-09-04T16:30:06.247 INFO:tasks.workunit.client.1.smithi193.stdout:0/351: readlink d18/d25/l2b 0 2024-09-04T16:30:06.248 INFO:tasks.workunit.client.0.smithi170.stdout:4/129: write d1/f19 [250160,45458] 0 2024-09-04T16:30:06.248 INFO:tasks.workunit.client.0.smithi170.stdout:4/130: stat d1/d6/ff 0 2024-09-04T16:30:06.249 INFO:tasks.workunit.client.0.smithi170.stdout:4/131: chown d1/d6/d8/d20/l23 641182928 1 2024-09-04T16:30:06.254 INFO:tasks.workunit.client.0.smithi170.stdout:0/57: rename f6 to d11/f18 0 2024-09-04T16:30:06.254 INFO:tasks.workunit.client.0.smithi170.stdout:0/58: symlink d11/d13/l19 2 2024-09-04T16:30:06.254 INFO:tasks.workunit.client.0.smithi170.stdout:0/59: truncate fe 406367 0 2024-09-04T16:30:06.258 INFO:tasks.workunit.client.0.smithi170.stdout:7/23: mknod c9 0 2024-09-04T16:30:06.260 INFO:tasks.workunit.client.0.smithi170.stdout:3/61: unlink fa 0 2024-09-04T16:30:06.263 INFO:tasks.workunit.client.0.smithi170.stdout:1/134: getdents d9 0 2024-09-04T16:30:06.266 INFO:tasks.workunit.client.1.smithi193.stdout:7/409: sync 2024-09-04T16:30:06.266 INFO:tasks.workunit.client.1.smithi193.stdout:8/322: sync 2024-09-04T16:30:06.266 INFO:tasks.workunit.client.1.smithi193.stdout:9/383: creat d2/d18/d2f/d22/d30/d6a/f7a x:0 0 0 2024-09-04T16:30:06.267 INFO:tasks.workunit.client.0.smithi170.stdout:5/52: link d4/c9 d4/c13 0 2024-09-04T16:30:06.267 INFO:tasks.workunit.client.1.smithi193.stdout:7/410: fdatasync d9/d18/d22/d2b/d6c/d70/d79/f87 0 2024-09-04T16:30:06.268 INFO:tasks.workunit.client.0.smithi170.stdout:3/62: dwrite f10 [0,4194304] 0 2024-09-04T16:30:06.268 INFO:tasks.workunit.client.1.smithi193.stdout:7/411: dread d9/d18/d1e/f43 [0,4194304] 0 2024-09-04T16:30:06.270 INFO:tasks.workunit.client.1.smithi193.stdout:2/291: mkdir d2/d9/db/d10/d38/d63 0 2024-09-04T16:30:06.270 INFO:tasks.workunit.client.0.smithi170.stdout:4/132: write d1/fc [5163274,27429] 0 2024-09-04T16:30:06.270 INFO:tasks.workunit.client.0.smithi170.stdout:6/88: getdents d0/d15 0 2024-09-04T16:30:06.274 INFO:tasks.workunit.client.0.smithi170.stdout:9/130: dwrite d2/d11/f1d [0,4194304] 0 2024-09-04T16:30:06.275 INFO:tasks.workunit.client.0.smithi170.stdout:7/24: rename f5 to fa 0 2024-09-04T16:30:06.279 INFO:tasks.workunit.client.0.smithi170.stdout:8/21: mkdir d6/d7 0 2024-09-04T16:30:06.281 INFO:tasks.workunit.client.1.smithi193.stdout:1/373: truncate d1/d2b/f2e 904587 0 2024-09-04T16:30:06.281 INFO:tasks.workunit.client.1.smithi193.stdout:9/384: chown d2/d8/d4d/l5d 1717 1 2024-09-04T16:30:06.282 INFO:tasks.workunit.client.1.smithi193.stdout:9/385: readlink d2/d18/l21 0 2024-09-04T16:30:06.285 INFO:tasks.workunit.client.1.smithi193.stdout:4/253: mkdir d3/d1a/d54 0 2024-09-04T16:30:06.288 INFO:tasks.workunit.client.1.smithi193.stdout:4/254: truncate d3/d1a/f3d 168415 0 2024-09-04T16:30:06.289 INFO:tasks.workunit.client.1.smithi193.stdout:2/292: rename d2/d9/db/d10/d1e/d26/f49 to d2/d9/db/d10/d1f/d4a/f64 0 2024-09-04T16:30:06.289 INFO:tasks.workunit.client.1.smithi193.stdout:8/323: dwrite d2/d20/d23/f29 [0,4194304] 0 2024-09-04T16:30:06.290 INFO:tasks.workunit.client.1.smithi193.stdout:0/352: truncate f6 3931467 0 2024-09-04T16:30:06.290 INFO:tasks.workunit.client.1.smithi193.stdout:4/255: fdatasync d3/f36 0 2024-09-04T16:30:06.292 INFO:tasks.workunit.client.1.smithi193.stdout:2/293: fsync d2/d9/db/d10/d38/f5f 0 2024-09-04T16:30:06.293 INFO:tasks.workunit.client.1.smithi193.stdout:7/412: dwrite d9/d39/d3e/f68 [0,4194304] 0 2024-09-04T16:30:06.294 INFO:tasks.workunit.client.1.smithi193.stdout:1/374: creat d1/d2b/d1b/d51/d6d/f7a x:0 0 0 2024-09-04T16:30:06.304 INFO:tasks.workunit.client.1.smithi193.stdout:4/256: dwrite d3/d3c/f45 [0,4194304] 0 2024-09-04T16:30:06.305 INFO:tasks.workunit.client.1.smithi193.stdout:0/353: dwrite d18/d25/d32/f44 [0,4194304] 0 2024-09-04T16:30:06.306 INFO:tasks.workunit.client.1.smithi193.stdout:2/294: write d2/f5e [37280,43470] 0 2024-09-04T16:30:06.307 INFO:tasks.workunit.client.1.smithi193.stdout:0/354: dread - d18/d25/d32/f42 zero size 2024-09-04T16:30:06.307 INFO:tasks.workunit.client.1.smithi193.stdout:3/353: getdents d0 0 2024-09-04T16:30:06.311 INFO:tasks.workunit.client.1.smithi193.stdout:1/375: creat d1/d2b/d10/d2a/f7b x:0 0 0 2024-09-04T16:30:06.312 INFO:tasks.workunit.client.1.smithi193.stdout:7/413: creat d9/d18/d22/d2b/d6c/d70/f8d x:0 0 0 2024-09-04T16:30:06.312 INFO:tasks.workunit.client.1.smithi193.stdout:6/275: sync 2024-09-04T16:30:06.313 INFO:tasks.workunit.client.1.smithi193.stdout:1/376: dread d1/d2b/d1b/d51/d6d/f78 [0,4194304] 0 2024-09-04T16:30:06.317 INFO:tasks.workunit.client.0.smithi170.stdout:2/47: link f0 d3/fe 0 2024-09-04T16:30:06.318 INFO:tasks.workunit.client.0.smithi170.stdout:9/131: creat d2/d11/f24 x:0 0 0 2024-09-04T16:30:06.319 INFO:tasks.workunit.client.0.smithi170.stdout:7/25: symlink lb 0 2024-09-04T16:30:06.319 INFO:tasks.workunit.client.0.smithi170.stdout:1/135: truncate d9/f18 6793154 0 2024-09-04T16:30:06.320 INFO:tasks.workunit.client.0.smithi170.stdout:5/53: truncate d4/f6 849432 0 2024-09-04T16:30:06.320 INFO:tasks.workunit.client.1.smithi193.stdout:9/386: rename d2/d4/l4e to d2/d8/d15/l7b 0 2024-09-04T16:30:06.321 INFO:tasks.workunit.client.0.smithi170.stdout:7/26: write f1 [2346456,104171] 0 2024-09-04T16:30:06.321 INFO:tasks.workunit.client.0.smithi170.stdout:4/133: mknod d1/c2d 0 2024-09-04T16:30:06.322 INFO:tasks.workunit.client.1.smithi193.stdout:4/257: symlink d3/d39/l55 0 2024-09-04T16:30:06.323 INFO:tasks.workunit.client.1.smithi193.stdout:2/295: mkdir d2/d9/db/d65 0 2024-09-04T16:30:06.323 INFO:tasks.workunit.client.1.smithi193.stdout:4/258: dread - d3/d1a/d2a/f3f zero size 2024-09-04T16:30:06.327 INFO:tasks.workunit.client.1.smithi193.stdout:9/387: dwrite d2/d8/d15/f62 [0,4194304] 0 2024-09-04T16:30:06.327 INFO:tasks.workunit.client.1.smithi193.stdout:8/324: dread d2/d20/d23/d24/d3c/f45 [0,4194304] 0 2024-09-04T16:30:06.368 INFO:tasks.workunit.client.0.smithi170.stdout:0/60: rmdir d11/d14 0 2024-09-04T16:30:06.369 INFO:tasks.workunit.client.1.smithi193.stdout:0/355: read - d18/d25/f29 zero size 2024-09-04T16:30:06.369 INFO:tasks.workunit.client.0.smithi170.stdout:0/61: readlink l10 0 2024-09-04T16:30:06.369 INFO:tasks.workunit.client.0.smithi170.stdout:6/89: mkdir d0/df/d1f/d21 0 2024-09-04T16:30:06.371 INFO:tasks.workunit.client.0.smithi170.stdout:9/132: dwrite d2/d11/f24 [0,4194304] 0 2024-09-04T16:30:06.371 INFO:tasks.workunit.client.1.smithi193.stdout:3/354: unlink d0/d3b/f60 0 2024-09-04T16:30:06.373 INFO:tasks.workunit.client.0.smithi170.stdout:6/90: write d0/f14 [264149,124727] 0 2024-09-04T16:30:06.374 INFO:tasks.workunit.client.0.smithi170.stdout:1/136: dwrite d9/f27 [0,4194304] 0 2024-09-04T16:30:06.378 INFO:tasks.workunit.client.0.smithi170.stdout:2/48: mkdir d3/db/df 0 2024-09-04T16:30:06.381 INFO:tasks.workunit.client.0.smithi170.stdout:7/27: creat fc x:0 0 0 2024-09-04T16:30:06.381 INFO:tasks.workunit.client.0.smithi170.stdout:7/28: dread - fa zero size 2024-09-04T16:30:06.383 INFO:tasks.workunit.client.0.smithi170.stdout:4/134: chown d1/c7 222 1 2024-09-04T16:30:06.384 INFO:tasks.workunit.client.0.smithi170.stdout:5/54: rename d4/l10 to d4/d8/l14 0 2024-09-04T16:30:06.384 INFO:tasks.workunit.client.0.smithi170.stdout:5/55: chown d4 80068954 1 2024-09-04T16:30:06.389 INFO:tasks.workunit.client.1.smithi193.stdout:8/325: chown d2/d12/fe 846961 1 2024-09-04T16:30:06.389 INFO:tasks.workunit.client.1.smithi193.stdout:8/326: chown d2/d20/d23/d24/c61 101706601 1 2024-09-04T16:30:06.391 INFO:tasks.workunit.client.1.smithi193.stdout:9/388: chown d2/d18/d2f/d22/c43 61249518 1 2024-09-04T16:30:06.392 INFO:tasks.workunit.client.1.smithi193.stdout:0/356: truncate d18/d25/f77 1230516 0 2024-09-04T16:30:06.393 INFO:tasks.workunit.client.1.smithi193.stdout:0/357: truncate d18/f69 392713 0 2024-09-04T16:30:06.393 INFO:tasks.workunit.client.0.smithi170.stdout:1/137: rmdir d9 39 2024-09-04T16:30:06.396 INFO:tasks.workunit.client.0.smithi170.stdout:7/29: write fa [63912,74113] 0 2024-09-04T16:30:06.397 INFO:tasks.workunit.client.0.smithi170.stdout:7/30: fdatasync f7 0 2024-09-04T16:30:06.398 INFO:tasks.workunit.client.0.smithi170.stdout:7/31: write f1 [4910998,97282] 0 2024-09-04T16:30:06.399 INFO:tasks.workunit.client.0.smithi170.stdout:2/49: rename d3/d4/f9 to d3/db/df/f10 0 2024-09-04T16:30:06.400 INFO:tasks.workunit.client.1.smithi193.stdout:7/414: symlink d9/d18/d22/l8e 0 2024-09-04T16:30:06.401 INFO:tasks.workunit.client.0.smithi170.stdout:5/56: rename d4/c5 to d4/c15 0 2024-09-04T16:30:06.402 INFO:tasks.workunit.client.0.smithi170.stdout:5/57: chown d4/c13 497895321 1 2024-09-04T16:30:06.402 INFO:tasks.workunit.client.0.smithi170.stdout:0/62: getdents d11/d13 0 2024-09-04T16:30:06.405 INFO:tasks.workunit.client.0.smithi170.stdout:6/91: mknod d0/c22 0 2024-09-04T16:30:06.408 INFO:tasks.workunit.client.1.smithi193.stdout:8/327: mkdir d2/d20/d23/d34/d3e/d6f 0 2024-09-04T16:30:06.409 INFO:tasks.workunit.client.1.smithi193.stdout:9/389: mknod d2/d18/c7c 0 2024-09-04T16:30:06.410 INFO:tasks.workunit.client.0.smithi170.stdout:1/138: write d9/f15 [660120,1901] 0 2024-09-04T16:30:06.412 INFO:tasks.workunit.client.1.smithi193.stdout:0/358: chown l7 13 1 2024-09-04T16:30:06.412 INFO:tasks.workunit.client.0.smithi170.stdout:4/135: creat d1/d26/f2e x:0 0 0 2024-09-04T16:30:06.412 INFO:tasks.workunit.client.1.smithi193.stdout:0/359: stat d18/d25/d5f/d6a 0 2024-09-04T16:30:06.413 INFO:tasks.workunit.client.0.smithi170.stdout:1/139: chown d9/d26/d2a 797551510 1 2024-09-04T16:30:06.414 INFO:tasks.workunit.client.1.smithi193.stdout:8/328: dwrite d2/d20/d23/d24/d3c/d65/d67/f3a [0,4194304] 0 2024-09-04T16:30:06.415 INFO:tasks.workunit.client.0.smithi170.stdout:5/58: dwrite d4/db/fe [0,4194304] 0 2024-09-04T16:30:06.415 INFO:tasks.workunit.client.1.smithi193.stdout:8/329: fdatasync d2/d20/d23/d1b/f21 0 2024-09-04T16:30:06.416 INFO:tasks.workunit.client.1.smithi193.stdout:4/259: link d3/d1a/d21/c32 d3/d39/c56 0 2024-09-04T16:30:06.417 INFO:tasks.workunit.client.0.smithi170.stdout:7/32: mknod cd 0 2024-09-04T16:30:06.418 INFO:tasks.workunit.client.1.smithi193.stdout:5/325: sync 2024-09-04T16:30:06.418 INFO:tasks.workunit.client.0.smithi170.stdout:0/63: dwrite f9 [0,4194304] 0 2024-09-04T16:30:06.418 INFO:tasks.workunit.client.1.smithi193.stdout:2/296: rename d2/d9/db/d10/d4e/l57 to d2/d9/db/d10/d1f/l66 0 2024-09-04T16:30:06.419 INFO:tasks.workunit.client.1.smithi193.stdout:2/297: dread - d2/d9/db/d10/d1e/f5a zero size 2024-09-04T16:30:06.422 INFO:tasks.workunit.client.0.smithi170.stdout:4/136: write d1/d6/f12 [418573,73131] 0 2024-09-04T16:30:06.424 INFO:tasks.workunit.client.1.smithi193.stdout:2/298: dread d2/d14/f50 [0,4194304] 0 2024-09-04T16:30:06.424 INFO:tasks.workunit.client.0.smithi170.stdout:7/33: chown f7 544655 1 2024-09-04T16:30:06.428 INFO:tasks.workunit.client.1.smithi193.stdout:9/390: unlink d2/d18/d2f/d22/d30/d52/f57 0 2024-09-04T16:30:06.429 INFO:tasks.workunit.client.1.smithi193.stdout:9/391: write d2/d8/d61/f73 [204991,122725] 0 2024-09-04T16:30:06.429 INFO:tasks.workunit.client.0.smithi170.stdout:6/92: dwrite d0/d17/f18 [0,4194304] 0 2024-09-04T16:30:06.432 INFO:tasks.workunit.client.1.smithi193.stdout:3/355: link d0/d9/fb d0/d18/d1c/d25/f78 0 2024-09-04T16:30:06.433 INFO:tasks.workunit.client.1.smithi193.stdout:3/356: chown d0/d18/d1c/d51/d6c 6 1 2024-09-04T16:30:06.435 INFO:tasks.workunit.client.1.smithi193.stdout:6/276: sync 2024-09-04T16:30:06.436 INFO:tasks.workunit.client.1.smithi193.stdout:6/277: write d5/f26 [657527,104321] 0 2024-09-04T16:30:06.438 INFO:tasks.workunit.client.1.smithi193.stdout:6/278: truncate d5/de/d15/d48/f4b 772383 0 2024-09-04T16:30:06.439 INFO:tasks.workunit.client.1.smithi193.stdout:1/377: getdents d1/d2b/db/d54 0 2024-09-04T16:30:06.440 INFO:tasks.workunit.client.1.smithi193.stdout:1/378: chown d1/d2b/d10/d2a/l76 388 1 2024-09-04T16:30:06.442 INFO:tasks.workunit.client.0.smithi170.stdout:1/140: creat d9/d26/f2d x:0 0 0 2024-09-04T16:30:06.445 INFO:tasks.workunit.client.0.smithi170.stdout:7/34: symlink le 0 2024-09-04T16:30:06.446 INFO:tasks.workunit.client.1.smithi193.stdout:8/330: symlink d2/d20/d23/d24/l70 0 2024-09-04T16:30:06.447 INFO:tasks.workunit.client.0.smithi170.stdout:7/35: write f1 [3469957,33554] 0 2024-09-04T16:30:06.448 INFO:tasks.workunit.client.1.smithi193.stdout:8/331: chown d2/d20/f36 110449558 1 2024-09-04T16:30:06.448 INFO:tasks.workunit.client.1.smithi193.stdout:7/415: dwrite d9/de/f1c [0,4194304] 0 2024-09-04T16:30:06.449 INFO:tasks.workunit.client.0.smithi170.stdout:7/36: stat fc 0 2024-09-04T16:30:06.450 INFO:tasks.workunit.client.1.smithi193.stdout:8/332: fsync d2/d20/d23/d24/f49 0 2024-09-04T16:30:06.454 INFO:tasks.workunit.client.1.smithi193.stdout:0/360: write d18/d25/d3b/f75 [4588873,117389] 0 2024-09-04T16:30:06.455 INFO:tasks.workunit.client.0.smithi170.stdout:2/50: dwrite d3/fe [0,4194304] 0 2024-09-04T16:30:06.455 INFO:tasks.workunit.client.0.smithi170.stdout:2/51: stat f1 0 2024-09-04T16:30:06.456 INFO:tasks.workunit.client.1.smithi193.stdout:6/279: dread d5/de/f17 [0,4194304] 0 2024-09-04T16:30:06.456 INFO:tasks.workunit.client.0.smithi170.stdout:1/141: write d9/d11/f1a [93079,122295] 0 2024-09-04T16:30:06.456 INFO:tasks.workunit.client.0.smithi170.stdout:2/52: chown d3/d7 578330 1 2024-09-04T16:30:06.457 INFO:tasks.workunit.client.1.smithi193.stdout:2/299: mknod d2/d9/db/d10/d1f/d22/c67 0 2024-09-04T16:30:06.460 INFO:tasks.workunit.client.1.smithi193.stdout:9/392: symlink d2/d18/d66/l7d 0 2024-09-04T16:30:06.461 INFO:tasks.workunit.client.1.smithi193.stdout:4/260: write d3/d1a/d2a/f2d [3545347,17513] 0 2024-09-04T16:30:06.461 INFO:tasks.workunit.client.1.smithi193.stdout:3/357: fsync d0/d18/d1c/d51/d5a/f77 0 2024-09-04T16:30:06.463 INFO:tasks.workunit.client.0.smithi170.stdout:0/64: mkdir d11/d13/d1a 0 2024-09-04T16:30:06.463 INFO:tasks.workunit.client.1.smithi193.stdout:3/358: write d0/d18/f50 [4947039,72370] 0 2024-09-04T16:30:06.464 INFO:tasks.workunit.client.1.smithi193.stdout:4/261: truncate d3/d39/f42 5235344 0 2024-09-04T16:30:06.464 INFO:tasks.workunit.client.1.smithi193.stdout:3/359: chown d0/d10 2 1 2024-09-04T16:30:06.464 INFO:tasks.workunit.client.0.smithi170.stdout:7/37: creat ff x:0 0 0 2024-09-04T16:30:06.465 INFO:tasks.workunit.client.1.smithi193.stdout:4/262: write d3/f18 [2106789,29650] 0 2024-09-04T16:30:06.466 INFO:tasks.workunit.client.0.smithi170.stdout:7/38: fdatasync f7 0 2024-09-04T16:30:06.467 INFO:tasks.workunit.client.0.smithi170.stdout:2/53: dwrite d3/d4/f6 [0,4194304] 0 2024-09-04T16:30:06.468 INFO:tasks.workunit.client.1.smithi193.stdout:1/379: creat d1/d2b/db/f7c x:0 0 0 2024-09-04T16:30:06.469 INFO:tasks.workunit.client.1.smithi193.stdout:1/380: dread - d1/d2b/f6a zero size 2024-09-04T16:30:06.470 INFO:tasks.workunit.client.0.smithi170.stdout:6/93: link d0/df/fa d0/df/d1f/d21/f23 0 2024-09-04T16:30:06.471 INFO:tasks.workunit.client.1.smithi193.stdout:3/360: dread d0/f66 [0,4194304] 0 2024-09-04T16:30:06.475 INFO:tasks.workunit.client.0.smithi170.stdout:4/137: link d1/c2c d1/d6/c2f 0 2024-09-04T16:30:06.476 INFO:tasks.workunit.client.1.smithi193.stdout:0/361: symlink d18/d25/d32/d57/d6c/l7c 0 2024-09-04T16:30:06.478 INFO:tasks.workunit.client.1.smithi193.stdout:5/326: dwrite d1/d29/d18/f2f [0,4194304] 0 2024-09-04T16:30:06.478 INFO:tasks.workunit.client.1.smithi193.stdout:6/280: symlink d5/de/d15/d48/l56 0 2024-09-04T16:30:06.480 INFO:tasks.workunit.client.0.smithi170.stdout:5/59: truncate f1 1576591 0 2024-09-04T16:30:06.481 INFO:tasks.workunit.client.0.smithi170.stdout:7/39: unlink l2 0 2024-09-04T16:30:06.483 INFO:tasks.workunit.client.0.smithi170.stdout:2/54: creat d3/db/df/f11 x:0 0 0 2024-09-04T16:30:06.483 INFO:tasks.workunit.client.1.smithi193.stdout:8/333: dread d2/f3 [0,4194304] 0 2024-09-04T16:30:06.483 INFO:tasks.workunit.client.1.smithi193.stdout:2/300: truncate d2/d9/f36 679694 0 2024-09-04T16:30:06.485 INFO:tasks.workunit.client.0.smithi170.stdout:2/55: write d3/d4/fa [2832306,94451] 0 2024-09-04T16:30:06.485 INFO:tasks.workunit.client.1.smithi193.stdout:8/334: read d2/d20/d23/d34/d46/f5e [326699,63916] 0 2024-09-04T16:30:06.486 INFO:tasks.workunit.client.0.smithi170.stdout:6/94: creat d0/df/d1b/f24 x:0 0 0 2024-09-04T16:30:06.486 INFO:tasks.workunit.client.1.smithi193.stdout:6/281: dwrite d5/f11 [0,4194304] 0 2024-09-04T16:30:06.487 INFO:tasks.workunit.client.0.smithi170.stdout:6/95: chown d0/fd 11423 1 2024-09-04T16:30:06.487 INFO:tasks.workunit.client.0.smithi170.stdout:6/96: stat d0/f2 0 2024-09-04T16:30:06.488 INFO:tasks.workunit.client.0.smithi170.stdout:6/97: chown d0/fd 1424 1 2024-09-04T16:30:06.489 INFO:tasks.workunit.client.0.smithi170.stdout:6/98: write d0/f9 [298427,97229] 0 2024-09-04T16:30:06.489 INFO:tasks.workunit.client.0.smithi170.stdout:4/138: unlink d1/d6/ce 0 2024-09-04T16:30:06.494 INFO:tasks.workunit.client.0.smithi170.stdout:0/65: symlink d11/d13/d1a/l1b 0 2024-09-04T16:30:06.498 INFO:tasks.workunit.client.1.smithi193.stdout:4/263: creat d3/d39/f57 x:0 0 0 2024-09-04T16:30:06.499 INFO:tasks.workunit.client.0.smithi170.stdout:7/40: creat f10 x:0 0 0 2024-09-04T16:30:06.500 INFO:tasks.workunit.client.1.smithi193.stdout:4/264: read d3/f18 [525141,17476] 0 2024-09-04T16:30:06.501 INFO:tasks.workunit.client.0.smithi170.stdout:2/56: creat d3/db/f12 x:0 0 0 2024-09-04T16:30:06.502 INFO:tasks.workunit.client.1.smithi193.stdout:4/265: read d3/f30 [135323,118388] 0 2024-09-04T16:30:06.502 INFO:tasks.workunit.client.1.smithi193.stdout:3/361: symlink d0/d3b/l79 0 2024-09-04T16:30:06.505 INFO:tasks.workunit.client.1.smithi193.stdout:4/266: dread d3/d39/f42 [0,4194304] 0 2024-09-04T16:30:06.508 INFO:tasks.workunit.client.1.smithi193.stdout:0/362: symlink d18/d25/d32/d57/d6c/l7d 0 2024-09-04T16:30:06.509 INFO:tasks.workunit.client.0.smithi170.stdout:2/57: dwrite d3/db/df/f11 [0,4194304] 0 2024-09-04T16:30:06.512 INFO:tasks.workunit.client.0.smithi170.stdout:0/66: rename f9 to d11/f1c 0 2024-09-04T16:30:06.515 INFO:tasks.workunit.client.0.smithi170.stdout:7/41: symlink l11 0 2024-09-04T16:30:06.517 INFO:tasks.workunit.client.0.smithi170.stdout:6/99: write d0/df/d1f/d21/f23 [486903,127800] 0 2024-09-04T16:30:06.518 INFO:tasks.workunit.client.1.smithi193.stdout:8/335: mknod d2/d20/d23/d34/d4b/c71 0 2024-09-04T16:30:06.519 INFO:tasks.workunit.client.0.smithi170.stdout:6/100: write d0/fd [83029,34866] 0 2024-09-04T16:30:06.519 INFO:tasks.workunit.client.1.smithi193.stdout:6/282: creat d5/d27/d3e/d43/f57 x:0 0 0 2024-09-04T16:30:06.520 INFO:tasks.workunit.client.0.smithi170.stdout:6/101: write d0/d17/f1d [627054,12060] 0 2024-09-04T16:30:06.521 INFO:tasks.workunit.client.0.smithi170.stdout:4/139: mknod d1/d6/d8/c30 0 2024-09-04T16:30:06.523 INFO:tasks.workunit.client.0.smithi170.stdout:2/58: mknod d3/d7/c13 0 2024-09-04T16:30:06.524 INFO:tasks.workunit.client.1.smithi193.stdout:6/283: dwrite d5/f19 [0,4194304] 0 2024-09-04T16:30:06.526 INFO:tasks.workunit.client.1.smithi193.stdout:7/416: creat d9/d18/f8f x:0 0 0 2024-09-04T16:30:06.526 INFO:tasks.workunit.client.0.smithi170.stdout:0/67: symlink d11/d13/d1a/l1d 0 2024-09-04T16:30:06.527 INFO:tasks.workunit.client.1.smithi193.stdout:1/381: mknod d1/c7d 0 2024-09-04T16:30:06.530 INFO:tasks.workunit.client.0.smithi170.stdout:7/42: mkdir d12 0 2024-09-04T16:30:06.533 INFO:tasks.workunit.client.1.smithi193.stdout:3/362: unlink d0/d7/de/f44 0 2024-09-04T16:30:06.537 INFO:tasks.workunit.client.0.smithi170.stdout:0/68: dwrite ff [0,4194304] 0 2024-09-04T16:30:06.541 INFO:tasks.workunit.client.1.smithi193.stdout:9/393: creat d2/d18/d2f/f7e x:0 0 0 2024-09-04T16:30:06.543 INFO:tasks.workunit.client.1.smithi193.stdout:2/301: rename d2/d9/d18/f31 to d2/d9/db/d10/d38/d63/f68 0 2024-09-04T16:30:06.544 INFO:tasks.workunit.client.1.smithi193.stdout:0/363: dwrite d18/d25/d32/f42 [0,4194304] 0 2024-09-04T16:30:06.545 INFO:tasks.workunit.client.0.smithi170.stdout:7/43: unlink cd 0 2024-09-04T16:30:06.545 INFO:tasks.workunit.client.0.smithi170.stdout:7/44: readlink le 0 2024-09-04T16:30:06.545 INFO:tasks.workunit.client.1.smithi193.stdout:2/302: chown d2/f5e 13 1 2024-09-04T16:30:06.546 INFO:tasks.workunit.client.0.smithi170.stdout:7/45: write f10 [207808,127732] 0 2024-09-04T16:30:06.546 INFO:tasks.workunit.client.0.smithi170.stdout:7/46: stat f10 0 2024-09-04T16:30:06.546 INFO:tasks.workunit.client.0.smithi170.stdout:7/47: read - ff zero size 2024-09-04T16:30:06.549 INFO:tasks.workunit.client.1.smithi193.stdout:8/336: creat d2/d20/d23/d24/d3c/d65/f72 x:0 0 0 2024-09-04T16:30:06.551 INFO:tasks.workunit.client.0.smithi170.stdout:4/140: write d1/d6/d8/f9 [2096797,14560] 0 2024-09-04T16:30:06.552 INFO:tasks.workunit.client.1.smithi193.stdout:8/337: stat d2/d20/d23/f29 0 2024-09-04T16:30:06.552 INFO:tasks.workunit.client.1.smithi193.stdout:9/394: dwrite d2/d8/d15/f16 [0,4194304] 0 2024-09-04T16:30:06.553 INFO:tasks.workunit.client.1.smithi193.stdout:9/395: chown d2/d8/d25/l5e 106483 1 2024-09-04T16:30:06.554 INFO:tasks.workunit.client.0.smithi170.stdout:0/69: mknod d11/c1e 0 2024-09-04T16:30:06.556 INFO:tasks.workunit.client.1.smithi193.stdout:2/303: dwrite d2/fc [4194304,4194304] 0 2024-09-04T16:30:06.559 INFO:tasks.workunit.client.1.smithi193.stdout:7/417: symlink d9/de/d27/d62/l90 0 2024-09-04T16:30:06.560 INFO:tasks.workunit.client.0.smithi170.stdout:2/59: dwrite f1 [0,4194304] 0 2024-09-04T16:30:06.562 INFO:tasks.workunit.client.0.smithi170.stdout:5/60: read f1 [1283658,9546] 0 2024-09-04T16:30:06.563 INFO:tasks.workunit.client.1.smithi193.stdout:8/338: dwrite d2/d20/d23/d34/d3e/f50 [0,4194304] 0 2024-09-04T16:30:06.567 INFO:tasks.workunit.client.0.smithi170.stdout:4/141: chown d1/f1e 185556 1 2024-09-04T16:30:06.569 INFO:tasks.workunit.client.0.smithi170.stdout:0/70: fsync d11/f1c 0 2024-09-04T16:30:06.572 INFO:tasks.workunit.client.1.smithi193.stdout:3/363: unlink d0/f3 0 2024-09-04T16:30:06.575 INFO:tasks.workunit.client.0.smithi170.stdout:5/61: unlink d4/ff 0 2024-09-04T16:30:06.579 INFO:tasks.workunit.client.1.smithi193.stdout:4/267: link d3/fd d3/d3c/f58 0 2024-09-04T16:30:06.579 INFO:tasks.workunit.client.0.smithi170.stdout:0/71: dwrite d11/f16 [0,4194304] 0 2024-09-04T16:30:06.582 INFO:tasks.workunit.client.0.smithi170.stdout:7/48: getdents d12 0 2024-09-04T16:30:06.582 INFO:tasks.workunit.client.0.smithi170.stdout:5/62: dread d4/db/fe [0,4194304] 0 2024-09-04T16:30:06.584 INFO:tasks.workunit.client.0.smithi170.stdout:6/102: getdents d0/df 0 2024-09-04T16:30:06.584 INFO:tasks.workunit.client.0.smithi170.stdout:6/103: chown d0/df/d1f/d21 56145739 1 2024-09-04T16:30:06.587 INFO:tasks.workunit.client.1.smithi193.stdout:0/364: chown d18/d25/c30 206331 1 2024-09-04T16:30:06.587 INFO:tasks.workunit.client.1.smithi193.stdout:4/268: dwrite d3/d1a/d2a/f40 [0,4194304] 0 2024-09-04T16:30:06.589 INFO:tasks.workunit.client.1.smithi193.stdout:1/382: dwrite d1/d2b/d1b/d51/d6d/f78 [0,4194304] 0 2024-09-04T16:30:06.593 INFO:tasks.workunit.client.1.smithi193.stdout:6/284: mknod d5/d33/d4e/d51/c58 0 2024-09-04T16:30:06.594 INFO:tasks.workunit.client.0.smithi170.stdout:0/72: symlink d11/d13/d1a/l1f 0 2024-09-04T16:30:06.594 INFO:tasks.workunit.client.1.smithi193.stdout:5/327: sync 2024-09-04T16:30:06.598 INFO:tasks.workunit.client.1.smithi193.stdout:2/304: unlink d2/d9/d18/d3f/c53 0 2024-09-04T16:30:06.600 INFO:tasks.workunit.client.1.smithi193.stdout:6/285: dwrite d5/f3f [0,4194304] 0 2024-09-04T16:30:06.601 INFO:tasks.workunit.client.0.smithi170.stdout:5/63: fdatasync d4/db/fc 0 2024-09-04T16:30:06.603 INFO:tasks.workunit.client.1.smithi193.stdout:7/418: creat d9/d18/d22/d2b/f91 x:0 0 0 2024-09-04T16:30:06.608 INFO:tasks.workunit.client.0.smithi170.stdout:0/73: dread f0 [0,4194304] 0 2024-09-04T16:30:06.608 INFO:tasks.workunit.client.0.smithi170.stdout:0/74: stat d11/f15 0 2024-09-04T16:30:06.609 INFO:tasks.workunit.client.0.smithi170.stdout:7/49: mknod d12/c13 0 2024-09-04T16:30:06.610 INFO:tasks.workunit.client.0.smithi170.stdout:7/50: chown fa 109889795 1 2024-09-04T16:30:06.610 INFO:tasks.workunit.client.0.smithi170.stdout:2/60: truncate d3/db/df/f11 2651253 0 2024-09-04T16:30:06.616 INFO:tasks.workunit.client.0.smithi170.stdout:5/64: symlink d4/db/l16 0 2024-09-04T16:30:06.618 INFO:tasks.workunit.client.0.smithi170.stdout:4/142: creat d1/f31 x:0 0 0 2024-09-04T16:30:06.618 INFO:tasks.workunit.client.0.smithi170.stdout:0/75: dwrite f3 [0,4194304] 0 2024-09-04T16:30:06.620 INFO:tasks.workunit.client.1.smithi193.stdout:0/365: symlink d18/d25/d3b/l7e 0 2024-09-04T16:30:06.620 INFO:tasks.workunit.client.1.smithi193.stdout:8/339: write d2/f2e [266088,61773] 0 2024-09-04T16:30:06.621 INFO:tasks.workunit.client.0.smithi170.stdout:5/65: dread d4/db/fc [0,4194304] 0 2024-09-04T16:30:06.621 INFO:tasks.workunit.client.1.smithi193.stdout:0/366: truncate d18/d25/d3b/f51 441983 0 2024-09-04T16:30:06.622 INFO:tasks.workunit.client.1.smithi193.stdout:8/340: write d2/d20/d23/f16 [3039100,45372] 0 2024-09-04T16:30:06.622 INFO:tasks.workunit.client.0.smithi170.stdout:5/66: readlink d4/db/l16 0 2024-09-04T16:30:06.624 INFO:tasks.workunit.client.0.smithi170.stdout:0/76: dread f0 [0,4194304] 0 2024-09-04T16:30:06.624 INFO:tasks.workunit.client.1.smithi193.stdout:1/383: rmdir d1/d39/d48 39 2024-09-04T16:30:06.624 INFO:tasks.workunit.client.1.smithi193.stdout:2/305: dread d2/d9/db/d10/d38/f3b [0,4194304] 0 2024-09-04T16:30:06.625 INFO:tasks.workunit.client.1.smithi193.stdout:1/384: readlink d1/d2b/d10/d2a/l71 0 2024-09-04T16:30:06.626 INFO:tasks.workunit.client.0.smithi170.stdout:0/77: chown d11/d13/d1a/l1b 789 1 2024-09-04T16:30:06.627 INFO:tasks.workunit.client.0.smithi170.stdout:0/78: readlink d11/d13/d1a/l1f 0 2024-09-04T16:30:06.628 INFO:tasks.workunit.client.0.smithi170.stdout:2/61: unlink f1 0 2024-09-04T16:30:06.629 INFO:tasks.workunit.client.0.smithi170.stdout:6/104: dwrite d0/f11 [0,4194304] 0 2024-09-04T16:30:06.630 INFO:tasks.workunit.client.1.smithi193.stdout:5/328: chown d1/d8/db/d15/f30 3888 1 2024-09-04T16:30:06.631 INFO:tasks.workunit.client.0.smithi170.stdout:7/51: creat d12/f14 x:0 0 0 2024-09-04T16:30:06.632 INFO:tasks.workunit.client.1.smithi193.stdout:9/396: fsync d2/d4/f3a 0 2024-09-04T16:30:06.636 INFO:tasks.workunit.client.0.smithi170.stdout:7/52: chown le 480 1 2024-09-04T16:30:06.636 INFO:tasks.workunit.client.0.smithi170.stdout:4/143: creat d1/d6/f32 x:0 0 0 2024-09-04T16:30:06.637 INFO:tasks.workunit.client.1.smithi193.stdout:9/397: stat d2/d8 0 2024-09-04T16:30:06.638 INFO:tasks.workunit.client.0.smithi170.stdout:4/144: chown d1/d6/d8/f21 7468070 1 2024-09-04T16:30:06.638 INFO:tasks.workunit.client.0.smithi170.stdout:5/67: read d4/f6 [332125,43982] 0 2024-09-04T16:30:06.639 INFO:tasks.workunit.client.0.smithi170.stdout:2/62: dwrite d3/d4/f6 [0,4194304] 0 2024-09-04T16:30:06.639 INFO:tasks.workunit.client.0.smithi170.stdout:2/63: chown d3/db 40073651 1 2024-09-04T16:30:06.640 INFO:tasks.workunit.client.1.smithi193.stdout:9/398: dwrite d2/d8/f55 [0,4194304] 0 2024-09-04T16:30:06.641 INFO:tasks.workunit.client.1.smithi193.stdout:8/341: dread d2/d20/d23/d51/d59/f6d [0,4194304] 0 2024-09-04T16:30:06.642 INFO:tasks.workunit.client.1.smithi193.stdout:6/286: rename d5/d27/d3e/f4f to d5/d33/d4e/f59 0 2024-09-04T16:30:06.643 INFO:tasks.workunit.client.1.smithi193.stdout:9/399: truncate d2/d18/d2f/d22/d30/d6a/f79 542583 0 2024-09-04T16:30:06.644 INFO:tasks.workunit.client.1.smithi193.stdout:6/287: read d5/de/d15/d48/f4b [739032,108507] 0 2024-09-04T16:30:06.646 INFO:tasks.workunit.client.0.smithi170.stdout:0/79: rename fb to d11/d13/f20 0 2024-09-04T16:30:06.647 INFO:tasks.workunit.client.0.smithi170.stdout:0/80: fsync f3 0 2024-09-04T16:30:06.647 INFO:tasks.workunit.client.1.smithi193.stdout:8/342: dread d2/f2e [0,4194304] 0 2024-09-04T16:30:06.648 INFO:tasks.workunit.client.0.smithi170.stdout:0/81: chown f4 95 1 2024-09-04T16:30:06.649 INFO:tasks.workunit.client.0.smithi170.stdout:0/82: truncate d11/f1c 4374342 0 2024-09-04T16:30:06.655 INFO:tasks.workunit.client.1.smithi193.stdout:4/269: symlink d3/d1a/l59 0 2024-09-04T16:30:06.656 INFO:tasks.workunit.client.0.smithi170.stdout:5/68: chown d4/c15 1382681022 1 2024-09-04T16:30:06.656 INFO:tasks.workunit.client.1.smithi193.stdout:0/367: write d18/d25/d32/d57/d6d/f72 [3784894,108154] 0 2024-09-04T16:30:06.658 INFO:tasks.workunit.client.1.smithi193.stdout:2/306: mknod d2/d9/db/d10/d1e/d26/c69 0 2024-09-04T16:30:06.659 INFO:tasks.workunit.client.0.smithi170.stdout:2/64: mkdir d3/d4/d14 0 2024-09-04T16:30:06.659 INFO:tasks.workunit.client.1.smithi193.stdout:1/385: chown d1/d2b/d1b/d28/d50/c73 0 1 2024-09-04T16:30:06.660 INFO:tasks.workunit.client.1.smithi193.stdout:0/368: dread d18/d25/d32/f44 [0,4194304] 0 2024-09-04T16:30:06.661 INFO:tasks.workunit.client.1.smithi193.stdout:1/386: fsync d1/d2b/d10/f25 0 2024-09-04T16:30:06.666 INFO:tasks.workunit.client.0.smithi170.stdout:0/83: creat d11/d13/d1a/f21 x:0 0 0 2024-09-04T16:30:06.673 INFO:tasks.workunit.client.0.smithi170.stdout:4/145: mkdir d1/d6/d2b/d33 0 2024-09-04T16:30:06.674 INFO:tasks.workunit.client.1.smithi193.stdout:9/400: rmdir d2/d18/d2f/d22/d30/d6a 39 2024-09-04T16:30:06.675 INFO:tasks.workunit.client.0.smithi170.stdout:6/105: truncate d0/d17/f1d 190911 0 2024-09-04T16:30:06.676 INFO:tasks.workunit.client.1.smithi193.stdout:7/419: sync 2024-09-04T16:30:06.677 INFO:tasks.workunit.client.1.smithi193.stdout:6/288: creat d5/de/d15/d1b/f5a x:0 0 0 2024-09-04T16:30:06.677 INFO:tasks.workunit.client.1.smithi193.stdout:7/420: write d9/d39/d3e/f68 [3034910,104747] 0 2024-09-04T16:30:06.678 INFO:tasks.workunit.client.1.smithi193.stdout:3/364: rmdir d0/d18/d1c 39 2024-09-04T16:30:06.679 INFO:tasks.workunit.client.1.smithi193.stdout:7/421: write d9/de/f1c [733726,39724] 0 2024-09-04T16:30:06.679 INFO:tasks.workunit.client.1.smithi193.stdout:7/422: stat d9/l12 0 2024-09-04T16:30:06.680 INFO:tasks.workunit.client.1.smithi193.stdout:4/270: unlink d3/f24 0 2024-09-04T16:30:06.682 INFO:tasks.workunit.client.1.smithi193.stdout:5/329: fsync d1/d8/db/d23/f26 0 2024-09-04T16:30:06.683 INFO:tasks.workunit.client.1.smithi193.stdout:5/330: chown d1/d8/db/d23/l49 779 1 2024-09-04T16:30:06.687 INFO:tasks.workunit.client.1.smithi193.stdout:9/401: creat d2/d18/d66/f7f x:0 0 0 2024-09-04T16:30:06.687 INFO:tasks.workunit.client.1.smithi193.stdout:1/387: dread d1/d2b/db/f23 [0,4194304] 0 2024-09-04T16:30:06.692 INFO:tasks.workunit.client.1.smithi193.stdout:6/289: truncate d5/de/d15/f24 4196982 0 2024-09-04T16:30:06.693 INFO:tasks.workunit.client.1.smithi193.stdout:6/290: read - d5/d27/d3e/d43/f57 zero size 2024-09-04T16:30:06.693 INFO:tasks.workunit.client.1.smithi193.stdout:7/423: mknod d9/d18/d22/d2b/d6c/d70/c92 0 2024-09-04T16:30:06.695 INFO:tasks.workunit.client.1.smithi193.stdout:7/424: truncate d9/d39/d3e/d4d/d4f/f5d 835691 0 2024-09-04T16:30:06.695 INFO:tasks.workunit.client.1.smithi193.stdout:2/307: creat d2/d9/db/d65/f6a x:0 0 0 2024-09-04T16:30:06.697 INFO:tasks.workunit.client.1.smithi193.stdout:0/369: symlink d18/d79/l7f 0 2024-09-04T16:30:06.700 INFO:tasks.workunit.client.1.smithi193.stdout:8/343: write d2/d12/f19 [1015727,38069] 0 2024-09-04T16:30:06.701 INFO:tasks.workunit.client.1.smithi193.stdout:3/365: mkdir d0/d18/d1c/d51/d7a 0 2024-09-04T16:30:06.702 INFO:tasks.workunit.client.1.smithi193.stdout:3/366: chown d0/d18/d65 124 1 2024-09-04T16:30:06.703 INFO:tasks.workunit.client.1.smithi193.stdout:4/271: link d3/d1a/d21/f2c d3/d39/f5a 0 2024-09-04T16:30:06.705 INFO:tasks.workunit.client.1.smithi193.stdout:7/425: rename d9/d18/d22/d2b/f33 to d9/d11/f93 0 2024-09-04T16:30:06.705 INFO:tasks.workunit.client.1.smithi193.stdout:9/402: rename d2/d18/d2f to d2/d18/d2f/d22/d30/d6a/d80 22 2024-09-04T16:30:06.707 INFO:tasks.workunit.client.1.smithi193.stdout:2/308: symlink d2/d9/db/d10/d1e/d56/l6b 0 2024-09-04T16:30:06.707 INFO:tasks.workunit.client.1.smithi193.stdout:5/331: fsync d1/f16 0 2024-09-04T16:30:06.708 INFO:tasks.workunit.client.1.smithi193.stdout:2/309: dread - d2/d9/db/d10/d1f/f62 zero size 2024-09-04T16:30:06.708 INFO:tasks.workunit.client.1.smithi193.stdout:2/310: stat d2/d9/db/f16 0 2024-09-04T16:30:06.709 INFO:tasks.workunit.client.1.smithi193.stdout:2/311: fdatasync d2/d9/db/d10/d38/f5f 0 2024-09-04T16:30:06.711 INFO:tasks.workunit.client.1.smithi193.stdout:2/312: write d2/d9/db/d10/d1e/d26/f3a [552894,49794] 0 2024-09-04T16:30:06.711 INFO:tasks.workunit.client.1.smithi193.stdout:3/367: fdatasync d0/d18/d1c/d30/f33 0 2024-09-04T16:30:06.712 INFO:tasks.workunit.client.1.smithi193.stdout:2/313: readlink d2/d9/db/d10/l32 0 2024-09-04T16:30:06.713 INFO:tasks.workunit.client.1.smithi193.stdout:1/388: dwrite d1/d2b/f31 [0,4194304] 0 2024-09-04T16:30:06.714 INFO:tasks.workunit.client.1.smithi193.stdout:7/426: creat d9/d39/d3e/d4d/d4f/f94 x:0 0 0 2024-09-04T16:30:06.715 INFO:tasks.workunit.client.1.smithi193.stdout:1/389: dread - d1/d2b/f6a zero size 2024-09-04T16:30:06.715 INFO:tasks.workunit.client.1.smithi193.stdout:9/403: mkdir d2/d18/d2f/d22/d30/d6a/d6e/d81 0 2024-09-04T16:30:06.717 INFO:tasks.workunit.client.1.smithi193.stdout:5/332: mknod d1/d29/d18/d42/c5f 0 2024-09-04T16:30:06.718 INFO:tasks.workunit.client.1.smithi193.stdout:8/344: symlink d2/d20/l73 0 2024-09-04T16:30:06.720 INFO:tasks.workunit.client.1.smithi193.stdout:4/272: creat d3/d1a/d54/f5b x:0 0 0 2024-09-04T16:30:06.722 INFO:tasks.workunit.client.1.smithi193.stdout:2/314: mknod d2/d9/db/d10/d1f/d22/c6c 0 2024-09-04T16:30:06.722 INFO:tasks.workunit.client.1.smithi193.stdout:8/345: chown d2/d20/l26 2996050 1 2024-09-04T16:30:06.726 INFO:tasks.workunit.client.1.smithi193.stdout:0/370: truncate d18/d25/d3b/f40 583271 0 2024-09-04T16:30:06.726 INFO:tasks.workunit.client.1.smithi193.stdout:9/404: dwrite d2/d18/d2f/f7e [0,4194304] 0 2024-09-04T16:30:06.728 INFO:tasks.workunit.client.1.smithi193.stdout:1/390: dwrite d1/d2b/db/f3b [0,4194304] 0 2024-09-04T16:30:06.736 INFO:tasks.workunit.client.1.smithi193.stdout:3/368: mkdir d0/d9/d49/d7b 0 2024-09-04T16:30:06.737 INFO:tasks.workunit.client.1.smithi193.stdout:5/333: dwrite d1/d8/db/d15/f47 [0,4194304] 0 2024-09-04T16:30:06.738 INFO:tasks.workunit.client.1.smithi193.stdout:4/273: mknod d3/d1a/d2a/c5c 0 2024-09-04T16:30:06.739 INFO:tasks.workunit.client.1.smithi193.stdout:8/346: unlink d2/l18 0 2024-09-04T16:30:06.740 INFO:tasks.workunit.client.1.smithi193.stdout:2/315: creat d2/d14/f6d x:0 0 0 2024-09-04T16:30:06.743 INFO:tasks.workunit.client.1.smithi193.stdout:1/391: truncate d1/f1c 3101055 0 2024-09-04T16:30:06.743 INFO:tasks.workunit.client.1.smithi193.stdout:0/371: creat d18/d25/d5f/d6a/f80 x:0 0 0 2024-09-04T16:30:06.748 INFO:tasks.workunit.client.1.smithi193.stdout:3/369: dread d0/d18/d1c/d30/f41 [0,4194304] 0 2024-09-04T16:30:06.749 INFO:tasks.workunit.client.1.smithi193.stdout:1/392: creat d1/d2b/db/f7e x:0 0 0 2024-09-04T16:30:06.750 INFO:tasks.workunit.client.1.smithi193.stdout:9/405: dread d2/d8/d25/f3e [0,4194304] 0 2024-09-04T16:30:06.750 INFO:tasks.workunit.client.1.smithi193.stdout:6/291: dread d5/de/d15/f24 [0,4194304] 0 2024-09-04T16:30:06.751 INFO:tasks.workunit.client.1.smithi193.stdout:2/316: chown d2/d9/db/d10/d1f/f4c 41620082 1 2024-09-04T16:30:06.752 INFO:tasks.workunit.client.1.smithi193.stdout:0/372: link d18/f1c d18/d25/d5f/f81 0 2024-09-04T16:30:06.752 INFO:tasks.workunit.client.1.smithi193.stdout:1/393: readlink d1/d2b/d1b/l52 0 2024-09-04T16:30:06.754 INFO:tasks.workunit.client.1.smithi193.stdout:6/292: readlink d5/de/d15/d1b/l32 0 2024-09-04T16:30:06.754 INFO:tasks.workunit.client.1.smithi193.stdout:7/427: dwrite d9/de/d27/f37 [0,4194304] 0 2024-09-04T16:30:06.755 INFO:tasks.workunit.client.1.smithi193.stdout:2/317: dread d2/f5e [0,4194304] 0 2024-09-04T16:30:06.756 INFO:tasks.workunit.client.1.smithi193.stdout:8/347: rename d2/d20/d23/d24/d3c/d65/d67/f3a to d2/d20/d23/d24/d3c/d65/f74 0 2024-09-04T16:30:06.758 INFO:tasks.workunit.client.1.smithi193.stdout:0/373: truncate d18/f4c 6245077 0 2024-09-04T16:30:06.758 INFO:tasks.workunit.client.1.smithi193.stdout:4/274: getdents d3/d3c/d47 0 2024-09-04T16:30:06.759 INFO:tasks.workunit.client.1.smithi193.stdout:9/406: symlink d2/l82 0 2024-09-04T16:30:06.761 INFO:tasks.workunit.client.1.smithi193.stdout:0/374: chown d18/f4c 1165 1 2024-09-04T16:30:06.762 INFO:tasks.workunit.client.1.smithi193.stdout:3/370: creat d0/d18/d65/f7c x:0 0 0 2024-09-04T16:30:06.763 INFO:tasks.workunit.client.1.smithi193.stdout:5/334: dread d1/d8/db/d23/f26 [0,4194304] 0 2024-09-04T16:30:06.765 INFO:tasks.workunit.client.1.smithi193.stdout:0/375: stat d18/d25/d3b/l6b 0 2024-09-04T16:30:06.768 INFO:tasks.workunit.client.1.smithi193.stdout:2/318: creat d2/d9/db/d10/f6e x:0 0 0 2024-09-04T16:30:06.769 INFO:tasks.workunit.client.1.smithi193.stdout:8/348: symlink d2/d12/l75 0 2024-09-04T16:30:06.776 INFO:tasks.workunit.client.1.smithi193.stdout:7/428: dwrite d9/d39/d3e/d4d/f6a [0,4194304] 0 2024-09-04T16:30:06.776 INFO:tasks.workunit.client.1.smithi193.stdout:1/394: dwrite d1/d2b/d10/f17 [4194304,4194304] 0 2024-09-04T16:30:06.780 INFO:tasks.workunit.client.0.smithi170.stdout:5/69: symlink d4/l17 0 2024-09-04T16:30:06.780 INFO:tasks.workunit.client.0.smithi170.stdout:7/53: truncate fa 89266 0 2024-09-04T16:30:06.780 INFO:tasks.workunit.client.1.smithi193.stdout:1/395: dread - d1/d2b/d10/f59 zero size 2024-09-04T16:30:06.780 INFO:tasks.workunit.client.1.smithi193.stdout:4/275: dwrite d3/fc [0,4194304] 0 2024-09-04T16:30:06.782 INFO:tasks.workunit.client.0.smithi170.stdout:0/84: symlink d11/d13/d1a/l22 0 2024-09-04T16:30:06.782 INFO:tasks.workunit.client.0.smithi170.stdout:4/146: creat d1/d6/f34 x:0 0 0 2024-09-04T16:30:06.782 INFO:tasks.workunit.client.1.smithi193.stdout:9/407: symlink d2/d8/l83 0 2024-09-04T16:30:06.782 INFO:tasks.workunit.client.1.smithi193.stdout:5/335: mknod d1/d29/d1e/d37/d3f/c60 0 2024-09-04T16:30:06.782 INFO:tasks.workunit.client.0.smithi170.stdout:0/85: fdatasync d11/f15 0 2024-09-04T16:30:06.784 INFO:tasks.workunit.client.1.smithi193.stdout:6/293: dwrite d5/de/f17 [0,4194304] 0 2024-09-04T16:30:06.784 INFO:tasks.workunit.client.0.smithi170.stdout:6/106: unlink d0/df/d1b/l1e 0 2024-09-04T16:30:06.786 INFO:tasks.workunit.client.0.smithi170.stdout:6/107: chown d0/f11 33 1 2024-09-04T16:30:06.791 INFO:tasks.workunit.client.0.smithi170.stdout:7/54: mkdir d12/d15 0 2024-09-04T16:30:06.795 INFO:tasks.workunit.client.0.smithi170.stdout:4/147: dwrite d1/d26/f2e [0,4194304] 0 2024-09-04T16:30:06.797 INFO:tasks.workunit.client.1.smithi193.stdout:0/376: rename l13 to d18/d25/l82 0 2024-09-04T16:30:06.799 INFO:tasks.workunit.client.1.smithi193.stdout:4/276: read d3/d1a/d21/f3a [78102,82421] 0 2024-09-04T16:30:06.799 INFO:tasks.workunit.client.1.smithi193.stdout:1/396: dread d1/d2b/f2e [0,4194304] 0 2024-09-04T16:30:06.801 INFO:tasks.workunit.client.1.smithi193.stdout:7/429: dread f8 [0,4194304] 0 2024-09-04T16:30:06.801 INFO:tasks.workunit.client.1.smithi193.stdout:1/397: write d1/d2b/db/d54/f70 [76160,38483] 0 2024-09-04T16:30:06.802 INFO:tasks.workunit.client.0.smithi170.stdout:6/108: rename d0/df/d1f/d21 to d0/d17/d25 0 2024-09-04T16:30:06.803 INFO:tasks.workunit.client.0.smithi170.stdout:6/109: readlink d0/df/l12 0 2024-09-04T16:30:06.803 INFO:tasks.workunit.client.1.smithi193.stdout:1/398: write d1/d2b/d10/d56/f6b [3414801,50290] 0 2024-09-04T16:30:06.804 INFO:tasks.workunit.client.0.smithi170.stdout:6/110: truncate d0/f14 1097363 0 2024-09-04T16:30:06.808 INFO:tasks.workunit.client.1.smithi193.stdout:9/408: creat d2/d56/f84 x:0 0 0 2024-09-04T16:30:06.809 INFO:tasks.workunit.client.1.smithi193.stdout:3/371: truncate d0/d18/d1c/d51/f72 287764 0 2024-09-04T16:30:06.811 INFO:tasks.workunit.client.1.smithi193.stdout:2/319: link d2/d9/db/d10/f6e d2/d9/d18/f6f 0 2024-09-04T16:30:06.812 INFO:tasks.workunit.client.1.smithi193.stdout:2/320: fsync d2/d9/db/d10/f5c 0 2024-09-04T16:30:06.813 INFO:tasks.workunit.client.1.smithi193.stdout:2/321: chown d2/d9/db/d10/d1e/d56 3022 1 2024-09-04T16:30:06.814 INFO:tasks.workunit.client.0.smithi170.stdout:7/55: mkdir d12/d16 0 2024-09-04T16:30:06.814 INFO:tasks.workunit.client.1.smithi193.stdout:9/409: dwrite d2/d18/d2f/d22/d30/f72 [0,4194304] 0 2024-09-04T16:30:06.823 INFO:tasks.workunit.client.1.smithi193.stdout:8/349: truncate d2/d20/f2d 631196 0 2024-09-04T16:30:06.825 INFO:tasks.workunit.client.1.smithi193.stdout:4/277: mknod d3/d3c/d47/c5d 0 2024-09-04T16:30:06.827 INFO:tasks.workunit.client.1.smithi193.stdout:7/430: mkdir d9/d39/d95 0 2024-09-04T16:30:06.827 INFO:tasks.workunit.client.0.smithi170.stdout:4/148: mkdir d1/d6/d8/d20/d35 0 2024-09-04T16:30:06.828 INFO:tasks.workunit.client.0.smithi170.stdout:5/70: dwrite f1 [0,4194304] 0 2024-09-04T16:30:06.829 INFO:tasks.workunit.client.1.smithi193.stdout:8/350: dwrite d2/d12/f43 [0,4194304] 0 2024-09-04T16:30:06.831 INFO:tasks.workunit.client.1.smithi193.stdout:7/431: dread f8 [0,4194304] 0 2024-09-04T16:30:06.832 INFO:tasks.workunit.client.0.smithi170.stdout:6/111: creat d0/d15/f26 x:0 0 0 2024-09-04T16:30:06.834 INFO:tasks.workunit.client.1.smithi193.stdout:1/399: unlink d1/d2b/d10/c1a 0 2024-09-04T16:30:06.836 INFO:tasks.workunit.client.0.smithi170.stdout:2/65: link d3/d4/c5 d3/c15 0 2024-09-04T16:30:06.836 INFO:tasks.workunit.client.1.smithi193.stdout:3/372: chown d0/d18/d1c/d25/f78 3 1 2024-09-04T16:30:06.839 INFO:tasks.workunit.client.0.smithi170.stdout:7/56: unlink f10 0 2024-09-04T16:30:06.841 INFO:tasks.workunit.client.1.smithi193.stdout:5/336: mknod d1/d8/db/d36/d40/d46/c61 0 2024-09-04T16:30:06.847 INFO:tasks.workunit.client.0.smithi170.stdout:7/57: dwrite ff [0,4194304] 0 2024-09-04T16:30:06.849 INFO:tasks.workunit.client.0.smithi170.stdout:7/58: truncate d12/f14 660421 0 2024-09-04T16:30:06.850 INFO:tasks.workunit.client.0.smithi170.stdout:0/86: truncate ff 1828770 0 2024-09-04T16:30:06.850 INFO:tasks.workunit.client.0.smithi170.stdout:7/59: stat d12/f14 0 2024-09-04T16:30:06.850 INFO:tasks.workunit.client.1.smithi193.stdout:9/410: stat d2/d18/d2f/d22/d30/d6a/d6e/c58 0 2024-09-04T16:30:06.852 INFO:tasks.workunit.client.1.smithi193.stdout:9/411: fsync d2/d8/d61/f6b 0 2024-09-04T16:30:06.852 INFO:tasks.workunit.client.1.smithi193.stdout:0/377: dwrite d18/f1c [0,4194304] 0 2024-09-04T16:30:06.858 INFO:tasks.workunit.client.1.smithi193.stdout:9/412: dread d2/d8/d61/f73 [0,4194304] 0 2024-09-04T16:30:06.860 INFO:tasks.workunit.client.1.smithi193.stdout:4/278: write d3/f14 [4792728,89233] 0 2024-09-04T16:30:06.861 INFO:tasks.workunit.client.1.smithi193.stdout:7/432: rmdir d9/d39/d3e/d4a 39 2024-09-04T16:30:06.861 INFO:tasks.workunit.client.1.smithi193.stdout:9/413: read d2/d4/f5 [1984880,61587] 0 2024-09-04T16:30:06.862 INFO:tasks.workunit.client.1.smithi193.stdout:4/279: fdatasync d3/f31 0 2024-09-04T16:30:06.864 INFO:tasks.workunit.client.1.smithi193.stdout:1/400: mkdir d1/d2b/db/d7f 0 2024-09-04T16:30:06.865 INFO:tasks.workunit.client.1.smithi193.stdout:3/373: mkdir d0/d9/d49/d7d 0 2024-09-04T16:30:06.867 INFO:tasks.workunit.client.1.smithi193.stdout:5/337: creat d1/d8/db/d36/d40/f62 x:0 0 0 2024-09-04T16:30:06.874 INFO:tasks.workunit.client.1.smithi193.stdout:0/378: rmdir d18/d25/d3b 39 2024-09-04T16:30:06.881 INFO:tasks.workunit.client.1.smithi193.stdout:8/351: write d2/f8 [2872699,102390] 0 2024-09-04T16:30:06.882 INFO:tasks.workunit.client.1.smithi193.stdout:8/352: read d2/d20/d23/f1d [2246149,50174] 0 2024-09-04T16:30:06.883 INFO:tasks.workunit.client.1.smithi193.stdout:8/353: write f0 [1755210,100526] 0 2024-09-04T16:30:06.883 INFO:tasks.workunit.client.1.smithi193.stdout:7/433: read d9/d39/d3e/d4a/f5b [3855715,39107] 0 2024-09-04T16:30:06.889 INFO:tasks.workunit.client.1.smithi193.stdout:2/322: link d2/d9/db/d10/d38/f3b d2/d9/db/d10/d38/f70 0 2024-09-04T16:30:06.890 INFO:tasks.workunit.client.1.smithi193.stdout:2/323: read d2/d9/d18/f37 [1089160,126723] 0 2024-09-04T16:30:06.891 INFO:tasks.workunit.client.1.smithi193.stdout:6/294: rename d5/c40 to d5/c5b 0 2024-09-04T16:30:06.892 INFO:tasks.workunit.client.1.smithi193.stdout:6/295: chown d5/de/d15/d1b 204908718 1 2024-09-04T16:30:06.894 INFO:tasks.workunit.client.1.smithi193.stdout:0/379: creat d18/d25/d5f/d6a/f83 x:0 0 0 2024-09-04T16:30:06.904 INFO:tasks.workunit.client.1.smithi193.stdout:4/280: truncate d3/f10 1390800 0 2024-09-04T16:30:06.905 INFO:tasks.workunit.client.1.smithi193.stdout:8/354: mkdir d2/d20/d23/d51/d76 0 2024-09-04T16:30:06.905 INFO:tasks.workunit.client.1.smithi193.stdout:2/324: dwrite d2/d9/d18/d3f/f44 [4194304,4194304] 0 2024-09-04T16:30:06.905 INFO:tasks.workunit.client.1.smithi193.stdout:9/414: write d2/d18/d2f/f45 [677585,115479] 0 2024-09-04T16:30:06.906 INFO:tasks.workunit.client.1.smithi193.stdout:6/296: mknod d5/d33/d4e/c5c 0 2024-09-04T16:30:06.907 INFO:tasks.workunit.client.1.smithi193.stdout:9/415: chown d2/d56 7756392 1 2024-09-04T16:30:06.908 INFO:tasks.workunit.client.1.smithi193.stdout:5/338: rename d1/d29/d1e/d37/f43 to d1/d29/d1e/d37/f63 0 2024-09-04T16:30:06.911 INFO:tasks.workunit.client.1.smithi193.stdout:9/416: fsync d2/d18/d2f/f45 0 2024-09-04T16:30:06.915 INFO:tasks.workunit.client.1.smithi193.stdout:6/297: unlink d5/d27/c38 0 2024-09-04T16:30:06.915 INFO:tasks.workunit.client.1.smithi193.stdout:0/380: dwrite d18/f21 [0,4194304] 0 2024-09-04T16:30:06.918 INFO:tasks.workunit.client.1.smithi193.stdout:2/325: dwrite d2/d9/d18/f4f [0,4194304] 0 2024-09-04T16:30:06.919 INFO:tasks.workunit.client.1.smithi193.stdout:3/374: write d0/d10/f1a [1042678,39344] 0 2024-09-04T16:30:06.921 INFO:tasks.workunit.client.1.smithi193.stdout:4/281: write d3/f12 [911400,53452] 0 2024-09-04T16:30:06.923 INFO:tasks.workunit.client.1.smithi193.stdout:5/339: symlink d1/d8/db/d36/l64 0 2024-09-04T16:30:06.923 INFO:tasks.workunit.client.1.smithi193.stdout:5/340: stat d1/f16 0 2024-09-04T16:30:06.936 INFO:tasks.workunit.client.1.smithi193.stdout:0/381: creat d18/d25/d32/d57/f84 x:0 0 0 2024-09-04T16:30:06.937 INFO:tasks.workunit.client.1.smithi193.stdout:2/326: rmdir d2/d9/db/d10/d1e/d26 39 2024-09-04T16:30:06.940 INFO:tasks.workunit.client.1.smithi193.stdout:3/375: rename d0/d18/d65 to d0/d18/d1c/d25/d5e/d7e 0 2024-09-04T16:30:06.944 INFO:tasks.workunit.client.1.smithi193.stdout:5/341: dread d1/d8/fc [0,4194304] 0 2024-09-04T16:30:06.945 INFO:tasks.workunit.client.1.smithi193.stdout:8/355: link d2/d12/l75 d2/d20/d23/d24/l77 0 2024-09-04T16:30:06.947 INFO:tasks.workunit.client.1.smithi193.stdout:2/327: creat d2/f71 x:0 0 0 2024-09-04T16:30:06.948 INFO:tasks.workunit.client.1.smithi193.stdout:4/282: mkdir d3/d1a/d21/d52/d5e 0 2024-09-04T16:30:06.949 INFO:tasks.workunit.client.1.smithi193.stdout:9/417: dwrite d2/d8/d61/f73 [0,4194304] 0 2024-09-04T16:30:06.950 INFO:tasks.workunit.client.1.smithi193.stdout:5/342: creat d1/d8/db/d36/f65 x:0 0 0 2024-09-04T16:30:06.950 INFO:tasks.workunit.client.1.smithi193.stdout:9/418: write d2/f42 [1659956,29998] 0 2024-09-04T16:30:06.951 INFO:tasks.workunit.client.1.smithi193.stdout:8/356: rmdir d2/d20/d23/d34 39 2024-09-04T16:30:06.952 INFO:tasks.workunit.client.1.smithi193.stdout:5/343: chown d1/d8/f2d 341135 1 2024-09-04T16:30:06.952 INFO:tasks.workunit.client.1.smithi193.stdout:8/357: fsync d2/d12/f19 0 2024-09-04T16:30:06.952 INFO:tasks.workunit.client.1.smithi193.stdout:6/298: dwrite d5/de/f18 [4194304,4194304] 0 2024-09-04T16:30:06.953 INFO:tasks.workunit.client.1.smithi193.stdout:6/299: fdatasync d5/f19 0 2024-09-04T16:30:06.953 INFO:tasks.workunit.client.1.smithi193.stdout:3/376: mknod d0/c7f 0 2024-09-04T16:30:06.959 INFO:tasks.workunit.client.1.smithi193.stdout:2/328: creat d2/d9/db/f72 x:0 0 0 2024-09-04T16:30:06.965 INFO:tasks.workunit.client.1.smithi193.stdout:9/419: symlink d2/d18/d66/l85 0 2024-09-04T16:30:06.972 INFO:tasks.workunit.client.1.smithi193.stdout:6/300: mkdir d5/d27/d3e/d43/d5d 0 2024-09-04T16:30:06.972 INFO:tasks.workunit.client.1.smithi193.stdout:6/301: chown d5/de/f45 31 1 2024-09-04T16:30:06.973 INFO:tasks.workunit.client.1.smithi193.stdout:4/283: mkdir d3/d5f 0 2024-09-04T16:30:06.975 INFO:tasks.workunit.client.1.smithi193.stdout:3/377: mknod d0/d18/d1c/d25/d5e/d7e/c80 0 2024-09-04T16:30:06.976 INFO:tasks.workunit.client.1.smithi193.stdout:2/329: creat d2/d9/db/d10/d1e/d56/f73 x:0 0 0 2024-09-04T16:30:06.978 INFO:tasks.workunit.client.1.smithi193.stdout:9/420: mkdir d2/d56/d86 0 2024-09-04T16:30:06.980 INFO:tasks.workunit.client.1.smithi193.stdout:8/358: rename d2/f3 to d2/d20/d23/d34/d46/d69/f78 0 2024-09-04T16:30:06.981 INFO:tasks.workunit.client.1.smithi193.stdout:5/344: dread d1/d29/f1d [4194304,4194304] 0 2024-09-04T16:30:06.982 INFO:tasks.workunit.client.1.smithi193.stdout:3/378: mknod d0/d10/d24/c81 0 2024-09-04T16:30:06.983 INFO:tasks.workunit.client.1.smithi193.stdout:2/330: mkdir d2/d9/d18/d74 0 2024-09-04T16:30:06.983 INFO:tasks.workunit.client.1.smithi193.stdout:3/379: write d0/d18/d1c/d51/d5a/f77 [92834,43709] 0 2024-09-04T16:30:06.983 INFO:tasks.workunit.client.1.smithi193.stdout:2/331: chown d2/d9/db/d65 447297 1 2024-09-04T16:30:06.984 INFO:tasks.workunit.client.1.smithi193.stdout:9/421: creat d2/d8/d61/f87 x:0 0 0 2024-09-04T16:30:06.986 INFO:tasks.workunit.client.1.smithi193.stdout:4/284: dread d3/d1a/d2a/f3b [0,4194304] 0 2024-09-04T16:30:06.987 INFO:tasks.workunit.client.1.smithi193.stdout:8/359: symlink d2/d20/d23/d51/l79 0 2024-09-04T16:30:06.989 INFO:tasks.workunit.client.1.smithi193.stdout:5/345: fsync d1/f16 0 2024-09-04T16:30:06.989 INFO:tasks.workunit.client.1.smithi193.stdout:2/332: dread d2/d9/d18/f37 [0,4194304] 0 2024-09-04T16:30:06.992 INFO:tasks.workunit.client.1.smithi193.stdout:9/422: truncate d2/d4/f5 1504605 0 2024-09-04T16:30:06.994 INFO:tasks.workunit.client.1.smithi193.stdout:1/401: sync 2024-09-04T16:30:06.994 INFO:tasks.workunit.client.1.smithi193.stdout:7/434: sync 2024-09-04T16:30:06.996 INFO:tasks.workunit.client.1.smithi193.stdout:9/423: chown d2/d18/d2f/d22/d30/l4a 1 1 2024-09-04T16:30:06.996 INFO:tasks.workunit.client.1.smithi193.stdout:8/360: dwrite d2/d12/f19 [0,4194304] 0 2024-09-04T16:30:06.996 INFO:tasks.workunit.client.1.smithi193.stdout:4/285: dwrite d3/d1a/d21/f34 [0,4194304] 0 2024-09-04T16:30:06.997 INFO:tasks.workunit.client.1.smithi193.stdout:1/402: stat d1/d2b/l9 0 2024-09-04T16:30:06.999 INFO:tasks.workunit.client.1.smithi193.stdout:8/361: chown d2/d20/d23/d24/d3c/d65/f72 947195 1 2024-09-04T16:30:07.000 INFO:tasks.workunit.client.1.smithi193.stdout:2/333: dwrite d2/f2a [0,4194304] 0 2024-09-04T16:30:07.000 INFO:tasks.workunit.client.1.smithi193.stdout:6/302: rename d5/d27/d3e/d49/f50 to d5/f5e 0 2024-09-04T16:30:07.008 INFO:tasks.workunit.client.1.smithi193.stdout:3/380: rmdir d0/d7/de/d45 39 2024-09-04T16:30:07.008 INFO:tasks.workunit.client.1.smithi193.stdout:8/362: read - d2/d20/d23/d34/d4b/f4f zero size 2024-09-04T16:30:07.010 INFO:tasks.workunit.client.1.smithi193.stdout:6/303: read d5/d27/f35 [3961267,12694] 0 2024-09-04T16:30:07.021 INFO:tasks.workunit.client.1.smithi193.stdout:7/435: unlink d9/d18/d22/c7b 0 2024-09-04T16:30:07.021 INFO:tasks.workunit.client.1.smithi193.stdout:7/436: stat d9/d39/d3e/d4a/f4b 0 2024-09-04T16:30:07.022 INFO:tasks.workunit.client.1.smithi193.stdout:7/437: write d9/d18/d22/d2b/f91 [1047644,14261] 0 2024-09-04T16:30:07.023 INFO:tasks.workunit.client.1.smithi193.stdout:7/438: chown d9/de/d27/f3d 2 1 2024-09-04T16:30:07.030 INFO:tasks.workunit.client.1.smithi193.stdout:6/304: mkdir d5/de/d15/d1b/d5f 0 2024-09-04T16:30:07.031 INFO:tasks.workunit.client.1.smithi193.stdout:3/381: dwrite d0/d18/d1c/d51/f56 [4194304,4194304] 0 2024-09-04T16:30:07.039 INFO:tasks.workunit.client.1.smithi193.stdout:7/439: dread d9/d18/d22/d2b/f5f [0,4194304] 0 2024-09-04T16:30:07.039 INFO:tasks.workunit.client.1.smithi193.stdout:9/424: read d2/d4/f5 [1366710,109469] 0 2024-09-04T16:30:07.040 INFO:tasks.workunit.client.1.smithi193.stdout:9/425: write d2/f28 [6488991,79444] 0 2024-09-04T16:30:07.041 INFO:tasks.workunit.client.1.smithi193.stdout:9/426: dread - d2/d56/f75 zero size 2024-09-04T16:30:07.044 INFO:tasks.workunit.client.1.smithi193.stdout:9/427: stat d2/l82 0 2024-09-04T16:30:07.049 INFO:tasks.workunit.client.1.smithi193.stdout:4/286: write d3/d1a/d2a/f2d [5388368,74016] 0 2024-09-04T16:30:07.049 INFO:tasks.workunit.client.1.smithi193.stdout:1/403: getdents d1 0 2024-09-04T16:30:07.050 INFO:tasks.workunit.client.1.smithi193.stdout:1/404: write d1/d2b/d10/d2a/f7b [859079,24680] 0 2024-09-04T16:30:07.055 INFO:tasks.workunit.client.1.smithi193.stdout:9/428: unlink d2/d18/d2f/f29 0 2024-09-04T16:30:07.056 INFO:tasks.workunit.client.1.smithi193.stdout:9/429: chown d2/d18/d2f/d22/d30/d6a/f79 0 1 2024-09-04T16:30:07.058 INFO:tasks.workunit.client.1.smithi193.stdout:3/382: link d0/d18/d1b/f36 d0/d9/d49/d7b/f82 0 2024-09-04T16:30:07.059 INFO:tasks.workunit.client.1.smithi193.stdout:2/334: getdents d2/d9/db/d10/d1f/d4a 0 2024-09-04T16:30:07.061 INFO:tasks.workunit.client.1.smithi193.stdout:7/440: truncate d9/de/f49 1260619 0 2024-09-04T16:30:07.062 INFO:tasks.workunit.client.1.smithi193.stdout:7/441: chown d9/d18/d22 855671 1 2024-09-04T16:30:07.076 INFO:tasks.workunit.client.1.smithi193.stdout:0/382: sync 2024-09-04T16:30:07.077 INFO:tasks.workunit.client.0.smithi170.stdout:4/149: rename d1/d26 to d1/d6/d2b/d33/d36 0 2024-09-04T16:30:07.079 INFO:tasks.workunit.client.0.smithi170.stdout:7/60: symlink d12/l17 0 2024-09-04T16:30:07.081 INFO:tasks.workunit.client.1.smithi193.stdout:8/363: truncate d2/d20/d23/d1b/f48 2828789 0 2024-09-04T16:30:07.081 INFO:tasks.workunit.client.0.smithi170.stdout:6/112: symlink d0/l27 0 2024-09-04T16:30:07.082 INFO:tasks.workunit.client.1.smithi193.stdout:3/383: rmdir d0/d18 39 2024-09-04T16:30:07.082 INFO:tasks.workunit.client.1.smithi193.stdout:6/305: write d5/d33/d4e/d51/f54 [2454395,36020] 0 2024-09-04T16:30:07.082 INFO:tasks.workunit.client.1.smithi193.stdout:2/335: unlink d2/d14/c58 0 2024-09-04T16:30:07.082 INFO:tasks.workunit.client.1.smithi193.stdout:1/405: rename d1/l3c to d1/d2b/db/d54/d63/l80 0 2024-09-04T16:30:07.083 INFO:tasks.workunit.client.1.smithi193.stdout:6/306: readlink d5/de/d15/l2e 0 2024-09-04T16:30:07.084 INFO:tasks.workunit.client.1.smithi193.stdout:9/430: mkdir d2/d8/d88 0 2024-09-04T16:30:07.086 INFO:tasks.workunit.client.1.smithi193.stdout:9/431: write d2/f42 [3774805,81873] 0 2024-09-04T16:30:07.087 INFO:tasks.workunit.client.1.smithi193.stdout:6/307: write d5/de/d15/d1b/f1e [2789457,129470] 0 2024-09-04T16:30:07.088 INFO:tasks.workunit.client.1.smithi193.stdout:8/364: creat d2/d12/f7a x:0 0 0 2024-09-04T16:30:07.088 INFO:tasks.workunit.client.1.smithi193.stdout:8/365: readlink l1 0 2024-09-04T16:30:07.089 INFO:tasks.workunit.client.0.smithi170.stdout:4/150: mknod d1/d6/d22/c37 0 2024-09-04T16:30:07.090 INFO:tasks.workunit.client.0.smithi170.stdout:6/113: creat d0/df/f28 x:0 0 0 2024-09-04T16:30:07.091 INFO:tasks.workunit.client.1.smithi193.stdout:9/432: truncate d2/d8/d4d/f69 677398 0 2024-09-04T16:30:07.091 INFO:tasks.workunit.client.1.smithi193.stdout:7/442: dwrite d9/d39/d3e/f3f [0,4194304] 0 2024-09-04T16:30:07.092 INFO:tasks.workunit.client.1.smithi193.stdout:2/336: dwrite d2/fc [4194304,4194304] 0 2024-09-04T16:30:07.092 INFO:tasks.workunit.client.0.smithi170.stdout:4/151: symlink d1/d6/l38 0 2024-09-04T16:30:07.096 INFO:tasks.workunit.client.0.smithi170.stdout:6/114: dread d0/d17/f18 [0,4194304] 0 2024-09-04T16:30:07.098 INFO:tasks.workunit.client.1.smithi193.stdout:1/406: unlink d1/d2b/db/f7c 0 2024-09-04T16:30:07.099 INFO:tasks.workunit.client.1.smithi193.stdout:1/407: chown d1/d2b/db 3071764 1 2024-09-04T16:30:07.101 INFO:tasks.workunit.client.0.smithi170.stdout:6/115: creat d0/df/d1b/f29 x:0 0 0 2024-09-04T16:30:07.104 INFO:tasks.workunit.client.1.smithi193.stdout:1/408: dwrite d1/d2b/d10/f1f [8388608,4194304] 0 2024-09-04T16:30:07.106 INFO:tasks.workunit.client.1.smithi193.stdout:6/308: unlink d5/f20 0 2024-09-04T16:30:07.108 INFO:tasks.workunit.client.0.smithi170.stdout:6/116: mkdir d0/d17/d2a 0 2024-09-04T16:30:07.111 INFO:tasks.workunit.client.1.smithi193.stdout:6/309: dread d5/fb [0,4194304] 0 2024-09-04T16:30:07.112 INFO:tasks.workunit.client.1.smithi193.stdout:8/366: write d2/d20/d23/d1b/f28 [2331020,95401] 0 2024-09-04T16:30:07.112 INFO:tasks.workunit.client.1.smithi193.stdout:6/310: chown d5/d27/d3e/d43/c36 20455 1 2024-09-04T16:30:07.114 INFO:tasks.workunit.client.1.smithi193.stdout:6/311: write d5/d33/f4c [474160,13596] 0 2024-09-04T16:30:07.114 INFO:tasks.workunit.client.1.smithi193.stdout:6/312: fdatasync d5/ff 0 2024-09-04T16:30:07.115 INFO:tasks.workunit.client.1.smithi193.stdout:7/443: rmdir d9/de/d27/d62 39 2024-09-04T16:30:07.116 INFO:tasks.workunit.client.1.smithi193.stdout:3/384: read d0/d18/d1c/d30/f33 [2541319,69885] 0 2024-09-04T16:30:07.119 INFO:tasks.workunit.client.1.smithi193.stdout:2/337: creat d2/d9/db/f75 x:0 0 0 2024-09-04T16:30:07.119 INFO:tasks.workunit.client.1.smithi193.stdout:5/346: sync 2024-09-04T16:30:07.127 INFO:tasks.workunit.client.1.smithi193.stdout:6/313: mknod d5/d27/d3e/d49/c60 0 2024-09-04T16:30:07.128 INFO:tasks.workunit.client.1.smithi193.stdout:6/314: truncate d5/d33/d4e/f59 316979 0 2024-09-04T16:30:07.130 INFO:tasks.workunit.client.1.smithi193.stdout:2/338: mknod d2/d9/db/d10/d1f/d4a/c76 0 2024-09-04T16:30:07.132 INFO:tasks.workunit.client.1.smithi193.stdout:5/347: rename d1/d29/d1e/d37/d3f/d4f/f4a to d1/d29/d1e/d37/d3f/d4f/f66 0 2024-09-04T16:30:07.133 INFO:tasks.workunit.client.1.smithi193.stdout:6/315: dwrite d5/de/f45 [0,4194304] 0 2024-09-04T16:30:07.137 INFO:tasks.workunit.client.1.smithi193.stdout:3/385: rename d0/d18/d1c/d30/f76 to d0/d9/f83 0 2024-09-04T16:30:07.139 INFO:tasks.workunit.client.0.smithi170.stdout:7/61: write ff [4313785,45424] 0 2024-09-04T16:30:07.139 INFO:tasks.workunit.client.1.smithi193.stdout:2/339: dwrite d2/d9/db/d10/d1f/f42 [0,4194304] 0 2024-09-04T16:30:07.142 INFO:tasks.workunit.client.1.smithi193.stdout:6/316: creat d5/d27/d3e/d43/f61 x:0 0 0 2024-09-04T16:30:07.144 INFO:tasks.workunit.client.0.smithi170.stdout:7/62: creat d12/f18 x:0 0 0 2024-09-04T16:30:07.144 INFO:tasks.workunit.client.0.smithi170.stdout:7/63: dread - fc zero size 2024-09-04T16:30:07.146 INFO:tasks.workunit.client.0.smithi170.stdout:7/64: dread d12/f14 [0,4194304] 0 2024-09-04T16:30:07.147 INFO:tasks.workunit.client.0.smithi170.stdout:7/65: write f1 [5680309,31011] 0 2024-09-04T16:30:07.148 INFO:tasks.workunit.client.1.smithi193.stdout:5/348: dwrite d1/d8/db/d15/f47 [0,4194304] 0 2024-09-04T16:30:07.148 INFO:tasks.workunit.client.0.smithi170.stdout:7/66: write f7 [636281,94624] 0 2024-09-04T16:30:07.149 INFO:tasks.workunit.client.0.smithi170.stdout:0/87: truncate d11/d13/f20 15660 0 2024-09-04T16:30:07.149 INFO:tasks.workunit.client.1.smithi193.stdout:1/409: getdents d1/d2b/db/d54/d63 0 2024-09-04T16:30:07.150 INFO:tasks.workunit.client.1.smithi193.stdout:7/444: getdents d9/d39/d3e 0 2024-09-04T16:30:07.153 INFO:tasks.workunit.client.1.smithi193.stdout:7/445: write d9/d18/f4c [407519,14054] 0 2024-09-04T16:30:07.156 INFO:tasks.workunit.client.0.smithi170.stdout:0/88: rename f5 to d11/f23 0 2024-09-04T16:30:07.157 INFO:tasks.workunit.client.0.smithi170.stdout:0/89: chown d11/f1c 264408663 1 2024-09-04T16:30:07.157 INFO:tasks.workunit.client.0.smithi170.stdout:0/90: fdatasync d11/f15 0 2024-09-04T16:30:07.158 INFO:tasks.workunit.client.1.smithi193.stdout:3/386: dread d0/d18/d1b/f3f [0,4194304] 0 2024-09-04T16:30:07.159 INFO:tasks.workunit.client.1.smithi193.stdout:1/410: rmdir d1/d2b/d1b/d51/d6d 39 2024-09-04T16:30:07.160 INFO:tasks.workunit.client.1.smithi193.stdout:1/411: write d1/d2b/f45 [3447126,97173] 0 2024-09-04T16:30:07.160 INFO:tasks.workunit.client.1.smithi193.stdout:1/412: read d1/f34 [608025,17310] 0 2024-09-04T16:30:07.165 INFO:tasks.workunit.client.0.smithi170.stdout:0/91: dwrite fd [0,4194304] 0 2024-09-04T16:30:07.170 INFO:tasks.workunit.client.0.smithi170.stdout:6/117: truncate d0/df/f10 554155 0 2024-09-04T16:30:07.172 INFO:tasks.workunit.client.0.smithi170.stdout:6/118: truncate d0/df/fb 419571 0 2024-09-04T16:30:07.173 INFO:tasks.workunit.client.1.smithi193.stdout:4/287: sync 2024-09-04T16:30:07.174 INFO:tasks.workunit.client.1.smithi193.stdout:4/288: read d3/d3c/f58 [504079,51674] 0 2024-09-04T16:30:07.174 INFO:tasks.workunit.client.1.smithi193.stdout:7/446: mkdir d9/d18/d22/d2b/d96 0 2024-09-04T16:30:07.175 INFO:tasks.workunit.client.1.smithi193.stdout:0/383: truncate d18/d25/d3b/f75 7274476 0 2024-09-04T16:30:07.176 INFO:tasks.workunit.client.1.smithi193.stdout:3/387: dread d0/d7/fc [0,4194304] 0 2024-09-04T16:30:07.176 INFO:tasks.workunit.client.0.smithi170.stdout:6/119: truncate d0/f2 2414273 0 2024-09-04T16:30:07.176 INFO:tasks.workunit.client.0.smithi170.stdout:6/120: readlink d0/df/d1f/l20 0 2024-09-04T16:30:07.177 INFO:tasks.workunit.client.1.smithi193.stdout:7/447: truncate d9/d18/d22/d2b/d6c/d70/f8d 251369 0 2024-09-04T16:30:07.178 INFO:tasks.workunit.client.1.smithi193.stdout:7/448: truncate d9/d18/d1e/f71 648113 0 2024-09-04T16:30:07.178 INFO:tasks.workunit.client.1.smithi193.stdout:9/433: truncate d2/d8/d4d/f69 31097 0 2024-09-04T16:30:07.181 INFO:tasks.workunit.client.1.smithi193.stdout:1/413: rmdir d1/d2b/d1b/d28/d50 39 2024-09-04T16:30:07.182 INFO:tasks.workunit.client.1.smithi193.stdout:8/367: truncate d2/d20/d23/d24/d3c/d65/f74 294928 0 2024-09-04T16:30:07.183 INFO:tasks.workunit.client.1.smithi193.stdout:8/368: write d2/d20/d23/d24/d3c/d65/f72 [954223,130036] 0 2024-09-04T16:30:07.184 INFO:tasks.workunit.client.1.smithi193.stdout:6/317: creat d5/de/d15/f62 x:0 0 0 2024-09-04T16:30:07.187 INFO:tasks.workunit.client.0.smithi170.stdout:6/121: dwrite d0/d17/f18 [0,4194304] 0 2024-09-04T16:30:07.187 INFO:tasks.workunit.client.1.smithi193.stdout:5/349: link d1/d29/d1e/d37/f63 d1/d29/d1e/d37/f67 0 2024-09-04T16:30:07.189 INFO:tasks.workunit.client.1.smithi193.stdout:4/289: mknod d3/d1a/d2a/c60 0 2024-09-04T16:30:07.197 INFO:tasks.workunit.client.1.smithi193.stdout:7/449: mknod d9/d18/d22/d2b/c97 0 2024-09-04T16:30:07.197 INFO:tasks.workunit.client.0.smithi170.stdout:7/67: truncate f1 4592767 0 2024-09-04T16:30:07.198 INFO:tasks.workunit.client.1.smithi193.stdout:1/414: mknod d1/d2b/db/c81 0 2024-09-04T16:30:07.199 INFO:tasks.workunit.client.1.smithi193.stdout:8/369: chown d2/d20/c5c 63 1 2024-09-04T16:30:07.199 INFO:tasks.workunit.client.1.smithi193.stdout:2/340: truncate d2/d9/db/f2e 824144 0 2024-09-04T16:30:07.202 INFO:tasks.workunit.client.0.smithi170.stdout:7/68: fdatasync fa 0 2024-09-04T16:30:07.203 INFO:tasks.workunit.client.1.smithi193.stdout:8/370: dread d2/d20/d23/d24/d3c/d65/f72 [0,4194304] 0 2024-09-04T16:30:07.203 INFO:tasks.workunit.client.0.smithi170.stdout:7/69: fdatasync f7 0 2024-09-04T16:30:07.204 INFO:tasks.workunit.client.1.smithi193.stdout:4/290: symlink d3/d39/l61 0 2024-09-04T16:30:07.205 INFO:tasks.workunit.client.1.smithi193.stdout:4/291: chown d3/d3c/d47/c51 472 1 2024-09-04T16:30:07.207 INFO:tasks.workunit.client.0.smithi170.stdout:7/70: dread ff [0,4194304] 0 2024-09-04T16:30:07.208 INFO:tasks.workunit.client.1.smithi193.stdout:3/388: mknod d0/d10/d24/d55/c84 0 2024-09-04T16:30:07.208 INFO:tasks.workunit.client.0.smithi170.stdout:7/71: chown c3 17986 1 2024-09-04T16:30:07.211 INFO:tasks.workunit.client.1.smithi193.stdout:9/434: symlink d2/d18/d2f/d22/d30/l89 0 2024-09-04T16:30:07.213 INFO:tasks.workunit.client.1.smithi193.stdout:1/415: creat d1/d2b/db/f82 x:0 0 0 2024-09-04T16:30:07.216 INFO:tasks.workunit.client.1.smithi193.stdout:7/450: dread d9/de/d27/f52 [0,4194304] 0 2024-09-04T16:30:07.217 INFO:tasks.workunit.client.1.smithi193.stdout:6/318: creat d5/de/d15/d1b/d5f/f63 x:0 0 0 2024-09-04T16:30:07.217 INFO:tasks.workunit.client.1.smithi193.stdout:7/451: write d9/d39/d3e/d4d/f6a [3949704,1054] 0 2024-09-04T16:30:07.218 INFO:tasks.workunit.client.1.smithi193.stdout:7/452: fdatasync d9/d39/d3e/f7c 0 2024-09-04T16:30:07.218 INFO:tasks.workunit.client.1.smithi193.stdout:5/350: getdents d1/d29/d1e/d37/d58 0 2024-09-04T16:30:07.225 INFO:tasks.workunit.client.1.smithi193.stdout:9/435: creat d2/d56/f8a x:0 0 0 2024-09-04T16:30:07.226 INFO:tasks.workunit.client.0.smithi170.stdout:0/92: dwrite d11/d13/f20 [0,4194304] 0 2024-09-04T16:30:07.227 INFO:tasks.workunit.client.1.smithi193.stdout:1/416: write d1/d2b/d10/f21 [596462,77841] 0 2024-09-04T16:30:07.232 INFO:tasks.workunit.client.0.smithi170.stdout:0/93: creat d11/d13/f24 x:0 0 0 2024-09-04T16:30:07.233 INFO:tasks.workunit.client.1.smithi193.stdout:2/341: mkdir d2/d9/db/d10/d1f/d77 0 2024-09-04T16:30:07.233 INFO:tasks.workunit.client.0.smithi170.stdout:6/122: write d0/df/f10 [1305234,119022] 0 2024-09-04T16:30:07.236 INFO:tasks.workunit.client.0.smithi170.stdout:0/94: creat d11/f25 x:0 0 0 2024-09-04T16:30:07.241 INFO:tasks.workunit.client.0.smithi170.stdout:0/95: rename d11/d13/d1a/l1d to d11/l26 0 2024-09-04T16:30:07.241 INFO:tasks.workunit.client.1.smithi193.stdout:7/453: mkdir d9/d39/d3e/d4d/d98 0 2024-09-04T16:30:07.249 INFO:tasks.workunit.client.0.smithi170.stdout:0/96: creat d11/f27 x:0 0 0 2024-09-04T16:30:07.249 INFO:tasks.workunit.client.0.smithi170.stdout:0/97: dread fe [0,4194304] 0 2024-09-04T16:30:07.249 INFO:tasks.workunit.client.0.smithi170.stdout:0/98: truncate d11/f18 611324 0 2024-09-04T16:30:07.250 INFO:tasks.workunit.client.1.smithi193.stdout:8/371: mknod d2/c7b 0 2024-09-04T16:30:07.250 INFO:tasks.workunit.client.1.smithi193.stdout:0/384: getdents d18/d25/d5f 0 2024-09-04T16:30:07.250 INFO:tasks.workunit.client.0.smithi170.stdout:0/99: creat d11/d13/f28 x:0 0 0 2024-09-04T16:30:07.250 INFO:tasks.workunit.client.0.smithi170.stdout:0/100: fsync d11/f1c 0 2024-09-04T16:30:07.251 INFO:tasks.workunit.client.0.smithi170.stdout:7/72: truncate ff 1783100 0 2024-09-04T16:30:07.252 INFO:tasks.workunit.client.1.smithi193.stdout:9/436: symlink d2/d18/d2f/d22/d30/d52/l8b 0 2024-09-04T16:30:07.253 INFO:tasks.workunit.client.1.smithi193.stdout:1/417: mkdir d1/d83 0 2024-09-04T16:30:07.254 INFO:tasks.workunit.client.1.smithi193.stdout:2/342: rmdir d2 39 2024-09-04T16:30:07.255 INFO:tasks.workunit.client.1.smithi193.stdout:1/418: read - d1/d2b/d10/f59 zero size 2024-09-04T16:30:07.256 INFO:tasks.workunit.client.0.smithi170.stdout:0/101: creat d11/f29 x:0 0 0 2024-09-04T16:30:07.260 INFO:tasks.workunit.client.1.smithi193.stdout:4/292: dwrite d3/f16 [0,4194304] 0 2024-09-04T16:30:07.261 INFO:tasks.workunit.client.1.smithi193.stdout:3/389: dwrite d0/d9/fb [0,4194304] 0 2024-09-04T16:30:07.261 INFO:tasks.workunit.client.1.smithi193.stdout:4/293: dread - d3/d1a/d21/f37 zero size 2024-09-04T16:30:07.263 INFO:tasks.workunit.client.0.smithi170.stdout:0/102: dwrite d11/d13/f24 [0,4194304] 0 2024-09-04T16:30:07.264 INFO:tasks.workunit.client.1.smithi193.stdout:1/419: dread d1/d39/f67 [0,4194304] 0 2024-09-04T16:30:07.266 INFO:tasks.workunit.client.1.smithi193.stdout:8/372: write d2/f31 [726750,127621] 0 2024-09-04T16:30:07.269 INFO:tasks.workunit.client.0.smithi170.stdout:0/103: dread f4 [0,4194304] 0 2024-09-04T16:30:07.270 INFO:tasks.workunit.client.1.smithi193.stdout:6/319: dwrite d5/de/d15/f24 [0,4194304] 0 2024-09-04T16:30:07.270 INFO:tasks.workunit.client.0.smithi170.stdout:0/104: chown d11/f15 6 1 2024-09-04T16:30:07.272 INFO:tasks.workunit.client.1.smithi193.stdout:9/437: dread d2/f6 [0,4194304] 0 2024-09-04T16:30:07.273 INFO:tasks.workunit.client.1.smithi193.stdout:5/351: write d1/d29/f1d [2943334,101303] 0 2024-09-04T16:30:07.280 INFO:tasks.workunit.client.0.smithi170.stdout:0/105: unlink d11/d13/d1a/f21 0 2024-09-04T16:30:07.284 INFO:tasks.workunit.client.0.smithi170.stdout:6/123: dwrite d0/d17/f1d [0,4194304] 0 2024-09-04T16:30:07.285 INFO:tasks.workunit.client.0.smithi170.stdout:6/124: dread - d0/f5 zero size 2024-09-04T16:30:07.286 INFO:tasks.workunit.client.0.smithi170.stdout:7/73: dread ff [0,4194304] 0 2024-09-04T16:30:07.287 INFO:tasks.workunit.client.0.smithi170.stdout:7/74: dread - d12/f18 zero size 2024-09-04T16:30:07.289 INFO:tasks.workunit.client.0.smithi170.stdout:0/106: dread d11/f15 [0,4194304] 0 2024-09-04T16:30:07.289 INFO:tasks.workunit.client.1.smithi193.stdout:8/373: mkdir d2/d20/d23/d34/d4b/d7c 0 2024-09-04T16:30:07.293 INFO:tasks.workunit.client.1.smithi193.stdout:6/320: symlink d5/d27/d3e/d43/l64 0 2024-09-04T16:30:07.294 INFO:tasks.workunit.client.0.smithi170.stdout:0/107: mkdir d11/d2a 0 2024-09-04T16:30:07.295 INFO:tasks.workunit.client.1.smithi193.stdout:9/438: rmdir d2/d8/d25 39 2024-09-04T16:30:07.298 INFO:tasks.workunit.client.0.smithi170.stdout:0/108: dread d11/d13/f20 [0,4194304] 0 2024-09-04T16:30:07.300 INFO:tasks.workunit.client.1.smithi193.stdout:7/454: truncate d9/de/f1f 122878 0 2024-09-04T16:30:07.301 INFO:tasks.workunit.client.1.smithi193.stdout:1/420: mkdir d1/d2b/d1b/d28/d50/d84 0 2024-09-04T16:30:07.303 INFO:tasks.workunit.client.0.smithi170.stdout:0/109: unlink d11/f27 0 2024-09-04T16:30:07.304 INFO:tasks.workunit.client.1.smithi193.stdout:4/294: write d3/f2f [143688,44065] 0 2024-09-04T16:30:07.304 INFO:tasks.workunit.client.1.smithi193.stdout:8/374: readlink d2/d12/l75 0 2024-09-04T16:30:07.308 INFO:tasks.workunit.client.1.smithi193.stdout:6/321: creat d5/de/d15/d48/f65 x:0 0 0 2024-09-04T16:30:07.308 INFO:tasks.workunit.client.0.smithi170.stdout:0/110: symlink d11/d2a/l2b 0 2024-09-04T16:30:07.309 INFO:tasks.workunit.client.1.smithi193.stdout:8/375: dread d2/d20/d23/d1b/d4e/f56 [0,4194304] 0 2024-09-04T16:30:07.311 INFO:tasks.workunit.client.1.smithi193.stdout:5/352: symlink d1/d29/d1e/d37/d3f/l68 0 2024-09-04T16:30:07.312 INFO:tasks.workunit.client.1.smithi193.stdout:8/376: dread d2/d20/d23/f1d [0,4194304] 0 2024-09-04T16:30:07.313 INFO:tasks.workunit.client.0.smithi170.stdout:0/111: symlink d11/d13/d1a/l2c 0 2024-09-04T16:30:07.314 INFO:tasks.workunit.client.1.smithi193.stdout:7/455: rename d9/d18/d22/l60 to d9/de/l99 0 2024-09-04T16:30:07.315 INFO:tasks.workunit.client.0.smithi170.stdout:7/75: dwrite d12/f14 [0,4194304] 0 2024-09-04T16:30:07.319 INFO:tasks.workunit.client.0.smithi170.stdout:0/112: rename l10 to d11/l2d 0 2024-09-04T16:30:07.320 INFO:tasks.workunit.client.0.smithi170.stdout:0/113: chown d11/d13/d1a/l1b 8634200 1 2024-09-04T16:30:07.322 INFO:tasks.workunit.client.1.smithi193.stdout:2/343: creat d2/d9/db/d10/d1e/f78 x:0 0 0 2024-09-04T16:30:07.323 INFO:tasks.workunit.client.0.smithi170.stdout:7/76: mknod d12/d15/c19 0 2024-09-04T16:30:07.324 INFO:tasks.workunit.client.0.smithi170.stdout:7/77: write d12/f14 [289428,111702] 0 2024-09-04T16:30:07.324 INFO:tasks.workunit.client.1.smithi193.stdout:6/322: creat d5/d33/d4e/d51/f66 x:0 0 0 2024-09-04T16:30:07.325 INFO:tasks.workunit.client.0.smithi170.stdout:7/78: write f7 [1675719,108347] 0 2024-09-04T16:30:07.327 INFO:tasks.workunit.client.0.smithi170.stdout:0/114: unlink lc 0 2024-09-04T16:30:07.328 INFO:tasks.workunit.client.1.smithi193.stdout:9/439: truncate d2/d4/f23 575534 0 2024-09-04T16:30:07.330 INFO:tasks.workunit.client.1.smithi193.stdout:3/390: getdents d0/d7 0 2024-09-04T16:30:07.331 INFO:tasks.workunit.client.0.smithi170.stdout:7/79: creat d12/f1a x:0 0 0 2024-09-04T16:30:07.334 INFO:tasks.workunit.client.1.smithi193.stdout:9/440: dwrite d2/d56/f75 [0,4194304] 0 2024-09-04T16:30:07.335 INFO:tasks.workunit.client.1.smithi193.stdout:9/441: truncate d2/f28 8637750 0 2024-09-04T16:30:07.336 INFO:tasks.workunit.client.0.smithi170.stdout:7/80: symlink d12/l1b 0 2024-09-04T16:30:07.336 INFO:tasks.workunit.client.1.smithi193.stdout:9/442: truncate d2/d18/d2f/f45 1559797 0 2024-09-04T16:30:07.337 INFO:tasks.workunit.client.1.smithi193.stdout:1/421: write d1/d2b/f2e [234128,102270] 0 2024-09-04T16:30:07.338 INFO:tasks.workunit.client.1.smithi193.stdout:8/377: dread d2/d20/d23/d34/d46/f5e [0,4194304] 0 2024-09-04T16:30:07.339 INFO:tasks.workunit.client.1.smithi193.stdout:4/295: symlink d3/d39/d44/l62 0 2024-09-04T16:30:07.341 INFO:tasks.workunit.client.0.smithi170.stdout:7/81: rename le to d12/d16/l1c 0 2024-09-04T16:30:07.345 INFO:tasks.workunit.client.0.smithi170.stdout:7/82: fdatasync fa 0 2024-09-04T16:30:07.346 INFO:tasks.workunit.client.1.smithi193.stdout:0/385: sync 2024-09-04T16:30:07.347 INFO:tasks.workunit.client.1.smithi193.stdout:6/323: rmdir d5/de/d15/d1b 39 2024-09-04T16:30:07.350 INFO:tasks.workunit.client.1.smithi193.stdout:3/391: symlink d0/d10/d24/d55/l85 0 2024-09-04T16:30:07.351 INFO:tasks.workunit.client.1.smithi193.stdout:3/392: read d0/d18/d1c/d25/f78 [2113006,97026] 0 2024-09-04T16:30:07.353 INFO:tasks.workunit.client.0.smithi170.stdout:7/83: mkdir d12/d16/d1d 0 2024-09-04T16:30:07.356 INFO:tasks.workunit.client.1.smithi193.stdout:7/456: mkdir d9/d39/d3e/d4d/d98/d9a 0 2024-09-04T16:30:07.357 INFO:tasks.workunit.client.1.smithi193.stdout:9/443: creat d2/d8/d15/f8c x:0 0 0 2024-09-04T16:30:07.357 INFO:tasks.workunit.client.1.smithi193.stdout:9/444: fsync d2/d56/f76 0 2024-09-04T16:30:07.359 INFO:tasks.workunit.client.1.smithi193.stdout:2/344: write d2/d9/db/d10/d38/f70 [2848515,47943] 0 2024-09-04T16:30:07.360 INFO:tasks.workunit.client.1.smithi193.stdout:1/422: symlink d1/d2b/l85 0 2024-09-04T16:30:07.361 INFO:tasks.workunit.client.0.smithi170.stdout:0/115: dwrite fe [0,4194304] 0 2024-09-04T16:30:07.365 INFO:tasks.workunit.client.1.smithi193.stdout:4/296: mknod d3/d3c/c63 0 2024-09-04T16:30:07.366 INFO:tasks.workunit.client.0.smithi170.stdout:7/84: dwrite fc [0,4194304] 0 2024-09-04T16:30:07.368 INFO:tasks.workunit.client.0.smithi170.stdout:0/116: creat d11/d13/d1a/f2e x:0 0 0 2024-09-04T16:30:07.369 INFO:tasks.workunit.client.1.smithi193.stdout:5/353: truncate d1/d29/d1e/d37/d3f/d4f/d3e/f41 803173 0 2024-09-04T16:30:07.371 INFO:tasks.workunit.client.1.smithi193.stdout:6/324: truncate d5/de/d15/d1b/f53 439527 0 2024-09-04T16:30:07.374 INFO:tasks.workunit.client.0.smithi170.stdout:7/85: symlink d12/d16/d1d/l1e 0 2024-09-04T16:30:07.377 INFO:tasks.workunit.client.1.smithi193.stdout:3/393: rename d0/d9/l19 to d0/d9/d49/d7b/l86 0 2024-09-04T16:30:07.377 INFO:tasks.workunit.client.0.smithi170.stdout:0/117: dwrite d11/f29 [0,4194304] 0 2024-09-04T16:30:07.381 INFO:tasks.workunit.client.0.smithi170.stdout:7/86: creat d12/d16/f1f x:0 0 0 2024-09-04T16:30:07.385 INFO:tasks.workunit.client.0.smithi170.stdout:0/118: mkdir d11/d13/d2f 0 2024-09-04T16:30:07.386 INFO:tasks.workunit.client.1.smithi193.stdout:1/423: symlink d1/d2b/db/d54/d63/l86 0 2024-09-04T16:30:07.386 INFO:tasks.workunit.client.0.smithi170.stdout:0/119: write f0 [2078795,113081] 0 2024-09-04T16:30:07.389 INFO:tasks.workunit.client.1.smithi193.stdout:0/386: mknod d18/d25/c85 0 2024-09-04T16:30:07.390 INFO:tasks.workunit.client.1.smithi193.stdout:6/325: fdatasync d5/de/d15/d1b/f53 0 2024-09-04T16:30:07.391 INFO:tasks.workunit.client.1.smithi193.stdout:1/424: dwrite d1/d2b/d10/f1f [0,4194304] 0 2024-09-04T16:30:07.391 INFO:tasks.workunit.client.1.smithi193.stdout:6/326: write d5/f6 [4312004,114526] 0 2024-09-04T16:30:07.393 INFO:tasks.workunit.client.0.smithi170.stdout:0/120: rename d11/f16 to d11/d13/f30 0 2024-09-04T16:30:07.397 INFO:tasks.workunit.client.0.smithi170.stdout:7/87: getdents d12/d16 0 2024-09-04T16:30:07.398 INFO:tasks.workunit.client.1.smithi193.stdout:6/327: dwrite d5/de/f45 [0,4194304] 0 2024-09-04T16:30:07.399 INFO:tasks.workunit.client.1.smithi193.stdout:5/354: rename d1/d29/d1e/d37/d3f/d4f to d1/d29/d69 0 2024-09-04T16:30:07.400 INFO:tasks.workunit.client.0.smithi170.stdout:7/88: write d12/d16/f1f [885872,125055] 0 2024-09-04T16:30:07.406 INFO:tasks.workunit.client.0.smithi170.stdout:0/121: dwrite d11/d13/f24 [0,4194304] 0 2024-09-04T16:30:07.408 INFO:tasks.workunit.client.1.smithi193.stdout:9/445: mknod d2/d18/d2f/d22/d30/c8d 0 2024-09-04T16:30:07.409 INFO:tasks.workunit.client.1.smithi193.stdout:2/345: mkdir d2/d9/db/d10/d51/d79 0 2024-09-04T16:30:07.409 INFO:tasks.workunit.client.0.smithi170.stdout:7/89: symlink d12/d16/l20 0 2024-09-04T16:30:07.410 INFO:tasks.workunit.client.1.smithi193.stdout:9/446: dread - d2/d8/d61/f87 zero size 2024-09-04T16:30:07.413 INFO:tasks.workunit.client.1.smithi193.stdout:2/346: dread d2/d9/d18/f28 [4194304,4194304] 0 2024-09-04T16:30:07.416 INFO:tasks.workunit.client.0.smithi170.stdout:0/122: link d11/f29 d11/d13/d2f/f31 0 2024-09-04T16:30:07.417 INFO:tasks.workunit.client.0.smithi170.stdout:0/123: fdatasync fe 0 2024-09-04T16:30:07.417 INFO:tasks.workunit.client.1.smithi193.stdout:7/457: creat d9/d18/f9b x:0 0 0 2024-09-04T16:30:07.418 INFO:tasks.workunit.client.0.smithi170.stdout:0/124: fdatasync d11/f25 0 2024-09-04T16:30:07.419 INFO:tasks.workunit.client.1.smithi193.stdout:1/425: mknod d1/d2b/d1b/d28/c87 0 2024-09-04T16:30:07.419 INFO:tasks.workunit.client.1.smithi193.stdout:8/378: getdents d2/d20/d23/d34/d46/d69 0 2024-09-04T16:30:07.419 INFO:tasks.workunit.client.0.smithi170.stdout:0/125: stat c1 0 2024-09-04T16:30:07.420 INFO:tasks.workunit.client.1.smithi193.stdout:1/426: stat d1/d2b/db/f23 0 2024-09-04T16:30:07.420 INFO:tasks.workunit.client.1.smithi193.stdout:8/379: stat d2/d20/d23/d1b/f21 0 2024-09-04T16:30:07.421 INFO:tasks.workunit.client.1.smithi193.stdout:1/427: read d1/d2b/d10/f21 [181238,17521] 0 2024-09-04T16:30:07.421 INFO:tasks.workunit.client.1.smithi193.stdout:8/380: write d2/f8 [3089508,127378] 0 2024-09-04T16:30:07.421 INFO:tasks.workunit.client.0.smithi170.stdout:7/90: dwrite f1 [0,4194304] 0 2024-09-04T16:30:07.422 INFO:tasks.workunit.client.0.smithi170.stdout:7/91: read fa [74336,125000] 0 2024-09-04T16:30:07.430 INFO:tasks.workunit.client.1.smithi193.stdout:2/347: dread d2/d9/db/d10/d1e/d26/f48 [0,4194304] 0 2024-09-04T16:30:07.431 INFO:tasks.workunit.client.0.smithi170.stdout:7/92: mkdir d12/d16/d1d/d21 0 2024-09-04T16:30:07.432 INFO:tasks.workunit.client.1.smithi193.stdout:3/394: dwrite d0/d18/d1c/d30/f41 [0,4194304] 0 2024-09-04T16:30:07.432 INFO:tasks.workunit.client.1.smithi193.stdout:4/297: getdents d3/d39/d44 0 2024-09-04T16:30:07.440 INFO:tasks.workunit.client.0.smithi170.stdout:7/93: link f1 d12/d16/d1d/d21/f22 0 2024-09-04T16:30:07.441 INFO:tasks.workunit.client.1.smithi193.stdout:8/381: truncate d2/d20/d23/d24/d3c/f45 3971228 0 2024-09-04T16:30:07.443 INFO:tasks.workunit.client.0.smithi170.stdout:0/126: dwrite ff [0,4194304] 0 2024-09-04T16:30:07.445 INFO:tasks.workunit.client.1.smithi193.stdout:6/328: rename d5/de/d15/f62 to d5/de/d15/f67 0 2024-09-04T16:30:07.445 INFO:tasks.workunit.client.0.smithi170.stdout:0/127: readlink d11/d13/d1a/l22 0 2024-09-04T16:30:07.446 INFO:tasks.workunit.client.0.smithi170.stdout:7/94: dread d12/d16/f1f [0,4194304] 0 2024-09-04T16:30:07.448 INFO:tasks.workunit.client.0.smithi170.stdout:0/128: rename d11/d13/d1a/l22 to d11/d13/d1a/l32 0 2024-09-04T16:30:07.450 INFO:tasks.workunit.client.0.smithi170.stdout:0/129: dread d11/f15 [0,4194304] 0 2024-09-04T16:30:07.451 INFO:tasks.workunit.client.1.smithi193.stdout:8/382: dread d2/d20/d23/d34/d46/d69/f78 [0,4194304] 0 2024-09-04T16:30:07.451 INFO:tasks.workunit.client.0.smithi170.stdout:7/95: mknod d12/d16/d1d/c23 0 2024-09-04T16:30:07.452 INFO:tasks.workunit.client.1.smithi193.stdout:0/387: link l7 d18/d25/d32/l86 0 2024-09-04T16:30:07.452 INFO:tasks.workunit.client.1.smithi193.stdout:6/329: dwrite d5/f3f [4194304,4194304] 0 2024-09-04T16:30:07.454 INFO:tasks.workunit.client.1.smithi193.stdout:1/428: mknod d1/d39/d48/c88 0 2024-09-04T16:30:07.455 INFO:tasks.workunit.client.1.smithi193.stdout:8/383: write d2/d20/d23/d34/d46/d53/f64 [4031547,113677] 0 2024-09-04T16:30:07.456 INFO:tasks.workunit.client.1.smithi193.stdout:8/384: stat d2/d20 0 2024-09-04T16:30:07.460 INFO:tasks.workunit.client.0.smithi170.stdout:7/96: creat d12/d15/f24 x:0 0 0 2024-09-04T16:30:07.462 INFO:tasks.workunit.client.1.smithi193.stdout:3/395: write d0/d9/f58 [371774,57377] 0 2024-09-04T16:30:07.463 INFO:tasks.workunit.client.1.smithi193.stdout:3/396: truncate d0/d9/f58 1100465 0 2024-09-04T16:30:07.465 INFO:tasks.workunit.client.0.smithi170.stdout:0/130: link d11/f1c d11/d13/d2f/f33 0 2024-09-04T16:30:07.465 INFO:tasks.workunit.client.0.smithi170.stdout:0/131: readlink d11/d2a/l2b 0 2024-09-04T16:30:07.466 INFO:tasks.workunit.client.1.smithi193.stdout:5/355: getdents d1/d29/d1e/d37 0 2024-09-04T16:30:07.467 INFO:tasks.workunit.client.0.smithi170.stdout:7/97: write d12/d16/d1d/d21/f22 [358597,102308] 0 2024-09-04T16:30:07.469 INFO:tasks.workunit.client.0.smithi170.stdout:0/132: creat d11/d2a/f34 x:0 0 0 2024-09-04T16:30:07.469 INFO:tasks.workunit.client.0.smithi170.stdout:0/133: chown d11/d13/d2f 369528386 1 2024-09-04T16:30:07.470 INFO:tasks.workunit.client.0.smithi170.stdout:7/98: rmdir d12/d15 39 2024-09-04T16:30:07.471 INFO:tasks.workunit.client.1.smithi193.stdout:0/388: symlink d18/d25/d32/l87 0 2024-09-04T16:30:07.472 INFO:tasks.workunit.client.1.smithi193.stdout:6/330: mkdir d5/d33/d4e/d51/d68 0 2024-09-04T16:30:07.474 INFO:tasks.workunit.client.0.smithi170.stdout:0/134: mkdir d11/d13/d35 0 2024-09-04T16:30:07.477 INFO:tasks.workunit.client.0.smithi170.stdout:0/135: fsync d11/d13/d2f/f33 0 2024-09-04T16:30:07.479 INFO:tasks.workunit.client.1.smithi193.stdout:5/356: mknod d1/d8/db/d15/c6a 0 2024-09-04T16:30:07.479 INFO:tasks.workunit.client.1.smithi193.stdout:5/357: read d1/d29/f1d [8547644,18735] 0 2024-09-04T16:30:07.481 INFO:tasks.workunit.client.0.smithi170.stdout:7/99: write fa [662624,59621] 0 2024-09-04T16:30:07.482 INFO:tasks.workunit.client.0.smithi170.stdout:0/136: mkdir d11/d13/d36 0 2024-09-04T16:30:07.483 INFO:tasks.workunit.client.0.smithi170.stdout:0/137: fsync d11/d2a/f34 0 2024-09-04T16:30:07.484 INFO:tasks.workunit.client.1.smithi193.stdout:0/389: mkdir d18/d79/d88 0 2024-09-04T16:30:07.485 INFO:tasks.workunit.client.1.smithi193.stdout:6/331: readlink d5/de/l46 0 2024-09-04T16:30:07.486 INFO:tasks.workunit.client.1.smithi193.stdout:1/429: mkdir d1/d2b/d1b/d51/d6d/d89 0 2024-09-04T16:30:07.486 INFO:tasks.workunit.client.1.smithi193.stdout:6/332: dread - d5/d27/d3e/d43/f61 zero size 2024-09-04T16:30:07.487 INFO:tasks.workunit.client.0.smithi170.stdout:0/138: mkdir d11/d13/d1a/d37 0 2024-09-04T16:30:07.487 INFO:tasks.workunit.client.1.smithi193.stdout:6/333: fsync d5/d33/f3a 0 2024-09-04T16:30:07.489 INFO:tasks.workunit.client.1.smithi193.stdout:6/334: chown d5/fb 4327139 1 2024-09-04T16:30:07.489 INFO:tasks.workunit.client.1.smithi193.stdout:1/430: truncate d1/d2b/d10/d2a/f7b 1465009 0 2024-09-04T16:30:07.489 INFO:tasks.workunit.client.1.smithi193.stdout:8/385: dwrite d2/d12/fe [0,4194304] 0 2024-09-04T16:30:07.491 INFO:tasks.workunit.client.1.smithi193.stdout:2/348: getdents d2/d9/db/d10/d4e 0 2024-09-04T16:30:07.491 INFO:tasks.workunit.client.0.smithi170.stdout:7/100: getdents d12/d16/d1d/d21 0 2024-09-04T16:30:07.491 INFO:tasks.workunit.client.1.smithi193.stdout:6/335: dread - d5/de/d15/d1b/f5a zero size 2024-09-04T16:30:07.492 INFO:tasks.workunit.client.1.smithi193.stdout:4/298: getdents d3/d3c 0 2024-09-04T16:30:07.492 INFO:tasks.workunit.client.1.smithi193.stdout:2/349: readlink d2/d9/d18/l19 0 2024-09-04T16:30:07.493 INFO:tasks.workunit.client.0.smithi170.stdout:7/101: fsync ff 0 2024-09-04T16:30:07.493 INFO:tasks.workunit.client.1.smithi193.stdout:4/299: read - d3/d39/f57 zero size 2024-09-04T16:30:07.495 INFO:tasks.workunit.client.1.smithi193.stdout:5/358: dread d1/d29/d69/d3e/f41 [0,4194304] 0 2024-09-04T16:30:07.499 INFO:tasks.workunit.client.1.smithi193.stdout:3/397: dread d0/d7/de/d45/f46 [0,4194304] 0 2024-09-04T16:30:07.499 INFO:tasks.workunit.client.0.smithi170.stdout:7/102: rmdir d12 39 2024-09-04T16:30:07.500 INFO:tasks.workunit.client.0.smithi170.stdout:0/139: truncate d11/f18 492151 0 2024-09-04T16:30:07.502 INFO:tasks.workunit.client.1.smithi193.stdout:8/386: creat d2/d20/d23/d24/d3c/f7d x:0 0 0 2024-09-04T16:30:07.502 INFO:tasks.workunit.client.1.smithi193.stdout:0/390: getdents d18/d25/d5f/d6a/d7b 0 2024-09-04T16:30:07.505 INFO:tasks.workunit.client.1.smithi193.stdout:6/336: creat d5/d27/d3e/f69 x:0 0 0 2024-09-04T16:30:07.505 INFO:tasks.workunit.client.0.smithi170.stdout:7/103: creat d12/d16/f25 x:0 0 0 2024-09-04T16:30:07.506 INFO:tasks.workunit.client.1.smithi193.stdout:2/350: mkdir d2/d9/db/d10/d38/d7a 0 2024-09-04T16:30:07.507 INFO:tasks.workunit.client.1.smithi193.stdout:6/337: write d5/f26 [968572,16652] 0 2024-09-04T16:30:07.508 INFO:tasks.workunit.client.1.smithi193.stdout:4/300: rename d3/d1a/d2a/f3f to d3/d1a/d54/f64 0 2024-09-04T16:30:07.509 INFO:tasks.workunit.client.0.smithi170.stdout:7/104: rename d12/c13 to d12/d16/d1d/c26 0 2024-09-04T16:30:07.509 INFO:tasks.workunit.client.0.smithi170.stdout:7/105: dread - d12/f1a zero size 2024-09-04T16:30:07.510 INFO:tasks.workunit.client.0.smithi170.stdout:0/140: link c1 d11/d2a/c38 0 2024-09-04T16:30:07.510 INFO:tasks.workunit.client.0.smithi170.stdout:7/106: chown d12/d16/f1f 1903 1 2024-09-04T16:30:07.510 INFO:tasks.workunit.client.1.smithi193.stdout:3/398: fsync d0/f66 0 2024-09-04T16:30:07.511 INFO:tasks.workunit.client.0.smithi170.stdout:7/107: chown d12/d16/d1d/c23 6 1 2024-09-04T16:30:07.511 INFO:tasks.workunit.client.1.smithi193.stdout:8/387: dwrite d2/d20/f6a [0,4194304] 0 2024-09-04T16:30:07.511 INFO:tasks.workunit.client.0.smithi170.stdout:7/108: stat d12/f1a 0 2024-09-04T16:30:07.512 INFO:tasks.workunit.client.1.smithi193.stdout:0/391: dwrite d18/f1d [0,4194304] 0 2024-09-04T16:30:07.513 INFO:tasks.workunit.client.0.smithi170.stdout:0/141: stat d11/l26 0 2024-09-04T16:30:07.520 INFO:tasks.workunit.client.1.smithi193.stdout:5/359: mknod d1/d8/db/c6b 0 2024-09-04T16:30:07.523 INFO:tasks.workunit.client.1.smithi193.stdout:2/351: mkdir d2/d9/d18/d7b 0 2024-09-04T16:30:07.525 INFO:tasks.workunit.client.0.smithi170.stdout:7/109: symlink d12/d15/l27 0 2024-09-04T16:30:07.527 INFO:tasks.workunit.client.1.smithi193.stdout:2/352: dread d2/d9/db/d10/d38/f3b [0,4194304] 0 2024-09-04T16:30:07.529 INFO:tasks.workunit.client.1.smithi193.stdout:1/431: creat d1/d39/f8a x:0 0 0 2024-09-04T16:30:07.529 INFO:tasks.workunit.client.0.smithi170.stdout:7/110: rmdir d12/d15 39 2024-09-04T16:30:07.530 INFO:tasks.workunit.client.0.smithi170.stdout:7/111: write f1 [372501,64259] 0 2024-09-04T16:30:07.532 INFO:tasks.workunit.client.1.smithi193.stdout:3/399: readlink d0/d3b/l70 0 2024-09-04T16:30:07.532 INFO:tasks.workunit.client.1.smithi193.stdout:9/447: sync 2024-09-04T16:30:07.534 INFO:tasks.workunit.client.1.smithi193.stdout:2/353: dwrite d2/d9/db/d10/d1e/d26/f3a [0,4194304] 0 2024-09-04T16:30:07.535 INFO:tasks.workunit.client.1.smithi193.stdout:8/388: mknod d2/d20/d23/d34/d3e/c7e 0 2024-09-04T16:30:07.535 INFO:tasks.workunit.client.0.smithi170.stdout:0/142: write d11/d13/d2f/f33 [4529491,113757] 0 2024-09-04T16:30:07.536 INFO:tasks.workunit.client.1.smithi193.stdout:8/389: fsync d2/f8 0 2024-09-04T16:30:07.538 INFO:tasks.workunit.client.0.smithi170.stdout:0/143: rename d11/d13/d1a to d11/d13/d1a/d37/d39 22 2024-09-04T16:30:07.540 INFO:tasks.workunit.client.1.smithi193.stdout:4/301: dread d3/d3c/f45 [0,4194304] 0 2024-09-04T16:30:07.541 INFO:tasks.workunit.client.0.smithi170.stdout:7/112: dwrite d12/d16/f1f [0,4194304] 0 2024-09-04T16:30:07.547 INFO:tasks.workunit.client.1.smithi193.stdout:6/338: symlink d5/d33/d4e/d51/d68/l6a 0 2024-09-04T16:30:07.550 INFO:tasks.workunit.client.0.smithi170.stdout:7/113: creat d12/d15/f28 x:0 0 0 2024-09-04T16:30:07.551 INFO:tasks.workunit.client.0.smithi170.stdout:7/114: chown d12/f18 317581666 1 2024-09-04T16:30:07.552 INFO:tasks.workunit.client.0.smithi170.stdout:7/115: write d12/f1a [1027864,34108] 0 2024-09-04T16:30:07.552 INFO:tasks.workunit.client.1.smithi193.stdout:0/392: symlink d18/d25/l89 0 2024-09-04T16:30:07.552 INFO:tasks.workunit.client.1.smithi193.stdout:5/360: dwrite d1/d8/db/d23/f26 [0,4194304] 0 2024-09-04T16:30:07.553 INFO:tasks.workunit.client.0.smithi170.stdout:0/144: fdatasync d11/f18 0 2024-09-04T16:30:07.557 INFO:tasks.workunit.client.1.smithi193.stdout:2/354: symlink d2/d9/db/d10/d1e/d56/l7c 0 2024-09-04T16:30:07.558 INFO:tasks.workunit.client.0.smithi170.stdout:7/116: fsync d12/d16/d1d/d21/f22 0 2024-09-04T16:30:07.558 INFO:tasks.workunit.client.0.smithi170.stdout:7/117: chown l11 3 1 2024-09-04T16:30:07.558 INFO:tasks.workunit.client.0.smithi170.stdout:0/145: write d11/f25 [944666,127693] 0 2024-09-04T16:30:07.558 INFO:tasks.workunit.client.0.smithi170.stdout:7/118: dread ff [0,4194304] 0 2024-09-04T16:30:07.559 INFO:tasks.workunit.client.1.smithi193.stdout:2/355: chown d2/d9/d18/l4d 93460 1 2024-09-04T16:30:07.559 INFO:tasks.workunit.client.1.smithi193.stdout:9/448: dwrite d2/d8/f4f [0,4194304] 0 2024-09-04T16:30:07.559 INFO:tasks.workunit.client.0.smithi170.stdout:7/119: write fa [1136533,81175] 0 2024-09-04T16:30:07.560 INFO:tasks.workunit.client.1.smithi193.stdout:9/449: chown d2/d4/f3a 53586183 1 2024-09-04T16:30:07.561 INFO:tasks.workunit.client.0.smithi170.stdout:0/146: dread d11/f29 [0,4194304] 0 2024-09-04T16:30:07.562 INFO:tasks.workunit.client.1.smithi193.stdout:3/400: dwrite d0/d7/f6b [0,4194304] 0 2024-09-04T16:30:07.564 INFO:tasks.workunit.client.1.smithi193.stdout:3/401: readlink d0/d3b/l79 0 2024-09-04T16:30:07.564 INFO:tasks.workunit.client.1.smithi193.stdout:4/302: rename d3/d1a/d2a/l38 to d3/d1a/d21/d52/d5e/l65 0 2024-09-04T16:30:07.566 INFO:tasks.workunit.client.0.smithi170.stdout:7/120: dread f1 [0,4194304] 0 2024-09-04T16:30:07.567 INFO:tasks.workunit.client.0.smithi170.stdout:7/121: write f1 [4832857,15836] 0 2024-09-04T16:30:07.568 INFO:tasks.workunit.client.1.smithi193.stdout:0/393: rmdir d18/d25/d32/d57/d6c 39 2024-09-04T16:30:07.569 INFO:tasks.workunit.client.0.smithi170.stdout:7/122: stat lb 0 2024-09-04T16:30:07.569 INFO:tasks.workunit.client.1.smithi193.stdout:0/394: fdatasync fb 0 2024-09-04T16:30:07.573 INFO:tasks.workunit.client.0.smithi170.stdout:7/123: mkdir d12/d29 0 2024-09-04T16:30:07.574 INFO:tasks.workunit.client.0.smithi170.stdout:7/124: stat d12/l1b 0 2024-09-04T16:30:07.577 INFO:tasks.workunit.client.0.smithi170.stdout:0/147: dwrite d11/d13/f20 [0,4194304] 0 2024-09-04T16:30:07.579 INFO:tasks.workunit.client.0.smithi170.stdout:7/125: creat d12/d29/f2a x:0 0 0 2024-09-04T16:30:07.582 INFO:tasks.workunit.client.0.smithi170.stdout:7/126: symlink d12/d16/d1d/d21/l2b 0 2024-09-04T16:30:07.585 INFO:tasks.workunit.client.0.smithi170.stdout:7/127: symlink d12/d29/l2c 0 2024-09-04T16:30:07.586 INFO:tasks.workunit.client.0.smithi170.stdout:7/128: write f1 [2159518,117494] 0 2024-09-04T16:30:07.587 INFO:tasks.workunit.client.0.smithi170.stdout:7/129: write f1 [3425208,49568] 0 2024-09-04T16:30:07.590 INFO:tasks.workunit.client.0.smithi170.stdout:7/130: unlink d12/d15/c19 0 2024-09-04T16:30:07.592 INFO:tasks.workunit.client.0.smithi170.stdout:7/131: chown l0 591148178 1 2024-09-04T16:30:07.594 INFO:tasks.workunit.client.0.smithi170.stdout:0/148: truncate ff 3683926 0 2024-09-04T16:30:07.596 INFO:tasks.workunit.client.0.smithi170.stdout:7/132: dread d12/f1a [0,4194304] 0 2024-09-04T16:30:07.597 INFO:tasks.workunit.client.0.smithi170.stdout:0/149: mkdir d11/d13/d1a/d3a 0 2024-09-04T16:30:07.597 INFO:tasks.workunit.client.0.smithi170.stdout:0/150: stat d11/d13/d1a 0 2024-09-04T16:30:07.599 INFO:tasks.workunit.client.0.smithi170.stdout:7/133: link f1 d12/d29/f2d 0 2024-09-04T16:30:07.601 INFO:tasks.workunit.client.0.smithi170.stdout:7/134: write d12/f1a [14566,104256] 0 2024-09-04T16:30:07.601 INFO:tasks.workunit.client.0.smithi170.stdout:7/135: readlink d12/d16/l20 0 2024-09-04T16:30:07.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:07 smithi170 ceph-mon[29272]: pgmap v23: 65 pgs: 65 active+clean; 571 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 63 MiB/s wr, 230 op/s 2024-09-04T16:30:07.602 INFO:tasks.workunit.client.0.smithi170.stdout:7/136: dread - d12/d29/f2a zero size 2024-09-04T16:30:07.602 INFO:tasks.workunit.client.0.smithi170.stdout:0/151: rmdir d11/d13/d1a/d37 0 2024-09-04T16:30:07.602 INFO:tasks.workunit.client.0.smithi170.stdout:7/137: write d12/f14 [4019034,22114] 0 2024-09-04T16:30:07.604 INFO:tasks.workunit.client.0.smithi170.stdout:0/152: dread d11/f18 [0,4194304] 0 2024-09-04T16:30:07.607 INFO:tasks.workunit.client.0.smithi170.stdout:7/138: dread d12/d29/f2d [0,4194304] 0 2024-09-04T16:30:07.609 INFO:tasks.workunit.client.0.smithi170.stdout:0/153: dread d11/d13/f20 [0,4194304] 0 2024-09-04T16:30:07.609 INFO:tasks.workunit.client.0.smithi170.stdout:7/139: creat d12/d16/d1d/f2e x:0 0 0 2024-09-04T16:30:07.615 INFO:tasks.workunit.client.0.smithi170.stdout:7/140: getdents d12/d15 0 2024-09-04T16:30:07.618 INFO:tasks.workunit.client.1.smithi193.stdout:5/361: read d1/d8/f2d [19640,69568] 0 2024-09-04T16:30:07.618 INFO:tasks.workunit.client.1.smithi193.stdout:3/402: mkdir d0/d9/d49/d87 0 2024-09-04T16:30:07.618 INFO:tasks.workunit.client.1.smithi193.stdout:1/432: creat d1/d2b/d1b/d51/f8b x:0 0 0 2024-09-04T16:30:07.619 INFO:tasks.workunit.client.1.smithi193.stdout:6/339: write d5/de/f41 [566986,109775] 0 2024-09-04T16:30:07.619 INFO:tasks.workunit.client.1.smithi193.stdout:0/395: read d18/f19 [909800,103879] 0 2024-09-04T16:30:07.619 INFO:tasks.workunit.client.0.smithi170.stdout:7/141: dread d12/d29/f2d [0,4194304] 0 2024-09-04T16:30:07.620 INFO:tasks.workunit.client.1.smithi193.stdout:8/390: creat d2/f7f x:0 0 0 2024-09-04T16:30:07.620 INFO:tasks.workunit.client.0.smithi170.stdout:7/142: stat d12/d16/d1d/c23 0 2024-09-04T16:30:07.623 INFO:tasks.workunit.client.1.smithi193.stdout:3/403: mknod d0/d18/d1c/d51/c88 0 2024-09-04T16:30:07.628 INFO:tasks.workunit.client.1.smithi193.stdout:1/433: unlink d1/d2b/d10/d2a/f7b 0 2024-09-04T16:30:07.628 INFO:tasks.workunit.client.1.smithi193.stdout:1/434: fdatasync d1/d2b/db/d54/f70 0 2024-09-04T16:30:07.630 INFO:tasks.workunit.client.1.smithi193.stdout:9/450: creat d2/d8/f8e x:0 0 0 2024-09-04T16:30:07.634 INFO:tasks.workunit.client.1.smithi193.stdout:6/340: mknod d5/de/d15/c6b 0 2024-09-04T16:30:07.636 INFO:tasks.workunit.client.1.smithi193.stdout:9/451: mknod d2/d8/d4d/c8f 0 2024-09-04T16:30:07.638 INFO:tasks.workunit.client.0.smithi170.stdout:7/143: dwrite d12/d16/d1d/d21/f22 [0,4194304] 0 2024-09-04T16:30:07.638 INFO:tasks.workunit.client.1.smithi193.stdout:6/341: fdatasync d5/de/d15/d48/f4b 0 2024-09-04T16:30:07.639 INFO:tasks.workunit.client.0.smithi170.stdout:7/144: chown d12/d16/d1d 261585291 1 2024-09-04T16:30:07.639 INFO:tasks.workunit.client.1.smithi193.stdout:8/391: dread d2/d20/d23/d1b/f33 [0,4194304] 0 2024-09-04T16:30:07.641 INFO:tasks.workunit.client.1.smithi193.stdout:5/362: rename d1/d8/db/d36/d40/d46/c61 to d1/d8/c6c 0 2024-09-04T16:30:07.642 INFO:tasks.workunit.client.1.smithi193.stdout:3/404: creat d0/f89 x:0 0 0 2024-09-04T16:30:07.643 INFO:tasks.workunit.client.0.smithi170.stdout:7/145: creat d12/d15/f2f x:0 0 0 2024-09-04T16:30:07.644 INFO:tasks.workunit.client.0.smithi170.stdout:7/146: dread - d12/d16/d1d/f2e zero size 2024-09-04T16:30:07.647 INFO:tasks.workunit.client.1.smithi193.stdout:6/342: dwrite d5/f6 [0,4194304] 0 2024-09-04T16:30:07.648 INFO:tasks.workunit.client.1.smithi193.stdout:8/392: dwrite d2/d20/f6a [0,4194304] 0 2024-09-04T16:30:07.649 INFO:tasks.workunit.client.1.smithi193.stdout:8/393: chown d2/d20/l73 74 1 2024-09-04T16:30:07.649 INFO:tasks.workunit.client.1.smithi193.stdout:8/394: fdatasync d2/d12/fe 0 2024-09-04T16:30:07.651 INFO:tasks.workunit.client.1.smithi193.stdout:8/395: readlink d2/d20/d23/d51/l79 0 2024-09-04T16:30:07.651 INFO:tasks.workunit.client.0.smithi170.stdout:7/147: creat d12/f30 x:0 0 0 2024-09-04T16:30:07.652 INFO:tasks.workunit.client.1.smithi193.stdout:3/405: mknod d0/d18/d1c/d25/d5e/d68/c8a 0 2024-09-04T16:30:07.652 INFO:tasks.workunit.client.1.smithi193.stdout:5/363: chown d1/d8/l3a 1572 1 2024-09-04T16:30:07.653 INFO:tasks.workunit.client.0.smithi170.stdout:7/148: write d12/d16/f1f [1099117,46692] 0 2024-09-04T16:30:07.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:07 smithi193 ceph-mon[36288]: pgmap v23: 65 pgs: 65 active+clean; 571 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 63 MiB/s wr, 230 op/s 2024-09-04T16:30:07.657 INFO:tasks.workunit.client.1.smithi193.stdout:0/396: rename d18/d25/d3b/f51 to d18/d25/f8a 0 2024-09-04T16:30:07.661 INFO:tasks.workunit.client.1.smithi193.stdout:7/458: sync 2024-09-04T16:30:07.661 INFO:tasks.workunit.client.1.smithi193.stdout:0/397: chown d18/f38 3908 1 2024-09-04T16:30:07.662 INFO:tasks.workunit.client.1.smithi193.stdout:9/452: rename d2/d8/d4d/c5b to d2/d56/d86/c90 0 2024-09-04T16:30:07.662 INFO:tasks.workunit.client.1.smithi193.stdout:6/343: link d5/d27/d3e/d43/c36 d5/d27/c6c 0 2024-09-04T16:30:07.663 INFO:tasks.workunit.client.1.smithi193.stdout:9/453: chown d2/d8/d4d/c8f 119868708 1 2024-09-04T16:30:07.664 INFO:tasks.workunit.client.1.smithi193.stdout:7/459: mknod d9/d18/d22/d2b/c9c 0 2024-09-04T16:30:07.666 INFO:tasks.workunit.client.1.smithi193.stdout:8/396: getdents d2 0 2024-09-04T16:30:07.666 INFO:tasks.workunit.client.1.smithi193.stdout:0/398: mknod d18/d25/c8b 0 2024-09-04T16:30:07.667 INFO:tasks.workunit.client.1.smithi193.stdout:6/344: mknod d5/de/d15/c6d 0 2024-09-04T16:30:07.711 INFO:tasks.workunit.client.1.smithi193.stdout:8/397: mknod d2/d20/d23/d34/d3e/d6f/c80 0 2024-09-04T16:30:07.711 INFO:tasks.workunit.client.1.smithi193.stdout:0/399: mknod d18/d25/c8c 0 2024-09-04T16:30:07.711 INFO:tasks.workunit.client.1.smithi193.stdout:6/345: mkdir d5/d27/d3e/d6e 0 2024-09-04T16:30:07.714 INFO:tasks.workunit.client.1.smithi193.stdout:7/460: dwrite d9/f19 [4194304,4194304] 0 2024-09-04T16:30:07.715 INFO:tasks.workunit.client.1.smithi193.stdout:8/398: chown d2/d20/d23/d51/d59 0 1 2024-09-04T16:30:07.715 INFO:tasks.workunit.client.1.smithi193.stdout:0/400: dread d18/f69 [0,4194304] 0 2024-09-04T16:30:07.717 INFO:tasks.workunit.client.1.smithi193.stdout:6/346: creat d5/de/d15/d1b/f6f x:0 0 0 2024-09-04T16:30:07.718 INFO:tasks.workunit.client.1.smithi193.stdout:8/399: readlink d2/d20/d23/l3b 0 2024-09-04T16:30:07.719 INFO:tasks.workunit.client.1.smithi193.stdout:0/401: dread - d18/d25/d32/f53 zero size 2024-09-04T16:30:07.720 INFO:tasks.workunit.client.1.smithi193.stdout:9/454: dwrite d2/d8/d25/f3e [0,4194304] 0 2024-09-04T16:30:07.722 INFO:tasks.workunit.client.1.smithi193.stdout:3/406: dread d0/d18/f50 [0,4194304] 0 2024-09-04T16:30:07.722 INFO:tasks.workunit.client.1.smithi193.stdout:5/364: dread d1/f11 [0,4194304] 0 2024-09-04T16:30:07.723 INFO:tasks.workunit.client.1.smithi193.stdout:6/347: mkdir d5/d33/d4e/d51/d68/d70 0 2024-09-04T16:30:07.725 INFO:tasks.workunit.client.1.smithi193.stdout:6/348: chown d5/d33/c52 41 1 2024-09-04T16:30:07.726 INFO:tasks.workunit.client.1.smithi193.stdout:6/349: write d5/f11 [847211,120177] 0 2024-09-04T16:30:07.726 INFO:tasks.workunit.client.1.smithi193.stdout:9/455: creat d2/d8/d4d/f91 x:0 0 0 2024-09-04T16:30:07.729 INFO:tasks.workunit.client.1.smithi193.stdout:7/461: creat d9/d18/f9d x:0 0 0 2024-09-04T16:30:07.730 INFO:tasks.workunit.client.1.smithi193.stdout:5/365: symlink d1/d29/d69/d3e/d55/l6d 0 2024-09-04T16:30:07.730 INFO:tasks.workunit.client.1.smithi193.stdout:7/462: write d9/d39/f51 [285547,59416] 0 2024-09-04T16:30:07.732 INFO:tasks.workunit.client.1.smithi193.stdout:9/456: symlink d2/d4/l92 0 2024-09-04T16:30:07.732 INFO:tasks.workunit.client.1.smithi193.stdout:9/457: fsync d2/d8/d25/f37 0 2024-09-04T16:30:07.733 INFO:tasks.workunit.client.1.smithi193.stdout:9/458: chown d2/d8/d15/f31 7 1 2024-09-04T16:30:07.734 INFO:tasks.workunit.client.1.smithi193.stdout:3/407: link d0/d18/d1c/d25/f48 d0/d18/d1b/f8b 0 2024-09-04T16:30:07.734 INFO:tasks.workunit.client.1.smithi193.stdout:8/400: getdents d2/d20/d23/d24 0 2024-09-04T16:30:07.736 INFO:tasks.workunit.client.1.smithi193.stdout:5/366: creat d1/d29/f6e x:0 0 0 2024-09-04T16:30:07.737 INFO:tasks.workunit.client.1.smithi193.stdout:5/367: chown d1/d8/db/d23/f25 14703484 1 2024-09-04T16:30:07.737 INFO:tasks.workunit.client.1.smithi193.stdout:5/368: write d1/d29/f59 [890718,15562] 0 2024-09-04T16:30:07.738 INFO:tasks.workunit.client.1.smithi193.stdout:2/356: sync 2024-09-04T16:30:07.738 INFO:tasks.workunit.client.1.smithi193.stdout:5/369: chown d1/d29/d1e/c5d 45968 1 2024-09-04T16:30:07.739 INFO:tasks.workunit.client.1.smithi193.stdout:3/408: unlink d0/d7/de/d45/f46 0 2024-09-04T16:30:07.741 INFO:tasks.workunit.client.1.smithi193.stdout:2/357: read d2/f35 [145470,63086] 0 2024-09-04T16:30:07.741 INFO:tasks.workunit.client.1.smithi193.stdout:7/463: truncate d9/de/d27/f52 3281520 0 2024-09-04T16:30:07.743 INFO:tasks.workunit.client.1.smithi193.stdout:5/370: creat d1/d29/d69/d3e/f6f x:0 0 0 2024-09-04T16:30:07.744 INFO:tasks.workunit.client.1.smithi193.stdout:2/358: chown d2/f7 240721115 1 2024-09-04T16:30:07.747 INFO:tasks.workunit.client.1.smithi193.stdout:6/350: truncate d5/d33/d4e/d51/f54 4395556 0 2024-09-04T16:30:07.748 INFO:tasks.workunit.client.1.smithi193.stdout:9/459: dread d2/f1c [0,4194304] 0 2024-09-04T16:30:07.748 INFO:tasks.workunit.client.1.smithi193.stdout:5/371: chown d1/d29/d18/l1f 2159055 1 2024-09-04T16:30:07.748 INFO:tasks.workunit.client.1.smithi193.stdout:6/351: readlink d5/de/d15/l16 0 2024-09-04T16:30:07.749 INFO:tasks.workunit.client.1.smithi193.stdout:2/359: fdatasync d2/d9/db/d10/f6e 0 2024-09-04T16:30:07.752 INFO:tasks.workunit.client.1.smithi193.stdout:3/409: link d0/d7/l11 d0/d18/d1c/d51/d6c/l8c 0 2024-09-04T16:30:07.753 INFO:tasks.workunit.client.1.smithi193.stdout:6/352: mkdir d5/d33/d4e/d51/d71 0 2024-09-04T16:30:07.755 INFO:tasks.workunit.client.1.smithi193.stdout:9/460: dwrite d2/d8/f4f [0,4194304] 0 2024-09-04T16:30:07.756 INFO:tasks.workunit.client.1.smithi193.stdout:3/410: creat d0/d7/de/d45/f8d x:0 0 0 2024-09-04T16:30:07.756 INFO:tasks.workunit.client.1.smithi193.stdout:7/464: dread d9/d11/f4e [0,4194304] 0 2024-09-04T16:30:07.759 INFO:tasks.workunit.client.1.smithi193.stdout:3/411: mkdir d0/d18/d1c/d30/d8e 0 2024-09-04T16:30:07.761 INFO:tasks.workunit.client.1.smithi193.stdout:5/372: write d1/d8/db/d23/f25 [1845629,34571] 0 2024-09-04T16:30:07.763 INFO:tasks.workunit.client.1.smithi193.stdout:7/465: rename d9/d39/d3e/d4d/f50 to d9/d39/d3e/d7d/f9e 0 2024-09-04T16:30:07.764 INFO:tasks.workunit.client.1.smithi193.stdout:5/373: chown d1/d29/d1e/d37/d3f/f5a 123 1 2024-09-04T16:30:07.764 INFO:tasks.workunit.client.1.smithi193.stdout:7/466: read d9/d11/f4e [197990,32792] 0 2024-09-04T16:30:07.766 INFO:tasks.workunit.client.1.smithi193.stdout:9/461: dwrite d2/f3d [0,4194304] 0 2024-09-04T16:30:07.766 INFO:tasks.workunit.client.1.smithi193.stdout:7/467: stat d9/d18/d22/d2b/d6c 0 2024-09-04T16:30:07.768 INFO:tasks.workunit.client.1.smithi193.stdout:9/462: chown d2/d8/d15/f62 1886440180 1 2024-09-04T16:30:07.768 INFO:tasks.workunit.client.1.smithi193.stdout:7/468: readlink d9/d39/d3e/d4a/l7f 0 2024-09-04T16:30:07.768 INFO:tasks.workunit.client.1.smithi193.stdout:6/353: truncate d5/de/d15/d1b/f1e 403402 0 2024-09-04T16:30:07.770 INFO:tasks.workunit.client.1.smithi193.stdout:3/412: link d0/d7/de/c34 d0/d7/de/d45/c8f 0 2024-09-04T16:30:07.770 INFO:tasks.workunit.client.1.smithi193.stdout:5/374: read d1/d29/d1e/d37/d3f/f5a [1378487,63545] 0 2024-09-04T16:30:07.774 INFO:tasks.workunit.client.1.smithi193.stdout:9/463: unlink d2/d18/d2f/d22/d30/d52/l5f 0 2024-09-04T16:30:07.775 INFO:tasks.workunit.client.1.smithi193.stdout:3/413: dwrite d0/d7/de/d45/f8d [0,4194304] 0 2024-09-04T16:30:07.775 INFO:tasks.workunit.client.1.smithi193.stdout:9/464: write d2/d8/d61/f73 [1669460,49889] 0 2024-09-04T16:30:07.777 INFO:tasks.workunit.client.1.smithi193.stdout:3/414: write d0/d10/f38 [3344125,97046] 0 2024-09-04T16:30:07.777 INFO:tasks.workunit.client.1.smithi193.stdout:3/415: stat d0/d18/d1c 0 2024-09-04T16:30:07.779 INFO:tasks.workunit.client.1.smithi193.stdout:6/354: rename d5/de/d15/d1b/f53 to d5/d27/d3e/d43/f72 0 2024-09-04T16:30:07.779 INFO:tasks.workunit.client.1.smithi193.stdout:5/375: fsync d1/d29/d69/f66 0 2024-09-04T16:30:07.781 INFO:tasks.workunit.client.1.smithi193.stdout:7/469: creat d9/d85/f9f x:0 0 0 2024-09-04T16:30:07.787 INFO:tasks.workunit.client.1.smithi193.stdout:9/465: dread d2/d8/d15/f16 [0,4194304] 0 2024-09-04T16:30:07.787 INFO:tasks.workunit.client.1.smithi193.stdout:5/376: mknod d1/d29/d1e/d37/c70 0 2024-09-04T16:30:07.790 INFO:tasks.workunit.client.1.smithi193.stdout:5/377: readlink d1/l10 0 2024-09-04T16:30:07.792 INFO:tasks.workunit.client.1.smithi193.stdout:9/466: unlink d2/d18/d2f/d22/d30/l4a 0 2024-09-04T16:30:07.793 INFO:tasks.workunit.client.1.smithi193.stdout:6/355: write d5/de/d15/d1b/f1e [157052,89293] 0 2024-09-04T16:30:07.794 INFO:tasks.workunit.client.1.smithi193.stdout:6/356: write d5/d33/f3a [494245,10221] 0 2024-09-04T16:30:07.797 INFO:tasks.workunit.client.1.smithi193.stdout:5/378: dwrite d1/d8/db/d15/f47 [0,4194304] 0 2024-09-04T16:30:07.799 INFO:tasks.workunit.client.1.smithi193.stdout:7/470: dread d9/d18/d1e/f2e [0,4194304] 0 2024-09-04T16:30:07.799 INFO:tasks.workunit.client.1.smithi193.stdout:6/357: creat d5/d27/d3e/f73 x:0 0 0 2024-09-04T16:30:07.801 INFO:tasks.workunit.client.1.smithi193.stdout:7/471: creat d9/de/fa0 x:0 0 0 2024-09-04T16:30:07.802 INFO:tasks.workunit.client.1.smithi193.stdout:5/379: unlink d1/d8/c6c 0 2024-09-04T16:30:07.803 INFO:tasks.workunit.client.1.smithi193.stdout:7/472: write d9/d39/f51 [4945347,95995] 0 2024-09-04T16:30:07.804 INFO:tasks.workunit.client.1.smithi193.stdout:6/358: truncate d5/de/d15/d1b/d5f/f63 307748 0 2024-09-04T16:30:07.804 INFO:tasks.workunit.client.1.smithi193.stdout:5/380: symlink d1/l71 0 2024-09-04T16:30:07.806 INFO:tasks.workunit.client.1.smithi193.stdout:7/473: creat d9/d39/fa1 x:0 0 0 2024-09-04T16:30:07.806 INFO:tasks.workunit.client.1.smithi193.stdout:7/474: dread - d9/d39/fa1 zero size 2024-09-04T16:30:07.808 INFO:tasks.workunit.client.1.smithi193.stdout:6/359: chown d5/d27/c55 1955 1 2024-09-04T16:30:07.810 INFO:tasks.workunit.client.1.smithi193.stdout:7/475: creat d9/d39/d3e/fa2 x:0 0 0 2024-09-04T16:30:07.811 INFO:tasks.workunit.client.1.smithi193.stdout:4/303: sync 2024-09-04T16:30:07.813 INFO:tasks.workunit.client.1.smithi193.stdout:4/304: mknod d3/d39/d44/c66 0 2024-09-04T16:30:07.813 INFO:tasks.workunit.client.1.smithi193.stdout:6/360: link d5/de/d15/d48/l56 d5/d27/d3e/d6e/l74 0 2024-09-04T16:30:07.816 INFO:tasks.workunit.client.1.smithi193.stdout:6/361: read d5/d33/d4e/f59 [54464,111554] 0 2024-09-04T16:30:07.816 INFO:tasks.workunit.client.1.smithi193.stdout:7/476: getdents d9/d18/d22/d2b/d6c/d70 0 2024-09-04T16:30:07.817 INFO:tasks.workunit.client.1.smithi193.stdout:6/362: chown d5/de/f18 875928 1 2024-09-04T16:30:07.822 INFO:tasks.workunit.client.1.smithi193.stdout:7/477: unlink d9/de/d27/f52 0 2024-09-04T16:30:07.823 INFO:tasks.workunit.client.1.smithi193.stdout:6/363: symlink d5/d27/d3e/d43/d5d/l75 0 2024-09-04T16:30:07.823 INFO:tasks.workunit.client.1.smithi193.stdout:7/478: write d9/d18/f9b [215849,20405] 0 2024-09-04T16:30:07.826 INFO:tasks.workunit.client.1.smithi193.stdout:5/381: dread d1/d8/db/d15/f30 [0,4194304] 0 2024-09-04T16:30:07.826 INFO:tasks.workunit.client.1.smithi193.stdout:6/364: dread d5/d27/d3e/d43/f72 [0,4194304] 0 2024-09-04T16:30:07.827 INFO:tasks.workunit.client.1.smithi193.stdout:6/365: fdatasync d5/d27/d3e/d43/f61 0 2024-09-04T16:30:07.829 INFO:tasks.workunit.client.1.smithi193.stdout:5/382: symlink d1/d29/d1e/l72 0 2024-09-04T16:30:07.830 INFO:tasks.workunit.client.1.smithi193.stdout:5/383: dread - d1/d8/db/f4e zero size 2024-09-04T16:30:07.831 INFO:tasks.workunit.client.1.smithi193.stdout:5/384: stat d1/d8/db/d36/f65 0 2024-09-04T16:30:07.831 INFO:tasks.workunit.client.1.smithi193.stdout:4/305: dread d3/d1a/d2a/f2d [0,4194304] 0 2024-09-04T16:30:07.833 INFO:tasks.workunit.client.1.smithi193.stdout:5/385: creat d1/d8/db/d15/f73 x:0 0 0 2024-09-04T16:30:07.834 INFO:tasks.workunit.client.1.smithi193.stdout:4/306: mknod d3/d1a/d21/c67 0 2024-09-04T16:30:07.836 INFO:tasks.workunit.client.1.smithi193.stdout:4/307: creat d3/d1a/d21/d52/d5e/f68 x:0 0 0 2024-09-04T16:30:07.837 INFO:tasks.workunit.client.1.smithi193.stdout:4/308: mknod d3/d1a/d2a/c69 0 2024-09-04T16:30:07.839 INFO:tasks.workunit.client.1.smithi193.stdout:7/479: truncate d9/d39/f51 2671564 0 2024-09-04T16:30:07.841 INFO:tasks.workunit.client.1.smithi193.stdout:7/480: symlink d9/d85/la3 0 2024-09-04T16:30:07.843 INFO:tasks.workunit.client.1.smithi193.stdout:7/481: rename d9/d18/d1e/c58 to d9/d39/d95/ca4 0 2024-09-04T16:30:07.845 INFO:tasks.workunit.client.1.smithi193.stdout:5/386: dread d1/d8/f2d [0,4194304] 0 2024-09-04T16:30:07.846 INFO:tasks.workunit.client.1.smithi193.stdout:7/482: creat d9/d39/d3e/d53/fa5 x:0 0 0 2024-09-04T16:30:07.847 INFO:tasks.workunit.client.1.smithi193.stdout:7/483: read d9/d18/d22/d2b/f5f [1314351,50799] 0 2024-09-04T16:30:07.849 INFO:tasks.workunit.client.1.smithi193.stdout:7/484: unlink d9/d39/d3e/d4a/f4b 0 2024-09-04T16:30:07.851 INFO:tasks.workunit.client.1.smithi193.stdout:7/485: chown d9/de/d27/d62/l90 179439 1 2024-09-04T16:30:07.852 INFO:tasks.workunit.client.1.smithi193.stdout:7/486: mkdir d9/d18/d22/d2b/da6 0 2024-09-04T16:30:07.855 INFO:tasks.workunit.client.1.smithi193.stdout:7/487: creat d9/d11/fa7 x:0 0 0 2024-09-04T16:30:07.855 INFO:tasks.workunit.client.1.smithi193.stdout:7/488: dread - d9/de/f5a zero size 2024-09-04T16:30:07.856 INFO:tasks.workunit.client.1.smithi193.stdout:7/489: rename d9/d18/d22 to d9/d18/d22/d2b/d96/da8 22 2024-09-04T16:30:07.856 INFO:tasks.workunit.client.1.smithi193.stdout:5/387: write d1/d29/d69/d3e/f41 [1058407,65528] 0 2024-09-04T16:30:07.859 INFO:tasks.workunit.client.1.smithi193.stdout:5/388: chown d1/d29/d1e/d37/f4d 9 1 2024-09-04T16:30:07.865 INFO:tasks.workunit.client.1.smithi193.stdout:5/389: truncate d1/d29/d69/d3e/f41 166260 0 2024-09-04T16:30:07.867 INFO:tasks.workunit.client.1.smithi193.stdout:5/390: mkdir d1/d29/d74 0 2024-09-04T16:30:07.868 INFO:tasks.workunit.client.1.smithi193.stdout:5/391: readlink d1/d8/l24 0 2024-09-04T16:30:07.868 INFO:tasks.workunit.client.1.smithi193.stdout:5/392: chown d1/d8/db/d15 1807576 1 2024-09-04T16:30:07.868 INFO:tasks.workunit.client.1.smithi193.stdout:5/393: write d1/d29/f6e [396404,4784] 0 2024-09-04T16:30:07.869 INFO:tasks.workunit.client.1.smithi193.stdout:7/490: dread d9/d39/d3e/f7c [0,4194304] 0 2024-09-04T16:30:07.870 INFO:tasks.workunit.client.1.smithi193.stdout:5/394: mknod d1/d29/c75 0 2024-09-04T16:30:07.872 INFO:tasks.workunit.client.1.smithi193.stdout:7/491: mknod d9/d39/d3e/d7d/ca9 0 2024-09-04T16:30:07.872 INFO:tasks.workunit.client.1.smithi193.stdout:5/395: fsync d1/d29/d18/d42/f51 0 2024-09-04T16:30:07.875 INFO:tasks.workunit.client.1.smithi193.stdout:7/492: dread d9/d18/d22/d2b/f5f [0,4194304] 0 2024-09-04T16:30:07.876 INFO:tasks.workunit.client.0.smithi170.stdout:3/63: sync 2024-09-04T16:30:07.877 INFO:tasks.workunit.client.0.smithi170.stdout:3/64: write f10 [4407550,32813] 0 2024-09-04T16:30:07.877 INFO:tasks.workunit.client.1.smithi193.stdout:7/493: creat d9/d39/d3e/d4a/faa x:0 0 0 2024-09-04T16:30:07.878 INFO:tasks.workunit.client.1.smithi193.stdout:7/494: write f3 [2658305,86939] 0 2024-09-04T16:30:07.879 INFO:tasks.workunit.client.1.smithi193.stdout:7/495: write d9/d39/d3e/d4a/faa [298063,24918] 0 2024-09-04T16:30:07.882 INFO:tasks.workunit.client.1.smithi193.stdout:5/396: write d1/d29/d69/d3e/f41 [342464,48291] 0 2024-09-04T16:30:07.884 INFO:tasks.workunit.client.0.smithi170.stdout:3/65: link f12 d13/d14/f15 0 2024-09-04T16:30:07.889 INFO:tasks.workunit.client.0.smithi170.stdout:3/66: creat d13/d14/f16 x:0 0 0 2024-09-04T16:30:07.889 INFO:tasks.workunit.client.0.smithi170.stdout:3/67: dread - d13/d14/f15 zero size 2024-09-04T16:30:07.890 INFO:tasks.workunit.client.1.smithi193.stdout:5/397: link d1/d8/f2d d1/d29/d1e/f76 0 2024-09-04T16:30:07.890 INFO:tasks.workunit.client.1.smithi193.stdout:5/398: chown d1/d8/fd 49016 1 2024-09-04T16:30:07.894 INFO:tasks.workunit.client.1.smithi193.stdout:7/496: dread d9/d39/d3e/d69/f82 [0,4194304] 0 2024-09-04T16:30:07.895 INFO:tasks.workunit.client.1.smithi193.stdout:0/402: sync 2024-09-04T16:30:07.895 INFO:tasks.workunit.client.1.smithi193.stdout:1/435: sync 2024-09-04T16:30:07.896 INFO:tasks.workunit.client.1.smithi193.stdout:0/403: stat d18/d25/c30 0 2024-09-04T16:30:07.896 INFO:tasks.workunit.client.1.smithi193.stdout:1/436: stat d1/d2b/d1b/c3d 0 2024-09-04T16:30:07.897 INFO:tasks.workunit.client.0.smithi170.stdout:3/68: dwrite f10 [0,4194304] 0 2024-09-04T16:30:07.897 INFO:tasks.workunit.client.1.smithi193.stdout:0/404: fdatasync d18/d25/d32/f42 0 2024-09-04T16:30:07.899 INFO:tasks.workunit.client.1.smithi193.stdout:7/497: mkdir d9/d39/d3e/d4d/d4f/dab 0 2024-09-04T16:30:07.901 INFO:tasks.workunit.client.1.smithi193.stdout:5/399: write d1/d29/d1e/f76 [2599811,37842] 0 2024-09-04T16:30:07.907 INFO:tasks.workunit.client.1.smithi193.stdout:7/498: dwrite d9/d85/f9f [0,4194304] 0 2024-09-04T16:30:07.923 INFO:tasks.workunit.client.1.smithi193.stdout:2/360: sync 2024-09-04T16:30:07.923 INFO:tasks.workunit.client.1.smithi193.stdout:8/401: sync 2024-09-04T16:30:07.971 INFO:tasks.workunit.client.1.smithi193.stdout:4/309: sync 2024-09-04T16:30:07.971 INFO:tasks.workunit.client.1.smithi193.stdout:6/366: sync 2024-09-04T16:30:07.971 INFO:tasks.workunit.client.1.smithi193.stdout:3/416: sync 2024-09-04T16:30:07.971 INFO:tasks.workunit.client.1.smithi193.stdout:9/467: sync 2024-09-04T16:30:07.972 INFO:tasks.workunit.client.1.smithi193.stdout:9/468: chown d2/d4/f5 22305565 1 2024-09-04T16:30:07.973 INFO:tasks.workunit.client.1.smithi193.stdout:9/469: read d2/d18/d2f/d22/d30/f72 [2949377,95767] 0 2024-09-04T16:30:07.993 INFO:tasks.workunit.client.1.smithi193.stdout:1/437: rename d1/l2 to d1/d39/l8c 0 2024-09-04T16:30:07.993 INFO:tasks.workunit.client.1.smithi193.stdout:0/405: getdents d18/d79 0 2024-09-04T16:30:07.993 INFO:tasks.workunit.client.1.smithi193.stdout:1/438: chown d1/d2b/d10/f59 34768 1 2024-09-04T16:30:07.994 INFO:tasks.workunit.client.1.smithi193.stdout:5/400: creat d1/d29/d69/d3e/d55/f77 x:0 0 0 2024-09-04T16:30:07.994 INFO:tasks.workunit.client.1.smithi193.stdout:0/406: write d18/d25/d32/f53 [883197,113732] 0 2024-09-04T16:30:07.994 INFO:tasks.workunit.client.1.smithi193.stdout:7/499: rmdir d9/de/d27/d62 39 2024-09-04T16:30:07.995 INFO:tasks.workunit.client.1.smithi193.stdout:1/439: write d1/d2b/d1b/d28/f75 [75282,128019] 0 2024-09-04T16:30:07.996 INFO:tasks.workunit.client.1.smithi193.stdout:8/402: mkdir d2/d20/d23/d34/d3e/d6f/d81 0 2024-09-04T16:30:07.998 INFO:tasks.workunit.client.1.smithi193.stdout:4/310: write d3/d1a/d2a/f2d [4767758,58785] 0 2024-09-04T16:30:07.999 INFO:tasks.workunit.client.1.smithi193.stdout:3/417: mkdir d0/d18/d1c/d25/d5e/d90 0 2024-09-04T16:30:08.003 INFO:tasks.workunit.client.1.smithi193.stdout:5/401: rename d1/d29/d18/d42/f4c to d1/d8/db/d23/f78 0 2024-09-04T16:30:08.005 INFO:tasks.workunit.client.1.smithi193.stdout:7/500: read d9/de/f49 [1146309,93023] 0 2024-09-04T16:30:08.005 INFO:tasks.workunit.client.1.smithi193.stdout:8/403: mkdir d2/d20/d23/d51/d59/d82 0 2024-09-04T16:30:08.006 INFO:tasks.workunit.client.1.smithi193.stdout:2/361: dwrite d2/d14/f50 [0,4194304] 0 2024-09-04T16:30:08.013 INFO:tasks.workunit.client.1.smithi193.stdout:3/418: readlink d0/d9/d49/d7b/l86 0 2024-09-04T16:30:08.014 INFO:tasks.workunit.client.1.smithi193.stdout:1/440: dwrite d1/d2b/db/f82 [0,4194304] 0 2024-09-04T16:30:08.014 INFO:tasks.workunit.client.1.smithi193.stdout:7/501: chown d9/d39/d3e/fa2 81435199 1 2024-09-04T16:30:08.020 INFO:tasks.workunit.client.1.smithi193.stdout:0/407: dread fb [0,4194304] 0 2024-09-04T16:30:08.020 INFO:tasks.workunit.client.1.smithi193.stdout:8/404: write d2/d12/fd [498757,89048] 0 2024-09-04T16:30:08.021 INFO:tasks.workunit.client.1.smithi193.stdout:9/470: getdents d2/d56/d86 0 2024-09-04T16:30:08.022 INFO:tasks.workunit.client.1.smithi193.stdout:2/362: creat d2/d9/db/d10/f7d x:0 0 0 2024-09-04T16:30:08.022 INFO:tasks.workunit.client.1.smithi193.stdout:4/311: dwrite d3/f12 [0,4194304] 0 2024-09-04T16:30:08.023 INFO:tasks.workunit.client.1.smithi193.stdout:7/502: read d9/d39/d3e/d4d/d4f/f5d [195505,30513] 0 2024-09-04T16:30:08.025 INFO:tasks.workunit.client.1.smithi193.stdout:5/402: dwrite d1/d8/db/d36/f65 [0,4194304] 0 2024-09-04T16:30:08.026 INFO:tasks.workunit.client.1.smithi193.stdout:1/441: write d1/d2b/d10/f17 [2716024,20070] 0 2024-09-04T16:30:08.027 INFO:tasks.workunit.client.1.smithi193.stdout:4/312: write f0 [5670067,128348] 0 2024-09-04T16:30:08.027 INFO:tasks.workunit.client.1.smithi193.stdout:9/471: write d2/d8/f4f [4416183,89813] 0 2024-09-04T16:30:08.028 INFO:tasks.workunit.client.1.smithi193.stdout:2/363: chown d2/d9/db/d10/f7d 294 1 2024-09-04T16:30:08.028 INFO:tasks.workunit.client.1.smithi193.stdout:8/405: chown d2/d20/d23/d34/c6b 161057 1 2024-09-04T16:30:08.029 INFO:tasks.workunit.client.1.smithi193.stdout:0/408: mkdir d18/d8d 0 2024-09-04T16:30:08.029 INFO:tasks.workunit.client.1.smithi193.stdout:2/364: readlink d2/l2f 0 2024-09-04T16:30:08.032 INFO:tasks.workunit.client.1.smithi193.stdout:3/419: getdents d0/d18/d1c/d25/d5e/d68 0 2024-09-04T16:30:08.033 INFO:tasks.workunit.client.1.smithi193.stdout:5/403: mknod d1/d29/c79 0 2024-09-04T16:30:08.033 INFO:tasks.workunit.client.1.smithi193.stdout:7/503: symlink d9/d39/d3e/lac 0 2024-09-04T16:30:08.034 INFO:tasks.workunit.client.1.smithi193.stdout:4/313: creat d3/d39/d44/f6a x:0 0 0 2024-09-04T16:30:08.034 INFO:tasks.workunit.client.1.smithi193.stdout:3/420: dread - d0/d18/d1b/f8b zero size 2024-09-04T16:30:08.036 INFO:tasks.workunit.client.1.smithi193.stdout:7/504: chown d9/d39/d3e/d69/f80 424782620 1 2024-09-04T16:30:08.037 INFO:tasks.workunit.client.1.smithi193.stdout:4/314: read d3/d1a/d2a/f3b [835914,33003] 0 2024-09-04T16:30:08.037 INFO:tasks.workunit.client.1.smithi193.stdout:0/409: rename ca to d18/d25/d5f/d65/c8e 0 2024-09-04T16:30:08.038 INFO:tasks.workunit.client.1.smithi193.stdout:5/404: rmdir d1 39 2024-09-04T16:30:08.038 INFO:tasks.workunit.client.1.smithi193.stdout:6/367: sync 2024-09-04T16:30:08.040 INFO:tasks.workunit.client.1.smithi193.stdout:1/442: getdents d1/d2b/d1b/d28/d50/d84 0 2024-09-04T16:30:08.041 INFO:tasks.workunit.client.1.smithi193.stdout:7/505: write d9/d39/d3e/d4d/d4f/f86 [2087188,27239] 0 2024-09-04T16:30:08.041 INFO:tasks.workunit.client.1.smithi193.stdout:8/406: truncate d2/d20/d23/d24/d3c/d65/f74 1042897 0 2024-09-04T16:30:08.043 INFO:tasks.workunit.client.1.smithi193.stdout:7/506: write d9/d39/d3e/d53/fa5 [417403,37125] 0 2024-09-04T16:30:08.045 INFO:tasks.workunit.client.1.smithi193.stdout:7/507: read d9/d39/d3e/d69/f83 [1019997,5255] 0 2024-09-04T16:30:08.045 INFO:tasks.workunit.client.1.smithi193.stdout:6/368: creat d5/de/d15/d1b/d5f/f76 x:0 0 0 2024-09-04T16:30:08.049 INFO:tasks.workunit.client.1.smithi193.stdout:4/315: link d3/f14 d3/d39/f6b 0 2024-09-04T16:30:08.050 INFO:tasks.workunit.client.1.smithi193.stdout:6/369: dwrite d5/fb [0,4194304] 0 2024-09-04T16:30:08.051 INFO:tasks.workunit.client.1.smithi193.stdout:9/472: dread d2/d8/d15/f71 [0,4194304] 0 2024-09-04T16:30:08.051 INFO:tasks.workunit.client.1.smithi193.stdout:9/473: read - d2/d8/d4d/f91 zero size 2024-09-04T16:30:08.052 INFO:tasks.workunit.client.1.smithi193.stdout:8/407: symlink d2/d20/d23/d24/d3c/d65/l83 0 2024-09-04T16:30:08.055 INFO:tasks.workunit.client.0.smithi170.stdout:6/125: sync 2024-09-04T16:30:08.055 INFO:tasks.workunit.client.0.smithi170.stdout:0/154: sync 2024-09-04T16:30:08.055 INFO:tasks.workunit.client.0.smithi170.stdout:8/22: sync 2024-09-04T16:30:08.055 INFO:tasks.workunit.client.0.smithi170.stdout:9/133: sync 2024-09-04T16:30:08.055 INFO:tasks.workunit.client.0.smithi170.stdout:5/71: sync 2024-09-04T16:30:08.055 INFO:tasks.workunit.client.0.smithi170.stdout:4/152: sync 2024-09-04T16:30:08.055 INFO:tasks.workunit.client.0.smithi170.stdout:2/66: sync 2024-09-04T16:30:08.055 INFO:tasks.workunit.client.0.smithi170.stdout:1/142: sync 2024-09-04T16:30:08.055 INFO:tasks.workunit.client.0.smithi170.stdout:7/149: sync 2024-09-04T16:30:08.059 INFO:tasks.workunit.client.0.smithi170.stdout:8/23: write f0 [1916758,117484] 0 2024-09-04T16:30:08.061 INFO:tasks.workunit.client.0.smithi170.stdout:2/67: creat d3/db/df/f16 x:0 0 0 2024-09-04T16:30:08.062 INFO:tasks.workunit.client.0.smithi170.stdout:9/134: write d2/d7/f20 [2780851,69417] 0 2024-09-04T16:30:08.062 INFO:tasks.workunit.client.0.smithi170.stdout:1/143: mkdir d9/d11/d2e 0 2024-09-04T16:30:08.063 INFO:tasks.workunit.client.0.smithi170.stdout:8/24: fsync f0 0 2024-09-04T16:30:08.063 INFO:tasks.workunit.client.0.smithi170.stdout:9/135: chown d2/d11/f22 112507 1 2024-09-04T16:30:08.064 INFO:tasks.workunit.client.0.smithi170.stdout:5/72: rename d4/c9 to d4/db/c18 0 2024-09-04T16:30:08.064 INFO:tasks.workunit.client.0.smithi170.stdout:9/136: write d2/d7/f1f [947894,28137] 0 2024-09-04T16:30:08.071 INFO:tasks.workunit.client.1.smithi193.stdout:2/365: link d2/d9/db/d10/l32 d2/l7e 0 2024-09-04T16:30:08.071 INFO:tasks.workunit.client.1.smithi193.stdout:9/474: stat d2/d18/d2f/d22/d30/c8d 0 2024-09-04T16:30:08.071 INFO:tasks.workunit.client.0.smithi170.stdout:8/25: dwrite f0 [0,4194304] 0 2024-09-04T16:30:08.071 INFO:tasks.workunit.client.1.smithi193.stdout:0/410: rmdir d18/d8d 0 2024-09-04T16:30:08.072 INFO:tasks.workunit.client.0.smithi170.stdout:9/137: dread d2/f4 [0,4194304] 0 2024-09-04T16:30:08.072 INFO:tasks.workunit.client.0.smithi170.stdout:6/126: symlink d0/d17/d2a/l2b 0 2024-09-04T16:30:08.073 INFO:tasks.workunit.client.1.smithi193.stdout:0/411: chown d18/l22 2 1 2024-09-04T16:30:08.074 INFO:tasks.workunit.client.1.smithi193.stdout:3/421: rename d0/d10/d24/c81 to d0/d18/c91 0 2024-09-04T16:30:08.075 INFO:tasks.workunit.client.1.smithi193.stdout:1/443: rename d1/d2b to d1/d2b/db/d54/d8d 22 2024-09-04T16:30:08.076 INFO:tasks.workunit.client.1.smithi193.stdout:6/370: dwrite d5/f3f [4194304,4194304] 0 2024-09-04T16:30:08.077 INFO:tasks.workunit.client.1.smithi193.stdout:4/316: dread d3/f1c [0,4194304] 0 2024-09-04T16:30:08.078 INFO:tasks.workunit.client.0.smithi170.stdout:0/155: symlink d11/d13/d36/l3b 0 2024-09-04T16:30:08.079 INFO:tasks.workunit.client.0.smithi170.stdout:8/26: dwrite f0 [0,4194304] 0 2024-09-04T16:30:08.081 INFO:tasks.workunit.client.1.smithi193.stdout:6/371: chown d5/de/d15/f2f 336 1 2024-09-04T16:30:08.082 INFO:tasks.workunit.client.1.smithi193.stdout:3/422: rmdir d0/d10/d24 39 2024-09-04T16:30:08.084 INFO:tasks.workunit.client.1.smithi193.stdout:2/366: dwrite d2/d9/db/d10/f7d [0,4194304] 0 2024-09-04T16:30:08.086 INFO:tasks.workunit.client.1.smithi193.stdout:5/405: rename d1/d8/db/d23/f78 to d1/d29/d69/d3e/f7a 0 2024-09-04T16:30:08.095 INFO:tasks.workunit.client.1.smithi193.stdout:9/475: mkdir d2/d18/d2f/d22/d30/d6a/d6e/d81/d93 0 2024-09-04T16:30:08.095 INFO:tasks.workunit.client.0.smithi170.stdout:2/68: write f2 [4659503,66624] 0 2024-09-04T16:30:08.096 INFO:tasks.workunit.client.0.smithi170.stdout:2/69: dread - d3/db/f12 zero size 2024-09-04T16:30:08.096 INFO:tasks.workunit.client.0.smithi170.stdout:7/150: truncate fc 3825872 0 2024-09-04T16:30:08.097 INFO:tasks.workunit.client.1.smithi193.stdout:5/406: dwrite d1/d29/d69/f66 [0,4194304] 0 2024-09-04T16:30:08.099 INFO:tasks.workunit.client.0.smithi170.stdout:6/127: creat d0/df/d1f/f2c x:0 0 0 2024-09-04T16:30:08.104 INFO:tasks.workunit.client.1.smithi193.stdout:3/423: dread d0/d18/d1c/d25/f42 [0,4194304] 0 2024-09-04T16:30:08.105 INFO:tasks.workunit.client.1.smithi193.stdout:6/372: creat d5/de/d15/d1b/d5f/f77 x:0 0 0 2024-09-04T16:30:08.107 INFO:tasks.workunit.client.1.smithi193.stdout:2/367: truncate d2/d9/d18/f6f 971341 0 2024-09-04T16:30:08.109 INFO:tasks.workunit.client.1.smithi193.stdout:4/317: write d3/f29 [1081140,11608] 0 2024-09-04T16:30:08.109 INFO:tasks.workunit.client.1.smithi193.stdout:2/368: chown d2/d9/db/c46 7 1 2024-09-04T16:30:08.110 INFO:tasks.workunit.client.0.smithi170.stdout:9/138: dwrite d2/d7/f1a [4194304,4194304] 0 2024-09-04T16:30:08.111 INFO:tasks.workunit.client.1.smithi193.stdout:8/408: link d2/c2a d2/d20/d23/d34/d3e/c84 0 2024-09-04T16:30:08.111 INFO:tasks.workunit.client.1.smithi193.stdout:4/318: stat d3/d39/d44/f6a 0 2024-09-04T16:30:08.112 INFO:tasks.workunit.client.0.smithi170.stdout:1/144: rmdir d9/d26/d2a 0 2024-09-04T16:30:08.113 INFO:tasks.workunit.client.1.smithi193.stdout:4/319: readlink d3/l33 0 2024-09-04T16:30:08.113 INFO:tasks.workunit.client.1.smithi193.stdout:2/369: chown d2/d9/db/d10/d51/d79 1 1 2024-09-04T16:30:08.113 INFO:tasks.workunit.client.1.smithi193.stdout:0/412: dwrite f6 [0,4194304] 0 2024-09-04T16:30:08.114 INFO:tasks.workunit.client.0.smithi170.stdout:7/151: mknod d12/d16/d1d/c31 0 2024-09-04T16:30:08.114 INFO:tasks.workunit.client.1.smithi193.stdout:9/476: creat d2/d18/d2f/d22/d30/d6a/f94 x:0 0 0 2024-09-04T16:30:08.114 INFO:tasks.workunit.client.0.smithi170.stdout:6/128: mkdir d0/d17/d25/d2d 0 2024-09-04T16:30:08.116 INFO:tasks.workunit.client.1.smithi193.stdout:4/320: dread - d3/d1a/d21/f37 zero size 2024-09-04T16:30:08.116 INFO:tasks.workunit.client.0.smithi170.stdout:6/129: truncate d0/f5 955170 0 2024-09-04T16:30:08.116 INFO:tasks.workunit.client.0.smithi170.stdout:4/153: rename d1/d6/d8/d20/l24 to d1/d6/d8/l39 0 2024-09-04T16:30:08.118 INFO:tasks.workunit.client.1.smithi193.stdout:3/424: mknod d0/d9/c92 0 2024-09-04T16:30:08.120 INFO:tasks.workunit.client.0.smithi170.stdout:9/139: symlink d2/d7/l25 0 2024-09-04T16:30:08.120 INFO:tasks.workunit.client.0.smithi170.stdout:9/140: chown d2/lb 342 1 2024-09-04T16:30:08.120 INFO:tasks.workunit.client.1.smithi193.stdout:8/409: rmdir d2/d20/d23/d24 39 2024-09-04T16:30:08.124 INFO:tasks.workunit.client.1.smithi193.stdout:2/370: mknod d2/d9/db/d10/c7f 0 2024-09-04T16:30:08.124 INFO:tasks.workunit.client.1.smithi193.stdout:5/407: dwrite d1/d8/f12 [0,4194304] 0 2024-09-04T16:30:08.127 INFO:tasks.workunit.client.1.smithi193.stdout:0/413: rename d18/l5c to d18/d25/d3b/l8f 0 2024-09-04T16:30:08.129 INFO:tasks.workunit.client.0.smithi170.stdout:5/73: getdents d4 0 2024-09-04T16:30:08.129 INFO:tasks.workunit.client.0.smithi170.stdout:5/74: fsync f1 0 2024-09-04T16:30:08.130 INFO:tasks.workunit.client.0.smithi170.stdout:5/75: read d4/db/fc [39022,52474] 0 2024-09-04T16:30:08.131 INFO:tasks.workunit.client.1.smithi193.stdout:5/408: dwrite d1/d29/d18/f5e [4194304,4194304] 0 2024-09-04T16:30:08.133 INFO:tasks.workunit.client.1.smithi193.stdout:7/508: sync 2024-09-04T16:30:08.133 INFO:tasks.workunit.client.0.smithi170.stdout:8/27: rename f0 to d6/f8 0 2024-09-04T16:30:08.134 INFO:tasks.workunit.client.0.smithi170.stdout:8/28: readlink l4 0 2024-09-04T16:30:08.134 INFO:tasks.workunit.client.1.smithi193.stdout:7/509: chown d9/d39/d3e/d53/fa5 10 1 2024-09-04T16:30:08.134 INFO:tasks.workunit.client.1.smithi193.stdout:7/510: chown d9/d39 0 1 2024-09-04T16:30:08.135 INFO:tasks.workunit.client.1.smithi193.stdout:7/511: chown d9/d39/d3e 187 1 2024-09-04T16:30:08.135 INFO:tasks.workunit.client.0.smithi170.stdout:4/154: symlink d1/d6/l3a 0 2024-09-04T16:30:08.136 INFO:tasks.workunit.client.1.smithi193.stdout:1/444: getdents d1/d2b/db 0 2024-09-04T16:30:08.137 INFO:tasks.workunit.client.1.smithi193.stdout:3/425: creat d0/d7/de/d45/f93 x:0 0 0 2024-09-04T16:30:08.139 INFO:tasks.workunit.client.0.smithi170.stdout:9/141: write d2/d7/fc [1265946,115389] 0 2024-09-04T16:30:08.141 INFO:tasks.workunit.client.0.smithi170.stdout:6/130: mkdir d0/d17/d25/d2d/d2e 0 2024-09-04T16:30:08.148 INFO:tasks.workunit.client.1.smithi193.stdout:4/321: rename d3/d1a/d21/f3e to d3/d1a/d21/d52/f6c 0 2024-09-04T16:30:08.150 INFO:tasks.workunit.client.1.smithi193.stdout:2/371: dwrite d2/d9/db/d10/d1f/d4a/f64 [0,4194304] 0 2024-09-04T16:30:08.150 INFO:tasks.workunit.client.0.smithi170.stdout:7/152: rename d12/d16/d1d/d21/f22 to d12/d16/d1d/f32 0 2024-09-04T16:30:08.150 INFO:tasks.workunit.client.1.smithi193.stdout:2/372: chown d2/d9/d18/c2b 3 1 2024-09-04T16:30:08.152 INFO:tasks.workunit.client.1.smithi193.stdout:5/409: unlink d1/l10 0 2024-09-04T16:30:08.155 INFO:tasks.workunit.client.1.smithi193.stdout:1/445: symlink d1/d39/d48/l8e 0 2024-09-04T16:30:08.155 INFO:tasks.workunit.client.1.smithi193.stdout:1/446: readlink d1/d39/d48/l8e 0 2024-09-04T16:30:08.161 INFO:tasks.workunit.client.0.smithi170.stdout:6/131: dwrite d0/df/d1b/f24 [0,4194304] 0 2024-09-04T16:30:08.161 INFO:tasks.workunit.client.1.smithi193.stdout:1/447: dwrite d1/d2b/d10/f25 [0,4194304] 0 2024-09-04T16:30:08.162 INFO:tasks.workunit.client.0.smithi170.stdout:5/76: dwrite d4/db/fe [4194304,4194304] 0 2024-09-04T16:30:08.163 INFO:tasks.workunit.client.1.smithi193.stdout:6/373: truncate d5/de/d15/f24 2776925 0 2024-09-04T16:30:08.163 INFO:tasks.workunit.client.0.smithi170.stdout:9/142: dwrite d2/d11/f24 [4194304,4194304] 0 2024-09-04T16:30:08.164 INFO:tasks.workunit.client.1.smithi193.stdout:1/448: write d1/d2b/db/f5b [511197,88302] 0 2024-09-04T16:30:08.164 INFO:tasks.workunit.client.0.smithi170.stdout:9/143: truncate d2/f13 442603 0 2024-09-04T16:30:08.165 INFO:tasks.workunit.client.0.smithi170.stdout:0/156: getdents d11/d13 0 2024-09-04T16:30:08.165 INFO:tasks.workunit.client.0.smithi170.stdout:5/77: chown d4/d8/c12 1447086 1 2024-09-04T16:30:08.166 INFO:tasks.workunit.client.0.smithi170.stdout:9/144: chown d2/c6 2757624 1 2024-09-04T16:30:08.166 INFO:tasks.workunit.client.1.smithi193.stdout:6/374: chown d5/de/d15/d1b/f1e 398197975 1 2024-09-04T16:30:08.166 INFO:tasks.workunit.client.1.smithi193.stdout:8/410: mknod d2/d20/c85 0 2024-09-04T16:30:08.167 INFO:tasks.workunit.client.1.smithi193.stdout:6/375: dread - d5/d33/d4e/d51/f66 zero size 2024-09-04T16:30:08.172 INFO:tasks.workunit.client.0.smithi170.stdout:1/145: truncate d9/f15 56511 0 2024-09-04T16:30:08.173 INFO:tasks.workunit.client.0.smithi170.stdout:5/78: dread d4/db/fc [0,4194304] 0 2024-09-04T16:30:08.177 INFO:tasks.workunit.client.0.smithi170.stdout:7/153: rmdir d12/d16 39 2024-09-04T16:30:08.179 INFO:tasks.workunit.client.0.smithi170.stdout:4/155: mkdir d1/d6/d8/d3b 0 2024-09-04T16:30:08.180 INFO:tasks.workunit.client.1.smithi193.stdout:6/376: dwrite d5/d27/d3e/f69 [0,4194304] 0 2024-09-04T16:30:08.181 INFO:tasks.workunit.client.1.smithi193.stdout:6/377: write d5/de/f45 [285876,90645] 0 2024-09-04T16:30:08.182 INFO:tasks.workunit.client.1.smithi193.stdout:5/410: creat d1/d29/d69/f7b x:0 0 0 2024-09-04T16:30:08.184 INFO:tasks.workunit.client.0.smithi170.stdout:5/79: dwrite d4/db/fc [0,4194304] 0 2024-09-04T16:30:08.184 INFO:tasks.workunit.client.0.smithi170.stdout:6/132: symlink d0/d17/l2f 0 2024-09-04T16:30:08.186 INFO:tasks.workunit.client.0.smithi170.stdout:6/133: truncate d0/d15/f26 75697 0 2024-09-04T16:30:08.188 INFO:tasks.workunit.client.0.smithi170.stdout:0/157: creat d11/d13/d1a/f3c x:0 0 0 2024-09-04T16:30:08.190 INFO:tasks.workunit.client.1.smithi193.stdout:3/426: mknod d0/d18/d1c/d51/d6c/c94 0 2024-09-04T16:30:08.193 INFO:tasks.workunit.client.1.smithi193.stdout:1/449: rmdir d1/d2b/d10/d56 39 2024-09-04T16:30:08.196 INFO:tasks.workunit.client.0.smithi170.stdout:1/146: chown d9/f18 0 1 2024-09-04T16:30:08.197 INFO:tasks.workunit.client.1.smithi193.stdout:8/411: mkdir d2/d86 0 2024-09-04T16:30:08.199 INFO:tasks.workunit.client.0.smithi170.stdout:8/29: rmdir d6/d7 0 2024-09-04T16:30:08.200 INFO:tasks.workunit.client.1.smithi193.stdout:9/477: getdents d2/d18/d2f/d22/d30/d6a 0 2024-09-04T16:30:08.202 INFO:tasks.workunit.client.1.smithi193.stdout:0/414: creat d18/d25/f90 x:0 0 0 2024-09-04T16:30:08.203 INFO:tasks.workunit.client.1.smithi193.stdout:0/415: chown cf 566 1 2024-09-04T16:30:08.203 INFO:tasks.workunit.client.0.smithi170.stdout:4/156: creat d1/d6/d2b/d33/d36/f3c x:0 0 0 2024-09-04T16:30:08.204 INFO:tasks.workunit.client.1.smithi193.stdout:4/322: write d3/f30 [1033679,65743] 0 2024-09-04T16:30:08.205 INFO:tasks.workunit.client.0.smithi170.stdout:5/80: truncate d4/f6 584814 0 2024-09-04T16:30:08.207 INFO:tasks.workunit.client.0.smithi170.stdout:6/134: mkdir d0/d17/d2a/d30 0 2024-09-04T16:30:08.210 INFO:tasks.workunit.client.0.smithi170.stdout:9/145: link d2/fd d2/d11/f26 0 2024-09-04T16:30:08.211 INFO:tasks.workunit.client.0.smithi170.stdout:9/146: write d2/d11/f24 [7279959,57186] 0 2024-09-04T16:30:08.211 INFO:tasks.workunit.client.0.smithi170.stdout:1/147: truncate d9/f18 2788772 0 2024-09-04T16:30:08.214 INFO:tasks.workunit.client.0.smithi170.stdout:7/154: symlink d12/l33 0 2024-09-04T16:30:08.215 INFO:tasks.workunit.client.1.smithi193.stdout:5/411: symlink d1/d29/l7c 0 2024-09-04T16:30:08.216 INFO:tasks.workunit.client.0.smithi170.stdout:5/81: symlink d4/d8/l19 0 2024-09-04T16:30:08.219 INFO:tasks.workunit.client.1.smithi193.stdout:3/427: unlink d0/d10/f1a 0 2024-09-04T16:30:08.220 INFO:tasks.workunit.client.0.smithi170.stdout:6/135: mkdir d0/d17/d31 0 2024-09-04T16:30:08.220 INFO:tasks.workunit.client.1.smithi193.stdout:1/450: rmdir d1/d39/d48 39 2024-09-04T16:30:08.223 INFO:tasks.workunit.client.1.smithi193.stdout:1/451: dread d1/d2b/f2c [0,4194304] 0 2024-09-04T16:30:08.224 INFO:tasks.workunit.client.1.smithi193.stdout:9/478: mkdir d2/d18/d2f/d22/d30/d6a/d6e/d95 0 2024-09-04T16:30:08.224 INFO:tasks.workunit.client.0.smithi170.stdout:6/136: dread d0/d17/f1d [0,4194304] 0 2024-09-04T16:30:08.225 INFO:tasks.workunit.client.1.smithi193.stdout:9/479: dread - d2/d18/d2f/d22/d30/d6a/f94 zero size 2024-09-04T16:30:08.225 INFO:tasks.workunit.client.0.smithi170.stdout:9/147: mkdir d2/d7/d27 0 2024-09-04T16:30:08.225 INFO:tasks.workunit.client.1.smithi193.stdout:9/480: write d2/f42 [3787789,8636] 0 2024-09-04T16:30:08.226 INFO:tasks.workunit.client.0.smithi170.stdout:1/148: mkdir d9/d11/d2f 0 2024-09-04T16:30:08.226 INFO:tasks.workunit.client.0.smithi170.stdout:9/148: write d2/f13 [955600,102795] 0 2024-09-04T16:30:08.230 INFO:tasks.workunit.client.1.smithi193.stdout:7/512: rename d9/de/c15 to d9/d18/cad 0 2024-09-04T16:30:08.232 INFO:tasks.workunit.client.1.smithi193.stdout:2/373: rmdir d2/d9/d18/d74 0 2024-09-04T16:30:08.233 INFO:tasks.workunit.client.0.smithi170.stdout:6/137: dwrite d0/df/f28 [0,4194304] 0 2024-09-04T16:30:08.234 INFO:tasks.workunit.client.0.smithi170.stdout:7/155: mkdir d12/d15/d34 0 2024-09-04T16:30:08.241 INFO:tasks.workunit.client.1.smithi193.stdout:5/412: creat d1/d8/db/d15/d2b/f7d x:0 0 0 2024-09-04T16:30:08.242 INFO:tasks.workunit.client.1.smithi193.stdout:5/413: dread - d1/d8/db/f4e zero size 2024-09-04T16:30:08.244 INFO:tasks.workunit.client.1.smithi193.stdout:3/428: symlink d0/d18/d1c/d51/l95 0 2024-09-04T16:30:08.245 INFO:tasks.workunit.client.1.smithi193.stdout:3/429: dread - d0/d7/de/d45/f93 zero size 2024-09-04T16:30:08.247 INFO:tasks.workunit.client.0.smithi170.stdout:1/149: mknod d9/c30 0 2024-09-04T16:30:08.248 INFO:tasks.workunit.client.0.smithi170.stdout:1/150: fdatasync d9/f10 0 2024-09-04T16:30:08.248 INFO:tasks.workunit.client.1.smithi193.stdout:8/412: truncate d2/d20/d23/d1b/f21 4630815 0 2024-09-04T16:30:08.249 INFO:tasks.workunit.client.0.smithi170.stdout:0/158: dwrite ff [0,4194304] 0 2024-09-04T16:30:08.250 INFO:tasks.workunit.client.1.smithi193.stdout:1/452: fsync d1/f53 0 2024-09-04T16:30:08.250 INFO:tasks.workunit.client.0.smithi170.stdout:0/159: chown d11/c1e 45902 1 2024-09-04T16:30:08.253 INFO:tasks.workunit.client.1.smithi193.stdout:3/430: dread d0/d9/f2c [0,4194304] 0 2024-09-04T16:30:08.257 INFO:tasks.workunit.client.0.smithi170.stdout:7/156: write d12/d16/f1f [4843603,24968] 0 2024-09-04T16:30:08.258 INFO:tasks.workunit.client.1.smithi193.stdout:9/481: dread d2/d8/d4d/f69 [0,4194304] 0 2024-09-04T16:30:08.259 INFO:tasks.workunit.client.1.smithi193.stdout:4/323: symlink d3/d1a/l6d 0 2024-09-04T16:30:08.261 INFO:tasks.workunit.client.1.smithi193.stdout:7/513: symlink d9/d39/d3e/d53/lae 0 2024-09-04T16:30:08.261 INFO:tasks.workunit.client.0.smithi170.stdout:8/30: getdents d6 0 2024-09-04T16:30:08.265 INFO:tasks.workunit.client.0.smithi170.stdout:9/149: symlink d2/d7/d27/l28 0 2024-09-04T16:30:08.266 INFO:tasks.workunit.client.0.smithi170.stdout:9/150: chown d2/c6 125 1 2024-09-04T16:30:08.268 INFO:tasks.workunit.client.0.smithi170.stdout:0/160: symlink d11/d13/d1a/l3d 0 2024-09-04T16:30:08.269 INFO:tasks.workunit.client.0.smithi170.stdout:6/138: symlink d0/d17/d31/l32 0 2024-09-04T16:30:08.271 INFO:tasks.workunit.client.0.smithi170.stdout:5/82: fdatasync d4/f6 0 2024-09-04T16:30:08.273 INFO:tasks.workunit.client.0.smithi170.stdout:7/157: mknod d12/d16/d1d/d21/c35 0 2024-09-04T16:30:08.276 INFO:tasks.workunit.client.1.smithi193.stdout:9/482: mknod d2/d8/d61/c96 0 2024-09-04T16:30:08.277 INFO:tasks.workunit.client.0.smithi170.stdout:1/151: fdatasync d9/f18 0 2024-09-04T16:30:08.277 INFO:tasks.workunit.client.0.smithi170.stdout:7/158: dread d12/d16/d1d/f32 [0,4194304] 0 2024-09-04T16:30:08.278 INFO:tasks.workunit.client.0.smithi170.stdout:1/152: readlink d9/l1d 0 2024-09-04T16:30:08.278 INFO:tasks.workunit.client.1.smithi193.stdout:4/324: write d3/d1a/d54/f64 [245664,63684] 0 2024-09-04T16:30:08.278 INFO:tasks.workunit.client.1.smithi193.stdout:1/453: write d1/f1c [3708583,45629] 0 2024-09-04T16:30:08.279 INFO:tasks.workunit.client.0.smithi170.stdout:1/153: write d9/d11/f1e [753607,65964] 0 2024-09-04T16:30:08.280 INFO:tasks.workunit.client.0.smithi170.stdout:0/161: symlink d11/d2a/l3e 0 2024-09-04T16:30:08.282 INFO:tasks.workunit.client.0.smithi170.stdout:1/154: read d9/d11/f1e [236851,83235] 0 2024-09-04T16:30:08.283 INFO:tasks.workunit.client.0.smithi170.stdout:6/139: write d0/d17/f1d [1194708,128929] 0 2024-09-04T16:30:08.283 INFO:tasks.workunit.client.1.smithi193.stdout:6/378: getdents d5/d27/d3e/d49 0 2024-09-04T16:30:08.283 INFO:tasks.workunit.client.0.smithi170.stdout:1/155: rename d9 to d9/d26/d28/d31 22 2024-09-04T16:30:08.284 INFO:tasks.workunit.client.1.smithi193.stdout:7/514: dwrite d9/d18/d1e/f2e [0,4194304] 0 2024-09-04T16:30:08.285 INFO:tasks.workunit.client.0.smithi170.stdout:5/83: dread d4/f6 [0,4194304] 0 2024-09-04T16:30:08.286 INFO:tasks.workunit.client.0.smithi170.stdout:5/84: fsync f1 0 2024-09-04T16:30:08.286 INFO:tasks.workunit.client.0.smithi170.stdout:9/151: creat d2/d11/d23/f29 x:0 0 0 2024-09-04T16:30:08.287 INFO:tasks.workunit.client.0.smithi170.stdout:5/85: write d4/db/fe [512567,62621] 0 2024-09-04T16:30:08.287 INFO:tasks.workunit.client.1.smithi193.stdout:8/413: creat d2/d20/d23/d51/d76/f87 x:0 0 0 2024-09-04T16:30:08.291 INFO:tasks.workunit.client.1.smithi193.stdout:0/416: getdents d18/d25/d32/d57 0 2024-09-04T16:30:08.292 INFO:tasks.workunit.client.0.smithi170.stdout:6/140: unlink d0/l27 0 2024-09-04T16:30:08.295 INFO:tasks.workunit.client.1.smithi193.stdout:9/483: mknod d2/d18/d2f/d22/d30/d52/c97 0 2024-09-04T16:30:08.295 INFO:tasks.workunit.client.0.smithi170.stdout:9/152: dwrite d2/d11/d23/f29 [0,4194304] 0 2024-09-04T16:30:08.296 INFO:tasks.workunit.client.1.smithi193.stdout:9/484: chown d2/d56/d86/c90 2398 1 2024-09-04T16:30:08.297 INFO:tasks.workunit.client.1.smithi193.stdout:4/325: unlink d3/d1a/d2a/f41 0 2024-09-04T16:30:08.298 INFO:tasks.workunit.client.1.smithi193.stdout:3/431: dwrite d0/d18/d1c/d51/f56 [4194304,4194304] 0 2024-09-04T16:30:08.298 INFO:tasks.workunit.client.1.smithi193.stdout:4/326: readlink d3/d39/d44/l62 0 2024-09-04T16:30:08.300 INFO:tasks.workunit.client.1.smithi193.stdout:1/454: creat d1/d2b/db/f8f x:0 0 0 2024-09-04T16:30:08.301 INFO:tasks.workunit.client.0.smithi170.stdout:7/159: creat d12/d15/d34/f36 x:0 0 0 2024-09-04T16:30:08.302 INFO:tasks.workunit.client.0.smithi170.stdout:7/160: truncate d12/d16/f1f 4965343 0 2024-09-04T16:30:08.303 INFO:tasks.workunit.client.0.smithi170.stdout:7/161: write d12/f1a [1961864,101045] 0 2024-09-04T16:30:08.303 INFO:tasks.workunit.client.1.smithi193.stdout:2/374: rename d2/d9/db/d10/d38/f3b to d2/d9/f80 0 2024-09-04T16:30:08.304 INFO:tasks.workunit.client.0.smithi170.stdout:5/86: mknod d4/c1a 0 2024-09-04T16:30:08.304 INFO:tasks.workunit.client.1.smithi193.stdout:3/432: dread d0/d7/f6b [0,4194304] 0 2024-09-04T16:30:08.305 INFO:tasks.workunit.client.1.smithi193.stdout:6/379: stat d5/f6 0 2024-09-04T16:30:08.305 INFO:tasks.workunit.client.1.smithi193.stdout:5/414: link d1/d8/l24 d1/d8/db/d36/d40/d46/l7e 0 2024-09-04T16:30:08.306 INFO:tasks.workunit.client.0.smithi170.stdout:0/162: mkdir d11/d13/d2f/d3f 0 2024-09-04T16:30:08.307 INFO:tasks.workunit.client.1.smithi193.stdout:5/415: dread - d1/d8/db/d36/f52 zero size 2024-09-04T16:30:08.308 INFO:tasks.workunit.client.1.smithi193.stdout:8/414: creat d2/d20/d23/d1b/d4e/f88 x:0 0 0 2024-09-04T16:30:08.309 INFO:tasks.workunit.client.1.smithi193.stdout:0/417: mknod d18/d25/d3b/c91 0 2024-09-04T16:30:08.312 INFO:tasks.workunit.client.0.smithi170.stdout:6/141: symlink d0/d17/d25/l33 0 2024-09-04T16:30:08.313 INFO:tasks.workunit.client.0.smithi170.stdout:6/142: read d0/d17/f18 [2243959,32059] 0 2024-09-04T16:30:08.317 INFO:tasks.workunit.client.0.smithi170.stdout:5/87: chown d4/c13 1692 1 2024-09-04T16:30:08.320 INFO:tasks.workunit.client.0.smithi170.stdout:7/162: mknod d12/d16/d1d/d21/c37 0 2024-09-04T16:30:08.321 INFO:tasks.workunit.client.1.smithi193.stdout:4/327: mknod d3/d39/c6e 0 2024-09-04T16:30:08.322 INFO:tasks.workunit.client.0.smithi170.stdout:0/163: rename fd to d11/d13/d36/f40 0 2024-09-04T16:30:08.323 INFO:tasks.workunit.client.1.smithi193.stdout:1/455: rmdir d1/d2b/db/d54/d63 39 2024-09-04T16:30:08.325 INFO:tasks.workunit.client.0.smithi170.stdout:1/156: rmdir d9/d26/d28 0 2024-09-04T16:30:08.326 INFO:tasks.workunit.client.0.smithi170.stdout:1/157: write d9/f10 [2717936,12216] 0 2024-09-04T16:30:08.326 INFO:tasks.workunit.client.0.smithi170.stdout:0/164: dread fe [0,4194304] 0 2024-09-04T16:30:08.327 INFO:tasks.workunit.client.0.smithi170.stdout:0/165: write d11/f1c [217288,37462] 0 2024-09-04T16:30:08.328 INFO:tasks.workunit.client.1.smithi193.stdout:1/456: dwrite d1/d2b/db/f8f [0,4194304] 0 2024-09-04T16:30:08.328 INFO:tasks.workunit.client.0.smithi170.stdout:0/166: dread d11/f18 [0,4194304] 0 2024-09-04T16:30:08.329 INFO:tasks.workunit.client.1.smithi193.stdout:1/457: dread - d1/d2b/db/f7e zero size 2024-09-04T16:30:08.330 INFO:tasks.workunit.client.0.smithi170.stdout:0/167: read d11/d13/d2f/f31 [3556748,3562] 0 2024-09-04T16:30:08.331 INFO:tasks.workunit.client.1.smithi193.stdout:6/380: rename d5/f6 to d5/de/d15/d1b/d5f/f78 0 2024-09-04T16:30:08.332 INFO:tasks.workunit.client.1.smithi193.stdout:2/375: dwrite d2/d9/db/d10/d1e/d26/f3a [0,4194304] 0 2024-09-04T16:30:08.333 INFO:tasks.workunit.client.1.smithi193.stdout:2/376: write d2/d9/db/d10/d38/f5f [910647,111860] 0 2024-09-04T16:30:08.335 INFO:tasks.workunit.client.0.smithi170.stdout:7/163: creat d12/d15/d34/f38 x:0 0 0 2024-09-04T16:30:08.336 INFO:tasks.workunit.client.0.smithi170.stdout:7/164: readlink d12/d16/l1c 0 2024-09-04T16:30:08.342 INFO:tasks.workunit.client.1.smithi193.stdout:8/415: readlink d2/d20/d23/d24/d3c/d65/l83 0 2024-09-04T16:30:08.342 INFO:tasks.workunit.client.1.smithi193.stdout:8/416: readlink d2/d20/d23/d24/l77 0 2024-09-04T16:30:08.343 INFO:tasks.workunit.client.0.smithi170.stdout:1/158: creat d9/d11/f32 x:0 0 0 2024-09-04T16:30:08.343 INFO:tasks.workunit.client.1.smithi193.stdout:9/485: dwrite d2/d18/d2f/d22/d30/f72 [0,4194304] 0 2024-09-04T16:30:08.343 INFO:tasks.workunit.client.1.smithi193.stdout:0/418: rmdir d18/d25 39 2024-09-04T16:30:08.344 INFO:tasks.workunit.client.0.smithi170.stdout:7/165: dwrite d12/d15/f24 [0,4194304] 0 2024-09-04T16:30:08.346 INFO:tasks.workunit.client.0.smithi170.stdout:1/159: write d9/d11/f14 [1036840,76035] 0 2024-09-04T16:30:08.347 INFO:tasks.workunit.client.0.smithi170.stdout:1/160: write d9/f22 [118124,126814] 0 2024-09-04T16:30:08.351 INFO:tasks.workunit.client.1.smithi193.stdout:7/515: truncate d9/d18/f4c 51344 0 2024-09-04T16:30:08.353 INFO:tasks.workunit.client.0.smithi170.stdout:0/168: fdatasync d11/f23 0 2024-09-04T16:30:08.355 INFO:tasks.workunit.client.1.smithi193.stdout:4/328: symlink d3/d1a/d54/l6f 0 2024-09-04T16:30:08.355 INFO:tasks.workunit.client.0.smithi170.stdout:1/161: dread d9/f13 [0,4194304] 0 2024-09-04T16:30:08.356 INFO:tasks.workunit.client.1.smithi193.stdout:4/329: dread - d3/d3c/f53 zero size 2024-09-04T16:30:08.357 INFO:tasks.workunit.client.0.smithi170.stdout:5/88: truncate d4/db/fc 2392651 0 2024-09-04T16:30:08.361 INFO:tasks.workunit.client.1.smithi193.stdout:5/416: dread d1/f16 [0,4194304] 0 2024-09-04T16:30:08.361 INFO:tasks.workunit.client.1.smithi193.stdout:1/458: rename d1/f53 to d1/d2b/d1b/d51/d6d/f90 0 2024-09-04T16:30:08.362 INFO:tasks.workunit.client.0.smithi170.stdout:7/166: mknod d12/d16/c39 0 2024-09-04T16:30:08.363 INFO:tasks.workunit.client.1.smithi193.stdout:6/381: creat d5/de/d15/d1b/f79 x:0 0 0 2024-09-04T16:30:08.363 INFO:tasks.workunit.client.0.smithi170.stdout:1/162: dwrite d9/f13 [0,4194304] 0 2024-09-04T16:30:08.366 INFO:tasks.workunit.client.0.smithi170.stdout:6/143: link d0/d17/l2f d0/d17/d25/d2d/d2e/l34 0 2024-09-04T16:30:08.370 INFO:tasks.workunit.client.0.smithi170.stdout:5/89: rename d4/l17 to d4/l1b 0 2024-09-04T16:30:08.372 INFO:tasks.workunit.client.1.smithi193.stdout:6/382: fdatasync d5/de/f18 0 2024-09-04T16:30:08.373 INFO:tasks.workunit.client.1.smithi193.stdout:5/417: dread d1/d8/f12 [0,4194304] 0 2024-09-04T16:30:08.373 INFO:tasks.workunit.client.0.smithi170.stdout:5/90: write d4/f6 [1466684,50249] 0 2024-09-04T16:30:08.373 INFO:tasks.workunit.client.0.smithi170.stdout:1/163: mkdir d9/d33 0 2024-09-04T16:30:08.373 INFO:tasks.workunit.client.1.smithi193.stdout:8/417: dread - d2/d20/d23/d34/d3e/f41 zero size 2024-09-04T16:30:08.375 INFO:tasks.workunit.client.0.smithi170.stdout:7/167: dwrite d12/d15/f2f [0,4194304] 0 2024-09-04T16:30:08.375 INFO:tasks.workunit.client.1.smithi193.stdout:4/330: mknod d3/d3c/d47/c70 0 2024-09-04T16:30:08.376 INFO:tasks.workunit.client.1.smithi193.stdout:6/383: dread - d5/de/d15/d1b/d5f/f77 zero size 2024-09-04T16:30:08.377 INFO:tasks.workunit.client.1.smithi193.stdout:6/384: fsync d5/de/d15/d1b/f1e 0 2024-09-04T16:30:08.378 INFO:tasks.workunit.client.0.smithi170.stdout:1/164: truncate d9/d11/f32 998146 0 2024-09-04T16:30:08.379 INFO:tasks.workunit.client.0.smithi170.stdout:6/144: rmdir d0/df 39 2024-09-04T16:30:08.382 INFO:tasks.workunit.client.1.smithi193.stdout:3/433: write d0/d18/f3a [1934783,27518] 0 2024-09-04T16:30:08.385 INFO:tasks.workunit.client.0.smithi170.stdout:1/165: dwrite d9/f18 [0,4194304] 0 2024-09-04T16:30:08.387 INFO:tasks.workunit.client.0.smithi170.stdout:1/166: chown d9/f2b 1 1 2024-09-04T16:30:08.388 INFO:tasks.workunit.client.1.smithi193.stdout:0/419: write d18/f38 [8088797,129568] 0 2024-09-04T16:30:08.391 INFO:tasks.workunit.client.1.smithi193.stdout:2/377: dwrite d2/f7 [4194304,4194304] 0 2024-09-04T16:30:08.392 INFO:tasks.workunit.client.0.smithi170.stdout:5/91: mkdir d4/d8/d1c 0 2024-09-04T16:30:08.392 INFO:tasks.workunit.client.1.smithi193.stdout:2/378: dread - d2/f71 zero size 2024-09-04T16:30:08.393 INFO:tasks.workunit.client.0.smithi170.stdout:0/169: dwrite d11/f18 [0,4194304] 0 2024-09-04T16:30:08.394 INFO:tasks.workunit.client.0.smithi170.stdout:7/168: mknod d12/d16/c3a 0 2024-09-04T16:30:08.398 INFO:tasks.workunit.client.0.smithi170.stdout:1/167: mkdir d9/d34 0 2024-09-04T16:30:08.400 INFO:tasks.workunit.client.1.smithi193.stdout:5/418: mknod d1/d8/db/d15/d2b/c7f 0 2024-09-04T16:30:08.403 INFO:tasks.workunit.client.1.smithi193.stdout:8/418: dread d2/d20/d23/d34/d3e/f50 [0,4194304] 0 2024-09-04T16:30:08.405 INFO:tasks.workunit.client.0.smithi170.stdout:5/92: creat d4/db/f1d x:0 0 0 2024-09-04T16:30:08.405 INFO:tasks.workunit.client.1.smithi193.stdout:3/434: dread d0/d18/d1c/d30/f41 [0,4194304] 0 2024-09-04T16:30:08.406 INFO:tasks.workunit.client.1.smithi193.stdout:4/331: creat d3/d1a/d21/d52/d5e/f71 x:0 0 0 2024-09-04T16:30:08.406 INFO:tasks.workunit.client.0.smithi170.stdout:0/170: write d11/d13/d36/f40 [356122,55367] 0 2024-09-04T16:30:08.408 INFO:tasks.workunit.client.0.smithi170.stdout:7/169: creat d12/d15/d34/f3b x:0 0 0 2024-09-04T16:30:08.408 INFO:tasks.workunit.client.1.smithi193.stdout:6/385: symlink d5/d27/d3e/d43/l7a 0 2024-09-04T16:30:08.409 INFO:tasks.workunit.client.1.smithi193.stdout:6/386: write d5/ff [3602179,50191] 0 2024-09-04T16:30:08.413 INFO:tasks.workunit.client.0.smithi170.stdout:0/171: dread d11/d13/f24 [0,4194304] 0 2024-09-04T16:30:08.413 INFO:tasks.workunit.client.0.smithi170.stdout:7/170: dread d12/f1a [0,4194304] 0 2024-09-04T16:30:08.414 INFO:tasks.workunit.client.0.smithi170.stdout:0/172: fsync d11/d13/d2f/f33 0 2024-09-04T16:30:08.414 INFO:tasks.workunit.client.0.smithi170.stdout:7/171: chown d12/f14 215 1 2024-09-04T16:30:08.415 INFO:tasks.workunit.client.0.smithi170.stdout:0/173: write d11/f23 [33077,102053] 0 2024-09-04T16:30:08.416 INFO:tasks.workunit.client.0.smithi170.stdout:5/93: creat d4/db/f1e x:0 0 0 2024-09-04T16:30:08.423 INFO:tasks.workunit.client.1.smithi193.stdout:2/379: unlink d2/d14/c27 0 2024-09-04T16:30:08.425 INFO:tasks.workunit.client.1.smithi193.stdout:5/419: symlink d1/d8/db/d36/d40/l80 0 2024-09-04T16:30:08.425 INFO:tasks.workunit.client.0.smithi170.stdout:7/172: mknod d12/d15/c3c 0 2024-09-04T16:30:08.427 INFO:tasks.workunit.client.1.smithi193.stdout:8/419: unlink d2/d20/d23/d24/d3c/d65/d67/c44 0 2024-09-04T16:30:08.429 INFO:tasks.workunit.client.1.smithi193.stdout:4/332: rename d3/d1a/d21/f3a to d3/d1a/d21/d52/d5e/f72 0 2024-09-04T16:30:08.429 INFO:tasks.workunit.client.0.smithi170.stdout:1/168: rmdir d9/d33 0 2024-09-04T16:30:08.430 INFO:tasks.workunit.client.1.smithi193.stdout:5/420: dwrite d1/d29/d69/d3e/f41 [0,4194304] 0 2024-09-04T16:30:08.432 INFO:tasks.workunit.client.1.smithi193.stdout:1/459: creat d1/d2b/d10/f91 x:0 0 0 2024-09-04T16:30:08.432 INFO:tasks.workunit.client.0.smithi170.stdout:1/169: symlink d9/d26/l35 0 2024-09-04T16:30:08.434 INFO:tasks.workunit.client.1.smithi193.stdout:7/516: getdents d9/de/d27 0 2024-09-04T16:30:08.435 INFO:tasks.workunit.client.0.smithi170.stdout:7/173: truncate fc 4339176 0 2024-09-04T16:30:08.435 INFO:tasks.workunit.client.1.smithi193.stdout:7/517: fdatasync f3 0 2024-09-04T16:30:08.435 INFO:tasks.workunit.client.1.smithi193.stdout:7/518: stat f3 0 2024-09-04T16:30:08.436 INFO:tasks.workunit.client.0.smithi170.stdout:7/174: read - d12/d29/f2a zero size 2024-09-04T16:30:08.436 INFO:tasks.workunit.client.1.smithi193.stdout:2/380: creat d2/d9/db/d10/d4e/f81 x:0 0 0 2024-09-04T16:30:08.437 INFO:tasks.workunit.client.0.smithi170.stdout:7/175: write d12/d15/d34/f38 [734624,62161] 0 2024-09-04T16:30:08.437 INFO:tasks.workunit.client.0.smithi170.stdout:0/174: getdents d11/d13/d36 0 2024-09-04T16:30:08.439 INFO:tasks.workunit.client.1.smithi193.stdout:1/460: dwrite d1/d2b/db/f5b [0,4194304] 0 2024-09-04T16:30:08.439 INFO:tasks.workunit.client.0.smithi170.stdout:0/175: fdatasync d11/f25 0 2024-09-04T16:30:08.439 INFO:tasks.workunit.client.1.smithi193.stdout:3/435: mkdir d0/d18/d1b/d3d/d96 0 2024-09-04T16:30:08.440 INFO:tasks.workunit.client.1.smithi193.stdout:9/486: sync 2024-09-04T16:30:08.441 INFO:tasks.workunit.client.1.smithi193.stdout:8/420: rename d2/d20/c5c to d2/d20/d23/d51/c89 0 2024-09-04T16:30:08.442 INFO:tasks.workunit.client.0.smithi170.stdout:7/176: fsync f1 0 2024-09-04T16:30:08.445 INFO:tasks.workunit.client.0.smithi170.stdout:0/176: mknod d11/c41 0 2024-09-04T16:30:08.447 INFO:tasks.workunit.client.1.smithi193.stdout:9/487: truncate d2/d8/d15/f48 914282 0 2024-09-04T16:30:08.447 INFO:tasks.workunit.client.1.smithi193.stdout:7/519: dwrite d9/d11/fa7 [0,4194304] 0 2024-09-04T16:30:08.448 INFO:tasks.workunit.client.0.smithi170.stdout:7/177: creat d12/d29/f3d x:0 0 0 2024-09-04T16:30:08.448 INFO:tasks.workunit.client.0.smithi170.stdout:1/170: dread d9/d11/f21 [0,4194304] 0 2024-09-04T16:30:08.449 INFO:tasks.workunit.client.0.smithi170.stdout:0/177: creat d11/d13/d36/f42 x:0 0 0 2024-09-04T16:30:08.451 INFO:tasks.workunit.client.0.smithi170.stdout:0/178: truncate d11/d13/d1a/f2e 988781 0 2024-09-04T16:30:08.451 INFO:tasks.workunit.client.1.smithi193.stdout:4/333: dwrite d3/d1a/d21/f22 [0,4194304] 0 2024-09-04T16:30:08.461 INFO:tasks.workunit.client.0.smithi170.stdout:7/178: creat d12/d15/d34/f3e x:0 0 0 2024-09-04T16:30:08.462 INFO:tasks.workunit.client.0.smithi170.stdout:7/179: dread - d12/d15/d34/f3e zero size 2024-09-04T16:30:08.462 INFO:tasks.workunit.client.1.smithi193.stdout:2/381: chown d2/d9/d18/f28 434515 1 2024-09-04T16:30:08.464 INFO:tasks.workunit.client.0.smithi170.stdout:0/179: rename d11/d13/d1a to d11/d2a/d43 0 2024-09-04T16:30:08.466 INFO:tasks.workunit.client.0.smithi170.stdout:7/180: creat d12/d16/f3f x:0 0 0 2024-09-04T16:30:08.469 INFO:tasks.workunit.client.1.smithi193.stdout:3/436: dread d0/f66 [0,4194304] 0 2024-09-04T16:30:08.470 INFO:tasks.workunit.client.0.smithi170.stdout:0/180: truncate d11/f29 5066537 0 2024-09-04T16:30:08.471 INFO:tasks.workunit.client.0.smithi170.stdout:7/181: symlink d12/d16/d1d/d21/l40 0 2024-09-04T16:30:08.472 INFO:tasks.workunit.client.0.smithi170.stdout:7/182: dread - d12/d16/d1d/f2e zero size 2024-09-04T16:30:08.476 INFO:tasks.workunit.client.1.smithi193.stdout:8/421: mknod d2/d20/d23/d24/d3c/d65/d67/c8a 0 2024-09-04T16:30:08.480 INFO:tasks.workunit.client.0.smithi170.stdout:7/183: unlink d12/d16/d1d/c23 0 2024-09-04T16:30:08.481 INFO:tasks.workunit.client.1.smithi193.stdout:0/420: getdents d18 0 2024-09-04T16:30:08.481 INFO:tasks.workunit.client.1.smithi193.stdout:9/488: rmdir d2/d18/d2f/d22/d30/d6a/d6e/d81 39 2024-09-04T16:30:08.481 INFO:tasks.workunit.client.0.smithi170.stdout:7/184: rmdir d12/d16/d1d 39 2024-09-04T16:30:08.484 INFO:tasks.workunit.client.1.smithi193.stdout:7/520: creat d9/d39/d3e/d4a/faf x:0 0 0 2024-09-04T16:30:08.484 INFO:tasks.workunit.client.1.smithi193.stdout:2/382: fsync d2/d9/db/d10/d38/d63/f68 0 2024-09-04T16:30:08.486 INFO:tasks.workunit.client.0.smithi170.stdout:7/185: mkdir d12/d15/d41 0 2024-09-04T16:30:08.488 INFO:tasks.workunit.client.1.smithi193.stdout:6/387: getdents d5/d33/d4e/d51 0 2024-09-04T16:30:08.489 INFO:tasks.workunit.client.0.smithi170.stdout:7/186: mkdir d12/d15/d34/d42 0 2024-09-04T16:30:08.490 INFO:tasks.workunit.client.0.smithi170.stdout:7/187: chown d12/l17 215442 1 2024-09-04T16:30:08.490 INFO:tasks.workunit.client.1.smithi193.stdout:8/422: mknod d2/d20/d23/d1b/d4e/c8b 0 2024-09-04T16:30:08.491 INFO:tasks.workunit.client.1.smithi193.stdout:0/421: rmdir d18/d25/d32/d57/d6c 39 2024-09-04T16:30:08.491 INFO:tasks.workunit.client.0.smithi170.stdout:7/188: readlink d12/d16/l1c 0 2024-09-04T16:30:08.491 INFO:tasks.workunit.client.1.smithi193.stdout:2/383: symlink d2/d9/db/d10/d51/l82 0 2024-09-04T16:30:08.492 INFO:tasks.workunit.client.1.smithi193.stdout:2/384: chown d2/d9/db/d10/d1f/f4c 1556 1 2024-09-04T16:30:08.493 INFO:tasks.workunit.client.0.smithi170.stdout:0/181: dwrite d11/d13/f24 [4194304,4194304] 0 2024-09-04T16:30:08.493 INFO:tasks.workunit.client.1.smithi193.stdout:1/461: rename d1/d2b/db/c18 to d1/d39/c92 0 2024-09-04T16:30:08.494 INFO:tasks.workunit.client.1.smithi193.stdout:6/388: mkdir d5/d33/d4e/d51/d7b 0 2024-09-04T16:30:08.497 INFO:tasks.workunit.client.1.smithi193.stdout:5/421: creat d1/d29/d1e/d37/d3f/f81 x:0 0 0 2024-09-04T16:30:08.497 INFO:tasks.workunit.client.1.smithi193.stdout:5/422: chown d1/d29/d69/d3e 95730 1 2024-09-04T16:30:08.498 INFO:tasks.workunit.client.1.smithi193.stdout:7/521: mkdir d9/d39/d3e/d4d/d4f/dab/db0 0 2024-09-04T16:30:08.499 INFO:tasks.workunit.client.0.smithi170.stdout:0/182: symlink d11/d13/d36/l44 0 2024-09-04T16:30:08.503 INFO:tasks.workunit.client.1.smithi193.stdout:8/423: creat d2/d20/d23/d34/d46/d69/f8c x:0 0 0 2024-09-04T16:30:08.504 INFO:tasks.workunit.client.0.smithi170.stdout:0/183: chown c1 38582361 1 2024-09-04T16:30:08.504 INFO:tasks.workunit.client.1.smithi193.stdout:3/437: getdents d0/d7 0 2024-09-04T16:30:08.505 INFO:tasks.workunit.client.0.smithi170.stdout:7/189: getdents d12/d29 0 2024-09-04T16:30:08.505 INFO:tasks.workunit.client.0.smithi170.stdout:7/190: write d12/d29/f3d [316267,49878] 0 2024-09-04T16:30:08.506 INFO:tasks.workunit.client.0.smithi170.stdout:7/191: stat d12/d16/f1f 0 2024-09-04T16:30:08.507 INFO:tasks.workunit.client.0.smithi170.stdout:0/184: unlink d11/d13/f30 0 2024-09-04T16:30:08.508 INFO:tasks.workunit.client.0.smithi170.stdout:0/185: write d11/f23 [1755404,115160] 0 2024-09-04T16:30:08.509 INFO:tasks.workunit.client.1.smithi193.stdout:6/389: symlink d5/d33/d4e/l7c 0 2024-09-04T16:30:08.511 INFO:tasks.workunit.client.1.smithi193.stdout:0/422: fdatasync d18/d25/d3b/f40 0 2024-09-04T16:30:08.512 INFO:tasks.workunit.client.0.smithi170.stdout:7/192: mknod d12/d16/c43 0 2024-09-04T16:30:08.513 INFO:tasks.workunit.client.0.smithi170.stdout:0/186: truncate d11/d13/d2f/f31 3201880 0 2024-09-04T16:30:08.514 INFO:tasks.workunit.client.1.smithi193.stdout:3/438: fsync d0/d18/d1b/f36 0 2024-09-04T16:30:08.516 INFO:tasks.workunit.client.0.smithi170.stdout:7/193: chown d12/d16/d1d/f32 5 1 2024-09-04T16:30:08.517 INFO:tasks.workunit.client.0.smithi170.stdout:7/194: dread - d12/d29/f2a zero size 2024-09-04T16:30:08.517 INFO:tasks.workunit.client.1.smithi193.stdout:2/385: symlink d2/d9/d61/l83 0 2024-09-04T16:30:08.528 INFO:tasks.workunit.client.0.smithi170.stdout:7/195: link d12/f1a d12/d29/f44 0 2024-09-04T16:30:08.531 INFO:tasks.workunit.client.1.smithi193.stdout:5/423: rename d1/d8/db/d36/d40/l80 to d1/d29/d1e/d37/l82 0 2024-09-04T16:30:08.532 INFO:tasks.workunit.client.0.smithi170.stdout:0/187: dwrite d11/d13/d2f/f31 [0,4194304] 0 2024-09-04T16:30:08.533 INFO:tasks.workunit.client.1.smithi193.stdout:0/423: write d18/d25/d32/d57/d6d/f72 [2479215,71330] 0 2024-09-04T16:30:08.534 INFO:tasks.workunit.client.1.smithi193.stdout:8/424: creat d2/d20/f8d x:0 0 0 2024-09-04T16:30:08.535 INFO:tasks.workunit.client.1.smithi193.stdout:7/522: getdents d9/d18/d1e 0 2024-09-04T16:30:08.537 INFO:tasks.workunit.client.0.smithi170.stdout:7/196: dwrite d12/d15/d34/f3b [0,4194304] 0 2024-09-04T16:30:08.538 INFO:tasks.workunit.client.0.smithi170.stdout:7/197: chown d12/d16/f1f 3226 1 2024-09-04T16:30:08.539 INFO:tasks.workunit.client.1.smithi193.stdout:6/390: rename d5/de/f45 to d5/d33/d4e/d51/d7b/f7d 0 2024-09-04T16:30:08.539 INFO:tasks.workunit.client.0.smithi170.stdout:7/198: stat d12/d15/d41 0 2024-09-04T16:30:08.540 INFO:tasks.workunit.client.0.smithi170.stdout:0/188: mknod d11/d13/c45 0 2024-09-04T16:30:08.542 INFO:tasks.workunit.client.1.smithi193.stdout:0/424: truncate d18/f4c 3517807 0 2024-09-04T16:30:08.544 INFO:tasks.workunit.client.0.smithi170.stdout:0/189: truncate f4 1621957 0 2024-09-04T16:30:08.546 INFO:tasks.workunit.client.0.smithi170.stdout:7/199: creat d12/d15/d41/f45 x:0 0 0 2024-09-04T16:30:08.546 INFO:tasks.workunit.client.1.smithi193.stdout:8/425: dwrite d2/f8 [0,4194304] 0 2024-09-04T16:30:08.548 INFO:tasks.workunit.client.1.smithi193.stdout:2/386: rename d2/d9/db/d10/l40 to d2/d9/d61/l84 0 2024-09-04T16:30:08.550 INFO:tasks.workunit.client.0.smithi170.stdout:7/200: dread fa [0,4194304] 0 2024-09-04T16:30:08.551 INFO:tasks.workunit.client.1.smithi193.stdout:6/391: creat d5/d33/d4e/d51/f7e x:0 0 0 2024-09-04T16:30:08.551 INFO:tasks.workunit.client.1.smithi193.stdout:0/425: stat d18/d25/d32/d57/f56 0 2024-09-04T16:30:08.554 INFO:tasks.workunit.client.1.smithi193.stdout:0/426: write d18/f21 [395481,43336] 0 2024-09-04T16:30:08.554 INFO:tasks.workunit.client.1.smithi193.stdout:7/523: truncate d9/d18/f4c 1026901 0 2024-09-04T16:30:08.555 INFO:tasks.workunit.client.1.smithi193.stdout:5/424: rename d1/d29/d1e to d1/d8/db/d15/d2b/d83 0 2024-09-04T16:30:08.555 INFO:tasks.workunit.client.0.smithi170.stdout:3/69: sync 2024-09-04T16:30:08.555 INFO:tasks.workunit.client.0.smithi170.stdout:2/70: sync 2024-09-04T16:30:08.556 INFO:tasks.workunit.client.1.smithi193.stdout:8/426: write d2/d12/fd [2291999,48280] 0 2024-09-04T16:30:08.556 INFO:tasks.workunit.client.0.smithi170.stdout:3/70: fsync ff 0 2024-09-04T16:30:08.558 INFO:tasks.workunit.client.1.smithi193.stdout:8/427: write d2/d20/d23/d34/d4b/f4f [798981,126181] 0 2024-09-04T16:30:08.559 INFO:tasks.workunit.client.0.smithi170.stdout:3/71: write fb [208788,106971] 0 2024-09-04T16:30:08.559 INFO:tasks.workunit.client.0.smithi170.stdout:2/71: write f0 [398425,54271] 0 2024-09-04T16:30:08.560 INFO:tasks.workunit.client.0.smithi170.stdout:7/201: dwrite d12/d15/d34/f3e [0,4194304] 0 2024-09-04T16:30:08.561 INFO:tasks.workunit.client.1.smithi193.stdout:7/524: link d9/de/f5a d9/d39/d95/fb1 0 2024-09-04T16:30:08.561 INFO:tasks.workunit.client.0.smithi170.stdout:2/72: chown d3/db/df 49333201 1 2024-09-04T16:30:08.561 INFO:tasks.workunit.client.1.smithi193.stdout:5/425: mkdir d1/d8/db/d36/d40/d46/d84 0 2024-09-04T16:30:08.562 INFO:tasks.workunit.client.1.smithi193.stdout:0/427: dwrite d18/d25/d3b/f41 [0,4194304] 0 2024-09-04T16:30:08.563 INFO:tasks.workunit.client.0.smithi170.stdout:2/73: write d3/db/df/f16 [446310,119168] 0 2024-09-04T16:30:08.563 INFO:tasks.workunit.client.1.smithi193.stdout:0/428: write d18/d25/f3c [2400514,58761] 0 2024-09-04T16:30:08.564 INFO:tasks.workunit.client.0.smithi170.stdout:3/72: mkdir d13/d14/d17 0 2024-09-04T16:30:08.565 INFO:tasks.workunit.client.1.smithi193.stdout:8/428: fsync d2/d20/d23/d34/d46/d69/f78 0 2024-09-04T16:30:08.565 INFO:tasks.workunit.client.0.smithi170.stdout:7/202: rmdir d12/d29 39 2024-09-04T16:30:08.568 INFO:tasks.workunit.client.0.smithi170.stdout:2/74: symlink d3/l17 0 2024-09-04T16:30:08.569 INFO:tasks.workunit.client.1.smithi193.stdout:7/525: dread d9/d39/d3e/d4d/d4f/f5d [0,4194304] 0 2024-09-04T16:30:08.569 INFO:tasks.workunit.client.1.smithi193.stdout:7/526: readlink d9/l12 0 2024-09-04T16:30:08.569 INFO:tasks.workunit.client.0.smithi170.stdout:3/73: creat d13/f18 x:0 0 0 2024-09-04T16:30:08.571 INFO:tasks.workunit.client.0.smithi170.stdout:7/203: mknod d12/d15/d41/c46 0 2024-09-04T16:30:08.573 INFO:tasks.workunit.client.0.smithi170.stdout:2/75: dread d3/fe [0,4194304] 0 2024-09-04T16:30:08.573 INFO:tasks.workunit.client.1.smithi193.stdout:0/429: symlink d18/d25/d32/l92 0 2024-09-04T16:30:08.575 INFO:tasks.workunit.client.0.smithi170.stdout:3/74: fdatasync f12 0 2024-09-04T16:30:08.576 INFO:tasks.workunit.client.1.smithi193.stdout:8/429: dwrite d2/d20/d23/d1b/d4e/f55 [0,4194304] 0 2024-09-04T16:30:08.578 INFO:tasks.workunit.client.1.smithi193.stdout:5/426: mknod d1/d8/db/d15/d2b/d83/d37/d58/c85 0 2024-09-04T16:30:08.579 INFO:tasks.workunit.client.0.smithi170.stdout:2/76: mkdir d3/d18 0 2024-09-04T16:30:08.579 INFO:tasks.workunit.client.0.smithi170.stdout:2/77: chown d3/d4/f6 1706628 1 2024-09-04T16:30:08.580 INFO:tasks.workunit.client.1.smithi193.stdout:7/527: dwrite d9/d39/d3e/fa2 [0,4194304] 0 2024-09-04T16:30:08.582 INFO:tasks.workunit.client.1.smithi193.stdout:0/430: creat d18/d25/d32/d57/d6d/f93 x:0 0 0 2024-09-04T16:30:08.584 INFO:tasks.workunit.client.1.smithi193.stdout:0/431: chown d18/d25/c8c 233024549 1 2024-09-04T16:30:08.584 INFO:tasks.workunit.client.0.smithi170.stdout:3/75: creat d13/f19 x:0 0 0 2024-09-04T16:30:08.590 INFO:tasks.workunit.client.1.smithi193.stdout:5/427: dwrite d1/d8/db/f4e [0,4194304] 0 2024-09-04T16:30:08.591 INFO:tasks.workunit.client.0.smithi170.stdout:2/78: dwrite f2 [4194304,4194304] 0 2024-09-04T16:30:08.591 INFO:tasks.workunit.client.1.smithi193.stdout:0/432: write d18/d25/d32/d57/f56 [22353,111142] 0 2024-09-04T16:30:08.594 INFO:tasks.workunit.client.1.smithi193.stdout:7/528: dwrite d9/d11/f93 [0,4194304] 0 2024-09-04T16:30:08.597 INFO:tasks.workunit.client.0.smithi170.stdout:0/190: dread f4 [0,4194304] 0 2024-09-04T16:30:08.597 INFO:tasks.workunit.client.1.smithi193.stdout:4/334: sync 2024-09-04T16:30:08.598 INFO:tasks.workunit.client.0.smithi170.stdout:0/191: chown c1 317269706 1 2024-09-04T16:30:08.599 INFO:tasks.workunit.client.1.smithi193.stdout:2/387: readlink d2/d9/d61/l84 0 2024-09-04T16:30:08.601 INFO:tasks.workunit.client.1.smithi193.stdout:4/335: write d3/f12 [2391586,63022] 0 2024-09-04T16:30:08.603 INFO:tasks.workunit.client.1.smithi193.stdout:5/428: dread d1/d8/db/d15/f30 [0,4194304] 0 2024-09-04T16:30:08.603 INFO:tasks.workunit.client.0.smithi170.stdout:0/192: dread d11/d13/d2f/f33 [0,4194304] 0 2024-09-04T16:30:08.605 INFO:tasks.workunit.client.1.smithi193.stdout:5/429: write d1/d8/db/d36/d40/f62 [987695,105673] 0 2024-09-04T16:30:08.606 INFO:tasks.workunit.client.1.smithi193.stdout:7/529: mknod d9/d18/d1e/cb2 0 2024-09-04T16:30:08.608 INFO:tasks.workunit.client.1.smithi193.stdout:5/430: write d1/d29/d69/f7b [296158,130976] 0 2024-09-04T16:30:08.609 INFO:tasks.workunit.client.0.smithi170.stdout:2/79: mknod d3/d4/d14/c19 0 2024-09-04T16:30:08.610 INFO:tasks.workunit.client.0.smithi170.stdout:3/76: truncate ff 1212586 0 2024-09-04T16:30:08.610 INFO:tasks.workunit.client.0.smithi170.stdout:2/80: chown d3/d4/d14 474618981 1 2024-09-04T16:30:08.611 INFO:tasks.workunit.client.1.smithi193.stdout:4/336: dwrite d3/d1a/d54/f5b [0,4194304] 0 2024-09-04T16:30:08.611 INFO:tasks.workunit.client.1.smithi193.stdout:2/388: creat d2/d9/db/d10/d51/f85 x:0 0 0 2024-09-04T16:30:08.612 INFO:tasks.workunit.client.0.smithi170.stdout:0/193: creat d11/d13/f46 x:0 0 0 2024-09-04T16:30:08.613 INFO:tasks.workunit.client.1.smithi193.stdout:0/433: creat d18/d25/d5f/d6a/d7b/f94 x:0 0 0 2024-09-04T16:30:08.616 INFO:tasks.workunit.client.0.smithi170.stdout:2/81: dread d3/db/df/f11 [0,4194304] 0 2024-09-04T16:30:08.617 INFO:tasks.workunit.client.0.smithi170.stdout:0/194: rename d11/d13/c45 to d11/d2a/d43/c47 0 2024-09-04T16:30:08.617 INFO:tasks.workunit.client.1.smithi193.stdout:5/431: dread d1/d29/f59 [0,4194304] 0 2024-09-04T16:30:08.620 INFO:tasks.workunit.client.1.smithi193.stdout:2/389: dwrite d2/d9/db/d10/d1f/d22/f33 [0,4194304] 0 2024-09-04T16:30:08.620 INFO:tasks.workunit.client.1.smithi193.stdout:7/530: creat d9/d18/d22/d2b/fb3 x:0 0 0 2024-09-04T16:30:08.622 INFO:tasks.workunit.client.0.smithi170.stdout:0/195: dread d11/d13/d2f/f33 [0,4194304] 0 2024-09-04T16:30:08.629 INFO:tasks.workunit.client.1.smithi193.stdout:0/434: mknod d18/d25/d3b/c95 0 2024-09-04T16:30:08.632 INFO:tasks.workunit.client.0.smithi170.stdout:0/196: mknod d11/d13/d35/c48 0 2024-09-04T16:30:08.633 INFO:tasks.workunit.client.1.smithi193.stdout:2/390: symlink d2/d9/db/d10/l86 0 2024-09-04T16:30:08.634 INFO:tasks.workunit.client.0.smithi170.stdout:2/82: getdents d3/d4 0 2024-09-04T16:30:08.635 INFO:tasks.workunit.client.1.smithi193.stdout:0/435: dwrite d18/f38 [0,4194304] 0 2024-09-04T16:30:08.636 INFO:tasks.workunit.client.1.smithi193.stdout:0/436: stat d18/f69 0 2024-09-04T16:30:08.636 INFO:tasks.workunit.client.1.smithi193.stdout:0/437: write d18/d25/f4d [874203,9337] 0 2024-09-04T16:30:08.639 INFO:tasks.workunit.client.0.smithi170.stdout:2/83: symlink d3/d7/l1a 0 2024-09-04T16:30:08.640 INFO:tasks.workunit.client.0.smithi170.stdout:0/197: dwrite f0 [0,4194304] 0 2024-09-04T16:30:08.642 INFO:tasks.workunit.client.0.smithi170.stdout:0/198: truncate d11/d13/d36/f42 595153 0 2024-09-04T16:30:08.643 INFO:tasks.workunit.client.1.smithi193.stdout:5/432: mknod d1/d8/db/d15/d2b/d83/d37/d3f/c86 0 2024-09-04T16:30:08.644 INFO:tasks.workunit.client.1.smithi193.stdout:2/391: mkdir d2/d9/db/d10/d51/d87 0 2024-09-04T16:30:08.645 INFO:tasks.workunit.client.1.smithi193.stdout:2/392: chown d2/d9/db/d10/d38/f5f 335 1 2024-09-04T16:30:08.645 INFO:tasks.workunit.client.0.smithi170.stdout:7/204: dwrite fc [0,4194304] 0 2024-09-04T16:30:08.645 INFO:tasks.workunit.client.1.smithi193.stdout:2/393: stat d2/d9/d18/f28 0 2024-09-04T16:30:08.648 INFO:tasks.workunit.client.1.smithi193.stdout:2/394: truncate d2/d9/db/d10/d1e/d26/f3a 4595599 0 2024-09-04T16:30:08.648 INFO:tasks.workunit.client.0.smithi170.stdout:0/199: creat d11/d13/d35/f49 x:0 0 0 2024-09-04T16:30:08.652 INFO:tasks.workunit.client.1.smithi193.stdout:5/433: creat d1/d8/db/d36/d40/d46/f87 x:0 0 0 2024-09-04T16:30:08.653 INFO:tasks.workunit.client.1.smithi193.stdout:5/434: write d1/d29/d18/f5e [8426938,8483] 0 2024-09-04T16:30:08.656 INFO:tasks.workunit.client.0.smithi170.stdout:2/84: dwrite d3/fe [0,4194304] 0 2024-09-04T16:30:08.656 INFO:tasks.workunit.client.0.smithi170.stdout:0/200: mkdir d11/d13/d4a 0 2024-09-04T16:30:08.657 INFO:tasks.workunit.client.0.smithi170.stdout:2/85: chown d3/d18 1677 1 2024-09-04T16:30:08.657 INFO:tasks.workunit.client.1.smithi193.stdout:2/395: creat d2/d9/d18/d3f/f88 x:0 0 0 2024-09-04T16:30:08.659 INFO:tasks.workunit.client.0.smithi170.stdout:7/205: dwrite d12/d15/d34/f36 [0,4194304] 0 2024-09-04T16:30:08.665 INFO:tasks.workunit.client.1.smithi193.stdout:0/438: dread d18/d25/f3c [0,4194304] 0 2024-09-04T16:30:08.665 INFO:tasks.workunit.client.0.smithi170.stdout:0/201: dread f3 [0,4194304] 0 2024-09-04T16:30:08.665 INFO:tasks.workunit.client.0.smithi170.stdout:2/86: dread f2 [4194304,4194304] 0 2024-09-04T16:30:08.667 INFO:tasks.workunit.client.0.smithi170.stdout:0/202: write d11/f18 [5118714,96371] 0 2024-09-04T16:30:08.669 INFO:tasks.workunit.client.1.smithi193.stdout:5/435: readlink d1/d29/d69/l45 0 2024-09-04T16:30:08.669 INFO:tasks.workunit.client.1.smithi193.stdout:2/396: creat d2/d9/db/f89 x:0 0 0 2024-09-04T16:30:08.670 INFO:tasks.workunit.client.1.smithi193.stdout:2/397: fdatasync d2/d9/db/d10/d51/f85 0 2024-09-04T16:30:08.674 INFO:tasks.workunit.client.1.smithi193.stdout:4/337: write d3/d1a/d21/d52/d5e/f72 [37526,74478] 0 2024-09-04T16:30:08.674 INFO:tasks.workunit.client.0.smithi170.stdout:2/87: dwrite f0 [0,4194304] 0 2024-09-04T16:30:08.675 INFO:tasks.workunit.client.0.smithi170.stdout:2/88: write d3/db/df/f16 [1225102,13363] 0 2024-09-04T16:30:08.677 INFO:tasks.workunit.client.1.smithi193.stdout:0/439: dwrite d18/f20 [0,4194304] 0 2024-09-04T16:30:08.677 INFO:tasks.workunit.client.0.smithi170.stdout:0/203: creat d11/d13/d35/f4b x:0 0 0 2024-09-04T16:30:08.678 INFO:tasks.workunit.client.1.smithi193.stdout:4/338: mknod d3/d1a/d21/c73 0 2024-09-04T16:30:08.679 INFO:tasks.workunit.client.0.smithi170.stdout:7/206: link d12/d16/f25 d12/d16/d1d/f47 0 2024-09-04T16:30:08.679 INFO:tasks.workunit.client.0.smithi170.stdout:7/207: dread - d12/d15/d41/f45 zero size 2024-09-04T16:30:08.684 INFO:tasks.workunit.client.1.smithi193.stdout:5/436: rename d1/d8/db/d23 to d1/d8/db/d15/d2b/d83/d37/d88 0 2024-09-04T16:30:08.685 INFO:tasks.workunit.client.1.smithi193.stdout:0/440: write d18/d25/d32/d57/f4e [1169040,84191] 0 2024-09-04T16:30:08.687 INFO:tasks.workunit.client.1.smithi193.stdout:4/339: creat d3/d39/d44/f74 x:0 0 0 2024-09-04T16:30:08.688 INFO:tasks.workunit.client.0.smithi170.stdout:4/157: sync 2024-09-04T16:30:08.688 INFO:tasks.workunit.client.0.smithi170.stdout:0/204: unlink d11/d2a/f34 0 2024-09-04T16:30:08.689 INFO:tasks.workunit.client.0.smithi170.stdout:0/205: write d11/d13/f24 [8006542,63058] 0 2024-09-04T16:30:08.690 INFO:tasks.workunit.client.1.smithi193.stdout:2/398: rename d2/d9/db/d10/d1e/d56/f73 to d2/d9/db/d10/d51/d87/f8a 0 2024-09-04T16:30:08.690 INFO:tasks.workunit.client.0.smithi170.stdout:0/206: stat d11/d13/d36/f42 0 2024-09-04T16:30:08.692 INFO:tasks.workunit.client.0.smithi170.stdout:0/207: dread d11/d13/d36/f42 [0,4194304] 0 2024-09-04T16:30:08.705 INFO:tasks.workunit.client.1.smithi193.stdout:9/489: sync 2024-09-04T16:30:08.705 INFO:tasks.workunit.client.1.smithi193.stdout:1/462: sync 2024-09-04T16:30:08.705 INFO:tasks.workunit.client.1.smithi193.stdout:6/392: sync 2024-09-04T16:30:08.705 INFO:tasks.workunit.client.1.smithi193.stdout:8/430: sync 2024-09-04T16:30:08.706 INFO:tasks.workunit.client.1.smithi193.stdout:3/439: sync 2024-09-04T16:30:08.707 INFO:tasks.workunit.client.1.smithi193.stdout:6/393: truncate d5/de/d15/d48/f65 574165 0 2024-09-04T16:30:08.710 INFO:tasks.workunit.client.1.smithi193.stdout:9/490: dwrite d2/f42 [4194304,4194304] 0 2024-09-04T16:30:08.715 INFO:tasks.workunit.client.1.smithi193.stdout:5/437: creat d1/d29/d69/d3e/f89 x:0 0 0 2024-09-04T16:30:08.715 INFO:tasks.workunit.client.0.smithi170.stdout:2/89: mknod d3/d18/c1b 0 2024-09-04T16:30:08.717 INFO:tasks.workunit.client.1.smithi193.stdout:5/438: write d1/d29/d69/d3e/f41 [1334520,24051] 0 2024-09-04T16:30:08.718 INFO:tasks.workunit.client.1.smithi193.stdout:9/491: dwrite d2/d8/d25/f3e [4194304,4194304] 0 2024-09-04T16:30:08.719 INFO:tasks.workunit.client.1.smithi193.stdout:0/441: creat d18/d25/d5f/d6a/d7b/f96 x:0 0 0 2024-09-04T16:30:08.720 INFO:tasks.workunit.client.1.smithi193.stdout:9/492: fsync d2/d18/d2f/f36 0 2024-09-04T16:30:08.721 INFO:tasks.workunit.client.0.smithi170.stdout:7/208: mkdir d12/d48 0 2024-09-04T16:30:08.721 INFO:tasks.workunit.client.1.smithi193.stdout:0/442: write d18/d25/d3b/f75 [2389034,109659] 0 2024-09-04T16:30:08.723 INFO:tasks.workunit.client.1.smithi193.stdout:8/431: rmdir d2/d20/d23 39 2024-09-04T16:30:08.724 INFO:tasks.workunit.client.1.smithi193.stdout:7/531: sync 2024-09-04T16:30:08.725 INFO:tasks.workunit.client.0.smithi170.stdout:2/90: mkdir d3/db/d1c 0 2024-09-04T16:30:08.725 INFO:tasks.workunit.client.0.smithi170.stdout:2/91: readlink d3/l17 0 2024-09-04T16:30:08.726 INFO:tasks.workunit.client.0.smithi170.stdout:7/209: dread d12/f14 [0,4194304] 0 2024-09-04T16:30:08.726 INFO:tasks.workunit.client.0.smithi170.stdout:4/158: mknod d1/d6/d8/d3b/c3d 0 2024-09-04T16:30:08.727 INFO:tasks.workunit.client.1.smithi193.stdout:1/463: stat d1/d39/d48/c88 0 2024-09-04T16:30:08.727 INFO:tasks.workunit.client.0.smithi170.stdout:7/210: fsync d12/d15/d34/f3e 0 2024-09-04T16:30:08.728 INFO:tasks.workunit.client.0.smithi170.stdout:7/211: stat d12/d16/f3f 0 2024-09-04T16:30:08.730 INFO:tasks.workunit.client.1.smithi193.stdout:6/394: unlink d5/d27/d3e/d49/c60 0 2024-09-04T16:30:08.732 INFO:tasks.workunit.client.0.smithi170.stdout:2/92: rename d3/d4/fa to d3/d7/f1d 0 2024-09-04T16:30:08.734 INFO:tasks.workunit.client.1.smithi193.stdout:4/340: creat d3/d5f/f75 x:0 0 0 2024-09-04T16:30:08.737 INFO:tasks.workunit.client.1.smithi193.stdout:2/399: symlink d2/d9/db/d10/d1f/d77/l8b 0 2024-09-04T16:30:08.738 INFO:tasks.workunit.client.1.smithi193.stdout:2/400: fsync d2/d9/db/d10/d38/d63/f68 0 2024-09-04T16:30:08.739 INFO:tasks.workunit.client.1.smithi193.stdout:2/401: chown d2/d9/db/d10/d1f/d4a/f64 52 1 2024-09-04T16:30:08.739 INFO:tasks.workunit.client.0.smithi170.stdout:0/208: rmdir d11/d2a/d43/d3a 0 2024-09-04T16:30:08.740 INFO:tasks.workunit.client.1.smithi193.stdout:0/443: fsync d18/d25/d32/f44 0 2024-09-04T16:30:08.741 INFO:tasks.workunit.client.1.smithi193.stdout:0/444: write f17 [201216,50644] 0 2024-09-04T16:30:08.743 INFO:tasks.workunit.client.1.smithi193.stdout:8/432: chown d2/d20/d23/d24/d3c/d65/d67 44 1 2024-09-04T16:30:08.744 INFO:tasks.workunit.client.0.smithi170.stdout:2/93: symlink d3/db/df/l1e 0 2024-09-04T16:30:08.746 INFO:tasks.workunit.client.0.smithi170.stdout:4/159: mkdir d1/d6/d8/d20/d35/d3e 0 2024-09-04T16:30:08.747 INFO:tasks.workunit.client.0.smithi170.stdout:4/160: write d1/d6/ff [5100816,74933] 0 2024-09-04T16:30:08.748 INFO:tasks.workunit.client.0.smithi170.stdout:7/212: mkdir d12/d49 0 2024-09-04T16:30:08.749 INFO:tasks.workunit.client.1.smithi193.stdout:1/464: dread d1/d2b/d10/f1f [4194304,4194304] 0 2024-09-04T16:30:08.750 INFO:tasks.workunit.client.1.smithi193.stdout:1/465: write d1/d39/f46 [1886552,74269] 0 2024-09-04T16:30:08.753 INFO:tasks.workunit.client.1.smithi193.stdout:6/395: rename d5/f26 to d5/d27/d3e/f7f 0 2024-09-04T16:30:08.755 INFO:tasks.workunit.client.0.smithi170.stdout:2/94: mknod d3/db/c1f 0 2024-09-04T16:30:08.756 INFO:tasks.workunit.client.0.smithi170.stdout:2/95: stat d3/d18 0 2024-09-04T16:30:08.756 INFO:tasks.workunit.client.1.smithi193.stdout:5/439: mknod d1/d29/d74/c8a 0 2024-09-04T16:30:08.757 INFO:tasks.workunit.client.0.smithi170.stdout:0/209: dwrite d11/d13/d36/f42 [0,4194304] 0 2024-09-04T16:30:08.758 INFO:tasks.workunit.client.1.smithi193.stdout:5/440: dread d1/d8/f34 [0,4194304] 0 2024-09-04T16:30:08.758 INFO:tasks.workunit.client.0.smithi170.stdout:0/210: read d11/f18 [4904058,1453] 0 2024-09-04T16:30:08.760 INFO:tasks.workunit.client.1.smithi193.stdout:3/440: write d0/d18/d1c/d25/f48 [6634,125816] 0 2024-09-04T16:30:08.760 INFO:tasks.workunit.client.0.smithi170.stdout:0/211: truncate d11/d2a/d43/f2e 1623603 0 2024-09-04T16:30:08.761 INFO:tasks.workunit.client.0.smithi170.stdout:7/213: rmdir d12/d15/d34 39 2024-09-04T16:30:08.766 INFO:tasks.workunit.client.0.smithi170.stdout:4/161: dread d1/d6/d8/f9 [0,4194304] 0 2024-09-04T16:30:08.767 INFO:tasks.workunit.client.0.smithi170.stdout:2/96: rmdir d3/d4 39 2024-09-04T16:30:08.768 INFO:tasks.workunit.client.1.smithi193.stdout:0/445: symlink d18/d79/l97 0 2024-09-04T16:30:08.769 INFO:tasks.workunit.client.1.smithi193.stdout:0/446: dread - d18/d25/d32/d57/d6d/f93 zero size 2024-09-04T16:30:08.770 INFO:tasks.workunit.client.1.smithi193.stdout:8/433: creat d2/d12/f8e x:0 0 0 2024-09-04T16:30:08.771 INFO:tasks.workunit.client.0.smithi170.stdout:2/97: dread f0 [0,4194304] 0 2024-09-04T16:30:08.772 INFO:tasks.workunit.client.0.smithi170.stdout:2/98: write d3/fe [4058223,114260] 0 2024-09-04T16:30:08.773 INFO:tasks.workunit.client.0.smithi170.stdout:0/212: creat d11/d2a/f4c x:0 0 0 2024-09-04T16:30:08.776 INFO:tasks.workunit.client.1.smithi193.stdout:6/396: fsync d5/de/d15/d1b/f1e 0 2024-09-04T16:30:08.779 INFO:tasks.workunit.client.1.smithi193.stdout:7/532: dwrite d9/de/f49 [0,4194304] 0 2024-09-04T16:30:08.780 INFO:tasks.workunit.client.0.smithi170.stdout:2/99: unlink d3/l17 0 2024-09-04T16:30:08.781 INFO:tasks.workunit.client.1.smithi193.stdout:5/441: creat d1/d8/db/d36/d40/d46/f8b x:0 0 0 2024-09-04T16:30:08.782 INFO:tasks.workunit.client.1.smithi193.stdout:4/341: write d3/d39/f6b [1753039,77243] 0 2024-09-04T16:30:08.782 INFO:tasks.workunit.client.0.smithi170.stdout:0/213: rmdir d11/d13 39 2024-09-04T16:30:08.783 INFO:tasks.workunit.client.1.smithi193.stdout:9/493: creat d2/f98 x:0 0 0 2024-09-04T16:30:08.783 INFO:tasks.workunit.client.1.smithi193.stdout:9/494: chown d2/d4/f5 3860747 1 2024-09-04T16:30:08.784 INFO:tasks.workunit.client.1.smithi193.stdout:3/441: stat d0/d18/c91 0 2024-09-04T16:30:08.790 INFO:tasks.workunit.client.0.smithi170.stdout:0/214: fsync d11/d13/d2f/f31 0 2024-09-04T16:30:08.791 INFO:tasks.workunit.client.0.smithi170.stdout:0/215: dread - d11/d13/f28 zero size 2024-09-04T16:30:08.791 INFO:tasks.workunit.client.0.smithi170.stdout:7/214: creat d12/d15/f4a x:0 0 0 2024-09-04T16:30:08.792 INFO:tasks.workunit.client.0.smithi170.stdout:7/215: dread - d12/d16/f25 zero size 2024-09-04T16:30:08.792 INFO:tasks.workunit.client.0.smithi170.stdout:4/162: link d1/c2d d1/d6/d2b/c3f 0 2024-09-04T16:30:08.794 INFO:tasks.workunit.client.0.smithi170.stdout:4/163: write d1/d6/f1b [5888884,113896] 0 2024-09-04T16:30:08.794 INFO:tasks.workunit.client.0.smithi170.stdout:2/100: creat d3/d4/f20 x:0 0 0 2024-09-04T16:30:08.795 INFO:tasks.workunit.client.0.smithi170.stdout:4/164: chown d1/d6/f14 709966 1 2024-09-04T16:30:08.797 INFO:tasks.workunit.client.0.smithi170.stdout:0/216: fsync f4 0 2024-09-04T16:30:08.808 INFO:tasks.workunit.client.0.smithi170.stdout:0/217: symlink d11/d13/d36/l4d 0 2024-09-04T16:30:08.810 INFO:tasks.workunit.client.0.smithi170.stdout:7/216: mkdir d12/d4b 0 2024-09-04T16:30:08.811 INFO:tasks.workunit.client.0.smithi170.stdout:7/217: write d12/d15/d41/f45 [332568,1438] 0 2024-09-04T16:30:08.816 INFO:tasks.workunit.client.0.smithi170.stdout:0/218: creat d11/d13/d4a/f4e x:0 0 0 2024-09-04T16:30:08.817 INFO:tasks.workunit.client.0.smithi170.stdout:0/219: truncate d11/f1c 5009497 0 2024-09-04T16:30:08.820 INFO:tasks.workunit.client.0.smithi170.stdout:0/220: link d11/d13/f24 d11/d13/d2f/d3f/f4f 0 2024-09-04T16:30:08.824 INFO:tasks.workunit.client.0.smithi170.stdout:4/165: truncate d1/d6/d8/fa 3286350 0 2024-09-04T16:30:08.824 INFO:tasks.workunit.client.0.smithi170.stdout:4/166: stat d1/f1e 0 2024-09-04T16:30:08.826 INFO:tasks.workunit.client.1.smithi193.stdout:6/397: creat d5/d33/d4e/d51/f80 x:0 0 0 2024-09-04T16:30:08.826 INFO:tasks.workunit.client.1.smithi193.stdout:1/466: creat d1/d2b/d1b/d51/d6d/d89/f93 x:0 0 0 2024-09-04T16:30:08.826 INFO:tasks.workunit.client.1.smithi193.stdout:9/495: dwrite d2/d8/d15/f48 [0,4194304] 0 2024-09-04T16:30:08.826 INFO:tasks.workunit.client.1.smithi193.stdout:0/447: link f6 d18/d25/d32/f98 0 2024-09-04T16:30:08.828 INFO:tasks.workunit.client.0.smithi170.stdout:2/101: dwrite d3/db/df/f11 [0,4194304] 0 2024-09-04T16:30:08.828 INFO:tasks.workunit.client.0.smithi170.stdout:7/218: write d12/f1a [2744985,124136] 0 2024-09-04T16:30:08.829 INFO:tasks.workunit.client.1.smithi193.stdout:5/442: dread d1/d8/db/d36/d40/f62 [0,4194304] 0 2024-09-04T16:30:08.832 INFO:tasks.workunit.client.1.smithi193.stdout:5/443: write d1/d8/db/d36/d40/d46/f8b [631707,49598] 0 2024-09-04T16:30:08.833 INFO:tasks.workunit.client.0.smithi170.stdout:4/167: mknod d1/d6/d22/c40 0 2024-09-04T16:30:08.834 INFO:tasks.workunit.client.0.smithi170.stdout:4/168: readlink d1/d6/l3a 0 2024-09-04T16:30:08.835 INFO:tasks.workunit.client.1.smithi193.stdout:3/442: symlink d0/l97 0 2024-09-04T16:30:08.835 INFO:tasks.workunit.client.0.smithi170.stdout:2/102: unlink d3/db/df/f16 0 2024-09-04T16:30:08.837 INFO:tasks.workunit.client.1.smithi193.stdout:3/443: write d0/d7/de/d45/f8d [4957766,107666] 0 2024-09-04T16:30:08.838 INFO:tasks.workunit.client.1.smithi193.stdout:9/496: symlink d2/d8/d4d/l99 0 2024-09-04T16:30:08.840 INFO:tasks.workunit.client.0.smithi170.stdout:7/219: creat d12/d15/d34/f4c x:0 0 0 2024-09-04T16:30:08.842 INFO:tasks.workunit.client.1.smithi193.stdout:8/434: creat d2/d20/f8f x:0 0 0 2024-09-04T16:30:08.845 INFO:tasks.workunit.client.0.smithi170.stdout:7/220: dread d12/d15/f2f [0,4194304] 0 2024-09-04T16:30:08.847 INFO:tasks.workunit.client.0.smithi170.stdout:4/169: rmdir d1/d6/d2b 39 2024-09-04T16:30:08.848 INFO:tasks.workunit.client.0.smithi170.stdout:2/103: read d3/fe [1950313,59138] 0 2024-09-04T16:30:08.851 INFO:tasks.workunit.client.0.smithi170.stdout:7/221: truncate d12/d29/f3d 1395725 0 2024-09-04T16:30:08.852 INFO:tasks.workunit.client.1.smithi193.stdout:0/448: rename d18/d25/d32/d57/f78 to d18/d25/d5f/d65/f99 0 2024-09-04T16:30:08.853 INFO:tasks.workunit.client.0.smithi170.stdout:4/170: rmdir d1 39 2024-09-04T16:30:08.855 INFO:tasks.workunit.client.1.smithi193.stdout:6/398: dread d5/f11 [0,4194304] 0 2024-09-04T16:30:08.855 INFO:tasks.workunit.client.1.smithi193.stdout:4/342: truncate d3/fa 1772655 0 2024-09-04T16:30:08.856 INFO:tasks.workunit.client.1.smithi193.stdout:8/435: truncate d2/d20/d23/d34/d3e/f41 546610 0 2024-09-04T16:30:08.856 INFO:tasks.workunit.client.1.smithi193.stdout:6/399: truncate d5/d27/d3e/f7f 1863961 0 2024-09-04T16:30:08.857 INFO:tasks.workunit.client.1.smithi193.stdout:6/400: chown d5/de/d15/d1b/d5f/f76 797401891 1 2024-09-04T16:30:08.858 INFO:tasks.workunit.client.0.smithi170.stdout:2/104: creat d3/d4/f21 x:0 0 0 2024-09-04T16:30:08.858 INFO:tasks.workunit.client.0.smithi170.stdout:7/222: dwrite d12/d15/f28 [0,4194304] 0 2024-09-04T16:30:08.859 INFO:tasks.workunit.client.1.smithi193.stdout:6/401: read - d5/de/d15/d1b/f79 zero size 2024-09-04T16:30:08.859 INFO:tasks.workunit.client.1.smithi193.stdout:5/444: mknod d1/d8/c8c 0 2024-09-04T16:30:08.859 INFO:tasks.workunit.client.1.smithi193.stdout:2/402: sync 2024-09-04T16:30:08.859 INFO:tasks.workunit.client.1.smithi193.stdout:6/402: chown d5/de/d15/d1b/f79 5490 1 2024-09-04T16:30:08.859 INFO:tasks.workunit.client.0.smithi170.stdout:7/223: write d12/d29/f2d [3262323,102991] 0 2024-09-04T16:30:08.860 INFO:tasks.workunit.client.0.smithi170.stdout:2/105: write d3/db/df/f11 [3996292,37313] 0 2024-09-04T16:30:08.860 INFO:tasks.workunit.client.1.smithi193.stdout:4/343: dread d3/f31 [0,4194304] 0 2024-09-04T16:30:08.860 INFO:tasks.workunit.client.1.smithi193.stdout:5/445: chown d1/d8/db/d15/d2b/c7f 418881 1 2024-09-04T16:30:08.862 INFO:tasks.workunit.client.1.smithi193.stdout:3/444: creat d0/d18/d1c/d51/d7a/f98 x:0 0 0 2024-09-04T16:30:08.863 INFO:tasks.workunit.client.1.smithi193.stdout:3/445: read d0/d18/d1c/d30/f41 [3256340,55134] 0 2024-09-04T16:30:08.869 INFO:tasks.workunit.client.1.smithi193.stdout:8/436: rmdir d2/d20/d23/d24/d3c 39 2024-09-04T16:30:08.870 INFO:tasks.workunit.client.0.smithi170.stdout:7/224: rmdir d12/d16 39 2024-09-04T16:30:08.872 INFO:tasks.workunit.client.0.smithi170.stdout:2/106: mknod d3/d4/c22 0 2024-09-04T16:30:08.873 INFO:tasks.workunit.client.1.smithi193.stdout:6/403: chown d5/de/d15/d48/l56 213344549 1 2024-09-04T16:30:08.873 INFO:tasks.workunit.client.0.smithi170.stdout:2/107: write d3/d4/f6 [4488274,56876] 0 2024-09-04T16:30:08.873 INFO:tasks.workunit.client.1.smithi193.stdout:6/404: fdatasync d5/f3f 0 2024-09-04T16:30:08.880 INFO:tasks.workunit.client.1.smithi193.stdout:0/449: mkdir d18/d79/d88/d9a 0 2024-09-04T16:30:08.883 INFO:tasks.workunit.client.1.smithi193.stdout:8/437: mkdir d2/d20/d23/d34/d46/d53/d90 0 2024-09-04T16:30:08.884 INFO:tasks.workunit.client.0.smithi170.stdout:4/171: symlink d1/l41 0 2024-09-04T16:30:08.885 INFO:tasks.workunit.client.1.smithi193.stdout:2/403: mknod d2/d9/db/d10/d1e/c8c 0 2024-09-04T16:30:08.889 INFO:tasks.workunit.client.1.smithi193.stdout:4/344: write d3/f18 [4629639,90811] 0 2024-09-04T16:30:08.889 INFO:tasks.workunit.client.1.smithi193.stdout:2/404: dread - d2/d9/db/d10/d1f/f62 zero size 2024-09-04T16:30:08.889 INFO:tasks.workunit.client.1.smithi193.stdout:6/405: unlink d5/de/d15/d1b/d5f/f63 0 2024-09-04T16:30:08.889 INFO:tasks.workunit.client.0.smithi170.stdout:7/225: write d12/f14 [3945305,78590] 0 2024-09-04T16:30:08.893 INFO:tasks.workunit.client.1.smithi193.stdout:4/345: dread d3/fd [0,4194304] 0 2024-09-04T16:30:08.893 INFO:tasks.workunit.client.0.smithi170.stdout:2/108: getdents d3/d4 0 2024-09-04T16:30:08.893 INFO:tasks.workunit.client.0.smithi170.stdout:2/109: readlink d3/ld 0 2024-09-04T16:30:08.894 INFO:tasks.workunit.client.1.smithi193.stdout:6/406: dwrite d5/de/f17 [4194304,4194304] 0 2024-09-04T16:30:08.896 INFO:tasks.workunit.client.0.smithi170.stdout:7/226: dread d12/d15/f2f [0,4194304] 0 2024-09-04T16:30:08.896 INFO:tasks.workunit.client.0.smithi170.stdout:4/172: dread d1/d6/d2b/d33/d36/f2e [0,4194304] 0 2024-09-04T16:30:08.897 INFO:tasks.workunit.client.1.smithi193.stdout:9/497: rename d2/d18/d2f/d22/d6c to d2/d18/d2f/d9a 0 2024-09-04T16:30:08.898 INFO:tasks.workunit.client.0.smithi170.stdout:4/173: fdatasync d1/d6/f14 0 2024-09-04T16:30:08.898 INFO:tasks.workunit.client.1.smithi193.stdout:8/438: mknod d2/d20/d23/d1b/d4e/c91 0 2024-09-04T16:30:08.899 INFO:tasks.workunit.client.1.smithi193.stdout:8/439: dread - d2/d20/d23/d51/d76/f87 zero size 2024-09-04T16:30:08.899 INFO:tasks.workunit.client.0.smithi170.stdout:4/174: write d1/f19 [52451,2170] 0 2024-09-04T16:30:08.902 INFO:tasks.workunit.client.0.smithi170.stdout:2/110: dwrite d3/d4/f6 [4194304,4194304] 0 2024-09-04T16:30:08.918 INFO:tasks.workunit.client.1.smithi193.stdout:9/498: dread d2/d8/f55 [0,4194304] 0 2024-09-04T16:30:08.919 INFO:tasks.workunit.client.1.smithi193.stdout:9/499: chown d2/d4/f5 59 1 2024-09-04T16:30:08.924 INFO:tasks.workunit.client.0.smithi170.stdout:4/175: dread d1/d6/f14 [0,4194304] 0 2024-09-04T16:30:08.940 INFO:tasks.workunit.client.1.smithi193.stdout:2/405: creat d2/d9/db/d10/d4e/f8d x:0 0 0 2024-09-04T16:30:08.943 INFO:tasks.workunit.client.0.smithi170.stdout:8/31: sync 2024-09-04T16:30:08.944 INFO:tasks.workunit.client.0.smithi170.stdout:8/32: stat l1 0 2024-09-04T16:30:08.945 INFO:tasks.workunit.client.1.smithi193.stdout:0/450: write f6 [3557865,65508] 0 2024-09-04T16:30:08.945 INFO:tasks.workunit.client.1.smithi193.stdout:3/446: link d0/d7/de/l59 d0/d18/d1c/d30/d8e/l99 0 2024-09-04T16:30:08.946 INFO:tasks.workunit.client.1.smithi193.stdout:3/447: readlink d0/d18/d1c/d30/d8e/l99 0 2024-09-04T16:30:08.947 INFO:tasks.workunit.client.0.smithi170.stdout:8/33: dread d6/f8 [0,4194304] 0 2024-09-04T16:30:08.949 INFO:tasks.workunit.client.0.smithi170.stdout:7/227: symlink d12/l4d 0 2024-09-04T16:30:08.949 INFO:tasks.workunit.client.1.smithi193.stdout:1/467: sync 2024-09-04T16:30:08.949 INFO:tasks.workunit.client.1.smithi193.stdout:7/533: sync 2024-09-04T16:30:08.949 INFO:tasks.workunit.client.1.smithi193.stdout:4/346: fsync d3/d39/f42 0 2024-09-04T16:30:08.950 INFO:tasks.workunit.client.1.smithi193.stdout:4/347: write d3/fe [1407333,40981] 0 2024-09-04T16:30:08.951 INFO:tasks.workunit.client.0.smithi170.stdout:2/111: creat d3/db/d1c/f23 x:0 0 0 2024-09-04T16:30:08.953 INFO:tasks.workunit.client.0.smithi170.stdout:4/176: rename d1/l1c to d1/d6/d8/d20/l42 0 2024-09-04T16:30:08.955 INFO:tasks.workunit.client.0.smithi170.stdout:8/34: mknod d6/c9 0 2024-09-04T16:30:08.955 INFO:tasks.workunit.client.0.smithi170.stdout:4/177: write d1/f31 [198849,61117] 0 2024-09-04T16:30:08.956 INFO:tasks.workunit.client.1.smithi193.stdout:6/407: symlink d5/d33/l81 0 2024-09-04T16:30:08.956 INFO:tasks.workunit.client.0.smithi170.stdout:7/228: dwrite d12/f30 [0,4194304] 0 2024-09-04T16:30:08.957 INFO:tasks.workunit.client.1.smithi193.stdout:6/408: read d5/de/d15/d48/f4b [618738,82138] 0 2024-09-04T16:30:08.957 INFO:tasks.workunit.client.0.smithi170.stdout:2/112: mkdir d3/d18/d24 0 2024-09-04T16:30:08.958 INFO:tasks.workunit.client.0.smithi170.stdout:2/113: chown d3/d7/l1a 16 1 2024-09-04T16:30:08.960 INFO:tasks.workunit.client.1.smithi193.stdout:5/446: rename d1/d8/db/d15/d2b/f7d to d1/d29/f8d 0 2024-09-04T16:30:08.965 INFO:tasks.workunit.client.1.smithi193.stdout:9/500: fsync d2/d4/fd 0 2024-09-04T16:30:08.966 INFO:tasks.workunit.client.1.smithi193.stdout:9/501: write d2/d8/f4f [3496970,36701] 0 2024-09-04T16:30:08.968 INFO:tasks.workunit.client.1.smithi193.stdout:0/451: readlink d18/d25/d32/d57/d6c/l7c 0 2024-09-04T16:30:08.971 INFO:tasks.workunit.client.1.smithi193.stdout:7/534: write d9/d39/d3e/f68 [4780173,99077] 0 2024-09-04T16:30:08.976 INFO:tasks.workunit.client.1.smithi193.stdout:1/468: dread d1/d2b/d10/f21 [0,4194304] 0 2024-09-04T16:30:08.978 INFO:tasks.workunit.client.1.smithi193.stdout:2/406: dwrite d2/fe [0,4194304] 0 2024-09-04T16:30:08.980 INFO:tasks.workunit.client.1.smithi193.stdout:2/407: write d2/d9/db/f21 [2635518,59449] 0 2024-09-04T16:30:08.980 INFO:tasks.workunit.client.1.smithi193.stdout:9/502: unlink d2/d56/f8a 0 2024-09-04T16:30:08.980 INFO:tasks.workunit.client.1.smithi193.stdout:3/448: mkdir d0/d10/d24/d9a 0 2024-09-04T16:30:08.983 INFO:tasks.workunit.client.1.smithi193.stdout:8/440: write d2/d20/d23/d24/d3c/d65/f72 [711495,87317] 0 2024-09-04T16:30:08.983 INFO:tasks.workunit.client.1.smithi193.stdout:7/535: creat d9/d39/d3e/d4d/d4f/fb4 x:0 0 0 2024-09-04T16:30:08.984 INFO:tasks.workunit.client.1.smithi193.stdout:6/409: mkdir d5/d33/d4e/d51/d71/d82 0 2024-09-04T16:30:08.985 INFO:tasks.workunit.client.1.smithi193.stdout:1/469: symlink d1/d2b/d10/d2a/l94 0 2024-09-04T16:30:08.989 INFO:tasks.workunit.client.1.smithi193.stdout:4/348: write d3/f10 [852477,109845] 0 2024-09-04T16:30:08.990 INFO:tasks.workunit.client.1.smithi193.stdout:1/470: chown d1/d2b/d10/c4b 56627 1 2024-09-04T16:30:08.992 INFO:tasks.workunit.client.1.smithi193.stdout:9/503: creat d2/d18/d2f/d22/d30/f9b x:0 0 0 2024-09-04T16:30:08.993 INFO:tasks.workunit.client.1.smithi193.stdout:5/447: dwrite d1/d29/d18/d42/f51 [0,4194304] 0 2024-09-04T16:30:08.994 INFO:tasks.workunit.client.1.smithi193.stdout:6/410: write d5/d27/d3e/f7f [1722301,94770] 0 2024-09-04T16:30:08.998 INFO:tasks.workunit.client.1.smithi193.stdout:8/441: dread d2/f2e [0,4194304] 0 2024-09-04T16:30:09.000 INFO:tasks.workunit.client.1.smithi193.stdout:9/504: symlink d2/d8/d15/l9c 0 2024-09-04T16:30:09.000 INFO:tasks.workunit.client.1.smithi193.stdout:1/471: truncate d1/d39/f8a 181222 0 2024-09-04T16:30:09.001 INFO:tasks.workunit.client.1.smithi193.stdout:2/408: dread d2/d9/d18/d3f/f41 [4194304,4194304] 0 2024-09-04T16:30:09.002 INFO:tasks.workunit.client.1.smithi193.stdout:3/449: dwrite d0/f89 [0,4194304] 0 2024-09-04T16:30:09.002 INFO:tasks.workunit.client.1.smithi193.stdout:4/349: rename d3/d1a/d21/d52/d5e/f72 to d3/d3c/f76 0 2024-09-04T16:30:09.004 INFO:tasks.workunit.client.1.smithi193.stdout:8/442: fsync d2/f2e 0 2024-09-04T16:30:09.008 INFO:tasks.workunit.client.1.smithi193.stdout:2/409: symlink d2/d14/l8e 0 2024-09-04T16:30:09.010 INFO:tasks.workunit.client.1.smithi193.stdout:3/450: write d0/d18/d1b/f8b [465930,82393] 0 2024-09-04T16:30:09.010 INFO:tasks.workunit.client.1.smithi193.stdout:7/536: dwrite d9/d18/d22/f30 [4194304,4194304] 0 2024-09-04T16:30:09.011 INFO:tasks.workunit.client.1.smithi193.stdout:1/472: truncate d1/d2b/db/f7e 469848 0 2024-09-04T16:30:09.019 INFO:tasks.workunit.client.1.smithi193.stdout:2/410: chown d2/d9/db/f16 442 1 2024-09-04T16:30:09.019 INFO:tasks.workunit.client.1.smithi193.stdout:5/448: rename d1/d29/d69 to d1/d8/db/d15/d2b/d83/d37/d3f/d8e 0 2024-09-04T16:30:09.020 INFO:tasks.workunit.client.1.smithi193.stdout:9/505: write d2/d8/f55 [2491785,86313] 0 2024-09-04T16:30:09.022 INFO:tasks.workunit.client.1.smithi193.stdout:8/443: mknod d2/d20/d23/d24/d3c/d65/d67/c92 0 2024-09-04T16:30:09.024 INFO:tasks.workunit.client.1.smithi193.stdout:6/411: dwrite d5/d33/f3a [0,4194304] 0 2024-09-04T16:30:09.029 INFO:tasks.workunit.client.1.smithi193.stdout:7/537: write d9/d39/d3e/f5c [3955164,116804] 0 2024-09-04T16:30:09.030 INFO:tasks.workunit.client.1.smithi193.stdout:8/444: chown d2/d20/d23/d51/d59/d82 27 1 2024-09-04T16:30:09.033 INFO:tasks.workunit.client.1.smithi193.stdout:4/350: dwrite d3/d39/f5a [0,4194304] 0 2024-09-04T16:30:09.035 INFO:tasks.workunit.client.1.smithi193.stdout:5/449: mknod d1/d8/db/d36/d40/d46/d84/c8f 0 2024-09-04T16:30:09.036 INFO:tasks.workunit.client.1.smithi193.stdout:7/538: write f8 [2614586,92569] 0 2024-09-04T16:30:09.040 INFO:tasks.workunit.client.1.smithi193.stdout:2/411: rename d2/d9/db/d10/d38/f5f to d2/d9/db/d10/f8f 0 2024-09-04T16:30:09.043 INFO:tasks.workunit.client.1.smithi193.stdout:4/351: rmdir d3/d39/d44 39 2024-09-04T16:30:09.045 INFO:tasks.workunit.client.1.smithi193.stdout:3/451: dwrite d0/d18/d1c/d25/f48 [0,4194304] 0 2024-09-04T16:30:09.045 INFO:tasks.workunit.client.1.smithi193.stdout:9/506: dread d2/d4/f23 [0,4194304] 0 2024-09-04T16:30:09.046 INFO:tasks.workunit.client.1.smithi193.stdout:1/473: dwrite d1/d2b/f61 [4194304,4194304] 0 2024-09-04T16:30:09.051 INFO:tasks.workunit.client.1.smithi193.stdout:9/507: write d2/d8/f8e [277775,28622] 0 2024-09-04T16:30:09.052 INFO:tasks.workunit.client.1.smithi193.stdout:6/412: dwrite d5/f19 [0,4194304] 0 2024-09-04T16:30:09.052 INFO:tasks.workunit.client.1.smithi193.stdout:0/452: sync 2024-09-04T16:30:09.055 INFO:tasks.workunit.client.1.smithi193.stdout:5/450: creat d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f90 x:0 0 0 2024-09-04T16:30:09.057 INFO:tasks.workunit.client.1.smithi193.stdout:0/453: write d18/f20 [5054574,41001] 0 2024-09-04T16:30:09.057 INFO:tasks.workunit.client.1.smithi193.stdout:8/445: rename d2/d20/d23/d1b/d4e/d62 to d2/d20/d23/d34/d3e/d6f/d93 0 2024-09-04T16:30:09.057 INFO:tasks.workunit.client.1.smithi193.stdout:2/412: dread d2/d9/db/d10/f6e [0,4194304] 0 2024-09-04T16:30:09.058 INFO:tasks.workunit.client.1.smithi193.stdout:0/454: stat d18/d79/l97 0 2024-09-04T16:30:09.058 INFO:tasks.workunit.client.1.smithi193.stdout:3/452: unlink d0/d7/de/f22 0 2024-09-04T16:30:09.059 INFO:tasks.workunit.client.1.smithi193.stdout:0/455: fsync d18/f55 0 2024-09-04T16:30:09.061 INFO:tasks.workunit.client.1.smithi193.stdout:6/413: symlink d5/de/d15/d48/l83 0 2024-09-04T16:30:09.062 INFO:tasks.workunit.client.1.smithi193.stdout:7/539: link l4 d9/d39/d3e/d4d/d4f/lb5 0 2024-09-04T16:30:09.062 INFO:tasks.workunit.client.1.smithi193.stdout:2/413: truncate d2/d9/db/d10/f5c 150449 0 2024-09-04T16:30:09.063 INFO:tasks.workunit.client.0.smithi170.stdout:2/114: write d3/db/f12 [12655,22972] 0 2024-09-04T16:30:09.063 INFO:tasks.workunit.client.0.smithi170.stdout:8/35: creat d6/fa x:0 0 0 2024-09-04T16:30:09.065 INFO:tasks.workunit.client.0.smithi170.stdout:2/115: fsync d3/d4/f21 0 2024-09-04T16:30:09.066 INFO:tasks.workunit.client.1.smithi193.stdout:5/451: creat d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f91 x:0 0 0 2024-09-04T16:30:09.067 INFO:tasks.workunit.client.0.smithi170.stdout:8/36: chown l1 36756 1 2024-09-04T16:30:09.067 INFO:tasks.workunit.client.1.smithi193.stdout:8/446: mkdir d2/d20/d23/d34/d46/d69/d94 0 2024-09-04T16:30:09.067 INFO:tasks.workunit.client.1.smithi193.stdout:9/508: dwrite d2/d18/d2f/d22/d30/f72 [0,4194304] 0 2024-09-04T16:30:09.068 INFO:tasks.workunit.client.0.smithi170.stdout:8/37: chown d6/f8 0 1 2024-09-04T16:30:09.068 INFO:tasks.workunit.client.0.smithi170.stdout:8/38: chown d6 1763 1 2024-09-04T16:30:09.068 INFO:tasks.workunit.client.1.smithi193.stdout:7/540: truncate d9/d18/d22/d2b/d6c/d70/d79/f87 239998 0 2024-09-04T16:30:09.069 INFO:tasks.workunit.client.0.smithi170.stdout:4/178: mkdir d1/d6/d8/d20/d35/d3e/d43 0 2024-09-04T16:30:09.069 INFO:tasks.workunit.client.1.smithi193.stdout:8/447: stat d2/d20/d23/d24/d3c/d65/d67 0 2024-09-04T16:30:09.070 INFO:tasks.workunit.client.1.smithi193.stdout:6/414: read d5/de/d15/d1b/f1e [351313,127928] 0 2024-09-04T16:30:09.070 INFO:tasks.workunit.client.1.smithi193.stdout:1/474: symlink d1/d39/l95 0 2024-09-04T16:30:09.071 INFO:tasks.workunit.client.0.smithi170.stdout:2/116: mknod d3/db/d1c/c25 0 2024-09-04T16:30:09.071 INFO:tasks.workunit.client.0.smithi170.stdout:7/229: dwrite d12/d16/d1d/f32 [0,4194304] 0 2024-09-04T16:30:09.073 INFO:tasks.workunit.client.0.smithi170.stdout:2/117: write d3/db/d1c/f23 [387222,95287] 0 2024-09-04T16:30:09.073 INFO:tasks.workunit.client.1.smithi193.stdout:1/475: fdatasync d1/d2b/db/f3f 0 2024-09-04T16:30:09.074 INFO:tasks.workunit.client.1.smithi193.stdout:8/448: write d2/d20/d23/d1b/f21 [4705225,116162] 0 2024-09-04T16:30:09.077 INFO:tasks.workunit.client.0.smithi170.stdout:8/39: unlink l5 0 2024-09-04T16:30:09.079 INFO:tasks.workunit.client.1.smithi193.stdout:0/456: dwrite d18/f48 [0,4194304] 0 2024-09-04T16:30:09.082 INFO:tasks.workunit.client.0.smithi170.stdout:2/118: dwrite d3/db/d1c/f23 [0,4194304] 0 2024-09-04T16:30:09.089 INFO:tasks.workunit.client.1.smithi193.stdout:6/415: creat d5/d27/f84 x:0 0 0 2024-09-04T16:30:09.089 INFO:tasks.workunit.client.1.smithi193.stdout:8/449: dwrite d2/d20/d23/d34/d46/d53/f64 [0,4194304] 0 2024-09-04T16:30:09.089 INFO:tasks.workunit.client.1.smithi193.stdout:6/416: read - d5/f5e zero size 2024-09-04T16:30:09.092 INFO:tasks.workunit.client.0.smithi170.stdout:2/119: rename d3/db/df/f11 to d3/d7/f26 0 2024-09-04T16:30:09.092 INFO:tasks.workunit.client.0.smithi170.stdout:4/179: creat d1/d6/d8/f44 x:0 0 0 2024-09-04T16:30:09.093 INFO:tasks.workunit.client.0.smithi170.stdout:8/40: dwrite d6/f8 [0,4194304] 0 2024-09-04T16:30:09.093 INFO:tasks.workunit.client.1.smithi193.stdout:1/476: creat d1/d39/d48/f96 x:0 0 0 2024-09-04T16:30:09.094 INFO:tasks.workunit.client.0.smithi170.stdout:8/41: chown c3 6752 1 2024-09-04T16:30:09.094 INFO:tasks.workunit.client.1.smithi193.stdout:1/477: chown d1/d2b/d10/f1f 3422 1 2024-09-04T16:30:09.099 INFO:tasks.workunit.client.0.smithi170.stdout:8/42: creat d6/fb x:0 0 0 2024-09-04T16:30:09.100 INFO:tasks.workunit.client.1.smithi193.stdout:1/478: dwrite d1/d2b/d1b/d51/d6d/f78 [0,4194304] 0 2024-09-04T16:30:09.101 INFO:tasks.workunit.client.1.smithi193.stdout:9/509: symlink d2/d8/d88/l9d 0 2024-09-04T16:30:09.103 INFO:tasks.workunit.client.0.smithi170.stdout:4/180: dwrite d1/d6/d8/f21 [0,4194304] 0 2024-09-04T16:30:09.105 INFO:tasks.workunit.client.1.smithi193.stdout:2/414: link d2/f71 d2/d9/f90 0 2024-09-04T16:30:09.105 INFO:tasks.workunit.client.1.smithi193.stdout:6/417: dread d5/d27/d3e/f7f [0,4194304] 0 2024-09-04T16:30:09.107 INFO:tasks.workunit.client.1.smithi193.stdout:6/418: read d5/d27/d3e/d43/f72 [125846,119023] 0 2024-09-04T16:30:09.107 INFO:tasks.workunit.client.0.smithi170.stdout:8/43: dwrite d6/fa [0,4194304] 0 2024-09-04T16:30:09.112 INFO:tasks.workunit.client.1.smithi193.stdout:3/453: getdents d0/d18/d1c/d51/d7a 0 2024-09-04T16:30:09.112 INFO:tasks.workunit.client.0.smithi170.stdout:8/44: rename c3 to d6/cc 0 2024-09-04T16:30:09.113 INFO:tasks.workunit.client.1.smithi193.stdout:6/419: dread d5/f11 [0,4194304] 0 2024-09-04T16:30:09.114 INFO:tasks.workunit.client.0.smithi170.stdout:7/230: fdatasync f1 0 2024-09-04T16:30:09.114 INFO:tasks.workunit.client.1.smithi193.stdout:2/415: mkdir d2/d9/db/d10/d1f/d77/d91 0 2024-09-04T16:30:09.114 INFO:tasks.workunit.client.1.smithi193.stdout:7/541: getdents d9/d18/d22/d2b/d6c 0 2024-09-04T16:30:09.115 INFO:tasks.workunit.client.1.smithi193.stdout:8/450: getdents d2/d57 0 2024-09-04T16:30:09.116 INFO:tasks.workunit.client.1.smithi193.stdout:1/479: mkdir d1/d2b/d1b/d28/d50/d84/d97 0 2024-09-04T16:30:09.116 INFO:tasks.workunit.client.1.smithi193.stdout:0/457: getdents d18/d25/d32/d57/d6d 0 2024-09-04T16:30:09.118 INFO:tasks.workunit.client.0.smithi170.stdout:7/231: mknod d12/d48/c4e 0 2024-09-04T16:30:09.118 INFO:tasks.workunit.client.1.smithi193.stdout:1/480: readlink d1/d39/d48/l8e 0 2024-09-04T16:30:09.120 INFO:tasks.workunit.client.1.smithi193.stdout:6/420: mkdir d5/d33/d85 0 2024-09-04T16:30:09.121 INFO:tasks.workunit.client.1.smithi193.stdout:9/510: mknod d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/c9e 0 2024-09-04T16:30:09.123 INFO:tasks.workunit.client.0.smithi170.stdout:7/232: dread d12/f1a [0,4194304] 0 2024-09-04T16:30:09.123 INFO:tasks.workunit.client.1.smithi193.stdout:0/458: truncate d18/d25/d32/d57/f56 432347 0 2024-09-04T16:30:09.123 INFO:tasks.workunit.client.1.smithi193.stdout:8/451: mkdir d2/d95 0 2024-09-04T16:30:09.123 INFO:tasks.workunit.client.1.smithi193.stdout:7/542: mkdir d9/d39/d3e/d4d/d98/d9a/db6 0 2024-09-04T16:30:09.124 INFO:tasks.workunit.client.1.smithi193.stdout:2/416: symlink d2/d9/db/d10/d51/d79/l92 0 2024-09-04T16:30:09.125 INFO:tasks.workunit.client.1.smithi193.stdout:6/421: write d5/d33/d4e/d51/f80 [659663,1789] 0 2024-09-04T16:30:09.129 INFO:tasks.workunit.client.1.smithi193.stdout:3/454: dwrite d0/d18/d1b/f37 [0,4194304] 0 2024-09-04T16:30:09.130 INFO:tasks.workunit.client.1.smithi193.stdout:7/543: creat d9/d18/d22/fb7 x:0 0 0 2024-09-04T16:30:09.130 INFO:tasks.workunit.client.1.smithi193.stdout:2/417: readlink d2/d9/db/d10/d51/d79/l92 0 2024-09-04T16:30:09.131 INFO:tasks.workunit.client.1.smithi193.stdout:6/422: chown d5/d27/d3e/d43/d5d/l75 9 1 2024-09-04T16:30:09.135 INFO:tasks.workunit.client.1.smithi193.stdout:3/455: fdatasync d0/d18/d1c/d25/f42 0 2024-09-04T16:30:09.137 INFO:tasks.workunit.client.1.smithi193.stdout:0/459: dwrite d18/d25/d5f/d6a/f83 [0,4194304] 0 2024-09-04T16:30:09.139 INFO:tasks.workunit.client.1.smithi193.stdout:7/544: creat d9/d18/d22/fb8 x:0 0 0 2024-09-04T16:30:09.143 INFO:tasks.workunit.client.1.smithi193.stdout:9/511: dread d2/d8/d61/f73 [0,4194304] 0 2024-09-04T16:30:09.143 INFO:tasks.workunit.client.1.smithi193.stdout:3/456: creat d0/d10/d24/d55/f9b x:0 0 0 2024-09-04T16:30:09.145 INFO:tasks.workunit.client.1.smithi193.stdout:4/352: sync 2024-09-04T16:30:09.149 INFO:tasks.workunit.client.1.smithi193.stdout:4/353: fsync d3/d39/d44/f74 0 2024-09-04T16:30:09.150 INFO:tasks.workunit.client.1.smithi193.stdout:8/452: dread d2/d20/d23/d51/d59/f6d [0,4194304] 0 2024-09-04T16:30:09.151 INFO:tasks.workunit.client.1.smithi193.stdout:0/460: rename d18/d25/c30 to d18/d25/c9b 0 2024-09-04T16:30:09.152 INFO:tasks.workunit.client.1.smithi193.stdout:4/354: dread d3/f1c [0,4194304] 0 2024-09-04T16:30:09.152 INFO:tasks.workunit.client.1.smithi193.stdout:4/355: readlink d3/d1a/l59 0 2024-09-04T16:30:09.153 INFO:tasks.workunit.client.1.smithi193.stdout:4/356: chown d3/c26 14 1 2024-09-04T16:30:09.154 INFO:tasks.workunit.client.1.smithi193.stdout:7/545: rename l4 to d9/d18/d22/lb9 0 2024-09-04T16:30:09.157 INFO:tasks.workunit.client.1.smithi193.stdout:7/546: mknod d9/d39/d3e/d4d/d4f/dab/cba 0 2024-09-04T16:30:09.159 INFO:tasks.workunit.client.1.smithi193.stdout:3/457: dread d0/d18/d1c/d30/f33 [0,4194304] 0 2024-09-04T16:30:09.159 INFO:tasks.workunit.client.1.smithi193.stdout:0/461: dwrite d18/d25/d32/d57/f56 [0,4194304] 0 2024-09-04T16:30:09.159 INFO:tasks.workunit.client.1.smithi193.stdout:9/512: rename d2/l82 to d2/d18/d2f/l9f 0 2024-09-04T16:30:09.160 INFO:tasks.workunit.client.1.smithi193.stdout:0/462: stat lc 0 2024-09-04T16:30:09.162 INFO:tasks.workunit.client.1.smithi193.stdout:7/547: creat d9/de/d27/fbb x:0 0 0 2024-09-04T16:30:09.164 INFO:tasks.workunit.client.1.smithi193.stdout:8/453: rename d2/d20/d23/d34/d3e/c7e to d2/d20/d23/d51/c96 0 2024-09-04T16:30:09.164 INFO:tasks.workunit.client.1.smithi193.stdout:9/513: mkdir d2/d8/d4d/da0 0 2024-09-04T16:30:09.165 INFO:tasks.workunit.client.1.smithi193.stdout:8/454: stat d2/d20/d23/d34/d3e 0 2024-09-04T16:30:09.166 INFO:tasks.workunit.client.1.smithi193.stdout:8/455: readlink d2/d12/lf 0 2024-09-04T16:30:09.166 INFO:tasks.workunit.client.0.smithi170.stdout:8/45: rename d6/cc to d6/cd 0 2024-09-04T16:30:09.167 INFO:tasks.workunit.client.1.smithi193.stdout:8/456: write d2/d20/d23/d1b/f21 [2222798,76782] 0 2024-09-04T16:30:09.168 INFO:tasks.workunit.client.1.smithi193.stdout:3/458: truncate d0/d18/d1b/f36 1703963 0 2024-09-04T16:30:09.170 INFO:tasks.workunit.client.1.smithi193.stdout:7/548: mkdir d9/d18/d22/d2b/d6c/d70/d79/dbc 0 2024-09-04T16:30:09.170 INFO:tasks.workunit.client.1.smithi193.stdout:9/514: dread d2/d18/d2f/f45 [0,4194304] 0 2024-09-04T16:30:09.173 INFO:tasks.workunit.client.1.smithi193.stdout:8/457: stat d2/d20/d23/d24/d3c/f45 0 2024-09-04T16:30:09.174 INFO:tasks.workunit.client.1.smithi193.stdout:5/452: sync 2024-09-04T16:30:09.174 INFO:tasks.workunit.client.1.smithi193.stdout:3/459: mknod d0/d18/d1c/d30/c9c 0 2024-09-04T16:30:09.177 INFO:tasks.workunit.client.1.smithi193.stdout:1/481: truncate d1/d2b/db/f7e 289241 0 2024-09-04T16:30:09.177 INFO:tasks.workunit.client.1.smithi193.stdout:4/357: dread d3/f10 [0,4194304] 0 2024-09-04T16:30:09.179 INFO:tasks.workunit.client.1.smithi193.stdout:7/549: dwrite d9/d18/d1e/f71 [0,4194304] 0 2024-09-04T16:30:09.179 INFO:tasks.workunit.client.1.smithi193.stdout:9/515: dread d2/d8/d15/f48 [0,4194304] 0 2024-09-04T16:30:09.179 INFO:tasks.workunit.client.0.smithi170.stdout:7/233: dwrite d12/d15/f2f [0,4194304] 0 2024-09-04T16:30:09.180 INFO:tasks.workunit.client.1.smithi193.stdout:8/458: creat d2/d20/d23/d34/d46/d53/f97 x:0 0 0 2024-09-04T16:30:09.180 INFO:tasks.workunit.client.1.smithi193.stdout:1/482: fdatasync d1/d2b/db/d54/f70 0 2024-09-04T16:30:09.181 INFO:tasks.workunit.client.1.smithi193.stdout:3/460: truncate d0/d18/d1c/d30/f4e 840240 0 2024-09-04T16:30:09.181 INFO:tasks.workunit.client.1.smithi193.stdout:5/453: write d1/d8/db/d15/d2b/d83/d37/d3f/d8e/f66 [4752711,83035] 0 2024-09-04T16:30:09.182 INFO:tasks.workunit.client.1.smithi193.stdout:4/358: write d3/d1a/d21/f37 [357357,77777] 0 2024-09-04T16:30:09.182 INFO:tasks.workunit.client.1.smithi193.stdout:8/459: chown d2/d57 2030412 1 2024-09-04T16:30:09.183 INFO:tasks.workunit.client.1.smithi193.stdout:2/418: truncate d2/d14/f50 1471483 0 2024-09-04T16:30:09.184 INFO:tasks.workunit.client.1.smithi193.stdout:9/516: dread - d2/d8/d15/f8c zero size 2024-09-04T16:30:09.185 INFO:tasks.workunit.client.1.smithi193.stdout:6/423: truncate d5/de/d15/f2f 3160345 0 2024-09-04T16:30:09.185 INFO:tasks.workunit.client.0.smithi170.stdout:7/234: mknod d12/d49/c4f 0 2024-09-04T16:30:09.187 INFO:tasks.workunit.client.1.smithi193.stdout:7/550: mkdir d9/d11/dbd 0 2024-09-04T16:30:09.188 INFO:tasks.workunit.client.1.smithi193.stdout:0/463: chown d18/d25/c9b 15703 1 2024-09-04T16:30:09.188 INFO:tasks.workunit.client.1.smithi193.stdout:8/460: write d2/d12/f8e [642410,94916] 0 2024-09-04T16:30:09.189 INFO:tasks.workunit.client.1.smithi193.stdout:2/419: dread - d2/d9/db/d10/d1e/f5a zero size 2024-09-04T16:30:09.190 INFO:tasks.workunit.client.0.smithi170.stdout:7/235: rename d12/d48 to d12/d15/d41/d50 0 2024-09-04T16:30:09.190 INFO:tasks.workunit.client.1.smithi193.stdout:9/517: chown d2/d8/d61/f73 3194757 1 2024-09-04T16:30:09.192 INFO:tasks.workunit.client.1.smithi193.stdout:7/551: write d9/d18/d1e/f71 [2519273,6772] 0 2024-09-04T16:30:09.192 INFO:tasks.workunit.client.1.smithi193.stdout:2/420: stat d2/fe 0 2024-09-04T16:30:09.192 INFO:tasks.workunit.client.1.smithi193.stdout:0/464: chown d18/d25/f4d 243 1 2024-09-04T16:30:09.193 INFO:tasks.workunit.client.1.smithi193.stdout:3/461: mknod d0/d18/d1b/d3d/c9d 0 2024-09-04T16:30:09.194 INFO:tasks.workunit.client.1.smithi193.stdout:6/424: mknod d5/d33/d4e/d51/d7b/c86 0 2024-09-04T16:30:09.194 INFO:tasks.workunit.client.1.smithi193.stdout:4/359: write d3/f10 [1829751,115103] 0 2024-09-04T16:30:09.195 INFO:tasks.workunit.client.1.smithi193.stdout:1/483: dread d1/d2b/db/f23 [0,4194304] 0 2024-09-04T16:30:09.195 INFO:tasks.workunit.client.0.smithi170.stdout:7/236: rename d12/d16/d1d/d21 to d12/d4b/d51 0 2024-09-04T16:30:09.196 INFO:tasks.workunit.client.1.smithi193.stdout:3/462: stat d0/d7/de/d45/f8d 0 2024-09-04T16:30:09.197 INFO:tasks.workunit.client.0.smithi170.stdout:8/46: stat d6/cd 0 2024-09-04T16:30:09.198 INFO:tasks.workunit.client.1.smithi193.stdout:9/518: dread d2/d18/d2f/d22/d30/d6a/f79 [0,4194304] 0 2024-09-04T16:30:09.201 INFO:tasks.workunit.client.1.smithi193.stdout:8/461: dread d2/f8 [0,4194304] 0 2024-09-04T16:30:09.201 INFO:tasks.workunit.client.1.smithi193.stdout:3/463: write d0/d18/d1c/d25/d5e/d7e/f7c [506205,68414] 0 2024-09-04T16:30:09.203 INFO:tasks.workunit.client.1.smithi193.stdout:2/421: readlink d2/l7e 0 2024-09-04T16:30:09.204 INFO:tasks.workunit.client.1.smithi193.stdout:0/465: mkdir d18/d25/d32/d9c 0 2024-09-04T16:30:09.205 INFO:tasks.workunit.client.1.smithi193.stdout:4/360: dwrite d3/d1a/f3d [0,4194304] 0 2024-09-04T16:30:09.206 INFO:tasks.workunit.client.1.smithi193.stdout:0/466: dread - d18/d25/d5f/d6a/f80 zero size 2024-09-04T16:30:09.208 INFO:tasks.workunit.client.0.smithi170.stdout:7/237: creat d12/f52 x:0 0 0 2024-09-04T16:30:09.209 INFO:tasks.workunit.client.0.smithi170.stdout:8/47: link l4 d6/le 0 2024-09-04T16:30:09.209 INFO:tasks.workunit.client.0.smithi170.stdout:8/48: stat d6/fb 0 2024-09-04T16:30:09.214 INFO:tasks.workunit.client.0.smithi170.stdout:7/238: rename ff to d12/d4b/d51/f53 0 2024-09-04T16:30:09.214 INFO:tasks.workunit.client.1.smithi193.stdout:9/519: dread d2/f42 [0,4194304] 0 2024-09-04T16:30:09.218 INFO:tasks.workunit.client.0.smithi170.stdout:8/49: rename d6/c9 to d6/cf 0 2024-09-04T16:30:09.218 INFO:tasks.workunit.client.0.smithi170.stdout:8/50: read - d6/fb zero size 2024-09-04T16:30:09.219 INFO:tasks.workunit.client.0.smithi170.stdout:7/239: dread d12/f14 [0,4194304] 0 2024-09-04T16:30:09.226 INFO:tasks.workunit.client.0.smithi170.stdout:8/51: dwrite d6/fa [0,4194304] 0 2024-09-04T16:30:09.226 INFO:tasks.workunit.client.0.smithi170.stdout:7/240: dwrite fc [0,4194304] 0 2024-09-04T16:30:09.226 INFO:tasks.workunit.client.1.smithi193.stdout:1/484: creat d1/d2b/d1b/d51/d6d/f98 x:0 0 0 2024-09-04T16:30:09.227 INFO:tasks.workunit.client.1.smithi193.stdout:1/485: chown d1/cc 103937 1 2024-09-04T16:30:09.230 INFO:tasks.workunit.client.0.smithi170.stdout:8/52: mkdir d6/d10 0 2024-09-04T16:30:09.231 INFO:tasks.workunit.client.0.smithi170.stdout:8/53: fdatasync d6/f8 0 2024-09-04T16:30:09.233 INFO:tasks.workunit.client.1.smithi193.stdout:3/464: fdatasync d0/d7/f6b 0 2024-09-04T16:30:09.234 INFO:tasks.workunit.client.0.smithi170.stdout:7/241: dwrite d12/d15/d41/f45 [0,4194304] 0 2024-09-04T16:30:09.240 INFO:tasks.workunit.client.0.smithi170.stdout:7/242: mknod d12/d4b/c54 0 2024-09-04T16:30:09.242 INFO:tasks.workunit.client.0.smithi170.stdout:8/54: symlink d6/d10/l11 0 2024-09-04T16:30:09.243 INFO:tasks.workunit.client.1.smithi193.stdout:5/454: truncate d1/d29/d18/f2f 2722253 0 2024-09-04T16:30:09.245 INFO:tasks.workunit.client.1.smithi193.stdout:5/455: dread d1/f16 [8388608,4194304] 0 2024-09-04T16:30:09.246 INFO:tasks.workunit.client.1.smithi193.stdout:5/456: fsync d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f89 0 2024-09-04T16:30:09.247 INFO:tasks.workunit.client.1.smithi193.stdout:5/457: read - d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/d55/f77 zero size 2024-09-04T16:30:09.249 INFO:tasks.workunit.client.0.smithi170.stdout:7/243: rename d12/d4b/d51/f53 to d12/d15/d41/f55 0 2024-09-04T16:30:09.251 INFO:tasks.workunit.client.1.smithi193.stdout:9/520: rename d2/d8/d4d/l99 to d2/d8/d4d/da0/la1 0 2024-09-04T16:30:09.254 INFO:tasks.workunit.client.0.smithi170.stdout:7/244: creat d12/d15/d34/f56 x:0 0 0 2024-09-04T16:30:09.255 INFO:tasks.workunit.client.1.smithi193.stdout:1/486: mknod d1/c99 0 2024-09-04T16:30:09.256 INFO:tasks.workunit.client.1.smithi193.stdout:1/487: fsync d1/d2b/db/f3f 0 2024-09-04T16:30:09.257 INFO:tasks.workunit.client.1.smithi193.stdout:3/465: fdatasync d0/d9/f2c 0 2024-09-04T16:30:09.257 INFO:tasks.workunit.client.0.smithi170.stdout:7/245: dread d12/f1a [0,4194304] 0 2024-09-04T16:30:09.258 INFO:tasks.workunit.client.0.smithi170.stdout:7/246: fdatasync d12/f52 0 2024-09-04T16:30:09.262 INFO:tasks.workunit.client.1.smithi193.stdout:8/462: dwrite d2/d20/d23/d1b/f33 [0,4194304] 0 2024-09-04T16:30:09.263 INFO:tasks.workunit.client.0.smithi170.stdout:7/247: symlink d12/d15/d34/d42/l57 0 2024-09-04T16:30:09.264 INFO:tasks.workunit.client.1.smithi193.stdout:2/422: dwrite d2/f5e [0,4194304] 0 2024-09-04T16:30:09.264 INFO:tasks.workunit.client.0.smithi170.stdout:8/55: truncate d6/fa 2288114 0 2024-09-04T16:30:09.266 INFO:tasks.workunit.client.1.smithi193.stdout:2/423: dread - d2/d9/db/d10/d51/d87/f8a zero size 2024-09-04T16:30:09.268 INFO:tasks.workunit.client.0.smithi170.stdout:7/248: dread d12/f30 [0,4194304] 0 2024-09-04T16:30:09.269 INFO:tasks.workunit.client.1.smithi193.stdout:6/425: rmdir d5/d27/d3e/d49 0 2024-09-04T16:30:09.269 INFO:tasks.workunit.client.0.smithi170.stdout:8/56: dread d6/f8 [0,4194304] 0 2024-09-04T16:30:09.270 INFO:tasks.workunit.client.1.smithi193.stdout:5/458: symlink d1/d8/db/d15/d2b/d83/d37/d3f/d8e/l92 0 2024-09-04T16:30:09.271 INFO:tasks.workunit.client.1.smithi193.stdout:5/459: write d1/d29/d18/f5e [7393269,30172] 0 2024-09-04T16:30:09.274 INFO:tasks.workunit.client.0.smithi170.stdout:8/57: unlink d6/f8 0 2024-09-04T16:30:09.276 INFO:tasks.workunit.client.1.smithi193.stdout:1/488: creat d1/d2b/db/f9a x:0 0 0 2024-09-04T16:30:09.277 INFO:tasks.workunit.client.0.smithi170.stdout:7/249: dwrite f1 [0,4194304] 0 2024-09-04T16:30:09.279 INFO:tasks.workunit.client.1.smithi193.stdout:1/489: fsync d1/d39/f46 0 2024-09-04T16:30:09.280 INFO:tasks.workunit.client.1.smithi193.stdout:5/460: dwrite d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/d55/f77 [0,4194304] 0 2024-09-04T16:30:09.280 INFO:tasks.workunit.client.0.smithi170.stdout:8/58: dread d6/fa [0,4194304] 0 2024-09-04T16:30:09.281 INFO:tasks.workunit.client.1.smithi193.stdout:3/466: write d0/d18/d1c/d25/f78 [821181,32756] 0 2024-09-04T16:30:09.281 INFO:tasks.workunit.client.0.smithi170.stdout:7/250: mknod d12/d15/d41/c58 0 2024-09-04T16:30:09.282 INFO:tasks.workunit.client.1.smithi193.stdout:3/467: chown d0/d10 1 1 2024-09-04T16:30:09.285 INFO:tasks.workunit.client.1.smithi193.stdout:4/361: creat d3/d39/f77 x:0 0 0 2024-09-04T16:30:09.286 INFO:tasks.workunit.client.1.smithi193.stdout:4/362: chown d3/d1a/d54/f64 1037525 1 2024-09-04T16:30:09.287 INFO:tasks.workunit.client.1.smithi193.stdout:7/552: getdents d9/d18/d22/d2b 0 2024-09-04T16:30:09.290 INFO:tasks.workunit.client.1.smithi193.stdout:2/424: rename d2/d9/db/d10/f25 to d2/d9/db/d10/d1f/d22/f93 0 2024-09-04T16:30:09.290 INFO:tasks.workunit.client.0.smithi170.stdout:8/59: dwrite d6/fb [0,4194304] 0 2024-09-04T16:30:09.291 INFO:tasks.workunit.client.1.smithi193.stdout:0/467: sync 2024-09-04T16:30:09.299 INFO:tasks.workunit.client.0.smithi170.stdout:8/60: rename d6/d10/l11 to d6/d10/l12 0 2024-09-04T16:30:09.303 INFO:tasks.workunit.client.0.smithi170.stdout:8/61: unlink l1 0 2024-09-04T16:30:09.305 INFO:tasks.workunit.client.0.smithi170.stdout:7/251: truncate f1 1116684 0 2024-09-04T16:30:09.307 INFO:tasks.workunit.client.1.smithi193.stdout:8/463: mknod d2/c98 0 2024-09-04T16:30:09.310 INFO:tasks.workunit.client.0.smithi170.stdout:7/252: symlink d12/d16/d1d/l59 0 2024-09-04T16:30:09.310 INFO:tasks.workunit.client.1.smithi193.stdout:9/521: truncate d2/f28 8330989 0 2024-09-04T16:30:09.311 INFO:tasks.workunit.client.0.smithi170.stdout:1/171: sync 2024-09-04T16:30:09.312 INFO:tasks.workunit.client.0.smithi170.stdout:5/94: sync 2024-09-04T16:30:09.312 INFO:tasks.workunit.client.0.smithi170.stdout:9/153: sync 2024-09-04T16:30:09.312 INFO:tasks.workunit.client.0.smithi170.stdout:6/145: sync 2024-09-04T16:30:09.312 INFO:tasks.workunit.client.1.smithi193.stdout:9/522: chown d2/d18/d2f/d22/d30/f72 5 1 2024-09-04T16:30:09.312 INFO:tasks.workunit.client.1.smithi193.stdout:8/464: dwrite d2/d20/d23/d1b/d4e/f55 [0,4194304] 0 2024-09-04T16:30:09.313 INFO:tasks.workunit.client.0.smithi170.stdout:9/154: read d2/d11/d23/f29 [842676,28314] 0 2024-09-04T16:30:09.315 INFO:tasks.workunit.client.1.smithi193.stdout:8/465: write d2/d20/d23/d1b/f28 [5509399,3094] 0 2024-09-04T16:30:09.317 INFO:tasks.workunit.client.1.smithi193.stdout:4/363: rename d3/d1a/d2a/f2d to d3/d1a/d21/f78 0 2024-09-04T16:30:09.317 INFO:tasks.workunit.client.1.smithi193.stdout:7/553: dwrite d9/d39/d3e/d4a/f5b [0,4194304] 0 2024-09-04T16:30:09.318 INFO:tasks.workunit.client.0.smithi170.stdout:8/62: link d6/le d6/l13 0 2024-09-04T16:30:09.322 INFO:tasks.workunit.client.0.smithi170.stdout:6/146: dwrite d0/f16 [0,4194304] 0 2024-09-04T16:30:09.323 INFO:tasks.workunit.client.0.smithi170.stdout:5/95: mknod d4/c1f 0 2024-09-04T16:30:09.325 INFO:tasks.workunit.client.0.smithi170.stdout:5/96: write d4/db/f1d [1019639,100413] 0 2024-09-04T16:30:09.325 INFO:tasks.workunit.client.0.smithi170.stdout:1/172: creat d9/d26/f36 x:0 0 0 2024-09-04T16:30:09.327 INFO:tasks.workunit.client.1.smithi193.stdout:1/490: mknod d1/d2b/db/d54/c9b 0 2024-09-04T16:30:09.328 INFO:tasks.workunit.client.1.smithi193.stdout:1/491: dread - d1/d2b/d10/f59 zero size 2024-09-04T16:30:09.332 INFO:tasks.workunit.client.1.smithi193.stdout:5/461: mknod d1/c93 0 2024-09-04T16:30:09.333 INFO:tasks.workunit.client.0.smithi170.stdout:9/155: mkdir d2/d11/d23/d2a 0 2024-09-04T16:30:09.334 INFO:tasks.workunit.client.1.smithi193.stdout:3/468: mkdir d0/d9/d49/d87/d9e 0 2024-09-04T16:30:09.334 INFO:tasks.workunit.client.0.smithi170.stdout:7/253: truncate d12/d15/d41/f55 1941582 0 2024-09-04T16:30:09.335 INFO:tasks.workunit.client.1.smithi193.stdout:6/426: dwrite d5/de/d15/f24 [0,4194304] 0 2024-09-04T16:30:09.338 INFO:tasks.workunit.client.1.smithi193.stdout:9/523: mknod d2/d18/d2f/d22/d30/d52/ca2 0 2024-09-04T16:30:09.338 INFO:tasks.workunit.client.0.smithi170.stdout:8/63: write d6/fa [2118577,84104] 0 2024-09-04T16:30:09.342 INFO:tasks.workunit.client.0.smithi170.stdout:6/147: write d0/df/f10 [565217,31253] 0 2024-09-04T16:30:09.344 INFO:tasks.workunit.client.0.smithi170.stdout:5/97: unlink d4/d8/l19 0 2024-09-04T16:30:09.344 INFO:tasks.workunit.client.1.smithi193.stdout:8/466: mknod d2/d20/d23/d34/c99 0 2024-09-04T16:30:09.344 INFO:tasks.workunit.client.0.smithi170.stdout:9/156: dwrite d2/d11/f12 [0,4194304] 0 2024-09-04T16:30:09.345 INFO:tasks.workunit.client.1.smithi193.stdout:8/467: fdatasync d2/d20/d23/d51/d76/f87 0 2024-09-04T16:30:09.347 INFO:tasks.workunit.client.0.smithi170.stdout:9/157: write d2/f4 [4161453,114635] 0 2024-09-04T16:30:09.349 INFO:tasks.workunit.client.0.smithi170.stdout:7/254: dwrite d12/d29/f3d [0,4194304] 0 2024-09-04T16:30:09.351 INFO:tasks.workunit.client.0.smithi170.stdout:7/255: chown d12/d4b/d51/c37 85725 1 2024-09-04T16:30:09.352 INFO:tasks.workunit.client.1.smithi193.stdout:0/468: symlink d18/d79/d88/d9a/l9d 0 2024-09-04T16:30:09.353 INFO:tasks.workunit.client.1.smithi193.stdout:2/425: dwrite d2/d9/db/d10/f6e [0,4194304] 0 2024-09-04T16:30:09.357 INFO:tasks.workunit.client.0.smithi170.stdout:7/256: dread fc [0,4194304] 0 2024-09-04T16:30:09.360 INFO:tasks.workunit.client.1.smithi193.stdout:6/427: mknod d5/de/d15/d1b/c87 0 2024-09-04T16:30:09.363 INFO:tasks.workunit.client.1.smithi193.stdout:8/468: creat d2/d20/d23/d34/f9a x:0 0 0 2024-09-04T16:30:09.366 INFO:tasks.workunit.client.0.smithi170.stdout:1/173: rename d9/f15 to d9/f37 0 2024-09-04T16:30:09.370 INFO:tasks.workunit.client.0.smithi170.stdout:5/98: creat d4/db/f20 x:0 0 0 2024-09-04T16:30:09.372 INFO:tasks.workunit.client.0.smithi170.stdout:5/99: write d4/db/f1e [365915,84319] 0 2024-09-04T16:30:09.373 INFO:tasks.workunit.client.1.smithi193.stdout:0/469: unlink l5 0 2024-09-04T16:30:09.374 INFO:tasks.workunit.client.0.smithi170.stdout:5/100: write d4/db/f20 [687476,51149] 0 2024-09-04T16:30:09.374 INFO:tasks.workunit.client.0.smithi170.stdout:1/174: dwrite d9/d11/f32 [0,4194304] 0 2024-09-04T16:30:09.375 INFO:tasks.workunit.client.0.smithi170.stdout:9/158: mkdir d2/d7/d27/d2b 0 2024-09-04T16:30:09.377 INFO:tasks.workunit.client.1.smithi193.stdout:5/462: write d1/d8/fc [1237730,33512] 0 2024-09-04T16:30:09.377 INFO:tasks.workunit.client.0.smithi170.stdout:8/64: symlink d6/l14 0 2024-09-04T16:30:09.382 INFO:tasks.workunit.client.1.smithi193.stdout:0/470: unlink d18/f69 0 2024-09-04T16:30:09.383 INFO:tasks.workunit.client.1.smithi193.stdout:2/426: link d2/d9/db/d10/d1f/f4c d2/f94 0 2024-09-04T16:30:09.384 INFO:tasks.workunit.client.0.smithi170.stdout:6/148: symlink d0/d17/d25/d2d/d2e/l35 0 2024-09-04T16:30:09.385 INFO:tasks.workunit.client.1.smithi193.stdout:2/427: read d2/d9/db/d10/d1f/d22/f33 [1563362,42014] 0 2024-09-04T16:30:09.385 INFO:tasks.workunit.client.1.smithi193.stdout:6/428: mkdir d5/d33/d4e/d51/d71/d82/d88 0 2024-09-04T16:30:09.385 INFO:tasks.workunit.client.0.smithi170.stdout:5/101: chown d4/d8/l14 8262124 1 2024-09-04T16:30:09.386 INFO:tasks.workunit.client.1.smithi193.stdout:2/428: write d2/f5e [5024363,92963] 0 2024-09-04T16:30:09.386 INFO:tasks.workunit.client.1.smithi193.stdout:5/463: rmdir d1/d8/db/d15/d2b/d83/d37/d58 39 2024-09-04T16:30:09.387 INFO:tasks.workunit.client.1.smithi193.stdout:5/464: stat d1/d8/db/d15/d2b 0 2024-09-04T16:30:09.387 INFO:tasks.workunit.client.0.smithi170.stdout:5/102: read d4/db/fe [2434000,123084] 0 2024-09-04T16:30:09.388 INFO:tasks.workunit.client.1.smithi193.stdout:4/364: rename d3/fa to d3/d39/f79 0 2024-09-04T16:30:09.390 INFO:tasks.workunit.client.1.smithi193.stdout:9/524: write d2/d18/d2f/d22/d30/d6a/f79 [388011,23675] 0 2024-09-04T16:30:09.392 INFO:tasks.workunit.client.0.smithi170.stdout:8/65: creat d6/f15 x:0 0 0 2024-09-04T16:30:09.395 INFO:tasks.workunit.client.0.smithi170.stdout:5/103: dwrite d4/db/f20 [0,4194304] 0 2024-09-04T16:30:09.396 INFO:tasks.workunit.client.0.smithi170.stdout:6/149: symlink d0/df/d1b/l36 0 2024-09-04T16:30:09.399 INFO:tasks.workunit.client.0.smithi170.stdout:1/175: symlink d9/d34/l38 0 2024-09-04T16:30:09.400 INFO:tasks.workunit.client.1.smithi193.stdout:5/465: creat d1/d8/db/d15/d2b/f94 x:0 0 0 2024-09-04T16:30:09.404 INFO:tasks.workunit.client.0.smithi170.stdout:6/150: dread d0/df/f10 [0,4194304] 0 2024-09-04T16:30:09.405 INFO:tasks.workunit.client.0.smithi170.stdout:0/221: sync 2024-09-04T16:30:09.405 INFO:tasks.workunit.client.1.smithi193.stdout:7/554: rename d9/d18/f8f to d9/d39/d3e/d4d/fbe 0 2024-09-04T16:30:09.407 INFO:tasks.workunit.client.0.smithi170.stdout:8/66: mkdir d6/d10/d16 0 2024-09-04T16:30:09.408 INFO:tasks.workunit.client.1.smithi193.stdout:9/525: rmdir d2/d18/d2f/d22 39 2024-09-04T16:30:09.410 INFO:tasks.workunit.client.0.smithi170.stdout:7/257: rename d12/d15/d41/d50 to d12/d5a 0 2024-09-04T16:30:09.411 INFO:tasks.workunit.client.1.smithi193.stdout:7/555: dwrite d9/d39/d3e/f68 [4194304,4194304] 0 2024-09-04T16:30:09.412 INFO:tasks.workunit.client.1.smithi193.stdout:7/556: chown d9/d39/f8b 11177 1 2024-09-04T16:30:09.414 INFO:tasks.workunit.client.0.smithi170.stdout:8/67: dwrite d6/fa [0,4194304] 0 2024-09-04T16:30:09.415 INFO:tasks.workunit.client.1.smithi193.stdout:6/429: link d5/f5e d5/d27/d3e/f89 0 2024-09-04T16:30:09.427 INFO:tasks.workunit.client.1.smithi193.stdout:3/469: rename d0/d7/de/d45/l4b to d0/d18/d1c/d25/d5e/d7e/l9f 0 2024-09-04T16:30:09.427 INFO:tasks.workunit.client.1.smithi193.stdout:8/469: rename d2/d20/d23/d24 to d2/d20/d23/d24/d3c/d9b 22 2024-09-04T16:30:09.428 INFO:tasks.workunit.client.0.smithi170.stdout:9/159: rename d2/fe to d2/d7/f2c 0 2024-09-04T16:30:09.429 INFO:tasks.workunit.client.1.smithi193.stdout:8/470: readlink d2/d12/l75 0 2024-09-04T16:30:09.429 INFO:tasks.workunit.client.0.smithi170.stdout:7/258: creat d12/d15/d34/f5b x:0 0 0 2024-09-04T16:30:09.430 INFO:tasks.workunit.client.1.smithi193.stdout:9/526: chown d2/d8/d4d/da0/la1 9632 1 2024-09-04T16:30:09.431 INFO:tasks.workunit.client.0.smithi170.stdout:7/259: write d12/d16/d1d/f2e [32317,68691] 0 2024-09-04T16:30:09.433 INFO:tasks.workunit.client.1.smithi193.stdout:7/557: creat d9/de/fbf x:0 0 0 2024-09-04T16:30:09.434 INFO:tasks.workunit.client.1.smithi193.stdout:7/558: write f8 [3409640,84918] 0 2024-09-04T16:30:09.435 INFO:tasks.workunit.client.1.smithi193.stdout:1/492: sync 2024-09-04T16:30:09.436 INFO:tasks.workunit.client.1.smithi193.stdout:6/430: write d5/d27/d3e/d43/f72 [988904,83615] 0 2024-09-04T16:30:09.437 INFO:tasks.workunit.client.1.smithi193.stdout:1/493: write d1/d2b/d1b/f4c [2091479,127802] 0 2024-09-04T16:30:09.437 INFO:tasks.workunit.client.1.smithi193.stdout:4/365: fdatasync d3/d39/f79 0 2024-09-04T16:30:09.439 INFO:tasks.workunit.client.1.smithi193.stdout:2/429: truncate d2/fe 1163256 0 2024-09-04T16:30:09.440 INFO:tasks.workunit.client.1.smithi193.stdout:2/430: dread - d2/d9/db/f72 zero size 2024-09-04T16:30:09.441 INFO:tasks.workunit.client.1.smithi193.stdout:3/470: mkdir d0/d18/d1c/d25/da0 0 2024-09-04T16:30:09.443 INFO:tasks.workunit.client.1.smithi193.stdout:1/494: dwrite d1/d2b/d1b/f4c [0,4194304] 0 2024-09-04T16:30:09.445 INFO:tasks.workunit.client.0.smithi170.stdout:6/151: dwrite d0/f4 [0,4194304] 0 2024-09-04T16:30:09.453 INFO:tasks.workunit.client.0.smithi170.stdout:5/104: dwrite f1 [0,4194304] 0 2024-09-04T16:30:09.454 INFO:tasks.workunit.client.0.smithi170.stdout:5/105: write d4/db/f1e [653329,55348] 0 2024-09-04T16:30:09.454 INFO:tasks.workunit.client.0.smithi170.stdout:1/176: link d9/d34/l38 d9/d11/l39 0 2024-09-04T16:30:09.455 INFO:tasks.workunit.client.0.smithi170.stdout:5/106: chown d4/db/c18 3174 1 2024-09-04T16:30:09.456 INFO:tasks.workunit.client.0.smithi170.stdout:9/160: mknod d2/d7/d27/d2b/c2d 0 2024-09-04T16:30:09.456 INFO:tasks.workunit.client.0.smithi170.stdout:5/107: chown d4/c15 249 1 2024-09-04T16:30:09.462 INFO:tasks.workunit.client.0.smithi170.stdout:1/177: dwrite d9/f10 [0,4194304] 0 2024-09-04T16:30:09.464 INFO:tasks.workunit.client.0.smithi170.stdout:1/178: write d9/f22 [812956,54607] 0 2024-09-04T16:30:09.465 INFO:tasks.workunit.client.0.smithi170.stdout:9/161: fdatasync d2/fd 0 2024-09-04T16:30:09.466 INFO:tasks.workunit.client.0.smithi170.stdout:5/108: truncate d4/db/fe 6841618 0 2024-09-04T16:30:09.467 INFO:tasks.workunit.client.0.smithi170.stdout:8/68: link d6/d10/l12 d6/l17 0 2024-09-04T16:30:09.473 INFO:tasks.workunit.client.0.smithi170.stdout:6/152: fsync d0/f4 0 2024-09-04T16:30:09.473 INFO:tasks.workunit.client.0.smithi170.stdout:1/179: getdents d9/d34 0 2024-09-04T16:30:09.476 INFO:tasks.workunit.client.0.smithi170.stdout:1/180: chown d9/d11/f1e 204395 1 2024-09-04T16:30:09.477 INFO:tasks.workunit.client.1.smithi193.stdout:0/471: sync 2024-09-04T16:30:09.477 INFO:tasks.workunit.client.0.smithi170.stdout:9/162: dwrite d2/d11/f22 [0,4194304] 0 2024-09-04T16:30:09.479 INFO:tasks.workunit.client.1.smithi193.stdout:8/471: symlink d2/d20/d23/d1b/l9c 0 2024-09-04T16:30:09.479 INFO:tasks.workunit.client.0.smithi170.stdout:9/163: fsync d2/f4 0 2024-09-04T16:30:09.479 INFO:tasks.workunit.client.1.smithi193.stdout:9/527: mkdir d2/d8/d88/da3 0 2024-09-04T16:30:09.480 INFO:tasks.workunit.client.0.smithi170.stdout:7/260: truncate d12/f30 3889327 0 2024-09-04T16:30:09.480 INFO:tasks.workunit.client.1.smithi193.stdout:7/559: mkdir d9/d39/d3e/d69/dc0 0 2024-09-04T16:30:09.480 INFO:tasks.workunit.client.1.smithi193.stdout:5/466: write d1/d29/d18/f2f [1847342,94106] 0 2024-09-04T16:30:09.481 INFO:tasks.workunit.client.1.smithi193.stdout:2/431: mknod d2/d9/db/d10/d51/c95 0 2024-09-04T16:30:09.481 INFO:tasks.workunit.client.0.smithi170.stdout:1/181: creat d9/d11/f3a x:0 0 0 2024-09-04T16:30:09.481 INFO:tasks.workunit.client.1.smithi193.stdout:3/471: rename d0/d7/l6d to d0/d7/de/d45/la1 0 2024-09-04T16:30:09.482 INFO:tasks.workunit.client.0.smithi170.stdout:8/69: dwrite d6/fb [0,4194304] 0 2024-09-04T16:30:09.487 INFO:tasks.workunit.client.1.smithi193.stdout:6/431: symlink d5/d33/d4e/d51/d71/d82/d88/l8a 0 2024-09-04T16:30:09.487 INFO:tasks.workunit.client.0.smithi170.stdout:6/153: dwrite d0/fd [0,4194304] 0 2024-09-04T16:30:09.488 INFO:tasks.workunit.client.1.smithi193.stdout:6/432: rename d5/d27/d3e/d43 to d5/d27/d3e/d43/d5d/d8b 22 2024-09-04T16:30:09.489 INFO:tasks.workunit.client.0.smithi170.stdout:6/154: chown d0/f5 971071530 1 2024-09-04T16:30:09.491 INFO:tasks.workunit.client.1.smithi193.stdout:8/472: symlink d2/d20/d23/d51/l9d 0 2024-09-04T16:30:09.493 INFO:tasks.workunit.client.0.smithi170.stdout:8/70: chown d6/l17 1824497 1 2024-09-04T16:30:09.495 INFO:tasks.workunit.client.0.smithi170.stdout:8/71: write d6/fb [2267445,50765] 0 2024-09-04T16:30:09.501 INFO:tasks.workunit.client.0.smithi170.stdout:7/261: mkdir d12/d29/d5c 0 2024-09-04T16:30:09.502 INFO:tasks.workunit.client.1.smithi193.stdout:1/495: dread d1/d2b/d10/f25 [0,4194304] 0 2024-09-04T16:30:09.502 INFO:tasks.workunit.client.1.smithi193.stdout:9/528: dread d2/d8/d15/f71 [0,4194304] 0 2024-09-04T16:30:09.505 INFO:tasks.workunit.client.0.smithi170.stdout:6/155: symlink d0/d17/d25/d2d/l37 0 2024-09-04T16:30:09.508 INFO:tasks.workunit.client.1.smithi193.stdout:0/472: write d18/d25/d5f/d6a/d7b/f96 [248625,58985] 0 2024-09-04T16:30:09.509 INFO:tasks.workunit.client.0.smithi170.stdout:8/72: mkdir d6/d10/d18 0 2024-09-04T16:30:09.509 INFO:tasks.workunit.client.0.smithi170.stdout:7/262: dwrite d12/d29/f2a [0,4194304] 0 2024-09-04T16:30:09.510 INFO:tasks.workunit.client.0.smithi170.stdout:9/164: dwrite d2/d11/f26 [0,4194304] 0 2024-09-04T16:30:09.511 INFO:tasks.workunit.client.0.smithi170.stdout:8/73: write d6/f15 [625775,53872] 0 2024-09-04T16:30:09.512 INFO:tasks.workunit.client.0.smithi170.stdout:9/165: truncate d2/f13 1318105 0 2024-09-04T16:30:09.513 INFO:tasks.workunit.client.1.smithi193.stdout:6/433: mkdir d5/d27/d3e/d8c 0 2024-09-04T16:30:09.513 INFO:tasks.workunit.client.0.smithi170.stdout:1/182: creat d9/d11/d2f/f3b x:0 0 0 2024-09-04T16:30:09.514 INFO:tasks.workunit.client.0.smithi170.stdout:1/183: chown d9/d26/f36 4905 1 2024-09-04T16:30:09.515 INFO:tasks.workunit.client.1.smithi193.stdout:8/473: symlink d2/d20/d23/d51/d59/l9e 0 2024-09-04T16:30:09.519 INFO:tasks.workunit.client.0.smithi170.stdout:7/263: mknod d12/d49/c5d 0 2024-09-04T16:30:09.521 INFO:tasks.workunit.client.1.smithi193.stdout:9/529: write d2/d18/d2f/d22/d30/d6a/f7a [171659,26901] 0 2024-09-04T16:30:09.522 INFO:tasks.workunit.client.1.smithi193.stdout:3/472: unlink d0/d18/d1c/d51/f72 0 2024-09-04T16:30:09.523 INFO:tasks.workunit.client.1.smithi193.stdout:3/473: stat d0/d7/f6b 0 2024-09-04T16:30:09.523 INFO:tasks.workunit.client.0.smithi170.stdout:9/166: write d2/d7/f2c [2760713,104637] 0 2024-09-04T16:30:09.523 INFO:tasks.workunit.client.0.smithi170.stdout:6/156: dread d0/f14 [0,4194304] 0 2024-09-04T16:30:09.525 INFO:tasks.workunit.client.0.smithi170.stdout:1/184: symlink d9/d11/d2f/l3c 0 2024-09-04T16:30:09.525 INFO:tasks.workunit.client.0.smithi170.stdout:9/167: write d2/f4 [3186509,65350] 0 2024-09-04T16:30:09.526 INFO:tasks.workunit.client.0.smithi170.stdout:1/185: chown d9/d34/l38 6 1 2024-09-04T16:30:09.526 INFO:tasks.workunit.client.1.smithi193.stdout:0/473: rename d18/d25/d32/d57/d6c/l74 to d18/d25/d32/d57/d6c/l9e 0 2024-09-04T16:30:09.527 INFO:tasks.workunit.client.1.smithi193.stdout:6/434: rmdir d5/de/d15 39 2024-09-04T16:30:09.529 INFO:tasks.workunit.client.1.smithi193.stdout:7/560: rmdir d9/d39/d3e/d4d/d4f/dab/db0 0 2024-09-04T16:30:09.532 INFO:tasks.workunit.client.0.smithi170.stdout:7/264: creat d12/d29/f5e x:0 0 0 2024-09-04T16:30:09.533 INFO:tasks.workunit.client.1.smithi193.stdout:2/432: creat d2/d9/db/d10/d1e/f96 x:0 0 0 2024-09-04T16:30:09.535 INFO:tasks.workunit.client.0.smithi170.stdout:9/168: rename d2/f13 to d2/d7/d27/f2e 0 2024-09-04T16:30:09.537 INFO:tasks.workunit.client.0.smithi170.stdout:6/157: dwrite d0/d17/f1c [0,4194304] 0 2024-09-04T16:30:09.538 INFO:tasks.workunit.client.1.smithi193.stdout:4/366: sync 2024-09-04T16:30:09.541 INFO:tasks.workunit.client.0.smithi170.stdout:8/74: dread d6/f15 [0,4194304] 0 2024-09-04T16:30:09.541 INFO:tasks.workunit.client.0.smithi170.stdout:1/186: dwrite d9/d11/f3a [0,4194304] 0 2024-09-04T16:30:09.543 INFO:tasks.workunit.client.0.smithi170.stdout:6/158: write d0/d17/f1d [3887668,91394] 0 2024-09-04T16:30:09.543 INFO:tasks.workunit.client.0.smithi170.stdout:7/265: mknod d12/d5a/c5f 0 2024-09-04T16:30:09.544 INFO:tasks.workunit.client.1.smithi193.stdout:0/474: rmdir d18/d25 39 2024-09-04T16:30:09.545 INFO:tasks.workunit.client.0.smithi170.stdout:6/159: rename d0/d17/d25/d2d/d2e to d0/d17/d25/d2d/d2e/d38 22 2024-09-04T16:30:09.545 INFO:tasks.workunit.client.1.smithi193.stdout:3/474: dread d0/d18/d1c/d51/d5a/f5c [0,4194304] 0 2024-09-04T16:30:09.546 INFO:tasks.workunit.client.1.smithi193.stdout:6/435: symlink d5/d27/d3e/d43/d5d/l8d 0 2024-09-04T16:30:09.546 INFO:tasks.workunit.client.1.smithi193.stdout:3/475: write d0/d10/f38 [1344496,99724] 0 2024-09-04T16:30:09.547 INFO:tasks.workunit.client.1.smithi193.stdout:3/476: stat d0/d10/d24/d55/c84 0 2024-09-04T16:30:09.548 INFO:tasks.workunit.client.1.smithi193.stdout:8/474: symlink d2/d20/d23/d34/d46/d53/d90/l9f 0 2024-09-04T16:30:09.549 INFO:tasks.workunit.client.0.smithi170.stdout:9/169: symlink d2/d7/d27/d2b/l2f 0 2024-09-04T16:30:09.553 INFO:tasks.workunit.client.1.smithi193.stdout:2/433: stat d2/fe 0 2024-09-04T16:30:09.554 INFO:tasks.workunit.client.0.smithi170.stdout:8/75: symlink d6/d10/l19 0 2024-09-04T16:30:09.555 INFO:tasks.workunit.client.1.smithi193.stdout:5/467: write d1/d8/db/d15/d2b/d83/d37/f67 [2617315,68222] 0 2024-09-04T16:30:09.556 INFO:tasks.workunit.client.0.smithi170.stdout:1/187: rmdir d9/d11 39 2024-09-04T16:30:09.556 INFO:tasks.workunit.client.0.smithi170.stdout:8/76: read d6/fa [2227209,65423] 0 2024-09-04T16:30:09.557 INFO:tasks.workunit.client.0.smithi170.stdout:9/170: dwrite d2/d7/f8 [0,4194304] 0 2024-09-04T16:30:09.560 INFO:tasks.workunit.client.1.smithi193.stdout:6/436: write d5/f11 [1846382,39355] 0 2024-09-04T16:30:09.562 INFO:tasks.workunit.client.0.smithi170.stdout:6/160: unlink d0/df/fb 0 2024-09-04T16:30:09.565 INFO:tasks.workunit.client.1.smithi193.stdout:3/477: mkdir d0/d18/d1c/d51/d5a/da2 0 2024-09-04T16:30:09.584 INFO:tasks.workunit.client.0.smithi170.stdout:9/171: dread d2/d7/f20 [0,4194304] 0 2024-09-04T16:30:09.584 INFO:tasks.workunit.client.0.smithi170.stdout:9/172: fdatasync d2/fd 0 2024-09-04T16:30:09.584 INFO:tasks.workunit.client.0.smithi170.stdout:9/173: readlink d2/l21 0 2024-09-04T16:30:09.588 INFO:tasks.workunit.client.0.smithi170.stdout:9/174: dwrite d2/d7/f20 [0,4194304] 0 2024-09-04T16:30:09.593 INFO:tasks.workunit.client.1.smithi193.stdout:1/496: sync 2024-09-04T16:30:09.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:09 smithi170 ceph-mon[29272]: pgmap v24: 65 pgs: 65 active+clean; 1.2 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 31 MiB/s rd, 165 MiB/s wr, 414 op/s 2024-09-04T16:30:09.610 INFO:tasks.workunit.client.1.smithi193.stdout:4/367: sync 2024-09-04T16:30:09.610 INFO:tasks.workunit.client.1.smithi193.stdout:9/530: sync 2024-09-04T16:30:09.610 INFO:tasks.workunit.client.1.smithi193.stdout:9/531: readlink d2/d18/l6f 0 2024-09-04T16:30:09.612 INFO:tasks.workunit.client.1.smithi193.stdout:8/475: rename d2/d20/d23/d51/d59/d6c to d2/d20/d23/d24/d3c/d65/d67/da0 0 2024-09-04T16:30:09.612 INFO:tasks.workunit.client.0.smithi170.stdout:9/175: dwrite d2/d11/f22 [0,4194304] 0 2024-09-04T16:30:09.615 INFO:tasks.workunit.client.1.smithi193.stdout:2/434: symlink d2/d9/db/d10/d1e/d56/l97 0 2024-09-04T16:30:09.615 INFO:tasks.workunit.client.1.smithi193.stdout:2/435: chown d2/d9/d18/c2b 151972759 1 2024-09-04T16:30:09.655 INFO:tasks.workunit.client.0.smithi170.stdout:3/77: sync 2024-09-04T16:30:09.655 INFO:tasks.workunit.client.0.smithi170.stdout:4/181: sync 2024-09-04T16:30:09.655 INFO:tasks.workunit.client.0.smithi170.stdout:2/120: sync 2024-09-04T16:30:09.655 INFO:tasks.workunit.client.0.smithi170.stdout:3/78: chown d13/f19 353 1 2024-09-04T16:30:09.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:09 smithi193 ceph-mon[36288]: pgmap v24: 65 pgs: 65 active+clean; 1.2 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 31 MiB/s rd, 165 MiB/s wr, 414 op/s 2024-09-04T16:30:09.656 INFO:tasks.workunit.client.0.smithi170.stdout:3/79: dread - d13/f18 zero size 2024-09-04T16:30:09.656 INFO:tasks.workunit.client.0.smithi170.stdout:3/80: stat d13/d14/d17 0 2024-09-04T16:30:09.658 INFO:tasks.workunit.client.1.smithi193.stdout:0/475: mkdir d18/d25/d5f/d65/d9f 0 2024-09-04T16:30:09.660 INFO:tasks.workunit.client.1.smithi193.stdout:3/478: creat d0/d18/d1c/d51/d5a/fa3 x:0 0 0 2024-09-04T16:30:09.661 INFO:tasks.workunit.client.0.smithi170.stdout:6/161: mkdir d0/d17/d39 0 2024-09-04T16:30:09.662 INFO:tasks.workunit.client.1.smithi193.stdout:1/497: rmdir d1/d39/d48 39 2024-09-04T16:30:09.662 INFO:tasks.workunit.client.0.smithi170.stdout:8/77: dwrite d6/f15 [0,4194304] 0 2024-09-04T16:30:09.664 INFO:tasks.workunit.client.1.smithi193.stdout:6/437: dwrite d5/de/d15/d1b/d5f/f77 [0,4194304] 0 2024-09-04T16:30:09.668 INFO:tasks.workunit.client.0.smithi170.stdout:9/176: truncate d2/d11/d23/f29 3510805 0 2024-09-04T16:30:09.671 INFO:tasks.workunit.client.1.smithi193.stdout:8/476: read d2/d20/d23/d24/d3c/d65/f74 [717591,6925] 0 2024-09-04T16:30:09.673 INFO:tasks.workunit.client.1.smithi193.stdout:8/477: write d2/d20/d23/d34/d46/d53/f97 [116997,22397] 0 2024-09-04T16:30:09.673 INFO:tasks.workunit.client.1.smithi193.stdout:7/561: mknod d9/de/d27/cc1 0 2024-09-04T16:30:09.675 INFO:tasks.workunit.client.1.smithi193.stdout:7/562: chown d9/d39/d3e/fa2 40 1 2024-09-04T16:30:09.675 INFO:tasks.workunit.client.1.smithi193.stdout:2/436: mknod d2/d9/db/d10/c98 0 2024-09-04T16:30:09.677 INFO:tasks.workunit.client.0.smithi170.stdout:4/182: creat d1/d6/d8/d3b/f45 x:0 0 0 2024-09-04T16:30:09.678 INFO:tasks.workunit.client.0.smithi170.stdout:4/183: chown d1/d6/ff 31 1 2024-09-04T16:30:09.678 INFO:tasks.workunit.client.1.smithi193.stdout:5/468: mknod d1/d8/db/d15/d2b/d83/d37/d58/c95 0 2024-09-04T16:30:09.679 INFO:tasks.workunit.client.0.smithi170.stdout:4/184: write d1/d6/f34 [811858,40597] 0 2024-09-04T16:30:09.679 INFO:tasks.workunit.client.0.smithi170.stdout:1/188: dread d9/d11/f1e [0,4194304] 0 2024-09-04T16:30:09.680 INFO:tasks.workunit.client.1.smithi193.stdout:4/368: dread d3/d39/f79 [0,4194304] 0 2024-09-04T16:30:09.681 INFO:tasks.workunit.client.0.smithi170.stdout:1/189: write d9/f22 [895030,28145] 0 2024-09-04T16:30:09.683 INFO:tasks.workunit.client.0.smithi170.stdout:8/78: fsync d6/f15 0 2024-09-04T16:30:09.683 INFO:tasks.workunit.client.1.smithi193.stdout:7/563: dread d9/d18/d22/d2b/f91 [0,4194304] 0 2024-09-04T16:30:09.683 INFO:tasks.workunit.client.1.smithi193.stdout:8/478: dwrite d2/d20/d23/d24/d3c/d65/f72 [0,4194304] 0 2024-09-04T16:30:09.688 INFO:tasks.workunit.client.0.smithi170.stdout:1/190: dwrite d9/d11/f32 [0,4194304] 0 2024-09-04T16:30:09.690 INFO:tasks.workunit.client.1.smithi193.stdout:9/532: mknod d2/d18/d2f/d22/d30/ca4 0 2024-09-04T16:30:09.691 INFO:tasks.workunit.client.1.smithi193.stdout:4/369: dwrite d3/fc [0,4194304] 0 2024-09-04T16:30:09.693 INFO:tasks.workunit.client.1.smithi193.stdout:8/479: dread d2/f8 [0,4194304] 0 2024-09-04T16:30:09.693 INFO:tasks.workunit.client.0.smithi170.stdout:9/177: creat d2/d11/d23/f30 x:0 0 0 2024-09-04T16:30:09.693 INFO:tasks.workunit.client.0.smithi170.stdout:2/121: symlink d3/d18/d24/l27 0 2024-09-04T16:30:09.694 INFO:tasks.workunit.client.1.smithi193.stdout:8/480: write d2/d12/fd [3052504,40906] 0 2024-09-04T16:30:09.697 INFO:tasks.workunit.client.0.smithi170.stdout:3/81: write f12 [794098,84528] 0 2024-09-04T16:30:09.697 INFO:tasks.workunit.client.1.smithi193.stdout:2/437: mknod d2/d9/db/d10/d1e/d56/c99 0 2024-09-04T16:30:09.701 INFO:tasks.workunit.client.1.smithi193.stdout:5/469: unlink d1/d8/l3a 0 2024-09-04T16:30:09.704 INFO:tasks.workunit.client.1.smithi193.stdout:1/498: write d1/d2b/db/f3b [3696425,101059] 0 2024-09-04T16:30:09.705 INFO:tasks.workunit.client.1.smithi193.stdout:1/499: dread - d1/d2b/d10/f59 zero size 2024-09-04T16:30:09.706 INFO:tasks.workunit.client.0.smithi170.stdout:9/178: dwrite d2/d11/f1d [0,4194304] 0 2024-09-04T16:30:09.706 INFO:tasks.workunit.client.1.smithi193.stdout:4/370: dread d3/f35 [4194304,4194304] 0 2024-09-04T16:30:09.708 INFO:tasks.workunit.client.0.smithi170.stdout:7/266: getdents d12/d49 0 2024-09-04T16:30:09.710 INFO:tasks.workunit.client.1.smithi193.stdout:7/564: dread d9/d85/f9f [0,4194304] 0 2024-09-04T16:30:09.711 INFO:tasks.workunit.client.0.smithi170.stdout:8/79: rmdir d6 39 2024-09-04T16:30:09.712 INFO:tasks.workunit.client.1.smithi193.stdout:6/438: symlink d5/d27/d3e/d6e/l8e 0 2024-09-04T16:30:09.712 INFO:tasks.workunit.client.0.smithi170.stdout:1/191: truncate d9/d11/f1e 130940 0 2024-09-04T16:30:09.714 INFO:tasks.workunit.client.0.smithi170.stdout:2/122: symlink d3/db/df/l28 0 2024-09-04T16:30:09.715 INFO:tasks.workunit.client.0.smithi170.stdout:3/82: dwrite d13/d14/f15 [0,4194304] 0 2024-09-04T16:30:09.718 INFO:tasks.workunit.client.1.smithi193.stdout:3/479: dwrite d0/f47 [0,4194304] 0 2024-09-04T16:30:09.720 INFO:tasks.workunit.client.1.smithi193.stdout:3/480: chown d0/d18/d1c/d30/f33 33786066 1 2024-09-04T16:30:09.728 INFO:tasks.workunit.client.0.smithi170.stdout:9/179: symlink d2/d7/d27/d2b/l31 0 2024-09-04T16:30:09.729 INFO:tasks.workunit.client.1.smithi193.stdout:0/476: truncate d18/d25/d3b/f75 1300724 0 2024-09-04T16:30:09.730 INFO:tasks.workunit.client.0.smithi170.stdout:7/267: unlink c9 0 2024-09-04T16:30:09.731 INFO:tasks.workunit.client.1.smithi193.stdout:4/371: rmdir d3/d3c 39 2024-09-04T16:30:09.731 INFO:tasks.workunit.client.1.smithi193.stdout:5/470: dread d1/d8/db/d15/d2b/d83/d37/d3f/d8e/f66 [0,4194304] 0 2024-09-04T16:30:09.731 INFO:tasks.workunit.client.1.smithi193.stdout:2/438: dread d2/d9/db/d10/d1f/f4c [0,4194304] 0 2024-09-04T16:30:09.732 INFO:tasks.workunit.client.0.smithi170.stdout:6/162: truncate d0/f16 737082 0 2024-09-04T16:30:09.734 INFO:tasks.workunit.client.0.smithi170.stdout:1/192: creat d9/d11/f3d x:0 0 0 2024-09-04T16:30:09.735 INFO:tasks.workunit.client.0.smithi170.stdout:1/193: chown d9/d34 51806 1 2024-09-04T16:30:09.739 INFO:tasks.workunit.client.1.smithi193.stdout:8/481: mkdir d2/d57/da1 0 2024-09-04T16:30:09.740 INFO:tasks.workunit.client.0.smithi170.stdout:6/163: dwrite d0/f5 [0,4194304] 0 2024-09-04T16:30:09.741 INFO:tasks.workunit.client.0.smithi170.stdout:6/164: dread - d0/df/d1b/f29 zero size 2024-09-04T16:30:09.742 INFO:tasks.workunit.client.0.smithi170.stdout:7/268: write d12/d16/d1d/f32 [211379,15522] 0 2024-09-04T16:30:09.747 INFO:tasks.workunit.client.0.smithi170.stdout:3/83: dread ff [0,4194304] 0 2024-09-04T16:30:09.748 INFO:tasks.workunit.client.0.smithi170.stdout:3/84: write d13/f19 [766400,17176] 0 2024-09-04T16:30:09.750 INFO:tasks.workunit.client.0.smithi170.stdout:1/194: mkdir d9/d11/d3e 0 2024-09-04T16:30:09.754 INFO:tasks.workunit.client.1.smithi193.stdout:4/372: rename d3/f12 to d3/d1a/d54/f7a 0 2024-09-04T16:30:09.755 INFO:tasks.workunit.client.1.smithi193.stdout:4/373: fsync d3/d1a/d21/f22 0 2024-09-04T16:30:09.756 INFO:tasks.workunit.client.1.smithi193.stdout:5/471: mkdir d1/d29/d74/d96 0 2024-09-04T16:30:09.757 INFO:tasks.workunit.client.1.smithi193.stdout:0/477: dread d18/d25/d32/f98 [0,4194304] 0 2024-09-04T16:30:09.758 INFO:tasks.workunit.client.1.smithi193.stdout:2/439: rmdir d2/d9/db/d10 39 2024-09-04T16:30:09.759 INFO:tasks.workunit.client.0.smithi170.stdout:4/185: getdents d1/d6/d22 0 2024-09-04T16:30:09.759 INFO:tasks.workunit.client.1.smithi193.stdout:2/440: read d2/fe [308231,54940] 0 2024-09-04T16:30:09.760 INFO:tasks.workunit.client.1.smithi193.stdout:7/565: mkdir d9/d39/d3e/d4d/d98/d9a/db6/dc2 0 2024-09-04T16:30:09.761 INFO:tasks.workunit.client.0.smithi170.stdout:9/180: mkdir d2/d32 0 2024-09-04T16:30:09.762 INFO:tasks.workunit.client.0.smithi170.stdout:6/165: rmdir d0/d17/d31 39 2024-09-04T16:30:09.764 INFO:tasks.workunit.client.1.smithi193.stdout:6/439: link d5/de/f41 d5/de/d15/d1b/d5f/f8f 0 2024-09-04T16:30:09.765 INFO:tasks.workunit.client.1.smithi193.stdout:6/440: write d5/de/d15/d1b/f1e [260799,58348] 0 2024-09-04T16:30:09.768 INFO:tasks.workunit.client.0.smithi170.stdout:7/269: creat d12/d15/d34/d42/f60 x:0 0 0 2024-09-04T16:30:09.768 INFO:tasks.workunit.client.0.smithi170.stdout:6/166: write d0/f5 [4923741,59867] 0 2024-09-04T16:30:09.771 INFO:tasks.workunit.client.1.smithi193.stdout:8/482: symlink d2/d20/d23/d34/d3e/d6f/la2 0 2024-09-04T16:30:09.771 INFO:tasks.workunit.client.1.smithi193.stdout:8/483: read d2/d20/d23/d34/d46/f5e [511988,3290] 0 2024-09-04T16:30:09.772 INFO:tasks.workunit.client.0.smithi170.stdout:3/85: creat d13/f1a x:0 0 0 2024-09-04T16:30:09.773 INFO:tasks.workunit.client.0.smithi170.stdout:1/195: creat d9/d11/f3f x:0 0 0 2024-09-04T16:30:09.774 INFO:tasks.workunit.client.0.smithi170.stdout:4/186: dread d1/f19 [0,4194304] 0 2024-09-04T16:30:09.775 INFO:tasks.workunit.client.1.smithi193.stdout:5/472: unlink d1/d8/db/d15/d2b/f94 0 2024-09-04T16:30:09.778 INFO:tasks.workunit.client.1.smithi193.stdout:9/533: getdents d2/d18/d2f/d22/d30 0 2024-09-04T16:30:09.779 INFO:tasks.workunit.client.0.smithi170.stdout:7/270: write d12/d29/f44 [2328195,51466] 0 2024-09-04T16:30:09.780 INFO:tasks.workunit.client.0.smithi170.stdout:7/271: chown d12/d29/d5c 32027384 1 2024-09-04T16:30:09.781 INFO:tasks.workunit.client.1.smithi193.stdout:6/441: symlink d5/d33/d4e/d51/d71/d82/l90 0 2024-09-04T16:30:09.781 INFO:tasks.workunit.client.1.smithi193.stdout:7/566: dread d9/d18/f4c [0,4194304] 0 2024-09-04T16:30:09.782 INFO:tasks.workunit.client.0.smithi170.stdout:7/272: chown d12/d15/d41/c58 57444 1 2024-09-04T16:30:09.782 INFO:tasks.workunit.client.0.smithi170.stdout:8/80: rmdir d6/d10/d18 0 2024-09-04T16:30:09.782 INFO:tasks.workunit.client.1.smithi193.stdout:9/534: write d2/d18/d2f/d22/d30/d6a/f7a [697712,125870] 0 2024-09-04T16:30:09.783 INFO:tasks.workunit.client.1.smithi193.stdout:1/500: link d1/d2b/d1b/l52 d1/d39/d48/l9c 0 2024-09-04T16:30:09.784 INFO:tasks.workunit.client.0.smithi170.stdout:6/167: creat d0/df/f3a x:0 0 0 2024-09-04T16:30:09.784 INFO:tasks.workunit.client.1.smithi193.stdout:4/374: dread d3/d3c/f45 [0,4194304] 0 2024-09-04T16:30:09.785 INFO:tasks.workunit.client.1.smithi193.stdout:6/442: dread d5/de/d15/d48/f4b [0,4194304] 0 2024-09-04T16:30:09.785 INFO:tasks.workunit.client.0.smithi170.stdout:3/86: symlink d13/d14/l1b 0 2024-09-04T16:30:09.786 INFO:tasks.workunit.client.1.smithi193.stdout:8/484: dread d2/d20/d23/f16 [0,4194304] 0 2024-09-04T16:30:09.787 INFO:tasks.workunit.client.0.smithi170.stdout:2/123: getdents d3/d4/d14 0 2024-09-04T16:30:09.789 INFO:tasks.workunit.client.1.smithi193.stdout:1/501: dwrite d1/d2b/f31 [0,4194304] 0 2024-09-04T16:30:09.792 INFO:tasks.workunit.client.1.smithi193.stdout:0/478: mkdir d18/d25/d5f/d65/d9f/da0 0 2024-09-04T16:30:09.794 INFO:tasks.workunit.client.1.smithi193.stdout:3/481: sync 2024-09-04T16:30:09.797 INFO:tasks.workunit.client.1.smithi193.stdout:2/441: unlink d2/d9/db/d10/l24 0 2024-09-04T16:30:09.798 INFO:tasks.workunit.client.0.smithi170.stdout:7/273: rename d12/d15/l27 to d12/d4b/l61 0 2024-09-04T16:30:09.800 INFO:tasks.workunit.client.0.smithi170.stdout:8/81: rmdir d6/d10 39 2024-09-04T16:30:09.804 INFO:tasks.workunit.client.0.smithi170.stdout:2/124: write d3/d7/f26 [866410,71403] 0 2024-09-04T16:30:09.807 INFO:tasks.workunit.client.0.smithi170.stdout:4/187: link d1/d6/d8/d20/f25 d1/d6/d8/d20/d35/d3e/f46 0 2024-09-04T16:30:09.808 INFO:tasks.workunit.client.0.smithi170.stdout:9/181: truncate d2/d7/f1f 227524 0 2024-09-04T16:30:09.810 INFO:tasks.workunit.client.1.smithi193.stdout:6/443: mknod d5/d27/d3e/d43/d5d/c91 0 2024-09-04T16:30:09.812 INFO:tasks.workunit.client.1.smithi193.stdout:3/482: dread d0/d7/de/d45/f8d [0,4194304] 0 2024-09-04T16:30:09.814 INFO:tasks.workunit.client.1.smithi193.stdout:8/485: mknod d2/d12/ca3 0 2024-09-04T16:30:09.815 INFO:tasks.workunit.client.0.smithi170.stdout:3/87: mkdir d13/d14/d17/d1c 0 2024-09-04T16:30:09.815 INFO:tasks.workunit.client.1.smithi193.stdout:4/375: write d3/d3c/f58 [1767430,28379] 0 2024-09-04T16:30:09.815 INFO:tasks.workunit.client.0.smithi170.stdout:3/88: readlink l11 0 2024-09-04T16:30:09.816 INFO:tasks.workunit.client.0.smithi170.stdout:3/89: write f10 [392084,47075] 0 2024-09-04T16:30:09.817 INFO:tasks.workunit.client.0.smithi170.stdout:2/125: mknod d3/d7/c29 0 2024-09-04T16:30:09.817 INFO:tasks.workunit.client.0.smithi170.stdout:3/90: chown d13/f18 144 1 2024-09-04T16:30:09.818 INFO:tasks.workunit.client.0.smithi170.stdout:3/91: stat d13/d14 0 2024-09-04T16:30:09.818 INFO:tasks.workunit.client.0.smithi170.stdout:3/92: chown c9 2 1 2024-09-04T16:30:09.819 INFO:tasks.workunit.client.1.smithi193.stdout:0/479: rmdir d18/d25/d5f/d6a/d7b 39 2024-09-04T16:30:09.820 INFO:tasks.workunit.client.0.smithi170.stdout:2/126: dread d3/db/f12 [0,4194304] 0 2024-09-04T16:30:09.820 INFO:tasks.workunit.client.0.smithi170.stdout:7/274: symlink d12/l62 0 2024-09-04T16:30:09.821 INFO:tasks.workunit.client.0.smithi170.stdout:7/275: chown d12/d5a 12 1 2024-09-04T16:30:09.822 INFO:tasks.workunit.client.0.smithi170.stdout:2/127: fdatasync d3/d4/f6 0 2024-09-04T16:30:09.822 INFO:tasks.workunit.client.1.smithi193.stdout:5/473: rename d1/d29/c1c to d1/d8/db/d36/c97 0 2024-09-04T16:30:09.823 INFO:tasks.workunit.client.0.smithi170.stdout:2/128: write d3/d4/f6 [5037525,91493] 0 2024-09-04T16:30:09.824 INFO:tasks.workunit.client.0.smithi170.stdout:9/182: creat d2/d11/f33 x:0 0 0 2024-09-04T16:30:09.826 INFO:tasks.workunit.client.0.smithi170.stdout:3/93: dwrite d13/f1a [0,4194304] 0 2024-09-04T16:30:09.829 INFO:tasks.workunit.client.1.smithi193.stdout:4/376: dread d3/f18 [0,4194304] 0 2024-09-04T16:30:09.830 INFO:tasks.workunit.client.1.smithi193.stdout:7/567: stat d9/de/d27/f84 0 2024-09-04T16:30:09.835 INFO:tasks.workunit.client.1.smithi193.stdout:9/535: link d2/d8/d61/f87 d2/d18/d2f/d22/d30/d6a/fa5 0 2024-09-04T16:30:09.837 INFO:tasks.workunit.client.0.smithi170.stdout:3/94: dwrite d13/f19 [0,4194304] 0 2024-09-04T16:30:09.839 INFO:tasks.workunit.client.1.smithi193.stdout:6/444: symlink d5/de/d15/d1b/d5f/l92 0 2024-09-04T16:30:09.840 INFO:tasks.workunit.client.1.smithi193.stdout:6/445: dread - d5/d27/f84 zero size 2024-09-04T16:30:09.840 INFO:tasks.workunit.client.1.smithi193.stdout:3/483: mknod d0/d18/d1c/d51/d7a/ca4 0 2024-09-04T16:30:09.841 INFO:tasks.workunit.client.1.smithi193.stdout:3/484: write d0/d9/fb [3406847,4513] 0 2024-09-04T16:30:09.848 INFO:tasks.workunit.client.0.smithi170.stdout:4/188: dwrite d1/f19 [0,4194304] 0 2024-09-04T16:30:09.848 INFO:tasks.workunit.client.0.smithi170.stdout:2/129: stat d3/d4/c5 0 2024-09-04T16:30:09.852 INFO:tasks.workunit.client.1.smithi193.stdout:2/442: rename d2/d9/d18/d3f to d2/d14/d9a 0 2024-09-04T16:30:09.855 INFO:tasks.workunit.client.0.smithi170.stdout:2/130: dwrite d3/db/d1c/f23 [0,4194304] 0 2024-09-04T16:30:09.855 INFO:tasks.workunit.client.0.smithi170.stdout:8/82: truncate d6/fb 3989326 0 2024-09-04T16:30:09.858 INFO:tasks.workunit.client.1.smithi193.stdout:4/377: rmdir d3/d3c/d47 39 2024-09-04T16:30:09.858 INFO:tasks.workunit.client.1.smithi193.stdout:4/378: chown d3/d1a/d21/f34 167509828 1 2024-09-04T16:30:09.859 INFO:tasks.workunit.client.1.smithi193.stdout:7/568: creat d9/d39/d3e/d4d/d4f/dab/fc3 x:0 0 0 2024-09-04T16:30:09.860 INFO:tasks.workunit.client.1.smithi193.stdout:7/569: dread - d9/de/d27/f84 zero size 2024-09-04T16:30:09.860 INFO:tasks.workunit.client.1.smithi193.stdout:9/536: fsync d2/d8/d15/f48 0 2024-09-04T16:30:09.861 INFO:tasks.workunit.client.1.smithi193.stdout:7/570: write f8 [6713536,8388] 0 2024-09-04T16:30:09.861 INFO:tasks.workunit.client.0.smithi170.stdout:3/95: mkdir d13/d14/d1d 0 2024-09-04T16:30:09.863 INFO:tasks.workunit.client.1.smithi193.stdout:7/571: chown d9/d39/d3e/d53/fa5 1 1 2024-09-04T16:30:09.863 INFO:tasks.workunit.client.1.smithi193.stdout:9/537: truncate d2/d8/d15/f71 4874578 0 2024-09-04T16:30:09.863 INFO:tasks.workunit.client.0.smithi170.stdout:7/276: mknod d12/d29/d5c/c63 0 2024-09-04T16:30:09.863 INFO:tasks.workunit.client.0.smithi170.stdout:3/96: dread ff [0,4194304] 0 2024-09-04T16:30:09.864 INFO:tasks.workunit.client.0.smithi170.stdout:7/277: stat d12/d15/d34/f3b 0 2024-09-04T16:30:09.865 INFO:tasks.workunit.client.0.smithi170.stdout:4/189: mkdir d1/d6/d2b/d47 0 2024-09-04T16:30:09.866 INFO:tasks.workunit.client.0.smithi170.stdout:4/190: write d1/d6/f14 [4039189,111703] 0 2024-09-04T16:30:09.867 INFO:tasks.workunit.client.1.smithi193.stdout:8/486: creat d2/d20/d23/d34/d3e/d6f/d81/fa4 x:0 0 0 2024-09-04T16:30:09.868 INFO:tasks.workunit.client.0.smithi170.stdout:4/191: write d1/d6/d8/f21 [3898134,86792] 0 2024-09-04T16:30:09.869 INFO:tasks.workunit.client.1.smithi193.stdout:3/485: mknod d0/d10/d24/ca5 0 2024-09-04T16:30:09.872 INFO:tasks.workunit.client.1.smithi193.stdout:1/502: creat d1/d2b/d1b/d28/f9d x:0 0 0 2024-09-04T16:30:09.873 INFO:tasks.workunit.client.0.smithi170.stdout:8/83: readlink l2 0 2024-09-04T16:30:09.873 INFO:tasks.workunit.client.1.smithi193.stdout:1/503: write d1/d2b/db/f3f [4053799,86196] 0 2024-09-04T16:30:09.874 INFO:tasks.workunit.client.1.smithi193.stdout:1/504: chown d1/d2b/db/f3f 0 1 2024-09-04T16:30:09.876 INFO:tasks.workunit.client.0.smithi170.stdout:2/131: creat d3/db/d1c/f2a x:0 0 0 2024-09-04T16:30:09.877 INFO:tasks.workunit.client.1.smithi193.stdout:5/474: mkdir d1/d29/d74/d96/d98 0 2024-09-04T16:30:09.879 INFO:tasks.workunit.client.1.smithi193.stdout:2/443: mkdir d2/d9/db/d10/d51/d87/d9b 0 2024-09-04T16:30:09.881 INFO:tasks.workunit.client.0.smithi170.stdout:7/278: creat d12/d15/d41/f64 x:0 0 0 2024-09-04T16:30:09.881 INFO:tasks.workunit.client.1.smithi193.stdout:4/379: mkdir d3/d1a/d21/d52/d5e/d7b 0 2024-09-04T16:30:09.882 INFO:tasks.workunit.client.1.smithi193.stdout:5/475: dread d1/d29/f6e [0,4194304] 0 2024-09-04T16:30:09.882 INFO:tasks.workunit.client.1.smithi193.stdout:8/487: dread d2/d20/d23/f29 [0,4194304] 0 2024-09-04T16:30:09.883 INFO:tasks.workunit.client.1.smithi193.stdout:8/488: fdatasync d2/d20/d23/d1b/d4e/f55 0 2024-09-04T16:30:09.884 INFO:tasks.workunit.client.1.smithi193.stdout:8/489: dread - d2/d20/f8d zero size 2024-09-04T16:30:09.885 INFO:tasks.workunit.client.1.smithi193.stdout:8/490: write d2/d12/f8e [172261,78380] 0 2024-09-04T16:30:09.889 INFO:tasks.workunit.client.1.smithi193.stdout:9/538: symlink d2/d18/d2f/d9a/la6 0 2024-09-04T16:30:09.889 INFO:tasks.workunit.client.1.smithi193.stdout:5/476: dwrite d1/d8/db/d36/d40/d46/f87 [0,4194304] 0 2024-09-04T16:30:09.890 INFO:tasks.workunit.client.1.smithi193.stdout:5/477: write d1/d8/db/d36/f52 [87604,7868] 0 2024-09-04T16:30:09.892 INFO:tasks.workunit.client.0.smithi170.stdout:3/97: creat d13/d14/d1d/f1e x:0 0 0 2024-09-04T16:30:09.895 INFO:tasks.workunit.client.1.smithi193.stdout:0/480: truncate d18/d25/f3c 1421553 0 2024-09-04T16:30:09.897 INFO:tasks.workunit.client.0.smithi170.stdout:9/183: getdents d2/d11 0 2024-09-04T16:30:09.897 INFO:tasks.workunit.client.0.smithi170.stdout:9/184: fdatasync d2/d11/f1b 0 2024-09-04T16:30:09.900 INFO:tasks.workunit.client.1.smithi193.stdout:0/481: dwrite d18/d25/d32/f42 [0,4194304] 0 2024-09-04T16:30:09.900 INFO:tasks.workunit.client.1.smithi193.stdout:4/380: symlink d3/d1a/d21/d52/d5e/l7c 0 2024-09-04T16:30:09.901 INFO:tasks.workunit.client.1.smithi193.stdout:4/381: fdatasync d3/f16 0 2024-09-04T16:30:09.902 INFO:tasks.workunit.client.1.smithi193.stdout:0/482: write d18/d25/d32/f52 [4079149,7734] 0 2024-09-04T16:30:09.909 INFO:tasks.workunit.client.0.smithi170.stdout:4/192: dwrite d1/d6/d8/d20/d35/d3e/f46 [0,4194304] 0 2024-09-04T16:30:09.909 INFO:tasks.workunit.client.0.smithi170.stdout:4/193: chown d1/d6/d8/d20/f25 744132 1 2024-09-04T16:30:09.980 INFO:tasks.workunit.client.1.smithi193.stdout:7/572: link d9/de/f1c d9/d39/fc4 0 2024-09-04T16:30:09.983 INFO:tasks.workunit.client.0.smithi170.stdout:9/185: mkdir d2/d7/d27/d2b/d34 0 2024-09-04T16:30:09.984 INFO:tasks.workunit.client.1.smithi193.stdout:9/539: creat d2/d18/d2f/d22/d30/d6a/fa7 x:0 0 0 2024-09-04T16:30:09.986 INFO:tasks.workunit.client.1.smithi193.stdout:9/540: fsync d2/d8/d15/f1b 0 2024-09-04T16:30:09.986 INFO:tasks.workunit.client.1.smithi193.stdout:7/573: dwrite d9/d39/d3e/d4a/f5b [4194304,4194304] 0 2024-09-04T16:30:09.988 INFO:tasks.workunit.client.1.smithi193.stdout:3/486: link d0/d18/d1b/f8b d0/d7/fa6 0 2024-09-04T16:30:09.990 INFO:tasks.workunit.client.0.smithi170.stdout:3/98: dwrite d13/f19 [4194304,4194304] 0 2024-09-04T16:30:09.991 INFO:tasks.workunit.client.0.smithi170.stdout:3/99: write fb [5066784,18891] 0 2024-09-04T16:30:09.994 INFO:tasks.workunit.client.0.smithi170.stdout:2/132: getdents d3/db/df 0 2024-09-04T16:30:09.995 INFO:tasks.workunit.client.1.smithi193.stdout:2/444: symlink d2/d9/l9c 0 2024-09-04T16:30:09.996 INFO:tasks.workunit.client.0.smithi170.stdout:7/279: getdents d12/d15 0 2024-09-04T16:30:09.996 INFO:tasks.workunit.client.1.smithi193.stdout:2/445: fdatasync d2/d9/db/f75 0 2024-09-04T16:30:09.998 INFO:tasks.workunit.client.0.smithi170.stdout:4/194: link d1/d6/f14 d1/d6/d22/f48 0 2024-09-04T16:30:09.999 INFO:tasks.workunit.client.0.smithi170.stdout:4/195: read d1/d6/d8/f9 [2106961,33241] 0 2024-09-04T16:30:10.000 INFO:tasks.workunit.client.0.smithi170.stdout:8/84: write d6/fb [1677755,95685] 0 2024-09-04T16:30:10.002 INFO:tasks.workunit.client.1.smithi193.stdout:4/382: rename d3/d39/l61 to d3/d1a/d21/l7d 0 2024-09-04T16:30:10.003 INFO:tasks.workunit.client.1.smithi193.stdout:6/446: getdents d5/de/d15/d1b 0 2024-09-04T16:30:10.004 INFO:tasks.workunit.client.1.smithi193.stdout:0/483: chown d18/d25/d32/d57/c71 217602 1 2024-09-04T16:30:10.005 INFO:tasks.workunit.client.0.smithi170.stdout:3/100: mkdir d13/d14/d1f 0 2024-09-04T16:30:10.006 INFO:tasks.workunit.client.1.smithi193.stdout:0/484: write d18/d25/d32/f53 [754953,33283] 0 2024-09-04T16:30:10.009 INFO:tasks.workunit.client.1.smithi193.stdout:8/491: link d2/d20/d23/d51/d76/f87 d2/d20/d23/d34/d46/d53/fa5 0 2024-09-04T16:30:10.010 INFO:tasks.workunit.client.1.smithi193.stdout:8/492: chown d2/d20/d23/d34/d3e/d6f/d81/fa4 29801 1 2024-09-04T16:30:10.010 INFO:tasks.workunit.client.0.smithi170.stdout:2/133: unlink d3/c15 0 2024-09-04T16:30:10.012 INFO:tasks.workunit.client.0.smithi170.stdout:7/280: mkdir d12/d16/d1d/d65 0 2024-09-04T16:30:10.013 INFO:tasks.workunit.client.0.smithi170.stdout:7/281: chown d12/d16/f3f 122 1 2024-09-04T16:30:10.013 INFO:tasks.workunit.client.0.smithi170.stdout:7/282: stat d12/d29/d5c 0 2024-09-04T16:30:10.013 INFO:tasks.workunit.client.0.smithi170.stdout:7/283: chown d12/d16 216 1 2024-09-04T16:30:10.015 INFO:tasks.workunit.client.1.smithi193.stdout:9/541: mknod d2/d18/d2f/d9a/ca8 0 2024-09-04T16:30:10.015 INFO:tasks.workunit.client.0.smithi170.stdout:9/186: write d2/d11/d23/f29 [2538917,127391] 0 2024-09-04T16:30:10.018 INFO:tasks.workunit.client.0.smithi170.stdout:9/187: stat d2/d7/l25 0 2024-09-04T16:30:10.019 INFO:tasks.workunit.client.1.smithi193.stdout:7/574: readlink d9/d39/d3e/d4d/d4f/lb5 0 2024-09-04T16:30:10.019 INFO:tasks.workunit.client.0.smithi170.stdout:3/101: symlink d13/l20 0 2024-09-04T16:30:10.020 INFO:tasks.workunit.client.0.smithi170.stdout:7/284: dwrite f7 [0,4194304] 0 2024-09-04T16:30:10.021 INFO:tasks.workunit.client.0.smithi170.stdout:7/285: read d12/d29/f2d [594242,34912] 0 2024-09-04T16:30:10.022 INFO:tasks.workunit.client.0.smithi170.stdout:4/196: write d1/f1e [681714,44351] 0 2024-09-04T16:30:10.024 INFO:tasks.workunit.client.0.smithi170.stdout:2/134: creat d3/db/f2b x:0 0 0 2024-09-04T16:30:10.025 INFO:tasks.workunit.client.1.smithi193.stdout:2/446: mknod d2/d9/db/d10/d1f/d22/c9d 0 2024-09-04T16:30:10.026 INFO:tasks.workunit.client.1.smithi193.stdout:2/447: write d2/d9/db/f72 [1019961,19258] 0 2024-09-04T16:30:10.027 INFO:tasks.workunit.client.1.smithi193.stdout:4/383: mknod d3/d1a/d21/d52/d5e/c7e 0 2024-09-04T16:30:10.028 INFO:tasks.workunit.client.0.smithi170.stdout:8/85: mkdir d6/d10/d1a 0 2024-09-04T16:30:10.030 INFO:tasks.workunit.client.0.smithi170.stdout:9/188: mkdir d2/d7/d35 0 2024-09-04T16:30:10.031 INFO:tasks.workunit.client.0.smithi170.stdout:3/102: mkdir d13/d14/d21 0 2024-09-04T16:30:10.032 INFO:tasks.workunit.client.1.smithi193.stdout:0/485: creat d18/d25/d5f/fa1 x:0 0 0 2024-09-04T16:30:10.033 INFO:tasks.workunit.client.0.smithi170.stdout:9/189: chown d2/d11/f22 73412 1 2024-09-04T16:30:10.033 INFO:tasks.workunit.client.0.smithi170.stdout:7/286: dwrite d12/f18 [0,4194304] 0 2024-09-04T16:30:10.033 INFO:tasks.workunit.client.0.smithi170.stdout:8/86: truncate d6/f15 4347911 0 2024-09-04T16:30:10.034 INFO:tasks.workunit.client.1.smithi193.stdout:8/493: creat d2/d57/fa6 x:0 0 0 2024-09-04T16:30:10.034 INFO:tasks.workunit.client.1.smithi193.stdout:8/494: chown d2/d20/d23/d34/d46/f5e 3 1 2024-09-04T16:30:10.035 INFO:tasks.workunit.client.0.smithi170.stdout:9/190: fdatasync d2/d11/f1b 0 2024-09-04T16:30:10.036 INFO:tasks.workunit.client.0.smithi170.stdout:8/87: chown d6/cd 169757 1 2024-09-04T16:30:10.038 INFO:tasks.workunit.client.0.smithi170.stdout:2/135: dwrite d3/db/d1c/f23 [0,4194304] 0 2024-09-04T16:30:10.043 INFO:tasks.workunit.client.0.smithi170.stdout:2/136: write d3/d4/f21 [656269,70274] 0 2024-09-04T16:30:10.044 INFO:tasks.workunit.client.0.smithi170.stdout:0/222: sync 2024-09-04T16:30:10.046 INFO:tasks.workunit.client.0.smithi170.stdout:4/197: dread d1/d6/f1b [0,4194304] 0 2024-09-04T16:30:10.049 INFO:tasks.workunit.client.0.smithi170.stdout:7/287: dwrite d12/d15/d34/f36 [0,4194304] 0 2024-09-04T16:30:10.052 INFO:tasks.workunit.client.0.smithi170.stdout:9/191: dread d2/d11/f1d [0,4194304] 0 2024-09-04T16:30:10.052 INFO:tasks.workunit.client.0.smithi170.stdout:3/103: truncate ff 1858 0 2024-09-04T16:30:10.054 INFO:tasks.workunit.client.0.smithi170.stdout:3/104: fdatasync d13/f1a 0 2024-09-04T16:30:10.059 INFO:tasks.workunit.client.0.smithi170.stdout:2/137: dwrite d3/db/f2b [0,4194304] 0 2024-09-04T16:30:10.061 INFO:tasks.workunit.client.0.smithi170.stdout:4/198: symlink d1/d6/d22/l49 0 2024-09-04T16:30:10.063 INFO:tasks.workunit.client.0.smithi170.stdout:2/138: dread d3/fe [0,4194304] 0 2024-09-04T16:30:10.067 INFO:tasks.workunit.client.1.smithi193.stdout:1/505: getdents d1/d2b/db/d54 0 2024-09-04T16:30:10.070 INFO:tasks.workunit.client.0.smithi170.stdout:9/192: creat d2/d11/f36 x:0 0 0 2024-09-04T16:30:10.071 INFO:tasks.workunit.client.1.smithi193.stdout:4/384: mkdir d3/d1a/d21/d52/d7f 0 2024-09-04T16:30:10.072 INFO:tasks.workunit.client.1.smithi193.stdout:4/385: write d3/f6 [3095902,3142] 0 2024-09-04T16:30:10.073 INFO:tasks.workunit.client.1.smithi193.stdout:4/386: fdatasync d3/d39/d44/f6a 0 2024-09-04T16:30:10.075 INFO:tasks.workunit.client.0.smithi170.stdout:8/88: symlink d6/l1b 0 2024-09-04T16:30:10.076 INFO:tasks.workunit.client.0.smithi170.stdout:4/199: symlink d1/d6/d8/d20/d35/l4a 0 2024-09-04T16:30:10.077 INFO:tasks.workunit.client.1.smithi193.stdout:5/478: getdents d1/d8/db/d36/d40/d46/d84 0 2024-09-04T16:30:10.079 INFO:tasks.workunit.client.0.smithi170.stdout:0/223: truncate d11/d13/d2f/d3f/f4f 1214338 0 2024-09-04T16:30:10.080 INFO:tasks.workunit.client.1.smithi193.stdout:8/495: dwrite d2/d20/d23/d34/d3e/f50 [0,4194304] 0 2024-09-04T16:30:10.080 INFO:tasks.workunit.client.1.smithi193.stdout:7/575: mknod d9/d18/d22/cc5 0 2024-09-04T16:30:10.081 INFO:tasks.workunit.client.0.smithi170.stdout:0/224: read d11/f1c [4689499,17493] 0 2024-09-04T16:30:10.081 INFO:tasks.workunit.client.0.smithi170.stdout:8/89: dwrite d6/fb [0,4194304] 0 2024-09-04T16:30:10.081 INFO:tasks.workunit.client.1.smithi193.stdout:8/496: write d2/d20/d23/d1b/d4e/f88 [629800,110917] 0 2024-09-04T16:30:10.082 INFO:tasks.workunit.client.1.smithi193.stdout:8/497: dread - d2/d20/d23/d34/d3e/d6f/d81/fa4 zero size 2024-09-04T16:30:10.083 INFO:tasks.workunit.client.1.smithi193.stdout:1/506: mkdir d1/d2b/db/d9e 0 2024-09-04T16:30:10.090 INFO:tasks.workunit.client.0.smithi170.stdout:3/105: mknod d13/d14/d17/d1c/c22 0 2024-09-04T16:30:10.092 INFO:tasks.workunit.client.0.smithi170.stdout:0/225: dwrite d11/d13/f28 [0,4194304] 0 2024-09-04T16:30:10.095 INFO:tasks.workunit.client.1.smithi193.stdout:6/447: link d5/de/d15/d1b/f6f d5/de/f93 0 2024-09-04T16:30:10.097 INFO:tasks.workunit.client.1.smithi193.stdout:4/387: rename d3/d1a/d2a/c69 to d3/d1a/d21/d52/c80 0 2024-09-04T16:30:10.098 INFO:tasks.workunit.client.1.smithi193.stdout:4/388: chown d3/d39/f77 1 1 2024-09-04T16:30:10.099 INFO:tasks.workunit.client.1.smithi193.stdout:3/487: write d0/d9/f83 [151470,68623] 0 2024-09-04T16:30:10.100 INFO:tasks.workunit.client.1.smithi193.stdout:5/479: mknod d1/d8/db/d15/d2b/d83/d37/d88/c99 0 2024-09-04T16:30:10.100 INFO:tasks.workunit.client.1.smithi193.stdout:4/389: stat d3/d1a/d21/f4c 0 2024-09-04T16:30:10.101 INFO:tasks.workunit.client.1.smithi193.stdout:4/390: read - d3/d39/f77 zero size 2024-09-04T16:30:10.101 INFO:tasks.workunit.client.1.smithi193.stdout:3/488: readlink d0/d18/d1c/d25/d5e/d68/l69 0 2024-09-04T16:30:10.101 INFO:tasks.workunit.client.0.smithi170.stdout:7/288: write d12/f14 [2195098,104110] 0 2024-09-04T16:30:10.102 INFO:tasks.workunit.client.1.smithi193.stdout:8/498: symlink d2/d20/d23/d51/la7 0 2024-09-04T16:30:10.104 INFO:tasks.workunit.client.0.smithi170.stdout:9/193: creat d2/d11/d23/d2a/f37 x:0 0 0 2024-09-04T16:30:10.105 INFO:tasks.workunit.client.1.smithi193.stdout:1/507: mknod d1/d2b/d1b/c9f 0 2024-09-04T16:30:10.107 INFO:tasks.workunit.client.1.smithi193.stdout:1/508: chown d1/d2b/d1b/d28/f9d 64379 1 2024-09-04T16:30:10.107 INFO:tasks.workunit.client.1.smithi193.stdout:4/391: dwrite d3/f29 [0,4194304] 0 2024-09-04T16:30:10.113 INFO:tasks.workunit.client.0.smithi170.stdout:2/139: write d3/fe [277418,43015] 0 2024-09-04T16:30:10.113 INFO:tasks.workunit.client.1.smithi193.stdout:0/486: creat d18/fa2 x:0 0 0 2024-09-04T16:30:10.114 INFO:tasks.workunit.client.0.smithi170.stdout:4/200: fdatasync d1/d6/d8/fa 0 2024-09-04T16:30:10.117 INFO:tasks.workunit.client.1.smithi193.stdout:5/480: fdatasync d1/d29/f59 0 2024-09-04T16:30:10.117 INFO:tasks.workunit.client.1.smithi193.stdout:1/509: dwrite d1/d2b/d10/d2a/f6f [0,4194304] 0 2024-09-04T16:30:10.117 INFO:tasks.workunit.client.1.smithi193.stdout:4/392: dwrite d3/d39/f6b [0,4194304] 0 2024-09-04T16:30:10.117 INFO:tasks.workunit.client.1.smithi193.stdout:9/542: sync 2024-09-04T16:30:10.120 INFO:tasks.workunit.client.1.smithi193.stdout:2/448: write d2/d14/f50 [2051794,8811] 0 2024-09-04T16:30:10.121 INFO:tasks.workunit.client.1.smithi193.stdout:3/489: creat d0/d18/d1c/d25/d5e/d7e/fa7 x:0 0 0 2024-09-04T16:30:10.126 INFO:tasks.workunit.client.0.smithi170.stdout:9/194: read d2/d7/f1f [68963,80645] 0 2024-09-04T16:30:10.127 INFO:tasks.workunit.client.0.smithi170.stdout:9/195: chown d2/d7/d35 92 1 2024-09-04T16:30:10.129 INFO:tasks.workunit.client.0.smithi170.stdout:3/106: dread f10 [0,4194304] 0 2024-09-04T16:30:10.134 INFO:tasks.workunit.client.1.smithi193.stdout:0/487: mknod d18/d25/d32/ca3 0 2024-09-04T16:30:10.134 INFO:tasks.workunit.client.1.smithi193.stdout:0/488: stat d18/d25 0 2024-09-04T16:30:10.136 INFO:tasks.workunit.client.0.smithi170.stdout:8/90: dwrite d6/fa [0,4194304] 0 2024-09-04T16:30:10.138 INFO:tasks.workunit.client.0.smithi170.stdout:2/140: mkdir d3/d18/d24/d2c 0 2024-09-04T16:30:10.139 INFO:tasks.workunit.client.1.smithi193.stdout:6/448: write d5/d27/d3e/f89 [855374,2704] 0 2024-09-04T16:30:10.141 INFO:tasks.workunit.client.0.smithi170.stdout:8/91: dread d6/fb [0,4194304] 0 2024-09-04T16:30:10.143 INFO:tasks.workunit.client.1.smithi193.stdout:5/481: creat d1/d8/db/d15/d2b/d83/d37/d58/f9a x:0 0 0 2024-09-04T16:30:10.144 INFO:tasks.workunit.client.0.smithi170.stdout:0/226: creat d11/f50 x:0 0 0 2024-09-04T16:30:10.145 INFO:tasks.workunit.client.0.smithi170.stdout:0/227: write ff [1816859,28823] 0 2024-09-04T16:30:10.145 INFO:tasks.workunit.client.1.smithi193.stdout:2/449: creat d2/d9/db/d65/f9e x:0 0 0 2024-09-04T16:30:10.146 INFO:tasks.workunit.client.0.smithi170.stdout:0/228: write d11/d13/d35/f49 [75174,80457] 0 2024-09-04T16:30:10.147 INFO:tasks.workunit.client.0.smithi170.stdout:9/196: rename d2/d7/c19 to d2/d7/d27/c38 0 2024-09-04T16:30:10.149 INFO:tasks.workunit.client.1.smithi193.stdout:9/543: dwrite d2/d8/d15/f16 [0,4194304] 0 2024-09-04T16:30:10.150 INFO:tasks.workunit.client.1.smithi193.stdout:5/482: dread d1/d8/db/d15/d2b/d83/d37/d3f/d8e/f7b [0,4194304] 0 2024-09-04T16:30:10.153 INFO:tasks.workunit.client.0.smithi170.stdout:4/201: truncate d1/d6/d8/fa 1126488 0 2024-09-04T16:30:10.154 INFO:tasks.workunit.client.0.smithi170.stdout:2/141: symlink d3/d7/l2d 0 2024-09-04T16:30:10.156 INFO:tasks.workunit.client.1.smithi193.stdout:4/393: mkdir d3/d81 0 2024-09-04T16:30:10.157 INFO:tasks.workunit.client.0.smithi170.stdout:0/229: dread d11/f25 [0,4194304] 0 2024-09-04T16:30:10.158 INFO:tasks.workunit.client.0.smithi170.stdout:9/197: dwrite d2/d11/f1b [0,4194304] 0 2024-09-04T16:30:10.160 INFO:tasks.workunit.client.0.smithi170.stdout:7/289: dwrite d12/d16/f25 [0,4194304] 0 2024-09-04T16:30:10.167 INFO:tasks.workunit.client.1.smithi193.stdout:3/490: write d0/d18/f50 [5877656,112032] 0 2024-09-04T16:30:10.169 INFO:tasks.workunit.client.1.smithi193.stdout:7/576: sync 2024-09-04T16:30:10.170 INFO:tasks.workunit.client.1.smithi193.stdout:2/450: creat d2/d9/db/d10/d38/d63/f9f x:0 0 0 2024-09-04T16:30:10.171 INFO:tasks.workunit.client.0.smithi170.stdout:7/290: dwrite d12/d15/d41/f64 [0,4194304] 0 2024-09-04T16:30:10.173 INFO:tasks.workunit.client.1.smithi193.stdout:9/544: creat d2/d18/fa9 x:0 0 0 2024-09-04T16:30:10.176 INFO:tasks.workunit.client.0.smithi170.stdout:4/202: fsync d1/d6/d8/f9 0 2024-09-04T16:30:10.177 INFO:tasks.workunit.client.1.smithi193.stdout:5/483: truncate d1/d8/db/d15/f30 2185077 0 2024-09-04T16:30:10.178 INFO:tasks.workunit.client.0.smithi170.stdout:8/92: symlink d6/d10/d1a/l1c 0 2024-09-04T16:30:10.181 INFO:tasks.workunit.client.0.smithi170.stdout:9/198: symlink d2/d11/d23/l39 0 2024-09-04T16:30:10.183 INFO:tasks.workunit.client.0.smithi170.stdout:8/93: dread d6/fb [0,4194304] 0 2024-09-04T16:30:10.183 INFO:tasks.workunit.client.1.smithi193.stdout:3/491: rmdir d0/d9/d49 39 2024-09-04T16:30:10.186 INFO:tasks.workunit.client.1.smithi193.stdout:6/449: dwrite d5/de/d15/d48/f4b [0,4194304] 0 2024-09-04T16:30:10.186 INFO:tasks.workunit.client.1.smithi193.stdout:8/499: getdents d2/d20/d23/d34/d46 0 2024-09-04T16:30:10.187 INFO:tasks.workunit.client.0.smithi170.stdout:4/203: symlink d1/d6/d2b/d33/l4b 0 2024-09-04T16:30:10.188 INFO:tasks.workunit.client.1.smithi193.stdout:8/500: chown d2/d20/d23/d34/d3e/l54 305502 1 2024-09-04T16:30:10.188 INFO:tasks.workunit.client.0.smithi170.stdout:4/204: dread - d1/d6/f32 zero size 2024-09-04T16:30:10.191 INFO:tasks.workunit.client.0.smithi170.stdout:0/230: truncate f3 1429221 0 2024-09-04T16:30:10.192 INFO:tasks.workunit.client.0.smithi170.stdout:2/142: dread d3/d7/f1d [0,4194304] 0 2024-09-04T16:30:10.192 INFO:tasks.workunit.client.0.smithi170.stdout:8/94: dwrite d6/f15 [0,4194304] 0 2024-09-04T16:30:10.193 INFO:tasks.workunit.client.1.smithi193.stdout:0/489: rename d18/d25/d32/f53 to d18/d25/fa4 0 2024-09-04T16:30:10.193 INFO:tasks.workunit.client.1.smithi193.stdout:2/451: dread d2/fc [4194304,4194304] 0 2024-09-04T16:30:10.194 INFO:tasks.workunit.client.0.smithi170.stdout:2/143: readlink d3/d18/d24/l27 0 2024-09-04T16:30:10.194 INFO:tasks.workunit.client.1.smithi193.stdout:0/490: chown d18/d25/d5f/d65/d9f 879 1 2024-09-04T16:30:10.195 INFO:tasks.workunit.client.0.smithi170.stdout:9/199: unlink d2/d7/f8 0 2024-09-04T16:30:10.217 INFO:tasks.workunit.client.1.smithi193.stdout:1/510: sync 2024-09-04T16:30:10.227 INFO:tasks.workunit.client.1.smithi193.stdout:5/484: stat d1/d8/db/d36/f48 0 2024-09-04T16:30:10.228 INFO:tasks.workunit.client.1.smithi193.stdout:5/485: chown d1/d8/db/d15/d2b/d83/c5d 8553 1 2024-09-04T16:30:10.229 INFO:tasks.workunit.client.1.smithi193.stdout:5/486: truncate d1/d8/fc 1675616 0 2024-09-04T16:30:10.229 INFO:tasks.workunit.client.0.smithi170.stdout:3/107: getdents d13/d14/d17 0 2024-09-04T16:30:10.229 INFO:tasks.workunit.client.0.smithi170.stdout:3/108: stat c9 0 2024-09-04T16:30:10.230 INFO:tasks.workunit.client.1.smithi193.stdout:5/487: readlink d1/d8/db/d15/d2b/d83/d37/d3f/d8e/l92 0 2024-09-04T16:30:10.236 INFO:tasks.workunit.client.1.smithi193.stdout:7/577: write d9/d39/d3e/d4d/d4f/f5d [913570,128696] 0 2024-09-04T16:30:10.236 INFO:tasks.workunit.client.1.smithi193.stdout:5/488: dwrite d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f91 [0,4194304] 0 2024-09-04T16:30:10.237 INFO:tasks.workunit.client.1.smithi193.stdout:5/489: dread - d1/d8/db/f56 zero size 2024-09-04T16:30:10.238 INFO:tasks.workunit.client.1.smithi193.stdout:7/578: chown d9/d39/d3e/d7d/ca9 95256061 1 2024-09-04T16:30:10.238 INFO:tasks.workunit.client.1.smithi193.stdout:3/492: creat d0/d18/d1b/d3d/fa8 x:0 0 0 2024-09-04T16:30:10.239 INFO:tasks.workunit.client.1.smithi193.stdout:3/493: readlink d0/d10/l5d 0 2024-09-04T16:30:10.240 INFO:tasks.workunit.client.0.smithi170.stdout:4/205: symlink d1/d6/d2b/d33/d36/l4c 0 2024-09-04T16:30:10.246 INFO:tasks.workunit.client.0.smithi170.stdout:8/95: creat d6/d10/f1d x:0 0 0 2024-09-04T16:30:10.250 INFO:tasks.workunit.client.1.smithi193.stdout:8/501: fdatasync d2/d20/d23/d51/d59/f6d 0 2024-09-04T16:30:10.255 INFO:tasks.workunit.client.0.smithi170.stdout:2/144: dwrite d3/d7/f1d [0,4194304] 0 2024-09-04T16:30:10.263 INFO:tasks.workunit.client.0.smithi170.stdout:2/145: dwrite d3/d4/f6 [4194304,4194304] 0 2024-09-04T16:30:10.264 INFO:tasks.workunit.client.1.smithi193.stdout:3/494: dread d0/f89 [0,4194304] 0 2024-09-04T16:30:10.264 INFO:tasks.workunit.client.0.smithi170.stdout:2/146: fdatasync d3/fe 0 2024-09-04T16:30:10.264 INFO:tasks.workunit.client.1.smithi193.stdout:3/495: stat d0/f47 0 2024-09-04T16:30:10.265 INFO:tasks.workunit.client.0.smithi170.stdout:3/109: rename d13/d14/d1d/f1e to d13/d14/d1d/f23 0 2024-09-04T16:30:10.266 INFO:tasks.workunit.client.0.smithi170.stdout:3/110: fsync d13/f18 0 2024-09-04T16:30:10.268 INFO:tasks.workunit.client.1.smithi193.stdout:2/452: fsync d2/d9/db/f21 0 2024-09-04T16:30:10.271 INFO:tasks.workunit.client.0.smithi170.stdout:7/291: rename d12/d15/f4a to d12/f66 0 2024-09-04T16:30:10.272 INFO:tasks.workunit.client.0.smithi170.stdout:5/109: sync 2024-09-04T16:30:10.272 INFO:tasks.workunit.client.0.smithi170.stdout:1/196: sync 2024-09-04T16:30:10.272 INFO:tasks.workunit.client.0.smithi170.stdout:6/168: sync 2024-09-04T16:30:10.274 INFO:tasks.workunit.client.1.smithi193.stdout:2/453: dwrite d2/d9/db/d10/d1e/f78 [0,4194304] 0 2024-09-04T16:30:10.274 INFO:tasks.workunit.client.0.smithi170.stdout:5/110: fsync d4/db/f20 0 2024-09-04T16:30:10.277 INFO:tasks.workunit.client.1.smithi193.stdout:5/490: mknod d1/d8/db/d36/d40/d46/c9b 0 2024-09-04T16:30:10.278 INFO:tasks.workunit.client.1.smithi193.stdout:5/491: chown d1/d29/l7c 120847535 1 2024-09-04T16:30:10.280 INFO:tasks.workunit.client.0.smithi170.stdout:8/96: creat d6/d10/f1e x:0 0 0 2024-09-04T16:30:10.282 INFO:tasks.workunit.client.0.smithi170.stdout:3/111: dwrite fb [0,4194304] 0 2024-09-04T16:30:10.289 INFO:tasks.workunit.client.0.smithi170.stdout:3/112: write d13/f19 [5059690,44286] 0 2024-09-04T16:30:10.290 INFO:tasks.workunit.client.1.smithi193.stdout:8/502: mkdir d2/d20/d23/d24/d3c/d65/d67/da0/da8 0 2024-09-04T16:30:10.290 INFO:tasks.workunit.client.0.smithi170.stdout:7/292: dwrite d12/d29/f3d [0,4194304] 0 2024-09-04T16:30:10.291 INFO:tasks.workunit.client.1.smithi193.stdout:8/503: read d2/d20/d23/d24/d3c/d65/f72 [2149941,30032] 0 2024-09-04T16:30:10.291 INFO:tasks.workunit.client.0.smithi170.stdout:3/113: read d13/f19 [7678683,51950] 0 2024-09-04T16:30:10.293 INFO:tasks.workunit.client.0.smithi170.stdout:3/114: fsync d13/f18 0 2024-09-04T16:30:10.294 INFO:tasks.workunit.client.0.smithi170.stdout:2/147: symlink d3/d4/l2e 0 2024-09-04T16:30:10.299 INFO:tasks.workunit.client.1.smithi193.stdout:4/394: symlink d3/d1a/l82 0 2024-09-04T16:30:10.300 INFO:tasks.workunit.client.0.smithi170.stdout:3/115: dread f10 [0,4194304] 0 2024-09-04T16:30:10.301 INFO:tasks.workunit.client.0.smithi170.stdout:5/111: dread d4/db/f1d [0,4194304] 0 2024-09-04T16:30:10.303 INFO:tasks.workunit.client.1.smithi193.stdout:3/496: dwrite d0/d18/d1c/d30/f41 [0,4194304] 0 2024-09-04T16:30:10.303 INFO:tasks.workunit.client.0.smithi170.stdout:0/231: rename d11/d2a/d43/l2c to d11/d13/d36/l51 0 2024-09-04T16:30:10.304 INFO:tasks.workunit.client.0.smithi170.stdout:3/116: chown d13/d14/d17/d1c 310770 1 2024-09-04T16:30:10.304 INFO:tasks.workunit.client.0.smithi170.stdout:2/148: dread d3/d4/f21 [0,4194304] 0 2024-09-04T16:30:10.305 INFO:tasks.workunit.client.0.smithi170.stdout:3/117: write d13/f1a [3731042,62695] 0 2024-09-04T16:30:10.306 INFO:tasks.workunit.client.0.smithi170.stdout:2/149: write d3/d4/f21 [1298808,88908] 0 2024-09-04T16:30:10.306 INFO:tasks.workunit.client.1.smithi193.stdout:5/492: creat d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/d55/f9c x:0 0 0 2024-09-04T16:30:10.318 INFO:tasks.workunit.client.1.smithi193.stdout:8/504: mknod d2/d20/d23/d34/d3e/d6f/d81/ca9 0 2024-09-04T16:30:10.321 INFO:tasks.workunit.client.1.smithi193.stdout:9/545: getdents d2/d18/d2f 0 2024-09-04T16:30:10.322 INFO:tasks.workunit.client.1.smithi193.stdout:9/546: fsync d2/d18/d2f/d22/d30/d6a/f7a 0 2024-09-04T16:30:10.323 INFO:tasks.workunit.client.1.smithi193.stdout:8/505: dread d2/d20/d23/d1b/d4e/f55 [0,4194304] 0 2024-09-04T16:30:10.326 INFO:tasks.workunit.client.1.smithi193.stdout:8/506: dread d2/f8 [0,4194304] 0 2024-09-04T16:30:10.331 INFO:tasks.workunit.client.0.smithi170.stdout:7/293: rename d12/d16/c39 to d12/d4b/d51/c67 0 2024-09-04T16:30:10.332 INFO:tasks.workunit.client.0.smithi170.stdout:7/294: stat d12/l33 0 2024-09-04T16:30:10.333 INFO:tasks.workunit.client.0.smithi170.stdout:3/118: symlink d13/d14/d1d/l24 0 2024-09-04T16:30:10.335 INFO:tasks.workunit.client.0.smithi170.stdout:2/150: truncate d3/db/f12 918074 0 2024-09-04T16:30:10.335 INFO:tasks.workunit.client.0.smithi170.stdout:2/151: chown d3/d4/l2e 4097 1 2024-09-04T16:30:10.336 INFO:tasks.workunit.client.0.smithi170.stdout:2/152: stat d3/d18/c1b 0 2024-09-04T16:30:10.339 INFO:tasks.workunit.client.1.smithi193.stdout:2/454: link d2/d9/db/f16 d2/d9/db/d10/d51/d87/fa0 0 2024-09-04T16:30:10.346 INFO:tasks.workunit.client.1.smithi193.stdout:2/455: stat d2/d9/f80 0 2024-09-04T16:30:10.347 INFO:tasks.workunit.client.1.smithi193.stdout:2/456: write d2/f5e [1486245,117103] 0 2024-09-04T16:30:10.348 INFO:tasks.workunit.client.1.smithi193.stdout:3/497: creat d0/d10/fa9 x:0 0 0 2024-09-04T16:30:10.351 INFO:tasks.workunit.client.1.smithi193.stdout:3/498: read d0/d18/d1c/d25/d5e/d7e/f7c [356032,99411] 0 2024-09-04T16:30:10.353 INFO:tasks.workunit.client.1.smithi193.stdout:2/457: dwrite d2/d9/db/d10/d4e/f8d [0,4194304] 0 2024-09-04T16:30:10.372 INFO:tasks.workunit.client.1.smithi193.stdout:1/511: mkdir d1/d2b/d1b/da0 0 2024-09-04T16:30:10.377 INFO:tasks.workunit.client.1.smithi193.stdout:1/512: dwrite d1/d39/d48/f96 [0,4194304] 0 2024-09-04T16:30:10.379 INFO:tasks.workunit.client.1.smithi193.stdout:1/513: rmdir d1/d2b/d1b 39 2024-09-04T16:30:10.382 INFO:tasks.workunit.client.1.smithi193.stdout:1/514: mkdir d1/d2b/db/d54/da1 0 2024-09-04T16:30:10.384 INFO:tasks.workunit.client.1.smithi193.stdout:1/515: write d1/d2b/d1b/d28/f75 [420561,30389] 0 2024-09-04T16:30:10.384 INFO:tasks.workunit.client.1.smithi193.stdout:6/450: truncate d5/ff 1951000 0 2024-09-04T16:30:10.387 INFO:tasks.workunit.client.1.smithi193.stdout:4/395: rename d3/d5f to d3/d1a/d2a/d83 0 2024-09-04T16:30:10.388 INFO:tasks.workunit.client.1.smithi193.stdout:4/396: chown d3/d39/d44 7 1 2024-09-04T16:30:10.389 INFO:tasks.workunit.client.1.smithi193.stdout:8/507: unlink d2/d20/f6a 0 2024-09-04T16:30:10.389 INFO:tasks.workunit.client.1.smithi193.stdout:6/451: creat d5/d33/d85/f94 x:0 0 0 2024-09-04T16:30:10.391 INFO:tasks.workunit.client.1.smithi193.stdout:1/516: rmdir d1/d83 0 2024-09-04T16:30:10.393 INFO:tasks.workunit.client.1.smithi193.stdout:6/452: creat d5/de/d15/d1b/f95 x:0 0 0 2024-09-04T16:30:10.396 INFO:tasks.workunit.client.1.smithi193.stdout:6/453: read - d5/d33/d4e/d51/f66 zero size 2024-09-04T16:30:10.399 INFO:tasks.workunit.client.1.smithi193.stdout:1/517: dwrite d1/d2b/d10/f59 [0,4194304] 0 2024-09-04T16:30:10.399 INFO:tasks.workunit.client.1.smithi193.stdout:6/454: read - d5/f44 zero size 2024-09-04T16:30:10.400 INFO:tasks.workunit.client.1.smithi193.stdout:0/491: dwrite d18/f38 [0,4194304] 0 2024-09-04T16:30:10.401 INFO:tasks.workunit.client.1.smithi193.stdout:1/518: chown d1/d2b/db/f8f 31091 1 2024-09-04T16:30:10.401 INFO:tasks.workunit.client.1.smithi193.stdout:6/455: write d5/de/d15/f24 [810171,70106] 0 2024-09-04T16:30:10.403 INFO:tasks.workunit.client.1.smithi193.stdout:7/579: truncate d9/f19 2241720 0 2024-09-04T16:30:10.406 INFO:tasks.workunit.client.1.smithi193.stdout:1/519: write d1/d2b/db/f82 [2093458,94835] 0 2024-09-04T16:30:10.406 INFO:tasks.workunit.client.1.smithi193.stdout:1/520: read d1/d2b/d10/f59 [954111,49057] 0 2024-09-04T16:30:10.411 INFO:tasks.workunit.client.1.smithi193.stdout:6/456: dwrite d5/fb [0,4194304] 0 2024-09-04T16:30:10.413 INFO:tasks.workunit.client.1.smithi193.stdout:5/493: rename d1/d8/db/d15/d2b/d83/f76 to d1/d8/db/d15/d2b/d83/d37/f9d 0 2024-09-04T16:30:10.415 INFO:tasks.workunit.client.1.smithi193.stdout:7/580: rmdir d9/d39/d3e/d4d/d98/d9a/db6/dc2 0 2024-09-04T16:30:10.416 INFO:tasks.workunit.client.1.smithi193.stdout:1/521: dwrite d1/d2b/d1b/d28/f75 [0,4194304] 0 2024-09-04T16:30:10.417 INFO:tasks.workunit.client.1.smithi193.stdout:6/457: dread d5/de/d15/d1b/f1e [0,4194304] 0 2024-09-04T16:30:10.418 INFO:tasks.workunit.client.1.smithi193.stdout:2/458: rename d2/d9/d18/c2b to d2/d9/db/d10/d1e/d56/d59/ca1 0 2024-09-04T16:30:10.420 INFO:tasks.workunit.client.1.smithi193.stdout:5/494: mkdir d1/d8/db/d15/d2b/d83/d37/d58/d9e 0 2024-09-04T16:30:10.421 INFO:tasks.workunit.client.1.smithi193.stdout:5/495: chown d1/d29/d18/d42/c5f 6 1 2024-09-04T16:30:10.422 INFO:tasks.workunit.client.1.smithi193.stdout:7/581: fdatasync d9/d39/d3e/d69/f82 0 2024-09-04T16:30:10.423 INFO:tasks.workunit.client.1.smithi193.stdout:7/582: dread - d9/d39/fa1 zero size 2024-09-04T16:30:10.428 INFO:tasks.workunit.client.1.smithi193.stdout:1/522: creat d1/d2b/d1b/d28/d50/d84/d97/fa2 x:0 0 0 2024-09-04T16:30:10.429 INFO:tasks.workunit.client.1.smithi193.stdout:7/583: creat d9/d39/fc6 x:0 0 0 2024-09-04T16:30:10.430 INFO:tasks.workunit.client.1.smithi193.stdout:7/584: chown d9/d39/d3e/d53/fa5 15340 1 2024-09-04T16:30:10.431 INFO:tasks.workunit.client.1.smithi193.stdout:7/585: readlink d9/d39/d3e/d4d/l6b 0 2024-09-04T16:30:10.431 INFO:tasks.workunit.client.1.smithi193.stdout:7/586: dread - d9/d39/f8b zero size 2024-09-04T16:30:10.432 INFO:tasks.workunit.client.1.smithi193.stdout:4/397: rename d3/d3c/c63 to d3/c84 0 2024-09-04T16:30:10.434 INFO:tasks.workunit.client.0.smithi170.stdout:1/197: mknod d9/d11/d3e/c40 0 2024-09-04T16:30:10.434 INFO:tasks.workunit.client.0.smithi170.stdout:8/97: mknod d6/d10/d16/c1f 0 2024-09-04T16:30:10.434 INFO:tasks.workunit.client.0.smithi170.stdout:0/232: rename d11/d2a/d43/l1b to d11/d2a/l52 0 2024-09-04T16:30:10.435 INFO:tasks.workunit.client.0.smithi170.stdout:3/119: creat d13/f25 x:0 0 0 2024-09-04T16:30:10.435 INFO:tasks.workunit.client.1.smithi193.stdout:1/523: truncate d1/d2b/d1b/d28/d50/f5d 415530 0 2024-09-04T16:30:10.437 INFO:tasks.workunit.client.0.smithi170.stdout:9/200: write d2/d7/f20 [1771195,19009] 0 2024-09-04T16:30:10.438 INFO:tasks.workunit.client.0.smithi170.stdout:4/206: truncate d1/d6/d8/d20/f25 99944 0 2024-09-04T16:30:10.439 INFO:tasks.workunit.client.1.smithi193.stdout:4/398: write d3/d1a/d54/f7a [4151638,104202] 0 2024-09-04T16:30:10.439 INFO:tasks.workunit.client.0.smithi170.stdout:6/169: truncate d0/d17/f1c 2090476 0 2024-09-04T16:30:10.440 INFO:tasks.workunit.client.0.smithi170.stdout:2/153: mknod d3/d18/c2f 0 2024-09-04T16:30:10.440 INFO:tasks.workunit.client.1.smithi193.stdout:1/524: dread d1/d2b/d10/f25 [0,4194304] 0 2024-09-04T16:30:10.441 INFO:tasks.workunit.client.0.smithi170.stdout:4/207: write d1/d6/d8/d3b/f45 [805231,58632] 0 2024-09-04T16:30:10.442 INFO:tasks.workunit.client.1.smithi193.stdout:6/458: getdents d5/d33/d4e/d51/d71/d82/d88 0 2024-09-04T16:30:10.443 INFO:tasks.workunit.client.0.smithi170.stdout:0/233: creat d11/d2a/f53 x:0 0 0 2024-09-04T16:30:10.443 INFO:tasks.workunit.client.1.smithi193.stdout:9/547: dwrite d2/d8/d15/f35 [0,4194304] 0 2024-09-04T16:30:10.443 INFO:tasks.workunit.client.1.smithi193.stdout:7/587: creat d9/d18/d22/d2b/da6/fc7 x:0 0 0 2024-09-04T16:30:10.444 INFO:tasks.workunit.client.0.smithi170.stdout:8/98: mkdir d6/d10/d20 0 2024-09-04T16:30:10.445 INFO:tasks.workunit.client.0.smithi170.stdout:1/198: dwrite d9/f27 [0,4194304] 0 2024-09-04T16:30:10.446 INFO:tasks.workunit.client.0.smithi170.stdout:8/99: write d6/d10/f1e [338361,2087] 0 2024-09-04T16:30:10.448 INFO:tasks.workunit.client.0.smithi170.stdout:1/199: truncate d9/d11/f3d 155862 0 2024-09-04T16:30:10.449 INFO:tasks.workunit.client.1.smithi193.stdout:6/459: dwrite d5/d27/d3e/d43/f57 [0,4194304] 0 2024-09-04T16:30:10.450 INFO:tasks.workunit.client.0.smithi170.stdout:3/120: mknod d13/d14/d1d/c26 0 2024-09-04T16:30:10.452 INFO:tasks.workunit.client.0.smithi170.stdout:1/200: truncate d9/d11/d2f/f3b 587079 0 2024-09-04T16:30:10.454 INFO:tasks.workunit.client.1.smithi193.stdout:7/588: creat d9/d85/fc8 x:0 0 0 2024-09-04T16:30:10.456 INFO:tasks.workunit.client.0.smithi170.stdout:2/154: rmdir d3/d18/d24 39 2024-09-04T16:30:10.456 INFO:tasks.workunit.client.1.smithi193.stdout:7/589: chown d9/d18/d22/d2b/d96 45228 1 2024-09-04T16:30:10.459 INFO:tasks.workunit.client.1.smithi193.stdout:9/548: dread d2/d18/d2f/f45 [0,4194304] 0 2024-09-04T16:30:10.460 INFO:tasks.workunit.client.0.smithi170.stdout:7/295: dwrite d12/d15/f28 [4194304,4194304] 0 2024-09-04T16:30:10.460 INFO:tasks.workunit.client.1.smithi193.stdout:4/399: mknod d3/d1a/d21/d52/d7f/c85 0 2024-09-04T16:30:10.461 INFO:tasks.workunit.client.1.smithi193.stdout:4/400: chown d3/d1a/d2a/d83/f75 2 1 2024-09-04T16:30:10.461 INFO:tasks.workunit.client.1.smithi193.stdout:9/549: read d2/d18/d2f/d22/d30/d6a/f79 [495331,98293] 0 2024-09-04T16:30:10.462 INFO:tasks.workunit.client.0.smithi170.stdout:7/296: chown d12/d5a/c4e 1035 1 2024-09-04T16:30:10.462 INFO:tasks.workunit.client.0.smithi170.stdout:4/208: creat d1/d6/d2b/d33/f4d x:0 0 0 2024-09-04T16:30:10.463 INFO:tasks.workunit.client.1.smithi193.stdout:3/499: write d0/d9/d49/d7b/f82 [957187,16657] 0 2024-09-04T16:30:10.464 INFO:tasks.workunit.client.0.smithi170.stdout:4/209: stat d1/d6/ff 0 2024-09-04T16:30:10.465 INFO:tasks.workunit.client.1.smithi193.stdout:6/460: rename d5/d27/d3e/d43/f61 to d5/d27/d3e/d43/f96 0 2024-09-04T16:30:10.467 INFO:tasks.workunit.client.0.smithi170.stdout:0/234: unlink f0 0 2024-09-04T16:30:10.468 INFO:tasks.workunit.client.0.smithi170.stdout:2/155: dwrite d3/db/d1c/f2a [0,4194304] 0 2024-09-04T16:30:10.469 INFO:tasks.workunit.client.1.smithi193.stdout:0/492: unlink d18/d25/c8b 0 2024-09-04T16:30:10.469 INFO:tasks.workunit.client.0.smithi170.stdout:2/156: dread - d3/d4/f20 zero size 2024-09-04T16:30:10.470 INFO:tasks.workunit.client.1.smithi193.stdout:0/493: dread - d18/d25/d32/d57/d6d/f93 zero size 2024-09-04T16:30:10.473 INFO:tasks.workunit.client.0.smithi170.stdout:3/121: creat d13/d14/d1d/f27 x:0 0 0 2024-09-04T16:30:10.474 INFO:tasks.workunit.client.0.smithi170.stdout:1/201: rmdir d9/d11 39 2024-09-04T16:30:10.475 INFO:tasks.workunit.client.0.smithi170.stdout:0/235: dwrite d11/d13/f28 [0,4194304] 0 2024-09-04T16:30:10.483 INFO:tasks.workunit.client.0.smithi170.stdout:8/100: symlink d6/l21 0 2024-09-04T16:30:10.485 INFO:tasks.workunit.client.1.smithi193.stdout:6/461: mkdir d5/d27/d3e/d43/d5d/d97 0 2024-09-04T16:30:10.485 INFO:tasks.workunit.client.0.smithi170.stdout:7/297: dwrite d12/d15/f2f [0,4194304] 0 2024-09-04T16:30:10.485 INFO:tasks.workunit.client.1.smithi193.stdout:6/462: fdatasync d5/de/d15/d1b/f79 0 2024-09-04T16:30:10.487 INFO:tasks.workunit.client.0.smithi170.stdout:4/210: rename d1/d6/d8/d3b to d1/d6/d8/d20/d35/d3e/d4e 0 2024-09-04T16:30:10.490 INFO:tasks.workunit.client.1.smithi193.stdout:6/463: dread d5/de/d15/d48/f4b [0,4194304] 0 2024-09-04T16:30:10.490 INFO:tasks.workunit.client.1.smithi193.stdout:8/508: truncate d2/f8 1776767 0 2024-09-04T16:30:10.490 INFO:tasks.workunit.client.1.smithi193.stdout:0/494: write d18/d25/d32/d57/f84 [139734,79762] 0 2024-09-04T16:30:10.498 INFO:tasks.workunit.client.1.smithi193.stdout:8/509: dwrite d2/d20/d23/d34/d46/d53/f97 [0,4194304] 0 2024-09-04T16:30:10.500 INFO:tasks.workunit.client.0.smithi170.stdout:8/101: rmdir d6/d10/d1a 39 2024-09-04T16:30:10.505 INFO:tasks.workunit.client.0.smithi170.stdout:7/298: fdatasync d12/d15/d34/f4c 0 2024-09-04T16:30:10.507 INFO:tasks.workunit.client.0.smithi170.stdout:7/299: write d12/d15/d34/f4c [723683,116214] 0 2024-09-04T16:30:10.508 INFO:tasks.workunit.client.0.smithi170.stdout:8/102: dwrite d6/d10/f1e [0,4194304] 0 2024-09-04T16:30:10.508 INFO:tasks.workunit.client.1.smithi193.stdout:2/459: write d2/d9/db/d10/d38/f70 [2842441,29433] 0 2024-09-04T16:30:10.509 INFO:tasks.workunit.client.1.smithi193.stdout:2/460: write d2/d9/db/d10/d1e/d26/f3a [4199394,56792] 0 2024-09-04T16:30:10.510 INFO:tasks.workunit.client.0.smithi170.stdout:8/103: write d6/fa [1865320,49264] 0 2024-09-04T16:30:10.510 INFO:tasks.workunit.client.0.smithi170.stdout:6/170: getdents d0/d17/d25/d2d 0 2024-09-04T16:30:10.511 INFO:tasks.workunit.client.0.smithi170.stdout:8/104: chown d6/d10/f1e 481780566 1 2024-09-04T16:30:10.512 INFO:tasks.workunit.client.0.smithi170.stdout:8/105: truncate d6/d10/f1d 139086 0 2024-09-04T16:30:10.513 INFO:tasks.workunit.client.0.smithi170.stdout:8/106: fdatasync d6/d10/f1d 0 2024-09-04T16:30:10.514 INFO:tasks.workunit.client.1.smithi193.stdout:4/401: creat d3/f86 x:0 0 0 2024-09-04T16:30:10.515 INFO:tasks.workunit.client.1.smithi193.stdout:4/402: fsync d3/d39/d44/f6a 0 2024-09-04T16:30:10.516 INFO:tasks.workunit.client.1.smithi193.stdout:5/496: truncate d1/d8/db/d15/d2b/d83/d37/f67 3627777 0 2024-09-04T16:30:10.520 INFO:tasks.workunit.client.1.smithi193.stdout:3/500: link d0/d18/d1c/d30/f41 d0/d7/de/faa 0 2024-09-04T16:30:10.522 INFO:tasks.workunit.client.0.smithi170.stdout:7/300: write d12/d15/d41/f64 [2889157,130670] 0 2024-09-04T16:30:10.522 INFO:tasks.workunit.client.0.smithi170.stdout:7/301: stat d12/d15/d41/c58 0 2024-09-04T16:30:10.523 INFO:tasks.workunit.client.1.smithi193.stdout:3/501: read d0/d18/f50 [3536656,105627] 0 2024-09-04T16:30:10.523 INFO:tasks.workunit.client.1.smithi193.stdout:6/464: truncate d5/de/d15/f2f 2987770 0 2024-09-04T16:30:10.527 INFO:tasks.workunit.client.0.smithi170.stdout:8/107: rename d6/d10/d16/c1f to d6/d10/d16/c22 0 2024-09-04T16:30:10.528 INFO:tasks.workunit.client.1.smithi193.stdout:2/461: mknod d2/d9/d61/ca2 0 2024-09-04T16:30:10.530 INFO:tasks.workunit.client.1.smithi193.stdout:2/462: chown d2/d9/d18/f28 6 1 2024-09-04T16:30:10.531 INFO:tasks.workunit.client.1.smithi193.stdout:1/525: dwrite d1/d2b/d10/f21 [0,4194304] 0 2024-09-04T16:30:10.532 INFO:tasks.workunit.client.1.smithi193.stdout:9/550: getdents d2/d8 0 2024-09-04T16:30:10.534 INFO:tasks.workunit.client.0.smithi170.stdout:6/171: symlink d0/d17/d2a/d30/l3b 0 2024-09-04T16:30:10.539 INFO:tasks.workunit.client.1.smithi193.stdout:7/590: dwrite d9/d18/f4c [0,4194304] 0 2024-09-04T16:30:10.540 INFO:tasks.workunit.client.0.smithi170.stdout:6/172: dwrite d0/df/d1b/f29 [0,4194304] 0 2024-09-04T16:30:10.580 INFO:tasks.workunit.client.1.smithi193.stdout:3/502: unlink d0/d9/d49/d7b/f82 0 2024-09-04T16:30:10.583 INFO:tasks.workunit.client.0.smithi170.stdout:2/157: rename d3/db/f12 to d3/d18/f30 0 2024-09-04T16:30:10.586 INFO:tasks.workunit.client.1.smithi193.stdout:6/465: creat d5/de/d15/d48/f98 x:0 0 0 2024-09-04T16:30:10.586 INFO:tasks.workunit.client.0.smithi170.stdout:7/302: mkdir d12/d15/d68 0 2024-09-04T16:30:10.588 INFO:tasks.workunit.client.1.smithi193.stdout:0/495: creat d18/d25/d32/d57/fa5 x:0 0 0 2024-09-04T16:30:10.589 INFO:tasks.workunit.client.1.smithi193.stdout:0/496: fdatasync d18/d25/d5f/f81 0 2024-09-04T16:30:10.592 INFO:tasks.workunit.client.1.smithi193.stdout:7/591: read d9/d39/d3e/d4d/f6a [92464,130990] 0 2024-09-04T16:30:10.593 INFO:tasks.workunit.client.1.smithi193.stdout:4/403: rename d3/d3c/d47/c49 to d3/d1a/d21/c87 0 2024-09-04T16:30:10.596 INFO:tasks.workunit.client.0.smithi170.stdout:6/173: symlink d0/d17/d25/d2d/d2e/l3c 0 2024-09-04T16:30:10.599 INFO:tasks.workunit.client.0.smithi170.stdout:2/158: symlink d3/d7/l31 0 2024-09-04T16:30:10.601 INFO:tasks.workunit.client.0.smithi170.stdout:3/122: rename d13/f18 to d13/d14/d1d/f28 0 2024-09-04T16:30:10.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:10 smithi170 ceph-mon[29272]: pgmap v25: 65 pgs: 65 active+clean; 1.2 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 31 MiB/s rd, 152 MiB/s wr, 296 op/s 2024-09-04T16:30:10.601 INFO:tasks.workunit.client.0.smithi170.stdout:0/236: write d11/d13/d2f/f33 [2942268,81652] 0 2024-09-04T16:30:10.602 INFO:tasks.workunit.client.1.smithi193.stdout:5/497: mknod d1/d8/db/c9f 0 2024-09-04T16:30:10.603 INFO:tasks.workunit.client.0.smithi170.stdout:7/303: mkdir d12/d29/d5c/d69 0 2024-09-04T16:30:10.605 INFO:tasks.workunit.client.0.smithi170.stdout:8/108: link d6/fb d6/d10/d1a/f23 0 2024-09-04T16:30:10.609 INFO:tasks.workunit.client.0.smithi170.stdout:8/109: dread d6/f15 [0,4194304] 0 2024-09-04T16:30:10.609 INFO:tasks.workunit.client.0.smithi170.stdout:1/202: rename d9/d11/d2f/l3c to d9/d11/d3e/l41 0 2024-09-04T16:30:10.610 INFO:tasks.workunit.client.0.smithi170.stdout:2/159: rename d3 to d3/db/d32 22 2024-09-04T16:30:10.615 INFO:tasks.workunit.client.0.smithi170.stdout:7/304: chown d12/d4b/d51/c67 9 1 2024-09-04T16:30:10.622 INFO:tasks.workunit.client.0.smithi170.stdout:8/110: write d6/fb [3384854,113098] 0 2024-09-04T16:30:10.623 INFO:tasks.workunit.client.1.smithi193.stdout:7/592: unlink d9/d18/d22/d2b/d6c/d70/c92 0 2024-09-04T16:30:10.623 INFO:tasks.workunit.client.0.smithi170.stdout:8/111: write d6/d10/d1a/f23 [5005547,103841] 0 2024-09-04T16:30:10.624 INFO:tasks.workunit.client.0.smithi170.stdout:1/203: mknod d9/d26/c42 0 2024-09-04T16:30:10.625 INFO:tasks.workunit.client.1.smithi193.stdout:7/593: chown d9/d18/d1e/f29 403 1 2024-09-04T16:30:10.625 INFO:tasks.workunit.client.1.smithi193.stdout:0/497: dwrite d18/d25/d5f/d6a/d7b/f94 [0,4194304] 0 2024-09-04T16:30:10.626 INFO:tasks.workunit.client.0.smithi170.stdout:2/160: mkdir d3/db/d1c/d33 0 2024-09-04T16:30:10.626 INFO:tasks.workunit.client.0.smithi170.stdout:2/161: chown d3/d4 2 1 2024-09-04T16:30:10.626 INFO:tasks.workunit.client.1.smithi193.stdout:0/498: chown f15 8 1 2024-09-04T16:30:10.636 INFO:tasks.workunit.client.0.smithi170.stdout:7/305: dwrite d12/d15/d41/f45 [0,4194304] 0 2024-09-04T16:30:10.638 INFO:tasks.workunit.client.1.smithi193.stdout:8/510: sync 2024-09-04T16:30:10.642 INFO:tasks.workunit.client.1.smithi193.stdout:1/526: write d1/d2b/db/f3e [598693,114665] 0 2024-09-04T16:30:10.642 INFO:tasks.workunit.client.1.smithi193.stdout:1/527: stat d1/d2b/db/f8f 0 2024-09-04T16:30:10.648 INFO:tasks.workunit.client.0.smithi170.stdout:7/306: rename d12/l17 to d12/d29/l6a 0 2024-09-04T16:30:10.649 INFO:tasks.workunit.client.0.smithi170.stdout:7/307: write d12/f14 [4364455,122700] 0 2024-09-04T16:30:10.650 INFO:tasks.workunit.client.0.smithi170.stdout:1/204: fsync d9/d11/f1e 0 2024-09-04T16:30:10.651 INFO:tasks.workunit.client.1.smithi193.stdout:7/594: stat d9/de/d27/l59 0 2024-09-04T16:30:10.651 INFO:tasks.workunit.client.1.smithi193.stdout:7/595: stat d9/d11/l21 0 2024-09-04T16:30:10.652 INFO:tasks.workunit.client.0.smithi170.stdout:0/237: getdents d11/d2a 0 2024-09-04T16:30:10.652 INFO:tasks.workunit.client.0.smithi170.stdout:1/205: dread d9/d11/d2f/f3b [0,4194304] 0 2024-09-04T16:30:10.654 INFO:tasks.workunit.client.1.smithi193.stdout:0/499: mkdir d18/d25/d5f/d65/d9f/da6 0 2024-09-04T16:30:10.655 INFO:tasks.workunit.client.1.smithi193.stdout:0/500: write d18/d25/f4d [2014137,25962] 0 2024-09-04T16:30:10.655 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:10 smithi193 ceph-mon[36288]: pgmap v25: 65 pgs: 65 active+clean; 1.2 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 31 MiB/s rd, 152 MiB/s wr, 296 op/s 2024-09-04T16:30:10.656 INFO:tasks.workunit.client.1.smithi193.stdout:2/463: link d2/d9/d18/l4d d2/d9/db/d10/d51/la3 0 2024-09-04T16:30:10.656 INFO:tasks.workunit.client.1.smithi193.stdout:2/464: chown d2/d9/db/d10/d51/d79/l92 730358211 1 2024-09-04T16:30:10.657 INFO:tasks.workunit.client.0.smithi170.stdout:7/308: creat d12/d49/f6b x:0 0 0 2024-09-04T16:30:10.658 INFO:tasks.workunit.client.0.smithi170.stdout:7/309: write d12/f52 [792228,101838] 0 2024-09-04T16:30:10.659 INFO:tasks.workunit.client.1.smithi193.stdout:8/511: creat d2/d20/d23/d34/d3e/d6f/d81/faa x:0 0 0 2024-09-04T16:30:10.659 INFO:tasks.workunit.client.0.smithi170.stdout:7/310: chown d12/d16/d1d/f47 25653 1 2024-09-04T16:30:10.662 INFO:tasks.workunit.client.1.smithi193.stdout:1/528: chown d1/d2b/d10/l37 15507 1 2024-09-04T16:30:10.662 INFO:tasks.workunit.client.0.smithi170.stdout:1/206: write d9/f13 [589672,87925] 0 2024-09-04T16:30:10.662 INFO:tasks.workunit.client.1.smithi193.stdout:6/466: link d5/f44 d5/de/d15/d1b/f99 0 2024-09-04T16:30:10.663 INFO:tasks.workunit.client.0.smithi170.stdout:1/207: dread - d9/d26/f36 zero size 2024-09-04T16:30:10.663 INFO:tasks.workunit.client.0.smithi170.stdout:0/238: truncate d11/f18 5239841 0 2024-09-04T16:30:10.665 INFO:tasks.workunit.client.1.smithi193.stdout:8/512: dwrite d2/d20/d23/d1b/f33 [4194304,4194304] 0 2024-09-04T16:30:10.665 INFO:tasks.workunit.client.1.smithi193.stdout:3/503: rename d0/d9/d49/d7b to d0/d18/d1b/dab 0 2024-09-04T16:30:10.666 INFO:tasks.workunit.client.1.smithi193.stdout:8/513: readlink d2/d20/d23/d24/l70 0 2024-09-04T16:30:10.666 INFO:tasks.workunit.client.0.smithi170.stdout:8/112: getdents d6/d10 0 2024-09-04T16:30:10.666 INFO:tasks.workunit.client.1.smithi193.stdout:8/514: read - d2/d20/d23/d51/f63 zero size 2024-09-04T16:30:10.670 INFO:tasks.workunit.client.1.smithi193.stdout:4/404: creat d3/d3c/f88 x:0 0 0 2024-09-04T16:30:10.672 INFO:tasks.workunit.client.1.smithi193.stdout:9/551: truncate d2/d4/f7 1027792 0 2024-09-04T16:30:10.675 INFO:tasks.workunit.client.0.smithi170.stdout:1/208: rename d9/d11/f32 to d9/d11/f43 0 2024-09-04T16:30:10.677 INFO:tasks.workunit.client.0.smithi170.stdout:8/113: mkdir d6/d10/d16/d24 0 2024-09-04T16:30:10.677 INFO:tasks.workunit.client.1.smithi193.stdout:9/552: dwrite d2/d8/d15/f62 [0,4194304] 0 2024-09-04T16:30:10.678 INFO:tasks.workunit.client.0.smithi170.stdout:8/114: write d6/d10/f1e [3619033,13200] 0 2024-09-04T16:30:10.680 INFO:tasks.workunit.client.1.smithi193.stdout:0/501: dwrite d18/f20 [0,4194304] 0 2024-09-04T16:30:10.682 INFO:tasks.workunit.client.1.smithi193.stdout:1/529: mkdir d1/da3 0 2024-09-04T16:30:10.683 INFO:tasks.workunit.client.0.smithi170.stdout:0/239: unlink d11/l2d 0 2024-09-04T16:30:10.689 INFO:tasks.workunit.client.1.smithi193.stdout:3/504: creat d0/d18/d1c/d30/fac x:0 0 0 2024-09-04T16:30:10.691 INFO:tasks.workunit.client.1.smithi193.stdout:8/515: rmdir d2/d20 39 2024-09-04T16:30:10.694 INFO:tasks.workunit.client.0.smithi170.stdout:7/311: rmdir d12/d29/d5c/d69 0 2024-09-04T16:30:10.695 INFO:tasks.workunit.client.1.smithi193.stdout:7/596: truncate d9/f19 2024563 0 2024-09-04T16:30:10.695 INFO:tasks.workunit.client.1.smithi193.stdout:7/597: write d9/d39/d3e/d53/fa5 [1173082,10869] 0 2024-09-04T16:30:10.696 INFO:tasks.workunit.client.0.smithi170.stdout:0/240: unlink d11/d2a/d43/l1f 0 2024-09-04T16:30:10.702 INFO:tasks.workunit.client.1.smithi193.stdout:9/553: unlink d2/d8/d4d/c53 0 2024-09-04T16:30:10.703 INFO:tasks.workunit.client.0.smithi170.stdout:8/115: getdents d6/d10/d20 0 2024-09-04T16:30:10.703 INFO:tasks.workunit.client.1.smithi193.stdout:9/554: chown d2/d56/d86/c90 0 1 2024-09-04T16:30:10.704 INFO:tasks.workunit.client.0.smithi170.stdout:7/312: symlink d12/d29/l6c 0 2024-09-04T16:30:10.705 INFO:tasks.workunit.client.0.smithi170.stdout:0/241: mknod d11/d13/d36/c54 0 2024-09-04T16:30:10.706 INFO:tasks.workunit.client.1.smithi193.stdout:6/467: mknod d5/de/d15/c9a 0 2024-09-04T16:30:10.710 INFO:tasks.workunit.client.0.smithi170.stdout:0/242: dwrite d11/d13/d36/f40 [0,4194304] 0 2024-09-04T16:30:10.711 INFO:tasks.workunit.client.1.smithi193.stdout:8/516: truncate d2/d20/d23/d34/d46/d53/f97 4896062 0 2024-09-04T16:30:10.711 INFO:tasks.workunit.client.0.smithi170.stdout:7/313: creat d12/d29/d5c/f6d x:0 0 0 2024-09-04T16:30:10.711 INFO:tasks.workunit.client.0.smithi170.stdout:0/243: chown d11/d13/d2f 1 1 2024-09-04T16:30:10.713 INFO:tasks.workunit.client.1.smithi193.stdout:4/405: mkdir d3/d3c/d89 0 2024-09-04T16:30:10.714 INFO:tasks.workunit.client.1.smithi193.stdout:4/406: write d3/d1a/d21/f37 [892113,33152] 0 2024-09-04T16:30:10.718 INFO:tasks.workunit.client.0.smithi170.stdout:8/116: rename d6/cf to d6/d10/d16/c25 0 2024-09-04T16:30:10.718 INFO:tasks.workunit.client.0.smithi170.stdout:1/209: write d9/f37 [345318,1967] 0 2024-09-04T16:30:10.720 INFO:tasks.workunit.client.0.smithi170.stdout:0/244: mknod d11/d13/d35/c55 0 2024-09-04T16:30:10.721 INFO:tasks.workunit.client.1.smithi193.stdout:0/502: creat d18/d25/d5f/d65/d9f/da0/fa7 x:0 0 0 2024-09-04T16:30:10.723 INFO:tasks.workunit.client.1.smithi193.stdout:7/598: dwrite d9/d11/f4e [0,4194304] 0 2024-09-04T16:30:10.724 INFO:tasks.workunit.client.1.smithi193.stdout:7/599: chown d9/d39/d3e/d53/l65 8966 1 2024-09-04T16:30:10.725 INFO:tasks.workunit.client.0.smithi170.stdout:8/117: dread d6/d10/f1e [0,4194304] 0 2024-09-04T16:30:10.726 INFO:tasks.workunit.client.0.smithi170.stdout:1/210: dwrite d9/f10 [0,4194304] 0 2024-09-04T16:30:10.726 INFO:tasks.workunit.client.1.smithi193.stdout:1/530: mknod d1/d2b/d10/d56/ca4 0 2024-09-04T16:30:10.727 INFO:tasks.workunit.client.1.smithi193.stdout:1/531: write d1/d2b/d10/f1f [4460619,123021] 0 2024-09-04T16:30:10.728 INFO:tasks.workunit.client.1.smithi193.stdout:1/532: dread - d1/d2b/d10/f91 zero size 2024-09-04T16:30:10.730 INFO:tasks.workunit.client.1.smithi193.stdout:1/533: write d1/d2b/d1b/d51/d6d/f98 [424790,63006] 0 2024-09-04T16:30:10.734 INFO:tasks.workunit.client.1.smithi193.stdout:6/468: creat d5/d27/f9b x:0 0 0 2024-09-04T16:30:10.739 INFO:tasks.workunit.client.1.smithi193.stdout:8/517: unlink d2/d20/d23/d34/d46/f5e 0 2024-09-04T16:30:10.742 INFO:tasks.workunit.client.1.smithi193.stdout:9/555: write d2/d8/d4d/f69 [586955,85609] 0 2024-09-04T16:30:10.744 INFO:tasks.workunit.client.1.smithi193.stdout:0/503: readlink d18/l76 0 2024-09-04T16:30:10.745 INFO:tasks.workunit.client.0.smithi170.stdout:0/245: write f4 [1716503,90427] 0 2024-09-04T16:30:10.746 INFO:tasks.workunit.client.0.smithi170.stdout:8/118: mkdir d6/d26 0 2024-09-04T16:30:10.746 INFO:tasks.workunit.client.0.smithi170.stdout:7/314: truncate d12/d29/f2a 3272643 0 2024-09-04T16:30:10.752 INFO:tasks.workunit.client.1.smithi193.stdout:6/469: creat d5/d33/d4e/d51/d71/d82/f9c x:0 0 0 2024-09-04T16:30:10.753 INFO:tasks.workunit.client.1.smithi193.stdout:5/498: rename d1/d8/db/d36/c3b to d1/d8/db/ca0 0 2024-09-04T16:30:10.755 INFO:tasks.workunit.client.1.smithi193.stdout:5/499: dread - d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f90 zero size 2024-09-04T16:30:10.755 INFO:tasks.workunit.client.0.smithi170.stdout:0/246: dread f3 [0,4194304] 0 2024-09-04T16:30:10.756 INFO:tasks.workunit.client.1.smithi193.stdout:8/518: creat d2/d20/d23/d34/d46/d69/fab x:0 0 0 2024-09-04T16:30:10.756 INFO:tasks.workunit.client.0.smithi170.stdout:7/315: dread fc [4194304,4194304] 0 2024-09-04T16:30:10.756 INFO:tasks.workunit.client.0.smithi170.stdout:7/316: stat fa 0 2024-09-04T16:30:10.757 INFO:tasks.workunit.client.0.smithi170.stdout:7/317: write d12/f14 [5005603,119356] 0 2024-09-04T16:30:10.757 INFO:tasks.workunit.client.0.smithi170.stdout:8/119: mknod d6/d10/d16/d24/c27 0 2024-09-04T16:30:10.760 INFO:tasks.workunit.client.0.smithi170.stdout:1/211: truncate d9/d11/f3a 2531958 0 2024-09-04T16:30:10.764 INFO:tasks.workunit.client.1.smithi193.stdout:9/556: symlink d2/d8/d25/laa 0 2024-09-04T16:30:10.767 INFO:tasks.workunit.client.0.smithi170.stdout:1/212: dwrite d9/d26/f36 [0,4194304] 0 2024-09-04T16:30:10.769 INFO:tasks.workunit.client.0.smithi170.stdout:8/120: unlink d6/l21 0 2024-09-04T16:30:10.769 INFO:tasks.workunit.client.1.smithi193.stdout:9/557: dwrite d2/d8/d15/f35 [0,4194304] 0 2024-09-04T16:30:10.770 INFO:tasks.workunit.client.0.smithi170.stdout:8/121: stat d6/d10/l19 0 2024-09-04T16:30:10.770 INFO:tasks.workunit.client.1.smithi193.stdout:5/500: dread d1/d29/d18/d42/f51 [0,4194304] 0 2024-09-04T16:30:10.770 INFO:tasks.workunit.client.1.smithi193.stdout:4/407: truncate d3/d1a/f3d 2883795 0 2024-09-04T16:30:10.773 INFO:tasks.workunit.client.0.smithi170.stdout:0/247: link d11/d13/d2f/f31 d11/d2a/f56 0 2024-09-04T16:30:10.774 INFO:tasks.workunit.client.0.smithi170.stdout:0/248: chown d11/d2a/d43/f2e 31312644 1 2024-09-04T16:30:10.775 INFO:tasks.workunit.client.0.smithi170.stdout:8/122: dread d6/fa [0,4194304] 0 2024-09-04T16:30:10.781 INFO:tasks.workunit.client.0.smithi170.stdout:7/318: rmdir d12/d15/d34/d42 39 2024-09-04T16:30:10.781 INFO:tasks.workunit.client.0.smithi170.stdout:8/123: dread d6/d10/d1a/f23 [0,4194304] 0 2024-09-04T16:30:10.781 INFO:tasks.workunit.client.1.smithi193.stdout:1/534: write d1/d2b/d1b/d51/d6d/f90 [269589,111479] 0 2024-09-04T16:30:10.784 INFO:tasks.workunit.client.1.smithi193.stdout:6/470: dread d5/de/d15/f2f [0,4194304] 0 2024-09-04T16:30:10.785 INFO:tasks.workunit.client.0.smithi170.stdout:1/213: symlink d9/d34/l44 0 2024-09-04T16:30:10.789 INFO:tasks.workunit.client.0.smithi170.stdout:7/319: dwrite d12/d29/f44 [0,4194304] 0 2024-09-04T16:30:10.790 INFO:tasks.workunit.client.0.smithi170.stdout:7/320: chown d12/d4b/d51/l2b 1751839430 1 2024-09-04T16:30:10.791 INFO:tasks.workunit.client.1.smithi193.stdout:5/501: symlink d1/d8/db/d36/la1 0 2024-09-04T16:30:10.791 INFO:tasks.workunit.client.0.smithi170.stdout:0/249: mknod d11/d2a/d43/c57 0 2024-09-04T16:30:10.792 INFO:tasks.workunit.client.1.smithi193.stdout:5/502: read d1/f11 [1407505,101200] 0 2024-09-04T16:30:10.793 INFO:tasks.workunit.client.1.smithi193.stdout:4/408: rmdir d3/d39 39 2024-09-04T16:30:10.795 INFO:tasks.workunit.client.1.smithi193.stdout:4/409: read d3/d1a/d54/f7a [37659,70088] 0 2024-09-04T16:30:10.799 INFO:tasks.workunit.client.1.smithi193.stdout:9/558: dread d2/d8/d25/f37 [0,4194304] 0 2024-09-04T16:30:10.800 INFO:tasks.workunit.client.1.smithi193.stdout:8/519: dwrite d2/d20/d23/d51/d76/f87 [0,4194304] 0 2024-09-04T16:30:10.801 INFO:tasks.workunit.client.1.smithi193.stdout:9/559: chown d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/c9e 403623164 1 2024-09-04T16:30:10.802 INFO:tasks.workunit.client.1.smithi193.stdout:6/471: creat d5/d33/d4e/d51/d71/d82/f9d x:0 0 0 2024-09-04T16:30:10.804 INFO:tasks.workunit.client.0.smithi170.stdout:0/250: creat d11/d2a/d43/f58 x:0 0 0 2024-09-04T16:30:10.806 INFO:tasks.workunit.client.1.smithi193.stdout:2/465: rename d2/d14 to d2/d9/db/d10/d1e/da4 0 2024-09-04T16:30:10.807 INFO:tasks.workunit.client.1.smithi193.stdout:9/560: dread d2/d8/d25/f37 [0,4194304] 0 2024-09-04T16:30:10.808 INFO:tasks.workunit.client.0.smithi170.stdout:1/214: creat d9/d11/d2e/f45 x:0 0 0 2024-09-04T16:30:10.808 INFO:tasks.workunit.client.1.smithi193.stdout:4/410: chown d3/d1a/d21/c32 31993 1 2024-09-04T16:30:10.808 INFO:tasks.workunit.client.1.smithi193.stdout:9/561: write d2/d8/d15/f16 [4630449,107684] 0 2024-09-04T16:30:10.809 INFO:tasks.workunit.client.0.smithi170.stdout:1/215: dread - d9/d26/f2d zero size 2024-09-04T16:30:10.809 INFO:tasks.workunit.client.0.smithi170.stdout:7/321: fdatasync d12/d29/f2a 0 2024-09-04T16:30:10.814 INFO:tasks.workunit.client.1.smithi193.stdout:8/520: symlink d2/d20/d23/d24/d3c/d65/lac 0 2024-09-04T16:30:10.817 INFO:tasks.workunit.client.0.smithi170.stdout:7/322: readlink d12/d4b/l61 0 2024-09-04T16:30:10.819 INFO:tasks.workunit.client.1.smithi193.stdout:6/472: unlink d5/de/d15/d1b/l4a 0 2024-09-04T16:30:10.820 INFO:tasks.workunit.client.1.smithi193.stdout:8/521: dread d2/d20/f47 [0,4194304] 0 2024-09-04T16:30:10.822 INFO:tasks.workunit.client.1.smithi193.stdout:3/505: rename d0/d10/c12 to d0/d18/d1c/d6e/cad 0 2024-09-04T16:30:10.822 INFO:tasks.workunit.client.0.smithi170.stdout:8/124: truncate d6/fb 1505596 0 2024-09-04T16:30:10.825 INFO:tasks.workunit.client.1.smithi193.stdout:2/466: mkdir d2/d9/db/d10/d38/da5 0 2024-09-04T16:30:10.826 INFO:tasks.workunit.client.0.smithi170.stdout:7/323: symlink d12/d5a/l6e 0 2024-09-04T16:30:10.826 INFO:tasks.workunit.client.0.smithi170.stdout:7/324: stat d12/d5a/l6e 0 2024-09-04T16:30:10.826 INFO:tasks.workunit.client.0.smithi170.stdout:7/325: readlink l0 0 2024-09-04T16:30:10.830 INFO:tasks.workunit.client.1.smithi193.stdout:1/535: creat d1/d2b/d10/fa5 x:0 0 0 2024-09-04T16:30:10.833 INFO:tasks.workunit.client.0.smithi170.stdout:1/216: getdents d9/d26 0 2024-09-04T16:30:10.834 INFO:tasks.workunit.client.1.smithi193.stdout:3/506: dread d0/d9/fb [0,4194304] 0 2024-09-04T16:30:10.834 INFO:tasks.workunit.client.0.smithi170.stdout:0/251: dwrite d11/f29 [0,4194304] 0 2024-09-04T16:30:10.836 INFO:tasks.workunit.client.1.smithi193.stdout:8/522: read - d2/f7f zero size 2024-09-04T16:30:10.839 INFO:tasks.workunit.client.0.smithi170.stdout:1/217: creat d9/d26/f46 x:0 0 0 2024-09-04T16:30:10.844 INFO:tasks.workunit.client.1.smithi193.stdout:7/600: rename d9/d18/d22/d2b/f55 to d9/d18/d22/d2b/d6c/d70/d79/dbc/fc9 0 2024-09-04T16:30:10.847 INFO:tasks.workunit.client.0.smithi170.stdout:8/125: rename d6/d10 to d6/d28 0 2024-09-04T16:30:10.848 INFO:tasks.workunit.client.0.smithi170.stdout:1/218: dwrite d9/d26/f2d [0,4194304] 0 2024-09-04T16:30:10.853 INFO:tasks.workunit.client.0.smithi170.stdout:1/219: dread d9/f10 [0,4194304] 0 2024-09-04T16:30:10.855 INFO:tasks.workunit.client.1.smithi193.stdout:4/411: write d3/d1a/d2a/f3b [488524,78724] 0 2024-09-04T16:30:10.857 INFO:tasks.workunit.client.1.smithi193.stdout:6/473: fsync d5/de/d15/d1b/d5f/f78 0 2024-09-04T16:30:10.858 INFO:tasks.workunit.client.1.smithi193.stdout:6/474: chown d5/d27/f9b 52307968 1 2024-09-04T16:30:10.860 INFO:tasks.workunit.client.1.smithi193.stdout:8/523: creat d2/d20/d23/d34/d46/d53/d90/fad x:0 0 0 2024-09-04T16:30:10.866 INFO:tasks.workunit.client.0.smithi170.stdout:0/252: creat d11/d13/d2f/d3f/f59 x:0 0 0 2024-09-04T16:30:10.867 INFO:tasks.workunit.client.0.smithi170.stdout:0/253: dread - d11/d2a/d43/f58 zero size 2024-09-04T16:30:10.874 INFO:tasks.workunit.client.0.smithi170.stdout:0/254: dwrite d11/d13/f28 [0,4194304] 0 2024-09-04T16:30:10.874 INFO:tasks.workunit.client.1.smithi193.stdout:3/507: mkdir d0/d9/dae 0 2024-09-04T16:30:10.875 INFO:tasks.workunit.client.1.smithi193.stdout:6/475: symlink d5/d33/d4e/l9e 0 2024-09-04T16:30:10.879 INFO:tasks.workunit.client.1.smithi193.stdout:0/504: rename d18/d25/l3d to d18/d25/d5f/d6a/d7b/la8 0 2024-09-04T16:30:10.879 INFO:tasks.workunit.client.0.smithi170.stdout:0/255: stat d11/d13/d2f/d3f/f4f 0 2024-09-04T16:30:10.880 INFO:tasks.workunit.client.0.smithi170.stdout:0/256: chown d11/l26 1 1 2024-09-04T16:30:10.881 INFO:tasks.workunit.client.0.smithi170.stdout:7/326: truncate d12/d15/f28 3571768 0 2024-09-04T16:30:10.882 INFO:tasks.workunit.client.1.smithi193.stdout:2/467: creat d2/d9/db/d10/d1f/fa6 x:0 0 0 2024-09-04T16:30:10.883 INFO:tasks.workunit.client.1.smithi193.stdout:1/536: creat d1/d2b/d1b/d51/fa6 x:0 0 0 2024-09-04T16:30:10.883 INFO:tasks.workunit.client.1.smithi193.stdout:0/505: truncate d18/d25/f8a 938894 0 2024-09-04T16:30:10.884 INFO:tasks.workunit.client.0.smithi170.stdout:7/327: mknod d12/d29/d5c/c6f 0 2024-09-04T16:30:10.885 INFO:tasks.workunit.client.1.smithi193.stdout:4/412: dread d3/d1a/f3d [0,4194304] 0 2024-09-04T16:30:10.887 INFO:tasks.workunit.client.1.smithi193.stdout:7/601: dread d9/de/d27/f35 [4194304,4194304] 0 2024-09-04T16:30:10.887 INFO:tasks.workunit.client.1.smithi193.stdout:5/503: rename d1/d8/db/d15/d2b/d83/d37/d3f/d8e/f7b to d1/d8/db/d15/fa2 0 2024-09-04T16:30:10.887 INFO:tasks.workunit.client.1.smithi193.stdout:2/468: read d2/d9/d18/f37 [673144,49896] 0 2024-09-04T16:30:10.887 INFO:tasks.workunit.client.0.smithi170.stdout:0/257: mknod d11/c5a 0 2024-09-04T16:30:10.888 INFO:tasks.workunit.client.1.smithi193.stdout:6/476: dwrite d5/d33/d4e/d51/d71/d82/f9c [0,4194304] 0 2024-09-04T16:30:10.888 INFO:tasks.workunit.client.1.smithi193.stdout:1/537: write d1/d2b/d1b/d51/d6d/f7a [328021,106510] 0 2024-09-04T16:30:10.890 INFO:tasks.workunit.client.0.smithi170.stdout:0/258: write d11/d13/d35/f4b [848611,76790] 0 2024-09-04T16:30:10.891 INFO:tasks.workunit.client.1.smithi193.stdout:5/504: fsync d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f6f 0 2024-09-04T16:30:10.891 INFO:tasks.workunit.client.1.smithi193.stdout:1/538: truncate d1/f1c 4273003 0 2024-09-04T16:30:10.892 INFO:tasks.workunit.client.1.smithi193.stdout:5/505: chown d1/d8/fd 27 1 2024-09-04T16:30:10.892 INFO:tasks.workunit.client.0.smithi170.stdout:0/259: stat d11/d13/d2f/f31 0 2024-09-04T16:30:10.893 INFO:tasks.workunit.client.1.smithi193.stdout:7/602: creat d9/de/fca x:0 0 0 2024-09-04T16:30:10.893 INFO:tasks.workunit.client.0.smithi170.stdout:0/260: chown d11/d2a/l3e 18 1 2024-09-04T16:30:10.894 INFO:tasks.workunit.client.0.smithi170.stdout:8/126: dwrite d6/f15 [0,4194304] 0 2024-09-04T16:30:10.895 INFO:tasks.workunit.client.0.smithi170.stdout:7/328: getdents d12/d15/d41 0 2024-09-04T16:30:10.899 INFO:tasks.workunit.client.1.smithi193.stdout:9/562: rename d2/d4/f7 to d2/d18/d2f/fab 0 2024-09-04T16:30:10.901 INFO:tasks.workunit.client.1.smithi193.stdout:6/477: mkdir d5/de/d15/d9f 0 2024-09-04T16:30:10.901 INFO:tasks.workunit.client.1.smithi193.stdout:5/506: truncate d1/d8/db/d36/f48 1230544 0 2024-09-04T16:30:10.902 INFO:tasks.workunit.client.1.smithi193.stdout:6/478: write d5/de/d15/d1b/f79 [136928,24975] 0 2024-09-04T16:30:10.905 INFO:tasks.workunit.client.1.smithi193.stdout:8/524: rename l1 to d2/d20/d23/d1b/d4e/lae 0 2024-09-04T16:30:10.906 INFO:tasks.workunit.client.1.smithi193.stdout:8/525: dread - d2/d20/f8f zero size 2024-09-04T16:30:10.910 INFO:tasks.workunit.client.1.smithi193.stdout:0/506: getdents d18/d25 0 2024-09-04T16:30:10.911 INFO:tasks.workunit.client.1.smithi193.stdout:3/508: write d0/d7/fc [3247579,82911] 0 2024-09-04T16:30:10.911 INFO:tasks.workunit.client.1.smithi193.stdout:5/507: unlink d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f90 0 2024-09-04T16:30:10.911 INFO:tasks.workunit.client.1.smithi193.stdout:6/479: write d5/d27/d3e/f7f [60781,29859] 0 2024-09-04T16:30:10.912 INFO:tasks.workunit.client.1.smithi193.stdout:3/509: chown d0/d18/d1c/d51/d7a/f98 7582 1 2024-09-04T16:30:10.913 INFO:tasks.workunit.client.1.smithi193.stdout:4/413: rename d3/f31 to d3/d1a/d2a/f8a 0 2024-09-04T16:30:10.914 INFO:tasks.workunit.client.1.smithi193.stdout:7/603: link d9/de/f5a d9/d18/d22/d2b/d6c/d70/fcb 0 2024-09-04T16:30:10.914 INFO:tasks.workunit.client.1.smithi193.stdout:3/510: chown d0/d18/f3a 1 1 2024-09-04T16:30:10.915 INFO:tasks.workunit.client.1.smithi193.stdout:0/507: rmdir d18 39 2024-09-04T16:30:10.916 INFO:tasks.workunit.client.1.smithi193.stdout:6/480: mkdir d5/d27/da0 0 2024-09-04T16:30:10.918 INFO:tasks.workunit.client.1.smithi193.stdout:6/481: write d5/d33/d4e/d51/d71/d82/f9d [591517,4514] 0 2024-09-04T16:30:10.919 INFO:tasks.workunit.client.1.smithi193.stdout:6/482: fdatasync d5/d27/d3e/f73 0 2024-09-04T16:30:10.919 INFO:tasks.workunit.client.1.smithi193.stdout:2/469: rename d2/d9/db/d10/d1e/da4/d9a/f88 to d2/d9/db/d65/fa7 0 2024-09-04T16:30:10.920 INFO:tasks.workunit.client.1.smithi193.stdout:5/508: creat d1/d8/db/d36/d40/d46/d84/fa3 x:0 0 0 2024-09-04T16:30:10.923 INFO:tasks.workunit.client.1.smithi193.stdout:7/604: chown d9/de/d27/f38 109 1 2024-09-04T16:30:10.963 INFO:tasks.workunit.client.0.smithi170.stdout:0/261: mknod d11/d13/d35/c5b 0 2024-09-04T16:30:10.963 INFO:tasks.workunit.client.0.smithi170.stdout:5/112: sync 2024-09-04T16:30:10.964 INFO:tasks.workunit.client.0.smithi170.stdout:7/329: write d12/d15/d34/f56 [510879,114553] 0 2024-09-04T16:30:10.966 INFO:tasks.workunit.client.1.smithi193.stdout:4/414: dread d3/d1a/d2a/f40 [0,4194304] 0 2024-09-04T16:30:10.967 INFO:tasks.workunit.client.0.smithi170.stdout:8/127: dwrite d6/f15 [0,4194304] 0 2024-09-04T16:30:10.968 INFO:tasks.workunit.client.0.smithi170.stdout:8/128: chown d6/l1b 279 1 2024-09-04T16:30:10.968 INFO:tasks.workunit.client.1.smithi193.stdout:9/563: dwrite d2/d18/d2f/d22/d30/d6a/f7a [0,4194304] 0 2024-09-04T16:30:10.969 INFO:tasks.workunit.client.0.smithi170.stdout:5/113: symlink d4/db/l21 0 2024-09-04T16:30:10.974 INFO:tasks.workunit.client.0.smithi170.stdout:0/262: creat d11/d13/d4a/f5c x:0 0 0 2024-09-04T16:30:10.977 INFO:tasks.workunit.client.1.smithi193.stdout:5/509: unlink d1/d8/db/d36/f65 0 2024-09-04T16:30:10.978 INFO:tasks.workunit.client.1.smithi193.stdout:6/483: write d5/d33/d4e/d51/f54 [4048762,122897] 0 2024-09-04T16:30:10.980 INFO:tasks.workunit.client.1.smithi193.stdout:5/510: dread - d1/d8/db/d36/d40/d46/d84/fa3 zero size 2024-09-04T16:30:10.980 INFO:tasks.workunit.client.1.smithi193.stdout:5/511: readlink d1/d8/l35 0 2024-09-04T16:30:10.981 INFO:tasks.workunit.client.1.smithi193.stdout:7/605: unlink d9/d39/d3e/d69/f82 0 2024-09-04T16:30:10.981 INFO:tasks.workunit.client.1.smithi193.stdout:3/511: dwrite d0/d18/d1c/d25/d5e/d7e/f7c [0,4194304] 0 2024-09-04T16:30:10.982 INFO:tasks.workunit.client.1.smithi193.stdout:8/526: getdents d2/d20/d23/d34/d4b 0 2024-09-04T16:30:10.983 INFO:tasks.workunit.client.0.smithi170.stdout:8/129: mknod d6/d28/d20/c29 0 2024-09-04T16:30:10.983 INFO:tasks.workunit.client.1.smithi193.stdout:5/512: fsync d1/d8/db/d15/d2b/d83/d37/d3f/f81 0 2024-09-04T16:30:10.985 INFO:tasks.workunit.client.1.smithi193.stdout:1/539: rename d1/d2b/db/d54/d63 to d1/d2b/d10/d56/da7 0 2024-09-04T16:30:10.987 INFO:tasks.workunit.client.1.smithi193.stdout:4/415: creat d3/d1a/d2a/f8b x:0 0 0 2024-09-04T16:30:10.988 INFO:tasks.workunit.client.1.smithi193.stdout:9/564: symlink d2/d18/d2f/d22/lac 0 2024-09-04T16:30:10.988 INFO:tasks.workunit.client.0.smithi170.stdout:8/130: rmdir d6/d28 39 2024-09-04T16:30:10.991 INFO:tasks.workunit.client.1.smithi193.stdout:1/540: dwrite d1/d2b/f6a [0,4194304] 0 2024-09-04T16:30:10.997 INFO:tasks.workunit.client.0.smithi170.stdout:7/330: getdents d12/d15/d34 0 2024-09-04T16:30:11.002 INFO:tasks.workunit.client.0.smithi170.stdout:5/114: getdents d4 0 2024-09-04T16:30:11.003 INFO:tasks.workunit.client.1.smithi193.stdout:0/508: mkdir d18/d25/d32/d9c/da9 0 2024-09-04T16:30:11.004 INFO:tasks.workunit.client.0.smithi170.stdout:0/263: getdents d11/d13/d35 0 2024-09-04T16:30:11.005 INFO:tasks.workunit.client.1.smithi193.stdout:0/509: truncate d18/d25/d5f/d6a/f80 826391 0 2024-09-04T16:30:11.005 INFO:tasks.workunit.client.1.smithi193.stdout:2/470: truncate d2/d9/d18/f6f 3915748 0 2024-09-04T16:30:11.005 INFO:tasks.workunit.client.1.smithi193.stdout:0/510: write f17 [2341102,25421] 0 2024-09-04T16:30:11.006 INFO:tasks.workunit.client.0.smithi170.stdout:8/131: unlink d6/l13 0 2024-09-04T16:30:11.008 INFO:tasks.workunit.client.0.smithi170.stdout:5/115: symlink d4/d8/l22 0 2024-09-04T16:30:11.009 INFO:tasks.workunit.client.1.smithi193.stdout:8/527: dread d2/d20/f2d [0,4194304] 0 2024-09-04T16:30:11.010 INFO:tasks.workunit.client.1.smithi193.stdout:8/528: fdatasync d2/d20/d23/d51/d59/f6d 0 2024-09-04T16:30:11.010 INFO:tasks.workunit.client.1.smithi193.stdout:8/529: write d2/d20/f36 [189605,66054] 0 2024-09-04T16:30:11.012 INFO:tasks.workunit.client.0.smithi170.stdout:8/132: write d6/d28/f1d [1125888,78705] 0 2024-09-04T16:30:11.017 INFO:tasks.workunit.client.1.smithi193.stdout:9/565: creat d2/d56/d86/fad x:0 0 0 2024-09-04T16:30:11.017 INFO:tasks.workunit.client.1.smithi193.stdout:9/566: stat d2/d18/c7c 0 2024-09-04T16:30:11.019 INFO:tasks.workunit.client.0.smithi170.stdout:0/264: truncate d11/d13/f28 866759 0 2024-09-04T16:30:11.020 INFO:tasks.workunit.client.0.smithi170.stdout:8/133: symlink d6/d28/d1a/l2a 0 2024-09-04T16:30:11.022 INFO:tasks.workunit.client.1.smithi193.stdout:1/541: unlink d1/d2b/d1b/d28/c87 0 2024-09-04T16:30:11.022 INFO:tasks.workunit.client.0.smithi170.stdout:5/116: mkdir d4/d8/d1c/d23 0 2024-09-04T16:30:11.023 INFO:tasks.workunit.client.1.smithi193.stdout:1/542: chown d1/d2b/db/f82 1499 1 2024-09-04T16:30:11.024 INFO:tasks.workunit.client.0.smithi170.stdout:0/265: creat d11/d2a/f5d x:0 0 0 2024-09-04T16:30:11.026 INFO:tasks.workunit.client.0.smithi170.stdout:0/266: read d11/d13/f24 [1136921,90832] 0 2024-09-04T16:30:11.026 INFO:tasks.workunit.client.1.smithi193.stdout:2/471: mknod d2/d9/db/d10/d51/ca8 0 2024-09-04T16:30:11.026 INFO:tasks.workunit.client.1.smithi193.stdout:5/513: dread d1/d8/db/d15/d2b/d83/d37/f67 [0,4194304] 0 2024-09-04T16:30:11.027 INFO:tasks.workunit.client.0.smithi170.stdout:8/134: creat d6/d26/f2b x:0 0 0 2024-09-04T16:30:11.028 INFO:tasks.workunit.client.0.smithi170.stdout:8/135: dread - d6/d26/f2b zero size 2024-09-04T16:30:11.029 INFO:tasks.workunit.client.1.smithi193.stdout:0/511: fsync d18/d25/d32/f98 0 2024-09-04T16:30:11.030 INFO:tasks.workunit.client.0.smithi170.stdout:0/267: symlink d11/d13/d35/l5e 0 2024-09-04T16:30:11.031 INFO:tasks.workunit.client.0.smithi170.stdout:0/268: fdatasync d11/f1c 0 2024-09-04T16:30:11.034 INFO:tasks.workunit.client.1.smithi193.stdout:0/512: dwrite d18/d25/d5f/f81 [4194304,4194304] 0 2024-09-04T16:30:11.035 INFO:tasks.workunit.client.1.smithi193.stdout:0/513: write d18/d25/d5f/d6a/f80 [1515229,34266] 0 2024-09-04T16:30:11.036 INFO:tasks.workunit.client.0.smithi170.stdout:0/269: rename f3 to d11/d2a/f5f 0 2024-09-04T16:30:11.036 INFO:tasks.workunit.client.0.smithi170.stdout:0/270: fdatasync d11/d2a/f53 0 2024-09-04T16:30:11.037 INFO:tasks.workunit.client.1.smithi193.stdout:4/416: creat d3/d3c/d89/f8c x:0 0 0 2024-09-04T16:30:11.037 INFO:tasks.workunit.client.0.smithi170.stdout:8/136: mknod d6/c2c 0 2024-09-04T16:30:11.041 INFO:tasks.workunit.client.0.smithi170.stdout:0/271: link d11/d13/d35/f49 d11/d2a/d43/f60 0 2024-09-04T16:30:11.045 INFO:tasks.workunit.client.0.smithi170.stdout:8/137: dwrite d6/d26/f2b [0,4194304] 0 2024-09-04T16:30:11.049 INFO:tasks.workunit.client.1.smithi193.stdout:9/567: dread d2/d8/d15/f34 [0,4194304] 0 2024-09-04T16:30:11.051 INFO:tasks.workunit.client.0.smithi170.stdout:0/272: dwrite d11/d2a/f4c [0,4194304] 0 2024-09-04T16:30:11.053 INFO:tasks.workunit.client.0.smithi170.stdout:8/138: dread d6/f15 [0,4194304] 0 2024-09-04T16:30:11.059 INFO:tasks.workunit.client.0.smithi170.stdout:0/273: mknod d11/d13/d2f/d3f/c61 0 2024-09-04T16:30:11.061 INFO:tasks.workunit.client.0.smithi170.stdout:8/139: fsync d6/d26/f2b 0 2024-09-04T16:30:11.061 INFO:tasks.workunit.client.1.smithi193.stdout:2/472: creat d2/d9/db/d10/d1e/da4/d9a/fa9 x:0 0 0 2024-09-04T16:30:11.062 INFO:tasks.workunit.client.1.smithi193.stdout:7/606: link d9/d18/d22/l8e d9/d39/d3e/d4d/d4f/lcc 0 2024-09-04T16:30:11.063 INFO:tasks.workunit.client.1.smithi193.stdout:7/607: truncate d9/d18/f9b 263892 0 2024-09-04T16:30:11.066 INFO:tasks.workunit.client.0.smithi170.stdout:8/140: creat d6/d28/d20/f2d x:0 0 0 2024-09-04T16:30:11.069 INFO:tasks.workunit.client.1.smithi193.stdout:8/530: link d2/d20/d23/d34/d46/d69/fab d2/d20/d23/d24/d3c/d65/d67/da0/faf 0 2024-09-04T16:30:11.071 INFO:tasks.workunit.client.1.smithi193.stdout:0/514: mknod d18/d25/d32/caa 0 2024-09-04T16:30:11.071 INFO:tasks.workunit.client.0.smithi170.stdout:8/141: dread d6/fb [0,4194304] 0 2024-09-04T16:30:11.076 INFO:tasks.workunit.client.1.smithi193.stdout:5/514: mknod d1/d29/d18/ca4 0 2024-09-04T16:30:11.078 INFO:tasks.workunit.client.0.smithi170.stdout:8/142: dwrite d6/d26/f2b [0,4194304] 0 2024-09-04T16:30:11.078 INFO:tasks.workunit.client.1.smithi193.stdout:7/608: rename d9/d39/d3e/d4d/d4f/f5d to d9/d18/d22/d2b/d6c/fcd 0 2024-09-04T16:30:11.079 INFO:tasks.workunit.client.1.smithi193.stdout:8/531: symlink d2/d20/d23/d1b/lb0 0 2024-09-04T16:30:11.086 INFO:tasks.workunit.client.1.smithi193.stdout:0/515: dread d18/d25/f4d [0,4194304] 0 2024-09-04T16:30:11.086 INFO:tasks.workunit.client.1.smithi193.stdout:5/515: symlink d1/d8/db/d15/d2b/d83/la5 0 2024-09-04T16:30:11.086 INFO:tasks.workunit.client.1.smithi193.stdout:0/516: chown d18/d25/l89 3598897 1 2024-09-04T16:30:11.088 INFO:tasks.workunit.client.1.smithi193.stdout:7/609: dread - d9/d39/d95/fb1 zero size 2024-09-04T16:30:11.089 INFO:tasks.workunit.client.1.smithi193.stdout:7/610: write d9/d39/fc6 [784424,16994] 0 2024-09-04T16:30:11.089 INFO:tasks.workunit.client.1.smithi193.stdout:8/532: truncate d2/d20/d23/f16 4806800 0 2024-09-04T16:30:11.092 INFO:tasks.workunit.client.1.smithi193.stdout:4/417: creat d3/d3c/f8d x:0 0 0 2024-09-04T16:30:11.093 INFO:tasks.workunit.client.1.smithi193.stdout:1/543: truncate d1/d2b/db/f82 3522785 0 2024-09-04T16:30:11.093 INFO:tasks.workunit.client.0.smithi170.stdout:0/274: dwrite d11/d13/f28 [0,4194304] 0 2024-09-04T16:30:11.094 INFO:tasks.workunit.client.0.smithi170.stdout:0/275: chown d11/f23 312617 1 2024-09-04T16:30:11.094 INFO:tasks.workunit.client.1.smithi193.stdout:1/544: truncate d1/d2b/d1b/d51/d6d/f98 878641 0 2024-09-04T16:30:11.095 INFO:tasks.workunit.client.0.smithi170.stdout:8/143: fsync d6/d26/f2b 0 2024-09-04T16:30:11.098 INFO:tasks.workunit.client.0.smithi170.stdout:0/276: creat d11/d13/d4a/f62 x:0 0 0 2024-09-04T16:30:11.099 INFO:tasks.workunit.client.0.smithi170.stdout:0/277: dread - d11/d2a/f5d zero size 2024-09-04T16:30:11.103 INFO:tasks.workunit.client.1.smithi193.stdout:8/533: creat d2/d20/d23/d24/d3c/fb1 x:0 0 0 2024-09-04T16:30:11.103 INFO:tasks.workunit.client.0.smithi170.stdout:0/278: creat d11/d13/d2f/d3f/f63 x:0 0 0 2024-09-04T16:30:11.106 INFO:tasks.workunit.client.0.smithi170.stdout:0/279: mknod d11/d13/c64 0 2024-09-04T16:30:11.107 INFO:tasks.workunit.client.1.smithi193.stdout:9/568: dwrite d2/d18/d2f/fab [0,4194304] 0 2024-09-04T16:30:11.108 INFO:tasks.workunit.client.0.smithi170.stdout:0/280: dread d11/f25 [0,4194304] 0 2024-09-04T16:30:11.109 INFO:tasks.workunit.client.1.smithi193.stdout:7/611: rename d9/de/d27/f37 to d9/d39/d95/fce 0 2024-09-04T16:30:11.109 INFO:tasks.workunit.client.1.smithi193.stdout:2/473: dwrite d2/d9/db/f2e [0,4194304] 0 2024-09-04T16:30:11.109 INFO:tasks.workunit.client.1.smithi193.stdout:9/569: write d2/d8/f55 [1147525,30763] 0 2024-09-04T16:30:11.112 INFO:tasks.workunit.client.1.smithi193.stdout:4/418: truncate d3/d1a/d21/f22 93648 0 2024-09-04T16:30:11.113 INFO:tasks.workunit.client.1.smithi193.stdout:2/474: chown d2/d9/db/f75 1985863 1 2024-09-04T16:30:11.116 INFO:tasks.workunit.client.0.smithi170.stdout:0/281: dwrite d11/d13/d2f/f33 [0,4194304] 0 2024-09-04T16:30:11.120 INFO:tasks.workunit.client.0.smithi170.stdout:0/282: write d11/d13/d2f/d3f/f63 [379384,40394] 0 2024-09-04T16:30:11.126 INFO:tasks.workunit.client.0.smithi170.stdout:8/144: dwrite d6/d28/d1a/f23 [0,4194304] 0 2024-09-04T16:30:11.126 INFO:tasks.workunit.client.1.smithi193.stdout:5/516: truncate d1/f11 3551264 0 2024-09-04T16:30:11.127 INFO:tasks.workunit.client.1.smithi193.stdout:9/570: mknod d2/d18/d2f/d22/d30/d6a/d6e/d81/cae 0 2024-09-04T16:30:11.127 INFO:tasks.workunit.client.0.smithi170.stdout:8/145: fdatasync d6/d28/f1d 0 2024-09-04T16:30:11.129 INFO:tasks.workunit.client.1.smithi193.stdout:1/545: dread d1/d2b/d10/f19 [0,4194304] 0 2024-09-04T16:30:11.130 INFO:tasks.workunit.client.1.smithi193.stdout:0/517: getdents d18/d25/d5f/d6a 0 2024-09-04T16:30:11.131 INFO:tasks.workunit.client.0.smithi170.stdout:0/283: creat d11/d13/d2f/d3f/f65 x:0 0 0 2024-09-04T16:30:11.131 INFO:tasks.workunit.client.1.smithi193.stdout:9/571: dread d2/f6 [0,4194304] 0 2024-09-04T16:30:11.135 INFO:tasks.workunit.client.1.smithi193.stdout:8/534: mkdir d2/d20/d23/d34/d4b/d7c/db2 0 2024-09-04T16:30:11.136 INFO:tasks.workunit.client.0.smithi170.stdout:8/146: mknod d6/d28/d16/c2e 0 2024-09-04T16:30:11.141 INFO:tasks.workunit.client.0.smithi170.stdout:0/284: dwrite d11/d13/d4a/f5c [0,4194304] 0 2024-09-04T16:30:11.141 INFO:tasks.workunit.client.0.smithi170.stdout:8/147: mkdir d6/d28/d1a/d2f 0 2024-09-04T16:30:11.142 INFO:tasks.workunit.client.1.smithi193.stdout:1/546: write d1/d2b/d10/f25 [3843602,54867] 0 2024-09-04T16:30:11.142 INFO:tasks.workunit.client.0.smithi170.stdout:8/148: dread - d6/d28/d20/f2d zero size 2024-09-04T16:30:11.144 INFO:tasks.workunit.client.1.smithi193.stdout:2/475: mkdir d2/d9/db/d10/d38/da5/daa 0 2024-09-04T16:30:11.146 INFO:tasks.workunit.client.1.smithi193.stdout:2/476: write d2/d9/db/d10/d51/f85 [565731,88589] 0 2024-09-04T16:30:11.147 INFO:tasks.workunit.client.0.smithi170.stdout:8/149: rename d6/c2c to d6/d28/d1a/d2f/c30 0 2024-09-04T16:30:11.147 INFO:tasks.workunit.client.1.smithi193.stdout:2/477: stat d2/d9/db/d10/d1f/d22/c47 0 2024-09-04T16:30:11.151 INFO:tasks.workunit.client.1.smithi193.stdout:7/612: mkdir d9/d39/d3e/d69/dcf 0 2024-09-04T16:30:11.152 INFO:tasks.workunit.client.1.smithi193.stdout:7/613: write d9/d11/f4e [5101469,39297] 0 2024-09-04T16:30:11.154 INFO:tasks.workunit.client.0.smithi170.stdout:8/150: symlink d6/d28/d1a/d2f/l31 0 2024-09-04T16:30:11.154 INFO:tasks.workunit.client.1.smithi193.stdout:2/478: dread d2/d9/db/d10/d38/d63/f68 [0,4194304] 0 2024-09-04T16:30:11.160 INFO:tasks.workunit.client.1.smithi193.stdout:9/572: mknod d2/d18/d2f/d22/d30/d6a/d6e/caf 0 2024-09-04T16:30:11.161 INFO:tasks.workunit.client.0.smithi170.stdout:0/285: write d11/d2a/f5f [543326,25365] 0 2024-09-04T16:30:11.161 INFO:tasks.workunit.client.1.smithi193.stdout:8/535: creat d2/d86/fb3 x:0 0 0 2024-09-04T16:30:11.162 INFO:tasks.workunit.client.0.smithi170.stdout:0/286: chown d11/d13/d2f/f33 8 1 2024-09-04T16:30:11.162 INFO:tasks.workunit.client.1.smithi193.stdout:8/536: write d2/d20/d23/d1b/f28 [2365374,114704] 0 2024-09-04T16:30:11.165 INFO:tasks.workunit.client.0.smithi170.stdout:8/151: rename d6/d28/d16/c25 to d6/c32 0 2024-09-04T16:30:11.167 INFO:tasks.workunit.client.1.smithi193.stdout:2/479: write d2/d9/db/d65/fa7 [894309,4812] 0 2024-09-04T16:30:11.168 INFO:tasks.workunit.client.1.smithi193.stdout:5/517: write d1/d8/db/d15/fa2 [104250,82686] 0 2024-09-04T16:30:11.168 INFO:tasks.workunit.client.1.smithi193.stdout:2/480: chown d2/d9/d61/ca2 57064 1 2024-09-04T16:30:11.169 INFO:tasks.workunit.client.0.smithi170.stdout:8/152: mknod d6/d28/d1a/c33 0 2024-09-04T16:30:11.169 INFO:tasks.workunit.client.1.smithi193.stdout:5/518: dread - d1/d8/db/d15/d2b/d83/d37/d3f/f81 zero size 2024-09-04T16:30:11.171 INFO:tasks.workunit.client.1.smithi193.stdout:5/519: read - d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f6f zero size 2024-09-04T16:30:11.171 INFO:tasks.workunit.client.1.smithi193.stdout:0/518: rmdir d18/d25/d5f/d65/d9f/da6 0 2024-09-04T16:30:11.172 INFO:tasks.workunit.client.1.smithi193.stdout:5/520: read - d1/d8/db/d36/d40/d46/d84/fa3 zero size 2024-09-04T16:30:11.172 INFO:tasks.workunit.client.0.smithi170.stdout:8/153: mknod d6/d28/d16/c34 0 2024-09-04T16:30:11.174 INFO:tasks.workunit.client.1.smithi193.stdout:9/573: mknod d2/d8/d15/cb0 0 2024-09-04T16:30:11.177 INFO:tasks.workunit.client.1.smithi193.stdout:8/537: creat d2/d20/d23/d34/fb4 x:0 0 0 2024-09-04T16:30:11.179 INFO:tasks.workunit.client.0.smithi170.stdout:0/287: dwrite d11/d2a/d43/f60 [0,4194304] 0 2024-09-04T16:30:11.182 INFO:tasks.workunit.client.1.smithi193.stdout:1/547: dwrite d1/d2b/db/f7e [0,4194304] 0 2024-09-04T16:30:11.185 INFO:tasks.workunit.client.0.smithi170.stdout:0/288: mkdir d11/d13/d4a/d66 0 2024-09-04T16:30:11.186 INFO:tasks.workunit.client.0.smithi170.stdout:8/154: write d6/d28/f1e [4277178,3867] 0 2024-09-04T16:30:11.186 INFO:tasks.workunit.client.0.smithi170.stdout:0/289: chown f4 14013 1 2024-09-04T16:30:11.190 INFO:tasks.workunit.client.1.smithi193.stdout:0/519: creat d18/d79/d88/fab x:0 0 0 2024-09-04T16:30:11.192 INFO:tasks.workunit.client.1.smithi193.stdout:0/520: write d18/d25/d32/f98 [2763282,109482] 0 2024-09-04T16:30:11.192 INFO:tasks.workunit.client.1.smithi193.stdout:5/521: dread d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/d55/f77 [0,4194304] 0 2024-09-04T16:30:11.193 INFO:tasks.workunit.client.0.smithi170.stdout:0/290: symlink d11/d13/d4a/d66/l67 0 2024-09-04T16:30:11.193 INFO:tasks.workunit.client.0.smithi170.stdout:8/155: dwrite d6/d28/d20/f2d [0,4194304] 0 2024-09-04T16:30:11.194 INFO:tasks.workunit.client.1.smithi193.stdout:1/548: symlink d1/d2b/d1b/d28/d50/d84/d97/la8 0 2024-09-04T16:30:11.195 INFO:tasks.workunit.client.1.smithi193.stdout:1/549: chown d1/d2b/d10/d2a 46 1 2024-09-04T16:30:11.197 INFO:tasks.workunit.client.1.smithi193.stdout:1/550: write d1/d2b/d10/d56/f6b [535177,63868] 0 2024-09-04T16:30:11.198 INFO:tasks.workunit.client.1.smithi193.stdout:0/521: creat d18/d25/d5f/d6a/d7b/fac x:0 0 0 2024-09-04T16:30:11.199 INFO:tasks.workunit.client.1.smithi193.stdout:1/551: chown d1/d2b/d1b/d51/f8b 227 1 2024-09-04T16:30:11.202 INFO:tasks.workunit.client.1.smithi193.stdout:9/574: getdents d2/d18/d2f/d22/d30 0 2024-09-04T16:30:11.203 INFO:tasks.workunit.client.1.smithi193.stdout:5/522: rename d1/d8/fc to d1/d8/db/fa6 0 2024-09-04T16:30:11.204 INFO:tasks.workunit.client.1.smithi193.stdout:8/538: dread d2/d20/d23/d24/d3c/f45 [0,4194304] 0 2024-09-04T16:30:11.206 INFO:tasks.workunit.client.1.smithi193.stdout:9/575: truncate d2/d18/fa9 795412 0 2024-09-04T16:30:11.207 INFO:tasks.workunit.client.0.smithi170.stdout:0/291: dread d11/f18 [0,4194304] 0 2024-09-04T16:30:11.208 INFO:tasks.workunit.client.1.smithi193.stdout:2/481: dread d2/d9/db/d10/f6e [0,4194304] 0 2024-09-04T16:30:11.208 INFO:tasks.workunit.client.1.smithi193.stdout:8/539: truncate d2/d20/d23/d51/f63 331920 0 2024-09-04T16:30:11.208 INFO:tasks.workunit.client.1.smithi193.stdout:5/523: mkdir d1/d8/db/d15/d2b/d83/d37/d58/d9e/da7 0 2024-09-04T16:30:11.209 INFO:tasks.workunit.client.1.smithi193.stdout:0/522: dwrite d18/d25/d32/d57/d6d/f72 [0,4194304] 0 2024-09-04T16:30:11.210 INFO:tasks.workunit.client.0.smithi170.stdout:0/292: getdents d11/d13/d36 0 2024-09-04T16:30:11.211 INFO:tasks.workunit.client.0.smithi170.stdout:0/293: fdatasync d11/f25 0 2024-09-04T16:30:11.212 INFO:tasks.workunit.client.1.smithi193.stdout:2/482: symlink d2/d9/db/d10/d51/d79/lab 0 2024-09-04T16:30:11.214 INFO:tasks.workunit.client.1.smithi193.stdout:5/524: creat d1/d8/db/d15/d2b/d83/d37/d88/fa8 x:0 0 0 2024-09-04T16:30:11.215 INFO:tasks.workunit.client.1.smithi193.stdout:0/523: dread d18/f38 [0,4194304] 0 2024-09-04T16:30:11.218 INFO:tasks.workunit.client.0.smithi170.stdout:0/294: creat d11/f68 x:0 0 0 2024-09-04T16:30:11.218 INFO:tasks.workunit.client.1.smithi193.stdout:5/525: mknod d1/d8/db/d36/ca9 0 2024-09-04T16:30:11.219 INFO:tasks.workunit.client.1.smithi193.stdout:8/540: link d2/c35 d2/d20/d23/d1b/cb5 0 2024-09-04T16:30:11.220 INFO:tasks.workunit.client.1.smithi193.stdout:2/483: dwrite d2/f2a [4194304,4194304] 0 2024-09-04T16:30:11.224 INFO:tasks.workunit.client.1.smithi193.stdout:8/541: fsync d2/d20/d23/d24/d3c/f45 0 2024-09-04T16:30:11.228 INFO:tasks.workunit.client.0.smithi170.stdout:0/295: dread d11/d13/d2f/d3f/f4f [0,4194304] 0 2024-09-04T16:30:11.228 INFO:tasks.workunit.client.0.smithi170.stdout:8/156: dwrite d6/fa [0,4194304] 0 2024-09-04T16:30:11.228 INFO:tasks.workunit.client.1.smithi193.stdout:0/524: dread d18/f20 [4194304,4194304] 0 2024-09-04T16:30:11.229 INFO:tasks.workunit.client.1.smithi193.stdout:5/526: fdatasync d1/d8/db/d15/d2b/d83/d37/f63 0 2024-09-04T16:30:11.229 INFO:tasks.workunit.client.0.smithi170.stdout:0/296: read - d11/d13/d4a/f62 zero size 2024-09-04T16:30:11.233 INFO:tasks.workunit.client.1.smithi193.stdout:8/542: dwrite d2/d20/d23/f1d [0,4194304] 0 2024-09-04T16:30:11.234 INFO:tasks.workunit.client.0.smithi170.stdout:0/297: rename d11/d2a/l52 to d11/d13/d36/l69 0 2024-09-04T16:30:11.236 INFO:tasks.workunit.client.0.smithi170.stdout:8/157: dwrite d6/d26/f2b [0,4194304] 0 2024-09-04T16:30:11.237 INFO:tasks.workunit.client.1.smithi193.stdout:0/525: rename d18/d25/d32/c67 to d18/d25/d32/d9c/cad 0 2024-09-04T16:30:11.240 INFO:tasks.workunit.client.1.smithi193.stdout:8/543: mkdir d2/d95/db6 0 2024-09-04T16:30:11.246 INFO:tasks.workunit.client.0.smithi170.stdout:0/298: creat d11/f6a x:0 0 0 2024-09-04T16:30:11.248 INFO:tasks.workunit.client.1.smithi193.stdout:8/544: mknod d2/d20/d23/d34/d3e/d6f/d81/cb7 0 2024-09-04T16:30:11.252 INFO:tasks.workunit.client.1.smithi193.stdout:2/484: dread d2/d9/db/d10/d1e/da4/d9a/f41 [0,4194304] 0 2024-09-04T16:30:11.253 INFO:tasks.workunit.client.1.smithi193.stdout:2/485: fdatasync d2/d9/db/d10/f6e 0 2024-09-04T16:30:11.256 INFO:tasks.workunit.client.1.smithi193.stdout:2/486: unlink d2/d9/db/d10/d1e/d26/f48 0 2024-09-04T16:30:11.256 INFO:tasks.workunit.client.1.smithi193.stdout:1/552: dread d1/d2b/d10/d56/f6b [0,4194304] 0 2024-09-04T16:30:11.259 INFO:tasks.workunit.client.1.smithi193.stdout:1/553: chown d1/d2b/d1b/l60 30879433 1 2024-09-04T16:30:11.264 INFO:tasks.workunit.client.1.smithi193.stdout:5/527: dread d1/d29/d18/f2f [0,4194304] 0 2024-09-04T16:30:11.265 INFO:tasks.workunit.client.1.smithi193.stdout:2/487: dread d2/d9/db/f72 [0,4194304] 0 2024-09-04T16:30:11.266 INFO:tasks.workunit.client.0.smithi170.stdout:8/158: truncate d6/fb 4101957 0 2024-09-04T16:30:11.267 INFO:tasks.workunit.client.1.smithi193.stdout:1/554: dwrite d1/d2b/d1b/f4c [0,4194304] 0 2024-09-04T16:30:11.267 INFO:tasks.workunit.client.1.smithi193.stdout:8/545: dread d2/d12/f43 [0,4194304] 0 2024-09-04T16:30:11.270 INFO:tasks.workunit.client.0.smithi170.stdout:8/159: dread d6/f15 [0,4194304] 0 2024-09-04T16:30:11.270 INFO:tasks.workunit.client.1.smithi193.stdout:2/488: write d2/d9/db/d10/d1e/da4/d9a/f41 [8702145,93255] 0 2024-09-04T16:30:11.271 INFO:tasks.workunit.client.0.smithi170.stdout:8/160: write d6/fa [527714,61741] 0 2024-09-04T16:30:11.271 INFO:tasks.workunit.client.1.smithi193.stdout:2/489: readlink d2/l7e 0 2024-09-04T16:30:11.272 INFO:tasks.workunit.client.1.smithi193.stdout:8/546: mkdir d2/d20/d23/d34/d4b/db8 0 2024-09-04T16:30:11.274 INFO:tasks.workunit.client.0.smithi170.stdout:8/161: rename d6/d28/f1e to d6/d28/d1a/d2f/f35 0 2024-09-04T16:30:11.277 INFO:tasks.workunit.client.1.smithi193.stdout:2/490: mkdir d2/d9/db/d10/d38/dac 0 2024-09-04T16:30:11.278 INFO:tasks.workunit.client.0.smithi170.stdout:8/162: creat d6/d28/d1a/f36 x:0 0 0 2024-09-04T16:30:11.281 INFO:tasks.workunit.client.1.smithi193.stdout:5/528: write d1/d8/db/d15/d2b/d83/d37/f9d [4596232,47319] 0 2024-09-04T16:30:11.281 INFO:tasks.workunit.client.1.smithi193.stdout:1/555: dread d1/d2b/d1b/d28/d50/f5d [0,4194304] 0 2024-09-04T16:30:11.283 INFO:tasks.workunit.client.1.smithi193.stdout:8/547: getdents d2/d20/d23/d34/d4b/d7c 0 2024-09-04T16:30:11.284 INFO:tasks.workunit.client.1.smithi193.stdout:2/491: creat d2/d9/fad x:0 0 0 2024-09-04T16:30:11.284 INFO:tasks.workunit.client.0.smithi170.stdout:8/163: link d6/d28/d16/d24/c27 d6/d26/c37 0 2024-09-04T16:30:11.287 INFO:tasks.workunit.client.0.smithi170.stdout:8/164: mkdir d6/d28/d1a/d38 0 2024-09-04T16:30:11.289 INFO:tasks.workunit.client.1.smithi193.stdout:8/548: dwrite d2/d12/f8e [0,4194304] 0 2024-09-04T16:30:11.291 INFO:tasks.workunit.client.1.smithi193.stdout:5/529: rename d1/d8/db/d15/d2b/d83/c5d to d1/d29/d74/d96/d98/caa 0 2024-09-04T16:30:11.291 INFO:tasks.workunit.client.1.smithi193.stdout:2/492: creat d2/d9/db/d10/d1e/d56/fae x:0 0 0 2024-09-04T16:30:11.292 INFO:tasks.workunit.client.0.smithi170.stdout:8/165: unlink d6/f15 0 2024-09-04T16:30:11.294 INFO:tasks.workunit.client.0.smithi170.stdout:8/166: symlink d6/d28/d1a/d2f/l39 0 2024-09-04T16:30:11.296 INFO:tasks.workunit.client.1.smithi193.stdout:8/549: getdents d2/d20/d23/d51/d59/d82 0 2024-09-04T16:30:11.297 INFO:tasks.workunit.client.1.smithi193.stdout:1/556: dread d1/d2b/f2c [8388608,4194304] 0 2024-09-04T16:30:11.298 INFO:tasks.workunit.client.1.smithi193.stdout:8/550: fdatasync d2/d20/d23/d34/d46/d69/f8c 0 2024-09-04T16:30:11.300 INFO:tasks.workunit.client.1.smithi193.stdout:1/557: creat d1/d2b/d10/d2a/fa9 x:0 0 0 2024-09-04T16:30:11.302 INFO:tasks.workunit.client.1.smithi193.stdout:5/530: dwrite d1/d8/db/d15/d2b/d83/d37/d3f/f5a [4194304,4194304] 0 2024-09-04T16:30:11.303 INFO:tasks.workunit.client.1.smithi193.stdout:8/551: rename d2/d20/d23/d34/d46/d69 to d2/d20/d23/d24/d3c/d65/d67/da0/da8/db9 0 2024-09-04T16:30:11.305 INFO:tasks.workunit.client.1.smithi193.stdout:5/531: read - d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f6f zero size 2024-09-04T16:30:11.308 INFO:tasks.workunit.client.1.smithi193.stdout:1/558: dread d1/d2b/d10/f59 [0,4194304] 0 2024-09-04T16:30:11.308 INFO:tasks.workunit.client.1.smithi193.stdout:5/532: truncate d1/d29/f8d 5128 0 2024-09-04T16:30:11.309 INFO:tasks.workunit.client.1.smithi193.stdout:5/533: chown d1/d29/d74 558604 1 2024-09-04T16:30:11.311 INFO:tasks.workunit.client.1.smithi193.stdout:1/559: creat d1/d2b/d10/d56/faa x:0 0 0 2024-09-04T16:30:11.312 INFO:tasks.workunit.client.1.smithi193.stdout:1/560: fsync d1/d2b/d1b/d51/fa6 0 2024-09-04T16:30:11.313 INFO:tasks.workunit.client.0.smithi170.stdout:8/167: truncate d6/fa 1578111 0 2024-09-04T16:30:11.314 INFO:tasks.workunit.client.0.smithi170.stdout:8/168: dread - d6/d28/d1a/f36 zero size 2024-09-04T16:30:11.315 INFO:tasks.workunit.client.1.smithi193.stdout:1/561: mknod d1/d2b/cab 0 2024-09-04T16:30:11.316 INFO:tasks.workunit.client.1.smithi193.stdout:1/562: write d1/d2b/db/f3f [2069107,84412] 0 2024-09-04T16:30:11.318 INFO:tasks.workunit.client.1.smithi193.stdout:8/552: write d2/f8 [511100,695] 0 2024-09-04T16:30:11.318 INFO:tasks.workunit.client.0.smithi170.stdout:8/169: dread d6/d26/f2b [0,4194304] 0 2024-09-04T16:30:11.319 INFO:tasks.workunit.client.1.smithi193.stdout:1/563: mknod d1/d2b/db/d54/da1/cac 0 2024-09-04T16:30:11.320 INFO:tasks.workunit.client.0.smithi170.stdout:8/170: dread - d6/d28/d1a/f36 zero size 2024-09-04T16:30:11.320 INFO:tasks.workunit.client.1.smithi193.stdout:8/553: chown d2/l9 16285670 1 2024-09-04T16:30:11.321 INFO:tasks.workunit.client.1.smithi193.stdout:2/493: dread d2/d9/db/d10/d1e/d26/f3a [0,4194304] 0 2024-09-04T16:30:11.322 INFO:tasks.workunit.client.1.smithi193.stdout:1/564: mknod d1/d2b/d10/d56/cad 0 2024-09-04T16:30:11.323 INFO:tasks.workunit.client.1.smithi193.stdout:2/494: write d2/d9/d18/f4f [2053030,118475] 0 2024-09-04T16:30:11.324 INFO:tasks.workunit.client.0.smithi170.stdout:8/171: dread d6/fb [0,4194304] 0 2024-09-04T16:30:11.325 INFO:tasks.workunit.client.1.smithi193.stdout:5/534: dread d1/d29/f1d [4194304,4194304] 0 2024-09-04T16:30:11.326 INFO:tasks.workunit.client.0.smithi170.stdout:8/172: write d6/d28/d20/f2d [4863491,12548] 0 2024-09-04T16:30:11.326 INFO:tasks.workunit.client.1.smithi193.stdout:8/554: rename d2/d20/d23/d34/d3e/c84 to d2/d20/cba 0 2024-09-04T16:30:11.328 INFO:tasks.workunit.client.1.smithi193.stdout:6/484: sync 2024-09-04T16:30:11.328 INFO:tasks.workunit.client.1.smithi193.stdout:3/512: sync 2024-09-04T16:30:11.328 INFO:tasks.workunit.client.1.smithi193.stdout:4/419: sync 2024-09-04T16:30:11.328 INFO:tasks.workunit.client.1.smithi193.stdout:1/565: dread d1/d2b/d1b/d51/d6d/f98 [0,4194304] 0 2024-09-04T16:30:11.330 INFO:tasks.workunit.client.1.smithi193.stdout:1/566: stat d1/d2b/d1b/da0 0 2024-09-04T16:30:11.330 INFO:tasks.workunit.client.1.smithi193.stdout:3/513: fdatasync d0/d18/d1c/d51/d5a/fa3 0 2024-09-04T16:30:11.330 INFO:tasks.workunit.client.1.smithi193.stdout:6/485: read d5/de/d15/f24 [2086248,39487] 0 2024-09-04T16:30:11.331 INFO:tasks.workunit.client.0.smithi170.stdout:8/173: rename d6/d28/d1a/c33 to d6/d26/c3a 0 2024-09-04T16:30:11.333 INFO:tasks.workunit.client.0.smithi170.stdout:8/174: mknod d6/d28/c3b 0 2024-09-04T16:30:11.335 INFO:tasks.workunit.client.1.smithi193.stdout:1/567: mknod d1/d2b/d1b/d28/d50/d84/d97/cae 0 2024-09-04T16:30:11.336 INFO:tasks.workunit.client.1.smithi193.stdout:6/486: creat d5/d33/d85/fa1 x:0 0 0 2024-09-04T16:30:11.337 INFO:tasks.workunit.client.1.smithi193.stdout:5/535: dwrite d1/d8/db/d15/d2b/d83/d37/f4d [0,4194304] 0 2024-09-04T16:30:11.337 INFO:tasks.workunit.client.0.smithi170.stdout:8/175: unlink d6/d28/d20/f2d 0 2024-09-04T16:30:11.337 INFO:tasks.workunit.client.0.smithi170.stdout:8/176: stat d6/d28/l12 0 2024-09-04T16:30:11.340 INFO:tasks.workunit.client.1.smithi193.stdout:3/514: dwrite d0/d18/d1c/d51/d7a/f98 [0,4194304] 0 2024-09-04T16:30:11.341 INFO:tasks.workunit.client.0.smithi170.stdout:8/177: write d6/d28/d1a/d2f/f35 [2339290,70831] 0 2024-09-04T16:30:11.346 INFO:tasks.workunit.client.1.smithi193.stdout:4/420: creat d3/f8e x:0 0 0 2024-09-04T16:30:11.346 INFO:tasks.workunit.client.1.smithi193.stdout:6/487: mknod d5/de/d15/d1b/ca2 0 2024-09-04T16:30:11.346 INFO:tasks.workunit.client.1.smithi193.stdout:8/555: dwrite d2/d20/f2d [0,4194304] 0 2024-09-04T16:30:11.347 INFO:tasks.workunit.client.1.smithi193.stdout:5/536: truncate d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f6f 280437 0 2024-09-04T16:30:11.348 INFO:tasks.workunit.client.0.smithi170.stdout:8/178: rename d6/fb to d6/d28/d1a/f3c 0 2024-09-04T16:30:11.353 INFO:tasks.workunit.client.0.smithi170.stdout:8/179: symlink d6/d28/d20/l3d 0 2024-09-04T16:30:11.354 INFO:tasks.workunit.client.0.smithi170.stdout:8/180: chown d6/l14 58 1 2024-09-04T16:30:11.361 INFO:tasks.workunit.client.1.smithi193.stdout:4/421: symlink d3/d81/l8f 0 2024-09-04T16:30:11.362 INFO:tasks.workunit.client.1.smithi193.stdout:5/537: mknod d1/d8/cab 0 2024-09-04T16:30:11.366 INFO:tasks.workunit.client.1.smithi193.stdout:3/515: write d0/d18/d1c/d25/f78 [1196143,77167] 0 2024-09-04T16:30:11.367 INFO:tasks.workunit.client.1.smithi193.stdout:5/538: dread d1/d8/db/fa6 [0,4194304] 0 2024-09-04T16:30:11.368 INFO:tasks.workunit.client.0.smithi170.stdout:8/181: rename d6/d28/d1a/f3c to d6/d28/d1a/d2f/f3e 0 2024-09-04T16:30:11.369 INFO:tasks.workunit.client.1.smithi193.stdout:4/422: symlink d3/d1a/l90 0 2024-09-04T16:30:11.369 INFO:tasks.workunit.client.0.smithi170.stdout:8/182: read d6/d26/f2b [2327435,89336] 0 2024-09-04T16:30:11.370 INFO:tasks.workunit.client.1.smithi193.stdout:8/556: rename d2/c1a to d2/cbb 0 2024-09-04T16:30:11.370 INFO:tasks.workunit.client.1.smithi193.stdout:5/539: write d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f89 [699591,37057] 0 2024-09-04T16:30:11.371 INFO:tasks.workunit.client.1.smithi193.stdout:6/488: dread d5/f19 [0,4194304] 0 2024-09-04T16:30:11.372 INFO:tasks.workunit.client.1.smithi193.stdout:1/568: truncate d1/d2b/d10/f1f 8409173 0 2024-09-04T16:30:11.372 INFO:tasks.workunit.client.1.smithi193.stdout:4/423: read d3/d39/f79 [1696048,14098] 0 2024-09-04T16:30:11.373 INFO:tasks.workunit.client.0.smithi170.stdout:8/183: creat d6/d28/d1a/d2f/f3f x:0 0 0 2024-09-04T16:30:11.373 INFO:tasks.workunit.client.1.smithi193.stdout:4/424: chown d3/d1a/d21/c32 0 1 2024-09-04T16:30:11.374 INFO:tasks.workunit.client.1.smithi193.stdout:3/516: truncate d0/d18/d1c/d30/f41 1984116 0 2024-09-04T16:30:11.376 INFO:tasks.workunit.client.0.smithi170.stdout:8/184: mkdir d6/d28/d40 0 2024-09-04T16:30:11.376 INFO:tasks.workunit.client.1.smithi193.stdout:8/557: write d2/d12/f19 [2125461,84559] 0 2024-09-04T16:30:11.377 INFO:tasks.workunit.client.0.smithi170.stdout:8/185: write d6/d28/d1a/d2f/f35 [2113928,65572] 0 2024-09-04T16:30:11.378 INFO:tasks.workunit.client.1.smithi193.stdout:4/425: fdatasync d3/d1a/f3d 0 2024-09-04T16:30:11.378 INFO:tasks.workunit.client.1.smithi193.stdout:5/540: symlink d1/d29/d18/lac 0 2024-09-04T16:30:11.379 INFO:tasks.workunit.client.1.smithi193.stdout:6/489: dwrite d5/d33/d4e/d51/f80 [0,4194304] 0 2024-09-04T16:30:11.383 INFO:tasks.workunit.client.1.smithi193.stdout:1/569: rename d1/d2b/d1b/l27 to d1/d2b/db/d7f/laf 0 2024-09-04T16:30:11.389 INFO:tasks.workunit.client.1.smithi193.stdout:8/558: mknod d2/d20/d23/d24/d3c/d65/d67/cbc 0 2024-09-04T16:30:11.390 INFO:tasks.workunit.client.1.smithi193.stdout:8/559: read d2/d20/d23/d51/f63 [150826,119964] 0 2024-09-04T16:30:11.392 INFO:tasks.workunit.client.1.smithi193.stdout:4/426: write d3/d1a/d2a/f8a [1681051,97315] 0 2024-09-04T16:30:11.394 INFO:tasks.workunit.client.1.smithi193.stdout:4/427: fdatasync d3/d1a/d54/f64 0 2024-09-04T16:30:11.394 INFO:tasks.workunit.client.1.smithi193.stdout:5/541: unlink d1/d8/db/d15/d2b/d83/d37/d58/c95 0 2024-09-04T16:30:11.396 INFO:tasks.workunit.client.1.smithi193.stdout:5/542: write d1/d8/db/d15/d2b/d83/d37/f9d [2395274,74697] 0 2024-09-04T16:30:11.396 INFO:tasks.workunit.client.1.smithi193.stdout:8/560: creat d2/d20/d23/d51/fbd x:0 0 0 2024-09-04T16:30:11.400 INFO:tasks.workunit.client.1.smithi193.stdout:5/543: dread d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f89 [0,4194304] 0 2024-09-04T16:30:11.401 INFO:tasks.workunit.client.1.smithi193.stdout:5/544: dread - d1/d8/db/d15/f73 zero size 2024-09-04T16:30:11.453 INFO:tasks.workunit.client.1.smithi193.stdout:7/614: sync 2024-09-04T16:30:11.506 INFO:tasks.workunit.client.1.smithi193.stdout:2/495: sync 2024-09-04T16:30:11.506 INFO:tasks.workunit.client.1.smithi193.stdout:0/526: sync 2024-09-04T16:30:11.506 INFO:tasks.workunit.client.1.smithi193.stdout:9/576: sync 2024-09-04T16:30:11.506 INFO:tasks.workunit.client.1.smithi193.stdout:9/577: stat d2/d8/d88 0 2024-09-04T16:30:11.506 INFO:tasks.workunit.client.1.smithi193.stdout:0/527: chown d18/d25/d32/d57/f84 0 1 2024-09-04T16:30:11.514 INFO:tasks.workunit.client.1.smithi193.stdout:3/517: write d0/d18/d1c/d30/f33 [2154008,96459] 0 2024-09-04T16:30:11.517 INFO:tasks.workunit.client.1.smithi193.stdout:1/570: link d1/d2b/d10/d2a/l36 d1/d2b/db/d9e/lb0 0 2024-09-04T16:30:11.518 INFO:tasks.workunit.client.1.smithi193.stdout:1/571: truncate d1/d2b/d1b/d51/d6d/f90 969475 0 2024-09-04T16:30:11.521 INFO:tasks.workunit.client.0.smithi170.stdout:8/186: dwrite d6/d28/d1a/d2f/f3e [0,4194304] 0 2024-09-04T16:30:11.523 INFO:tasks.workunit.client.0.smithi170.stdout:8/187: truncate d6/d28/d1a/f23 4756531 0 2024-09-04T16:30:11.524 INFO:tasks.workunit.client.0.smithi170.stdout:8/188: write d6/d28/d1a/d2f/f3e [801801,95709] 0 2024-09-04T16:30:11.524 INFO:tasks.workunit.client.1.smithi193.stdout:0/528: unlink d18/d25/d32/d57/fa5 0 2024-09-04T16:30:11.524 INFO:tasks.workunit.client.1.smithi193.stdout:7/615: dread d9/d18/d22/d2b/f91 [0,4194304] 0 2024-09-04T16:30:11.525 INFO:tasks.workunit.client.1.smithi193.stdout:0/529: fdatasync d18/d25/d5f/d6a/d7b/fac 0 2024-09-04T16:30:11.525 INFO:tasks.workunit.client.1.smithi193.stdout:9/578: rename d2/c65 to d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/cb1 0 2024-09-04T16:30:11.528 INFO:tasks.workunit.client.1.smithi193.stdout:4/428: creat d3/d1a/d21/d52/d5e/d7b/f91 x:0 0 0 2024-09-04T16:30:11.530 INFO:tasks.workunit.client.1.smithi193.stdout:3/518: mkdir d0/d18/d1b/d3d/daf 0 2024-09-04T16:30:11.531 INFO:tasks.workunit.client.1.smithi193.stdout:8/561: creat d2/d20/d23/d34/d4b/db8/fbe x:0 0 0 2024-09-04T16:30:11.532 INFO:tasks.workunit.client.1.smithi193.stdout:3/519: chown d0/d7/de/d45/f8d 57 1 2024-09-04T16:30:11.533 INFO:tasks.workunit.client.1.smithi193.stdout:6/490: dwrite d5/de/d15/d1b/f99 [0,4194304] 0 2024-09-04T16:30:11.535 INFO:tasks.workunit.client.1.smithi193.stdout:6/491: write d5/d27/d3e/f69 [254657,83989] 0 2024-09-04T16:30:11.540 INFO:tasks.workunit.client.1.smithi193.stdout:1/572: mkdir d1/d2b/d10/d56/da7/db1 0 2024-09-04T16:30:11.540 INFO:tasks.workunit.client.1.smithi193.stdout:2/496: rename d2/d9/d18/l4d to d2/d9/d18/laf 0 2024-09-04T16:30:11.542 INFO:tasks.workunit.client.0.smithi170.stdout:8/189: write d6/fa [44861,111041] 0 2024-09-04T16:30:11.543 INFO:tasks.workunit.client.1.smithi193.stdout:7/616: symlink d9/d18/d22/d2b/d6c/ld0 0 2024-09-04T16:30:11.543 INFO:tasks.workunit.client.0.smithi170.stdout:8/190: dread - d6/d28/d1a/d2f/f3f zero size 2024-09-04T16:30:11.544 INFO:tasks.workunit.client.1.smithi193.stdout:0/530: creat d18/d25/d3b/fae x:0 0 0 2024-09-04T16:30:11.544 INFO:tasks.workunit.client.0.smithi170.stdout:8/191: chown d6/l14 16 1 2024-09-04T16:30:11.544 INFO:tasks.workunit.client.0.smithi170.stdout:8/192: chown d6/d28/c3b 343000202 1 2024-09-04T16:30:11.545 INFO:tasks.workunit.client.0.smithi170.stdout:8/193: fsync d6/d28/d1a/f23 0 2024-09-04T16:30:11.547 INFO:tasks.workunit.client.1.smithi193.stdout:8/562: dread d2/d20/f36 [0,4194304] 0 2024-09-04T16:30:11.554 INFO:tasks.workunit.client.1.smithi193.stdout:6/492: rename d5/d27/d3e/d43/d5d/c91 to d5/d27/d3e/d43/d5d/ca3 0 2024-09-04T16:30:11.554 INFO:tasks.workunit.client.1.smithi193.stdout:1/573: unlink d1/d2b/db/f7e 0 2024-09-04T16:30:11.554 INFO:tasks.workunit.client.1.smithi193.stdout:2/497: mknod d2/d9/db/d10/d38/d63/cb0 0 2024-09-04T16:30:11.555 INFO:tasks.workunit.client.0.smithi170.stdout:8/194: dwrite d6/d28/d1a/d2f/f3e [4194304,4194304] 0 2024-09-04T16:30:11.555 INFO:tasks.workunit.client.0.smithi170.stdout:9/201: sync 2024-09-04T16:30:11.557 INFO:tasks.workunit.client.1.smithi193.stdout:2/498: dwrite d2/d9/db/d10/d1e/da4/d9a/fa9 [0,4194304] 0 2024-09-04T16:30:11.558 INFO:tasks.workunit.client.1.smithi193.stdout:0/531: symlink d18/d25/d3b/laf 0 2024-09-04T16:30:11.559 INFO:tasks.workunit.client.1.smithi193.stdout:0/532: fdatasync d18/d25/d32/d57/f84 0 2024-09-04T16:30:11.559 INFO:tasks.workunit.client.1.smithi193.stdout:2/499: dread - d2/d9/db/d10/d1e/da4/f6d zero size 2024-09-04T16:30:11.561 INFO:tasks.workunit.client.1.smithi193.stdout:9/579: truncate d2/d18/d2f/f47 4986481 0 2024-09-04T16:30:11.563 INFO:tasks.workunit.client.1.smithi193.stdout:9/580: write d2/d18/d2f/d22/d30/d6a/fa7 [697457,123443] 0 2024-09-04T16:30:11.563 INFO:tasks.workunit.client.1.smithi193.stdout:4/429: write d3/f1f [112178,31129] 0 2024-09-04T16:30:11.566 INFO:tasks.workunit.client.1.smithi193.stdout:8/563: chown d2/c4 2076 1 2024-09-04T16:30:11.567 INFO:tasks.workunit.client.0.smithi170.stdout:8/195: link d6/d28/d1a/d2f/f3f d6/f41 0 2024-09-04T16:30:11.568 INFO:tasks.workunit.client.1.smithi193.stdout:5/545: getdents d1/d8/db/d15/d2b/d83/d37/d58/d9e 0 2024-09-04T16:30:11.569 INFO:tasks.workunit.client.0.smithi170.stdout:8/196: write d6/d28/d1a/d2f/f35 [3423007,38387] 0 2024-09-04T16:30:11.572 INFO:tasks.workunit.client.1.smithi193.stdout:1/574: stat d1/d2b/db/d54/c55 0 2024-09-04T16:30:11.574 INFO:tasks.workunit.client.1.smithi193.stdout:1/575: chown d1/d2b/d10/d56/cad 7878 1 2024-09-04T16:30:11.574 INFO:tasks.workunit.client.0.smithi170.stdout:8/197: creat d6/d28/d1a/f42 x:0 0 0 2024-09-04T16:30:11.575 INFO:tasks.workunit.client.1.smithi193.stdout:1/576: chown d1/d2b/d1b/d51/d6d/f7a 1686 1 2024-09-04T16:30:11.575 INFO:tasks.workunit.client.0.smithi170.stdout:9/202: write d2/f17 [4802447,65989] 0 2024-09-04T16:30:11.576 INFO:tasks.workunit.client.1.smithi193.stdout:1/577: chown d1/d2b/d1b/d51 194 1 2024-09-04T16:30:11.576 INFO:tasks.workunit.client.1.smithi193.stdout:1/578: stat d1/la 0 2024-09-04T16:30:11.577 INFO:tasks.workunit.client.1.smithi193.stdout:3/520: rename d0/d7/de/faa to d0/d18/d1b/dab/fb0 0 2024-09-04T16:30:11.579 INFO:tasks.workunit.client.0.smithi170.stdout:8/198: rmdir d6/d28 39 2024-09-04T16:30:11.581 INFO:tasks.workunit.client.0.smithi170.stdout:9/203: creat d2/d7/d27/f3a x:0 0 0 2024-09-04T16:30:11.581 INFO:tasks.workunit.client.1.smithi193.stdout:9/581: dread d2/d18/d2f/d22/d30/f72 [0,4194304] 0 2024-09-04T16:30:11.584 INFO:tasks.workunit.client.1.smithi193.stdout:0/533: creat d18/d25/d5f/fb0 x:0 0 0 2024-09-04T16:30:11.587 INFO:tasks.workunit.client.0.smithi170.stdout:9/204: dwrite d2/fd [0,4194304] 0 2024-09-04T16:30:11.587 INFO:tasks.workunit.client.1.smithi193.stdout:4/430: symlink d3/d1a/d21/d52/d7f/l92 0 2024-09-04T16:30:11.588 INFO:tasks.workunit.client.0.smithi170.stdout:8/199: dread d6/d28/d1a/f23 [4194304,4194304] 0 2024-09-04T16:30:11.596 INFO:tasks.workunit.client.0.smithi170.stdout:8/200: dwrite d6/d28/d1a/d2f/f35 [0,4194304] 0 2024-09-04T16:30:11.598 INFO:tasks.workunit.client.1.smithi193.stdout:5/546: write d1/d8/f34 [1013433,100402] 0 2024-09-04T16:30:11.600 INFO:tasks.workunit.client.0.smithi170.stdout:9/205: link d2/d11/d23/l39 d2/d32/l3b 0 2024-09-04T16:30:11.602 INFO:tasks.workunit.client.1.smithi193.stdout:9/582: mkdir d2/d8/d25/db2 0 2024-09-04T16:30:11.604 INFO:tasks.workunit.client.0.smithi170.stdout:9/206: rmdir d2/d32 39 2024-09-04T16:30:11.605 INFO:tasks.workunit.client.1.smithi193.stdout:7/617: write d9/d39/d3e/d69/f80 [325067,18408] 0 2024-09-04T16:30:11.607 INFO:tasks.workunit.client.1.smithi193.stdout:2/500: mknod d2/d9/db/d10/d1f/d77/d91/cb1 0 2024-09-04T16:30:11.607 INFO:tasks.workunit.client.1.smithi193.stdout:4/431: dread d3/f14 [0,4194304] 0 2024-09-04T16:30:11.607 INFO:tasks.workunit.client.0.smithi170.stdout:8/201: link d6/d26/f2b d6/d28/d16/f43 0 2024-09-04T16:30:11.608 INFO:tasks.workunit.client.1.smithi193.stdout:2/501: readlink d2/l7e 0 2024-09-04T16:30:11.608 INFO:tasks.workunit.client.1.smithi193.stdout:3/521: dread d0/d7/fa6 [0,4194304] 0 2024-09-04T16:30:11.609 INFO:tasks.workunit.client.1.smithi193.stdout:2/502: write d2/d9/db/d10/d1f/d22/f93 [1996691,48974] 0 2024-09-04T16:30:11.610 INFO:tasks.workunit.client.1.smithi193.stdout:2/503: chown d2/d9/db/d10/d38/da5/daa 16 1 2024-09-04T16:30:11.611 INFO:tasks.workunit.client.1.smithi193.stdout:2/504: fsync d2/f7 0 2024-09-04T16:30:11.612 INFO:tasks.workunit.client.0.smithi170.stdout:8/202: creat d6/d28/d16/f44 x:0 0 0 2024-09-04T16:30:11.612 INFO:tasks.workunit.client.0.smithi170.stdout:9/207: mknod d2/d32/c3c 0 2024-09-04T16:30:11.613 INFO:tasks.workunit.client.1.smithi193.stdout:6/493: link d5/d27/d3e/d6e/l74 d5/d33/d4e/d51/d68/la4 0 2024-09-04T16:30:11.614 INFO:tasks.workunit.client.1.smithi193.stdout:3/522: dread d0/d9/f58 [0,4194304] 0 2024-09-04T16:30:11.615 INFO:tasks.workunit.client.1.smithi193.stdout:5/547: rename d1/d8/db/d36/d40/f62 to d1/d8/db/d15/d2b/d83/d37/d58/fad 0 2024-09-04T16:30:11.616 INFO:tasks.workunit.client.1.smithi193.stdout:9/583: mknod d2/d8/cb3 0 2024-09-04T16:30:11.617 INFO:tasks.workunit.client.0.smithi170.stdout:9/208: read d2/d11/f24 [966984,105127] 0 2024-09-04T16:30:11.618 INFO:tasks.workunit.client.0.smithi170.stdout:8/203: dread d6/d28/f1d [0,4194304] 0 2024-09-04T16:30:11.619 INFO:tasks.workunit.client.1.smithi193.stdout:6/494: dwrite d5/f5e [0,4194304] 0 2024-09-04T16:30:11.621 INFO:tasks.workunit.client.0.smithi170.stdout:8/204: chown d6/le 634 1 2024-09-04T16:30:11.621 INFO:tasks.workunit.client.1.smithi193.stdout:8/564: write d2/d20/d23/d24/d3c/d65/d67/f68 [4130629,82401] 0 2024-09-04T16:30:11.622 INFO:tasks.workunit.client.1.smithi193.stdout:2/505: rmdir d2/d9 39 2024-09-04T16:30:11.623 INFO:tasks.workunit.client.0.smithi170.stdout:9/209: rename d2/d7 to d2/d3d 0 2024-09-04T16:30:11.623 INFO:tasks.workunit.client.0.smithi170.stdout:9/210: readlink d2/d3d/d27/l28 0 2024-09-04T16:30:11.623 INFO:tasks.workunit.client.0.smithi170.stdout:9/211: chown d2/d11/d23/d2a 5043 1 2024-09-04T16:30:11.624 INFO:tasks.workunit.client.1.smithi193.stdout:8/565: fsync d2/d20/d23/d34/fb4 0 2024-09-04T16:30:11.625 INFO:tasks.workunit.client.0.smithi170.stdout:8/205: creat d6/d28/d1a/f45 x:0 0 0 2024-09-04T16:30:11.625 INFO:tasks.workunit.client.1.smithi193.stdout:1/579: creat d1/d2b/d10/fb2 x:0 0 0 2024-09-04T16:30:11.625 INFO:tasks.workunit.client.0.smithi170.stdout:8/206: stat d6/d28/d1a/f36 0 2024-09-04T16:30:11.628 INFO:tasks.workunit.client.1.smithi193.stdout:6/495: dwrite d5/d27/d3e/f73 [0,4194304] 0 2024-09-04T16:30:11.630 INFO:tasks.workunit.client.1.smithi193.stdout:4/432: rename d3/fd to d3/d1a/d2a/d83/f93 0 2024-09-04T16:30:11.631 INFO:tasks.workunit.client.1.smithi193.stdout:4/433: fsync d3/d39/d44/f6a 0 2024-09-04T16:30:11.631 INFO:tasks.workunit.client.0.smithi170.stdout:9/212: dread d2/d3d/fc [0,4194304] 0 2024-09-04T16:30:11.631 INFO:tasks.workunit.client.1.smithi193.stdout:4/434: fdatasync d3/d1a/d21/d52/d5e/f71 0 2024-09-04T16:30:11.633 INFO:tasks.workunit.client.0.smithi170.stdout:9/213: chown d2/d3d/fc 61382 1 2024-09-04T16:30:11.634 INFO:tasks.workunit.client.1.smithi193.stdout:5/548: mkdir d1/d29/d74/dae 0 2024-09-04T16:30:11.634 INFO:tasks.workunit.client.0.smithi170.stdout:8/207: dwrite d6/d28/f1d [0,4194304] 0 2024-09-04T16:30:11.636 INFO:tasks.workunit.client.0.smithi170.stdout:8/208: chown d6/d28/d1a/d2f/l39 239521470 1 2024-09-04T16:30:11.637 INFO:tasks.workunit.client.0.smithi170.stdout:9/214: read d2/d11/d23/f29 [127834,20218] 0 2024-09-04T16:30:11.643 INFO:tasks.workunit.client.1.smithi193.stdout:7/618: unlink d9/de/d27/c46 0 2024-09-04T16:30:11.647 INFO:tasks.workunit.client.0.smithi170.stdout:8/209: mkdir d6/d28/d16/d24/d46 0 2024-09-04T16:30:11.647 INFO:tasks.workunit.client.0.smithi170.stdout:9/215: dwrite d2/d11/d23/f30 [0,4194304] 0 2024-09-04T16:30:11.647 INFO:tasks.workunit.client.0.smithi170.stdout:9/216: chown d2/d3d/d27/f2e 447766717 1 2024-09-04T16:30:11.647 INFO:tasks.workunit.client.0.smithi170.stdout:9/217: readlink d2/d3d/l25 0 2024-09-04T16:30:11.655 INFO:tasks.workunit.client.1.smithi193.stdout:8/566: creat d2/d20/d23/d51/d59/fbf x:0 0 0 2024-09-04T16:30:11.655 INFO:tasks.workunit.client.1.smithi193.stdout:3/523: dwrite d0/d7/de/d45/f8d [4194304,4194304] 0 2024-09-04T16:30:11.655 INFO:tasks.workunit.client.0.smithi170.stdout:9/218: symlink d2/d3d/d27/d2b/l3e 0 2024-09-04T16:30:11.663 INFO:tasks.workunit.client.1.smithi193.stdout:6/496: creat d5/d33/d4e/d51/d71/d82/fa5 x:0 0 0 2024-09-04T16:30:11.663 INFO:tasks.workunit.client.1.smithi193.stdout:6/497: dread - d5/d33/d85/fa1 zero size 2024-09-04T16:30:11.666 INFO:tasks.workunit.client.1.smithi193.stdout:0/534: getdents d18/d25/d32/d9c 0 2024-09-04T16:30:11.668 INFO:tasks.workunit.client.1.smithi193.stdout:0/535: fsync d18/d25/d5f/fb0 0 2024-09-04T16:30:11.668 INFO:tasks.workunit.client.1.smithi193.stdout:8/567: stat d2/d20/cba 0 2024-09-04T16:30:11.669 INFO:tasks.workunit.client.1.smithi193.stdout:4/435: symlink d3/d1a/l94 0 2024-09-04T16:30:11.670 INFO:tasks.workunit.client.1.smithi193.stdout:3/524: chown d0/d18/d1b/f36 59707 1 2024-09-04T16:30:11.671 INFO:tasks.workunit.client.1.smithi193.stdout:8/568: fsync d2/d20/d23/d24/f49 0 2024-09-04T16:30:11.672 INFO:tasks.workunit.client.1.smithi193.stdout:6/498: chown d5/d27/d3e/d43/d5d/ca3 8913 1 2024-09-04T16:30:11.674 INFO:tasks.workunit.client.1.smithi193.stdout:1/580: dwrite d1/d2b/d1b/d28/d50/f5d [0,4194304] 0 2024-09-04T16:30:11.674 INFO:tasks.workunit.client.1.smithi193.stdout:7/619: creat d9/d18/fd1 x:0 0 0 2024-09-04T16:30:11.675 INFO:tasks.workunit.client.1.smithi193.stdout:5/549: getdents d1/d29/d74 0 2024-09-04T16:30:11.677 INFO:tasks.workunit.client.1.smithi193.stdout:4/436: rename d3/d39/f5a to d3/d3c/d47/f95 0 2024-09-04T16:30:11.678 INFO:tasks.workunit.client.1.smithi193.stdout:3/525: mknod d0/d10/d24/d55/cb1 0 2024-09-04T16:30:11.680 INFO:tasks.workunit.client.1.smithi193.stdout:1/581: creat d1/fb3 x:0 0 0 2024-09-04T16:30:11.681 INFO:tasks.workunit.client.1.smithi193.stdout:9/584: dwrite d2/d8/d15/f48 [0,4194304] 0 2024-09-04T16:30:11.684 INFO:tasks.workunit.client.1.smithi193.stdout:7/620: fsync d9/d39/d3e/d4d/fbe 0 2024-09-04T16:30:11.685 INFO:tasks.workunit.client.1.smithi193.stdout:4/437: symlink d3/d81/l96 0 2024-09-04T16:30:11.686 INFO:tasks.workunit.client.1.smithi193.stdout:2/506: dwrite d2/d9/db/d10/f6e [0,4194304] 0 2024-09-04T16:30:11.688 INFO:tasks.workunit.client.1.smithi193.stdout:0/536: dwrite d18/d25/d5f/f81 [4194304,4194304] 0 2024-09-04T16:30:11.689 INFO:tasks.workunit.client.1.smithi193.stdout:1/582: rmdir d1/d2b/d10 39 2024-09-04T16:30:11.690 INFO:tasks.workunit.client.1.smithi193.stdout:5/550: fsync d1/d8/db/d15/d2b/d83/d37/d3f/d8e/f66 0 2024-09-04T16:30:11.690 INFO:tasks.workunit.client.1.smithi193.stdout:3/526: truncate d0/d18/d1b/d3d/fa8 843974 0 2024-09-04T16:30:11.691 INFO:tasks.workunit.client.1.smithi193.stdout:6/499: rmdir d5/d33/d4e/d51/d68/d70 0 2024-09-04T16:30:11.694 INFO:tasks.workunit.client.1.smithi193.stdout:9/585: mkdir d2/db4 0 2024-09-04T16:30:11.697 INFO:tasks.workunit.client.1.smithi193.stdout:6/500: chown d5/d33/d4e/d51 4377762 1 2024-09-04T16:30:11.697 INFO:tasks.workunit.client.1.smithi193.stdout:4/438: readlink d3/d1a/d21/d52/d5e/l65 0 2024-09-04T16:30:11.699 INFO:tasks.workunit.client.1.smithi193.stdout:0/537: unlink d18/c1e 0 2024-09-04T16:30:11.699 INFO:tasks.workunit.client.1.smithi193.stdout:4/439: fdatasync d3/f10 0 2024-09-04T16:30:11.699 INFO:tasks.workunit.client.1.smithi193.stdout:8/569: dwrite d2/d20/d23/d34/d46/d53/fa5 [0,4194304] 0 2024-09-04T16:30:11.700 INFO:tasks.workunit.client.1.smithi193.stdout:5/551: unlink d1/d8/db/d15/d2b/d83/d37/d3f/d8e/l92 0 2024-09-04T16:30:11.701 INFO:tasks.workunit.client.1.smithi193.stdout:1/583: chown d1/d2b/db/d7f/laf 0 1 2024-09-04T16:30:11.702 INFO:tasks.workunit.client.1.smithi193.stdout:7/621: mkdir d9/d39/d3e/d69/dc0/dd2 0 2024-09-04T16:30:11.704 INFO:tasks.workunit.client.1.smithi193.stdout:1/584: chown d1/d39/d48/l79 20 1 2024-09-04T16:30:11.705 INFO:tasks.workunit.client.1.smithi193.stdout:7/622: chown d9/de/d27/f84 84 1 2024-09-04T16:30:11.705 INFO:tasks.workunit.client.1.smithi193.stdout:9/586: unlink d2/d8/d88/l9d 0 2024-09-04T16:30:11.706 INFO:tasks.workunit.client.1.smithi193.stdout:4/440: chown d3/d1a/d2a/f3b 4862 1 2024-09-04T16:30:11.707 INFO:tasks.workunit.client.1.smithi193.stdout:3/527: rename d0/d18/d1c/d25/d5e/d68/l69 to d0/d10/lb2 0 2024-09-04T16:30:11.708 INFO:tasks.workunit.client.1.smithi193.stdout:1/585: symlink d1/d39/d48/lb4 0 2024-09-04T16:30:11.710 INFO:tasks.workunit.client.1.smithi193.stdout:3/528: chown d0/d7/f6b 9 1 2024-09-04T16:30:11.711 INFO:tasks.workunit.client.1.smithi193.stdout:7/623: creat d9/d18/d22/d2b/d6c/fd3 x:0 0 0 2024-09-04T16:30:11.712 INFO:tasks.workunit.client.1.smithi193.stdout:4/441: truncate d3/d3c/f53 357752 0 2024-09-04T16:30:11.713 INFO:tasks.workunit.client.1.smithi193.stdout:9/587: write d2/d8/d15/f34 [1441382,106248] 0 2024-09-04T16:30:11.714 INFO:tasks.workunit.client.1.smithi193.stdout:8/570: rename d2/d20/d23/d51/d59 to d2/d20/dc0 0 2024-09-04T16:30:11.716 INFO:tasks.workunit.client.1.smithi193.stdout:1/586: creat d1/d2b/d1b/d51/d6d/fb5 x:0 0 0 2024-09-04T16:30:11.717 INFO:tasks.workunit.client.1.smithi193.stdout:0/538: dwrite d18/d25/d32/d57/f4e [0,4194304] 0 2024-09-04T16:30:11.718 INFO:tasks.workunit.client.1.smithi193.stdout:3/529: write d0/d18/d1c/d30/f4e [1058097,42264] 0 2024-09-04T16:30:11.718 INFO:tasks.workunit.client.1.smithi193.stdout:5/552: link d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/d55/f9c d1/d29/d18/faf 0 2024-09-04T16:30:11.719 INFO:tasks.workunit.client.1.smithi193.stdout:6/501: dwrite d5/de/d15/f67 [0,4194304] 0 2024-09-04T16:30:11.723 INFO:tasks.workunit.client.1.smithi193.stdout:8/571: write d2/d20/d23/d34/d46/d53/fa5 [4884890,583] 0 2024-09-04T16:30:11.725 INFO:tasks.workunit.client.1.smithi193.stdout:7/624: rename d9/d39/d3e/d69/dc0 to d9/d11/dd4 0 2024-09-04T16:30:11.726 INFO:tasks.workunit.client.1.smithi193.stdout:4/442: truncate d3/d39/f79 1563308 0 2024-09-04T16:30:11.727 INFO:tasks.workunit.client.1.smithi193.stdout:5/553: fdatasync d1/d8/db/d15/d2b/d83/d37/d88/f25 0 2024-09-04T16:30:11.727 INFO:tasks.workunit.client.1.smithi193.stdout:0/539: mkdir d18/d25/d32/d57/d6c/db1 0 2024-09-04T16:30:11.728 INFO:tasks.workunit.client.1.smithi193.stdout:4/443: read - d3/f8e zero size 2024-09-04T16:30:11.729 INFO:tasks.workunit.client.1.smithi193.stdout:4/444: write d3/d39/d44/f74 [470454,71560] 0 2024-09-04T16:30:11.729 INFO:tasks.workunit.client.0.smithi170.stdout:9/219: unlink d2/d3d/l25 0 2024-09-04T16:30:11.729 INFO:tasks.workunit.client.0.smithi170.stdout:8/210: getdents d6/d28/d40 0 2024-09-04T16:30:11.730 INFO:tasks.workunit.client.1.smithi193.stdout:4/445: fdatasync d3/d39/d44/f6a 0 2024-09-04T16:30:11.733 INFO:tasks.workunit.client.1.smithi193.stdout:2/507: dread d2/d9/db/d10/d1f/f42 [0,4194304] 0 2024-09-04T16:30:11.734 INFO:tasks.workunit.client.1.smithi193.stdout:2/508: read d2/d9/d18/f6f [3810053,73628] 0 2024-09-04T16:30:11.734 INFO:tasks.workunit.client.0.smithi170.stdout:8/211: creat d6/d28/d1a/d2f/f47 x:0 0 0 2024-09-04T16:30:11.736 INFO:tasks.workunit.client.1.smithi193.stdout:0/540: dread d18/d25/f8a [0,4194304] 0 2024-09-04T16:30:11.736 INFO:tasks.workunit.client.1.smithi193.stdout:9/588: write d2/f28 [4944137,9757] 0 2024-09-04T16:30:11.738 INFO:tasks.workunit.client.1.smithi193.stdout:6/502: creat d5/d27/da0/fa6 x:0 0 0 2024-09-04T16:30:11.738 INFO:tasks.workunit.client.0.smithi170.stdout:8/212: dread d6/d28/d16/f43 [0,4194304] 0 2024-09-04T16:30:11.739 INFO:tasks.workunit.client.1.smithi193.stdout:1/587: mkdir d1/d2b/d10/db6 0 2024-09-04T16:30:11.741 INFO:tasks.workunit.client.1.smithi193.stdout:1/588: fsync d1/d2b/d10/d2a/f6f 0 2024-09-04T16:30:11.741 INFO:tasks.workunit.client.1.smithi193.stdout:4/446: creat d3/d3c/d89/f97 x:0 0 0 2024-09-04T16:30:11.741 INFO:tasks.workunit.client.0.smithi170.stdout:9/220: getdents d2 0 2024-09-04T16:30:11.742 INFO:tasks.workunit.client.1.smithi193.stdout:4/447: chown d3/d1a/c20 379 1 2024-09-04T16:30:11.742 INFO:tasks.workunit.client.1.smithi193.stdout:1/589: dread - d1/d2b/d1b/d51/f8b zero size 2024-09-04T16:30:11.744 INFO:tasks.workunit.client.1.smithi193.stdout:7/625: creat d9/de/d27/d62/d72/fd5 x:0 0 0 2024-09-04T16:30:11.744 INFO:tasks.workunit.client.1.smithi193.stdout:6/503: dwrite d5/d27/d3e/f7f [0,4194304] 0 2024-09-04T16:30:11.748 INFO:tasks.workunit.client.0.smithi170.stdout:8/213: write d6/d28/d16/f43 [1564303,82644] 0 2024-09-04T16:30:11.750 INFO:tasks.workunit.client.1.smithi193.stdout:4/448: dread d3/d1a/d2a/f8a [0,4194304] 0 2024-09-04T16:30:11.751 INFO:tasks.workunit.client.1.smithi193.stdout:2/509: symlink d2/d9/db/d10/d51/lb2 0 2024-09-04T16:30:11.752 INFO:tasks.workunit.client.1.smithi193.stdout:2/510: stat d2/d9/db/d65/f6a 0 2024-09-04T16:30:11.752 INFO:tasks.workunit.client.1.smithi193.stdout:2/511: dread - d2/d9/db/d10/d38/d63/f9f zero size 2024-09-04T16:30:11.753 INFO:tasks.workunit.client.1.smithi193.stdout:2/512: dread - d2/d9/db/d65/f9e zero size 2024-09-04T16:30:11.756 INFO:tasks.workunit.client.0.smithi170.stdout:8/214: dwrite d6/d26/f2b [0,4194304] 0 2024-09-04T16:30:11.756 INFO:tasks.workunit.client.1.smithi193.stdout:2/513: dread d2/d9/db/f2e [0,4194304] 0 2024-09-04T16:30:11.761 INFO:tasks.workunit.client.1.smithi193.stdout:2/514: fdatasync d2/d9/db/f75 0 2024-09-04T16:30:11.761 INFO:tasks.workunit.client.1.smithi193.stdout:0/541: creat d18/d25/d5f/d65/fb2 x:0 0 0 2024-09-04T16:30:11.762 INFO:tasks.workunit.client.0.smithi170.stdout:8/215: chown d6/d26/c37 345880 1 2024-09-04T16:30:11.765 INFO:tasks.workunit.client.0.smithi170.stdout:9/221: truncate d2/d11/f24 2062434 0 2024-09-04T16:30:11.766 INFO:tasks.workunit.client.0.smithi170.stdout:9/222: write d2/d11/f12 [4529879,24242] 0 2024-09-04T16:30:11.767 INFO:tasks.workunit.client.1.smithi193.stdout:3/530: rename d0/d3b/c53 to d0/d10/cb3 0 2024-09-04T16:30:11.768 INFO:tasks.workunit.client.1.smithi193.stdout:7/626: symlink d9/de/ld6 0 2024-09-04T16:30:11.768 INFO:tasks.workunit.client.1.smithi193.stdout:3/531: dread - d0/d18/d1c/d30/fac zero size 2024-09-04T16:30:11.769 INFO:tasks.workunit.client.1.smithi193.stdout:5/554: dwrite d1/d8/db/d15/f30 [0,4194304] 0 2024-09-04T16:30:11.770 INFO:tasks.workunit.client.0.smithi170.stdout:8/216: fsync d6/d26/f2b 0 2024-09-04T16:30:11.771 INFO:tasks.workunit.client.1.smithi193.stdout:6/504: mkdir d5/de/d15/d1b/d5f/da7 0 2024-09-04T16:30:11.772 INFO:tasks.workunit.client.0.smithi170.stdout:9/223: getdents d2/d3d/d35 0 2024-09-04T16:30:11.776 INFO:tasks.workunit.client.1.smithi193.stdout:5/555: dwrite d1/d8/db/d36/d40/d46/f8b [0,4194304] 0 2024-09-04T16:30:11.779 INFO:tasks.workunit.client.0.smithi170.stdout:9/224: write d2/d3d/d27/f2e [14942,80250] 0 2024-09-04T16:30:11.783 INFO:tasks.workunit.client.1.smithi193.stdout:1/590: mkdir d1/d2b/d10/db7 0 2024-09-04T16:30:11.784 INFO:tasks.workunit.client.1.smithi193.stdout:1/591: write d1/d2b/db/f5b [1660207,102462] 0 2024-09-04T16:30:11.785 INFO:tasks.workunit.client.0.smithi170.stdout:9/225: unlink d2/c6 0 2024-09-04T16:30:11.785 INFO:tasks.workunit.client.0.smithi170.stdout:8/217: write d6/d28/d1a/d2f/f3f [420122,56807] 0 2024-09-04T16:30:11.787 INFO:tasks.workunit.client.1.smithi193.stdout:7/627: fsync d9/d18/d1e/f43 0 2024-09-04T16:30:11.788 INFO:tasks.workunit.client.1.smithi193.stdout:0/542: dwrite d18/f1a [0,4194304] 0 2024-09-04T16:30:11.789 INFO:tasks.workunit.client.1.smithi193.stdout:1/592: dread - d1/d2b/d1b/d28/f77 zero size 2024-09-04T16:30:11.790 INFO:tasks.workunit.client.1.smithi193.stdout:3/532: rmdir d0/d10/d24 39 2024-09-04T16:30:11.791 INFO:tasks.workunit.client.1.smithi193.stdout:4/449: mkdir d3/d3c/d98 0 2024-09-04T16:30:11.793 INFO:tasks.workunit.client.1.smithi193.stdout:3/533: chown d0/d9/d49/d7d 3588 1 2024-09-04T16:30:11.794 INFO:tasks.workunit.client.1.smithi193.stdout:5/556: symlink d1/d29/d74/d96/lb0 0 2024-09-04T16:30:11.796 INFO:tasks.workunit.client.0.smithi170.stdout:9/226: fsync d2/d11/f26 0 2024-09-04T16:30:11.798 INFO:tasks.workunit.client.1.smithi193.stdout:7/628: dwrite d9/d18/f9b [0,4194304] 0 2024-09-04T16:30:11.799 INFO:tasks.workunit.client.1.smithi193.stdout:0/543: mknod d18/d25/d5f/d6a/cb3 0 2024-09-04T16:30:11.801 INFO:tasks.workunit.client.1.smithi193.stdout:6/505: symlink d5/d27/d3e/d8c/la8 0 2024-09-04T16:30:11.802 INFO:tasks.workunit.client.1.smithi193.stdout:1/593: symlink d1/d2b/d10/d56/lb8 0 2024-09-04T16:30:11.803 INFO:tasks.workunit.client.0.smithi170.stdout:9/227: mkdir d2/d3d/d3f 0 2024-09-04T16:30:11.804 INFO:tasks.workunit.client.1.smithi193.stdout:9/589: getdents d2/d8/d15 0 2024-09-04T16:30:11.804 INFO:tasks.workunit.client.1.smithi193.stdout:6/506: truncate d5/d27/f84 925951 0 2024-09-04T16:30:11.805 INFO:tasks.workunit.client.1.smithi193.stdout:4/450: creat d3/d81/f99 x:0 0 0 2024-09-04T16:30:11.806 INFO:tasks.workunit.client.1.smithi193.stdout:1/594: truncate d1/d2b/d10/d56/faa 1024580 0 2024-09-04T16:30:11.807 INFO:tasks.workunit.client.1.smithi193.stdout:4/451: fdatasync d3/d1a/d2a/f8b 0 2024-09-04T16:30:11.808 INFO:tasks.workunit.client.1.smithi193.stdout:0/544: dwrite d18/d79/d88/fab [0,4194304] 0 2024-09-04T16:30:11.808 INFO:tasks.workunit.client.1.smithi193.stdout:5/557: creat d1/d8/db/d36/fb1 x:0 0 0 2024-09-04T16:30:11.816 INFO:tasks.workunit.client.1.smithi193.stdout:3/534: symlink d0/d18/lb4 0 2024-09-04T16:30:11.817 INFO:tasks.workunit.client.1.smithi193.stdout:9/590: creat d2/d18/d2f/d22/d30/d6a/fb5 x:0 0 0 2024-09-04T16:30:11.818 INFO:tasks.workunit.client.1.smithi193.stdout:4/452: symlink d3/d81/l9a 0 2024-09-04T16:30:11.820 INFO:tasks.workunit.client.1.smithi193.stdout:9/591: dread - d2/d8/d15/f8c zero size 2024-09-04T16:30:11.820 INFO:tasks.workunit.client.1.smithi193.stdout:0/545: mkdir d18/d25/d5f/db4 0 2024-09-04T16:30:11.822 INFO:tasks.workunit.client.1.smithi193.stdout:5/558: mknod d1/d8/cb2 0 2024-09-04T16:30:11.822 INFO:tasks.workunit.client.1.smithi193.stdout:1/595: dwrite d1/d2b/d1b/d51/f8b [0,4194304] 0 2024-09-04T16:30:11.823 INFO:tasks.workunit.client.0.smithi170.stdout:3/123: sync 2024-09-04T16:30:11.823 INFO:tasks.workunit.client.0.smithi170.stdout:6/174: sync 2024-09-04T16:30:11.823 INFO:tasks.workunit.client.0.smithi170.stdout:4/211: sync 2024-09-04T16:30:11.824 INFO:tasks.workunit.client.1.smithi193.stdout:6/507: dwrite d5/f19 [0,4194304] 0 2024-09-04T16:30:11.824 INFO:tasks.workunit.client.0.smithi170.stdout:9/228: dwrite d2/d11/d23/f29 [0,4194304] 0 2024-09-04T16:30:11.825 INFO:tasks.workunit.client.1.smithi193.stdout:3/535: symlink d0/lb5 0 2024-09-04T16:30:11.825 INFO:tasks.workunit.client.0.smithi170.stdout:4/212: chown d1/d6/d8/f9 10914 1 2024-09-04T16:30:11.826 INFO:tasks.workunit.client.0.smithi170.stdout:9/229: dread - d2/d3d/d27/f3a zero size 2024-09-04T16:30:11.827 INFO:tasks.workunit.client.0.smithi170.stdout:9/230: read d2/d11/f26 [2323664,73953] 0 2024-09-04T16:30:11.830 INFO:tasks.workunit.client.1.smithi193.stdout:1/596: write d1/d39/d48/f96 [2993759,104523] 0 2024-09-04T16:30:11.830 INFO:tasks.workunit.client.1.smithi193.stdout:3/536: chown d0/d18/d1b/d3d/d96 13 1 2024-09-04T16:30:11.831 INFO:tasks.workunit.client.0.smithi170.stdout:6/175: creat d0/d17/d25/d2d/f3d x:0 0 0 2024-09-04T16:30:11.834 INFO:tasks.workunit.client.1.smithi193.stdout:1/597: fdatasync d1/d2b/db/f9a 0 2024-09-04T16:30:11.834 INFO:tasks.workunit.client.1.smithi193.stdout:7/629: dwrite d9/d18/d22/d2b/f91 [0,4194304] 0 2024-09-04T16:30:11.834 INFO:tasks.workunit.client.1.smithi193.stdout:0/546: symlink d18/d25/d5f/d65/lb5 0 2024-09-04T16:30:11.835 INFO:tasks.workunit.client.1.smithi193.stdout:6/508: read d5/de/d15/d1b/d5f/f77 [3568700,126508] 0 2024-09-04T16:30:11.835 INFO:tasks.workunit.client.0.smithi170.stdout:3/124: mknod d13/d14/d1f/c29 0 2024-09-04T16:30:11.837 INFO:tasks.workunit.client.1.smithi193.stdout:9/592: dwrite d2/f28 [4194304,4194304] 0 2024-09-04T16:30:11.838 INFO:tasks.workunit.client.1.smithi193.stdout:7/630: write d9/d11/fa7 [2465059,121058] 0 2024-09-04T16:30:11.840 INFO:tasks.workunit.client.1.smithi193.stdout:5/559: write d1/d29/d18/f2f [702842,101961] 0 2024-09-04T16:30:11.841 INFO:tasks.workunit.client.0.smithi170.stdout:9/231: symlink d2/d11/d23/d2a/l40 0 2024-09-04T16:30:11.841 INFO:tasks.workunit.client.1.smithi193.stdout:6/509: write d5/d33/d4e/d51/f66 [142177,41314] 0 2024-09-04T16:30:11.843 INFO:tasks.workunit.client.0.smithi170.stdout:6/176: mkdir d0/df/d1b/d3e 0 2024-09-04T16:30:11.845 INFO:tasks.workunit.client.1.smithi193.stdout:3/537: dwrite d0/d9/f83 [0,4194304] 0 2024-09-04T16:30:11.852 INFO:tasks.workunit.client.0.smithi170.stdout:6/177: dwrite d0/df/d1b/f29 [0,4194304] 0 2024-09-04T16:30:11.853 INFO:tasks.workunit.client.1.smithi193.stdout:7/631: dwrite d9/d18/d1e/f2e [0,4194304] 0 2024-09-04T16:30:11.853 INFO:tasks.workunit.client.0.smithi170.stdout:6/178: readlink d0/d17/d2a/d30/l3b 0 2024-09-04T16:30:11.854 INFO:tasks.workunit.client.1.smithi193.stdout:1/598: rmdir d1/d2b/d10/d56/da7 39 2024-09-04T16:30:11.855 INFO:tasks.workunit.client.1.smithi193.stdout:0/547: symlink d18/d25/d5f/d65/d9f/lb6 0 2024-09-04T16:30:11.855 INFO:tasks.workunit.client.0.smithi170.stdout:6/179: truncate d0/df/f3a 686846 0 2024-09-04T16:30:11.858 INFO:tasks.workunit.client.1.smithi193.stdout:9/593: symlink d2/d18/d2f/d22/lb6 0 2024-09-04T16:30:11.863 INFO:tasks.workunit.client.0.smithi170.stdout:9/232: chown d2/d32 183063 1 2024-09-04T16:30:11.865 INFO:tasks.workunit.client.1.smithi193.stdout:5/560: creat d1/d8/db/d15/d2b/d83/d37/d88/fb3 x:0 0 0 2024-09-04T16:30:11.865 INFO:tasks.workunit.client.1.smithi193.stdout:3/538: mkdir d0/d18/d1c/d25/d5e/d7e/db6 0 2024-09-04T16:30:11.865 INFO:tasks.workunit.client.1.smithi193.stdout:7/632: rmdir d9/d18/d1e 39 2024-09-04T16:30:11.867 INFO:tasks.workunit.client.1.smithi193.stdout:5/561: truncate d1/d29/f8d 944000 0 2024-09-04T16:30:11.869 INFO:tasks.workunit.client.1.smithi193.stdout:5/562: readlink d1/d8/db/d15/d2b/d83/d37/d3f/d8e/l53 0 2024-09-04T16:30:11.873 INFO:tasks.workunit.client.0.smithi170.stdout:4/213: rename d1/d6/d8/f21 to d1/d6/f4f 0 2024-09-04T16:30:11.875 INFO:tasks.workunit.client.1.smithi193.stdout:1/599: link d1/d2b/d10/d2a/f6f d1/d2b/d1b/da0/fb9 0 2024-09-04T16:30:11.878 INFO:tasks.workunit.client.0.smithi170.stdout:9/233: write d2/fd [763493,112153] 0 2024-09-04T16:30:11.883 INFO:tasks.workunit.client.1.smithi193.stdout:5/563: creat d1/d29/d74/d96/d98/fb4 x:0 0 0 2024-09-04T16:30:11.884 INFO:tasks.workunit.client.0.smithi170.stdout:9/234: readlink d2/lb 0 2024-09-04T16:30:11.884 INFO:tasks.workunit.client.0.smithi170.stdout:9/235: chown d2/d3d/f1a 50278156 1 2024-09-04T16:30:11.886 INFO:tasks.workunit.client.0.smithi170.stdout:4/214: rename d1/c27 to d1/d6/d22/c50 0 2024-09-04T16:30:11.888 INFO:tasks.workunit.client.0.smithi170.stdout:9/236: read d2/d3d/f20 [2272781,96340] 0 2024-09-04T16:30:11.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.888+0000 7f7aa2b9f640 1 -- 172.21.15.170:0/2862834516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a9c100ba0 msgr2=0x7f7a9c100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:11.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.888+0000 7f7aa2b9f640 1 --2- 172.21.15.170:0/2862834516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a9c100ba0 0x7f7a9c100fa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009880 tx=0x7f7a9802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:30:11.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.889+0000 7f7aa2b9f640 1 -- 172.21.15.170:0/2862834516 shutdown_connections 2024-09-04T16:30:11.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.889+0000 7f7aa2b9f640 1 --2- 172.21.15.170:0/2862834516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a9c1018c0 0x7f7a9c101d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:11.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.889+0000 7f7aa2b9f640 1 --2- 172.21.15.170:0/2862834516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a9c100ba0 0x7f7a9c100fa0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:11.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.889+0000 7f7aa2b9f640 1 -- 172.21.15.170:0/2862834516 >> 172.21.15.170:0/2862834516 conn(0x7f7a9c0fb5b0 msgr2=0x7f7a9c0fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:11.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.889+0000 7f7aa2b9f640 1 -- 172.21.15.170:0/2862834516 shutdown_connections 2024-09-04T16:30:11.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.889+0000 7f7aa2b9f640 1 -- 172.21.15.170:0/2862834516 wait complete. 2024-09-04T16:30:11.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.890+0000 7f7aa2b9f640 1 Processor -- start 2024-09-04T16:30:11.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.890+0000 7f7aa2b9f640 1 -- start start 2024-09-04T16:30:11.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.891+0000 7f7aa2b9f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a9c100ba0 0x7f7a9c100230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:11.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.891+0000 7f7aa2b9f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a9c1018c0 0x7f7a9c199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:11.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.891+0000 7f7aa2b9f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c1094b0 con 0x7f7a9c1018c0 2024-09-04T16:30:11.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.891+0000 7f7aa2b9f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c109330 con 0x7f7a9c100ba0 2024-09-04T16:30:11.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.891+0000 7f7aa139c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a9c1018c0 0x7f7a9c199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:11.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.891+0000 7f7aa139c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a9c1018c0 0x7f7a9c199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41174/0 (socket says 172.21.15.170:41174) 2024-09-04T16:30:11.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.891+0000 7f7aa139c640 1 -- 172.21.15.170:0/1715373953 learned_addr learned my addr 172.21.15.170:0/1715373953 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:30:11.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.891+0000 7f7aa1b9d640 1 --2- 172.21.15.170:0/1715373953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a9c100ba0 0x7f7a9c100230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:11.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.891+0000 7f7aa139c640 1 -- 172.21.15.170:0/1715373953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a9c100ba0 msgr2=0x7f7a9c100230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:11.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.891+0000 7f7aa139c640 1 --2- 172.21.15.170:0/1715373953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a9c100ba0 0x7f7a9c100230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:11.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.891+0000 7f7aa139c640 1 -- 172.21.15.170:0/1715373953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c19a3b0 con 0x7f7a9c1018c0 2024-09-04T16:30:11.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.892+0000 7f7aa139c640 1 --2- 172.21.15.170:0/1715373953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a9c1018c0 0x7f7a9c199dc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c00e970 tx=0x7f7a8c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:11.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.892+0000 7f7a92ffd640 1 -- 172.21.15.170:0/1715373953 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a8c00cac0 con 0x7f7a9c1018c0 2024-09-04T16:30:11.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.892+0000 7f7a92ffd640 1 -- 172.21.15.170:0/1715373953 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7a8c00cc60 con 0x7f7a9c1018c0 2024-09-04T16:30:11.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.892+0000 7f7a92ffd640 1 -- 172.21.15.170:0/1715373953 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a8c018720 con 0x7f7a9c1018c0 2024-09-04T16:30:11.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.892+0000 7f7aa2b9f640 1 -- 172.21.15.170:0/1715373953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9c19a6a0 con 0x7f7a9c1018c0 2024-09-04T16:30:11.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.892+0000 7f7aa2b9f640 1 -- 172.21.15.170:0/1715373953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a9c19ac30 con 0x7f7a9c1018c0 2024-09-04T16:30:11.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.893+0000 7f7aa2b9f640 1 -- 172.21.15.170:0/1715373953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a9c100fa0 con 0x7f7a9c1018c0 2024-09-04T16:30:11.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.895+0000 7f7a92ffd640 1 -- 172.21.15.170:0/1715373953 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 25) ==== 97250+0+0 (secure 0 0 0) 0x7f7a8c010430 con 0x7f7a9c1018c0 2024-09-04T16:30:11.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.895+0000 7f7a92ffd640 1 --2- 172.21.15.170:0/1715373953 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f7a88074010 0x7f7a880764d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:11.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.895+0000 7f7a92ffd640 1 -- 172.21.15.170:0/1715373953 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f7a8c095b60 con 0x7f7a9c1018c0 2024-09-04T16:30:11.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.896+0000 7f7aa1b9d640 1 --2- 172.21.15.170:0/1715373953 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f7a88074010 0x7f7a880764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:11.897 INFO:tasks.workunit.client.0.smithi170.stdout:9/237: rename d2/d11/f22 to d2/d32/f41 0 2024-09-04T16:30:11.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.896+0000 7f7aa1b9d640 1 --2- 172.21.15.170:0/1715373953 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f7a88074010 0x7f7a880764d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7a98006010 tx=0x7f7a98005a20 comp rx=0 tx=0).ready entity=mgr.14682 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:11.897 INFO:tasks.workunit.client.1.smithi193.stdout:9/594: getdents d2/d8/d25/db2 0 2024-09-04T16:30:11.898 INFO:tasks.workunit.client.1.smithi193.stdout:8/572: sync 2024-09-04T16:30:11.898 INFO:tasks.workunit.client.1.smithi193.stdout:5/564: symlink d1/d8/db/d15/d2b/lb5 0 2024-09-04T16:30:11.899 INFO:tasks.workunit.client.1.smithi193.stdout:5/565: fsync d1/d8/f34 0 2024-09-04T16:30:11.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:11.900+0000 7f7a92ffd640 1 -- 172.21.15.170:0/1715373953 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f7a8c061610 con 0x7f7a9c1018c0 2024-09-04T16:30:11.901 INFO:tasks.workunit.client.0.smithi170.stdout:6/180: truncate d0/f9 1356718 0 2024-09-04T16:30:11.903 INFO:tasks.workunit.client.1.smithi193.stdout:6/510: dwrite d5/de/d15/d48/f4b [0,4194304] 0 2024-09-04T16:30:11.904 INFO:tasks.workunit.client.1.smithi193.stdout:8/573: creat d2/d20/d23/d34/d4b/db8/fc1 x:0 0 0 2024-09-04T16:30:11.905 INFO:tasks.workunit.client.1.smithi193.stdout:8/574: read d2/d20/dc0/f6d [1084099,37754] 0 2024-09-04T16:30:11.906 INFO:tasks.workunit.client.0.smithi170.stdout:3/125: truncate fb 3692706 0 2024-09-04T16:30:11.908 INFO:tasks.workunit.client.0.smithi170.stdout:6/181: dwrite d0/d17/f1d [0,4194304] 0 2024-09-04T16:30:11.912 INFO:tasks.workunit.client.0.smithi170.stdout:4/215: getdents d1/d6/d8/d20/d35/d3e 0 2024-09-04T16:30:11.913 INFO:tasks.workunit.client.1.smithi193.stdout:1/600: creat d1/d2b/d1b/d28/fba x:0 0 0 2024-09-04T16:30:11.917 INFO:tasks.workunit.client.1.smithi193.stdout:9/595: link d2/f3d d2/d18/d2f/d22/d30/d6a/d6e/d95/fb7 0 2024-09-04T16:30:11.918 INFO:tasks.workunit.client.1.smithi193.stdout:3/539: truncate d0/d18/d1c/d30/f33 3176398 0 2024-09-04T16:30:11.920 INFO:tasks.workunit.client.1.smithi193.stdout:7/633: dwrite d9/d18/d1e/f43 [0,4194304] 0 2024-09-04T16:30:11.922 INFO:tasks.workunit.client.0.smithi170.stdout:3/126: dwrite f10 [4194304,4194304] 0 2024-09-04T16:30:11.922 INFO:tasks.workunit.client.1.smithi193.stdout:8/575: mkdir d2/d20/d23/d24/d3c/d65/d67/da0/da8/db9/dc2 0 2024-09-04T16:30:11.923 INFO:tasks.workunit.client.0.smithi170.stdout:3/127: readlink l11 0 2024-09-04T16:30:11.923 INFO:tasks.workunit.client.0.smithi170.stdout:3/128: stat cc 0 2024-09-04T16:30:11.925 INFO:tasks.workunit.client.0.smithi170.stdout:4/216: mkdir d1/d6/d8/d20/d35/d3e/d4e/d51 0 2024-09-04T16:30:11.925 INFO:tasks.workunit.client.1.smithi193.stdout:9/596: dwrite d2/d8/d15/f1b [4194304,4194304] 0 2024-09-04T16:30:11.926 INFO:tasks.workunit.client.0.smithi170.stdout:4/217: stat d1/d6/f32 0 2024-09-04T16:30:11.928 INFO:tasks.workunit.client.1.smithi193.stdout:5/566: unlink d1/d8/l24 0 2024-09-04T16:30:11.929 INFO:tasks.workunit.client.1.smithi193.stdout:5/567: chown d1/d8/db/d36/d40 1608518 1 2024-09-04T16:30:11.931 INFO:tasks.workunit.client.0.smithi170.stdout:3/129: dwrite f10 [4194304,4194304] 0 2024-09-04T16:30:11.932 INFO:tasks.workunit.client.0.smithi170.stdout:9/238: write d2/f4 [2676824,16024] 0 2024-09-04T16:30:11.934 INFO:tasks.workunit.client.1.smithi193.stdout:1/601: symlink d1/d2b/db/d7f/lbb 0 2024-09-04T16:30:11.935 INFO:tasks.workunit.client.1.smithi193.stdout:1/602: stat d1/d2b/d10/d2a 0 2024-09-04T16:30:11.936 INFO:tasks.workunit.client.0.smithi170.stdout:3/130: fsync d13/d14/d1d/f23 0 2024-09-04T16:30:11.937 INFO:tasks.workunit.client.0.smithi170.stdout:3/131: write f10 [1512634,33626] 0 2024-09-04T16:30:11.937 INFO:tasks.workunit.client.0.smithi170.stdout:9/239: symlink d2/d3d/d27/d2b/l42 0 2024-09-04T16:30:11.939 INFO:tasks.workunit.client.0.smithi170.stdout:3/132: dread - d13/d14/d1d/f27 zero size 2024-09-04T16:30:11.940 INFO:tasks.workunit.client.0.smithi170.stdout:6/182: getdents d0/df 0 2024-09-04T16:30:11.943 INFO:tasks.workunit.client.1.smithi193.stdout:8/576: unlink d2/d20/d23/d24/d3c/d65/d67/da0/faf 0 2024-09-04T16:30:11.946 INFO:tasks.workunit.client.1.smithi193.stdout:9/597: rename d2/d8/d15/f1b to d2/d8/d15/fb8 0 2024-09-04T16:30:11.947 INFO:tasks.workunit.client.0.smithi170.stdout:3/133: mknod d13/d14/d1d/c2a 0 2024-09-04T16:30:11.948 INFO:tasks.workunit.client.0.smithi170.stdout:3/134: dread - d13/d14/d1d/f23 zero size 2024-09-04T16:30:11.957 INFO:tasks.workunit.client.0.smithi170.stdout:4/218: dread d1/d6/f4f [0,4194304] 0 2024-09-04T16:30:11.958 INFO:tasks.workunit.client.1.smithi193.stdout:7/634: mknod d9/d18/cd7 0 2024-09-04T16:30:11.961 INFO:tasks.workunit.client.0.smithi170.stdout:3/135: rename d13/d14/f16 to d13/d14/d21/f2b 0 2024-09-04T16:30:11.962 INFO:tasks.workunit.client.1.smithi193.stdout:8/577: rmdir d2/d20/d23/d24/d3c/d65/d67/da0/da8 39 2024-09-04T16:30:11.962 INFO:tasks.workunit.client.0.smithi170.stdout:4/219: dwrite d1/f1e [0,4194304] 0 2024-09-04T16:30:11.963 INFO:tasks.workunit.client.1.smithi193.stdout:7/635: dwrite d9/d39/d3e/d4d/fbe [0,4194304] 0 2024-09-04T16:30:11.963 INFO:tasks.workunit.client.1.smithi193.stdout:8/578: chown d2/d20/dc0/f6d 696096 1 2024-09-04T16:30:11.964 INFO:tasks.workunit.client.0.smithi170.stdout:7/331: sync 2024-09-04T16:30:11.964 INFO:tasks.workunit.client.0.smithi170.stdout:2/162: sync 2024-09-04T16:30:11.964 INFO:tasks.workunit.client.0.smithi170.stdout:1/220: sync 2024-09-04T16:30:11.964 INFO:tasks.workunit.client.1.smithi193.stdout:7/636: fdatasync d9/d18/fd1 0 2024-09-04T16:30:11.970 INFO:tasks.workunit.client.1.smithi193.stdout:7/637: dread d9/d18/d22/d2b/f91 [0,4194304] 0 2024-09-04T16:30:11.971 INFO:tasks.workunit.client.1.smithi193.stdout:7/638: chown d9/d18/d22/c3c 6523 1 2024-09-04T16:30:11.971 INFO:tasks.workunit.client.0.smithi170.stdout:2/163: dwrite d3/db/d1c/f23 [0,4194304] 0 2024-09-04T16:30:11.972 INFO:tasks.workunit.client.1.smithi193.stdout:7/639: chown d9/d39/d3e/d53/l65 0 1 2024-09-04T16:30:11.975 INFO:tasks.workunit.client.1.smithi193.stdout:5/568: write d1/d29/f59 [1103931,57881] 0 2024-09-04T16:30:11.978 INFO:tasks.workunit.client.1.smithi193.stdout:5/569: dread d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f6f [0,4194304] 0 2024-09-04T16:30:11.981 INFO:tasks.workunit.client.0.smithi170.stdout:4/220: symlink d1/d6/d8/d20/l52 0 2024-09-04T16:30:11.982 INFO:tasks.workunit.client.0.smithi170.stdout:4/221: dread - d1/d6/d2b/d33/f4d zero size 2024-09-04T16:30:11.982 INFO:tasks.workunit.client.0.smithi170.stdout:4/222: read d1/f19 [1744893,123071] 0 2024-09-04T16:30:11.983 INFO:tasks.workunit.client.0.smithi170.stdout:6/183: getdents d0/d17/d25/d2d 0 2024-09-04T16:30:11.985 INFO:tasks.workunit.client.1.smithi193.stdout:5/570: dwrite d1/d8/db/d15/d2b/d83/d37/f9d [0,4194304] 0 2024-09-04T16:30:11.988 INFO:tasks.workunit.client.1.smithi193.stdout:2/515: sync 2024-09-04T16:30:11.989 INFO:tasks.workunit.client.1.smithi193.stdout:9/598: symlink d2/d8/d25/db2/lb9 0 2024-09-04T16:30:11.990 INFO:tasks.workunit.client.1.smithi193.stdout:9/599: read d2/d18/fa9 [251181,11624] 0 2024-09-04T16:30:11.992 INFO:tasks.workunit.client.0.smithi170.stdout:7/332: rename d12/f66 to d12/d15/d34/f70 0 2024-09-04T16:30:11.993 INFO:tasks.workunit.client.0.smithi170.stdout:7/333: chown d12/f18 0 1 2024-09-04T16:30:11.994 INFO:tasks.workunit.client.0.smithi170.stdout:1/221: write d9/f2b [363543,123310] 0 2024-09-04T16:30:11.995 INFO:tasks.workunit.client.0.smithi170.stdout:1/222: write d9/d26/f36 [1073027,63155] 0 2024-09-04T16:30:11.998 INFO:tasks.workunit.client.1.smithi193.stdout:1/603: link d1/d2b/d1b/d28/d50/f5d d1/d2b/d10/fbc 0 2024-09-04T16:30:11.998 INFO:tasks.workunit.client.1.smithi193.stdout:1/604: chown d1/d2b/d10/d56/cad 4 1 2024-09-04T16:30:11.999 INFO:tasks.workunit.client.0.smithi170.stdout:2/164: unlink d3/d7/l1a 0 2024-09-04T16:30:11.999 INFO:tasks.workunit.client.1.smithi193.stdout:3/540: getdents d0/d18/d1c/d51/d6c 0 2024-09-04T16:30:12.002 INFO:tasks.workunit.client.0.smithi170.stdout:6/184: symlink d0/df/d1b/l3f 0 2024-09-04T16:30:12.004 INFO:tasks.workunit.client.0.smithi170.stdout:2/165: dread d3/db/d1c/f23 [0,4194304] 0 2024-09-04T16:30:12.004 INFO:tasks.workunit.client.1.smithi193.stdout:1/605: dwrite d1/d2b/d10/d2a/fa9 [0,4194304] 0 2024-09-04T16:30:12.004 INFO:tasks.workunit.client.1.smithi193.stdout:8/579: link d2/d12/fe d2/d20/dc0/fc3 0 2024-09-04T16:30:12.005 INFO:tasks.workunit.client.0.smithi170.stdout:2/166: read d3/d7/f1d [2233864,41598] 0 2024-09-04T16:30:12.006 INFO:tasks.workunit.client.1.smithi193.stdout:5/571: write d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/d55/f77 [499561,17370] 0 2024-09-04T16:30:12.008 INFO:tasks.workunit.client.1.smithi193.stdout:5/572: chown d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f41 0 1 2024-09-04T16:30:12.016 INFO:tasks.workunit.client.1.smithi193.stdout:9/600: chown d2/d8/cf 31 1 2024-09-04T16:30:12.018 INFO:tasks.workunit.client.1.smithi193.stdout:7/640: creat d9/d11/dd4/dd2/fd8 x:0 0 0 2024-09-04T16:30:12.018 INFO:tasks.workunit.client.1.smithi193.stdout:7/641: read - d9/de/d27/fbb zero size 2024-09-04T16:30:12.019 INFO:tasks.workunit.client.0.smithi170.stdout:6/185: mknod d0/df/c40 0 2024-09-04T16:30:12.019 INFO:tasks.workunit.client.1.smithi193.stdout:7/642: truncate d9/d18/d22/fb7 625763 0 2024-09-04T16:30:12.020 INFO:tasks.workunit.client.1.smithi193.stdout:7/643: write d9/d39/fc6 [1810481,119451] 0 2024-09-04T16:30:12.021 INFO:tasks.workunit.client.1.smithi193.stdout:3/541: rename d0/d9/c35 to d0/d18/d1c/d25/d5e/d7e/cb7 0 2024-09-04T16:30:12.022 INFO:tasks.workunit.client.1.smithi193.stdout:7/644: write d9/d18/d22/d2b/d6c/fd3 [49864,110673] 0 2024-09-04T16:30:12.024 INFO:tasks.workunit.client.1.smithi193.stdout:4/453: sync 2024-09-04T16:30:12.024 INFO:tasks.workunit.client.1.smithi193.stdout:0/548: sync 2024-09-04T16:30:12.025 INFO:tasks.workunit.client.0.smithi170.stdout:4/223: rename d1/d6/d8/l39 to d1/d6/d2b/d47/l53 0 2024-09-04T16:30:12.026 INFO:tasks.workunit.client.0.smithi170.stdout:3/136: truncate fb 2951106 0 2024-09-04T16:30:12.026 INFO:tasks.workunit.client.0.smithi170.stdout:3/137: fsync f10 0 2024-09-04T16:30:12.027 INFO:tasks.workunit.client.1.smithi193.stdout:3/542: truncate d0/d18/d1c/d51/d7a/f98 4425393 0 2024-09-04T16:30:12.028 INFO:tasks.workunit.client.0.smithi170.stdout:3/138: chown d13/d14/d1d/f27 1 1 2024-09-04T16:30:12.028 INFO:tasks.workunit.client.0.smithi170.stdout:2/167: fsync d3/d4/f21 0 2024-09-04T16:30:12.028 INFO:tasks.workunit.client.0.smithi170.stdout:2/168: readlink d3/d7/l31 0 2024-09-04T16:30:12.029 INFO:tasks.workunit.client.0.smithi170.stdout:3/139: chown d13/f25 26286623 1 2024-09-04T16:30:12.030 INFO:tasks.workunit.client.0.smithi170.stdout:7/334: write d12/d15/d34/f56 [1312714,127229] 0 2024-09-04T16:30:12.030 INFO:tasks.workunit.client.0.smithi170.stdout:2/169: fsync d3/db/d1c/f2a 0 2024-09-04T16:30:12.032 INFO:tasks.workunit.client.1.smithi193.stdout:0/549: dwrite f6 [4194304,4194304] 0 2024-09-04T16:30:12.034 INFO:tasks.workunit.client.0.smithi170.stdout:6/186: creat d0/d17/d25/f41 x:0 0 0 2024-09-04T16:30:12.035 INFO:tasks.workunit.client.1.smithi193.stdout:0/550: read d18/f20 [4037496,6672] 0 2024-09-04T16:30:12.035 INFO:tasks.workunit.client.1.smithi193.stdout:3/543: dwrite d0/d18/d1c/d25/d5e/d7e/f7c [0,4194304] 0 2024-09-04T16:30:12.035 INFO:tasks.workunit.client.0.smithi170.stdout:6/187: dread - d0/d17/d25/d2d/f3d zero size 2024-09-04T16:30:12.038 INFO:tasks.workunit.client.0.smithi170.stdout:6/188: write d0/df/f3a [1190631,108908] 0 2024-09-04T16:30:12.039 INFO:tasks.workunit.client.0.smithi170.stdout:2/170: dwrite d3/fe [0,4194304] 0 2024-09-04T16:30:12.049 INFO:tasks.workunit.client.1.smithi193.stdout:9/601: unlink d2/d8/d15/f31 0 2024-09-04T16:30:12.052 INFO:tasks.workunit.client.1.smithi193.stdout:8/580: write d2/d20/f47 [851445,114914] 0 2024-09-04T16:30:12.057 INFO:tasks.workunit.client.1.smithi193.stdout:9/602: dwrite d2/d18/d2f/d22/d30/d6a/f94 [0,4194304] 0 2024-09-04T16:30:12.058 INFO:tasks.workunit.client.1.smithi193.stdout:5/573: dwrite d1/d8/fd [0,4194304] 0 2024-09-04T16:30:12.064 INFO:tasks.workunit.client.0.smithi170.stdout:1/223: creat d9/f47 x:0 0 0 2024-09-04T16:30:12.067 INFO:tasks.workunit.client.1.smithi193.stdout:5/574: dwrite d1/d8/db/d15/fa2 [0,4194304] 0 2024-09-04T16:30:12.070 INFO:tasks.workunit.client.1.smithi193.stdout:5/575: dread d1/d8/fd [0,4194304] 0 2024-09-04T16:30:12.072 INFO:tasks.workunit.client.0.smithi170.stdout:2/171: symlink d3/db/l34 0 2024-09-04T16:30:12.075 INFO:tasks.workunit.client.0.smithi170.stdout:4/224: getdents d1/d6/d8/d20/d35/d3e/d43 0 2024-09-04T16:30:12.076 INFO:tasks.workunit.client.0.smithi170.stdout:3/140: truncate ff 1030411 0 2024-09-04T16:30:12.077 INFO:tasks.workunit.client.0.smithi170.stdout:1/224: symlink d9/d34/l48 0 2024-09-04T16:30:12.078 INFO:tasks.workunit.client.0.smithi170.stdout:1/225: write d9/f37 [968138,115198] 0 2024-09-04T16:30:12.082 INFO:tasks.workunit.client.1.smithi193.stdout:7/645: chown d9/d18/d1e/c56 229712753 1 2024-09-04T16:30:12.085 INFO:tasks.workunit.client.0.smithi170.stdout:1/226: dread d9/d26/f36 [0,4194304] 0 2024-09-04T16:30:12.087 INFO:tasks.workunit.client.1.smithi193.stdout:6/511: sync 2024-09-04T16:30:12.088 INFO:tasks.workunit.client.1.smithi193.stdout:4/454: unlink d3/d1a/d21/d52/d7f/c85 0 2024-09-04T16:30:12.091 INFO:tasks.workunit.client.0.smithi170.stdout:4/225: mkdir d1/d6/d8/d20/d35/d54 0 2024-09-04T16:30:12.092 INFO:tasks.workunit.client.1.smithi193.stdout:6/512: dwrite d5/f3f [4194304,4194304] 0 2024-09-04T16:30:12.093 INFO:tasks.workunit.client.0.smithi170.stdout:3/141: unlink d13/d14/f15 0 2024-09-04T16:30:12.095 INFO:tasks.workunit.client.1.smithi193.stdout:1/606: mknod d1/d2b/d1b/d51/cbd 0 2024-09-04T16:30:12.098 INFO:tasks.workunit.client.0.smithi170.stdout:7/335: dwrite d12/d15/d41/f55 [0,4194304] 0 2024-09-04T16:30:12.108 INFO:tasks.workunit.client.1.smithi193.stdout:0/551: creat d18/d25/d3b/fb7 x:0 0 0 2024-09-04T16:30:12.108 INFO:tasks.workunit.client.0.smithi170.stdout:6/189: write d0/f9 [1994358,36909] 0 2024-09-04T16:30:12.117 INFO:tasks.workunit.client.0.smithi170.stdout:4/226: symlink d1/d6/d8/d20/l55 0 2024-09-04T16:30:12.123 INFO:tasks.workunit.client.0.smithi170.stdout:7/336: chown d12/d15/f2f 28 1 2024-09-04T16:30:12.126 INFO:tasks.workunit.client.0.smithi170.stdout:2/172: creat d3/f35 x:0 0 0 2024-09-04T16:30:12.128 INFO:tasks.workunit.client.0.smithi170.stdout:1/227: dwrite d9/f10 [4194304,4194304] 0 2024-09-04T16:30:12.131 INFO:tasks.workunit.client.1.smithi193.stdout:5/576: symlink d1/d8/db/d15/d2b/lb6 0 2024-09-04T16:30:12.136 INFO:tasks.workunit.client.1.smithi193.stdout:4/455: creat d3/d81/f9b x:0 0 0 2024-09-04T16:30:12.138 INFO:tasks.workunit.client.1.smithi193.stdout:6/513: mkdir d5/d33/d85/da9 0 2024-09-04T16:30:12.139 INFO:tasks.workunit.client.1.smithi193.stdout:2/516: getdents d2/d9/db/d10/d51 0 2024-09-04T16:30:12.140 INFO:tasks.workunit.client.1.smithi193.stdout:2/517: chown d2/d9/db/d10/d1e/da4/f50 23981 1 2024-09-04T16:30:12.142 INFO:tasks.workunit.client.0.smithi170.stdout:1/228: symlink d9/d11/d2f/l49 0 2024-09-04T16:30:12.143 INFO:tasks.workunit.client.0.smithi170.stdout:1/229: chown d9/d26/f2d 8 1 2024-09-04T16:30:12.149 INFO:tasks.workunit.client.1.smithi193.stdout:9/603: unlink d2/d8/d61/f73 0 2024-09-04T16:30:12.149 INFO:tasks.workunit.client.0.smithi170.stdout:1/230: mknod d9/d11/d2e/c4a 0 2024-09-04T16:30:12.150 INFO:tasks.workunit.client.1.smithi193.stdout:7/646: creat d9/d11/dbd/fd9 x:0 0 0 2024-09-04T16:30:12.152 INFO:tasks.workunit.client.0.smithi170.stdout:6/190: write d0/f2 [1317943,15064] 0 2024-09-04T16:30:12.154 INFO:tasks.workunit.client.0.smithi170.stdout:4/227: link d1/fc d1/d6/d8/f56 0 2024-09-04T16:30:12.154 INFO:tasks.workunit.client.0.smithi170.stdout:2/173: dread f2 [4194304,4194304] 0 2024-09-04T16:30:12.157 INFO:tasks.workunit.client.1.smithi193.stdout:5/577: rename d1/d8/f34 to d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/fb7 0 2024-09-04T16:30:12.158 INFO:tasks.workunit.client.0.smithi170.stdout:1/231: creat d9/d11/d2f/f4b x:0 0 0 2024-09-04T16:30:12.158 INFO:tasks.workunit.client.1.smithi193.stdout:8/581: dwrite d2/d20/d23/d34/d3e/f41 [0,4194304] 0 2024-09-04T16:30:12.158 INFO:tasks.workunit.client.1.smithi193.stdout:4/456: mkdir d3/d3c/d47/d9c 0 2024-09-04T16:30:12.159 INFO:tasks.workunit.client.0.smithi170.stdout:7/337: dread d12/f30 [0,4194304] 0 2024-09-04T16:30:12.159 INFO:tasks.workunit.client.0.smithi170.stdout:6/191: mkdir d0/df/d1f/d42 0 2024-09-04T16:30:12.161 INFO:tasks.workunit.client.1.smithi193.stdout:6/514: creat d5/de/d15/d48/faa x:0 0 0 2024-09-04T16:30:12.162 INFO:tasks.workunit.client.0.smithi170.stdout:4/228: creat d1/d6/d2b/d33/f57 x:0 0 0 2024-09-04T16:30:12.163 INFO:tasks.workunit.client.1.smithi193.stdout:1/607: sync 2024-09-04T16:30:12.164 INFO:tasks.workunit.client.1.smithi193.stdout:0/552: fsync d18/d25/d5f/d6a/f83 0 2024-09-04T16:30:12.165 INFO:tasks.workunit.client.1.smithi193.stdout:1/608: stat d1/d2b/d1b/d51/d6d/f7a 0 2024-09-04T16:30:12.167 INFO:tasks.workunit.client.1.smithi193.stdout:1/609: fsync d1/d2b/d10/d56/faa 0 2024-09-04T16:30:12.167 INFO:tasks.workunit.client.0.smithi170.stdout:1/232: creat d9/d11/d2e/f4c x:0 0 0 2024-09-04T16:30:12.168 INFO:tasks.workunit.client.1.smithi193.stdout:3/544: rmdir d0/d9/d49/d87/d9e 0 2024-09-04T16:30:12.168 INFO:tasks.workunit.client.1.smithi193.stdout:6/515: dwrite d5/de/d15/d1b/f5a [0,4194304] 0 2024-09-04T16:30:12.170 INFO:tasks.workunit.client.0.smithi170.stdout:6/192: creat d0/d17/d25/d2d/d2e/f43 x:0 0 0 2024-09-04T16:30:12.170 INFO:tasks.workunit.client.1.smithi193.stdout:9/604: mkdir d2/d18/d2f/d22/d30/dba 0 2024-09-04T16:30:12.175 INFO:tasks.workunit.client.0.smithi170.stdout:6/193: read d0/df/f28 [933861,121497] 0 2024-09-04T16:30:12.175 INFO:tasks.workunit.client.1.smithi193.stdout:2/518: dread d2/f35 [0,4194304] 0 2024-09-04T16:30:12.176 INFO:tasks.workunit.client.1.smithi193.stdout:2/519: dread - d2/f71 zero size 2024-09-04T16:30:12.177 INFO:tasks.workunit.client.0.smithi170.stdout:4/229: mkdir d1/d6/d8/d20/d35/d54/d58 0 2024-09-04T16:30:12.178 INFO:tasks.workunit.client.0.smithi170.stdout:7/338: dwrite d12/d15/d34/f38 [0,4194304] 0 2024-09-04T16:30:12.179 INFO:tasks.workunit.client.0.smithi170.stdout:2/174: rmdir d3/db/d1c/d33 0 2024-09-04T16:30:12.181 INFO:tasks.workunit.client.1.smithi193.stdout:8/582: fdatasync d2/d20/dc0/f6d 0 2024-09-04T16:30:12.181 INFO:tasks.workunit.client.1.smithi193.stdout:4/457: write d3/d3c/f58 [2532021,72418] 0 2024-09-04T16:30:12.182 INFO:tasks.workunit.client.1.smithi193.stdout:8/583: readlink d2/d20/d23/d51/la7 0 2024-09-04T16:30:12.187 INFO:tasks.workunit.client.1.smithi193.stdout:0/553: dwrite d18/f38 [0,4194304] 0 2024-09-04T16:30:12.187 INFO:tasks.workunit.client.0.smithi170.stdout:2/175: dread d3/db/d1c/f2a [0,4194304] 0 2024-09-04T16:30:12.188 INFO:tasks.workunit.client.1.smithi193.stdout:9/605: mkdir d2/d18/d2f/d22/d30/d52/dbb 0 2024-09-04T16:30:12.191 INFO:tasks.workunit.client.1.smithi193.stdout:2/520: dread d2/d9/db/d10/f7d [0,4194304] 0 2024-09-04T16:30:12.191 INFO:tasks.workunit.client.0.smithi170.stdout:4/230: creat d1/d6/d2b/d47/f59 x:0 0 0 2024-09-04T16:30:12.194 INFO:tasks.workunit.client.1.smithi193.stdout:5/578: truncate d1/d8/db/d15/d2b/d83/d37/d88/f25 703935 0 2024-09-04T16:30:12.194 INFO:tasks.workunit.client.0.smithi170.stdout:2/176: mknod d3/db/d1c/c36 0 2024-09-04T16:30:12.195 INFO:tasks.workunit.client.1.smithi193.stdout:5/579: dread - d1/d29/d18/faf zero size 2024-09-04T16:30:12.196 INFO:tasks.workunit.client.0.smithi170.stdout:2/177: read d3/db/f2b [2037019,79043] 0 2024-09-04T16:30:12.199 INFO:tasks.workunit.client.0.smithi170.stdout:7/339: rename d12/d15/d34 to d12/d15/d71 0 2024-09-04T16:30:12.200 INFO:tasks.workunit.client.1.smithi193.stdout:6/516: symlink d5/de/lab 0 2024-09-04T16:30:12.202 INFO:tasks.workunit.client.1.smithi193.stdout:8/584: dwrite d2/d12/f43 [4194304,4194304] 0 2024-09-04T16:30:12.209 INFO:tasks.workunit.client.1.smithi193.stdout:7/647: link d9/d39/d3e/d7d/ca9 d9/d11/cda 0 2024-09-04T16:30:12.211 INFO:tasks.workunit.client.0.smithi170.stdout:4/231: truncate d1/d6/d8/f9 3205346 0 2024-09-04T16:30:12.212 INFO:tasks.workunit.client.1.smithi193.stdout:0/554: symlink d18/d25/d5f/d65/d9f/lb8 0 2024-09-04T16:30:12.214 INFO:tasks.workunit.client.0.smithi170.stdout:2/178: readlink d3/d18/d24/l27 0 2024-09-04T16:30:12.215 INFO:tasks.workunit.client.1.smithi193.stdout:9/606: symlink d2/d8/d25/lbc 0 2024-09-04T16:30:12.222 INFO:tasks.workunit.client.0.smithi170.stdout:2/179: unlink d3/d4/c22 0 2024-09-04T16:30:12.224 INFO:tasks.workunit.client.1.smithi193.stdout:5/580: truncate d1/f16 5622143 0 2024-09-04T16:30:12.226 INFO:tasks.workunit.client.0.smithi170.stdout:6/194: write d0/d17/f18 [215495,14703] 0 2024-09-04T16:30:12.227 INFO:tasks.workunit.client.0.smithi170.stdout:6/195: fdatasync d0/df/d1f/f2c 0 2024-09-04T16:30:12.232 INFO:tasks.workunit.client.0.smithi170.stdout:2/180: dread d3/d18/f30 [0,4194304] 0 2024-09-04T16:30:12.232 INFO:tasks.workunit.client.0.smithi170.stdout:7/340: rename d12/d29/f2a to d12/f72 0 2024-09-04T16:30:12.232 INFO:tasks.workunit.client.1.smithi193.stdout:6/517: mknod d5/d27/d3e/d43/d5d/cac 0 2024-09-04T16:30:12.233 INFO:tasks.workunit.client.0.smithi170.stdout:2/181: write d3/db/d1c/f2a [607894,27232] 0 2024-09-04T16:30:12.234 INFO:tasks.workunit.client.1.smithi193.stdout:8/585: stat d2/d20/d23/d1b/f48 0 2024-09-04T16:30:12.234 INFO:tasks.workunit.client.1.smithi193.stdout:6/518: read d5/d33/d4e/d51/d7b/f7d [35448,118969] 0 2024-09-04T16:30:12.236 INFO:tasks.workunit.client.1.smithi193.stdout:1/610: symlink d1/d2b/d10/d56/da7/db1/lbe 0 2024-09-04T16:30:12.239 INFO:tasks.workunit.client.0.smithi170.stdout:6/196: rename d0/d17/d25 to d0/df/d1b/d3e/d44 0 2024-09-04T16:30:12.243 INFO:tasks.workunit.client.0.smithi170.stdout:7/341: symlink d12/d4b/d51/l73 0 2024-09-04T16:30:12.244 INFO:tasks.workunit.client.1.smithi193.stdout:4/458: dwrite d3/d1a/f3d [0,4194304] 0 2024-09-04T16:30:12.244 INFO:tasks.workunit.client.0.smithi170.stdout:6/197: dread d0/df/d1b/f29 [0,4194304] 0 2024-09-04T16:30:12.244 INFO:tasks.workunit.client.1.smithi193.stdout:4/459: chown d3/d1a/l6d 3683 1 2024-09-04T16:30:12.245 INFO:tasks.workunit.client.1.smithi193.stdout:9/607: creat d2/d18/fbd x:0 0 0 2024-09-04T16:30:12.246 INFO:tasks.workunit.client.0.smithi170.stdout:2/182: truncate d3/d7/f1d 3671210 0 2024-09-04T16:30:12.251 INFO:tasks.workunit.client.1.smithi193.stdout:3/545: getdents d0/d18/d1b/dab 0 2024-09-04T16:30:12.253 INFO:tasks.workunit.client.0.smithi170.stdout:7/342: fdatasync d12/d15/d71/f5b 0 2024-09-04T16:30:12.253 INFO:tasks.workunit.client.1.smithi193.stdout:4/460: dwrite d3/d1a/d21/f37 [0,4194304] 0 2024-09-04T16:30:12.253 INFO:tasks.workunit.client.1.smithi193.stdout:3/546: write d0/d9/f83 [961336,15624] 0 2024-09-04T16:30:12.254 INFO:tasks.workunit.client.0.smithi170.stdout:2/183: dwrite d3/fe [0,4194304] 0 2024-09-04T16:30:12.255 INFO:tasks.workunit.client.1.smithi193.stdout:6/519: creat d5/d27/d3e/d8c/fad x:0 0 0 2024-09-04T16:30:12.258 INFO:tasks.workunit.client.0.smithi170.stdout:0/299: sync 2024-09-04T16:30:12.258 INFO:tasks.workunit.client.0.smithi170.stdout:8/218: sync 2024-09-04T16:30:12.258 INFO:tasks.workunit.client.0.smithi170.stdout:5/117: sync 2024-09-04T16:30:12.266 INFO:tasks.workunit.client.0.smithi170.stdout:2/184: dwrite d3/d4/f20 [0,4194304] 0 2024-09-04T16:30:12.266 INFO:tasks.workunit.client.0.smithi170.stdout:4/232: write d1/d6/d8/d20/d35/d3e/f46 [1078437,3662] 0 2024-09-04T16:30:12.268 INFO:tasks.workunit.client.1.smithi193.stdout:1/611: dwrite d1/d2b/db/d54/f70 [0,4194304] 0 2024-09-04T16:30:12.270 INFO:tasks.workunit.client.1.smithi193.stdout:7/648: link d9/d39/d3e/d4a/f5b d9/d18/d22/d2b/fdb 0 2024-09-04T16:30:12.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.270+0000 7f7aa2b9f640 1 -- 172.21.15.170:0/1715373953 --> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7a9c190080 con 0x7f7a88074010 2024-09-04T16:30:12.274 INFO:tasks.workunit.client.0.smithi170.stdout:7/343: creat d12/d29/d5c/f74 x:0 0 0 2024-09-04T16:30:12.275 INFO:tasks.workunit.client.0.smithi170.stdout:7/344: rename d12 to d12/d4b/d75 22 2024-09-04T16:30:12.275 INFO:tasks.workunit.client.0.smithi170.stdout:6/198: dread d0/d17/f18 [0,4194304] 0 2024-09-04T16:30:12.275 INFO:tasks.workunit.client.1.smithi193.stdout:0/555: write d18/d25/f77 [58785,107900] 0 2024-09-04T16:30:12.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.277+0000 7f7a92ffd640 1 -- 172.21.15.170:0/1715373953 <== mgr.14682 v2:172.21.15.193:6828/4218378172 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f7a9c190080 con 0x7f7a88074010 2024-09-04T16:30:12.278 INFO:tasks.workunit.client.1.smithi193.stdout:7/649: dwrite d9/d85/fc8 [0,4194304] 0 2024-09-04T16:30:12.278 INFO:tasks.workunit.client.1.smithi193.stdout:0/556: chown d18/d25/d32/d57/d6c/l7d 58962636 1 2024-09-04T16:30:12.281 INFO:tasks.workunit.client.0.smithi170.stdout:0/300: unlink d11/c1e 0 2024-09-04T16:30:12.285 INFO:tasks.workunit.client.0.smithi170.stdout:7/345: dwrite d12/d29/f3d [4194304,4194304] 0 2024-09-04T16:30:12.287 INFO:tasks.workunit.client.0.smithi170.stdout:5/118: rename d4/db/c18 to d4/db/c24 0 2024-09-04T16:30:12.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.287+0000 7f7aa2b9f640 1 -- 172.21.15.170:0/1715373953 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f7a88074010 msgr2=0x7f7a880764d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:12.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.287+0000 7f7aa2b9f640 1 --2- 172.21.15.170:0/1715373953 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f7a88074010 0x7f7a880764d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7a98006010 tx=0x7f7a98005a20 comp rx=0 tx=0).stop 2024-09-04T16:30:12.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.287+0000 7f7aa2b9f640 1 -- 172.21.15.170:0/1715373953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a9c1018c0 msgr2=0x7f7a9c199dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:12.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.287+0000 7f7aa2b9f640 1 --2- 172.21.15.170:0/1715373953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a9c1018c0 0x7f7a9c199dc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c00e970 tx=0x7f7a8c00ee30 comp rx=0 tx=0).stop 2024-09-04T16:30:12.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.287+0000 7f7aa2b9f640 1 -- 172.21.15.170:0/1715373953 shutdown_connections 2024-09-04T16:30:12.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.287+0000 7f7aa2b9f640 1 --2- 172.21.15.170:0/1715373953 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f7a88074010 0x7f7a880764d0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7a98006010 tx=0x7f7a98005a20 comp rx=0 tx=0).stop 2024-09-04T16:30:12.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.287+0000 7f7aa2b9f640 1 --2- 172.21.15.170:0/1715373953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a9c1018c0 0x7f7a9c199dc0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:12.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.287+0000 7f7aa2b9f640 1 --2- 172.21.15.170:0/1715373953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a9c100ba0 0x7f7a9c100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:12.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.287+0000 7f7aa2b9f640 1 -- 172.21.15.170:0/1715373953 >> 172.21.15.170:0/1715373953 conn(0x7f7a9c0fb5b0 msgr2=0x7f7a9c104dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:12.289 INFO:tasks.workunit.client.0.smithi170.stdout:8/219: creat d6/d28/d20/f48 x:0 0 0 2024-09-04T16:30:12.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.290+0000 7f7aa2b9f640 1 -- 172.21.15.170:0/1715373953 shutdown_connections 2024-09-04T16:30:12.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.290+0000 7f7aa2b9f640 1 -- 172.21.15.170:0/1715373953 wait complete. 2024-09-04T16:30:12.295 INFO:tasks.workunit.client.0.smithi170.stdout:2/185: write f2 [3529801,31498] 0 2024-09-04T16:30:12.296 INFO:tasks.workunit.client.1.smithi193.stdout:8/586: symlink d2/d20/d23/d34/d4b/d7c/db2/lc4 0 2024-09-04T16:30:12.296 INFO:tasks.workunit.client.0.smithi170.stdout:2/186: chown d3/db 22112 1 2024-09-04T16:30:12.297 INFO:tasks.workunit.client.1.smithi193.stdout:8/587: truncate d2/f7f 1013426 0 2024-09-04T16:30:12.297 INFO:tasks.workunit.client.0.smithi170.stdout:2/187: readlink d3/d18/d24/l27 0 2024-09-04T16:30:12.297 INFO:tasks.workunit.client.1.smithi193.stdout:8/588: fsync d2/d20/d23/d34/fb4 0 2024-09-04T16:30:12.298 INFO:tasks.workunit.client.0.smithi170.stdout:6/199: rename d0/f6 to d0/d15/f45 0 2024-09-04T16:30:12.298 INFO:tasks.workunit.client.1.smithi193.stdout:8/589: fsync d2/d20/d23/d1b/d4e/f56 0 2024-09-04T16:30:12.299 INFO:tasks.workunit.client.1.smithi193.stdout:8/590: chown d2/d12/lf 1663966 1 2024-09-04T16:30:12.301 INFO:tasks.workunit.client.0.smithi170.stdout:6/200: read d0/d15/f26 [46438,99196] 0 2024-09-04T16:30:12.302 INFO:tasks.workunit.client.0.smithi170.stdout:0/301: unlink ff 0 2024-09-04T16:30:12.303 INFO:tasks.workunit.client.0.smithi170.stdout:6/201: readlink d0/df/d1b/d3e/d44/d2d/d2e/l3c 0 2024-09-04T16:30:12.304 INFO:tasks.workunit.client.0.smithi170.stdout:2/188: dread d3/d4/f20 [0,4194304] 0 2024-09-04T16:30:12.305 INFO:tasks.workunit.client.1.smithi193.stdout:1/612: mknod d1/d2b/d10/d56/da7/db1/cbf 0 2024-09-04T16:30:12.311 INFO:tasks.workunit.client.0.smithi170.stdout:5/119: dread d4/db/f1d [0,4194304] 0 2024-09-04T16:30:12.311 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:30:12.314 INFO:tasks.workunit.client.0.smithi170.stdout:8/220: symlink d6/d28/l49 0 2024-09-04T16:30:12.315 INFO:tasks.workunit.client.1.smithi193.stdout:9/608: write d2/d18/d2f/d22/d30/d6a/d6e/f5a [775442,125551] 0 2024-09-04T16:30:12.315 INFO:tasks.workunit.client.1.smithi193.stdout:7/650: symlink d9/d39/d3e/d4d/d4f/dab/ldc 0 2024-09-04T16:30:12.316 INFO:tasks.workunit.client.1.smithi193.stdout:5/581: write d1/f11 [2562838,100767] 0 2024-09-04T16:30:12.319 INFO:tasks.workunit.client.1.smithi193.stdout:4/461: write d3/f1c [1267548,69369] 0 2024-09-04T16:30:12.320 INFO:tasks.workunit.client.1.smithi193.stdout:2/521: getdents d2/d9/db/d10/d1f 0 2024-09-04T16:30:12.326 INFO:tasks.workunit.client.0.smithi170.stdout:6/202: rmdir d0/df/d1b/d3e/d44 39 2024-09-04T16:30:12.327 INFO:tasks.workunit.client.1.smithi193.stdout:3/547: creat d0/d18/d1c/d25/d5e/d90/fb8 x:0 0 0 2024-09-04T16:30:12.328 INFO:tasks.workunit.client.1.smithi193.stdout:3/548: read d0/d9/f83 [603783,68254] 0 2024-09-04T16:30:12.329 INFO:tasks.workunit.client.1.smithi193.stdout:3/549: read d0/d18/f3a [348566,62825] 0 2024-09-04T16:30:12.331 INFO:tasks.workunit.client.0.smithi170.stdout:2/189: unlink d3/fe 0 2024-09-04T16:30:12.332 INFO:tasks.workunit.client.0.smithi170.stdout:7/346: link fa d12/d15/d68/f76 0 2024-09-04T16:30:12.333 INFO:tasks.workunit.client.0.smithi170.stdout:7/347: chown d12/d5a/c5f 69 1 2024-09-04T16:30:12.334 INFO:tasks.workunit.client.0.smithi170.stdout:7/348: readlink d12/l62 0 2024-09-04T16:30:12.335 INFO:tasks.workunit.client.1.smithi193.stdout:8/591: unlink d2/d20/l26 0 2024-09-04T16:30:12.335 INFO:tasks.workunit.client.1.smithi193.stdout:6/520: truncate d5/f3f 4834504 0 2024-09-04T16:30:12.336 INFO:tasks.workunit.client.0.smithi170.stdout:8/221: creat d6/d28/d1a/d2f/f4a x:0 0 0 2024-09-04T16:30:12.337 INFO:tasks.workunit.client.1.smithi193.stdout:1/613: mknod d1/d2b/db/d7f/cc0 0 2024-09-04T16:30:12.337 INFO:tasks.workunit.client.0.smithi170.stdout:8/222: fdatasync d6/fa 0 2024-09-04T16:30:12.337 INFO:tasks.workunit.client.0.smithi170.stdout:4/233: link d1/d6/d22/l49 d1/d6/d8/d20/d35/d3e/d43/l5a 0 2024-09-04T16:30:12.338 INFO:tasks.workunit.client.1.smithi193.stdout:9/609: creat d2/d56/fbe x:0 0 0 2024-09-04T16:30:12.338 INFO:tasks.workunit.client.0.smithi170.stdout:8/223: write d6/d28/d1a/d2f/f4a [900582,126717] 0 2024-09-04T16:30:12.340 INFO:tasks.workunit.client.0.smithi170.stdout:8/224: dread - d6/d28/d1a/f45 zero size 2024-09-04T16:30:12.342 INFO:tasks.workunit.client.1.smithi193.stdout:0/557: symlink d18/d25/d5f/db4/lb9 0 2024-09-04T16:30:12.343 INFO:tasks.workunit.client.1.smithi193.stdout:4/462: symlink d3/d1a/d54/l9d 0 2024-09-04T16:30:12.344 INFO:tasks.workunit.client.1.smithi193.stdout:5/582: dwrite d1/d8/fd [0,4194304] 0 2024-09-04T16:30:12.346 INFO:tasks.workunit.client.1.smithi193.stdout:2/522: creat d2/d9/db/d10/d1f/d4a/fb3 x:0 0 0 2024-09-04T16:30:12.346 INFO:tasks.workunit.client.0.smithi170.stdout:2/190: creat d3/d4/f37 x:0 0 0 2024-09-04T16:30:12.347 INFO:tasks.workunit.client.0.smithi170.stdout:2/191: stat d3/db/d1c/f23 0 2024-09-04T16:30:12.353 INFO:tasks.workunit.client.1.smithi193.stdout:2/523: dwrite d2/d9/db/f89 [0,4194304] 0 2024-09-04T16:30:12.358 INFO:tasks.workunit.client.1.smithi193.stdout:8/592: mkdir d2/d20/d23/d34/d3e/dc5 0 2024-09-04T16:30:12.359 INFO:tasks.workunit.client.1.smithi193.stdout:8/593: write d2/d20/d23/d34/d3e/f50 [1164872,43878] 0 2024-09-04T16:30:12.360 INFO:tasks.workunit.client.0.smithi170.stdout:4/234: truncate d1/d6/f12 545482 0 2024-09-04T16:30:12.361 INFO:tasks.workunit.client.0.smithi170.stdout:6/203: dwrite d0/f14 [0,4194304] 0 2024-09-04T16:30:12.363 INFO:tasks.workunit.client.0.smithi170.stdout:6/204: chown d0/d17/d2a/d30/l3b 887877334 1 2024-09-04T16:30:12.364 INFO:tasks.workunit.client.0.smithi170.stdout:8/225: symlink d6/d26/l4b 0 2024-09-04T16:30:12.369 INFO:tasks.workunit.client.0.smithi170.stdout:0/302: link d11/d13/d36/c54 d11/d13/d2f/c6b 0 2024-09-04T16:30:12.369 INFO:tasks.workunit.client.1.smithi193.stdout:7/651: truncate f3 1012167 0 2024-09-04T16:30:12.370 INFO:tasks.workunit.client.1.smithi193.stdout:0/558: chown d18/d25/d5f/d6a/d7b 3864900 1 2024-09-04T16:30:12.374 INFO:tasks.workunit.client.0.smithi170.stdout:7/349: symlink d12/d16/d1d/d65/l77 0 2024-09-04T16:30:12.374 INFO:tasks.workunit.client.1.smithi193.stdout:1/614: write d1/d2b/d1b/d51/d6d/f98 [1049595,76156] 0 2024-09-04T16:30:12.377 INFO:tasks.workunit.client.0.smithi170.stdout:4/235: symlink d1/d6/d8/d20/l5b 0 2024-09-04T16:30:12.380 INFO:tasks.workunit.client.0.smithi170.stdout:6/205: truncate d0/d15/f26 246712 0 2024-09-04T16:30:12.381 INFO:tasks.workunit.client.0.smithi170.stdout:8/226: rename d6/d28/l49 to d6/d28/d16/d24/l4c 0 2024-09-04T16:30:12.382 INFO:tasks.workunit.client.1.smithi193.stdout:2/524: dread d2/fc [4194304,4194304] 0 2024-09-04T16:30:12.382 INFO:tasks.workunit.client.0.smithi170.stdout:8/227: chown d6/cd 1 1 2024-09-04T16:30:12.383 INFO:tasks.workunit.client.0.smithi170.stdout:4/236: dread d1/d6/f4f [0,4194304] 0 2024-09-04T16:30:12.384 INFO:tasks.workunit.client.0.smithi170.stdout:0/303: mknod d11/d13/d4a/c6c 0 2024-09-04T16:30:12.385 INFO:tasks.workunit.client.0.smithi170.stdout:4/237: read - d1/d6/d2b/d33/f4d zero size 2024-09-04T16:30:12.386 INFO:tasks.workunit.client.1.smithi193.stdout:6/521: symlink d5/de/lae 0 2024-09-04T16:30:12.386 INFO:tasks.workunit.client.1.smithi193.stdout:6/522: stat d5/d33 0 2024-09-04T16:30:12.386 INFO:tasks.workunit.client.0.smithi170.stdout:2/192: mknod d3/c38 0 2024-09-04T16:30:12.387 INFO:tasks.workunit.client.0.smithi170.stdout:2/193: fsync d3/f35 0 2024-09-04T16:30:12.387 INFO:tasks.workunit.client.1.smithi193.stdout:6/523: truncate d5/d33/d4e/d51/d71/d82/fa5 494293 0 2024-09-04T16:30:12.389 INFO:tasks.workunit.client.0.smithi170.stdout:5/120: getdents d4/db 0 2024-09-04T16:30:12.392 INFO:tasks.workunit.client.0.smithi170.stdout:7/350: unlink d12/d16/d1d/d65/l77 0 2024-09-04T16:30:12.394 INFO:tasks.workunit.client.0.smithi170.stdout:6/206: creat d0/d17/d2a/f46 x:0 0 0 2024-09-04T16:30:12.394 INFO:tasks.workunit.client.1.smithi193.stdout:7/652: rmdir d9/d11/dbd 39 2024-09-04T16:30:12.397 INFO:tasks.workunit.client.0.smithi170.stdout:0/304: mkdir d11/d13/d4a/d66/d6d 0 2024-09-04T16:30:12.398 INFO:tasks.workunit.client.1.smithi193.stdout:9/610: fdatasync d2/d8/f26 0 2024-09-04T16:30:12.399 INFO:tasks.workunit.client.1.smithi193.stdout:7/653: dwrite d9/d39/d3e/fa2 [0,4194304] 0 2024-09-04T16:30:12.400 INFO:tasks.workunit.client.1.smithi193.stdout:7/654: dread d9/d18/d22/d2b/d6c/d70/f8d [0,4194304] 0 2024-09-04T16:30:12.404 INFO:tasks.workunit.client.0.smithi170.stdout:5/121: unlink d4/db/f20 0 2024-09-04T16:30:12.404 INFO:tasks.workunit.client.0.smithi170.stdout:3/142: sync 2024-09-04T16:30:12.404 INFO:tasks.workunit.client.0.smithi170.stdout:9/240: sync 2024-09-04T16:30:12.405 INFO:tasks.workunit.client.1.smithi193.stdout:8/594: dwrite d2/d20/d23/f1d [0,4194304] 0 2024-09-04T16:30:12.406 INFO:tasks.workunit.client.0.smithi170.stdout:5/122: fsync d4/db/f1e 0 2024-09-04T16:30:12.408 INFO:tasks.workunit.client.1.smithi193.stdout:7/655: dread d9/d39/d3e/d69/f80 [0,4194304] 0 2024-09-04T16:30:12.408 INFO:tasks.workunit.client.0.smithi170.stdout:5/123: read d4/db/fe [1158587,107945] 0 2024-09-04T16:30:12.414 INFO:tasks.workunit.client.0.smithi170.stdout:3/143: dwrite d13/d14/d1d/f27 [0,4194304] 0 2024-09-04T16:30:12.414 INFO:tasks.workunit.client.1.smithi193.stdout:4/463: truncate d3/f30 130940 0 2024-09-04T16:30:12.415 INFO:tasks.workunit.client.0.smithi170.stdout:3/144: readlink d13/d14/l1b 0 2024-09-04T16:30:12.416 INFO:tasks.workunit.client.1.smithi193.stdout:2/525: mkdir d2/d9/db/d10/d51/d79/db4 0 2024-09-04T16:30:12.417 INFO:tasks.workunit.client.0.smithi170.stdout:0/305: symlink d11/d13/d2f/l6e 0 2024-09-04T16:30:12.420 INFO:tasks.workunit.client.0.smithi170.stdout:4/238: link d1/f31 d1/d6/d8/d20/d35/d3e/d4e/d51/f5c 0 2024-09-04T16:30:12.420 INFO:tasks.workunit.client.1.smithi193.stdout:6/524: creat d5/d27/faf x:0 0 0 2024-09-04T16:30:12.421 INFO:tasks.workunit.client.0.smithi170.stdout:0/306: truncate d11/d2a/d43/f3c 796935 0 2024-09-04T16:30:12.421 INFO:tasks.workunit.client.0.smithi170.stdout:2/194: fdatasync d3/d7/f1d 0 2024-09-04T16:30:12.422 INFO:tasks.workunit.client.1.smithi193.stdout:2/526: dwrite d2/d9/db/d10/d1e/f78 [4194304,4194304] 0 2024-09-04T16:30:12.425 INFO:tasks.workunit.client.1.smithi193.stdout:2/527: chown d2/d9/d18/l19 1686978 1 2024-09-04T16:30:12.425 INFO:tasks.workunit.client.0.smithi170.stdout:7/351: link f7 d12/d15/d68/f78 0 2024-09-04T16:30:12.425 INFO:tasks.workunit.client.1.smithi193.stdout:9/611: symlink d2/d8/d15/lbf 0 2024-09-04T16:30:12.427 INFO:tasks.workunit.client.1.smithi193.stdout:6/525: dwrite d5/de/d15/d48/f4b [0,4194304] 0 2024-09-04T16:30:12.430 INFO:tasks.workunit.client.0.smithi170.stdout:7/352: dread d12/d15/f2f [0,4194304] 0 2024-09-04T16:30:12.433 INFO:tasks.workunit.client.1.smithi193.stdout:0/559: creat d18/d25/d32/d9c/da9/fba x:0 0 0 2024-09-04T16:30:12.433 INFO:tasks.workunit.client.0.smithi170.stdout:7/353: write d12/d15/f2f [4345657,11256] 0 2024-09-04T16:30:12.433 INFO:tasks.workunit.client.1.smithi193.stdout:9/612: dwrite d2/f1c [0,4194304] 0 2024-09-04T16:30:12.436 INFO:tasks.workunit.client.1.smithi193.stdout:8/595: readlink d2/l5 0 2024-09-04T16:30:12.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.436+0000 7f412e47b640 1 -- 172.21.15.170:0/3568979920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41281011c0 msgr2=0x7f4128101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:12.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.436+0000 7f412e47b640 1 --2- 172.21.15.170:0/3568979920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41281011c0 0x7f4128101640 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f411c009880 tx=0x7f411c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:30:12.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.436+0000 7f412e47b640 1 -- 172.21.15.170:0/3568979920 shutdown_connections 2024-09-04T16:30:12.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.436+0000 7f412e47b640 1 --2- 172.21.15.170:0/3568979920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41281011c0 0x7f4128101640 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:12.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.436+0000 7f412e47b640 1 --2- 172.21.15.170:0/3568979920 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41280fffc0 0x7f41281003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:12.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.436+0000 7f412e47b640 1 -- 172.21.15.170:0/3568979920 >> 172.21.15.170:0/3568979920 conn(0x7f41280fb750 msgr2=0x7f41280fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:12.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.436+0000 7f412e47b640 1 -- 172.21.15.170:0/3568979920 shutdown_connections 2024-09-04T16:30:12.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.436+0000 7f412e47b640 1 -- 172.21.15.170:0/3568979920 wait complete. 2024-09-04T16:30:12.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.437+0000 7f412e47b640 1 Processor -- start 2024-09-04T16:30:12.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.437+0000 7f412e47b640 1 -- start start 2024-09-04T16:30:12.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.437+0000 7f412e47b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41280fffc0 0x7f4128110490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:12.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.437+0000 7f412e47b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41281011c0 0x7f41281109d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:12.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.437+0000 7f412e47b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4128108550 con 0x7f41281011c0 2024-09-04T16:30:12.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.437+0000 7f412e47b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f41281083d0 con 0x7f41280fffc0 2024-09-04T16:30:12.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.438+0000 7f41277fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41281011c0 0x7f41281109d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:12.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.438+0000 7f41277fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41281011c0 0x7f41281109d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41194/0 (socket says 172.21.15.170:41194) 2024-09-04T16:30:12.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.438+0000 7f41277fe640 1 -- 172.21.15.170:0/2201437201 learned_addr learned my addr 172.21.15.170:0/2201437201 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:30:12.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.438+0000 7f4127fff640 1 --2- 172.21.15.170:0/2201437201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41280fffc0 0x7f4128110490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:12.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.438+0000 7f41277fe640 1 -- 172.21.15.170:0/2201437201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41280fffc0 msgr2=0x7f4128110490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:12.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.438+0000 7f41277fe640 1 --2- 172.21.15.170:0/2201437201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41280fffc0 0x7f4128110490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:12.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.438+0000 7f41277fe640 1 -- 172.21.15.170:0/2201437201 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411c031510 con 0x7f41281011c0 2024-09-04T16:30:12.441 INFO:tasks.workunit.client.1.smithi193.stdout:7/656: creat d9/d18/d1e/fdd x:0 0 0 2024-09-04T16:30:12.441 INFO:tasks.workunit.client.1.smithi193.stdout:9/613: write d2/d56/d86/fad [604362,65055] 0 2024-09-04T16:30:12.441 INFO:tasks.workunit.client.1.smithi193.stdout:6/526: dwrite d5/d33/d4e/d51/f54 [0,4194304] 0 2024-09-04T16:30:12.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.438+0000 7f41277fe640 1 --2- 172.21.15.170:0/2201437201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41281011c0 0x7f41281109d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f411c031710 tx=0x7f411c031ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:12.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.439+0000 7f41257fa640 1 -- 172.21.15.170:0/2201437201 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f411c040070 con 0x7f41281011c0 2024-09-04T16:30:12.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.439+0000 7f412e47b640 1 -- 172.21.15.170:0/2201437201 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41281159d0 con 0x7f41281011c0 2024-09-04T16:30:12.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.439+0000 7f412e47b640 1 -- 172.21.15.170:0/2201437201 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4128115f00 con 0x7f41281011c0 2024-09-04T16:30:12.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.439+0000 7f41257fa640 1 -- 172.21.15.170:0/2201437201 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f411c004a10 con 0x7f41281011c0 2024-09-04T16:30:12.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.439+0000 7f41257fa640 1 -- 172.21.15.170:0/2201437201 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f411c035030 con 0x7f41281011c0 2024-09-04T16:30:12.443 INFO:tasks.workunit.client.1.smithi193.stdout:5/583: creat d1/d8/db/fb8 x:0 0 0 2024-09-04T16:30:12.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.441+0000 7f412e47b640 1 -- 172.21.15.170:0/2201437201 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41140052c0 con 0x7f41281011c0 2024-09-04T16:30:12.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.442+0000 7f41257fa640 1 -- 172.21.15.170:0/2201437201 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 25) ==== 97250+0+0 (secure 0 0 0) 0x7f411c043070 con 0x7f41281011c0 2024-09-04T16:30:12.444 INFO:tasks.workunit.client.0.smithi170.stdout:2/195: creat d3/db/df/f39 x:0 0 0 2024-09-04T16:30:12.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.443+0000 7f41257fa640 1 --2- 172.21.15.170:0/2201437201 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f4110074110 0x7f41100765d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:12.445 INFO:tasks.workunit.client.0.smithi170.stdout:2/196: chown d3/db/l34 5968 1 2024-09-04T16:30:12.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.444+0000 7f41257fa640 1 -- 172.21.15.170:0/2201437201 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f411c0b6530 con 0x7f41281011c0 2024-09-04T16:30:12.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.444+0000 7f4127fff640 1 --2- 172.21.15.170:0/2201437201 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f4110074110 0x7f41100765d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:12.446 INFO:tasks.workunit.client.1.smithi193.stdout:1/615: mknod d1/d2b/d10/cc1 0 2024-09-04T16:30:12.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.446+0000 7f4127fff640 1 --2- 172.21.15.170:0/2201437201 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f4110074110 0x7f41100765d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4118005fd0 tx=0x7f4118005850 comp rx=0 tx=0).ready entity=mgr.14682 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:12.447 INFO:tasks.workunit.client.1.smithi193.stdout:3/550: getdents d0/d18/d1c/d51/d7a 0 2024-09-04T16:30:12.449 INFO:tasks.workunit.client.1.smithi193.stdout:4/464: creat d3/d39/d44/f9e x:0 0 0 2024-09-04T16:30:12.450 INFO:tasks.workunit.client.1.smithi193.stdout:9/614: dwrite d2/f98 [0,4194304] 0 2024-09-04T16:30:12.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.452+0000 7f41257fa640 1 -- 172.21.15.170:0/2201437201 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f411c07df80 con 0x7f41281011c0 2024-09-04T16:30:12.453 INFO:tasks.workunit.client.0.smithi170.stdout:5/124: write d4/db/f1d [1804179,73757] 0 2024-09-04T16:30:12.454 INFO:tasks.workunit.client.0.smithi170.stdout:8/228: getdents d6 0 2024-09-04T16:30:12.457 INFO:tasks.workunit.client.0.smithi170.stdout:4/239: mknod d1/d6/c5d 0 2024-09-04T16:30:12.459 INFO:tasks.workunit.client.1.smithi193.stdout:2/528: unlink d2/d9/db/f2e 0 2024-09-04T16:30:12.460 INFO:tasks.workunit.client.1.smithi193.stdout:2/529: truncate d2/d9/d18/f4f 4995258 0 2024-09-04T16:30:12.466 INFO:tasks.workunit.client.0.smithi170.stdout:6/207: getdents d0/d17/d2a/d30 0 2024-09-04T16:30:12.470 INFO:tasks.workunit.client.1.smithi193.stdout:8/596: unlink d2/d20/d23/d1b/f21 0 2024-09-04T16:30:12.471 INFO:tasks.workunit.client.0.smithi170.stdout:8/229: symlink d6/d28/d16/d24/l4d 0 2024-09-04T16:30:12.471 INFO:tasks.workunit.client.1.smithi193.stdout:8/597: read d2/d20/f47 [353145,110558] 0 2024-09-04T16:30:12.472 INFO:tasks.workunit.client.0.smithi170.stdout:8/230: write d6/d28/d20/f48 [1008115,82517] 0 2024-09-04T16:30:12.474 INFO:tasks.workunit.client.0.smithi170.stdout:7/354: dread f1 [0,4194304] 0 2024-09-04T16:30:12.478 INFO:tasks.workunit.client.0.smithi170.stdout:0/307: rename d11/f18 to d11/f6f 0 2024-09-04T16:30:12.481 INFO:tasks.workunit.client.0.smithi170.stdout:2/197: dwrite d3/d4/f21 [0,4194304] 0 2024-09-04T16:30:12.481 INFO:tasks.workunit.client.1.smithi193.stdout:5/584: dread d1/d8/db/d15/d2b/d83/d37/d3f/f5a [4194304,4194304] 0 2024-09-04T16:30:12.483 INFO:tasks.workunit.client.0.smithi170.stdout:8/231: rmdir d6/d28/d1a 39 2024-09-04T16:30:12.483 INFO:tasks.workunit.client.1.smithi193.stdout:5/585: read d1/d8/db/d15/fa2 [2654948,94531] 0 2024-09-04T16:30:12.483 INFO:tasks.workunit.client.1.smithi193.stdout:9/615: truncate d2/d8/f4f 4408938 0 2024-09-04T16:30:12.483 INFO:tasks.workunit.client.0.smithi170.stdout:2/198: truncate d3/db/d1c/f2a 4325432 0 2024-09-04T16:30:12.484 INFO:tasks.workunit.client.0.smithi170.stdout:4/240: write d1/d6/d8/d20/d35/d3e/d4e/d51/f5c [894719,1104] 0 2024-09-04T16:30:12.486 INFO:tasks.workunit.client.1.smithi193.stdout:3/551: dwrite d0/d18/d1c/d51/d5a/f5c [0,4194304] 0 2024-09-04T16:30:12.487 INFO:tasks.workunit.client.0.smithi170.stdout:2/199: write d3/d4/f6 [4476002,58322] 0 2024-09-04T16:30:12.489 INFO:tasks.workunit.client.1.smithi193.stdout:3/552: read d0/d18/d1b/f8b [2551313,114084] 0 2024-09-04T16:30:12.489 INFO:tasks.workunit.client.1.smithi193.stdout:6/527: dwrite d5/d27/f35 [4194304,4194304] 0 2024-09-04T16:30:12.490 INFO:tasks.workunit.client.0.smithi170.stdout:6/208: mkdir d0/df/d1b/d3e/d47 0 2024-09-04T16:30:12.494 INFO:tasks.workunit.client.0.smithi170.stdout:4/241: dwrite d1/d6/d2b/d47/f59 [0,4194304] 0 2024-09-04T16:30:12.495 INFO:tasks.workunit.client.0.smithi170.stdout:0/308: rename d11/l26 to d11/d13/d2f/d3f/l70 0 2024-09-04T16:30:12.499 INFO:tasks.workunit.client.0.smithi170.stdout:4/242: read - d1/d6/d8/f44 zero size 2024-09-04T16:30:12.503 INFO:tasks.workunit.client.0.smithi170.stdout:6/209: dread d0/df/f3a [0,4194304] 0 2024-09-04T16:30:12.504 INFO:tasks.workunit.client.1.smithi193.stdout:8/598: fdatasync d2/f2e 0 2024-09-04T16:30:12.504 INFO:tasks.workunit.client.0.smithi170.stdout:8/232: unlink d6/d28/d16/f44 0 2024-09-04T16:30:12.505 INFO:tasks.workunit.client.0.smithi170.stdout:0/309: dwrite d11/f1c [0,4194304] 0 2024-09-04T16:30:12.507 INFO:tasks.workunit.client.0.smithi170.stdout:0/310: dread - d11/d2a/f5d zero size 2024-09-04T16:30:12.508 INFO:tasks.workunit.client.0.smithi170.stdout:6/210: truncate d0/f2 3140430 0 2024-09-04T16:30:12.511 INFO:tasks.workunit.client.0.smithi170.stdout:7/355: mkdir d12/d15/d71/d42/d79 0 2024-09-04T16:30:12.512 INFO:tasks.workunit.client.0.smithi170.stdout:5/125: getdents d4/d8 0 2024-09-04T16:30:12.515 INFO:tasks.workunit.client.1.smithi193.stdout:2/530: mkdir d2/d9/d18/d7b/db5 0 2024-09-04T16:30:12.520 INFO:tasks.workunit.client.0.smithi170.stdout:8/233: truncate d6/d28/d1a/d2f/f35 4972237 0 2024-09-04T16:30:12.524 INFO:tasks.workunit.client.1.smithi193.stdout:3/553: dread d0/d9/f58 [0,4194304] 0 2024-09-04T16:30:12.525 INFO:tasks.workunit.client.1.smithi193.stdout:6/528: rename d5/de/f93 to d5/d33/d4e/d51/fb0 0 2024-09-04T16:30:12.528 INFO:tasks.workunit.client.1.smithi193.stdout:8/599: dread d2/d20/d23/d24/d3c/d65/d67/f68 [0,4194304] 0 2024-09-04T16:30:12.534 INFO:tasks.workunit.client.1.smithi193.stdout:4/465: link d3/d39/d44/c66 d3/d3c/d47/d9c/c9f 0 2024-09-04T16:30:12.536 INFO:tasks.workunit.client.1.smithi193.stdout:9/616: mknod d2/d18/d2f/cc0 0 2024-09-04T16:30:12.536 INFO:tasks.workunit.client.0.smithi170.stdout:2/200: write f0 [5040580,87636] 0 2024-09-04T16:30:12.537 INFO:tasks.workunit.client.0.smithi170.stdout:2/201: chown d3/db/l34 472386732 1 2024-09-04T16:30:12.538 INFO:tasks.workunit.client.1.smithi193.stdout:5/586: mkdir d1/d29/d74/dae/db9 0 2024-09-04T16:30:12.539 INFO:tasks.workunit.client.1.smithi193.stdout:0/560: link d18/c1f d18/d79/d88/cbb 0 2024-09-04T16:30:12.540 INFO:tasks.workunit.client.1.smithi193.stdout:7/657: sync 2024-09-04T16:30:12.541 INFO:tasks.workunit.client.0.smithi170.stdout:0/311: truncate d11/d13/d35/f49 2735806 0 2024-09-04T16:30:12.543 INFO:tasks.workunit.client.1.smithi193.stdout:2/531: rename d2/d9/fad to d2/d9/db/d10/d51/d87/d9b/fb6 0 2024-09-04T16:30:12.543 INFO:tasks.workunit.client.0.smithi170.stdout:4/243: dwrite d1/d6/f12 [0,4194304] 0 2024-09-04T16:30:12.544 INFO:tasks.workunit.client.1.smithi193.stdout:2/532: truncate d2/d9/db/f89 4656680 0 2024-09-04T16:30:12.545 INFO:tasks.workunit.client.0.smithi170.stdout:5/126: truncate d4/db/f1e 698662 0 2024-09-04T16:30:12.548 INFO:tasks.workunit.client.0.smithi170.stdout:6/211: creat d0/d17/f48 x:0 0 0 2024-09-04T16:30:12.550 INFO:tasks.workunit.client.1.smithi193.stdout:1/616: getdents d1/d39 0 2024-09-04T16:30:12.550 INFO:tasks.workunit.client.0.smithi170.stdout:2/202: unlink d3/d7/c8 0 2024-09-04T16:30:12.552 INFO:tasks.workunit.client.1.smithi193.stdout:4/466: symlink d3/d1a/d21/d52/d7f/la0 0 2024-09-04T16:30:12.555 INFO:tasks.workunit.client.0.smithi170.stdout:0/312: rmdir d11/d13/d2f 39 2024-09-04T16:30:12.557 INFO:tasks.workunit.client.0.smithi170.stdout:0/313: stat d11/d2a/l3e 0 2024-09-04T16:30:12.558 INFO:tasks.workunit.client.1.smithi193.stdout:4/467: dwrite d3/d3c/f58 [0,4194304] 0 2024-09-04T16:30:12.559 INFO:tasks.workunit.client.0.smithi170.stdout:5/127: dwrite d4/db/f1d [0,4194304] 0 2024-09-04T16:30:12.560 INFO:tasks.workunit.client.1.smithi193.stdout:4/468: write d3/d1a/d21/d52/d5e/f68 [316257,125256] 0 2024-09-04T16:30:12.560 INFO:tasks.workunit.client.1.smithi193.stdout:5/587: creat d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/d55/fba x:0 0 0 2024-09-04T16:30:12.563 INFO:tasks.workunit.client.1.smithi193.stdout:6/529: dwrite d5/d33/d4e/d51/f80 [4194304,4194304] 0 2024-09-04T16:30:12.565 INFO:tasks.workunit.client.0.smithi170.stdout:7/356: rename d12/d15/d68/f76 to d12/d16/f7a 0 2024-09-04T16:30:12.565 INFO:tasks.workunit.client.0.smithi170.stdout:2/203: dwrite d3/d4/f6 [8388608,4194304] 0 2024-09-04T16:30:12.573 INFO:tasks.workunit.client.0.smithi170.stdout:4/244: fsync d1/d6/f14 0 2024-09-04T16:30:12.574 INFO:tasks.workunit.client.1.smithi193.stdout:0/561: unlink d18/d25/d32/d57/f84 0 2024-09-04T16:30:12.574 INFO:tasks.workunit.client.1.smithi193.stdout:0/562: readlink d18/d25/d32/d57/d6c/l7d 0 2024-09-04T16:30:12.578 INFO:tasks.workunit.client.1.smithi193.stdout:7/658: creat d9/d18/d22/d2b/d6c/d70/d79/fde x:0 0 0 2024-09-04T16:30:12.578 INFO:tasks.workunit.client.1.smithi193.stdout:7/659: readlink d9/d11/l21 0 2024-09-04T16:30:12.584 INFO:tasks.workunit.client.1.smithi193.stdout:1/617: symlink d1/d2b/d10/d2a/lc2 0 2024-09-04T16:30:12.584 INFO:tasks.workunit.client.1.smithi193.stdout:1/618: chown d1/l13 5 1 2024-09-04T16:30:12.587 INFO:tasks.workunit.client.1.smithi193.stdout:9/617: unlink d2/d18/d2f/d22/d30/d6a/fa5 0 2024-09-04T16:30:12.588 INFO:tasks.workunit.client.1.smithi193.stdout:9/618: dread - d2/d18/fbd zero size 2024-09-04T16:30:12.589 INFO:tasks.workunit.client.0.smithi170.stdout:8/234: rename d6/d28/d1a/d2f/f3f to d6/d28/d16/d24/d46/f4e 0 2024-09-04T16:30:12.591 INFO:tasks.workunit.client.0.smithi170.stdout:2/204: rmdir d3 39 2024-09-04T16:30:12.595 INFO:tasks.workunit.client.1.smithi193.stdout:7/660: dread d9/d18/f4c [0,4194304] 0 2024-09-04T16:30:12.595 INFO:tasks.workunit.client.1.smithi193.stdout:5/588: unlink d1/d8/db/d15/d2b/d83/d37/d3f/f81 0 2024-09-04T16:30:12.596 INFO:tasks.workunit.client.1.smithi193.stdout:5/589: stat d1/d8/db/d36/l3c 0 2024-09-04T16:30:12.597 INFO:tasks.workunit.client.1.smithi193.stdout:5/590: read d1/d8/db/d15/d2b/d83/d37/f63 [2075329,54925] 0 2024-09-04T16:30:12.598 INFO:tasks.workunit.client.1.smithi193.stdout:6/530: mkdir d5/d27/d3e/db1 0 2024-09-04T16:30:12.598 INFO:tasks.workunit.client.1.smithi193.stdout:5/591: write d1/d8/db/d15/f30 [2473998,34484] 0 2024-09-04T16:30:12.600 INFO:tasks.workunit.client.1.smithi193.stdout:0/563: readlink l7 0 2024-09-04T16:30:12.602 INFO:tasks.workunit.client.0.smithi170.stdout:5/128: mknod d4/d8/d1c/d23/c25 0 2024-09-04T16:30:12.603 INFO:tasks.workunit.client.1.smithi193.stdout:2/533: mkdir d2/db7 0 2024-09-04T16:30:12.605 INFO:tasks.workunit.client.1.smithi193.stdout:1/619: fdatasync d1/d2b/d10/d2a/f6f 0 2024-09-04T16:30:12.609 INFO:tasks.workunit.client.1.smithi193.stdout:4/469: mknod d3/d3c/d98/ca1 0 2024-09-04T16:30:12.611 INFO:tasks.workunit.client.0.smithi170.stdout:2/205: chown d3/db/df/l28 23073 1 2024-09-04T16:30:12.613 INFO:tasks.workunit.client.0.smithi170.stdout:4/245: symlink d1/l5e 0 2024-09-04T16:30:12.614 INFO:tasks.workunit.client.1.smithi193.stdout:0/564: creat d18/d25/d5f/d65/d9f/da0/fbc x:0 0 0 2024-09-04T16:30:12.614 INFO:tasks.workunit.client.1.smithi193.stdout:0/565: chown lc 2483 1 2024-09-04T16:30:12.617 INFO:tasks.workunit.client.1.smithi193.stdout:3/554: rename d0/d18/d1c/d25/f78 to d0/d18/d1c/fb9 0 2024-09-04T16:30:12.618 INFO:tasks.workunit.client.0.smithi170.stdout:5/129: mkdir d4/d8/d1c/d26 0 2024-09-04T16:30:12.625 INFO:tasks.workunit.client.0.smithi170.stdout:6/212: getdents d0/d17 0 2024-09-04T16:30:12.627 INFO:tasks.workunit.client.0.smithi170.stdout:0/314: rename d11/d2a to d11/d13/d71 0 2024-09-04T16:30:12.632 INFO:tasks.workunit.client.0.smithi170.stdout:7/357: getdents d12/d15/d68 0 2024-09-04T16:30:12.634 INFO:tasks.workunit.client.0.smithi170.stdout:4/246: link d1/d6/d2b/d33/d36/f3c d1/d6/d8/d20/d35/d3e/d43/f5f 0 2024-09-04T16:30:12.635 INFO:tasks.workunit.client.0.smithi170.stdout:4/247: stat d1/d6/d8/d20/d35/d3e/d4e/f45 0 2024-09-04T16:30:12.635 INFO:tasks.workunit.client.0.smithi170.stdout:6/213: fdatasync d0/df/f10 0 2024-09-04T16:30:12.637 INFO:tasks.workunit.client.0.smithi170.stdout:0/315: creat d11/d13/d35/f72 x:0 0 0 2024-09-04T16:30:12.637 INFO:tasks.workunit.client.0.smithi170.stdout:5/130: mkdir d4/d8/d1c/d26/d27 0 2024-09-04T16:30:12.637 INFO:tasks.workunit.client.0.smithi170.stdout:8/235: getdents d6 0 2024-09-04T16:30:12.638 INFO:tasks.workunit.client.0.smithi170.stdout:2/206: creat d3/d18/f3a x:0 0 0 2024-09-04T16:30:12.640 INFO:tasks.workunit.client.0.smithi170.stdout:7/358: truncate d12/d15/f2f 932979 0 2024-09-04T16:30:12.644 INFO:tasks.workunit.client.0.smithi170.stdout:0/316: dwrite d11/d13/d36/f42 [0,4194304] 0 2024-09-04T16:30:12.644 INFO:tasks.workunit.client.0.smithi170.stdout:4/248: mkdir d1/d6/d8/d20/d35/d3e/d60 0 2024-09-04T16:30:12.645 INFO:tasks.workunit.client.0.smithi170.stdout:1/233: sync 2024-09-04T16:30:12.649 INFO:tasks.workunit.client.0.smithi170.stdout:5/131: rename d4/d8/l14 to d4/d8/d1c/d26/l28 0 2024-09-04T16:30:12.653 INFO:tasks.workunit.client.1.smithi193.stdout:1/620: unlink d1/d2b/d1b/d51/d6d/f90 0 2024-09-04T16:30:12.653 INFO:tasks.workunit.client.1.smithi193.stdout:8/600: rename d2/d20/d23/d24/d3c/f45 to d2/d20/d23/d34/fc6 0 2024-09-04T16:30:12.653 INFO:tasks.workunit.client.1.smithi193.stdout:4/470: creat d3/d1a/d21/d52/d5e/fa2 x:0 0 0 2024-09-04T16:30:12.654 INFO:tasks.workunit.client.0.smithi170.stdout:2/207: unlink d3/d18/d24/l27 0 2024-09-04T16:30:12.654 INFO:tasks.workunit.client.1.smithi193.stdout:9/619: dread d2/d8/f55 [0,4194304] 0 2024-09-04T16:30:12.655 INFO:tasks.workunit.client.0.smithi170.stdout:8/236: rename d6/fa to d6/f4f 0 2024-09-04T16:30:12.656 INFO:tasks.workunit.client.1.smithi193.stdout:6/531: truncate d5/de/d15/f67 387517 0 2024-09-04T16:30:12.656 INFO:tasks.workunit.client.1.smithi193.stdout:1/621: write d1/d2b/d10/d2a/fa9 [642621,120214] 0 2024-09-04T16:30:12.657 INFO:tasks.workunit.client.0.smithi170.stdout:7/359: mkdir d12/d16/d1d/d65/d7b 0 2024-09-04T16:30:12.657 INFO:tasks.workunit.client.1.smithi193.stdout:6/532: readlink d5/d27/d3e/d43/l64 0 2024-09-04T16:30:12.658 INFO:tasks.workunit.client.0.smithi170.stdout:7/360: fsync d12/f52 0 2024-09-04T16:30:12.659 INFO:tasks.workunit.client.1.smithi193.stdout:4/471: dread d3/d1a/d21/f37 [0,4194304] 0 2024-09-04T16:30:12.663 INFO:tasks.workunit.client.0.smithi170.stdout:2/208: dwrite d3/d4/f21 [0,4194304] 0 2024-09-04T16:30:12.664 INFO:tasks.workunit.client.0.smithi170.stdout:0/317: symlink d11/d13/d71/d43/l73 0 2024-09-04T16:30:12.664 INFO:tasks.workunit.client.0.smithi170.stdout:1/234: dread d9/d11/f21 [0,4194304] 0 2024-09-04T16:30:12.665 INFO:tasks.workunit.client.0.smithi170.stdout:0/318: fsync f4 0 2024-09-04T16:30:12.667 INFO:tasks.workunit.client.0.smithi170.stdout:7/361: dread d12/f1a [0,4194304] 0 2024-09-04T16:30:12.669 INFO:tasks.workunit.client.1.smithi193.stdout:5/592: rename d1/d29/d74/dae to d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb 0 2024-09-04T16:30:12.672 INFO:tasks.workunit.client.0.smithi170.stdout:5/132: unlink d4/d8/la 0 2024-09-04T16:30:12.677 INFO:tasks.workunit.client.0.smithi170.stdout:5/133: dread d4/db/f1d [0,4194304] 0 2024-09-04T16:30:12.678 INFO:tasks.workunit.client.1.smithi193.stdout:8/601: creat d2/d20/d23/d34/d46/fc7 x:0 0 0 2024-09-04T16:30:12.678 INFO:tasks.workunit.client.1.smithi193.stdout:7/661: sync 2024-09-04T16:30:12.680 INFO:tasks.workunit.client.1.smithi193.stdout:6/533: unlink d5/de/d15/d48/faa 0 2024-09-04T16:30:12.681 INFO:tasks.workunit.client.1.smithi193.stdout:7/662: dread d9/d18/d1e/f2e [0,4194304] 0 2024-09-04T16:30:12.684 INFO:tasks.workunit.client.1.smithi193.stdout:3/555: write d0/d18/d1c/d30/f41 [145934,17020] 0 2024-09-04T16:30:12.686 INFO:tasks.workunit.client.0.smithi170.stdout:2/209: creat d3/db/f3b x:0 0 0 2024-09-04T16:30:12.690 INFO:tasks.workunit.client.1.smithi193.stdout:9/620: mknod d2/d8/cc1 0 2024-09-04T16:30:12.691 INFO:tasks.workunit.client.0.smithi170.stdout:1/235: dread d9/d26/f36 [0,4194304] 0 2024-09-04T16:30:12.691 INFO:tasks.workunit.client.0.smithi170.stdout:4/249: creat d1/d6/d8/d20/d35/d3e/d60/f61 x:0 0 0 2024-09-04T16:30:12.697 INFO:tasks.workunit.client.0.smithi170.stdout:1/236: dread d9/d26/f36 [0,4194304] 0 2024-09-04T16:30:12.697 INFO:tasks.workunit.client.0.smithi170.stdout:8/237: mkdir d6/d28/d40/d50 0 2024-09-04T16:30:12.698 INFO:tasks.workunit.client.0.smithi170.stdout:5/134: mkdir d4/d8/d1c/d29 0 2024-09-04T16:30:12.701 INFO:tasks.workunit.client.0.smithi170.stdout:6/214: getdents d0/df/d1b 0 2024-09-04T16:30:12.702 INFO:tasks.workunit.client.0.smithi170.stdout:6/215: write d0/f5 [5534376,14654] 0 2024-09-04T16:30:12.702 INFO:tasks.workunit.client.1.smithi193.stdout:4/472: mkdir d3/da3 0 2024-09-04T16:30:12.703 INFO:tasks.workunit.client.0.smithi170.stdout:6/216: write d0/fd [906093,89839] 0 2024-09-04T16:30:12.704 INFO:tasks.workunit.client.1.smithi193.stdout:4/473: truncate d3/d1a/d21/d52/d5e/fa2 8455 0 2024-09-04T16:30:12.704 INFO:tasks.workunit.client.0.smithi170.stdout:6/217: write d0/d17/f1d [3695619,50603] 0 2024-09-04T16:30:12.705 INFO:tasks.workunit.client.0.smithi170.stdout:7/362: write d12/d16/d1d/f32 [1451952,56403] 0 2024-09-04T16:30:12.708 INFO:tasks.workunit.client.1.smithi193.stdout:8/602: write d2/d20/d23/d24/d3c/d65/d67/f68 [2016339,90616] 0 2024-09-04T16:30:12.708 INFO:tasks.workunit.client.1.smithi193.stdout:6/534: dread d5/ff [0,4194304] 0 2024-09-04T16:30:12.709 INFO:tasks.workunit.client.1.smithi193.stdout:3/556: creat d0/d18/d1b/dab/fba x:0 0 0 2024-09-04T16:30:12.709 INFO:tasks.workunit.client.0.smithi170.stdout:0/319: fdatasync d11/d13/d71/d43/f60 0 2024-09-04T16:30:12.710 INFO:tasks.workunit.client.1.smithi193.stdout:4/474: truncate d3/d1a/d21/d52/d5e/d7b/f91 399464 0 2024-09-04T16:30:12.710 INFO:tasks.workunit.client.0.smithi170.stdout:0/320: dread - d11/d13/d71/f53 zero size 2024-09-04T16:30:12.710 INFO:tasks.workunit.client.0.smithi170.stdout:4/250: creat d1/d6/d22/f62 x:0 0 0 2024-09-04T16:30:12.712 INFO:tasks.workunit.client.1.smithi193.stdout:8/603: write d2/d20/dc0/fbf [391903,85858] 0 2024-09-04T16:30:12.712 INFO:tasks.workunit.client.1.smithi193.stdout:7/663: dwrite d9/d18/d22/d2b/f91 [4194304,4194304] 0 2024-09-04T16:30:12.713 INFO:tasks.workunit.client.0.smithi170.stdout:8/238: mknod d6/d28/d16/c51 0 2024-09-04T16:30:12.713 INFO:tasks.workunit.client.1.smithi193.stdout:4/475: chown d3/d1a/d2a/l2b 1 1 2024-09-04T16:30:12.714 INFO:tasks.workunit.client.1.smithi193.stdout:0/566: rename d18/d79/l97 to d18/d25/d32/d57/lbd 0 2024-09-04T16:30:12.716 INFO:tasks.workunit.client.0.smithi170.stdout:1/237: mknod d9/d11/d3e/c4d 0 2024-09-04T16:30:12.717 INFO:tasks.workunit.client.0.smithi170.stdout:1/238: chown d9/f10 90 1 2024-09-04T16:30:12.718 INFO:tasks.workunit.client.0.smithi170.stdout:4/251: dwrite d1/d6/f34 [0,4194304] 0 2024-09-04T16:30:12.719 INFO:tasks.workunit.client.0.smithi170.stdout:1/239: read - d9/d11/d2f/f4b zero size 2024-09-04T16:30:12.721 INFO:tasks.workunit.client.0.smithi170.stdout:4/252: chown d1/l41 357666 1 2024-09-04T16:30:12.723 INFO:tasks.workunit.client.1.smithi193.stdout:5/593: write d1/f5b [683792,43116] 0 2024-09-04T16:30:12.725 INFO:tasks.workunit.client.1.smithi193.stdout:3/557: truncate d0/d9/f2c 1631754 0 2024-09-04T16:30:12.730 INFO:tasks.workunit.client.0.smithi170.stdout:6/218: dread d0/df/f3a [0,4194304] 0 2024-09-04T16:30:12.731 INFO:tasks.workunit.client.1.smithi193.stdout:7/664: creat d9/d11/dd4/dd2/fdf x:0 0 0 2024-09-04T16:30:12.732 INFO:tasks.workunit.client.1.smithi193.stdout:3/558: dwrite d0/f47 [0,4194304] 0 2024-09-04T16:30:12.733 INFO:tasks.workunit.client.1.smithi193.stdout:0/567: rmdir d18/d25/d5f/d65 39 2024-09-04T16:30:12.734 INFO:tasks.workunit.client.1.smithi193.stdout:3/559: dread - d0/d18/d1c/d30/fac zero size 2024-09-04T16:30:12.735 INFO:tasks.workunit.client.1.smithi193.stdout:7/665: truncate d9/d18/d22/d2b/d6c/fcd 1048625 0 2024-09-04T16:30:12.735 INFO:tasks.workunit.client.1.smithi193.stdout:0/568: fdatasync d18/d25/d5f/d6a/d7b/f96 0 2024-09-04T16:30:12.737 INFO:tasks.workunit.client.1.smithi193.stdout:0/569: chown d18/d25/d5f/fb0 20 1 2024-09-04T16:30:12.738 INFO:tasks.workunit.client.0.smithi170.stdout:8/239: mkdir d6/d28/d16/d52 0 2024-09-04T16:30:12.741 INFO:tasks.workunit.client.0.smithi170.stdout:5/135: creat d4/d8/d1c/d29/f2a x:0 0 0 2024-09-04T16:30:12.741 INFO:tasks.workunit.client.1.smithi193.stdout:2/534: sync 2024-09-04T16:30:12.742 INFO:tasks.workunit.client.1.smithi193.stdout:6/535: truncate d5/de/f18 7953400 0 2024-09-04T16:30:12.743 INFO:tasks.workunit.client.1.smithi193.stdout:9/621: dwrite d2/d18/d2f/f47 [0,4194304] 0 2024-09-04T16:30:12.744 INFO:tasks.workunit.client.0.smithi170.stdout:1/240: creat d9/d11/d3e/f4e x:0 0 0 2024-09-04T16:30:12.747 INFO:tasks.workunit.client.0.smithi170.stdout:7/363: link d12/f1a d12/d49/f7c 0 2024-09-04T16:30:12.748 INFO:tasks.workunit.client.1.smithi193.stdout:7/666: dwrite d9/d39/d3e/d4d/d4f/dab/fc3 [0,4194304] 0 2024-09-04T16:30:12.748 INFO:tasks.workunit.client.1.smithi193.stdout:0/570: dwrite fb [0,4194304] 0 2024-09-04T16:30:12.750 INFO:tasks.workunit.client.1.smithi193.stdout:7/667: dread - d9/de/f5a zero size 2024-09-04T16:30:12.750 INFO:tasks.workunit.client.0.smithi170.stdout:2/210: rename d3/d18 to d3/d3c 0 2024-09-04T16:30:12.752 INFO:tasks.workunit.client.0.smithi170.stdout:1/241: dread d9/f22 [0,4194304] 0 2024-09-04T16:30:12.753 INFO:tasks.workunit.client.1.smithi193.stdout:9/622: dwrite d2/d56/fbe [0,4194304] 0 2024-09-04T16:30:12.753 INFO:tasks.workunit.client.1.smithi193.stdout:3/560: symlink d0/d18/d1c/d25/d5e/lbb 0 2024-09-04T16:30:12.756 INFO:tasks.workunit.client.0.smithi170.stdout:0/321: unlink d11/d13/d35/f49 0 2024-09-04T16:30:12.760 INFO:tasks.workunit.client.0.smithi170.stdout:5/136: creat d4/f2b x:0 0 0 2024-09-04T16:30:12.762 INFO:tasks.workunit.client.0.smithi170.stdout:1/242: dwrite d9/d11/d2e/f45 [0,4194304] 0 2024-09-04T16:30:12.765 INFO:tasks.workunit.client.1.smithi193.stdout:5/594: truncate d1/d8/db/d36/d40/d46/d84/fa3 754488 0 2024-09-04T16:30:12.773 INFO:tasks.workunit.client.0.smithi170.stdout:8/240: rename d6/l1b to d6/d28/d16/l53 0 2024-09-04T16:30:12.777 INFO:tasks.workunit.client.1.smithi193.stdout:4/476: write d3/f30 [1071841,67810] 0 2024-09-04T16:30:12.782 INFO:tasks.workunit.client.1.smithi193.stdout:4/477: dwrite d3/f1c [0,4194304] 0 2024-09-04T16:30:12.782 INFO:tasks.workunit.client.1.smithi193.stdout:1/622: sync 2024-09-04T16:30:12.783 INFO:tasks.workunit.client.1.smithi193.stdout:0/571: creat d18/d25/d32/d57/d6c/fbe x:0 0 0 2024-09-04T16:30:12.784 INFO:tasks.workunit.client.0.smithi170.stdout:4/253: dwrite d1/d6/d22/f48 [4194304,4194304] 0 2024-09-04T16:30:12.785 INFO:tasks.workunit.client.0.smithi170.stdout:4/254: chown d1/d6/c5d 2916 1 2024-09-04T16:30:12.786 INFO:tasks.workunit.client.1.smithi193.stdout:4/478: write d3/d3c/f88 [548212,101780] 0 2024-09-04T16:30:12.786 INFO:tasks.workunit.client.1.smithi193.stdout:8/604: dwrite d2/d20/d23/d24/d3c/d65/d67/da0/da8/db9/f78 [0,4194304] 0 2024-09-04T16:30:12.786 INFO:tasks.workunit.client.1.smithi193.stdout:1/623: chown d1/d2b/d1b/d28/d50/c73 3 1 2024-09-04T16:30:12.786 INFO:tasks.workunit.client.1.smithi193.stdout:0/572: truncate d18/d25/d3b/fae 25999 0 2024-09-04T16:30:12.786 INFO:tasks.workunit.client.0.smithi170.stdout:4/255: write d1/d6/d8/d20/d35/d3e/d4e/d51/f5c [123086,2989] 0 2024-09-04T16:30:12.793 INFO:tasks.workunit.client.1.smithi193.stdout:7/668: unlink d9/d18/d22/d2b/c9c 0 2024-09-04T16:30:12.796 INFO:tasks.workunit.client.0.smithi170.stdout:5/137: unlink d4/db/fc 0 2024-09-04T16:30:12.800 INFO:tasks.workunit.client.0.smithi170.stdout:7/364: write d12/d15/d68/f78 [1287190,62113] 0 2024-09-04T16:30:12.801 INFO:tasks.workunit.client.0.smithi170.stdout:1/243: rename d9/d34/l48 to d9/d34/l4f 0 2024-09-04T16:30:12.801 INFO:tasks.workunit.client.0.smithi170.stdout:1/244: readlink d9/lf 0 2024-09-04T16:30:12.802 INFO:tasks.workunit.client.0.smithi170.stdout:1/245: read d9/d11/d2e/f45 [3464884,121531] 0 2024-09-04T16:30:12.804 INFO:tasks.workunit.client.0.smithi170.stdout:1/246: read d9/f2b [141399,117149] 0 2024-09-04T16:30:12.805 INFO:tasks.workunit.client.1.smithi193.stdout:5/595: unlink d1/d8/f22 0 2024-09-04T16:30:12.806 INFO:tasks.workunit.client.1.smithi193.stdout:6/536: mkdir d5/de/d15/d1b/d5f/da7/db2 0 2024-09-04T16:30:12.807 INFO:tasks.workunit.client.0.smithi170.stdout:2/211: getdents d3/d3c/d24/d2c 0 2024-09-04T16:30:12.807 INFO:tasks.workunit.client.0.smithi170.stdout:2/212: stat d3 0 2024-09-04T16:30:12.808 INFO:tasks.workunit.client.0.smithi170.stdout:2/213: read - d3/db/f3b zero size 2024-09-04T16:30:12.809 INFO:tasks.workunit.client.0.smithi170.stdout:6/219: link d0/f14 d0/df/d1b/d3e/d44/d2d/d2e/f49 0 2024-09-04T16:30:12.809 INFO:tasks.workunit.client.0.smithi170.stdout:2/214: write d3/d3c/f3a [527818,68677] 0 2024-09-04T16:30:12.810 INFO:tasks.workunit.client.1.smithi193.stdout:2/535: creat d2/d9/db/d10/d38/dac/fb8 x:0 0 0 2024-09-04T16:30:12.810 INFO:tasks.workunit.client.1.smithi193.stdout:6/537: dread d5/d33/d4e/d51/d7b/f7d [0,4194304] 0 2024-09-04T16:30:12.813 INFO:tasks.workunit.client.1.smithi193.stdout:6/538: dread d5/de/d15/d1b/f79 [0,4194304] 0 2024-09-04T16:30:12.813 INFO:tasks.workunit.client.1.smithi193.stdout:1/624: creat d1/d2b/db/d54/da1/fc3 x:0 0 0 2024-09-04T16:30:12.814 INFO:tasks.workunit.client.0.smithi170.stdout:0/322: mknod d11/d13/c74 0 2024-09-04T16:30:12.815 INFO:tasks.workunit.client.1.smithi193.stdout:6/539: chown d5/d33/f4c 1282 1 2024-09-04T16:30:12.815 INFO:tasks.workunit.client.1.smithi193.stdout:4/479: symlink d3/d1a/d21/d52/d5e/d7b/la4 0 2024-09-04T16:30:12.816 INFO:tasks.workunit.client.1.smithi193.stdout:2/536: dwrite d2/d9/db/d10/d38/dac/fb8 [0,4194304] 0 2024-09-04T16:30:12.817 INFO:tasks.workunit.client.1.smithi193.stdout:4/480: chown d3/d1a/d2a/f8b 411 1 2024-09-04T16:30:12.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.817+0000 7f412e47b640 1 -- 172.21.15.170:0/2201437201 --> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4114000bf0 con 0x7f4110074110 2024-09-04T16:30:12.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.818+0000 7f41257fa640 1 -- 172.21.15.170:0/2201437201 <== mgr.14682 v2:172.21.15.193:6828/4218378172 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f4114000bf0 con 0x7f4110074110 2024-09-04T16:30:12.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.822+0000 7f412e47b640 1 -- 172.21.15.170:0/2201437201 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f4110074110 msgr2=0x7f41100765d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:12.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.822+0000 7f412e47b640 1 --2- 172.21.15.170:0/2201437201 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f4110074110 0x7f41100765d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4118005fd0 tx=0x7f4118005850 comp rx=0 tx=0).stop 2024-09-04T16:30:12.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.822+0000 7f412e47b640 1 -- 172.21.15.170:0/2201437201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41281011c0 msgr2=0x7f41281109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:12.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.822+0000 7f412e47b640 1 --2- 172.21.15.170:0/2201437201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41281011c0 0x7f41281109d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f411c031710 tx=0x7f411c031ed0 comp rx=0 tx=0).stop 2024-09-04T16:30:12.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.822+0000 7f412e47b640 1 -- 172.21.15.170:0/2201437201 shutdown_connections 2024-09-04T16:30:12.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.822+0000 7f412e47b640 1 --2- 172.21.15.170:0/2201437201 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f4110074110 0x7f41100765d0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4118005fd0 tx=0x7f4118005850 comp rx=0 tx=0).stop 2024-09-04T16:30:12.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.822+0000 7f412e47b640 1 --2- 172.21.15.170:0/2201437201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41281011c0 0x7f41281109d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:12.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.822+0000 7f412e47b640 1 --2- 172.21.15.170:0/2201437201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41280fffc0 0x7f4128110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:12.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.822+0000 7f412e47b640 1 -- 172.21.15.170:0/2201437201 >> 172.21.15.170:0/2201437201 conn(0x7f41280fb750 msgr2=0x7f4128104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:12.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.822+0000 7f412e47b640 1 -- 172.21.15.170:0/2201437201 shutdown_connections 2024-09-04T16:30:12.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.822+0000 7f412e47b640 1 -- 172.21.15.170:0/2201437201 wait complete. 2024-09-04T16:30:12.826 INFO:tasks.workunit.client.0.smithi170.stdout:5/138: creat d4/f2c x:0 0 0 2024-09-04T16:30:12.831 INFO:tasks.workunit.client.1.smithi193.stdout:3/561: symlink d0/d9/d49/d7d/lbc 0 2024-09-04T16:30:12.832 INFO:tasks.workunit.client.1.smithi193.stdout:1/625: dread d1/d2b/d1b/f4c [0,4194304] 0 2024-09-04T16:30:12.833 INFO:tasks.workunit.client.0.smithi170.stdout:8/241: getdents d6/d28/d1a/d38 0 2024-09-04T16:30:12.834 INFO:tasks.workunit.client.1.smithi193.stdout:5/596: symlink d1/d8/db/d15/d2b/d83/d37/d3f/d8e/lbc 0 2024-09-04T16:30:12.836 INFO:tasks.workunit.client.0.smithi170.stdout:1/247: creat d9/d11/d3e/f50 x:0 0 0 2024-09-04T16:30:12.838 INFO:tasks.workunit.client.1.smithi193.stdout:5/597: dwrite d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f91 [0,4194304] 0 2024-09-04T16:30:12.846 INFO:tasks.workunit.client.0.smithi170.stdout:2/215: mknod d3/db/c3d 0 2024-09-04T16:30:12.847 INFO:tasks.workunit.client.0.smithi170.stdout:2/216: readlink d3/db/l34 0 2024-09-04T16:30:12.848 INFO:tasks.workunit.client.0.smithi170.stdout:8/242: dwrite d6/d28/d1a/f42 [0,4194304] 0 2024-09-04T16:30:12.852 INFO:tasks.workunit.client.0.smithi170.stdout:1/248: dwrite d9/f18 [4194304,4194304] 0 2024-09-04T16:30:12.852 INFO:tasks.workunit.client.0.smithi170.stdout:7/365: getdents d12/d15/d41 0 2024-09-04T16:30:12.856 INFO:tasks.workunit.client.1.smithi193.stdout:2/537: symlink d2/d9/db/d10/d38/lb9 0 2024-09-04T16:30:12.858 INFO:tasks.workunit.client.1.smithi193.stdout:4/481: creat d3/d1a/d21/d52/d5e/fa5 x:0 0 0 2024-09-04T16:30:12.858 INFO:tasks.workunit.client.1.smithi193.stdout:2/538: dread - d2/d9/db/d10/d51/d87/d9b/fb6 zero size 2024-09-04T16:30:12.863 INFO:tasks.workunit.client.1.smithi193.stdout:9/623: getdents d2/d8/d88/da3 0 2024-09-04T16:30:12.863 INFO:tasks.workunit.client.1.smithi193.stdout:3/562: creat d0/d3b/fbd x:0 0 0 2024-09-04T16:30:12.864 INFO:tasks.workunit.client.0.smithi170.stdout:7/366: dwrite d12/d29/d5c/f74 [0,4194304] 0 2024-09-04T16:30:12.865 INFO:tasks.workunit.client.1.smithi193.stdout:3/563: fsync d0/d18/d1c/d25/d5e/d7e/f7c 0 2024-09-04T16:30:12.870 INFO:tasks.workunit.client.1.smithi193.stdout:3/564: dwrite d0/d18/d1c/d30/fac [0,4194304] 0 2024-09-04T16:30:12.872 INFO:tasks.workunit.client.1.smithi193.stdout:5/598: rename d1/d29/d74/d96/d98/fb4 to d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/fbd 0 2024-09-04T16:30:12.875 INFO:tasks.workunit.client.0.smithi170.stdout:2/217: creat d3/d7/f3e x:0 0 0 2024-09-04T16:30:12.876 INFO:tasks.workunit.client.0.smithi170.stdout:6/220: dwrite d0/df/d1b/f29 [0,4194304] 0 2024-09-04T16:30:12.877 INFO:tasks.workunit.client.0.smithi170.stdout:2/218: write f0 [2966890,100186] 0 2024-09-04T16:30:12.880 INFO:tasks.workunit.client.1.smithi193.stdout:0/573: creat d18/d25/d5f/fbf x:0 0 0 2024-09-04T16:30:12.883 INFO:tasks.workunit.client.0.smithi170.stdout:8/243: creat d6/d28/d1a/f54 x:0 0 0 2024-09-04T16:30:12.883 INFO:tasks.workunit.client.1.smithi193.stdout:6/540: getdents d5/de/d15/d1b/d5f/da7/db2 0 2024-09-04T16:30:12.886 INFO:tasks.workunit.client.0.smithi170.stdout:1/249: symlink d9/d11/d2e/l51 0 2024-09-04T16:30:12.887 INFO:tasks.workunit.client.1.smithi193.stdout:7/669: creat d9/d18/d22/fe0 x:0 0 0 2024-09-04T16:30:12.888 INFO:tasks.workunit.client.0.smithi170.stdout:8/244: dread d6/d28/d16/d24/d46/f4e [0,4194304] 0 2024-09-04T16:30:12.888 INFO:tasks.workunit.client.1.smithi193.stdout:7/670: chown d9/de/l75 7800 1 2024-09-04T16:30:12.889 INFO:tasks.workunit.client.1.smithi193.stdout:2/539: dread d2/d9/d18/f6f [0,4194304] 0 2024-09-04T16:30:12.889 INFO:tasks.workunit.client.1.smithi193.stdout:4/482: write d3/d1a/d21/f2c [1860166,109099] 0 2024-09-04T16:30:12.891 INFO:tasks.workunit.client.0.smithi170.stdout:7/367: rmdir d12/d5a 39 2024-09-04T16:30:12.899 INFO:tasks.workunit.client.0.smithi170.stdout:4/256: getdents d1/d6/d8/d20/d35/d3e/d4e/d51 0 2024-09-04T16:30:12.900 INFO:tasks.workunit.client.0.smithi170.stdout:0/323: dwrite d11/f6f [4194304,4194304] 0 2024-09-04T16:30:12.900 INFO:tasks.workunit.client.0.smithi170.stdout:6/221: write d0/df/fa [292991,37875] 0 2024-09-04T16:30:12.902 INFO:tasks.workunit.client.0.smithi170.stdout:6/222: fsync d0/d17/d2a/f46 0 2024-09-04T16:30:12.903 INFO:tasks.workunit.client.0.smithi170.stdout:1/250: creat d9/d11/d2e/f52 x:0 0 0 2024-09-04T16:30:12.905 INFO:tasks.workunit.client.1.smithi193.stdout:0/574: symlink d18/d25/d32/lc0 0 2024-09-04T16:30:12.906 INFO:tasks.workunit.client.1.smithi193.stdout:8/605: getdents d2/d20/d23/d34/d3e/d6f/d81 0 2024-09-04T16:30:12.906 INFO:tasks.workunit.client.1.smithi193.stdout:9/624: write d2/d8/d15/f35 [4309006,113492] 0 2024-09-04T16:30:12.906 INFO:tasks.workunit.client.0.smithi170.stdout:8/245: mkdir d6/d28/d16/d24/d46/d55 0 2024-09-04T16:30:12.907 INFO:tasks.workunit.client.1.smithi193.stdout:6/541: creat d5/d27/d3e/d6e/fb3 x:0 0 0 2024-09-04T16:30:12.908 INFO:tasks.workunit.client.0.smithi170.stdout:8/246: chown d6/d28/d16/d24 434 1 2024-09-04T16:30:12.908 INFO:tasks.workunit.client.1.smithi193.stdout:8/606: readlink d2/l9 0 2024-09-04T16:30:12.908 INFO:tasks.workunit.client.0.smithi170.stdout:7/368: symlink d12/d29/d5c/l7d 0 2024-09-04T16:30:12.909 INFO:tasks.workunit.client.1.smithi193.stdout:6/542: fdatasync d5/d27/d3e/f73 0 2024-09-04T16:30:12.910 INFO:tasks.workunit.client.1.smithi193.stdout:7/671: chown d9/de/d27/f67 1 1 2024-09-04T16:30:12.911 INFO:tasks.workunit.client.1.smithi193.stdout:7/672: dread - d9/de/fca zero size 2024-09-04T16:30:12.912 INFO:tasks.workunit.client.0.smithi170.stdout:2/219: symlink d3/l3f 0 2024-09-04T16:30:12.913 INFO:tasks.workunit.client.1.smithi193.stdout:4/483: dwrite d3/d3c/f58 [0,4194304] 0 2024-09-04T16:30:12.913 INFO:tasks.workunit.client.0.smithi170.stdout:4/257: mknod d1/d6/d8/d20/d35/d54/c63 0 2024-09-04T16:30:12.913 INFO:tasks.workunit.client.0.smithi170.stdout:0/324: truncate d11/f15 1516861 0 2024-09-04T16:30:12.914 INFO:tasks.workunit.client.0.smithi170.stdout:2/220: write d3/f35 [193096,124635] 0 2024-09-04T16:30:12.914 INFO:tasks.workunit.client.1.smithi193.stdout:4/484: truncate d3/d3c/f88 1310854 0 2024-09-04T16:30:12.915 INFO:tasks.workunit.client.0.smithi170.stdout:1/251: dwrite d9/d26/f46 [0,4194304] 0 2024-09-04T16:30:12.916 INFO:tasks.workunit.client.1.smithi193.stdout:9/625: mkdir d2/d56/d86/dc2 0 2024-09-04T16:30:12.916 INFO:tasks.workunit.client.0.smithi170.stdout:0/325: dread - d11/f68 zero size 2024-09-04T16:30:12.916 INFO:tasks.workunit.client.1.smithi193.stdout:4/485: chown d3/d1a/d21/c46 2 1 2024-09-04T16:30:12.918 INFO:tasks.workunit.client.1.smithi193.stdout:4/486: readlink d3/d1a/d54/l6f 0 2024-09-04T16:30:12.919 INFO:tasks.workunit.client.1.smithi193.stdout:3/565: dread d0/d9/f2c [0,4194304] 0 2024-09-04T16:30:12.920 INFO:tasks.workunit.client.1.smithi193.stdout:7/673: dwrite d9/d18/d22/fb8 [0,4194304] 0 2024-09-04T16:30:12.920 INFO:tasks.workunit.client.0.smithi170.stdout:7/369: creat d12/d15/d71/d42/f7e x:0 0 0 2024-09-04T16:30:12.923 INFO:tasks.workunit.client.1.smithi193.stdout:4/487: dread d3/d1a/d2a/d83/f93 [0,4194304] 0 2024-09-04T16:30:12.923 INFO:tasks.workunit.client.0.smithi170.stdout:8/247: symlink d6/d28/d1a/d2f/l56 0 2024-09-04T16:30:12.924 INFO:tasks.workunit.client.0.smithi170.stdout:6/223: chown d0/df/c13 7530 1 2024-09-04T16:30:12.926 INFO:tasks.workunit.client.0.smithi170.stdout:0/326: chown d11/d13/d4a/f62 986210 1 2024-09-04T16:30:12.929 INFO:tasks.workunit.client.0.smithi170.stdout:1/252: creat d9/d11/f53 x:0 0 0 2024-09-04T16:30:12.929 INFO:tasks.workunit.client.0.smithi170.stdout:4/258: creat d1/d6/d2b/d33/f64 x:0 0 0 2024-09-04T16:30:12.929 INFO:tasks.workunit.client.0.smithi170.stdout:2/221: dwrite d3/d4/f37 [0,4194304] 0 2024-09-04T16:30:12.930 INFO:tasks.workunit.client.1.smithi193.stdout:6/543: creat d5/d27/d3e/d8c/fb4 x:0 0 0 2024-09-04T16:30:12.930 INFO:tasks.workunit.client.0.smithi170.stdout:8/248: read d6/d28/d1a/d2f/f35 [1424805,66675] 0 2024-09-04T16:30:12.931 INFO:tasks.workunit.client.1.smithi193.stdout:6/544: read d5/d33/d4e/d51/d7b/f7d [215481,71379] 0 2024-09-04T16:30:12.934 INFO:tasks.workunit.client.0.smithi170.stdout:2/222: stat d3/db/c3d 0 2024-09-04T16:30:12.935 INFO:tasks.workunit.client.1.smithi193.stdout:0/575: mknod d18/d25/d5f/d65/cc1 0 2024-09-04T16:30:12.935 INFO:tasks.workunit.client.1.smithi193.stdout:0/576: fsync d18/d79/d88/fab 0 2024-09-04T16:30:12.936 INFO:tasks.workunit.client.1.smithi193.stdout:6/545: dwrite d5/d27/d3e/f89 [0,4194304] 0 2024-09-04T16:30:12.937 INFO:tasks.workunit.client.1.smithi193.stdout:0/577: chown d18/d25/f3c 8 1 2024-09-04T16:30:12.945 INFO:tasks.workunit.client.1.smithi193.stdout:0/578: dwrite d18/f1a [0,4194304] 0 2024-09-04T16:30:12.946 INFO:tasks.workunit.client.1.smithi193.stdout:3/566: rmdir d0/d18/d1c/d51/d7a 39 2024-09-04T16:30:12.947 INFO:tasks.workunit.client.1.smithi193.stdout:7/674: fsync d9/d18/f4c 0 2024-09-04T16:30:12.949 INFO:tasks.workunit.client.0.smithi170.stdout:2/223: dread d3/db/d1c/f2a [0,4194304] 0 2024-09-04T16:30:12.950 INFO:tasks.workunit.client.1.smithi193.stdout:1/626: sync 2024-09-04T16:30:12.950 INFO:tasks.workunit.client.0.smithi170.stdout:0/327: mkdir d11/d75 0 2024-09-04T16:30:12.953 INFO:tasks.workunit.client.0.smithi170.stdout:4/259: dwrite d1/d6/d8/d20/d35/d3e/d4e/d51/f5c [0,4194304] 0 2024-09-04T16:30:12.955 INFO:tasks.workunit.client.0.smithi170.stdout:0/328: write d11/d13/f28 [4208871,119402] 0 2024-09-04T16:30:12.955 INFO:tasks.workunit.client.0.smithi170.stdout:8/249: dwrite d6/d28/f1d [0,4194304] 0 2024-09-04T16:30:12.960 INFO:tasks.workunit.client.1.smithi193.stdout:4/488: dwrite d3/f6 [4194304,4194304] 0 2024-09-04T16:30:12.961 INFO:tasks.workunit.client.1.smithi193.stdout:1/627: dwrite d1/d2b/f45 [4194304,4194304] 0 2024-09-04T16:30:12.964 INFO:tasks.workunit.client.1.smithi193.stdout:4/489: write d3/f6 [8874324,92832] 0 2024-09-04T16:30:12.966 INFO:tasks.workunit.client.1.smithi193.stdout:8/607: dread d2/d20/d23/d34/d3e/f50 [0,4194304] 0 2024-09-04T16:30:12.969 INFO:tasks.workunit.client.0.smithi170.stdout:8/250: creat d6/f57 x:0 0 0 2024-09-04T16:30:12.972 INFO:tasks.workunit.client.0.smithi170.stdout:1/253: creat d9/f54 x:0 0 0 2024-09-04T16:30:12.973 INFO:tasks.workunit.client.0.smithi170.stdout:1/254: fsync d9/f37 0 2024-09-04T16:30:12.974 INFO:tasks.workunit.client.1.smithi193.stdout:2/540: truncate d2/d9/db/d65/fa7 591168 0 2024-09-04T16:30:12.975 INFO:tasks.workunit.client.0.smithi170.stdout:4/260: symlink d1/d6/d8/d20/l65 0 2024-09-04T16:30:12.975 INFO:tasks.workunit.client.1.smithi193.stdout:6/546: rename d5/c5b to d5/d33/d4e/d51/d7b/cb5 0 2024-09-04T16:30:12.976 INFO:tasks.workunit.client.0.smithi170.stdout:8/251: dread d6/d28/f1d [0,4194304] 0 2024-09-04T16:30:12.982 INFO:tasks.workunit.client.0.smithi170.stdout:0/329: creat d11/d13/d71/f76 x:0 0 0 2024-09-04T16:30:12.982 INFO:tasks.workunit.client.1.smithi193.stdout:1/628: dread d1/d2b/f45 [4194304,4194304] 0 2024-09-04T16:30:12.982 INFO:tasks.workunit.client.1.smithi193.stdout:1/629: stat d1/d2b/d1b/f4c 0 2024-09-04T16:30:12.983 INFO:tasks.workunit.client.1.smithi193.stdout:2/541: dread d2/d9/db/d10/d38/dac/fb8 [0,4194304] 0 2024-09-04T16:30:12.984 INFO:tasks.workunit.client.0.smithi170.stdout:2/224: mkdir d3/d3c/d40 0 2024-09-04T16:30:12.984 INFO:tasks.workunit.client.0.smithi170.stdout:2/225: readlink d3/db/df/l28 0 2024-09-04T16:30:12.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.984+0000 7fbc2fb48640 1 -- 172.21.15.170:0/3228792577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc28100200 msgr2=0x7fbc28100600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:12.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.984+0000 7fbc2fb48640 1 --2- 172.21.15.170:0/3228792577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc28100200 0x7fbc28100600 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009880 tx=0x7fbc1802a4b0 comp rx=0 tx=0).stop 2024-09-04T16:30:12.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.984+0000 7fbc2fb48640 1 -- 172.21.15.170:0/3228792577 shutdown_connections 2024-09-04T16:30:12.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.984+0000 7fbc2fb48640 1 --2- 172.21.15.170:0/3228792577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc28100b40 0x7fbc28100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:12.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.984+0000 7fbc2fb48640 1 --2- 172.21.15.170:0/3228792577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc28100200 0x7fbc28100600 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:12.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.984+0000 7fbc2fb48640 1 -- 172.21.15.170:0/3228792577 >> 172.21.15.170:0/3228792577 conn(0x7fbc280fc010 msgr2=0x7fbc280fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:12.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.985+0000 7fbc2fb48640 1 -- 172.21.15.170:0/3228792577 shutdown_connections 2024-09-04T16:30:12.986 INFO:tasks.workunit.client.0.smithi170.stdout:2/226: chown d3/db/d1c/c25 7 1 2024-09-04T16:30:12.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.985+0000 7fbc2fb48640 1 -- 172.21.15.170:0/3228792577 wait complete. 2024-09-04T16:30:12.987 INFO:tasks.workunit.client.1.smithi193.stdout:5/599: sync 2024-09-04T16:30:12.987 INFO:tasks.workunit.client.0.smithi170.stdout:2/227: chown d3/d3c 24574493 1 2024-09-04T16:30:12.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.986+0000 7fbc2fb48640 1 Processor -- start 2024-09-04T16:30:12.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.986+0000 7fbc2fb48640 1 -- start start 2024-09-04T16:30:12.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.987+0000 7fbc2fb48640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc28100200 0x7fbc28105d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:12.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.987+0000 7fbc2fb48640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc28100b40 0x7fbc28106250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:12.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.987+0000 7fbc2fb48640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2810c990 con 0x7fbc28100b40 2024-09-04T16:30:12.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.987+0000 7fbc2fb48640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2810c810 con 0x7fbc28100200 2024-09-04T16:30:12.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.987+0000 7fbc2d8e4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc28100200 0x7fbc28105d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:12.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.987+0000 7fbc2d8e4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc28100200 0x7fbc28105d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.170:37846/0 (socket says 172.21.15.170:37846) 2024-09-04T16:30:12.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.987+0000 7fbc2d8e4640 1 -- 172.21.15.170:0/2482017314 learned_addr learned my addr 172.21.15.170:0/2482017314 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:30:12.989 INFO:tasks.workunit.client.0.smithi170.stdout:2/228: chown d3/db/f3b 3085 1 2024-09-04T16:30:12.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.987+0000 7fbc2d0e3640 1 --2- 172.21.15.170:0/2482017314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc28100b40 0x7fbc28106250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:12.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.988+0000 7fbc2d8e4640 1 -- 172.21.15.170:0/2482017314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc28100b40 msgr2=0x7fbc28106250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:12.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.988+0000 7fbc2d8e4640 1 --2- 172.21.15.170:0/2482017314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc28100b40 0x7fbc28106250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:12.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.988+0000 7fbc2d8e4640 1 -- 172.21.15.170:0/2482017314 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc28102890 con 0x7fbc28100200 2024-09-04T16:30:12.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.988+0000 7fbc2d8e4640 1 --2- 172.21.15.170:0/2482017314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc28100200 0x7fbc28105d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbc18005880 tx=0x7fbc180048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:12.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.989+0000 7fbc1effd640 1 -- 172.21.15.170:0/2482017314 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc18040070 con 0x7fbc28100200 2024-09-04T16:30:12.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.989+0000 7fbc1effd640 1 -- 172.21.15.170:0/2482017314 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc18003ab0 con 0x7fbc28100200 2024-09-04T16:30:12.990 INFO:tasks.workunit.client.1.smithi193.stdout:9/626: creat d2/d18/d2f/fc3 x:0 0 0 2024-09-04T16:30:12.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.989+0000 7fbc1effd640 1 -- 172.21.15.170:0/2482017314 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc18035020 con 0x7fbc28100200 2024-09-04T16:30:12.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.989+0000 7fbc2fb48640 1 -- 172.21.15.170:0/2482017314 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc28102b20 con 0x7fbc28100200 2024-09-04T16:30:12.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.989+0000 7fbc2fb48640 1 -- 172.21.15.170:0/2482017314 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc28103050 con 0x7fbc28100200 2024-09-04T16:30:12.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.990+0000 7fbc2fb48640 1 -- 172.21.15.170:0/2482017314 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc28100600 con 0x7fbc28100200 2024-09-04T16:30:12.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.991+0000 7fbc1effd640 1 -- 172.21.15.170:0/2482017314 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 97250+0+0 (secure 0 0 0) 0x7fbc18043070 con 0x7fbc28100200 2024-09-04T16:30:12.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.992+0000 7fbc1effd640 1 --2- 172.21.15.170:0/2482017314 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fbc14073ff0 0x7fbc140764b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:12.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.992+0000 7fbc1effd640 1 -- 172.21.15.170:0/2482017314 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fbc180b6040 con 0x7fbc28100200 2024-09-04T16:30:12.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.992+0000 7fbc2d0e3640 1 --2- 172.21.15.170:0/2482017314 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fbc14073ff0 0x7fbc140764b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:12.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:12.992+0000 7fbc2d0e3640 1 --2- 172.21.15.170:0/2482017314 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fbc14073ff0 0x7fbc140764b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbc28103c90 tx=0x7fbc2400b390 comp rx=0 tx=0).ready entity=mgr.14682 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:12.993 INFO:tasks.workunit.client.1.smithi193.stdout:4/490: write d3/d1a/d21/d52/f6c [7074116,27623] 0 2024-09-04T16:30:12.994 INFO:tasks.workunit.client.0.smithi170.stdout:4/261: rmdir d1/d6/d8/d20/d35/d3e 39 2024-09-04T16:30:12.996 INFO:tasks.workunit.client.1.smithi193.stdout:4/491: write d3/d81/f9b [268224,66271] 0 2024-09-04T16:30:12.996 INFO:tasks.workunit.client.1.smithi193.stdout:9/627: dwrite d2/f98 [4194304,4194304] 0 2024-09-04T16:30:12.997 INFO:tasks.workunit.client.1.smithi193.stdout:6/547: creat d5/d33/d4e/d51/d68/fb6 x:0 0 0 2024-09-04T16:30:12.998 INFO:tasks.workunit.client.0.smithi170.stdout:6/224: dread d0/f11 [0,4194304] 0 2024-09-04T16:30:13.001 INFO:tasks.workunit.client.1.smithi193.stdout:3/567: mknod d0/d18/cbe 0 2024-09-04T16:30:13.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.000+0000 7fbc1effd640 1 -- 172.21.15.170:0/2482017314 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fbc18081cc0 con 0x7fbc28100200 2024-09-04T16:30:13.002 INFO:tasks.workunit.client.1.smithi193.stdout:1/630: mknod d1/d2b/db/d7f/cc4 0 2024-09-04T16:30:13.003 INFO:tasks.workunit.client.1.smithi193.stdout:1/631: read - d1/d2b/db/d54/da1/fc3 zero size 2024-09-04T16:30:13.004 INFO:tasks.workunit.client.1.smithi193.stdout:6/548: dwrite d5/f44 [0,4194304] 0 2024-09-04T16:30:13.005 INFO:tasks.workunit.client.1.smithi193.stdout:1/632: dread d1/d39/f8a [0,4194304] 0 2024-09-04T16:30:13.006 INFO:tasks.workunit.client.0.smithi170.stdout:4/262: unlink d1/d6/ff 0 2024-09-04T16:30:13.009 INFO:tasks.workunit.client.1.smithi193.stdout:2/542: mknod d2/d9/db/d10/d51/d79/cba 0 2024-09-04T16:30:13.011 INFO:tasks.workunit.client.1.smithi193.stdout:2/543: chown d2/d9/db/d10/d51/d87 7032572 1 2024-09-04T16:30:13.012 INFO:tasks.workunit.client.0.smithi170.stdout:0/330: mkdir d11/d75/d77 0 2024-09-04T16:30:13.013 INFO:tasks.workunit.client.0.smithi170.stdout:0/331: fdatasync d11/f29 0 2024-09-04T16:30:13.014 INFO:tasks.workunit.client.1.smithi193.stdout:5/600: rmdir d1/d8/db 39 2024-09-04T16:30:13.015 INFO:tasks.workunit.client.0.smithi170.stdout:4/263: dwrite d1/d6/f12 [0,4194304] 0 2024-09-04T16:30:13.018 INFO:tasks.workunit.client.0.smithi170.stdout:2/229: dread d3/d7/f26 [0,4194304] 0 2024-09-04T16:30:13.020 INFO:tasks.workunit.client.0.smithi170.stdout:1/255: link d9/d11/f21 d9/f55 0 2024-09-04T16:30:13.022 INFO:tasks.workunit.client.1.smithi193.stdout:3/568: dread d0/d7/fc [0,4194304] 0 2024-09-04T16:30:13.029 INFO:tasks.workunit.client.0.smithi170.stdout:6/225: mknod d0/df/d1f/d42/c4a 0 2024-09-04T16:30:13.029 INFO:tasks.workunit.client.1.smithi193.stdout:8/608: truncate d2/d20/f2d 2313875 0 2024-09-04T16:30:13.031 INFO:tasks.workunit.client.0.smithi170.stdout:0/332: mknod d11/d13/d71/c78 0 2024-09-04T16:30:13.033 INFO:tasks.workunit.client.1.smithi193.stdout:0/579: creat d18/d25/d5f/fc2 x:0 0 0 2024-09-04T16:30:13.033 INFO:tasks.workunit.client.0.smithi170.stdout:4/264: rmdir d1/d6/d2b/d33/d36 39 2024-09-04T16:30:13.033 INFO:tasks.workunit.client.1.smithi193.stdout:0/580: chown d18/d25/f29 23502 1 2024-09-04T16:30:13.034 INFO:tasks.workunit.client.1.smithi193.stdout:0/581: stat d18/d25/d5f/c68 0 2024-09-04T16:30:13.038 INFO:tasks.workunit.client.0.smithi170.stdout:8/252: getdents d6/d28/d16 0 2024-09-04T16:30:13.038 INFO:tasks.workunit.client.1.smithi193.stdout:6/549: rmdir d5/d33/d4e/d51/d68 39 2024-09-04T16:30:13.039 INFO:tasks.workunit.client.0.smithi170.stdout:6/226: mknod d0/df/d1f/d42/c4b 0 2024-09-04T16:30:13.041 INFO:tasks.workunit.client.1.smithi193.stdout:2/544: creat d2/d9/db/d10/d38/da5/fbb x:0 0 0 2024-09-04T16:30:13.042 INFO:tasks.workunit.client.0.smithi170.stdout:6/227: read d0/fd [1483704,90794] 0 2024-09-04T16:30:13.043 INFO:tasks.workunit.client.1.smithi193.stdout:7/675: rename d9/d18/d22/d2b/c81 to d9/d11/ce1 0 2024-09-04T16:30:13.044 INFO:tasks.workunit.client.1.smithi193.stdout:7/676: chown d9/d18 24757875 1 2024-09-04T16:30:13.044 INFO:tasks.workunit.client.0.smithi170.stdout:2/230: creat d3/d3c/d40/f41 x:0 0 0 2024-09-04T16:30:13.045 INFO:tasks.workunit.client.1.smithi193.stdout:2/545: dread d2/d9/db/d10/d38/dac/fb8 [0,4194304] 0 2024-09-04T16:30:13.045 INFO:tasks.workunit.client.0.smithi170.stdout:8/253: dwrite d6/d28/d1a/d2f/f47 [0,4194304] 0 2024-09-04T16:30:13.045 INFO:tasks.workunit.client.1.smithi193.stdout:7/677: truncate d9/d39/d3e/d7d/f9e 254970 0 2024-09-04T16:30:13.045 INFO:tasks.workunit.client.1.smithi193.stdout:2/546: write d2/f2a [3396090,66777] 0 2024-09-04T16:30:13.046 INFO:tasks.workunit.client.0.smithi170.stdout:8/254: dread - d6/d28/d1a/f54 zero size 2024-09-04T16:30:13.047 INFO:tasks.workunit.client.0.smithi170.stdout:2/231: dread d3/d3c/f30 [0,4194304] 0 2024-09-04T16:30:13.048 INFO:tasks.workunit.client.0.smithi170.stdout:3/145: sync 2024-09-04T16:30:13.048 INFO:tasks.workunit.client.0.smithi170.stdout:9/241: sync 2024-09-04T16:30:13.056 INFO:tasks.workunit.client.0.smithi170.stdout:0/333: rename d11/d13/d35/f72 to d11/f79 0 2024-09-04T16:30:13.056 INFO:tasks.workunit.client.0.smithi170.stdout:3/146: rename d13/d14 to d13/d14/d17/d1c/d2c 22 2024-09-04T16:30:13.058 INFO:tasks.workunit.client.0.smithi170.stdout:8/255: write d6/d28/d1a/f23 [5784120,21184] 0 2024-09-04T16:30:13.061 INFO:tasks.workunit.client.0.smithi170.stdout:2/232: write d3/d4/f20 [2743451,41641] 0 2024-09-04T16:30:13.063 INFO:tasks.workunit.client.0.smithi170.stdout:3/147: chown f12 9633 1 2024-09-04T16:30:13.064 INFO:tasks.workunit.client.0.smithi170.stdout:4/265: dwrite d1/fc [0,4194304] 0 2024-09-04T16:30:13.065 INFO:tasks.workunit.client.0.smithi170.stdout:0/334: creat d11/d13/d36/f7a x:0 0 0 2024-09-04T16:30:13.067 INFO:tasks.workunit.client.0.smithi170.stdout:4/266: write d1/d6/d2b/d33/f57 [898026,41067] 0 2024-09-04T16:30:13.067 INFO:tasks.workunit.client.0.smithi170.stdout:9/242: getdents d2/d3d/d3f 0 2024-09-04T16:30:13.069 INFO:tasks.workunit.client.0.smithi170.stdout:2/233: truncate d3/d7/f1d 3286804 0 2024-09-04T16:30:13.070 INFO:tasks.workunit.client.0.smithi170.stdout:3/148: fdatasync f12 0 2024-09-04T16:30:13.073 INFO:tasks.workunit.client.1.smithi193.stdout:4/492: symlink d3/la6 0 2024-09-04T16:30:13.073 INFO:tasks.workunit.client.0.smithi170.stdout:9/243: rmdir d2/d32 39 2024-09-04T16:30:13.075 INFO:tasks.workunit.client.0.smithi170.stdout:8/256: dwrite d6/f41 [0,4194304] 0 2024-09-04T16:30:13.078 INFO:tasks.workunit.client.0.smithi170.stdout:8/257: write d6/d28/d1a/d2f/f47 [3378964,16944] 0 2024-09-04T16:30:13.079 INFO:tasks.workunit.client.1.smithi193.stdout:8/609: mkdir d2/d20/d23/d24/d3c/d65/dc8 0 2024-09-04T16:30:13.080 INFO:tasks.workunit.client.1.smithi193.stdout:8/610: chown d2/d20/d23/d34/d46/d53/d90/fad 23593 1 2024-09-04T16:30:13.082 INFO:tasks.workunit.client.0.smithi170.stdout:2/234: creat d3/db/d1c/f42 x:0 0 0 2024-09-04T16:30:13.084 INFO:tasks.workunit.client.0.smithi170.stdout:0/335: truncate d11/d13/d71/d43/f58 1008380 0 2024-09-04T16:30:13.091 INFO:tasks.workunit.client.1.smithi193.stdout:5/601: sync 2024-09-04T16:30:13.092 INFO:tasks.workunit.client.0.smithi170.stdout:8/258: mknod d6/d28/d16/d24/d46/c58 0 2024-09-04T16:30:13.095 INFO:tasks.workunit.client.1.smithi193.stdout:3/569: getdents d0/d18/d1b/d3d/d96 0 2024-09-04T16:30:13.096 INFO:tasks.workunit.client.1.smithi193.stdout:9/628: dwrite d2/d8/f26 [0,4194304] 0 2024-09-04T16:30:13.099 INFO:tasks.workunit.client.1.smithi193.stdout:1/633: truncate d1/d2b/d1b/d28/f75 3023080 0 2024-09-04T16:30:13.100 INFO:tasks.workunit.client.0.smithi170.stdout:8/259: dwrite d6/d28/d1a/f23 [0,4194304] 0 2024-09-04T16:30:13.102 INFO:tasks.workunit.client.0.smithi170.stdout:0/336: rename d11/d13/d36/f42 to d11/d75/f7b 0 2024-09-04T16:30:13.108 INFO:tasks.workunit.client.1.smithi193.stdout:2/547: mknod d2/d9/db/d10/d38/cbc 0 2024-09-04T16:30:13.111 INFO:tasks.workunit.client.0.smithi170.stdout:3/149: write ff [8346,89713] 0 2024-09-04T16:30:13.112 INFO:tasks.workunit.client.1.smithi193.stdout:2/548: dread d2/d9/db/f89 [0,4194304] 0 2024-09-04T16:30:13.112 INFO:tasks.workunit.client.1.smithi193.stdout:4/493: symlink d3/d1a/d21/d52/la7 0 2024-09-04T16:30:13.116 INFO:tasks.workunit.client.1.smithi193.stdout:7/678: write d9/de/d27/f38 [3809364,9801] 0 2024-09-04T16:30:13.117 INFO:tasks.workunit.client.1.smithi193.stdout:8/611: mkdir d2/d20/d23/d24/d3c/dc9 0 2024-09-04T16:30:13.119 INFO:tasks.workunit.client.0.smithi170.stdout:8/260: rename d6/d28/d16/c34 to d6/d28/d16/c59 0 2024-09-04T16:30:13.120 INFO:tasks.workunit.client.0.smithi170.stdout:0/337: rmdir d11/d13/d4a 39 2024-09-04T16:30:13.121 INFO:tasks.workunit.client.1.smithi193.stdout:6/550: getdents d5/d27/d3e/d43/d5d/d97 0 2024-09-04T16:30:13.122 INFO:tasks.workunit.client.1.smithi193.stdout:6/551: read d5/d27/f35 [6016771,80377] 0 2024-09-04T16:30:13.122 INFO:tasks.workunit.client.1.smithi193.stdout:8/612: dwrite d2/d12/f8e [0,4194304] 0 2024-09-04T16:30:13.123 INFO:tasks.workunit.client.1.smithi193.stdout:5/602: write d1/d29/d18/d42/f51 [535635,84516] 0 2024-09-04T16:30:13.123 INFO:tasks.workunit.client.1.smithi193.stdout:6/552: chown d5/d33/d4e/c5c 244858 1 2024-09-04T16:30:13.124 INFO:tasks.workunit.client.1.smithi193.stdout:8/613: chown d2/d20/d23/d1b/f28 71 1 2024-09-04T16:30:13.125 INFO:tasks.workunit.client.1.smithi193.stdout:3/570: fsync d0/d9/f83 0 2024-09-04T16:30:13.130 INFO:tasks.workunit.client.0.smithi170.stdout:2/235: getdents d3 0 2024-09-04T16:30:13.131 INFO:tasks.workunit.client.1.smithi193.stdout:4/494: rename d3/d1a/d21/d52/d5e/f68 to d3/d1a/d21/d52/d5e/fa8 0 2024-09-04T16:30:13.132 INFO:tasks.workunit.client.0.smithi170.stdout:9/244: dread d2/d32/f41 [0,4194304] 0 2024-09-04T16:30:13.133 INFO:tasks.workunit.client.0.smithi170.stdout:8/261: dwrite d6/d28/f1d [0,4194304] 0 2024-09-04T16:30:13.134 INFO:tasks.workunit.client.1.smithi193.stdout:7/679: rmdir d9/d39/d3e/d7d 39 2024-09-04T16:30:13.136 INFO:tasks.workunit.client.1.smithi193.stdout:0/582: getdents d18/d25/d32/d9c 0 2024-09-04T16:30:13.136 INFO:tasks.workunit.client.1.smithi193.stdout:4/495: dwrite d3/f35 [0,4194304] 0 2024-09-04T16:30:13.137 INFO:tasks.workunit.client.0.smithi170.stdout:8/262: write d6/d28/d1a/f54 [287180,56154] 0 2024-09-04T16:30:13.138 INFO:tasks.workunit.client.1.smithi193.stdout:4/496: readlink d3/d1a/d21/d52/d7f/la0 0 2024-09-04T16:30:13.138 INFO:tasks.workunit.client.1.smithi193.stdout:0/583: write d18/d25/d3b/f75 [4037127,35716] 0 2024-09-04T16:30:13.140 INFO:tasks.workunit.client.1.smithi193.stdout:0/584: write d18/d25/d32/d57/f4e [972844,84565] 0 2024-09-04T16:30:13.141 INFO:tasks.workunit.client.1.smithi193.stdout:0/585: chown d18/d79/d88/d9a 2049948 1 2024-09-04T16:30:13.143 INFO:tasks.workunit.client.0.smithi170.stdout:3/150: getdents d13 0 2024-09-04T16:30:13.143 INFO:tasks.workunit.client.0.smithi170.stdout:2/236: dwrite d3/d4/f20 [4194304,4194304] 0 2024-09-04T16:30:13.144 INFO:tasks.workunit.client.1.smithi193.stdout:5/603: fsync d1/d8/db/f56 0 2024-09-04T16:30:13.148 INFO:tasks.workunit.client.0.smithi170.stdout:0/338: truncate d11/f1c 3847937 0 2024-09-04T16:30:13.150 INFO:tasks.workunit.client.0.smithi170.stdout:8/263: rename d6/d28/d1a/f23 to d6/d28/d16/f5a 0 2024-09-04T16:30:13.153 INFO:tasks.workunit.client.0.smithi170.stdout:3/151: mkdir d13/d14/d1d/d2d 0 2024-09-04T16:30:13.154 INFO:tasks.workunit.client.0.smithi170.stdout:2/237: symlink d3/d3c/d40/l43 0 2024-09-04T16:30:13.159 INFO:tasks.workunit.client.1.smithi193.stdout:6/553: write d5/de/d15/d1b/d5f/f8f [1059834,104126] 0 2024-09-04T16:30:13.160 INFO:tasks.workunit.client.1.smithi193.stdout:9/629: truncate d2/d56/fbe 4160189 0 2024-09-04T16:30:13.160 INFO:tasks.workunit.client.1.smithi193.stdout:6/554: readlink d5/d27/d3e/d43/l7a 0 2024-09-04T16:30:13.161 INFO:tasks.workunit.client.1.smithi193.stdout:9/630: chown d2/d56/f76 21 1 2024-09-04T16:30:13.165 INFO:tasks.workunit.client.1.smithi193.stdout:6/555: dwrite d5/d27/d3e/f69 [0,4194304] 0 2024-09-04T16:30:13.165 INFO:tasks.workunit.client.1.smithi193.stdout:1/634: truncate d1/d2b/db/f5b 689002 0 2024-09-04T16:30:13.165 INFO:tasks.workunit.client.0.smithi170.stdout:8/264: write d6/d28/d1a/d2f/f3e [2741285,52808] 0 2024-09-04T16:30:13.167 INFO:tasks.workunit.client.1.smithi193.stdout:6/556: chown d5/de/d15/d1b/f99 122 1 2024-09-04T16:30:13.168 INFO:tasks.workunit.client.1.smithi193.stdout:1/635: write d1/d2b/d1b/d51/d6d/d89/f93 [1023143,64335] 0 2024-09-04T16:30:13.168 INFO:tasks.workunit.client.1.smithi193.stdout:7/680: symlink d9/d18/d22/d2b/da6/le2 0 2024-09-04T16:30:13.168 INFO:tasks.workunit.client.1.smithi193.stdout:6/557: dread - d5/d27/d3e/d8c/fad zero size 2024-09-04T16:30:13.169 INFO:tasks.workunit.client.1.smithi193.stdout:7/681: write d9/d39/d3e/d4d/d4f/dab/fc3 [3122517,16338] 0 2024-09-04T16:30:13.170 INFO:tasks.workunit.client.0.smithi170.stdout:3/152: creat d13/d14/d21/f2e x:0 0 0 2024-09-04T16:30:13.170 INFO:tasks.workunit.client.1.smithi193.stdout:7/682: dread - d9/d11/dd4/dd2/fdf zero size 2024-09-04T16:30:13.173 INFO:tasks.workunit.client.0.smithi170.stdout:9/245: truncate d2/d11/d23/f29 3921474 0 2024-09-04T16:30:13.174 INFO:tasks.workunit.client.0.smithi170.stdout:2/238: mkdir d3/d3c/d24/d44 0 2024-09-04T16:30:13.175 INFO:tasks.workunit.client.0.smithi170.stdout:9/246: truncate d2/d11/d23/f30 4542431 0 2024-09-04T16:30:13.175 INFO:tasks.workunit.client.1.smithi193.stdout:4/497: chown d3/d1a/c4b 172 1 2024-09-04T16:30:13.177 INFO:tasks.workunit.client.0.smithi170.stdout:8/265: creat d6/d28/d1a/d2f/f5b x:0 0 0 2024-09-04T16:30:13.186 INFO:tasks.workunit.client.0.smithi170.stdout:0/339: creat d11/d13/f7c x:0 0 0 2024-09-04T16:30:13.188 INFO:tasks.workunit.client.0.smithi170.stdout:8/266: unlink d6/d26/c37 0 2024-09-04T16:30:13.189 INFO:tasks.workunit.client.1.smithi193.stdout:3/571: mkdir d0/d18/d1c/d51/d7a/dbf 0 2024-09-04T16:30:13.191 INFO:tasks.workunit.client.1.smithi193.stdout:2/549: sync 2024-09-04T16:30:13.194 INFO:tasks.workunit.client.1.smithi193.stdout:9/631: mknod d2/d56/cc4 0 2024-09-04T16:30:13.194 INFO:tasks.workunit.client.0.smithi170.stdout:8/267: dwrite d6/d28/f1d [0,4194304] 0 2024-09-04T16:30:13.194 INFO:tasks.workunit.client.1.smithi193.stdout:3/572: dwrite d0/d18/d1c/d30/f41 [0,4194304] 0 2024-09-04T16:30:13.195 INFO:tasks.workunit.client.0.smithi170.stdout:3/153: getdents d13 0 2024-09-04T16:30:13.196 INFO:tasks.workunit.client.0.smithi170.stdout:9/247: stat d2/d11/d23/f29 0 2024-09-04T16:30:13.197 INFO:tasks.workunit.client.0.smithi170.stdout:3/154: write d13/d14/d1d/f27 [4286778,57535] 0 2024-09-04T16:30:13.199 INFO:tasks.workunit.client.1.smithi193.stdout:6/558: mknod d5/d27/d3e/d8c/cb7 0 2024-09-04T16:30:13.200 INFO:tasks.workunit.client.0.smithi170.stdout:3/155: dread - d13/d14/d21/f2e zero size 2024-09-04T16:30:13.201 INFO:tasks.workunit.client.1.smithi193.stdout:7/683: unlink d9/d39/d3e/d4d/d4f/dab/ldc 0 2024-09-04T16:30:13.203 INFO:tasks.workunit.client.0.smithi170.stdout:8/268: dwrite d6/d28/d1a/f54 [0,4194304] 0 2024-09-04T16:30:13.212 INFO:tasks.workunit.client.0.smithi170.stdout:9/248: unlink d2/d3d/f2c 0 2024-09-04T16:30:13.217 INFO:tasks.workunit.client.1.smithi193.stdout:8/614: rename d2/d20/d23/d1b/d4e/f56 to d2/fca 0 2024-09-04T16:30:13.219 INFO:tasks.workunit.client.1.smithi193.stdout:2/550: rmdir d2/d9 39 2024-09-04T16:30:13.221 INFO:tasks.workunit.client.0.smithi170.stdout:9/249: unlink d2/d3d/l16 0 2024-09-04T16:30:13.226 INFO:tasks.workunit.client.1.smithi193.stdout:1/636: getdents d1/da3 0 2024-09-04T16:30:13.226 INFO:tasks.workunit.client.1.smithi193.stdout:1/637: stat d1/d2b/d1b/da0/fb9 0 2024-09-04T16:30:13.228 INFO:tasks.workunit.client.0.smithi170.stdout:9/250: dwrite d2/d11/f33 [0,4194304] 0 2024-09-04T16:30:13.231 INFO:tasks.workunit.client.0.smithi170.stdout:9/251: write d2/d3d/d27/f2e [1926674,8186] 0 2024-09-04T16:30:13.232 INFO:tasks.workunit.client.1.smithi193.stdout:7/684: dwrite d9/d11/dbd/fd9 [0,4194304] 0 2024-09-04T16:30:13.233 INFO:tasks.workunit.client.1.smithi193.stdout:8/615: write d2/fca [1295200,38747] 0 2024-09-04T16:30:13.237 INFO:tasks.workunit.client.0.smithi170.stdout:9/252: read d2/d11/d23/f29 [1711296,90917] 0 2024-09-04T16:30:13.241 INFO:tasks.workunit.client.1.smithi193.stdout:9/632: truncate d2/d8/d61/f87 739771 0 2024-09-04T16:30:13.241 INFO:tasks.workunit.client.0.smithi170.stdout:8/269: truncate d6/d28/d16/d24/d46/f4e 1539579 0 2024-09-04T16:30:13.242 INFO:tasks.workunit.client.1.smithi193.stdout:3/573: write d0/d7/fc [3362257,39523] 0 2024-09-04T16:30:13.246 INFO:tasks.workunit.client.0.smithi170.stdout:9/253: creat d2/d3d/d35/f43 x:0 0 0 2024-09-04T16:30:13.247 INFO:tasks.workunit.client.0.smithi170.stdout:8/270: unlink d6/cd 0 2024-09-04T16:30:13.248 INFO:tasks.workunit.client.1.smithi193.stdout:0/586: link c12 d18/cc3 0 2024-09-04T16:30:13.251 INFO:tasks.workunit.client.1.smithi193.stdout:6/559: write d5/de/f18 [5137870,109323] 0 2024-09-04T16:30:13.252 INFO:tasks.workunit.client.0.smithi170.stdout:9/254: creat d2/d3d/d35/f44 x:0 0 0 2024-09-04T16:30:13.253 INFO:tasks.workunit.client.0.smithi170.stdout:8/271: dread d6/d28/d1a/d2f/f47 [0,4194304] 0 2024-09-04T16:30:13.254 INFO:tasks.workunit.client.1.smithi193.stdout:8/616: fsync d2/d20/d23/d24/d3c/d65/f74 0 2024-09-04T16:30:13.254 INFO:tasks.workunit.client.1.smithi193.stdout:0/587: dwrite d18/d25/d32/d57/f56 [0,4194304] 0 2024-09-04T16:30:13.257 INFO:tasks.workunit.client.1.smithi193.stdout:9/633: fdatasync d2/f42 0 2024-09-04T16:30:13.259 INFO:tasks.workunit.client.0.smithi170.stdout:8/272: creat d6/d28/d1a/d2f/f5c x:0 0 0 2024-09-04T16:30:13.260 INFO:tasks.workunit.client.1.smithi193.stdout:6/560: dwrite d5/d27/d3e/d8c/fb4 [0,4194304] 0 2024-09-04T16:30:13.268 INFO:tasks.workunit.client.1.smithi193.stdout:6/561: dread d5/de/d15/d1b/d5f/f8f [0,4194304] 0 2024-09-04T16:30:13.268 INFO:tasks.workunit.client.1.smithi193.stdout:5/604: rename d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/d55 to d1/d8/db/d36/d40/d46/dbe 0 2024-09-04T16:30:13.270 INFO:tasks.workunit.client.1.smithi193.stdout:6/562: read d5/de/f17 [2339398,121065] 0 2024-09-04T16:30:13.271 INFO:tasks.workunit.client.1.smithi193.stdout:8/617: creat d2/d57/fcb x:0 0 0 2024-09-04T16:30:13.271 INFO:tasks.workunit.client.1.smithi193.stdout:2/551: write d2/d9/db/d65/f6a [641998,124563] 0 2024-09-04T16:30:13.273 INFO:tasks.workunit.client.1.smithi193.stdout:8/618: truncate d2/d57/fa6 958076 0 2024-09-04T16:30:13.275 INFO:tasks.workunit.client.1.smithi193.stdout:1/638: write d1/d2b/db/f3b [1017701,82850] 0 2024-09-04T16:30:13.275 INFO:tasks.workunit.client.1.smithi193.stdout:3/574: mkdir d0/d18/d1c/d51/d5a/da2/dc0 0 2024-09-04T16:30:13.279 INFO:tasks.workunit.client.1.smithi193.stdout:9/634: read d2/d8/d25/f3e [1194349,28770] 0 2024-09-04T16:30:13.280 INFO:tasks.workunit.client.1.smithi193.stdout:4/498: rename d3/d39/d44/f74 to d3/d1a/d21/d52/d5e/d7b/fa9 0 2024-09-04T16:30:13.286 INFO:tasks.workunit.client.0.smithi170.stdout:9/255: dread d2/f4 [0,4194304] 0 2024-09-04T16:30:13.287 INFO:tasks.workunit.client.1.smithi193.stdout:5/605: dread d1/d29/d18/f5e [4194304,4194304] 0 2024-09-04T16:30:13.287 INFO:tasks.workunit.client.0.smithi170.stdout:9/256: write d2/d11/f26 [534885,35074] 0 2024-09-04T16:30:13.288 INFO:tasks.workunit.client.1.smithi193.stdout:2/552: creat d2/d9/db/d10/d4e/fbd x:0 0 0 2024-09-04T16:30:13.290 INFO:tasks.workunit.client.1.smithi193.stdout:8/619: creat d2/d20/d23/d1b/d4e/fcc x:0 0 0 2024-09-04T16:30:13.291 INFO:tasks.workunit.client.1.smithi193.stdout:3/575: dread d0/d7/f6b [0,4194304] 0 2024-09-04T16:30:13.292 INFO:tasks.workunit.client.1.smithi193.stdout:1/639: unlink d1/d39/d48/l8e 0 2024-09-04T16:30:13.292 INFO:tasks.workunit.client.0.smithi170.stdout:9/257: chown d2/d11/f24 1016 1 2024-09-04T16:30:13.299 INFO:tasks.workunit.client.1.smithi193.stdout:7/685: rename d9/d39/d3e/d4d/d4f/f94 to d9/d18/d22/d2b/d6c/d70/fe3 0 2024-09-04T16:30:13.300 INFO:tasks.workunit.client.1.smithi193.stdout:4/499: readlink d3/d1a/d21/l7d 0 2024-09-04T16:30:13.305 INFO:tasks.workunit.client.0.smithi170.stdout:9/258: dread d2/d11/f12 [0,4194304] 0 2024-09-04T16:30:13.307 INFO:tasks.workunit.client.1.smithi193.stdout:2/553: symlink d2/d9/db/d10/d4e/lbe 0 2024-09-04T16:30:13.307 INFO:tasks.workunit.client.1.smithi193.stdout:9/635: write d2/d4/f5 [1495666,118608] 0 2024-09-04T16:30:13.308 INFO:tasks.workunit.client.1.smithi193.stdout:2/554: write d2/d9/db/d65/f6a [16674,98167] 0 2024-09-04T16:30:13.308 INFO:tasks.workunit.client.1.smithi193.stdout:3/576: creat d0/d18/d1b/d3d/fc1 x:0 0 0 2024-09-04T16:30:13.310 INFO:tasks.workunit.client.1.smithi193.stdout:3/577: chown d0/d18/d1b/f36 337 1 2024-09-04T16:30:13.311 INFO:tasks.workunit.client.1.smithi193.stdout:6/563: truncate d5/d33/f3a 1427417 0 2024-09-04T16:30:13.312 INFO:tasks.workunit.client.0.smithi170.stdout:9/259: link d2/f4 d2/d3d/d27/d2b/d34/f45 0 2024-09-04T16:30:13.313 INFO:tasks.workunit.client.1.smithi193.stdout:4/500: mkdir d3/d1a/d21/d52/d5e/daa 0 2024-09-04T16:30:13.314 INFO:tasks.workunit.client.1.smithi193.stdout:0/588: getdents d18/d25/d3b 0 2024-09-04T16:30:13.316 INFO:tasks.workunit.client.1.smithi193.stdout:5/606: link d1/d29/d18/f2f d1/d8/db/d15/d2b/d83/d37/d58/d9e/da7/fbf 0 2024-09-04T16:30:13.316 INFO:tasks.workunit.client.1.smithi193.stdout:6/564: dwrite d5/d27/d3e/f73 [0,4194304] 0 2024-09-04T16:30:13.317 INFO:tasks.workunit.client.1.smithi193.stdout:2/555: creat d2/d9/db/d10/d1f/d22/fbf x:0 0 0 2024-09-04T16:30:13.318 INFO:tasks.workunit.client.1.smithi193.stdout:1/640: mkdir d1/d2b/d1b/d51/dc5 0 2024-09-04T16:30:13.319 INFO:tasks.workunit.client.1.smithi193.stdout:3/578: chown d0/d10/d24/d55/l85 231717 1 2024-09-04T16:30:13.319 INFO:tasks.workunit.client.1.smithi193.stdout:4/501: mknod d3/d3c/d89/cab 0 2024-09-04T16:30:13.320 INFO:tasks.workunit.client.1.smithi193.stdout:2/556: readlink d2/d9/db/d10/d4e/lbe 0 2024-09-04T16:30:13.320 INFO:tasks.workunit.client.1.smithi193.stdout:4/502: read d3/f1c [1358280,42842] 0 2024-09-04T16:30:13.321 INFO:tasks.workunit.client.1.smithi193.stdout:9/636: symlink d2/d18/d2f/d22/d30/d52/dbb/lc5 0 2024-09-04T16:30:13.322 INFO:tasks.workunit.client.1.smithi193.stdout:7/686: dread d9/f19 [0,4194304] 0 2024-09-04T16:30:13.323 INFO:tasks.workunit.client.1.smithi193.stdout:6/565: dread d5/de/f41 [0,4194304] 0 2024-09-04T16:30:13.324 INFO:tasks.workunit.client.1.smithi193.stdout:5/607: truncate d1/d8/db/d15/d2b/d83/d37/f63 4113820 0 2024-09-04T16:30:13.325 INFO:tasks.workunit.client.1.smithi193.stdout:4/503: dread - d3/f28 zero size 2024-09-04T16:30:13.325 INFO:tasks.workunit.client.1.smithi193.stdout:9/637: fsync d2/d4/f23 0 2024-09-04T16:30:13.328 INFO:tasks.workunit.client.1.smithi193.stdout:9/638: write d2/f1c [403581,35509] 0 2024-09-04T16:30:13.329 INFO:tasks.workunit.client.1.smithi193.stdout:3/579: dread d0/d18/d1c/d25/f42 [0,4194304] 0 2024-09-04T16:30:13.332 INFO:tasks.workunit.client.1.smithi193.stdout:2/557: rename d2/c3 to d2/d9/db/d10/d1e/cc0 0 2024-09-04T16:30:13.333 INFO:tasks.workunit.client.1.smithi193.stdout:6/566: dwrite d5/d27/da0/fa6 [0,4194304] 0 2024-09-04T16:30:13.335 INFO:tasks.workunit.client.1.smithi193.stdout:9/639: truncate d2/d4/f3a 481039 0 2024-09-04T16:30:13.335 INFO:tasks.workunit.client.1.smithi193.stdout:2/558: write d2/d9/db/d10/d1e/f78 [2854360,4024] 0 2024-09-04T16:30:13.338 INFO:tasks.workunit.client.1.smithi193.stdout:5/608: creat d1/d8/fc0 x:0 0 0 2024-09-04T16:30:13.340 INFO:tasks.workunit.client.1.smithi193.stdout:7/687: getdents d9/d18/d22/d2b/d6c/d70 0 2024-09-04T16:30:13.340 INFO:tasks.workunit.client.1.smithi193.stdout:3/580: dwrite d0/d7/f6b [0,4194304] 0 2024-09-04T16:30:13.340 INFO:tasks.workunit.client.1.smithi193.stdout:9/640: truncate d2/d18/fbd 1004156 0 2024-09-04T16:30:13.343 INFO:tasks.workunit.client.1.smithi193.stdout:1/641: write d1/f6e [446439,119386] 0 2024-09-04T16:30:13.344 INFO:tasks.workunit.client.1.smithi193.stdout:2/559: mkdir d2/d9/db/d10/d1e/d26/dc1 0 2024-09-04T16:30:13.345 INFO:tasks.workunit.client.1.smithi193.stdout:5/609: mkdir d1/d8/db/d36/d40/dc1 0 2024-09-04T16:30:13.348 INFO:tasks.workunit.client.1.smithi193.stdout:2/560: dread - d2/d9/db/d10/d4e/f81 zero size 2024-09-04T16:30:13.350 INFO:tasks.workunit.client.1.smithi193.stdout:3/581: dread d0/d7/fc [0,4194304] 0 2024-09-04T16:30:13.350 INFO:tasks.workunit.client.1.smithi193.stdout:0/589: dwrite f3 [0,4194304] 0 2024-09-04T16:30:13.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.350+0000 7fbc2fb48640 1 -- 172.21.15.170:0/2482017314 --> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fbc2802d970 con 0x7fbc14073ff0 2024-09-04T16:30:13.351 INFO:tasks.workunit.client.1.smithi193.stdout:3/582: chown d0/d10/d24/d55/c84 2 1 2024-09-04T16:30:13.353 INFO:tasks.workunit.client.1.smithi193.stdout:0/590: write d18/d25/d5f/d6a/d7b/fac [751664,45512] 0 2024-09-04T16:30:13.353 INFO:tasks.workunit.client.1.smithi193.stdout:4/504: rename d3/f1f to d3/d39/fac 0 2024-09-04T16:30:13.355 INFO:tasks.workunit.client.1.smithi193.stdout:5/610: fsync d1/d29/d18/f5e 0 2024-09-04T16:30:13.356 INFO:tasks.workunit.client.1.smithi193.stdout:3/583: write d0/d18/d1c/d51/d5a/fa3 [414454,105104] 0 2024-09-04T16:30:13.356 INFO:tasks.workunit.client.1.smithi193.stdout:1/642: mknod d1/d2b/d1b/d28/d50/d84/cc6 0 2024-09-04T16:30:13.358 INFO:tasks.workunit.client.1.smithi193.stdout:0/591: readlink d18/d25/d5f/d65/d9f/lb8 0 2024-09-04T16:30:13.359 INFO:tasks.workunit.client.1.smithi193.stdout:1/643: fdatasync d1/d2b/d1b/d51/fa6 0 2024-09-04T16:30:13.360 INFO:tasks.workunit.client.1.smithi193.stdout:3/584: read - d0/d18/d1c/d25/d5e/d90/fb8 zero size 2024-09-04T16:30:13.361 INFO:tasks.workunit.client.1.smithi193.stdout:6/567: truncate d5/d27/f84 95458 0 2024-09-04T16:30:13.365 INFO:tasks.workunit.client.1.smithi193.stdout:7/688: write d9/d39/d3e/f3f [848563,86115] 0 2024-09-04T16:30:13.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.365+0000 7fbc1effd640 1 -- 172.21.15.170:0/2482017314 <== mgr.14682 v2:172.21.15.193:6828/4218378172 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fbc2802d970 con 0x7fbc14073ff0 2024-09-04T16:30:13.366 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:30:13.366 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (6m) 32s ago 7m 25.1M - 0.25.0 c8568f914cd2 e85db6a2e731 2024-09-04T16:30:13.366 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 starting - - - - 2024-09-04T16:30:13.366 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (7m) 37s ago 7m 5268k - 19.1.1-252-g48920dab b708f9119ac7 f9a24a1cb9dd 2024-09-04T16:30:13.366 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (8m) 32s ago 8m 6891k - 19.1.1-252-g48920dab b708f9119ac7 aa2ec5c5776a 2024-09-04T16:30:13.366 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (7m) 37s ago 7m 6895k - 19.1.1-252-g48920dab b708f9119ac7 a24f0ce3b3fb 2024-09-04T16:30:13.366 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (6m) 32s ago 7m 79.2M - 9.4.12 2bacad6d85d8 5bffd3332aba 2024-09-04T16:30:13.366 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (2m) 32s ago 2m 22.0M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:30:13.366 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (2m) 32s ago 2m 140M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:30:13.366 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (2m) 37s ago 2m 13.1M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:30:13.366 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (2m) 37s ago 2m 12.4M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:30:13.366 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:9283,8765,8443 running (9m) 32s ago 9m 249M - 19.1.1-252-g48920dab b708f9119ac7 3f0663652a64 2024-09-04T16:30:13.367 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (59s) 37s ago 7m 496M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 5d9c73a5a6dd 2024-09-04T16:30:13.367 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (9m) 32s ago 9m 54.0M 2048M 19.1.1-252-g48920dab b708f9119ac7 194ff39cc041 2024-09-04T16:30:13.367 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (7m) 37s ago 7m 41.0M 2048M 19.1.1-252-g48920dab b708f9119ac7 38c8e99ca323 2024-09-04T16:30:13.367 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (8m) 32s ago 8m 15.8M - 1.5.0 0da6a335fe13 e311ba1b18bc 2024-09-04T16:30:13.367 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (7m) 37s ago 7m 16.2M - 1.5.0 0da6a335fe13 09fd1aa1fdb6 2024-09-04T16:30:13.367 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (5m) 32s ago 5m 81.5M 1216M 19.1.1-252-g48920dab b708f9119ac7 6c2ea484615d 2024-09-04T16:30:13.367 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (5m) 32s ago 5m 88.1M 1216M 19.1.1-252-g48920dab b708f9119ac7 20469ba5727b 2024-09-04T16:30:13.367 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (5m) 32s ago 5m 71.5M 1216M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:30:13.367 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (4m) 37s ago 4m 88.2M 2240M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:30:13.368 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (4m) 37s ago 4m 78.7M 2240M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:30:13.368 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (3m) 37s ago 3m 80.3M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:30:13.368 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (6m) 32s ago 7m 60.0M - 2.43.0 a07b618ecd1d 58faf9d631cd 2024-09-04T16:30:13.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.368+0000 7fbc2fb48640 1 -- 172.21.15.170:0/2482017314 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fbc14073ff0 msgr2=0x7fbc140764b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:13.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.368+0000 7fbc2fb48640 1 --2- 172.21.15.170:0/2482017314 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fbc14073ff0 0x7fbc140764b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbc28103c90 tx=0x7fbc2400b390 comp rx=0 tx=0).stop 2024-09-04T16:30:13.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.368+0000 7fbc2fb48640 1 -- 172.21.15.170:0/2482017314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc28100200 msgr2=0x7fbc28105d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:13.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.368+0000 7fbc2fb48640 1 --2- 172.21.15.170:0/2482017314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc28100200 0x7fbc28105d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbc18005880 tx=0x7fbc180048f0 comp rx=0 tx=0).stop 2024-09-04T16:30:13.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.368+0000 7fbc2fb48640 1 -- 172.21.15.170:0/2482017314 shutdown_connections 2024-09-04T16:30:13.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.368+0000 7fbc2fb48640 1 --2- 172.21.15.170:0/2482017314 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fbc14073ff0 0x7fbc140764b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:13.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.368+0000 7fbc2fb48640 1 --2- 172.21.15.170:0/2482017314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc28100b40 0x7fbc28106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:13.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.368+0000 7fbc2fb48640 1 --2- 172.21.15.170:0/2482017314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc28100200 0x7fbc28105d10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:13.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.368+0000 7fbc2fb48640 1 -- 172.21.15.170:0/2482017314 >> 172.21.15.170:0/2482017314 conn(0x7fbc280fc010 msgr2=0x7fbc28108c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:13.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.369+0000 7fbc2fb48640 1 -- 172.21.15.170:0/2482017314 shutdown_connections 2024-09-04T16:30:13.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.369+0000 7fbc2fb48640 1 -- 172.21.15.170:0/2482017314 wait complete. 2024-09-04T16:30:13.370 INFO:tasks.workunit.client.1.smithi193.stdout:0/592: mkdir d18/d25/d5f/d65/dc4 0 2024-09-04T16:30:13.370 INFO:tasks.workunit.client.1.smithi193.stdout:9/641: truncate d2/d18/d2f/d22/d30/d6a/d6e/f5a 3851459 0 2024-09-04T16:30:13.372 INFO:tasks.workunit.client.1.smithi193.stdout:5/611: write d1/d8/db/d36/d40/d46/dbe/f9c [21776,112868] 0 2024-09-04T16:30:13.373 INFO:tasks.workunit.client.1.smithi193.stdout:6/568: rmdir d5/d33/d4e/d51/d71/d82 39 2024-09-04T16:30:13.374 INFO:tasks.workunit.client.1.smithi193.stdout:5/612: truncate d1/d29/d18/d42/f51 5212895 0 2024-09-04T16:30:13.374 INFO:tasks.workunit.client.1.smithi193.stdout:6/569: readlink d5/de/d15/l39 0 2024-09-04T16:30:13.374 INFO:tasks.workunit.client.1.smithi193.stdout:4/505: mkdir d3/d3c/dad 0 2024-09-04T16:30:13.375 INFO:tasks.workunit.client.1.smithi193.stdout:4/506: truncate d3/f30 2178965 0 2024-09-04T16:30:13.378 INFO:tasks.workunit.client.1.smithi193.stdout:2/561: truncate d2/f5e 3352003 0 2024-09-04T16:30:13.380 INFO:tasks.workunit.client.1.smithi193.stdout:9/642: creat d2/d8/d25/db2/fc6 x:0 0 0 2024-09-04T16:30:13.381 INFO:tasks.workunit.client.1.smithi193.stdout:2/562: stat d2/d9/db/d10/d1e/da4/f50 0 2024-09-04T16:30:13.383 INFO:tasks.workunit.client.1.smithi193.stdout:0/593: rename d18/l50 to d18/d25/d3b/lc5 0 2024-09-04T16:30:13.384 INFO:tasks.workunit.client.1.smithi193.stdout:9/643: truncate d2/d8/f26 5099383 0 2024-09-04T16:30:13.390 INFO:tasks.workunit.client.1.smithi193.stdout:4/507: dwrite d3/d3c/f88 [0,4194304] 0 2024-09-04T16:30:13.390 INFO:tasks.workunit.client.1.smithi193.stdout:1/644: getdents d1/d2b/d10 0 2024-09-04T16:30:13.391 INFO:tasks.workunit.client.1.smithi193.stdout:6/570: dread d5/de/d15/d48/f4b [0,4194304] 0 2024-09-04T16:30:13.391 INFO:tasks.workunit.client.1.smithi193.stdout:2/563: mkdir d2/d9/db/d10/d1f/d4a/dc2 0 2024-09-04T16:30:13.392 INFO:tasks.workunit.client.1.smithi193.stdout:7/689: dwrite d9/d18/d22/d2b/d6c/d70/fe3 [0,4194304] 0 2024-09-04T16:30:13.394 INFO:tasks.workunit.client.1.smithi193.stdout:6/571: chown d5/d27/d3e/c4d 9293 1 2024-09-04T16:30:13.395 INFO:tasks.workunit.client.1.smithi193.stdout:2/564: write d2/d9/db/d10/d4e/f8d [491568,125465] 0 2024-09-04T16:30:13.396 INFO:tasks.workunit.client.1.smithi193.stdout:1/645: mkdir d1/d2b/d1b/d51/d6d/d89/dc7 0 2024-09-04T16:30:13.397 INFO:tasks.workunit.client.1.smithi193.stdout:6/572: chown d5/de/d15/c6d 2067637 1 2024-09-04T16:30:13.398 INFO:tasks.workunit.client.1.smithi193.stdout:2/565: chown d2/d9/db/f21 19 1 2024-09-04T16:30:13.400 INFO:tasks.workunit.client.1.smithi193.stdout:7/690: creat d9/d18/d22/d2b/fe4 x:0 0 0 2024-09-04T16:30:13.400 INFO:tasks.workunit.client.1.smithi193.stdout:6/573: chown d5/d27/d3e/f7f 1641040 1 2024-09-04T16:30:13.400 INFO:tasks.workunit.client.1.smithi193.stdout:4/508: dwrite d3/d1a/d2a/f3b [0,4194304] 0 2024-09-04T16:30:13.403 INFO:tasks.workunit.client.1.smithi193.stdout:9/644: dread d2/d18/d2f/d22/d30/d6a/fa7 [0,4194304] 0 2024-09-04T16:30:13.405 INFO:tasks.workunit.client.1.smithi193.stdout:0/594: getdents d18/d25/d32/d57/d6c 0 2024-09-04T16:30:13.405 INFO:tasks.workunit.client.1.smithi193.stdout:1/646: mkdir d1/d2b/d10/db7/dc8 0 2024-09-04T16:30:13.406 INFO:tasks.workunit.client.1.smithi193.stdout:4/509: chown d3/d1a/d21/d52/d5e/fa8 166627 1 2024-09-04T16:30:13.406 INFO:tasks.workunit.client.1.smithi193.stdout:5/613: dwrite d1/d8/db/d15/d2b/d83/d37/f67 [0,4194304] 0 2024-09-04T16:30:13.409 INFO:tasks.workunit.client.1.smithi193.stdout:6/574: creat d5/de/d15/fb8 x:0 0 0 2024-09-04T16:30:13.410 INFO:tasks.workunit.client.1.smithi193.stdout:6/575: write d5/f11 [1240099,66153] 0 2024-09-04T16:30:13.414 INFO:tasks.workunit.client.1.smithi193.stdout:4/510: dread d3/f30 [0,4194304] 0 2024-09-04T16:30:13.416 INFO:tasks.workunit.client.1.smithi193.stdout:0/595: rename d18/l58 to d18/d25/d32/lc6 0 2024-09-04T16:30:13.417 INFO:tasks.workunit.client.1.smithi193.stdout:5/614: symlink d1/d29/d18/lc2 0 2024-09-04T16:30:13.419 INFO:tasks.workunit.client.1.smithi193.stdout:4/511: fsync d3/d1a/d21/d52/d5e/fa8 0 2024-09-04T16:30:13.421 INFO:tasks.workunit.client.1.smithi193.stdout:4/512: write d3/f8e [825064,98405] 0 2024-09-04T16:30:13.422 INFO:tasks.workunit.client.1.smithi193.stdout:9/645: getdents d2/d8/d4d/da0 0 2024-09-04T16:30:13.424 INFO:tasks.workunit.client.1.smithi193.stdout:1/647: rename d1/d39/c44 to d1/d2b/db/d9e/cc9 0 2024-09-04T16:30:13.428 INFO:tasks.workunit.client.1.smithi193.stdout:6/576: rename d5/fb to d5/de/d15/d9f/fb9 0 2024-09-04T16:30:13.430 INFO:tasks.workunit.client.1.smithi193.stdout:5/615: dwrite d1/d8/db/d15/d2b/d83/d37/d88/fa8 [0,4194304] 0 2024-09-04T16:30:13.431 INFO:tasks.workunit.client.1.smithi193.stdout:2/566: dread d2/d9/db/d10/f7d [0,4194304] 0 2024-09-04T16:30:13.432 INFO:tasks.workunit.client.1.smithi193.stdout:9/646: dwrite d2/f98 [0,4194304] 0 2024-09-04T16:30:13.433 INFO:tasks.workunit.client.1.smithi193.stdout:2/567: chown d2/d9/db/d10/d38 2541 1 2024-09-04T16:30:13.435 INFO:tasks.workunit.client.1.smithi193.stdout:7/691: dread d9/d11/fa7 [0,4194304] 0 2024-09-04T16:30:13.436 INFO:tasks.workunit.client.1.smithi193.stdout:8/620: sync 2024-09-04T16:30:13.439 INFO:tasks.workunit.client.1.smithi193.stdout:2/568: rmdir d2/d9/d61 39 2024-09-04T16:30:13.440 INFO:tasks.workunit.client.1.smithi193.stdout:7/692: mknod d9/d18/d22/d2b/d6c/d70/d79/ce5 0 2024-09-04T16:30:13.442 INFO:tasks.workunit.client.1.smithi193.stdout:1/648: creat d1/d2b/d1b/d51/dc5/fca x:0 0 0 2024-09-04T16:30:13.443 INFO:tasks.workunit.client.1.smithi193.stdout:9/647: creat d2/d18/d2f/d9a/fc7 x:0 0 0 2024-09-04T16:30:13.444 INFO:tasks.workunit.client.1.smithi193.stdout:4/513: getdents d3/d1a/d21/d52/d5e/d7b 0 2024-09-04T16:30:13.446 INFO:tasks.workunit.client.1.smithi193.stdout:2/569: chown d2/d9/db/d10/d51/d87/f8a 74040 1 2024-09-04T16:30:13.446 INFO:tasks.workunit.client.1.smithi193.stdout:5/616: rename d1/d8/db/d15/d2b/d83/d37/d88 to d1/dc3 0 2024-09-04T16:30:13.448 INFO:tasks.workunit.client.1.smithi193.stdout:0/596: dwrite d18/d25/d5f/d65/f6f [0,4194304] 0 2024-09-04T16:30:13.448 INFO:tasks.workunit.client.1.smithi193.stdout:7/693: fsync d9/d18/d22/d2b/f5f 0 2024-09-04T16:30:13.450 INFO:tasks.workunit.client.1.smithi193.stdout:4/514: stat d3/d1a/d21/f22 0 2024-09-04T16:30:13.452 INFO:tasks.workunit.client.1.smithi193.stdout:9/648: chown d2/d18/d2f/d22/d30/d6a/d6e/c58 138032548 1 2024-09-04T16:30:13.454 INFO:tasks.workunit.client.1.smithi193.stdout:7/694: fsync d9/d39/d3e/f3f 0 2024-09-04T16:30:13.456 INFO:tasks.workunit.client.1.smithi193.stdout:6/577: dwrite d5/de/d15/d1b/f6f [0,4194304] 0 2024-09-04T16:30:13.456 INFO:tasks.workunit.client.1.smithi193.stdout:2/570: rmdir d2/d9/db/d10/d51/d87/d9b 39 2024-09-04T16:30:13.457 INFO:tasks.workunit.client.1.smithi193.stdout:7/695: chown d9/d39/d3e 11549 1 2024-09-04T16:30:13.458 INFO:tasks.workunit.client.1.smithi193.stdout:9/649: mknod d2/d8/d4d/cc8 0 2024-09-04T16:30:13.458 INFO:tasks.workunit.client.1.smithi193.stdout:8/621: dwrite d2/d20/d23/d34/d4b/db8/fbe [0,4194304] 0 2024-09-04T16:30:13.459 INFO:tasks.workunit.client.1.smithi193.stdout:2/571: rmdir d2/d9 39 2024-09-04T16:30:13.459 INFO:tasks.workunit.client.1.smithi193.stdout:4/515: write d3/d1a/d2a/f40 [2891599,94303] 0 2024-09-04T16:30:13.459 INFO:tasks.workunit.client.1.smithi193.stdout:5/617: mkdir d1/d8/db/d15/d2b/d83/d37/d58/dc4 0 2024-09-04T16:30:13.460 INFO:tasks.workunit.client.1.smithi193.stdout:0/597: write d18/d25/d32/d57/d6c/fbe [73168,87662] 0 2024-09-04T16:30:13.462 INFO:tasks.workunit.client.1.smithi193.stdout:7/696: chown d9/d18/d1e/c6f 2961 1 2024-09-04T16:30:13.465 INFO:tasks.workunit.client.1.smithi193.stdout:9/650: symlink d2/d8/d88/lc9 0 2024-09-04T16:30:13.465 INFO:tasks.workunit.client.1.smithi193.stdout:8/622: dread - d2/d20/d23/d24/d3c/fb1 zero size 2024-09-04T16:30:13.466 INFO:tasks.workunit.client.1.smithi193.stdout:4/516: write d3/d1a/d2a/f8b [399364,73167] 0 2024-09-04T16:30:13.467 INFO:tasks.workunit.client.1.smithi193.stdout:5/618: fsync d1/d8/db/d36/d40/d46/f87 0 2024-09-04T16:30:13.467 INFO:tasks.workunit.client.1.smithi193.stdout:0/598: chown d18/d25/d3b/lc5 129 1 2024-09-04T16:30:13.469 INFO:tasks.workunit.client.1.smithi193.stdout:4/517: write d3/d39/f6b [3157743,28159] 0 2024-09-04T16:30:13.470 INFO:tasks.workunit.client.1.smithi193.stdout:5/619: chown d1/d8/db/d15/f47 523551 1 2024-09-04T16:30:13.471 INFO:tasks.workunit.client.1.smithi193.stdout:2/572: fdatasync d2/d9/db/d10/d51/d87/f8a 0 2024-09-04T16:30:13.472 INFO:tasks.workunit.client.1.smithi193.stdout:5/620: stat d1/d8/c8c 0 2024-09-04T16:30:13.473 INFO:tasks.workunit.client.1.smithi193.stdout:6/578: dread d5/ff [0,4194304] 0 2024-09-04T16:30:13.473 INFO:tasks.workunit.client.1.smithi193.stdout:0/599: unlink c12 0 2024-09-04T16:30:13.473 INFO:tasks.workunit.client.1.smithi193.stdout:2/573: readlink d2/d9/d18/l45 0 2024-09-04T16:30:13.475 INFO:tasks.workunit.client.1.smithi193.stdout:9/651: mknod d2/d18/d2f/cca 0 2024-09-04T16:30:13.475 INFO:tasks.workunit.client.1.smithi193.stdout:4/518: dread d3/d3c/f76 [0,4194304] 0 2024-09-04T16:30:13.481 INFO:tasks.workunit.client.1.smithi193.stdout:5/621: dread d1/d8/db/d36/f52 [0,4194304] 0 2024-09-04T16:30:13.484 INFO:tasks.workunit.client.1.smithi193.stdout:8/623: dwrite d2/d20/d23/d24/d3c/d65/d67/f68 [4194304,4194304] 0 2024-09-04T16:30:13.484 INFO:tasks.workunit.client.1.smithi193.stdout:6/579: creat d5/d27/d3e/d43/d5d/d97/fba x:0 0 0 2024-09-04T16:30:13.487 INFO:tasks.workunit.client.1.smithi193.stdout:1/649: dread d1/d2b/d1b/d28/d50/f5d [0,4194304] 0 2024-09-04T16:30:13.490 INFO:tasks.workunit.client.1.smithi193.stdout:5/622: readlink d1/d8/db/d15/d2b/d83/d37/d3f/l68 0 2024-09-04T16:30:13.490 INFO:tasks.workunit.client.1.smithi193.stdout:6/580: stat d5/d33/d4e/d51/d71 0 2024-09-04T16:30:13.490 INFO:tasks.workunit.client.1.smithi193.stdout:0/600: dread d18/d25/f3c [0,4194304] 0 2024-09-04T16:30:13.491 INFO:tasks.workunit.client.1.smithi193.stdout:7/697: dwrite d9/d39/d3e/f7c [0,4194304] 0 2024-09-04T16:30:13.493 INFO:tasks.workunit.client.1.smithi193.stdout:9/652: dwrite d2/f28 [0,4194304] 0 2024-09-04T16:30:13.494 INFO:tasks.workunit.client.1.smithi193.stdout:1/650: rmdir d1/d2b/d10/d2a 39 2024-09-04T16:30:13.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.494+0000 7f75ca55a640 1 -- 172.21.15.170:0/4016841066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75c4100000 msgr2=0x7f75c4100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:13.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.494+0000 7f75ca55a640 1 --2- 172.21.15.170:0/4016841066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75c4100000 0x7f75c4100400 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009880 tx=0x7f75b402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:30:13.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.494+0000 7f75ca55a640 1 -- 172.21.15.170:0/4016841066 shutdown_connections 2024-09-04T16:30:13.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.494+0000 7f75ca55a640 1 --2- 172.21.15.170:0/4016841066 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75c4101200 0x7f75c4101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:13.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.494+0000 7f75ca55a640 1 --2- 172.21.15.170:0/4016841066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75c4100000 0x7f75c4100400 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:13.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.494+0000 7f75ca55a640 1 -- 172.21.15.170:0/4016841066 >> 172.21.15.170:0/4016841066 conn(0x7f75c40fb7b0 msgr2=0x7f75c40fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:13.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.494+0000 7f75ca55a640 1 -- 172.21.15.170:0/4016841066 shutdown_connections 2024-09-04T16:30:13.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.494+0000 7f75ca55a640 1 -- 172.21.15.170:0/4016841066 wait complete. 2024-09-04T16:30:13.496 INFO:tasks.workunit.client.1.smithi193.stdout:5/623: write d1/d29/f8d [1461890,33409] 0 2024-09-04T16:30:13.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.495+0000 7f75ca55a640 1 Processor -- start 2024-09-04T16:30:13.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.495+0000 7f75ca55a640 1 -- start start 2024-09-04T16:30:13.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.496+0000 7f75ca55a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75c4100000 0x7f75c4106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:13.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.496+0000 7f75ca55a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75c4101200 0x7f75c419c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:13.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.496+0000 7f75ca55a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f75c41096b0 con 0x7f75c4100000 2024-09-04T16:30:13.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.496+0000 7f75ca55a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f75c4109530 con 0x7f75c4101200 2024-09-04T16:30:13.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.496+0000 7f75c3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75c4100000 0x7f75c4106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:13.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.496+0000 7f75c3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75c4100000 0x7f75c4106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41228/0 (socket says 172.21.15.170:41228) 2024-09-04T16:30:13.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.496+0000 7f75c3fff640 1 -- 172.21.15.170:0/3466800453 learned_addr learned my addr 172.21.15.170:0/3466800453 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:30:13.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.496+0000 7f75c3fff640 1 -- 172.21.15.170:0/3466800453 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75c4101200 msgr2=0x7f75c419c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:13.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.496+0000 7f75c3fff640 1 --2- 172.21.15.170:0/3466800453 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75c4101200 0x7f75c419c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:13.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.496+0000 7f75c3fff640 1 -- 172.21.15.170:0/3466800453 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c419c7b0 con 0x7f75c4100000 2024-09-04T16:30:13.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.497+0000 7f75c3fff640 1 --2- 172.21.15.170:0/3466800453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75c4100000 0x7f75c4106f30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009230 tx=0x7f75b40045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:13.498 INFO:tasks.workunit.client.1.smithi193.stdout:7/698: creat d9/d18/d22/d2b/da6/fe6 x:0 0 0 2024-09-04T16:30:13.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.497+0000 7f75c17fa640 1 -- 172.21.15.170:0/3466800453 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f75b403f070 con 0x7f75c4100000 2024-09-04T16:30:13.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.497+0000 7f75c17fa640 1 -- 172.21.15.170:0/3466800453 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f75b4004a50 con 0x7f75c4100000 2024-09-04T16:30:13.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.497+0000 7f75ca55a640 1 -- 172.21.15.170:0/3466800453 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c419ca40 con 0x7f75c4100000 2024-09-04T16:30:13.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.497+0000 7f75ca55a640 1 -- 172.21.15.170:0/3466800453 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c419ceb0 con 0x7f75c4100000 2024-09-04T16:30:13.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.497+0000 7f75c17fa640 1 -- 172.21.15.170:0/3466800453 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f75b4035030 con 0x7f75c4100000 2024-09-04T16:30:13.499 INFO:tasks.workunit.client.1.smithi193.stdout:8/624: mknod d2/d20/d23/d24/d3c/d65/d67/da0/da8/db9/d94/ccd 0 2024-09-04T16:30:13.501 INFO:tasks.workunit.client.1.smithi193.stdout:9/653: unlink d2/d18/d2f/f36 0 2024-09-04T16:30:13.501 INFO:tasks.workunit.client.1.smithi193.stdout:4/519: dread d3/f6 [0,4194304] 0 2024-09-04T16:30:13.502 INFO:tasks.workunit.client.1.smithi193.stdout:0/601: rmdir d18/d25/d32/d9c 39 2024-09-04T16:30:13.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.499+0000 7f75ca55a640 1 -- 172.21.15.170:0/3466800453 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75b00052c0 con 0x7f75c4100000 2024-09-04T16:30:13.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.501+0000 7f75c17fa640 1 -- 172.21.15.170:0/3466800453 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 25) ==== 97250+0+0 (secure 0 0 0) 0x7f75b4042070 con 0x7f75c4100000 2024-09-04T16:30:13.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.502+0000 7f75c17fa640 1 --2- 172.21.15.170:0/3466800453 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f75ac073fc0 0x7f75ac076480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:13.503 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:13 smithi170 ceph-mon[29272]: pgmap v26: 65 pgs: 65 active+clean; 1.2 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 31 MiB/s rd, 152 MiB/s wr, 296 op/s 2024-09-04T16:30:13.503 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:13 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:30:13.503 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:13 smithi170 ceph-mon[29272]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:30:13.503 INFO:tasks.workunit.client.1.smithi193.stdout:3/585: sync 2024-09-04T16:30:13.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.503+0000 7f75c37fe640 1 --2- 172.21.15.170:0/3466800453 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f75ac073fc0 0x7f75ac076480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:13.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.504+0000 7f75c37fe640 1 --2- 172.21.15.170:0/3466800453 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f75ac073fc0 0x7f75ac076480 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f75c4106cb0 tx=0x7f75b8005ed0 comp rx=0 tx=0).ready entity=mgr.14682 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:13.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.504+0000 7f75c17fa640 1 -- 172.21.15.170:0/3466800453 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f75b40b6010 con 0x7f75c4100000 2024-09-04T16:30:13.506 INFO:tasks.workunit.client.1.smithi193.stdout:0/602: fsync d18/f38 0 2024-09-04T16:30:13.508 INFO:tasks.workunit.client.1.smithi193.stdout:6/581: dwrite d5/de/d15/d48/f98 [0,4194304] 0 2024-09-04T16:30:13.509 INFO:tasks.workunit.client.1.smithi193.stdout:8/625: read d2/d12/f43 [4020252,120062] 0 2024-09-04T16:30:13.510 INFO:tasks.workunit.client.1.smithi193.stdout:6/582: chown d5/d33/d4e/l9e 286223913 1 2024-09-04T16:30:13.511 INFO:tasks.workunit.client.1.smithi193.stdout:5/624: rename d1/d8/db/d36/d40/d46/f87 to d1/d8/db/d36/d40/fc5 0 2024-09-04T16:30:13.511 INFO:tasks.workunit.client.1.smithi193.stdout:9/654: mkdir d2/d8/d25/dcb 0 2024-09-04T16:30:13.513 INFO:tasks.workunit.client.1.smithi193.stdout:8/626: fdatasync d2/d20/d23/d24/d3c/fb1 0 2024-09-04T16:30:13.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.513+0000 7f75c17fa640 1 -- 172.21.15.170:0/3466800453 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f75b407d9f0 con 0x7f75c4100000 2024-09-04T16:30:13.516 INFO:tasks.workunit.client.1.smithi193.stdout:8/627: fsync d2/d20/f8d 0 2024-09-04T16:30:13.516 INFO:tasks.workunit.client.1.smithi193.stdout:1/651: dread d1/d2b/f61 [4194304,4194304] 0 2024-09-04T16:30:13.517 INFO:tasks.workunit.client.1.smithi193.stdout:7/699: fsync d9/d39/d95/fce 0 2024-09-04T16:30:13.521 INFO:tasks.workunit.client.1.smithi193.stdout:8/628: mknod d2/d86/cce 0 2024-09-04T16:30:13.521 INFO:tasks.workunit.client.1.smithi193.stdout:3/586: dwrite d0/d10/d24/d55/f9b [0,4194304] 0 2024-09-04T16:30:13.521 INFO:tasks.workunit.client.1.smithi193.stdout:1/652: chown d1/d2b/d1b/d28/fba 3340909 1 2024-09-04T16:30:13.524 INFO:tasks.workunit.client.1.smithi193.stdout:9/655: dread d2/d8/f26 [0,4194304] 0 2024-09-04T16:30:13.524 INFO:tasks.workunit.client.1.smithi193.stdout:0/603: rename d18/f48 to d18/d25/d32/d57/d6c/db1/fc7 0 2024-09-04T16:30:13.526 INFO:tasks.workunit.client.1.smithi193.stdout:5/625: truncate d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/fb7 1422919 0 2024-09-04T16:30:13.527 INFO:tasks.workunit.client.1.smithi193.stdout:6/583: link d5/d27/d3e/d6e/fb3 d5/d27/d3e/d43/d5d/d97/fbb 0 2024-09-04T16:30:13.527 INFO:tasks.workunit.client.1.smithi193.stdout:1/653: write d1/d2b/db/d54/da1/fc3 [723688,42209] 0 2024-09-04T16:30:13.530 INFO:tasks.workunit.client.1.smithi193.stdout:5/626: truncate d1/d8/fc0 435707 0 2024-09-04T16:30:13.531 INFO:tasks.workunit.client.1.smithi193.stdout:9/656: dread - d2/d56/f76 zero size 2024-09-04T16:30:13.531 INFO:tasks.workunit.client.1.smithi193.stdout:3/587: dread d0/d18/d1c/d51/d5a/fa3 [0,4194304] 0 2024-09-04T16:30:13.536 INFO:tasks.workunit.client.1.smithi193.stdout:5/627: mkdir d1/d8/db/d15/d2b/dc6 0 2024-09-04T16:30:13.538 INFO:tasks.workunit.client.1.smithi193.stdout:8/629: dwrite d2/d20/d23/d34/f9a [0,4194304] 0 2024-09-04T16:30:13.539 INFO:tasks.workunit.client.1.smithi193.stdout:5/628: dread - d1/d8/db/d36/fb1 zero size 2024-09-04T16:30:13.540 INFO:tasks.workunit.client.1.smithi193.stdout:4/520: dwrite d3/d1a/d21/f4c [0,4194304] 0 2024-09-04T16:30:13.541 INFO:tasks.workunit.client.1.smithi193.stdout:9/657: symlink d2/d56/d86/dc2/lcc 0 2024-09-04T16:30:13.544 INFO:tasks.workunit.client.1.smithi193.stdout:0/604: dwrite d18/d25/d5f/d65/d9f/da0/fbc [0,4194304] 0 2024-09-04T16:30:13.545 INFO:tasks.workunit.client.1.smithi193.stdout:8/630: write d2/d20/dc0/f6d [3139494,56665] 0 2024-09-04T16:30:13.547 INFO:tasks.workunit.client.1.smithi193.stdout:5/629: write d1/d8/db/fa6 [2122279,96381] 0 2024-09-04T16:30:13.548 INFO:tasks.workunit.client.1.smithi193.stdout:9/658: creat d2/d8/d4d/fcd x:0 0 0 2024-09-04T16:30:13.550 INFO:tasks.workunit.client.1.smithi193.stdout:9/659: readlink d2/d18/d2f/d22/d30/d52/dbb/lc5 0 2024-09-04T16:30:13.550 INFO:tasks.workunit.client.1.smithi193.stdout:8/631: read d2/f8 [1366083,91744] 0 2024-09-04T16:30:13.551 INFO:tasks.workunit.client.1.smithi193.stdout:7/700: truncate d9/d11/f93 2636743 0 2024-09-04T16:30:13.553 INFO:tasks.workunit.client.1.smithi193.stdout:5/630: mknod d1/d29/d74/d96/cc7 0 2024-09-04T16:30:13.554 INFO:tasks.workunit.client.1.smithi193.stdout:0/605: dwrite d18/d25/d3b/fae [0,4194304] 0 2024-09-04T16:30:13.554 INFO:tasks.workunit.client.1.smithi193.stdout:6/584: write d5/de/f41 [308075,11473] 0 2024-09-04T16:30:13.557 INFO:tasks.workunit.client.1.smithi193.stdout:4/521: truncate d3/f10 1190196 0 2024-09-04T16:30:13.557 INFO:tasks.workunit.client.1.smithi193.stdout:1/654: write d1/d2b/db/f23 [752989,91984] 0 2024-09-04T16:30:13.562 INFO:tasks.workunit.client.1.smithi193.stdout:7/701: mknod d9/d18/d22/d2b/d6c/ce7 0 2024-09-04T16:30:13.564 INFO:tasks.workunit.client.1.smithi193.stdout:8/632: rename d2/d12/ca3 to d2/d12/ccf 0 2024-09-04T16:30:13.566 INFO:tasks.workunit.client.1.smithi193.stdout:0/606: unlink d18/d25/d32/f98 0 2024-09-04T16:30:13.566 INFO:tasks.workunit.client.1.smithi193.stdout:4/522: dread d3/d39/f6b [4194304,4194304] 0 2024-09-04T16:30:13.567 INFO:tasks.workunit.client.1.smithi193.stdout:6/585: mknod d5/d27/d3e/d43/cbc 0 2024-09-04T16:30:13.569 INFO:tasks.workunit.client.1.smithi193.stdout:2/574: sync 2024-09-04T16:30:13.570 INFO:tasks.workunit.client.1.smithi193.stdout:9/660: dwrite d2/d8/d15/f71 [4194304,4194304] 0 2024-09-04T16:30:13.571 INFO:tasks.workunit.client.1.smithi193.stdout:4/523: fsync d3/d1a/d21/f2c 0 2024-09-04T16:30:13.573 INFO:tasks.workunit.client.1.smithi193.stdout:4/524: readlink d3/d1a/d21/d52/d7f/l92 0 2024-09-04T16:30:13.575 INFO:tasks.workunit.client.1.smithi193.stdout:7/702: rename d9/d39/d3e/d4d/d4f/lb5 to d9/de/le8 0 2024-09-04T16:30:13.577 INFO:tasks.workunit.client.1.smithi193.stdout:1/655: readlink d1/d2b/d10/d2a/l76 0 2024-09-04T16:30:13.578 INFO:tasks.workunit.client.1.smithi193.stdout:3/588: dread d0/d9/fb [0,4194304] 0 2024-09-04T16:30:13.580 INFO:tasks.workunit.client.1.smithi193.stdout:9/661: dwrite d2/d8/d4d/f69 [0,4194304] 0 2024-09-04T16:30:13.581 INFO:tasks.workunit.client.1.smithi193.stdout:4/525: dread d3/d1a/d2a/f3b [0,4194304] 0 2024-09-04T16:30:13.582 INFO:tasks.workunit.client.1.smithi193.stdout:6/586: unlink d5/de/d15/c6b 0 2024-09-04T16:30:13.583 INFO:tasks.workunit.client.1.smithi193.stdout:4/526: stat d3/d1a/d21/d52/d5e/l65 0 2024-09-04T16:30:13.584 INFO:tasks.workunit.client.1.smithi193.stdout:0/607: creat d18/d25/d5f/d65/d9f/da0/fc8 x:0 0 0 2024-09-04T16:30:13.585 INFO:tasks.workunit.client.1.smithi193.stdout:3/589: dread d0/d10/d24/d55/f9b [0,4194304] 0 2024-09-04T16:30:13.594 INFO:tasks.workunit.client.1.smithi193.stdout:5/631: truncate d1/d8/db/d15/d2b/d83/d37/f63 1270031 0 2024-09-04T16:30:13.594 INFO:tasks.workunit.client.1.smithi193.stdout:3/590: dwrite d0/d7/de/d45/f93 [0,4194304] 0 2024-09-04T16:30:13.594 INFO:tasks.workunit.client.1.smithi193.stdout:3/591: dread - d0/d10/fa9 zero size 2024-09-04T16:30:13.595 INFO:tasks.workunit.client.1.smithi193.stdout:1/656: read d1/d2b/d10/f25 [2777085,109300] 0 2024-09-04T16:30:13.595 INFO:tasks.workunit.client.1.smithi193.stdout:1/657: fdatasync d1/fb3 0 2024-09-04T16:30:13.597 INFO:tasks.workunit.client.1.smithi193.stdout:0/608: fsync d18/d25/d32/f44 0 2024-09-04T16:30:13.597 INFO:tasks.workunit.client.1.smithi193.stdout:1/658: read d1/d2b/d1b/d28/f35 [4195368,33733] 0 2024-09-04T16:30:13.598 INFO:tasks.workunit.client.1.smithi193.stdout:0/609: write d18/d25/d3b/f41 [1760386,55094] 0 2024-09-04T16:30:13.600 INFO:tasks.workunit.client.1.smithi193.stdout:8/633: write d2/f31 [69745,90929] 0 2024-09-04T16:30:13.606 INFO:tasks.workunit.client.1.smithi193.stdout:4/527: mkdir d3/d3c/dae 0 2024-09-04T16:30:13.608 INFO:tasks.workunit.client.1.smithi193.stdout:2/575: dwrite d2/d9/db/d10/d51/d87/d9b/fb6 [0,4194304] 0 2024-09-04T16:30:13.608 INFO:tasks.workunit.client.1.smithi193.stdout:3/592: chown d0/l6 139273 1 2024-09-04T16:30:13.609 INFO:tasks.workunit.client.1.smithi193.stdout:0/610: dwrite d18/d25/d5f/d65/f6f [0,4194304] 0 2024-09-04T16:30:13.609 INFO:tasks.workunit.client.1.smithi193.stdout:6/587: creat d5/d33/d4e/d51/d71/d82/fbd x:0 0 0 2024-09-04T16:30:13.610 INFO:tasks.workunit.client.1.smithi193.stdout:2/576: chown d2/f94 4007298 1 2024-09-04T16:30:13.614 INFO:tasks.workunit.client.1.smithi193.stdout:5/632: mkdir d1/d8/db/d36/d40/dc1/dc8 0 2024-09-04T16:30:13.615 INFO:tasks.workunit.client.1.smithi193.stdout:5/633: chown d1/d8/f2d 0 1 2024-09-04T16:30:13.621 INFO:tasks.workunit.client.1.smithi193.stdout:0/611: mkdir d18/d25/d32/d57/d6c/db1/dc9 0 2024-09-04T16:30:13.622 INFO:tasks.workunit.client.1.smithi193.stdout:7/703: getdents d9/d39/d3e/d4d 0 2024-09-04T16:30:13.622 INFO:tasks.workunit.client.1.smithi193.stdout:0/612: stat d18/d25/d5f/d65/d9f/da0/fa7 0 2024-09-04T16:30:13.625 INFO:tasks.workunit.client.1.smithi193.stdout:9/662: getdents d2/d4 0 2024-09-04T16:30:13.627 INFO:tasks.workunit.client.1.smithi193.stdout:7/704: rename d9/de/d27/f84 to d9/d39/fe9 0 2024-09-04T16:30:13.628 INFO:tasks.workunit.client.1.smithi193.stdout:2/577: creat d2/d9/db/d10/d1f/d4a/dc2/fc3 x:0 0 0 2024-09-04T16:30:13.629 INFO:tasks.workunit.client.1.smithi193.stdout:0/613: readlink d18/d25/d5f/d6a/l6e 0 2024-09-04T16:30:13.631 INFO:tasks.workunit.client.1.smithi193.stdout:4/528: dwrite d3/d1a/d21/f22 [0,4194304] 0 2024-09-04T16:30:13.631 INFO:tasks.workunit.client.1.smithi193.stdout:5/634: fsync d1/d8/db/d36/f48 0 2024-09-04T16:30:13.632 INFO:tasks.workunit.client.1.smithi193.stdout:7/705: fsync d9/de/fa0 0 2024-09-04T16:30:13.633 INFO:tasks.workunit.client.1.smithi193.stdout:3/593: getdents d0/d18/d1b/dab 0 2024-09-04T16:30:13.635 INFO:tasks.workunit.client.1.smithi193.stdout:6/588: getdents d5/de 0 2024-09-04T16:30:13.636 INFO:tasks.workunit.client.1.smithi193.stdout:2/578: write d2/d9/db/d10/f6e [3453049,129783] 0 2024-09-04T16:30:13.638 INFO:tasks.workunit.client.1.smithi193.stdout:8/634: dwrite d2/d20/f2d [0,4194304] 0 2024-09-04T16:30:13.638 INFO:tasks.workunit.client.1.smithi193.stdout:4/529: unlink d3/d1a/d2a/l2b 0 2024-09-04T16:30:13.639 INFO:tasks.workunit.client.1.smithi193.stdout:6/589: chown d5/d27/d3e/d6e 12695 1 2024-09-04T16:30:13.642 INFO:tasks.workunit.client.1.smithi193.stdout:3/594: write d0/d18/d1c/d25/d5e/d90/fb8 [1026167,74598] 0 2024-09-04T16:30:13.642 INFO:tasks.workunit.client.1.smithi193.stdout:2/579: read - d2/d9/db/d10/d1e/d56/fae zero size 2024-09-04T16:30:13.646 INFO:tasks.workunit.client.1.smithi193.stdout:2/580: fdatasync d2/d9/d18/f6f 0 2024-09-04T16:30:13.647 INFO:tasks.workunit.client.1.smithi193.stdout:4/530: creat d3/d1a/d54/faf x:0 0 0 2024-09-04T16:30:13.648 INFO:tasks.workunit.client.1.smithi193.stdout:5/635: dwrite d1/d29/d18/d42/f51 [0,4194304] 0 2024-09-04T16:30:13.648 INFO:tasks.workunit.client.1.smithi193.stdout:3/595: symlink d0/d18/d1c/d6e/lc2 0 2024-09-04T16:30:13.649 INFO:tasks.workunit.client.1.smithi193.stdout:6/590: dread d5/d33/d4e/f59 [0,4194304] 0 2024-09-04T16:30:13.649 INFO:tasks.workunit.client.1.smithi193.stdout:0/614: link d18/d25/d5f/d6a/cb3 d18/d25/d32/d57/d6c/db1/dc9/cca 0 2024-09-04T16:30:13.652 INFO:tasks.workunit.client.1.smithi193.stdout:4/531: rmdir d3/d3c/d47/d9c 39 2024-09-04T16:30:13.652 INFO:tasks.workunit.client.1.smithi193.stdout:2/581: stat d2/d9/db/d10/d1e/da4/d9a/f44 0 2024-09-04T16:30:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:13 smithi193 ceph-mon[36288]: pgmap v26: 65 pgs: 65 active+clean; 1.2 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 31 MiB/s rd, 152 MiB/s wr, 296 op/s 2024-09-04T16:30:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:13 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:30:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:13 smithi193 ceph-mon[36288]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:30:13.656 INFO:tasks.workunit.client.1.smithi193.stdout:0/615: mknod d18/d25/ccb 0 2024-09-04T16:30:13.656 INFO:tasks.workunit.client.1.smithi193.stdout:6/591: mknod d5/de/d15/d9f/cbe 0 2024-09-04T16:30:13.657 INFO:tasks.workunit.client.1.smithi193.stdout:9/663: dwrite d2/d56/fbe [4194304,4194304] 0 2024-09-04T16:30:13.659 INFO:tasks.workunit.client.1.smithi193.stdout:0/616: fdatasync d18/d25/d32/f52 0 2024-09-04T16:30:13.660 INFO:tasks.workunit.client.1.smithi193.stdout:5/636: fsync d1/d8/db/d15/d2b/d83/d37/d3f/f5a 0 2024-09-04T16:30:13.661 INFO:tasks.workunit.client.1.smithi193.stdout:2/582: mkdir d2/d9/db/d10/d1f/d4a/dc2/dc4 0 2024-09-04T16:30:13.664 INFO:tasks.workunit.client.1.smithi193.stdout:6/592: creat d5/de/fbf x:0 0 0 2024-09-04T16:30:13.665 INFO:tasks.workunit.client.1.smithi193.stdout:7/706: dwrite d9/d39/f51 [0,4194304] 0 2024-09-04T16:30:13.670 INFO:tasks.workunit.client.1.smithi193.stdout:3/596: write d0/d9/f58 [1307951,85162] 0 2024-09-04T16:30:13.670 INFO:tasks.workunit.client.1.smithi193.stdout:4/532: dwrite d3/d1a/d2a/f40 [4194304,4194304] 0 2024-09-04T16:30:13.671 INFO:tasks.workunit.client.1.smithi193.stdout:9/664: fsync d2/d18/d2f/d22/d30/d6a/d6e/f5a 0 2024-09-04T16:30:13.671 INFO:tasks.workunit.client.1.smithi193.stdout:2/583: write d2/d9/db/d10/d1e/da4/d9a/fa9 [1773944,44341] 0 2024-09-04T16:30:13.673 INFO:tasks.workunit.client.1.smithi193.stdout:3/597: fdatasync d0/d18/d1b/f37 0 2024-09-04T16:30:13.676 INFO:tasks.workunit.client.1.smithi193.stdout:8/635: dread d2/d20/d23/d1b/d4e/f55 [0,4194304] 0 2024-09-04T16:30:13.677 INFO:tasks.workunit.client.1.smithi193.stdout:4/533: truncate d3/d1a/d21/d52/d5e/fa2 1004585 0 2024-09-04T16:30:13.678 INFO:tasks.workunit.client.1.smithi193.stdout:7/707: symlink d9/d11/dbd/lea 0 2024-09-04T16:30:13.679 INFO:tasks.workunit.client.1.smithi193.stdout:8/636: fdatasync d2/d20/d23/d34/d46/fc7 0 2024-09-04T16:30:13.681 INFO:tasks.workunit.client.1.smithi193.stdout:0/617: getdents d18 0 2024-09-04T16:30:13.682 INFO:tasks.workunit.client.1.smithi193.stdout:9/665: mknod d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/cce 0 2024-09-04T16:30:13.684 INFO:tasks.workunit.client.1.smithi193.stdout:8/637: truncate d2/d20/f8d 1008649 0 2024-09-04T16:30:13.684 INFO:tasks.workunit.client.1.smithi193.stdout:3/598: symlink d0/d18/d1c/d25/da0/lc3 0 2024-09-04T16:30:13.687 INFO:tasks.workunit.client.1.smithi193.stdout:2/584: truncate d2/d9/db/d10/d1f/d22/fbf 123440 0 2024-09-04T16:30:13.687 INFO:tasks.workunit.client.1.smithi193.stdout:3/599: symlink d0/d18/d1c/d6e/lc4 0 2024-09-04T16:30:13.688 INFO:tasks.workunit.client.1.smithi193.stdout:9/666: creat d2/d18/d2f/d22/d30/d52/fcf x:0 0 0 2024-09-04T16:30:13.688 INFO:tasks.workunit.client.1.smithi193.stdout:3/600: write d0/d10/fa9 [155746,60094] 0 2024-09-04T16:30:13.689 INFO:tasks.workunit.client.1.smithi193.stdout:6/593: rename d5/de/d15/d1b/c29 to d5/d33/d4e/d51/d7b/cc0 0 2024-09-04T16:30:13.692 INFO:tasks.workunit.client.1.smithi193.stdout:6/594: truncate d5/ff 743118 0 2024-09-04T16:30:13.693 INFO:tasks.workunit.client.1.smithi193.stdout:6/595: stat d5/de/d15/d48/f65 0 2024-09-04T16:30:13.695 INFO:tasks.workunit.client.1.smithi193.stdout:6/596: stat d5/d33/d4e/d51/f7e 0 2024-09-04T16:30:13.695 INFO:tasks.workunit.client.1.smithi193.stdout:0/618: rename d18/d25/d5f/d6a/f80 to d18/d25/d32/d57/d6c/db1/fcc 0 2024-09-04T16:30:13.695 INFO:tasks.workunit.client.1.smithi193.stdout:6/597: write d5/d33/d4e/d51/f80 [7035987,94694] 0 2024-09-04T16:30:13.697 INFO:tasks.workunit.client.1.smithi193.stdout:6/598: chown d5/d27/d3e/d43/d5d/d97/fbb 57 1 2024-09-04T16:30:13.697 INFO:tasks.workunit.client.1.smithi193.stdout:2/585: rename d2/d9/db/d10/c3e to d2/d9/db/d10/d1f/d22/cc5 0 2024-09-04T16:30:13.697 INFO:tasks.workunit.client.1.smithi193.stdout:5/637: dread d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f7a [0,4194304] 0 2024-09-04T16:30:13.699 INFO:tasks.workunit.client.1.smithi193.stdout:5/638: stat d1/d8/db/d15/d2b/d83/l72 0 2024-09-04T16:30:13.700 INFO:tasks.workunit.client.1.smithi193.stdout:9/667: rename d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/cce to d2/d4/cd0 0 2024-09-04T16:30:13.701 INFO:tasks.workunit.client.1.smithi193.stdout:5/639: write d1/d8/fd [2443711,89416] 0 2024-09-04T16:30:13.701 INFO:tasks.workunit.client.1.smithi193.stdout:9/668: chown d2/d18/d66 900 1 2024-09-04T16:30:13.703 INFO:tasks.workunit.client.1.smithi193.stdout:6/599: unlink d5/d33/d4e/d51/d71/d82/f9d 0 2024-09-04T16:30:13.703 INFO:tasks.workunit.client.1.smithi193.stdout:7/708: truncate d9/de/d27/f38 9610620 0 2024-09-04T16:30:13.707 INFO:tasks.workunit.client.1.smithi193.stdout:7/709: write d9/d39/d3e/d4d/d4f/f86 [1335931,45003] 0 2024-09-04T16:30:13.707 INFO:tasks.workunit.client.1.smithi193.stdout:3/601: dread d0/f89 [0,4194304] 0 2024-09-04T16:30:13.707 INFO:tasks.workunit.client.1.smithi193.stdout:0/619: dwrite d18/d25/d32/d9c/da9/fba [0,4194304] 0 2024-09-04T16:30:13.746 INFO:tasks.workunit.client.1.smithi193.stdout:2/586: rmdir d2/d9/db/d10/d38/da5/daa 0 2024-09-04T16:30:13.747 INFO:tasks.workunit.client.1.smithi193.stdout:5/640: write d1/d8/db/d15/f47 [156239,85494] 0 2024-09-04T16:30:13.747 INFO:tasks.workunit.client.1.smithi193.stdout:1/659: sync 2024-09-04T16:30:13.750 INFO:tasks.workunit.client.1.smithi193.stdout:7/710: symlink d9/d39/d3e/d69/dcf/leb 0 2024-09-04T16:30:13.751 INFO:tasks.workunit.client.1.smithi193.stdout:7/711: write d9/d39/d3e/fa2 [954005,90361] 0 2024-09-04T16:30:13.752 INFO:tasks.workunit.client.1.smithi193.stdout:7/712: chown d9/d18/c47 1172 1 2024-09-04T16:30:13.754 INFO:tasks.workunit.client.1.smithi193.stdout:2/587: write d2/d9/f90 [464250,46208] 0 2024-09-04T16:30:13.758 INFO:tasks.workunit.client.1.smithi193.stdout:9/669: dread d2/d8/d15/f62 [0,4194304] 0 2024-09-04T16:30:13.759 INFO:tasks.workunit.client.1.smithi193.stdout:2/588: read - d2/d9/db/d10/d1e/d56/fae zero size 2024-09-04T16:30:13.761 INFO:tasks.workunit.client.1.smithi193.stdout:7/713: dwrite d9/de/f1c [0,4194304] 0 2024-09-04T16:30:13.762 INFO:tasks.workunit.client.1.smithi193.stdout:0/620: dread d18/f4c [0,4194304] 0 2024-09-04T16:30:13.764 INFO:tasks.workunit.client.1.smithi193.stdout:1/660: dwrite d1/d2b/d10/f19 [4194304,4194304] 0 2024-09-04T16:30:13.765 INFO:tasks.workunit.client.1.smithi193.stdout:3/602: dread d0/d18/d1c/d51/d5a/f77 [0,4194304] 0 2024-09-04T16:30:13.766 INFO:tasks.workunit.client.1.smithi193.stdout:2/589: creat d2/d9/db/d10/d1e/da4/fc6 x:0 0 0 2024-09-04T16:30:13.767 INFO:tasks.workunit.client.1.smithi193.stdout:1/661: fsync d1/d2b/d1b/d51/d6d/f78 0 2024-09-04T16:30:13.768 INFO:tasks.workunit.client.1.smithi193.stdout:9/670: mkdir d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/dd1 0 2024-09-04T16:30:13.768 INFO:tasks.workunit.client.1.smithi193.stdout:3/603: chown d0/d18/d1c/d51/d5a/da2/dc0 1971587553 1 2024-09-04T16:30:13.768 INFO:tasks.workunit.client.1.smithi193.stdout:1/662: chown d1/d2b/f45 3487 1 2024-09-04T16:30:13.770 INFO:tasks.workunit.client.1.smithi193.stdout:7/714: mknod d9/d39/d3e/d4d/d98/d9a/db6/cec 0 2024-09-04T16:30:13.770 INFO:tasks.workunit.client.1.smithi193.stdout:1/663: write d1/d2b/db/f3b [8227317,64973] 0 2024-09-04T16:30:13.772 INFO:tasks.workunit.client.1.smithi193.stdout:0/621: write d18/d25/d5f/d65/f99 [5061002,80153] 0 2024-09-04T16:30:13.772 INFO:tasks.workunit.client.1.smithi193.stdout:9/671: write d2/d8/d15/f16 [313496,4794] 0 2024-09-04T16:30:13.772 INFO:tasks.workunit.client.1.smithi193.stdout:2/590: stat d2/d9/d18/laf 0 2024-09-04T16:30:13.774 INFO:tasks.workunit.client.1.smithi193.stdout:3/604: symlink d0/d18/d1b/d3d/lc5 0 2024-09-04T16:30:13.779 INFO:tasks.workunit.client.1.smithi193.stdout:2/591: mkdir d2/d9/db/d10/d38/da5/dc7 0 2024-09-04T16:30:13.780 INFO:tasks.workunit.client.1.smithi193.stdout:1/664: mkdir d1/d2b/d1b/d51/dcb 0 2024-09-04T16:30:13.782 INFO:tasks.workunit.client.1.smithi193.stdout:7/715: creat d9/d18/fed x:0 0 0 2024-09-04T16:30:13.783 INFO:tasks.workunit.client.1.smithi193.stdout:2/592: symlink d2/d9/db/d10/d38/da5/lc8 0 2024-09-04T16:30:13.783 INFO:tasks.workunit.client.1.smithi193.stdout:1/665: write d1/d2b/d1b/d51/d6d/fb5 [856810,2458] 0 2024-09-04T16:30:13.783 INFO:tasks.workunit.client.1.smithi193.stdout:7/716: chown d9/d18/c45 1 1 2024-09-04T16:30:13.785 INFO:tasks.workunit.client.1.smithi193.stdout:2/593: unlink d2/f71 0 2024-09-04T16:30:13.786 INFO:tasks.workunit.client.1.smithi193.stdout:1/666: readlink d1/d39/d48/l9c 0 2024-09-04T16:30:13.787 INFO:tasks.workunit.client.1.smithi193.stdout:7/717: creat d9/d39/d3e/d53/fee x:0 0 0 2024-09-04T16:30:13.790 INFO:tasks.workunit.client.1.smithi193.stdout:2/594: symlink d2/d9/d18/d7b/db5/lc9 0 2024-09-04T16:30:13.790 INFO:tasks.workunit.client.1.smithi193.stdout:0/622: dwrite d18/f4c [0,4194304] 0 2024-09-04T16:30:13.791 INFO:tasks.workunit.client.1.smithi193.stdout:7/718: symlink d9/d18/d22/d2b/d6c/d70/lef 0 2024-09-04T16:30:13.793 INFO:tasks.workunit.client.1.smithi193.stdout:7/719: readlink d9/de/ld6 0 2024-09-04T16:30:13.793 INFO:tasks.workunit.client.1.smithi193.stdout:1/667: creat d1/d2b/d10/db7/dc8/fcc x:0 0 0 2024-09-04T16:30:13.799 INFO:tasks.workunit.client.1.smithi193.stdout:9/672: dread d2/d8/f55 [0,4194304] 0 2024-09-04T16:30:13.799 INFO:tasks.workunit.client.1.smithi193.stdout:0/623: mknod d18/d25/d3b/ccd 0 2024-09-04T16:30:13.799 INFO:tasks.workunit.client.1.smithi193.stdout:2/595: mkdir d2/d9/db/d10/d51/dca 0 2024-09-04T16:30:13.799 INFO:tasks.workunit.client.1.smithi193.stdout:7/720: mknod d9/d39/d3e/d53/cf0 0 2024-09-04T16:30:13.799 INFO:tasks.workunit.client.1.smithi193.stdout:9/673: write d2/d8/d15/f8c [989508,37006] 0 2024-09-04T16:30:13.799 INFO:tasks.workunit.client.1.smithi193.stdout:0/624: write d18/d25/d5f/d65/d9f/da0/fa7 [227238,7459] 0 2024-09-04T16:30:13.802 INFO:tasks.workunit.client.1.smithi193.stdout:0/625: rmdir d18/d25/d32/d57/d6d 39 2024-09-04T16:30:13.804 INFO:tasks.workunit.client.1.smithi193.stdout:1/668: dwrite d1/d2b/f31 [4194304,4194304] 0 2024-09-04T16:30:13.804 INFO:tasks.workunit.client.1.smithi193.stdout:2/596: rename d2/d9/db/d10/d51/c95 to d2/d9/db/d10/d51/d87/ccb 0 2024-09-04T16:30:13.805 INFO:tasks.workunit.client.1.smithi193.stdout:0/626: truncate d18/d25/d5f/fa1 274938 0 2024-09-04T16:30:13.806 INFO:tasks.workunit.client.1.smithi193.stdout:0/627: write d18/fa2 [944427,18120] 0 2024-09-04T16:30:13.807 INFO:tasks.workunit.client.1.smithi193.stdout:0/628: fsync d18/d79/d88/fab 0 2024-09-04T16:30:13.808 INFO:tasks.workunit.client.1.smithi193.stdout:9/674: getdents d2/d18/d2f/d22/d30/d6a/d6e/d81/d93 0 2024-09-04T16:30:13.810 INFO:tasks.workunit.client.1.smithi193.stdout:9/675: chown d2/d8/d25/lbc 1489 1 2024-09-04T16:30:13.810 INFO:tasks.workunit.client.1.smithi193.stdout:3/605: dread d0/d18/f50 [0,4194304] 0 2024-09-04T16:30:13.811 INFO:tasks.workunit.client.1.smithi193.stdout:1/669: getdents d1/d2b/db/d9e 0 2024-09-04T16:30:13.813 INFO:tasks.workunit.client.1.smithi193.stdout:0/629: mkdir d18/d25/d32/dce 0 2024-09-04T16:30:13.816 INFO:tasks.workunit.client.1.smithi193.stdout:2/597: dwrite d2/d9/db/f72 [0,4194304] 0 2024-09-04T16:30:13.816 INFO:tasks.workunit.client.1.smithi193.stdout:1/670: symlink d1/d2b/d10/d56/da7/lcd 0 2024-09-04T16:30:13.819 INFO:tasks.workunit.client.1.smithi193.stdout:9/676: getdents d2/d18/d2f/d9a 0 2024-09-04T16:30:13.825 INFO:tasks.workunit.client.1.smithi193.stdout:0/630: dread d18/d25/f77 [0,4194304] 0 2024-09-04T16:30:13.826 INFO:tasks.workunit.client.1.smithi193.stdout:9/677: creat d2/d18/d2f/d22/d30/d6a/fd2 x:0 0 0 2024-09-04T16:30:13.828 INFO:tasks.workunit.client.1.smithi193.stdout:1/671: dwrite d1/d2b/db/f3b [4194304,4194304] 0 2024-09-04T16:30:13.828 INFO:tasks.workunit.client.1.smithi193.stdout:2/598: dwrite d2/d9/db/d65/f9e [0,4194304] 0 2024-09-04T16:30:13.831 INFO:tasks.workunit.client.1.smithi193.stdout:1/672: dread - d1/d2b/d1b/d28/d50/d84/d97/fa2 zero size 2024-09-04T16:30:13.833 INFO:tasks.workunit.client.1.smithi193.stdout:9/678: mknod d2/d18/d2f/d9a/cd3 0 2024-09-04T16:30:13.837 INFO:tasks.workunit.client.1.smithi193.stdout:1/673: rmdir d1/d2b/d1b/d28/d50 39 2024-09-04T16:30:13.839 INFO:tasks.workunit.client.1.smithi193.stdout:0/631: dread f17 [0,4194304] 0 2024-09-04T16:30:13.842 INFO:tasks.workunit.client.1.smithi193.stdout:1/674: rename d1/d2b/db/f3e to d1/d39/fce 0 2024-09-04T16:30:13.846 INFO:tasks.workunit.client.1.smithi193.stdout:3/606: truncate d0/d7/fa6 1334579 0 2024-09-04T16:30:13.848 INFO:tasks.workunit.client.1.smithi193.stdout:9/679: creat d2/d8/fd4 x:0 0 0 2024-09-04T16:30:13.852 INFO:tasks.workunit.client.1.smithi193.stdout:1/675: dwrite d1/fb3 [0,4194304] 0 2024-09-04T16:30:13.853 INFO:tasks.workunit.client.1.smithi193.stdout:1/676: fdatasync d1/d2b/db/f9a 0 2024-09-04T16:30:13.859 INFO:tasks.workunit.client.1.smithi193.stdout:1/677: fdatasync d1/d2b/d10/fa5 0 2024-09-04T16:30:13.862 INFO:tasks.workunit.client.1.smithi193.stdout:0/632: dread d18/d25/d32/f42 [0,4194304] 0 2024-09-04T16:30:13.862 INFO:tasks.workunit.client.1.smithi193.stdout:3/607: fdatasync d0/d18/d1c/d30/f33 0 2024-09-04T16:30:13.862 INFO:tasks.workunit.client.1.smithi193.stdout:2/599: write d2/d9/db/d10/d38/da5/fbb [74640,45817] 0 2024-09-04T16:30:13.863 INFO:tasks.workunit.client.1.smithi193.stdout:0/633: chown d18/d25/d5f/d6a/d7b/f96 3170 1 2024-09-04T16:30:13.866 INFO:tasks.workunit.client.1.smithi193.stdout:4/534: sync 2024-09-04T16:30:13.867 INFO:tasks.workunit.client.1.smithi193.stdout:4/535: fdatasync d3/d3c/d89/f8c 0 2024-09-04T16:30:13.868 INFO:tasks.workunit.client.1.smithi193.stdout:2/600: mknod d2/d9/db/d65/ccc 0 2024-09-04T16:30:13.868 INFO:tasks.workunit.client.1.smithi193.stdout:3/608: dread d0/f66 [0,4194304] 0 2024-09-04T16:30:13.871 INFO:tasks.workunit.client.1.smithi193.stdout:0/634: mknod d18/d25/d5f/d65/d9f/ccf 0 2024-09-04T16:30:13.871 INFO:tasks.workunit.client.1.smithi193.stdout:9/680: dread d2/d18/d2f/d22/d30/d6a/f94 [0,4194304] 0 2024-09-04T16:30:13.873 INFO:tasks.workunit.client.1.smithi193.stdout:4/536: readlink d3/l4e 0 2024-09-04T16:30:13.876 INFO:tasks.workunit.client.1.smithi193.stdout:2/601: dread d2/d9/f90 [0,4194304] 0 2024-09-04T16:30:13.878 INFO:tasks.workunit.client.1.smithi193.stdout:4/537: mknod d3/d1a/d2a/cb0 0 2024-09-04T16:30:13.879 INFO:tasks.workunit.client.1.smithi193.stdout:3/609: creat d0/d9/dae/fc6 x:0 0 0 2024-09-04T16:30:13.880 INFO:tasks.workunit.client.1.smithi193.stdout:1/678: getdents d1/d2b 0 2024-09-04T16:30:13.881 INFO:tasks.workunit.client.1.smithi193.stdout:9/681: dwrite d2/d8/d25/f3e [0,4194304] 0 2024-09-04T16:30:13.882 INFO:tasks.workunit.client.1.smithi193.stdout:9/682: chown d2/d18/d2f/d22/d30/d6a/d6e/d81/d93 42 1 2024-09-04T16:30:13.883 INFO:tasks.workunit.client.1.smithi193.stdout:2/602: mknod d2/d9/db/d10/d51/ccd 0 2024-09-04T16:30:13.885 INFO:tasks.workunit.client.1.smithi193.stdout:3/610: creat d0/d9/dae/fc7 x:0 0 0 2024-09-04T16:30:13.887 INFO:tasks.workunit.client.1.smithi193.stdout:1/679: unlink d1/d39/l62 0 2024-09-04T16:30:13.888 INFO:tasks.workunit.client.1.smithi193.stdout:9/683: symlink d2/d18/d2f/d9a/ld5 0 2024-09-04T16:30:13.889 INFO:tasks.workunit.client.1.smithi193.stdout:0/635: link d18/d25/d32/d57/c73 d18/d25/d32/d9c/cd0 0 2024-09-04T16:30:13.890 INFO:tasks.workunit.client.1.smithi193.stdout:3/611: mknod d0/d9/d49/d7d/cc8 0 2024-09-04T16:30:13.892 INFO:tasks.workunit.client.1.smithi193.stdout:3/612: write d0/d7/de/d45/f8d [4977507,121249] 0 2024-09-04T16:30:13.892 INFO:tasks.workunit.client.1.smithi193.stdout:1/680: rename d1/d2b/db/d7f/laf to d1/d2b/lcf 0 2024-09-04T16:30:13.893 INFO:tasks.workunit.client.1.smithi193.stdout:2/603: mknod d2/d9/db/d10/d38/d7a/cce 0 2024-09-04T16:30:13.895 INFO:tasks.workunit.client.1.smithi193.stdout:2/604: chown d2/d9/db/d10/d4e/f81 31900 1 2024-09-04T16:30:13.897 INFO:tasks.workunit.client.1.smithi193.stdout:4/538: dwrite d3/d1a/d2a/f8a [0,4194304] 0 2024-09-04T16:30:13.899 INFO:tasks.workunit.client.1.smithi193.stdout:2/605: creat d2/d9/db/d10/d1e/da4/fcf x:0 0 0 2024-09-04T16:30:13.900 INFO:tasks.workunit.client.1.smithi193.stdout:4/539: unlink d3/d1a/d2a/f8a 0 2024-09-04T16:30:13.906 INFO:tasks.workunit.client.1.smithi193.stdout:4/540: rename d3/d3c/d47/d9c to d3/d1a/d54/db1 0 2024-09-04T16:30:13.909 INFO:tasks.workunit.client.1.smithi193.stdout:9/684: dread d2/d8/d15/f48 [0,4194304] 0 2024-09-04T16:30:13.910 INFO:tasks.workunit.client.1.smithi193.stdout:4/541: mkdir d3/d1a/d2a/db2 0 2024-09-04T16:30:13.911 INFO:tasks.workunit.client.1.smithi193.stdout:2/606: dwrite d2/fc [8388608,4194304] 0 2024-09-04T16:30:13.912 INFO:tasks.workunit.client.1.smithi193.stdout:1/681: getdents d1/d2b/db/d9e 0 2024-09-04T16:30:13.912 INFO:tasks.workunit.client.1.smithi193.stdout:3/613: dread d0/d9/f83 [0,4194304] 0 2024-09-04T16:30:13.913 INFO:tasks.workunit.client.1.smithi193.stdout:9/685: symlink d2/d8/d88/ld6 0 2024-09-04T16:30:13.914 INFO:tasks.workunit.client.1.smithi193.stdout:2/607: fsync d2/d9/db/d10/d1e/da4/fcf 0 2024-09-04T16:30:13.915 INFO:tasks.workunit.client.1.smithi193.stdout:4/542: rename d3/c26 to d3/d1a/d21/cb3 0 2024-09-04T16:30:13.916 INFO:tasks.workunit.client.1.smithi193.stdout:4/543: stat d3/d81/f99 0 2024-09-04T16:30:13.916 INFO:tasks.workunit.client.1.smithi193.stdout:9/686: mknod d2/d18/cd7 0 2024-09-04T16:30:13.917 INFO:tasks.workunit.client.1.smithi193.stdout:4/544: readlink d3/d1a/d21/d52/la7 0 2024-09-04T16:30:13.917 INFO:tasks.workunit.client.1.smithi193.stdout:2/608: mkdir d2/d9/db/d10/d1f/dd0 0 2024-09-04T16:30:13.918 INFO:tasks.workunit.client.1.smithi193.stdout:1/682: fsync d1/d2b/f61 0 2024-09-04T16:30:13.919 INFO:tasks.workunit.client.1.smithi193.stdout:2/609: truncate d2/d9/db/d10/d1e/da4/f6d 330646 0 2024-09-04T16:30:13.920 INFO:tasks.workunit.client.1.smithi193.stdout:9/687: creat d2/d8/d88/fd8 x:0 0 0 2024-09-04T16:30:13.922 INFO:tasks.workunit.client.1.smithi193.stdout:3/614: getdents d0/d7/de/d45 0 2024-09-04T16:30:13.923 INFO:tasks.workunit.client.1.smithi193.stdout:9/688: rmdir d2/d18/d2f/d22/d30/d6a 39 2024-09-04T16:30:13.924 INFO:tasks.workunit.client.1.smithi193.stdout:3/615: fsync d0/d18/d1c/d30/fac 0 2024-09-04T16:30:13.926 INFO:tasks.workunit.client.1.smithi193.stdout:2/610: dwrite d2/d9/db/d10/d4e/f8d [0,4194304] 0 2024-09-04T16:30:13.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.926+0000 7f75ca55a640 1 -- 172.21.15.170:0/3466800453 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f75b0005880 con 0x7f75c4100000 2024-09-04T16:30:13.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.926+0000 7f75c17fa640 1 -- 172.21.15.170:0/3466800453 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f75b4081b60 con 0x7f75c4100000 2024-09-04T16:30:13.927 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:30:13.927 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:30:13.927 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 2 2024-09-04T16:30:13.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:30:13.927 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:30:13.927 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 1, 2024-09-04T16:30:13.928 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 1 2024-09-04T16:30:13.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:30:13.928 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:30:13.928 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 6 2024-09-04T16:30:13.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:30:13.928 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:30:13.928 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:30:13.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:30:13.928 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:30:13.928 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 13, 2024-09-04T16:30:13.928 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 1 2024-09-04T16:30:13.928 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:30:13.929 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:30:13.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.929+0000 7f75ca55a640 1 -- 172.21.15.170:0/3466800453 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f75ac073fc0 msgr2=0x7f75ac076480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:13.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.929+0000 7f75ca55a640 1 --2- 172.21.15.170:0/3466800453 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f75ac073fc0 0x7f75ac076480 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f75c4106cb0 tx=0x7f75b8005ed0 comp rx=0 tx=0).stop 2024-09-04T16:30:13.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.929+0000 7f75ca55a640 1 -- 172.21.15.170:0/3466800453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75c4100000 msgr2=0x7f75c4106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:13.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.929+0000 7f75ca55a640 1 --2- 172.21.15.170:0/3466800453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75c4100000 0x7f75c4106f30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009230 tx=0x7f75b40045c0 comp rx=0 tx=0).stop 2024-09-04T16:30:13.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.930+0000 7f75ca55a640 1 -- 172.21.15.170:0/3466800453 shutdown_connections 2024-09-04T16:30:13.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.930+0000 7f75ca55a640 1 --2- 172.21.15.170:0/3466800453 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f75ac073fc0 0x7f75ac076480 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:13.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.930+0000 7f75ca55a640 1 --2- 172.21.15.170:0/3466800453 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75c4101200 0x7f75c419c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:13.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.930+0000 7f75ca55a640 1 --2- 172.21.15.170:0/3466800453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75c4100000 0x7f75c4106f30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:13.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.930+0000 7f75ca55a640 1 -- 172.21.15.170:0/3466800453 >> 172.21.15.170:0/3466800453 conn(0x7f75c40fb7b0 msgr2=0x7f75c41046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:13.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.930+0000 7f75ca55a640 1 -- 172.21.15.170:0/3466800453 shutdown_connections 2024-09-04T16:30:13.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:13.930+0000 7f75ca55a640 1 -- 172.21.15.170:0/3466800453 wait complete. 2024-09-04T16:30:13.934 INFO:tasks.workunit.client.1.smithi193.stdout:9/689: mknod d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/cd9 0 2024-09-04T16:30:13.937 INFO:tasks.workunit.client.1.smithi193.stdout:1/683: truncate d1/d2b/d1b/d51/d6d/d89/f93 221973 0 2024-09-04T16:30:13.939 INFO:tasks.workunit.client.1.smithi193.stdout:2/611: dread d2/f2a [0,4194304] 0 2024-09-04T16:30:13.942 INFO:tasks.workunit.client.1.smithi193.stdout:2/612: stat d2/d9/db/d10/d1f/d22/c9d 0 2024-09-04T16:30:13.945 INFO:tasks.workunit.client.1.smithi193.stdout:2/613: mkdir d2/d9/db/d10/d38/dac/dd1 0 2024-09-04T16:30:13.948 INFO:tasks.workunit.client.1.smithi193.stdout:3/616: dwrite d0/d7/fa6 [0,4194304] 0 2024-09-04T16:30:13.950 INFO:tasks.workunit.client.1.smithi193.stdout:1/684: truncate d1/d2b/d1b/d28/d50/f5d 2435489 0 2024-09-04T16:30:13.952 INFO:tasks.workunit.client.1.smithi193.stdout:9/690: dwrite d2/d18/d66/f6d [0,4194304] 0 2024-09-04T16:30:13.953 INFO:tasks.workunit.client.1.smithi193.stdout:2/614: write d2/d9/db/d10/d1f/f62 [370585,16403] 0 2024-09-04T16:30:13.953 INFO:tasks.workunit.client.1.smithi193.stdout:3/617: creat d0/d3b/fc9 x:0 0 0 2024-09-04T16:30:13.955 INFO:tasks.workunit.client.1.smithi193.stdout:8/638: sync 2024-09-04T16:30:13.958 INFO:tasks.workunit.client.1.smithi193.stdout:2/615: stat d2/d9/db/d10/d1f/d22 0 2024-09-04T16:30:13.959 INFO:tasks.workunit.client.1.smithi193.stdout:3/618: chown d0/d18/d1c/d25/d5e/d68/c63 224 1 2024-09-04T16:30:13.960 INFO:tasks.workunit.client.1.smithi193.stdout:3/619: chown d0/d18/d1c/d25/d5e/d7e/fa7 54486718 1 2024-09-04T16:30:13.960 INFO:tasks.workunit.client.1.smithi193.stdout:9/691: mkdir d2/d8/d88/da3/dda 0 2024-09-04T16:30:13.960 INFO:tasks.workunit.client.1.smithi193.stdout:3/620: chown d0/f66 240943869 1 2024-09-04T16:30:13.961 INFO:tasks.workunit.client.1.smithi193.stdout:3/621: chown d0/d18/d1c/d51/l95 12 1 2024-09-04T16:30:13.962 INFO:tasks.workunit.client.1.smithi193.stdout:1/685: rename d1/fb3 to d1/d2b/d10/db7/dc8/fd0 0 2024-09-04T16:30:13.963 INFO:tasks.workunit.client.1.smithi193.stdout:1/686: stat d1/d2b/d10/d2a/l94 0 2024-09-04T16:30:13.964 INFO:tasks.workunit.client.1.smithi193.stdout:8/639: rmdir d2/d20/d23/d34/d46/d53 39 2024-09-04T16:30:13.967 INFO:tasks.workunit.client.1.smithi193.stdout:1/687: mkdir d1/d2b/d1b/d28/d50/d84/dd1 0 2024-09-04T16:30:13.971 INFO:tasks.workunit.client.1.smithi193.stdout:9/692: link d2/f6 d2/d56/fdb 0 2024-09-04T16:30:13.973 INFO:tasks.workunit.client.1.smithi193.stdout:1/688: dwrite d1/d2b/d1b/d51/d6d/f78 [0,4194304] 0 2024-09-04T16:30:13.973 INFO:tasks.workunit.client.1.smithi193.stdout:2/616: write d2/d9/f36 [1524551,90814] 0 2024-09-04T16:30:13.974 INFO:tasks.workunit.client.1.smithi193.stdout:9/693: read d2/d8/d25/f37 [254160,80856] 0 2024-09-04T16:30:13.974 INFO:tasks.workunit.client.1.smithi193.stdout:3/622: creat d0/d18/d1c/d51/fca x:0 0 0 2024-09-04T16:30:13.975 INFO:tasks.workunit.client.1.smithi193.stdout:8/640: getdents d2/d20/d23/d24/d3c/d65/d67/da0/da8/db9/d94 0 2024-09-04T16:30:13.976 INFO:tasks.workunit.client.1.smithi193.stdout:9/694: stat d2/f1c 0 2024-09-04T16:30:13.977 INFO:tasks.workunit.client.1.smithi193.stdout:2/617: rmdir d2/d9/db/d10/d51/d87 39 2024-09-04T16:30:13.978 INFO:tasks.workunit.client.1.smithi193.stdout:3/623: symlink d0/d18/d1c/d25/lcb 0 2024-09-04T16:30:13.978 INFO:tasks.workunit.client.1.smithi193.stdout:1/689: truncate d1/d2b/db/f5b 448961 0 2024-09-04T16:30:13.979 INFO:tasks.workunit.client.1.smithi193.stdout:9/695: creat d2/d18/d2f/d9a/fdc x:0 0 0 2024-09-04T16:30:13.980 INFO:tasks.workunit.client.1.smithi193.stdout:1/690: readlink d1/d39/d48/l9c 0 2024-09-04T16:30:13.980 INFO:tasks.workunit.client.1.smithi193.stdout:8/641: symlink d2/d20/d23/d24/d3c/d65/d67/da0/da8/db9/ld0 0 2024-09-04T16:30:13.981 INFO:tasks.workunit.client.1.smithi193.stdout:2/618: truncate d2/d9/db/d10/f5c 852917 0 2024-09-04T16:30:13.981 INFO:tasks.workunit.client.1.smithi193.stdout:8/642: readlink d2/d20/d23/l3b 0 2024-09-04T16:30:13.982 INFO:tasks.workunit.client.1.smithi193.stdout:9/696: creat d2/d18/d2f/d9a/fdd x:0 0 0 2024-09-04T16:30:13.982 INFO:tasks.workunit.client.1.smithi193.stdout:1/691: symlink d1/d39/d48/ld2 0 2024-09-04T16:30:13.985 INFO:tasks.workunit.client.1.smithi193.stdout:8/643: chown d2/d20/d23/d24/f5d 29557478 1 2024-09-04T16:30:13.985 INFO:tasks.workunit.client.1.smithi193.stdout:9/697: write d2/d8/d25/f37 [1272283,16053] 0 2024-09-04T16:30:13.987 INFO:tasks.workunit.client.1.smithi193.stdout:3/624: dwrite d0/d18/d1c/d30/f4e [0,4194304] 0 2024-09-04T16:30:13.988 INFO:tasks.workunit.client.1.smithi193.stdout:2/619: read d2/d9/db/d10/d38/dac/fb8 [1911782,40808] 0 2024-09-04T16:30:13.988 INFO:tasks.workunit.client.1.smithi193.stdout:8/644: creat d2/d20/d23/d24/d3c/fd1 x:0 0 0 2024-09-04T16:30:13.991 INFO:tasks.workunit.client.1.smithi193.stdout:9/698: rename d2/d8/d88/da3 to d2/d56/d86/dc2/dde 0 2024-09-04T16:30:13.992 INFO:tasks.workunit.client.1.smithi193.stdout:3/625: symlink d0/lcc 0 2024-09-04T16:30:13.992 INFO:tasks.workunit.client.1.smithi193.stdout:9/699: write d2/d8/d4d/f91 [1035981,114332] 0 2024-09-04T16:30:13.995 INFO:tasks.workunit.client.1.smithi193.stdout:3/626: truncate d0/d3b/fc9 16590 0 2024-09-04T16:30:13.995 INFO:tasks.workunit.client.1.smithi193.stdout:3/627: stat d0/d18/d1c/d30/fac 0 2024-09-04T16:30:13.997 INFO:tasks.workunit.client.1.smithi193.stdout:8/645: mknod d2/d95/db6/cd2 0 2024-09-04T16:30:14.002 INFO:tasks.workunit.client.1.smithi193.stdout:3/628: mkdir d0/d18/d1c/d25/da0/dcd 0 2024-09-04T16:30:14.002 INFO:tasks.workunit.client.1.smithi193.stdout:8/646: creat d2/d20/d23/d24/d3c/d65/fd3 x:0 0 0 2024-09-04T16:30:14.002 INFO:tasks.workunit.client.1.smithi193.stdout:3/629: stat d0/d10/d24/d55/l85 0 2024-09-04T16:30:14.003 INFO:tasks.workunit.client.1.smithi193.stdout:1/692: dread d1/d2b/f6a [0,4194304] 0 2024-09-04T16:30:14.003 INFO:tasks.workunit.client.1.smithi193.stdout:0/636: sync 2024-09-04T16:30:14.003 INFO:tasks.workunit.client.1.smithi193.stdout:5/641: sync 2024-09-04T16:30:14.003 INFO:tasks.workunit.client.1.smithi193.stdout:6/600: sync 2024-09-04T16:30:14.003 INFO:tasks.workunit.client.1.smithi193.stdout:7/721: sync 2024-09-04T16:30:14.003 INFO:tasks.workunit.client.1.smithi193.stdout:2/620: dwrite d2/d9/db/d10/d51/d87/f8a [0,4194304] 0 2024-09-04T16:30:14.003 INFO:tasks.workunit.client.1.smithi193.stdout:8/647: mkdir d2/d20/d23/d34/d4b/dd4 0 2024-09-04T16:30:14.003 INFO:tasks.workunit.client.1.smithi193.stdout:1/693: chown d1/d2b/d1b/da0 4334 1 2024-09-04T16:30:14.005 INFO:tasks.workunit.client.1.smithi193.stdout:0/637: write d18/d25/d3b/f41 [975931,101142] 0 2024-09-04T16:30:14.006 INFO:tasks.workunit.client.1.smithi193.stdout:7/722: mkdir d9/d11/dd4/dd2/df1 0 2024-09-04T16:30:14.010 INFO:tasks.workunit.client.1.smithi193.stdout:8/648: chown d2/d20/d23/d34/d46/d53/fa5 25 1 2024-09-04T16:30:14.011 INFO:tasks.workunit.client.1.smithi193.stdout:3/630: dread d0/d18/d1b/f8b [0,4194304] 0 2024-09-04T16:30:14.011 INFO:tasks.workunit.client.1.smithi193.stdout:8/649: stat d2/d20/d23 0 2024-09-04T16:30:14.014 INFO:tasks.workunit.client.1.smithi193.stdout:6/601: dwrite d5/de/d15/d48/f98 [0,4194304] 0 2024-09-04T16:30:14.017 INFO:tasks.workunit.client.1.smithi193.stdout:2/621: dwrite d2/d9/db/d10/d1f/d22/f93 [0,4194304] 0 2024-09-04T16:30:14.017 INFO:tasks.workunit.client.1.smithi193.stdout:0/638: dread d18/f19 [0,4194304] 0 2024-09-04T16:30:14.019 INFO:tasks.workunit.client.1.smithi193.stdout:1/694: dwrite d1/d2b/d10/f91 [0,4194304] 0 2024-09-04T16:30:14.020 INFO:tasks.workunit.client.1.smithi193.stdout:8/650: rename d2/d20/d23/d1b/f33 to d2/d20/dc0/fd5 0 2024-09-04T16:30:14.020 INFO:tasks.workunit.client.0.smithi170.stdout:5/139: sync 2024-09-04T16:30:14.024 INFO:tasks.workunit.client.1.smithi193.stdout:0/639: creat d18/d25/d32/d57/d6c/fd1 x:0 0 0 2024-09-04T16:30:14.024 INFO:tasks.workunit.client.1.smithi193.stdout:1/695: mknod d1/d2b/d10/d56/da7/cd3 0 2024-09-04T16:30:14.025 INFO:tasks.workunit.client.1.smithi193.stdout:1/696: stat d1/d2b/d1b/c3d 0 2024-09-04T16:30:14.035 INFO:tasks.workunit.client.1.smithi193.stdout:4/545: sync 2024-09-04T16:30:14.036 INFO:tasks.workunit.client.1.smithi193.stdout:6/602: rename d5/d33/d4e/d51/f66 to d5/de/d15/d9f/fc1 0 2024-09-04T16:30:14.037 INFO:tasks.workunit.client.1.smithi193.stdout:2/622: truncate d2/d9/db/d10/d1e/da4/d9a/f44 808462 0 2024-09-04T16:30:14.037 INFO:tasks.workunit.client.1.smithi193.stdout:1/697: unlink d1/d2b/d10/db7/dc8/fd0 0 2024-09-04T16:30:14.045 INFO:tasks.workunit.client.1.smithi193.stdout:4/546: dwrite d3/d1a/d21/d52/f6c [4194304,4194304] 0 2024-09-04T16:30:14.046 INFO:tasks.workunit.client.1.smithi193.stdout:2/623: dwrite d2/d9/db/d10/d1e/da4/fc6 [0,4194304] 0 2024-09-04T16:30:14.050 INFO:tasks.workunit.client.1.smithi193.stdout:2/624: write d2/d9/db/d10/d4e/fbd [972144,27242] 0 2024-09-04T16:30:14.051 INFO:tasks.workunit.client.1.smithi193.stdout:6/603: mknod d5/d33/d4e/d51/d68/cc2 0 2024-09-04T16:30:14.051 INFO:tasks.workunit.client.1.smithi193.stdout:1/698: creat d1/d2b/db/d54/da1/fd4 x:0 0 0 2024-09-04T16:30:14.055 INFO:tasks.workunit.client.1.smithi193.stdout:8/651: dread d2/d20/dc0/f6d [0,4194304] 0 2024-09-04T16:30:14.058 INFO:tasks.workunit.client.1.smithi193.stdout:0/640: dread d18/f38 [0,4194304] 0 2024-09-04T16:30:14.060 INFO:tasks.workunit.client.1.smithi193.stdout:2/625: creat d2/d9/db/d10/d38/d7a/fd2 x:0 0 0 2024-09-04T16:30:14.061 INFO:tasks.workunit.client.1.smithi193.stdout:9/700: write d2/d8/d15/f34 [689586,53452] 0 2024-09-04T16:30:14.061 INFO:tasks.workunit.client.1.smithi193.stdout:4/547: dwrite d3/d1a/d2a/d83/f93 [0,4194304] 0 2024-09-04T16:30:14.064 INFO:tasks.workunit.client.1.smithi193.stdout:0/641: write d18/d25/d32/f42 [4211436,45139] 0 2024-09-04T16:30:14.065 INFO:tasks.workunit.client.1.smithi193.stdout:6/604: creat d5/de/d15/d1b/d5f/da7/db2/fc3 x:0 0 0 2024-09-04T16:30:14.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.065+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/549601202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c4104d80 msgr2=0x7fc6c4105200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:14.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.065+0000 7fc6c8aa9640 1 --2- 172.21.15.170:0/549601202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c4104d80 0x7fc6c4105200 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009880 tx=0x7fc6ac02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:30:14.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.066+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/549601202 shutdown_connections 2024-09-04T16:30:14.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.066+0000 7fc6c8aa9640 1 --2- 172.21.15.170:0/549601202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c4104d80 0x7fc6c4105200 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:14.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.066+0000 7fc6c8aa9640 1 --2- 172.21.15.170:0/549601202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6c4103b80 0x7fc6c4103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:14.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.066+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/549601202 >> 172.21.15.170:0/549601202 conn(0x7fc6c40ff310 msgr2=0x7fc6c4101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:14.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.066+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/549601202 shutdown_connections 2024-09-04T16:30:14.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.066+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/549601202 wait complete. 2024-09-04T16:30:14.068 INFO:tasks.workunit.client.1.smithi193.stdout:8/652: rename d2/d20/d23/d24/d3c/d65/d67 to d2/d20/d23/d34/dd6 0 2024-09-04T16:30:14.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.067+0000 7fc6c8aa9640 1 Processor -- start 2024-09-04T16:30:14.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.067+0000 7fc6c8aa9640 1 -- start start 2024-09-04T16:30:14.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.068+0000 7fc6c8aa9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c4103b80 0x7fc6c41996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:14.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.068+0000 7fc6c8aa9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6c4104d80 0x7fc6c4199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:14.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.068+0000 7fc6c259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c4103b80 0x7fc6c41996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:14.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.068+0000 7fc6c259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c4103b80 0x7fc6c41996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41250/0 (socket says 172.21.15.170:41250) 2024-09-04T16:30:14.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.068+0000 7fc6c259c640 1 -- 172.21.15.170:0/1631946531 learned_addr learned my addr 172.21.15.170:0/1631946531 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:30:14.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.068+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/1631946531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c410c9c0 con 0x7fc6c4103b80 2024-09-04T16:30:14.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.068+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/1631946531 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c410c840 con 0x7fc6c4104d80 2024-09-04T16:30:14.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.069+0000 7fc6bbfff640 1 --2- 172.21.15.170:0/1631946531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6c4104d80 0x7fc6c4199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:14.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.070+0000 7fc6c259c640 1 -- 172.21.15.170:0/1631946531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6c4104d80 msgr2=0x7fc6c4199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:14.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.070+0000 7fc6c259c640 1 --2- 172.21.15.170:0/1631946531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6c4104d80 0x7fc6c4199bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:14.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.070+0000 7fc6c259c640 1 -- 172.21.15.170:0/1631946531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c419a270 con 0x7fc6c4103b80 2024-09-04T16:30:14.072 INFO:tasks.workunit.client.1.smithi193.stdout:2/626: chown d2/d9/d18/f37 14416590 1 2024-09-04T16:30:14.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.070+0000 7fc6c259c640 1 --2- 172.21.15.170:0/1631946531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c4103b80 0x7fc6c41996b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400e940 tx=0x7fc6b400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:14.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.071+0000 7fc6bb7fe640 1 -- 172.21.15.170:0/1631946531 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6b400cac0 con 0x7fc6c4103b80 2024-09-04T16:30:14.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.071+0000 7fc6bb7fe640 1 -- 172.21.15.170:0/1631946531 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc6b400cc60 con 0x7fc6c4103b80 2024-09-04T16:30:14.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.072+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/1631946531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c419ecb0 con 0x7fc6c4103b80 2024-09-04T16:30:14.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.072+0000 7fc6bb7fe640 1 -- 172.21.15.170:0/1631946531 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6b4003e30 con 0x7fc6c4103b80 2024-09-04T16:30:14.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.072+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/1631946531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c419f1c0 con 0x7fc6c4103b80 2024-09-04T16:30:14.074 INFO:tasks.workunit.client.1.smithi193.stdout:5/642: truncate d1/f11 116154 0 2024-09-04T16:30:14.074 INFO:tasks.workunit.client.1.smithi193.stdout:5/643: chown d1/dc3/fb3 146 1 2024-09-04T16:30:14.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.073+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/1631946531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c4103f80 con 0x7fc6c4103b80 2024-09-04T16:30:14.076 INFO:tasks.workunit.client.1.smithi193.stdout:6/605: creat d5/d33/d4e/d51/d71/d82/fc4 x:0 0 0 2024-09-04T16:30:14.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.075+0000 7fc6bb7fe640 1 -- 172.21.15.170:0/1631946531 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 25) ==== 97250+0+0 (secure 0 0 0) 0x7fc6b4003fd0 con 0x7fc6c4103b80 2024-09-04T16:30:14.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.075+0000 7fc6bb7fe640 1 --2- 172.21.15.170:0/1631946531 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fc6b0073ec0 0x7fc6b0076380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:14.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.075+0000 7fc6bb7fe640 1 -- 172.21.15.170:0/1631946531 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fc6b40959f0 con 0x7fc6c4103b80 2024-09-04T16:30:14.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.075+0000 7fc6bbfff640 1 --2- 172.21.15.170:0/1631946531 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fc6b0073ec0 0x7fc6b0076380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:14.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.076+0000 7fc6bbfff640 1 --2- 172.21.15.170:0/1631946531 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fc6b0073ec0 0x7fc6b0076380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac006010 tx=0x7fc6ac02a9a0 comp rx=0 tx=0).ready entity=mgr.14682 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:14.077 INFO:tasks.workunit.client.1.smithi193.stdout:7/723: truncate d9/d18/d22/f30 7729897 0 2024-09-04T16:30:14.078 INFO:tasks.workunit.client.1.smithi193.stdout:6/606: chown d5/d27/d3e/d43/d5d/l75 227735430 1 2024-09-04T16:30:14.078 INFO:tasks.workunit.client.1.smithi193.stdout:8/653: chown d2/d20/d23/d34/d4b/c4c 31 1 2024-09-04T16:30:14.078 INFO:tasks.workunit.client.1.smithi193.stdout:4/548: getdents d3/d1a/d2a/db2 0 2024-09-04T16:30:14.078 INFO:tasks.workunit.client.1.smithi193.stdout:4/549: stat d3/d1a/d54/f7a 0 2024-09-04T16:30:14.079 INFO:tasks.workunit.client.1.smithi193.stdout:4/550: write d3/d1a/d21/f78 [3904676,15571] 0 2024-09-04T16:30:14.079 INFO:tasks.workunit.client.1.smithi193.stdout:9/701: getdents d2/d18/d2f/d22/d30/dba 0 2024-09-04T16:30:14.080 INFO:tasks.workunit.client.1.smithi193.stdout:9/702: stat d2/d56/d86/dc2 0 2024-09-04T16:30:14.081 INFO:tasks.workunit.client.1.smithi193.stdout:0/642: link d18/d25/f77 d18/d25/d32/d9c/da9/fd2 0 2024-09-04T16:30:14.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.081+0000 7fc6bb7fe640 1 -- 172.21.15.170:0/1631946531 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fc6b401d060 con 0x7fc6c4103b80 2024-09-04T16:30:14.083 INFO:tasks.workunit.client.1.smithi193.stdout:6/607: dwrite d5/d27/d3e/d43/f72 [0,4194304] 0 2024-09-04T16:30:14.083 INFO:tasks.workunit.client.1.smithi193.stdout:5/644: write d1/d8/db/f4e [1000741,54595] 0 2024-09-04T16:30:14.084 INFO:tasks.workunit.client.1.smithi193.stdout:6/608: stat d5/d33/d4e/d51/c58 0 2024-09-04T16:30:14.085 INFO:tasks.workunit.client.1.smithi193.stdout:3/631: truncate d0/d18/d1c/d25/f48 2521754 0 2024-09-04T16:30:14.087 INFO:tasks.workunit.client.1.smithi193.stdout:8/654: creat d2/d20/d23/d34/d4b/d7c/db2/fd7 x:0 0 0 2024-09-04T16:30:14.088 INFO:tasks.workunit.client.1.smithi193.stdout:2/627: link d2/d9/db/f75 d2/d9/db/d10/d1e/d26/dc1/fd3 0 2024-09-04T16:30:14.089 INFO:tasks.workunit.client.1.smithi193.stdout:2/628: fsync d2/d9/db/d10/d1e/f96 0 2024-09-04T16:30:14.092 INFO:tasks.workunit.client.1.smithi193.stdout:5/645: mknod d1/d8/db/d36/d40/d46/d84/cc9 0 2024-09-04T16:30:14.093 INFO:tasks.workunit.client.1.smithi193.stdout:5/646: dread - d1/d8/db/d15/d2b/d83/d37/d58/f9a zero size 2024-09-04T16:30:14.095 INFO:tasks.workunit.client.1.smithi193.stdout:4/551: truncate d3/f16 1389457 0 2024-09-04T16:30:14.095 INFO:tasks.workunit.client.1.smithi193.stdout:5/647: dread d1/d8/fc0 [0,4194304] 0 2024-09-04T16:30:14.098 INFO:tasks.workunit.client.1.smithi193.stdout:7/724: creat d9/de/d27/ff2 x:0 0 0 2024-09-04T16:30:14.100 INFO:tasks.workunit.client.1.smithi193.stdout:0/643: creat d18/d25/d5f/d6a/fd3 x:0 0 0 2024-09-04T16:30:14.102 INFO:tasks.workunit.client.1.smithi193.stdout:4/552: creat d3/d1a/d2a/d83/fb4 x:0 0 0 2024-09-04T16:30:14.103 INFO:tasks.workunit.client.1.smithi193.stdout:0/644: write d18/d25/d5f/fb0 [554801,10493] 0 2024-09-04T16:30:14.103 INFO:tasks.workunit.client.1.smithi193.stdout:9/703: rename d2/d8/d4d/da0 to d2/d18/d2f/d22/d30/d6a/d6e/ddf 0 2024-09-04T16:30:14.105 INFO:tasks.workunit.client.1.smithi193.stdout:5/648: mkdir d1/d8/db/d15/d2b/d83/d37/d58/dca 0 2024-09-04T16:30:14.107 INFO:tasks.workunit.client.1.smithi193.stdout:7/725: dwrite d9/d18/fd1 [0,4194304] 0 2024-09-04T16:30:14.107 INFO:tasks.workunit.client.1.smithi193.stdout:4/553: write d3/d1a/d21/f2c [1080125,108006] 0 2024-09-04T16:30:14.109 INFO:tasks.workunit.client.1.smithi193.stdout:3/632: dread d0/d18/d1c/d25/d5e/d7e/f7c [0,4194304] 0 2024-09-04T16:30:14.109 INFO:tasks.workunit.client.1.smithi193.stdout:9/704: fsync d2/d18/d2f/d22/d30/d6a/f7a 0 2024-09-04T16:30:14.109 INFO:tasks.workunit.client.1.smithi193.stdout:8/655: rename d2/d95 to d2/d20/d23/d34/dd6/da0/da8/db9/dc2/dd8 0 2024-09-04T16:30:14.111 INFO:tasks.workunit.client.1.smithi193.stdout:0/645: mkdir d18/d25/d5f/d65/dd4 0 2024-09-04T16:30:14.115 INFO:tasks.workunit.client.1.smithi193.stdout:2/629: dread d2/d9/db/d10/d1e/da4/d9a/f41 [0,4194304] 0 2024-09-04T16:30:14.116 INFO:tasks.workunit.client.1.smithi193.stdout:4/554: creat d3/d1a/d2a/d83/fb5 x:0 0 0 2024-09-04T16:30:14.118 INFO:tasks.workunit.client.1.smithi193.stdout:1/699: dwrite d1/d2b/d10/fbc [0,4194304] 0 2024-09-04T16:30:14.120 INFO:tasks.workunit.client.1.smithi193.stdout:1/700: write d1/d2b/db/d54/da1/fc3 [1017555,45178] 0 2024-09-04T16:30:14.120 INFO:tasks.workunit.client.1.smithi193.stdout:0/646: unlink d18/d25/f90 0 2024-09-04T16:30:14.121 INFO:tasks.workunit.client.1.smithi193.stdout:8/656: mknod d2/cd9 0 2024-09-04T16:30:14.123 INFO:tasks.workunit.client.1.smithi193.stdout:3/633: mkdir d0/d9/dae/dce 0 2024-09-04T16:30:14.124 INFO:tasks.workunit.client.1.smithi193.stdout:0/647: fsync d18/d25/d3b/f75 0 2024-09-04T16:30:14.124 INFO:tasks.workunit.client.1.smithi193.stdout:9/705: symlink d2/d18/d2f/d22/le0 0 2024-09-04T16:30:14.124 INFO:tasks.workunit.client.1.smithi193.stdout:8/657: read d2/d20/dc0/fc3 [520935,20172] 0 2024-09-04T16:30:14.125 INFO:tasks.workunit.client.1.smithi193.stdout:3/634: chown d0/d10/d24/d55/f9b 525 1 2024-09-04T16:30:14.125 INFO:tasks.workunit.client.1.smithi193.stdout:7/726: rename d9/d39/d3e/d4a/faa to d9/d39/d3e/d4d/d98/d9a/ff3 0 2024-09-04T16:30:14.126 INFO:tasks.workunit.client.1.smithi193.stdout:8/658: chown d2/d20/f8f 2755664 1 2024-09-04T16:30:14.127 INFO:tasks.workunit.client.1.smithi193.stdout:8/659: fdatasync d2/d12/f19 0 2024-09-04T16:30:14.129 INFO:tasks.workunit.client.1.smithi193.stdout:4/555: dread - d3/d39/f57 zero size 2024-09-04T16:30:14.129 INFO:tasks.workunit.client.1.smithi193.stdout:2/630: fdatasync d2/d9/db/d10/d38/dac/fb8 0 2024-09-04T16:30:14.130 INFO:tasks.workunit.client.1.smithi193.stdout:5/649: getdents d1/d8/db/d15/d2b/d83/d37/d58/dc4 0 2024-09-04T16:30:14.133 INFO:tasks.workunit.client.1.smithi193.stdout:8/660: fsync d2/d20/d23/d34/dd6/da0/da8/db9/f8c 0 2024-09-04T16:30:14.134 INFO:tasks.workunit.client.1.smithi193.stdout:4/556: read - d3/d1a/d21/d52/d5e/fa5 zero size 2024-09-04T16:30:14.134 INFO:tasks.workunit.client.1.smithi193.stdout:2/631: write d2/fc [7712148,128885] 0 2024-09-04T16:30:14.135 INFO:tasks.workunit.client.1.smithi193.stdout:0/648: rmdir d18/d25/d5f/d65/d9f 39 2024-09-04T16:30:14.140 INFO:tasks.workunit.client.1.smithi193.stdout:7/727: dwrite d9/d39/d3e/f3f [0,4194304] 0 2024-09-04T16:30:14.141 INFO:tasks.workunit.client.1.smithi193.stdout:4/557: truncate d3/d81/f9b 1093669 0 2024-09-04T16:30:14.143 INFO:tasks.workunit.client.1.smithi193.stdout:3/635: dwrite d0/d18/d1c/d51/fca [0,4194304] 0 2024-09-04T16:30:14.145 INFO:tasks.workunit.client.1.smithi193.stdout:6/609: dwrite d5/de/d15/d1b/d5f/f76 [0,4194304] 0 2024-09-04T16:30:14.147 INFO:tasks.workunit.client.1.smithi193.stdout:6/610: fsync d5/d27/d3e/d8c/fad 0 2024-09-04T16:30:14.147 INFO:tasks.workunit.client.1.smithi193.stdout:8/661: unlink d2/d20/d23/d1b/lb0 0 2024-09-04T16:30:14.148 INFO:tasks.workunit.client.1.smithi193.stdout:4/558: dread d3/d39/fac [0,4194304] 0 2024-09-04T16:30:14.149 INFO:tasks.workunit.client.1.smithi193.stdout:8/662: chown d2/d20/d23/d24/d3c/d65/f74 15 1 2024-09-04T16:30:14.155 INFO:tasks.workunit.client.1.smithi193.stdout:7/728: fdatasync d9/de/f1a 0 2024-09-04T16:30:14.156 INFO:tasks.workunit.client.1.smithi193.stdout:6/611: rmdir d5/d33 39 2024-09-04T16:30:14.159 INFO:tasks.workunit.client.1.smithi193.stdout:4/559: mkdir d3/d1a/d21/d52/d7f/db6 0 2024-09-04T16:30:14.161 INFO:tasks.workunit.client.1.smithi193.stdout:8/663: rename d2/d20/d23/d51/l79 to d2/d20/d23/d24/d3c/dc9/lda 0 2024-09-04T16:30:14.161 INFO:tasks.workunit.client.1.smithi193.stdout:4/560: write d3/d1a/d21/f78 [3357210,33044] 0 2024-09-04T16:30:14.161 INFO:tasks.workunit.client.1.smithi193.stdout:1/701: getdents d1/d2b/d10/d56/da7/db1 0 2024-09-04T16:30:14.163 INFO:tasks.workunit.client.1.smithi193.stdout:2/632: symlink d2/d9/db/d10/d1f/d77/d91/ld4 0 2024-09-04T16:30:14.164 INFO:tasks.workunit.client.1.smithi193.stdout:5/650: dread d1/d29/f1d [4194304,4194304] 0 2024-09-04T16:30:14.164 INFO:tasks.workunit.client.1.smithi193.stdout:0/649: mkdir d18/d25/d5f/d65/dc4/dd5 0 2024-09-04T16:30:14.166 INFO:tasks.workunit.client.1.smithi193.stdout:0/650: read d18/d25/d5f/d6a/d7b/f94 [2442836,95596] 0 2024-09-04T16:30:14.172 INFO:tasks.workunit.client.1.smithi193.stdout:1/702: fdatasync d1/d2b/f6a 0 2024-09-04T16:30:14.173 INFO:tasks.workunit.client.1.smithi193.stdout:9/706: dwrite d2/d18/d66/f7f [0,4194304] 0 2024-09-04T16:30:14.174 INFO:tasks.workunit.client.1.smithi193.stdout:4/561: rename d3/d1a/d21/d52/d5e/c7e to d3/d1a/d2a/cb7 0 2024-09-04T16:30:14.182 INFO:tasks.workunit.client.1.smithi193.stdout:0/651: creat d18/d25/d32/d9c/fd6 x:0 0 0 2024-09-04T16:30:14.185 INFO:tasks.workunit.client.1.smithi193.stdout:7/729: unlink d9/de/d27/f3d 0 2024-09-04T16:30:14.186 INFO:tasks.workunit.client.1.smithi193.stdout:3/636: link d0/d18/d1c/d25/da0/lc3 d0/d18/d1c/d25/d5e/lcf 0 2024-09-04T16:30:14.190 INFO:tasks.workunit.client.1.smithi193.stdout:1/703: unlink d1/d2b/d1b/c3d 0 2024-09-04T16:30:14.193 INFO:tasks.workunit.client.1.smithi193.stdout:7/730: fdatasync d9/d85/f9f 0 2024-09-04T16:30:14.195 INFO:tasks.workunit.client.1.smithi193.stdout:6/612: unlink d5/d33/d4e/d51/d7b/cb5 0 2024-09-04T16:30:14.195 INFO:tasks.workunit.client.1.smithi193.stdout:5/651: write d1/f16 [360065,15906] 0 2024-09-04T16:30:14.199 INFO:tasks.workunit.client.1.smithi193.stdout:0/652: mkdir d18/d25/d32/dce/dd7 0 2024-09-04T16:30:14.199 INFO:tasks.workunit.client.1.smithi193.stdout:8/664: link d2/d20/d23/d1b/cb5 d2/d20/d23/d34/dd6/cdb 0 2024-09-04T16:30:14.200 INFO:tasks.workunit.client.1.smithi193.stdout:0/653: chown d18/l2d 12279536 1 2024-09-04T16:30:14.201 INFO:tasks.workunit.client.1.smithi193.stdout:0/654: chown d18/d25/d3b/f75 66080 1 2024-09-04T16:30:14.205 INFO:tasks.workunit.client.1.smithi193.stdout:6/613: dwrite d5/de/d15/d1b/d5f/f78 [0,4194304] 0 2024-09-04T16:30:14.206 INFO:tasks.workunit.client.1.smithi193.stdout:0/655: chown d18/d25/d3b/l8f 3554 1 2024-09-04T16:30:14.207 INFO:tasks.workunit.client.1.smithi193.stdout:5/652: creat d1/d29/d18/d42/fcb x:0 0 0 2024-09-04T16:30:14.207 INFO:tasks.workunit.client.1.smithi193.stdout:4/562: creat d3/d3c/fb8 x:0 0 0 2024-09-04T16:30:14.207 INFO:tasks.workunit.client.1.smithi193.stdout:5/653: readlink d1/d8/db/d15/d2b/lb5 0 2024-09-04T16:30:14.207 INFO:tasks.workunit.client.1.smithi193.stdout:6/614: truncate d5/de/d15/f2f 2550468 0 2024-09-04T16:30:14.207 INFO:tasks.workunit.client.1.smithi193.stdout:1/704: truncate d1/f6e 239446 0 2024-09-04T16:30:14.208 INFO:tasks.workunit.client.1.smithi193.stdout:2/633: rename d2/d9/db/d10/d1f/d22/cc5 to d2/d9/cd5 0 2024-09-04T16:30:14.209 INFO:tasks.workunit.client.1.smithi193.stdout:8/665: creat d2/d20/dc0/d82/fdc x:0 0 0 2024-09-04T16:30:14.210 INFO:tasks.workunit.client.1.smithi193.stdout:4/563: mkdir d3/d1a/d2a/db9 0 2024-09-04T16:30:14.213 INFO:tasks.workunit.client.1.smithi193.stdout:0/656: symlink d18/d25/d5f/d6a/ld8 0 2024-09-04T16:30:14.216 INFO:tasks.workunit.client.1.smithi193.stdout:3/637: rename d0/d18/d1b/f37 to d0/d18/d1b/d3d/d96/fd0 0 2024-09-04T16:30:14.217 INFO:tasks.workunit.client.1.smithi193.stdout:9/707: link d2/d8/c14 d2/d18/d2f/d22/d30/d6a/d6e/ce1 0 2024-09-04T16:30:14.219 INFO:tasks.workunit.client.1.smithi193.stdout:8/666: symlink d2/d20/d23/d34/d3e/d6f/d81/ldd 0 2024-09-04T16:30:14.222 INFO:tasks.workunit.client.1.smithi193.stdout:5/654: dread d1/d29/d18/f2f [0,4194304] 0 2024-09-04T16:30:14.223 INFO:tasks.workunit.client.1.smithi193.stdout:6/615: symlink d5/d33/d4e/d51/d71/lc5 0 2024-09-04T16:30:14.225 INFO:tasks.workunit.client.1.smithi193.stdout:2/634: creat d2/d9/db/d10/d1e/d56/fd6 x:0 0 0 2024-09-04T16:30:14.226 INFO:tasks.workunit.client.1.smithi193.stdout:2/635: write d2/d9/db/d10/d1e/d56/fae [351951,95868] 0 2024-09-04T16:30:14.230 INFO:tasks.workunit.client.1.smithi193.stdout:4/564: mknod d3/d39/cba 0 2024-09-04T16:30:14.231 INFO:tasks.workunit.client.1.smithi193.stdout:8/667: rmdir d2/d20/d23/d34/d3e/d6f/d81 39 2024-09-04T16:30:14.234 INFO:tasks.workunit.client.1.smithi193.stdout:1/705: creat d1/d2b/d10/d56/fd5 x:0 0 0 2024-09-04T16:30:14.234 INFO:tasks.workunit.client.1.smithi193.stdout:4/565: chown d3/d1a/d21/d52/d5e/fa8 7134 1 2024-09-04T16:30:14.234 INFO:tasks.workunit.client.1.smithi193.stdout:7/731: rename d9/d39/d3e/d7d/ca9 to d9/d39/d3e/d53/cf4 0 2024-09-04T16:30:14.235 INFO:tasks.workunit.client.1.smithi193.stdout:3/638: mknod d0/d18/cd1 0 2024-09-04T16:30:14.235 INFO:tasks.workunit.client.1.smithi193.stdout:2/636: dwrite d2/d9/db/d10/d38/d63/f9f [0,4194304] 0 2024-09-04T16:30:14.235 INFO:tasks.workunit.client.1.smithi193.stdout:8/668: dread d2/d20/f8d [0,4194304] 0 2024-09-04T16:30:14.237 INFO:tasks.workunit.client.1.smithi193.stdout:9/708: dread d2/d18/d2f/f45 [0,4194304] 0 2024-09-04T16:30:14.238 INFO:tasks.workunit.client.1.smithi193.stdout:2/637: stat d2/d9/db/d10/d38/dac 0 2024-09-04T16:30:14.239 INFO:tasks.workunit.client.1.smithi193.stdout:0/657: dread f15 [0,4194304] 0 2024-09-04T16:30:14.240 INFO:tasks.workunit.client.1.smithi193.stdout:4/566: fsync d3/f28 0 2024-09-04T16:30:14.240 INFO:tasks.workunit.client.1.smithi193.stdout:9/709: write d2/d18/d2f/d22/d30/d52/fcf [602288,22853] 0 2024-09-04T16:30:14.241 INFO:tasks.workunit.client.1.smithi193.stdout:2/638: stat d2/d9/db/d10/d1e/d56/l97 0 2024-09-04T16:30:14.241 INFO:tasks.workunit.client.1.smithi193.stdout:3/639: truncate d0/d18/d1c/d25/d5e/d7e/fa7 451613 0 2024-09-04T16:30:14.245 INFO:tasks.workunit.client.1.smithi193.stdout:6/616: mkdir d5/d27/dc6 0 2024-09-04T16:30:14.246 INFO:tasks.workunit.client.1.smithi193.stdout:7/732: mkdir d9/d18/d22/d2b/d6c/d70/df5 0 2024-09-04T16:30:14.248 INFO:tasks.workunit.client.1.smithi193.stdout:9/710: dwrite d2/f42 [0,4194304] 0 2024-09-04T16:30:14.253 INFO:tasks.workunit.client.1.smithi193.stdout:5/655: getdents d1/d29/d18 0 2024-09-04T16:30:14.253 INFO:tasks.workunit.client.1.smithi193.stdout:6/617: symlink d5/d33/d4e/d51/d71/d82/lc7 0 2024-09-04T16:30:14.260 INFO:tasks.workunit.client.1.smithi193.stdout:4/567: creat d3/d3c/fbb x:0 0 0 2024-09-04T16:30:14.260 INFO:tasks.workunit.client.1.smithi193.stdout:5/656: mknod d1/d8/db/d15/d2b/dc6/ccc 0 2024-09-04T16:30:14.262 INFO:tasks.workunit.client.1.smithi193.stdout:0/658: getdents d18/d25/d5f/d6a 0 2024-09-04T16:30:14.263 INFO:tasks.workunit.client.1.smithi193.stdout:4/568: symlink d3/d1a/d54/db1/lbc 0 2024-09-04T16:30:14.264 INFO:tasks.workunit.client.1.smithi193.stdout:5/657: write d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f7a [4136041,130647] 0 2024-09-04T16:30:14.265 INFO:tasks.workunit.client.1.smithi193.stdout:5/658: chown d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f89 33938 1 2024-09-04T16:30:14.266 INFO:tasks.workunit.client.1.smithi193.stdout:0/659: rename d18/d25/d5f/d6a/fd3 to d18/d25/d5f/d65/dc4/fd9 0 2024-09-04T16:30:14.266 INFO:tasks.workunit.client.1.smithi193.stdout:5/659: chown d1/d8/db/d15/d2b/d83/d37/d3f/l68 2107318 1 2024-09-04T16:30:14.267 INFO:tasks.workunit.client.1.smithi193.stdout:5/660: write d1/f5b [1681418,29411] 0 2024-09-04T16:30:14.271 INFO:tasks.workunit.client.1.smithi193.stdout:4/569: dwrite d3/d1a/d21/d52/d5e/d7b/fa9 [0,4194304] 0 2024-09-04T16:30:14.272 INFO:tasks.workunit.client.0.smithi170.stdout:7/370: sync 2024-09-04T16:30:14.288 INFO:tasks.workunit.client.1.smithi193.stdout:1/706: write d1/d2b/d1b/d28/f75 [2837649,28333] 0 2024-09-04T16:30:14.291 INFO:tasks.workunit.client.1.smithi193.stdout:6/618: dwrite d5/d27/d3e/f89 [0,4194304] 0 2024-09-04T16:30:14.292 INFO:tasks.workunit.client.1.smithi193.stdout:8/669: dwrite d2/d20/d23/d24/d3c/d65/f72 [0,4194304] 0 2024-09-04T16:30:14.293 INFO:tasks.workunit.client.1.smithi193.stdout:1/707: rename d1/da3 to d1/d2b/d10/d56/da7/db1/dd6 0 2024-09-04T16:30:14.297 INFO:tasks.workunit.client.1.smithi193.stdout:6/619: write d5/de/f18 [2550280,83271] 0 2024-09-04T16:30:14.303 INFO:tasks.workunit.client.1.smithi193.stdout:8/670: dwrite d2/fca [4194304,4194304] 0 2024-09-04T16:30:14.305 INFO:tasks.workunit.client.1.smithi193.stdout:6/620: unlink d5/de/d15/d1b/d5f/f77 0 2024-09-04T16:30:14.306 INFO:tasks.workunit.client.1.smithi193.stdout:8/671: unlink d2/d86/cce 0 2024-09-04T16:30:14.307 INFO:tasks.workunit.client.1.smithi193.stdout:1/708: dwrite d1/d2b/d10/f59 [0,4194304] 0 2024-09-04T16:30:14.309 INFO:tasks.workunit.client.1.smithi193.stdout:1/709: stat d1/d2b/d1b/d28/c57 0 2024-09-04T16:30:14.312 INFO:tasks.workunit.client.1.smithi193.stdout:6/621: link d5/de/d15/d1b/d5f/f78 d5/d27/d3e/d6e/fc8 0 2024-09-04T16:30:14.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.365+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/1631946531 --> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc6c4109300 con 0x7fc6b0073ec0 2024-09-04T16:30:14.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.367+0000 7fc6bb7fe640 1 -- 172.21.15.170:0/1631946531 <== mgr.14682 v2:172.21.15.193:6828/4218378172 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7fc6c4109300 con 0x7fc6b0073ec0 2024-09-04T16:30:14.367 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:30:14.367 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:30:14.367 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:30:14.367 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-04T16:30:14.368 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [], 2024-09-04T16:30:14.368 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "1/2 daemons upgraded", 2024-09-04T16:30:14.368 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "", 2024-09-04T16:30:14.368 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:30:14.368 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:30:14.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.369+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/1631946531 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fc6b0073ec0 msgr2=0x7fc6b0076380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:14.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.369+0000 7fc6c8aa9640 1 --2- 172.21.15.170:0/1631946531 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fc6b0073ec0 0x7fc6b0076380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac006010 tx=0x7fc6ac02a9a0 comp rx=0 tx=0).stop 2024-09-04T16:30:14.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.369+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/1631946531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c4103b80 msgr2=0x7fc6c41996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:14.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.369+0000 7fc6c8aa9640 1 --2- 172.21.15.170:0/1631946531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c4103b80 0x7fc6c41996b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400e940 tx=0x7fc6b400ee00 comp rx=0 tx=0).stop 2024-09-04T16:30:14.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.369+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/1631946531 shutdown_connections 2024-09-04T16:30:14.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.369+0000 7fc6c8aa9640 1 --2- 172.21.15.170:0/1631946531 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fc6b0073ec0 0x7fc6b0076380 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:14.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.369+0000 7fc6c8aa9640 1 --2- 172.21.15.170:0/1631946531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6c4104d80 0x7fc6c4199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:14.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.369+0000 7fc6c8aa9640 1 --2- 172.21.15.170:0/1631946531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c4103b80 0x7fc6c41996b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:14.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.369+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/1631946531 >> 172.21.15.170:0/1631946531 conn(0x7fc6c40ff310 msgr2=0x7fc6c41014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:14.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.369+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/1631946531 shutdown_connections 2024-09-04T16:30:14.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:14.369+0000 7fc6c8aa9640 1 -- 172.21.15.170:0/1631946531 wait complete. 2024-09-04T16:30:14.403 INFO:tasks.workunit.client.1.smithi193.stdout:7/733: sync 2024-09-04T16:30:14.404 INFO:tasks.workunit.client.1.smithi193.stdout:7/734: write d9/d85/fc8 [2085887,10660] 0 2024-09-04T16:30:14.409 INFO:tasks.workunit.client.1.smithi193.stdout:7/735: dwrite d9/d39/d3e/fa2 [4194304,4194304] 0 2024-09-04T16:30:14.431 INFO:tasks.workunit.client.0.smithi170.stdout:4/267: sync 2024-09-04T16:30:14.431 INFO:tasks.workunit.client.0.smithi170.stdout:1/256: sync 2024-09-04T16:30:14.433 INFO:tasks.workunit.client.0.smithi170.stdout:1/257: unlink d9/d26/f2d 0 2024-09-04T16:30:14.433 INFO:tasks.workunit.client.0.smithi170.stdout:1/258: stat d9/d11/d3e/c40 0 2024-09-04T16:30:14.434 INFO:tasks.workunit.client.0.smithi170.stdout:1/259: dread - d9/d11/d3e/f4e zero size 2024-09-04T16:30:14.434 INFO:tasks.workunit.client.0.smithi170.stdout:4/268: truncate d1/d6/d8/d20/d35/d3e/f46 1598477 0 2024-09-04T16:30:14.439 INFO:tasks.workunit.client.0.smithi170.stdout:7/371: dread d12/d15/d71/f56 [0,4194304] 0 2024-09-04T16:30:14.442 INFO:tasks.workunit.client.1.smithi193.stdout:3/640: write d0/f66 [1276740,34295] 0 2024-09-04T16:30:14.443 INFO:tasks.workunit.client.0.smithi170.stdout:1/260: dwrite d9/f37 [0,4194304] 0 2024-09-04T16:30:14.443 INFO:tasks.workunit.client.0.smithi170.stdout:4/269: dread d1/d6/d8/d20/d35/d3e/d4e/d51/f5c [0,4194304] 0 2024-09-04T16:30:14.446 INFO:tasks.workunit.client.0.smithi170.stdout:4/270: write d1/d6/d8/d20/d35/d3e/d4e/f45 [977909,119894] 0 2024-09-04T16:30:14.446 INFO:tasks.workunit.client.1.smithi193.stdout:3/641: dread d0/d9/f83 [0,4194304] 0 2024-09-04T16:30:14.447 INFO:tasks.workunit.client.0.smithi170.stdout:4/271: dread - d1/d6/d22/f62 zero size 2024-09-04T16:30:14.447 INFO:tasks.workunit.client.0.smithi170.stdout:1/261: creat d9/d26/f56 x:0 0 0 2024-09-04T16:30:14.449 INFO:tasks.workunit.client.0.smithi170.stdout:4/272: readlink d1/d6/d8/d20/l55 0 2024-09-04T16:30:14.449 INFO:tasks.workunit.client.1.smithi193.stdout:2/639: dwrite d2/d9/db/d65/fa7 [0,4194304] 0 2024-09-04T16:30:14.454 INFO:tasks.workunit.client.1.smithi193.stdout:3/642: mknod d0/d18/d1c/d51/d7a/cd2 0 2024-09-04T16:30:14.454 INFO:tasks.workunit.client.1.smithi193.stdout:9/711: dwrite d2/d4/f3a [0,4194304] 0 2024-09-04T16:30:14.456 INFO:tasks.workunit.client.1.smithi193.stdout:9/712: chown d2/d18/l21 740830655 1 2024-09-04T16:30:14.456 INFO:tasks.workunit.client.1.smithi193.stdout:2/640: chown d2/d9/d61/l83 197857 1 2024-09-04T16:30:14.456 INFO:tasks.workunit.client.1.smithi193.stdout:5/661: truncate d1/d8/db/d15/d2b/d83/d37/f4d 2391562 0 2024-09-04T16:30:14.458 INFO:tasks.workunit.client.1.smithi193.stdout:4/570: write d3/d39/f42 [799056,99709] 0 2024-09-04T16:30:14.459 INFO:tasks.workunit.client.1.smithi193.stdout:4/571: read - d3/d39/d44/f6a zero size 2024-09-04T16:30:14.461 INFO:tasks.workunit.client.1.smithi193.stdout:0/660: chown d18/d25/d5f/d6a/l6e 17855 1 2024-09-04T16:30:14.461 INFO:tasks.workunit.client.1.smithi193.stdout:4/572: chown d3/d3c/fb8 0 1 2024-09-04T16:30:14.466 INFO:tasks.workunit.client.1.smithi193.stdout:5/662: creat d1/d29/fcd x:0 0 0 2024-09-04T16:30:14.467 INFO:tasks.workunit.client.0.smithi170.stdout:4/273: link d1/c2c d1/d6/d8/d20/d35/d3e/c66 0 2024-09-04T16:30:14.469 INFO:tasks.workunit.client.1.smithi193.stdout:2/641: rename d2/d9/db/d10/d1e/da4/d9a/f41 to d2/d9/db/d10/d1e/da4/d9a/fd7 0 2024-09-04T16:30:14.469 INFO:tasks.workunit.client.1.smithi193.stdout:2/642: chown d2/d9/db/d10/d51/lb2 4402 1 2024-09-04T16:30:14.471 INFO:tasks.workunit.client.1.smithi193.stdout:1/710: truncate d1/d2b/d10/f59 3772216 0 2024-09-04T16:30:14.472 INFO:tasks.workunit.client.0.smithi170.stdout:1/262: getdents d9/d11 0 2024-09-04T16:30:14.472 INFO:tasks.workunit.client.0.smithi170.stdout:1/263: chown d9/f10 24380 1 2024-09-04T16:30:14.472 INFO:tasks.workunit.client.1.smithi193.stdout:1/711: chown d1/d2b/d1b/f4c 117 1 2024-09-04T16:30:14.473 INFO:tasks.workunit.client.1.smithi193.stdout:6/622: truncate d5/de/d15/d1b/d5f/f76 2756697 0 2024-09-04T16:30:14.473 INFO:tasks.workunit.client.0.smithi170.stdout:4/274: symlink d1/d6/d22/l67 0 2024-09-04T16:30:14.473 INFO:tasks.workunit.client.1.smithi193.stdout:6/623: stat d5/de/d15/d48 0 2024-09-04T16:30:14.476 INFO:tasks.workunit.client.0.smithi170.stdout:1/264: unlink d9/d26/l35 0 2024-09-04T16:30:14.476 INFO:tasks.workunit.client.1.smithi193.stdout:7/736: write d9/d18/d1e/f29 [2463047,77946] 0 2024-09-04T16:30:14.476 INFO:tasks.workunit.client.1.smithi193.stdout:3/643: getdents d0/d9/dae/dce 0 2024-09-04T16:30:14.477 INFO:tasks.workunit.client.0.smithi170.stdout:1/265: write d9/f13 [52499,79234] 0 2024-09-04T16:30:14.480 INFO:tasks.workunit.client.0.smithi170.stdout:4/275: dwrite d1/d6/d8/d20/f25 [0,4194304] 0 2024-09-04T16:30:14.481 INFO:tasks.workunit.client.0.smithi170.stdout:7/372: write d12/d49/f7c [5018489,42424] 0 2024-09-04T16:30:14.485 INFO:tasks.workunit.client.1.smithi193.stdout:1/712: write d1/d2b/f31 [6451006,127230] 0 2024-09-04T16:30:14.485 INFO:tasks.workunit.client.1.smithi193.stdout:0/661: dread d18/f1a [0,4194304] 0 2024-09-04T16:30:14.487 INFO:tasks.workunit.client.0.smithi170.stdout:4/276: mkdir d1/d6/d2b/d47/d68 0 2024-09-04T16:30:14.487 INFO:tasks.workunit.client.0.smithi170.stdout:1/266: dwrite d9/d11/d2f/f4b [0,4194304] 0 2024-09-04T16:30:14.489 INFO:tasks.workunit.client.0.smithi170.stdout:1/267: dread - d9/d26/f56 zero size 2024-09-04T16:30:14.489 INFO:tasks.workunit.client.1.smithi193.stdout:6/624: dread d5/de/d15/d1b/f6f [0,4194304] 0 2024-09-04T16:30:14.494 INFO:tasks.workunit.client.0.smithi170.stdout:1/268: creat d9/d11/d2f/f57 x:0 0 0 2024-09-04T16:30:14.494 INFO:tasks.workunit.client.0.smithi170.stdout:1/269: dread - d9/f47 zero size 2024-09-04T16:30:14.501 INFO:tasks.workunit.client.1.smithi193.stdout:1/713: unlink d1/f34 0 2024-09-04T16:30:14.503 INFO:tasks.workunit.client.1.smithi193.stdout:6/625: mknod d5/d27/d3e/d8c/cc9 0 2024-09-04T16:30:14.504 INFO:tasks.workunit.client.1.smithi193.stdout:7/737: creat d9/d18/d22/d2b/d96/ff6 x:0 0 0 2024-09-04T16:30:14.505 INFO:tasks.workunit.client.1.smithi193.stdout:1/714: read d1/d2b/f61 [1743106,50555] 0 2024-09-04T16:30:14.505 INFO:tasks.workunit.client.1.smithi193.stdout:3/644: creat d0/d18/d1c/d30/d8e/fd3 x:0 0 0 2024-09-04T16:30:14.506 INFO:tasks.workunit.client.1.smithi193.stdout:5/663: rename d1/d8/db/d15/d2b/d83/d37/d3f/f5a to d1/d8/db/d36/d40/d46/fce 0 2024-09-04T16:30:14.507 INFO:tasks.workunit.client.1.smithi193.stdout:2/643: dread d2/d9/db/d10/d38/f70 [0,4194304] 0 2024-09-04T16:30:14.508 INFO:tasks.workunit.client.1.smithi193.stdout:4/573: dwrite d3/f30 [0,4194304] 0 2024-09-04T16:30:14.510 INFO:tasks.workunit.client.1.smithi193.stdout:2/644: fdatasync d2/d9/db/d10/d51/f85 0 2024-09-04T16:30:14.511 INFO:tasks.workunit.client.1.smithi193.stdout:8/672: sync 2024-09-04T16:30:14.512 INFO:tasks.workunit.client.1.smithi193.stdout:3/645: unlink d0/d9/d49/c5b 0 2024-09-04T16:30:14.515 INFO:tasks.workunit.client.1.smithi193.stdout:4/574: mkdir d3/d3c/d89/dbd 0 2024-09-04T16:30:14.516 INFO:tasks.workunit.client.0.smithi170.stdout:1/270: dwrite d9/d11/f3f [0,4194304] 0 2024-09-04T16:30:14.516 INFO:tasks.workunit.client.1.smithi193.stdout:6/626: dwrite d5/de/d15/d1b/d5f/f8f [0,4194304] 0 2024-09-04T16:30:14.517 INFO:tasks.workunit.client.0.smithi170.stdout:1/271: read - d9/d11/d3e/f4e zero size 2024-09-04T16:30:14.518 INFO:tasks.workunit.client.1.smithi193.stdout:4/575: write d3/d1a/d2a/f8b [1313093,105416] 0 2024-09-04T16:30:14.521 INFO:tasks.workunit.client.1.smithi193.stdout:5/664: creat d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/fcf x:0 0 0 2024-09-04T16:30:14.521 INFO:tasks.workunit.client.1.smithi193.stdout:3/646: dwrite d0/d3b/fbd [0,4194304] 0 2024-09-04T16:30:14.525 INFO:tasks.workunit.client.1.smithi193.stdout:0/662: truncate d18/d25/d5f/d65/f99 272418 0 2024-09-04T16:30:14.528 INFO:tasks.workunit.client.1.smithi193.stdout:0/663: readlink d18/d25/d32/lc0 0 2024-09-04T16:30:14.529 INFO:tasks.workunit.client.0.smithi170.stdout:1/272: truncate d9/d11/f14 739467 0 2024-09-04T16:30:14.530 INFO:tasks.workunit.client.1.smithi193.stdout:3/647: dwrite d0/d3b/fc9 [0,4194304] 0 2024-09-04T16:30:14.536 INFO:tasks.workunit.client.0.smithi170.stdout:1/273: creat d9/d11/d2f/f58 x:0 0 0 2024-09-04T16:30:14.537 INFO:tasks.workunit.client.0.smithi170.stdout:1/274: chown d9/d11/d2e/f4c 68124005 1 2024-09-04T16:30:14.539 INFO:tasks.workunit.client.1.smithi193.stdout:1/715: getdents d1/d2b/d10/db6 0 2024-09-04T16:30:14.540 INFO:tasks.workunit.client.0.smithi170.stdout:1/275: mknod d9/d11/d3e/c59 0 2024-09-04T16:30:14.541 INFO:tasks.workunit.client.0.smithi170.stdout:1/276: write d9/f13 [1575868,13939] 0 2024-09-04T16:30:14.545 INFO:tasks.workunit.client.1.smithi193.stdout:7/738: rename d9/d39/d3e/d4d/f6a to d9/d39/d3e/d69/ff7 0 2024-09-04T16:30:14.546 INFO:tasks.workunit.client.1.smithi193.stdout:4/576: dread d3/d1a/d21/f78 [0,4194304] 0 2024-09-04T16:30:14.546 INFO:tasks.workunit.client.1.smithi193.stdout:4/577: readlink d3/l33 0 2024-09-04T16:30:14.547 INFO:tasks.workunit.client.1.smithi193.stdout:7/739: dread d9/d18/d22/fb7 [0,4194304] 0 2024-09-04T16:30:14.549 INFO:tasks.workunit.client.1.smithi193.stdout:2/645: fsync d2/d9/db/d10/d1f/f4c 0 2024-09-04T16:30:14.550 INFO:tasks.workunit.client.1.smithi193.stdout:2/646: write d2/d9/db/d10/d1e/da4/fc6 [3720117,69604] 0 2024-09-04T16:30:14.556 INFO:tasks.workunit.client.1.smithi193.stdout:5/665: mkdir d1/dd0 0 2024-09-04T16:30:14.557 INFO:tasks.workunit.client.1.smithi193.stdout:1/716: creat d1/d2b/d1b/fd7 x:0 0 0 2024-09-04T16:30:14.560 INFO:tasks.workunit.client.1.smithi193.stdout:7/740: unlink d9/de/fa0 0 2024-09-04T16:30:14.561 INFO:tasks.workunit.client.0.smithi170.stdout:1/277: truncate d9/d26/f46 730335 0 2024-09-04T16:30:14.563 INFO:tasks.workunit.client.1.smithi193.stdout:9/713: sync 2024-09-04T16:30:14.564 INFO:tasks.workunit.client.1.smithi193.stdout:0/664: rename d18/d25/d32/c66 to d18/d25/d32/d57/d6d/cda 0 2024-09-04T16:30:14.565 INFO:tasks.workunit.client.1.smithi193.stdout:2/647: chown d2/d9/db/d10/d1e/d56/d59/ca1 50 1 2024-09-04T16:30:14.565 INFO:tasks.workunit.client.1.smithi193.stdout:3/648: write d0/d18/d1c/d51/d5a/f77 [2572096,58268] 0 2024-09-04T16:30:14.566 INFO:tasks.workunit.client.0.smithi170.stdout:1/278: creat d9/d26/f5a x:0 0 0 2024-09-04T16:30:14.569 INFO:tasks.workunit.client.1.smithi193.stdout:4/578: write d3/d1a/d54/f5b [1110921,119554] 0 2024-09-04T16:30:14.575 INFO:tasks.workunit.client.0.smithi170.stdout:1/279: dread d9/d11/f14 [0,4194304] 0 2024-09-04T16:30:14.578 INFO:tasks.workunit.client.0.smithi170.stdout:1/280: mkdir d9/d26/d5b 0 2024-09-04T16:30:14.584 INFO:tasks.workunit.client.0.smithi170.stdout:1/281: write d9/d11/f14 [642024,60891] 0 2024-09-04T16:30:14.590 INFO:tasks.workunit.client.0.smithi170.stdout:1/282: dwrite d9/d11/d2f/f4b [0,4194304] 0 2024-09-04T16:30:14.597 INFO:tasks.workunit.client.0.smithi170.stdout:1/283: dwrite d9/d11/f53 [0,4194304] 0 2024-09-04T16:30:14.600 INFO:tasks.workunit.client.1.smithi193.stdout:6/627: dwrite d5/de/d15/f67 [0,4194304] 0 2024-09-04T16:30:14.601 INFO:tasks.workunit.client.1.smithi193.stdout:4/579: readlink d3/d81/l9a 0 2024-09-04T16:30:14.601 INFO:tasks.workunit.client.1.smithi193.stdout:7/741: unlink d9/d11/dbd/lea 0 2024-09-04T16:30:14.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:14 smithi170 ceph-mon[29272]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:30:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:14 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3466800453' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:30:14.602 INFO:tasks.workunit.client.1.smithi193.stdout:0/665: creat d18/d79/d88/fdb x:0 0 0 2024-09-04T16:30:14.602 INFO:tasks.workunit.client.1.smithi193.stdout:5/666: dread d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f91 [0,4194304] 0 2024-09-04T16:30:14.605 INFO:tasks.workunit.client.1.smithi193.stdout:2/648: fdatasync d2/d9/d18/f4f 0 2024-09-04T16:30:14.605 INFO:tasks.workunit.client.1.smithi193.stdout:7/742: write d9/d39/fa1 [978568,64957] 0 2024-09-04T16:30:14.607 INFO:tasks.workunit.client.1.smithi193.stdout:4/580: creat d3/d3c/d89/fbe x:0 0 0 2024-09-04T16:30:14.611 INFO:tasks.workunit.client.1.smithi193.stdout:0/666: write d18/d25/d32/d57/d6c/fd1 [472204,67200] 0 2024-09-04T16:30:14.612 INFO:tasks.workunit.client.0.smithi170.stdout:1/284: dwrite d9/d11/f3a [0,4194304] 0 2024-09-04T16:30:14.613 INFO:tasks.workunit.client.1.smithi193.stdout:7/743: write d9/d18/fd1 [917320,40721] 0 2024-09-04T16:30:14.613 INFO:tasks.workunit.client.1.smithi193.stdout:5/667: creat d1/d8/db/d15/d2b/d83/fd1 x:0 0 0 2024-09-04T16:30:14.614 INFO:tasks.workunit.client.0.smithi170.stdout:1/285: read d9/f10 [6384718,109774] 0 2024-09-04T16:30:14.616 INFO:tasks.workunit.client.0.smithi170.stdout:6/228: sync 2024-09-04T16:30:14.616 INFO:tasks.workunit.client.0.smithi170.stdout:2/239: sync 2024-09-04T16:30:14.617 INFO:tasks.workunit.client.1.smithi193.stdout:1/717: dwrite d1/d2b/d10/d56/f6b [0,4194304] 0 2024-09-04T16:30:14.621 INFO:tasks.workunit.client.0.smithi170.stdout:2/240: mkdir d3/db/df/d45 0 2024-09-04T16:30:14.622 INFO:tasks.workunit.client.1.smithi193.stdout:4/581: dread d3/f35 [0,4194304] 0 2024-09-04T16:30:14.623 INFO:tasks.workunit.client.0.smithi170.stdout:1/286: dwrite d9/f18 [4194304,4194304] 0 2024-09-04T16:30:14.625 INFO:tasks.workunit.client.0.smithi170.stdout:6/229: dwrite d0/f5 [4194304,4194304] 0 2024-09-04T16:30:14.626 INFO:tasks.workunit.client.1.smithi193.stdout:5/668: mknod d1/d8/db/d15/d2b/d83/d37/cd2 0 2024-09-04T16:30:14.628 INFO:tasks.workunit.client.1.smithi193.stdout:6/628: write d5/f3f [1785936,100303] 0 2024-09-04T16:30:14.629 INFO:tasks.workunit.client.0.smithi170.stdout:2/241: dread d3/db/f2b [0,4194304] 0 2024-09-04T16:30:14.631 INFO:tasks.workunit.client.1.smithi193.stdout:7/744: dwrite d9/d18/d22/fe0 [0,4194304] 0 2024-09-04T16:30:14.631 INFO:tasks.workunit.client.1.smithi193.stdout:8/673: sync 2024-09-04T16:30:14.632 INFO:tasks.workunit.client.0.smithi170.stdout:6/230: symlink d0/d17/d39/l4c 0 2024-09-04T16:30:14.634 INFO:tasks.workunit.client.0.smithi170.stdout:2/242: creat d3/f46 x:0 0 0 2024-09-04T16:30:14.635 INFO:tasks.workunit.client.1.smithi193.stdout:3/649: dread d0/d7/de/d45/f8d [4194304,4194304] 0 2024-09-04T16:30:14.638 INFO:tasks.workunit.client.1.smithi193.stdout:4/582: creat d3/d1a/d54/db1/fbf x:0 0 0 2024-09-04T16:30:14.639 INFO:tasks.workunit.client.1.smithi193.stdout:7/745: stat d9/d18/d22/d2b/d6c/fcd 0 2024-09-04T16:30:14.639 INFO:tasks.workunit.client.1.smithi193.stdout:5/669: dread - d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/fcf zero size 2024-09-04T16:30:14.641 INFO:tasks.workunit.client.1.smithi193.stdout:3/650: write d0/d3b/fbd [833148,72242] 0 2024-09-04T16:30:14.642 INFO:tasks.workunit.client.1.smithi193.stdout:1/718: dwrite d1/d39/fce [0,4194304] 0 2024-09-04T16:30:14.642 INFO:tasks.workunit.client.1.smithi193.stdout:8/674: chown d2/d20/d23/d34/fc6 655408 1 2024-09-04T16:30:14.643 INFO:tasks.workunit.client.1.smithi193.stdout:6/629: chown d5/de/d15/d1b/d5f/f76 32174478 1 2024-09-04T16:30:14.644 INFO:tasks.workunit.client.1.smithi193.stdout:7/746: readlink d9/d18/d22/d2b/da6/le2 0 2024-09-04T16:30:14.645 INFO:tasks.workunit.client.1.smithi193.stdout:4/583: symlink d3/lc0 0 2024-09-04T16:30:14.648 INFO:tasks.workunit.client.1.smithi193.stdout:5/670: creat d1/d29/d74/d96/fd3 x:0 0 0 2024-09-04T16:30:14.648 INFO:tasks.workunit.client.1.smithi193.stdout:7/747: write d9/d18/d22/d2b/fe4 [597861,34535] 0 2024-09-04T16:30:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:14 smithi193 ceph-mon[36288]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:30:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:14 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3466800453' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:30:14.657 INFO:tasks.workunit.client.0.smithi170.stdout:1/287: write d9/f55 [1384734,85495] 0 2024-09-04T16:30:14.665 INFO:tasks.workunit.client.0.smithi170.stdout:2/243: rename d3/d3c/d24/d2c to d3/db/d1c/d47 0 2024-09-04T16:30:14.667 INFO:tasks.workunit.client.0.smithi170.stdout:2/244: mkdir d3/d3c/d40/d48 0 2024-09-04T16:30:14.667 INFO:tasks.workunit.client.0.smithi170.stdout:6/231: dread d0/d17/f1d [0,4194304] 0 2024-09-04T16:30:14.667 INFO:tasks.workunit.client.0.smithi170.stdout:2/245: readlink d3/ld 0 2024-09-04T16:30:14.668 INFO:tasks.workunit.client.0.smithi170.stdout:6/232: dread - d0/df/d1f/f2c zero size 2024-09-04T16:30:14.670 INFO:tasks.workunit.client.0.smithi170.stdout:1/288: dread d9/f27 [0,4194304] 0 2024-09-04T16:30:14.670 INFO:tasks.workunit.client.0.smithi170.stdout:2/246: mknod d3/d4/c49 0 2024-09-04T16:30:14.671 INFO:tasks.workunit.client.0.smithi170.stdout:1/289: dread - d9/d11/d2e/f52 zero size 2024-09-04T16:30:14.672 INFO:tasks.workunit.client.0.smithi170.stdout:6/233: rename d0/d17/f48 to d0/df/d1b/f4d 0 2024-09-04T16:30:14.674 INFO:tasks.workunit.client.0.smithi170.stdout:2/247: rmdir d3/d3c 39 2024-09-04T16:30:14.675 INFO:tasks.workunit.client.1.smithi193.stdout:0/667: dwrite d18/d25/d3b/f40 [0,4194304] 0 2024-09-04T16:30:14.677 INFO:tasks.workunit.client.1.smithi193.stdout:0/668: dread - d18/d25/d3b/fb7 zero size 2024-09-04T16:30:14.678 INFO:tasks.workunit.client.1.smithi193.stdout:7/748: stat d9/d18/d22/d2b/d6c/d70/d79 0 2024-09-04T16:30:14.678 INFO:tasks.workunit.client.1.smithi193.stdout:0/669: fdatasync d18/f1c 0 2024-09-04T16:30:14.678 INFO:tasks.workunit.client.0.smithi170.stdout:1/290: link d9/d11/d2f/f57 d9/d11/d2f/f5c 0 2024-09-04T16:30:14.679 INFO:tasks.workunit.client.0.smithi170.stdout:6/234: dwrite d0/df/fa [0,4194304] 0 2024-09-04T16:30:14.679 INFO:tasks.workunit.client.1.smithi193.stdout:3/651: getdents d0/d18/d1b/d3d/daf 0 2024-09-04T16:30:14.680 INFO:tasks.workunit.client.0.smithi170.stdout:1/291: dread - d9/d11/d2f/f57 zero size 2024-09-04T16:30:14.681 INFO:tasks.workunit.client.1.smithi193.stdout:5/671: creat d1/d8/db/d36/d40/d46/d84/fd4 x:0 0 0 2024-09-04T16:30:14.681 INFO:tasks.workunit.client.0.smithi170.stdout:1/292: chown d9/d11/d2e 0 1 2024-09-04T16:30:14.682 INFO:tasks.workunit.client.0.smithi170.stdout:1/293: chown d9/f47 4050 1 2024-09-04T16:30:14.682 INFO:tasks.workunit.client.1.smithi193.stdout:4/584: getdents d3/d1a/d2a/db9 0 2024-09-04T16:30:14.682 INFO:tasks.workunit.client.1.smithi193.stdout:0/670: truncate d18/d25/d3b/f40 5142899 0 2024-09-04T16:30:14.684 INFO:tasks.workunit.client.1.smithi193.stdout:8/675: dwrite d2/d20/d23/d34/fc6 [0,4194304] 0 2024-09-04T16:30:14.684 INFO:tasks.workunit.client.0.smithi170.stdout:1/294: stat d9/d11/d3e/c40 0 2024-09-04T16:30:14.684 INFO:tasks.workunit.client.0.smithi170.stdout:1/295: readlink d9/l20 0 2024-09-04T16:30:14.685 INFO:tasks.workunit.client.0.smithi170.stdout:1/296: truncate d9/f47 401195 0 2024-09-04T16:30:14.686 INFO:tasks.workunit.client.1.smithi193.stdout:7/749: mkdir d9/d39/d3e/d4d/d98/d9a/db6/df8 0 2024-09-04T16:30:14.688 INFO:tasks.workunit.client.0.smithi170.stdout:2/248: symlink d3/db/d1c/d47/l4a 0 2024-09-04T16:30:14.688 INFO:tasks.workunit.client.0.smithi170.stdout:2/249: dread - d3/f46 zero size 2024-09-04T16:30:14.689 INFO:tasks.workunit.client.1.smithi193.stdout:3/652: mknod d0/d18/d1c/d51/d7a/cd4 0 2024-09-04T16:30:14.691 INFO:tasks.workunit.client.0.smithi170.stdout:6/235: mknod d0/df/d1b/d3e/d44/c4e 0 2024-09-04T16:30:14.692 INFO:tasks.workunit.client.0.smithi170.stdout:6/236: chown d0/df/d1b 59878 1 2024-09-04T16:30:14.693 INFO:tasks.workunit.client.1.smithi193.stdout:1/719: getdents d1/d2b/d10/d56/da7 0 2024-09-04T16:30:14.695 INFO:tasks.workunit.client.1.smithi193.stdout:1/720: chown d1/d2b/d1b/d51/d6d/d89 503 1 2024-09-04T16:30:14.696 INFO:tasks.workunit.client.0.smithi170.stdout:1/297: creat d9/d11/d2e/f5d x:0 0 0 2024-09-04T16:30:14.697 INFO:tasks.workunit.client.1.smithi193.stdout:1/721: write d1/d2b/db/f9a [312321,3981] 0 2024-09-04T16:30:14.697 INFO:tasks.workunit.client.1.smithi193.stdout:3/653: dwrite d0/d18/d1c/d51/d7a/f98 [4194304,4194304] 0 2024-09-04T16:30:14.698 INFO:tasks.workunit.client.1.smithi193.stdout:4/585: symlink d3/d39/d44/lc1 0 2024-09-04T16:30:14.699 INFO:tasks.workunit.client.1.smithi193.stdout:4/586: stat f0 0 2024-09-04T16:30:14.699 INFO:tasks.workunit.client.1.smithi193.stdout:1/722: chown d1/d2b/d1b/d28/d50/d84/d97 1026685 1 2024-09-04T16:30:14.699 INFO:tasks.workunit.client.1.smithi193.stdout:4/587: chown f0 11348191 1 2024-09-04T16:30:14.701 INFO:tasks.workunit.client.1.smithi193.stdout:1/723: write d1/d39/d48/f96 [3863974,123513] 0 2024-09-04T16:30:14.702 INFO:tasks.workunit.client.1.smithi193.stdout:2/649: sync 2024-09-04T16:30:14.702 INFO:tasks.workunit.client.1.smithi193.stdout:9/714: sync 2024-09-04T16:30:14.703 INFO:tasks.workunit.client.1.smithi193.stdout:1/724: write d1/d2b/d1b/d51/dc5/fca [447342,128] 0 2024-09-04T16:30:14.703 INFO:tasks.workunit.client.0.smithi170.stdout:1/298: symlink d9/d11/d3e/l5e 0 2024-09-04T16:30:14.704 INFO:tasks.workunit.client.1.smithi193.stdout:1/725: chown d1/d2b/d10/db7 1411 1 2024-09-04T16:30:14.704 INFO:tasks.workunit.client.0.smithi170.stdout:1/299: chown l8 216207 1 2024-09-04T16:30:14.707 INFO:tasks.workunit.client.0.smithi170.stdout:2/250: rename d3/d3c/d24 to d3/db/d4b 0 2024-09-04T16:30:14.710 INFO:tasks.workunit.client.1.smithi193.stdout:3/654: rmdir d0/d9/d49 39 2024-09-04T16:30:14.711 INFO:tasks.workunit.client.1.smithi193.stdout:3/655: stat d0/d18/d1c 0 2024-09-04T16:30:14.712 INFO:tasks.workunit.client.0.smithi170.stdout:2/251: write d3/d7/f3e [370293,65520] 0 2024-09-04T16:30:14.713 INFO:tasks.workunit.client.1.smithi193.stdout:0/671: mknod d18/d25/d5f/d6a/d7b/cdc 0 2024-09-04T16:30:14.714 INFO:tasks.workunit.client.1.smithi193.stdout:9/715: rmdir d2/d8/d88 39 2024-09-04T16:30:14.715 INFO:tasks.workunit.client.1.smithi193.stdout:2/650: rmdir d2/d9/db/d10/d51 39 2024-09-04T16:30:14.717 INFO:tasks.workunit.client.1.smithi193.stdout:1/726: creat d1/d2b/d1b/d51/d6d/fd8 x:0 0 0 2024-09-04T16:30:14.718 INFO:tasks.workunit.client.0.smithi170.stdout:0/340: sync 2024-09-04T16:30:14.718 INFO:tasks.workunit.client.0.smithi170.stdout:3/156: sync 2024-09-04T16:30:14.719 INFO:tasks.workunit.client.1.smithi193.stdout:5/672: creat d1/d8/db/fd5 x:0 0 0 2024-09-04T16:30:14.720 INFO:tasks.workunit.client.0.smithi170.stdout:2/252: dwrite d3/f35 [0,4194304] 0 2024-09-04T16:30:14.721 INFO:tasks.workunit.client.1.smithi193.stdout:4/588: mknod d3/d39/cc2 0 2024-09-04T16:30:14.722 INFO:tasks.workunit.client.1.smithi193.stdout:2/651: dwrite d2/f94 [4194304,4194304] 0 2024-09-04T16:30:14.727 INFO:tasks.workunit.client.1.smithi193.stdout:7/750: write d9/de/f1a [396510,72863] 0 2024-09-04T16:30:14.727 INFO:tasks.workunit.client.1.smithi193.stdout:7/751: stat d9/d18/d22/d2b/d6c/fd3 0 2024-09-04T16:30:14.728 INFO:tasks.workunit.client.0.smithi170.stdout:2/253: read d3/d4/f37 [695276,31408] 0 2024-09-04T16:30:14.728 INFO:tasks.workunit.client.1.smithi193.stdout:7/752: fsync d9/d18/d22/d2b/d96/ff6 0 2024-09-04T16:30:14.729 INFO:tasks.workunit.client.1.smithi193.stdout:7/753: write d9/d39/f8b [176803,113154] 0 2024-09-04T16:30:14.730 INFO:tasks.workunit.client.1.smithi193.stdout:6/630: sync 2024-09-04T16:30:14.732 INFO:tasks.workunit.client.1.smithi193.stdout:7/754: read d9/d18/d22/d2b/f5f [28248,24958] 0 2024-09-04T16:30:14.733 INFO:tasks.workunit.client.0.smithi170.stdout:3/157: rename c0 to d13/d14/d1f/c2f 0 2024-09-04T16:30:14.733 INFO:tasks.workunit.client.0.smithi170.stdout:1/300: dread d9/f13 [0,4194304] 0 2024-09-04T16:30:14.734 INFO:tasks.workunit.client.0.smithi170.stdout:3/158: stat f10 0 2024-09-04T16:30:14.735 INFO:tasks.workunit.client.1.smithi193.stdout:1/727: mkdir d1/d2b/d1b/dd9 0 2024-09-04T16:30:14.736 INFO:tasks.workunit.client.1.smithi193.stdout:3/656: fdatasync d0/d18/d1b/f8b 0 2024-09-04T16:30:14.737 INFO:tasks.workunit.client.0.smithi170.stdout:0/341: link d11/f6f d11/d75/f7d 0 2024-09-04T16:30:14.737 INFO:tasks.workunit.client.0.smithi170.stdout:1/301: write d9/f55 [2286869,33721] 0 2024-09-04T16:30:14.738 INFO:tasks.workunit.client.0.smithi170.stdout:6/237: dwrite d0/d15/f26 [0,4194304] 0 2024-09-04T16:30:14.740 INFO:tasks.workunit.client.0.smithi170.stdout:2/254: symlink d3/d4/l4c 0 2024-09-04T16:30:14.740 INFO:tasks.workunit.client.0.smithi170.stdout:0/342: chown d11/d13 124 1 2024-09-04T16:30:14.741 INFO:tasks.workunit.client.1.smithi193.stdout:5/673: creat d1/d8/db/d36/d40/d46/dbe/fd6 x:0 0 0 2024-09-04T16:30:14.743 INFO:tasks.workunit.client.1.smithi193.stdout:2/652: rmdir d2/d9/db/d10/d38 39 2024-09-04T16:30:14.744 INFO:tasks.workunit.client.1.smithi193.stdout:2/653: fsync d2/d9/db/d10/f5c 0 2024-09-04T16:30:14.747 INFO:tasks.workunit.client.1.smithi193.stdout:8/676: rename d2/d20/d23/f16 to d2/d20/d23/d34/d3e/d6f/fde 0 2024-09-04T16:30:14.749 INFO:tasks.workunit.client.0.smithi170.stdout:1/302: mkdir d9/d34/d5f 0 2024-09-04T16:30:14.750 INFO:tasks.workunit.client.1.smithi193.stdout:9/716: mkdir d2/d18/d2f/d22/d30/d6a/d6e/de2 0 2024-09-04T16:30:14.751 INFO:tasks.workunit.client.1.smithi193.stdout:8/677: dread d2/d20/d23/d34/fc6 [0,4194304] 0 2024-09-04T16:30:14.752 INFO:tasks.workunit.client.0.smithi170.stdout:2/255: creat d3/d7/f4d x:0 0 0 2024-09-04T16:30:14.752 INFO:tasks.workunit.client.0.smithi170.stdout:5/140: sync 2024-09-04T16:30:14.752 INFO:tasks.workunit.client.0.smithi170.stdout:4/277: sync 2024-09-04T16:30:14.752 INFO:tasks.workunit.client.0.smithi170.stdout:7/373: sync 2024-09-04T16:30:14.752 INFO:tasks.workunit.client.0.smithi170.stdout:8/273: sync 2024-09-04T16:30:14.752 INFO:tasks.workunit.client.0.smithi170.stdout:9/260: sync 2024-09-04T16:30:14.755 INFO:tasks.workunit.client.0.smithi170.stdout:5/141: truncate d4/f2b 578042 0 2024-09-04T16:30:14.755 INFO:tasks.workunit.client.0.smithi170.stdout:6/238: dread d0/f2 [0,4194304] 0 2024-09-04T16:30:14.755 INFO:tasks.workunit.client.1.smithi193.stdout:7/755: creat d9/d39/d3e/d4d/d4f/ff9 x:0 0 0 2024-09-04T16:30:14.757 INFO:tasks.workunit.client.1.smithi193.stdout:9/717: dwrite d2/d18/d2f/d9a/fdc [0,4194304] 0 2024-09-04T16:30:14.757 INFO:tasks.workunit.client.0.smithi170.stdout:0/343: mknod d11/d13/d71/c7e 0 2024-09-04T16:30:14.760 INFO:tasks.workunit.client.0.smithi170.stdout:7/374: dwrite d12/d15/d41/f45 [0,4194304] 0 2024-09-04T16:30:14.763 INFO:tasks.workunit.client.0.smithi170.stdout:2/256: mknod d3/db/d1c/c4e 0 2024-09-04T16:30:14.771 INFO:tasks.workunit.client.0.smithi170.stdout:9/261: fsync d2/d3d/f1f 0 2024-09-04T16:30:14.773 INFO:tasks.workunit.client.1.smithi193.stdout:0/672: truncate d18/d25/d5f/d6a/f83 3513183 0 2024-09-04T16:30:14.774 INFO:tasks.workunit.client.1.smithi193.stdout:2/654: mknod d2/d9/d18/d7b/db5/cd8 0 2024-09-04T16:30:14.776 INFO:tasks.workunit.client.1.smithi193.stdout:2/655: write d2/d9/db/d10/f6e [4531647,80948] 0 2024-09-04T16:30:14.776 INFO:tasks.workunit.client.1.smithi193.stdout:3/657: rename d0/d10/fa9 to d0/d18/d1c/d6e/fd5 0 2024-09-04T16:30:14.778 INFO:tasks.workunit.client.1.smithi193.stdout:6/631: mknod d5/d27/dc6/cca 0 2024-09-04T16:30:14.779 INFO:tasks.workunit.client.1.smithi193.stdout:6/632: readlink d5/de/d15/l16 0 2024-09-04T16:30:14.779 INFO:tasks.workunit.client.1.smithi193.stdout:8/678: dread d2/d20/d23/d34/dd6/da0/da8/db9/f78 [0,4194304] 0 2024-09-04T16:30:14.786 INFO:tasks.workunit.client.1.smithi193.stdout:7/756: creat d9/d39/d3e/d4d/d98/d9a/db6/ffa x:0 0 0 2024-09-04T16:30:14.786 INFO:tasks.workunit.client.1.smithi193.stdout:7/757: chown d9/d39/d3e/d4d/fbe 771550 1 2024-09-04T16:30:14.787 INFO:tasks.workunit.client.1.smithi193.stdout:1/728: getdents d1/d2b/d1b/d51/d6d/d89/dc7 0 2024-09-04T16:30:14.788 INFO:tasks.workunit.client.1.smithi193.stdout:1/729: write d1/d39/fce [861694,18670] 0 2024-09-04T16:30:14.789 INFO:tasks.workunit.client.1.smithi193.stdout:9/718: write d2/d8/d15/fb8 [8283650,53904] 0 2024-09-04T16:30:14.790 INFO:tasks.workunit.client.1.smithi193.stdout:4/589: rmdir d3/d3c/dad 0 2024-09-04T16:30:14.791 INFO:tasks.workunit.client.1.smithi193.stdout:0/673: mknod d18/d25/d5f/d6a/d7b/cdd 0 2024-09-04T16:30:14.793 INFO:tasks.workunit.client.1.smithi193.stdout:3/658: fsync d0/f89 0 2024-09-04T16:30:14.795 INFO:tasks.workunit.client.1.smithi193.stdout:3/659: write d0/d18/d1c/d25/d5e/d90/fb8 [740299,22668] 0 2024-09-04T16:30:14.795 INFO:tasks.workunit.client.1.smithi193.stdout:5/674: rename d1/d8/db/d15 to d1/d8/db/d15/d2b/d83/d37/d3f/dd7 22 2024-09-04T16:30:14.796 INFO:tasks.workunit.client.1.smithi193.stdout:6/633: fsync d5/de/d15/d9f/fc1 0 2024-09-04T16:30:14.797 INFO:tasks.workunit.client.1.smithi193.stdout:8/679: creat d2/d20/d23/d34/d3e/fdf x:0 0 0 2024-09-04T16:30:14.799 INFO:tasks.workunit.client.1.smithi193.stdout:2/656: dread d2/d9/db/d10/f7d [0,4194304] 0 2024-09-04T16:30:14.801 INFO:tasks.workunit.client.1.smithi193.stdout:2/657: readlink d2/d9/db/d10/l32 0 2024-09-04T16:30:14.801 INFO:tasks.workunit.client.1.smithi193.stdout:1/730: chown d1/d2b/c8 1581745 1 2024-09-04T16:30:14.802 INFO:tasks.workunit.client.1.smithi193.stdout:8/680: dread d2/f31 [0,4194304] 0 2024-09-04T16:30:14.809 INFO:tasks.workunit.client.1.smithi193.stdout:3/660: creat d0/d18/d1c/d30/d8e/fd6 x:0 0 0 2024-09-04T16:30:14.809 INFO:tasks.workunit.client.1.smithi193.stdout:3/661: fdatasync d0/d18/d1b/dab/fb0 0 2024-09-04T16:30:14.810 INFO:tasks.workunit.client.1.smithi193.stdout:5/675: mkdir d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/dd8 0 2024-09-04T16:30:14.811 INFO:tasks.workunit.client.1.smithi193.stdout:6/634: creat d5/de/d15/d1b/d5f/da7/db2/fcb x:0 0 0 2024-09-04T16:30:14.813 INFO:tasks.workunit.client.1.smithi193.stdout:7/758: mkdir d9/d11/dd4/dd2/df1/dfb 0 2024-09-04T16:30:14.814 INFO:tasks.workunit.client.1.smithi193.stdout:3/662: dwrite d0/f47 [0,4194304] 0 2024-09-04T16:30:14.815 INFO:tasks.workunit.client.1.smithi193.stdout:1/731: symlink d1/d2b/d1b/d28/d50/lda 0 2024-09-04T16:30:14.816 INFO:tasks.workunit.client.1.smithi193.stdout:1/732: chown d1/d2b/d1b/d28/d50/lda 6133242 1 2024-09-04T16:30:14.816 INFO:tasks.workunit.client.1.smithi193.stdout:2/658: symlink d2/d9/db/d10/d1e/d56/ld9 0 2024-09-04T16:30:14.817 INFO:tasks.workunit.client.1.smithi193.stdout:9/719: write d2/d18/d2f/d22/d30/d6a/f79 [1086062,5530] 0 2024-09-04T16:30:14.824 INFO:tasks.workunit.client.1.smithi193.stdout:4/590: dwrite d3/d1a/d2a/d83/f75 [0,4194304] 0 2024-09-04T16:30:14.827 INFO:tasks.workunit.client.1.smithi193.stdout:4/591: dread d3/d1a/d21/d52/d5e/fa8 [0,4194304] 0 2024-09-04T16:30:14.828 INFO:tasks.workunit.client.1.smithi193.stdout:6/635: unlink d5/d27/dc6/cca 0 2024-09-04T16:30:14.829 INFO:tasks.workunit.client.1.smithi193.stdout:6/636: chown d5/f19 13 1 2024-09-04T16:30:14.830 INFO:tasks.workunit.client.1.smithi193.stdout:7/759: symlink d9/de/lfc 0 2024-09-04T16:30:14.831 INFO:tasks.workunit.client.1.smithi193.stdout:3/663: unlink d0/d18/d1c/d51/l95 0 2024-09-04T16:30:14.834 INFO:tasks.workunit.client.1.smithi193.stdout:4/592: dwrite d3/f29 [0,4194304] 0 2024-09-04T16:30:14.834 INFO:tasks.workunit.client.1.smithi193.stdout:0/674: rmdir d18/d25/d5f/d65/dd4 0 2024-09-04T16:30:14.836 INFO:tasks.workunit.client.1.smithi193.stdout:9/720: truncate d2/d18/d2f/f45 1746995 0 2024-09-04T16:30:14.837 INFO:tasks.workunit.client.1.smithi193.stdout:6/637: fsync d5/d27/d3e/d6e/fb3 0 2024-09-04T16:30:14.839 INFO:tasks.workunit.client.1.smithi193.stdout:7/760: unlink d9/d18/fd1 0 2024-09-04T16:30:14.845 INFO:tasks.workunit.client.0.smithi170.stdout:3/159: dwrite d13/f19 [0,4194304] 0 2024-09-04T16:30:14.845 INFO:tasks.workunit.client.0.smithi170.stdout:2/257: unlink d3/d4/f6 0 2024-09-04T16:30:14.848 INFO:tasks.workunit.client.0.smithi170.stdout:6/239: dread d0/f14 [0,4194304] 0 2024-09-04T16:30:14.848 INFO:tasks.workunit.client.0.smithi170.stdout:1/303: truncate d9/d11/f43 3928401 0 2024-09-04T16:30:14.849 INFO:tasks.workunit.client.0.smithi170.stdout:7/375: write d12/d16/f1f [1262405,13228] 0 2024-09-04T16:30:14.850 INFO:tasks.workunit.client.0.smithi170.stdout:8/274: mkdir d6/d28/d16/d24/d46/d55/d5d 0 2024-09-04T16:30:14.850 INFO:tasks.workunit.client.1.smithi193.stdout:1/733: dread d1/d2b/db/f82 [0,4194304] 0 2024-09-04T16:30:14.850 INFO:tasks.workunit.client.0.smithi170.stdout:6/240: chown d0/df/d1b/d3e/d44/d2d 13350 1 2024-09-04T16:30:14.853 INFO:tasks.workunit.client.0.smithi170.stdout:8/275: fdatasync d6/d28/d20/f48 0 2024-09-04T16:30:14.854 INFO:tasks.workunit.client.0.smithi170.stdout:6/241: readlink d0/df/d1f/l20 0 2024-09-04T16:30:14.854 INFO:tasks.workunit.client.0.smithi170.stdout:5/142: truncate f1 76771 0 2024-09-04T16:30:14.855 INFO:tasks.workunit.client.1.smithi193.stdout:3/664: dread d0/d18/d1b/dab/fb0 [0,4194304] 0 2024-09-04T16:30:14.858 INFO:tasks.workunit.client.1.smithi193.stdout:2/659: mknod d2/d9/db/d10/d51/dca/cda 0 2024-09-04T16:30:14.858 INFO:tasks.workunit.client.1.smithi193.stdout:6/638: creat d5/d27/d3e/d43/fcc x:0 0 0 2024-09-04T16:30:14.858 INFO:tasks.workunit.client.0.smithi170.stdout:8/276: dread - d6/d28/d1a/d2f/f5b zero size 2024-09-04T16:30:14.861 INFO:tasks.workunit.client.0.smithi170.stdout:2/258: dwrite d3/db/d1c/f42 [0,4194304] 0 2024-09-04T16:30:14.861 INFO:tasks.workunit.client.1.smithi193.stdout:4/593: dread d3/d1a/d21/f37 [0,4194304] 0 2024-09-04T16:30:14.861 INFO:tasks.workunit.client.1.smithi193.stdout:8/681: link d2/d20/d23/d51/c96 d2/d20/d23/d34/d46/d53/ce0 0 2024-09-04T16:30:14.863 INFO:tasks.workunit.client.0.smithi170.stdout:3/160: dwrite d13/d14/d1d/f27 [0,4194304] 0 2024-09-04T16:30:14.865 INFO:tasks.workunit.client.1.smithi193.stdout:4/594: write d3/d1a/d21/d52/d5e/fa8 [705826,27919] 0 2024-09-04T16:30:14.865 INFO:tasks.workunit.client.1.smithi193.stdout:9/721: mknod d2/ce3 0 2024-09-04T16:30:14.866 INFO:tasks.workunit.client.1.smithi193.stdout:8/682: dread - d2/d20/d23/d34/dd6/da0/da8/db9/f8c zero size 2024-09-04T16:30:14.867 INFO:tasks.workunit.client.0.smithi170.stdout:2/259: dread d3/d7/f3e [0,4194304] 0 2024-09-04T16:30:14.869 INFO:tasks.workunit.client.1.smithi193.stdout:6/639: dwrite d5/d27/d3e/f69 [4194304,4194304] 0 2024-09-04T16:30:14.877 INFO:tasks.workunit.client.0.smithi170.stdout:4/278: rename d1/d6/f1b to d1/d6/d2b/d33/f69 0 2024-09-04T16:30:14.882 INFO:tasks.workunit.client.1.smithi193.stdout:9/722: dread d2/d56/d86/fad [0,4194304] 0 2024-09-04T16:30:14.883 INFO:tasks.workunit.client.0.smithi170.stdout:1/304: symlink d9/d11/l60 0 2024-09-04T16:30:14.885 INFO:tasks.workunit.client.1.smithi193.stdout:2/660: unlink d2/d9/db/d10/d1f/d22/c6c 0 2024-09-04T16:30:14.889 INFO:tasks.workunit.client.1.smithi193.stdout:5/676: link d1/d8/db/d15/d2b/d83/c20 d1/d8/db/cd9 0 2024-09-04T16:30:14.892 INFO:tasks.workunit.client.1.smithi193.stdout:4/595: unlink d3/d3c/d98/ca1 0 2024-09-04T16:30:14.892 INFO:tasks.workunit.client.1.smithi193.stdout:2/661: dwrite d2/d9/db/d10/d1f/d22/f93 [0,4194304] 0 2024-09-04T16:30:14.896 INFO:tasks.workunit.client.1.smithi193.stdout:8/683: dread d2/d20/f2d [0,4194304] 0 2024-09-04T16:30:14.899 INFO:tasks.workunit.client.1.smithi193.stdout:1/734: mknod d1/d2b/d1b/d51/cdb 0 2024-09-04T16:30:14.900 INFO:tasks.workunit.client.1.smithi193.stdout:5/677: dwrite d1/d29/f59 [0,4194304] 0 2024-09-04T16:30:14.903 INFO:tasks.workunit.client.1.smithi193.stdout:1/735: write d1/d2b/d1b/d28/f9d [94030,76540] 0 2024-09-04T16:30:14.904 INFO:tasks.workunit.client.1.smithi193.stdout:6/640: dwrite d5/de/d15/d9f/fb9 [0,4194304] 0 2024-09-04T16:30:14.907 INFO:tasks.workunit.client.1.smithi193.stdout:5/678: truncate d1/d8/db/d36/fb1 952649 0 2024-09-04T16:30:14.907 INFO:tasks.workunit.client.1.smithi193.stdout:7/761: link d9/d18/d22/d2b/da6/le2 d9/d39/d3e/d4d/d98/lfd 0 2024-09-04T16:30:14.908 INFO:tasks.workunit.client.0.smithi170.stdout:9/262: rename d2/d3d/d27/d2b/c2d to d2/d11/d23/c46 0 2024-09-04T16:30:14.910 INFO:tasks.workunit.client.1.smithi193.stdout:9/723: fsync d2/d18/d2f/d22/d30/f9b 0 2024-09-04T16:30:14.911 INFO:tasks.workunit.client.0.smithi170.stdout:1/305: read d9/f22 [581365,9625] 0 2024-09-04T16:30:14.914 INFO:tasks.workunit.client.1.smithi193.stdout:0/675: truncate d18/d25/d32/d57/d6d/f72 750443 0 2024-09-04T16:30:14.919 INFO:tasks.workunit.client.1.smithi193.stdout:3/665: write d0/d18/d1c/d51/f56 [7717951,114878] 0 2024-09-04T16:30:14.924 INFO:tasks.workunit.client.1.smithi193.stdout:8/684: rename d2/d20/d23/d34/dd6/da0/da8/db9/dc2 to d2/d20/d23/d24/d3c/d65/dc8/de1 0 2024-09-04T16:30:14.925 INFO:tasks.workunit.client.0.smithi170.stdout:5/143: write d4/db/fe [2609998,87437] 0 2024-09-04T16:30:15.040 INFO:tasks.workunit.client.1.smithi193.stdout:7/762: creat d9/d39/d3e/d4d/d4f/dab/ffe x:0 0 0 2024-09-04T16:30:15.040 INFO:tasks.workunit.client.1.smithi193.stdout:5/679: write d1/d8/db/d36/d40/d46/f8b [742804,111223] 0 2024-09-04T16:30:15.042 INFO:tasks.workunit.client.0.smithi170.stdout:6/242: mknod d0/d17/c4f 0 2024-09-04T16:30:15.042 INFO:tasks.workunit.client.0.smithi170.stdout:2/260: write d3/d4/f37 [4180700,124576] 0 2024-09-04T16:30:15.043 INFO:tasks.workunit.client.1.smithi193.stdout:9/724: mkdir d2/d18/d2f/d9a/de4 0 2024-09-04T16:30:15.045 INFO:tasks.workunit.client.0.smithi170.stdout:3/161: dwrite f12 [4194304,4194304] 0 2024-09-04T16:30:15.045 INFO:tasks.workunit.client.0.smithi170.stdout:8/277: rmdir d6/d28/d40/d50 0 2024-09-04T16:30:15.045 INFO:tasks.workunit.client.0.smithi170.stdout:4/279: write d1/f19 [1513881,49465] 0 2024-09-04T16:30:15.045 INFO:tasks.workunit.client.0.smithi170.stdout:2/261: dread - d3/db/f3b zero size 2024-09-04T16:30:15.046 INFO:tasks.workunit.client.1.smithi193.stdout:5/680: dwrite d1/d29/f1d [0,4194304] 0 2024-09-04T16:30:15.047 INFO:tasks.workunit.client.0.smithi170.stdout:2/262: dread - d3/f46 zero size 2024-09-04T16:30:15.047 INFO:tasks.workunit.client.0.smithi170.stdout:3/162: fsync d13/d14/d1d/f23 0 2024-09-04T16:30:15.049 INFO:tasks.workunit.client.1.smithi193.stdout:3/666: rmdir d0/d18/d1c/d6e 39 2024-09-04T16:30:15.055 INFO:tasks.workunit.client.1.smithi193.stdout:6/641: write d5/d27/d3e/d43/d5d/d97/fbb [683973,38176] 0 2024-09-04T16:30:15.056 INFO:tasks.workunit.client.0.smithi170.stdout:6/243: chown d0/f16 3972231 1 2024-09-04T16:30:15.058 INFO:tasks.workunit.client.1.smithi193.stdout:3/667: dwrite d0/d18/d1c/d51/d5a/f77 [4194304,4194304] 0 2024-09-04T16:30:15.059 INFO:tasks.workunit.client.0.smithi170.stdout:1/306: write d9/d11/d2f/f57 [1043628,120244] 0 2024-09-04T16:30:15.061 INFO:tasks.workunit.client.1.smithi193.stdout:8/685: rename d2/d12/l2c to d2/d57/le2 0 2024-09-04T16:30:15.061 INFO:tasks.workunit.client.0.smithi170.stdout:4/280: rmdir d1/d6/d8/d20/d35/d54 39 2024-09-04T16:30:15.063 INFO:tasks.workunit.client.1.smithi193.stdout:6/642: dwrite d5/de/d15/d9f/fb9 [0,4194304] 0 2024-09-04T16:30:15.063 INFO:tasks.workunit.client.0.smithi170.stdout:3/163: unlink d13/d14/d1d/c2a 0 2024-09-04T16:30:15.063 INFO:tasks.workunit.client.0.smithi170.stdout:4/281: read d1/d6/f4f [1353063,63904] 0 2024-09-04T16:30:15.067 INFO:tasks.workunit.client.0.smithi170.stdout:7/376: rename d12/d29/d5c/f6d to d12/d15/d71/f7f 0 2024-09-04T16:30:15.068 INFO:tasks.workunit.client.0.smithi170.stdout:1/307: fsync d9/d11/f1a 0 2024-09-04T16:30:15.071 INFO:tasks.workunit.client.0.smithi170.stdout:3/164: symlink d13/d14/d17/l30 0 2024-09-04T16:30:15.076 INFO:tasks.workunit.client.0.smithi170.stdout:4/282: mknod d1/d6/d22/c6a 0 2024-09-04T16:30:15.078 INFO:tasks.workunit.client.0.smithi170.stdout:8/278: rename d6/d28/d1a/d2f to d6/d28/d20/d5e 0 2024-09-04T16:30:15.081 INFO:tasks.workunit.client.0.smithi170.stdout:7/377: dread d12/d16/d1d/f2e [0,4194304] 0 2024-09-04T16:30:15.082 INFO:tasks.workunit.client.0.smithi170.stdout:7/378: dread d12/d16/d1d/f2e [0,4194304] 0 2024-09-04T16:30:15.083 INFO:tasks.workunit.client.0.smithi170.stdout:7/379: chown d12/d4b/d51/l2b 107342404 1 2024-09-04T16:30:15.084 INFO:tasks.workunit.client.0.smithi170.stdout:5/144: getdents d4/d8/d1c/d26 0 2024-09-04T16:30:15.086 INFO:tasks.workunit.client.0.smithi170.stdout:5/145: write d4/d8/d1c/d29/f2a [776285,43798] 0 2024-09-04T16:30:15.087 INFO:tasks.workunit.client.0.smithi170.stdout:3/165: rmdir d13/d14/d21 39 2024-09-04T16:30:15.088 INFO:tasks.workunit.client.0.smithi170.stdout:2/263: link d3/db/d1c/c25 d3/db/d4b/c4f 0 2024-09-04T16:30:15.089 INFO:tasks.workunit.client.0.smithi170.stdout:1/308: dwrite d9/f13 [0,4194304] 0 2024-09-04T16:30:15.090 INFO:tasks.workunit.client.0.smithi170.stdout:2/264: write d3/f46 [99809,106855] 0 2024-09-04T16:30:15.092 INFO:tasks.workunit.client.1.smithi193.stdout:5/681: fsync d1/d8/db/d15/fa2 0 2024-09-04T16:30:15.097 INFO:tasks.workunit.client.0.smithi170.stdout:3/166: mknod d13/d14/d1d/c31 0 2024-09-04T16:30:15.100 INFO:tasks.workunit.client.1.smithi193.stdout:1/736: creat d1/d2b/d1b/d51/fdc x:0 0 0 2024-09-04T16:30:15.101 INFO:tasks.workunit.client.1.smithi193.stdout:0/676: write d18/d25/d5f/d65/f99 [678596,39424] 0 2024-09-04T16:30:15.101 INFO:tasks.workunit.client.0.smithi170.stdout:1/309: fdatasync d9/d11/f1a 0 2024-09-04T16:30:15.103 INFO:tasks.workunit.client.1.smithi193.stdout:3/668: mknod d0/d7/cd7 0 2024-09-04T16:30:15.103 INFO:tasks.workunit.client.1.smithi193.stdout:8/686: write d2/d20/dc0/f6d [1264121,83850] 0 2024-09-04T16:30:15.104 INFO:tasks.workunit.client.0.smithi170.stdout:5/146: getdents d4/d8/d1c/d26/d27 0 2024-09-04T16:30:15.105 INFO:tasks.workunit.client.0.smithi170.stdout:5/147: dread - d4/f2c zero size 2024-09-04T16:30:15.105 INFO:tasks.workunit.client.1.smithi193.stdout:0/677: dread d18/f55 [0,4194304] 0 2024-09-04T16:30:15.105 INFO:tasks.workunit.client.1.smithi193.stdout:7/763: fsync d9/de/d27/f34 0 2024-09-04T16:30:15.106 INFO:tasks.workunit.client.0.smithi170.stdout:8/279: rename d6/d28/d40 to d6/d28/d5f 0 2024-09-04T16:30:15.107 INFO:tasks.workunit.client.0.smithi170.stdout:8/280: chown d6/d28/d20 114 1 2024-09-04T16:30:15.110 INFO:tasks.workunit.client.1.smithi193.stdout:4/596: getdents d3/d39 0 2024-09-04T16:30:15.112 INFO:tasks.workunit.client.1.smithi193.stdout:1/737: symlink d1/d2b/d1b/d28/d50/ldd 0 2024-09-04T16:30:15.113 INFO:tasks.workunit.client.1.smithi193.stdout:9/725: write d2/d18/d2f/f45 [1767033,58861] 0 2024-09-04T16:30:15.117 INFO:tasks.workunit.client.1.smithi193.stdout:3/669: rename d0/d18/f3a to d0/d18/d1c/d25/d5e/d68/fd8 0 2024-09-04T16:30:15.118 INFO:tasks.workunit.client.0.smithi170.stdout:1/310: mkdir d9/d26/d5b/d61 0 2024-09-04T16:30:15.118 INFO:tasks.workunit.client.0.smithi170.stdout:1/311: chown d9/d26/d5b/d61 108596622 1 2024-09-04T16:30:15.120 INFO:tasks.workunit.client.0.smithi170.stdout:2/265: rename d3/f35 to d3/f50 0 2024-09-04T16:30:15.121 INFO:tasks.workunit.client.0.smithi170.stdout:7/380: getdents d12/d49 0 2024-09-04T16:30:15.121 INFO:tasks.workunit.client.1.smithi193.stdout:6/643: truncate d5/de/d15/d1b/f6f 2487687 0 2024-09-04T16:30:15.122 INFO:tasks.workunit.client.1.smithi193.stdout:0/678: unlink d18/d25/d32/l46 0 2024-09-04T16:30:15.123 INFO:tasks.workunit.client.0.smithi170.stdout:7/381: write d12/d29/d5c/f74 [3941791,89027] 0 2024-09-04T16:30:15.123 INFO:tasks.workunit.client.0.smithi170.stdout:3/167: rename f10 to d13/d14/f32 0 2024-09-04T16:30:15.124 INFO:tasks.workunit.client.0.smithi170.stdout:5/148: dwrite d4/f6 [0,4194304] 0 2024-09-04T16:30:15.126 INFO:tasks.workunit.client.0.smithi170.stdout:8/281: truncate d6/f41 1788819 0 2024-09-04T16:30:15.129 INFO:tasks.workunit.client.1.smithi193.stdout:2/662: getdents d2/d9/db/d10/d38/da5 0 2024-09-04T16:30:15.129 INFO:tasks.workunit.client.0.smithi170.stdout:2/266: rmdir d3/d4 39 2024-09-04T16:30:15.131 INFO:tasks.workunit.client.1.smithi193.stdout:9/726: truncate d2/d18/fa9 295205 0 2024-09-04T16:30:15.132 INFO:tasks.workunit.client.1.smithi193.stdout:3/670: symlink d0/d18/d1c/d25/ld9 0 2024-09-04T16:30:15.133 INFO:tasks.workunit.client.1.smithi193.stdout:9/727: fsync d2/d18/d2f/fc3 0 2024-09-04T16:30:15.134 INFO:tasks.workunit.client.1.smithi193.stdout:9/728: chown d2/f42 72 1 2024-09-04T16:30:15.135 INFO:tasks.workunit.client.1.smithi193.stdout:2/663: dwrite d2/d9/db/d65/f9e [0,4194304] 0 2024-09-04T16:30:15.135 INFO:tasks.workunit.client.0.smithi170.stdout:7/382: creat d12/d16/d1d/f80 x:0 0 0 2024-09-04T16:30:15.140 INFO:tasks.workunit.client.1.smithi193.stdout:6/644: unlink d5/de/d15/fb8 0 2024-09-04T16:30:15.142 INFO:tasks.workunit.client.0.smithi170.stdout:8/282: unlink d6/d28/d20/d5e/f4a 0 2024-09-04T16:30:15.144 INFO:tasks.workunit.client.1.smithi193.stdout:0/679: fdatasync d18/d25/d5f/d6a/d7b/f94 0 2024-09-04T16:30:15.145 INFO:tasks.workunit.client.0.smithi170.stdout:1/312: truncate d9/d11/f43 3492466 0 2024-09-04T16:30:15.149 INFO:tasks.workunit.client.1.smithi193.stdout:5/682: dwrite d1/dc3/f25 [0,4194304] 0 2024-09-04T16:30:15.149 INFO:tasks.workunit.client.0.smithi170.stdout:7/383: rename d12/d29 to d12/d15/d71/d42/d81 0 2024-09-04T16:30:15.152 INFO:tasks.workunit.client.1.smithi193.stdout:5/683: truncate d1/d8/db/d36/d40/d46/dbe/fba 578174 0 2024-09-04T16:30:15.153 INFO:tasks.workunit.client.0.smithi170.stdout:2/267: dwrite d3/d7/f26 [0,4194304] 0 2024-09-04T16:30:15.153 INFO:tasks.workunit.client.0.smithi170.stdout:3/168: creat d13/d14/d21/f33 x:0 0 0 2024-09-04T16:30:15.165 INFO:tasks.workunit.client.0.smithi170.stdout:8/283: rename d6/l14 to d6/d26/l60 0 2024-09-04T16:30:15.166 INFO:tasks.workunit.client.1.smithi193.stdout:8/687: truncate d2/d20/d23/d34/d3e/f50 1169306 0 2024-09-04T16:30:15.167 INFO:tasks.workunit.client.1.smithi193.stdout:7/764: creat d9/d39/d3e/fff x:0 0 0 2024-09-04T16:30:15.168 INFO:tasks.workunit.client.1.smithi193.stdout:7/765: fdatasync d9/d39/fc4 0 2024-09-04T16:30:15.170 INFO:tasks.workunit.client.1.smithi193.stdout:4/597: truncate d3/f14 2659801 0 2024-09-04T16:30:15.171 INFO:tasks.workunit.client.1.smithi193.stdout:2/664: creat d2/d9/db/d10/d51/d79/fdb x:0 0 0 2024-09-04T16:30:15.172 INFO:tasks.workunit.client.1.smithi193.stdout:2/665: write d2/d9/db/d10/d4e/fbd [1379969,47062] 0 2024-09-04T16:30:15.172 INFO:tasks.workunit.client.0.smithi170.stdout:1/313: creat d9/d34/d5f/f62 x:0 0 0 2024-09-04T16:30:15.173 INFO:tasks.workunit.client.1.smithi193.stdout:1/738: truncate d1/d2b/f31 3876565 0 2024-09-04T16:30:15.174 INFO:tasks.workunit.client.1.smithi193.stdout:6/645: symlink d5/de/d15/d1b/d5f/da7/lcd 0 2024-09-04T16:30:15.175 INFO:tasks.workunit.client.1.smithi193.stdout:6/646: truncate d5/de/d15/d9f/fc1 1087186 0 2024-09-04T16:30:15.176 INFO:tasks.workunit.client.1.smithi193.stdout:0/680: rmdir d18/d79 39 2024-09-04T16:30:15.176 INFO:tasks.workunit.client.0.smithi170.stdout:2/268: symlink d3/d4/l51 0 2024-09-04T16:30:15.177 INFO:tasks.workunit.client.0.smithi170.stdout:3/169: creat d13/d14/d1d/d2d/f34 x:0 0 0 2024-09-04T16:30:15.178 INFO:tasks.workunit.client.0.smithi170.stdout:3/170: chown d13/d14/d17/d1c 13023 1 2024-09-04T16:30:15.179 INFO:tasks.workunit.client.0.smithi170.stdout:1/314: unlink d9/d11/l60 0 2024-09-04T16:30:15.182 INFO:tasks.workunit.client.0.smithi170.stdout:8/284: mknod d6/d28/d1a/d38/c61 0 2024-09-04T16:30:15.183 INFO:tasks.workunit.client.1.smithi193.stdout:3/671: mknod d0/d9/d49/d87/cda 0 2024-09-04T16:30:15.184 INFO:tasks.workunit.client.0.smithi170.stdout:8/285: write d6/d28/d1a/f36 [317500,22848] 0 2024-09-04T16:30:15.187 INFO:tasks.workunit.client.0.smithi170.stdout:1/315: dwrite d9/d26/f56 [0,4194304] 0 2024-09-04T16:30:15.187 INFO:tasks.workunit.client.1.smithi193.stdout:8/688: mknod d2/d20/d23/d24/d3c/d65/dc8/de1/dd8/ce3 0 2024-09-04T16:30:15.188 INFO:tasks.workunit.client.1.smithi193.stdout:8/689: chown d2/d20/d23/d24/d3c/d65/f74 1141 1 2024-09-04T16:30:15.194 INFO:tasks.workunit.client.0.smithi170.stdout:2/269: rename d3/db/df/f10 to d3/d4/f52 0 2024-09-04T16:30:15.194 INFO:tasks.workunit.client.0.smithi170.stdout:8/286: rename d6/d28/d20 to d6/d28/d20/d62 22 2024-09-04T16:30:15.194 INFO:tasks.workunit.client.1.smithi193.stdout:7/766: fsync d9/d39/d95/fb1 0 2024-09-04T16:30:15.196 INFO:tasks.workunit.client.1.smithi193.stdout:7/767: read d9/d18/d22/d2b/d6c/fcd [816811,86453] 0 2024-09-04T16:30:15.197 INFO:tasks.workunit.client.0.smithi170.stdout:3/171: write d13/d14/d21/f2b [134417,112832] 0 2024-09-04T16:30:15.199 INFO:tasks.workunit.client.0.smithi170.stdout:3/172: dread - d13/d14/d21/f2e zero size 2024-09-04T16:30:15.206 INFO:tasks.workunit.client.0.smithi170.stdout:8/287: dwrite d6/d28/d20/d5e/f5c [0,4194304] 0 2024-09-04T16:30:15.206 INFO:tasks.workunit.client.0.smithi170.stdout:2/270: dwrite d3/d3c/f3a [0,4194304] 0 2024-09-04T16:30:15.213 INFO:tasks.workunit.client.0.smithi170.stdout:3/173: dwrite d13/f25 [0,4194304] 0 2024-09-04T16:30:15.214 INFO:tasks.workunit.client.0.smithi170.stdout:3/174: stat d13/d14/d1f/c29 0 2024-09-04T16:30:15.215 INFO:tasks.workunit.client.0.smithi170.stdout:3/175: chown d13/d14/d1d 1936 1 2024-09-04T16:30:15.254 INFO:tasks.workunit.client.0.smithi170.stdout:1/316: write d9/d11/d2e/f45 [4809416,59176] 0 2024-09-04T16:30:15.254 INFO:tasks.workunit.client.1.smithi193.stdout:4/598: creat d3/d3c/d98/fc3 x:0 0 0 2024-09-04T16:30:15.255 INFO:tasks.workunit.client.0.smithi170.stdout:7/384: getdents d12/d16 0 2024-09-04T16:30:15.257 INFO:tasks.workunit.client.1.smithi193.stdout:4/599: dread d3/f30 [0,4194304] 0 2024-09-04T16:30:15.262 INFO:tasks.workunit.client.1.smithi193.stdout:4/600: dwrite d3/d1a/d54/f64 [0,4194304] 0 2024-09-04T16:30:15.263 INFO:tasks.workunit.client.0.smithi170.stdout:7/385: dwrite d12/d16/d1d/f80 [0,4194304] 0 2024-09-04T16:30:15.269 INFO:tasks.workunit.client.0.smithi170.stdout:3/176: symlink d13/d14/d1f/l35 0 2024-09-04T16:30:15.271 INFO:tasks.workunit.client.1.smithi193.stdout:5/684: mkdir d1/d8/db/d15/d2b/d83/d37/d58/dc4/dda 0 2024-09-04T16:30:15.278 INFO:tasks.workunit.client.1.smithi193.stdout:8/690: stat d2/d20/l5b 0 2024-09-04T16:30:15.280 INFO:tasks.workunit.client.0.smithi170.stdout:2/271: unlink d3/l3f 0 2024-09-04T16:30:15.283 INFO:tasks.workunit.client.0.smithi170.stdout:8/288: creat d6/d28/d16/d52/f63 x:0 0 0 2024-09-04T16:30:15.284 INFO:tasks.workunit.client.0.smithi170.stdout:8/289: chown d6/d28/d16/d24/d46/d55 2749119 1 2024-09-04T16:30:15.289 INFO:tasks.workunit.client.1.smithi193.stdout:5/685: dread d1/d8/db/d15/d2b/d83/d37/d3f/d8e/f66 [0,4194304] 0 2024-09-04T16:30:15.290 INFO:tasks.workunit.client.0.smithi170.stdout:3/177: creat d13/d14/d21/f36 x:0 0 0 2024-09-04T16:30:15.294 INFO:tasks.workunit.client.0.smithi170.stdout:3/178: dread f12 [4194304,4194304] 0 2024-09-04T16:30:15.295 INFO:tasks.workunit.client.0.smithi170.stdout:3/179: readlink d13/l20 0 2024-09-04T16:30:15.296 INFO:tasks.workunit.client.0.smithi170.stdout:2/272: creat d3/d3c/d40/f53 x:0 0 0 2024-09-04T16:30:15.297 INFO:tasks.workunit.client.1.smithi193.stdout:2/666: mkdir d2/db7/ddc 0 2024-09-04T16:30:15.300 INFO:tasks.workunit.client.0.smithi170.stdout:3/180: dread f12 [4194304,4194304] 0 2024-09-04T16:30:15.308 INFO:tasks.workunit.client.1.smithi193.stdout:4/601: unlink d3/d1a/c4f 0 2024-09-04T16:30:15.310 INFO:tasks.workunit.client.0.smithi170.stdout:2/273: dread d3/d4/f21 [0,4194304] 0 2024-09-04T16:30:15.310 INFO:tasks.workunit.client.0.smithi170.stdout:2/274: dread - d3/d7/f4d zero size 2024-09-04T16:30:15.311 INFO:tasks.workunit.client.0.smithi170.stdout:2/275: fdatasync d3/f46 0 2024-09-04T16:30:15.312 INFO:tasks.workunit.client.0.smithi170.stdout:8/290: link d6/d28/d20/d5e/f3e d6/d28/d16/d52/f64 0 2024-09-04T16:30:15.314 INFO:tasks.workunit.client.0.smithi170.stdout:3/181: creat d13/d14/d1d/d2d/f37 x:0 0 0 2024-09-04T16:30:15.322 INFO:tasks.workunit.client.1.smithi193.stdout:8/691: stat d2/d20/d23/d34/d3e/d6f/d81/cb7 0 2024-09-04T16:30:15.324 INFO:tasks.workunit.client.1.smithi193.stdout:8/692: write d2/d20/d23/d34/d4b/d7c/db2/fd7 [325868,56071] 0 2024-09-04T16:30:15.327 INFO:tasks.workunit.client.0.smithi170.stdout:8/291: symlink d6/d28/d16/d24/d46/l65 0 2024-09-04T16:30:15.331 INFO:tasks.workunit.client.1.smithi193.stdout:9/729: getdents d2/d18/d2f/d22/d30/d6a/d6e/d81 0 2024-09-04T16:30:15.332 INFO:tasks.workunit.client.0.smithi170.stdout:3/182: dread d13/d14/f32 [0,4194304] 0 2024-09-04T16:30:15.335 INFO:tasks.workunit.client.0.smithi170.stdout:8/292: dwrite d6/d28/d1a/f42 [0,4194304] 0 2024-09-04T16:30:15.339 INFO:tasks.workunit.client.0.smithi170.stdout:3/183: mknod d13/d14/d1f/c38 0 2024-09-04T16:30:15.345 INFO:tasks.workunit.client.1.smithi193.stdout:3/672: link d0/l97 d0/d18/d1c/d51/d5a/ldb 0 2024-09-04T16:30:15.346 INFO:tasks.workunit.client.1.smithi193.stdout:3/673: write d0/d18/d1c/d51/fca [4495986,36650] 0 2024-09-04T16:30:15.347 INFO:tasks.workunit.client.1.smithi193.stdout:8/693: rmdir d2/d20/d23/d24/d3c 39 2024-09-04T16:30:15.349 INFO:tasks.workunit.client.1.smithi193.stdout:8/694: read d2/d20/dc0/fbf [447237,71787] 0 2024-09-04T16:30:15.349 INFO:tasks.workunit.client.1.smithi193.stdout:5/686: fsync d1/d8/db/d15/d2b/d83/d37/f67 0 2024-09-04T16:30:15.351 INFO:tasks.workunit.client.1.smithi193.stdout:9/730: creat d2/d18/d2f/d22/d30/d6a/d6e/d81/fe5 x:0 0 0 2024-09-04T16:30:15.353 INFO:tasks.workunit.client.1.smithi193.stdout:6/647: getdents d5/d33 0 2024-09-04T16:30:15.354 INFO:tasks.workunit.client.1.smithi193.stdout:4/602: mknod d3/cc4 0 2024-09-04T16:30:15.356 INFO:tasks.workunit.client.1.smithi193.stdout:3/674: creat d0/d18/d1c/d25/d5e/d90/fdc x:0 0 0 2024-09-04T16:30:15.357 INFO:tasks.workunit.client.1.smithi193.stdout:3/675: chown d0/f47 15771 1 2024-09-04T16:30:15.361 INFO:tasks.workunit.client.1.smithi193.stdout:2/667: creat d2/d9/fdd x:0 0 0 2024-09-04T16:30:15.364 INFO:tasks.workunit.client.1.smithi193.stdout:6/648: creat d5/de/d15/d1b/d5f/fce x:0 0 0 2024-09-04T16:30:15.365 INFO:tasks.workunit.client.1.smithi193.stdout:4/603: write d3/d1a/d21/f2c [1514061,61334] 0 2024-09-04T16:30:15.366 INFO:tasks.workunit.client.1.smithi193.stdout:6/649: write d5/de/f18 [1956199,42519] 0 2024-09-04T16:30:15.367 INFO:tasks.workunit.client.1.smithi193.stdout:3/676: readlink d0/d18/d1c/d6e/l71 0 2024-09-04T16:30:15.367 INFO:tasks.workunit.client.1.smithi193.stdout:2/668: dwrite d2/d9/db/d65/f9e [0,4194304] 0 2024-09-04T16:30:15.370 INFO:tasks.workunit.client.1.smithi193.stdout:5/687: creat d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/dd8/fdb x:0 0 0 2024-09-04T16:30:15.372 INFO:tasks.workunit.client.1.smithi193.stdout:1/739: creat d1/d2b/d1b/d51/d6d/fde x:0 0 0 2024-09-04T16:30:15.375 INFO:tasks.workunit.client.1.smithi193.stdout:4/604: unlink d3/d1a/d54/faf 0 2024-09-04T16:30:15.379 INFO:tasks.workunit.client.1.smithi193.stdout:5/688: symlink d1/d29/d74/d96/ldc 0 2024-09-04T16:30:15.385 INFO:tasks.workunit.client.1.smithi193.stdout:5/689: unlink d1/d8/db/d15/d2b/d83/d37/d3f/d8e/l53 0 2024-09-04T16:30:15.386 INFO:tasks.workunit.client.1.smithi193.stdout:2/669: creat d2/d9/db/d10/d1f/d4a/dc2/dc4/fde x:0 0 0 2024-09-04T16:30:15.389 INFO:tasks.workunit.client.1.smithi193.stdout:2/670: mknod d2/d9/db/d10/d51/d87/cdf 0 2024-09-04T16:30:15.390 INFO:tasks.workunit.client.1.smithi193.stdout:2/671: chown d2/d9/db/d10/d1e/d56/l97 11011616 1 2024-09-04T16:30:15.391 INFO:tasks.workunit.client.1.smithi193.stdout:5/690: dread d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/fb7 [0,4194304] 0 2024-09-04T16:30:15.394 INFO:tasks.workunit.client.1.smithi193.stdout:5/691: creat d1/d8/db/d36/d40/dc1/fdd x:0 0 0 2024-09-04T16:30:15.403 INFO:tasks.workunit.client.1.smithi193.stdout:7/768: write d9/d18/d22/d2b/f5f [1417273,65408] 0 2024-09-04T16:30:15.406 INFO:tasks.workunit.client.1.smithi193.stdout:7/769: symlink d9/d39/d3e/d4d/d4f/dab/l100 0 2024-09-04T16:30:15.406 INFO:tasks.workunit.client.0.smithi170.stdout:2/276: fsync d3/d3c/d40/f53 0 2024-09-04T16:30:15.408 INFO:tasks.workunit.client.0.smithi170.stdout:7/386: write d12/d15/d71/f3e [1773256,63435] 0 2024-09-04T16:30:15.411 INFO:tasks.workunit.client.1.smithi193.stdout:7/770: dwrite d9/d18/fed [0,4194304] 0 2024-09-04T16:30:15.411 INFO:tasks.workunit.client.0.smithi170.stdout:7/387: read d12/d15/d68/f78 [3180647,130312] 0 2024-09-04T16:30:15.413 INFO:tasks.workunit.client.0.smithi170.stdout:2/277: dwrite f2 [4194304,4194304] 0 2024-09-04T16:30:15.422 INFO:tasks.workunit.client.0.smithi170.stdout:7/388: dwrite d12/f1a [4194304,4194304] 0 2024-09-04T16:30:15.423 INFO:tasks.workunit.client.0.smithi170.stdout:7/389: chown d12/f18 3623875 1 2024-09-04T16:30:15.425 INFO:tasks.workunit.client.0.smithi170.stdout:7/390: chown d12/d15/d71/d42/d81/d5c/c63 58 1 2024-09-04T16:30:15.427 INFO:tasks.workunit.client.0.smithi170.stdout:7/391: rmdir d12/d4b 39 2024-09-04T16:30:15.428 INFO:tasks.workunit.client.0.smithi170.stdout:7/392: stat d12/d15/d71/d42/d81/f44 0 2024-09-04T16:30:15.430 INFO:tasks.workunit.client.1.smithi193.stdout:5/692: creat d1/d8/db/d36/d40/fde x:0 0 0 2024-09-04T16:30:15.432 INFO:tasks.workunit.client.1.smithi193.stdout:7/771: dread d9/d18/f4c [0,4194304] 0 2024-09-04T16:30:15.434 INFO:tasks.workunit.client.1.smithi193.stdout:5/693: creat d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/fdf x:0 0 0 2024-09-04T16:30:15.435 INFO:tasks.workunit.client.0.smithi170.stdout:7/393: dwrite d12/d15/d71/d42/d81/f44 [0,4194304] 0 2024-09-04T16:30:15.437 INFO:tasks.workunit.client.1.smithi193.stdout:5/694: chown d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f89 955 1 2024-09-04T16:30:15.437 INFO:tasks.workunit.client.1.smithi193.stdout:8/695: truncate d2/d20/d23/d34/dd6/f68 7137352 0 2024-09-04T16:30:15.438 INFO:tasks.workunit.client.1.smithi193.stdout:0/681: symlink d18/d25/d5f/d6a/lde 0 2024-09-04T16:30:15.440 INFO:tasks.workunit.client.0.smithi170.stdout:7/394: mkdir d12/d16/d1d/d65/d82 0 2024-09-04T16:30:15.443 INFO:tasks.workunit.client.0.smithi170.stdout:0/344: sync 2024-09-04T16:30:15.444 INFO:tasks.workunit.client.0.smithi170.stdout:7/395: creat d12/d15/d41/f83 x:0 0 0 2024-09-04T16:30:15.445 INFO:tasks.workunit.client.1.smithi193.stdout:5/695: dwrite d1/d8/db/d15/f30 [4194304,4194304] 0 2024-09-04T16:30:15.447 INFO:tasks.workunit.client.1.smithi193.stdout:5/696: chown d1/d8/db/d15/d2b/d83/d37/d58/d9e 105425 1 2024-09-04T16:30:15.447 INFO:tasks.workunit.client.1.smithi193.stdout:8/696: mknod d2/d20/d23/d24/d3c/dc9/ce4 0 2024-09-04T16:30:15.450 INFO:tasks.workunit.client.1.smithi193.stdout:8/697: chown d2/d20/d23/d34/d4b/d7c/db2 2561314 1 2024-09-04T16:30:15.450 INFO:tasks.workunit.client.1.smithi193.stdout:9/731: rename d2/d8/d4d/l5d to d2/d18/d2f/d22/d30/d6a/d6e/le6 0 2024-09-04T16:30:15.451 INFO:tasks.workunit.client.0.smithi170.stdout:0/345: dwrite d11/d13/f28 [4194304,4194304] 0 2024-09-04T16:30:15.453 INFO:tasks.workunit.client.1.smithi193.stdout:5/697: mkdir d1/d8/db/d15/d2b/d83/d37/d58/de0 0 2024-09-04T16:30:15.454 INFO:tasks.workunit.client.1.smithi193.stdout:3/677: dwrite d0/d10/f38 [0,4194304] 0 2024-09-04T16:30:15.457 INFO:tasks.workunit.client.1.smithi193.stdout:3/678: dread d0/d18/d1c/d25/d5e/d7e/fa7 [0,4194304] 0 2024-09-04T16:30:15.457 INFO:tasks.workunit.client.0.smithi170.stdout:7/396: mknod d12/d15/d71/c84 0 2024-09-04T16:30:15.459 INFO:tasks.workunit.client.1.smithi193.stdout:1/740: rename d1/d2b/d10/d56/da7/lcd to d1/d2b/d10/db6/ldf 0 2024-09-04T16:30:15.461 INFO:tasks.workunit.client.1.smithi193.stdout:6/650: mkdir d5/d33/d4e/d51/d71/dcf 0 2024-09-04T16:30:15.467 INFO:tasks.workunit.client.1.smithi193.stdout:9/732: unlink d2/d8/c44 0 2024-09-04T16:30:15.468 INFO:tasks.workunit.client.0.smithi170.stdout:7/397: chown d12/d15/d71/f36 131051301 1 2024-09-04T16:30:15.468 INFO:tasks.workunit.client.1.smithi193.stdout:5/698: fsync d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f6f 0 2024-09-04T16:30:15.469 INFO:tasks.workunit.client.0.smithi170.stdout:3/184: mknod d13/d14/c39 0 2024-09-04T16:30:15.472 INFO:tasks.workunit.client.0.smithi170.stdout:8/293: mkdir d6/d28/d66 0 2024-09-04T16:30:15.474 INFO:tasks.workunit.client.0.smithi170.stdout:3/185: creat d13/d14/d21/f3a x:0 0 0 2024-09-04T16:30:15.476 INFO:tasks.workunit.client.0.smithi170.stdout:7/398: link f7 d12/d16/d1d/d65/d82/f85 0 2024-09-04T16:30:15.477 INFO:tasks.workunit.client.0.smithi170.stdout:7/399: fsync d12/d15/d71/d42/d81/f44 0 2024-09-04T16:30:15.477 INFO:tasks.workunit.client.1.smithi193.stdout:2/672: dwrite d2/d9/f90 [0,4194304] 0 2024-09-04T16:30:15.477 INFO:tasks.workunit.client.1.smithi193.stdout:4/605: rename d3/d3c/d89/f97 to d3/d3c/d89/dbd/fc5 0 2024-09-04T16:30:15.479 INFO:tasks.workunit.client.1.smithi193.stdout:4/606: chown d3/d1a/d21/d52/d5e/daa 105252 1 2024-09-04T16:30:15.479 INFO:tasks.workunit.client.0.smithi170.stdout:1/317: rename d9/d11/f3a to d9/d34/f63 0 2024-09-04T16:30:15.480 INFO:tasks.workunit.client.0.smithi170.stdout:8/294: mknod d6/d28/d1a/d38/c67 0 2024-09-04T16:30:15.480 INFO:tasks.workunit.client.1.smithi193.stdout:4/607: fdatasync d3/d39/d44/f6a 0 2024-09-04T16:30:15.481 INFO:tasks.workunit.client.0.smithi170.stdout:9/263: sync 2024-09-04T16:30:15.481 INFO:tasks.workunit.client.0.smithi170.stdout:1/318: write d9/d11/f53 [906472,50452] 0 2024-09-04T16:30:15.482 INFO:tasks.workunit.client.0.smithi170.stdout:3/186: creat d13/d14/d17/d1c/f3b x:0 0 0 2024-09-04T16:30:15.484 INFO:tasks.workunit.client.0.smithi170.stdout:9/264: truncate d2/d3d/d35/f43 864090 0 2024-09-04T16:30:15.484 INFO:tasks.workunit.client.1.smithi193.stdout:8/698: truncate d2/d20/d23/d34/d3e/d6f/fde 2065647 0 2024-09-04T16:30:15.485 INFO:tasks.workunit.client.1.smithi193.stdout:2/673: dwrite d2/d9/db/d65/f6a [0,4194304] 0 2024-09-04T16:30:15.488 INFO:tasks.workunit.client.1.smithi193.stdout:6/651: dwrite d5/de/f41 [0,4194304] 0 2024-09-04T16:30:15.492 INFO:tasks.workunit.client.0.smithi170.stdout:2/278: rename d3/d4/f37 to d3/d3c/d40/d48/f54 0 2024-09-04T16:30:15.493 INFO:tasks.workunit.client.1.smithi193.stdout:2/674: dread d2/d9/db/d10/f8f [0,4194304] 0 2024-09-04T16:30:15.494 INFO:tasks.workunit.client.0.smithi170.stdout:2/279: chown d3/d7/c29 571 1 2024-09-04T16:30:15.500 INFO:tasks.workunit.client.0.smithi170.stdout:0/346: dread d11/d13/d4a/f5c [0,4194304] 0 2024-09-04T16:30:15.501 INFO:tasks.workunit.client.1.smithi193.stdout:3/679: mkdir d0/d18/d1c/d51/ddd 0 2024-09-04T16:30:15.502 INFO:tasks.workunit.client.1.smithi193.stdout:3/680: chown d0/d3b/fbd 2354 1 2024-09-04T16:30:15.505 INFO:tasks.workunit.client.0.smithi170.stdout:2/280: dwrite d3/d3c/d40/f53 [0,4194304] 0 2024-09-04T16:30:15.506 INFO:tasks.workunit.client.0.smithi170.stdout:2/281: chown d3/d7/f26 242 1 2024-09-04T16:30:15.506 INFO:tasks.workunit.client.0.smithi170.stdout:9/265: readlink d2/d32/l3b 0 2024-09-04T16:30:15.507 INFO:tasks.workunit.client.1.smithi193.stdout:7/772: dwrite d9/d39/d95/fb1 [0,4194304] 0 2024-09-04T16:30:15.509 INFO:tasks.workunit.client.0.smithi170.stdout:1/319: dread d9/d26/f46 [0,4194304] 0 2024-09-04T16:30:15.512 INFO:tasks.workunit.client.1.smithi193.stdout:1/741: rename d1/d2b/d10/d56/da7/db1/lbe to d1/d2b/d10/db7/le0 0 2024-09-04T16:30:15.513 INFO:tasks.workunit.client.1.smithi193.stdout:0/682: dwrite d18/f1d [0,4194304] 0 2024-09-04T16:30:15.514 INFO:tasks.workunit.client.1.smithi193.stdout:0/683: read - d18/d25/d3b/fb7 zero size 2024-09-04T16:30:15.516 INFO:tasks.workunit.client.1.smithi193.stdout:0/684: fdatasync d18/d25/d32/d9c/fd6 0 2024-09-04T16:30:15.517 INFO:tasks.workunit.client.1.smithi193.stdout:0/685: write d18/d25/d3b/f40 [4060037,19563] 0 2024-09-04T16:30:15.523 INFO:tasks.workunit.client.0.smithi170.stdout:0/347: creat d11/d13/d36/f7f x:0 0 0 2024-09-04T16:30:15.528 INFO:tasks.workunit.client.0.smithi170.stdout:9/266: mknod d2/d11/d23/c47 0 2024-09-04T16:30:15.531 INFO:tasks.workunit.client.0.smithi170.stdout:1/320: creat d9/d11/d2f/f64 x:0 0 0 2024-09-04T16:30:15.534 INFO:tasks.workunit.client.0.smithi170.stdout:7/400: rename d12/d15/d71/f4c to d12/d15/d71/d42/d81/d5c/f86 0 2024-09-04T16:30:15.535 INFO:tasks.workunit.client.1.smithi193.stdout:7/773: symlink d9/d39/d3e/d4d/d4f/l101 0 2024-09-04T16:30:15.538 INFO:tasks.workunit.client.1.smithi193.stdout:1/742: mknod d1/d2b/d1b/d28/d50/d84/ce1 0 2024-09-04T16:30:15.538 INFO:tasks.workunit.client.0.smithi170.stdout:3/187: getdents d13 0 2024-09-04T16:30:15.540 INFO:tasks.workunit.client.0.smithi170.stdout:2/282: symlink d3/l55 0 2024-09-04T16:30:15.542 INFO:tasks.workunit.client.1.smithi193.stdout:4/608: fdatasync d3/f14 0 2024-09-04T16:30:15.542 INFO:tasks.workunit.client.0.smithi170.stdout:9/267: rmdir d2/d3d/d35 39 2024-09-04T16:30:15.543 INFO:tasks.workunit.client.1.smithi193.stdout:7/774: dwrite d9/d39/d3e/d53/fa5 [0,4194304] 0 2024-09-04T16:30:15.543 INFO:tasks.workunit.client.1.smithi193.stdout:4/609: fsync d3/d1a/d21/f22 0 2024-09-04T16:30:15.547 INFO:tasks.workunit.client.0.smithi170.stdout:8/295: truncate d6/d28/f1d 1789510 0 2024-09-04T16:30:15.548 INFO:tasks.workunit.client.0.smithi170.stdout:0/348: symlink d11/d75/d77/l80 0 2024-09-04T16:30:15.549 INFO:tasks.workunit.client.0.smithi170.stdout:0/349: stat d11/d13/d71/l2b 0 2024-09-04T16:30:15.549 INFO:tasks.workunit.client.1.smithi193.stdout:8/699: write d2/d12/f7a [230898,66267] 0 2024-09-04T16:30:15.550 INFO:tasks.workunit.client.1.smithi193.stdout:8/700: chown d2/d20/d23/f1d 9 1 2024-09-04T16:30:15.552 INFO:tasks.workunit.client.1.smithi193.stdout:3/681: mkdir d0/d18/d1c/dde 0 2024-09-04T16:30:15.553 INFO:tasks.workunit.client.1.smithi193.stdout:3/682: write d0/d9/dae/fc6 [370614,121887] 0 2024-09-04T16:30:15.556 INFO:tasks.workunit.client.0.smithi170.stdout:7/401: rename d12/d5a/c5f to d12/d16/d1d/c87 0 2024-09-04T16:30:15.557 INFO:tasks.workunit.client.0.smithi170.stdout:2/283: dwrite d3/d3c/d40/d48/f54 [0,4194304] 0 2024-09-04T16:30:15.557 INFO:tasks.workunit.client.1.smithi193.stdout:1/743: rename d1/d2b/d1b/d51/dc5 to d1/d2b/d1b/d28/d50/d84/dd1/de2 0 2024-09-04T16:30:15.562 INFO:tasks.workunit.client.0.smithi170.stdout:3/188: symlink d13/d14/l3c 0 2024-09-04T16:30:15.563 INFO:tasks.workunit.client.0.smithi170.stdout:3/189: chown d13/f1a 828780111 1 2024-09-04T16:30:15.565 INFO:tasks.workunit.client.0.smithi170.stdout:7/402: dwrite d12/d15/d71/f36 [0,4194304] 0 2024-09-04T16:30:15.565 INFO:tasks.workunit.client.0.smithi170.stdout:9/268: mknod d2/d3d/c48 0 2024-09-04T16:30:15.566 INFO:tasks.workunit.client.0.smithi170.stdout:3/190: chown d13/d14/d21/f2b 3628 1 2024-09-04T16:30:15.567 INFO:tasks.workunit.client.0.smithi170.stdout:3/191: write d13/f25 [1426715,113634] 0 2024-09-04T16:30:15.567 INFO:tasks.workunit.client.1.smithi193.stdout:7/775: creat d9/d18/d22/d2b/d6c/f102 x:0 0 0 2024-09-04T16:30:15.568 INFO:tasks.workunit.client.1.smithi193.stdout:7/776: write d9/d39/d3e/d4d/d98/d9a/db6/ffa [128333,48119] 0 2024-09-04T16:30:15.570 INFO:tasks.workunit.client.0.smithi170.stdout:0/350: rename d11/d13/d36/f7f to d11/d75/d77/f81 0 2024-09-04T16:30:15.573 INFO:tasks.workunit.client.0.smithi170.stdout:2/284: symlink d3/d3c/d40/l56 0 2024-09-04T16:30:15.574 INFO:tasks.workunit.client.0.smithi170.stdout:2/285: read - d3/db/f3b zero size 2024-09-04T16:30:15.575 INFO:tasks.workunit.client.1.smithi193.stdout:0/686: creat d18/d25/d5f/d65/dc4/dd5/fdf x:0 0 0 2024-09-04T16:30:15.576 INFO:tasks.workunit.client.0.smithi170.stdout:8/296: link d6/d28/d20/f48 d6/d28/d20/d5e/f68 0 2024-09-04T16:30:15.578 INFO:tasks.workunit.client.1.smithi193.stdout:9/733: getdents d2 0 2024-09-04T16:30:15.579 INFO:tasks.workunit.client.1.smithi193.stdout:9/734: write d2/f98 [8801862,59584] 0 2024-09-04T16:30:15.581 INFO:tasks.workunit.client.0.smithi170.stdout:2/286: dwrite d3/d3c/d40/f53 [0,4194304] 0 2024-09-04T16:30:15.582 INFO:tasks.workunit.client.0.smithi170.stdout:7/403: fsync d12/d15/d68/f78 0 2024-09-04T16:30:15.582 INFO:tasks.workunit.client.0.smithi170.stdout:2/287: fdatasync d3/d3c/f3a 0 2024-09-04T16:30:15.583 INFO:tasks.workunit.client.1.smithi193.stdout:5/699: getdents d1/d29/d74 0 2024-09-04T16:30:15.586 INFO:tasks.workunit.client.1.smithi193.stdout:8/701: mknod d2/d20/d23/d34/dd6/ce5 0 2024-09-04T16:30:15.588 INFO:tasks.workunit.client.0.smithi170.stdout:3/192: mkdir d13/d14/d1d/d2d/d3d 0 2024-09-04T16:30:15.589 INFO:tasks.workunit.client.1.smithi193.stdout:3/683: mknod d0/d18/d1c/d51/d6c/cdf 0 2024-09-04T16:30:15.593 INFO:tasks.workunit.client.1.smithi193.stdout:3/684: dread d0/d18/d1c/d51/d5a/fa3 [0,4194304] 0 2024-09-04T16:30:15.594 INFO:tasks.workunit.client.1.smithi193.stdout:3/685: stat d0/c7f 0 2024-09-04T16:30:15.595 INFO:tasks.workunit.client.0.smithi170.stdout:8/297: mknod d6/d28/d16/d24/d46/d55/c69 0 2024-09-04T16:30:15.599 INFO:tasks.workunit.client.1.smithi193.stdout:0/687: write d18/f19 [4451770,113653] 0 2024-09-04T16:30:15.600 INFO:tasks.workunit.client.1.smithi193.stdout:5/700: dread d1/d8/f2d [0,4194304] 0 2024-09-04T16:30:15.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:15 smithi170 ceph-mon[29272]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:30:15.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:15 smithi170 ceph-mon[29272]: pgmap v27: 65 pgs: 65 active+clean; 1.8 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 64 MiB/s rd, 265 MiB/s wr, 500 op/s 2024-09-04T16:30:15.602 INFO:tasks.workunit.client.1.smithi193.stdout:6/652: getdents d5/d27/d3e/d8c 0 2024-09-04T16:30:15.603 INFO:tasks.workunit.client.1.smithi193.stdout:6/653: write d5/de/d15/d1b/d5f/fce [726680,8942] 0 2024-09-04T16:30:15.604 INFO:tasks.workunit.client.1.smithi193.stdout:1/744: symlink d1/d2b/d1b/d51/d6d/d89/dc7/le3 0 2024-09-04T16:30:15.605 INFO:tasks.workunit.client.1.smithi193.stdout:6/654: fsync d5/de/f18 0 2024-09-04T16:30:15.605 INFO:tasks.workunit.client.1.smithi193.stdout:5/701: dread d1/d29/f1d [0,4194304] 0 2024-09-04T16:30:15.607 INFO:tasks.workunit.client.1.smithi193.stdout:4/610: creat d3/d3c/d47/fc6 x:0 0 0 2024-09-04T16:30:15.608 INFO:tasks.workunit.client.0.smithi170.stdout:2/288: mknod d3/db/d4b/d44/c57 0 2024-09-04T16:30:15.609 INFO:tasks.workunit.client.0.smithi170.stdout:9/269: link d2/d3d/d27/d2b/d34/f45 d2/d3d/d27/d2b/d34/f49 0 2024-09-04T16:30:15.611 INFO:tasks.workunit.client.1.smithi193.stdout:1/745: dwrite d1/d2b/d10/fa5 [0,4194304] 0 2024-09-04T16:30:15.616 INFO:tasks.workunit.client.0.smithi170.stdout:7/404: rename d12/d16/d1d/f47 to d12/f88 0 2024-09-04T16:30:15.616 INFO:tasks.workunit.client.0.smithi170.stdout:0/351: truncate d11/d13/d36/f40 350875 0 2024-09-04T16:30:15.616 INFO:tasks.workunit.client.1.smithi193.stdout:9/735: creat d2/d8/d25/dcb/fe7 x:0 0 0 2024-09-04T16:30:15.618 INFO:tasks.workunit.client.1.smithi193.stdout:0/688: write d18/d25/d5f/d6a/d7b/f96 [266943,33007] 0 2024-09-04T16:30:15.619 INFO:tasks.workunit.client.0.smithi170.stdout:9/270: mknod d2/d11/c4a 0 2024-09-04T16:30:15.620 INFO:tasks.workunit.client.0.smithi170.stdout:9/271: chown d2/d32/c3c 123 1 2024-09-04T16:30:15.621 INFO:tasks.workunit.client.0.smithi170.stdout:9/272: stat d2/d11/d23 0 2024-09-04T16:30:15.621 INFO:tasks.workunit.client.1.smithi193.stdout:9/736: read d2/d8/f55 [1445467,117066] 0 2024-09-04T16:30:15.621 INFO:tasks.workunit.client.0.smithi170.stdout:8/298: link d6/d28/d16/d24/d46/d55/c69 d6/c6a 0 2024-09-04T16:30:15.623 INFO:tasks.workunit.client.1.smithi193.stdout:7/777: truncate d9/d18/d22/d2b/f91 1413386 0 2024-09-04T16:30:15.625 INFO:tasks.workunit.client.1.smithi193.stdout:3/686: dwrite d0/d18/d1c/d30/f4e [4194304,4194304] 0 2024-09-04T16:30:15.625 INFO:tasks.workunit.client.0.smithi170.stdout:3/193: rename ff to d13/d14/d1f/f3e 0 2024-09-04T16:30:15.626 INFO:tasks.workunit.client.0.smithi170.stdout:3/194: dread - d13/d14/d21/f2e zero size 2024-09-04T16:30:15.627 INFO:tasks.workunit.client.0.smithi170.stdout:7/405: creat d12/d16/d1d/d65/f89 x:0 0 0 2024-09-04T16:30:15.630 INFO:tasks.workunit.client.1.smithi193.stdout:5/702: rmdir d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb 39 2024-09-04T16:30:15.633 INFO:tasks.workunit.client.1.smithi193.stdout:4/611: symlink d3/d1a/d54/lc7 0 2024-09-04T16:30:15.635 INFO:tasks.workunit.client.1.smithi193.stdout:0/689: mknod d18/d25/d32/dce/ce0 0 2024-09-04T16:30:15.636 INFO:tasks.workunit.client.0.smithi170.stdout:9/273: dread d2/d3d/f10 [0,4194304] 0 2024-09-04T16:30:15.637 INFO:tasks.workunit.client.1.smithi193.stdout:0/690: read d18/d25/d5f/d6a/d7b/f96 [177926,117885] 0 2024-09-04T16:30:15.642 INFO:tasks.workunit.client.1.smithi193.stdout:7/778: unlink d9/d18/d22/d2b/d6c/d70/d79/ce5 0 2024-09-04T16:30:15.644 INFO:tasks.workunit.client.1.smithi193.stdout:7/779: read d9/de/d27/f67 [46343,64176] 0 2024-09-04T16:30:15.645 INFO:tasks.workunit.client.1.smithi193.stdout:7/780: write d9/d39/d3e/fff [315438,44887] 0 2024-09-04T16:30:15.649 INFO:tasks.workunit.client.0.smithi170.stdout:7/406: mknod d12/d15/d71/d42/d79/c8a 0 2024-09-04T16:30:15.650 INFO:tasks.workunit.client.0.smithi170.stdout:7/407: chown d12/d15/d71/f36 7 1 2024-09-04T16:30:15.651 INFO:tasks.workunit.client.0.smithi170.stdout:0/352: write d11/d13/f46 [281661,2061] 0 2024-09-04T16:30:15.652 INFO:tasks.workunit.client.0.smithi170.stdout:2/289: getdents d3/d7 0 2024-09-04T16:30:15.654 INFO:tasks.workunit.client.1.smithi193.stdout:4/612: chown d3/d1a/d21/d52/c80 8433339 1 2024-09-04T16:30:15.654 INFO:tasks.workunit.client.0.smithi170.stdout:8/299: link d6/d28/d1a/l2a d6/d26/l6b 0 2024-09-04T16:30:15.655 INFO:tasks.workunit.client.1.smithi193.stdout:6/655: dwrite d5/de/d15/d48/f65 [0,4194304] 0 2024-09-04T16:30:15.655 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:15 smithi193 ceph-mon[36288]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:30:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:15 smithi193 ceph-mon[36288]: pgmap v27: 65 pgs: 65 active+clean; 1.8 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 64 MiB/s rd, 265 MiB/s wr, 500 op/s 2024-09-04T16:30:15.656 INFO:tasks.workunit.client.1.smithi193.stdout:1/746: unlink d1/d2b/d1b/l69 0 2024-09-04T16:30:15.657 INFO:tasks.workunit.client.0.smithi170.stdout:2/290: dread d3/d3c/d40/f53 [0,4194304] 0 2024-09-04T16:30:15.657 INFO:tasks.workunit.client.1.smithi193.stdout:1/747: fsync d1/d39/d48/f96 0 2024-09-04T16:30:15.659 INFO:tasks.workunit.client.0.smithi170.stdout:7/408: fdatasync d12/d15/d71/d42/f60 0 2024-09-04T16:30:15.660 INFO:tasks.workunit.client.1.smithi193.stdout:9/737: write d2/d18/d2f/d22/d30/f9b [965195,1795] 0 2024-09-04T16:30:15.661 INFO:tasks.workunit.client.1.smithi193.stdout:0/691: creat d18/d25/d32/dce/fe1 x:0 0 0 2024-09-04T16:30:15.661 INFO:tasks.workunit.client.1.smithi193.stdout:9/738: write d2/d18/fbd [1068873,83552] 0 2024-09-04T16:30:15.663 INFO:tasks.workunit.client.0.smithi170.stdout:0/353: symlink d11/d13/d35/l82 0 2024-09-04T16:30:15.665 INFO:tasks.workunit.client.1.smithi193.stdout:8/702: getdents d2/d20/d23/d1b/d4e 0 2024-09-04T16:30:15.665 INFO:tasks.workunit.client.1.smithi193.stdout:0/692: dread d18/d25/d32/d9c/da9/fd2 [0,4194304] 0 2024-09-04T16:30:15.665 INFO:tasks.workunit.client.1.smithi193.stdout:8/703: chown d2/d12/f7a 72596561 1 2024-09-04T16:30:15.667 INFO:tasks.workunit.client.0.smithi170.stdout:3/195: link d13/d14/d1f/c29 d13/d14/c3f 0 2024-09-04T16:30:15.669 INFO:tasks.workunit.client.0.smithi170.stdout:2/291: symlink d3/db/l58 0 2024-09-04T16:30:15.671 INFO:tasks.workunit.client.1.smithi193.stdout:0/693: dwrite d18/d25/d32/dce/fe1 [0,4194304] 0 2024-09-04T16:30:15.671 INFO:tasks.workunit.client.0.smithi170.stdout:3/196: truncate d13/d14/d1d/d2d/f37 705115 0 2024-09-04T16:30:15.672 INFO:tasks.workunit.client.1.smithi193.stdout:5/703: mkdir d1/d8/db/de1 0 2024-09-04T16:30:15.672 INFO:tasks.workunit.client.1.smithi193.stdout:0/694: chown d18/d25/d5f/d6a/d7b/fac 1649 1 2024-09-04T16:30:15.673 INFO:tasks.workunit.client.0.smithi170.stdout:9/274: dwrite d2/d3d/d27/d2b/d34/f45 [4194304,4194304] 0 2024-09-04T16:30:15.674 INFO:tasks.workunit.client.0.smithi170.stdout:3/197: write d13/d14/d21/f3a [735612,100988] 0 2024-09-04T16:30:15.675 INFO:tasks.workunit.client.0.smithi170.stdout:7/409: truncate d12/f30 2383698 0 2024-09-04T16:30:15.677 INFO:tasks.workunit.client.0.smithi170.stdout:2/292: dread d3/d3c/d40/d48/f54 [0,4194304] 0 2024-09-04T16:30:15.678 INFO:tasks.workunit.client.1.smithi193.stdout:4/613: mknod d3/d3c/d89/cc8 0 2024-09-04T16:30:15.679 INFO:tasks.workunit.client.0.smithi170.stdout:8/300: write d6/d28/d20/d5e/f68 [272413,29196] 0 2024-09-04T16:30:15.679 INFO:tasks.workunit.client.0.smithi170.stdout:0/354: creat d11/d13/d4a/d66/f83 x:0 0 0 2024-09-04T16:30:15.682 INFO:tasks.workunit.client.0.smithi170.stdout:0/355: write d11/d13/d36/f7a [917669,84544] 0 2024-09-04T16:30:15.682 INFO:tasks.workunit.client.1.smithi193.stdout:6/656: creat d5/de/d15/d1b/d5f/fd0 x:0 0 0 2024-09-04T16:30:15.683 INFO:tasks.workunit.client.1.smithi193.stdout:6/657: chown d5/d33/d4e/d51/f7e 58 1 2024-09-04T16:30:15.688 INFO:tasks.workunit.client.0.smithi170.stdout:3/198: mkdir d13/d14/d1f/d40 0 2024-09-04T16:30:15.689 INFO:tasks.workunit.client.0.smithi170.stdout:3/199: rename d13/d14 to d13/d14/d21/d41 22 2024-09-04T16:30:15.691 INFO:tasks.workunit.client.1.smithi193.stdout:9/739: symlink d2/d8/d4d/le8 0 2024-09-04T16:30:15.694 INFO:tasks.workunit.client.1.smithi193.stdout:7/781: symlink d9/d18/d22/d2b/d6c/d70/df5/l103 0 2024-09-04T16:30:15.695 INFO:tasks.workunit.client.0.smithi170.stdout:3/200: creat d13/d14/d17/f42 x:0 0 0 2024-09-04T16:30:15.696 INFO:tasks.workunit.client.0.smithi170.stdout:3/201: chown d13/l20 13163 1 2024-09-04T16:30:15.697 INFO:tasks.workunit.client.0.smithi170.stdout:3/202: fdatasync d13/d14/d17/f42 0 2024-09-04T16:30:15.699 INFO:tasks.workunit.client.0.smithi170.stdout:0/356: creat d11/d13/d2f/f84 x:0 0 0 2024-09-04T16:30:15.699 INFO:tasks.workunit.client.0.smithi170.stdout:3/203: dread d13/d14/d1d/d2d/f37 [0,4194304] 0 2024-09-04T16:30:15.700 INFO:tasks.workunit.client.0.smithi170.stdout:0/357: write d11/d13/d71/f5f [2404384,8291] 0 2024-09-04T16:30:15.701 INFO:tasks.workunit.client.0.smithi170.stdout:0/358: chown d11/d13/d4a/d66/d6d 2 1 2024-09-04T16:30:15.702 INFO:tasks.workunit.client.1.smithi193.stdout:8/704: dread d2/f2e [0,4194304] 0 2024-09-04T16:30:15.703 INFO:tasks.workunit.client.1.smithi193.stdout:5/704: symlink d1/d8/db/d36/d40/d46/dbe/le2 0 2024-09-04T16:30:15.704 INFO:tasks.workunit.client.0.smithi170.stdout:8/301: dread d6/f41 [0,4194304] 0 2024-09-04T16:30:15.705 INFO:tasks.workunit.client.0.smithi170.stdout:7/410: dread fc [0,4194304] 0 2024-09-04T16:30:15.706 INFO:tasks.workunit.client.0.smithi170.stdout:7/411: chown d12/d15/d71 62273 1 2024-09-04T16:30:15.706 INFO:tasks.workunit.client.1.smithi193.stdout:1/748: symlink d1/d2b/d1b/da0/le4 0 2024-09-04T16:30:15.707 INFO:tasks.workunit.client.0.smithi170.stdout:3/204: write d13/d14/d1d/f28 [232500,9518] 0 2024-09-04T16:30:15.709 INFO:tasks.workunit.client.0.smithi170.stdout:9/275: getdents d2/d3d/d27/d2b/d34 0 2024-09-04T16:30:15.711 INFO:tasks.workunit.client.0.smithi170.stdout:3/205: dread - d13/d14/d21/f33 zero size 2024-09-04T16:30:15.712 INFO:tasks.workunit.client.0.smithi170.stdout:0/359: symlink d11/d13/d36/l85 0 2024-09-04T16:30:15.712 INFO:tasks.workunit.client.1.smithi193.stdout:3/687: getdents d0/d18/d1c/d25/d5e/d90 0 2024-09-04T16:30:15.713 INFO:tasks.workunit.client.1.smithi193.stdout:8/705: dread - d2/d20/d23/d34/dd6/da0/da8/db9/fab zero size 2024-09-04T16:30:15.714 INFO:tasks.workunit.client.0.smithi170.stdout:3/206: fsync d13/d14/d21/f3a 0 2024-09-04T16:30:15.714 INFO:tasks.workunit.client.0.smithi170.stdout:8/302: dwrite d6/d28/d16/d52/f63 [0,4194304] 0 2024-09-04T16:30:15.716 INFO:tasks.workunit.client.0.smithi170.stdout:2/293: dwrite d3/d7/f1d [0,4194304] 0 2024-09-04T16:30:15.717 INFO:tasks.workunit.client.0.smithi170.stdout:2/294: readlink d3/d4/l2e 0 2024-09-04T16:30:15.723 INFO:tasks.workunit.client.0.smithi170.stdout:2/295: dread d3/db/f2b [0,4194304] 0 2024-09-04T16:30:15.725 INFO:tasks.workunit.client.1.smithi193.stdout:9/740: creat d2/d18/d2f/d22/d30/d6a/d6e/de2/fe9 x:0 0 0 2024-09-04T16:30:15.727 INFO:tasks.workunit.client.1.smithi193.stdout:7/782: truncate d9/d39/d3e/d69/ff7 3977377 0 2024-09-04T16:30:15.728 INFO:tasks.workunit.client.1.smithi193.stdout:7/783: chown d9/d39/d3e/d4d/d4f/fb4 22095198 1 2024-09-04T16:30:15.729 INFO:tasks.workunit.client.1.smithi193.stdout:3/688: symlink d0/d18/d1c/d30/le0 0 2024-09-04T16:30:15.730 INFO:tasks.workunit.client.0.smithi170.stdout:0/360: symlink d11/l86 0 2024-09-04T16:30:15.732 INFO:tasks.workunit.client.0.smithi170.stdout:2/296: unlink d3/db/df/l1e 0 2024-09-04T16:30:15.735 INFO:tasks.workunit.client.1.smithi193.stdout:8/706: unlink d2/d20/d23/d24/d3c/fd1 0 2024-09-04T16:30:15.737 INFO:tasks.workunit.client.1.smithi193.stdout:8/707: truncate d2/d20/d23/d34/d3e/d6f/d81/fa4 988033 0 2024-09-04T16:30:15.738 INFO:tasks.workunit.client.1.smithi193.stdout:8/708: write d2/d20/d23/d34/d3e/d6f/d81/faa [1026582,109201] 0 2024-09-04T16:30:15.739 INFO:tasks.workunit.client.0.smithi170.stdout:2/297: creat d3/db/d4b/f59 x:0 0 0 2024-09-04T16:30:15.739 INFO:tasks.workunit.client.0.smithi170.stdout:4/283: sync 2024-09-04T16:30:15.739 INFO:tasks.workunit.client.0.smithi170.stdout:6/244: sync 2024-09-04T16:30:15.740 INFO:tasks.workunit.client.0.smithi170.stdout:5/149: sync 2024-09-04T16:30:15.740 INFO:tasks.workunit.client.0.smithi170.stdout:5/150: readlink d4/d8/l11 0 2024-09-04T16:30:15.740 INFO:tasks.workunit.client.1.smithi193.stdout:5/705: truncate d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f41 4355154 0 2024-09-04T16:30:15.740 INFO:tasks.workunit.client.1.smithi193.stdout:8/709: write d2/d20/d23/d34/d3e/d6f/d81/fa4 [1495559,37172] 0 2024-09-04T16:30:15.741 INFO:tasks.workunit.client.0.smithi170.stdout:6/245: read d0/d15/f26 [1258987,101579] 0 2024-09-04T16:30:15.741 INFO:tasks.workunit.client.0.smithi170.stdout:3/207: rename l11 to d13/d14/l43 0 2024-09-04T16:30:15.742 INFO:tasks.workunit.client.1.smithi193.stdout:1/749: truncate d1/d2b/f2e 1922547 0 2024-09-04T16:30:15.743 INFO:tasks.workunit.client.0.smithi170.stdout:0/361: link d11/d75/f7b d11/d75/d77/f87 0 2024-09-04T16:30:15.745 INFO:tasks.workunit.client.1.smithi193.stdout:9/741: creat d2/d56/d86/fea x:0 0 0 2024-09-04T16:30:15.748 INFO:tasks.workunit.client.1.smithi193.stdout:7/784: symlink d9/d11/dd4/l104 0 2024-09-04T16:30:15.749 INFO:tasks.workunit.client.1.smithi193.stdout:2/675: sync 2024-09-04T16:30:15.750 INFO:tasks.workunit.client.1.smithi193.stdout:3/689: dread d0/d7/fa6 [0,4194304] 0 2024-09-04T16:30:15.751 INFO:tasks.workunit.client.1.smithi193.stdout:9/742: dwrite d2/d18/d2f/d9a/fc7 [0,4194304] 0 2024-09-04T16:30:15.752 INFO:tasks.workunit.client.1.smithi193.stdout:6/658: getdents d5/d33/d4e 0 2024-09-04T16:30:15.752 INFO:tasks.workunit.client.1.smithi193.stdout:6/659: stat d5/f44 0 2024-09-04T16:30:15.753 INFO:tasks.workunit.client.0.smithi170.stdout:8/303: truncate d6/f4f 1212904 0 2024-09-04T16:30:15.754 INFO:tasks.workunit.client.1.smithi193.stdout:9/743: read d2/d8/d15/f34 [3853887,107137] 0 2024-09-04T16:30:15.757 INFO:tasks.workunit.client.0.smithi170.stdout:3/208: dread d13/d14/d1d/d2d/f37 [0,4194304] 0 2024-09-04T16:30:15.759 INFO:tasks.workunit.client.1.smithi193.stdout:5/706: creat d1/d8/db/d15/d2b/d83/d37/d58/fe3 x:0 0 0 2024-09-04T16:30:15.759 INFO:tasks.workunit.client.0.smithi170.stdout:8/304: dread d6/d28/d1a/f36 [0,4194304] 0 2024-09-04T16:30:15.760 INFO:tasks.workunit.client.1.smithi193.stdout:5/707: write d1/d8/db/d36/d40/d46/d84/fa3 [1561576,110197] 0 2024-09-04T16:30:15.761 INFO:tasks.workunit.client.0.smithi170.stdout:0/362: creat d11/d13/d4a/f88 x:0 0 0 2024-09-04T16:30:15.761 INFO:tasks.workunit.client.1.smithi193.stdout:5/708: chown d1/d8/db/d15/d2b/d83/la5 123714 1 2024-09-04T16:30:15.763 INFO:tasks.workunit.client.0.smithi170.stdout:2/298: mknod d3/db/df/d45/c5a 0 2024-09-04T16:30:15.764 INFO:tasks.workunit.client.0.smithi170.stdout:2/299: chown d3/db/d1c/f42 5437 1 2024-09-04T16:30:15.768 INFO:tasks.workunit.client.0.smithi170.stdout:5/151: unlink f1 0 2024-09-04T16:30:15.768 INFO:tasks.workunit.client.0.smithi170.stdout:2/300: read d3/d4/f20 [4881463,46379] 0 2024-09-04T16:30:15.769 INFO:tasks.workunit.client.1.smithi193.stdout:2/676: symlink d2/d9/db/d10/d1e/d56/le0 0 2024-09-04T16:30:15.769 INFO:tasks.workunit.client.1.smithi193.stdout:2/677: chown d2/d9/db/d10/d1e/da4/d9a 2335958 1 2024-09-04T16:30:15.775 INFO:tasks.workunit.client.0.smithi170.stdout:3/209: symlink d13/d14/d21/l44 0 2024-09-04T16:30:15.776 INFO:tasks.workunit.client.1.smithi193.stdout:9/744: rmdir d2/d8/d25/dcb 39 2024-09-04T16:30:15.779 INFO:tasks.workunit.client.0.smithi170.stdout:5/152: symlink d4/l2d 0 2024-09-04T16:30:15.780 INFO:tasks.workunit.client.0.smithi170.stdout:5/153: write d4/f6 [2612695,130643] 0 2024-09-04T16:30:15.781 INFO:tasks.workunit.client.0.smithi170.stdout:5/154: write d4/f2c [1006308,33972] 0 2024-09-04T16:30:15.781 INFO:tasks.workunit.client.0.smithi170.stdout:2/301: creat d3/d3c/d40/d48/f5b x:0 0 0 2024-09-04T16:30:15.783 INFO:tasks.workunit.client.0.smithi170.stdout:4/284: creat d1/d6/d8/d20/d35/f6b x:0 0 0 2024-09-04T16:30:15.784 INFO:tasks.workunit.client.0.smithi170.stdout:4/285: read - d1/d6/d2b/d33/f4d zero size 2024-09-04T16:30:15.785 INFO:tasks.workunit.client.0.smithi170.stdout:4/286: fdatasync d1/d6/d8/f44 0 2024-09-04T16:30:15.786 INFO:tasks.workunit.client.0.smithi170.stdout:4/287: stat d1/l41 0 2024-09-04T16:30:15.786 INFO:tasks.workunit.client.1.smithi193.stdout:5/709: creat d1/d8/db/d15/d2b/d83/d37/d58/dc4/fe4 x:0 0 0 2024-09-04T16:30:15.787 INFO:tasks.workunit.client.1.smithi193.stdout:5/710: readlink d1/l71 0 2024-09-04T16:30:15.788 INFO:tasks.workunit.client.0.smithi170.stdout:3/210: symlink d13/d14/d1d/l45 0 2024-09-04T16:30:15.789 INFO:tasks.workunit.client.0.smithi170.stdout:3/211: readlink d13/d14/d1d/l45 0 2024-09-04T16:30:15.791 INFO:tasks.workunit.client.0.smithi170.stdout:0/363: truncate d11/d13/d2f/f31 3862618 0 2024-09-04T16:30:15.792 INFO:tasks.workunit.client.1.smithi193.stdout:2/678: creat d2/d9/d61/fe1 x:0 0 0 2024-09-04T16:30:15.794 INFO:tasks.workunit.client.1.smithi193.stdout:1/750: dwrite d1/d2b/db/f5b [0,4194304] 0 2024-09-04T16:30:15.794 INFO:tasks.workunit.client.1.smithi193.stdout:2/679: read d2/d9/db/d65/f9e [1581842,100848] 0 2024-09-04T16:30:15.796 INFO:tasks.workunit.client.1.smithi193.stdout:7/785: write d9/d18/d22/d2b/f91 [2016322,29149] 0 2024-09-04T16:30:15.796 INFO:tasks.workunit.client.1.smithi193.stdout:2/680: write d2/d9/d18/f4f [1913547,20227] 0 2024-09-04T16:30:15.798 INFO:tasks.workunit.client.1.smithi193.stdout:2/681: write d2/d9/db/d10/d38/d63/f68 [65031,52672] 0 2024-09-04T16:30:15.799 INFO:tasks.workunit.client.1.smithi193.stdout:9/745: mkdir d2/deb 0 2024-09-04T16:30:15.800 INFO:tasks.workunit.client.0.smithi170.stdout:5/155: symlink d4/d8/l2e 0 2024-09-04T16:30:15.803 INFO:tasks.workunit.client.0.smithi170.stdout:6/246: getdents d0 0 2024-09-04T16:30:15.804 INFO:tasks.workunit.client.0.smithi170.stdout:6/247: stat d0/df/d1f/f2c 0 2024-09-04T16:30:15.806 INFO:tasks.workunit.client.0.smithi170.stdout:0/364: symlink d11/d75/d77/l89 0 2024-09-04T16:30:15.807 INFO:tasks.workunit.client.1.smithi193.stdout:6/660: dwrite d5/de/d15/f2f [0,4194304] 0 2024-09-04T16:30:15.809 INFO:tasks.workunit.client.0.smithi170.stdout:4/288: mkdir d1/d6/d8/d6c 0 2024-09-04T16:30:15.809 INFO:tasks.workunit.client.1.smithi193.stdout:8/710: getdents d2/d20/d23/d34/dd6 0 2024-09-04T16:30:15.813 INFO:tasks.workunit.client.1.smithi193.stdout:0/695: sync 2024-09-04T16:30:15.814 INFO:tasks.workunit.client.0.smithi170.stdout:2/302: creat d3/d3c/f5c x:0 0 0 2024-09-04T16:30:15.814 INFO:tasks.workunit.client.1.smithi193.stdout:0/696: write d18/d25/d3b/f40 [1664690,5757] 0 2024-09-04T16:30:15.817 INFO:tasks.workunit.client.0.smithi170.stdout:5/156: dread d4/db/f1d [0,4194304] 0 2024-09-04T16:30:15.817 INFO:tasks.workunit.client.0.smithi170.stdout:3/212: dread fb [0,4194304] 0 2024-09-04T16:30:15.817 INFO:tasks.workunit.client.1.smithi193.stdout:2/682: rmdir d2/d9/db/d10/d51/d87 39 2024-09-04T16:30:15.819 INFO:tasks.workunit.client.1.smithi193.stdout:3/690: getdents d0/d7/de 0 2024-09-04T16:30:15.821 INFO:tasks.workunit.client.1.smithi193.stdout:6/661: mkdir d5/de/d15/d1b/d5f/da7/dd1 0 2024-09-04T16:30:15.822 INFO:tasks.workunit.client.0.smithi170.stdout:4/289: mknod d1/d6/d8/d20/d35/c6d 0 2024-09-04T16:30:15.824 INFO:tasks.workunit.client.1.smithi193.stdout:8/711: truncate d2/d12/fd 4104782 0 2024-09-04T16:30:15.825 INFO:tasks.workunit.client.0.smithi170.stdout:5/157: dread d4/db/fe [4194304,4194304] 0 2024-09-04T16:30:15.831 INFO:tasks.workunit.client.0.smithi170.stdout:0/365: write d11/d13/d2f/d3f/f4f [1188964,33143] 0 2024-09-04T16:30:15.833 INFO:tasks.workunit.client.1.smithi193.stdout:2/683: mknod d2/d9/db/d10/d38/dac/ce2 0 2024-09-04T16:30:15.833 INFO:tasks.workunit.client.0.smithi170.stdout:6/248: dwrite d0/fd [0,4194304] 0 2024-09-04T16:30:15.834 INFO:tasks.workunit.client.1.smithi193.stdout:3/691: fdatasync d0/d18/d1b/d3d/d96/fd0 0 2024-09-04T16:30:15.837 INFO:tasks.workunit.client.1.smithi193.stdout:9/746: dwrite d2/d8/d15/f71 [4194304,4194304] 0 2024-09-04T16:30:15.845 INFO:tasks.workunit.client.1.smithi193.stdout:4/614: sync 2024-09-04T16:30:15.884 INFO:tasks.workunit.client.0.smithi170.stdout:4/290: write d1/d6/d8/f9 [3751044,30475] 0 2024-09-04T16:30:15.885 INFO:tasks.workunit.client.1.smithi193.stdout:0/697: mknod d18/d25/d5f/d65/d9f/da0/ce2 0 2024-09-04T16:30:15.887 INFO:tasks.workunit.client.0.smithi170.stdout:5/158: write d4/db/f1e [1615064,48103] 0 2024-09-04T16:30:15.888 INFO:tasks.workunit.client.1.smithi193.stdout:5/711: getdents d1/d29/d74/d96/d98 0 2024-09-04T16:30:15.890 INFO:tasks.workunit.client.1.smithi193.stdout:3/692: truncate d0/d18/d1c/d25/f42 2848144 0 2024-09-04T16:30:15.892 INFO:tasks.workunit.client.1.smithi193.stdout:4/615: symlink d3/d1a/d54/db1/lc9 0 2024-09-04T16:30:15.895 INFO:tasks.workunit.client.1.smithi193.stdout:1/751: getdents d1/d2b/d1b/d51/d6d/d89 0 2024-09-04T16:30:15.897 INFO:tasks.workunit.client.1.smithi193.stdout:7/786: getdents d9/d39/d3e/d4d/d98 0 2024-09-04T16:30:15.897 INFO:tasks.workunit.client.0.smithi170.stdout:6/249: truncate d0/d17/d2a/f46 825225 0 2024-09-04T16:30:15.898 INFO:tasks.workunit.client.0.smithi170.stdout:0/366: creat d11/d13/f8a x:0 0 0 2024-09-04T16:30:15.899 INFO:tasks.workunit.client.1.smithi193.stdout:4/616: dwrite d3/d1a/d21/d52/d5e/fa8 [0,4194304] 0 2024-09-04T16:30:15.900 INFO:tasks.workunit.client.0.smithi170.stdout:0/367: write d11/d13/f8a [760115,80555] 0 2024-09-04T16:30:15.900 INFO:tasks.workunit.client.1.smithi193.stdout:4/617: stat d3/d3c/d47/l50 0 2024-09-04T16:30:15.901 INFO:tasks.workunit.client.0.smithi170.stdout:4/291: stat d1/d6/c2f 0 2024-09-04T16:30:15.901 INFO:tasks.workunit.client.1.smithi193.stdout:0/698: rename d18/d25/d5f/db4/lb9 to d18/d25/d32/d9c/le3 0 2024-09-04T16:30:15.903 INFO:tasks.workunit.client.0.smithi170.stdout:5/159: creat d4/d8/d1c/d23/f2f x:0 0 0 2024-09-04T16:30:15.904 INFO:tasks.workunit.client.1.smithi193.stdout:3/693: dread d0/d18/d1c/d30/fac [0,4194304] 0 2024-09-04T16:30:15.907 INFO:tasks.workunit.client.0.smithi170.stdout:0/368: rename d11/d13/d71/c38 to d11/d75/d77/c8b 0 2024-09-04T16:30:15.908 INFO:tasks.workunit.client.0.smithi170.stdout:4/292: rmdir d1/d6/d8/d20/d35/d3e/d43 39 2024-09-04T16:30:15.911 INFO:tasks.workunit.client.1.smithi193.stdout:6/662: rmdir d5/d27/d3e/db1 0 2024-09-04T16:30:15.912 INFO:tasks.workunit.client.0.smithi170.stdout:5/160: mknod d4/db/c30 0 2024-09-04T16:30:15.915 INFO:tasks.workunit.client.0.smithi170.stdout:0/369: mkdir d11/d13/d4a/d66/d8c 0 2024-09-04T16:30:15.916 INFO:tasks.workunit.client.1.smithi193.stdout:6/663: dwrite d5/de/d15/f67 [0,4194304] 0 2024-09-04T16:30:15.916 INFO:tasks.workunit.client.1.smithi193.stdout:1/752: dread d1/d2b/db/f3b [4194304,4194304] 0 2024-09-04T16:30:15.917 INFO:tasks.workunit.client.0.smithi170.stdout:0/370: stat d11/d13/d36/l3b 0 2024-09-04T16:30:15.917 INFO:tasks.workunit.client.0.smithi170.stdout:0/371: stat d11/d13/d71/f53 0 2024-09-04T16:30:15.918 INFO:tasks.workunit.client.0.smithi170.stdout:0/372: chown d11/d13/d35/l5e 24221 1 2024-09-04T16:30:15.924 INFO:tasks.workunit.client.0.smithi170.stdout:4/293: dread d1/d6/f4f [0,4194304] 0 2024-09-04T16:30:15.925 INFO:tasks.workunit.client.1.smithi193.stdout:2/684: creat d2/fe3 x:0 0 0 2024-09-04T16:30:15.926 INFO:tasks.workunit.client.1.smithi193.stdout:2/685: chown d2/d9/db/d10/d1f/d22/f33 32624 1 2024-09-04T16:30:15.927 INFO:tasks.workunit.client.1.smithi193.stdout:9/747: creat d2/d18/d2f/d22/d30/d6a/d6e/d95/fec x:0 0 0 2024-09-04T16:30:15.928 INFO:tasks.workunit.client.1.smithi193.stdout:9/748: chown d2/d18/d66/f6d 15415 1 2024-09-04T16:30:15.929 INFO:tasks.workunit.client.1.smithi193.stdout:2/686: read d2/d9/db/d65/fa7 [1615208,21987] 0 2024-09-04T16:30:15.929 INFO:tasks.workunit.client.1.smithi193.stdout:3/694: dread d0/d18/d1c/d25/d5e/d7e/fa7 [0,4194304] 0 2024-09-04T16:30:15.929 INFO:tasks.workunit.client.1.smithi193.stdout:9/749: readlink d2/d18/d2f/d22/d30/d52/l8b 0 2024-09-04T16:30:15.930 INFO:tasks.workunit.client.0.smithi170.stdout:6/250: dwrite d0/d15/f26 [0,4194304] 0 2024-09-04T16:30:15.930 INFO:tasks.workunit.client.0.smithi170.stdout:0/373: getdents d11/d13/d4a/d66/d6d 0 2024-09-04T16:30:15.930 INFO:tasks.workunit.client.1.smithi193.stdout:3/695: dread - d0/d18/d1b/dab/fba zero size 2024-09-04T16:30:15.931 INFO:tasks.workunit.client.1.smithi193.stdout:2/687: write d2/d9/db/d10/d1e/f78 [3589772,58733] 0 2024-09-04T16:30:15.931 INFO:tasks.workunit.client.0.smithi170.stdout:0/374: read d11/d13/f28 [2441456,40474] 0 2024-09-04T16:30:15.932 INFO:tasks.workunit.client.1.smithi193.stdout:3/696: truncate d0/d18/d1b/dab/fb0 4935334 0 2024-09-04T16:30:15.935 INFO:tasks.workunit.client.1.smithi193.stdout:8/712: getdents d2 0 2024-09-04T16:30:15.937 INFO:tasks.workunit.client.0.smithi170.stdout:5/161: truncate d4/d8/d1c/d29/f2a 247413 0 2024-09-04T16:30:15.938 INFO:tasks.workunit.client.0.smithi170.stdout:0/375: symlink d11/d13/d2f/d3f/l8d 0 2024-09-04T16:30:15.939 INFO:tasks.workunit.client.1.smithi193.stdout:1/753: chown d1/d2b/f2e 672 1 2024-09-04T16:30:15.941 INFO:tasks.workunit.client.1.smithi193.stdout:6/664: creat d5/d27/d3e/d43/d5d/d97/fd2 x:0 0 0 2024-09-04T16:30:15.942 INFO:tasks.workunit.client.0.smithi170.stdout:6/251: mknod d0/df/d1b/d3e/d47/c50 0 2024-09-04T16:30:15.943 INFO:tasks.workunit.client.1.smithi193.stdout:4/618: symlink d3/d3c/lca 0 2024-09-04T16:30:15.945 INFO:tasks.workunit.client.1.smithi193.stdout:7/787: truncate d9/d39/d3e/d69/ff7 1385467 0 2024-09-04T16:30:15.946 INFO:tasks.workunit.client.1.smithi193.stdout:4/619: dread d3/d1a/d21/d52/d5e/fa8 [0,4194304] 0 2024-09-04T16:30:15.947 INFO:tasks.workunit.client.0.smithi170.stdout:4/294: dread d1/d6/d22/f48 [0,4194304] 0 2024-09-04T16:30:15.948 INFO:tasks.workunit.client.1.smithi193.stdout:4/620: write d3/d3c/d89/f8c [304375,112519] 0 2024-09-04T16:30:15.948 INFO:tasks.workunit.client.1.smithi193.stdout:0/699: truncate d18/f1c 44841 0 2024-09-04T16:30:15.949 INFO:tasks.workunit.client.0.smithi170.stdout:4/295: chown d1/d6/d22/l49 673 1 2024-09-04T16:30:15.950 INFO:tasks.workunit.client.1.smithi193.stdout:5/712: creat d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/db9/fe5 x:0 0 0 2024-09-04T16:30:15.952 INFO:tasks.workunit.client.0.smithi170.stdout:0/376: mkdir d11/d8e 0 2024-09-04T16:30:15.957 INFO:tasks.workunit.client.1.smithi193.stdout:5/713: dwrite d1/d8/db/d15/d2b/d83/d37/d58/dc4/fe4 [0,4194304] 0 2024-09-04T16:30:15.957 INFO:tasks.workunit.client.0.smithi170.stdout:4/296: dwrite d1/f19 [0,4194304] 0 2024-09-04T16:30:15.957 INFO:tasks.workunit.client.0.smithi170.stdout:5/162: link d4/d8/l2e d4/d8/d1c/l31 0 2024-09-04T16:30:15.962 INFO:tasks.workunit.client.1.smithi193.stdout:2/688: creat d2/d9/d61/fe4 x:0 0 0 2024-09-04T16:30:15.964 INFO:tasks.workunit.client.0.smithi170.stdout:0/377: symlink d11/d75/l8f 0 2024-09-04T16:30:15.964 INFO:tasks.workunit.client.1.smithi193.stdout:2/689: chown d2/d9/db/d10/d38/da5/fbb 4801288 1 2024-09-04T16:30:15.966 INFO:tasks.workunit.client.0.smithi170.stdout:0/378: truncate d11/d13/d2f/f84 163847 0 2024-09-04T16:30:15.967 INFO:tasks.workunit.client.0.smithi170.stdout:5/163: symlink d4/db/l32 0 2024-09-04T16:30:15.969 INFO:tasks.workunit.client.0.smithi170.stdout:5/164: chown d4 0 1 2024-09-04T16:30:15.969 INFO:tasks.workunit.client.0.smithi170.stdout:6/252: dwrite d0/df/f3a [0,4194304] 0 2024-09-04T16:30:15.971 INFO:tasks.workunit.client.0.smithi170.stdout:0/379: write d11/d13/d2f/d3f/f4f [385942,18106] 0 2024-09-04T16:30:15.973 INFO:tasks.workunit.client.0.smithi170.stdout:4/297: mknod d1/d6/d2b/d47/c6e 0 2024-09-04T16:30:15.973 INFO:tasks.workunit.client.0.smithi170.stdout:6/253: read d0/fd [3521446,61785] 0 2024-09-04T16:30:15.976 INFO:tasks.workunit.client.0.smithi170.stdout:0/380: chown d11/d13/d71/l2b 201529991 1 2024-09-04T16:30:15.977 INFO:tasks.workunit.client.1.smithi193.stdout:6/665: creat d5/de/d15/d1b/fd3 x:0 0 0 2024-09-04T16:30:15.977 INFO:tasks.workunit.client.0.smithi170.stdout:4/298: write d1/d6/d8/f44 [414329,30562] 0 2024-09-04T16:30:15.980 INFO:tasks.workunit.client.0.smithi170.stdout:5/165: dwrite d4/d8/d1c/d23/f2f [0,4194304] 0 2024-09-04T16:30:15.982 INFO:tasks.workunit.client.1.smithi193.stdout:7/788: creat d9/d18/d22/d2b/da6/f105 x:0 0 0 2024-09-04T16:30:15.982 INFO:tasks.workunit.client.0.smithi170.stdout:5/166: write d4/d8/d1c/d23/f2f [2724096,87710] 0 2024-09-04T16:30:15.987 INFO:tasks.workunit.client.1.smithi193.stdout:7/789: dwrite d9/d18/d1e/f43 [0,4194304] 0 2024-09-04T16:30:15.987 INFO:tasks.workunit.client.0.smithi170.stdout:6/254: creat d0/d17/d2a/d30/f51 x:0 0 0 2024-09-04T16:30:15.988 INFO:tasks.workunit.client.1.smithi193.stdout:3/697: write d0/d7/fa6 [1183574,8560] 0 2024-09-04T16:30:15.989 INFO:tasks.workunit.client.0.smithi170.stdout:6/255: write d0/df/d1f/f2c [421402,19498] 0 2024-09-04T16:30:15.989 INFO:tasks.workunit.client.1.smithi193.stdout:4/621: mknod d3/d1a/d21/d52/d5e/d7b/ccb 0 2024-09-04T16:30:15.991 INFO:tasks.workunit.client.0.smithi170.stdout:0/381: rename d11/f6f to d11/d13/d71/f90 0 2024-09-04T16:30:15.997 INFO:tasks.workunit.client.1.smithi193.stdout:8/713: dwrite d2/d20/d23/d24/d3c/f7d [0,4194304] 0 2024-09-04T16:30:15.998 INFO:tasks.workunit.client.1.smithi193.stdout:9/750: readlink d2/d4/l92 0 2024-09-04T16:30:16.002 INFO:tasks.workunit.client.1.smithi193.stdout:2/690: mkdir d2/d9/db/d10/d1f/d77/de5 0 2024-09-04T16:30:16.003 INFO:tasks.workunit.client.1.smithi193.stdout:5/714: dread d1/f16 [0,4194304] 0 2024-09-04T16:30:16.003 INFO:tasks.workunit.client.1.smithi193.stdout:5/715: fsync d1/d8/db/d36/d40/d46/dbe/fd6 0 2024-09-04T16:30:16.004 INFO:tasks.workunit.client.0.smithi170.stdout:6/256: mknod d0/df/d1b/d3e/d47/c52 0 2024-09-04T16:30:16.007 INFO:tasks.workunit.client.0.smithi170.stdout:5/167: dwrite d4/db/f1d [0,4194304] 0 2024-09-04T16:30:16.011 INFO:tasks.workunit.client.0.smithi170.stdout:0/382: creat d11/d13/d4a/d66/d6d/f91 x:0 0 0 2024-09-04T16:30:16.016 INFO:tasks.workunit.client.0.smithi170.stdout:0/383: creat d11/d13/d2f/f92 x:0 0 0 2024-09-04T16:30:16.016 INFO:tasks.workunit.client.0.smithi170.stdout:5/168: dwrite d4/db/f1d [0,4194304] 0 2024-09-04T16:30:16.016 INFO:tasks.workunit.client.0.smithi170.stdout:4/299: getdents d1/d6/d8/d20/d35/d3e/d60 0 2024-09-04T16:30:16.019 INFO:tasks.workunit.client.1.smithi193.stdout:0/700: mkdir d18/d79/d88/d9a/de4 0 2024-09-04T16:30:16.022 INFO:tasks.workunit.client.1.smithi193.stdout:7/790: read - d9/d39/d3e/d4d/d4f/fb4 zero size 2024-09-04T16:30:16.022 INFO:tasks.workunit.client.0.smithi170.stdout:0/384: unlink d11/f23 0 2024-09-04T16:30:16.024 INFO:tasks.workunit.client.1.smithi193.stdout:4/622: mknod d3/d3c/d89/dbd/ccc 0 2024-09-04T16:30:16.025 INFO:tasks.workunit.client.1.smithi193.stdout:4/623: truncate d3/d1a/d2a/d83/fb4 583993 0 2024-09-04T16:30:16.025 INFO:tasks.workunit.client.1.smithi193.stdout:4/624: fdatasync d3/d3c/f53 0 2024-09-04T16:30:16.026 INFO:tasks.workunit.client.0.smithi170.stdout:5/169: dwrite d4/f2b [0,4194304] 0 2024-09-04T16:30:16.026 INFO:tasks.workunit.client.1.smithi193.stdout:9/751: rmdir d2/d18/d2f/d22/d30 39 2024-09-04T16:30:16.027 INFO:tasks.workunit.client.0.smithi170.stdout:0/385: chown d11/f1c 38410299 1 2024-09-04T16:30:16.028 INFO:tasks.workunit.client.1.smithi193.stdout:8/714: rename d2/d20/d23/d34/d4b/c71 to d2/d20/d23/d34/d4b/dd4/ce6 0 2024-09-04T16:30:16.029 INFO:tasks.workunit.client.0.smithi170.stdout:5/170: chown d4/f6 133723 1 2024-09-04T16:30:16.033 INFO:tasks.workunit.client.0.smithi170.stdout:0/386: unlink d11/d75/f7b 0 2024-09-04T16:30:16.033 INFO:tasks.workunit.client.0.smithi170.stdout:4/300: dwrite d1/d6/d8/d20/d35/d3e/d4e/f45 [0,4194304] 0 2024-09-04T16:30:16.033 INFO:tasks.workunit.client.0.smithi170.stdout:0/387: write d11/d13/f8a [222950,21782] 0 2024-09-04T16:30:16.033 INFO:tasks.workunit.client.0.smithi170.stdout:5/171: mkdir d4/d8/d1c/d33 0 2024-09-04T16:30:16.034 INFO:tasks.workunit.client.0.smithi170.stdout:5/172: write d4/f2b [940570,60595] 0 2024-09-04T16:30:16.035 INFO:tasks.workunit.client.1.smithi193.stdout:1/754: creat d1/d2b/d10/fe5 x:0 0 0 2024-09-04T16:30:16.044 INFO:tasks.workunit.client.0.smithi170.stdout:5/173: creat d4/db/f34 x:0 0 0 2024-09-04T16:30:16.045 INFO:tasks.workunit.client.0.smithi170.stdout:4/301: rmdir d1/d6/d8/d20/d35/d54 39 2024-09-04T16:30:16.046 INFO:tasks.workunit.client.1.smithi193.stdout:3/698: symlink d0/d9/dae/dce/le1 0 2024-09-04T16:30:16.046 INFO:tasks.workunit.client.1.smithi193.stdout:0/701: creat d18/d25/d5f/d6a/d7b/fe5 x:0 0 0 2024-09-04T16:30:16.046 INFO:tasks.workunit.client.1.smithi193.stdout:7/791: mkdir d9/d18/d22/d2b/da6/d106 0 2024-09-04T16:30:16.047 INFO:tasks.workunit.client.0.smithi170.stdout:0/388: link d11/f68 d11/d13/d36/f93 0 2024-09-04T16:30:16.048 INFO:tasks.workunit.client.0.smithi170.stdout:5/174: chown d4/d8/d1c/l31 6 1 2024-09-04T16:30:16.050 INFO:tasks.workunit.client.0.smithi170.stdout:0/389: chown d11/f15 742 1 2024-09-04T16:30:16.050 INFO:tasks.workunit.client.1.smithi193.stdout:8/715: mkdir d2/d20/d23/d24/d3c/de7 0 2024-09-04T16:30:16.050 INFO:tasks.workunit.client.0.smithi170.stdout:5/175: read d4/db/f1e [90377,40338] 0 2024-09-04T16:30:16.053 INFO:tasks.workunit.client.1.smithi193.stdout:7/792: dwrite d9/d39/d3e/f7c [0,4194304] 0 2024-09-04T16:30:16.053 INFO:tasks.workunit.client.1.smithi193.stdout:2/691: dread d2/d9/db/f89 [0,4194304] 0 2024-09-04T16:30:16.053 INFO:tasks.workunit.client.0.smithi170.stdout:4/302: dwrite d1/d6/d8/d20/d35/d3e/d4e/d51/f5c [0,4194304] 0 2024-09-04T16:30:16.054 INFO:tasks.workunit.client.0.smithi170.stdout:5/176: chown d4/c13 0 1 2024-09-04T16:30:16.056 INFO:tasks.workunit.client.0.smithi170.stdout:5/177: write d4/db/f34 [125290,128612] 0 2024-09-04T16:30:16.058 INFO:tasks.workunit.client.0.smithi170.stdout:5/178: write d4/d8/d1c/d23/f2f [1864719,86219] 0 2024-09-04T16:30:16.060 INFO:tasks.workunit.client.1.smithi193.stdout:6/666: truncate d5/d27/d3e/f69 5155970 0 2024-09-04T16:30:16.062 INFO:tasks.workunit.client.0.smithi170.stdout:4/303: creat d1/d6/d2b/d47/f6f x:0 0 0 2024-09-04T16:30:16.070 INFO:tasks.workunit.client.0.smithi170.stdout:4/304: rmdir d1/d6/d8/d20/d35/d3e/d4e/d51 39 2024-09-04T16:30:16.071 INFO:tasks.workunit.client.0.smithi170.stdout:0/390: link d11/d13/d36/l3b d11/d13/l94 0 2024-09-04T16:30:16.074 INFO:tasks.workunit.client.0.smithi170.stdout:5/179: dwrite d4/db/f1e [0,4194304] 0 2024-09-04T16:30:16.080 INFO:tasks.workunit.client.0.smithi170.stdout:5/180: dwrite d4/f6 [0,4194304] 0 2024-09-04T16:30:16.084 INFO:tasks.workunit.client.1.smithi193.stdout:3/699: unlink d0/d9/d49/l74 0 2024-09-04T16:30:16.086 INFO:tasks.workunit.client.0.smithi170.stdout:5/181: dread d4/db/f1e [0,4194304] 0 2024-09-04T16:30:16.087 INFO:tasks.workunit.client.1.smithi193.stdout:4/625: mkdir d3/d3c/dae/dcd 0 2024-09-04T16:30:16.089 INFO:tasks.workunit.client.1.smithi193.stdout:5/716: sync 2024-09-04T16:30:16.090 INFO:tasks.workunit.client.0.smithi170.stdout:4/305: rename d1/d6/d8/d20/d35/d54/c63 to d1/d6/d2b/d33/c70 0 2024-09-04T16:30:16.090 INFO:tasks.workunit.client.0.smithi170.stdout:4/306: readlink d1/d6/l3a 0 2024-09-04T16:30:16.091 INFO:tasks.workunit.client.1.smithi193.stdout:0/702: creat d18/d25/d5f/d65/dc4/dd5/fe6 x:0 0 0 2024-09-04T16:30:16.091 INFO:tasks.workunit.client.0.smithi170.stdout:4/307: readlink d1/d6/d22/l67 0 2024-09-04T16:30:16.091 INFO:tasks.workunit.client.0.smithi170.stdout:5/182: symlink d4/d8/d1c/d23/l35 0 2024-09-04T16:30:16.092 INFO:tasks.workunit.client.1.smithi193.stdout:9/752: mkdir d2/d8/d25/ded 0 2024-09-04T16:30:16.095 INFO:tasks.workunit.client.1.smithi193.stdout:1/755: unlink d1/d2b/d10/fb2 0 2024-09-04T16:30:16.097 INFO:tasks.workunit.client.1.smithi193.stdout:8/716: creat d2/d20/d23/d51/d76/fe8 x:0 0 0 2024-09-04T16:30:16.098 INFO:tasks.workunit.client.1.smithi193.stdout:7/793: readlink d9/de/l99 0 2024-09-04T16:30:16.102 INFO:tasks.workunit.client.0.smithi170.stdout:4/308: dwrite d1/d6/d8/d20/d35/d3e/d4e/d51/f5c [0,4194304] 0 2024-09-04T16:30:16.103 INFO:tasks.workunit.client.1.smithi193.stdout:4/626: rename d3/d1a/d54/f7a to d3/da3/fce 0 2024-09-04T16:30:16.104 INFO:tasks.workunit.client.0.smithi170.stdout:5/183: dwrite d4/db/fe [0,4194304] 0 2024-09-04T16:30:16.105 INFO:tasks.workunit.client.0.smithi170.stdout:5/184: truncate d4/f2c 1789495 0 2024-09-04T16:30:16.106 INFO:tasks.workunit.client.1.smithi193.stdout:1/756: chown d1/d2b/d10/l5e 1700386 1 2024-09-04T16:30:16.108 INFO:tasks.workunit.client.1.smithi193.stdout:7/794: rmdir d9/d18/d22/d2b/d6c/d70 39 2024-09-04T16:30:16.110 INFO:tasks.workunit.client.1.smithi193.stdout:3/700: mkdir d0/d10/d24/d9a/de2 0 2024-09-04T16:30:16.111 INFO:tasks.workunit.client.1.smithi193.stdout:3/701: readlink d0/lcc 0 2024-09-04T16:30:16.112 INFO:tasks.workunit.client.0.smithi170.stdout:4/309: dwrite d1/d6/d2b/d33/f57 [0,4194304] 0 2024-09-04T16:30:16.114 INFO:tasks.workunit.client.1.smithi193.stdout:5/717: rename d1/d29/d18/faf to d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/db9/fe6 0 2024-09-04T16:30:16.118 INFO:tasks.workunit.client.0.smithi170.stdout:4/310: rmdir d1/d6/d2b 39 2024-09-04T16:30:16.120 INFO:tasks.workunit.client.1.smithi193.stdout:7/795: write d9/d11/fa7 [2776206,47142] 0 2024-09-04T16:30:16.121 INFO:tasks.workunit.client.1.smithi193.stdout:6/667: link d5/d33/d4e/d51/d71/d82/f9c d5/d27/fd4 0 2024-09-04T16:30:16.123 INFO:tasks.workunit.client.0.smithi170.stdout:4/311: dread d1/d6/f4f [0,4194304] 0 2024-09-04T16:30:16.123 INFO:tasks.workunit.client.1.smithi193.stdout:3/702: mkdir d0/d18/d1c/d30/d8e/de3 0 2024-09-04T16:30:16.124 INFO:tasks.workunit.client.1.smithi193.stdout:5/718: mknod d1/d29/ce7 0 2024-09-04T16:30:16.125 INFO:tasks.workunit.client.0.smithi170.stdout:4/312: chown d1/d6/d2b/d33 271795516 1 2024-09-04T16:30:16.127 INFO:tasks.workunit.client.1.smithi193.stdout:8/717: dread d2/d20/d23/d34/d46/d53/f64 [0,4194304] 0 2024-09-04T16:30:16.128 INFO:tasks.workunit.client.1.smithi193.stdout:3/703: mkdir d0/d10/d24/de4 0 2024-09-04T16:30:16.130 INFO:tasks.workunit.client.1.smithi193.stdout:9/753: rename d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/dd1 to d2/d18/d2f/d22/d30/dee 0 2024-09-04T16:30:16.131 INFO:tasks.workunit.client.0.smithi170.stdout:4/313: dwrite d1/d6/d8/d20/f25 [0,4194304] 0 2024-09-04T16:30:16.133 INFO:tasks.workunit.client.0.smithi170.stdout:4/314: chown d1/d6/d22/l67 1791875784 1 2024-09-04T16:30:16.133 INFO:tasks.workunit.client.1.smithi193.stdout:8/718: creat d2/d20/d23/d24/d3c/d65/dc8/de1/dd8/fe9 x:0 0 0 2024-09-04T16:30:16.133 INFO:tasks.workunit.client.1.smithi193.stdout:5/719: dwrite d1/d8/db/d36/d40/d46/d84/fa3 [0,4194304] 0 2024-09-04T16:30:16.133 INFO:tasks.workunit.client.0.smithi170.stdout:4/315: dread - d1/d6/d2b/d47/f6f zero size 2024-09-04T16:30:16.134 INFO:tasks.workunit.client.0.smithi170.stdout:4/316: read - d1/d6/d8/d20/d35/d3e/d60/f61 zero size 2024-09-04T16:30:16.134 INFO:tasks.workunit.client.1.smithi193.stdout:6/668: dwrite d5/d27/d3e/f73 [4194304,4194304] 0 2024-09-04T16:30:16.137 INFO:tasks.workunit.client.0.smithi170.stdout:4/317: getdents d1/d6/d2b/d47 0 2024-09-04T16:30:16.138 INFO:tasks.workunit.client.1.smithi193.stdout:5/720: read d1/d8/f2d [2319673,20307] 0 2024-09-04T16:30:16.141 INFO:tasks.workunit.client.1.smithi193.stdout:3/704: truncate d0/d18/d1c/d30/fac 3365530 0 2024-09-04T16:30:16.141 INFO:tasks.workunit.client.1.smithi193.stdout:9/754: dread d2/d18/d2f/d22/d30/d6a/fa7 [0,4194304] 0 2024-09-04T16:30:16.143 INFO:tasks.workunit.client.1.smithi193.stdout:8/719: mkdir d2/d20/d23/d34/dd6/da0/dea 0 2024-09-04T16:30:16.144 INFO:tasks.workunit.client.1.smithi193.stdout:5/721: creat d1/d8/db/d36/d40/fe8 x:0 0 0 2024-09-04T16:30:16.145 INFO:tasks.workunit.client.1.smithi193.stdout:3/705: write d0/d18/d1c/d30/d8e/fd3 [681834,49936] 0 2024-09-04T16:30:16.146 INFO:tasks.workunit.client.0.smithi170.stdout:4/318: rmdir d1/d6/d2b/d47/d68 0 2024-09-04T16:30:16.146 INFO:tasks.workunit.client.1.smithi193.stdout:6/669: dwrite d5/d27/d3e/d43/fcc [0,4194304] 0 2024-09-04T16:30:16.148 INFO:tasks.workunit.client.1.smithi193.stdout:5/722: mkdir d1/dd0/de9 0 2024-09-04T16:30:16.154 INFO:tasks.workunit.client.1.smithi193.stdout:9/755: dwrite d2/d8/d25/db2/fc6 [0,4194304] 0 2024-09-04T16:30:16.157 INFO:tasks.workunit.client.1.smithi193.stdout:6/670: dwrite d5/de/fbf [0,4194304] 0 2024-09-04T16:30:16.158 INFO:tasks.workunit.client.1.smithi193.stdout:5/723: getdents d1/d8/db/d36/d40/d46/dbe 0 2024-09-04T16:30:16.162 INFO:tasks.workunit.client.1.smithi193.stdout:5/724: stat d1/d8/db/d15/d2b/d83/d37/d58/dc4/dda 0 2024-09-04T16:30:16.164 INFO:tasks.workunit.client.1.smithi193.stdout:6/671: fdatasync d5/de/d15/d1b/f79 0 2024-09-04T16:30:16.164 INFO:tasks.workunit.client.1.smithi193.stdout:9/756: dwrite d2/d18/d66/f7f [0,4194304] 0 2024-09-04T16:30:16.164 INFO:tasks.workunit.client.1.smithi193.stdout:5/725: chown d1/d29/l7c 0 1 2024-09-04T16:30:16.164 INFO:tasks.workunit.client.0.smithi170.stdout:0/391: write d11/f1c [2329917,41919] 0 2024-09-04T16:30:16.169 INFO:tasks.workunit.client.1.smithi193.stdout:9/757: creat d2/d8/d25/db2/fef x:0 0 0 2024-09-04T16:30:16.173 INFO:tasks.workunit.client.1.smithi193.stdout:6/672: dwrite d5/f5e [0,4194304] 0 2024-09-04T16:30:16.174 INFO:tasks.workunit.client.0.smithi170.stdout:0/392: symlink d11/d13/d4a/d66/d6d/l95 0 2024-09-04T16:30:16.175 INFO:tasks.workunit.client.1.smithi193.stdout:6/673: chown d5/d27/d3e/d6e/l74 134 1 2024-09-04T16:30:16.175 INFO:tasks.workunit.client.1.smithi193.stdout:6/674: chown d5/de/d15/c9a 0 1 2024-09-04T16:30:16.180 INFO:tasks.workunit.client.0.smithi170.stdout:0/393: rename d11/d13/d4a/f5c to d11/d13/d71/f96 0 2024-09-04T16:30:16.181 INFO:tasks.workunit.client.1.smithi193.stdout:9/758: fdatasync d2/d56/d86/fad 0 2024-09-04T16:30:16.182 INFO:tasks.workunit.client.1.smithi193.stdout:9/759: chown d2/d8/d15/f35 8 1 2024-09-04T16:30:16.183 INFO:tasks.workunit.client.0.smithi170.stdout:0/394: symlink d11/d13/d2f/d3f/l97 0 2024-09-04T16:30:16.184 INFO:tasks.workunit.client.1.smithi193.stdout:6/675: symlink d5/d27/ld5 0 2024-09-04T16:30:16.186 INFO:tasks.workunit.client.1.smithi193.stdout:2/692: write d2/d9/db/d10/d1e/f5a [577068,126745] 0 2024-09-04T16:30:16.188 INFO:tasks.workunit.client.1.smithi193.stdout:2/693: write d2/d9/fdd [62785,98736] 0 2024-09-04T16:30:16.190 INFO:tasks.workunit.client.1.smithi193.stdout:6/676: symlink d5/d33/d85/ld6 0 2024-09-04T16:30:16.190 INFO:tasks.workunit.client.1.smithi193.stdout:2/694: chown d2/d9/db/d10/d1f/f62 120721 1 2024-09-04T16:30:16.190 INFO:tasks.workunit.client.0.smithi170.stdout:0/395: dwrite d11/d13/d71/f4c [0,4194304] 0 2024-09-04T16:30:16.191 INFO:tasks.workunit.client.1.smithi193.stdout:6/677: chown d5/de/d15/d1b/f5a 12 1 2024-09-04T16:30:16.194 INFO:tasks.workunit.client.0.smithi170.stdout:5/185: truncate d4/db/fe 6503177 0 2024-09-04T16:30:16.195 INFO:tasks.workunit.client.0.smithi170.stdout:0/396: chown d11/d13/d71/d43/l3d 67353 1 2024-09-04T16:30:16.198 INFO:tasks.workunit.client.0.smithi170.stdout:5/186: creat d4/d8/d1c/d33/f36 x:0 0 0 2024-09-04T16:30:16.198 INFO:tasks.workunit.client.1.smithi193.stdout:2/695: getdents d2/d9/db/d10/d38/da5/dc7 0 2024-09-04T16:30:16.201 INFO:tasks.workunit.client.1.smithi193.stdout:4/627: truncate d3/f2f 2337352 0 2024-09-04T16:30:16.203 INFO:tasks.workunit.client.0.smithi170.stdout:0/397: dwrite d11/d13/d4a/d66/f83 [0,4194304] 0 2024-09-04T16:30:16.204 INFO:tasks.workunit.client.1.smithi193.stdout:7/796: dread d9/d18/d22/fe0 [0,4194304] 0 2024-09-04T16:30:16.204 INFO:tasks.workunit.client.1.smithi193.stdout:6/678: dwrite d5/d33/d4e/d51/d71/d82/fa5 [0,4194304] 0 2024-09-04T16:30:16.207 INFO:tasks.workunit.client.1.smithi193.stdout:0/703: dwrite f6 [8388608,4194304] 0 2024-09-04T16:30:16.208 INFO:tasks.workunit.client.1.smithi193.stdout:1/757: dwrite d1/d2b/db/f82 [0,4194304] 0 2024-09-04T16:30:16.211 INFO:tasks.workunit.client.1.smithi193.stdout:0/704: truncate d18/d25/d32/d57/d6c/fbe 342426 0 2024-09-04T16:30:16.213 INFO:tasks.workunit.client.1.smithi193.stdout:6/679: rmdir d5/de/d15/d1b 39 2024-09-04T16:30:16.213 INFO:tasks.workunit.client.0.smithi170.stdout:4/319: write d1/d6/f32 [517009,128458] 0 2024-09-04T16:30:16.214 INFO:tasks.workunit.client.1.smithi193.stdout:6/680: read d5/de/d15/f2f [533201,67040] 0 2024-09-04T16:30:16.217 INFO:tasks.workunit.client.0.smithi170.stdout:0/398: dwrite d11/d13/d4a/d66/d6d/f91 [0,4194304] 0 2024-09-04T16:30:16.217 INFO:tasks.workunit.client.0.smithi170.stdout:4/320: dread - d1/d6/d2b/d47/f6f zero size 2024-09-04T16:30:16.221 INFO:tasks.workunit.client.1.smithi193.stdout:7/797: rename d9/d18/d22/d2b/c2f to d9/d39/d3e/d4a/c107 0 2024-09-04T16:30:16.224 INFO:tasks.workunit.client.1.smithi193.stdout:7/798: chown d9/de/f1a 404730 1 2024-09-04T16:30:16.225 INFO:tasks.workunit.client.1.smithi193.stdout:0/705: dwrite d18/d25/d5f/d6a/d7b/fe5 [0,4194304] 0 2024-09-04T16:30:16.228 INFO:tasks.workunit.client.0.smithi170.stdout:0/399: creat d11/d8e/f98 x:0 0 0 2024-09-04T16:30:16.229 INFO:tasks.workunit.client.1.smithi193.stdout:6/681: creat d5/d27/d3e/d43/d5d/d97/fd7 x:0 0 0 2024-09-04T16:30:16.229 INFO:tasks.workunit.client.0.smithi170.stdout:4/321: symlink d1/d6/d8/d6c/l71 0 2024-09-04T16:30:16.232 INFO:tasks.workunit.client.0.smithi170.stdout:0/400: mknod d11/d13/d36/c99 0 2024-09-04T16:30:16.232 INFO:tasks.workunit.client.1.smithi193.stdout:9/760: write d2/d8/d61/f87 [247984,50852] 0 2024-09-04T16:30:16.252 INFO:tasks.workunit.client.0.smithi170.stdout:4/322: symlink d1/d6/d22/l72 0 2024-09-04T16:30:16.257 INFO:tasks.workunit.client.0.smithi170.stdout:5/187: rename d4/d8/d1c/d33 to d4/db/d37 0 2024-09-04T16:30:16.257 INFO:tasks.workunit.client.1.smithi193.stdout:9/761: dread d2/d8/d15/f8c [0,4194304] 0 2024-09-04T16:30:16.260 INFO:tasks.workunit.client.0.smithi170.stdout:4/323: mknod d1/d6/d8/d20/d35/d54/d58/c73 0 2024-09-04T16:30:16.261 INFO:tasks.workunit.client.0.smithi170.stdout:5/188: rmdir d4/db 39 2024-09-04T16:30:16.262 INFO:tasks.workunit.client.1.smithi193.stdout:1/758: dread d1/d2b/d10/f17 [0,4194304] 0 2024-09-04T16:30:16.263 INFO:tasks.workunit.client.0.smithi170.stdout:0/401: rename d11/d13/d4a/f62 to d11/d75/f9a 0 2024-09-04T16:30:16.270 INFO:tasks.workunit.client.0.smithi170.stdout:5/189: write d4/db/f1e [3519460,125637] 0 2024-09-04T16:30:16.271 INFO:tasks.workunit.client.0.smithi170.stdout:4/324: creat d1/f74 x:0 0 0 2024-09-04T16:30:16.272 INFO:tasks.workunit.client.0.smithi170.stdout:4/325: write d1/fc [1482320,4938] 0 2024-09-04T16:30:16.274 INFO:tasks.workunit.client.0.smithi170.stdout:0/402: link d11/d13/d2f/l6e d11/d13/d2f/d3f/l9b 0 2024-09-04T16:30:16.274 INFO:tasks.workunit.client.1.smithi193.stdout:0/706: getdents d18/d25/d5f/d65/d9f 0 2024-09-04T16:30:16.275 INFO:tasks.workunit.client.1.smithi193.stdout:9/762: truncate d2/d18/d2f/f7e 4189180 0 2024-09-04T16:30:16.277 INFO:tasks.workunit.client.1.smithi193.stdout:9/763: stat d2/d18/d2f/cc0 0 2024-09-04T16:30:16.277 INFO:tasks.workunit.client.1.smithi193.stdout:2/696: dwrite d2/f5e [0,4194304] 0 2024-09-04T16:30:16.278 INFO:tasks.workunit.client.1.smithi193.stdout:1/759: unlink d1/d39/l8c 0 2024-09-04T16:30:16.279 INFO:tasks.workunit.client.0.smithi170.stdout:0/403: creat d11/d8e/f9c x:0 0 0 2024-09-04T16:30:16.279 INFO:tasks.workunit.client.0.smithi170.stdout:0/404: chown d11/d13/d71/f4c 90 1 2024-09-04T16:30:16.280 INFO:tasks.workunit.client.1.smithi193.stdout:9/764: write d2/d8/d25/f37 [562736,8633] 0 2024-09-04T16:30:16.284 INFO:tasks.workunit.client.1.smithi193.stdout:7/799: dwrite d9/d39/d3e/d4a/f5b [4194304,4194304] 0 2024-09-04T16:30:16.286 INFO:tasks.workunit.client.1.smithi193.stdout:9/765: write d2/d8/d25/f37 [4262454,102482] 0 2024-09-04T16:30:16.287 INFO:tasks.workunit.client.1.smithi193.stdout:7/800: chown d9/d18/d1e/f2e 129 1 2024-09-04T16:30:16.288 INFO:tasks.workunit.client.0.smithi170.stdout:0/405: link d11/c41 d11/d75/c9d 0 2024-09-04T16:30:16.290 INFO:tasks.workunit.client.1.smithi193.stdout:0/707: dread d18/f21 [0,4194304] 0 2024-09-04T16:30:16.290 INFO:tasks.workunit.client.0.smithi170.stdout:5/190: truncate d4/db/f1e 4177609 0 2024-09-04T16:30:16.291 INFO:tasks.workunit.client.0.smithi170.stdout:5/191: stat d4/db/l21 0 2024-09-04T16:30:16.291 INFO:tasks.workunit.client.1.smithi193.stdout:2/697: dwrite d2/d9/d61/fe1 [0,4194304] 0 2024-09-04T16:30:16.292 INFO:tasks.workunit.client.0.smithi170.stdout:5/192: fsync d4/db/f34 0 2024-09-04T16:30:16.294 INFO:tasks.workunit.client.1.smithi193.stdout:7/801: read d9/d39/d3e/d4a/f5b [7244849,120437] 0 2024-09-04T16:30:16.294 INFO:tasks.workunit.client.1.smithi193.stdout:9/766: write d2/d18/d2f/d22/d30/d6a/fb5 [721010,46290] 0 2024-09-04T16:30:16.297 INFO:tasks.workunit.client.1.smithi193.stdout:5/726: sync 2024-09-04T16:30:16.297 INFO:tasks.workunit.client.1.smithi193.stdout:8/720: sync 2024-09-04T16:30:16.297 INFO:tasks.workunit.client.1.smithi193.stdout:3/706: sync 2024-09-04T16:30:16.297 INFO:tasks.workunit.client.0.smithi170.stdout:4/326: dwrite d1/d6/d8/d20/d35/d3e/d43/f5f [0,4194304] 0 2024-09-04T16:30:16.299 INFO:tasks.workunit.client.1.smithi193.stdout:2/698: fsync d2/d9/db/f89 0 2024-09-04T16:30:16.300 INFO:tasks.workunit.client.0.smithi170.stdout:4/327: write d1/d6/d8/d20/d35/d3e/d4e/f45 [208948,68609] 0 2024-09-04T16:30:16.300 INFO:tasks.workunit.client.0.smithi170.stdout:4/328: readlink d1/l41 0 2024-09-04T16:30:16.306 INFO:tasks.workunit.client.1.smithi193.stdout:0/708: read - d18/d25/d32/d57/d6d/f93 zero size 2024-09-04T16:30:16.308 INFO:tasks.workunit.client.1.smithi193.stdout:1/760: link d1/d2b/d1b/d51/cbd d1/d2b/d1b/d51/ce6 0 2024-09-04T16:30:16.310 INFO:tasks.workunit.client.1.smithi193.stdout:9/767: unlink d2/d8/f55 0 2024-09-04T16:30:16.313 INFO:tasks.workunit.client.0.smithi170.stdout:5/193: creat d4/d8/d1c/d26/d27/f38 x:0 0 0 2024-09-04T16:30:16.313 INFO:tasks.workunit.client.0.smithi170.stdout:0/406: truncate d11/d13/d36/f7a 658917 0 2024-09-04T16:30:16.315 INFO:tasks.workunit.client.0.smithi170.stdout:4/329: dread d1/d6/d8/f9 [0,4194304] 0 2024-09-04T16:30:16.315 INFO:tasks.workunit.client.1.smithi193.stdout:9/768: dread d2/d56/d86/fad [0,4194304] 0 2024-09-04T16:30:16.315 INFO:tasks.workunit.client.1.smithi193.stdout:7/802: write d9/d18/d22/d2b/d6c/d70/fe3 [2990782,101024] 0 2024-09-04T16:30:16.316 INFO:tasks.workunit.client.1.smithi193.stdout:9/769: chown d2/d4/l92 1525 1 2024-09-04T16:30:16.316 INFO:tasks.workunit.client.0.smithi170.stdout:4/330: chown d1/d6/d8/d20/d35/d3e/d43 3991 1 2024-09-04T16:30:16.316 INFO:tasks.workunit.client.0.smithi170.stdout:0/407: fsync d11/f68 0 2024-09-04T16:30:16.317 INFO:tasks.workunit.client.0.smithi170.stdout:0/408: chown d11/d13/d36 4115145 1 2024-09-04T16:30:16.318 INFO:tasks.workunit.client.0.smithi170.stdout:5/194: mkdir d4/d8/d1c/d23/d39 0 2024-09-04T16:30:16.319 INFO:tasks.workunit.client.1.smithi193.stdout:3/707: mknod d0/d18/d1c/d51/d5a/da2/ce5 0 2024-09-04T16:30:16.319 INFO:tasks.workunit.client.1.smithi193.stdout:9/770: dread d2/d8/d25/db2/fc6 [0,4194304] 0 2024-09-04T16:30:16.321 INFO:tasks.workunit.client.1.smithi193.stdout:8/721: creat d2/d20/d23/d24/d3c/d65/dc8/de1/feb x:0 0 0 2024-09-04T16:30:16.321 INFO:tasks.workunit.client.1.smithi193.stdout:8/722: stat d2/d20/d23/d1b/d4e/f55 0 2024-09-04T16:30:16.322 INFO:tasks.workunit.client.1.smithi193.stdout:8/723: chown d2/d20/d23/d24/d3c/d65/dc8 195861 1 2024-09-04T16:30:16.323 INFO:tasks.workunit.client.1.smithi193.stdout:8/724: write d2/d20/d23/d34/d3e/d6f/d81/fa4 [1901009,67126] 0 2024-09-04T16:30:16.325 INFO:tasks.workunit.client.0.smithi170.stdout:4/331: dwrite d1/d6/d2b/d33/d36/f3c [4194304,4194304] 0 2024-09-04T16:30:16.329 INFO:tasks.workunit.client.0.smithi170.stdout:5/195: mkdir d4/d3a 0 2024-09-04T16:30:16.332 INFO:tasks.workunit.client.1.smithi193.stdout:0/709: creat d18/d25/d5f/d65/dc4/dd5/fe7 x:0 0 0 2024-09-04T16:30:16.339 INFO:tasks.workunit.client.0.smithi170.stdout:4/332: creat d1/d6/f75 x:0 0 0 2024-09-04T16:30:16.343 INFO:tasks.workunit.client.0.smithi170.stdout:5/196: creat d4/f3b x:0 0 0 2024-09-04T16:30:16.344 INFO:tasks.workunit.client.1.smithi193.stdout:5/727: mknod d1/dd0/de9/cea 0 2024-09-04T16:30:16.344 INFO:tasks.workunit.client.0.smithi170.stdout:4/333: chown d1/c2d 17 1 2024-09-04T16:30:16.346 INFO:tasks.workunit.client.1.smithi193.stdout:9/771: rename d2/d18/d2f/cc0 to d2/d18/d2f/d22/d30/d52/cf0 0 2024-09-04T16:30:16.347 INFO:tasks.workunit.client.0.smithi170.stdout:4/334: chown d1/l1a 16437539 1 2024-09-04T16:30:16.347 INFO:tasks.workunit.client.0.smithi170.stdout:4/335: readlink d1/d6/d2b/d33/d36/l2a 0 2024-09-04T16:30:16.348 INFO:tasks.workunit.client.0.smithi170.stdout:4/336: chown d1/d6/d22/c6a 30869 1 2024-09-04T16:30:16.348 INFO:tasks.workunit.client.1.smithi193.stdout:4/628: sync 2024-09-04T16:30:16.348 INFO:tasks.workunit.client.1.smithi193.stdout:2/699: symlink d2/le6 0 2024-09-04T16:30:16.350 INFO:tasks.workunit.client.0.smithi170.stdout:5/197: creat d4/f3c x:0 0 0 2024-09-04T16:30:16.350 INFO:tasks.workunit.client.1.smithi193.stdout:2/700: fdatasync d2/d9/db/d10/d1e/da4/fcf 0 2024-09-04T16:30:16.351 INFO:tasks.workunit.client.0.smithi170.stdout:5/198: fdatasync d4/d8/d1c/d23/f2f 0 2024-09-04T16:30:16.352 INFO:tasks.workunit.client.1.smithi193.stdout:2/701: read - d2/d9/db/d10/d1e/f96 zero size 2024-09-04T16:30:16.353 INFO:tasks.workunit.client.1.smithi193.stdout:9/772: dread d2/d18/d2f/f45 [0,4194304] 0 2024-09-04T16:30:16.354 INFO:tasks.workunit.client.1.smithi193.stdout:5/728: read d1/d8/db/d15/d2b/d83/d37/f4d [326620,113133] 0 2024-09-04T16:30:16.354 INFO:tasks.workunit.client.1.smithi193.stdout:9/773: fdatasync d2/d18/d2f/d9a/fc7 0 2024-09-04T16:30:16.356 INFO:tasks.workunit.client.0.smithi170.stdout:4/337: dwrite d1/d6/d2b/d33/f4d [0,4194304] 0 2024-09-04T16:30:16.357 INFO:tasks.workunit.client.1.smithi193.stdout:3/708: dread d0/fa [4194304,4194304] 0 2024-09-04T16:30:16.357 INFO:tasks.workunit.client.1.smithi193.stdout:3/709: fdatasync d0/d3b/fbd 0 2024-09-04T16:30:16.360 INFO:tasks.workunit.client.0.smithi170.stdout:5/199: rename d4/db/l21 to d4/d8/d1c/d23/l3d 0 2024-09-04T16:30:16.361 INFO:tasks.workunit.client.1.smithi193.stdout:4/629: mkdir d3/d3c/d98/dcf 0 2024-09-04T16:30:16.363 INFO:tasks.workunit.client.0.smithi170.stdout:4/338: creat d1/d6/d8/d20/d35/d3e/d4e/d51/f76 x:0 0 0 2024-09-04T16:30:16.363 INFO:tasks.workunit.client.1.smithi193.stdout:3/710: dwrite d0/d18/d1c/d30/f41 [4194304,4194304] 0 2024-09-04T16:30:16.366 INFO:tasks.workunit.client.1.smithi193.stdout:3/711: read d0/d18/f50 [397381,76688] 0 2024-09-04T16:30:16.368 INFO:tasks.workunit.client.0.smithi170.stdout:5/200: dread d4/db/f1e [0,4194304] 0 2024-09-04T16:30:16.368 INFO:tasks.workunit.client.1.smithi193.stdout:3/712: chown d0/d9/d49/d87 5957 1 2024-09-04T16:30:16.369 INFO:tasks.workunit.client.1.smithi193.stdout:8/725: dwrite d2/d20/d23/d24/d3c/d65/f74 [0,4194304] 0 2024-09-04T16:30:16.370 INFO:tasks.workunit.client.1.smithi193.stdout:5/729: creat d1/d8/db/d15/d2b/d83/feb x:0 0 0 2024-09-04T16:30:16.371 INFO:tasks.workunit.client.1.smithi193.stdout:8/726: chown d2/d20/d23/d24/f49 0 1 2024-09-04T16:30:16.372 INFO:tasks.workunit.client.1.smithi193.stdout:9/774: mkdir d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/df1 0 2024-09-04T16:30:16.373 INFO:tasks.workunit.client.0.smithi170.stdout:5/201: unlink d4/db/l32 0 2024-09-04T16:30:16.374 INFO:tasks.workunit.client.0.smithi170.stdout:5/202: read d4/f6 [2365817,25750] 0 2024-09-04T16:30:16.377 INFO:tasks.workunit.client.1.smithi193.stdout:4/630: rmdir d3/d3c/dae 39 2024-09-04T16:30:16.379 INFO:tasks.workunit.client.0.smithi170.stdout:5/203: mkdir d4/d8/d1c/d23/d3e 0 2024-09-04T16:30:16.382 INFO:tasks.workunit.client.1.smithi193.stdout:7/803: link d9/d39/d3e/d69/ff7 d9/d39/d3e/d4d/d98/d9a/f108 0 2024-09-04T16:30:16.383 INFO:tasks.workunit.client.1.smithi193.stdout:0/710: truncate d18/f1d 1344165 0 2024-09-04T16:30:16.384 INFO:tasks.workunit.client.1.smithi193.stdout:0/711: dread - d18/d25/d32/d57/d6d/f93 zero size 2024-09-04T16:30:16.384 INFO:tasks.workunit.client.0.smithi170.stdout:5/204: creat d4/d8/d1c/d26/d27/f3f x:0 0 0 2024-09-04T16:30:16.385 INFO:tasks.workunit.client.1.smithi193.stdout:2/702: mknod d2/d9/db/d10/d1e/ce7 0 2024-09-04T16:30:16.389 INFO:tasks.workunit.client.0.smithi170.stdout:5/205: creat d4/d8/d1c/d23/d39/f40 x:0 0 0 2024-09-04T16:30:16.389 INFO:tasks.workunit.client.1.smithi193.stdout:8/727: fsync d2/d20/f8f 0 2024-09-04T16:30:16.390 INFO:tasks.workunit.client.1.smithi193.stdout:5/730: rmdir d1/d8/db/d15/d2b/d83/d37 39 2024-09-04T16:30:16.391 INFO:tasks.workunit.client.0.smithi170.stdout:5/206: mkdir d4/d8/d1c/d41 0 2024-09-04T16:30:16.392 INFO:tasks.workunit.client.0.smithi170.stdout:5/207: chown d4/c1a 3 1 2024-09-04T16:30:16.393 INFO:tasks.workunit.client.1.smithi193.stdout:3/713: dwrite d0/d7/fc [0,4194304] 0 2024-09-04T16:30:16.393 INFO:tasks.workunit.client.0.smithi170.stdout:5/208: readlink d4/l1b 0 2024-09-04T16:30:16.393 INFO:tasks.workunit.client.1.smithi193.stdout:8/728: read d2/d12/f8e [3588088,128341] 0 2024-09-04T16:30:16.394 INFO:tasks.workunit.client.1.smithi193.stdout:7/804: mkdir d9/d39/d3e/d4d/d4f/dab/d109 0 2024-09-04T16:30:16.395 INFO:tasks.workunit.client.1.smithi193.stdout:0/712: creat d18/d79/d88/d9a/fe8 x:0 0 0 2024-09-04T16:30:16.396 INFO:tasks.workunit.client.1.smithi193.stdout:7/805: chown d9/c32 1127 1 2024-09-04T16:30:16.397 INFO:tasks.workunit.client.1.smithi193.stdout:1/761: rename d1/d2b/d10/d2a/l40 to d1/d2b/d10/le7 0 2024-09-04T16:30:16.398 INFO:tasks.workunit.client.1.smithi193.stdout:1/762: fdatasync d1/d2b/db/d54/da1/fc3 0 2024-09-04T16:30:16.404 INFO:tasks.workunit.client.1.smithi193.stdout:9/775: creat d2/d8/d25/ded/ff2 x:0 0 0 2024-09-04T16:30:16.405 INFO:tasks.workunit.client.1.smithi193.stdout:6/682: sync 2024-09-04T16:30:16.405 INFO:tasks.workunit.client.1.smithi193.stdout:9/776: stat d2/d8/d61/f6b 0 2024-09-04T16:30:16.405 INFO:tasks.workunit.client.0.smithi170.stdout:5/209: link d4/d8/l22 d4/db/d37/l42 0 2024-09-04T16:30:16.406 INFO:tasks.workunit.client.0.smithi170.stdout:5/210: dread - d4/f3b zero size 2024-09-04T16:30:16.407 INFO:tasks.workunit.client.1.smithi193.stdout:4/631: creat d3/d1a/d21/d52/d7f/db6/fd0 x:0 0 0 2024-09-04T16:30:16.409 INFO:tasks.workunit.client.1.smithi193.stdout:3/714: creat d0/d18/d1c/d51/d6c/fe6 x:0 0 0 2024-09-04T16:30:16.409 INFO:tasks.workunit.client.1.smithi193.stdout:2/703: write d2/d9/db/d65/f9e [2306840,107717] 0 2024-09-04T16:30:16.409 INFO:tasks.workunit.client.0.smithi170.stdout:5/211: truncate d4/f6 66911 0 2024-09-04T16:30:16.410 INFO:tasks.workunit.client.0.smithi170.stdout:5/212: chown d4/d8/d1c/d23/l35 24129333 1 2024-09-04T16:30:16.411 INFO:tasks.workunit.client.1.smithi193.stdout:8/729: truncate d2/d20/d23/d1b/d4e/f88 1786941 0 2024-09-04T16:30:16.412 INFO:tasks.workunit.client.1.smithi193.stdout:1/763: readlink d1/d2b/d10/le7 0 2024-09-04T16:30:16.414 INFO:tasks.workunit.client.1.smithi193.stdout:6/683: chown d5/de/d15/d1b/f95 118018858 1 2024-09-04T16:30:16.414 INFO:tasks.workunit.client.1.smithi193.stdout:6/684: chown d5/de/d15/l2e 1982 1 2024-09-04T16:30:16.414 INFO:tasks.workunit.client.0.smithi170.stdout:5/213: dread d4/f2c [0,4194304] 0 2024-09-04T16:30:16.415 INFO:tasks.workunit.client.1.smithi193.stdout:9/777: creat d2/d8/d4d/ff3 x:0 0 0 2024-09-04T16:30:16.416 INFO:tasks.workunit.client.1.smithi193.stdout:5/731: mkdir d1/d8/db/d15/d2b/d83/d37/d58/d9e/dec 0 2024-09-04T16:30:16.416 INFO:tasks.workunit.client.1.smithi193.stdout:4/632: symlink d3/d1a/d54/db1/ld1 0 2024-09-04T16:30:16.417 INFO:tasks.workunit.client.0.smithi170.stdout:5/214: mkdir d4/d8/d1c/d26/d27/d43 0 2024-09-04T16:30:16.417 INFO:tasks.workunit.client.0.smithi170.stdout:5/215: readlink d4/d8/d1c/d23/l35 0 2024-09-04T16:30:16.418 INFO:tasks.workunit.client.1.smithi193.stdout:0/713: unlink d18/d25/d32/d9c/cd0 0 2024-09-04T16:30:16.418 INFO:tasks.workunit.client.0.smithi170.stdout:1/321: sync 2024-09-04T16:30:16.418 INFO:tasks.workunit.client.0.smithi170.stdout:5/216: stat d4/c1f 0 2024-09-04T16:30:16.419 INFO:tasks.workunit.client.1.smithi193.stdout:7/806: symlink d9/d11/l10a 0 2024-09-04T16:30:16.420 INFO:tasks.workunit.client.1.smithi193.stdout:2/704: creat d2/d9/db/d10/d1e/da4/d9a/fe8 x:0 0 0 2024-09-04T16:30:16.421 INFO:tasks.workunit.client.1.smithi193.stdout:2/705: truncate d2/d9/db/d10/d1f/f62 1431099 0 2024-09-04T16:30:16.422 INFO:tasks.workunit.client.1.smithi193.stdout:2/706: dread - d2/d9/db/d10/d4e/f81 zero size 2024-09-04T16:30:16.422 INFO:tasks.workunit.client.0.smithi170.stdout:1/322: symlink d9/d26/d5b/d61/l65 0 2024-09-04T16:30:16.423 INFO:tasks.workunit.client.1.smithi193.stdout:6/685: creat d5/de/d15/d1b/d5f/fd8 x:0 0 0 2024-09-04T16:30:16.424 INFO:tasks.workunit.client.0.smithi170.stdout:5/217: creat d4/d8/d1c/d26/d27/d43/f44 x:0 0 0 2024-09-04T16:30:16.425 INFO:tasks.workunit.client.0.smithi170.stdout:5/218: readlink d4/db/l16 0 2024-09-04T16:30:16.425 INFO:tasks.workunit.client.1.smithi193.stdout:5/732: creat d1/d8/db/d36/d40/dc1/fed x:0 0 0 2024-09-04T16:30:16.426 INFO:tasks.workunit.client.1.smithi193.stdout:4/633: mkdir d3/da3/dd2 0 2024-09-04T16:30:16.427 INFO:tasks.workunit.client.1.smithi193.stdout:0/714: mkdir d18/d25/d3b/de9 0 2024-09-04T16:30:16.427 INFO:tasks.workunit.client.1.smithi193.stdout:7/807: truncate d9/de/d27/f35 1138803 0 2024-09-04T16:30:16.428 INFO:tasks.workunit.client.0.smithi170.stdout:5/219: mknod d4/d8/d1c/d26/d27/c45 0 2024-09-04T16:30:16.428 INFO:tasks.workunit.client.1.smithi193.stdout:8/730: getdents d2/d20/d23/d24/d3c/de7 0 2024-09-04T16:30:16.429 INFO:tasks.workunit.client.0.smithi170.stdout:1/323: dwrite d9/d11/d2e/f52 [0,4194304] 0 2024-09-04T16:30:16.429 INFO:tasks.workunit.client.1.smithi193.stdout:1/764: chown d1/d2b/d10/d2a/fa9 17040 1 2024-09-04T16:30:16.432 INFO:tasks.workunit.client.0.smithi170.stdout:5/220: dread d4/db/fe [4194304,4194304] 0 2024-09-04T16:30:16.442 INFO:tasks.workunit.client.0.smithi170.stdout:5/221: creat d4/d8/d1c/d41/f46 x:0 0 0 2024-09-04T16:30:16.443 INFO:tasks.workunit.client.0.smithi170.stdout:5/222: fdatasync d4/d8/d1c/d41/f46 0 2024-09-04T16:30:16.445 INFO:tasks.workunit.client.1.smithi193.stdout:1/765: dread d1/d2b/db/d54/f70 [0,4194304] 0 2024-09-04T16:30:16.446 INFO:tasks.workunit.client.1.smithi193.stdout:3/715: getdents d0/d18 0 2024-09-04T16:30:16.446 INFO:tasks.workunit.client.1.smithi193.stdout:1/766: fsync d1/d2b/d1b/d51/fdc 0 2024-09-04T16:30:16.447 INFO:tasks.workunit.client.1.smithi193.stdout:3/716: write d0/d7/fc [1552744,112791] 0 2024-09-04T16:30:16.447 INFO:tasks.workunit.client.1.smithi193.stdout:1/767: chown d1/d2b/d1b/d51/cdb 23 1 2024-09-04T16:30:16.448 INFO:tasks.workunit.client.1.smithi193.stdout:1/768: chown d1/d2b/d10/db7/dc8 18 1 2024-09-04T16:30:16.450 INFO:tasks.workunit.client.0.smithi170.stdout:5/223: dwrite d4/f2b [4194304,4194304] 0 2024-09-04T16:30:16.451 INFO:tasks.workunit.client.0.smithi170.stdout:5/224: write d4/d8/d1c/d23/f2f [2721812,46647] 0 2024-09-04T16:30:16.453 INFO:tasks.workunit.client.1.smithi193.stdout:1/769: dwrite d1/d2b/d10/f19 [0,4194304] 0 2024-09-04T16:30:16.454 INFO:tasks.workunit.client.1.smithi193.stdout:1/770: write d1/d2b/d1b/d51/fa6 [162563,107824] 0 2024-09-04T16:30:16.460 INFO:tasks.workunit.client.0.smithi170.stdout:5/225: dread d4/f2c [0,4194304] 0 2024-09-04T16:30:16.471 INFO:tasks.workunit.client.1.smithi193.stdout:5/733: link d1/d29/d74/d96/d98/caa d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/cee 0 2024-09-04T16:30:16.473 INFO:tasks.workunit.client.1.smithi193.stdout:0/715: write d18/d25/d5f/d6a/d7b/f94 [1382302,1168] 0 2024-09-04T16:30:16.475 INFO:tasks.workunit.client.1.smithi193.stdout:6/686: dwrite d5/de/d15/d1b/d5f/f78 [0,4194304] 0 2024-09-04T16:30:16.476 INFO:tasks.workunit.client.0.smithi170.stdout:1/324: dwrite d9/d11/f1a [0,4194304] 0 2024-09-04T16:30:16.476 INFO:tasks.workunit.client.1.smithi193.stdout:4/634: getdents d3/d3c/d47 0 2024-09-04T16:30:16.477 INFO:tasks.workunit.client.1.smithi193.stdout:4/635: readlink d3/d1a/d54/db1/lc9 0 2024-09-04T16:30:16.478 INFO:tasks.workunit.client.1.smithi193.stdout:7/808: getdents d9/d39/d3e/d7d 0 2024-09-04T16:30:16.481 INFO:tasks.workunit.client.1.smithi193.stdout:8/731: dread d2/d20/d23/d1b/d4e/f88 [0,4194304] 0 2024-09-04T16:30:16.482 INFO:tasks.workunit.client.0.smithi170.stdout:5/226: write d4/db/f1e [3224315,119484] 0 2024-09-04T16:30:16.482 INFO:tasks.workunit.client.0.smithi170.stdout:1/325: write d9/f10 [7131257,115925] 0 2024-09-04T16:30:16.484 INFO:tasks.workunit.client.1.smithi193.stdout:2/707: rename d2/d9/db/d10/d1f/c60 to d2/d9/db/d10/d51/d87/ce9 0 2024-09-04T16:30:16.485 INFO:tasks.workunit.client.1.smithi193.stdout:6/687: dwrite d5/de/d15/d9f/fb9 [0,4194304] 0 2024-09-04T16:30:16.485 INFO:tasks.workunit.client.1.smithi193.stdout:0/716: symlink d18/d25/d32/d9c/da9/lea 0 2024-09-04T16:30:16.487 INFO:tasks.workunit.client.1.smithi193.stdout:3/717: creat d0/d10/fe7 x:0 0 0 2024-09-04T16:30:16.488 INFO:tasks.workunit.client.0.smithi170.stdout:1/326: creat d9/d34/d5f/f66 x:0 0 0 2024-09-04T16:30:16.489 INFO:tasks.workunit.client.0.smithi170.stdout:1/327: write d9/d11/d3e/f4e [214486,76680] 0 2024-09-04T16:30:16.489 INFO:tasks.workunit.client.0.smithi170.stdout:5/227: mknod d4/d8/d1c/d29/c47 0 2024-09-04T16:30:16.490 INFO:tasks.workunit.client.0.smithi170.stdout:5/228: chown d4/d8/l2e 11630 1 2024-09-04T16:30:16.494 INFO:tasks.workunit.client.0.smithi170.stdout:1/328: creat d9/d34/d5f/f67 x:0 0 0 2024-09-04T16:30:16.495 INFO:tasks.workunit.client.1.smithi193.stdout:7/809: dwrite d9/d18/d1e/f43 [0,4194304] 0 2024-09-04T16:30:16.498 INFO:tasks.workunit.client.1.smithi193.stdout:1/771: dwrite d1/d39/f67 [0,4194304] 0 2024-09-04T16:30:16.499 INFO:tasks.workunit.client.1.smithi193.stdout:6/688: symlink d5/d33/d4e/d51/d7b/ld9 0 2024-09-04T16:30:16.500 INFO:tasks.workunit.client.0.smithi170.stdout:5/229: dwrite d4/d8/d1c/d26/d27/d43/f44 [0,4194304] 0 2024-09-04T16:30:16.500 INFO:tasks.workunit.client.0.smithi170.stdout:1/329: rename d9/d11/d3e/c59 to d9/d11/c68 0 2024-09-04T16:30:16.504 INFO:tasks.workunit.client.1.smithi193.stdout:3/718: creat d0/d18/d1c/d30/d8e/fe8 x:0 0 0 2024-09-04T16:30:16.508 INFO:tasks.workunit.client.1.smithi193.stdout:4/636: rename d3/d1a/d2a/f3b to d3/d3c/d98/fd3 0 2024-09-04T16:30:16.509 INFO:tasks.workunit.client.0.smithi170.stdout:5/230: mkdir d4/d8/d1c/d26/d27/d48 0 2024-09-04T16:30:16.510 INFO:tasks.workunit.client.0.smithi170.stdout:1/330: symlink d9/l69 0 2024-09-04T16:30:16.511 INFO:tasks.workunit.client.1.smithi193.stdout:7/810: mknod d9/d18/d22/d2b/d6c/d70/d79/c10b 0 2024-09-04T16:30:16.512 INFO:tasks.workunit.client.0.smithi170.stdout:5/231: truncate d4/d8/d1c/d23/d39/f40 921720 0 2024-09-04T16:30:16.512 INFO:tasks.workunit.client.1.smithi193.stdout:5/734: getdents d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/dd8 0 2024-09-04T16:30:16.513 INFO:tasks.workunit.client.1.smithi193.stdout:5/735: readlink d1/dc3/l50 0 2024-09-04T16:30:16.514 INFO:tasks.workunit.client.0.smithi170.stdout:1/331: mkdir d9/d11/d3e/d6a 0 2024-09-04T16:30:16.519 INFO:tasks.workunit.client.1.smithi193.stdout:3/719: creat d0/d9/dae/fe9 x:0 0 0 2024-09-04T16:30:16.519 INFO:tasks.workunit.client.1.smithi193.stdout:0/717: dread d18/f4c [0,4194304] 0 2024-09-04T16:30:16.519 INFO:tasks.workunit.client.1.smithi193.stdout:1/772: mknod d1/d2b/d10/ce8 0 2024-09-04T16:30:16.520 INFO:tasks.workunit.client.1.smithi193.stdout:0/718: chown d18/d25/d5f/d65/d9f/da0/fc8 863 1 2024-09-04T16:30:16.522 INFO:tasks.workunit.client.1.smithi193.stdout:6/689: mkdir d5/de/d15/dda 0 2024-09-04T16:30:16.524 INFO:tasks.workunit.client.1.smithi193.stdout:7/811: creat d9/de/d27/d62/f10c x:0 0 0 2024-09-04T16:30:16.525 INFO:tasks.workunit.client.1.smithi193.stdout:7/812: chown d9/d39/d3e/f3f 1215269 1 2024-09-04T16:30:16.526 INFO:tasks.workunit.client.1.smithi193.stdout:4/637: creat d3/d1a/d21/d52/d5e/daa/fd4 x:0 0 0 2024-09-04T16:30:16.527 INFO:tasks.workunit.client.1.smithi193.stdout:3/720: mknod d0/d18/d1c/d25/d5e/d90/cea 0 2024-09-04T16:30:16.529 INFO:tasks.workunit.client.0.smithi170.stdout:1/332: dread d9/f10 [0,4194304] 0 2024-09-04T16:30:16.529 INFO:tasks.workunit.client.1.smithi193.stdout:0/719: mkdir d18/d25/d32/d57/d6c/db1/deb 0 2024-09-04T16:30:16.530 INFO:tasks.workunit.client.0.smithi170.stdout:1/333: write d9/d26/f5a [948444,70826] 0 2024-09-04T16:30:16.531 INFO:tasks.workunit.client.1.smithi193.stdout:6/690: unlink d5/de/d15/d9f/fc1 0 2024-09-04T16:30:16.531 INFO:tasks.workunit.client.1.smithi193.stdout:2/708: write d2/d9/db/d10/d1f/d4a/f64 [1205281,13878] 0 2024-09-04T16:30:16.533 INFO:tasks.workunit.client.1.smithi193.stdout:0/720: write d18/d25/d32/dce/fe1 [411756,125643] 0 2024-09-04T16:30:16.533 INFO:tasks.workunit.client.1.smithi193.stdout:6/691: fdatasync d5/de/d15/d9f/fb9 0 2024-09-04T16:30:16.534 INFO:tasks.workunit.client.1.smithi193.stdout:7/813: truncate f8 1130473 0 2024-09-04T16:30:16.535 INFO:tasks.workunit.client.1.smithi193.stdout:3/721: dwrite d0/d18/d1b/f8b [0,4194304] 0 2024-09-04T16:30:16.537 INFO:tasks.workunit.client.0.smithi170.stdout:1/334: fdatasync d9/d11/f43 0 2024-09-04T16:30:16.539 INFO:tasks.workunit.client.1.smithi193.stdout:9/778: sync 2024-09-04T16:30:16.539 INFO:tasks.workunit.client.1.smithi193.stdout:1/773: mknod d1/d2b/d10/ce9 0 2024-09-04T16:30:16.543 INFO:tasks.workunit.client.1.smithi193.stdout:0/721: symlink d18/d25/d32/d9c/da9/lec 0 2024-09-04T16:30:16.543 INFO:tasks.workunit.client.1.smithi193.stdout:9/779: write d2/d18/d2f/d22/d30/d6a/d6e/d95/fec [528884,106887] 0 2024-09-04T16:30:16.544 INFO:tasks.workunit.client.0.smithi170.stdout:1/335: dwrite d9/d26/f5a [0,4194304] 0 2024-09-04T16:30:16.545 INFO:tasks.workunit.client.1.smithi193.stdout:7/814: unlink d9/d18/d22/d2b/d6c/c7e 0 2024-09-04T16:30:16.547 INFO:tasks.workunit.client.1.smithi193.stdout:7/815: fdatasync d9/d18/fed 0 2024-09-04T16:30:16.549 INFO:tasks.workunit.client.1.smithi193.stdout:8/732: truncate d2/d20/d23/d24/d3c/d65/f74 1365143 0 2024-09-04T16:30:16.550 INFO:tasks.workunit.client.1.smithi193.stdout:9/780: read d2/d8/d15/f48 [3554143,99127] 0 2024-09-04T16:30:16.552 INFO:tasks.workunit.client.1.smithi193.stdout:2/709: dwrite d2/d9/f36 [0,4194304] 0 2024-09-04T16:30:16.554 INFO:tasks.workunit.client.0.smithi170.stdout:5/232: truncate d4/db/fe 1213202 0 2024-09-04T16:30:16.555 INFO:tasks.workunit.client.1.smithi193.stdout:1/774: chown d1/d2b/d10/d56/da7/db1/dd6 203 1 2024-09-04T16:30:16.557 INFO:tasks.workunit.client.0.smithi170.stdout:1/336: getdents d9 0 2024-09-04T16:30:16.558 INFO:tasks.workunit.client.1.smithi193.stdout:0/722: dwrite d18/d25/d5f/d65/d9f/da0/fbc [0,4194304] 0 2024-09-04T16:30:16.558 INFO:tasks.workunit.client.1.smithi193.stdout:1/775: stat d1/d2b/d1b/d51/d6d/fd8 0 2024-09-04T16:30:16.558 INFO:tasks.workunit.client.0.smithi170.stdout:1/337: write d9/d11/d2e/f52 [2475655,113773] 0 2024-09-04T16:30:16.559 INFO:tasks.workunit.client.1.smithi193.stdout:0/723: fdatasync d18/d25/d32/f42 0 2024-09-04T16:30:16.559 INFO:tasks.workunit.client.1.smithi193.stdout:5/736: write d1/d8/f12 [1519201,22860] 0 2024-09-04T16:30:16.561 INFO:tasks.workunit.client.1.smithi193.stdout:4/638: rename d3/d1a/d21/d52/d5e to d3/d39/d44/dd5 0 2024-09-04T16:30:16.568 INFO:tasks.workunit.client.1.smithi193.stdout:5/737: dread d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/fb7 [0,4194304] 0 2024-09-04T16:30:16.568 INFO:tasks.workunit.client.0.smithi170.stdout:1/338: unlink d9/d34/d5f/f62 0 2024-09-04T16:30:16.571 INFO:tasks.workunit.client.1.smithi193.stdout:4/639: unlink d3/lc0 0 2024-09-04T16:30:16.574 INFO:tasks.workunit.client.1.smithi193.stdout:4/640: write d3/d39/d44/dd5/fa2 [667691,7892] 0 2024-09-04T16:30:16.575 INFO:tasks.workunit.client.1.smithi193.stdout:5/738: dwrite d1/d8/db/d15/f30 [4194304,4194304] 0 2024-09-04T16:30:16.577 INFO:tasks.workunit.client.1.smithi193.stdout:7/816: creat d9/d18/f10d x:0 0 0 2024-09-04T16:30:16.579 INFO:tasks.workunit.client.1.smithi193.stdout:6/692: dread d5/d27/d3e/d43/f57 [0,4194304] 0 2024-09-04T16:30:16.580 INFO:tasks.workunit.client.1.smithi193.stdout:8/733: creat d2/d20/d23/d34/d46/fec x:0 0 0 2024-09-04T16:30:16.584 INFO:tasks.workunit.client.1.smithi193.stdout:1/776: creat d1/d2b/d1b/d28/fea x:0 0 0 2024-09-04T16:30:16.587 INFO:tasks.workunit.client.1.smithi193.stdout:0/724: creat d18/d25/d32/fed x:0 0 0 2024-09-04T16:30:16.589 INFO:tasks.workunit.client.1.smithi193.stdout:8/734: rmdir d2/d20/d23/d24/d3c/dc9 39 2024-09-04T16:30:16.591 INFO:tasks.workunit.client.1.smithi193.stdout:6/693: rename d5/de/d15/d1b/d5f/l92 to d5/d33/d4e/d51/d71/dcf/ldb 0 2024-09-04T16:30:16.592 INFO:tasks.workunit.client.1.smithi193.stdout:4/641: creat d3/d3c/dae/fd6 x:0 0 0 2024-09-04T16:30:16.593 INFO:tasks.workunit.client.1.smithi193.stdout:5/739: symlink d1/d8/db/d15/d2b/d83/d37/d58/de0/lef 0 2024-09-04T16:30:16.594 INFO:tasks.workunit.client.1.smithi193.stdout:1/777: symlink d1/d2b/d1b/d28/d50/d84/dd1/de2/leb 0 2024-09-04T16:30:16.594 INFO:tasks.workunit.client.1.smithi193.stdout:9/781: dread d2/d8/d15/f34 [0,4194304] 0 2024-09-04T16:30:16.596 INFO:tasks.workunit.client.0.smithi170.stdout:1/339: dwrite d9/d11/f43 [0,4194304] 0 2024-09-04T16:30:16.596 INFO:tasks.workunit.client.1.smithi193.stdout:7/817: mknod d9/d39/d3e/d4d/d98/d9a/db6/df8/c10e 0 2024-09-04T16:30:16.597 INFO:tasks.workunit.client.1.smithi193.stdout:9/782: chown d2/d8/fd4 18163 1 2024-09-04T16:30:16.597 INFO:tasks.workunit.client.1.smithi193.stdout:0/725: dwrite d18/d25/d32/fed [0,4194304] 0 2024-09-04T16:30:16.599 INFO:tasks.workunit.client.1.smithi193.stdout:4/642: fdatasync d3/d39/f57 0 2024-09-04T16:30:16.600 INFO:tasks.workunit.client.0.smithi170.stdout:5/233: write d4/db/fe [44547,44743] 0 2024-09-04T16:30:16.600 INFO:tasks.workunit.client.1.smithi193.stdout:0/726: write d18/d25/f2a [2002218,54168] 0 2024-09-04T16:30:16.600 INFO:tasks.workunit.client.0.smithi170.stdout:5/234: read - d4/d8/d1c/d41/f46 zero size 2024-09-04T16:30:16.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:16 smithi170 ceph-mon[29272]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:30:16.601 INFO:tasks.workunit.client.0.smithi170.stdout:1/340: rename d9/d26/d5b to d9/d11/d2f/d6b 0 2024-09-04T16:30:16.602 INFO:tasks.workunit.client.1.smithi193.stdout:8/735: dread d2/d20/dc0/f6d [0,4194304] 0 2024-09-04T16:30:16.603 INFO:tasks.workunit.client.0.smithi170.stdout:5/235: write d4/d8/d1c/d26/d27/f38 [608886,10172] 0 2024-09-04T16:30:16.603 INFO:tasks.workunit.client.1.smithi193.stdout:8/736: fdatasync d2/d20/d23/d34/d4b/db8/fc1 0 2024-09-04T16:30:16.604 INFO:tasks.workunit.client.0.smithi170.stdout:1/341: write d9/d11/f43 [4595036,86683] 0 2024-09-04T16:30:16.604 INFO:tasks.workunit.client.1.smithi193.stdout:5/740: creat d1/d29/ff0 x:0 0 0 2024-09-04T16:30:16.605 INFO:tasks.workunit.client.0.smithi170.stdout:5/236: dread - d4/d8/d1c/d41/f46 zero size 2024-09-04T16:30:16.606 INFO:tasks.workunit.client.1.smithi193.stdout:8/737: write d2/d20/d23/d34/d46/fc7 [1009347,10949] 0 2024-09-04T16:30:16.606 INFO:tasks.workunit.client.0.smithi170.stdout:5/237: chown d4/d8/d1c/d26/d27 110863 1 2024-09-04T16:30:16.608 INFO:tasks.workunit.client.0.smithi170.stdout:5/238: write d4/db/f1d [57926,74452] 0 2024-09-04T16:30:16.608 INFO:tasks.workunit.client.1.smithi193.stdout:1/778: mknod d1/d2b/db/cec 0 2024-09-04T16:30:16.609 INFO:tasks.workunit.client.0.smithi170.stdout:5/239: readlink d4/d8/l2e 0 2024-09-04T16:30:16.609 INFO:tasks.workunit.client.0.smithi170.stdout:5/240: chown d4/d8/l11 51112446 1 2024-09-04T16:30:16.610 INFO:tasks.workunit.client.0.smithi170.stdout:5/241: stat d4/d8/d1c/d23/c25 0 2024-09-04T16:30:16.613 INFO:tasks.workunit.client.1.smithi193.stdout:8/738: fdatasync d2/d20/d23/d34/d46/fc7 0 2024-09-04T16:30:16.613 INFO:tasks.workunit.client.0.smithi170.stdout:1/342: unlink d9/d11/d2e/f4c 0 2024-09-04T16:30:16.614 INFO:tasks.workunit.client.1.smithi193.stdout:8/739: stat d2/d20/d23/d24/f49 0 2024-09-04T16:30:16.614 INFO:tasks.workunit.client.1.smithi193.stdout:7/818: symlink d9/d11/dd4/dd2/l10f 0 2024-09-04T16:30:16.615 INFO:tasks.workunit.client.1.smithi193.stdout:7/819: dread - d9/d39/d3e/d4d/d4f/ff9 zero size 2024-09-04T16:30:16.620 INFO:tasks.workunit.client.0.smithi170.stdout:5/242: rename d4/d8/l11 to d4/d8/l49 0 2024-09-04T16:30:16.621 INFO:tasks.workunit.client.1.smithi193.stdout:0/727: write d18/d25/f4d [3584021,83941] 0 2024-09-04T16:30:16.621 INFO:tasks.workunit.client.1.smithi193.stdout:0/728: chown d18/d25/d5f/db4 364624 1 2024-09-04T16:30:16.623 INFO:tasks.workunit.client.0.smithi170.stdout:1/343: rename d9/d11/d2f/d6b/d61/l65 to d9/d11/d2f/l6c 0 2024-09-04T16:30:16.625 INFO:tasks.workunit.client.1.smithi193.stdout:9/783: mkdir d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/df4 0 2024-09-04T16:30:16.626 INFO:tasks.workunit.client.0.smithi170.stdout:1/344: symlink d9/d11/d2f/d6b/l6d 0 2024-09-04T16:30:16.629 INFO:tasks.workunit.client.1.smithi193.stdout:5/741: rename d1/d8/db/d15/d2b/d83/d37/d58/dc4/fe4 to d1/d8/db/d36/d40/ff1 0 2024-09-04T16:30:16.629 INFO:tasks.workunit.client.1.smithi193.stdout:1/779: stat d1/d2b/d10/d2a/l94 0 2024-09-04T16:30:16.630 INFO:tasks.workunit.client.0.smithi170.stdout:1/345: symlink d9/d11/d2f/d6b/d61/l6e 0 2024-09-04T16:30:16.631 INFO:tasks.workunit.client.0.smithi170.stdout:1/346: fdatasync d9/d11/d3e/f4e 0 2024-09-04T16:30:16.631 INFO:tasks.workunit.client.1.smithi193.stdout:8/740: read d2/d20/d23/d51/f63 [89434,6037] 0 2024-09-04T16:30:16.632 INFO:tasks.workunit.client.1.smithi193.stdout:8/741: write d2/d20/d23/d34/d3e/d6f/d81/fa4 [1683584,47643] 0 2024-09-04T16:30:16.633 INFO:tasks.workunit.client.1.smithi193.stdout:8/742: readlink d2/l38 0 2024-09-04T16:30:16.634 INFO:tasks.workunit.client.1.smithi193.stdout:8/743: fsync d2/d20/d23/d51/d76/f87 0 2024-09-04T16:30:16.634 INFO:tasks.workunit.client.0.smithi170.stdout:1/347: rename d9/d11/d2f/f4b to d9/d11/d2f/d6b/d61/f6f 0 2024-09-04T16:30:16.637 INFO:tasks.workunit.client.1.smithi193.stdout:4/643: dwrite d3/f14 [0,4194304] 0 2024-09-04T16:30:16.638 INFO:tasks.workunit.client.1.smithi193.stdout:4/644: readlink d3/d39/d44/dd5/l65 0 2024-09-04T16:30:16.638 INFO:tasks.workunit.client.1.smithi193.stdout:3/722: sync 2024-09-04T16:30:16.639 INFO:tasks.workunit.client.1.smithi193.stdout:4/645: stat d3/f28 0 2024-09-04T16:30:16.643 INFO:tasks.workunit.client.1.smithi193.stdout:0/729: mknod d18/d25/d5f/d65/cee 0 2024-09-04T16:30:16.644 INFO:tasks.workunit.client.1.smithi193.stdout:0/730: read - d18/d25/d5f/fbf zero size 2024-09-04T16:30:16.644 INFO:tasks.workunit.client.1.smithi193.stdout:4/646: dwrite d3/d39/f6b [0,4194304] 0 2024-09-04T16:30:16.646 INFO:tasks.workunit.client.1.smithi193.stdout:4/647: rename d3/d39 to d3/d39/d44/dd5/dd7 22 2024-09-04T16:30:16.646 INFO:tasks.workunit.client.1.smithi193.stdout:6/694: link d5/d33/d4e/d51/d7b/ld9 d5/de/ldc 0 2024-09-04T16:30:16.646 INFO:tasks.workunit.client.1.smithi193.stdout:0/731: dread - d18/d25/d5f/d65/dc4/dd5/fdf zero size 2024-09-04T16:30:16.648 INFO:tasks.workunit.client.1.smithi193.stdout:9/784: creat d2/d18/d2f/d9a/de4/ff5 x:0 0 0 2024-09-04T16:30:16.650 INFO:tasks.workunit.client.1.smithi193.stdout:6/695: read d5/d33/d4e/d51/f80 [5288898,5192] 0 2024-09-04T16:30:16.651 INFO:tasks.workunit.client.1.smithi193.stdout:8/744: dwrite d2/d20/d23/d1b/f28 [0,4194304] 0 2024-09-04T16:30:16.651 INFO:tasks.workunit.client.1.smithi193.stdout:1/780: symlink d1/d2b/d10/led 0 2024-09-04T16:30:16.655 INFO:tasks.workunit.client.1.smithi193.stdout:3/723: mknod d0/d9/d49/d87/ceb 0 2024-09-04T16:30:16.655 INFO:tasks.workunit.client.1.smithi193.stdout:7/820: link d9/de/d27/f67 d9/d39/d3e/d7d/f110 0 2024-09-04T16:30:16.655 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:16 smithi193 ceph-mon[36288]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:30:16.658 INFO:tasks.workunit.client.1.smithi193.stdout:2/710: sync 2024-09-04T16:30:16.661 INFO:tasks.workunit.client.1.smithi193.stdout:9/785: creat d2/d56/d86/ff6 x:0 0 0 2024-09-04T16:30:16.662 INFO:tasks.workunit.client.1.smithi193.stdout:3/724: dwrite d0/d7/de/d45/f93 [0,4194304] 0 2024-09-04T16:30:16.664 INFO:tasks.workunit.client.0.smithi170.stdout:1/348: dwrite d9/d26/f36 [0,4194304] 0 2024-09-04T16:30:16.665 INFO:tasks.workunit.client.1.smithi193.stdout:4/648: dwrite d3/d1a/d21/f37 [0,4194304] 0 2024-09-04T16:30:16.665 INFO:tasks.workunit.client.0.smithi170.stdout:1/349: stat d9 0 2024-09-04T16:30:16.665 INFO:tasks.workunit.client.0.smithi170.stdout:1/350: chown d9/d11/l39 470 1 2024-09-04T16:30:16.667 INFO:tasks.workunit.client.1.smithi193.stdout:7/821: creat d9/d39/d3e/d4d/f111 x:0 0 0 2024-09-04T16:30:16.671 INFO:tasks.workunit.client.0.smithi170.stdout:1/351: creat d9/d11/d2f/d6b/f70 x:0 0 0 2024-09-04T16:30:16.675 INFO:tasks.workunit.client.0.smithi170.stdout:1/352: unlink d9/d11/f53 0 2024-09-04T16:30:16.681 INFO:tasks.workunit.client.0.smithi170.stdout:1/353: creat d9/d34/d5f/f71 x:0 0 0 2024-09-04T16:30:16.685 INFO:tasks.workunit.client.1.smithi193.stdout:6/696: rename d5/de/d15/d1b/d5f/da7/db2/fcb to d5/de/d15/d48/fdd 0 2024-09-04T16:30:16.685 INFO:tasks.workunit.client.1.smithi193.stdout:6/697: stat d5/de/d15/d1b/f1e 0 2024-09-04T16:30:16.686 INFO:tasks.workunit.client.0.smithi170.stdout:1/354: creat d9/d11/d2f/d6b/f72 x:0 0 0 2024-09-04T16:30:16.688 INFO:tasks.workunit.client.1.smithi193.stdout:7/822: mknod d9/d11/dd4/dd2/c112 0 2024-09-04T16:30:16.689 INFO:tasks.workunit.client.1.smithi193.stdout:0/732: rmdir d18/d25/d5f/db4 0 2024-09-04T16:30:16.690 INFO:tasks.workunit.client.1.smithi193.stdout:0/733: chown d18/d25/d5f/d6a/d7b/f96 808517839 1 2024-09-04T16:30:16.692 INFO:tasks.workunit.client.0.smithi170.stdout:1/355: unlink d9/d11/d3e/f4e 0 2024-09-04T16:30:16.694 INFO:tasks.workunit.client.1.smithi193.stdout:2/711: write d2/d9/db/f75 [403930,126985] 0 2024-09-04T16:30:16.696 INFO:tasks.workunit.client.0.smithi170.stdout:1/356: unlink d9/l69 0 2024-09-04T16:30:16.697 INFO:tasks.workunit.client.1.smithi193.stdout:5/742: truncate d1/d29/d18/f2f 116808 0 2024-09-04T16:30:16.698 INFO:tasks.workunit.client.1.smithi193.stdout:3/725: dread d0/d18/d1c/d51/d7a/f98 [4194304,4194304] 0 2024-09-04T16:30:16.699 INFO:tasks.workunit.client.1.smithi193.stdout:6/698: symlink d5/d27/d3e/d43/d5d/d97/lde 0 2024-09-04T16:30:16.699 INFO:tasks.workunit.client.1.smithi193.stdout:3/726: dread - d0/d18/d1b/dab/fba zero size 2024-09-04T16:30:16.700 INFO:tasks.workunit.client.1.smithi193.stdout:1/781: truncate d1/d2b/d10/fbc 3796146 0 2024-09-04T16:30:16.700 INFO:tasks.workunit.client.1.smithi193.stdout:4/649: mknod d3/d1a/d2a/db9/cd8 0 2024-09-04T16:30:16.702 INFO:tasks.workunit.client.1.smithi193.stdout:8/745: truncate d2/d20/d23/d34/d3e/f41 2740653 0 2024-09-04T16:30:16.702 INFO:tasks.workunit.client.1.smithi193.stdout:2/712: truncate d2/d9/db/d10/d1f/d22/f33 975121 0 2024-09-04T16:30:16.702 INFO:tasks.workunit.client.1.smithi193.stdout:3/727: dread - d0/d18/d1b/dab/fba zero size 2024-09-04T16:30:16.703 INFO:tasks.workunit.client.1.smithi193.stdout:5/743: symlink d1/d8/db/d15/d2b/lf2 0 2024-09-04T16:30:16.703 INFO:tasks.workunit.client.1.smithi193.stdout:9/786: dwrite d2/d56/f75 [0,4194304] 0 2024-09-04T16:30:16.704 INFO:tasks.workunit.client.1.smithi193.stdout:9/787: chown d2 1087 1 2024-09-04T16:30:16.705 INFO:tasks.workunit.client.1.smithi193.stdout:1/782: truncate d1/d2b/d10/db7/dc8/fcc 429732 0 2024-09-04T16:30:16.705 INFO:tasks.workunit.client.1.smithi193.stdout:2/713: dread - d2/d9/db/d10/d4e/f81 zero size 2024-09-04T16:30:16.723 INFO:tasks.workunit.client.1.smithi193.stdout:6/699: creat d5/d27/dc6/fdf x:0 0 0 2024-09-04T16:30:16.723 INFO:tasks.workunit.client.1.smithi193.stdout:7/823: rename d9/d18/d22/d2b/da6 to d9/d11/d113 0 2024-09-04T16:30:16.724 INFO:tasks.workunit.client.1.smithi193.stdout:3/728: creat d0/d9/d49/d7d/fec x:0 0 0 2024-09-04T16:30:16.725 INFO:tasks.workunit.client.1.smithi193.stdout:2/714: write d2/d9/db/d10/f5c [422119,113912] 0 2024-09-04T16:30:16.728 INFO:tasks.workunit.client.0.smithi170.stdout:1/357: dwrite d9/d34/f63 [0,4194304] 0 2024-09-04T16:30:16.728 INFO:tasks.workunit.client.1.smithi193.stdout:1/783: readlink d1/d2b/l85 0 2024-09-04T16:30:16.729 INFO:tasks.workunit.client.1.smithi193.stdout:7/824: rmdir d9/d39/d95 39 2024-09-04T16:30:16.729 INFO:tasks.workunit.client.1.smithi193.stdout:6/700: truncate d5/d27/d3e/d43/d5d/d97/fba 234944 0 2024-09-04T16:30:16.730 INFO:tasks.workunit.client.1.smithi193.stdout:3/729: creat d0/d9/dae/fed x:0 0 0 2024-09-04T16:30:16.733 INFO:tasks.workunit.client.1.smithi193.stdout:5/744: creat d1/d8/db/d36/d40/d46/ff3 x:0 0 0 2024-09-04T16:30:16.734 INFO:tasks.workunit.client.1.smithi193.stdout:8/746: dwrite d2/d20/d23/f1d [0,4194304] 0 2024-09-04T16:30:16.735 INFO:tasks.workunit.client.1.smithi193.stdout:0/734: rename d18/d25/d5f/d65/d9f to d18/d25/d5f/def 0 2024-09-04T16:30:16.736 INFO:tasks.workunit.client.1.smithi193.stdout:7/825: mkdir d9/d85/d114 0 2024-09-04T16:30:16.739 INFO:tasks.workunit.client.1.smithi193.stdout:6/701: mkdir d5/d33/d4e/d51/d7b/de0 0 2024-09-04T16:30:16.741 INFO:tasks.workunit.client.1.smithi193.stdout:7/826: readlink d9/d11/l21 0 2024-09-04T16:30:16.741 INFO:tasks.workunit.client.1.smithi193.stdout:0/735: unlink d18/d25/f8a 0 2024-09-04T16:30:16.742 INFO:tasks.workunit.client.0.smithi170.stdout:1/358: dread d9/f55 [0,4194304] 0 2024-09-04T16:30:16.743 INFO:tasks.workunit.client.1.smithi193.stdout:5/745: symlink d1/d8/db/d15/lf4 0 2024-09-04T16:30:16.744 INFO:tasks.workunit.client.0.smithi170.stdout:1/359: fdatasync d9/d11/f3f 0 2024-09-04T16:30:16.745 INFO:tasks.workunit.client.1.smithi193.stdout:2/715: dwrite d2/d9/db/d10/d38/da5/fbb [0,4194304] 0 2024-09-04T16:30:16.746 INFO:tasks.workunit.client.1.smithi193.stdout:9/788: rename d2/d18/d2f/l9f to d2/d18/d2f/d22/d30/d6a/d6e/de2/lf7 0 2024-09-04T16:30:16.748 INFO:tasks.workunit.client.1.smithi193.stdout:0/736: write d18/d25/d5f/fa1 [650307,126197] 0 2024-09-04T16:30:16.748 INFO:tasks.workunit.client.1.smithi193.stdout:8/747: read - d2/d20/d23/d34/dd6/da0/da8/db9/f8c zero size 2024-09-04T16:30:16.748 INFO:tasks.workunit.client.1.smithi193.stdout:7/827: chown d9/d39/d3e/d4d/d4f/lcc 1933804 1 2024-09-04T16:30:16.749 INFO:tasks.workunit.client.1.smithi193.stdout:6/702: chown d5/d33/d4e/d51/d71/d82/f9c 1098 1 2024-09-04T16:30:16.750 INFO:tasks.workunit.client.0.smithi170.stdout:1/360: symlink d9/d26/l73 0 2024-09-04T16:30:16.751 INFO:tasks.workunit.client.1.smithi193.stdout:1/784: dwrite d1/d2b/db/f9a [0,4194304] 0 2024-09-04T16:30:16.752 INFO:tasks.workunit.client.1.smithi193.stdout:0/737: chown d18/d25/d32/d57/d6c/fbe 28195298 1 2024-09-04T16:30:16.755 INFO:tasks.workunit.client.1.smithi193.stdout:9/789: truncate d2/d18/d2f/d9a/de4/ff5 447038 0 2024-09-04T16:30:16.756 INFO:tasks.workunit.client.1.smithi193.stdout:7/828: symlink d9/d39/d3e/d4d/d98/l115 0 2024-09-04T16:30:16.756 INFO:tasks.workunit.client.0.smithi170.stdout:1/361: symlink d9/d11/d3e/d6a/l74 0 2024-09-04T16:30:16.758 INFO:tasks.workunit.client.1.smithi193.stdout:1/785: symlink d1/d2b/d1b/d28/d50/lee 0 2024-09-04T16:30:16.759 INFO:tasks.workunit.client.1.smithi193.stdout:6/703: creat d5/d33/d4e/d51/d68/fe1 x:0 0 0 2024-09-04T16:30:16.760 INFO:tasks.workunit.client.0.smithi170.stdout:1/362: symlink d9/d11/d3e/l75 0 2024-09-04T16:30:16.764 INFO:tasks.workunit.client.1.smithi193.stdout:0/738: rename d18/d25/d3b/fb7 to d18/d79/d88/d9a/ff0 0 2024-09-04T16:30:16.765 INFO:tasks.workunit.client.1.smithi193.stdout:0/739: chown d18/d25/d32/d57/d6c/db1/deb 11 1 2024-09-04T16:30:16.766 INFO:tasks.workunit.client.1.smithi193.stdout:1/786: mkdir d1/d39/d48/def 0 2024-09-04T16:30:16.767 INFO:tasks.workunit.client.1.smithi193.stdout:6/704: fsync d5/d27/d3e/d43/f57 0 2024-09-04T16:30:16.768 INFO:tasks.workunit.client.1.smithi193.stdout:1/787: stat d1/d2b/d10/d56/faa 0 2024-09-04T16:30:16.768 INFO:tasks.workunit.client.1.smithi193.stdout:3/730: dread d0/d3b/fc9 [0,4194304] 0 2024-09-04T16:30:16.769 INFO:tasks.workunit.client.1.smithi193.stdout:0/740: creat d18/d25/d32/d9c/da9/ff1 x:0 0 0 2024-09-04T16:30:16.771 INFO:tasks.workunit.client.1.smithi193.stdout:6/705: write d5/d27/faf [120965,36269] 0 2024-09-04T16:30:16.771 INFO:tasks.workunit.client.1.smithi193.stdout:7/829: rename d9/de/d27/d62/c64 to d9/d18/d22/d2b/d6c/c116 0 2024-09-04T16:30:16.771 INFO:tasks.workunit.client.1.smithi193.stdout:0/741: write d18/d25/d32/d57/f56 [2793458,126725] 0 2024-09-04T16:30:16.772 INFO:tasks.workunit.client.1.smithi193.stdout:3/731: unlink d0/d18/d1c/d30/c75 0 2024-09-04T16:30:16.776 INFO:tasks.workunit.client.1.smithi193.stdout:3/732: mkdir d0/d18/dee 0 2024-09-04T16:30:16.776 INFO:tasks.workunit.client.1.smithi193.stdout:6/706: dread d5/de/d15/d1b/d5f/fce [0,4194304] 0 2024-09-04T16:30:16.777 INFO:tasks.workunit.client.1.smithi193.stdout:1/788: dread d1/d2b/d1b/d28/f9d [0,4194304] 0 2024-09-04T16:30:16.778 INFO:tasks.workunit.client.1.smithi193.stdout:7/830: getdents d9/d11/dbd 0 2024-09-04T16:30:16.781 INFO:tasks.workunit.client.1.smithi193.stdout:1/789: creat d1/d39/d48/ff0 x:0 0 0 2024-09-04T16:30:16.782 INFO:tasks.workunit.client.1.smithi193.stdout:8/748: dread d2/d12/f19 [0,4194304] 0 2024-09-04T16:30:16.782 INFO:tasks.workunit.client.1.smithi193.stdout:6/707: creat d5/d33/d4e/d51/d7b/de0/fe2 x:0 0 0 2024-09-04T16:30:16.783 INFO:tasks.workunit.client.1.smithi193.stdout:2/716: truncate d2/f2a 467907 0 2024-09-04T16:30:16.783 INFO:tasks.workunit.client.1.smithi193.stdout:6/708: chown d5/d27/d3e/d8c 122590 1 2024-09-04T16:30:16.785 INFO:tasks.workunit.client.1.smithi193.stdout:9/790: write d2/d18/d2f/d22/d30/f72 [2211020,14713] 0 2024-09-04T16:30:16.786 INFO:tasks.workunit.client.1.smithi193.stdout:1/790: rename d1/d2b/db/f23 to d1/d2b/db/d54/da1/ff1 0 2024-09-04T16:30:16.787 INFO:tasks.workunit.client.1.smithi193.stdout:8/749: mkdir d2/d20/d23/ded 0 2024-09-04T16:30:16.788 INFO:tasks.workunit.client.1.smithi193.stdout:8/750: chown d2/d20/d23/d34/d4b/dd4 462058918 1 2024-09-04T16:30:16.788 INFO:tasks.workunit.client.1.smithi193.stdout:6/709: rmdir d5/d27/d3e/d6e 39 2024-09-04T16:30:16.789 INFO:tasks.workunit.client.1.smithi193.stdout:7/831: getdents d9/d11/dd4/dd2 0 2024-09-04T16:30:16.789 INFO:tasks.workunit.client.1.smithi193.stdout:8/751: stat d2/d20/d23/d34/d46/fec 0 2024-09-04T16:30:16.790 INFO:tasks.workunit.client.0.smithi170.stdout:1/363: dwrite d9/d11/f1e [0,4194304] 0 2024-09-04T16:30:16.790 INFO:tasks.workunit.client.0.smithi170.stdout:1/364: stat d9/d26/f46 0 2024-09-04T16:30:16.795 INFO:tasks.workunit.client.1.smithi193.stdout:7/832: dwrite d9/d18/d22/d2b/d96/ff6 [0,4194304] 0 2024-09-04T16:30:16.796 INFO:tasks.workunit.client.1.smithi193.stdout:1/791: creat d1/d39/d48/ff2 x:0 0 0 2024-09-04T16:30:16.796 INFO:tasks.workunit.client.1.smithi193.stdout:0/742: write f15 [4751100,83181] 0 2024-09-04T16:30:16.798 INFO:tasks.workunit.client.1.smithi193.stdout:7/833: read - d9/d11/dd4/dd2/fdf zero size 2024-09-04T16:30:16.799 INFO:tasks.workunit.client.1.smithi193.stdout:6/710: mknod d5/d33/d85/ce3 0 2024-09-04T16:30:16.804 INFO:tasks.workunit.client.0.smithi170.stdout:1/365: getdents d9/d34 0 2024-09-04T16:30:16.805 INFO:tasks.workunit.client.0.smithi170.stdout:1/366: chown d9/d11/l2c 27688 1 2024-09-04T16:30:16.806 INFO:tasks.workunit.client.1.smithi193.stdout:1/792: unlink d1/d39/d48/l79 0 2024-09-04T16:30:16.807 INFO:tasks.workunit.client.1.smithi193.stdout:0/743: mkdir d18/d25/d5f/d65/dc4/dd5/df2 0 2024-09-04T16:30:16.808 INFO:tasks.workunit.client.1.smithi193.stdout:2/717: truncate d2/d9/db/f75 270395 0 2024-09-04T16:30:16.809 INFO:tasks.workunit.client.1.smithi193.stdout:6/711: mknod d5/de/d15/d48/ce4 0 2024-09-04T16:30:16.811 INFO:tasks.workunit.client.1.smithi193.stdout:6/712: write d5/de/d15/d9f/fb9 [1339175,81036] 0 2024-09-04T16:30:16.811 INFO:tasks.workunit.client.1.smithi193.stdout:8/752: rename d2/d20/dc0/f6d to d2/d20/d23/fee 0 2024-09-04T16:30:16.812 INFO:tasks.workunit.client.1.smithi193.stdout:9/791: getdents d2/d18/d2f/d22/d30/d6a/d6e/d81 0 2024-09-04T16:30:16.813 INFO:tasks.workunit.client.1.smithi193.stdout:6/713: chown d5/d27/d3e/d43/l64 6999 1 2024-09-04T16:30:16.813 INFO:tasks.workunit.client.1.smithi193.stdout:9/792: stat d2/d8/d61 0 2024-09-04T16:30:16.813 INFO:tasks.workunit.client.1.smithi193.stdout:7/834: creat d9/d39/d3e/d69/f117 x:0 0 0 2024-09-04T16:30:16.816 INFO:tasks.workunit.client.1.smithi193.stdout:2/718: mknod d2/d9/db/d10/d1f/d4a/dc2/dc4/cea 0 2024-09-04T16:30:16.818 INFO:tasks.workunit.client.1.smithi193.stdout:3/733: rename d0/d9/d49/d87/ceb to d0/d18/d1c/d25/d5e/d7e/cef 0 2024-09-04T16:30:16.820 INFO:tasks.workunit.client.1.smithi193.stdout:8/753: write d2/d20/d23/f1d [3186409,73315] 0 2024-09-04T16:30:16.821 INFO:tasks.workunit.client.1.smithi193.stdout:9/793: creat d2/d8/d25/ded/ff8 x:0 0 0 2024-09-04T16:30:16.822 INFO:tasks.workunit.client.1.smithi193.stdout:1/793: dwrite d1/d2b/f45 [4194304,4194304] 0 2024-09-04T16:30:16.823 INFO:tasks.workunit.client.1.smithi193.stdout:0/744: creat d18/d25/d32/d57/d6c/db1/dc9/ff3 x:0 0 0 2024-09-04T16:30:16.823 INFO:tasks.workunit.client.0.smithi170.stdout:7/412: sync 2024-09-04T16:30:16.824 INFO:tasks.workunit.client.0.smithi170.stdout:7/413: stat lb 0 2024-09-04T16:30:16.825 INFO:tasks.workunit.client.1.smithi193.stdout:7/835: rename d9/de/ld6 to d9/d39/d3e/d4d/d98/d9a/db6/l118 0 2024-09-04T16:30:16.827 INFO:tasks.workunit.client.1.smithi193.stdout:6/714: dwrite d5/de/d15/d1b/d5f/fd0 [0,4194304] 0 2024-09-04T16:30:16.829 INFO:tasks.workunit.client.1.smithi193.stdout:0/745: chown d18/d25/d5f/d65/dc4/dd5/df2 50309 1 2024-09-04T16:30:16.832 INFO:tasks.workunit.client.1.smithi193.stdout:2/719: dwrite d2/f5e [0,4194304] 0 2024-09-04T16:30:16.833 INFO:tasks.workunit.client.1.smithi193.stdout:0/746: dread - d18/d25/d32/d57/d6c/db1/dc9/ff3 zero size 2024-09-04T16:30:16.835 INFO:tasks.workunit.client.0.smithi170.stdout:7/414: creat d12/d4b/d51/f8b x:0 0 0 2024-09-04T16:30:16.835 INFO:tasks.workunit.client.1.smithi193.stdout:9/794: truncate d2/d8/d25/dcb/fe7 167381 0 2024-09-04T16:30:16.835 INFO:tasks.workunit.client.1.smithi193.stdout:9/795: write d2/d8/d4d/ff3 [451027,109996] 0 2024-09-04T16:30:16.841 INFO:tasks.workunit.client.0.smithi170.stdout:1/367: dread d9/d11/d2f/d6b/d61/f6f [0,4194304] 0 2024-09-04T16:30:16.844 INFO:tasks.workunit.client.1.smithi193.stdout:1/794: symlink d1/d2b/d10/db7/lf3 0 2024-09-04T16:30:16.845 INFO:tasks.workunit.client.0.smithi170.stdout:7/415: fdatasync d12/f72 0 2024-09-04T16:30:16.848 INFO:tasks.workunit.client.1.smithi193.stdout:0/747: symlink d18/d79/d88/d9a/lf4 0 2024-09-04T16:30:16.850 INFO:tasks.workunit.client.1.smithi193.stdout:2/720: creat d2/d9/db/d10/d38/da5/feb x:0 0 0 2024-09-04T16:30:16.851 INFO:tasks.workunit.client.0.smithi170.stdout:7/416: mknod d12/d15/d71/d42/d79/c8c 0 2024-09-04T16:30:16.854 INFO:tasks.workunit.client.1.smithi193.stdout:7/836: fsync f3 0 2024-09-04T16:30:16.856 INFO:tasks.workunit.client.1.smithi193.stdout:7/837: chown d9/d39/d3e/d4d/d4f/ff9 31741 1 2024-09-04T16:30:16.857 INFO:tasks.workunit.client.0.smithi170.stdout:1/368: getdents d9/d34 0 2024-09-04T16:30:16.858 INFO:tasks.workunit.client.1.smithi193.stdout:3/734: dread d0/d18/d1c/d30/f4e [0,4194304] 0 2024-09-04T16:30:16.859 INFO:tasks.workunit.client.1.smithi193.stdout:4/650: sync 2024-09-04T16:30:16.860 INFO:tasks.workunit.client.1.smithi193.stdout:3/735: read d0/d7/fc [3819982,47590] 0 2024-09-04T16:30:16.860 INFO:tasks.workunit.client.0.smithi170.stdout:7/417: write d12/d15/d71/f70 [879746,59719] 0 2024-09-04T16:30:16.861 INFO:tasks.workunit.client.0.smithi170.stdout:7/418: write d12/d15/d41/f83 [945657,70273] 0 2024-09-04T16:30:16.862 INFO:tasks.workunit.client.0.smithi170.stdout:1/369: read d9/f2b [62664,68788] 0 2024-09-04T16:30:16.864 INFO:tasks.workunit.client.1.smithi193.stdout:0/748: mkdir d18/d25/d5f/d6a/d7b/df5 0 2024-09-04T16:30:16.865 INFO:tasks.workunit.client.1.smithi193.stdout:0/749: chown d18/d25/d32/f44 1835 1 2024-09-04T16:30:16.865 INFO:tasks.workunit.client.0.smithi170.stdout:7/419: mkdir d12/d16/d8d 0 2024-09-04T16:30:16.866 INFO:tasks.workunit.client.1.smithi193.stdout:9/796: mkdir d2/d8/d25/df9 0 2024-09-04T16:30:16.867 INFO:tasks.workunit.client.0.smithi170.stdout:1/370: symlink d9/d11/d3e/d6a/l76 0 2024-09-04T16:30:16.869 INFO:tasks.workunit.client.1.smithi193.stdout:9/797: dread d2/d18/fbd [0,4194304] 0 2024-09-04T16:30:16.870 INFO:tasks.workunit.client.0.smithi170.stdout:1/371: mkdir d9/d26/d77 0 2024-09-04T16:30:16.871 INFO:tasks.workunit.client.1.smithi193.stdout:8/754: rmdir d2/d20/d23/d34/dd6/da0/dea 0 2024-09-04T16:30:16.873 INFO:tasks.workunit.client.0.smithi170.stdout:1/372: unlink d9/d11/d3e/l5e 0 2024-09-04T16:30:16.874 INFO:tasks.workunit.client.1.smithi193.stdout:6/715: creat d5/d27/d3e/fe5 x:0 0 0 2024-09-04T16:30:16.875 INFO:tasks.workunit.client.0.smithi170.stdout:1/373: chown d9/c30 391 1 2024-09-04T16:30:16.877 INFO:tasks.workunit.client.0.smithi170.stdout:7/420: getdents d12/d15 0 2024-09-04T16:30:16.878 INFO:tasks.workunit.client.1.smithi193.stdout:3/736: rename d0/d9/dae/dce/le1 to d0/d18/d1c/d25/d5e/d68/lf0 0 2024-09-04T16:30:16.880 INFO:tasks.workunit.client.1.smithi193.stdout:2/721: symlink d2/d9/db/d10/lec 0 2024-09-04T16:30:16.882 INFO:tasks.workunit.client.0.smithi170.stdout:7/421: symlink d12/d4b/d51/l8e 0 2024-09-04T16:30:16.882 INFO:tasks.workunit.client.1.smithi193.stdout:0/750: creat d18/d25/ff6 x:0 0 0 2024-09-04T16:30:16.886 INFO:tasks.workunit.client.1.smithi193.stdout:6/716: dread d5/de/d15/d48/f65 [0,4194304] 0 2024-09-04T16:30:16.891 INFO:tasks.workunit.client.1.smithi193.stdout:1/795: truncate d1/d2b/d1b/d28/f9d 41070 0 2024-09-04T16:30:16.891 INFO:tasks.workunit.client.1.smithi193.stdout:8/755: mknod d2/d20/d23/d34/d46/d53/cef 0 2024-09-04T16:30:16.892 INFO:tasks.workunit.client.1.smithi193.stdout:2/722: dread d2/d9/db/d10/d1e/da4/d9a/fa9 [0,4194304] 0 2024-09-04T16:30:16.893 INFO:tasks.workunit.client.0.smithi170.stdout:0/409: sync 2024-09-04T16:30:16.893 INFO:tasks.workunit.client.0.smithi170.stdout:8/305: sync 2024-09-04T16:30:16.893 INFO:tasks.workunit.client.0.smithi170.stdout:4/339: sync 2024-09-04T16:30:16.893 INFO:tasks.workunit.client.0.smithi170.stdout:9/276: sync 2024-09-04T16:30:16.893 INFO:tasks.workunit.client.0.smithi170.stdout:3/213: sync 2024-09-04T16:30:16.893 INFO:tasks.workunit.client.0.smithi170.stdout:2/303: sync 2024-09-04T16:30:16.893 INFO:tasks.workunit.client.0.smithi170.stdout:6/257: sync 2024-09-04T16:30:16.896 INFO:tasks.workunit.client.0.smithi170.stdout:9/277: dread d2/d3d/f1f [0,4194304] 0 2024-09-04T16:30:16.899 INFO:tasks.workunit.client.1.smithi193.stdout:0/751: mknod d18/d25/d5f/def/da0/cf7 0 2024-09-04T16:30:16.899 INFO:tasks.workunit.client.0.smithi170.stdout:1/374: link d9/d26/f46 d9/d26/f78 0 2024-09-04T16:30:16.904 INFO:tasks.workunit.client.1.smithi193.stdout:7/838: rmdir d9/d39/d3e/d4d/d4f/dab/d109 0 2024-09-04T16:30:16.906 INFO:tasks.workunit.client.1.smithi193.stdout:6/717: dread d5/ff [0,4194304] 0 2024-09-04T16:30:16.906 INFO:tasks.workunit.client.1.smithi193.stdout:9/798: mkdir d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/df4/dfa 0 2024-09-04T16:30:16.908 INFO:tasks.workunit.client.1.smithi193.stdout:9/799: stat d2/d8/d25/dcb/fe7 0 2024-09-04T16:30:16.908 INFO:tasks.workunit.client.0.smithi170.stdout:3/214: mkdir d13/d14/d21/d46 0 2024-09-04T16:30:16.909 INFO:tasks.workunit.client.1.smithi193.stdout:1/796: creat d1/d2b/db/d7f/ff4 x:0 0 0 2024-09-04T16:30:16.910 INFO:tasks.workunit.client.0.smithi170.stdout:2/304: creat d3/d4/d14/f5d x:0 0 0 2024-09-04T16:30:16.914 INFO:tasks.workunit.client.1.smithi193.stdout:5/746: sync 2024-09-04T16:30:16.915 INFO:tasks.workunit.client.0.smithi170.stdout:9/278: mknod d2/d3d/d27/d2b/d34/c4b 0 2024-09-04T16:30:16.916 INFO:tasks.workunit.client.1.smithi193.stdout:5/747: chown d1/d8/db/d36/ca9 10 1 2024-09-04T16:30:16.916 INFO:tasks.workunit.client.1.smithi193.stdout:4/651: link d3/d3c/d47/c5d d3/d39/d44/dd5/cd9 0 2024-09-04T16:30:16.916 INFO:tasks.workunit.client.1.smithi193.stdout:4/652: read d3/d3c/f88 [567748,36469] 0 2024-09-04T16:30:16.917 INFO:tasks.workunit.client.0.smithi170.stdout:1/375: mkdir d9/d11/d3e/d6a/d79 0 2024-09-04T16:30:16.918 INFO:tasks.workunit.client.1.smithi193.stdout:3/737: mknod d0/d18/cf1 0 2024-09-04T16:30:16.920 INFO:tasks.workunit.client.1.smithi193.stdout:5/748: dwrite d1/dc3/f25 [0,4194304] 0 2024-09-04T16:30:16.924 INFO:tasks.workunit.client.1.smithi193.stdout:0/752: chown d18/d25/d32/lc6 121894 1 2024-09-04T16:30:16.924 INFO:tasks.workunit.client.1.smithi193.stdout:0/753: readlink l7 0 2024-09-04T16:30:16.925 INFO:tasks.workunit.client.1.smithi193.stdout:0/754: truncate d18/d25/d5f/d65/fb2 296333 0 2024-09-04T16:30:16.925 INFO:tasks.workunit.client.0.smithi170.stdout:6/258: mknod d0/d17/d31/c53 0 2024-09-04T16:30:16.926 INFO:tasks.workunit.client.1.smithi193.stdout:7/839: truncate d9/d39/d3e/d69/f80 235236 0 2024-09-04T16:30:16.928 INFO:tasks.workunit.client.0.smithi170.stdout:3/215: rmdir d13 39 2024-09-04T16:30:16.930 INFO:tasks.workunit.client.0.smithi170.stdout:2/305: creat d3/d3c/d40/d48/f5e x:0 0 0 2024-09-04T16:30:16.932 INFO:tasks.workunit.client.1.smithi193.stdout:8/756: dwrite d2/d20/d23/d34/d46/d53/f64 [0,4194304] 0 2024-09-04T16:30:16.933 INFO:tasks.workunit.client.1.smithi193.stdout:2/723: dwrite d2/d9/db/f89 [0,4194304] 0 2024-09-04T16:30:16.933 INFO:tasks.workunit.client.1.smithi193.stdout:8/757: dread - d2/d20/f8f zero size 2024-09-04T16:30:16.934 INFO:tasks.workunit.client.1.smithi193.stdout:8/758: write d2/d20/d23/d34/d3e/d6f/d81/fa4 [1052826,113415] 0 2024-09-04T16:30:16.938 INFO:tasks.workunit.client.0.smithi170.stdout:9/279: readlink d2/l21 0 2024-09-04T16:30:16.944 INFO:tasks.workunit.client.0.smithi170.stdout:7/422: link d12/l33 d12/d15/l8f 0 2024-09-04T16:30:16.944 INFO:tasks.workunit.client.0.smithi170.stdout:2/306: dwrite d3/db/d1c/f42 [0,4194304] 0 2024-09-04T16:30:16.949 INFO:tasks.workunit.client.0.smithi170.stdout:6/259: rename d0/df/d1b/d3e/d47/c52 to d0/df/d1f/c54 0 2024-09-04T16:30:16.949 INFO:tasks.workunit.client.0.smithi170.stdout:8/306: dwrite d6/f4f [0,4194304] 0 2024-09-04T16:30:16.955 INFO:tasks.workunit.client.0.smithi170.stdout:0/410: dwrite d11/d13/d2f/f31 [0,4194304] 0 2024-09-04T16:30:16.955 INFO:tasks.workunit.client.0.smithi170.stdout:4/340: truncate d1/d6/d8/d20/d35/d3e/d4e/d51/f5c 2857959 0 2024-09-04T16:30:16.958 INFO:tasks.workunit.client.1.smithi193.stdout:6/718: mkdir d5/de/d15/d1b/d5f/da7/dd1/de6 0 2024-09-04T16:30:16.962 INFO:tasks.workunit.client.0.smithi170.stdout:1/376: dwrite d9/f37 [0,4194304] 0 2024-09-04T16:30:16.962 INFO:tasks.workunit.client.0.smithi170.stdout:1/377: dread - d9/d11/d2f/d6b/f72 zero size 2024-09-04T16:30:16.962 INFO:tasks.workunit.client.1.smithi193.stdout:1/797: dwrite d1/d2b/d10/f17 [4194304,4194304] 0 2024-09-04T16:30:16.965 INFO:tasks.workunit.client.0.smithi170.stdout:1/378: chown d9/d11/f21 428 1 2024-09-04T16:30:16.965 INFO:tasks.workunit.client.1.smithi193.stdout:1/798: read d1/d2b/d10/db7/dc8/fcc [22596,112908] 0 2024-09-04T16:30:16.972 INFO:tasks.workunit.client.0.smithi170.stdout:9/280: dwrite d2/d3d/d35/f43 [0,4194304] 0 2024-09-04T16:30:16.974 INFO:tasks.workunit.client.1.smithi193.stdout:8/759: symlink d2/d20/d23/d24/d3c/d65/lf0 0 2024-09-04T16:30:16.976 INFO:tasks.workunit.client.0.smithi170.stdout:3/216: unlink d13/d14/d17/d1c/f3b 0 2024-09-04T16:30:16.976 INFO:tasks.workunit.client.1.smithi193.stdout:3/738: fdatasync d0/d18/d1c/d6e/fd5 0 2024-09-04T16:30:16.977 INFO:tasks.workunit.client.1.smithi193.stdout:3/739: write d0/d18/d1c/d51/fca [1192969,56584] 0 2024-09-04T16:30:16.979 INFO:tasks.workunit.client.0.smithi170.stdout:8/307: creat d6/d28/d16/d52/f6c x:0 0 0 2024-09-04T16:30:16.981 INFO:tasks.workunit.client.0.smithi170.stdout:7/423: read - d12/d15/d71/f5b zero size 2024-09-04T16:30:16.983 INFO:tasks.workunit.client.1.smithi193.stdout:9/800: rename d2/d56/cc4 to d2/cfb 0 2024-09-04T16:30:16.984 INFO:tasks.workunit.client.1.smithi193.stdout:4/653: rename d3/da3/dd2 to d3/da3/dd2/dda 22 2024-09-04T16:30:16.986 INFO:tasks.workunit.client.1.smithi193.stdout:4/654: write d3/d39/d44/dd5/d7b/f91 [1232272,120022] 0 2024-09-04T16:30:16.986 INFO:tasks.workunit.client.0.smithi170.stdout:9/281: mknod d2/d3d/d27/d2b/c4c 0 2024-09-04T16:30:16.988 INFO:tasks.workunit.client.1.smithi193.stdout:1/799: creat d1/d39/d48/ff5 x:0 0 0 2024-09-04T16:30:16.989 INFO:tasks.workunit.client.0.smithi170.stdout:4/341: symlink d1/d6/d2b/d33/l77 0 2024-09-04T16:30:16.990 INFO:tasks.workunit.client.0.smithi170.stdout:8/308: chown d6/c6a 3168 1 2024-09-04T16:30:16.992 INFO:tasks.workunit.client.1.smithi193.stdout:7/840: creat d9/d18/d22/d2b/d6c/f119 x:0 0 0 2024-09-04T16:30:16.993 INFO:tasks.workunit.client.1.smithi193.stdout:8/760: dwrite d2/d20/dc0/fd5 [4194304,4194304] 0 2024-09-04T16:30:16.994 INFO:tasks.workunit.client.0.smithi170.stdout:3/217: creat d13/d14/d1f/d40/f47 x:0 0 0 2024-09-04T16:30:16.995 INFO:tasks.workunit.client.1.smithi193.stdout:0/755: rename d18/d25/d32/d57/d6c/l7c to d18/d25/d32/d9c/da9/lf8 0 2024-09-04T16:30:16.996 INFO:tasks.workunit.client.0.smithi170.stdout:4/342: mkdir d1/d6/d2b/d47/d78 0 2024-09-04T16:30:16.998 INFO:tasks.workunit.client.0.smithi170.stdout:8/309: mkdir d6/d28/d16/d24/d6d 0 2024-09-04T16:30:16.998 INFO:tasks.workunit.client.0.smithi170.stdout:1/379: link d9/c30 d9/d11/d2f/c7a 0 2024-09-04T16:30:16.999 INFO:tasks.workunit.client.0.smithi170.stdout:8/310: chown d6/d28/d16/d24/d46/c58 1 1 2024-09-04T16:30:17.000 INFO:tasks.workunit.client.0.smithi170.stdout:8/311: fsync d6/d28/d20/d5e/f5b 0 2024-09-04T16:30:17.000 INFO:tasks.workunit.client.1.smithi193.stdout:2/724: creat d2/d9/db/d10/d51/fed x:0 0 0 2024-09-04T16:30:17.001 INFO:tasks.workunit.client.0.smithi170.stdout:9/282: mkdir d2/d3d/d4d 0 2024-09-04T16:30:17.002 INFO:tasks.workunit.client.1.smithi193.stdout:4/655: mknod d3/d39/d44/dd5/daa/cdb 0 2024-09-04T16:30:17.004 INFO:tasks.workunit.client.0.smithi170.stdout:3/218: fdatasync d13/d14/d1f/f3e 0 2024-09-04T16:30:17.004 INFO:tasks.workunit.client.1.smithi193.stdout:4/656: write d3/d39/f6b [4065717,113337] 0 2024-09-04T16:30:17.004 INFO:tasks.workunit.client.1.smithi193.stdout:2/725: truncate d2/d9/db/d10/d1e/da4/d9a/fe8 1035148 0 2024-09-04T16:30:17.005 INFO:tasks.workunit.client.0.smithi170.stdout:1/380: dread d9/d11/d2f/d6b/d61/f6f [0,4194304] 0 2024-09-04T16:30:17.006 INFO:tasks.workunit.client.0.smithi170.stdout:1/381: write d9/d11/d2e/f52 [635505,121882] 0 2024-09-04T16:30:17.006 INFO:tasks.workunit.client.0.smithi170.stdout:7/424: symlink d12/d16/d1d/l90 0 2024-09-04T16:30:17.007 INFO:tasks.workunit.client.1.smithi193.stdout:1/800: read d1/d2b/d10/f21 [695496,39372] 0 2024-09-04T16:30:17.008 INFO:tasks.workunit.client.0.smithi170.stdout:7/425: readlink d12/d15/d71/d42/l57 0 2024-09-04T16:30:17.008 INFO:tasks.workunit.client.0.smithi170.stdout:1/382: fsync d9/d34/d5f/f67 0 2024-09-04T16:30:17.009 INFO:tasks.workunit.client.0.smithi170.stdout:8/312: mkdir d6/d28/d20/d6e 0 2024-09-04T16:30:17.009 INFO:tasks.workunit.client.0.smithi170.stdout:1/383: write d9/d11/f43 [924516,94544] 0 2024-09-04T16:30:17.010 INFO:tasks.workunit.client.1.smithi193.stdout:7/841: rmdir d9/d39 39 2024-09-04T16:30:17.010 INFO:tasks.workunit.client.1.smithi193.stdout:4/657: dread d3/d3c/d89/f8c [0,4194304] 0 2024-09-04T16:30:17.012 INFO:tasks.workunit.client.0.smithi170.stdout:6/260: write d0/f4 [4487851,83130] 0 2024-09-04T16:30:17.012 INFO:tasks.workunit.client.0.smithi170.stdout:9/283: symlink d2/d11/d23/l4e 0 2024-09-04T16:30:17.012 INFO:tasks.workunit.client.1.smithi193.stdout:4/658: chown d3/d1a/d54/l6f 208725 1 2024-09-04T16:30:17.014 INFO:tasks.workunit.client.1.smithi193.stdout:0/756: truncate d18/d25/f3c 1651945 0 2024-09-04T16:30:17.014 INFO:tasks.workunit.client.0.smithi170.stdout:7/426: dread fa [0,4194304] 0 2024-09-04T16:30:17.015 INFO:tasks.workunit.client.1.smithi193.stdout:1/801: dwrite d1/d2b/d1b/d51/d6d/fde [0,4194304] 0 2024-09-04T16:30:17.016 INFO:tasks.workunit.client.0.smithi170.stdout:1/384: dread d9/d11/d2e/f52 [0,4194304] 0 2024-09-04T16:30:17.017 INFO:tasks.workunit.client.1.smithi193.stdout:8/761: dread d2/f8 [0,4194304] 0 2024-09-04T16:30:17.021 INFO:tasks.workunit.client.1.smithi193.stdout:2/726: rmdir d2/db7 39 2024-09-04T16:30:17.022 INFO:tasks.workunit.client.0.smithi170.stdout:8/313: mknod d6/d28/d1a/c6f 0 2024-09-04T16:30:17.023 INFO:tasks.workunit.client.1.smithi193.stdout:5/749: dwrite d1/d8/db/d15/d2b/d83/d37/d58/d9e/da7/fbf [0,4194304] 0 2024-09-04T16:30:17.024 INFO:tasks.workunit.client.1.smithi193.stdout:8/762: write d2/d20/d23/d24/d3c/fb1 [306416,82639] 0 2024-09-04T16:30:17.025 INFO:tasks.workunit.client.1.smithi193.stdout:6/719: dwrite d5/de/d15/f2f [0,4194304] 0 2024-09-04T16:30:17.029 INFO:tasks.workunit.client.1.smithi193.stdout:4/659: mkdir d3/d3c/d89/dbd/ddc 0 2024-09-04T16:30:17.033 INFO:tasks.workunit.client.1.smithi193.stdout:4/660: truncate d3/d1a/d21/f2c 5818491 0 2024-09-04T16:30:17.036 INFO:tasks.workunit.client.1.smithi193.stdout:6/720: dwrite d5/d27/d3e/f89 [0,4194304] 0 2024-09-04T16:30:17.040 INFO:tasks.workunit.client.1.smithi193.stdout:3/740: link d0/d18/d1c/d51/d6c/l8c d0/d18/d1c/d25/d5e/d7e/lf2 0 2024-09-04T16:30:17.041 INFO:tasks.workunit.client.1.smithi193.stdout:2/727: symlink d2/d9/db/d10/d38/d7a/lee 0 2024-09-04T16:30:17.042 INFO:tasks.workunit.client.1.smithi193.stdout:4/661: dwrite d3/d3c/dae/fd6 [0,4194304] 0 2024-09-04T16:30:17.043 INFO:tasks.workunit.client.0.smithi170.stdout:9/284: mknod d2/d3d/c4f 0 2024-09-04T16:30:17.045 INFO:tasks.workunit.client.1.smithi193.stdout:5/750: mknod d1/d8/db/d36/d40/cf5 0 2024-09-04T16:30:17.049 INFO:tasks.workunit.client.0.smithi170.stdout:3/219: creat d13/d14/f48 x:0 0 0 2024-09-04T16:30:17.050 INFO:tasks.workunit.client.0.smithi170.stdout:9/285: dwrite d2/f4 [0,4194304] 0 2024-09-04T16:30:17.051 INFO:tasks.workunit.client.1.smithi193.stdout:9/801: truncate d2/d8/d15/f71 3637848 0 2024-09-04T16:30:17.052 INFO:tasks.workunit.client.1.smithi193.stdout:8/763: rename d2/d20/d23/d34/dd6/l39 to d2/d20/d23/d24/d3c/d65/lf1 0 2024-09-04T16:30:17.053 INFO:tasks.workunit.client.0.smithi170.stdout:7/427: creat d12/d16/d1d/d65/d82/f91 x:0 0 0 2024-09-04T16:30:17.055 INFO:tasks.workunit.client.1.smithi193.stdout:0/757: unlink d18/d25/d32/d57/c73 0 2024-09-04T16:30:17.056 INFO:tasks.workunit.client.0.smithi170.stdout:1/385: mkdir d9/d7b 0 2024-09-04T16:30:17.059 INFO:tasks.workunit.client.1.smithi193.stdout:3/741: dwrite d0/d10/fe7 [0,4194304] 0 2024-09-04T16:30:17.060 INFO:tasks.workunit.client.0.smithi170.stdout:3/220: symlink d13/l49 0 2024-09-04T16:30:17.060 INFO:tasks.workunit.client.1.smithi193.stdout:6/721: mkdir d5/d33/d4e/d51/d68/de7 0 2024-09-04T16:30:17.061 INFO:tasks.workunit.client.0.smithi170.stdout:9/286: mknod d2/d32/c50 0 2024-09-04T16:30:17.062 INFO:tasks.workunit.client.1.smithi193.stdout:0/758: fdatasync d18/d25/d32/f52 0 2024-09-04T16:30:17.062 INFO:tasks.workunit.client.1.smithi193.stdout:2/728: creat d2/d9/db/d10/d38/d63/fef x:0 0 0 2024-09-04T16:30:17.062 INFO:tasks.workunit.client.1.smithi193.stdout:4/662: rmdir d3/d1a/d21 39 2024-09-04T16:30:17.062 INFO:tasks.workunit.client.0.smithi170.stdout:7/428: creat d12/d15/d71/d42/d79/f92 x:0 0 0 2024-09-04T16:30:17.064 INFO:tasks.workunit.client.1.smithi193.stdout:4/663: dread - d3/d3c/d47/fc6 zero size 2024-09-04T16:30:17.064 INFO:tasks.workunit.client.1.smithi193.stdout:2/729: write d2/d9/fdd [1148687,69581] 0 2024-09-04T16:30:17.065 INFO:tasks.workunit.client.0.smithi170.stdout:7/429: rename d12/d15/d71/d42/d81 to d12/d15/d71/d42/d81/d5c/d93 22 2024-09-04T16:30:17.066 INFO:tasks.workunit.client.1.smithi193.stdout:5/751: dwrite d1/d8/db/d36/d40/d46/f8b [0,4194304] 0 2024-09-04T16:30:17.066 INFO:tasks.workunit.client.0.smithi170.stdout:8/314: rmdir d6/d28/d16/d24/d6d 0 2024-09-04T16:30:17.068 INFO:tasks.workunit.client.0.smithi170.stdout:8/315: fdatasync d6/d28/d1a/f42 0 2024-09-04T16:30:17.069 INFO:tasks.workunit.client.0.smithi170.stdout:8/316: chown d6/d26/f2b 90 1 2024-09-04T16:30:17.072 INFO:tasks.workunit.client.0.smithi170.stdout:1/386: write d9/d11/d2e/f52 [1961637,79950] 0 2024-09-04T16:30:17.073 INFO:tasks.workunit.client.0.smithi170.stdout:9/287: read d2/f17 [527769,83306] 0 2024-09-04T16:30:17.075 INFO:tasks.workunit.client.0.smithi170.stdout:9/288: write d2/d11/d23/f30 [3358462,92840] 0 2024-09-04T16:30:17.075 INFO:tasks.workunit.client.0.smithi170.stdout:7/430: creat d12/d15/d71/d42/d81/d5c/f94 x:0 0 0 2024-09-04T16:30:17.077 INFO:tasks.workunit.client.0.smithi170.stdout:7/431: dread - d12/d16/d1d/d65/f89 zero size 2024-09-04T16:30:17.078 INFO:tasks.workunit.client.1.smithi193.stdout:1/802: write d1/d2b/d10/f21 [2149678,26188] 0 2024-09-04T16:30:17.079 INFO:tasks.workunit.client.0.smithi170.stdout:5/243: sync 2024-09-04T16:30:17.079 INFO:tasks.workunit.client.0.smithi170.stdout:8/317: rmdir d6/d28/d16/d24/d46 39 2024-09-04T16:30:17.080 INFO:tasks.workunit.client.0.smithi170.stdout:5/244: chown d4/d8/d1c/d23 1634733 1 2024-09-04T16:30:17.081 INFO:tasks.workunit.client.0.smithi170.stdout:8/318: chown d6/d28/l12 57 1 2024-09-04T16:30:17.084 INFO:tasks.workunit.client.0.smithi170.stdout:7/432: write d12/d15/d41/f83 [1121739,38295] 0 2024-09-04T16:30:17.085 INFO:tasks.workunit.client.0.smithi170.stdout:5/245: dread d4/f6 [0,4194304] 0 2024-09-04T16:30:17.086 INFO:tasks.workunit.client.0.smithi170.stdout:8/319: mkdir d6/d28/d5f/d70 0 2024-09-04T16:30:17.086 INFO:tasks.workunit.client.1.smithi193.stdout:9/802: dread d2/d56/fbe [4194304,4194304] 0 2024-09-04T16:30:17.088 INFO:tasks.workunit.client.0.smithi170.stdout:1/387: mkdir d9/d11/d3e/d6a/d79/d7c 0 2024-09-04T16:30:17.089 INFO:tasks.workunit.client.0.smithi170.stdout:3/221: getdents d13/d14/d17/d1c 0 2024-09-04T16:30:17.090 INFO:tasks.workunit.client.0.smithi170.stdout:6/261: truncate d0/d15/f26 2687402 0 2024-09-04T16:30:17.090 INFO:tasks.workunit.client.0.smithi170.stdout:5/246: dread d4/d8/d1c/d26/d27/f38 [0,4194304] 0 2024-09-04T16:30:17.097 INFO:tasks.workunit.client.0.smithi170.stdout:9/289: dread d2/d11/f24 [0,4194304] 0 2024-09-04T16:30:17.110 INFO:tasks.workunit.client.0.smithi170.stdout:9/290: symlink d2/d11/d23/l51 0 2024-09-04T16:30:17.110 INFO:tasks.workunit.client.0.smithi170.stdout:6/262: dwrite d0/df/d1b/d3e/d44/d2d/d2e/f49 [0,4194304] 0 2024-09-04T16:30:17.112 INFO:tasks.workunit.client.0.smithi170.stdout:9/291: chown d2/d11/d23/d2a/f37 8102 1 2024-09-04T16:30:17.112 INFO:tasks.workunit.client.0.smithi170.stdout:3/222: dread d13/f25 [0,4194304] 0 2024-09-04T16:30:17.117 INFO:tasks.workunit.client.1.smithi193.stdout:7/842: truncate d9/d39/d3e/d69/f83 2299088 0 2024-09-04T16:30:17.118 INFO:tasks.workunit.client.1.smithi193.stdout:8/764: creat d2/d20/d23/d34/dd6/ff2 x:0 0 0 2024-09-04T16:30:17.119 INFO:tasks.workunit.client.1.smithi193.stdout:8/765: stat d2/d20/d23/d34/d4b/db8/fc1 0 2024-09-04T16:30:17.119 INFO:tasks.workunit.client.0.smithi170.stdout:7/433: creat d12/f95 x:0 0 0 2024-09-04T16:30:17.121 INFO:tasks.workunit.client.1.smithi193.stdout:6/722: symlink d5/d33/d4e/le8 0 2024-09-04T16:30:17.122 INFO:tasks.workunit.client.0.smithi170.stdout:7/434: read d12/d15/d71/d42/d81/d5c/f74 [2213688,27564] 0 2024-09-04T16:30:17.123 INFO:tasks.workunit.client.0.smithi170.stdout:6/263: symlink d0/df/d1b/l55 0 2024-09-04T16:30:17.125 INFO:tasks.workunit.client.0.smithi170.stdout:9/292: truncate d2/f17 619746 0 2024-09-04T16:30:17.128 INFO:tasks.workunit.client.0.smithi170.stdout:3/223: fsync d13/d14/d1d/d2d/f37 0 2024-09-04T16:30:17.131 INFO:tasks.workunit.client.1.smithi193.stdout:0/759: rename cf to d18/d25/d32/d57/d6c/db1/deb/cf9 0 2024-09-04T16:30:17.136 INFO:tasks.workunit.client.0.smithi170.stdout:7/435: symlink d12/d15/d71/d42/d81/d5c/l96 0 2024-09-04T16:30:17.136 INFO:tasks.workunit.client.0.smithi170.stdout:7/436: stat d12/l33 0 2024-09-04T16:30:17.137 INFO:tasks.workunit.client.1.smithi193.stdout:0/760: dwrite f6 [8388608,4194304] 0 2024-09-04T16:30:17.138 INFO:tasks.workunit.client.0.smithi170.stdout:6/264: rename d0/df/d1f/d42 to d0/d15/d56 0 2024-09-04T16:30:17.139 INFO:tasks.workunit.client.1.smithi193.stdout:4/664: dwrite d3/d3c/f76 [0,4194304] 0 2024-09-04T16:30:17.140 INFO:tasks.workunit.client.0.smithi170.stdout:9/293: creat d2/d11/d23/d2a/f52 x:0 0 0 2024-09-04T16:30:17.141 INFO:tasks.workunit.client.1.smithi193.stdout:9/803: write d2/d18/d2f/d22/d30/d6a/fa7 [700989,98314] 0 2024-09-04T16:30:17.141 INFO:tasks.workunit.client.1.smithi193.stdout:4/665: dread - d3/d39/d44/f6a zero size 2024-09-04T16:30:17.143 INFO:tasks.workunit.client.0.smithi170.stdout:8/320: write d6/d28/f1d [800197,26459] 0 2024-09-04T16:30:17.144 INFO:tasks.workunit.client.1.smithi193.stdout:4/666: truncate d3/d39/d44/dd5/fa5 39631 0 2024-09-04T16:30:17.145 INFO:tasks.workunit.client.1.smithi193.stdout:8/766: mkdir d2/d20/d23/d34/d4b/db8/df3 0 2024-09-04T16:30:17.146 INFO:tasks.workunit.client.1.smithi193.stdout:8/767: stat d2/d20/f2d 0 2024-09-04T16:30:17.146 INFO:tasks.workunit.client.1.smithi193.stdout:6/723: rmdir d5/d27 39 2024-09-04T16:30:17.147 INFO:tasks.workunit.client.0.smithi170.stdout:6/265: dwrite d0/df/d1b/d3e/d44/d2d/d2e/f43 [0,4194304] 0 2024-09-04T16:30:17.150 INFO:tasks.workunit.client.0.smithi170.stdout:7/437: rename d12/d4b to d12/d16/d1d/d65/d7b/d97 0 2024-09-04T16:30:17.150 INFO:tasks.workunit.client.1.smithi193.stdout:5/752: dread d1/dc3/f26 [0,4194304] 0 2024-09-04T16:30:17.152 INFO:tasks.workunit.client.1.smithi193.stdout:3/742: truncate d0/d18/d1c/d25/d5e/d68/fd8 1015278 0 2024-09-04T16:30:17.153 INFO:tasks.workunit.client.1.smithi193.stdout:3/743: write d0/f47 [70339,859] 0 2024-09-04T16:30:17.161 INFO:tasks.workunit.client.0.smithi170.stdout:5/247: dwrite d4/d8/d1c/d29/f2a [0,4194304] 0 2024-09-04T16:30:17.162 INFO:tasks.workunit.client.1.smithi193.stdout:1/803: rename d1/d2b/db/d7f/lbb to d1/d2b/d10/d56/da7/db1/lf6 0 2024-09-04T16:30:17.162 INFO:tasks.workunit.client.1.smithi193.stdout:1/804: dread - d1/d2b/d1b/d28/fea zero size 2024-09-04T16:30:17.163 INFO:tasks.workunit.client.0.smithi170.stdout:6/266: creat d0/df/d1b/d3e/d44/d2d/f57 x:0 0 0 2024-09-04T16:30:17.164 INFO:tasks.workunit.client.0.smithi170.stdout:6/267: stat d0/df/d1b/d3e/d44 0 2024-09-04T16:30:17.166 INFO:tasks.workunit.client.0.smithi170.stdout:5/248: dread d4/db/f1e [0,4194304] 0 2024-09-04T16:30:17.168 INFO:tasks.workunit.client.0.smithi170.stdout:9/294: rename d2/d11/f1d to d2/d3d/d27/f53 0 2024-09-04T16:30:17.169 INFO:tasks.workunit.client.0.smithi170.stdout:5/249: write d4/d8/d1c/d26/d27/f3f [219256,71900] 0 2024-09-04T16:30:17.170 INFO:tasks.workunit.client.1.smithi193.stdout:2/730: mknod d2/d9/db/d10/d38/dac/dd1/cf0 0 2024-09-04T16:30:17.171 INFO:tasks.workunit.client.0.smithi170.stdout:5/250: chown d4/d8/d1c/d23/c25 28610276 1 2024-09-04T16:30:17.174 INFO:tasks.workunit.client.1.smithi193.stdout:0/761: mkdir d18/d25/d5f/def/dfa 0 2024-09-04T16:30:17.178 INFO:tasks.workunit.client.1.smithi193.stdout:7/843: mkdir d9/d18/d22/d11a 0 2024-09-04T16:30:17.179 INFO:tasks.workunit.client.0.smithi170.stdout:1/388: dwrite d9/d26/f78 [0,4194304] 0 2024-09-04T16:30:17.187 INFO:tasks.workunit.client.1.smithi193.stdout:5/753: creat d1/d8/db/d15/d2b/d83/d37/d58/ff6 x:0 0 0 2024-09-04T16:30:17.192 INFO:tasks.workunit.client.0.smithi170.stdout:9/295: dread d2/d11/f33 [0,4194304] 0 2024-09-04T16:30:17.193 INFO:tasks.workunit.client.0.smithi170.stdout:8/321: write d6/d28/d16/f5a [4463998,111519] 0 2024-09-04T16:30:17.194 INFO:tasks.workunit.client.0.smithi170.stdout:8/322: stat d6/d28/d20/l3d 0 2024-09-04T16:30:17.195 INFO:tasks.workunit.client.0.smithi170.stdout:1/389: chown d9/c1f 6260014 1 2024-09-04T16:30:17.196 INFO:tasks.workunit.client.1.smithi193.stdout:9/804: mkdir d2/d18/d2f/d22/d30/dfc 0 2024-09-04T16:30:17.199 INFO:tasks.workunit.client.1.smithi193.stdout:7/844: unlink d9/d18/d22/d2b/d6c/d70/lef 0 2024-09-04T16:30:17.204 INFO:tasks.workunit.client.0.smithi170.stdout:9/296: unlink d2/d3d/d27/d2b/l31 0 2024-09-04T16:30:17.205 INFO:tasks.workunit.client.0.smithi170.stdout:8/323: dread d6/d28/d20/d5e/f5c [0,4194304] 0 2024-09-04T16:30:17.205 INFO:tasks.workunit.client.1.smithi193.stdout:6/724: creat d5/d27/d3e/d8c/fe9 x:0 0 0 2024-09-04T16:30:17.209 INFO:tasks.workunit.client.1.smithi193.stdout:5/754: mkdir d1/d8/db/d15/d2b/d83/d37/d58/de0/df7 0 2024-09-04T16:30:17.210 INFO:tasks.workunit.client.0.smithi170.stdout:5/251: creat d4/f4a x:0 0 0 2024-09-04T16:30:17.211 INFO:tasks.workunit.client.0.smithi170.stdout:1/390: dread d9/f22 [0,4194304] 0 2024-09-04T16:30:17.212 INFO:tasks.workunit.client.0.smithi170.stdout:5/252: chown d4/d8/d1c/d41/f46 49249993 1 2024-09-04T16:30:17.215 INFO:tasks.workunit.client.0.smithi170.stdout:7/438: getdents d12/d16 0 2024-09-04T16:30:17.217 INFO:tasks.workunit.client.0.smithi170.stdout:5/253: dread d4/d8/d1c/d26/d27/d43/f44 [0,4194304] 0 2024-09-04T16:30:17.218 INFO:tasks.workunit.client.1.smithi193.stdout:9/805: mkdir d2/d18/d2f/d22/d30/d52/dfd 0 2024-09-04T16:30:17.219 INFO:tasks.workunit.client.1.smithi193.stdout:9/806: read d2/d18/d2f/f47 [3972899,120658] 0 2024-09-04T16:30:17.219 INFO:tasks.workunit.client.1.smithi193.stdout:7/845: unlink d9/d39/d3e/d4d/d98/d9a/db6/df8/c10e 0 2024-09-04T16:30:17.220 INFO:tasks.workunit.client.1.smithi193.stdout:7/846: chown d9/de/c13 31770 1 2024-09-04T16:30:17.221 INFO:tasks.workunit.client.1.smithi193.stdout:4/667: rmdir d3/d1a/d2a/db2 0 2024-09-04T16:30:17.223 INFO:tasks.workunit.client.1.smithi193.stdout:5/755: dread d1/d29/d18/d42/f51 [0,4194304] 0 2024-09-04T16:30:17.223 INFO:tasks.workunit.client.1.smithi193.stdout:6/725: rmdir d5/d33/d4e/d51/d7b 39 2024-09-04T16:30:17.225 INFO:tasks.workunit.client.1.smithi193.stdout:8/768: link d2/d20/d23/d34/d4b/f4f d2/d20/d23/d34/d46/d53/d90/ff4 0 2024-09-04T16:30:17.225 INFO:tasks.workunit.client.1.smithi193.stdout:6/726: fsync d5/d33/d4e/d51/d68/fe1 0 2024-09-04T16:30:17.226 INFO:tasks.workunit.client.0.smithi170.stdout:1/391: mkdir d9/d11/d2f/d6b/d7d 0 2024-09-04T16:30:17.229 INFO:tasks.workunit.client.1.smithi193.stdout:1/805: creat d1/d2b/d10/d56/ff7 x:0 0 0 2024-09-04T16:30:17.230 INFO:tasks.workunit.client.0.smithi170.stdout:7/439: creat d12/d16/f98 x:0 0 0 2024-09-04T16:30:17.230 INFO:tasks.workunit.client.1.smithi193.stdout:5/756: dwrite d1/d8/db/d15/d2b/d83/d37/d58/ff6 [0,4194304] 0 2024-09-04T16:30:17.231 INFO:tasks.workunit.client.0.smithi170.stdout:9/297: mkdir d2/d3d/d54 0 2024-09-04T16:30:17.232 INFO:tasks.workunit.client.1.smithi193.stdout:0/762: link d18/d25/d5f/d6a/d7b/cdc d18/d25/d32/d57/d6c/db1/cfb 0 2024-09-04T16:30:17.234 INFO:tasks.workunit.client.1.smithi193.stdout:0/763: write d18/d25/d3b/f41 [5053500,56890] 0 2024-09-04T16:30:17.234 INFO:tasks.workunit.client.0.smithi170.stdout:8/324: mkdir d6/d28/d16/d24/d46/d55/d71 0 2024-09-04T16:30:17.235 INFO:tasks.workunit.client.1.smithi193.stdout:7/847: dread d9/d11/dbd/fd9 [0,4194304] 0 2024-09-04T16:30:17.241 INFO:tasks.workunit.client.1.smithi193.stdout:9/807: creat d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/df4/ffe x:0 0 0 2024-09-04T16:30:17.241 INFO:tasks.workunit.client.1.smithi193.stdout:9/808: chown d2/d18/d66 1111527 1 2024-09-04T16:30:17.243 INFO:tasks.workunit.client.1.smithi193.stdout:9/809: chown d2/d18/d2f/d22/d30/d6a/d6e/d95/fec 3608 1 2024-09-04T16:30:17.243 INFO:tasks.workunit.client.1.smithi193.stdout:4/668: dread d3/d3c/d89/f8c [0,4194304] 0 2024-09-04T16:30:17.245 INFO:tasks.workunit.client.0.smithi170.stdout:8/325: mkdir d6/d28/d20/d5e/d72 0 2024-09-04T16:30:17.246 INFO:tasks.workunit.client.0.smithi170.stdout:8/326: write d6/d28/d20/f48 [1450740,76424] 0 2024-09-04T16:30:17.247 INFO:tasks.workunit.client.0.smithi170.stdout:1/392: rename d9/l16 to d9/d11/d2f/l7e 0 2024-09-04T16:30:17.252 INFO:tasks.workunit.client.0.smithi170.stdout:1/393: dread d9/d11/f43 [0,4194304] 0 2024-09-04T16:30:17.253 INFO:tasks.workunit.client.0.smithi170.stdout:8/327: dread d6/d28/d20/f48 [0,4194304] 0 2024-09-04T16:30:17.256 INFO:tasks.workunit.client.1.smithi193.stdout:1/806: mkdir d1/d2b/d1b/d51/d6d/d89/dc7/df8 0 2024-09-04T16:30:17.257 INFO:tasks.workunit.client.0.smithi170.stdout:7/440: readlink d12/d16/d1d/d65/d7b/d97/d51/l8e 0 2024-09-04T16:30:17.257 INFO:tasks.workunit.client.1.smithi193.stdout:5/757: symlink d1/dd0/lf8 0 2024-09-04T16:30:17.260 INFO:tasks.workunit.client.1.smithi193.stdout:5/758: dread d1/d8/db/d15/d2b/d83/d37/f9d [4194304,4194304] 0 2024-09-04T16:30:17.263 INFO:tasks.workunit.client.0.smithi170.stdout:8/328: rename d6/d28/d16/d24/d46/d55 to d6/d28/d16/d52/d73 0 2024-09-04T16:30:17.269 INFO:tasks.workunit.client.0.smithi170.stdout:7/441: dread d12/d15/d71/f36 [0,4194304] 0 2024-09-04T16:30:17.269 INFO:tasks.workunit.client.1.smithi193.stdout:9/810: creat d2/d18/fff x:0 0 0 2024-09-04T16:30:17.270 INFO:tasks.workunit.client.0.smithi170.stdout:8/329: creat d6/d28/d16/d24/d46/f74 x:0 0 0 2024-09-04T16:30:17.270 INFO:tasks.workunit.client.1.smithi193.stdout:4/669: dread - d3/f86 zero size 2024-09-04T16:30:17.272 INFO:tasks.workunit.client.1.smithi193.stdout:1/807: creat d1/d2b/d10/d56/da7/db1/ff9 x:0 0 0 2024-09-04T16:30:17.272 INFO:tasks.workunit.client.0.smithi170.stdout:7/442: write d12/d15/d71/d42/d81/f2d [610932,35865] 0 2024-09-04T16:30:17.273 INFO:tasks.workunit.client.1.smithi193.stdout:5/759: creat d1/dd0/de9/ff9 x:0 0 0 2024-09-04T16:30:17.273 INFO:tasks.workunit.client.0.smithi170.stdout:1/394: dwrite d9/d11/d2f/f3b [0,4194304] 0 2024-09-04T16:30:17.274 INFO:tasks.workunit.client.1.smithi193.stdout:5/760: fdatasync d1/d8/db/d15/d2b/d83/d37/d58/f9a 0 2024-09-04T16:30:17.275 INFO:tasks.workunit.client.1.smithi193.stdout:3/744: sync 2024-09-04T16:30:17.276 INFO:tasks.workunit.client.0.smithi170.stdout:8/330: fdatasync d6/d28/d20/d5e/f47 0 2024-09-04T16:30:17.276 INFO:tasks.workunit.client.0.smithi170.stdout:8/331: stat d6/d28/d5f 0 2024-09-04T16:30:17.277 INFO:tasks.workunit.client.0.smithi170.stdout:7/443: symlink d12/d15/d41/l99 0 2024-09-04T16:30:17.278 INFO:tasks.workunit.client.1.smithi193.stdout:3/745: write d0/d9/dae/fc7 [998405,76954] 0 2024-09-04T16:30:17.278 INFO:tasks.workunit.client.1.smithi193.stdout:8/769: creat d2/d20/d23/d24/ff5 x:0 0 0 2024-09-04T16:30:17.278 INFO:tasks.workunit.client.0.smithi170.stdout:1/395: mkdir d9/d11/d2f/d7f 0 2024-09-04T16:30:17.279 INFO:tasks.workunit.client.0.smithi170.stdout:7/444: write d12/d15/d71/d42/d81/d5c/f94 [1037745,38481] 0 2024-09-04T16:30:17.284 INFO:tasks.workunit.client.1.smithi193.stdout:6/727: rmdir d5/de/d15/d1b/d5f/da7/dd1/de6 0 2024-09-04T16:30:17.284 INFO:tasks.workunit.client.0.smithi170.stdout:1/396: mknod d9/d26/c80 0 2024-09-04T16:30:17.285 INFO:tasks.workunit.client.0.smithi170.stdout:7/445: chown d12/d16/c3a 3153 1 2024-09-04T16:30:17.286 INFO:tasks.workunit.client.0.smithi170.stdout:7/446: readlink d12/d15/d71/d42/d81/l6c 0 2024-09-04T16:30:17.289 INFO:tasks.workunit.client.1.smithi193.stdout:1/808: dwrite d1/d2b/d10/f59 [0,4194304] 0 2024-09-04T16:30:17.292 INFO:tasks.workunit.client.0.smithi170.stdout:7/447: creat d12/d15/d68/f9a x:0 0 0 2024-09-04T16:30:17.292 INFO:tasks.workunit.client.1.smithi193.stdout:7/848: write d9/d39/d3e/d7d/f110 [1276546,13614] 0 2024-09-04T16:30:17.292 INFO:tasks.workunit.client.1.smithi193.stdout:9/811: mknod d2/d8/d25/c100 0 2024-09-04T16:30:17.293 INFO:tasks.workunit.client.0.smithi170.stdout:7/448: fdatasync d12/d15/d41/f83 0 2024-09-04T16:30:17.295 INFO:tasks.workunit.client.0.smithi170.stdout:7/449: write d12/d15/d41/f45 [1024345,106062] 0 2024-09-04T16:30:17.295 INFO:tasks.workunit.client.1.smithi193.stdout:0/764: getdents d18/d25/d3b 0 2024-09-04T16:30:17.297 INFO:tasks.workunit.client.0.smithi170.stdout:8/332: write d6/d28/d16/d24/d46/f4e [1676082,32572] 0 2024-09-04T16:30:17.300 INFO:tasks.workunit.client.1.smithi193.stdout:7/849: dwrite d9/de/fca [0,4194304] 0 2024-09-04T16:30:17.301 INFO:tasks.workunit.client.0.smithi170.stdout:8/333: mknod d6/d28/d16/d52/c75 0 2024-09-04T16:30:17.301 INFO:tasks.workunit.client.0.smithi170.stdout:1/397: write d9/d11/f43 [2148707,128476] 0 2024-09-04T16:30:17.303 INFO:tasks.workunit.client.1.smithi193.stdout:9/812: write d2/f28 [7265717,33100] 0 2024-09-04T16:30:17.304 INFO:tasks.workunit.client.1.smithi193.stdout:4/670: creat d3/d1a/fdd x:0 0 0 2024-09-04T16:30:17.305 INFO:tasks.workunit.client.0.smithi170.stdout:7/450: rename d12/d16/c3a to d12/d15/c9b 0 2024-09-04T16:30:17.306 INFO:tasks.workunit.client.1.smithi193.stdout:5/761: dread d1/d8/db/d36/d40/d46/d84/fa3 [0,4194304] 0 2024-09-04T16:30:17.307 INFO:tasks.workunit.client.1.smithi193.stdout:5/762: stat d1/l71 0 2024-09-04T16:30:17.307 INFO:tasks.workunit.client.1.smithi193.stdout:6/728: mknod d5/d33/d4e/d51/d71/cea 0 2024-09-04T16:30:17.309 INFO:tasks.workunit.client.0.smithi170.stdout:8/334: unlink d6/d28/d16/f5a 0 2024-09-04T16:30:17.310 INFO:tasks.workunit.client.1.smithi193.stdout:0/765: mkdir d18/d25/d32/d57/d6c/dfc 0 2024-09-04T16:30:17.310 INFO:tasks.workunit.client.0.smithi170.stdout:8/335: chown d6/d28/d20/d5e/l31 474270061 1 2024-09-04T16:30:17.311 INFO:tasks.workunit.client.0.smithi170.stdout:1/398: creat d9/d11/d3e/d6a/f81 x:0 0 0 2024-09-04T16:30:17.312 INFO:tasks.workunit.client.1.smithi193.stdout:1/809: creat d1/d2b/d1b/dd9/ffa x:0 0 0 2024-09-04T16:30:17.312 INFO:tasks.workunit.client.1.smithi193.stdout:3/746: write d0/d18/d1c/d25/d5e/d68/fd8 [1032579,85863] 0 2024-09-04T16:30:17.315 INFO:tasks.workunit.client.0.smithi170.stdout:8/336: fsync d6/d28/d16/f43 0 2024-09-04T16:30:17.316 INFO:tasks.workunit.client.0.smithi170.stdout:8/337: dread - d6/f57 zero size 2024-09-04T16:30:17.317 INFO:tasks.workunit.client.0.smithi170.stdout:1/399: creat d9/d11/d3e/f82 x:0 0 0 2024-09-04T16:30:17.319 INFO:tasks.workunit.client.0.smithi170.stdout:1/400: mkdir d9/d26/d77/d83 0 2024-09-04T16:30:17.321 INFO:tasks.workunit.client.0.smithi170.stdout:1/401: write d9/d34/f63 [2911987,112356] 0 2024-09-04T16:30:17.321 INFO:tasks.workunit.client.0.smithi170.stdout:1/402: fdatasync d9/d11/d2e/f45 0 2024-09-04T16:30:17.324 INFO:tasks.workunit.client.0.smithi170.stdout:1/403: mkdir d9/d11/d2f/d7f/d84 0 2024-09-04T16:30:17.327 INFO:tasks.workunit.client.1.smithi193.stdout:8/770: creat d2/d20/ff6 x:0 0 0 2024-09-04T16:30:17.327 INFO:tasks.workunit.client.1.smithi193.stdout:3/747: chown d0/d10/d24/d55/l85 2996593 1 2024-09-04T16:30:17.327 INFO:tasks.workunit.client.1.smithi193.stdout:5/763: dread - d1/dc3/fb3 zero size 2024-09-04T16:30:17.328 INFO:tasks.workunit.client.0.smithi170.stdout:1/404: write d9/f10 [9293067,31004] 0 2024-09-04T16:30:17.330 INFO:tasks.workunit.client.1.smithi193.stdout:5/764: truncate d1/d29/d18/d42/fcb 736546 0 2024-09-04T16:30:17.330 INFO:tasks.workunit.client.1.smithi193.stdout:5/765: chown d1/d8/db/d15/fa2 3801954 1 2024-09-04T16:30:17.331 INFO:tasks.workunit.client.1.smithi193.stdout:5/766: dread - d1/d29/fcd zero size 2024-09-04T16:30:17.331 INFO:tasks.workunit.client.0.smithi170.stdout:7/451: rename d12/d49/f7c to d12/d16/d1d/d65/d82/f9c 0 2024-09-04T16:30:17.333 INFO:tasks.workunit.client.0.smithi170.stdout:1/405: mkdir d9/d11/d85 0 2024-09-04T16:30:17.334 INFO:tasks.workunit.client.0.smithi170.stdout:1/406: write d9/d26/f46 [3483745,11143] 0 2024-09-04T16:30:17.335 INFO:tasks.workunit.client.1.smithi193.stdout:6/729: creat d5/d33/d85/da9/feb x:0 0 0 2024-09-04T16:30:17.336 INFO:tasks.workunit.client.1.smithi193.stdout:0/766: symlink d18/d25/d5f/lfd 0 2024-09-04T16:30:17.338 INFO:tasks.workunit.client.0.smithi170.stdout:7/452: rename d12/d16/d1d/d65/d7b/d97 to d12/d15/d71/d42/d79/d9d 0 2024-09-04T16:30:17.339 INFO:tasks.workunit.client.1.smithi193.stdout:1/810: mknod d1/d2b/d10/cfb 0 2024-09-04T16:30:17.341 INFO:tasks.workunit.client.0.smithi170.stdout:1/407: chown d9/lf 405644163 1 2024-09-04T16:30:17.342 INFO:tasks.workunit.client.0.smithi170.stdout:1/408: chown d9/d11/d2e/c4a 8256 1 2024-09-04T16:30:17.342 INFO:tasks.workunit.client.0.smithi170.stdout:1/409: truncate d9/f10 9633675 0 2024-09-04T16:30:17.343 INFO:tasks.workunit.client.1.smithi193.stdout:3/748: creat d0/d18/d1c/d25/d5e/d90/ff3 x:0 0 0 2024-09-04T16:30:17.343 INFO:tasks.workunit.client.0.smithi170.stdout:1/410: dread - d9/d11/d3e/f82 zero size 2024-09-04T16:30:17.344 INFO:tasks.workunit.client.0.smithi170.stdout:7/453: write d12/d15/d71/f36 [5042821,34922] 0 2024-09-04T16:30:17.344 INFO:tasks.workunit.client.1.smithi193.stdout:1/811: dwrite d1/d2b/db/f82 [0,4194304] 0 2024-09-04T16:30:17.346 INFO:tasks.workunit.client.1.smithi193.stdout:8/771: truncate d2/d20/f47 123919 0 2024-09-04T16:30:17.346 INFO:tasks.workunit.client.1.smithi193.stdout:9/813: write d2/d4/f23 [308732,35524] 0 2024-09-04T16:30:17.349 INFO:tasks.workunit.client.0.smithi170.stdout:7/454: fsync f7 0 2024-09-04T16:30:17.349 INFO:tasks.workunit.client.1.smithi193.stdout:9/814: write d2/d4/f3a [3141290,84987] 0 2024-09-04T16:30:17.351 INFO:tasks.workunit.client.1.smithi193.stdout:6/730: creat d5/d33/d4e/d51/d68/fec x:0 0 0 2024-09-04T16:30:17.353 INFO:tasks.workunit.client.0.smithi170.stdout:1/411: creat d9/d26/d77/d83/f86 x:0 0 0 2024-09-04T16:30:17.354 INFO:tasks.workunit.client.0.smithi170.stdout:1/412: write d9/d11/f43 [4982000,73728] 0 2024-09-04T16:30:17.355 INFO:tasks.workunit.client.1.smithi193.stdout:0/767: creat d18/d25/d5f/def/da0/ffe x:0 0 0 2024-09-04T16:30:17.359 INFO:tasks.workunit.client.1.smithi193.stdout:4/671: getdents d3/d3c/dae 0 2024-09-04T16:30:17.362 INFO:tasks.workunit.client.1.smithi193.stdout:5/767: dread d1/d8/db/d15/d2b/d83/f4b [4194304,4194304] 0 2024-09-04T16:30:17.362 INFO:tasks.workunit.client.1.smithi193.stdout:1/812: symlink d1/d2b/d1b/d51/d6d/d89/dc7/lfc 0 2024-09-04T16:30:17.365 INFO:tasks.workunit.client.0.smithi170.stdout:1/413: link d9/d11/f1e d9/d11/d3e/f87 0 2024-09-04T16:30:17.366 INFO:tasks.workunit.client.0.smithi170.stdout:1/414: write d9/d34/f63 [384830,14950] 0 2024-09-04T16:30:17.367 INFO:tasks.workunit.client.0.smithi170.stdout:7/455: link lb d12/d16/d1d/l9e 0 2024-09-04T16:30:17.373 INFO:tasks.workunit.client.0.smithi170.stdout:7/456: mknod d12/c9f 0 2024-09-04T16:30:17.374 INFO:tasks.workunit.client.1.smithi193.stdout:3/749: dread d0/d18/d1b/d3d/fa8 [0,4194304] 0 2024-09-04T16:30:17.375 INFO:tasks.workunit.client.1.smithi193.stdout:5/768: creat d1/d8/db/d15/d2b/d83/d37/d58/ffa x:0 0 0 2024-09-04T16:30:17.375 INFO:tasks.workunit.client.1.smithi193.stdout:3/750: write d0/d7/fa6 [4250123,9063] 0 2024-09-04T16:30:17.376 INFO:tasks.workunit.client.1.smithi193.stdout:1/813: symlink d1/d2b/d1b/d28/d50/d84/dd1/de2/lfd 0 2024-09-04T16:30:17.377 INFO:tasks.workunit.client.1.smithi193.stdout:1/814: fsync d1/d2b/d10/f17 0 2024-09-04T16:30:17.377 INFO:tasks.workunit.client.0.smithi170.stdout:1/415: getdents d9/d26/d77/d83 0 2024-09-04T16:30:17.378 INFO:tasks.workunit.client.1.smithi193.stdout:1/815: write d1/d2b/f6a [2023218,74371] 0 2024-09-04T16:30:17.381 INFO:tasks.workunit.client.1.smithi193.stdout:6/731: creat d5/d33/d4e/d51/d7b/fed x:0 0 0 2024-09-04T16:30:17.382 INFO:tasks.workunit.client.1.smithi193.stdout:2/731: sync 2024-09-04T16:30:17.383 INFO:tasks.workunit.client.1.smithi193.stdout:2/732: readlink d2/d9/db/d10/d51/d79/lab 0 2024-09-04T16:30:17.383 INFO:tasks.workunit.client.1.smithi193.stdout:0/768: link d18/d25/d32/d9c/fd6 d18/d25/d3b/de9/fff 0 2024-09-04T16:30:17.384 INFO:tasks.workunit.client.1.smithi193.stdout:4/672: symlink d3/d3c/d98/dcf/lde 0 2024-09-04T16:30:17.385 INFO:tasks.workunit.client.1.smithi193.stdout:3/751: mknod d0/d9/d49/cf4 0 2024-09-04T16:30:17.387 INFO:tasks.workunit.client.1.smithi193.stdout:8/772: rename d2/d86 to d2/d20/d23/d24/df7 0 2024-09-04T16:30:17.388 INFO:tasks.workunit.client.0.smithi170.stdout:7/457: dwrite d12/d15/f2f [0,4194304] 0 2024-09-04T16:30:17.390 INFO:tasks.workunit.client.0.smithi170.stdout:1/416: getdents d9/d11 0 2024-09-04T16:30:17.395 INFO:tasks.workunit.client.1.smithi193.stdout:9/815: creat d2/d18/d2f/d22/d30/d6a/d6e/f101 x:0 0 0 2024-09-04T16:30:17.397 INFO:tasks.workunit.client.1.smithi193.stdout:1/816: fdatasync d1/d39/f8a 0 2024-09-04T16:30:17.398 INFO:tasks.workunit.client.0.smithi170.stdout:1/417: dwrite d9/d11/d2f/f5c [0,4194304] 0 2024-09-04T16:30:17.401 INFO:tasks.workunit.client.1.smithi193.stdout:4/673: mkdir d3/d1a/d2a/ddf 0 2024-09-04T16:30:17.403 INFO:tasks.workunit.client.1.smithi193.stdout:3/752: creat d0/d18/d1c/d30/ff5 x:0 0 0 2024-09-04T16:30:17.403 INFO:tasks.workunit.client.0.smithi170.stdout:1/418: fsync d9/d11/f1e 0 2024-09-04T16:30:17.407 INFO:tasks.workunit.client.1.smithi193.stdout:6/732: rename d5/d33/d4e/d51/d68/fec to d5/d33/d4e/d51/d71/d82/d88/fee 0 2024-09-04T16:30:17.408 INFO:tasks.workunit.client.1.smithi193.stdout:0/769: dwrite d18/d25/d32/d57/d6c/db1/fcc [0,4194304] 0 2024-09-04T16:30:17.409 INFO:tasks.workunit.client.0.smithi170.stdout:1/419: mknod d9/d11/d2f/d6b/c88 0 2024-09-04T16:30:17.409 INFO:tasks.workunit.client.1.smithi193.stdout:5/769: creat d1/d8/db/d15/d2b/d83/d37/d58/d9e/dec/ffb x:0 0 0 2024-09-04T16:30:17.410 INFO:tasks.workunit.client.0.smithi170.stdout:7/458: getdents d12/d15/d71/d42/d79/d9d 0 2024-09-04T16:30:17.412 INFO:tasks.workunit.client.0.smithi170.stdout:7/459: write d12/d16/f98 [676344,120181] 0 2024-09-04T16:30:17.412 INFO:tasks.workunit.client.1.smithi193.stdout:2/733: creat d2/d9/db/d10/d51/d79/db4/ff1 x:0 0 0 2024-09-04T16:30:17.413 INFO:tasks.workunit.client.1.smithi193.stdout:4/674: dwrite d3/d39/d44/dd5/fa5 [0,4194304] 0 2024-09-04T16:30:17.413 INFO:tasks.workunit.client.1.smithi193.stdout:1/817: symlink d1/d2b/d10/db7/dc8/lfe 0 2024-09-04T16:30:17.415 INFO:tasks.workunit.client.1.smithi193.stdout:5/770: dread - d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/dd8/fdb zero size 2024-09-04T16:30:17.415 INFO:tasks.workunit.client.1.smithi193.stdout:3/753: mknod d0/d3b/cf6 0 2024-09-04T16:30:17.415 INFO:tasks.workunit.client.1.smithi193.stdout:7/850: sync 2024-09-04T16:30:17.415 INFO:tasks.workunit.client.0.smithi170.stdout:7/460: creat d12/d15/d68/fa0 x:0 0 0 2024-09-04T16:30:17.417 INFO:tasks.workunit.client.1.smithi193.stdout:8/773: read - d2/d57/fcb zero size 2024-09-04T16:30:17.418 INFO:tasks.workunit.client.0.smithi170.stdout:7/461: chown d12/d16/l20 159277 1 2024-09-04T16:30:17.419 INFO:tasks.workunit.client.1.smithi193.stdout:7/851: write d9/d18/d22/d2b/d6c/d70/fe3 [4174383,34592] 0 2024-09-04T16:30:17.419 INFO:tasks.workunit.client.1.smithi193.stdout:9/816: fdatasync d2/d4/fd 0 2024-09-04T16:30:17.420 INFO:tasks.workunit.client.1.smithi193.stdout:5/771: chown d1/d8/db/d15/d2b/d83/d37/d58/f9a 20225650 1 2024-09-04T16:30:17.421 INFO:tasks.workunit.client.1.smithi193.stdout:5/772: chown d1/d8/db/d15 65566135 1 2024-09-04T16:30:17.421 INFO:tasks.workunit.client.1.smithi193.stdout:7/852: write d9/d18/f4c [1581707,86360] 0 2024-09-04T16:30:17.422 INFO:tasks.workunit.client.1.smithi193.stdout:6/733: symlink d5/d33/d4e/d51/d71/d82/d88/lef 0 2024-09-04T16:30:17.423 INFO:tasks.workunit.client.0.smithi170.stdout:7/462: creat d12/d16/d1d/d65/d82/fa1 x:0 0 0 2024-09-04T16:30:17.423 INFO:tasks.workunit.client.1.smithi193.stdout:0/770: creat d18/d25/d32/d57/d6c/db1/deb/f100 x:0 0 0 2024-09-04T16:30:17.425 INFO:tasks.workunit.client.1.smithi193.stdout:5/773: dread - d1/d8/db/d15/d2b/d83/d37/d58/f9a zero size 2024-09-04T16:30:17.427 INFO:tasks.workunit.client.1.smithi193.stdout:3/754: unlink d0/d18/d1c/d30/f41 0 2024-09-04T16:30:17.430 INFO:tasks.workunit.client.1.smithi193.stdout:5/774: write d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/db9/fe5 [52102,71656] 0 2024-09-04T16:30:17.431 INFO:tasks.workunit.client.1.smithi193.stdout:7/853: mkdir d9/de/d11b 0 2024-09-04T16:30:17.432 INFO:tasks.workunit.client.0.smithi170.stdout:1/420: truncate d9/d11/d3e/f87 1531633 0 2024-09-04T16:30:17.432 INFO:tasks.workunit.client.1.smithi193.stdout:1/818: dwrite d1/d39/f8a [0,4194304] 0 2024-09-04T16:30:17.433 INFO:tasks.workunit.client.0.smithi170.stdout:1/421: truncate d9/d11/d2f/d6b/f70 183068 0 2024-09-04T16:30:17.434 INFO:tasks.workunit.client.0.smithi170.stdout:7/463: creat d12/d15/d71/fa2 x:0 0 0 2024-09-04T16:30:17.434 INFO:tasks.workunit.client.1.smithi193.stdout:5/775: write d1/d8/db/d15/d2b/d83/d37/d58/d9e/da7/fbf [1280380,42756] 0 2024-09-04T16:30:17.434 INFO:tasks.workunit.client.1.smithi193.stdout:7/854: dread - d9/d39/d3e/d4d/d4f/dab/ffe zero size 2024-09-04T16:30:17.436 INFO:tasks.workunit.client.1.smithi193.stdout:6/734: creat d5/d33/d4e/d51/d71/dcf/ff0 x:0 0 0 2024-09-04T16:30:17.436 INFO:tasks.workunit.client.1.smithi193.stdout:5/776: readlink d1/d8/db/d15/d2b/lb5 0 2024-09-04T16:30:17.440 INFO:tasks.workunit.client.0.smithi170.stdout:7/464: mknod d12/d15/d71/d42/ca3 0 2024-09-04T16:30:17.443 INFO:tasks.workunit.client.1.smithi193.stdout:7/855: dwrite d9/d39/d3e/d7d/f110 [0,4194304] 0 2024-09-04T16:30:17.446 INFO:tasks.workunit.client.1.smithi193.stdout:7/856: write d9/d18/d22/d2b/d6c/f119 [910328,29312] 0 2024-09-04T16:30:17.447 INFO:tasks.workunit.client.1.smithi193.stdout:3/755: rename d0/d7/f6b to d0/d18/d1c/d51/d6c/ff7 0 2024-09-04T16:30:17.447 INFO:tasks.workunit.client.0.smithi170.stdout:7/465: dwrite d12/d15/d41/f83 [0,4194304] 0 2024-09-04T16:30:17.448 INFO:tasks.workunit.client.1.smithi193.stdout:3/756: dread - d0/d18/d1c/d30/d8e/fd6 zero size 2024-09-04T16:30:17.449 INFO:tasks.workunit.client.1.smithi193.stdout:3/757: stat d0/d18/d1c/d30/d8e 0 2024-09-04T16:30:17.454 INFO:tasks.workunit.client.1.smithi193.stdout:1/819: dread d1/d2b/d10/f21 [0,4194304] 0 2024-09-04T16:30:17.457 INFO:tasks.workunit.client.1.smithi193.stdout:4/675: creat d3/d3c/fe0 x:0 0 0 2024-09-04T16:30:17.459 INFO:tasks.workunit.client.1.smithi193.stdout:1/820: dread d1/d2b/d10/f59 [0,4194304] 0 2024-09-04T16:30:17.460 INFO:tasks.workunit.client.1.smithi193.stdout:6/735: mkdir d5/d33/df1 0 2024-09-04T16:30:17.461 INFO:tasks.workunit.client.0.smithi170.stdout:7/466: creat d12/d15/fa4 x:0 0 0 2024-09-04T16:30:17.464 INFO:tasks.workunit.client.0.smithi170.stdout:1/422: dread d9/d11/f1e [0,4194304] 0 2024-09-04T16:30:17.464 INFO:tasks.workunit.client.1.smithi193.stdout:7/857: dread d9/d39/d3e/d53/fa5 [0,4194304] 0 2024-09-04T16:30:17.464 INFO:tasks.workunit.client.1.smithi193.stdout:5/777: mknod d1/d8/db/d15/d2b/cfc 0 2024-09-04T16:30:17.464 INFO:tasks.workunit.client.0.smithi170.stdout:7/467: read d12/d16/d1d/d65/d82/f9c [8303971,39251] 0 2024-09-04T16:30:17.465 INFO:tasks.workunit.client.1.smithi193.stdout:7/858: fdatasync d9/d18/d22/d2b/d6c/d70/fe3 0 2024-09-04T16:30:17.465 INFO:tasks.workunit.client.1.smithi193.stdout:0/771: creat d18/d25/d5f/def/dfa/f101 x:0 0 0 2024-09-04T16:30:17.466 INFO:tasks.workunit.client.0.smithi170.stdout:7/468: dread d12/d16/d1d/f2e [0,4194304] 0 2024-09-04T16:30:17.468 INFO:tasks.workunit.client.0.smithi170.stdout:1/423: creat d9/d11/d2e/f89 x:0 0 0 2024-09-04T16:30:17.471 INFO:tasks.workunit.client.1.smithi193.stdout:7/859: dwrite d9/d39/d3e/fa2 [4194304,4194304] 0 2024-09-04T16:30:17.472 INFO:tasks.workunit.client.1.smithi193.stdout:9/817: link d2/d18/d2f/d22/d30/f9b d2/d8/d25/f102 0 2024-09-04T16:30:17.473 INFO:tasks.workunit.client.1.smithi193.stdout:8/774: dwrite d2/d20/d23/d34/fc6 [0,4194304] 0 2024-09-04T16:30:17.474 INFO:tasks.workunit.client.1.smithi193.stdout:8/775: chown d2/d20/d23/d24/d3c 231524533 1 2024-09-04T16:30:17.476 INFO:tasks.workunit.client.0.smithi170.stdout:7/469: creat d12/d16/d8d/fa5 x:0 0 0 2024-09-04T16:30:17.485 INFO:tasks.workunit.client.0.smithi170.stdout:7/470: rename d12/d16/d1d/f2e to d12/d15/d71/d42/d79/d9d/fa6 0 2024-09-04T16:30:17.488 INFO:tasks.workunit.client.1.smithi193.stdout:5/778: mkdir d1/d29/d74/d96/dfd 0 2024-09-04T16:30:17.489 INFO:tasks.workunit.client.0.smithi170.stdout:7/471: fdatasync d12/d16/f1f 0 2024-09-04T16:30:17.491 INFO:tasks.workunit.client.1.smithi193.stdout:0/772: write d18/f55 [1412659,84101] 0 2024-09-04T16:30:17.495 INFO:tasks.workunit.client.0.smithi170.stdout:7/472: write d12/d15/d71/f7f [50435,128737] 0 2024-09-04T16:30:17.498 INFO:tasks.workunit.client.1.smithi193.stdout:9/818: dread d2/d18/fbd [0,4194304] 0 2024-09-04T16:30:17.498 INFO:tasks.workunit.client.0.smithi170.stdout:7/473: creat d12/d16/d1d/d65/fa7 x:0 0 0 2024-09-04T16:30:17.499 INFO:tasks.workunit.client.1.smithi193.stdout:8/776: creat d2/d20/d23/d34/dd6/da0/da8/db9/ff8 x:0 0 0 2024-09-04T16:30:17.500 INFO:tasks.workunit.client.1.smithi193.stdout:4/676: creat d3/d1a/d21/fe1 x:0 0 0 2024-09-04T16:30:17.501 INFO:tasks.workunit.client.0.smithi170.stdout:7/474: mkdir d12/d16/d1d/d65/d82/da8 0 2024-09-04T16:30:17.502 INFO:tasks.workunit.client.0.smithi170.stdout:7/475: read d12/d15/d41/f83 [1904664,74172] 0 2024-09-04T16:30:17.502 INFO:tasks.workunit.client.1.smithi193.stdout:9/819: write d2/d4/f3a [2973584,102968] 0 2024-09-04T16:30:17.503 INFO:tasks.workunit.client.1.smithi193.stdout:1/821: dwrite d1/d2b/d10/db7/dc8/fcc [0,4194304] 0 2024-09-04T16:30:17.504 INFO:tasks.workunit.client.1.smithi193.stdout:8/777: fdatasync d2/d20/d23/d34/f9a 0 2024-09-04T16:30:17.504 INFO:tasks.workunit.client.0.smithi170.stdout:7/476: write d12/d15/d71/f5b [857306,97017] 0 2024-09-04T16:30:17.504 INFO:tasks.workunit.client.0.smithi170.stdout:1/424: dread d9/f13 [0,4194304] 0 2024-09-04T16:30:17.507 INFO:tasks.workunit.client.1.smithi193.stdout:9/820: fdatasync d2/d56/f75 0 2024-09-04T16:30:17.509 INFO:tasks.workunit.client.1.smithi193.stdout:3/758: write d0/d18/d1c/d25/f42 [2033546,96158] 0 2024-09-04T16:30:17.509 INFO:tasks.workunit.client.1.smithi193.stdout:7/860: dwrite d9/d18/d22/d2b/d6c/fcd [0,4194304] 0 2024-09-04T16:30:17.510 INFO:tasks.workunit.client.1.smithi193.stdout:4/677: truncate d3/d1a/d21/d52/d7f/db6/fd0 547047 0 2024-09-04T16:30:17.510 INFO:tasks.workunit.client.0.smithi170.stdout:7/477: read d12/f30 [549761,36687] 0 2024-09-04T16:30:17.511 INFO:tasks.workunit.client.0.smithi170.stdout:1/425: symlink d9/d26/l8a 0 2024-09-04T16:30:17.513 INFO:tasks.workunit.client.0.smithi170.stdout:7/478: truncate d12/d15/d41/f45 4964329 0 2024-09-04T16:30:17.513 INFO:tasks.workunit.client.0.smithi170.stdout:7/479: readlink d12/l1b 0 2024-09-04T16:30:17.514 INFO:tasks.workunit.client.1.smithi193.stdout:4/678: dread d3/d1a/d2a/d83/fb4 [0,4194304] 0 2024-09-04T16:30:17.515 INFO:tasks.workunit.client.0.smithi170.stdout:1/426: write d9/f47 [795221,121150] 0 2024-09-04T16:30:17.517 INFO:tasks.workunit.client.0.smithi170.stdout:7/480: write d12/f1a [5425799,83049] 0 2024-09-04T16:30:17.517 INFO:tasks.workunit.client.1.smithi193.stdout:5/779: write d1/d8/db/d15/d2b/d83/d37/f9d [1577832,44989] 0 2024-09-04T16:30:17.519 INFO:tasks.workunit.client.1.smithi193.stdout:5/780: dread - d1/d8/db/d36/d40/dc1/fed zero size 2024-09-04T16:30:17.520 INFO:tasks.workunit.client.0.smithi170.stdout:1/427: symlink d9/d11/d2f/l8b 0 2024-09-04T16:30:17.520 INFO:tasks.workunit.client.1.smithi193.stdout:6/736: link d5/d27/d3e/d6e/l8e d5/de/d15/d1b/d5f/da7/dd1/lf2 0 2024-09-04T16:30:17.521 INFO:tasks.workunit.client.1.smithi193.stdout:0/773: rmdir d18/d79/d88/d9a/de4 0 2024-09-04T16:30:17.524 INFO:tasks.workunit.client.1.smithi193.stdout:1/822: rename d1/d2b/d1b/d28/f77 to d1/d2b/d1b/d51/d6d/d89/fff 0 2024-09-04T16:30:17.524 INFO:tasks.workunit.client.1.smithi193.stdout:3/759: dwrite d0/d18/d1c/d6e/fd5 [0,4194304] 0 2024-09-04T16:30:17.526 INFO:tasks.workunit.client.1.smithi193.stdout:3/760: dread - d0/d18/d1c/d30/d8e/fd6 zero size 2024-09-04T16:30:17.526 INFO:tasks.workunit.client.0.smithi170.stdout:7/481: dwrite d12/f95 [0,4194304] 0 2024-09-04T16:30:17.526 INFO:tasks.workunit.client.1.smithi193.stdout:9/821: symlink d2/d18/d2f/d22/d30/dee/l103 0 2024-09-04T16:30:17.529 INFO:tasks.workunit.client.1.smithi193.stdout:4/679: mkdir d3/d3c/d98/de2 0 2024-09-04T16:30:17.529 INFO:tasks.workunit.client.0.smithi170.stdout:1/428: dwrite d9/d26/f56 [0,4194304] 0 2024-09-04T16:30:17.532 INFO:tasks.workunit.client.1.smithi193.stdout:6/737: creat d5/d33/d85/ff3 x:0 0 0 2024-09-04T16:30:17.532 INFO:tasks.workunit.client.1.smithi193.stdout:0/774: mknod d18/d25/d32/d57/d6d/c102 0 2024-09-04T16:30:17.539 INFO:tasks.workunit.client.1.smithi193.stdout:8/778: dread d2/d20/f2d [0,4194304] 0 2024-09-04T16:30:17.540 INFO:tasks.workunit.client.0.smithi170.stdout:7/482: getdents d12/d15/d71/d42/d79 0 2024-09-04T16:30:17.542 INFO:tasks.workunit.client.1.smithi193.stdout:6/738: unlink d5/de/d15/l16 0 2024-09-04T16:30:17.543 INFO:tasks.workunit.client.1.smithi193.stdout:8/779: write d2/d20/d23/d24/d3c/fb1 [1188507,99809] 0 2024-09-04T16:30:17.543 INFO:tasks.workunit.client.1.smithi193.stdout:1/823: truncate d1/d2b/d1b/d28/f9d 957556 0 2024-09-04T16:30:17.545 INFO:tasks.workunit.client.1.smithi193.stdout:6/739: chown d5/d33/d4e/d51/d7b/de0 55 1 2024-09-04T16:30:17.545 INFO:tasks.workunit.client.0.smithi170.stdout:7/483: creat d12/d15/d71/d42/fa9 x:0 0 0 2024-09-04T16:30:17.546 INFO:tasks.workunit.client.1.smithi193.stdout:8/780: write d2/d20/d23/d24/d3c/d65/fd3 [815140,99535] 0 2024-09-04T16:30:17.548 INFO:tasks.workunit.client.1.smithi193.stdout:0/775: creat d18/d25/d32/dce/dd7/f103 x:0 0 0 2024-09-04T16:30:17.549 INFO:tasks.workunit.client.1.smithi193.stdout:3/761: rmdir d0/d18/d1c/d51/d5a/da2/dc0 0 2024-09-04T16:30:17.550 INFO:tasks.workunit.client.0.smithi170.stdout:7/484: mkdir d12/d15/d71/d42/d79/d9d/daa 0 2024-09-04T16:30:17.551 INFO:tasks.workunit.client.1.smithi193.stdout:7/861: write d9/d39/d3e/f5c [5171867,103559] 0 2024-09-04T16:30:17.552 INFO:tasks.workunit.client.1.smithi193.stdout:6/740: unlink d5/d33/d4e/d51/d71/d82/fbd 0 2024-09-04T16:30:17.553 INFO:tasks.workunit.client.1.smithi193.stdout:6/741: stat d5/d33/d4e/d51/d7b/de0 0 2024-09-04T16:30:17.554 INFO:tasks.workunit.client.0.smithi170.stdout:7/485: write d12/d15/d71/f56 [1445709,67255] 0 2024-09-04T16:30:17.556 INFO:tasks.workunit.client.1.smithi193.stdout:1/824: mkdir d1/d2b/d10/d56/d100 0 2024-09-04T16:30:17.557 INFO:tasks.workunit.client.0.smithi170.stdout:7/486: chown d12/d16/c43 99704 1 2024-09-04T16:30:17.558 INFO:tasks.workunit.client.1.smithi193.stdout:6/742: chown d5/de/f41 17 1 2024-09-04T16:30:17.559 INFO:tasks.workunit.client.1.smithi193.stdout:0/776: fsync d18/d25/d5f/f81 0 2024-09-04T16:30:17.560 INFO:tasks.workunit.client.1.smithi193.stdout:3/762: rename d0/d18/d1b/dab to d0/d18/d1c/d51/d6c/df8 0 2024-09-04T16:30:17.562 INFO:tasks.workunit.client.1.smithi193.stdout:3/763: chown d0/d18/dee 76596 1 2024-09-04T16:30:17.563 INFO:tasks.workunit.client.1.smithi193.stdout:6/743: mknod d5/d33/d4e/d51/d7b/cf4 0 2024-09-04T16:30:17.563 INFO:tasks.workunit.client.1.smithi193.stdout:1/825: dwrite d1/d2b/d1b/d28/d50/d84/dd1/de2/fca [0,4194304] 0 2024-09-04T16:30:17.563 INFO:tasks.workunit.client.1.smithi193.stdout:3/764: chown d0/d9/dae/dce 819508 1 2024-09-04T16:30:17.564 INFO:tasks.workunit.client.0.smithi170.stdout:7/487: dwrite d12/d16/d1d/d65/fa7 [0,4194304] 0 2024-09-04T16:30:17.565 INFO:tasks.workunit.client.1.smithi193.stdout:7/862: creat d9/d39/f11c x:0 0 0 2024-09-04T16:30:17.565 INFO:tasks.workunit.client.0.smithi170.stdout:7/488: write d12/d15/d68/f9a [750294,4688] 0 2024-09-04T16:30:17.567 INFO:tasks.workunit.client.1.smithi193.stdout:3/765: fsync d0/d18/d1b/f8b 0 2024-09-04T16:30:17.569 INFO:tasks.workunit.client.1.smithi193.stdout:7/863: write d9/d18/f10d [108960,48133] 0 2024-09-04T16:30:17.570 INFO:tasks.workunit.client.0.smithi170.stdout:7/489: rename d12/d15/d71/d42/d79/d9d/c54 to d12/d15/d71/d42/d79/d9d/cab 0 2024-09-04T16:30:17.572 INFO:tasks.workunit.client.1.smithi193.stdout:3/766: read - d0/d18/d1c/d30/d8e/fe8 zero size 2024-09-04T16:30:17.572 INFO:tasks.workunit.client.1.smithi193.stdout:9/822: write d2/d18/d2f/d22/d30/f9b [244693,124127] 0 2024-09-04T16:30:17.573 INFO:tasks.workunit.client.1.smithi193.stdout:0/777: dwrite d18/d25/d5f/fa1 [0,4194304] 0 2024-09-04T16:30:17.578 INFO:tasks.workunit.client.0.smithi170.stdout:7/490: link d12/d16/f98 d12/d15/d68/fac 0 2024-09-04T16:30:17.580 INFO:tasks.workunit.client.1.smithi193.stdout:7/864: creat d9/de/d11b/f11d x:0 0 0 2024-09-04T16:30:17.582 INFO:tasks.workunit.client.1.smithi193.stdout:4/680: dwrite d3/d39/d44/dd5/f71 [0,4194304] 0 2024-09-04T16:30:17.583 INFO:tasks.workunit.client.0.smithi170.stdout:7/491: readlink d12/d16/d1d/l9e 0 2024-09-04T16:30:17.583 INFO:tasks.workunit.client.0.smithi170.stdout:7/492: stat d12/d5a/l6e 0 2024-09-04T16:30:17.584 INFO:tasks.workunit.client.0.smithi170.stdout:7/493: stat d12/d15/d71/d42/d79/d9d 0 2024-09-04T16:30:17.587 INFO:tasks.workunit.client.1.smithi193.stdout:6/744: rename d5/d27/d3e/d8c/cb7 to d5/d27/d3e/cf5 0 2024-09-04T16:30:17.588 INFO:tasks.workunit.client.1.smithi193.stdout:8/781: write d2/d20/d23/d1b/d4e/f88 [2320754,74751] 0 2024-09-04T16:30:17.589 INFO:tasks.workunit.client.1.smithi193.stdout:9/823: mkdir d2/d8/d104 0 2024-09-04T16:30:17.590 INFO:tasks.workunit.client.1.smithi193.stdout:3/767: dwrite d0/d9/dae/fe9 [0,4194304] 0 2024-09-04T16:30:17.594 INFO:tasks.workunit.client.1.smithi193.stdout:4/681: unlink d3/cc4 0 2024-09-04T16:30:17.594 INFO:tasks.workunit.client.1.smithi193.stdout:7/865: dwrite d9/d18/d1e/f43 [0,4194304] 0 2024-09-04T16:30:17.595 INFO:tasks.workunit.client.1.smithi193.stdout:4/682: dread - d3/f28 zero size 2024-09-04T16:30:17.596 INFO:tasks.workunit.client.1.smithi193.stdout:6/745: fsync d5/d33/d4e/d51/d7b/f7d 0 2024-09-04T16:30:17.597 INFO:tasks.workunit.client.1.smithi193.stdout:6/746: fsync d5/d27/d3e/d6e/fc8 0 2024-09-04T16:30:17.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:17 smithi170 ceph-mon[29272]: pgmap v28: 65 pgs: 65 active+clean; 1.8 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 61 MiB/s rd, 215 MiB/s wr, 388 op/s 2024-09-04T16:30:17.636 INFO:tasks.workunit.client.1.smithi193.stdout:2/734: sync 2024-09-04T16:30:17.648 INFO:tasks.workunit.client.1.smithi193.stdout:8/782: unlink d2/d20/d23/d1b/d4e/f88 0 2024-09-04T16:30:17.649 INFO:tasks.workunit.client.1.smithi193.stdout:4/683: fdatasync d3/d39/f57 0 2024-09-04T16:30:17.650 INFO:tasks.workunit.client.1.smithi193.stdout:0/778: write d18/f20 [2856955,97933] 0 2024-09-04T16:30:17.651 INFO:tasks.workunit.client.1.smithi193.stdout:9/824: dwrite d2/d18/d2f/d9a/de4/ff5 [0,4194304] 0 2024-09-04T16:30:17.653 INFO:tasks.workunit.client.1.smithi193.stdout:4/684: write f0 [3922118,56731] 0 2024-09-04T16:30:17.655 INFO:tasks.workunit.client.1.smithi193.stdout:7/866: mkdir d9/d11/d113/d106/d11e 0 2024-09-04T16:30:17.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:17 smithi193 ceph-mon[36288]: pgmap v28: 65 pgs: 65 active+clean; 1.8 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 61 MiB/s rd, 215 MiB/s wr, 388 op/s 2024-09-04T16:30:17.656 INFO:tasks.workunit.client.1.smithi193.stdout:6/747: unlink d5/d33/d85/fa1 0 2024-09-04T16:30:17.657 INFO:tasks.workunit.client.1.smithi193.stdout:2/735: mkdir d2/d9/db/d10/d38/dac/df2 0 2024-09-04T16:30:17.657 INFO:tasks.workunit.client.1.smithi193.stdout:8/783: mkdir d2/d20/d23/d34/d4b/d7c/df9 0 2024-09-04T16:30:17.658 INFO:tasks.workunit.client.1.smithi193.stdout:9/825: read d2/d18/d2f/d22/d30/d6a/fb5 [336085,116172] 0 2024-09-04T16:30:17.659 INFO:tasks.workunit.client.1.smithi193.stdout:4/685: mknod d3/d3c/d98/dcf/ce3 0 2024-09-04T16:30:17.660 INFO:tasks.workunit.client.1.smithi193.stdout:1/826: dwrite d1/d2b/d1b/d51/d6d/f7a [0,4194304] 0 2024-09-04T16:30:17.661 INFO:tasks.workunit.client.1.smithi193.stdout:8/784: chown d2/d20/d23/d34/dd6/ce5 1605 1 2024-09-04T16:30:17.662 INFO:tasks.workunit.client.1.smithi193.stdout:0/779: rename d18/d25/d5f/d65/fb2 to d18/d25/d32/dce/dd7/f104 0 2024-09-04T16:30:17.663 INFO:tasks.workunit.client.1.smithi193.stdout:2/736: mknod d2/d9/db/d65/cf3 0 2024-09-04T16:30:17.667 INFO:tasks.workunit.client.1.smithi193.stdout:8/785: mkdir d2/d20/d23/d51/d76/dfa 0 2024-09-04T16:30:17.669 INFO:tasks.workunit.client.1.smithi193.stdout:0/780: rename d18/d25/d3b/f41 to d18/d79/d88/d9a/f105 0 2024-09-04T16:30:17.671 INFO:tasks.workunit.client.1.smithi193.stdout:7/867: write d9/d18/d22/d2b/fb3 [743499,101424] 0 2024-09-04T16:30:17.671 INFO:tasks.workunit.client.1.smithi193.stdout:4/686: symlink d3/d3c/d98/de2/le4 0 2024-09-04T16:30:17.674 INFO:tasks.workunit.client.1.smithi193.stdout:8/786: mkdir d2/d20/d23/d34/d4b/d7c/dfb 0 2024-09-04T16:30:17.675 INFO:tasks.workunit.client.1.smithi193.stdout:9/826: write d2/d56/d86/fad [964278,94062] 0 2024-09-04T16:30:17.675 INFO:tasks.workunit.client.1.smithi193.stdout:2/737: symlink d2/d9/db/d10/d1f/lf4 0 2024-09-04T16:30:17.677 INFO:tasks.workunit.client.1.smithi193.stdout:0/781: mkdir d18/d25/d5f/def/dfa/d106 0 2024-09-04T16:30:17.677 INFO:tasks.workunit.client.1.smithi193.stdout:7/868: dread d9/d39/d3e/d53/fa5 [0,4194304] 0 2024-09-04T16:30:17.679 INFO:tasks.workunit.client.1.smithi193.stdout:2/738: readlink d2/d9/d18/laf 0 2024-09-04T16:30:17.680 INFO:tasks.workunit.client.1.smithi193.stdout:8/787: mknod d2/d20/d23/d34/d4b/dd4/cfc 0 2024-09-04T16:30:17.680 INFO:tasks.workunit.client.1.smithi193.stdout:4/687: dread d3/d1a/d21/f78 [4194304,4194304] 0 2024-09-04T16:30:17.680 INFO:tasks.workunit.client.1.smithi193.stdout:7/869: write d9/d18/d1e/f29 [4855973,59655] 0 2024-09-04T16:30:17.680 INFO:tasks.workunit.client.1.smithi193.stdout:0/782: mkdir d18/d25/d5f/d107 0 2024-09-04T16:30:17.689 INFO:tasks.workunit.client.1.smithi193.stdout:0/783: write d18/d25/f2a [4020089,116952] 0 2024-09-04T16:30:17.689 INFO:tasks.workunit.client.1.smithi193.stdout:4/688: unlink d3/d1a/l94 0 2024-09-04T16:30:17.690 INFO:tasks.workunit.client.1.smithi193.stdout:8/788: truncate d2/d20/d23/d34/d46/fec 300638 0 2024-09-04T16:30:17.690 INFO:tasks.workunit.client.1.smithi193.stdout:1/827: dread d1/d2b/d10/d2a/fa9 [0,4194304] 0 2024-09-04T16:30:17.690 INFO:tasks.workunit.client.1.smithi193.stdout:0/784: unlink d18/d25/d3b/c59 0 2024-09-04T16:30:17.690 INFO:tasks.workunit.client.1.smithi193.stdout:7/870: truncate d9/d18/d22/d2b/d6c/d70/f8d 812988 0 2024-09-04T16:30:17.690 INFO:tasks.workunit.client.1.smithi193.stdout:4/689: write d3/d1a/d21/d52/d7f/db6/fd0 [1292101,102164] 0 2024-09-04T16:30:17.690 INFO:tasks.workunit.client.1.smithi193.stdout:1/828: mkdir d1/d39/d101 0 2024-09-04T16:30:17.692 INFO:tasks.workunit.client.1.smithi193.stdout:2/739: dwrite d2/d9/db/d10/d1f/f62 [0,4194304] 0 2024-09-04T16:30:17.692 INFO:tasks.workunit.client.1.smithi193.stdout:7/871: creat d9/de/f11f x:0 0 0 2024-09-04T16:30:17.697 INFO:tasks.workunit.client.1.smithi193.stdout:2/740: creat d2/d9/d18/ff5 x:0 0 0 2024-09-04T16:30:17.697 INFO:tasks.workunit.client.1.smithi193.stdout:4/690: creat d3/d1a/d21/d52/d7f/db6/fe5 x:0 0 0 2024-09-04T16:30:17.698 INFO:tasks.workunit.client.1.smithi193.stdout:7/872: truncate d9/de/d27/f34 1701454 0 2024-09-04T16:30:17.701 INFO:tasks.workunit.client.1.smithi193.stdout:7/873: fdatasync d9/d18/d22/fb7 0 2024-09-04T16:30:17.702 INFO:tasks.workunit.client.1.smithi193.stdout:9/827: dread d2/d18/d2f/d22/d30/d6a/d6e/f5a [0,4194304] 0 2024-09-04T16:30:17.709 INFO:tasks.workunit.client.1.smithi193.stdout:1/829: write d1/d2b/db/f8f [4284810,63460] 0 2024-09-04T16:30:17.710 INFO:tasks.workunit.client.1.smithi193.stdout:8/789: dread d2/d20/d23/d34/d3e/f41 [0,4194304] 0 2024-09-04T16:30:17.715 INFO:tasks.workunit.client.1.smithi193.stdout:9/828: getdents d2/d56/d86/dc2 0 2024-09-04T16:30:17.715 INFO:tasks.workunit.client.1.smithi193.stdout:0/785: dwrite d18/d25/d5f/f81 [0,4194304] 0 2024-09-04T16:30:17.717 INFO:tasks.workunit.client.1.smithi193.stdout:7/874: dwrite d9/d18/d1e/f2e [0,4194304] 0 2024-09-04T16:30:17.721 INFO:tasks.workunit.client.1.smithi193.stdout:4/691: dread d3/d1a/d21/f34 [0,4194304] 0 2024-09-04T16:30:17.722 INFO:tasks.workunit.client.1.smithi193.stdout:8/790: creat d2/d20/d23/d34/d3e/d6f/d93/ffd x:0 0 0 2024-09-04T16:30:17.723 INFO:tasks.workunit.client.1.smithi193.stdout:2/741: dread d2/d9/db/d10/f7d [0,4194304] 0 2024-09-04T16:30:17.724 INFO:tasks.workunit.client.1.smithi193.stdout:7/875: unlink d9/d18/d22/d2b/d6c/f102 0 2024-09-04T16:30:17.724 INFO:tasks.workunit.client.1.smithi193.stdout:4/692: write d3/d1a/d54/f64 [4745627,1825] 0 2024-09-04T16:30:17.726 INFO:tasks.workunit.client.1.smithi193.stdout:1/830: truncate d1/d39/f46 1649284 0 2024-09-04T16:30:17.727 INFO:tasks.workunit.client.1.smithi193.stdout:1/831: stat d1/d2b 0 2024-09-04T16:30:17.727 INFO:tasks.workunit.client.1.smithi193.stdout:2/742: write d2/d9/db/d10/d51/fed [945982,72815] 0 2024-09-04T16:30:17.729 INFO:tasks.workunit.client.1.smithi193.stdout:4/693: truncate d3/d3c/d89/dbd/fc5 339617 0 2024-09-04T16:30:17.730 INFO:tasks.workunit.client.1.smithi193.stdout:8/791: mkdir d2/d20/d23/d34/d46/d66/dfe 0 2024-09-04T16:30:17.730 INFO:tasks.workunit.client.1.smithi193.stdout:4/694: write d3/d3c/fbb [308894,111548] 0 2024-09-04T16:30:17.733 INFO:tasks.workunit.client.1.smithi193.stdout:2/743: creat d2/d9/db/d10/d51/dca/ff6 x:0 0 0 2024-09-04T16:30:17.734 INFO:tasks.workunit.client.1.smithi193.stdout:7/876: fsync d9/d11/f93 0 2024-09-04T16:30:17.736 INFO:tasks.workunit.client.1.smithi193.stdout:9/829: rename d2/f3d to d2/d18/d2f/d22/d30/f105 0 2024-09-04T16:30:17.737 INFO:tasks.workunit.client.1.smithi193.stdout:0/786: mknod d18/d25/d5f/def/dfa/d106/c108 0 2024-09-04T16:30:17.743 INFO:tasks.workunit.client.1.smithi193.stdout:0/787: write d18/f1a [2296226,108443] 0 2024-09-04T16:30:17.745 INFO:tasks.workunit.client.1.smithi193.stdout:1/832: dwrite d1/d2b/f2c [0,4194304] 0 2024-09-04T16:30:17.747 INFO:tasks.workunit.client.1.smithi193.stdout:1/833: fdatasync d1/d39/d48/f96 0 2024-09-04T16:30:17.748 INFO:tasks.workunit.client.1.smithi193.stdout:9/830: truncate d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/df4/ffe 237672 0 2024-09-04T16:30:17.748 INFO:tasks.workunit.client.1.smithi193.stdout:8/792: getdents d2/d20/d23/d34/d3e/d6f/d93 0 2024-09-04T16:30:17.749 INFO:tasks.workunit.client.1.smithi193.stdout:1/834: stat d1/d39/d48/c88 0 2024-09-04T16:30:17.752 INFO:tasks.workunit.client.1.smithi193.stdout:5/781: sync 2024-09-04T16:30:17.752 INFO:tasks.workunit.client.1.smithi193.stdout:4/695: dread d3/d1a/d21/f78 [0,4194304] 0 2024-09-04T16:30:17.753 INFO:tasks.workunit.client.1.smithi193.stdout:1/835: chown d1/d2b/d10/d56/f6b 14127155 1 2024-09-04T16:30:17.754 INFO:tasks.workunit.client.1.smithi193.stdout:8/793: unlink d2/d20/d23/d24/d3c/fb1 0 2024-09-04T16:30:17.755 INFO:tasks.workunit.client.1.smithi193.stdout:2/744: dread d2/d9/d61/fe1 [0,4194304] 0 2024-09-04T16:30:17.755 INFO:tasks.workunit.client.1.smithi193.stdout:4/696: write d3/d3c/fb8 [757981,112698] 0 2024-09-04T16:30:17.755 INFO:tasks.workunit.client.1.smithi193.stdout:0/788: write d18/d25/d32/f44 [1989160,69650] 0 2024-09-04T16:30:17.756 INFO:tasks.workunit.client.1.smithi193.stdout:5/782: symlink d1/d8/db/d15/lfe 0 2024-09-04T16:30:17.757 INFO:tasks.workunit.client.1.smithi193.stdout:0/789: chown d18/d25/d32/l87 1250003384 1 2024-09-04T16:30:17.758 INFO:tasks.workunit.client.1.smithi193.stdout:1/836: rename d1/d2b/d10/le7 to d1/l102 0 2024-09-04T16:30:17.758 INFO:tasks.workunit.client.1.smithi193.stdout:4/697: rmdir d3/d1a/d54 39 2024-09-04T16:30:17.760 INFO:tasks.workunit.client.1.smithi193.stdout:0/790: chown d18/d25/d5f/def/da0/ffe 787444 1 2024-09-04T16:30:17.761 INFO:tasks.workunit.client.1.smithi193.stdout:5/783: creat d1/d29/d74/d96/dfd/fff x:0 0 0 2024-09-04T16:30:17.762 INFO:tasks.workunit.client.1.smithi193.stdout:1/837: creat d1/d2b/d10/d56/da7/db1/f103 x:0 0 0 2024-09-04T16:30:17.762 INFO:tasks.workunit.client.1.smithi193.stdout:4/698: mknod d3/d3c/d98/de2/ce6 0 2024-09-04T16:30:17.763 INFO:tasks.workunit.client.1.smithi193.stdout:7/877: dread d9/d85/fc8 [0,4194304] 0 2024-09-04T16:30:17.765 INFO:tasks.workunit.client.1.smithi193.stdout:8/794: getdents d2/d20/dc0/d82 0 2024-09-04T16:30:17.766 INFO:tasks.workunit.client.1.smithi193.stdout:5/784: fdatasync d1/d8/db/fa6 0 2024-09-04T16:30:17.766 INFO:tasks.workunit.client.1.smithi193.stdout:9/831: link d2/d18/d2f/d22/d30/d6a/d6e/d81/cae d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/c106 0 2024-09-04T16:30:17.769 INFO:tasks.workunit.client.1.smithi193.stdout:8/795: truncate d2/d20/ff6 1021974 0 2024-09-04T16:30:17.770 INFO:tasks.workunit.client.1.smithi193.stdout:7/878: mknod d9/de/d11b/c120 0 2024-09-04T16:30:17.770 INFO:tasks.workunit.client.1.smithi193.stdout:9/832: chown d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/df4 3 1 2024-09-04T16:30:17.770 INFO:tasks.workunit.client.1.smithi193.stdout:0/791: dread d18/d25/d32/d57/d6c/db1/fcc [0,4194304] 0 2024-09-04T16:30:17.771 INFO:tasks.workunit.client.1.smithi193.stdout:1/838: unlink d1/d2b/d10/d2a/l36 0 2024-09-04T16:30:17.772 INFO:tasks.workunit.client.1.smithi193.stdout:4/699: dread d3/d39/f79 [0,4194304] 0 2024-09-04T16:30:17.774 INFO:tasks.workunit.client.1.smithi193.stdout:0/792: readlink d18/l34 0 2024-09-04T16:30:17.775 INFO:tasks.workunit.client.1.smithi193.stdout:9/833: mkdir d2/d18/d2f/d22/d30/d6a/d6e/de2/d107 0 2024-09-04T16:30:17.779 INFO:tasks.workunit.client.1.smithi193.stdout:5/785: write d1/dc3/f26 [187481,38904] 0 2024-09-04T16:30:17.784 INFO:tasks.workunit.client.1.smithi193.stdout:9/834: write d2/d18/d2f/d22/d30/d6a/f94 [2854081,49875] 0 2024-09-04T16:30:17.787 INFO:tasks.workunit.client.1.smithi193.stdout:2/745: dread d2/d9/db/f72 [0,4194304] 0 2024-09-04T16:30:17.792 INFO:tasks.workunit.client.1.smithi193.stdout:0/793: dwrite d18/d25/d32/d57/d6c/db1/deb/f100 [0,4194304] 0 2024-09-04T16:30:17.792 INFO:tasks.workunit.client.1.smithi193.stdout:2/746: chown d2/db7/ddc 7 1 2024-09-04T16:30:17.794 INFO:tasks.workunit.client.1.smithi193.stdout:5/786: creat d1/d8/db/d15/d2b/d83/d37/d58/de0/f100 x:0 0 0 2024-09-04T16:30:17.795 INFO:tasks.workunit.client.1.smithi193.stdout:7/879: dwrite d9/de/d27/d62/d72/fd5 [0,4194304] 0 2024-09-04T16:30:17.796 INFO:tasks.workunit.client.1.smithi193.stdout:1/839: dread d1/d2b/db/f8f [0,4194304] 0 2024-09-04T16:30:17.796 INFO:tasks.workunit.client.1.smithi193.stdout:4/700: dwrite d3/d1a/d54/f5b [0,4194304] 0 2024-09-04T16:30:17.798 INFO:tasks.workunit.client.1.smithi193.stdout:5/787: chown d1/d8/db/d15/f47 14 1 2024-09-04T16:30:17.799 INFO:tasks.workunit.client.1.smithi193.stdout:1/840: fdatasync d1/d39/f8a 0 2024-09-04T16:30:17.799 INFO:tasks.workunit.client.1.smithi193.stdout:0/794: mkdir d18/d109 0 2024-09-04T16:30:17.801 INFO:tasks.workunit.client.1.smithi193.stdout:3/768: sync 2024-09-04T16:30:17.803 INFO:tasks.workunit.client.1.smithi193.stdout:7/880: mknod d9/de/d11b/c121 0 2024-09-04T16:30:17.806 INFO:tasks.workunit.client.1.smithi193.stdout:2/747: write d2/d9/db/d10/d1f/f62 [2632063,90028] 0 2024-09-04T16:30:17.807 INFO:tasks.workunit.client.1.smithi193.stdout:4/701: chown d3/d1a/d2a/f40 8004209 1 2024-09-04T16:30:17.808 INFO:tasks.workunit.client.1.smithi193.stdout:8/796: dread d2/d12/f8e [0,4194304] 0 2024-09-04T16:30:17.808 INFO:tasks.workunit.client.1.smithi193.stdout:7/881: stat d9/d39/d3e/f5c 0 2024-09-04T16:30:17.808 INFO:tasks.workunit.client.1.smithi193.stdout:3/769: chown d0/d18/d1c/d30/c32 21766 1 2024-09-04T16:30:17.809 INFO:tasks.workunit.client.1.smithi193.stdout:4/702: write d3/f8e [1826336,110166] 0 2024-09-04T16:30:17.810 INFO:tasks.workunit.client.1.smithi193.stdout:0/795: read d18/d25/d3b/fae [3325512,118729] 0 2024-09-04T16:30:17.812 INFO:tasks.workunit.client.1.smithi193.stdout:9/835: dread d2/d18/d2f/d22/d30/d6a/d6e/f5a [0,4194304] 0 2024-09-04T16:30:17.812 INFO:tasks.workunit.client.1.smithi193.stdout:8/797: write d2/d20/d23/d34/d4b/db8/fbe [3743619,4714] 0 2024-09-04T16:30:17.813 INFO:tasks.workunit.client.1.smithi193.stdout:8/798: readlink d2/d20/d23/d24/d3c/d65/lac 0 2024-09-04T16:30:17.814 INFO:tasks.workunit.client.1.smithi193.stdout:5/788: mknod d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/dd8/c101 0 2024-09-04T16:30:17.816 INFO:tasks.workunit.client.1.smithi193.stdout:1/841: creat d1/d2b/db/d9e/f104 x:0 0 0 2024-09-04T16:30:17.820 INFO:tasks.workunit.client.1.smithi193.stdout:3/770: rename d0/d18/d1c/d30/d8e/fd6 to d0/d7/de/d45/ff9 0 2024-09-04T16:30:17.821 INFO:tasks.workunit.client.1.smithi193.stdout:7/882: dread d9/d18/d22/d2b/d6c/d70/f8d [0,4194304] 0 2024-09-04T16:30:17.822 INFO:tasks.workunit.client.1.smithi193.stdout:1/842: read d1/d2b/d1b/d51/d6d/fb5 [830728,6691] 0 2024-09-04T16:30:17.824 INFO:tasks.workunit.client.1.smithi193.stdout:8/799: dwrite d2/d20/d23/d34/d3e/d6f/d81/faa [0,4194304] 0 2024-09-04T16:30:17.825 INFO:tasks.workunit.client.1.smithi193.stdout:3/771: fdatasync d0/d18/d1b/d3d/fc1 0 2024-09-04T16:30:17.825 INFO:tasks.workunit.client.1.smithi193.stdout:5/789: dwrite d1/d8/db/d36/d40/fe8 [0,4194304] 0 2024-09-04T16:30:17.826 INFO:tasks.workunit.client.1.smithi193.stdout:9/836: symlink d2/d18/d2f/d22/d30/d6a/d6e/de2/d107/l108 0 2024-09-04T16:30:17.828 INFO:tasks.workunit.client.1.smithi193.stdout:2/748: creat d2/d9/db/d10/d1e/ff7 x:0 0 0 2024-09-04T16:30:17.829 INFO:tasks.workunit.client.1.smithi193.stdout:1/843: write d1/d2b/d1b/d51/d6d/f7a [5042221,1708] 0 2024-09-04T16:30:17.831 INFO:tasks.workunit.client.1.smithi193.stdout:9/837: write d2/d18/d66/f6d [3842846,78793] 0 2024-09-04T16:30:17.834 INFO:tasks.workunit.client.1.smithi193.stdout:5/790: mkdir d1/dd0/d102 0 2024-09-04T16:30:17.834 INFO:tasks.workunit.client.1.smithi193.stdout:9/838: dread - d2/d8/d25/db2/fef zero size 2024-09-04T16:30:17.835 INFO:tasks.workunit.client.1.smithi193.stdout:8/800: symlink d2/d20/d23/d34/d46/d53/lff 0 2024-09-04T16:30:17.835 INFO:tasks.workunit.client.1.smithi193.stdout:1/844: dread - d1/d2b/d1b/d28/d50/d84/d97/fa2 zero size 2024-09-04T16:30:17.837 INFO:tasks.workunit.client.1.smithi193.stdout:7/883: dwrite d9/d11/dd4/dd2/fdf [0,4194304] 0 2024-09-04T16:30:17.838 INFO:tasks.workunit.client.1.smithi193.stdout:3/772: chown d0/d18/d1c/d51/d5a/ldb 498273 1 2024-09-04T16:30:17.839 INFO:tasks.workunit.client.1.smithi193.stdout:0/796: dread d18/d25/d5f/d6a/d7b/fe5 [0,4194304] 0 2024-09-04T16:30:17.842 INFO:tasks.workunit.client.1.smithi193.stdout:2/749: rmdir d2/db7/ddc 0 2024-09-04T16:30:17.845 INFO:tasks.workunit.client.1.smithi193.stdout:1/845: rename d1/d39/d48/l41 to d1/d2b/d1b/d51/d6d/l105 0 2024-09-04T16:30:17.847 INFO:tasks.workunit.client.1.smithi193.stdout:0/797: creat d18/d25/d32/dce/dd7/f10a x:0 0 0 2024-09-04T16:30:17.848 INFO:tasks.workunit.client.1.smithi193.stdout:2/750: symlink d2/d9/db/d10/d1f/d4a/dc2/lf8 0 2024-09-04T16:30:17.849 INFO:tasks.workunit.client.1.smithi193.stdout:5/791: creat d1/d8/db/d15/d2b/d83/d37/d3f/d8e/f103 x:0 0 0 2024-09-04T16:30:17.850 INFO:tasks.workunit.client.1.smithi193.stdout:2/751: fdatasync d2/d9/db/d10/d51/d79/fdb 0 2024-09-04T16:30:17.851 INFO:tasks.workunit.client.1.smithi193.stdout:7/884: rename d9/d18/d22/fb8 to d9/d39/d3e/d4d/d4f/f122 0 2024-09-04T16:30:17.851 INFO:tasks.workunit.client.1.smithi193.stdout:1/846: dwrite d1/d2b/d10/fa5 [0,4194304] 0 2024-09-04T16:30:17.852 INFO:tasks.workunit.client.1.smithi193.stdout:5/792: write d1/d8/db/d15/d2b/d83/d37/f9d [1234901,93607] 0 2024-09-04T16:30:17.854 INFO:tasks.workunit.client.1.smithi193.stdout:2/752: truncate d2/d9/db/d10/d38/d63/f68 432566 0 2024-09-04T16:30:17.860 INFO:tasks.workunit.client.1.smithi193.stdout:1/847: dwrite d1/d2b/d1b/d51/d6d/fd8 [0,4194304] 0 2024-09-04T16:30:17.860 INFO:tasks.workunit.client.1.smithi193.stdout:2/753: fsync d2/d9/db/f16 0 2024-09-04T16:30:17.861 INFO:tasks.workunit.client.1.smithi193.stdout:2/754: fsync d2/d9/f36 0 2024-09-04T16:30:17.864 INFO:tasks.workunit.client.1.smithi193.stdout:1/848: mkdir d1/d2b/d1b/d28/d50/d84/d106 0 2024-09-04T16:30:17.866 INFO:tasks.workunit.client.1.smithi193.stdout:2/755: mknod d2/d9/db/cf9 0 2024-09-04T16:30:17.868 INFO:tasks.workunit.client.1.smithi193.stdout:2/756: creat d2/d9/db/d10/d51/dca/ffa x:0 0 0 2024-09-04T16:30:17.870 INFO:tasks.workunit.client.1.smithi193.stdout:2/757: mknod d2/d9/db/d10/d1f/d22/cfb 0 2024-09-04T16:30:17.875 INFO:tasks.workunit.client.1.smithi193.stdout:2/758: dwrite d2/d9/db/d10/d51/dca/ff6 [0,4194304] 0 2024-09-04T16:30:17.920 INFO:tasks.workunit.client.0.smithi170.stdout:2/307: sync 2024-09-04T16:30:17.927 INFO:tasks.workunit.client.0.smithi170.stdout:2/308: dread d3/d3c/f30 [0,4194304] 0 2024-09-04T16:30:17.933 INFO:tasks.workunit.client.1.smithi193.stdout:6/748: sync 2024-09-04T16:30:17.937 INFO:tasks.workunit.client.1.smithi193.stdout:6/749: symlink d5/d27/d3e/d43/lf6 0 2024-09-04T16:30:17.939 INFO:tasks.workunit.client.1.smithi193.stdout:1/849: dread d1/d2b/d10/d2a/f6f [0,4194304] 0 2024-09-04T16:30:17.939 INFO:tasks.workunit.client.1.smithi193.stdout:6/750: chown d5/de/lab 6621620 1 2024-09-04T16:30:17.941 INFO:tasks.workunit.client.0.smithi170.stdout:2/309: dread d3/f50 [0,4194304] 0 2024-09-04T16:30:17.942 INFO:tasks.workunit.client.0.smithi170.stdout:2/310: chown d3/d3c/d40/d48/f54 54 1 2024-09-04T16:30:17.944 INFO:tasks.workunit.client.1.smithi193.stdout:1/850: mkdir d1/d2b/db/d54/d107 0 2024-09-04T16:30:17.945 INFO:tasks.workunit.client.1.smithi193.stdout:3/773: write d0/d9/f83 [2370402,34818] 0 2024-09-04T16:30:17.946 INFO:tasks.workunit.client.1.smithi193.stdout:8/801: dwrite d2/d20/d23/d24/df7/fb3 [0,4194304] 0 2024-09-04T16:30:17.947 INFO:tasks.workunit.client.0.smithi170.stdout:2/311: rename d3/d4/l2e to d3/db/l5f 0 2024-09-04T16:30:17.947 INFO:tasks.workunit.client.1.smithi193.stdout:8/802: dread - d2/d20/d23/d24/ff5 zero size 2024-09-04T16:30:17.950 INFO:tasks.workunit.client.0.smithi170.stdout:2/312: symlink d3/d3c/d40/d48/l60 0 2024-09-04T16:30:17.955 INFO:tasks.workunit.client.1.smithi193.stdout:3/774: link d0/d18/d1c/d25/d5e/d7e/f7c d0/d10/d24/d55/ffa 0 2024-09-04T16:30:17.956 INFO:tasks.workunit.client.0.smithi170.stdout:2/313: unlink d3/d4/c5 0 2024-09-04T16:30:17.958 INFO:tasks.workunit.client.1.smithi193.stdout:3/775: creat d0/d18/d1c/d25/d5e/ffb x:0 0 0 2024-09-04T16:30:17.959 INFO:tasks.workunit.client.1.smithi193.stdout:3/776: write d0/d18/d1b/d3d/fc1 [738263,44313] 0 2024-09-04T16:30:17.961 INFO:tasks.workunit.client.1.smithi193.stdout:3/777: mkdir d0/d18/d1c/d51/d5a/dfc 0 2024-09-04T16:30:17.963 INFO:tasks.workunit.client.1.smithi193.stdout:5/793: truncate d1/d29/d18/f2f 524937 0 2024-09-04T16:30:17.964 INFO:tasks.workunit.client.1.smithi193.stdout:1/851: dread d1/d2b/d1b/d28/f75 [0,4194304] 0 2024-09-04T16:30:17.967 INFO:tasks.workunit.client.1.smithi193.stdout:1/852: stat d1/d2b/d1b/d51 0 2024-09-04T16:30:17.968 INFO:tasks.workunit.client.1.smithi193.stdout:5/794: dread - d1/d8/db/d36/d40/d46/dbe/fd6 zero size 2024-09-04T16:30:17.970 INFO:tasks.workunit.client.1.smithi193.stdout:0/798: dwrite d18/d25/d3b/de9/fff [0,4194304] 0 2024-09-04T16:30:17.970 INFO:tasks.workunit.client.1.smithi193.stdout:8/803: dread d2/d20/dc0/fc3 [0,4194304] 0 2024-09-04T16:30:17.971 INFO:tasks.workunit.client.1.smithi193.stdout:5/795: dread - d1/d29/d74/d96/fd3 zero size 2024-09-04T16:30:17.977 INFO:tasks.workunit.client.1.smithi193.stdout:0/799: creat d18/d25/d32/d57/d6c/db1/f10b x:0 0 0 2024-09-04T16:30:17.978 INFO:tasks.workunit.client.1.smithi193.stdout:8/804: fdatasync d2/d20/d23/d34/dd6/f68 0 2024-09-04T16:30:17.980 INFO:tasks.workunit.client.1.smithi193.stdout:2/759: dwrite d2/f2a [0,4194304] 0 2024-09-04T16:30:17.982 INFO:tasks.workunit.client.1.smithi193.stdout:0/800: unlink d18/d25/d5f/f81 0 2024-09-04T16:30:17.984 INFO:tasks.workunit.client.1.smithi193.stdout:5/796: mknod d1/d8/db/d15/d2b/d83/d37/d58/dca/c104 0 2024-09-04T16:30:17.986 INFO:tasks.workunit.client.1.smithi193.stdout:6/751: dwrite d5/d33/f3a [0,4194304] 0 2024-09-04T16:30:17.987 INFO:tasks.workunit.client.1.smithi193.stdout:1/853: dread d1/d2b/d1b/d28/d50/d84/dd1/de2/fca [0,4194304] 0 2024-09-04T16:30:17.987 INFO:tasks.workunit.client.1.smithi193.stdout:0/801: chown d18/d25/ccb 139 1 2024-09-04T16:30:17.988 INFO:tasks.workunit.client.1.smithi193.stdout:8/805: creat d2/d20/f100 x:0 0 0 2024-09-04T16:30:17.990 INFO:tasks.workunit.client.1.smithi193.stdout:0/802: dread - d18/d25/d5f/fc2 zero size 2024-09-04T16:30:17.991 INFO:tasks.workunit.client.1.smithi193.stdout:6/752: chown d5/d33/d4e/d51/d7b/c86 3268372 1 2024-09-04T16:30:17.991 INFO:tasks.workunit.client.1.smithi193.stdout:2/760: symlink d2/d9/db/d10/d1f/d77/de5/lfc 0 2024-09-04T16:30:17.992 INFO:tasks.workunit.client.1.smithi193.stdout:3/778: dwrite d0/d18/d1b/f36 [0,4194304] 0 2024-09-04T16:30:17.993 INFO:tasks.workunit.client.1.smithi193.stdout:0/803: chown d18/d25/d3b/l6b 5384421 1 2024-09-04T16:30:17.994 INFO:tasks.workunit.client.0.smithi170.stdout:2/314: write d3/d3c/d40/f53 [4068169,20637] 0 2024-09-04T16:30:17.994 INFO:tasks.workunit.client.1.smithi193.stdout:3/779: dread - d0/d9/dae/fed zero size 2024-09-04T16:30:17.994 INFO:tasks.workunit.client.1.smithi193.stdout:5/797: truncate d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/fcf 912334 0 2024-09-04T16:30:17.995 INFO:tasks.workunit.client.0.smithi170.stdout:2/315: write d3/d3c/d40/f53 [1347128,123767] 0 2024-09-04T16:30:17.997 INFO:tasks.workunit.client.1.smithi193.stdout:4/703: sync 2024-09-04T16:30:18.004 INFO:tasks.workunit.client.0.smithi170.stdout:2/316: fdatasync f0 0 2024-09-04T16:30:18.005 INFO:tasks.workunit.client.1.smithi193.stdout:2/761: creat d2/d9/db/d10/d1e/d56/ffd x:0 0 0 2024-09-04T16:30:18.006 INFO:tasks.workunit.client.1.smithi193.stdout:0/804: creat d18/d25/d32/dce/f10c x:0 0 0 2024-09-04T16:30:18.009 INFO:tasks.workunit.client.0.smithi170.stdout:2/317: mknod d3/db/c61 0 2024-09-04T16:30:18.011 INFO:tasks.workunit.client.1.smithi193.stdout:5/798: creat d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f105 x:0 0 0 2024-09-04T16:30:18.011 INFO:tasks.workunit.client.1.smithi193.stdout:8/806: write d2/d20/d23/d51/f63 [1352086,67102] 0 2024-09-04T16:30:18.011 INFO:tasks.workunit.client.0.smithi170.stdout:2/318: mkdir d3/db/d62 0 2024-09-04T16:30:18.012 INFO:tasks.workunit.client.1.smithi193.stdout:5/799: dread - d1/d8/db/d36/d40/fde zero size 2024-09-04T16:30:18.016 INFO:tasks.workunit.client.1.smithi193.stdout:6/753: creat d5/d27/da0/ff7 x:0 0 0 2024-09-04T16:30:18.018 INFO:tasks.workunit.client.1.smithi193.stdout:0/805: creat d18/d25/d5f/def/f10d x:0 0 0 2024-09-04T16:30:18.018 INFO:tasks.workunit.client.1.smithi193.stdout:5/800: dread d1/f5b [0,4194304] 0 2024-09-04T16:30:18.019 INFO:tasks.workunit.client.1.smithi193.stdout:5/801: write d1/dc3/fa8 [3372535,125909] 0 2024-09-04T16:30:18.021 INFO:tasks.workunit.client.1.smithi193.stdout:0/806: truncate d18/d25/d32/d9c/da9/ff1 464152 0 2024-09-04T16:30:18.021 INFO:tasks.workunit.client.1.smithi193.stdout:1/854: link d1/d2b/d10/f25 d1/d2b/db/d54/d107/f108 0 2024-09-04T16:30:18.023 INFO:tasks.workunit.client.1.smithi193.stdout:2/762: mkdir d2/d9/db/d10/dfe 0 2024-09-04T16:30:18.026 INFO:tasks.workunit.client.1.smithi193.stdout:5/802: rmdir d1/d8/db/d15/d2b/d83/d37/d58/d9e 39 2024-09-04T16:30:18.028 INFO:tasks.workunit.client.1.smithi193.stdout:5/803: read - d1/d8/db/d15/d2b/d83/d37/d58/fe3 zero size 2024-09-04T16:30:18.028 INFO:tasks.workunit.client.1.smithi193.stdout:0/807: creat d18/d25/d5f/def/dfa/f10e x:0 0 0 2024-09-04T16:30:18.029 INFO:tasks.workunit.client.1.smithi193.stdout:1/855: fdatasync d1/d2b/d1b/d51/d6d/d89/f93 0 2024-09-04T16:30:18.030 INFO:tasks.workunit.client.1.smithi193.stdout:0/808: chown d18/d25/d32/d57/d6c/db1/dc9 2 1 2024-09-04T16:30:18.030 INFO:tasks.workunit.client.1.smithi193.stdout:6/754: symlink d5/de/d15/dda/lf8 0 2024-09-04T16:30:18.030 INFO:tasks.workunit.client.1.smithi193.stdout:2/763: dwrite d2/d9/db/d10/d38/da5/feb [0,4194304] 0 2024-09-04T16:30:18.032 INFO:tasks.workunit.client.1.smithi193.stdout:2/764: chown d2/d9/db/d65/f9e 0 1 2024-09-04T16:30:18.035 INFO:tasks.workunit.client.1.smithi193.stdout:5/804: chown d1/d8/db/d15/d2b/d83/d37/d3f/d8e/f66 236711824 1 2024-09-04T16:30:18.036 INFO:tasks.workunit.client.1.smithi193.stdout:5/805: write d1/d8/db/d36/d40/d46/ff3 [943414,23737] 0 2024-09-04T16:30:18.037 INFO:tasks.workunit.client.1.smithi193.stdout:1/856: symlink d1/d39/d101/l109 0 2024-09-04T16:30:18.038 INFO:tasks.workunit.client.1.smithi193.stdout:1/857: fdatasync d1/d2b/d10/fa5 0 2024-09-04T16:30:18.041 INFO:tasks.workunit.client.0.smithi170.stdout:2/319: dwrite d3/db/d1c/f23 [0,4194304] 0 2024-09-04T16:30:18.042 INFO:tasks.workunit.client.1.smithi193.stdout:2/765: rename d2/d9/db/d10/d1f/dd0 to d2/d9/db/d10/d1f/d77/d91/dff 0 2024-09-04T16:30:18.042 INFO:tasks.workunit.client.1.smithi193.stdout:3/780: write d0/d18/f50 [3517978,32357] 0 2024-09-04T16:30:18.043 INFO:tasks.workunit.client.1.smithi193.stdout:8/807: write d2/d20/d23/d34/d46/d53/f97 [2355910,50858] 0 2024-09-04T16:30:18.046 INFO:tasks.workunit.client.1.smithi193.stdout:6/755: creat d5/de/d15/ff9 x:0 0 0 2024-09-04T16:30:18.050 INFO:tasks.workunit.client.1.smithi193.stdout:1/858: dwrite d1/d2b/d10/d56/faa [0,4194304] 0 2024-09-04T16:30:18.056 INFO:tasks.workunit.client.0.smithi170.stdout:0/411: sync 2024-09-04T16:30:18.057 INFO:tasks.workunit.client.0.smithi170.stdout:0/412: truncate d11/d13/d71/d43/f58 1502115 0 2024-09-04T16:30:18.062 INFO:tasks.workunit.client.0.smithi170.stdout:0/413: creat d11/d75/f9e x:0 0 0 2024-09-04T16:30:18.064 INFO:tasks.workunit.client.0.smithi170.stdout:0/414: dread - d11/d13/d2f/d3f/f65 zero size 2024-09-04T16:30:18.068 INFO:tasks.workunit.client.0.smithi170.stdout:0/415: rename d11/d13/d2f/d3f/l8d to d11/d75/d77/l9f 0 2024-09-04T16:30:18.070 INFO:tasks.workunit.client.0.smithi170.stdout:0/416: creat d11/d13/d4a/d66/fa0 x:0 0 0 2024-09-04T16:30:18.075 INFO:tasks.workunit.client.1.smithi193.stdout:9/839: sync 2024-09-04T16:30:18.075 INFO:tasks.workunit.client.1.smithi193.stdout:7/885: sync 2024-09-04T16:30:18.086 INFO:tasks.workunit.client.0.smithi170.stdout:0/417: dwrite d11/d75/d77/f81 [0,4194304] 0 2024-09-04T16:30:18.095 INFO:tasks.workunit.client.1.smithi193.stdout:8/808: symlink d2/d20/d23/d24/d3c/de7/l101 0 2024-09-04T16:30:18.095 INFO:tasks.workunit.client.1.smithi193.stdout:1/859: mknod d1/c10a 0 2024-09-04T16:30:18.096 INFO:tasks.workunit.client.1.smithi193.stdout:9/840: read d2/d4/f23 [89043,119795] 0 2024-09-04T16:30:18.096 INFO:tasks.workunit.client.1.smithi193.stdout:3/781: rename d0/d18/d1c/d25/d5e/lbb to d0/d18/d1c/d25/d5e/d68/lfd 0 2024-09-04T16:30:18.097 INFO:tasks.workunit.client.1.smithi193.stdout:2/766: dread d2/d9/db/d10/d38/da5/feb [0,4194304] 0 2024-09-04T16:30:18.097 INFO:tasks.workunit.client.1.smithi193.stdout:1/860: dread - d1/d39/d48/ff5 zero size 2024-09-04T16:30:18.099 INFO:tasks.workunit.client.1.smithi193.stdout:9/841: write d2/d18/d2f/d22/d30/d6a/f7a [494826,76031] 0 2024-09-04T16:30:18.100 INFO:tasks.workunit.client.1.smithi193.stdout:3/782: write d0/d18/d1c/d25/d5e/d90/fb8 [1387595,100901] 0 2024-09-04T16:30:18.100 INFO:tasks.workunit.client.1.smithi193.stdout:6/756: rename d5/d33/c52 to d5/d33/d4e/d51/d71/d82/cfa 0 2024-09-04T16:30:18.100 INFO:tasks.workunit.client.0.smithi170.stdout:0/418: dread d11/f15 [0,4194304] 0 2024-09-04T16:30:18.101 INFO:tasks.workunit.client.1.smithi193.stdout:1/861: write d1/d2b/d10/d56/f6b [64835,105209] 0 2024-09-04T16:30:18.102 INFO:tasks.workunit.client.1.smithi193.stdout:9/842: fsync d2/d18/d2f/d22/d30/d6a/d6e/d95/fec 0 2024-09-04T16:30:18.104 INFO:tasks.workunit.client.0.smithi170.stdout:0/419: creat d11/fa1 x:0 0 0 2024-09-04T16:30:18.107 INFO:tasks.workunit.client.1.smithi193.stdout:9/843: mknod d2/d18/d2f/d22/d30/dfc/c109 0 2024-09-04T16:30:18.109 INFO:tasks.workunit.client.0.smithi170.stdout:0/420: link d11/d13/d36/c99 d11/d13/ca2 0 2024-09-04T16:30:18.110 INFO:tasks.workunit.client.0.smithi170.stdout:0/421: creat d11/d13/d35/fa3 x:0 0 0 2024-09-04T16:30:18.111 INFO:tasks.workunit.client.1.smithi193.stdout:3/783: dwrite d0/d18/d1b/f36 [4194304,4194304] 0 2024-09-04T16:30:18.112 INFO:tasks.workunit.client.1.smithi193.stdout:9/844: creat d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/df1/f10a x:0 0 0 2024-09-04T16:30:18.113 INFO:tasks.workunit.client.1.smithi193.stdout:6/757: dread d5/de/d15/d48/f65 [0,4194304] 0 2024-09-04T16:30:18.113 INFO:tasks.workunit.client.0.smithi170.stdout:0/422: symlink d11/d13/d71/la4 0 2024-09-04T16:30:18.113 INFO:tasks.workunit.client.1.smithi193.stdout:9/845: chown d2/d56/d86/dc2/dde 135013 1 2024-09-04T16:30:18.114 INFO:tasks.workunit.client.0.smithi170.stdout:0/423: chown d11/d13/d36/l44 44560 1 2024-09-04T16:30:18.117 INFO:tasks.workunit.client.1.smithi193.stdout:3/784: rename d0/d18/d1c/d25/d5e/d68/fd8 to d0/d18/d1c/d25/da0/dcd/ffe 0 2024-09-04T16:30:18.120 INFO:tasks.workunit.client.1.smithi193.stdout:6/758: dwrite d5/de/f41 [0,4194304] 0 2024-09-04T16:30:18.122 INFO:tasks.workunit.client.1.smithi193.stdout:9/846: dwrite d2/d18/d2f/d22/d30/f9b [0,4194304] 0 2024-09-04T16:30:18.123 INFO:tasks.workunit.client.1.smithi193.stdout:6/759: read - d5/d33/d85/ff3 zero size 2024-09-04T16:30:18.123 INFO:tasks.workunit.client.1.smithi193.stdout:9/847: readlink d2/d18/d2f/d22/l77 0 2024-09-04T16:30:18.128 INFO:tasks.workunit.client.1.smithi193.stdout:7/886: write d9/d18/d22/d2b/d6c/d70/d79/dbc/fc9 [886227,117488] 0 2024-09-04T16:30:18.130 INFO:tasks.workunit.client.1.smithi193.stdout:9/848: creat d2/d18/d2f/d9a/de4/f10b x:0 0 0 2024-09-04T16:30:18.134 INFO:tasks.workunit.client.0.smithi170.stdout:0/424: write d11/d13/d4a/f4e [132367,112671] 0 2024-09-04T16:30:18.136 INFO:tasks.workunit.client.0.smithi170.stdout:0/425: creat d11/d13/d35/fa5 x:0 0 0 2024-09-04T16:30:18.137 INFO:tasks.workunit.client.1.smithi193.stdout:1/862: dread d1/d2b/d10/f1f [4194304,4194304] 0 2024-09-04T16:30:18.138 INFO:tasks.workunit.client.1.smithi193.stdout:7/887: mkdir d9/de/d11b/d123 0 2024-09-04T16:30:18.139 INFO:tasks.workunit.client.1.smithi193.stdout:8/809: dwrite d2/d20/dc0/fbf [0,4194304] 0 2024-09-04T16:30:18.139 INFO:tasks.workunit.client.1.smithi193.stdout:9/849: truncate d2/d56/d86/ff6 737753 0 2024-09-04T16:30:18.146 INFO:tasks.workunit.client.1.smithi193.stdout:6/760: dwrite d5/d27/d3e/d6e/fc8 [0,4194304] 0 2024-09-04T16:30:18.147 INFO:tasks.workunit.client.1.smithi193.stdout:2/767: dwrite d2/d9/d18/f28 [0,4194304] 0 2024-09-04T16:30:18.148 INFO:tasks.workunit.client.1.smithi193.stdout:1/863: unlink d1/d2b/db/d54/c55 0 2024-09-04T16:30:18.148 INFO:tasks.workunit.client.1.smithi193.stdout:3/785: dwrite d0/d3b/fc9 [0,4194304] 0 2024-09-04T16:30:18.150 INFO:tasks.workunit.client.1.smithi193.stdout:7/888: fsync d9/d39/d3e/d7d/f9e 0 2024-09-04T16:30:18.153 INFO:tasks.workunit.client.1.smithi193.stdout:9/850: write d2/d18/d2f/d22/d30/d52/fcf [829883,57904] 0 2024-09-04T16:30:18.155 INFO:tasks.workunit.client.1.smithi193.stdout:8/810: mkdir d2/d20/d23/d34/d4b/d102 0 2024-09-04T16:30:18.158 INFO:tasks.workunit.client.1.smithi193.stdout:6/761: unlink d5/d27/d3e/d43/d5d/d97/fbb 0 2024-09-04T16:30:18.159 INFO:tasks.workunit.client.1.smithi193.stdout:4/704: sync 2024-09-04T16:30:18.159 INFO:tasks.workunit.client.1.smithi193.stdout:2/768: mknod d2/d9/db/d10/d38/da5/c100 0 2024-09-04T16:30:18.160 INFO:tasks.workunit.client.1.smithi193.stdout:1/864: truncate d1/d2b/d10/f59 1062644 0 2024-09-04T16:30:18.162 INFO:tasks.workunit.client.1.smithi193.stdout:5/806: sync 2024-09-04T16:30:18.162 INFO:tasks.workunit.client.1.smithi193.stdout:0/809: sync 2024-09-04T16:30:18.162 INFO:tasks.workunit.client.1.smithi193.stdout:9/851: creat d2/d8/d25/ded/f10c x:0 0 0 2024-09-04T16:30:18.164 INFO:tasks.workunit.client.1.smithi193.stdout:3/786: creat d0/d9/fff x:0 0 0 2024-09-04T16:30:18.165 INFO:tasks.workunit.client.1.smithi193.stdout:1/865: chown d1/d2b/d1b/d28/d50/ldd 958783507 1 2024-09-04T16:30:18.165 INFO:tasks.workunit.client.1.smithi193.stdout:7/889: dwrite d9/de/d27/ff2 [0,4194304] 0 2024-09-04T16:30:18.166 INFO:tasks.workunit.client.1.smithi193.stdout:8/811: rename d2/d57/da1 to d2/d20/d23/d34/d4b/dd4/d103 0 2024-09-04T16:30:18.168 INFO:tasks.workunit.client.1.smithi193.stdout:4/705: symlink d3/d1a/le7 0 2024-09-04T16:30:18.173 INFO:tasks.workunit.client.1.smithi193.stdout:6/762: dwrite d5/d27/d3e/d43/fcc [4194304,4194304] 0 2024-09-04T16:30:18.174 INFO:tasks.workunit.client.1.smithi193.stdout:0/810: rename d18/d25/d5f/lfd to d18/d79/d88/l10f 0 2024-09-04T16:30:18.174 INFO:tasks.workunit.client.1.smithi193.stdout:8/812: fdatasync d2/d20/d23/d51/fbd 0 2024-09-04T16:30:18.175 INFO:tasks.workunit.client.1.smithi193.stdout:1/866: mkdir d1/d2b/d10/d56/da7/db1/d10b 0 2024-09-04T16:30:18.177 INFO:tasks.workunit.client.1.smithi193.stdout:4/706: creat d3/d1a/d21/d52/d7f/fe8 x:0 0 0 2024-09-04T16:30:18.179 INFO:tasks.workunit.client.1.smithi193.stdout:6/763: rmdir d5/de/d15/d1b/d5f/da7/db2 39 2024-09-04T16:30:18.179 INFO:tasks.workunit.client.1.smithi193.stdout:8/813: dread d2/f7f [0,4194304] 0 2024-09-04T16:30:18.180 INFO:tasks.workunit.client.1.smithi193.stdout:6/764: stat d5/d27/d3e/d43 0 2024-09-04T16:30:18.181 INFO:tasks.workunit.client.1.smithi193.stdout:8/814: read d2/d12/f8e [3292664,40220] 0 2024-09-04T16:30:18.181 INFO:tasks.workunit.client.1.smithi193.stdout:7/890: getdents d9 0 2024-09-04T16:30:18.182 INFO:tasks.workunit.client.1.smithi193.stdout:4/707: symlink d3/d3c/d89/dbd/le9 0 2024-09-04T16:30:18.184 INFO:tasks.workunit.client.1.smithi193.stdout:6/765: unlink d5/de/d15/f2f 0 2024-09-04T16:30:18.184 INFO:tasks.workunit.client.1.smithi193.stdout:8/815: stat d2/d20/d23/d34/dd6/da0 0 2024-09-04T16:30:18.187 INFO:tasks.workunit.client.1.smithi193.stdout:4/708: write d3/d1a/d21/f2c [2875739,107216] 0 2024-09-04T16:30:18.189 INFO:tasks.workunit.client.1.smithi193.stdout:7/891: fsync d9/d39/d3e/d4d/d98/d9a/f108 0 2024-09-04T16:30:18.190 INFO:tasks.workunit.client.1.smithi193.stdout:0/811: dread d18/d25/d32/d9c/da9/fd2 [0,4194304] 0 2024-09-04T16:30:18.193 INFO:tasks.workunit.client.1.smithi193.stdout:1/867: dwrite d1/d2b/f2c [4194304,4194304] 0 2024-09-04T16:30:18.194 INFO:tasks.workunit.client.1.smithi193.stdout:6/766: symlink d5/d27/d3e/d43/lfb 0 2024-09-04T16:30:18.194 INFO:tasks.workunit.client.1.smithi193.stdout:8/816: creat d2/d20/d23/d34/d4b/db8/f104 x:0 0 0 2024-09-04T16:30:18.195 INFO:tasks.workunit.client.1.smithi193.stdout:4/709: creat d3/d1a/d21/d52/fea x:0 0 0 2024-09-04T16:30:18.197 INFO:tasks.workunit.client.1.smithi193.stdout:4/710: write d3/f6 [3843909,15442] 0 2024-09-04T16:30:18.197 INFO:tasks.workunit.client.1.smithi193.stdout:7/892: truncate d9/d11/d113/fc7 556010 0 2024-09-04T16:30:18.198 INFO:tasks.workunit.client.1.smithi193.stdout:5/807: dread d1/d8/db/d15/d2b/d83/f4b [4194304,4194304] 0 2024-09-04T16:30:18.200 INFO:tasks.workunit.client.1.smithi193.stdout:3/787: dread d0/d18/d1c/d51/d5a/f77 [0,4194304] 0 2024-09-04T16:30:18.200 INFO:tasks.workunit.client.1.smithi193.stdout:4/711: chown d3/d1a/d21/f37 0 1 2024-09-04T16:30:18.202 INFO:tasks.workunit.client.1.smithi193.stdout:5/808: truncate d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f91 4978901 0 2024-09-04T16:30:18.203 INFO:tasks.workunit.client.1.smithi193.stdout:6/767: rename d5/d33/d4e/d51/d68/fb6 to d5/de/d15/d48/ffc 0 2024-09-04T16:30:18.204 INFO:tasks.workunit.client.1.smithi193.stdout:7/893: symlink d9/d39/d3e/d7d/l124 0 2024-09-04T16:30:18.205 INFO:tasks.workunit.client.1.smithi193.stdout:7/894: dread - d9/d39/d3e/d4d/d4f/fb4 zero size 2024-09-04T16:30:18.206 INFO:tasks.workunit.client.1.smithi193.stdout:3/788: unlink d0/d7/de/d45/ff9 0 2024-09-04T16:30:18.207 INFO:tasks.workunit.client.1.smithi193.stdout:4/712: mkdir d3/d1a/d21/d52/d7f/deb 0 2024-09-04T16:30:18.208 INFO:tasks.workunit.client.1.smithi193.stdout:3/789: chown d0/d18/d1c/d25/d5e/d90/cea 328897 1 2024-09-04T16:30:18.209 INFO:tasks.workunit.client.1.smithi193.stdout:5/809: write d1/d8/db/d36/d40/fc5 [2801433,127719] 0 2024-09-04T16:30:18.210 INFO:tasks.workunit.client.1.smithi193.stdout:8/817: rename d2/d20/d23/d34/d3e/d6f/d81/ca9 to d2/d20/d23/d51/d76/dfa/c105 0 2024-09-04T16:30:18.212 INFO:tasks.workunit.client.1.smithi193.stdout:3/790: creat d0/d3b/f100 x:0 0 0 2024-09-04T16:30:18.213 INFO:tasks.workunit.client.1.smithi193.stdout:4/713: truncate d3/d1a/d2a/d83/fb4 1290283 0 2024-09-04T16:30:18.213 INFO:tasks.workunit.client.1.smithi193.stdout:5/810: read d1/d8/db/d15/d2b/d83/d37/f63 [985599,1129] 0 2024-09-04T16:30:18.213 INFO:tasks.workunit.client.1.smithi193.stdout:3/791: chown d0/d9/f58 521072 1 2024-09-04T16:30:18.214 INFO:tasks.workunit.client.1.smithi193.stdout:6/768: rename d5/d33/d85/ce3 to d5/d33/d4e/d51/d7b/de0/cfd 0 2024-09-04T16:30:18.214 INFO:tasks.workunit.client.1.smithi193.stdout:3/792: fsync d0/d18/d1b/d3d/d96/fd0 0 2024-09-04T16:30:18.215 INFO:tasks.workunit.client.1.smithi193.stdout:5/811: rmdir d1/d29/d74 39 2024-09-04T16:30:18.216 INFO:tasks.workunit.client.1.smithi193.stdout:4/714: mkdir d3/d3c/d98/de2/dec 0 2024-09-04T16:30:18.217 INFO:tasks.workunit.client.1.smithi193.stdout:7/895: getdents d9/d39/d3e/d4d/d4f/dab 0 2024-09-04T16:30:18.217 INFO:tasks.workunit.client.1.smithi193.stdout:1/868: dread d1/d2b/d10/f21 [0,4194304] 0 2024-09-04T16:30:18.217 INFO:tasks.workunit.client.1.smithi193.stdout:4/715: write d3/d1a/d54/f64 [1459127,82062] 0 2024-09-04T16:30:18.218 INFO:tasks.workunit.client.1.smithi193.stdout:3/793: mkdir d0/d9/dae/d101 0 2024-09-04T16:30:18.218 INFO:tasks.workunit.client.1.smithi193.stdout:6/769: symlink d5/d33/d4e/d51/d7b/de0/lfe 0 2024-09-04T16:30:18.219 INFO:tasks.workunit.client.1.smithi193.stdout:3/794: chown d0/d18/f50 122 1 2024-09-04T16:30:18.219 INFO:tasks.workunit.client.1.smithi193.stdout:8/818: rmdir d2/d20/d23/d34/d3e/dc5 0 2024-09-04T16:30:18.221 INFO:tasks.workunit.client.1.smithi193.stdout:4/716: symlink d3/d1a/d54/led 0 2024-09-04T16:30:18.222 INFO:tasks.workunit.client.1.smithi193.stdout:7/896: mkdir d9/de/d27/d62/d72/d125 0 2024-09-04T16:30:18.222 INFO:tasks.workunit.client.1.smithi193.stdout:4/717: write d3/d3c/d47/fc6 [342923,96792] 0 2024-09-04T16:30:18.223 INFO:tasks.workunit.client.1.smithi193.stdout:6/770: write d5/de/d15/d1b/d5f/fce [848961,127112] 0 2024-09-04T16:30:18.223 INFO:tasks.workunit.client.1.smithi193.stdout:7/897: chown d9/de/f49 6 1 2024-09-04T16:30:18.223 INFO:tasks.workunit.client.1.smithi193.stdout:3/795: symlink d0/d18/d1c/d25/da0/dcd/l102 0 2024-09-04T16:30:18.224 INFO:tasks.workunit.client.1.smithi193.stdout:8/819: creat d2/d20/d23/d34/dd6/da0/da8/db9/f106 x:0 0 0 2024-09-04T16:30:18.226 INFO:tasks.workunit.client.1.smithi193.stdout:1/869: creat d1/d2b/d10/d56/f10c x:0 0 0 2024-09-04T16:30:18.226 INFO:tasks.workunit.client.1.smithi193.stdout:4/718: symlink d3/d3c/d47/lee 0 2024-09-04T16:30:18.228 INFO:tasks.workunit.client.1.smithi193.stdout:3/796: rename d0/d18/dee to d0/d18/d1c/d25/d5e/d90/d103 0 2024-09-04T16:30:18.229 INFO:tasks.workunit.client.1.smithi193.stdout:8/820: rmdir d2/d20/d23/d34/d4b/d7c/db2 39 2024-09-04T16:30:18.230 INFO:tasks.workunit.client.1.smithi193.stdout:3/797: readlink d0/d18/d1c/d25/ld9 0 2024-09-04T16:30:18.230 INFO:tasks.workunit.client.1.smithi193.stdout:4/719: stat d3/d1a/d2a/cb7 0 2024-09-04T16:30:18.231 INFO:tasks.workunit.client.1.smithi193.stdout:7/898: dwrite d9/d18/d1e/f43 [0,4194304] 0 2024-09-04T16:30:18.231 INFO:tasks.workunit.client.1.smithi193.stdout:1/870: creat d1/d2b/d1b/d51/d6d/d89/dc7/f10d x:0 0 0 2024-09-04T16:30:18.232 INFO:tasks.workunit.client.1.smithi193.stdout:5/812: link d1/d29/d18/ca4 d1/d8/db/d36/d40/d46/c106 0 2024-09-04T16:30:18.233 INFO:tasks.workunit.client.1.smithi193.stdout:6/771: creat d5/fff x:0 0 0 2024-09-04T16:30:18.234 INFO:tasks.workunit.client.1.smithi193.stdout:5/813: fsync d1/d8/db/d15/f47 0 2024-09-04T16:30:18.237 INFO:tasks.workunit.client.1.smithi193.stdout:1/871: mknod d1/d2b/d1b/d51/d6d/d89/dc7/c10e 0 2024-09-04T16:30:18.238 INFO:tasks.workunit.client.1.smithi193.stdout:3/798: read d0/d7/de/d45/f93 [3681661,54662] 0 2024-09-04T16:30:18.238 INFO:tasks.workunit.client.1.smithi193.stdout:7/899: creat d9/d39/d3e/d69/dcf/f126 x:0 0 0 2024-09-04T16:30:18.240 INFO:tasks.workunit.client.1.smithi193.stdout:7/900: chown d9/d18/d22/d2b/f91 8654071 1 2024-09-04T16:30:18.243 INFO:tasks.workunit.client.1.smithi193.stdout:1/872: mkdir d1/d2b/d1b/d51/d6d/d89/dc7/d10f 0 2024-09-04T16:30:18.250 INFO:tasks.workunit.client.1.smithi193.stdout:8/821: getdents d2/d20/d23/d34/d46/d53/d90 0 2024-09-04T16:30:18.251 INFO:tasks.workunit.client.1.smithi193.stdout:5/814: rmdir d1/d8/db/d15/d2b/d83/d37/d58/de0/df7 0 2024-09-04T16:30:18.254 INFO:tasks.workunit.client.1.smithi193.stdout:2/769: write d2/d9/db/d10/d38/f70 [2809172,56406] 0 2024-09-04T16:30:18.258 INFO:tasks.workunit.client.1.smithi193.stdout:1/873: dwrite d1/d2b/d1b/d51/fa6 [0,4194304] 0 2024-09-04T16:30:18.258 INFO:tasks.workunit.client.1.smithi193.stdout:7/901: dwrite d9/d39/d3e/d4d/d4f/f122 [0,4194304] 0 2024-09-04T16:30:18.258 INFO:tasks.workunit.client.1.smithi193.stdout:3/799: dwrite d0/d18/d1c/d51/d6c/df8/fba [0,4194304] 0 2024-09-04T16:30:18.259 INFO:tasks.workunit.client.1.smithi193.stdout:9/852: sync 2024-09-04T16:30:18.262 INFO:tasks.workunit.client.1.smithi193.stdout:7/902: readlink d9/de/l75 0 2024-09-04T16:30:18.263 INFO:tasks.workunit.client.1.smithi193.stdout:3/800: dread - d0/d9/dae/fed zero size 2024-09-04T16:30:18.265 INFO:tasks.workunit.client.1.smithi193.stdout:0/812: truncate d18/d25/d3b/de9/fff 1174584 0 2024-09-04T16:30:18.266 INFO:tasks.workunit.client.1.smithi193.stdout:8/822: creat d2/d20/d23/d34/d4b/d7c/db2/f107 x:0 0 0 2024-09-04T16:30:18.267 INFO:tasks.workunit.client.1.smithi193.stdout:7/903: mknod d9/d85/c127 0 2024-09-04T16:30:18.269 INFO:tasks.workunit.client.1.smithi193.stdout:8/823: fdatasync d2/d20/dc0/fbf 0 2024-09-04T16:30:18.271 INFO:tasks.workunit.client.1.smithi193.stdout:3/801: unlink d0/d18/d1c/d30/c32 0 2024-09-04T16:30:18.273 INFO:tasks.workunit.client.1.smithi193.stdout:1/874: symlink d1/d2b/d10/d56/da7/db1/d10b/l110 0 2024-09-04T16:30:18.273 INFO:tasks.workunit.client.1.smithi193.stdout:2/770: dwrite d2/d9/db/d10/f6e [4194304,4194304] 0 2024-09-04T16:30:18.276 INFO:tasks.workunit.client.1.smithi193.stdout:3/802: read - d0/d18/d1c/d51/d6c/fe6 zero size 2024-09-04T16:30:18.277 INFO:tasks.workunit.client.1.smithi193.stdout:6/772: dread d5/d27/f35 [4194304,4194304] 0 2024-09-04T16:30:18.280 INFO:tasks.workunit.client.1.smithi193.stdout:0/813: dwrite d18/d25/d5f/def/dfa/f10e [0,4194304] 0 2024-09-04T16:30:18.281 INFO:tasks.workunit.client.1.smithi193.stdout:7/904: symlink d9/d39/d3e/d4d/d98/d9a/db6/l128 0 2024-09-04T16:30:18.284 INFO:tasks.workunit.client.1.smithi193.stdout:5/815: getdents d1/d8/db/d15/d2b/d83/d37/d58/d9e/dec 0 2024-09-04T16:30:18.286 INFO:tasks.workunit.client.1.smithi193.stdout:1/875: unlink d1/d2b/d10/fa5 0 2024-09-04T16:30:18.289 INFO:tasks.workunit.client.1.smithi193.stdout:2/771: dwrite d2/fc [12582912,4194304] 0 2024-09-04T16:30:18.292 INFO:tasks.workunit.client.1.smithi193.stdout:6/773: rmdir d5/d33/d4e/d51/d7b/de0 39 2024-09-04T16:30:18.296 INFO:tasks.workunit.client.1.smithi193.stdout:4/720: truncate d3/d3c/d47/fc6 1204074 0 2024-09-04T16:30:18.297 INFO:tasks.workunit.client.1.smithi193.stdout:5/816: creat d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/dd8/f107 x:0 0 0 2024-09-04T16:30:18.298 INFO:tasks.workunit.client.1.smithi193.stdout:6/774: read d5/f5e [3883686,98030] 0 2024-09-04T16:30:18.299 INFO:tasks.workunit.client.1.smithi193.stdout:0/814: symlink d18/d25/d5f/d6a/l110 0 2024-09-04T16:30:18.302 INFO:tasks.workunit.client.1.smithi193.stdout:8/824: dread d2/d20/d23/d1b/f48 [0,4194304] 0 2024-09-04T16:30:18.302 INFO:tasks.workunit.client.1.smithi193.stdout:4/721: mknod d3/d39/d44/dd5/cef 0 2024-09-04T16:30:18.304 INFO:tasks.workunit.client.1.smithi193.stdout:0/815: read d18/d25/d32/d57/f4e [2590461,28024] 0 2024-09-04T16:30:18.306 INFO:tasks.workunit.client.1.smithi193.stdout:5/817: chown d1/d8/db/d36/d40/d46/c9b 13781 1 2024-09-04T16:30:18.306 INFO:tasks.workunit.client.1.smithi193.stdout:2/772: mknod d2/d9/db/d10/d1e/c101 0 2024-09-04T16:30:18.308 INFO:tasks.workunit.client.1.smithi193.stdout:9/853: truncate d2/d8/d61/f87 516478 0 2024-09-04T16:30:18.310 INFO:tasks.workunit.client.1.smithi193.stdout:4/722: dwrite d3/d1a/d21/f37 [0,4194304] 0 2024-09-04T16:30:18.310 INFO:tasks.workunit.client.1.smithi193.stdout:2/773: truncate d2/d9/d61/fe4 313847 0 2024-09-04T16:30:18.310 INFO:tasks.workunit.client.1.smithi193.stdout:8/825: rename d2/d20/d23/d24/df7/fb3 to d2/d20/d23/d34/d46/d53/d90/f108 0 2024-09-04T16:30:18.313 INFO:tasks.workunit.client.1.smithi193.stdout:4/723: write d3/d39/d44/dd5/f71 [4564236,5266] 0 2024-09-04T16:30:18.313 INFO:tasks.workunit.client.1.smithi193.stdout:0/816: read d18/d79/d88/d9a/f105 [254870,54419] 0 2024-09-04T16:30:18.316 INFO:tasks.workunit.client.1.smithi193.stdout:4/724: chown d3/d1a/d54/led 9451 1 2024-09-04T16:30:18.316 INFO:tasks.workunit.client.1.smithi193.stdout:5/818: creat d1/d8/db/d15/d2b/d83/d37/d58/dc4/dda/f108 x:0 0 0 2024-09-04T16:30:18.318 INFO:tasks.workunit.client.1.smithi193.stdout:9/854: unlink d2/l2d 0 2024-09-04T16:30:18.318 INFO:tasks.workunit.client.1.smithi193.stdout:8/826: rmdir d2/d20/d23/d24/d3c/d65 39 2024-09-04T16:30:18.319 INFO:tasks.workunit.client.1.smithi193.stdout:4/725: read - d3/d3c/f8d zero size 2024-09-04T16:30:18.320 INFO:tasks.workunit.client.1.smithi193.stdout:2/774: dwrite d2/d9/db/f21 [0,4194304] 0 2024-09-04T16:30:18.324 INFO:tasks.workunit.client.1.smithi193.stdout:9/855: write d2/d8/d4d/ff3 [622824,82004] 0 2024-09-04T16:30:18.324 INFO:tasks.workunit.client.1.smithi193.stdout:2/775: mkdir d2/d9/db/d10/d1e/d56/d59/d102 0 2024-09-04T16:30:18.326 INFO:tasks.workunit.client.1.smithi193.stdout:7/905: write d9/d18/d1e/f71 [2649740,92965] 0 2024-09-04T16:30:18.328 INFO:tasks.workunit.client.1.smithi193.stdout:5/819: creat d1/d29/d74/d96/d98/f109 x:0 0 0 2024-09-04T16:30:18.336 INFO:tasks.workunit.client.1.smithi193.stdout:1/876: write d1/d2b/d1b/d51/d6d/d89/fff [829812,101868] 0 2024-09-04T16:30:18.338 INFO:tasks.workunit.client.1.smithi193.stdout:2/776: rmdir d2/d9/db/d10/d1f/d4a 39 2024-09-04T16:30:18.340 INFO:tasks.workunit.client.1.smithi193.stdout:8/827: fsync d2/d20/d23/d34/d46/d53/d90/f108 0 2024-09-04T16:30:18.342 INFO:tasks.workunit.client.1.smithi193.stdout:0/817: dwrite d18/fa2 [0,4194304] 0 2024-09-04T16:30:18.345 INFO:tasks.workunit.client.1.smithi193.stdout:3/803: dwrite d0/d18/d1b/d3d/fa8 [0,4194304] 0 2024-09-04T16:30:18.347 INFO:tasks.workunit.client.1.smithi193.stdout:4/726: dwrite d3/f8e [0,4194304] 0 2024-09-04T16:30:18.347 INFO:tasks.workunit.client.1.smithi193.stdout:6/775: dread d5/de/d15/f67 [0,4194304] 0 2024-09-04T16:30:18.348 INFO:tasks.workunit.client.1.smithi193.stdout:1/877: mknod d1/d2b/d10/db7/c111 0 2024-09-04T16:30:18.348 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:18 smithi170 ceph-mon[29272]: pgmap v29: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail; 104 MiB/s rd, 328 MiB/s wr, 611 op/s 2024-09-04T16:30:18.350 INFO:tasks.workunit.client.1.smithi193.stdout:9/856: rename d2/d8/cc1 to d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/df4/dfa/c10d 0 2024-09-04T16:30:18.355 INFO:tasks.workunit.client.1.smithi193.stdout:2/777: chown d2/d9/db/d10/d1f/d4a/dc2/dc4/cea 1 1 2024-09-04T16:30:18.355 INFO:tasks.workunit.client.0.smithi170.stdout:4/343: sync 2024-09-04T16:30:18.357 INFO:tasks.workunit.client.1.smithi193.stdout:6/776: chown d5/d33/d4e/d51/d71/lc5 44 1 2024-09-04T16:30:18.358 INFO:tasks.workunit.client.1.smithi193.stdout:5/820: truncate d1/d8/db/f4e 3172639 0 2024-09-04T16:30:18.360 INFO:tasks.workunit.client.0.smithi170.stdout:4/344: rename d1/d6/d8/d20/d35/d54/d58 to d1/d6/d2b/d33/d36/d79 0 2024-09-04T16:30:18.361 INFO:tasks.workunit.client.1.smithi193.stdout:7/906: dwrite d9/d18/d22/d2b/d6c/d70/f8d [0,4194304] 0 2024-09-04T16:30:18.369 INFO:tasks.workunit.client.1.smithi193.stdout:1/878: truncate d1/d2b/d1b/f4c 1765813 0 2024-09-04T16:30:18.369 INFO:tasks.workunit.client.1.smithi193.stdout:5/821: chown d1/d8/db/c9f 251466765 1 2024-09-04T16:30:18.371 INFO:tasks.workunit.client.1.smithi193.stdout:6/777: chown d5/d27/d3e/d6e/fc8 35060 1 2024-09-04T16:30:18.372 INFO:tasks.workunit.client.1.smithi193.stdout:8/828: dwrite d2/d20/d23/d34/d4b/db8/fc1 [0,4194304] 0 2024-09-04T16:30:18.375 INFO:tasks.workunit.client.1.smithi193.stdout:3/804: truncate d0/d18/d1c/d51/d6c/df8/fb0 4086150 0 2024-09-04T16:30:18.376 INFO:tasks.workunit.client.1.smithi193.stdout:0/818: dwrite d18/d25/d32/d57/d6c/db1/dc9/ff3 [0,4194304] 0 2024-09-04T16:30:18.378 INFO:tasks.workunit.client.1.smithi193.stdout:4/727: dwrite d3/d39/d44/dd5/f71 [0,4194304] 0 2024-09-04T16:30:18.379 INFO:tasks.workunit.client.1.smithi193.stdout:7/907: truncate d9/d11/f4e 3325090 0 2024-09-04T16:30:18.381 INFO:tasks.workunit.client.1.smithi193.stdout:2/778: getdents d2/d9/db/d10/d1e/d56/d59/d102 0 2024-09-04T16:30:18.388 INFO:tasks.workunit.client.1.smithi193.stdout:4/728: write d3/f29 [3259870,62605] 0 2024-09-04T16:30:18.389 INFO:tasks.workunit.client.1.smithi193.stdout:1/879: dwrite d1/d2b/d10/fe5 [0,4194304] 0 2024-09-04T16:30:18.389 INFO:tasks.workunit.client.1.smithi193.stdout:3/805: unlink d0/d18/d1c/d51/d6c/fe6 0 2024-09-04T16:30:18.391 INFO:tasks.workunit.client.1.smithi193.stdout:8/829: fsync d2/d20/d23/d34/d46/d53/d90/ff4 0 2024-09-04T16:30:18.394 INFO:tasks.workunit.client.1.smithi193.stdout:4/729: chown d3/d3c/fb8 741 1 2024-09-04T16:30:18.394 INFO:tasks.workunit.client.1.smithi193.stdout:9/857: dwrite d2/d56/fbe [4194304,4194304] 0 2024-09-04T16:30:18.396 INFO:tasks.workunit.client.1.smithi193.stdout:1/880: fsync d1/d2b/d1b/d51/d6d/d89/fff 0 2024-09-04T16:30:18.397 INFO:tasks.workunit.client.1.smithi193.stdout:8/830: chown d2/d20/d23/d1b/d4e 318442296 1 2024-09-04T16:30:18.397 INFO:tasks.workunit.client.1.smithi193.stdout:4/730: dread - d3/f28 zero size 2024-09-04T16:30:18.408 INFO:tasks.workunit.client.0.smithi170.stdout:4/345: dread d1/d6/d2b/d33/f57 [0,4194304] 0 2024-09-04T16:30:18.433 INFO:tasks.workunit.client.0.smithi170.stdout:3/224: sync 2024-09-04T16:30:18.434 INFO:tasks.workunit.client.0.smithi170.stdout:3/225: truncate d13/d14/f48 210171 0 2024-09-04T16:30:18.435 INFO:tasks.workunit.client.0.smithi170.stdout:3/226: chown d13/f19 1 1 2024-09-04T16:30:18.463 INFO:tasks.workunit.client.1.smithi193.stdout:6/778: getdents d5/de/d15/d9f 0 2024-09-04T16:30:18.468 INFO:tasks.workunit.client.1.smithi193.stdout:3/806: symlink d0/d9/d49/l104 0 2024-09-04T16:30:18.469 INFO:tasks.workunit.client.1.smithi193.stdout:3/807: write d0/d3b/fbd [777102,41499] 0 2024-09-04T16:30:18.470 INFO:tasks.workunit.client.1.smithi193.stdout:7/908: write f8 [646349,106493] 0 2024-09-04T16:30:18.470 INFO:tasks.workunit.client.1.smithi193.stdout:9/858: mkdir d2/d8/d25/ded/d10e 0 2024-09-04T16:30:18.471 INFO:tasks.workunit.client.0.smithi170.stdout:4/346: link d1/d6/d2b/d33/d36/d79/c73 d1/d6/d8/d20/d35/c7a 0 2024-09-04T16:30:18.476 INFO:tasks.workunit.client.1.smithi193.stdout:7/909: dwrite d9/de/f1c [0,4194304] 0 2024-09-04T16:30:18.476 INFO:tasks.workunit.client.1.smithi193.stdout:5/822: link d1/d8/db/d15/d2b/d83/l72 d1/d8/db/d15/l10a 0 2024-09-04T16:30:18.477 INFO:tasks.workunit.client.1.smithi193.stdout:5/823: dread - d1/d29/ff0 zero size 2024-09-04T16:30:18.477 INFO:tasks.workunit.client.0.smithi170.stdout:4/347: link d1/d6/d8/d20/f25 d1/d6/d8/d20/d35/d3e/d4e/d51/f7b 0 2024-09-04T16:30:18.478 INFO:tasks.workunit.client.1.smithi193.stdout:1/881: dwrite d1/d2b/d10/f21 [0,4194304] 0 2024-09-04T16:30:18.479 INFO:tasks.workunit.client.1.smithi193.stdout:3/808: symlink d0/d10/d24/l105 0 2024-09-04T16:30:18.480 INFO:tasks.workunit.client.1.smithi193.stdout:9/859: mkdir d2/d18/d2f/d22/d30/d6a/d6e/de2/d10f 0 2024-09-04T16:30:18.481 INFO:tasks.workunit.client.1.smithi193.stdout:9/860: chown d2/d18/d2f/d22/d30/d6a/d6e/ddf 0 1 2024-09-04T16:30:18.483 INFO:tasks.workunit.client.1.smithi193.stdout:9/861: chown d2/d56/d86/dc2/dde/dda 49 1 2024-09-04T16:30:18.483 INFO:tasks.workunit.client.1.smithi193.stdout:6/779: mknod d5/d33/d4e/d51/d68/de7/c100 0 2024-09-04T16:30:18.484 INFO:tasks.workunit.client.1.smithi193.stdout:5/824: mknod d1/d8/db/d15/c10b 0 2024-09-04T16:30:18.485 INFO:tasks.workunit.client.1.smithi193.stdout:1/882: symlink d1/l112 0 2024-09-04T16:30:18.486 INFO:tasks.workunit.client.1.smithi193.stdout:4/731: creat d3/ff0 x:0 0 0 2024-09-04T16:30:18.488 INFO:tasks.workunit.client.1.smithi193.stdout:8/831: link d2/d20/l5b d2/d20/d23/d34/d4b/dd4/l109 0 2024-09-04T16:30:18.489 INFO:tasks.workunit.client.1.smithi193.stdout:9/862: mkdir d2/d18/d2f/d22/d30/d52/dbb/d110 0 2024-09-04T16:30:18.490 INFO:tasks.workunit.client.1.smithi193.stdout:9/863: chown d2/d56/d86/dc2/dde 115738 1 2024-09-04T16:30:18.491 INFO:tasks.workunit.client.1.smithi193.stdout:5/825: rmdir d1/d8/db/d15/d2b/d83/d37/d58/d9e/da7 39 2024-09-04T16:30:18.492 INFO:tasks.workunit.client.1.smithi193.stdout:5/826: fsync d1/d8/db/d36/d40/fde 0 2024-09-04T16:30:18.492 INFO:tasks.workunit.client.1.smithi193.stdout:3/809: mknod d0/d18/d1b/c106 0 2024-09-04T16:30:18.493 INFO:tasks.workunit.client.1.smithi193.stdout:4/732: rmdir d3/d3c/d98/de2 39 2024-09-04T16:30:18.494 INFO:tasks.workunit.client.1.smithi193.stdout:7/910: rename d9/d11/dd4/dd2/fd8 to d9/d11/f129 0 2024-09-04T16:30:18.494 INFO:tasks.workunit.client.1.smithi193.stdout:5/827: dread - d1/d8/db/d15/d2b/d83/d37/d58/de0/f100 zero size 2024-09-04T16:30:18.494 INFO:tasks.workunit.client.1.smithi193.stdout:0/819: sync 2024-09-04T16:30:18.496 INFO:tasks.workunit.client.1.smithi193.stdout:9/864: unlink d2/d18/d2f/d22/d30/l33 0 2024-09-04T16:30:18.500 INFO:tasks.workunit.client.1.smithi193.stdout:0/820: rmdir d18/d25/d32/d9c 39 2024-09-04T16:30:18.500 INFO:tasks.workunit.client.1.smithi193.stdout:5/828: dread d1/d8/fc0 [0,4194304] 0 2024-09-04T16:30:18.502 INFO:tasks.workunit.client.1.smithi193.stdout:4/733: fsync d3/d3c/d98/fd3 0 2024-09-04T16:30:18.503 INFO:tasks.workunit.client.1.smithi193.stdout:8/832: creat d2/d20/d23/d34/d3e/d6f/f10a x:0 0 0 2024-09-04T16:30:18.504 INFO:tasks.workunit.client.1.smithi193.stdout:9/865: dwrite d2/d18/d2f/d22/d30/d6a/d6e/f101 [0,4194304] 0 2024-09-04T16:30:18.505 INFO:tasks.workunit.client.1.smithi193.stdout:4/734: fsync d3/d1a/d54/db1/fbf 0 2024-09-04T16:30:18.505 INFO:tasks.workunit.client.1.smithi193.stdout:9/866: chown d2/d56/f76 95453044 1 2024-09-04T16:30:18.506 INFO:tasks.workunit.client.1.smithi193.stdout:5/829: unlink d1/d29/f59 0 2024-09-04T16:30:18.506 INFO:tasks.workunit.client.1.smithi193.stdout:4/735: write d3/d1a/d21/d52/f6c [772231,19076] 0 2024-09-04T16:30:18.509 INFO:tasks.workunit.client.1.smithi193.stdout:2/779: truncate d2/d9/db/d10/d1f/d22/f93 2934174 0 2024-09-04T16:30:18.511 INFO:tasks.workunit.client.1.smithi193.stdout:5/830: mkdir d1/dc3/d10c 0 2024-09-04T16:30:18.512 INFO:tasks.workunit.client.1.smithi193.stdout:7/911: chown d9/d11/f4e 7081177 1 2024-09-04T16:30:18.513 INFO:tasks.workunit.client.1.smithi193.stdout:1/883: dread d1/d2b/d10/f91 [0,4194304] 0 2024-09-04T16:30:18.514 INFO:tasks.workunit.client.1.smithi193.stdout:5/831: chown d1/d29/d74/d96/lb0 5 1 2024-09-04T16:30:18.514 INFO:tasks.workunit.client.1.smithi193.stdout:8/833: creat d2/d20/d23/d24/d3c/d65/dc8/f10b x:0 0 0 2024-09-04T16:30:18.516 INFO:tasks.workunit.client.1.smithi193.stdout:9/867: getdents d2/d8/d25/ded/d10e 0 2024-09-04T16:30:18.517 INFO:tasks.workunit.client.1.smithi193.stdout:6/780: write d5/d27/d3e/d43/f57 [4169822,71371] 0 2024-09-04T16:30:18.517 INFO:tasks.workunit.client.0.smithi170.stdout:4/348: dwrite d1/d6/d8/d20/d35/d3e/d4e/d51/f5c [0,4194304] 0 2024-09-04T16:30:18.517 INFO:tasks.workunit.client.0.smithi170.stdout:4/349: dread - d1/d6/d22/f62 zero size 2024-09-04T16:30:18.517 INFO:tasks.workunit.client.1.smithi193.stdout:4/736: symlink d3/da3/dd2/lf1 0 2024-09-04T16:30:18.518 INFO:tasks.workunit.client.1.smithi193.stdout:4/737: dread - d3/f86 zero size 2024-09-04T16:30:18.524 INFO:tasks.workunit.client.1.smithi193.stdout:5/832: mkdir d1/d29/d74/d96/d98/d10d 0 2024-09-04T16:30:18.525 INFO:tasks.workunit.client.1.smithi193.stdout:3/810: write d0/d7/fc [2691306,84458] 0 2024-09-04T16:30:18.526 INFO:tasks.workunit.client.0.smithi170.stdout:4/350: creat d1/f7c x:0 0 0 2024-09-04T16:30:18.527 INFO:tasks.workunit.client.1.smithi193.stdout:8/834: unlink d2/d20/d23/d24/l70 0 2024-09-04T16:30:18.531 INFO:tasks.workunit.client.0.smithi170.stdout:4/351: mknod d1/d6/d8/d20/d35/d3e/c7d 0 2024-09-04T16:30:18.532 INFO:tasks.workunit.client.1.smithi193.stdout:1/884: mknod d1/d2b/d10/d56/d100/c113 0 2024-09-04T16:30:18.532 INFO:tasks.workunit.client.0.smithi170.stdout:4/352: read d1/d6/f14 [3148502,1212] 0 2024-09-04T16:30:18.532 INFO:tasks.workunit.client.1.smithi193.stdout:3/811: symlink d0/d7/l107 0 2024-09-04T16:30:18.533 INFO:tasks.workunit.client.0.smithi170.stdout:4/353: read d1/d6/d2b/d33/f4d [772316,80351] 0 2024-09-04T16:30:18.535 INFO:tasks.workunit.client.1.smithi193.stdout:8/835: dwrite d2/d20/d23/d34/d46/d53/f64 [0,4194304] 0 2024-09-04T16:30:18.535 INFO:tasks.workunit.client.1.smithi193.stdout:6/781: mknod d5/de/d15/d1b/d5f/da7/c101 0 2024-09-04T16:30:18.538 INFO:tasks.workunit.client.1.smithi193.stdout:3/812: mknod d0/d18/d1c/d6e/c108 0 2024-09-04T16:30:18.540 INFO:tasks.workunit.client.1.smithi193.stdout:4/738: creat d3/d3c/d98/de2/dec/ff2 x:0 0 0 2024-09-04T16:30:18.541 INFO:tasks.workunit.client.1.smithi193.stdout:6/782: mknod d5/d33/d85/da9/c102 0 2024-09-04T16:30:18.541 INFO:tasks.workunit.client.1.smithi193.stdout:7/912: getdents d9/d39/d3e 0 2024-09-04T16:30:18.543 INFO:tasks.workunit.client.1.smithi193.stdout:8/836: read - d2/d20/d23/d34/d3e/d6f/f10a zero size 2024-09-04T16:30:18.545 INFO:tasks.workunit.client.1.smithi193.stdout:1/885: dwrite d1/d2b/d1b/d51/fdc [0,4194304] 0 2024-09-04T16:30:18.545 INFO:tasks.workunit.client.1.smithi193.stdout:7/913: read d9/d11/fa7 [1720267,50463] 0 2024-09-04T16:30:18.546 INFO:tasks.workunit.client.1.smithi193.stdout:3/813: read d0/d18/f50 [917545,128987] 0 2024-09-04T16:30:18.549 INFO:tasks.workunit.client.1.smithi193.stdout:4/739: rename d3/d1a/d21/d52/d7f/la0 to d3/d1a/d21/d52/lf3 0 2024-09-04T16:30:18.550 INFO:tasks.workunit.client.1.smithi193.stdout:7/914: write d9/d39/d3e/d4d/d4f/ff9 [431361,77149] 0 2024-09-04T16:30:18.551 INFO:tasks.workunit.client.1.smithi193.stdout:6/783: truncate d5/d27/d3e/d43/d5d/d97/fd2 242219 0 2024-09-04T16:30:18.554 INFO:tasks.workunit.client.1.smithi193.stdout:3/814: creat d0/d9/d49/d87/f109 x:0 0 0 2024-09-04T16:30:18.554 INFO:tasks.workunit.client.1.smithi193.stdout:2/780: dread d2/d9/db/d10/d1e/d26/f3a [0,4194304] 0 2024-09-04T16:30:18.555 INFO:tasks.workunit.client.1.smithi193.stdout:6/784: chown d5/de/d15/d48/l56 6154967 1 2024-09-04T16:30:18.558 INFO:tasks.workunit.client.1.smithi193.stdout:4/740: truncate d3/f36 71866 0 2024-09-04T16:30:18.558 INFO:tasks.workunit.client.1.smithi193.stdout:0/821: truncate d18/f1a 2740783 0 2024-09-04T16:30:18.558 INFO:tasks.workunit.client.1.smithi193.stdout:3/815: write d0/d9/d49/d87/f109 [963990,29382] 0 2024-09-04T16:30:18.560 INFO:tasks.workunit.client.1.smithi193.stdout:7/915: dread d9/d39/d3e/d4d/d98/d9a/db6/ffa [0,4194304] 0 2024-09-04T16:30:18.561 INFO:tasks.workunit.client.1.smithi193.stdout:4/741: readlink d3/d1a/d21/d52/d7f/l92 0 2024-09-04T16:30:18.561 INFO:tasks.workunit.client.1.smithi193.stdout:8/837: getdents d2/d20/d23/d51/d76/dfa 0 2024-09-04T16:30:18.561 INFO:tasks.workunit.client.1.smithi193.stdout:1/886: dwrite d1/d39/f67 [0,4194304] 0 2024-09-04T16:30:18.562 INFO:tasks.workunit.client.1.smithi193.stdout:2/781: mkdir d2/d9/db/d10/d38/dac/d103 0 2024-09-04T16:30:18.563 INFO:tasks.workunit.client.1.smithi193.stdout:4/742: chown d3/d39/d44/dd5/l7c 27773 1 2024-09-04T16:30:18.570 INFO:tasks.workunit.client.0.smithi170.stdout:4/354: truncate d1/d6/d2b/d33/f57 4070470 0 2024-09-04T16:30:18.572 INFO:tasks.workunit.client.1.smithi193.stdout:3/816: dread d0/d9/dae/fc6 [0,4194304] 0 2024-09-04T16:30:18.573 INFO:tasks.workunit.client.1.smithi193.stdout:7/916: fsync d9/d18/f9d 0 2024-09-04T16:30:18.574 INFO:tasks.workunit.client.0.smithi170.stdout:4/355: rename d1/d6/d22/f48 to d1/d6/d2b/f7e 0 2024-09-04T16:30:18.579 INFO:tasks.workunit.client.1.smithi193.stdout:6/785: dread d5/d27/d3e/d6e/fc8 [0,4194304] 0 2024-09-04T16:30:18.580 INFO:tasks.workunit.client.0.smithi170.stdout:4/356: creat d1/d6/d2b/d47/d78/f7f x:0 0 0 2024-09-04T16:30:18.581 INFO:tasks.workunit.client.1.smithi193.stdout:7/917: chown d9/d11/f4e 250820113 1 2024-09-04T16:30:18.582 INFO:tasks.workunit.client.1.smithi193.stdout:1/887: chown d1/d2b/d10/db7/le0 111 1 2024-09-04T16:30:18.585 INFO:tasks.workunit.client.1.smithi193.stdout:4/743: unlink d3/d39/d44/dd5/cd9 0 2024-09-04T16:30:18.587 INFO:tasks.workunit.client.1.smithi193.stdout:9/868: dwrite d2/d18/fbd [0,4194304] 0 2024-09-04T16:30:18.589 INFO:tasks.workunit.client.1.smithi193.stdout:7/918: write d9/d39/d3e/d4a/f5b [6281487,84535] 0 2024-09-04T16:30:18.590 INFO:tasks.workunit.client.1.smithi193.stdout:6/786: symlink d5/de/d15/d1b/d5f/da7/dd1/l103 0 2024-09-04T16:30:18.591 INFO:tasks.workunit.client.1.smithi193.stdout:5/833: dwrite d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f6f [0,4194304] 0 2024-09-04T16:30:18.592 INFO:tasks.workunit.client.0.smithi170.stdout:4/357: getdents d1/d6/d2b 0 2024-09-04T16:30:18.593 INFO:tasks.workunit.client.1.smithi193.stdout:4/744: mknod d3/d1a/d21/d52/cf4 0 2024-09-04T16:30:18.598 INFO:tasks.workunit.client.0.smithi170.stdout:4/358: rename d1/d6/d8/d20/d35/d3e/c66 to d1/d6/d8/c80 0 2024-09-04T16:30:18.599 INFO:tasks.workunit.client.1.smithi193.stdout:7/919: unlink d9/d18/d22/d2b/f91 0 2024-09-04T16:30:18.599 INFO:tasks.workunit.client.1.smithi193.stdout:2/782: dread d2/d9/db/d10/d51/d87/f8a [0,4194304] 0 2024-09-04T16:30:18.604 INFO:tasks.workunit.client.1.smithi193.stdout:9/869: fsync d2/d18/d2f/d22/d30/d6a/d6e/f101 0 2024-09-04T16:30:18.604 INFO:tasks.workunit.client.1.smithi193.stdout:3/817: getdents d0/d9/dae 0 2024-09-04T16:30:18.607 INFO:tasks.workunit.client.1.smithi193.stdout:2/783: mknod d2/d9/db/d10/c104 0 2024-09-04T16:30:18.609 INFO:tasks.workunit.client.1.smithi193.stdout:1/888: dwrite d1/d2b/f45 [8388608,4194304] 0 2024-09-04T16:30:18.613 INFO:tasks.workunit.client.1.smithi193.stdout:1/889: chown d1/f1c 501308 1 2024-09-04T16:30:18.613 INFO:tasks.workunit.client.1.smithi193.stdout:8/838: dwrite d2/f2e [0,4194304] 0 2024-09-04T16:30:18.614 INFO:tasks.workunit.client.1.smithi193.stdout:6/787: dwrite d5/d27/d3e/d43/d5d/d97/fd2 [0,4194304] 0 2024-09-04T16:30:18.615 INFO:tasks.workunit.client.1.smithi193.stdout:7/920: dread d9/d18/d22/d2b/fe4 [0,4194304] 0 2024-09-04T16:30:18.616 INFO:tasks.workunit.client.1.smithi193.stdout:9/870: creat d2/d18/d2f/d22/d30/d52/f111 x:0 0 0 2024-09-04T16:30:18.618 INFO:tasks.workunit.client.1.smithi193.stdout:3/818: creat d0/d18/d1c/d51/f10a x:0 0 0 2024-09-04T16:30:18.618 INFO:tasks.workunit.client.1.smithi193.stdout:8/839: chown d2/d20/d23/d34/d4b/db8/fc1 63966 1 2024-09-04T16:30:18.618 INFO:tasks.workunit.client.1.smithi193.stdout:5/834: link d1/d8/db/d36/d40/cf5 d1/d8/db/d15/d2b/d83/d37/d3f/c10e 0 2024-09-04T16:30:18.618 INFO:tasks.workunit.client.1.smithi193.stdout:9/871: dread - d2/d8/d25/ded/ff8 zero size 2024-09-04T16:30:18.621 INFO:tasks.workunit.client.1.smithi193.stdout:2/784: unlink d2/d9/db/d10/d51/la3 0 2024-09-04T16:30:18.622 INFO:tasks.workunit.client.0.smithi170.stdout:4/359: write d1/f1e [2693059,15026] 0 2024-09-04T16:30:18.624 INFO:tasks.workunit.client.1.smithi193.stdout:2/785: write d2/d9/db/d10/d1e/f78 [7939803,41618] 0 2024-09-04T16:30:18.625 INFO:tasks.workunit.client.1.smithi193.stdout:4/745: write d3/d39/f79 [2240424,54656] 0 2024-09-04T16:30:18.628 INFO:tasks.workunit.client.1.smithi193.stdout:8/840: dread d2/d20/d23/d34/d4b/db8/fc1 [0,4194304] 0 2024-09-04T16:30:18.628 INFO:tasks.workunit.client.1.smithi193.stdout:4/746: fsync d3/f29 0 2024-09-04T16:30:18.629 INFO:tasks.workunit.client.1.smithi193.stdout:1/890: mknod d1/d39/d101/c114 0 2024-09-04T16:30:18.630 INFO:tasks.workunit.client.1.smithi193.stdout:6/788: creat d5/d27/d3e/d43/d5d/f104 x:0 0 0 2024-09-04T16:30:18.632 INFO:tasks.workunit.client.1.smithi193.stdout:3/819: write d0/d7/de/d45/f8d [736071,63053] 0 2024-09-04T16:30:18.632 INFO:tasks.workunit.client.1.smithi193.stdout:5/835: symlink d1/d8/db/d15/d2b/d83/d37/d58/dc4/dda/l10f 0 2024-09-04T16:30:18.632 INFO:tasks.workunit.client.1.smithi193.stdout:4/747: write d3/d1a/d54/f5b [3927660,36295] 0 2024-09-04T16:30:18.634 INFO:tasks.workunit.client.1.smithi193.stdout:7/921: link d9/de/d27/f38 d9/d39/d3e/d4d/d98/d9a/db6/df8/f12a 0 2024-09-04T16:30:18.637 INFO:tasks.workunit.client.1.smithi193.stdout:8/841: fsync d2/d20/d23/d34/d4b/db8/fc1 0 2024-09-04T16:30:18.638 INFO:tasks.workunit.client.1.smithi193.stdout:7/922: dread d9/d39/d3e/d4d/d4f/ff9 [0,4194304] 0 2024-09-04T16:30:18.638 INFO:tasks.workunit.client.1.smithi193.stdout:4/748: mkdir d3/d81/df5 0 2024-09-04T16:30:18.639 INFO:tasks.workunit.client.1.smithi193.stdout:6/789: dread d5/f3f [4194304,4194304] 0 2024-09-04T16:30:18.640 INFO:tasks.workunit.client.1.smithi193.stdout:4/749: fdatasync d3/f35 0 2024-09-04T16:30:18.640 INFO:tasks.workunit.client.1.smithi193.stdout:5/836: mknod d1/d8/c110 0 2024-09-04T16:30:18.643 INFO:tasks.workunit.client.1.smithi193.stdout:1/891: getdents d1/d39/d48 0 2024-09-04T16:30:18.644 INFO:tasks.workunit.client.1.smithi193.stdout:3/820: getdents d0/d10/d24/d9a 0 2024-09-04T16:30:18.645 INFO:tasks.workunit.client.1.smithi193.stdout:4/750: creat d3/d1a/d2a/db9/ff6 x:0 0 0 2024-09-04T16:30:18.645 INFO:tasks.workunit.client.1.smithi193.stdout:9/872: dread d2/d18/d66/f7f [0,4194304] 0 2024-09-04T16:30:18.647 INFO:tasks.workunit.client.1.smithi193.stdout:5/837: mknod d1/d8/db/d36/d40/d46/d84/c111 0 2024-09-04T16:30:18.651 INFO:tasks.workunit.client.1.smithi193.stdout:0/822: sync 2024-09-04T16:30:18.652 INFO:tasks.workunit.client.1.smithi193.stdout:4/751: dread d3/d39/fac [0,4194304] 0 2024-09-04T16:30:18.652 INFO:tasks.workunit.client.1.smithi193.stdout:3/821: write d0/d18/d1c/d25/d5e/d90/ff3 [782273,42371] 0 2024-09-04T16:30:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:18 smithi193 ceph-mon[36288]: pgmap v29: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail; 104 MiB/s rd, 328 MiB/s wr, 611 op/s 2024-09-04T16:30:18.656 INFO:tasks.workunit.client.1.smithi193.stdout:8/842: dwrite d2/d20/d23/d24/d3c/d65/fd3 [0,4194304] 0 2024-09-04T16:30:18.658 INFO:tasks.workunit.client.1.smithi193.stdout:6/790: dwrite d5/d27/d3e/d43/f96 [0,4194304] 0 2024-09-04T16:30:18.659 INFO:tasks.workunit.client.1.smithi193.stdout:5/838: mknod d1/d8/db/d15/d2b/d83/d37/c112 0 2024-09-04T16:30:18.662 INFO:tasks.workunit.client.1.smithi193.stdout:3/822: mkdir d0/d7/de/d45/d10b 0 2024-09-04T16:30:18.666 INFO:tasks.workunit.client.1.smithi193.stdout:6/791: readlink d5/de/l46 0 2024-09-04T16:30:18.666 INFO:tasks.workunit.client.1.smithi193.stdout:7/923: dread d9/d18/d22/d2b/d6c/d70/fe3 [0,4194304] 0 2024-09-04T16:30:18.669 INFO:tasks.workunit.client.1.smithi193.stdout:3/823: creat d0/d3b/f10c x:0 0 0 2024-09-04T16:30:18.669 INFO:tasks.workunit.client.1.smithi193.stdout:0/823: dwrite d18/d25/d5f/d6a/d7b/fe5 [0,4194304] 0 2024-09-04T16:30:18.672 INFO:tasks.workunit.client.1.smithi193.stdout:0/824: chown d18/d25/d5f/def/da0/ffe 10658819 1 2024-09-04T16:30:18.672 INFO:tasks.workunit.client.1.smithi193.stdout:7/924: mknod d9/de/d27/d62/d72/c12b 0 2024-09-04T16:30:18.674 INFO:tasks.workunit.client.1.smithi193.stdout:3/824: write d0/d18/d1c/d51/d5a/f77 [8435931,96747] 0 2024-09-04T16:30:18.677 INFO:tasks.workunit.client.1.smithi193.stdout:0/825: fdatasync d18/d25/d5f/d65/dc4/fd9 0 2024-09-04T16:30:18.678 INFO:tasks.workunit.client.1.smithi193.stdout:1/892: dread d1/d39/d48/f96 [0,4194304] 0 2024-09-04T16:30:18.678 INFO:tasks.workunit.client.1.smithi193.stdout:3/825: mknod d0/d10/c10d 0 2024-09-04T16:30:18.680 INFO:tasks.workunit.client.1.smithi193.stdout:0/826: chown d18/d25/d32/c5a 68480 1 2024-09-04T16:30:18.681 INFO:tasks.workunit.client.1.smithi193.stdout:1/893: chown d1/d2b/d1b/d28/fba 7826 1 2024-09-04T16:30:18.682 INFO:tasks.workunit.client.1.smithi193.stdout:3/826: read d0/d18/d1b/d3d/d96/fd0 [3807538,67487] 0 2024-09-04T16:30:18.683 INFO:tasks.workunit.client.1.smithi193.stdout:1/894: rmdir d1/d2b/db/d54 39 2024-09-04T16:30:18.683 INFO:tasks.workunit.client.1.smithi193.stdout:0/827: mkdir d18/d25/d5f/d107/d111 0 2024-09-04T16:30:18.687 INFO:tasks.workunit.client.1.smithi193.stdout:1/895: creat d1/d2b/d10/d56/f115 x:0 0 0 2024-09-04T16:30:18.687 INFO:tasks.workunit.client.1.smithi193.stdout:9/873: dread d2/d18/d2f/fab [0,4194304] 0 2024-09-04T16:30:18.693 INFO:tasks.workunit.client.1.smithi193.stdout:9/874: creat d2/d8/d104/f112 x:0 0 0 2024-09-04T16:30:18.694 INFO:tasks.workunit.client.1.smithi193.stdout:7/925: dread d9/d39/d3e/d4d/d4f/dab/fc3 [0,4194304] 0 2024-09-04T16:30:18.695 INFO:tasks.workunit.client.1.smithi193.stdout:1/896: getdents d1/d2b/d1b/d28 0 2024-09-04T16:30:18.697 INFO:tasks.workunit.client.1.smithi193.stdout:8/843: dread d2/d20/d23/d34/dd6/da0/da8/db9/f78 [0,4194304] 0 2024-09-04T16:30:18.697 INFO:tasks.workunit.client.1.smithi193.stdout:9/875: rmdir d2/d18/d2f/d22/d30/d52/dbb/d110 0 2024-09-04T16:30:18.698 INFO:tasks.workunit.client.1.smithi193.stdout:9/876: fsync d2/d56/d86/fad 0 2024-09-04T16:30:18.698 INFO:tasks.workunit.client.1.smithi193.stdout:7/926: creat d9/d39/d3e/d4d/d98/d9a/f12c x:0 0 0 2024-09-04T16:30:18.699 INFO:tasks.workunit.client.1.smithi193.stdout:7/927: chown d9/de/d27/d62 120347 1 2024-09-04T16:30:18.699 INFO:tasks.workunit.client.1.smithi193.stdout:1/897: mkdir d1/d2b/d10/d2a/d116 0 2024-09-04T16:30:18.700 INFO:tasks.workunit.client.1.smithi193.stdout:9/877: truncate d2/d18/d2f/d9a/de4/f10b 591695 0 2024-09-04T16:30:18.701 INFO:tasks.workunit.client.1.smithi193.stdout:8/844: creat d2/d20/d23/d24/d3c/d65/dc8/de1/f10c x:0 0 0 2024-09-04T16:30:18.701 INFO:tasks.workunit.client.1.smithi193.stdout:9/878: read - d2/d56/d86/fea zero size 2024-09-04T16:30:18.701 INFO:tasks.workunit.client.1.smithi193.stdout:9/879: chown d2/d18/d2f/d9a/de4 722836080 1 2024-09-04T16:30:18.703 INFO:tasks.workunit.client.1.smithi193.stdout:7/928: creat d9/d18/d22/d2b/d96/f12d x:0 0 0 2024-09-04T16:30:18.703 INFO:tasks.workunit.client.1.smithi193.stdout:1/898: read d1/d2b/d10/fbc [666008,20713] 0 2024-09-04T16:30:18.705 INFO:tasks.workunit.client.1.smithi193.stdout:8/845: chown d2/f8 472763109 1 2024-09-04T16:30:18.705 INFO:tasks.workunit.client.1.smithi193.stdout:1/899: readlink d1/d2b/d10/d56/l74 0 2024-09-04T16:30:18.706 INFO:tasks.workunit.client.1.smithi193.stdout:8/846: readlink d2/d20/dc0/l9e 0 2024-09-04T16:30:18.707 INFO:tasks.workunit.client.1.smithi193.stdout:1/900: dread - d1/d2b/d10/d56/f10c zero size 2024-09-04T16:30:18.712 INFO:tasks.workunit.client.1.smithi193.stdout:7/929: dread d9/d39/d3e/d4d/d98/d9a/ff3 [0,4194304] 0 2024-09-04T16:30:18.712 INFO:tasks.workunit.client.1.smithi193.stdout:2/786: dwrite d2/d9/db/d10/d1f/d22/f33 [0,4194304] 0 2024-09-04T16:30:18.713 INFO:tasks.workunit.client.1.smithi193.stdout:5/839: fsync d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f91 0 2024-09-04T16:30:18.714 INFO:tasks.workunit.client.1.smithi193.stdout:1/901: write d1/d2b/d1b/dd9/ffa [129881,109742] 0 2024-09-04T16:30:18.714 INFO:tasks.workunit.client.1.smithi193.stdout:3/827: truncate d0/d18/d1b/d3d/fa8 2331108 0 2024-09-04T16:30:18.715 INFO:tasks.workunit.client.1.smithi193.stdout:9/880: dwrite d2/d4/f3a [0,4194304] 0 2024-09-04T16:30:18.716 INFO:tasks.workunit.client.1.smithi193.stdout:7/930: rmdir d9/d11 39 2024-09-04T16:30:18.717 INFO:tasks.workunit.client.1.smithi193.stdout:2/787: stat d2/d9/db/d10/d1e/c101 0 2024-09-04T16:30:18.719 INFO:tasks.workunit.client.1.smithi193.stdout:3/828: write d0/d18/d1c/d25/d5e/d90/fb8 [2449310,68441] 0 2024-09-04T16:30:18.723 INFO:tasks.workunit.client.1.smithi193.stdout:5/840: dread d1/d29/d18/d42/f51 [4194304,4194304] 0 2024-09-04T16:30:18.725 INFO:tasks.workunit.client.1.smithi193.stdout:5/841: dread d1/d8/fc0 [0,4194304] 0 2024-09-04T16:30:18.725 INFO:tasks.workunit.client.1.smithi193.stdout:9/881: mknod d2/d18/d2f/d22/d30/d6a/d6e/ddf/c113 0 2024-09-04T16:30:18.726 INFO:tasks.workunit.client.1.smithi193.stdout:3/829: mknod d0/d18/d1c/d25/d5e/d90/d103/c10e 0 2024-09-04T16:30:18.728 INFO:tasks.workunit.client.1.smithi193.stdout:3/830: write d0/d7/de/d45/f8d [4373326,100122] 0 2024-09-04T16:30:18.728 INFO:tasks.workunit.client.1.smithi193.stdout:3/831: read - d0/d9/d49/d7d/fec zero size 2024-09-04T16:30:18.729 INFO:tasks.workunit.client.1.smithi193.stdout:9/882: creat d2/d18/d2f/d22/d30/d6a/d6e/de2/d10f/f114 x:0 0 0 2024-09-04T16:30:18.730 INFO:tasks.workunit.client.1.smithi193.stdout:3/832: truncate d0/d9/fff 653241 0 2024-09-04T16:30:18.733 INFO:tasks.workunit.client.0.smithi170.stdout:6/268: sync 2024-09-04T16:30:18.734 INFO:tasks.workunit.client.1.smithi193.stdout:8/847: dread d2/d20/d23/d34/d3e/f41 [0,4194304] 0 2024-09-04T16:30:18.734 INFO:tasks.workunit.client.1.smithi193.stdout:8/848: chown d2 11915806 1 2024-09-04T16:30:18.735 INFO:tasks.workunit.client.1.smithi193.stdout:9/883: getdents d2/d56/d86/dc2/dde 0 2024-09-04T16:30:18.737 INFO:tasks.workunit.client.1.smithi193.stdout:3/833: dwrite d0/d18/d1b/f36 [0,4194304] 0 2024-09-04T16:30:18.738 INFO:tasks.workunit.client.1.smithi193.stdout:8/849: rename d2/d20/ff6 to d2/d20/d23/d34/d4b/d7c/df9/f10d 0 2024-09-04T16:30:18.739 INFO:tasks.workunit.client.0.smithi170.stdout:6/269: link d0/d15/f45 d0/df/d1f/f58 0 2024-09-04T16:30:18.742 INFO:tasks.workunit.client.1.smithi193.stdout:8/850: rename d2/d20/d23/d34/d4b/dd4/d103 to d2/d20/d23/d34/d46/d66/d10e 0 2024-09-04T16:30:18.743 INFO:tasks.workunit.client.1.smithi193.stdout:8/851: chown d2/d20/f8d 1660362 1 2024-09-04T16:30:18.744 INFO:tasks.workunit.client.1.smithi193.stdout:7/931: dread d9/d18/f9b [0,4194304] 0 2024-09-04T16:30:18.749 INFO:tasks.workunit.client.1.smithi193.stdout:2/788: write d2/d9/db/f75 [946354,60067] 0 2024-09-04T16:30:18.751 INFO:tasks.workunit.client.1.smithi193.stdout:3/834: creat d0/d18/d1c/d51/f10f x:0 0 0 2024-09-04T16:30:18.753 INFO:tasks.workunit.client.1.smithi193.stdout:8/852: dread d2/d20/d23/d34/d3e/d6f/d81/fa4 [0,4194304] 0 2024-09-04T16:30:18.760 INFO:tasks.workunit.client.0.smithi170.stdout:6/270: dwrite d0/d17/f1c [0,4194304] 0 2024-09-04T16:30:18.762 INFO:tasks.workunit.client.0.smithi170.stdout:6/271: truncate d0/df/d1b/f24 269986 0 2024-09-04T16:30:18.785 INFO:tasks.workunit.client.1.smithi193.stdout:4/752: sync 2024-09-04T16:30:18.787 INFO:tasks.workunit.client.0.smithi170.stdout:6/272: dread d0/df/d1f/f58 [0,4194304] 0 2024-09-04T16:30:18.789 INFO:tasks.workunit.client.0.smithi170.stdout:6/273: symlink d0/d17/l59 0 2024-09-04T16:30:18.790 INFO:tasks.workunit.client.0.smithi170.stdout:6/274: creat d0/d17/d31/f5a x:0 0 0 2024-09-04T16:30:18.793 INFO:tasks.workunit.client.0.smithi170.stdout:6/275: dread d0/df/d1f/f58 [0,4194304] 0 2024-09-04T16:30:18.795 INFO:tasks.workunit.client.0.smithi170.stdout:6/276: mkdir d0/d17/d5b 0 2024-09-04T16:30:18.797 INFO:tasks.workunit.client.0.smithi170.stdout:6/277: creat d0/d17/d2a/d30/f5c x:0 0 0 2024-09-04T16:30:18.798 INFO:tasks.workunit.client.0.smithi170.stdout:6/278: unlink d0/df/d1f/l20 0 2024-09-04T16:30:18.800 INFO:tasks.workunit.client.1.smithi193.stdout:1/902: dwrite d1/d2b/f31 [0,4194304] 0 2024-09-04T16:30:18.802 INFO:tasks.workunit.client.1.smithi193.stdout:2/789: link d2/d9/db/f89 d2/d9/db/d10/d1e/da4/f105 0 2024-09-04T16:30:18.802 INFO:tasks.workunit.client.1.smithi193.stdout:3/835: chown d0/d18/d1c/d25/d5e/d7e/cb7 293559 1 2024-09-04T16:30:18.804 INFO:tasks.workunit.client.1.smithi193.stdout:8/853: creat d2/d20/d23/d24/df7/f10f x:0 0 0 2024-09-04T16:30:18.806 INFO:tasks.workunit.client.1.smithi193.stdout:2/790: write d2/d9/db/d10/d1e/da4/f6d [380274,39027] 0 2024-09-04T16:30:18.809 INFO:tasks.workunit.client.1.smithi193.stdout:4/753: dwrite d3/d3c/f53 [0,4194304] 0 2024-09-04T16:30:18.810 INFO:tasks.workunit.client.1.smithi193.stdout:1/903: dread d1/d39/f67 [0,4194304] 0 2024-09-04T16:30:18.811 INFO:tasks.workunit.client.1.smithi193.stdout:2/791: chown d2/d9/db/d10/d38/dac/dd1/cf0 0 1 2024-09-04T16:30:18.813 INFO:tasks.workunit.client.1.smithi193.stdout:8/854: creat d2/d20/d23/d34/dd6/da0/da8/db9/f110 x:0 0 0 2024-09-04T16:30:18.814 INFO:tasks.workunit.client.1.smithi193.stdout:2/792: fdatasync d2/d9/db/d10/d38/d63/fef 0 2024-09-04T16:30:18.816 INFO:tasks.workunit.client.1.smithi193.stdout:4/754: unlink d3/d39/f79 0 2024-09-04T16:30:18.819 INFO:tasks.workunit.client.1.smithi193.stdout:1/904: symlink d1/d2b/l117 0 2024-09-04T16:30:18.820 INFO:tasks.workunit.client.1.smithi193.stdout:7/932: dread d9/d11/dd4/dd2/fdf [0,4194304] 0 2024-09-04T16:30:18.820 INFO:tasks.workunit.client.1.smithi193.stdout:2/793: symlink d2/d9/db/d10/d51/d87/d9b/l106 0 2024-09-04T16:30:18.823 INFO:tasks.workunit.client.1.smithi193.stdout:8/855: creat d2/d20/d23/d34/d3e/d6f/f111 x:0 0 0 2024-09-04T16:30:18.824 INFO:tasks.workunit.client.1.smithi193.stdout:2/794: creat d2/d9/db/d10/d1f/d77/d91/dff/f107 x:0 0 0 2024-09-04T16:30:18.825 INFO:tasks.workunit.client.1.smithi193.stdout:1/905: dread d1/d2b/d1b/d51/fdc [0,4194304] 0 2024-09-04T16:30:18.826 INFO:tasks.workunit.client.1.smithi193.stdout:7/933: mknod d9/de/d27/c12e 0 2024-09-04T16:30:18.829 INFO:tasks.workunit.client.1.smithi193.stdout:1/906: mkdir d1/d2b/db/d54/da1/d118 0 2024-09-04T16:30:18.833 INFO:tasks.workunit.client.1.smithi193.stdout:7/934: link d9/d39/d3e/d69/dcf/leb d9/d39/d3e/d4d/d4f/dab/l12f 0 2024-09-04T16:30:18.834 INFO:tasks.workunit.client.1.smithi193.stdout:1/907: fdatasync d1/d2b/d1b/f4c 0 2024-09-04T16:30:18.835 INFO:tasks.workunit.client.1.smithi193.stdout:7/935: rename f3 to d9/d39/d3e/d7d/f130 0 2024-09-04T16:30:18.836 INFO:tasks.workunit.client.1.smithi193.stdout:1/908: truncate d1/d2b/d1b/d28/d50/f5d 320453 0 2024-09-04T16:30:18.838 INFO:tasks.workunit.client.1.smithi193.stdout:1/909: chown d1/d2b/d1b/d51/d6d/f7a 1053396462 1 2024-09-04T16:30:18.839 INFO:tasks.workunit.client.1.smithi193.stdout:1/910: chown d1/d39/l95 118508784 1 2024-09-04T16:30:18.840 INFO:tasks.workunit.client.1.smithi193.stdout:7/936: getdents d9/d18 0 2024-09-04T16:30:18.843 INFO:tasks.workunit.client.1.smithi193.stdout:7/937: creat d9/de/f131 x:0 0 0 2024-09-04T16:30:18.846 INFO:tasks.workunit.client.1.smithi193.stdout:1/911: dwrite d1/d2b/d10/f21 [0,4194304] 0 2024-09-04T16:30:18.847 INFO:tasks.workunit.client.1.smithi193.stdout:2/795: truncate d2/d9/db/d10/d1f/d4a/f64 192711 0 2024-09-04T16:30:18.848 INFO:tasks.workunit.client.1.smithi193.stdout:1/912: write d1/d39/d48/ff5 [961117,20214] 0 2024-09-04T16:30:18.861 INFO:tasks.workunit.client.1.smithi193.stdout:2/796: truncate d2/d9/d18/f28 3176292 0 2024-09-04T16:30:18.884 INFO:tasks.workunit.client.1.smithi193.stdout:6/792: sync 2024-09-04T16:30:18.886 INFO:tasks.workunit.client.1.smithi193.stdout:6/793: chown d5/d27/d3e/c4d 1170738207 1 2024-09-04T16:30:18.886 INFO:tasks.workunit.client.1.smithi193.stdout:1/913: dwrite d1/d2b/d10/f59 [0,4194304] 0 2024-09-04T16:30:18.887 INFO:tasks.workunit.client.1.smithi193.stdout:1/914: chown d1/d2b/d10/fe5 1182 1 2024-09-04T16:30:18.892 INFO:tasks.workunit.client.1.smithi193.stdout:7/938: dread d9/d18/d22/d2b/f5f [0,4194304] 0 2024-09-04T16:30:18.942 INFO:tasks.workunit.client.0.smithi170.stdout:9/298: sync 2024-09-04T16:30:18.942 INFO:tasks.workunit.client.0.smithi170.stdout:8/338: sync 2024-09-04T16:30:18.942 INFO:tasks.workunit.client.0.smithi170.stdout:5/254: sync 2024-09-04T16:30:18.944 INFO:tasks.workunit.client.0.smithi170.stdout:8/339: write d6/d28/d20/f48 [728941,11409] 0 2024-09-04T16:30:18.947 INFO:tasks.workunit.client.0.smithi170.stdout:8/340: unlink d6/d28/d16/d24/l4d 0 2024-09-04T16:30:18.950 INFO:tasks.workunit.client.0.smithi170.stdout:9/299: write d2/d3d/f1f [58954,75196] 0 2024-09-04T16:30:18.954 INFO:tasks.workunit.client.0.smithi170.stdout:9/300: write d2/d3d/d35/f44 [813751,122233] 0 2024-09-04T16:30:18.956 INFO:tasks.workunit.client.1.smithi193.stdout:1/915: rename d1/d2b/l117 to d1/d2b/d1b/d51/d6d/d89/dc7/df8/l119 0 2024-09-04T16:30:18.957 INFO:tasks.workunit.client.0.smithi170.stdout:8/341: dwrite d6/d28/d20/d5e/f5c [0,4194304] 0 2024-09-04T16:30:18.957 INFO:tasks.workunit.client.1.smithi193.stdout:2/797: link d2/d9/db/d10/d1e/d56/l7c d2/d9/db/d65/l108 0 2024-09-04T16:30:18.957 INFO:tasks.workunit.client.1.smithi193.stdout:6/794: write d5/de/d15/d1b/f5a [1381847,16524] 0 2024-09-04T16:30:18.958 INFO:tasks.workunit.client.1.smithi193.stdout:1/916: dread - d1/d2b/d10/d56/ff7 zero size 2024-09-04T16:30:18.959 INFO:tasks.workunit.client.1.smithi193.stdout:7/939: creat d9/d39/d3e/f132 x:0 0 0 2024-09-04T16:30:18.960 INFO:tasks.workunit.client.1.smithi193.stdout:2/798: chown d2/l30 1253834284 1 2024-09-04T16:30:18.961 INFO:tasks.workunit.client.1.smithi193.stdout:7/940: chown d9/de/d27/ff2 13535234 1 2024-09-04T16:30:18.962 INFO:tasks.workunit.client.0.smithi170.stdout:8/342: rename d6/d28/d20/d5e/d72 to d6/d28/d20/d6e/d76 0 2024-09-04T16:30:18.963 INFO:tasks.workunit.client.1.smithi193.stdout:1/917: symlink d1/d2b/d10/db7/dc8/l11a 0 2024-09-04T16:30:18.964 INFO:tasks.workunit.client.1.smithi193.stdout:6/795: dread d5/de/d15/d48/f65 [0,4194304] 0 2024-09-04T16:30:18.965 INFO:tasks.workunit.client.0.smithi170.stdout:9/301: dwrite d2/d11/f26 [0,4194304] 0 2024-09-04T16:30:18.966 INFO:tasks.workunit.client.1.smithi193.stdout:6/796: truncate d5/d33/d4e/d51/d71/dcf/ff0 379241 0 2024-09-04T16:30:18.966 INFO:tasks.workunit.client.0.smithi170.stdout:8/343: mkdir d6/d28/d16/d77 0 2024-09-04T16:30:18.968 INFO:tasks.workunit.client.1.smithi193.stdout:7/941: link d9/de/f5a d9/d18/d22/d2b/d6c/d70/f133 0 2024-09-04T16:30:18.969 INFO:tasks.workunit.client.1.smithi193.stdout:1/918: mkdir d1/d2b/d1b/d51/d11b 0 2024-09-04T16:30:18.972 INFO:tasks.workunit.client.1.smithi193.stdout:2/799: rename d2/d9/db/d10/d1e/da4/l8e to d2/d9/db/l109 0 2024-09-04T16:30:18.973 INFO:tasks.workunit.client.0.smithi170.stdout:9/302: creat d2/d11/d23/f55 x:0 0 0 2024-09-04T16:30:18.974 INFO:tasks.workunit.client.1.smithi193.stdout:6/797: read - d5/d33/d4e/d51/d7b/de0/fe2 zero size 2024-09-04T16:30:18.975 INFO:tasks.workunit.client.1.smithi193.stdout:7/942: stat d9/de/d27/f35 0 2024-09-04T16:30:18.976 INFO:tasks.workunit.client.0.smithi170.stdout:9/303: mkdir d2/d11/d23/d2a/d56 0 2024-09-04T16:30:18.977 INFO:tasks.workunit.client.1.smithi193.stdout:6/798: write d5/d27/faf [319168,23534] 0 2024-09-04T16:30:18.977 INFO:tasks.workunit.client.0.smithi170.stdout:9/304: chown d2/d11/d23/d2a/f52 3 1 2024-09-04T16:30:18.980 INFO:tasks.workunit.client.1.smithi193.stdout:2/800: dwrite d2/d9/db/d10/d1e/f96 [0,4194304] 0 2024-09-04T16:30:18.980 INFO:tasks.workunit.client.1.smithi193.stdout:1/919: rmdir d1/d2b/db/d54/da1/d118 0 2024-09-04T16:30:18.981 INFO:tasks.workunit.client.1.smithi193.stdout:7/943: symlink d9/d85/l134 0 2024-09-04T16:30:18.983 INFO:tasks.workunit.client.1.smithi193.stdout:2/801: mkdir d2/d9/db/d10/d4e/d10a 0 2024-09-04T16:30:18.984 INFO:tasks.workunit.client.0.smithi170.stdout:9/305: dwrite d2/d3d/d35/f43 [0,4194304] 0 2024-09-04T16:30:18.984 INFO:tasks.workunit.client.1.smithi193.stdout:1/920: symlink d1/d2b/d10/db6/l11c 0 2024-09-04T16:30:18.986 INFO:tasks.workunit.client.1.smithi193.stdout:6/799: read d5/de/d15/d1b/f5a [146093,105462] 0 2024-09-04T16:30:18.986 INFO:tasks.workunit.client.1.smithi193.stdout:1/921: stat d1/d2b/d1b/dd9 0 2024-09-04T16:30:18.989 INFO:tasks.workunit.client.0.smithi170.stdout:9/306: rename d2/f4 to d2/d3d/f57 0 2024-09-04T16:30:18.993 INFO:tasks.workunit.client.1.smithi193.stdout:6/800: dread d5/de/d15/d1b/f1e [0,4194304] 0 2024-09-04T16:30:18.995 INFO:tasks.workunit.client.1.smithi193.stdout:0/828: sync 2024-09-04T16:30:18.995 INFO:tasks.workunit.client.1.smithi193.stdout:5/842: sync 2024-09-04T16:30:18.998 INFO:tasks.workunit.client.0.smithi170.stdout:8/344: dread d6/d28/f1d [0,4194304] 0 2024-09-04T16:30:18.999 INFO:tasks.workunit.client.1.smithi193.stdout:5/843: chown d1/d8/db/d15/c38 6017 1 2024-09-04T16:30:18.999 INFO:tasks.workunit.client.0.smithi170.stdout:9/307: dwrite d2/d3d/fc [4194304,4194304] 0 2024-09-04T16:30:19.003 INFO:tasks.workunit.client.1.smithi193.stdout:6/801: dwrite d5/de/d15/d1b/d5f/fd8 [0,4194304] 0 2024-09-04T16:30:19.004 INFO:tasks.workunit.client.1.smithi193.stdout:0/829: dwrite f15 [0,4194304] 0 2024-09-04T16:30:19.007 INFO:tasks.workunit.client.0.smithi170.stdout:8/345: dwrite d6/d28/f1d [0,4194304] 0 2024-09-04T16:30:19.010 INFO:tasks.workunit.client.1.smithi193.stdout:2/802: dread d2/d9/db/d10/d4e/f8d [0,4194304] 0 2024-09-04T16:30:19.014 INFO:tasks.workunit.client.0.smithi170.stdout:8/346: dwrite d6/d28/d16/d24/d46/f74 [0,4194304] 0 2024-09-04T16:30:19.016 INFO:tasks.workunit.client.0.smithi170.stdout:8/347: write d6/d28/f1d [181359,55326] 0 2024-09-04T16:30:19.023 INFO:tasks.workunit.client.1.smithi193.stdout:9/884: sync 2024-09-04T16:30:19.023 INFO:tasks.workunit.client.1.smithi193.stdout:3/836: sync 2024-09-04T16:30:19.023 INFO:tasks.workunit.client.1.smithi193.stdout:9/885: readlink d2/d18/l6f 0 2024-09-04T16:30:19.027 INFO:tasks.workunit.client.1.smithi193.stdout:6/802: dread d5/de/fbf [0,4194304] 0 2024-09-04T16:30:19.027 INFO:tasks.workunit.client.0.smithi170.stdout:0/426: sync 2024-09-04T16:30:19.030 INFO:tasks.workunit.client.0.smithi170.stdout:9/308: mkdir d2/d11/d58 0 2024-09-04T16:30:19.039 INFO:tasks.workunit.client.1.smithi193.stdout:2/803: rename d2/d9/d18/f6f to d2/d9/db/d10/d51/d87/d9b/f10b 0 2024-09-04T16:30:19.040 INFO:tasks.workunit.client.0.smithi170.stdout:8/348: symlink d6/d28/d16/d52/l78 0 2024-09-04T16:30:19.041 INFO:tasks.workunit.client.1.smithi193.stdout:3/837: rmdir d0/d18/d1c/d25/d5e/d90 39 2024-09-04T16:30:19.042 INFO:tasks.workunit.client.1.smithi193.stdout:1/922: truncate d1/d39/d48/ff5 586360 0 2024-09-04T16:30:19.042 INFO:tasks.workunit.client.0.smithi170.stdout:0/427: symlink d11/d13/d2f/d3f/la6 0 2024-09-04T16:30:19.043 INFO:tasks.workunit.client.1.smithi193.stdout:7/944: dwrite d9/d18/d22/d2b/d6c/d70/d79/f87 [0,4194304] 0 2024-09-04T16:30:19.044 INFO:tasks.workunit.client.0.smithi170.stdout:9/309: fsync d2/d3d/d27/d2b/d34/f49 0 2024-09-04T16:30:19.045 INFO:tasks.workunit.client.0.smithi170.stdout:9/310: readlink d2/d3d/d27/d2b/l2f 0 2024-09-04T16:30:19.047 INFO:tasks.workunit.client.1.smithi193.stdout:5/844: mkdir d1/dd0/d102/d113 0 2024-09-04T16:30:19.047 INFO:tasks.workunit.client.1.smithi193.stdout:7/945: read d9/d18/fed [1836473,82077] 0 2024-09-04T16:30:19.047 INFO:tasks.workunit.client.0.smithi170.stdout:8/349: mknod d6/d26/c79 0 2024-09-04T16:30:19.048 INFO:tasks.workunit.client.1.smithi193.stdout:5/845: fdatasync d1/d29/ff0 0 2024-09-04T16:30:19.050 INFO:tasks.workunit.client.0.smithi170.stdout:0/428: rename d11/d13/d4a/f4e to d11/d13/d2f/fa7 0 2024-09-04T16:30:19.051 INFO:tasks.workunit.client.1.smithi193.stdout:0/830: mkdir d18/d25/d5f/d65/dc4/dd5/df2/d112 0 2024-09-04T16:30:19.052 INFO:tasks.workunit.client.1.smithi193.stdout:0/831: chown d18/d25/f29 20 1 2024-09-04T16:30:19.057 INFO:tasks.workunit.client.0.smithi170.stdout:8/350: rename d6/d28/d1a/f45 to d6/f7a 0 2024-09-04T16:30:19.059 INFO:tasks.workunit.client.1.smithi193.stdout:2/804: mknod d2/d9/db/d10/d1f/d77/d91/dff/c10c 0 2024-09-04T16:30:19.060 INFO:tasks.workunit.client.0.smithi170.stdout:0/429: truncate d11/d13/d2f/d3f/f59 546193 0 2024-09-04T16:30:19.063 INFO:tasks.workunit.client.1.smithi193.stdout:9/886: mknod d2/d8/d25/c115 0 2024-09-04T16:30:19.064 INFO:tasks.workunit.client.1.smithi193.stdout:2/805: dwrite d2/d9/db/d10/d1f/f4c [4194304,4194304] 0 2024-09-04T16:30:19.067 INFO:tasks.workunit.client.0.smithi170.stdout:0/430: chown d11/d13/d36/l69 51882 1 2024-09-04T16:30:19.070 INFO:tasks.workunit.client.0.smithi170.stdout:0/431: chown d11/d13/d71/d43/c57 91676261 1 2024-09-04T16:30:19.071 INFO:tasks.workunit.client.0.smithi170.stdout:9/311: truncate d2/d11/f33 3461771 0 2024-09-04T16:30:19.078 INFO:tasks.workunit.client.0.smithi170.stdout:0/432: mkdir d11/d13/d4a/d66/d8c/da8 0 2024-09-04T16:30:19.078 INFO:tasks.workunit.client.0.smithi170.stdout:8/351: dwrite d6/d28/d1a/f36 [0,4194304] 0 2024-09-04T16:30:19.079 INFO:tasks.workunit.client.1.smithi193.stdout:0/832: symlink d18/d25/d5f/d107/l113 0 2024-09-04T16:30:19.079 INFO:tasks.workunit.client.1.smithi193.stdout:6/803: truncate d5/de/d15/d1b/d5f/fd8 966018 0 2024-09-04T16:30:19.080 INFO:tasks.workunit.client.1.smithi193.stdout:3/838: creat d0/d18/d1b/d3d/daf/f110 x:0 0 0 2024-09-04T16:30:19.080 INFO:tasks.workunit.client.1.smithi193.stdout:9/887: mknod d2/d56/d86/dc2/c116 0 2024-09-04T16:30:19.082 INFO:tasks.workunit.client.0.smithi170.stdout:9/312: fdatasync d2/d11/f33 0 2024-09-04T16:30:19.082 INFO:tasks.workunit.client.0.smithi170.stdout:0/433: dread - d11/d13/d71/f53 zero size 2024-09-04T16:30:19.084 INFO:tasks.workunit.client.0.smithi170.stdout:8/352: creat d6/d28/d5f/d70/f7b x:0 0 0 2024-09-04T16:30:19.087 INFO:tasks.workunit.client.0.smithi170.stdout:8/353: truncate d6/d28/d16/d24/d46/f4e 2075385 0 2024-09-04T16:30:19.089 INFO:tasks.workunit.client.1.smithi193.stdout:7/946: rename d9/d18/d22/d2b/d96/f12d to d9/de/d27/f135 0 2024-09-04T16:30:19.090 INFO:tasks.workunit.client.1.smithi193.stdout:7/947: write d9/d18/d22/d2b/fdb [6786153,98487] 0 2024-09-04T16:30:19.090 INFO:tasks.workunit.client.0.smithi170.stdout:0/434: rename d11/d13/d35/c48 to d11/d13/d4a/d66/d8c/da8/ca9 0 2024-09-04T16:30:19.092 INFO:tasks.workunit.client.0.smithi170.stdout:0/435: chown d11/d75/f7d 79832 1 2024-09-04T16:30:19.094 INFO:tasks.workunit.client.0.smithi170.stdout:9/313: mkdir d2/d3d/d4d/d59 0 2024-09-04T16:30:19.098 INFO:tasks.workunit.client.1.smithi193.stdout:9/888: creat d2/d18/d2f/d9a/de4/f117 x:0 0 0 2024-09-04T16:30:19.099 INFO:tasks.workunit.client.1.smithi193.stdout:3/839: symlink d0/d18/d1b/d3d/daf/l111 0 2024-09-04T16:30:19.099 INFO:tasks.workunit.client.1.smithi193.stdout:1/923: getdents d1/d2b/d10/d56/da7 0 2024-09-04T16:30:19.101 INFO:tasks.workunit.client.1.smithi193.stdout:3/840: fsync d0/d10/fe7 0 2024-09-04T16:30:19.101 INFO:tasks.workunit.client.1.smithi193.stdout:9/889: dread - d2/d18/d2f/d9a/de4/f117 zero size 2024-09-04T16:30:19.101 INFO:tasks.workunit.client.1.smithi193.stdout:2/806: dread d2/d9/db/f89 [0,4194304] 0 2024-09-04T16:30:19.102 INFO:tasks.workunit.client.1.smithi193.stdout:3/841: fsync d0/d3b/f100 0 2024-09-04T16:30:19.103 INFO:tasks.workunit.client.0.smithi170.stdout:8/354: unlink d6/d28/d1a/l2a 0 2024-09-04T16:30:19.103 INFO:tasks.workunit.client.0.smithi170.stdout:8/355: chown d6/c32 486 1 2024-09-04T16:30:19.103 INFO:tasks.workunit.client.0.smithi170.stdout:1/429: sync 2024-09-04T16:30:19.103 INFO:tasks.workunit.client.0.smithi170.stdout:7/494: sync 2024-09-04T16:30:19.104 INFO:tasks.workunit.client.1.smithi193.stdout:3/842: write d0/d9/d49/d87/f109 [839105,13463] 0 2024-09-04T16:30:19.107 INFO:tasks.workunit.client.0.smithi170.stdout:9/314: creat d2/d11/d23/d2a/d56/f5a x:0 0 0 2024-09-04T16:30:19.108 INFO:tasks.workunit.client.0.smithi170.stdout:9/315: write d2/d3d/fc [6185146,32692] 0 2024-09-04T16:30:19.109 INFO:tasks.workunit.client.1.smithi193.stdout:0/833: dread d18/d25/d32/dce/fe1 [0,4194304] 0 2024-09-04T16:30:19.112 INFO:tasks.workunit.client.0.smithi170.stdout:7/495: creat d12/d16/d1d/d65/fad x:0 0 0 2024-09-04T16:30:19.112 INFO:tasks.workunit.client.1.smithi193.stdout:7/948: dread d9/d18/d1e/f29 [0,4194304] 0 2024-09-04T16:30:19.114 INFO:tasks.workunit.client.0.smithi170.stdout:9/316: mkdir d2/d11/d23/d2a/d5b 0 2024-09-04T16:30:19.115 INFO:tasks.workunit.client.0.smithi170.stdout:9/317: chown d2/d3d/d4d/d59 957 1 2024-09-04T16:30:19.115 INFO:tasks.workunit.client.0.smithi170.stdout:1/430: write d9/f27 [4297679,18322] 0 2024-09-04T16:30:19.117 INFO:tasks.workunit.client.0.smithi170.stdout:1/431: read - d9/d11/d2e/f89 zero size 2024-09-04T16:30:19.117 INFO:tasks.workunit.client.0.smithi170.stdout:0/436: getdents d11/d13/d2f/d3f 0 2024-09-04T16:30:19.118 INFO:tasks.workunit.client.0.smithi170.stdout:1/432: dread d9/f22 [0,4194304] 0 2024-09-04T16:30:19.119 INFO:tasks.workunit.client.1.smithi193.stdout:2/807: dread d2/d9/f36 [0,4194304] 0 2024-09-04T16:30:19.119 INFO:tasks.workunit.client.0.smithi170.stdout:9/318: mknod d2/d32/c5c 0 2024-09-04T16:30:19.120 INFO:tasks.workunit.client.1.smithi193.stdout:2/808: chown d2/d9/db/d10/d38/dac/ce2 37021 1 2024-09-04T16:30:19.120 INFO:tasks.workunit.client.0.smithi170.stdout:9/319: readlink d2/d3d/d27/d2b/l2f 0 2024-09-04T16:30:19.121 INFO:tasks.workunit.client.0.smithi170.stdout:9/320: write d2/d3d/f57 [3884156,44957] 0 2024-09-04T16:30:19.122 INFO:tasks.workunit.client.0.smithi170.stdout:8/356: getdents d6/d28/d5f 0 2024-09-04T16:30:19.123 INFO:tasks.workunit.client.0.smithi170.stdout:8/357: fdatasync d6/f57 0 2024-09-04T16:30:19.124 INFO:tasks.workunit.client.0.smithi170.stdout:0/437: fdatasync d11/d13/f28 0 2024-09-04T16:30:19.127 INFO:tasks.workunit.client.0.smithi170.stdout:1/433: dwrite d9/d11/d3e/f82 [0,4194304] 0 2024-09-04T16:30:19.128 INFO:tasks.workunit.client.0.smithi170.stdout:1/434: write d9/d11/d2e/f52 [4183945,58717] 0 2024-09-04T16:30:19.128 INFO:tasks.workunit.client.1.smithi193.stdout:4/755: sync 2024-09-04T16:30:19.129 INFO:tasks.workunit.client.1.smithi193.stdout:8/856: sync 2024-09-04T16:30:19.130 INFO:tasks.workunit.client.1.smithi193.stdout:8/857: write d2/d20/d23/d1b/f28 [3482569,81685] 0 2024-09-04T16:30:19.138 INFO:tasks.workunit.client.0.smithi170.stdout:7/496: link d12/d16/f3f d12/d5a/fae 0 2024-09-04T16:30:19.140 INFO:tasks.workunit.client.0.smithi170.stdout:0/438: symlink d11/d13/d4a/d66/laa 0 2024-09-04T16:30:19.144 INFO:tasks.workunit.client.0.smithi170.stdout:3/227: sync 2024-09-04T16:30:19.144 INFO:tasks.workunit.client.0.smithi170.stdout:5/255: sync 2024-09-04T16:30:19.144 INFO:tasks.workunit.client.0.smithi170.stdout:4/360: sync 2024-09-04T16:30:19.144 INFO:tasks.workunit.client.0.smithi170.stdout:2/320: sync 2024-09-04T16:30:19.144 INFO:tasks.workunit.client.0.smithi170.stdout:6/279: sync 2024-09-04T16:30:19.146 INFO:tasks.workunit.client.0.smithi170.stdout:2/321: readlink d3/db/df/l28 0 2024-09-04T16:30:19.149 INFO:tasks.workunit.client.0.smithi170.stdout:1/435: dread d9/d11/d2e/f45 [0,4194304] 0 2024-09-04T16:30:19.154 INFO:tasks.workunit.client.0.smithi170.stdout:5/256: dwrite d4/f4a [0,4194304] 0 2024-09-04T16:30:19.156 INFO:tasks.workunit.client.0.smithi170.stdout:6/280: dwrite d0/d17/f1c [4194304,4194304] 0 2024-09-04T16:30:19.161 INFO:tasks.workunit.client.0.smithi170.stdout:4/361: creat d1/d6/d2b/d33/d36/f81 x:0 0 0 2024-09-04T16:30:19.164 INFO:tasks.workunit.client.0.smithi170.stdout:4/362: write d1/d6/d8/f56 [1856559,129082] 0 2024-09-04T16:30:19.165 INFO:tasks.workunit.client.0.smithi170.stdout:6/281: dwrite d0/df/f3a [0,4194304] 0 2024-09-04T16:30:19.171 INFO:tasks.workunit.client.0.smithi170.stdout:5/257: mknod d4/d8/c4b 0 2024-09-04T16:30:19.171 INFO:tasks.workunit.client.0.smithi170.stdout:1/436: dwrite d9/f37 [0,4194304] 0 2024-09-04T16:30:19.173 INFO:tasks.workunit.client.0.smithi170.stdout:9/321: getdents d2/d3d/d27 0 2024-09-04T16:30:19.176 INFO:tasks.workunit.client.0.smithi170.stdout:8/358: dwrite d6/d28/d20/d5e/f3e [0,4194304] 0 2024-09-04T16:30:19.178 INFO:tasks.workunit.client.0.smithi170.stdout:8/359: readlink d6/d28/d20/d5e/l39 0 2024-09-04T16:30:19.179 INFO:tasks.workunit.client.0.smithi170.stdout:2/322: getdents d3/db/d62 0 2024-09-04T16:30:19.179 INFO:tasks.workunit.client.0.smithi170.stdout:2/323: chown d3/d7/f3e 1134343819 1 2024-09-04T16:30:19.180 INFO:tasks.workunit.client.0.smithi170.stdout:2/324: write d3/d3c/f3a [4755288,24041] 0 2024-09-04T16:30:19.181 INFO:tasks.workunit.client.0.smithi170.stdout:2/325: chown d3/d3c/d40/f53 59676294 1 2024-09-04T16:30:19.185 INFO:tasks.workunit.client.0.smithi170.stdout:6/282: creat d0/df/d1b/d3e/d44/f5d x:0 0 0 2024-09-04T16:30:19.189 INFO:tasks.workunit.client.0.smithi170.stdout:1/437: rmdir d9/d26 39 2024-09-04T16:30:19.190 INFO:tasks.workunit.client.1.smithi193.stdout:9/890: stat d2/d18/fa9 0 2024-09-04T16:30:19.190 INFO:tasks.workunit.client.1.smithi193.stdout:9/891: stat d2/d18/d66 0 2024-09-04T16:30:19.192 INFO:tasks.workunit.client.0.smithi170.stdout:9/322: symlink d2/d11/d23/l5d 0 2024-09-04T16:30:19.193 INFO:tasks.workunit.client.0.smithi170.stdout:8/360: mknod d6/d28/d20/c7c 0 2024-09-04T16:30:19.194 INFO:tasks.workunit.client.0.smithi170.stdout:2/326: mknod d3/d3c/d40/c63 0 2024-09-04T16:30:19.196 INFO:tasks.workunit.client.1.smithi193.stdout:3/843: mkdir d0/d9/dae/d112 0 2024-09-04T16:30:19.197 INFO:tasks.workunit.client.0.smithi170.stdout:6/283: dwrite d0/d17/d2a/d30/f51 [0,4194304] 0 2024-09-04T16:30:19.197 INFO:tasks.workunit.client.1.smithi193.stdout:3/844: chown d0/lb5 1681124 1 2024-09-04T16:30:19.197 INFO:tasks.workunit.client.0.smithi170.stdout:0/439: getdents d11/d13/d4a/d66 0 2024-09-04T16:30:19.199 INFO:tasks.workunit.client.1.smithi193.stdout:0/834: rename d18/d25/l37 to d18/d25/d32/dce/dd7/l114 0 2024-09-04T16:30:19.202 INFO:tasks.workunit.client.0.smithi170.stdout:2/327: chown d3/d3c/d40/d48/f5e 12386 1 2024-09-04T16:30:19.202 INFO:tasks.workunit.client.0.smithi170.stdout:6/284: chown d0/df/f3a 286 1 2024-09-04T16:30:19.202 INFO:tasks.workunit.client.0.smithi170.stdout:1/438: dwrite d9/f27 [0,4194304] 0 2024-09-04T16:30:19.202 INFO:tasks.workunit.client.1.smithi193.stdout:0/835: write d18/d25/d5f/def/f10d [517732,102559] 0 2024-09-04T16:30:19.202 INFO:tasks.workunit.client.1.smithi193.stdout:3/845: dwrite d0/d18/d1b/d3d/d96/fd0 [0,4194304] 0 2024-09-04T16:30:19.203 INFO:tasks.workunit.client.0.smithi170.stdout:2/328: chown d3/d4/l4c 1952 1 2024-09-04T16:30:19.203 INFO:tasks.workunit.client.1.smithi193.stdout:7/949: mkdir d9/d18/d22/d2b/d136 0 2024-09-04T16:30:19.205 INFO:tasks.workunit.client.1.smithi193.stdout:4/756: symlink d3/d1a/d21/lf7 0 2024-09-04T16:30:19.205 INFO:tasks.workunit.client.0.smithi170.stdout:2/329: stat d3/db/c3d 0 2024-09-04T16:30:19.208 INFO:tasks.workunit.client.0.smithi170.stdout:2/330: fsync d3/d3c/f3a 0 2024-09-04T16:30:19.209 INFO:tasks.workunit.client.0.smithi170.stdout:3/228: getdents d13/d14/d21 0 2024-09-04T16:30:19.213 INFO:tasks.workunit.client.0.smithi170.stdout:8/361: dread d6/d28/d1a/f36 [0,4194304] 0 2024-09-04T16:30:19.215 INFO:tasks.workunit.client.0.smithi170.stdout:3/229: fdatasync d13/d14/d1d/f28 0 2024-09-04T16:30:19.218 INFO:tasks.workunit.client.0.smithi170.stdout:9/323: truncate d2/d3d/f20 3440829 0 2024-09-04T16:30:19.220 INFO:tasks.workunit.client.0.smithi170.stdout:0/440: creat d11/d8e/fab x:0 0 0 2024-09-04T16:30:19.223 INFO:tasks.workunit.client.1.smithi193.stdout:7/950: rename d9/d18/d22/d2b/fe4 to d9/d18/d22/d2b/d136/f137 0 2024-09-04T16:30:19.223 INFO:tasks.workunit.client.0.smithi170.stdout:7/497: link d12/d15/d71/d42/d79/d9d/fa6 d12/d15/faf 0 2024-09-04T16:30:19.226 INFO:tasks.workunit.client.1.smithi193.stdout:8/858: symlink d2/d20/d23/d34/d46/d66/dfe/l112 0 2024-09-04T16:30:19.227 INFO:tasks.workunit.client.1.smithi193.stdout:8/859: fsync d2/d20/f36 0 2024-09-04T16:30:19.227 INFO:tasks.workunit.client.0.smithi170.stdout:1/439: readlink d9/d11/d3e/l41 0 2024-09-04T16:30:19.228 INFO:tasks.workunit.client.0.smithi170.stdout:1/440: read d9/f22 [325623,13646] 0 2024-09-04T16:30:19.229 INFO:tasks.workunit.client.1.smithi193.stdout:9/892: symlink d2/d8/d25/df9/l118 0 2024-09-04T16:30:19.230 INFO:tasks.workunit.client.1.smithi193.stdout:9/893: write d2/d18/d2f/d22/d30/d6a/d6e/de2/d10f/f114 [255180,12415] 0 2024-09-04T16:30:19.230 INFO:tasks.workunit.client.1.smithi193.stdout:8/860: dread d2/d20/d23/d34/d4b/d7c/db2/fd7 [0,4194304] 0 2024-09-04T16:30:19.231 INFO:tasks.workunit.client.0.smithi170.stdout:4/363: dwrite d1/d6/d8/fa [0,4194304] 0 2024-09-04T16:30:19.232 INFO:tasks.workunit.client.1.smithi193.stdout:8/861: write d2/d20/d23/d24/d3c/d65/dc8/f10b [669293,18097] 0 2024-09-04T16:30:19.233 INFO:tasks.workunit.client.1.smithi193.stdout:8/862: chown d2/d20/d23/d1b/d4e/f55 15671 1 2024-09-04T16:30:19.236 INFO:tasks.workunit.client.1.smithi193.stdout:0/836: dread d18/f20 [0,4194304] 0 2024-09-04T16:30:19.239 INFO:tasks.workunit.client.1.smithi193.stdout:1/924: truncate d1/d2b/d1b/d51/fa6 1426512 0 2024-09-04T16:30:19.240 INFO:tasks.workunit.client.0.smithi170.stdout:1/441: dread d9/f47 [0,4194304] 0 2024-09-04T16:30:19.240 INFO:tasks.workunit.client.0.smithi170.stdout:8/362: creat d6/d28/d5f/d70/f7d x:0 0 0 2024-09-04T16:30:19.241 INFO:tasks.workunit.client.0.smithi170.stdout:4/364: dwrite d1/d6/d22/f62 [0,4194304] 0 2024-09-04T16:30:19.241 INFO:tasks.workunit.client.1.smithi193.stdout:4/757: creat d3/d3c/d89/dbd/ddc/ff8 x:0 0 0 2024-09-04T16:30:19.242 INFO:tasks.workunit.client.0.smithi170.stdout:1/442: read d9/d11/d2e/f45 [2811471,106563] 0 2024-09-04T16:30:19.249 INFO:tasks.workunit.client.0.smithi170.stdout:3/230: write d13/d14/f32 [6584404,4745] 0 2024-09-04T16:30:19.249 INFO:tasks.workunit.client.1.smithi193.stdout:9/894: readlink d2/d8/l40 0 2024-09-04T16:30:19.250 INFO:tasks.workunit.client.0.smithi170.stdout:9/324: symlink d2/d11/d23/d2a/d56/l5e 0 2024-09-04T16:30:19.253 INFO:tasks.workunit.client.0.smithi170.stdout:6/285: dwrite d0/df/d1b/d3e/d44/d2d/f3d [0,4194304] 0 2024-09-04T16:30:19.253 INFO:tasks.workunit.client.1.smithi193.stdout:0/837: dread d18/d25/d32/d57/d6c/db1/fc7 [0,4194304] 0 2024-09-04T16:30:19.254 INFO:tasks.workunit.client.0.smithi170.stdout:0/441: creat d11/d13/d4a/d66/d6d/fac x:0 0 0 2024-09-04T16:30:19.254 INFO:tasks.workunit.client.0.smithi170.stdout:2/331: write d3/d3c/d40/f41 [405411,55773] 0 2024-09-04T16:30:19.255 INFO:tasks.workunit.client.0.smithi170.stdout:6/286: stat d0 0 2024-09-04T16:30:19.255 INFO:tasks.workunit.client.0.smithi170.stdout:7/498: dread - d12/d5a/fae zero size 2024-09-04T16:30:19.259 INFO:tasks.workunit.client.1.smithi193.stdout:7/951: creat d9/d18/d22/d11a/f138 x:0 0 0 2024-09-04T16:30:19.260 INFO:tasks.workunit.client.1.smithi193.stdout:0/838: dwrite d18/d25/d3b/f40 [0,4194304] 0 2024-09-04T16:30:19.261 INFO:tasks.workunit.client.1.smithi193.stdout:7/952: chown d9/d18/d22 187 1 2024-09-04T16:30:19.261 INFO:tasks.workunit.client.1.smithi193.stdout:4/758: mkdir d3/d1a/d21/d52/d7f/db6/df9 0 2024-09-04T16:30:19.266 INFO:tasks.workunit.client.1.smithi193.stdout:5/846: sync 2024-09-04T16:30:19.266 INFO:tasks.workunit.client.1.smithi193.stdout:9/895: chown d2/d18/d2f/l2a 3162427 1 2024-09-04T16:30:19.266 INFO:tasks.workunit.client.0.smithi170.stdout:5/258: getdents d4/d8/d1c 0 2024-09-04T16:30:19.269 INFO:tasks.workunit.client.0.smithi170.stdout:8/363: creat d6/d28/d16/f7e x:0 0 0 2024-09-04T16:30:19.272 INFO:tasks.workunit.client.1.smithi193.stdout:7/953: unlink d9/d18/f4c 0 2024-09-04T16:30:19.273 INFO:tasks.workunit.client.0.smithi170.stdout:1/443: creat d9/d11/d3e/d6a/d79/f8c x:0 0 0 2024-09-04T16:30:19.274 INFO:tasks.workunit.client.1.smithi193.stdout:1/925: dwrite d1/d2b/db/d54/f70 [0,4194304] 0 2024-09-04T16:30:19.274 INFO:tasks.workunit.client.1.smithi193.stdout:5/847: dread d1/d8/db/d36/d40/d46/dbe/fba [0,4194304] 0 2024-09-04T16:30:19.274 INFO:tasks.workunit.client.1.smithi193.stdout:4/759: dread d3/d3c/d89/f8c [0,4194304] 0 2024-09-04T16:30:19.276 INFO:tasks.workunit.client.0.smithi170.stdout:9/325: mknod d2/d11/c5f 0 2024-09-04T16:30:19.277 INFO:tasks.workunit.client.1.smithi193.stdout:7/954: read - d9/d11/d113/f105 zero size 2024-09-04T16:30:19.277 INFO:tasks.workunit.client.0.smithi170.stdout:2/332: symlink d3/db/d1c/d47/l64 0 2024-09-04T16:30:19.277 INFO:tasks.workunit.client.0.smithi170.stdout:9/326: write d2/d3d/f10 [2051115,3578] 0 2024-09-04T16:30:19.278 INFO:tasks.workunit.client.1.smithi193.stdout:8/863: dread d2/d12/fd [0,4194304] 0 2024-09-04T16:30:19.278 INFO:tasks.workunit.client.1.smithi193.stdout:0/839: dwrite d18/d25/d5f/d65/dc4/dd5/fdf [0,4194304] 0 2024-09-04T16:30:19.279 INFO:tasks.workunit.client.0.smithi170.stdout:6/287: creat d0/df/d1f/f5e x:0 0 0 2024-09-04T16:30:19.282 INFO:tasks.workunit.client.0.smithi170.stdout:0/442: creat d11/d13/d35/fad x:0 0 0 2024-09-04T16:30:19.283 INFO:tasks.workunit.client.1.smithi193.stdout:9/896: symlink d2/d4/l119 0 2024-09-04T16:30:19.284 INFO:tasks.workunit.client.1.smithi193.stdout:9/897: fdatasync d2/f28 0 2024-09-04T16:30:19.284 INFO:tasks.workunit.client.1.smithi193.stdout:9/898: fsync d2/d8/d4d/ff3 0 2024-09-04T16:30:19.286 INFO:tasks.workunit.client.1.smithi193.stdout:8/864: dwrite d2/d20/f36 [4194304,4194304] 0 2024-09-04T16:30:19.286 INFO:tasks.workunit.client.1.smithi193.stdout:9/899: write d2/d8/d25/f37 [2184763,78720] 0 2024-09-04T16:30:19.287 INFO:tasks.workunit.client.0.smithi170.stdout:7/499: creat d12/d15/d41/fb0 x:0 0 0 2024-09-04T16:30:19.291 INFO:tasks.workunit.client.1.smithi193.stdout:1/926: rmdir d1/d39/d48 39 2024-09-04T16:30:19.291 INFO:tasks.workunit.client.1.smithi193.stdout:1/927: stat d1/cc 0 2024-09-04T16:30:19.292 INFO:tasks.workunit.client.1.smithi193.stdout:1/928: readlink d1/d2b/d10/d56/da7/l80 0 2024-09-04T16:30:19.293 INFO:tasks.workunit.client.1.smithi193.stdout:1/929: readlink d1/d2b/d1b/d28/d50/ldd 0 2024-09-04T16:30:19.293 INFO:tasks.workunit.client.0.smithi170.stdout:3/231: write d13/f1a [1319985,15472] 0 2024-09-04T16:30:19.294 INFO:tasks.workunit.client.1.smithi193.stdout:1/930: truncate d1/d2b/d10/d56/ff7 390961 0 2024-09-04T16:30:19.295 INFO:tasks.workunit.client.1.smithi193.stdout:1/931: write d1/d2b/d10/db7/dc8/fcc [461845,84105] 0 2024-09-04T16:30:19.296 INFO:tasks.workunit.client.1.smithi193.stdout:4/760: truncate d3/fc 5216031 0 2024-09-04T16:30:19.297 INFO:tasks.workunit.client.1.smithi193.stdout:4/761: readlink d3/d1a/d21/d52/d7f/l92 0 2024-09-04T16:30:19.297 INFO:tasks.workunit.client.0.smithi170.stdout:8/364: stat d6/d28/d16/d24/l4c 0 2024-09-04T16:30:19.304 INFO:tasks.workunit.client.1.smithi193.stdout:8/865: creat d2/d20/d23/d34/d46/d66/d10e/f113 x:0 0 0 2024-09-04T16:30:19.306 INFO:tasks.workunit.client.0.smithi170.stdout:0/443: mkdir d11/d13/d4a/d66/d8c/dae 0 2024-09-04T16:30:19.309 INFO:tasks.workunit.client.0.smithi170.stdout:5/259: symlink d4/d8/d1c/d26/d27/d48/l4c 0 2024-09-04T16:30:19.312 INFO:tasks.workunit.client.0.smithi170.stdout:0/444: dwrite d11/f29 [0,4194304] 0 2024-09-04T16:30:19.314 INFO:tasks.workunit.client.0.smithi170.stdout:7/500: dread d12/d15/d71/d42/d81/f44 [0,4194304] 0 2024-09-04T16:30:19.320 INFO:tasks.workunit.client.0.smithi170.stdout:4/365: rename d1/l5e to d1/d6/d8/d20/d35/d3e/d4e/l82 0 2024-09-04T16:30:19.321 INFO:tasks.workunit.client.1.smithi193.stdout:7/955: creat d9/d18/d22/d2b/d96/f139 x:0 0 0 2024-09-04T16:30:19.322 INFO:tasks.workunit.client.0.smithi170.stdout:1/444: creat d9/d26/d77/f8d x:0 0 0 2024-09-04T16:30:19.326 INFO:tasks.workunit.client.0.smithi170.stdout:7/501: dread f1 [0,4194304] 0 2024-09-04T16:30:19.327 INFO:tasks.workunit.client.0.smithi170.stdout:6/288: write d0/f2 [1762269,8764] 0 2024-09-04T16:30:19.330 INFO:tasks.workunit.client.0.smithi170.stdout:3/232: write d13/d14/d1d/d2d/f37 [800295,101399] 0 2024-09-04T16:30:19.331 INFO:tasks.workunit.client.0.smithi170.stdout:3/233: fdatasync d13/d14/d1d/d2d/f34 0 2024-09-04T16:30:19.334 INFO:tasks.workunit.client.1.smithi193.stdout:1/932: rename d1/d2b/d10/d56/da7/db1 to d1/d2b/d10/d56/d11d 0 2024-09-04T16:30:19.336 INFO:tasks.workunit.client.1.smithi193.stdout:0/840: dwrite d18/d25/d3b/de9/fff [0,4194304] 0 2024-09-04T16:30:19.336 INFO:tasks.workunit.client.0.smithi170.stdout:0/445: rmdir d11/d13 39 2024-09-04T16:30:19.336 INFO:tasks.workunit.client.0.smithi170.stdout:9/327: truncate d2/d11/f26 2128537 0 2024-09-04T16:30:19.337 INFO:tasks.workunit.client.1.smithi193.stdout:8/866: dwrite d2/d20/d23/d24/f5d [0,4194304] 0 2024-09-04T16:30:19.338 INFO:tasks.workunit.client.1.smithi193.stdout:9/900: getdents d2/d18/d66 0 2024-09-04T16:30:19.340 INFO:tasks.workunit.client.1.smithi193.stdout:9/901: readlink d2/d8/d25/df9/l118 0 2024-09-04T16:30:19.340 INFO:tasks.workunit.client.0.smithi170.stdout:4/366: mknod d1/d6/d22/c83 0 2024-09-04T16:30:19.341 INFO:tasks.workunit.client.1.smithi193.stdout:1/933: creat d1/f11e x:0 0 0 2024-09-04T16:30:19.342 INFO:tasks.workunit.client.0.smithi170.stdout:1/445: truncate d9/f22 777588 0 2024-09-04T16:30:19.342 INFO:tasks.workunit.client.1.smithi193.stdout:0/841: rmdir d18/d25/d5f/def/dfa 39 2024-09-04T16:30:19.344 INFO:tasks.workunit.client.1.smithi193.stdout:7/956: rmdir d9/d39/d3e/d53 39 2024-09-04T16:30:19.347 INFO:tasks.workunit.client.0.smithi170.stdout:7/502: mknod d12/d16/d1d/d65/d82/cb1 0 2024-09-04T16:30:19.348 INFO:tasks.workunit.client.0.smithi170.stdout:4/367: dwrite d1/d6/d8/d20/d35/d3e/d4e/d51/f5c [0,4194304] 0 2024-09-04T16:30:19.349 INFO:tasks.workunit.client.1.smithi193.stdout:3/846: sync 2024-09-04T16:30:19.350 INFO:tasks.workunit.client.1.smithi193.stdout:2/809: sync 2024-09-04T16:30:19.350 INFO:tasks.workunit.client.1.smithi193.stdout:6/804: sync 2024-09-04T16:30:19.351 INFO:tasks.workunit.client.1.smithi193.stdout:6/805: readlink d5/d33/l81 0 2024-09-04T16:30:19.354 INFO:tasks.workunit.client.1.smithi193.stdout:8/867: mknod d2/d20/d23/d34/d4b/c114 0 2024-09-04T16:30:19.355 INFO:tasks.workunit.client.0.smithi170.stdout:5/260: link d4/d8/d1c/d26/d27/f3f d4/d3a/f4d 0 2024-09-04T16:30:19.357 INFO:tasks.workunit.client.1.smithi193.stdout:1/934: creat d1/d2b/d10/d56/d11d/f11f x:0 0 0 2024-09-04T16:30:19.359 INFO:tasks.workunit.client.1.smithi193.stdout:4/762: dwrite d3/d39/d44/f9e [0,4194304] 0 2024-09-04T16:30:19.360 INFO:tasks.workunit.client.1.smithi193.stdout:4/763: chown d3/d1a/d54/db1/lbc 415955467 1 2024-09-04T16:30:19.361 INFO:tasks.workunit.client.0.smithi170.stdout:8/365: rmdir d6/d28/d66 0 2024-09-04T16:30:19.363 INFO:tasks.workunit.client.0.smithi170.stdout:5/261: dwrite d4/f3c [0,4194304] 0 2024-09-04T16:30:19.363 INFO:tasks.workunit.client.1.smithi193.stdout:2/810: unlink d2/d9/db/d10/l11 0 2024-09-04T16:30:19.366 INFO:tasks.workunit.client.0.smithi170.stdout:9/328: read d2/f17 [162456,104548] 0 2024-09-04T16:30:19.368 INFO:tasks.workunit.client.0.smithi170.stdout:9/329: read d2/d3d/d27/d2b/d34/f49 [5414913,120953] 0 2024-09-04T16:30:19.371 INFO:tasks.workunit.client.0.smithi170.stdout:1/446: mknod d9/d34/d5f/c8e 0 2024-09-04T16:30:19.372 INFO:tasks.workunit.client.0.smithi170.stdout:1/447: dread - d9/d11/d2f/f64 zero size 2024-09-04T16:30:19.373 INFO:tasks.workunit.client.1.smithi193.stdout:9/902: mknod d2/d8/d88/c11a 0 2024-09-04T16:30:19.375 INFO:tasks.workunit.client.0.smithi170.stdout:2/333: getdents d3/db/d1c 0 2024-09-04T16:30:19.376 INFO:tasks.workunit.client.0.smithi170.stdout:2/334: readlink d3/db/d1c/d47/l64 0 2024-09-04T16:30:19.379 INFO:tasks.workunit.client.1.smithi193.stdout:8/868: mknod d2/d20/d23/d34/c115 0 2024-09-04T16:30:19.380 INFO:tasks.workunit.client.0.smithi170.stdout:7/503: truncate d12/d16/f3f 252025 0 2024-09-04T16:30:19.381 INFO:tasks.workunit.client.1.smithi193.stdout:4/764: mknod d3/d1a/d54/db1/cfa 0 2024-09-04T16:30:19.382 INFO:tasks.workunit.client.1.smithi193.stdout:8/869: truncate d2/d20/d23/d24/d3c/d65/dc8/de1/f10c 684987 0 2024-09-04T16:30:19.382 INFO:tasks.workunit.client.1.smithi193.stdout:0/842: write d18/d25/d32/d57/f4e [4239,77678] 0 2024-09-04T16:30:19.384 INFO:tasks.workunit.client.1.smithi193.stdout:4/765: chown d3/d1a/d54/db1/ld1 16 1 2024-09-04T16:30:19.385 INFO:tasks.workunit.client.1.smithi193.stdout:7/957: mknod d9/d39/c13a 0 2024-09-04T16:30:19.386 INFO:tasks.workunit.client.1.smithi193.stdout:1/935: dread d1/d2b/d10/fbc [0,4194304] 0 2024-09-04T16:30:19.386 INFO:tasks.workunit.client.0.smithi170.stdout:1/448: dwrite d9/d26/d77/d83/f86 [0,4194304] 0 2024-09-04T16:30:19.387 INFO:tasks.workunit.client.0.smithi170.stdout:7/504: truncate d12/d15/fa4 756679 0 2024-09-04T16:30:19.390 INFO:tasks.workunit.client.0.smithi170.stdout:5/262: dread d4/f2b [4194304,4194304] 0 2024-09-04T16:30:19.390 INFO:tasks.workunit.client.0.smithi170.stdout:8/366: mknod d6/d28/d16/d24/d46/c7f 0 2024-09-04T16:30:19.391 INFO:tasks.workunit.client.1.smithi193.stdout:2/811: mknod d2/d9/db/d10/d4e/c10d 0 2024-09-04T16:30:19.391 INFO:tasks.workunit.client.0.smithi170.stdout:0/446: dwrite d11/d75/f7d [4194304,4194304] 0 2024-09-04T16:30:19.392 INFO:tasks.workunit.client.1.smithi193.stdout:6/806: dread d5/de/d15/f24 [0,4194304] 0 2024-09-04T16:30:19.392 INFO:tasks.workunit.client.1.smithi193.stdout:0/843: dwrite d18/d25/d3b/f40 [0,4194304] 0 2024-09-04T16:30:19.392 INFO:tasks.workunit.client.1.smithi193.stdout:8/870: dwrite d2/d20/d23/d34/d3e/d6f/d81/faa [0,4194304] 0 2024-09-04T16:30:19.396 INFO:tasks.workunit.client.0.smithi170.stdout:9/330: creat d2/d11/d23/d2a/d56/f60 x:0 0 0 2024-09-04T16:30:19.396 INFO:tasks.workunit.client.0.smithi170.stdout:5/263: write d4/db/f34 [1034757,56165] 0 2024-09-04T16:30:19.399 INFO:tasks.workunit.client.1.smithi193.stdout:4/766: unlink d3/d1a/d21/f78 0 2024-09-04T16:30:19.401 INFO:tasks.workunit.client.0.smithi170.stdout:1/449: dwrite d9/d26/f78 [0,4194304] 0 2024-09-04T16:30:19.401 INFO:tasks.workunit.client.1.smithi193.stdout:7/958: fdatasync d9/d39/d3e/d69/dcf/f126 0 2024-09-04T16:30:19.402 INFO:tasks.workunit.client.1.smithi193.stdout:4/767: write d3/d81/f9b [1898473,120290] 0 2024-09-04T16:30:19.402 INFO:tasks.workunit.client.0.smithi170.stdout:4/368: mknod d1/c84 0 2024-09-04T16:30:19.405 INFO:tasks.workunit.client.1.smithi193.stdout:3/847: rename d0/d18/d1c/d51/d5a/fa3 to d0/d18/d1c/f113 0 2024-09-04T16:30:19.406 INFO:tasks.workunit.client.0.smithi170.stdout:1/450: dread - d9/d26/d77/f8d zero size 2024-09-04T16:30:19.406 INFO:tasks.workunit.client.0.smithi170.stdout:8/367: dread d6/d28/d20/d5e/f5c [0,4194304] 0 2024-09-04T16:30:19.407 INFO:tasks.workunit.client.0.smithi170.stdout:6/289: rename d0/df/c13 to d0/d17/c5f 0 2024-09-04T16:30:19.408 INFO:tasks.workunit.client.1.smithi193.stdout:3/848: write d0/d3b/f100 [214716,4018] 0 2024-09-04T16:30:19.410 INFO:tasks.workunit.client.1.smithi193.stdout:4/768: dwrite d3/d3c/d89/dbd/ddc/ff8 [0,4194304] 0 2024-09-04T16:30:19.410 INFO:tasks.workunit.client.0.smithi170.stdout:7/505: fdatasync f1 0 2024-09-04T16:30:19.412 INFO:tasks.workunit.client.1.smithi193.stdout:4/769: readlink d3/l4e 0 2024-09-04T16:30:19.412 INFO:tasks.workunit.client.1.smithi193.stdout:9/903: creat d2/d56/d86/dc2/dde/dda/f11b x:0 0 0 2024-09-04T16:30:19.414 INFO:tasks.workunit.client.1.smithi193.stdout:0/844: readlink d18/d25/d5f/d6a/ld8 0 2024-09-04T16:30:19.416 INFO:tasks.workunit.client.1.smithi193.stdout:9/904: chown d2/d56/f76 3 1 2024-09-04T16:30:19.417 INFO:tasks.workunit.client.1.smithi193.stdout:9/905: readlink d2/d18/d2f/d22/d30/d6a/d6e/de2/d107/l108 0 2024-09-04T16:30:19.419 INFO:tasks.workunit.client.1.smithi193.stdout:7/959: mknod d9/d18/d22/d2b/d6c/d70/d79/c13b 0 2024-09-04T16:30:19.419 INFO:tasks.workunit.client.1.smithi193.stdout:9/906: truncate d2/d8/d25/f102 4555344 0 2024-09-04T16:30:19.420 INFO:tasks.workunit.client.0.smithi170.stdout:7/506: dwrite d12/d15/f2f [0,4194304] 0 2024-09-04T16:30:19.425 INFO:tasks.workunit.client.0.smithi170.stdout:5/264: rmdir d4/d3a 39 2024-09-04T16:30:19.426 INFO:tasks.workunit.client.1.smithi193.stdout:0/845: fdatasync d18/d25/d5f/def/da0/fc8 0 2024-09-04T16:30:19.428 INFO:tasks.workunit.client.0.smithi170.stdout:8/368: mkdir d6/d28/d1a/d80 0 2024-09-04T16:30:19.429 INFO:tasks.workunit.client.1.smithi193.stdout:8/871: dread d2/f31 [0,4194304] 0 2024-09-04T16:30:19.430 INFO:tasks.workunit.client.0.smithi170.stdout:4/369: rename d1/d6/d8/d20/l52 to d1/d6/d8/d20/d35/d3e/d60/l85 0 2024-09-04T16:30:19.432 INFO:tasks.workunit.client.0.smithi170.stdout:3/234: getdents d13/d14/d1d 0 2024-09-04T16:30:19.433 INFO:tasks.workunit.client.0.smithi170.stdout:4/370: fsync d1/d6/d2b/d33/d36/f3c 0 2024-09-04T16:30:19.433 INFO:tasks.workunit.client.1.smithi193.stdout:0/846: mknod d18/d25/d5f/d65/dc4/dd5/c115 0 2024-09-04T16:30:19.434 INFO:tasks.workunit.client.1.smithi193.stdout:7/960: symlink d9/d39/d95/l13c 0 2024-09-04T16:30:19.435 INFO:tasks.workunit.client.0.smithi170.stdout:3/235: write d13/d14/d21/f33 [288648,77563] 0 2024-09-04T16:30:19.436 INFO:tasks.workunit.client.1.smithi193.stdout:9/907: symlink d2/deb/l11c 0 2024-09-04T16:30:19.436 INFO:tasks.workunit.client.0.smithi170.stdout:8/369: dwrite d6/d28/d1a/f42 [0,4194304] 0 2024-09-04T16:30:19.436 INFO:tasks.workunit.client.1.smithi193.stdout:8/872: dwrite d2/d20/d23/f1d [0,4194304] 0 2024-09-04T16:30:19.437 INFO:tasks.workunit.client.0.smithi170.stdout:3/236: stat d13/d14/d21/d46 0 2024-09-04T16:30:19.437 INFO:tasks.workunit.client.0.smithi170.stdout:8/370: chown d6/d28/d1a/d38/c61 2991 1 2024-09-04T16:30:19.440 INFO:tasks.workunit.client.1.smithi193.stdout:3/849: rename d0/d18/d1c/d6e to d0/d18/d114 0 2024-09-04T16:30:19.442 INFO:tasks.workunit.client.0.smithi170.stdout:2/335: creat d3/f65 x:0 0 0 2024-09-04T16:30:19.444 INFO:tasks.workunit.client.0.smithi170.stdout:2/336: write d3/d4/d14/f5d [924859,76673] 0 2024-09-04T16:30:19.445 INFO:tasks.workunit.client.1.smithi193.stdout:8/873: mknod d2/d20/dc0/c116 0 2024-09-04T16:30:19.447 INFO:tasks.workunit.client.1.smithi193.stdout:0/847: mknod d18/d25/d5f/c116 0 2024-09-04T16:30:19.448 INFO:tasks.workunit.client.1.smithi193.stdout:0/848: chown d18/d25/d5f/def/f10d 1 1 2024-09-04T16:30:19.450 INFO:tasks.workunit.client.1.smithi193.stdout:4/770: rename d3/d1a/d21/d52/cf4 to d3/d1a/d21/d52/d7f/deb/cfb 0 2024-09-04T16:30:19.452 INFO:tasks.workunit.client.1.smithi193.stdout:7/961: mkdir d9/d39/d3e/d53/d13d 0 2024-09-04T16:30:19.455 INFO:tasks.workunit.client.1.smithi193.stdout:6/807: dwrite d5/f11 [0,4194304] 0 2024-09-04T16:30:19.457 INFO:tasks.workunit.client.1.smithi193.stdout:6/808: truncate d5/d33/d4e/d51/d68/fe1 517024 0 2024-09-04T16:30:19.458 INFO:tasks.workunit.client.1.smithi193.stdout:9/908: rename d2/d18/d66 to d2/deb/d11d 0 2024-09-04T16:30:19.459 INFO:tasks.workunit.client.0.smithi170.stdout:8/371: mkdir d6/d28/d1a/d81 0 2024-09-04T16:30:19.460 INFO:tasks.workunit.client.1.smithi193.stdout:4/771: creat d3/d81/ffc x:0 0 0 2024-09-04T16:30:19.461 INFO:tasks.workunit.client.0.smithi170.stdout:9/331: write d2/d11/f36 [841245,60558] 0 2024-09-04T16:30:19.462 INFO:tasks.workunit.client.1.smithi193.stdout:2/812: write d2/d9/db/d10/d1e/da4/d9a/f44 [1680147,108407] 0 2024-09-04T16:30:19.462 INFO:tasks.workunit.client.0.smithi170.stdout:5/265: mknod d4/c4e 0 2024-09-04T16:30:19.463 INFO:tasks.workunit.client.0.smithi170.stdout:0/447: dwrite d11/f68 [0,4194304] 0 2024-09-04T16:30:19.463 INFO:tasks.workunit.client.1.smithi193.stdout:5/848: sync 2024-09-04T16:30:19.464 INFO:tasks.workunit.client.1.smithi193.stdout:5/849: dread - d1/d8/db/fd5 zero size 2024-09-04T16:30:19.468 INFO:tasks.workunit.client.0.smithi170.stdout:5/266: fdatasync d4/d8/d1c/d41/f46 0 2024-09-04T16:30:19.470 INFO:tasks.workunit.client.0.smithi170.stdout:7/507: rmdir d12/d15/d71/d42/d79/d9d/daa 0 2024-09-04T16:30:19.471 INFO:tasks.workunit.client.1.smithi193.stdout:2/813: dwrite d2/fe3 [0,4194304] 0 2024-09-04T16:30:19.471 INFO:tasks.workunit.client.0.smithi170.stdout:7/508: chown f7 66 1 2024-09-04T16:30:19.472 INFO:tasks.workunit.client.0.smithi170.stdout:3/237: symlink d13/d14/l4a 0 2024-09-04T16:30:19.473 INFO:tasks.workunit.client.1.smithi193.stdout:7/962: rmdir d9/d39/d3e/d4d/d98 39 2024-09-04T16:30:19.476 INFO:tasks.workunit.client.1.smithi193.stdout:8/874: creat d2/d20/d23/d34/d46/f117 x:0 0 0 2024-09-04T16:30:19.477 INFO:tasks.workunit.client.0.smithi170.stdout:8/372: dwrite d6/d28/d20/d5e/f68 [0,4194304] 0 2024-09-04T16:30:19.477 INFO:tasks.workunit.client.0.smithi170.stdout:3/238: truncate d13/d14/f32 8458276 0 2024-09-04T16:30:19.479 INFO:tasks.workunit.client.1.smithi193.stdout:0/849: dread d18/d25/f3c [0,4194304] 0 2024-09-04T16:30:19.479 INFO:tasks.workunit.client.0.smithi170.stdout:6/290: dwrite d0/f9 [0,4194304] 0 2024-09-04T16:30:19.480 INFO:tasks.workunit.client.0.smithi170.stdout:8/373: dread - d6/d28/d16/f7e zero size 2024-09-04T16:30:19.481 INFO:tasks.workunit.client.0.smithi170.stdout:3/239: truncate d13/d14/d21/f2e 770030 0 2024-09-04T16:30:19.486 INFO:tasks.workunit.client.0.smithi170.stdout:4/371: dread d1/fc [0,4194304] 0 2024-09-04T16:30:19.486 INFO:tasks.workunit.client.0.smithi170.stdout:6/291: truncate d0/d17/d31/f5a 663664 0 2024-09-04T16:30:19.490 INFO:tasks.workunit.client.0.smithi170.stdout:9/332: dread d2/fd [0,4194304] 0 2024-09-04T16:30:19.491 INFO:tasks.workunit.client.1.smithi193.stdout:2/814: creat d2/d9/d61/f10e x:0 0 0 2024-09-04T16:30:19.493 INFO:tasks.workunit.client.0.smithi170.stdout:8/374: dwrite d6/d28/f1d [0,4194304] 0 2024-09-04T16:30:19.496 INFO:tasks.workunit.client.0.smithi170.stdout:9/333: chown d2/d3d/d35/f44 150 1 2024-09-04T16:30:19.499 INFO:tasks.workunit.client.0.smithi170.stdout:9/334: dread - d2/d3d/d27/f3a zero size 2024-09-04T16:30:19.502 INFO:tasks.workunit.client.0.smithi170.stdout:3/240: dwrite d13/d14/d21/f3a [0,4194304] 0 2024-09-04T16:30:19.503 INFO:tasks.workunit.client.1.smithi193.stdout:4/772: rename d3/f2f to d3/d3c/d47/ffd 0 2024-09-04T16:30:19.505 INFO:tasks.workunit.client.0.smithi170.stdout:4/372: symlink d1/d6/d2b/d33/d36/d79/l86 0 2024-09-04T16:30:19.505 INFO:tasks.workunit.client.0.smithi170.stdout:3/241: readlink d13/d14/l4a 0 2024-09-04T16:30:19.506 INFO:tasks.workunit.client.0.smithi170.stdout:6/292: dread d0/df/f3a [0,4194304] 0 2024-09-04T16:30:19.507 INFO:tasks.workunit.client.0.smithi170.stdout:4/373: readlink d1/d6/d22/l67 0 2024-09-04T16:30:19.508 INFO:tasks.workunit.client.0.smithi170.stdout:2/337: dwrite d3/d7/f3e [0,4194304] 0 2024-09-04T16:30:19.510 INFO:tasks.workunit.client.0.smithi170.stdout:6/293: readlink d0/df/d1b/d3e/d44/d2d/d2e/l3c 0 2024-09-04T16:30:19.511 INFO:tasks.workunit.client.1.smithi193.stdout:4/773: dwrite d3/f29 [0,4194304] 0 2024-09-04T16:30:19.511 INFO:tasks.workunit.client.1.smithi193.stdout:6/809: getdents d5/de/d15/d1b/d5f/da7 0 2024-09-04T16:30:19.513 INFO:tasks.workunit.client.0.smithi170.stdout:6/294: stat d0/df/d1b/d3e/d44/c4e 0 2024-09-04T16:30:19.515 INFO:tasks.workunit.client.0.smithi170.stdout:9/335: creat d2/d32/f61 x:0 0 0 2024-09-04T16:30:19.516 INFO:tasks.workunit.client.1.smithi193.stdout:7/963: rename d9/d39/fa1 to d9/de/d27/d62/d72/f13e 0 2024-09-04T16:30:19.517 INFO:tasks.workunit.client.1.smithi193.stdout:8/875: write d2/d20/d23/d34/d46/d53/d90/fad [586408,88384] 0 2024-09-04T16:30:19.517 INFO:tasks.workunit.client.0.smithi170.stdout:0/448: truncate d11/d13/d71/d43/f60 3417634 0 2024-09-04T16:30:19.518 INFO:tasks.workunit.client.0.smithi170.stdout:7/509: dwrite d12/d15/d71/f38 [0,4194304] 0 2024-09-04T16:30:19.521 INFO:tasks.workunit.client.1.smithi193.stdout:5/850: getdents d1/d8/db/d36/d40 0 2024-09-04T16:30:19.525 INFO:tasks.workunit.client.0.smithi170.stdout:8/375: rename l4 to d6/d28/d16/d77/l82 0 2024-09-04T16:30:19.526 INFO:tasks.workunit.client.1.smithi193.stdout:6/810: readlink d5/de/lae 0 2024-09-04T16:30:19.527 INFO:tasks.workunit.client.0.smithi170.stdout:0/449: dread d11/d75/d77/f81 [0,4194304] 0 2024-09-04T16:30:19.528 INFO:tasks.workunit.client.1.smithi193.stdout:4/774: rmdir d3 39 2024-09-04T16:30:19.529 INFO:tasks.workunit.client.0.smithi170.stdout:4/374: fdatasync d1/d6/d2b/f7e 0 2024-09-04T16:30:19.530 INFO:tasks.workunit.client.1.smithi193.stdout:7/964: rmdir d9/d39/d3e/d53 39 2024-09-04T16:30:19.531 INFO:tasks.workunit.client.0.smithi170.stdout:6/295: symlink d0/l60 0 2024-09-04T16:30:19.535 INFO:tasks.workunit.client.1.smithi193.stdout:6/811: symlink d5/de/d15/d1b/l105 0 2024-09-04T16:30:19.535 INFO:tasks.workunit.client.1.smithi193.stdout:2/815: dread d2/fc [12582912,4194304] 0 2024-09-04T16:30:19.536 INFO:tasks.workunit.client.1.smithi193.stdout:4/775: chown d3/d1a/c20 105169795 1 2024-09-04T16:30:19.537 INFO:tasks.workunit.client.0.smithi170.stdout:0/450: stat d11/c41 0 2024-09-04T16:30:19.537 INFO:tasks.workunit.client.1.smithi193.stdout:2/816: chown d2/d9/db/d10/d51 2350 1 2024-09-04T16:30:19.537 INFO:tasks.workunit.client.1.smithi193.stdout:4/776: fdatasync d3/d1a/d54/f64 0 2024-09-04T16:30:19.538 INFO:tasks.workunit.client.1.smithi193.stdout:0/850: dread d18/f38 [0,4194304] 0 2024-09-04T16:30:19.538 INFO:tasks.workunit.client.0.smithi170.stdout:0/451: read d11/f1c [2273488,57302] 0 2024-09-04T16:30:19.539 INFO:tasks.workunit.client.1.smithi193.stdout:7/965: dread - d9/d39/d3e/d4a/faf zero size 2024-09-04T16:30:19.540 INFO:tasks.workunit.client.1.smithi193.stdout:7/966: readlink d9/de/l75 0 2024-09-04T16:30:19.541 INFO:tasks.workunit.client.1.smithi193.stdout:6/812: unlink d5/d33/d4e/d51/f7e 0 2024-09-04T16:30:19.543 INFO:tasks.workunit.client.0.smithi170.stdout:2/338: write f0 [1039009,31193] 0 2024-09-04T16:30:19.543 INFO:tasks.workunit.client.0.smithi170.stdout:2/339: fdatasync d3/d7/f26 0 2024-09-04T16:30:19.544 INFO:tasks.workunit.client.1.smithi193.stdout:5/851: rename d1/d8/db/d36/d40/fe8 to d1/d8/db/d15/d2b/d83/f114 0 2024-09-04T16:30:19.545 INFO:tasks.workunit.client.1.smithi193.stdout:5/852: readlink d1/d8/db/d15/d2b/lb5 0 2024-09-04T16:30:19.546 INFO:tasks.workunit.client.1.smithi193.stdout:8/876: getdents d2/d20/d23/d24/d3c/d65/dc8/de1 0 2024-09-04T16:30:19.547 INFO:tasks.workunit.client.0.smithi170.stdout:9/336: write d2/d3d/d27/f3a [504848,71957] 0 2024-09-04T16:30:19.548 INFO:tasks.workunit.client.0.smithi170.stdout:8/376: mkdir d6/d28/d16/d24/d83 0 2024-09-04T16:30:19.551 INFO:tasks.workunit.client.1.smithi193.stdout:2/817: symlink d2/d9/db/d10/d51/d87/d9b/l10f 0 2024-09-04T16:30:19.552 INFO:tasks.workunit.client.1.smithi193.stdout:1/936: sync 2024-09-04T16:30:19.552 INFO:tasks.workunit.client.1.smithi193.stdout:2/818: fsync d2/d9/db/d10/d4e/fbd 0 2024-09-04T16:30:19.552 INFO:tasks.workunit.client.1.smithi193.stdout:4/777: creat d3/d1a/d54/ffe x:0 0 0 2024-09-04T16:30:19.553 INFO:tasks.workunit.client.1.smithi193.stdout:2/819: fsync d2/d9/db/d10/d51/dca/ffa 0 2024-09-04T16:30:19.553 INFO:tasks.workunit.client.1.smithi193.stdout:4/778: fdatasync d3/d3c/fe0 0 2024-09-04T16:30:19.554 INFO:tasks.workunit.client.0.smithi170.stdout:3/242: link d13/d14/d1d/f23 d13/d14/f4b 0 2024-09-04T16:30:19.557 INFO:tasks.workunit.client.1.smithi193.stdout:6/813: creat d5/d33/d4e/d51/d68/f106 x:0 0 0 2024-09-04T16:30:19.560 INFO:tasks.workunit.client.1.smithi193.stdout:8/877: dread d2/d20/d23/d34/d4b/db8/fc1 [0,4194304] 0 2024-09-04T16:30:19.560 INFO:tasks.workunit.client.1.smithi193.stdout:2/820: dwrite d2/d9/fdd [0,4194304] 0 2024-09-04T16:30:19.562 INFO:tasks.workunit.client.0.smithi170.stdout:2/340: unlink d3/d3c/c1b 0 2024-09-04T16:30:19.562 INFO:tasks.workunit.client.1.smithi193.stdout:2/821: chown d2/d9/f90 16634465 1 2024-09-04T16:30:19.563 INFO:tasks.workunit.client.1.smithi193.stdout:5/853: symlink d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/l115 0 2024-09-04T16:30:19.563 INFO:tasks.workunit.client.1.smithi193.stdout:5/854: dread - d1/d8/db/fd5 zero size 2024-09-04T16:30:19.568 INFO:tasks.workunit.client.0.smithi170.stdout:0/452: write d11/f6a [642588,52875] 0 2024-09-04T16:30:19.570 INFO:tasks.workunit.client.0.smithi170.stdout:7/510: rename d12/d15/d71/d42/d81/f44 to d12/d16/fb2 0 2024-09-04T16:30:19.572 INFO:tasks.workunit.client.1.smithi193.stdout:6/814: symlink d5/d33/l107 0 2024-09-04T16:30:19.577 INFO:tasks.workunit.client.1.smithi193.stdout:4/779: symlink d3/d1a/d2a/ddf/lff 0 2024-09-04T16:30:19.577 INFO:tasks.workunit.client.1.smithi193.stdout:2/822: creat d2/d9/db/d10/d38/dac/d103/f110 x:0 0 0 2024-09-04T16:30:19.578 INFO:tasks.workunit.client.1.smithi193.stdout:6/815: dread - d5/de/d15/d1b/d5f/da7/db2/fc3 zero size 2024-09-04T16:30:19.579 INFO:tasks.workunit.client.1.smithi193.stdout:2/823: chown d2/d9/db/d10/d1e/d56/l7c 2924626 1 2024-09-04T16:30:19.579 INFO:tasks.workunit.client.1.smithi193.stdout:0/851: getdents d18/d25/d5f/d6a 0 2024-09-04T16:30:19.580 INFO:tasks.workunit.client.1.smithi193.stdout:7/967: getdents d9/d18/d22/d2b/d6c/d70/d79 0 2024-09-04T16:30:19.580 INFO:tasks.workunit.client.1.smithi193.stdout:6/816: truncate d5/de/d15/d48/fdd 616354 0 2024-09-04T16:30:19.582 INFO:tasks.workunit.client.1.smithi193.stdout:0/852: creat d18/d109/f117 x:0 0 0 2024-09-04T16:30:19.583 INFO:tasks.workunit.client.1.smithi193.stdout:6/817: symlink d5/d33/d4e/d51/d68/l108 0 2024-09-04T16:30:19.584 INFO:tasks.workunit.client.1.smithi193.stdout:0/853: getdents d18/d25/d3b 0 2024-09-04T16:30:19.585 INFO:tasks.workunit.client.1.smithi193.stdout:6/818: write d5/d33/d4e/d51/d71/dcf/ff0 [947211,18945] 0 2024-09-04T16:30:19.589 INFO:tasks.workunit.client.1.smithi193.stdout:7/968: dwrite d9/d18/d22/d2b/d136/f137 [0,4194304] 0 2024-09-04T16:30:19.592 INFO:tasks.workunit.client.1.smithi193.stdout:2/824: dread d2/d9/db/d10/d1e/f5a [0,4194304] 0 2024-09-04T16:30:19.593 INFO:tasks.workunit.client.1.smithi193.stdout:6/819: getdents d5/d27/d3e/d6e 0 2024-09-04T16:30:19.596 INFO:tasks.workunit.client.1.smithi193.stdout:2/825: rename d2/d9/db/d10/d51/d87/d9b to d2/d9/db/d10/d1f/d77/d111 0 2024-09-04T16:30:19.597 INFO:tasks.workunit.client.1.smithi193.stdout:2/826: chown d2/d9/db/d10/d38/dac/d103 249 1 2024-09-04T16:30:19.610 INFO:tasks.workunit.client.1.smithi193.stdout:6/820: dread d5/de/d15/d1b/f6f [0,4194304] 0 2024-09-04T16:30:19.611 INFO:tasks.workunit.client.1.smithi193.stdout:6/821: truncate d5/d27/d3e/d43/d5d/f104 688462 0 2024-09-04T16:30:19.613 INFO:tasks.workunit.client.1.smithi193.stdout:6/822: mknod d5/d33/d85/da9/c109 0 2024-09-04T16:30:19.614 INFO:tasks.workunit.client.1.smithi193.stdout:6/823: dread d5/d27/d3e/d43/d5d/f104 [0,4194304] 0 2024-09-04T16:30:19.616 INFO:tasks.workunit.client.1.smithi193.stdout:6/824: rmdir d5/de/d15/d1b/d5f/da7 39 2024-09-04T16:30:19.619 INFO:tasks.workunit.client.1.smithi193.stdout:6/825: link d5/d27/d3e/d8c/cc9 d5/d27/d3e/d43/d5d/c10a 0 2024-09-04T16:30:19.621 INFO:tasks.workunit.client.1.smithi193.stdout:3/850: sync 2024-09-04T16:30:19.621 INFO:tasks.workunit.client.1.smithi193.stdout:9/909: sync 2024-09-04T16:30:19.623 INFO:tasks.workunit.client.1.smithi193.stdout:9/910: mknod d2/d8/d104/c11e 0 2024-09-04T16:30:19.626 INFO:tasks.workunit.client.1.smithi193.stdout:9/911: creat d2/d18/d2f/d22/d30/f11f x:0 0 0 2024-09-04T16:30:19.627 INFO:tasks.workunit.client.1.smithi193.stdout:9/912: dread - d2/d56/d86/fea zero size 2024-09-04T16:30:19.629 INFO:tasks.workunit.client.1.smithi193.stdout:9/913: creat d2/d18/d2f/d22/d30/d6a/d6e/de2/d107/f120 x:0 0 0 2024-09-04T16:30:19.631 INFO:tasks.workunit.client.1.smithi193.stdout:9/914: creat d2/d18/d2f/d22/d30/d6a/d6e/de2/d107/f121 x:0 0 0 2024-09-04T16:30:19.632 INFO:tasks.workunit.client.1.smithi193.stdout:9/915: rmdir d2/d8/d4d 39 2024-09-04T16:30:19.633 INFO:tasks.workunit.client.1.smithi193.stdout:9/916: fdatasync d2/d8/d15/f35 0 2024-09-04T16:30:19.635 INFO:tasks.workunit.client.1.smithi193.stdout:9/917: write d2/d8/d4d/ff3 [1696903,99500] 0 2024-09-04T16:30:19.635 INFO:tasks.workunit.client.1.smithi193.stdout:9/918: chown d2/d8/d88/c11a 0 1 2024-09-04T16:30:19.639 INFO:tasks.workunit.client.1.smithi193.stdout:9/919: rename d2/f28 to d2/d56/d86/dc2/dde/dda/f122 0 2024-09-04T16:30:19.639 INFO:tasks.workunit.client.1.smithi193.stdout:9/920: chown d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/df4 2611037 1 2024-09-04T16:30:19.641 INFO:tasks.workunit.client.1.smithi193.stdout:9/921: mknod d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/df1/c123 0 2024-09-04T16:30:19.641 INFO:tasks.workunit.client.1.smithi193.stdout:9/922: dread - d2/d8/d104/f112 zero size 2024-09-04T16:30:19.643 INFO:tasks.workunit.client.1.smithi193.stdout:9/923: symlink d2/d56/d86/dc2/l124 0 2024-09-04T16:30:19.643 INFO:tasks.workunit.client.1.smithi193.stdout:9/924: readlink d2/d18/d2f/d22/d30/l89 0 2024-09-04T16:30:19.645 INFO:tasks.workunit.client.1.smithi193.stdout:9/925: symlink d2/l125 0 2024-09-04T16:30:19.645 INFO:tasks.workunit.client.1.smithi193.stdout:9/926: chown d2/deb/d11d/l7d 78368298 1 2024-09-04T16:30:19.699 INFO:tasks.workunit.client.1.smithi193.stdout:7/969: sync 2024-09-04T16:30:19.699 INFO:tasks.workunit.client.1.smithi193.stdout:2/827: sync 2024-09-04T16:30:19.699 INFO:tasks.workunit.client.1.smithi193.stdout:8/878: sync 2024-09-04T16:30:19.699 INFO:tasks.workunit.client.1.smithi193.stdout:4/780: sync 2024-09-04T16:30:19.699 INFO:tasks.workunit.client.1.smithi193.stdout:4/781: fsync d3/d39/d44/f9e 0 2024-09-04T16:30:19.700 INFO:tasks.workunit.client.1.smithi193.stdout:4/782: stat d3/d1a/d2a/c5c 0 2024-09-04T16:30:19.702 INFO:tasks.workunit.client.1.smithi193.stdout:7/970: rename d9/de/d27/cc1 to d9/de/d27/c13f 0 2024-09-04T16:30:19.703 INFO:tasks.workunit.client.1.smithi193.stdout:8/879: rename d2/d20/d23/d34/f9a to d2/d20/d23/d24/d3c/d65/dc8/de1/dd8/f118 0 2024-09-04T16:30:19.707 INFO:tasks.workunit.client.1.smithi193.stdout:8/880: truncate d2/d20/d23/d24/df7/f10f 218297 0 2024-09-04T16:30:19.707 INFO:tasks.workunit.client.1.smithi193.stdout:4/783: dwrite d3/d81/ffc [0,4194304] 0 2024-09-04T16:30:19.707 INFO:tasks.workunit.client.1.smithi193.stdout:8/881: chown d2/d20/d23/d24/d3c/d65/dc8/de1/f10c 5804 1 2024-09-04T16:30:19.709 INFO:tasks.workunit.client.1.smithi193.stdout:7/971: symlink d9/de/l140 0 2024-09-04T16:30:19.711 INFO:tasks.workunit.client.0.smithi170.stdout:3/243: mkdir d13/d14/d21/d4c 0 2024-09-04T16:30:19.711 INFO:tasks.workunit.client.0.smithi170.stdout:2/341: creat d3/d7/f66 x:0 0 0 2024-09-04T16:30:19.713 INFO:tasks.workunit.client.0.smithi170.stdout:6/296: unlink d0/df/d1f/f58 0 2024-09-04T16:30:19.713 INFO:tasks.workunit.client.0.smithi170.stdout:2/342: stat d3/db 0 2024-09-04T16:30:19.714 INFO:tasks.workunit.client.0.smithi170.stdout:3/244: read d13/f19 [8350023,42947] 0 2024-09-04T16:30:19.714 INFO:tasks.workunit.client.0.smithi170.stdout:8/377: creat d6/d28/d1a/d81/f84 x:0 0 0 2024-09-04T16:30:19.715 INFO:tasks.workunit.client.0.smithi170.stdout:0/453: symlink d11/d8e/laf 0 2024-09-04T16:30:19.715 INFO:tasks.workunit.client.1.smithi193.stdout:8/882: read d2/fca [2083889,106759] 0 2024-09-04T16:30:19.717 INFO:tasks.workunit.client.0.smithi170.stdout:4/375: rename d1/d6/d8/d20/l65 to d1/d6/d8/d20/d35/d3e/d60/l87 0 2024-09-04T16:30:19.717 INFO:tasks.workunit.client.0.smithi170.stdout:0/454: chown d11/f6a 6578 1 2024-09-04T16:30:19.719 INFO:tasks.workunit.client.0.smithi170.stdout:9/337: link d2/d32/c5c d2/d32/c62 0 2024-09-04T16:30:19.720 INFO:tasks.workunit.client.0.smithi170.stdout:3/245: rmdir d13 39 2024-09-04T16:30:19.724 INFO:tasks.workunit.client.0.smithi170.stdout:6/297: rmdir d0/df/d1b/d3e/d44/d2d 39 2024-09-04T16:30:19.726 INFO:tasks.workunit.client.0.smithi170.stdout:6/298: stat d0/df/f28 0 2024-09-04T16:30:19.726 INFO:tasks.workunit.client.0.smithi170.stdout:8/378: dread d6/d28/d16/d24/d46/f74 [0,4194304] 0 2024-09-04T16:30:19.726 INFO:tasks.workunit.client.0.smithi170.stdout:2/343: dwrite d3/d7/f1d [4194304,4194304] 0 2024-09-04T16:30:19.730 INFO:tasks.workunit.client.0.smithi170.stdout:4/376: creat d1/d6/d8/d20/f88 x:0 0 0 2024-09-04T16:30:19.731 INFO:tasks.workunit.client.1.smithi193.stdout:1/937: write d1/d2b/f2e [1945474,54662] 0 2024-09-04T16:30:19.732 INFO:tasks.workunit.client.0.smithi170.stdout:0/455: creat d11/d13/d4a/d66/fb0 x:0 0 0 2024-09-04T16:30:19.734 INFO:tasks.workunit.client.1.smithi193.stdout:7/972: dread d9/d18/d22/d2b/d6c/d70/fcb [0,4194304] 0 2024-09-04T16:30:19.736 INFO:tasks.workunit.client.1.smithi193.stdout:5/855: truncate d1/d8/f2d 3443761 0 2024-09-04T16:30:19.737 INFO:tasks.workunit.client.1.smithi193.stdout:7/973: truncate d9/de/d11b/f11d 277853 0 2024-09-04T16:30:19.738 INFO:tasks.workunit.client.1.smithi193.stdout:1/938: dwrite d1/d2b/db/f82 [0,4194304] 0 2024-09-04T16:30:19.741 INFO:tasks.workunit.client.0.smithi170.stdout:2/344: mkdir d3/db/d1c/d47/d67 0 2024-09-04T16:30:19.742 INFO:tasks.workunit.client.1.smithi193.stdout:0/854: write d18/d79/d88/fab [1081211,31500] 0 2024-09-04T16:30:19.744 INFO:tasks.workunit.client.0.smithi170.stdout:4/377: symlink d1/d6/d2b/d47/l89 0 2024-09-04T16:30:19.745 INFO:tasks.workunit.client.1.smithi193.stdout:7/974: write d9/d39/d3e/f3f [1263906,13246] 0 2024-09-04T16:30:19.745 INFO:tasks.workunit.client.1.smithi193.stdout:7/975: stat d9/d11/dbd 0 2024-09-04T16:30:19.745 INFO:tasks.workunit.client.1.smithi193.stdout:1/939: symlink d1/d2b/d1b/d28/d50/d84/dd1/de2/l120 0 2024-09-04T16:30:19.746 INFO:tasks.workunit.client.0.smithi170.stdout:3/246: mkdir d13/d14/d21/d4d 0 2024-09-04T16:30:19.747 INFO:tasks.workunit.client.1.smithi193.stdout:5/856: symlink d1/d29/l116 0 2024-09-04T16:30:19.749 INFO:tasks.workunit.client.1.smithi193.stdout:6/826: write d5/d33/d4e/f59 [211476,69059] 0 2024-09-04T16:30:19.750 INFO:tasks.workunit.client.1.smithi193.stdout:3/851: write d0/d18/d1c/fb9 [504377,108925] 0 2024-09-04T16:30:19.752 INFO:tasks.workunit.client.0.smithi170.stdout:8/379: chown d6/d26/l6b 61 1 2024-09-04T16:30:19.753 INFO:tasks.workunit.client.0.smithi170.stdout:8/380: chown d6/d28/d16/c2e 52658 1 2024-09-04T16:30:19.757 INFO:tasks.workunit.client.1.smithi193.stdout:5/857: mknod d1/d8/db/d36/d40/c117 0 2024-09-04T16:30:19.759 INFO:tasks.workunit.client.1.smithi193.stdout:6/827: mkdir d5/d33/d4e/d51/d71/dcf/d10b 0 2024-09-04T16:30:19.760 INFO:tasks.workunit.client.0.smithi170.stdout:0/456: getdents d11/d13/d2f/d3f 0 2024-09-04T16:30:19.760 INFO:tasks.workunit.client.1.smithi193.stdout:7/976: dread d9/d39/d3e/d4d/d4f/dab/fc3 [0,4194304] 0 2024-09-04T16:30:19.760 INFO:tasks.workunit.client.0.smithi170.stdout:0/457: chown d11/d13/f20 85406 1 2024-09-04T16:30:19.761 INFO:tasks.workunit.client.1.smithi193.stdout:3/852: creat d0/d10/d24/f115 x:0 0 0 2024-09-04T16:30:19.761 INFO:tasks.workunit.client.0.smithi170.stdout:8/381: mkdir d6/d28/d5f/d85 0 2024-09-04T16:30:19.764 INFO:tasks.workunit.client.1.smithi193.stdout:9/927: dwrite d2/d18/d2f/f45 [0,4194304] 0 2024-09-04T16:30:19.765 INFO:tasks.workunit.client.1.smithi193.stdout:1/940: chown d1/d2b/d10/d56/da7/cd3 3852 1 2024-09-04T16:30:19.765 INFO:tasks.workunit.client.0.smithi170.stdout:3/247: mkdir d13/d14/d21/d4d/d4e 0 2024-09-04T16:30:19.765 INFO:tasks.workunit.client.0.smithi170.stdout:3/248: chown d13/d14/d21/d4c 6346634 1 2024-09-04T16:30:19.768 INFO:tasks.workunit.client.0.smithi170.stdout:7/511: write f7 [3397398,38288] 0 2024-09-04T16:30:19.768 INFO:tasks.workunit.client.1.smithi193.stdout:5/858: creat d1/d8/db/d15/d2b/d83/d37/d58/dc4/dda/f118 x:0 0 0 2024-09-04T16:30:19.771 INFO:tasks.workunit.client.1.smithi193.stdout:8/883: write d2/d20/d23/d34/dd6/da0/da8/db9/f78 [2976199,51584] 0 2024-09-04T16:30:19.771 INFO:tasks.workunit.client.0.smithi170.stdout:8/382: creat d6/d28/d5f/f86 x:0 0 0 2024-09-04T16:30:19.772 INFO:tasks.workunit.client.0.smithi170.stdout:2/345: dread d3/db/f2b [0,4194304] 0 2024-09-04T16:30:19.773 INFO:tasks.workunit.client.0.smithi170.stdout:8/383: chown d6/d28/d16/d52/d73/c69 39 1 2024-09-04T16:30:19.774 INFO:tasks.workunit.client.0.smithi170.stdout:2/346: chown d3/db/df/l28 11 1 2024-09-04T16:30:19.776 INFO:tasks.workunit.client.0.smithi170.stdout:4/378: creat d1/d6/d8/f8a x:0 0 0 2024-09-04T16:30:19.777 INFO:tasks.workunit.client.1.smithi193.stdout:0/855: creat d18/d25/d5f/f118 x:0 0 0 2024-09-04T16:30:19.778 INFO:tasks.workunit.client.0.smithi170.stdout:2/347: dread d3/db/f2b [0,4194304] 0 2024-09-04T16:30:19.780 INFO:tasks.workunit.client.0.smithi170.stdout:0/458: mknod d11/d75/d77/cb1 0 2024-09-04T16:30:19.782 INFO:tasks.workunit.client.0.smithi170.stdout:7/512: fdatasync d12/d15/d41/f64 0 2024-09-04T16:30:19.784 INFO:tasks.workunit.client.1.smithi193.stdout:1/941: dread - d1/d39/d48/ff0 zero size 2024-09-04T16:30:19.785 INFO:tasks.workunit.client.0.smithi170.stdout:6/299: write d0/df/d1b/d3e/d44/f41 [839134,80131] 0 2024-09-04T16:30:19.786 INFO:tasks.workunit.client.1.smithi193.stdout:1/942: fsync d1/d2b/d10/d56/d11d/ff9 0 2024-09-04T16:30:19.786 INFO:tasks.workunit.client.1.smithi193.stdout:9/928: creat d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/f126 x:0 0 0 2024-09-04T16:30:19.788 INFO:tasks.workunit.client.0.smithi170.stdout:4/379: mkdir d1/d6/d8/d20/d35/d3e/d4e/d51/d8b 0 2024-09-04T16:30:19.789 INFO:tasks.workunit.client.0.smithi170.stdout:4/380: readlink d1/d6/d8/d20/l5b 0 2024-09-04T16:30:19.789 INFO:tasks.workunit.client.1.smithi193.stdout:2/828: sync 2024-09-04T16:30:19.789 INFO:tasks.workunit.client.1.smithi193.stdout:3/853: dread d0/d18/d1b/d3d/fa8 [0,4194304] 0 2024-09-04T16:30:19.790 INFO:tasks.workunit.client.1.smithi193.stdout:5/859: fsync d1/d8/db/fb8 0 2024-09-04T16:30:19.790 INFO:tasks.workunit.client.0.smithi170.stdout:3/249: symlink d13/d14/d21/d4c/l4f 0 2024-09-04T16:30:19.791 INFO:tasks.workunit.client.1.smithi193.stdout:5/860: readlink d1/d8/db/d36/l64 0 2024-09-04T16:30:19.791 INFO:tasks.workunit.client.0.smithi170.stdout:3/250: dread - d13/d14/d21/f36 zero size 2024-09-04T16:30:19.791 INFO:tasks.workunit.client.1.smithi193.stdout:6/828: truncate d5/d27/d3e/f69 4467699 0 2024-09-04T16:30:19.792 INFO:tasks.workunit.client.1.smithi193.stdout:6/829: chown d5/de/d15/d9f 948 1 2024-09-04T16:30:19.792 INFO:tasks.workunit.client.0.smithi170.stdout:2/348: mkdir d3/d3c/d40/d48/d68 0 2024-09-04T16:30:19.792 INFO:tasks.workunit.client.0.smithi170.stdout:9/338: truncate d2/d11/f12 4376296 0 2024-09-04T16:30:19.794 INFO:tasks.workunit.client.0.smithi170.stdout:9/339: truncate d2/d11/d23/d2a/d56/f5a 437002 0 2024-09-04T16:30:19.794 INFO:tasks.workunit.client.0.smithi170.stdout:0/459: rmdir d11/d13/d71/d43 39 2024-09-04T16:30:19.795 INFO:tasks.workunit.client.0.smithi170.stdout:0/460: readlink d11/d13/d2f/d3f/la6 0 2024-09-04T16:30:19.796 INFO:tasks.workunit.client.1.smithi193.stdout:0/856: dread d18/fa2 [0,4194304] 0 2024-09-04T16:30:19.796 INFO:tasks.workunit.client.0.smithi170.stdout:0/461: write d11/d13/d35/fa3 [544730,42718] 0 2024-09-04T16:30:19.797 INFO:tasks.workunit.client.0.smithi170.stdout:0/462: write d11/d13/d4a/d66/f83 [368987,101703] 0 2024-09-04T16:30:19.798 INFO:tasks.workunit.client.1.smithi193.stdout:1/943: unlink d1/d39/f67 0 2024-09-04T16:30:19.800 INFO:tasks.workunit.client.1.smithi193.stdout:1/944: chown d1/d2b/d1b/d51/d6d 30518 1 2024-09-04T16:30:19.801 INFO:tasks.workunit.client.1.smithi193.stdout:7/977: dwrite d9/d39/d3e/d4d/d98/d9a/db6/ffa [0,4194304] 0 2024-09-04T16:30:19.802 INFO:tasks.workunit.client.0.smithi170.stdout:6/300: chown d0/d17/c4f 4 1 2024-09-04T16:30:19.803 INFO:tasks.workunit.client.1.smithi193.stdout:3/854: mkdir d0/d9/d49/d7d/d116 0 2024-09-04T16:30:19.804 INFO:tasks.workunit.client.0.smithi170.stdout:4/381: fdatasync d1/d6/f4f 0 2024-09-04T16:30:19.804 INFO:tasks.workunit.client.1.smithi193.stdout:3/855: write d0/d18/d1c/d30/d8e/fe8 [84094,37920] 0 2024-09-04T16:30:19.807 INFO:tasks.workunit.client.0.smithi170.stdout:2/349: symlink d3/d3c/d40/d48/l69 0 2024-09-04T16:30:19.808 INFO:tasks.workunit.client.1.smithi193.stdout:2/829: read d2/d9/db/d10/d1f/d22/f93 [2438954,31252] 0 2024-09-04T16:30:19.808 INFO:tasks.workunit.client.1.smithi193.stdout:5/861: mkdir d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/dd8/d119 0 2024-09-04T16:30:19.809 INFO:tasks.workunit.client.0.smithi170.stdout:8/384: write d6/d28/d16/f43 [3892534,77029] 0 2024-09-04T16:30:19.810 INFO:tasks.workunit.client.0.smithi170.stdout:8/385: chown d6/c6a 275 1 2024-09-04T16:30:19.811 INFO:tasks.workunit.client.0.smithi170.stdout:8/386: write d6/d28/d20/d5e/f47 [105143,50824] 0 2024-09-04T16:30:19.812 INFO:tasks.workunit.client.0.smithi170.stdout:8/387: write d6/d28/d16/f7e [562846,114712] 0 2024-09-04T16:30:19.813 INFO:tasks.workunit.client.1.smithi193.stdout:2/830: read d2/d9/db/d10/d1e/da4/d9a/f44 [2451347,51697] 0 2024-09-04T16:30:19.816 INFO:tasks.workunit.client.0.smithi170.stdout:7/513: mkdir d12/db3 0 2024-09-04T16:30:19.818 INFO:tasks.workunit.client.1.smithi193.stdout:8/884: write d2/d20/d23/d34/d46/d53/d90/ff4 [731517,106324] 0 2024-09-04T16:30:19.820 INFO:tasks.workunit.client.1.smithi193.stdout:1/945: creat d1/d2b/db/d54/da1/f121 x:0 0 0 2024-09-04T16:30:19.821 INFO:tasks.workunit.client.1.smithi193.stdout:1/946: readlink d1/d2b/db/l15 0 2024-09-04T16:30:19.821 INFO:tasks.workunit.client.0.smithi170.stdout:3/251: mkdir d13/d14/d21/d4d/d4e/d50 0 2024-09-04T16:30:19.822 INFO:tasks.workunit.client.1.smithi193.stdout:1/947: write d1/d2b/db/f3b [1979826,84436] 0 2024-09-04T16:30:19.822 INFO:tasks.workunit.client.1.smithi193.stdout:9/929: write d2/d8/d15/f16 [3942952,129211] 0 2024-09-04T16:30:19.823 INFO:tasks.workunit.client.0.smithi170.stdout:9/340: getdents d2/d3d/d4d/d59 0 2024-09-04T16:30:19.825 INFO:tasks.workunit.client.0.smithi170.stdout:0/463: mknod d11/d13/cb2 0 2024-09-04T16:30:19.829 INFO:tasks.workunit.client.1.smithi193.stdout:3/856: dwrite d0/d18/d1c/d25/d5e/d90/fdc [0,4194304] 0 2024-09-04T16:30:19.830 INFO:tasks.workunit.client.0.smithi170.stdout:9/341: dwrite d2/d3d/d35/f44 [0,4194304] 0 2024-09-04T16:30:19.832 INFO:tasks.workunit.client.1.smithi193.stdout:6/830: dwrite d5/d33/f4c [0,4194304] 0 2024-09-04T16:30:19.841 INFO:tasks.workunit.client.1.smithi193.stdout:8/885: fdatasync d2/f7f 0 2024-09-04T16:30:19.846 INFO:tasks.workunit.client.0.smithi170.stdout:3/252: write d13/d14/d1d/f23 [452193,64733] 0 2024-09-04T16:30:19.847 INFO:tasks.workunit.client.0.smithi170.stdout:3/253: read d13/f1a [2730643,65248] 0 2024-09-04T16:30:19.850 INFO:tasks.workunit.client.1.smithi193.stdout:5/862: mknod d1/d8/db/c11a 0 2024-09-04T16:30:19.851 INFO:tasks.workunit.client.1.smithi193.stdout:3/857: dread d0/d18/d1c/d51/d7a/f98 [4194304,4194304] 0 2024-09-04T16:30:19.851 INFO:tasks.workunit.client.1.smithi193.stdout:5/863: chown d1/d8/db/d36/d40/fc5 10156 1 2024-09-04T16:30:19.851 INFO:tasks.workunit.client.0.smithi170.stdout:8/388: creat d6/d28/d16/d24/f87 x:0 0 0 2024-09-04T16:30:19.852 INFO:tasks.workunit.client.0.smithi170.stdout:0/464: creat d11/d13/d4a/d66/d8c/dae/fb3 x:0 0 0 2024-09-04T16:30:19.853 INFO:tasks.workunit.client.1.smithi193.stdout:3/858: write d0/d18/d1b/d3d/d96/fd0 [2977978,17972] 0 2024-09-04T16:30:19.853 INFO:tasks.workunit.client.1.smithi193.stdout:5/864: write d1/d8/db/d36/d40/dc1/fdd [453675,7576] 0 2024-09-04T16:30:19.855 INFO:tasks.workunit.client.1.smithi193.stdout:3/859: write d0/d9/dae/fed [462263,105087] 0 2024-09-04T16:30:19.855 INFO:tasks.workunit.client.1.smithi193.stdout:2/831: mknod d2/d9/db/d10/d38/dac/df2/c112 0 2024-09-04T16:30:19.856 INFO:tasks.workunit.client.1.smithi193.stdout:2/832: chown d2/d9/db/d10/d51/dca/ff6 956431069 1 2024-09-04T16:30:19.857 INFO:tasks.workunit.client.0.smithi170.stdout:6/301: rename d0/df/d1b/d3e/d44/d2d/f57 to d0/df/d1b/d3e/d44/f61 0 2024-09-04T16:30:19.857 INFO:tasks.workunit.client.1.smithi193.stdout:6/831: mkdir d5/d33/d4e/d51/d71/dcf/d10c 0 2024-09-04T16:30:19.858 INFO:tasks.workunit.client.0.smithi170.stdout:9/342: mknod d2/d11/d23/d2a/d5b/c63 0 2024-09-04T16:30:19.859 INFO:tasks.workunit.client.1.smithi193.stdout:8/886: mknod d2/d12/c119 0 2024-09-04T16:30:19.859 INFO:tasks.workunit.client.0.smithi170.stdout:3/254: chown d13/d14/l43 2648103 1 2024-09-04T16:30:19.860 INFO:tasks.workunit.client.0.smithi170.stdout:9/343: truncate d2/d11/d23/d2a/f52 719010 0 2024-09-04T16:30:19.860 INFO:tasks.workunit.client.1.smithi193.stdout:9/930: truncate d2/d8/d61/f87 1531200 0 2024-09-04T16:30:19.860 INFO:tasks.workunit.client.1.smithi193.stdout:8/887: read - d2/d20/d23/d24/d3c/d65/dc8/de1/feb zero size 2024-09-04T16:30:19.860 INFO:tasks.workunit.client.1.smithi193.stdout:4/784: sync 2024-09-04T16:30:19.861 INFO:tasks.workunit.client.1.smithi193.stdout:8/888: write d2/d20/dc0/fd5 [2293471,54196] 0 2024-09-04T16:30:19.861 INFO:tasks.workunit.client.0.smithi170.stdout:8/389: creat d6/d28/d1a/d38/f88 x:0 0 0 2024-09-04T16:30:19.863 INFO:tasks.workunit.client.1.smithi193.stdout:1/948: rename d1/d2b/d10/f25 to d1/d2b/d1b/d51/dcb/f122 0 2024-09-04T16:30:19.866 INFO:tasks.workunit.client.0.smithi170.stdout:0/465: fdatasync d11/f25 0 2024-09-04T16:30:19.867 INFO:tasks.workunit.client.0.smithi170.stdout:0/466: chown d11/d13/d71/l2b 4654 1 2024-09-04T16:30:19.868 INFO:tasks.workunit.client.1.smithi193.stdout:0/857: link d18/d25/d32/d57/d6d/cda d18/d25/d5f/d6a/d7b/c119 0 2024-09-04T16:30:19.868 INFO:tasks.workunit.client.1.smithi193.stdout:8/889: dwrite d2/d20/dc0/fbf [0,4194304] 0 2024-09-04T16:30:19.868 INFO:tasks.workunit.client.0.smithi170.stdout:3/255: dwrite d13/d14/f4b [0,4194304] 0 2024-09-04T16:30:19.869 INFO:tasks.workunit.client.0.smithi170.stdout:7/514: getdents d12/d15/d71 0 2024-09-04T16:30:19.870 INFO:tasks.workunit.client.1.smithi193.stdout:8/890: write d2/d20/d23/d34/d4b/d7c/db2/f107 [695481,91727] 0 2024-09-04T16:30:19.876 INFO:tasks.workunit.client.0.smithi170.stdout:9/344: truncate d2/d3d/f10 6455168 0 2024-09-04T16:30:19.876 INFO:tasks.workunit.client.0.smithi170.stdout:3/256: dread d13/d14/d21/f2b [0,4194304] 0 2024-09-04T16:30:19.880 INFO:tasks.workunit.client.1.smithi193.stdout:4/785: fsync d3/d3c/d89/f8c 0 2024-09-04T16:30:19.884 INFO:tasks.workunit.client.1.smithi193.stdout:3/860: mknod d0/d10/d24/d9a/de2/c117 0 2024-09-04T16:30:19.887 INFO:tasks.workunit.client.1.smithi193.stdout:3/861: read d0/d18/d1c/d51/fca [1240743,25217] 0 2024-09-04T16:30:19.887 INFO:tasks.workunit.client.1.smithi193.stdout:8/891: creat d2/d20/d23/d34/d46/d66/d10e/f11a x:0 0 0 2024-09-04T16:30:19.888 INFO:tasks.workunit.client.1.smithi193.stdout:3/862: chown d0/d18/d1c/d51/fca 11007 1 2024-09-04T16:30:19.888 INFO:tasks.workunit.client.1.smithi193.stdout:8/892: dread - d2/d20/f100 zero size 2024-09-04T16:30:19.889 INFO:tasks.workunit.client.0.smithi170.stdout:8/390: creat d6/d28/d16/d52/d73/d5d/f89 x:0 0 0 2024-09-04T16:30:19.891 INFO:tasks.workunit.client.0.smithi170.stdout:9/345: creat d2/d3d/d27/f64 x:0 0 0 2024-09-04T16:30:19.894 INFO:tasks.workunit.client.1.smithi193.stdout:4/786: creat d3/d3c/d89/dbd/ddc/f100 x:0 0 0 2024-09-04T16:30:19.896 INFO:tasks.workunit.client.0.smithi170.stdout:8/391: dwrite d6/f4f [4194304,4194304] 0 2024-09-04T16:30:19.902 INFO:tasks.workunit.client.0.smithi170.stdout:9/346: dread d2/d3d/d27/f2e [0,4194304] 0 2024-09-04T16:30:19.903 INFO:tasks.workunit.client.1.smithi193.stdout:3/863: mkdir d0/d18/d1b/d3d/d118 0 2024-09-04T16:30:19.906 INFO:tasks.workunit.client.1.smithi193.stdout:2/833: dwrite d2/f35 [0,4194304] 0 2024-09-04T16:30:19.907 INFO:tasks.workunit.client.0.smithi170.stdout:3/257: dread d13/f19 [4194304,4194304] 0 2024-09-04T16:30:19.908 INFO:tasks.workunit.client.0.smithi170.stdout:3/258: chown d13/d14/d1d/d2d 154175 1 2024-09-04T16:30:19.908 INFO:tasks.workunit.client.1.smithi193.stdout:4/787: creat d3/d3c/d98/dcf/f101 x:0 0 0 2024-09-04T16:30:19.911 INFO:tasks.workunit.client.1.smithi193.stdout:2/834: chown d2/d9/db/d10/d1e/da4/d9a/f44 196 1 2024-09-04T16:30:19.911 INFO:tasks.workunit.client.1.smithi193.stdout:6/832: dwrite d5/d33/d4e/d51/f80 [4194304,4194304] 0 2024-09-04T16:30:19.913 INFO:tasks.workunit.client.1.smithi193.stdout:0/858: getdents d18/d25/d3b 0 2024-09-04T16:30:19.914 INFO:tasks.workunit.client.0.smithi170.stdout:0/467: dread d11/d13/d71/d43/f60 [0,4194304] 0 2024-09-04T16:30:19.916 INFO:tasks.workunit.client.0.smithi170.stdout:7/515: dwrite d12/d15/d41/f55 [0,4194304] 0 2024-09-04T16:30:19.920 INFO:tasks.workunit.client.1.smithi193.stdout:3/864: mknod d0/d18/d114/c119 0 2024-09-04T16:30:19.924 INFO:tasks.workunit.client.1.smithi193.stdout:4/788: mknod d3/d1a/d54/db1/c102 0 2024-09-04T16:30:19.927 INFO:tasks.workunit.client.1.smithi193.stdout:2/835: rename d2/fe3 to d2/d9/db/d10/d51/d79/f113 0 2024-09-04T16:30:19.927 INFO:tasks.workunit.client.1.smithi193.stdout:2/836: readlink d2/d9/db/d10/d1f/d77/l8b 0 2024-09-04T16:30:19.928 INFO:tasks.workunit.client.1.smithi193.stdout:6/833: truncate d5/de/d15/f24 321498 0 2024-09-04T16:30:19.930 INFO:tasks.workunit.client.1.smithi193.stdout:3/865: truncate d0/d18/d1c/d51/d5a/f5c 3249024 0 2024-09-04T16:30:19.932 INFO:tasks.workunit.client.0.smithi170.stdout:9/347: rename d2/d11/d23/d2a to d2/d3d/d27/d65 0 2024-09-04T16:30:19.933 INFO:tasks.workunit.client.1.smithi193.stdout:1/949: truncate d1/d2b/f2c 1233919 0 2024-09-04T16:30:19.934 INFO:tasks.workunit.client.1.smithi193.stdout:1/950: chown d1/d2b/d10/l5e 59552 1 2024-09-04T16:30:19.936 INFO:tasks.workunit.client.1.smithi193.stdout:4/789: rename d3/d39/d44/dd5/l65 to d3/d1a/d21/d52/d7f/deb/l103 0 2024-09-04T16:30:19.937 INFO:tasks.workunit.client.1.smithi193.stdout:2/837: rmdir d2/d9/db 39 2024-09-04T16:30:19.938 INFO:tasks.workunit.client.1.smithi193.stdout:6/834: stat d5/d27/d3e/d6e/l8e 0 2024-09-04T16:30:19.939 INFO:tasks.workunit.client.0.smithi170.stdout:6/302: link d0/ce d0/c62 0 2024-09-04T16:30:19.939 INFO:tasks.workunit.client.1.smithi193.stdout:6/835: chown d5/d33/d4e/d51/d71/lc5 9737 1 2024-09-04T16:30:19.939 INFO:tasks.workunit.client.1.smithi193.stdout:0/859: symlink d18/d25/d32/d9c/da9/l11a 0 2024-09-04T16:30:19.941 INFO:tasks.workunit.client.1.smithi193.stdout:7/978: sync 2024-09-04T16:30:19.941 INFO:tasks.workunit.client.1.smithi193.stdout:4/790: mkdir d3/d39/d44/dd5/d7b/d104 0 2024-09-04T16:30:19.943 INFO:tasks.workunit.client.1.smithi193.stdout:4/791: truncate d3/d3c/f53 4799153 0 2024-09-04T16:30:19.944 INFO:tasks.workunit.client.1.smithi193.stdout:6/836: creat d5/d33/d4e/d51/d71/d82/f10d x:0 0 0 2024-09-04T16:30:19.944 INFO:tasks.workunit.client.1.smithi193.stdout:2/838: write d2/d9/db/d10/d1e/f96 [3895457,60350] 0 2024-09-04T16:30:19.944 INFO:tasks.workunit.client.1.smithi193.stdout:3/866: dread d0/fa [0,4194304] 0 2024-09-04T16:30:19.948 INFO:tasks.workunit.client.1.smithi193.stdout:0/860: rename d18/d25/l36 to d18/d25/d32/d57/d6c/db1/dc9/l11b 0 2024-09-04T16:30:19.951 INFO:tasks.workunit.client.1.smithi193.stdout:7/979: read d9/de/f1f [20660,59974] 0 2024-09-04T16:30:19.952 INFO:tasks.workunit.client.0.smithi170.stdout:7/516: mknod d12/d16/d1d/d65/cb4 0 2024-09-04T16:30:19.955 INFO:tasks.workunit.client.0.smithi170.stdout:3/259: write fb [1082144,72547] 0 2024-09-04T16:30:19.956 INFO:tasks.workunit.client.0.smithi170.stdout:6/303: stat d0/df/d1b/d3e/d44/d2d/d2e/l35 0 2024-09-04T16:30:19.959 INFO:tasks.workunit.client.0.smithi170.stdout:0/468: creat d11/d13/d71/d43/fb4 x:0 0 0 2024-09-04T16:30:19.960 INFO:tasks.workunit.client.0.smithi170.stdout:0/469: chown d11/d13/d36/l44 514285 1 2024-09-04T16:30:19.961 INFO:tasks.workunit.client.1.smithi193.stdout:2/839: mkdir d2/d9/d18/d114 0 2024-09-04T16:30:19.961 INFO:tasks.workunit.client.0.smithi170.stdout:0/470: chown d11/d13/d4a/d66/d6d 1387 1 2024-09-04T16:30:19.961 INFO:tasks.workunit.client.0.smithi170.stdout:7/517: creat d12/d15/d41/fb5 x:0 0 0 2024-09-04T16:30:19.962 INFO:tasks.workunit.client.0.smithi170.stdout:7/518: write d12/d15/d71/f70 [604191,52268] 0 2024-09-04T16:30:19.962 INFO:tasks.workunit.client.1.smithi193.stdout:2/840: write d2/d9/db/d10/d1e/da4/f6d [543890,123296] 0 2024-09-04T16:30:19.963 INFO:tasks.workunit.client.0.smithi170.stdout:8/392: getdents d6/d28/d16/d24/d46 0 2024-09-04T16:30:19.964 INFO:tasks.workunit.client.0.smithi170.stdout:8/393: read - d6/d28/d16/d52/d73/d5d/f89 zero size 2024-09-04T16:30:19.965 INFO:tasks.workunit.client.1.smithi193.stdout:2/841: write d2/d9/db/d10/d1e/da4/d9a/fe8 [63639,5167] 0 2024-09-04T16:30:19.966 INFO:tasks.workunit.client.0.smithi170.stdout:9/348: dread d2/d32/f41 [0,4194304] 0 2024-09-04T16:30:19.967 INFO:tasks.workunit.client.0.smithi170.stdout:3/260: rmdir d13/d14/d21/d4c 39 2024-09-04T16:30:19.967 INFO:tasks.workunit.client.1.smithi193.stdout:0/861: dread f6 [0,4194304] 0 2024-09-04T16:30:19.968 INFO:tasks.workunit.client.0.smithi170.stdout:9/349: stat d2/d3d/d27/d65/d5b/c63 0 2024-09-04T16:30:19.968 INFO:tasks.workunit.client.0.smithi170.stdout:3/261: chown d13/d14/l43 400 1 2024-09-04T16:30:19.968 INFO:tasks.workunit.client.1.smithi193.stdout:7/980: write d9/d39/d3e/f7c [415450,26481] 0 2024-09-04T16:30:19.972 INFO:tasks.workunit.client.1.smithi193.stdout:4/792: link d3/f29 d3/d3c/d98/dcf/f105 0 2024-09-04T16:30:19.973 INFO:tasks.workunit.client.1.smithi193.stdout:3/867: creat d0/d9/dae/d101/f11a x:0 0 0 2024-09-04T16:30:19.973 INFO:tasks.workunit.client.1.smithi193.stdout:6/837: dread d5/d27/d3e/d43/f72 [0,4194304] 0 2024-09-04T16:30:19.974 INFO:tasks.workunit.client.1.smithi193.stdout:4/793: read d3/d39/d44/dd5/fa5 [3956157,18566] 0 2024-09-04T16:30:19.974 INFO:tasks.workunit.client.0.smithi170.stdout:8/394: chown d6/d26/c3a 83 1 2024-09-04T16:30:19.974 INFO:tasks.workunit.client.1.smithi193.stdout:6/838: chown d5/d27/d3e 11 1 2024-09-04T16:30:19.975 INFO:tasks.workunit.client.1.smithi193.stdout:6/839: chown d5/d27/d3e/d6e/l8e 420705 1 2024-09-04T16:30:19.975 INFO:tasks.workunit.client.1.smithi193.stdout:6/840: readlink l4 0 2024-09-04T16:30:19.976 INFO:tasks.workunit.client.0.smithi170.stdout:3/262: creat d13/f51 x:0 0 0 2024-09-04T16:30:19.977 INFO:tasks.workunit.client.0.smithi170.stdout:6/304: unlink d0/d17/d2a/f46 0 2024-09-04T16:30:19.979 INFO:tasks.workunit.client.0.smithi170.stdout:6/305: write d0/df/d1b/d3e/d44/d2d/f3d [3993193,35181] 0 2024-09-04T16:30:19.979 INFO:tasks.workunit.client.0.smithi170.stdout:6/306: chown d0/df/d1b 3401 1 2024-09-04T16:30:19.980 INFO:tasks.workunit.client.0.smithi170.stdout:8/395: creat d6/d28/d20/f8a x:0 0 0 2024-09-04T16:30:19.983 INFO:tasks.workunit.client.0.smithi170.stdout:3/263: creat d13/d14/d17/f52 x:0 0 0 2024-09-04T16:30:19.988 INFO:tasks.workunit.client.0.smithi170.stdout:9/350: dread d2/d3d/f20 [0,4194304] 0 2024-09-04T16:30:19.989 INFO:tasks.workunit.client.0.smithi170.stdout:6/307: chown d0/d15/d56/c4b 1155380 1 2024-09-04T16:30:19.989 INFO:tasks.workunit.client.0.smithi170.stdout:9/351: write d2/d11/f33 [2637157,122890] 0 2024-09-04T16:30:19.990 INFO:tasks.workunit.client.0.smithi170.stdout:6/308: stat d0/df/d1b/d3e 0 2024-09-04T16:30:19.990 INFO:tasks.workunit.client.0.smithi170.stdout:8/396: mkdir d6/d28/d16/d52/d73/d5d/d8b 0 2024-09-04T16:30:19.991 INFO:tasks.workunit.client.1.smithi193.stdout:6/841: dread d5/de/d15/d1b/d5f/f78 [0,4194304] 0 2024-09-04T16:30:19.992 INFO:tasks.workunit.client.0.smithi170.stdout:8/397: write d6/d28/d20/f48 [2485599,6087] 0 2024-09-04T16:30:19.992 INFO:tasks.workunit.client.1.smithi193.stdout:5/865: sync 2024-09-04T16:30:19.994 INFO:tasks.workunit.client.0.smithi170.stdout:3/264: rename d13/d14/d1d/d2d/f37 to d13/d14/d21/d46/f53 0 2024-09-04T16:30:19.995 INFO:tasks.workunit.client.1.smithi193.stdout:3/868: mkdir d0/d18/d1c/d25/da0/dcd/d11b 0 2024-09-04T16:30:19.996 INFO:tasks.workunit.client.0.smithi170.stdout:9/352: unlink d2/d11/d23/c47 0 2024-09-04T16:30:19.998 INFO:tasks.workunit.client.1.smithi193.stdout:2/842: link d2/d9/db/d10/d38/d63/f68 d2/d9/db/d10/d38/dac/df2/f115 0 2024-09-04T16:30:20.001 INFO:tasks.workunit.client.1.smithi193.stdout:0/862: symlink d18/d25/d5f/l11c 0 2024-09-04T16:30:20.002 INFO:tasks.workunit.client.0.smithi170.stdout:8/398: mkdir d6/d28/d16/d77/d8c 0 2024-09-04T16:30:20.003 INFO:tasks.workunit.client.0.smithi170.stdout:8/399: chown d6/d28/d5f/d85 91 1 2024-09-04T16:30:20.004 INFO:tasks.workunit.client.0.smithi170.stdout:7/519: dwrite d12/d15/faf [0,4194304] 0 2024-09-04T16:30:20.012 INFO:tasks.workunit.client.1.smithi193.stdout:7/981: dwrite d9/d39/d3e/d4d/d4f/fb4 [0,4194304] 0 2024-09-04T16:30:20.013 INFO:tasks.workunit.client.0.smithi170.stdout:7/520: dwrite d12/d15/d71/f36 [0,4194304] 0 2024-09-04T16:30:20.016 INFO:tasks.workunit.client.1.smithi193.stdout:2/843: dread d2/d9/db/d10/d51/dca/ff6 [0,4194304] 0 2024-09-04T16:30:20.018 INFO:tasks.workunit.client.1.smithi193.stdout:0/863: rmdir d18 39 2024-09-04T16:30:20.019 INFO:tasks.workunit.client.0.smithi170.stdout:8/400: mknod d6/d28/d16/d24/d46/c8d 0 2024-09-04T16:30:20.019 INFO:tasks.workunit.client.1.smithi193.stdout:6/842: dwrite d5/d33/d4e/d51/d71/d82/d88/fee [0,4194304] 0 2024-09-04T16:30:20.020 INFO:tasks.workunit.client.1.smithi193.stdout:4/794: dwrite d3/f30 [0,4194304] 0 2024-09-04T16:30:20.020 INFO:tasks.workunit.client.0.smithi170.stdout:8/401: stat d6/d28/d16/d52/l78 0 2024-09-04T16:30:20.022 INFO:tasks.workunit.client.0.smithi170.stdout:3/265: mknod d13/d14/d21/d4d/d4e/d50/c54 0 2024-09-04T16:30:20.023 INFO:tasks.workunit.client.0.smithi170.stdout:9/353: truncate d2/d3d/d27/d2b/d34/f45 303010 0 2024-09-04T16:30:20.023 INFO:tasks.workunit.client.1.smithi193.stdout:6/843: write d5/d33/d4e/d51/d71/d82/d88/fee [3548506,57592] 0 2024-09-04T16:30:20.025 INFO:tasks.workunit.client.0.smithi170.stdout:9/354: chown d2/d11/d23/f29 43813 1 2024-09-04T16:30:20.029 INFO:tasks.workunit.client.0.smithi170.stdout:6/309: write d0/d15/f45 [19100,23053] 0 2024-09-04T16:30:20.031 INFO:tasks.workunit.client.0.smithi170.stdout:8/402: symlink d6/d28/d16/d24/d46/l8e 0 2024-09-04T16:30:20.032 INFO:tasks.workunit.client.0.smithi170.stdout:3/266: dwrite fb [0,4194304] 0 2024-09-04T16:30:20.038 INFO:tasks.workunit.client.1.smithi193.stdout:0/864: chown d18/d25/d5f/d6a/f83 116241321 1 2024-09-04T16:30:20.038 INFO:tasks.workunit.client.0.smithi170.stdout:8/403: truncate d6/d28/d16/d52/f6c 619962 0 2024-09-04T16:30:20.038 INFO:tasks.workunit.client.0.smithi170.stdout:9/355: fsync d2/d3d/f20 0 2024-09-04T16:30:20.038 INFO:tasks.workunit.client.0.smithi170.stdout:8/404: fsync d6/d28/d1a/d38/f88 0 2024-09-04T16:30:20.041 INFO:tasks.workunit.client.0.smithi170.stdout:6/310: mknod d0/d17/d2a/c63 0 2024-09-04T16:30:20.042 INFO:tasks.workunit.client.1.smithi193.stdout:9/931: sync 2024-09-04T16:30:20.042 INFO:tasks.workunit.client.1.smithi193.stdout:8/893: sync 2024-09-04T16:30:20.042 INFO:tasks.workunit.client.1.smithi193.stdout:1/951: sync 2024-09-04T16:30:20.043 INFO:tasks.workunit.client.0.smithi170.stdout:3/267: chown d13/d14/d1f/c2f 29044 1 2024-09-04T16:30:20.043 INFO:tasks.workunit.client.0.smithi170.stdout:6/311: dread - d0/d17/d2a/d30/f5c zero size 2024-09-04T16:30:20.044 INFO:tasks.workunit.client.0.smithi170.stdout:3/268: write d13/d14/d21/f3a [1638539,82745] 0 2024-09-04T16:30:20.046 INFO:tasks.workunit.client.1.smithi193.stdout:3/869: write d0/d18/d1c/d30/fac [511348,103520] 0 2024-09-04T16:30:20.047 INFO:tasks.workunit.client.0.smithi170.stdout:7/521: write d12/d15/d71/d42/f60 [457514,124533] 0 2024-09-04T16:30:20.048 INFO:tasks.workunit.client.0.smithi170.stdout:8/405: mknod d6/d28/d1a/c8f 0 2024-09-04T16:30:20.049 INFO:tasks.workunit.client.0.smithi170.stdout:7/522: write d12/d15/d68/fa0 [234410,80826] 0 2024-09-04T16:30:20.049 INFO:tasks.workunit.client.1.smithi193.stdout:7/982: symlink d9/d11/dd4/dd2/df1/dfb/l141 0 2024-09-04T16:30:20.051 INFO:tasks.workunit.client.1.smithi193.stdout:0/865: mkdir d18/d25/d3b/d11d 0 2024-09-04T16:30:20.051 INFO:tasks.workunit.client.1.smithi193.stdout:4/795: getdents d3/d1a/d21/d52/d7f/db6/df9 0 2024-09-04T16:30:20.053 INFO:tasks.workunit.client.1.smithi193.stdout:1/952: mknod d1/d2b/d1b/d28/d50/d84/c123 0 2024-09-04T16:30:20.055 INFO:tasks.workunit.client.1.smithi193.stdout:8/894: truncate d2/d12/f43 8891761 0 2024-09-04T16:30:20.055 INFO:tasks.workunit.client.0.smithi170.stdout:7/523: rmdir d12/d15/d71/d42/d81 39 2024-09-04T16:30:20.056 INFO:tasks.workunit.client.1.smithi193.stdout:9/932: symlink d2/d18/d2f/d22/d30/d6a/d6e/d81/l127 0 2024-09-04T16:30:20.057 INFO:tasks.workunit.client.1.smithi193.stdout:9/933: fsync d2/d8/d25/dcb/fe7 0 2024-09-04T16:30:20.057 INFO:tasks.workunit.client.0.smithi170.stdout:3/269: creat d13/d14/d21/d4c/f55 x:0 0 0 2024-09-04T16:30:20.058 INFO:tasks.workunit.client.0.smithi170.stdout:6/312: rename d0/d17/d2a to d0/d17/d31/d64 0 2024-09-04T16:30:20.059 INFO:tasks.workunit.client.0.smithi170.stdout:3/270: write d13/d14/d1f/d40/f47 [547460,120483] 0 2024-09-04T16:30:20.060 INFO:tasks.workunit.client.0.smithi170.stdout:3/271: write d13/d14/f48 [696219,81475] 0 2024-09-04T16:30:20.061 INFO:tasks.workunit.client.1.smithi193.stdout:1/953: dread d1/d2b/d1b/f4c [0,4194304] 0 2024-09-04T16:30:20.061 INFO:tasks.workunit.client.1.smithi193.stdout:5/866: link d1/d29/d18/c33 d1/d8/db/d36/c11b 0 2024-09-04T16:30:20.062 INFO:tasks.workunit.client.0.smithi170.stdout:3/272: stat d13/d14/d21/f3a 0 2024-09-04T16:30:20.062 INFO:tasks.workunit.client.1.smithi193.stdout:5/867: write d1/dd0/de9/ff9 [520089,95700] 0 2024-09-04T16:30:20.065 INFO:tasks.workunit.client.0.smithi170.stdout:8/406: rename d6/d28/d1a/l1c to d6/d28/d5f/d85/l90 0 2024-09-04T16:30:20.066 INFO:tasks.workunit.client.0.smithi170.stdout:3/273: write d13/d14/d21/d4c/f55 [4273,8578] 0 2024-09-04T16:30:20.066 INFO:tasks.workunit.client.1.smithi193.stdout:6/844: creat d5/d33/df1/f10e x:0 0 0 2024-09-04T16:30:20.068 INFO:tasks.workunit.client.0.smithi170.stdout:7/524: dwrite d12/d16/fb2 [4194304,4194304] 0 2024-09-04T16:30:20.068 INFO:tasks.workunit.client.0.smithi170.stdout:6/313: creat d0/d17/d31/d64/f65 x:0 0 0 2024-09-04T16:30:20.068 INFO:tasks.workunit.client.0.smithi170.stdout:8/407: write d6/d28/d1a/d38/f88 [78710,74257] 0 2024-09-04T16:30:20.069 INFO:tasks.workunit.client.0.smithi170.stdout:3/274: write d13/d14/d1d/f23 [2968948,80214] 0 2024-09-04T16:30:20.070 INFO:tasks.workunit.client.0.smithi170.stdout:6/314: chown d0/df/d1b/d3e/d44 76949035 1 2024-09-04T16:30:20.071 INFO:tasks.workunit.client.0.smithi170.stdout:8/408: write d6/d28/d1a/d38/f88 [1039280,74523] 0 2024-09-04T16:30:20.073 INFO:tasks.workunit.client.1.smithi193.stdout:0/866: creat d18/d25/d5f/d65/dc4/dd5/df2/f11e x:0 0 0 2024-09-04T16:30:20.075 INFO:tasks.workunit.client.1.smithi193.stdout:0/867: dread d18/d25/f3c [0,4194304] 0 2024-09-04T16:30:20.080 INFO:tasks.workunit.client.0.smithi170.stdout:8/409: dwrite d6/d28/d20/d5e/f3e [4194304,4194304] 0 2024-09-04T16:30:20.080 INFO:tasks.workunit.client.0.smithi170.stdout:3/275: chown d13/d14/d1f/c29 6355264 1 2024-09-04T16:30:20.082 INFO:tasks.workunit.client.1.smithi193.stdout:9/934: truncate d2/d8/d15/f8c 265307 0 2024-09-04T16:30:20.082 INFO:tasks.workunit.client.0.smithi170.stdout:8/410: write d6/d28/d16/d52/f6c [179557,415] 0 2024-09-04T16:30:20.083 INFO:tasks.workunit.client.1.smithi193.stdout:9/935: write d2/d18/d2f/d22/d30/d6a/f94 [2416612,96201] 0 2024-09-04T16:30:20.085 INFO:tasks.workunit.client.1.smithi193.stdout:2/844: rename d2/d9/db/d10/d1f/d4a/c76 to d2/d9/db/d10/d51/d87/c116 0 2024-09-04T16:30:20.086 INFO:tasks.workunit.client.0.smithi170.stdout:7/525: symlink d12/d16/d1d/d65/d7b/lb6 0 2024-09-04T16:30:20.088 INFO:tasks.workunit.client.1.smithi193.stdout:7/983: write d9/d18/d22/d2b/d6c/d70/fcb [2632084,96798] 0 2024-09-04T16:30:20.088 INFO:tasks.workunit.client.1.smithi193.stdout:1/954: creat d1/d2b/d1b/d28/d50/d84/dd1/de2/f124 x:0 0 0 2024-09-04T16:30:20.091 INFO:tasks.workunit.client.0.smithi170.stdout:3/276: symlink d13/d14/d21/d46/l56 0 2024-09-04T16:30:20.092 INFO:tasks.workunit.client.1.smithi193.stdout:3/870: getdents d0/d18/d1c/d51/d7a/dbf 0 2024-09-04T16:30:20.093 INFO:tasks.workunit.client.0.smithi170.stdout:9/356: truncate d2/d3d/d27/f53 829969 0 2024-09-04T16:30:20.094 INFO:tasks.workunit.client.1.smithi193.stdout:9/936: dwrite d2/d18/d2f/fc3 [0,4194304] 0 2024-09-04T16:30:20.094 INFO:tasks.workunit.client.0.smithi170.stdout:7/526: dwrite d12/d16/d8d/fa5 [0,4194304] 0 2024-09-04T16:30:20.095 INFO:tasks.workunit.client.1.smithi193.stdout:3/871: write d0/d9/fb [2990409,8511] 0 2024-09-04T16:30:20.096 INFO:tasks.workunit.client.1.smithi193.stdout:4/796: link d3/d3c/d89/dbd/ddc/ff8 d3/d3c/d89/f106 0 2024-09-04T16:30:20.097 INFO:tasks.workunit.client.0.smithi170.stdout:3/277: mknod d13/d14/d1d/d2d/c57 0 2024-09-04T16:30:20.097 INFO:tasks.workunit.client.0.smithi170.stdout:7/527: truncate d12/d16/d1d/d65/f89 738575 0 2024-09-04T16:30:20.103 INFO:tasks.workunit.client.0.smithi170.stdout:3/278: rename d13/d14/d1f/d40 to d13/d14/d1d/d2d/d58 0 2024-09-04T16:30:20.106 INFO:tasks.workunit.client.0.smithi170.stdout:7/528: dwrite d12/d15/d71/d42/d79/d9d/d51/f8b [0,4194304] 0 2024-09-04T16:30:20.106 INFO:tasks.workunit.client.1.smithi193.stdout:0/868: rename d18/d25/d5f/fc2 to d18/d25/d5f/d65/dc4/dd5/df2/f11f 0 2024-09-04T16:30:20.108 INFO:tasks.workunit.client.1.smithi193.stdout:2/845: creat d2/d9/d18/d7b/db5/f117 x:0 0 0 2024-09-04T16:30:20.109 INFO:tasks.workunit.client.1.smithi193.stdout:8/895: creat d2/d20/d23/d34/dd6/da0/f11b x:0 0 0 2024-09-04T16:30:20.109 INFO:tasks.workunit.client.1.smithi193.stdout:7/984: stat d9/d18/d1e/c6f 0 2024-09-04T16:30:20.110 INFO:tasks.workunit.client.0.smithi170.stdout:3/279: symlink d13/d14/d1d/d2d/d3d/l59 0 2024-09-04T16:30:20.114 INFO:tasks.workunit.client.1.smithi193.stdout:5/868: dread d1/d8/db/d15/d2b/d83/d37/d58/d9e/da7/fbf [0,4194304] 0 2024-09-04T16:30:20.115 INFO:tasks.workunit.client.0.smithi170.stdout:7/529: mkdir d12/d16/db7 0 2024-09-04T16:30:20.115 INFO:tasks.workunit.client.1.smithi193.stdout:1/955: dwrite d1/d2b/d10/d56/d11d/f11f [0,4194304] 0 2024-09-04T16:30:20.115 INFO:tasks.workunit.client.1.smithi193.stdout:8/896: chown d2/d20/d23/fee 1462 1 2024-09-04T16:30:20.118 INFO:tasks.workunit.client.1.smithi193.stdout:2/846: read - d2/d9/db/d10/d1f/d77/d91/dff/f107 zero size 2024-09-04T16:30:20.118 INFO:tasks.workunit.client.0.smithi170.stdout:3/280: creat d13/d14/d1d/d2d/d3d/f5a x:0 0 0 2024-09-04T16:30:20.118 INFO:tasks.workunit.client.1.smithi193.stdout:8/897: stat d2/d20/dc0/d82/fdc 0 2024-09-04T16:30:20.122 INFO:tasks.workunit.client.0.smithi170.stdout:3/281: symlink d13/d14/d1d/d2d/d3d/l5b 0 2024-09-04T16:30:20.122 INFO:tasks.workunit.client.1.smithi193.stdout:0/869: dwrite d18/d25/ff6 [0,4194304] 0 2024-09-04T16:30:20.127 INFO:tasks.workunit.client.0.smithi170.stdout:8/411: dwrite d6/d28/d1a/f54 [0,4194304] 0 2024-09-04T16:30:20.132 INFO:tasks.workunit.client.0.smithi170.stdout:3/282: dread d13/d14/d21/f2b [0,4194304] 0 2024-09-04T16:30:20.135 INFO:tasks.workunit.client.0.smithi170.stdout:7/530: link d12/d16/d1d/f80 d12/d16/fb8 0 2024-09-04T16:30:20.138 INFO:tasks.workunit.client.0.smithi170.stdout:8/412: mkdir d6/d28/d5f/d91 0 2024-09-04T16:30:20.139 INFO:tasks.workunit.client.0.smithi170.stdout:8/413: chown d6/d28/d20/d5e/f5b 139 1 2024-09-04T16:30:20.140 INFO:tasks.workunit.client.0.smithi170.stdout:9/357: dwrite d2/d3d/f20 [0,4194304] 0 2024-09-04T16:30:20.142 INFO:tasks.workunit.client.1.smithi193.stdout:6/845: truncate d5/d33/d4e/d51/d71/dcf/ff0 346172 0 2024-09-04T16:30:20.155 INFO:tasks.workunit.client.1.smithi193.stdout:4/797: mknod d3/d1a/d54/db1/c107 0 2024-09-04T16:30:20.156 INFO:tasks.workunit.client.1.smithi193.stdout:7/985: write d9/d18/f10d [1016483,87046] 0 2024-09-04T16:30:20.157 INFO:tasks.workunit.client.1.smithi193.stdout:8/898: symlink d2/d20/d23/d24/d3c/d65/dc8/l11c 0 2024-09-04T16:30:20.157 INFO:tasks.workunit.client.1.smithi193.stdout:2/847: symlink d2/d9/db/d10/d38/dac/dd1/l118 0 2024-09-04T16:30:20.158 INFO:tasks.workunit.client.1.smithi193.stdout:2/848: fsync d2/d9/db/d10/d1f/f62 0 2024-09-04T16:30:20.158 INFO:tasks.workunit.client.1.smithi193.stdout:5/869: rename d1/d8/db/c9f to d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/db9/c11c 0 2024-09-04T16:30:20.159 INFO:tasks.workunit.client.1.smithi193.stdout:0/870: fsync d18/d25/f29 0 2024-09-04T16:30:20.160 INFO:tasks.workunit.client.1.smithi193.stdout:6/846: chown d5/d27/f84 7341575 1 2024-09-04T16:30:20.162 INFO:tasks.workunit.client.1.smithi193.stdout:0/871: write d18/d25/d3b/f40 [2125779,10816] 0 2024-09-04T16:30:20.162 INFO:tasks.workunit.client.1.smithi193.stdout:6/847: dread - d5/d33/d4e/d51/d68/f106 zero size 2024-09-04T16:30:20.163 INFO:tasks.workunit.client.1.smithi193.stdout:4/798: symlink d3/d3c/d98/dcf/l108 0 2024-09-04T16:30:20.164 INFO:tasks.workunit.client.1.smithi193.stdout:1/956: symlink d1/d2b/d10/d56/da7/l125 0 2024-09-04T16:30:20.165 INFO:tasks.workunit.client.1.smithi193.stdout:1/957: chown d1/d2b/d1b/d51/d6d/d89/dc7 146688454 1 2024-09-04T16:30:20.166 INFO:tasks.workunit.client.1.smithi193.stdout:7/986: creat d9/d39/d95/f142 x:0 0 0 2024-09-04T16:30:20.167 INFO:tasks.workunit.client.1.smithi193.stdout:8/899: creat d2/d20/d23/d24/d3c/de7/f11d x:0 0 0 2024-09-04T16:30:20.168 INFO:tasks.workunit.client.1.smithi193.stdout:8/900: write d2/d20/dc0/fbf [1144249,42852] 0 2024-09-04T16:30:20.171 INFO:tasks.workunit.client.1.smithi193.stdout:0/872: rmdir d18/d25/d32/d57 39 2024-09-04T16:30:20.172 INFO:tasks.workunit.client.1.smithi193.stdout:4/799: fsync d3/d3c/f8d 0 2024-09-04T16:30:20.176 INFO:tasks.workunit.client.1.smithi193.stdout:2/849: mkdir d2/d9/db/d10/d51/d87/d119 0 2024-09-04T16:30:20.181 INFO:tasks.workunit.client.1.smithi193.stdout:1/958: dread d1/d39/f46 [0,4194304] 0 2024-09-04T16:30:20.182 INFO:tasks.workunit.client.1.smithi193.stdout:4/800: creat d3/d1a/d21/d52/d7f/f109 x:0 0 0 2024-09-04T16:30:20.184 INFO:tasks.workunit.client.1.smithi193.stdout:7/987: creat d9/d18/f143 x:0 0 0 2024-09-04T16:30:20.185 INFO:tasks.workunit.client.1.smithi193.stdout:4/801: dread - d3/d39/f77 zero size 2024-09-04T16:30:20.186 INFO:tasks.workunit.client.1.smithi193.stdout:2/850: link d2/d9/db/d10/d38/d63/fef d2/d9/db/d10/d51/dca/f11a 0 2024-09-04T16:30:20.186 INFO:tasks.workunit.client.1.smithi193.stdout:4/802: chown d3/d1a/d21/d52/d7f/l92 153182145 1 2024-09-04T16:30:20.187 INFO:tasks.workunit.client.1.smithi193.stdout:0/873: mknod d18/d25/d32/d57/d6c/dfc/c120 0 2024-09-04T16:30:20.190 INFO:tasks.workunit.client.1.smithi193.stdout:8/901: dread d2/f2e [0,4194304] 0 2024-09-04T16:30:20.190 INFO:tasks.workunit.client.1.smithi193.stdout:4/803: mknod d3/d39/d44/dd5/daa/c10a 0 2024-09-04T16:30:20.191 INFO:tasks.workunit.client.1.smithi193.stdout:0/874: creat d18/d25/d32/d9c/f121 x:0 0 0 2024-09-04T16:30:20.191 INFO:tasks.workunit.client.1.smithi193.stdout:1/959: link d1/d2b/d1b/d51/fa6 d1/d2b/d1b/d51/d6d/d89/dc7/f126 0 2024-09-04T16:30:20.192 INFO:tasks.workunit.client.1.smithi193.stdout:7/988: dwrite d9/d18/d22/d2b/fdb [4194304,4194304] 0 2024-09-04T16:30:20.193 INFO:tasks.workunit.client.1.smithi193.stdout:0/875: truncate d18/d25/d5f/fbf 976380 0 2024-09-04T16:30:20.202 INFO:tasks.workunit.client.1.smithi193.stdout:1/960: dwrite d1/d2b/db/f82 [0,4194304] 0 2024-09-04T16:30:20.241 INFO:tasks.workunit.client.0.smithi170.stdout:9/358: dwrite d2/d11/f33 [0,4194304] 0 2024-09-04T16:30:20.245 INFO:tasks.workunit.client.0.smithi170.stdout:9/359: dread d2/d3d/d35/f44 [0,4194304] 0 2024-09-04T16:30:20.246 INFO:tasks.workunit.client.1.smithi193.stdout:9/937: truncate d2/d18/d2f/d22/d30/f9b 309430 0 2024-09-04T16:30:20.248 INFO:tasks.workunit.client.1.smithi193.stdout:3/872: truncate d0/d18/d1c/d25/d5e/d90/fb8 1406784 0 2024-09-04T16:30:20.251 INFO:tasks.workunit.client.1.smithi193.stdout:0/876: dwrite d18/d25/d32/d57/d6c/db1/fcc [4194304,4194304] 0 2024-09-04T16:30:20.253 INFO:tasks.workunit.client.1.smithi193.stdout:1/961: mkdir d1/d2b/d1b/d51/d6d/d89/dc7/df8/d127 0 2024-09-04T16:30:20.254 INFO:tasks.workunit.client.0.smithi170.stdout:9/360: dwrite d2/d3d/d27/f3a [0,4194304] 0 2024-09-04T16:30:20.257 INFO:tasks.workunit.client.1.smithi193.stdout:6/848: sync 2024-09-04T16:30:20.264 INFO:tasks.workunit.client.0.smithi170.stdout:9/361: mkdir d2/d3d/d27/d65/d66 0 2024-09-04T16:30:20.269 INFO:tasks.workunit.client.0.smithi170.stdout:9/362: mknod d2/d3d/d27/d65/c67 0 2024-09-04T16:30:20.269 INFO:tasks.workunit.client.1.smithi193.stdout:5/870: write d1/d8/db/d15/d2b/d83/d37/f9d [1721659,83907] 0 2024-09-04T16:30:20.270 INFO:tasks.workunit.client.1.smithi193.stdout:1/962: chown d1/d2b/f61 4100194 1 2024-09-04T16:30:20.270 INFO:tasks.workunit.client.0.smithi170.stdout:9/363: write d2/d3d/f20 [4148409,128352] 0 2024-09-04T16:30:20.271 INFO:tasks.workunit.client.1.smithi193.stdout:7/989: creat d9/d39/d3e/d53/d13d/f144 x:0 0 0 2024-09-04T16:30:20.271 INFO:tasks.workunit.client.1.smithi193.stdout:1/963: chown d1/d2b/db/d54/da1/fd4 117610999 1 2024-09-04T16:30:20.274 INFO:tasks.workunit.client.1.smithi193.stdout:6/849: fsync d5/d27/f35 0 2024-09-04T16:30:20.277 INFO:tasks.workunit.client.1.smithi193.stdout:9/938: truncate d2/d18/d2f/f7e 2559776 0 2024-09-04T16:30:20.278 INFO:tasks.workunit.client.1.smithi193.stdout:1/964: dread d1/d2b/d1b/dd9/ffa [0,4194304] 0 2024-09-04T16:30:20.280 INFO:tasks.workunit.client.0.smithi170.stdout:9/364: rename d2/d32/c62 to d2/d3d/d4d/d59/c68 0 2024-09-04T16:30:20.287 INFO:tasks.workunit.client.1.smithi193.stdout:2/851: truncate d2/d9/db/d10/f5c 233315 0 2024-09-04T16:30:20.289 INFO:tasks.workunit.client.1.smithi193.stdout:7/990: creat d9/d11/d113/d106/f145 x:0 0 0 2024-09-04T16:30:20.293 INFO:tasks.workunit.client.1.smithi193.stdout:1/965: stat d1/d2b/d10/cc1 0 2024-09-04T16:30:20.296 INFO:tasks.workunit.client.1.smithi193.stdout:4/804: dwrite d3/d3c/d47/ffd [0,4194304] 0 2024-09-04T16:30:20.298 INFO:tasks.workunit.client.1.smithi193.stdout:4/805: dread d3/d3c/d89/dbd/fc5 [0,4194304] 0 2024-09-04T16:30:20.299 INFO:tasks.workunit.client.1.smithi193.stdout:4/806: chown d3/d1a/d54/db1/c107 52 1 2024-09-04T16:30:20.306 INFO:tasks.workunit.client.1.smithi193.stdout:6/850: link d5/d33/d4e/d51/d68/fe1 d5/d33/d4e/d51/f10f 0 2024-09-04T16:30:20.306 INFO:tasks.workunit.client.1.smithi193.stdout:4/807: dwrite d3/d39/d44/dd5/fa2 [0,4194304] 0 2024-09-04T16:30:20.308 INFO:tasks.workunit.client.1.smithi193.stdout:4/808: write d3/d39/d44/dd5/d7b/f91 [1881053,26339] 0 2024-09-04T16:30:20.312 INFO:tasks.workunit.client.1.smithi193.stdout:1/966: rmdir d1/d39/d48/def 0 2024-09-04T16:30:20.314 INFO:tasks.workunit.client.1.smithi193.stdout:7/991: dread d9/d18/d1e/f71 [0,4194304] 0 2024-09-04T16:30:20.315 INFO:tasks.workunit.client.1.smithi193.stdout:4/809: dread d3/d3c/d47/ffd [0,4194304] 0 2024-09-04T16:30:20.318 INFO:tasks.workunit.client.1.smithi193.stdout:4/810: mkdir d3/d3c/dae/d10b 0 2024-09-04T16:30:20.319 INFO:tasks.workunit.client.1.smithi193.stdout:4/811: chown d3/d39/d44/dd5/daa/c10a 2255030 1 2024-09-04T16:30:20.321 INFO:tasks.workunit.client.1.smithi193.stdout:2/852: creat d2/d9/db/d10/d1e/d56/f11b x:0 0 0 2024-09-04T16:30:20.322 INFO:tasks.workunit.client.1.smithi193.stdout:4/812: dread - d3/d1a/d2a/d83/fb5 zero size 2024-09-04T16:30:20.324 INFO:tasks.workunit.client.1.smithi193.stdout:6/851: dread d5/f3f [0,4194304] 0 2024-09-04T16:30:20.325 INFO:tasks.workunit.client.1.smithi193.stdout:4/813: fdatasync d3/f1c 0 2024-09-04T16:30:20.326 INFO:tasks.workunit.client.1.smithi193.stdout:6/852: chown d5/d27/d3e/cf5 71851196 1 2024-09-04T16:30:20.328 INFO:tasks.workunit.client.1.smithi193.stdout:8/902: creat d2/d20/d23/d34/d46/f11e x:0 0 0 2024-09-04T16:30:20.329 INFO:tasks.workunit.client.1.smithi193.stdout:6/853: dread d5/de/d15/d48/fdd [0,4194304] 0 2024-09-04T16:30:20.331 INFO:tasks.workunit.client.1.smithi193.stdout:6/854: rmdir d5 39 2024-09-04T16:30:20.332 INFO:tasks.workunit.client.1.smithi193.stdout:8/903: mkdir d2/d20/d23/d24/d3c/de7/d11f 0 2024-09-04T16:30:20.333 INFO:tasks.workunit.client.1.smithi193.stdout:8/904: chown d2/d12/c119 634 1 2024-09-04T16:30:20.334 INFO:tasks.workunit.client.1.smithi193.stdout:6/855: dread - d5/d27/d3e/fe5 zero size 2024-09-04T16:30:20.336 INFO:tasks.workunit.client.1.smithi193.stdout:8/905: creat d2/d20/d23/d24/d3c/d65/dc8/de1/f120 x:0 0 0 2024-09-04T16:30:20.339 INFO:tasks.workunit.client.1.smithi193.stdout:8/906: truncate d2/d20/d23/d34/d46/f11e 19645 0 2024-09-04T16:30:20.341 INFO:tasks.workunit.client.1.smithi193.stdout:6/856: dwrite d5/d27/da0/ff7 [0,4194304] 0 2024-09-04T16:30:20.341 INFO:tasks.workunit.client.1.smithi193.stdout:2/853: creat d2/d9/db/d10/d1e/da4/f11c x:0 0 0 2024-09-04T16:30:20.347 INFO:tasks.workunit.client.1.smithi193.stdout:2/854: dread d2/d9/fdd [0,4194304] 0 2024-09-04T16:30:20.348 INFO:tasks.workunit.client.1.smithi193.stdout:4/814: rename d3/d1a/d2a/ddf to d3/d3c/d98/de2/dec/d10c 0 2024-09-04T16:30:20.349 INFO:tasks.workunit.client.1.smithi193.stdout:4/815: fsync d3/d1a/d21/d52/d7f/db6/fe5 0 2024-09-04T16:30:20.350 INFO:tasks.workunit.client.1.smithi193.stdout:7/992: mkdir d9/de/d27/d146 0 2024-09-04T16:30:20.351 INFO:tasks.workunit.client.1.smithi193.stdout:2/855: dread d2/f35 [0,4194304] 0 2024-09-04T16:30:20.352 INFO:tasks.workunit.client.1.smithi193.stdout:7/993: dread d9/d18/d22/fb7 [0,4194304] 0 2024-09-04T16:30:20.355 INFO:tasks.workunit.client.1.smithi193.stdout:2/856: mknod d2/d9/db/d10/d51/dca/c11d 0 2024-09-04T16:30:20.356 INFO:tasks.workunit.client.1.smithi193.stdout:7/994: dread d9/d39/d95/fb1 [0,4194304] 0 2024-09-04T16:30:20.360 INFO:tasks.workunit.client.1.smithi193.stdout:2/857: creat d2/d9/db/d10/d38/dac/dd1/f11e x:0 0 0 2024-09-04T16:30:20.365 INFO:tasks.workunit.client.0.smithi170.stdout:3/283: truncate d13/d14/f48 2603 0 2024-09-04T16:30:20.368 INFO:tasks.workunit.client.0.smithi170.stdout:3/284: creat d13/d14/d21/d4c/f5c x:0 0 0 2024-09-04T16:30:20.369 INFO:tasks.workunit.client.0.smithi170.stdout:3/285: write d13/d14/d17/f42 [318969,91763] 0 2024-09-04T16:30:20.371 INFO:tasks.workunit.client.0.smithi170.stdout:7/531: write d12/d15/d71/d42/d81/f2d [709527,37443] 0 2024-09-04T16:30:20.371 INFO:tasks.workunit.client.1.smithi193.stdout:7/995: dread d9/d39/d3e/f5c [0,4194304] 0 2024-09-04T16:30:20.372 INFO:tasks.workunit.client.0.smithi170.stdout:3/286: rmdir d13/d14/d1d/d2d/d3d 39 2024-09-04T16:30:20.376 INFO:tasks.workunit.client.0.smithi170.stdout:7/532: rename d12/d15/d41/f64 to d12/d16/d1d/d65/d82/fb9 0 2024-09-04T16:30:20.379 INFO:tasks.workunit.client.0.smithi170.stdout:7/533: dread d12/d15/fa4 [0,4194304] 0 2024-09-04T16:30:20.380 INFO:tasks.workunit.client.0.smithi170.stdout:3/287: dwrite d13/d14/d21/d46/f53 [0,4194304] 0 2024-09-04T16:30:20.383 INFO:tasks.workunit.client.0.smithi170.stdout:7/534: symlink d12/d15/d71/d42/d81/lba 0 2024-09-04T16:30:20.387 INFO:tasks.workunit.client.0.smithi170.stdout:7/535: creat d12/d16/d1d/d65/d82/fbb x:0 0 0 2024-09-04T16:30:20.388 INFO:tasks.workunit.client.0.smithi170.stdout:3/288: dread d13/d14/d1f/f3e [0,4194304] 0 2024-09-04T16:30:20.388 INFO:tasks.workunit.client.0.smithi170.stdout:3/289: fdatasync d13/d14/d1d/f28 0 2024-09-04T16:30:20.390 INFO:tasks.workunit.client.1.smithi193.stdout:3/873: truncate d0/d10/d24/d55/f9b 2468712 0 2024-09-04T16:30:20.395 INFO:tasks.workunit.client.0.smithi170.stdout:3/290: dwrite fb [0,4194304] 0 2024-09-04T16:30:20.398 INFO:tasks.workunit.client.0.smithi170.stdout:3/291: creat d13/d14/d21/d4c/f5d x:0 0 0 2024-09-04T16:30:20.398 INFO:tasks.workunit.client.1.smithi193.stdout:3/874: dwrite d0/d18/d1c/d51/d6c/ff7 [0,4194304] 0 2024-09-04T16:30:20.400 INFO:tasks.workunit.client.1.smithi193.stdout:0/877: mkdir d18/d25/d32/d9c/d122 0 2024-09-04T16:30:20.401 INFO:tasks.workunit.client.0.smithi170.stdout:3/292: dread d13/d14/d21/f2e [0,4194304] 0 2024-09-04T16:30:20.405 INFO:tasks.workunit.client.1.smithi193.stdout:3/875: symlink d0/d18/d1c/d51/d6c/l11c 0 2024-09-04T16:30:20.409 INFO:tasks.workunit.client.0.smithi170.stdout:7/536: dread d12/f72 [0,4194304] 0 2024-09-04T16:30:20.410 INFO:tasks.workunit.client.1.smithi193.stdout:0/878: creat d18/d25/d32/dce/dd7/f123 x:0 0 0 2024-09-04T16:30:20.411 INFO:tasks.workunit.client.1.smithi193.stdout:0/879: chown d18/d25/d5f/def/da0/cf7 1036768 1 2024-09-04T16:30:20.412 INFO:tasks.workunit.client.1.smithi193.stdout:3/876: creat d0/d18/d1b/d3d/d96/f11d x:0 0 0 2024-09-04T16:30:20.414 INFO:tasks.workunit.client.0.smithi170.stdout:9/365: write d2/d3d/d27/d2b/d34/f45 [340380,93376] 0 2024-09-04T16:30:20.415 INFO:tasks.workunit.client.0.smithi170.stdout:9/366: fdatasync d2/d3d/d27/d65/d56/f60 0 2024-09-04T16:30:20.416 INFO:tasks.workunit.client.0.smithi170.stdout:7/537: truncate d12/d15/f28 436659 0 2024-09-04T16:30:20.418 INFO:tasks.workunit.client.1.smithi193.stdout:3/877: dwrite d0/d10/fe7 [0,4194304] 0 2024-09-04T16:30:20.419 INFO:tasks.workunit.client.1.smithi193.stdout:3/878: chown d0/d18/d1c/d25/d5e/d68/c8a 4011413 1 2024-09-04T16:30:20.420 INFO:tasks.workunit.client.0.smithi170.stdout:7/538: unlink d12/d15/d71/d42/d81/l6c 0 2024-09-04T16:30:20.422 INFO:tasks.workunit.client.1.smithi193.stdout:3/879: creat d0/d18/d1c/d25/da0/dcd/f11e x:0 0 0 2024-09-04T16:30:20.423 INFO:tasks.workunit.client.1.smithi193.stdout:3/880: stat d0/d9/dae/fed 0 2024-09-04T16:30:20.424 INFO:tasks.workunit.client.0.smithi170.stdout:7/539: rename d12/d15/d71/d42/d81/f3d to d12/d15/d71/d42/d81/fbc 0 2024-09-04T16:30:20.427 INFO:tasks.workunit.client.0.smithi170.stdout:7/540: rmdir d12/d16 39 2024-09-04T16:30:20.427 INFO:tasks.workunit.client.0.smithi170.stdout:7/541: chown d12/f95 488115312 1 2024-09-04T16:30:20.429 INFO:tasks.workunit.client.0.smithi170.stdout:7/542: write d12/d15/d71/f56 [2229574,24007] 0 2024-09-04T16:30:20.430 INFO:tasks.workunit.client.1.smithi193.stdout:3/881: link d0/d18/d1c/d25/d5e/d7e/c80 d0/d7/de/c11f 0 2024-09-04T16:30:20.431 INFO:tasks.workunit.client.1.smithi193.stdout:3/882: chown d0/d18/d1c/d25/d5e/d7e/f7c 14265205 1 2024-09-04T16:30:20.431 INFO:tasks.workunit.client.0.smithi170.stdout:7/543: creat d12/d15/d71/d42/d79/fbd x:0 0 0 2024-09-04T16:30:20.432 INFO:tasks.workunit.client.1.smithi193.stdout:3/883: truncate d0/f89 2871090 0 2024-09-04T16:30:20.434 INFO:tasks.workunit.client.0.smithi170.stdout:7/544: mknod d12/d15/d41/cbe 0 2024-09-04T16:30:20.438 INFO:tasks.workunit.client.0.smithi170.stdout:7/545: symlink d12/d16/db7/lbf 0 2024-09-04T16:30:20.438 INFO:tasks.workunit.client.1.smithi193.stdout:3/884: dwrite d0/d18/d1c/d30/d8e/fe8 [0,4194304] 0 2024-09-04T16:30:20.440 INFO:tasks.workunit.client.0.smithi170.stdout:7/546: mknod d12/d15/d71/d42/d79/d9d/cc0 0 2024-09-04T16:30:20.442 INFO:tasks.workunit.client.1.smithi193.stdout:3/885: symlink d0/d18/d1c/d51/d7a/dbf/l120 0 2024-09-04T16:30:20.442 INFO:tasks.workunit.client.0.smithi170.stdout:7/547: unlink d12/d16/d1d/f32 0 2024-09-04T16:30:20.444 INFO:tasks.workunit.client.1.smithi193.stdout:1/967: sync 2024-09-04T16:30:20.444 INFO:tasks.workunit.client.1.smithi193.stdout:9/939: sync 2024-09-04T16:30:20.445 INFO:tasks.workunit.client.1.smithi193.stdout:3/886: mknod d0/d9/dae/d101/c121 0 2024-09-04T16:30:20.445 INFO:tasks.workunit.client.1.smithi193.stdout:1/968: read - d1/d2b/d10/d56/d11d/f103 zero size 2024-09-04T16:30:20.447 INFO:tasks.workunit.client.1.smithi193.stdout:1/969: stat d1/d2b/d1b/d28/d50/d84/dd1/de2/leb 0 2024-09-04T16:30:20.448 INFO:tasks.workunit.client.1.smithi193.stdout:9/940: mkdir d2/d18/d2f/d22/d30/d6a/d6e/de2/d10f/d128 0 2024-09-04T16:30:20.449 INFO:tasks.workunit.client.1.smithi193.stdout:9/941: chown d2/deb 614 1 2024-09-04T16:30:20.449 INFO:tasks.workunit.client.1.smithi193.stdout:1/970: truncate d1/d39/fce 3745020 0 2024-09-04T16:30:20.451 INFO:tasks.workunit.client.1.smithi193.stdout:3/887: dwrite d0/d3b/fc9 [4194304,4194304] 0 2024-09-04T16:30:20.452 INFO:tasks.workunit.client.1.smithi193.stdout:3/888: fdatasync d0/d10/fe7 0 2024-09-04T16:30:20.453 INFO:tasks.workunit.client.1.smithi193.stdout:9/942: fdatasync d2/d8/f26 0 2024-09-04T16:30:20.453 INFO:tasks.workunit.client.1.smithi193.stdout:3/889: fdatasync d0/d10/fe7 0 2024-09-04T16:30:20.453 INFO:tasks.workunit.client.1.smithi193.stdout:9/943: chown d2/d8 62 1 2024-09-04T16:30:20.454 INFO:tasks.workunit.client.1.smithi193.stdout:1/971: mkdir d1/d2b/d128 0 2024-09-04T16:30:20.455 INFO:tasks.workunit.client.1.smithi193.stdout:9/944: fdatasync d2/d18/d2f/d22/d30/d6a/d6e/de2/d107/f121 0 2024-09-04T16:30:20.458 INFO:tasks.workunit.client.1.smithi193.stdout:9/945: read d2/d18/d2f/d22/d30/d6a/d6e/de2/d10f/f114 [146696,75130] 0 2024-09-04T16:30:20.458 INFO:tasks.workunit.client.0.smithi170.stdout:7/548: dread d12/d15/d71/d42/d81/d5c/f74 [0,4194304] 0 2024-09-04T16:30:20.460 INFO:tasks.workunit.client.1.smithi193.stdout:1/972: dwrite d1/d2b/db/d54/f70 [0,4194304] 0 2024-09-04T16:30:20.461 INFO:tasks.workunit.client.1.smithi193.stdout:3/890: mkdir d0/d9/dae/d112/d122 0 2024-09-04T16:30:20.463 INFO:tasks.workunit.client.1.smithi193.stdout:9/946: rmdir d2/d18/d2f/d22/d30/d6a/d6e/d81/d93 39 2024-09-04T16:30:20.465 INFO:tasks.workunit.client.1.smithi193.stdout:1/973: chown d1/d2b/d10/d2a/lc2 259 1 2024-09-04T16:30:20.466 INFO:tasks.workunit.client.1.smithi193.stdout:1/974: chown d1/d2b/d1b/d28/d50/d84/dd1/de2/lfd 1 1 2024-09-04T16:30:20.467 INFO:tasks.workunit.client.0.smithi170.stdout:7/549: symlink d12/lc1 0 2024-09-04T16:30:20.470 INFO:tasks.workunit.client.1.smithi193.stdout:1/975: fsync d1/d2b/d10/f91 0 2024-09-04T16:30:20.473 INFO:tasks.workunit.client.1.smithi193.stdout:1/976: mknod d1/d2b/d10/d56/d11d/c129 0 2024-09-04T16:30:20.475 INFO:tasks.workunit.client.1.smithi193.stdout:9/947: creat d2/d4/f129 x:0 0 0 2024-09-04T16:30:20.476 INFO:tasks.workunit.client.1.smithi193.stdout:9/948: chown d2/d18/d2f/d9a/fdd 1744629172 1 2024-09-04T16:30:20.477 INFO:tasks.workunit.client.1.smithi193.stdout:5/871: link d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/db9/fe5 d1/d29/f11d 0 2024-09-04T16:30:20.478 INFO:tasks.workunit.client.1.smithi193.stdout:1/977: rmdir d1 39 2024-09-04T16:30:20.479 INFO:tasks.workunit.client.1.smithi193.stdout:9/949: creat d2/deb/d11d/f12a x:0 0 0 2024-09-04T16:30:20.479 INFO:tasks.workunit.client.1.smithi193.stdout:5/872: fsync d1/d8/db/d15/d2b/d83/fd1 0 2024-09-04T16:30:20.482 INFO:tasks.workunit.client.1.smithi193.stdout:6/857: write d5/d27/d3e/d43/d5d/f104 [59850,7860] 0 2024-09-04T16:30:20.486 INFO:tasks.workunit.client.1.smithi193.stdout:4/816: write d3/d1a/d21/f2c [4674058,6088] 0 2024-09-04T16:30:20.486 INFO:tasks.workunit.client.1.smithi193.stdout:8/907: dwrite d2/d20/dc0/d82/fdc [0,4194304] 0 2024-09-04T16:30:20.489 INFO:tasks.workunit.client.1.smithi193.stdout:1/978: dread d1/d2b/db/d54/da1/fc3 [0,4194304] 0 2024-09-04T16:30:20.489 INFO:tasks.workunit.client.1.smithi193.stdout:5/873: getdents d1/d8/db/d36/d40/d46 0 2024-09-04T16:30:20.493 INFO:tasks.workunit.client.1.smithi193.stdout:5/874: write d1/d8/db/d15/f30 [8555250,55844] 0 2024-09-04T16:30:20.493 INFO:tasks.workunit.client.1.smithi193.stdout:6/858: rename d5/d33/d4e/d51/fb0 to d5/d33/d4e/d51/f110 0 2024-09-04T16:30:20.495 INFO:tasks.workunit.client.1.smithi193.stdout:4/817: rename d3/d1a/d2a/db9/cd8 to d3/d1a/d21/d52/d7f/db6/df9/c10d 0 2024-09-04T16:30:20.495 INFO:tasks.workunit.client.1.smithi193.stdout:5/875: stat d1/d8/db/d15/lf4 0 2024-09-04T16:30:20.497 INFO:tasks.workunit.client.1.smithi193.stdout:8/908: dwrite d2/d20/d23/d34/d46/d53/fa5 [4194304,4194304] 0 2024-09-04T16:30:20.498 INFO:tasks.workunit.client.1.smithi193.stdout:4/818: creat d3/d1a/d2a/f10e x:0 0 0 2024-09-04T16:30:20.498 INFO:tasks.workunit.client.1.smithi193.stdout:5/876: truncate d1/d8/db/d36/d40/fde 477789 0 2024-09-04T16:30:20.499 INFO:tasks.workunit.client.1.smithi193.stdout:6/859: mknod d5/d33/d4e/d51/d71/dcf/d10b/c111 0 2024-09-04T16:30:20.499 INFO:tasks.workunit.client.1.smithi193.stdout:8/909: stat d2/d20/d23/d51/d76/fe8 0 2024-09-04T16:30:20.502 INFO:tasks.workunit.client.1.smithi193.stdout:6/860: creat d5/d33/d85/f112 x:0 0 0 2024-09-04T16:30:20.509 INFO:tasks.workunit.client.0.smithi170.stdout:1/451: sync 2024-09-04T16:30:20.509 INFO:tasks.workunit.client.0.smithi170.stdout:1/452: write d9/d26/f56 [5075957,3527] 0 2024-09-04T16:30:20.510 INFO:tasks.workunit.client.1.smithi193.stdout:4/819: rename d3/d1a/d21/d52/f6c to d3/f10f 0 2024-09-04T16:30:20.557 INFO:tasks.workunit.client.1.smithi193.stdout:2/858: sync 2024-09-04T16:30:20.563 INFO:tasks.workunit.client.1.smithi193.stdout:4/820: read d3/d39/d44/dd5/fa5 [2124943,41695] 0 2024-09-04T16:30:20.564 INFO:tasks.workunit.client.0.smithi170.stdout:1/453: mkdir d9/d7b/d8f 0 2024-09-04T16:30:20.564 INFO:tasks.workunit.client.1.smithi193.stdout:4/821: write d3/d3c/f53 [798373,4505] 0 2024-09-04T16:30:20.564 INFO:tasks.workunit.client.1.smithi193.stdout:5/877: getdents d1/d8/db/d15/d2b/d83/d37/d3f/d8e 0 2024-09-04T16:30:20.565 INFO:tasks.workunit.client.0.smithi170.stdout:1/454: write d9/d11/f1a [3579514,57117] 0 2024-09-04T16:30:20.567 INFO:tasks.workunit.client.1.smithi193.stdout:8/910: rename d2/d20/d23/d34/d46/d53/ce0 to d2/d20/d23/d34/d4b/d7c/dfb/c121 0 2024-09-04T16:30:20.569 INFO:tasks.workunit.client.1.smithi193.stdout:0/880: creat d18/d25/d32/f124 x:0 0 0 2024-09-04T16:30:20.569 INFO:tasks.workunit.client.1.smithi193.stdout:2/859: symlink d2/d9/db/d10/d1e/da4/d9a/l11f 0 2024-09-04T16:30:20.570 INFO:tasks.workunit.client.0.smithi170.stdout:1/455: creat d9/d26/d77/d83/f90 x:0 0 0 2024-09-04T16:30:20.574 INFO:tasks.workunit.client.1.smithi193.stdout:5/878: rename d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/fdf to d1/d8/db/d15/d2b/d83/d37/d58/dc4/dda/f11e 0 2024-09-04T16:30:20.574 INFO:tasks.workunit.client.1.smithi193.stdout:5/879: chown d1/l71 706 1 2024-09-04T16:30:20.575 INFO:tasks.workunit.client.0.smithi170.stdout:1/456: rename d9/d11/d3e/f50 to d9/d11/d3e/f91 0 2024-09-04T16:30:20.576 INFO:tasks.workunit.client.1.smithi193.stdout:0/881: write f6 [5845077,13781] 0 2024-09-04T16:30:20.576 INFO:tasks.workunit.client.0.smithi170.stdout:3/293: write d13/d14/d1d/f27 [2459684,80471] 0 2024-09-04T16:30:20.576 INFO:tasks.workunit.client.1.smithi193.stdout:0/882: fdatasync d18/d25/d32/dce/dd7/f10a 0 2024-09-04T16:30:20.577 INFO:tasks.workunit.client.1.smithi193.stdout:2/860: truncate d2/d9/db/d10/d1e/da4/d9a/fa9 666437 0 2024-09-04T16:30:20.579 INFO:tasks.workunit.client.0.smithi170.stdout:3/294: dread d13/d14/d1d/f28 [0,4194304] 0 2024-09-04T16:30:20.580 INFO:tasks.workunit.client.0.smithi170.stdout:1/457: symlink d9/d11/d2f/d7f/l92 0 2024-09-04T16:30:20.581 INFO:tasks.workunit.client.1.smithi193.stdout:2/861: dread d2/d9/db/d10/d38/dac/df2/f115 [0,4194304] 0 2024-09-04T16:30:20.581 INFO:tasks.workunit.client.0.smithi170.stdout:1/458: stat d9/d11/c23 0 2024-09-04T16:30:20.582 INFO:tasks.workunit.client.0.smithi170.stdout:1/459: write d9/d34/d5f/f66 [365668,105623] 0 2024-09-04T16:30:20.583 INFO:tasks.workunit.client.0.smithi170.stdout:3/295: mknod d13/d14/d21/d4d/d4e/c5e 0 2024-09-04T16:30:20.585 INFO:tasks.workunit.client.1.smithi193.stdout:5/880: creat d1/d8/db/d36/d40/d46/dbe/f11f x:0 0 0 2024-09-04T16:30:20.586 INFO:tasks.workunit.client.1.smithi193.stdout:0/883: mkdir d18/d109/d125 0 2024-09-04T16:30:20.587 INFO:tasks.workunit.client.0.smithi170.stdout:9/367: write d2/fd [1950976,43192] 0 2024-09-04T16:30:20.588 INFO:tasks.workunit.client.0.smithi170.stdout:9/368: fdatasync d2/d11/d23/f30 0 2024-09-04T16:30:20.592 INFO:tasks.workunit.client.0.smithi170.stdout:3/296: creat d13/f5f x:0 0 0 2024-09-04T16:30:20.595 INFO:tasks.workunit.client.1.smithi193.stdout:2/862: creat d2/d9/d18/d7b/f120 x:0 0 0 2024-09-04T16:30:20.595 INFO:tasks.workunit.client.0.smithi170.stdout:1/460: dread d9/f10 [4194304,4194304] 0 2024-09-04T16:30:20.599 INFO:tasks.workunit.client.0.smithi170.stdout:9/369: symlink d2/d3d/d27/d2b/d34/l69 0 2024-09-04T16:30:20.601 INFO:tasks.workunit.client.0.smithi170.stdout:3/297: creat d13/d14/d1f/f60 x:0 0 0 2024-09-04T16:30:20.607 INFO:tasks.workunit.client.1.smithi193.stdout:2/863: link d2/d9/db/d10/d1e/da4/f105 d2/d9/db/d10/d38/da5/dc7/f121 0 2024-09-04T16:30:20.607 INFO:tasks.workunit.client.1.smithi193.stdout:5/881: dread d1/d29/d18/f5e [0,4194304] 0 2024-09-04T16:30:20.608 INFO:tasks.workunit.client.1.smithi193.stdout:7/996: sync 2024-09-04T16:30:20.608 INFO:tasks.workunit.client.1.smithi193.stdout:3/891: sync 2024-09-04T16:30:20.609 INFO:tasks.workunit.client.0.smithi170.stdout:3/298: creat d13/d14/d1d/f61 x:0 0 0 2024-09-04T16:30:20.612 INFO:tasks.workunit.client.1.smithi193.stdout:2/864: write d2/d9/db/d10/d1e/d26/f3a [4828450,22989] 0 2024-09-04T16:30:20.613 INFO:tasks.workunit.client.1.smithi193.stdout:3/892: readlink d0/l20 0 2024-09-04T16:30:20.615 INFO:tasks.workunit.client.0.smithi170.stdout:3/299: write d13/d14/d1d/d2d/d3d/f5a [415970,92440] 0 2024-09-04T16:30:20.616 INFO:tasks.workunit.client.1.smithi193.stdout:7/997: fsync d9/d39/d3e/d53/fa5 0 2024-09-04T16:30:20.616 INFO:tasks.workunit.client.0.smithi170.stdout:3/300: chown d13 263562839 1 2024-09-04T16:30:20.617 INFO:tasks.workunit.client.1.smithi193.stdout:0/884: link d18/d25/d5f/d6a/d7b/cdc d18/d25/d32/d57/d6c/db1/deb/c126 0 2024-09-04T16:30:20.617 INFO:tasks.workunit.client.1.smithi193.stdout:0/885: chown d18/d25/d32/d9c 101998293 1 2024-09-04T16:30:20.618 INFO:tasks.workunit.client.1.smithi193.stdout:2/865: mknod d2/d9/d18/d7b/c122 0 2024-09-04T16:30:20.619 INFO:tasks.workunit.client.0.smithi170.stdout:3/301: mknod d13/d14/d21/d4c/c62 0 2024-09-04T16:30:20.620 INFO:tasks.workunit.client.1.smithi193.stdout:3/893: creat d0/d18/d1c/d51/d5a/da2/f123 x:0 0 0 2024-09-04T16:30:20.621 INFO:tasks.workunit.client.1.smithi193.stdout:5/882: creat d1/d8/db/d36/d40/dc1/dc8/f120 x:0 0 0 2024-09-04T16:30:20.626 INFO:tasks.workunit.client.1.smithi193.stdout:2/866: creat d2/d9/db/d10/d51/d87/d119/f123 x:0 0 0 2024-09-04T16:30:20.628 INFO:tasks.workunit.client.1.smithi193.stdout:5/883: mknod d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/db9/c121 0 2024-09-04T16:30:20.628 INFO:tasks.workunit.client.0.smithi170.stdout:7/550: write d12/d16/f3f [95154,26928] 0 2024-09-04T16:30:20.628 INFO:tasks.workunit.client.0.smithi170.stdout:3/302: link d13/d14/c39 d13/d14/c63 0 2024-09-04T16:30:20.629 INFO:tasks.workunit.client.0.smithi170.stdout:7/551: write d12/d16/d1d/d65/d82/fa1 [153172,122104] 0 2024-09-04T16:30:20.633 INFO:tasks.workunit.client.1.smithi193.stdout:3/894: dread d0/d18/d1c/d51/d5a/f77 [4194304,4194304] 0 2024-09-04T16:30:20.635 INFO:tasks.workunit.client.1.smithi193.stdout:7/998: link d9/de/lfc d9/d39/d3e/l147 0 2024-09-04T16:30:20.636 INFO:tasks.workunit.client.1.smithi193.stdout:9/950: write d2/d8/f8e [477945,69393] 0 2024-09-04T16:30:20.636 INFO:tasks.workunit.client.0.smithi170.stdout:7/552: dwrite d12/d15/d71/f3e [0,4194304] 0 2024-09-04T16:30:20.638 INFO:tasks.workunit.client.1.smithi193.stdout:3/895: creat d0/d9/d49/d87/f124 x:0 0 0 2024-09-04T16:30:20.639 INFO:tasks.workunit.client.1.smithi193.stdout:3/896: write d0/d9/dae/fed [289713,86036] 0 2024-09-04T16:30:20.639 INFO:tasks.workunit.client.1.smithi193.stdout:2/867: rename d2/d9/db/d10/d1f/f42 to d2/d9/db/d10/d1e/d56/d59/f124 0 2024-09-04T16:30:20.644 INFO:tasks.workunit.client.1.smithi193.stdout:9/951: chown d2/d4/c59 1 1 2024-09-04T16:30:20.645 INFO:tasks.workunit.client.0.smithi170.stdout:7/553: dwrite d12/d15/d71/d42/f60 [0,4194304] 0 2024-09-04T16:30:20.645 INFO:tasks.workunit.client.1.smithi193.stdout:9/952: chown d2/d8/d15/f35 15509 1 2024-09-04T16:30:20.650 INFO:tasks.workunit.client.1.smithi193.stdout:5/884: rename d1/d8/db/d15/d2b/d83/d37/f4d to d1/d29/d74/f122 0 2024-09-04T16:30:20.652 INFO:tasks.workunit.client.1.smithi193.stdout:2/868: mkdir d2/d9/db/d10/d51/dca/d125 0 2024-09-04T16:30:20.653 INFO:tasks.workunit.client.1.smithi193.stdout:9/953: dwrite d2/d8/d25/db2/fef [0,4194304] 0 2024-09-04T16:30:20.654 INFO:tasks.workunit.client.1.smithi193.stdout:2/869: write d2/d9/f36 [2876934,46572] 0 2024-09-04T16:30:20.657 INFO:tasks.workunit.client.1.smithi193.stdout:5/885: truncate d1/d8/db/d15/d2b/d83/d37/d3f/d8e/f66 2362539 0 2024-09-04T16:30:20.659 INFO:tasks.workunit.client.1.smithi193.stdout:2/870: creat d2/d9/db/d10/d1f/d4a/dc2/dc4/f126 x:0 0 0 2024-09-04T16:30:20.659 INFO:tasks.workunit.client.1.smithi193.stdout:6/861: write d5/d33/d4e/d51/d71/d82/fc4 [879923,121146] 0 2024-09-04T16:30:20.661 INFO:tasks.workunit.client.1.smithi193.stdout:5/886: truncate d1/d8/db/d36/d40/dc1/dc8/f120 586304 0 2024-09-04T16:30:20.663 INFO:tasks.workunit.client.1.smithi193.stdout:9/954: rename d2/d18/fff to d2/d18/d2f/d22/d30/dee/f12b 0 2024-09-04T16:30:20.664 INFO:tasks.workunit.client.0.smithi170.stdout:7/554: dread d12/d15/d71/f70 [0,4194304] 0 2024-09-04T16:30:20.665 INFO:tasks.workunit.client.1.smithi193.stdout:2/871: creat d2/d9/db/d10/d51/d79/f127 x:0 0 0 2024-09-04T16:30:20.666 INFO:tasks.workunit.client.1.smithi193.stdout:6/862: creat d5/d27/d3e/d8c/f113 x:0 0 0 2024-09-04T16:30:20.667 INFO:tasks.workunit.client.1.smithi193.stdout:5/887: mkdir d1/d29/d74/d96/dfd/d123 0 2024-09-04T16:30:20.672 INFO:tasks.workunit.client.1.smithi193.stdout:9/955: dwrite d2/deb/d11d/f7f [0,4194304] 0 2024-09-04T16:30:20.683 INFO:tasks.workunit.client.1.smithi193.stdout:1/979: sync 2024-09-04T16:30:20.701 INFO:tasks.workunit.client.1.smithi193.stdout:0/886: sync 2024-09-04T16:30:20.701 INFO:tasks.workunit.client.1.smithi193.stdout:4/822: sync 2024-09-04T16:30:20.702 INFO:tasks.workunit.client.1.smithi193.stdout:0/887: write d18/d25/d5f/def/da0/ffe [138694,92961] 0 2024-09-04T16:30:20.706 INFO:tasks.workunit.client.1.smithi193.stdout:4/823: dwrite d3/ff0 [0,4194304] 0 2024-09-04T16:30:20.776 INFO:tasks.workunit.client.0.smithi170.stdout:7/555: symlink d12/d16/d1d/d65/d82/da8/lc2 0 2024-09-04T16:30:20.777 INFO:tasks.workunit.client.1.smithi193.stdout:2/872: write d2/d9/db/d10/d38/da5/feb [963102,121287] 0 2024-09-04T16:30:20.777 INFO:tasks.workunit.client.1.smithi193.stdout:6/863: mknod d5/d33/d85/c114 0 2024-09-04T16:30:20.778 INFO:tasks.workunit.client.1.smithi193.stdout:6/864: dread - d5/d33/d4e/d51/d7b/de0/fe2 zero size 2024-09-04T16:30:20.782 INFO:tasks.workunit.client.0.smithi170.stdout:7/556: dread d12/f30 [0,4194304] 0 2024-09-04T16:30:20.783 INFO:tasks.workunit.client.0.smithi170.stdout:7/557: write d12/d15/d71/f7f [480765,57329] 0 2024-09-04T16:30:20.783 INFO:tasks.workunit.client.0.smithi170.stdout:7/558: fdatasync d12/d15/d71/f36 0 2024-09-04T16:30:20.839 INFO:tasks.workunit.client.1.smithi193.stdout:5/888: creat d1/dd0/de9/f124 x:0 0 0 2024-09-04T16:30:20.839 INFO:tasks.workunit.client.1.smithi193.stdout:5/889: chown d1/d8/db/d15/d2b/lf2 4 1 2024-09-04T16:30:20.841 INFO:tasks.workunit.client.1.smithi193.stdout:9/956: symlink d2/d56/d86/l12c 0 2024-09-04T16:30:20.845 INFO:tasks.workunit.client.1.smithi193.stdout:1/980: rename d1/d39/l66 to d1/d2b/d1b/d28/d50/l12a 0 2024-09-04T16:30:20.847 INFO:tasks.workunit.client.1.smithi193.stdout:8/911: write d2/d12/f43 [4433271,122682] 0 2024-09-04T16:30:20.852 INFO:tasks.workunit.client.1.smithi193.stdout:6/865: unlink d5/de/d15/d48/l83 0 2024-09-04T16:30:20.853 INFO:tasks.workunit.client.1.smithi193.stdout:6/866: dread d5/d33/d4e/d51/d68/fe1 [0,4194304] 0 2024-09-04T16:30:20.854 INFO:tasks.workunit.client.1.smithi193.stdout:9/957: readlink d2/l74 0 2024-09-04T16:30:20.855 INFO:tasks.workunit.client.1.smithi193.stdout:9/958: fsync d2/d18/d2f/fc3 0 2024-09-04T16:30:20.856 INFO:tasks.workunit.client.1.smithi193.stdout:9/959: write d2/d18/d2f/d22/d30/d6a/fa7 [827606,119714] 0 2024-09-04T16:30:20.858 INFO:tasks.workunit.client.1.smithi193.stdout:4/824: rename d3/d3c/d89/cc8 to d3/d81/c110 0 2024-09-04T16:30:20.859 INFO:tasks.workunit.client.1.smithi193.stdout:4/825: fsync d3/d39/d44/dd5/fa2 0 2024-09-04T16:30:20.859 INFO:tasks.workunit.client.1.smithi193.stdout:0/888: creat d18/d25/d32/d9c/d122/f127 x:0 0 0 2024-09-04T16:30:20.860 INFO:tasks.workunit.client.1.smithi193.stdout:8/912: mknod d2/d20/d23/d24/d3c/de7/c122 0 2024-09-04T16:30:20.863 INFO:tasks.workunit.client.1.smithi193.stdout:8/913: truncate d2/d20/d23/d34/dd6/da0/da8/db9/f110 521451 0 2024-09-04T16:30:20.863 INFO:tasks.workunit.client.0.smithi170.stdout:9/370: write d2/d32/f41 [4031916,70020] 0 2024-09-04T16:30:20.868 INFO:tasks.workunit.client.0.smithi170.stdout:1/461: dwrite d9/d11/f14 [0,4194304] 0 2024-09-04T16:30:20.871 INFO:tasks.workunit.client.1.smithi193.stdout:1/981: unlink d1/d2b/f31 0 2024-09-04T16:30:20.872 INFO:tasks.workunit.client.0.smithi170.stdout:1/462: write d9/d11/d2e/f89 [414927,118383] 0 2024-09-04T16:30:20.874 INFO:tasks.workunit.client.0.smithi170.stdout:9/371: dwrite d2/d3d/f57 [0,4194304] 0 2024-09-04T16:30:20.875 INFO:tasks.workunit.client.0.smithi170.stdout:1/463: dread - d9/d34/d5f/f71 zero size 2024-09-04T16:30:20.876 INFO:tasks.workunit.client.0.smithi170.stdout:9/372: chown d2/d3d/d27/d65/f52 30629006 1 2024-09-04T16:30:20.877 INFO:tasks.workunit.client.1.smithi193.stdout:9/960: symlink d2/d18/d2f/d9a/l12d 0 2024-09-04T16:30:20.882 INFO:tasks.workunit.client.0.smithi170.stdout:9/373: creat d2/d3d/d27/d2b/f6a x:0 0 0 2024-09-04T16:30:20.884 INFO:tasks.workunit.client.1.smithi193.stdout:0/889: mkdir d18/d25/d32/d57/d6c/d128 0 2024-09-04T16:30:20.886 INFO:tasks.workunit.client.1.smithi193.stdout:0/890: truncate d18/d25/d32/dce/dd7/f10a 128930 0 2024-09-04T16:30:20.887 INFO:tasks.workunit.client.0.smithi170.stdout:9/374: creat d2/d3d/d27/d2b/d34/f6b x:0 0 0 2024-09-04T16:30:20.887 INFO:tasks.workunit.client.0.smithi170.stdout:3/303: write f12 [8782914,13422] 0 2024-09-04T16:30:20.887 INFO:tasks.workunit.client.0.smithi170.stdout:5/267: sync 2024-09-04T16:30:20.887 INFO:tasks.workunit.client.0.smithi170.stdout:3/304: readlink d13/d14/l3c 0 2024-09-04T16:30:20.888 INFO:tasks.workunit.client.1.smithi193.stdout:8/914: fsync d2/d20/d23/d34/d4b/d7c/df9/f10d 0 2024-09-04T16:30:20.888 INFO:tasks.workunit.client.0.smithi170.stdout:9/375: write d2/d3d/d27/f53 [165977,77529] 0 2024-09-04T16:30:20.891 INFO:tasks.workunit.client.0.smithi170.stdout:3/305: write d13/d14/d21/f3a [3135411,129913] 0 2024-09-04T16:30:20.891 INFO:tasks.workunit.client.0.smithi170.stdout:9/376: dread - d2/d3d/d27/d2b/d34/f6b zero size 2024-09-04T16:30:20.892 INFO:tasks.workunit.client.0.smithi170.stdout:1/464: getdents d9/d11/d3e 0 2024-09-04T16:30:20.893 INFO:tasks.workunit.client.0.smithi170.stdout:3/306: read d13/d14/d21/d46/f53 [3078966,114606] 0 2024-09-04T16:30:20.896 INFO:tasks.workunit.client.1.smithi193.stdout:3/897: write d0/d18/d1c/d51/fca [4515723,14118] 0 2024-09-04T16:30:20.898 INFO:tasks.workunit.client.1.smithi193.stdout:7/999: dwrite d9/d39/d3e/d4d/d4f/ff9 [0,4194304] 0 2024-09-04T16:30:20.899 INFO:tasks.workunit.client.0.smithi170.stdout:3/307: dwrite f12 [0,4194304] 0 2024-09-04T16:30:20.899 INFO:tasks.workunit.client.0.smithi170.stdout:3/308: stat cc 0 2024-09-04T16:30:20.901 INFO:tasks.workunit.client.0.smithi170.stdout:3/309: write d13/d14/d21/d4c/f5d [73886,108194] 0 2024-09-04T16:30:20.902 INFO:tasks.workunit.client.1.smithi193.stdout:3/898: dread d0/d18/d1c/d30/d8e/fe8 [0,4194304] 0 2024-09-04T16:30:20.902 INFO:tasks.workunit.client.0.smithi170.stdout:3/310: fdatasync fb 0 2024-09-04T16:30:20.906 INFO:tasks.workunit.client.1.smithi193.stdout:8/915: mknod d2/d12/c123 0 2024-09-04T16:30:20.909 INFO:tasks.workunit.client.1.smithi193.stdout:1/982: mkdir d1/d2b/d10/d2a/d12b 0 2024-09-04T16:30:20.911 INFO:tasks.workunit.client.1.smithi193.stdout:1/983: dread d1/d2b/db/d54/da1/fc3 [0,4194304] 0 2024-09-04T16:30:20.916 INFO:tasks.workunit.client.1.smithi193.stdout:6/867: link d5/d33/d4e/l7c d5/d33/d4e/d51/d7b/l115 0 2024-09-04T16:30:20.921 INFO:tasks.workunit.client.1.smithi193.stdout:3/899: dread d0/f47 [0,4194304] 0 2024-09-04T16:30:20.921 INFO:tasks.workunit.client.1.smithi193.stdout:8/916: truncate d2/d20/d23/d1b/d4e/f55 3215765 0 2024-09-04T16:30:20.922 INFO:tasks.workunit.client.1.smithi193.stdout:1/984: symlink d1/d2b/d1b/d28/l12c 0 2024-09-04T16:30:20.925 INFO:tasks.workunit.client.0.smithi170.stdout:5/268: unlink d4/d8/d1c/d26/l28 0 2024-09-04T16:30:20.925 INFO:tasks.workunit.client.1.smithi193.stdout:2/873: write d2/d9/db/d10/d51/dca/f11a [65603,45066] 0 2024-09-04T16:30:20.927 INFO:tasks.workunit.client.0.smithi170.stdout:7/559: dwrite d12/f30 [0,4194304] 0 2024-09-04T16:30:20.927 INFO:tasks.workunit.client.1.smithi193.stdout:2/874: write d2/d9/d18/ff5 [805592,70986] 0 2024-09-04T16:30:20.928 INFO:tasks.workunit.client.1.smithi193.stdout:0/891: link d18/d25/d32/d9c/da9/lea d18/d25/d3b/de9/l129 0 2024-09-04T16:30:20.929 INFO:tasks.workunit.client.0.smithi170.stdout:9/377: symlink d2/d3d/d35/l6c 0 2024-09-04T16:30:20.929 INFO:tasks.workunit.client.1.smithi193.stdout:2/875: truncate d2/d9/db/d10/d1f/d77/d91/dff/f107 37136 0 2024-09-04T16:30:20.933 INFO:tasks.workunit.client.1.smithi193.stdout:8/917: mkdir d2/d20/d23/d34/d124 0 2024-09-04T16:30:20.935 INFO:tasks.workunit.client.1.smithi193.stdout:1/985: truncate d1/d2b/d1b/d51/d6d/d89/f93 976174 0 2024-09-04T16:30:20.937 INFO:tasks.workunit.client.1.smithi193.stdout:8/918: dread d2/d20/dc0/d82/fdc [0,4194304] 0 2024-09-04T16:30:20.938 INFO:tasks.workunit.client.0.smithi170.stdout:5/269: creat d4/d8/d1c/d41/f4f x:0 0 0 2024-09-04T16:30:20.939 INFO:tasks.workunit.client.1.smithi193.stdout:2/876: mknod d2/d9/db/d10/d1e/d56/c128 0 2024-09-04T16:30:20.939 INFO:tasks.workunit.client.1.smithi193.stdout:5/890: truncate d1/d8/f2d 377550 0 2024-09-04T16:30:20.940 INFO:tasks.workunit.client.1.smithi193.stdout:2/877: write d2/d9/db/d10/d4e/fbd [1669488,80838] 0 2024-09-04T16:30:20.941 INFO:tasks.workunit.client.1.smithi193.stdout:3/900: mkdir d0/d125 0 2024-09-04T16:30:20.942 INFO:tasks.workunit.client.0.smithi170.stdout:1/465: rename d9/f18 to d9/d26/f93 0 2024-09-04T16:30:20.945 INFO:tasks.workunit.client.1.smithi193.stdout:1/986: fsync d1/d2b/d1b/d51/d6d/f78 0 2024-09-04T16:30:20.948 INFO:tasks.workunit.client.0.smithi170.stdout:1/466: dwrite d9/d26/f36 [0,4194304] 0 2024-09-04T16:30:20.948 INFO:tasks.workunit.client.1.smithi193.stdout:6/868: rename d5/d27/d3e/d8c/fb4 to d5/d33/d4e/d51/d71/f116 0 2024-09-04T16:30:20.949 INFO:tasks.workunit.client.1.smithi193.stdout:6/869: chown d5/d33/d4e/d51/d68/l6a 10022508 1 2024-09-04T16:30:20.950 INFO:tasks.workunit.client.0.smithi170.stdout:7/560: symlink d12/d16/lc3 0 2024-09-04T16:30:20.952 INFO:tasks.workunit.client.0.smithi170.stdout:7/561: truncate d12/d16/d1d/d65/d82/f91 473309 0 2024-09-04T16:30:20.953 INFO:tasks.workunit.client.0.smithi170.stdout:9/378: mkdir d2/d3d/d6d 0 2024-09-04T16:30:20.954 INFO:tasks.workunit.client.1.smithi193.stdout:0/892: mkdir d18/d25/d5f/d107/d111/d12a 0 2024-09-04T16:30:20.956 INFO:tasks.workunit.client.1.smithi193.stdout:5/891: fsync d1/d8/db/d15/d2b/d83/fd1 0 2024-09-04T16:30:20.960 INFO:tasks.workunit.client.0.smithi170.stdout:7/562: rename d12/d16/d1d/l59 to d12/d49/lc4 0 2024-09-04T16:30:20.961 INFO:tasks.workunit.client.0.smithi170.stdout:7/563: write d12/d15/d68/fa0 [902936,54900] 0 2024-09-04T16:30:20.961 INFO:tasks.workunit.client.1.smithi193.stdout:4/826: truncate d3/d1a/d54/f5b 1565411 0 2024-09-04T16:30:20.962 INFO:tasks.workunit.client.0.smithi170.stdout:9/379: truncate d2/f17 1444590 0 2024-09-04T16:30:20.963 INFO:tasks.workunit.client.1.smithi193.stdout:9/961: dwrite d2/d8/d61/f6b [0,4194304] 0 2024-09-04T16:30:20.966 INFO:tasks.workunit.client.1.smithi193.stdout:9/962: read d2/d18/d2f/d22/d30/d6a/d6e/f101 [1758178,73025] 0 2024-09-04T16:30:20.966 INFO:tasks.workunit.client.1.smithi193.stdout:1/987: rmdir d1/d2b/d10/d56/d100 39 2024-09-04T16:30:20.968 INFO:tasks.workunit.client.0.smithi170.stdout:7/564: dwrite d12/d16/d1d/d65/d82/fbb [0,4194304] 0 2024-09-04T16:30:20.971 INFO:tasks.workunit.client.0.smithi170.stdout:5/270: getdents d4/d8/d1c/d29 0 2024-09-04T16:30:20.971 INFO:tasks.workunit.client.1.smithi193.stdout:8/919: unlink d2/cbb 0 2024-09-04T16:30:20.975 INFO:tasks.workunit.client.1.smithi193.stdout:0/893: mkdir d18/d25/d32/d9c/d122/d12b 0 2024-09-04T16:30:20.976 INFO:tasks.workunit.client.0.smithi170.stdout:9/380: symlink d2/d3d/d6d/l6e 0 2024-09-04T16:30:20.976 INFO:tasks.workunit.client.0.smithi170.stdout:7/565: dread d12/d15/d71/f5b [0,4194304] 0 2024-09-04T16:30:20.980 INFO:tasks.workunit.client.1.smithi193.stdout:5/892: creat d1/dd0/f125 x:0 0 0 2024-09-04T16:30:20.981 INFO:tasks.workunit.client.1.smithi193.stdout:5/893: stat d1/d8/cb2 0 2024-09-04T16:30:20.981 INFO:tasks.workunit.client.1.smithi193.stdout:0/894: dwrite d18/d25/d5f/d65/dc4/dd5/df2/f11e [0,4194304] 0 2024-09-04T16:30:20.981 INFO:tasks.workunit.client.0.smithi170.stdout:5/271: symlink d4/d8/d1c/d29/l50 0 2024-09-04T16:30:20.982 INFO:tasks.workunit.client.1.smithi193.stdout:5/894: chown d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/fb7 871774939 1 2024-09-04T16:30:20.985 INFO:tasks.workunit.client.0.smithi170.stdout:9/381: dwrite d2/d11/d23/f30 [0,4194304] 0 2024-09-04T16:30:20.985 INFO:tasks.workunit.client.1.smithi193.stdout:5/895: truncate d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/fb7 1727515 0 2024-09-04T16:30:20.989 INFO:tasks.workunit.client.0.smithi170.stdout:5/272: mkdir d4/db/d51 0 2024-09-04T16:30:20.991 INFO:tasks.workunit.client.0.smithi170.stdout:5/273: truncate d4/d8/d1c/d26/d27/f3f 695264 0 2024-09-04T16:30:20.993 INFO:tasks.workunit.client.0.smithi170.stdout:5/274: chown d4/d8/d1c/d23/d3e 3 1 2024-09-04T16:30:20.994 INFO:tasks.workunit.client.0.smithi170.stdout:7/566: truncate d12/d15/d71/f36 2666955 0 2024-09-04T16:30:21.000 INFO:tasks.workunit.client.1.smithi193.stdout:6/870: symlink d5/de/d15/d1b/d5f/da7/db2/l117 0 2024-09-04T16:30:21.002 INFO:tasks.workunit.client.0.smithi170.stdout:3/311: write d13/d14/d21/f2e [205803,64131] 0 2024-09-04T16:30:21.011 INFO:tasks.workunit.client.0.smithi170.stdout:3/312: rename d13/d14/d21/f33 to d13/d14/d17/f64 0 2024-09-04T16:30:21.013 INFO:tasks.workunit.client.0.smithi170.stdout:7/567: rmdir d12/db3 0 2024-09-04T16:30:21.015 INFO:tasks.workunit.client.1.smithi193.stdout:9/963: symlink d2/d18/d2f/d22/d30/d52/dfd/l12e 0 2024-09-04T16:30:21.017 INFO:tasks.workunit.client.0.smithi170.stdout:3/313: dwrite d13/f5f [0,4194304] 0 2024-09-04T16:30:21.017 INFO:tasks.workunit.client.0.smithi170.stdout:9/382: dread d2/d3d/f1a [4194304,4194304] 0 2024-09-04T16:30:21.019 INFO:tasks.workunit.client.0.smithi170.stdout:3/314: chown fb 2823358 1 2024-09-04T16:30:21.019 INFO:tasks.workunit.client.0.smithi170.stdout:7/568: mknod d12/d16/d1d/d65/d82/cc5 0 2024-09-04T16:30:21.022 INFO:tasks.workunit.client.1.smithi193.stdout:0/895: symlink d18/d25/d5f/def/dfa/d106/l12c 0 2024-09-04T16:30:21.024 INFO:tasks.workunit.client.0.smithi170.stdout:9/383: unlink d2/d11/c4a 0 2024-09-04T16:30:21.027 INFO:tasks.workunit.client.1.smithi193.stdout:5/896: link d1/d8/db/d36/d40/d46/d84/fa3 d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/dd8/f126 0 2024-09-04T16:30:21.027 INFO:tasks.workunit.client.1.smithi193.stdout:2/878: dwrite d2/d9/db/d10/d1e/d56/fd6 [0,4194304] 0 2024-09-04T16:30:21.028 INFO:tasks.workunit.client.0.smithi170.stdout:3/315: mknod d13/d14/d1d/c65 0 2024-09-04T16:30:21.029 INFO:tasks.workunit.client.0.smithi170.stdout:3/316: chown d13/d14/d21/d4d/d4e/d50 1054 1 2024-09-04T16:30:21.029 INFO:tasks.workunit.client.1.smithi193.stdout:1/988: creat d1/d2b/db/d54/f12d x:0 0 0 2024-09-04T16:30:21.031 INFO:tasks.workunit.client.0.smithi170.stdout:9/384: mknod d2/d3d/d4d/c6f 0 2024-09-04T16:30:21.032 INFO:tasks.workunit.client.1.smithi193.stdout:9/964: symlink d2/d8/d25/ded/l12f 0 2024-09-04T16:30:21.034 INFO:tasks.workunit.client.0.smithi170.stdout:3/317: mknod d13/d14/d21/d4c/c66 0 2024-09-04T16:30:21.035 INFO:tasks.workunit.client.0.smithi170.stdout:7/569: dread d12/f52 [0,4194304] 0 2024-09-04T16:30:21.038 INFO:tasks.workunit.client.1.smithi193.stdout:3/901: truncate d0/d18/d1c/fb9 1654320 0 2024-09-04T16:30:21.041 INFO:tasks.workunit.client.1.smithi193.stdout:1/989: symlink d1/d39/d101/l12e 0 2024-09-04T16:30:21.047 INFO:tasks.workunit.client.1.smithi193.stdout:5/897: unlink d1/d8/db/cd9 0 2024-09-04T16:30:21.048 INFO:tasks.workunit.client.1.smithi193.stdout:5/898: chown d1/d8/db/d15/f47 2419 1 2024-09-04T16:30:21.049 INFO:tasks.workunit.client.1.smithi193.stdout:2/879: mknod d2/d9/db/d10/dfe/c129 0 2024-09-04T16:30:21.049 INFO:tasks.workunit.client.1.smithi193.stdout:5/899: fdatasync d1/d8/db/d15/d2b/d83/d37/d58/f9a 0 2024-09-04T16:30:21.050 INFO:tasks.workunit.client.0.smithi170.stdout:5/275: truncate d4/db/f34 573005 0 2024-09-04T16:30:21.056 INFO:tasks.workunit.client.1.smithi193.stdout:0/896: dread d18/d25/d5f/d65/f6f [0,4194304] 0 2024-09-04T16:30:21.056 INFO:tasks.workunit.client.0.smithi170.stdout:9/385: getdents d2/d3d/d27/d2b/d34 0 2024-09-04T16:30:21.058 INFO:tasks.workunit.client.1.smithi193.stdout:9/965: dread d2/d8/d15/f62 [0,4194304] 0 2024-09-04T16:30:21.058 INFO:tasks.workunit.client.1.smithi193.stdout:4/827: write d3/f36 [418185,75330] 0 2024-09-04T16:30:21.058 INFO:tasks.workunit.client.0.smithi170.stdout:9/386: dread d2/d3d/d27/d65/d56/f5a [0,4194304] 0 2024-09-04T16:30:21.059 INFO:tasks.workunit.client.1.smithi193.stdout:4/828: stat d3/d1a/d21/fe1 0 2024-09-04T16:30:21.059 INFO:tasks.workunit.client.0.smithi170.stdout:3/318: dread d13/d14/f32 [0,4194304] 0 2024-09-04T16:30:21.059 INFO:tasks.workunit.client.1.smithi193.stdout:6/871: link d5/d27/d3e/d43/c36 d5/d27/da0/c118 0 2024-09-04T16:30:21.061 INFO:tasks.workunit.client.0.smithi170.stdout:5/276: creat d4/d8/d1c/d26/d27/d48/f52 x:0 0 0 2024-09-04T16:30:21.063 INFO:tasks.workunit.client.1.smithi193.stdout:2/880: creat d2/d9/d18/d7b/f12a x:0 0 0 2024-09-04T16:30:21.065 INFO:tasks.workunit.client.0.smithi170.stdout:9/387: chown d2/d3d/cf 521505 1 2024-09-04T16:30:21.065 INFO:tasks.workunit.client.0.smithi170.stdout:9/388: chown d2/d3d/d27/d2b/c4c 201 1 2024-09-04T16:30:21.067 INFO:tasks.workunit.client.0.smithi170.stdout:3/319: unlink d13/d14/d21/f3a 0 2024-09-04T16:30:21.067 INFO:tasks.workunit.client.0.smithi170.stdout:3/320: write d13/f51 [57739,60879] 0 2024-09-04T16:30:21.068 INFO:tasks.workunit.client.1.smithi193.stdout:2/881: dwrite d2/d9/db/d10/d1f/d22/f33 [4194304,4194304] 0 2024-09-04T16:30:21.068 INFO:tasks.workunit.client.0.smithi170.stdout:5/277: fsync d4/f2b 0 2024-09-04T16:30:21.069 INFO:tasks.workunit.client.0.smithi170.stdout:3/321: chown d13/d14/d21/f2b 10392 1 2024-09-04T16:30:21.074 INFO:tasks.workunit.client.0.smithi170.stdout:9/389: unlink d2/d3d/d27/l28 0 2024-09-04T16:30:21.075 INFO:tasks.workunit.client.1.smithi193.stdout:9/966: truncate d2/d18/d2f/d22/d30/d6a/fd2 244480 0 2024-09-04T16:30:21.076 INFO:tasks.workunit.client.0.smithi170.stdout:3/322: dwrite d13/d14/d1f/f60 [0,4194304] 0 2024-09-04T16:30:21.081 INFO:tasks.workunit.client.1.smithi193.stdout:9/967: dwrite d2/d18/d2f/d22/d30/d6a/d6e/d95/fec [0,4194304] 0 2024-09-04T16:30:21.085 INFO:tasks.workunit.client.1.smithi193.stdout:5/900: mknod d1/dd0/d102/d113/c127 0 2024-09-04T16:30:21.087 INFO:tasks.workunit.client.0.smithi170.stdout:3/323: mkdir d13/d14/d17/d1c/d67 0 2024-09-04T16:30:21.088 INFO:tasks.workunit.client.0.smithi170.stdout:7/570: write d12/d16/fb8 [646628,120694] 0 2024-09-04T16:30:21.090 INFO:tasks.workunit.client.1.smithi193.stdout:0/897: creat d18/d25/d5f/d65/dc4/dd5/df2/d112/f12d x:0 0 0 2024-09-04T16:30:21.092 INFO:tasks.workunit.client.0.smithi170.stdout:3/324: mkdir d13/d14/d21/d4d/d4e/d50/d68 0 2024-09-04T16:30:21.093 INFO:tasks.workunit.client.0.smithi170.stdout:3/325: fsync d13/d14/d1d/f61 0 2024-09-04T16:30:21.094 INFO:tasks.workunit.client.1.smithi193.stdout:1/990: creat d1/d2b/f12f x:0 0 0 2024-09-04T16:30:21.097 INFO:tasks.workunit.client.1.smithi193.stdout:2/882: dread d2/d9/db/d10/d51/f85 [0,4194304] 0 2024-09-04T16:30:21.098 INFO:tasks.workunit.client.0.smithi170.stdout:3/326: rmdir d13/d14/d21/d46 39 2024-09-04T16:30:21.103 INFO:tasks.workunit.client.0.smithi170.stdout:2/350: sync 2024-09-04T16:30:21.103 INFO:tasks.workunit.client.0.smithi170.stdout:4/382: sync 2024-09-04T16:30:21.103 INFO:tasks.workunit.client.1.smithi193.stdout:0/898: write d18/fa2 [144860,100232] 0 2024-09-04T16:30:21.104 INFO:tasks.workunit.client.0.smithi170.stdout:2/351: chown d3/d7/f4d 87600 1 2024-09-04T16:30:21.107 INFO:tasks.workunit.client.0.smithi170.stdout:3/327: link d13/d14/d21/d4c/c66 d13/d14/d17/c69 0 2024-09-04T16:30:21.108 INFO:tasks.workunit.client.0.smithi170.stdout:3/328: fdatasync fb 0 2024-09-04T16:30:21.109 INFO:tasks.workunit.client.0.smithi170.stdout:5/278: dwrite d4/f2c [0,4194304] 0 2024-09-04T16:30:21.110 INFO:tasks.workunit.client.1.smithi193.stdout:4/829: rename d3/d3c to d3/d1a/d111 0 2024-09-04T16:30:21.110 INFO:tasks.workunit.client.0.smithi170.stdout:3/329: dread - d13/d14/d1d/f61 zero size 2024-09-04T16:30:21.112 INFO:tasks.workunit.client.0.smithi170.stdout:5/279: fsync d4/d8/d1c/d29/f2a 0 2024-09-04T16:30:21.112 INFO:tasks.workunit.client.0.smithi170.stdout:3/330: write d13/d14/d1f/f3e [1769110,16012] 0 2024-09-04T16:30:21.112 INFO:tasks.workunit.client.1.smithi193.stdout:1/991: dread d1/d2b/db/f8f [0,4194304] 0 2024-09-04T16:30:21.114 INFO:tasks.workunit.client.0.smithi170.stdout:5/280: truncate d4/d8/d1c/d41/f46 511726 0 2024-09-04T16:30:21.119 INFO:tasks.workunit.client.1.smithi193.stdout:0/899: mknod d18/d109/c12e 0 2024-09-04T16:30:21.122 INFO:tasks.workunit.client.0.smithi170.stdout:3/331: dwrite d13/d14/d21/d4c/f55 [0,4194304] 0 2024-09-04T16:30:21.124 INFO:tasks.workunit.client.0.smithi170.stdout:5/281: dwrite d4/d8/d1c/d41/f4f [0,4194304] 0 2024-09-04T16:30:21.124 INFO:tasks.workunit.client.0.smithi170.stdout:3/332: chown d13/d14/d1d/d2d 161986 1 2024-09-04T16:30:21.126 INFO:tasks.workunit.client.0.smithi170.stdout:4/383: rename d1/d6/d2b/d33/d36/f2e to d1/d6/d2b/d33/f8c 0 2024-09-04T16:30:21.126 INFO:tasks.workunit.client.0.smithi170.stdout:7/571: write d12/d15/d68/fac [971782,113674] 0 2024-09-04T16:30:21.131 INFO:tasks.workunit.client.1.smithi193.stdout:6/872: dwrite d5/de/d15/d1b/d5f/fd8 [0,4194304] 0 2024-09-04T16:30:21.133 INFO:tasks.workunit.client.1.smithi193.stdout:2/883: write d2/d9/db/f21 [1090764,106763] 0 2024-09-04T16:30:21.134 INFO:tasks.workunit.client.1.smithi193.stdout:2/884: write d2/d9/db/d10/d1f/d22/f33 [1943616,78861] 0 2024-09-04T16:30:21.135 INFO:tasks.workunit.client.0.smithi170.stdout:3/333: dread d13/d14/d1d/d2d/d58/f47 [0,4194304] 0 2024-09-04T16:30:21.136 INFO:tasks.workunit.client.1.smithi193.stdout:8/920: sync 2024-09-04T16:30:21.147 INFO:tasks.workunit.client.0.smithi170.stdout:4/384: mkdir d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d8d 0 2024-09-04T16:30:21.147 INFO:tasks.workunit.client.0.smithi170.stdout:4/385: write d1/f7c [242867,114688] 0 2024-09-04T16:30:21.148 INFO:tasks.workunit.client.0.smithi170.stdout:5/282: creat d4/f53 x:0 0 0 2024-09-04T16:30:21.149 INFO:tasks.workunit.client.0.smithi170.stdout:3/334: mknod d13/d14/d21/c6a 0 2024-09-04T16:30:21.151 INFO:tasks.workunit.client.0.smithi170.stdout:5/283: creat d4/d8/d1c/d41/f54 x:0 0 0 2024-09-04T16:30:21.152 INFO:tasks.workunit.client.0.smithi170.stdout:5/284: write d4/d8/d1c/d41/f46 [47784,28072] 0 2024-09-04T16:30:21.153 INFO:tasks.workunit.client.0.smithi170.stdout:4/386: fsync d1/d6/d8/d20/d35/d3e/f46 0 2024-09-04T16:30:21.155 INFO:tasks.workunit.client.0.smithi170.stdout:3/335: mknod d13/d14/d1d/d2d/d58/c6b 0 2024-09-04T16:30:21.157 INFO:tasks.workunit.client.0.smithi170.stdout:7/572: truncate d12/d15/d68/f78 1724414 0 2024-09-04T16:30:21.160 INFO:tasks.workunit.client.0.smithi170.stdout:5/285: mknod d4/d8/c55 0 2024-09-04T16:30:21.161 INFO:tasks.workunit.client.0.smithi170.stdout:3/336: dwrite d13/d14/d21/d4c/f5c [0,4194304] 0 2024-09-04T16:30:21.167 INFO:tasks.workunit.client.0.smithi170.stdout:5/286: dwrite d4/d8/d1c/d41/f4f [0,4194304] 0 2024-09-04T16:30:21.169 INFO:tasks.workunit.client.0.smithi170.stdout:5/287: read d4/d8/d1c/d41/f46 [138112,111097] 0 2024-09-04T16:30:21.201 INFO:tasks.workunit.client.1.smithi193.stdout:3/902: sync 2024-09-04T16:30:21.202 INFO:tasks.workunit.client.1.smithi193.stdout:3/903: chown d0/d10/d24 480770 1 2024-09-04T16:30:21.202 INFO:tasks.workunit.client.1.smithi193.stdout:3/904: fsync d0/d18/d1c/d51/f10a 0 2024-09-04T16:30:21.213 INFO:tasks.workunit.client.0.smithi170.stdout:8/414: sync 2024-09-04T16:30:21.213 INFO:tasks.workunit.client.0.smithi170.stdout:0/471: sync 2024-09-04T16:30:21.213 INFO:tasks.workunit.client.0.smithi170.stdout:6/315: sync 2024-09-04T16:30:21.214 INFO:tasks.workunit.client.0.smithi170.stdout:8/415: fdatasync d6/d28/d20/d5e/f68 0 2024-09-04T16:30:21.235 INFO:tasks.workunit.client.1.smithi193.stdout:5/901: sync 2024-09-04T16:30:21.254 INFO:tasks.workunit.client.1.smithi193.stdout:4/830: mknod d3/d1a/d111/d98/de2/dec/d10c/c112 0 2024-09-04T16:30:21.255 INFO:tasks.workunit.client.1.smithi193.stdout:1/992: creat d1/d2b/d10/db6/f130 x:0 0 0 2024-09-04T16:30:21.256 INFO:tasks.workunit.client.1.smithi193.stdout:1/993: write d1/d2b/db/f9a [1615071,17173] 0 2024-09-04T16:30:21.257 INFO:tasks.workunit.client.0.smithi170.stdout:4/387: link d1/d6/d8/f56 d1/d6/d22/f8e 0 2024-09-04T16:30:21.257 INFO:tasks.workunit.client.1.smithi193.stdout:9/968: getdents d2/db4 0 2024-09-04T16:30:21.263 INFO:tasks.workunit.client.0.smithi170.stdout:5/288: rename d4/l2d to d4/d3a/l56 0 2024-09-04T16:30:21.263 INFO:tasks.workunit.client.0.smithi170.stdout:5/289: stat d4/f3c 0 2024-09-04T16:30:21.263 INFO:tasks.workunit.client.0.smithi170.stdout:5/290: readlink d4/d8/d1c/l31 0 2024-09-04T16:30:21.268 INFO:tasks.workunit.client.0.smithi170.stdout:6/316: creat d0/df/d1b/d3e/d44/d2d/d2e/f66 x:0 0 0 2024-09-04T16:30:21.268 INFO:tasks.workunit.client.0.smithi170.stdout:6/317: stat d0/df/f3a 0 2024-09-04T16:30:21.269 INFO:tasks.workunit.client.1.smithi193.stdout:2/885: creat d2/d9/db/d10/dfe/f12b x:0 0 0 2024-09-04T16:30:21.271 INFO:tasks.workunit.client.0.smithi170.stdout:8/416: rename d6/f4f to d6/f92 0 2024-09-04T16:30:21.275 INFO:tasks.workunit.client.1.smithi193.stdout:3/905: write d0/d18/d1c/d51/f56 [8057550,105458] 0 2024-09-04T16:30:21.276 INFO:tasks.workunit.client.1.smithi193.stdout:5/902: mknod d1/d8/db/d36/d40/dc1/c128 0 2024-09-04T16:30:21.277 INFO:tasks.workunit.client.0.smithi170.stdout:4/388: rmdir d1/d6/d22 39 2024-09-04T16:30:21.278 INFO:tasks.workunit.client.1.smithi193.stdout:4/831: mkdir d3/d1a/d111/d89/d113 0 2024-09-04T16:30:21.279 INFO:tasks.workunit.client.0.smithi170.stdout:3/337: mkdir d13/d14/d1d/d2d/d6c 0 2024-09-04T16:30:21.282 INFO:tasks.workunit.client.1.smithi193.stdout:1/994: creat d1/d2b/d10/db7/dc8/f131 x:0 0 0 2024-09-04T16:30:21.283 INFO:tasks.workunit.client.0.smithi170.stdout:5/291: symlink d4/d8/d1c/d41/l57 0 2024-09-04T16:30:21.283 INFO:tasks.workunit.client.0.smithi170.stdout:5/292: write d4/f2c [2270141,5564] 0 2024-09-04T16:30:21.285 INFO:tasks.workunit.client.0.smithi170.stdout:5/293: write d4/f4a [1393313,100589] 0 2024-09-04T16:30:21.286 INFO:tasks.workunit.client.0.smithi170.stdout:6/318: mkdir d0/df/d1b/d3e/d44/d2d/d67 0 2024-09-04T16:30:21.288 INFO:tasks.workunit.client.1.smithi193.stdout:0/900: mkdir d18/d25/d32/d12f 0 2024-09-04T16:30:21.290 INFO:tasks.workunit.client.0.smithi170.stdout:7/573: truncate d12/d16/f3f 94465 0 2024-09-04T16:30:21.292 INFO:tasks.workunit.client.0.smithi170.stdout:5/294: dwrite d4/f2c [0,4194304] 0 2024-09-04T16:30:21.292 INFO:tasks.workunit.client.1.smithi193.stdout:8/921: dwrite d2/d12/f8e [0,4194304] 0 2024-09-04T16:30:21.294 INFO:tasks.workunit.client.0.smithi170.stdout:4/389: stat d1/d6/d8/d20/d35/d3e/d60/l85 0 2024-09-04T16:30:21.304 INFO:tasks.workunit.client.1.smithi193.stdout:1/995: creat d1/d2b/d1b/d51/dcb/f132 x:0 0 0 2024-09-04T16:30:21.305 INFO:tasks.workunit.client.1.smithi193.stdout:9/969: truncate d2/f1c 5023118 0 2024-09-04T16:30:21.308 INFO:tasks.workunit.client.0.smithi170.stdout:6/319: rename d0/df/d1b/d3e/d44 to d0/df/d1b/d3e/d47/d68 0 2024-09-04T16:30:21.310 INFO:tasks.workunit.client.1.smithi193.stdout:6/873: link d5/d33/d4e/d51/d71/dcf/d10b/c111 d5/d33/d4e/c119 0 2024-09-04T16:30:21.313 INFO:tasks.workunit.client.0.smithi170.stdout:4/390: creat d1/d6/d2b/d47/d78/f8f x:0 0 0 2024-09-04T16:30:21.315 INFO:tasks.workunit.client.0.smithi170.stdout:4/391: read d1/fc [4403110,88893] 0 2024-09-04T16:30:21.315 INFO:tasks.workunit.client.1.smithi193.stdout:3/906: dwrite d0/d9/f58 [0,4194304] 0 2024-09-04T16:30:21.317 INFO:tasks.workunit.client.0.smithi170.stdout:7/574: rename d12/d16/d1d/d65/d82/cb1 to d12/d16/d1d/d65/cc6 0 2024-09-04T16:30:21.318 INFO:tasks.workunit.client.1.smithi193.stdout:6/874: dwrite d5/d27/d3e/d8c/fe9 [0,4194304] 0 2024-09-04T16:30:21.320 INFO:tasks.workunit.client.1.smithi193.stdout:1/996: truncate d1/d2b/d10/fbc 1203036 0 2024-09-04T16:30:21.324 INFO:tasks.workunit.client.1.smithi193.stdout:9/970: mkdir d2/d18/d2f/d22/d30/d6a/d130 0 2024-09-04T16:30:21.325 INFO:tasks.workunit.client.1.smithi193.stdout:3/907: dwrite d0/d9/dae/fed [0,4194304] 0 2024-09-04T16:30:21.326 INFO:tasks.workunit.client.1.smithi193.stdout:1/997: write d1/d2b/d10/f21 [4047178,33057] 0 2024-09-04T16:30:21.326 INFO:tasks.workunit.client.0.smithi170.stdout:8/417: dwrite d6/f7a [0,4194304] 0 2024-09-04T16:30:21.327 INFO:tasks.workunit.client.0.smithi170.stdout:6/320: fdatasync d0/f16 0 2024-09-04T16:30:21.329 INFO:tasks.workunit.client.0.smithi170.stdout:8/418: write d6/d28/d1a/f42 [1963866,17579] 0 2024-09-04T16:30:21.330 INFO:tasks.workunit.client.1.smithi193.stdout:2/886: rename d2/d9/d18/d114 to d2/d9/db/d10/d1e/d12c 0 2024-09-04T16:30:21.330 INFO:tasks.workunit.client.0.smithi170.stdout:8/419: chown d6/d28/d20/f48 1609 1 2024-09-04T16:30:21.331 INFO:tasks.workunit.client.1.smithi193.stdout:8/922: dwrite d2/d20/d23/d34/dd6/da0/da8/db9/fab [0,4194304] 0 2024-09-04T16:30:21.331 INFO:tasks.workunit.client.0.smithi170.stdout:8/420: chown d6/d28/d20/f48 411094 1 2024-09-04T16:30:21.332 INFO:tasks.workunit.client.0.smithi170.stdout:8/421: chown d6/d28/d20/d6e/d76 530 1 2024-09-04T16:30:21.336 INFO:tasks.workunit.client.0.smithi170.stdout:6/321: chown d0/d17/d39 1658 1 2024-09-04T16:30:21.338 INFO:tasks.workunit.client.0.smithi170.stdout:8/422: mkdir d6/d28/d16/d77/d93 0 2024-09-04T16:30:21.340 INFO:tasks.workunit.client.0.smithi170.stdout:8/423: fdatasync d6/d28/d16/d24/d46/f4e 0 2024-09-04T16:30:21.342 INFO:tasks.workunit.client.0.smithi170.stdout:6/322: chown d0/d17/c1a 5014 1 2024-09-04T16:30:21.346 INFO:tasks.workunit.client.0.smithi170.stdout:5/295: truncate d4/d3a/f4d 442583 0 2024-09-04T16:30:21.350 INFO:tasks.workunit.client.0.smithi170.stdout:8/424: creat d6/d28/d5f/d85/f94 x:0 0 0 2024-09-04T16:30:21.352 INFO:tasks.workunit.client.1.smithi193.stdout:4/832: rename d3/d1a/d111/d89/cab to d3/d1a/d21/c114 0 2024-09-04T16:30:21.353 INFO:tasks.workunit.client.0.smithi170.stdout:7/575: link d12/d15/d71/d42/d79/d9d/l61 d12/d16/lc7 0 2024-09-04T16:30:21.353 INFO:tasks.workunit.client.0.smithi170.stdout:5/296: dwrite d4/d8/d1c/d26/d27/d48/f52 [0,4194304] 0 2024-09-04T16:30:21.355 INFO:tasks.workunit.client.1.smithi193.stdout:1/998: dread d1/d2b/d10/f21 [0,4194304] 0 2024-09-04T16:30:21.358 INFO:tasks.workunit.client.0.smithi170.stdout:8/425: chown d6/d28/d16/c59 5 1 2024-09-04T16:30:21.359 INFO:tasks.workunit.client.1.smithi193.stdout:5/903: getdents d1/d8/db/d15/d2b 0 2024-09-04T16:30:21.360 INFO:tasks.workunit.client.0.smithi170.stdout:8/426: write d6/d28/d20/f8a [599692,113234] 0 2024-09-04T16:30:21.360 INFO:tasks.workunit.client.0.smithi170.stdout:7/576: stat d12/d16/d1d/d65/cc6 0 2024-09-04T16:30:21.361 INFO:tasks.workunit.client.1.smithi193.stdout:6/875: mknod d5/de/c11a 0 2024-09-04T16:30:21.362 INFO:tasks.workunit.client.0.smithi170.stdout:7/577: write d12/d15/d71/d42/d79/d9d/fa6 [1286107,34916] 0 2024-09-04T16:30:21.362 INFO:tasks.workunit.client.0.smithi170.stdout:5/297: mknod d4/d8/c58 0 2024-09-04T16:30:21.363 INFO:tasks.workunit.client.1.smithi193.stdout:0/901: getdents d18/d25/d32/d57 0 2024-09-04T16:30:21.366 INFO:tasks.workunit.client.1.smithi193.stdout:0/902: read d18/d25/d32/d57/d6c/db1/fc7 [2579064,124137] 0 2024-09-04T16:30:21.370 INFO:tasks.workunit.client.1.smithi193.stdout:9/971: rename d2/d56/d86/dc2/dde to d2/deb/d11d/d131 0 2024-09-04T16:30:21.372 INFO:tasks.workunit.client.0.smithi170.stdout:5/298: rename d4/c1a to d4/d8/d1c/d23/d3e/c59 0 2024-09-04T16:30:21.373 INFO:tasks.workunit.client.0.smithi170.stdout:5/299: chown d4/d8/d1c/d26/d27/f38 21708 1 2024-09-04T16:30:21.377 INFO:tasks.workunit.client.1.smithi193.stdout:0/903: dread d18/d25/d32/d57/f56 [0,4194304] 0 2024-09-04T16:30:21.378 INFO:tasks.workunit.client.1.smithi193.stdout:1/999: creat d1/d2b/d10/d56/d11d/dd6/f133 x:0 0 0 2024-09-04T16:30:21.378 INFO:tasks.workunit.client.1.smithi193.stdout:0/904: fsync d18/d25/d32/f124 0 2024-09-04T16:30:21.381 INFO:tasks.workunit.client.0.smithi170.stdout:8/427: dwrite d6/d28/d16/d24/d46/f74 [0,4194304] 0 2024-09-04T16:30:21.382 INFO:tasks.workunit.client.1.smithi193.stdout:2/887: truncate d2/d9/db/f75 841803 0 2024-09-04T16:30:21.384 INFO:tasks.workunit.client.0.smithi170.stdout:7/578: truncate d12/d16/d8d/fa5 228446 0 2024-09-04T16:30:21.388 INFO:tasks.workunit.client.1.smithi193.stdout:3/908: rename d0/d18/d1b/d3d/daf to d0/d18/d1c/d51/d6c/d126 0 2024-09-04T16:30:21.390 INFO:tasks.workunit.client.1.smithi193.stdout:0/905: unlink d18/d25/c2e 0 2024-09-04T16:30:21.391 INFO:tasks.workunit.client.0.smithi170.stdout:8/428: mkdir d6/d28/d16/d77/d93/d95 0 2024-09-04T16:30:21.392 INFO:tasks.workunit.client.1.smithi193.stdout:5/904: symlink d1/l129 0 2024-09-04T16:30:21.392 INFO:tasks.workunit.client.0.smithi170.stdout:5/300: getdents d4/d8/d1c/d23/d39 0 2024-09-04T16:30:21.393 INFO:tasks.workunit.client.0.smithi170.stdout:8/429: truncate d6/d28/d5f/d70/f7d 275923 0 2024-09-04T16:30:21.393 INFO:tasks.workunit.client.1.smithi193.stdout:6/876: creat d5/d33/d4e/d51/d71/dcf/d10c/f11b x:0 0 0 2024-09-04T16:30:21.395 INFO:tasks.workunit.client.0.smithi170.stdout:5/301: mkdir d4/d8/d1c/d26/d27/d48/d5a 0 2024-09-04T16:30:21.396 INFO:tasks.workunit.client.0.smithi170.stdout:7/579: dread f1 [0,4194304] 0 2024-09-04T16:30:21.397 INFO:tasks.workunit.client.1.smithi193.stdout:4/833: rename d3/da3 to d3/d1a/d111/d89/d115 0 2024-09-04T16:30:21.398 INFO:tasks.workunit.client.1.smithi193.stdout:4/834: readlink d3/d1a/d111/lca 0 2024-09-04T16:30:21.399 INFO:tasks.workunit.client.1.smithi193.stdout:9/972: creat d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/df4/f132 x:0 0 0 2024-09-04T16:30:21.399 INFO:tasks.workunit.client.1.smithi193.stdout:8/923: getdents d2/d20/d23/d34/d4b/d7c/df9 0 2024-09-04T16:30:21.402 INFO:tasks.workunit.client.1.smithi193.stdout:6/877: fsync d5/de/d15/f67 0 2024-09-04T16:30:21.403 INFO:tasks.workunit.client.0.smithi170.stdout:5/302: truncate d4/d8/d1c/d29/f2a 3871648 0 2024-09-04T16:30:21.403 INFO:tasks.workunit.client.1.smithi193.stdout:6/878: truncate d5/d33/d4e/d51/d7b/de0/fe2 178597 0 2024-09-04T16:30:21.404 INFO:tasks.workunit.client.1.smithi193.stdout:6/879: dread - d5/fff zero size 2024-09-04T16:30:21.405 INFO:tasks.workunit.client.1.smithi193.stdout:5/905: rename d1/d8/db/d15/d2b/d83/d37/d58/dc4/dda/f11e to d1/d8/db/d15/d2b/d83/d37/d58/d9e/dec/f12a 0 2024-09-04T16:30:21.407 INFO:tasks.workunit.client.1.smithi193.stdout:4/835: fdatasync d3/d39/d44/dd5/fa5 0 2024-09-04T16:30:21.415 INFO:tasks.workunit.client.1.smithi193.stdout:9/973: dwrite d2/deb/d11d/d131/dda/f122 [4194304,4194304] 0 2024-09-04T16:30:21.416 INFO:tasks.workunit.client.0.smithi170.stdout:7/580: dread d12/d16/fb8 [0,4194304] 0 2024-09-04T16:30:21.417 INFO:tasks.workunit.client.1.smithi193.stdout:2/888: rmdir d2/db7 0 2024-09-04T16:30:21.418 INFO:tasks.workunit.client.1.smithi193.stdout:6/880: symlink d5/d27/da0/l11c 0 2024-09-04T16:30:21.422 INFO:tasks.workunit.client.1.smithi193.stdout:9/974: dwrite d2/d18/d2f/d22/d30/d6a/f94 [0,4194304] 0 2024-09-04T16:30:21.424 INFO:tasks.workunit.client.0.smithi170.stdout:7/581: creat d12/d5a/fc8 x:0 0 0 2024-09-04T16:30:21.427 INFO:tasks.workunit.client.1.smithi193.stdout:4/836: unlink d3/d1a/d111/lca 0 2024-09-04T16:30:21.430 INFO:tasks.workunit.client.0.smithi170.stdout:7/582: mkdir d12/d15/d71/d42/d79/d9d/dc9 0 2024-09-04T16:30:21.431 INFO:tasks.workunit.client.0.smithi170.stdout:5/303: getdents d4/d8/d1c 0 2024-09-04T16:30:21.434 INFO:tasks.workunit.client.1.smithi193.stdout:0/906: truncate d18/d79/d88/d9a/f105 3818083 0 2024-09-04T16:30:21.434 INFO:tasks.workunit.client.1.smithi193.stdout:6/881: dread - d5/d27/d3e/d8c/fad zero size 2024-09-04T16:30:21.435 INFO:tasks.workunit.client.0.smithi170.stdout:7/583: mknod d12/d49/cca 0 2024-09-04T16:30:21.437 INFO:tasks.workunit.client.1.smithi193.stdout:5/906: write d1/d29/d18/f5e [7259617,24764] 0 2024-09-04T16:30:21.439 INFO:tasks.workunit.client.0.smithi170.stdout:7/584: dread d12/d15/d71/d42/f60 [0,4194304] 0 2024-09-04T16:30:21.440 INFO:tasks.workunit.client.1.smithi193.stdout:8/924: dwrite d2/d20/d23/d51/d76/fe8 [0,4194304] 0 2024-09-04T16:30:21.440 INFO:tasks.workunit.client.0.smithi170.stdout:5/304: truncate d4/d8/d1c/d26/d27/f38 1124262 0 2024-09-04T16:30:21.441 INFO:tasks.workunit.client.1.smithi193.stdout:8/925: write d2/d57/fcb [128628,108707] 0 2024-09-04T16:30:21.442 INFO:tasks.workunit.client.1.smithi193.stdout:3/909: getdents d0/d18/d1c/d25/d5e/d68 0 2024-09-04T16:30:21.443 INFO:tasks.workunit.client.1.smithi193.stdout:3/910: fsync d0/d18/d1b/f8b 0 2024-09-04T16:30:21.444 INFO:tasks.workunit.client.0.smithi170.stdout:7/585: dread d12/d15/d71/f38 [0,4194304] 0 2024-09-04T16:30:21.445 INFO:tasks.workunit.client.0.smithi170.stdout:5/305: mkdir d4/d8/d1c/d26/d27/d43/d5b 0 2024-09-04T16:30:21.446 INFO:tasks.workunit.client.1.smithi193.stdout:4/837: dread d3/d1a/d21/f2c [0,4194304] 0 2024-09-04T16:30:21.449 INFO:tasks.workunit.client.0.smithi170.stdout:5/306: creat d4/d8/d1c/d26/f5c x:0 0 0 2024-09-04T16:30:21.450 INFO:tasks.workunit.client.0.smithi170.stdout:7/586: dread d12/f30 [0,4194304] 0 2024-09-04T16:30:21.451 INFO:tasks.workunit.client.0.smithi170.stdout:7/587: truncate d12/d15/d71/f3e 4631857 0 2024-09-04T16:30:21.452 INFO:tasks.workunit.client.0.smithi170.stdout:7/588: chown d12/d49/c5d 978692 1 2024-09-04T16:30:21.452 INFO:tasks.workunit.client.1.smithi193.stdout:8/926: creat d2/d20/dc0/f125 x:0 0 0 2024-09-04T16:30:21.455 INFO:tasks.workunit.client.0.smithi170.stdout:7/589: chown d12/d16/f25 975451 1 2024-09-04T16:30:21.455 INFO:tasks.workunit.client.0.smithi170.stdout:7/590: chown d12/d15/d71/d42/d79/d9d/dc9 1134074 1 2024-09-04T16:30:21.456 INFO:tasks.workunit.client.1.smithi193.stdout:0/907: symlink d18/d25/d32/l130 0 2024-09-04T16:30:21.456 INFO:tasks.workunit.client.1.smithi193.stdout:0/908: stat d18/d25/d5f/d6a/d7b/df5 0 2024-09-04T16:30:21.460 INFO:tasks.workunit.client.1.smithi193.stdout:2/889: rename d2/d9/db/d10/d1e/da4/d9a/fd7 to d2/d9/db/d10/d51/d87/f12d 0 2024-09-04T16:30:21.461 INFO:tasks.workunit.client.0.smithi170.stdout:7/591: unlink d12/d15/d71/d42/fa9 0 2024-09-04T16:30:21.462 INFO:tasks.workunit.client.1.smithi193.stdout:3/911: mknod d0/d18/d1c/d51/d5a/da2/c127 0 2024-09-04T16:30:21.464 INFO:tasks.workunit.client.1.smithi193.stdout:9/975: link d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/cd9 d2/d18/d2f/d22/d30/d6a/d6e/de2/d10f/d128/c133 0 2024-09-04T16:30:21.465 INFO:tasks.workunit.client.0.smithi170.stdout:7/592: chown d12/d15/d71/d42/d81/l6a 7738 1 2024-09-04T16:30:21.466 INFO:tasks.workunit.client.1.smithi193.stdout:3/912: dread d0/d9/d49/d87/f109 [0,4194304] 0 2024-09-04T16:30:21.468 INFO:tasks.workunit.client.0.smithi170.stdout:1/467: sync 2024-09-04T16:30:21.469 INFO:tasks.workunit.client.1.smithi193.stdout:4/838: rename d3/d39/d44/dd5/d7b/d104 to d3/d1a/d111/d89/dbd/d116 0 2024-09-04T16:30:21.470 INFO:tasks.workunit.client.1.smithi193.stdout:0/909: dread d18/d25/d5f/d65/dc4/dd5/fdf [0,4194304] 0 2024-09-04T16:30:21.470 INFO:tasks.workunit.client.0.smithi170.stdout:7/593: mkdir d12/d16/d1d/d65/d82/dcb 0 2024-09-04T16:30:21.470 INFO:tasks.workunit.client.1.smithi193.stdout:4/839: fdatasync d3/d1a/d21/d52/d7f/db6/fe5 0 2024-09-04T16:30:21.471 INFO:tasks.workunit.client.0.smithi170.stdout:7/594: chown d12/d15/d71/d42/l57 197862446 1 2024-09-04T16:30:21.474 INFO:tasks.workunit.client.0.smithi170.stdout:7/595: creat d12/d15/d41/fcc x:0 0 0 2024-09-04T16:30:21.475 INFO:tasks.workunit.client.0.smithi170.stdout:7/596: write d12/d15/d41/fb5 [225940,83610] 0 2024-09-04T16:30:21.476 INFO:tasks.workunit.client.1.smithi193.stdout:5/907: dwrite d1/d8/db/d36/d40/d46/d84/fa3 [4194304,4194304] 0 2024-09-04T16:30:21.477 INFO:tasks.workunit.client.0.smithi170.stdout:1/468: symlink d9/d11/d3e/d6a/d79/d7c/l94 0 2024-09-04T16:30:21.478 INFO:tasks.workunit.client.1.smithi193.stdout:8/927: mkdir d2/d20/d23/d34/d124/d126 0 2024-09-04T16:30:21.478 INFO:tasks.workunit.client.1.smithi193.stdout:5/908: dread - d1/d8/db/d15/d2b/d83/d37/d58/ffa zero size 2024-09-04T16:30:21.480 INFO:tasks.workunit.client.0.smithi170.stdout:7/597: creat d12/d15/d71/d42/d81/d5c/fcd x:0 0 0 2024-09-04T16:30:21.481 INFO:tasks.workunit.client.0.smithi170.stdout:5/307: dwrite d4/db/f34 [0,4194304] 0 2024-09-04T16:30:21.485 INFO:tasks.workunit.client.0.smithi170.stdout:1/469: creat d9/d11/d3e/d6a/d79/f95 x:0 0 0 2024-09-04T16:30:21.488 INFO:tasks.workunit.client.1.smithi193.stdout:4/840: symlink d3/d39/d44/dd5/l117 0 2024-09-04T16:30:21.495 INFO:tasks.workunit.client.1.smithi193.stdout:5/909: dread d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f91 [0,4194304] 0 2024-09-04T16:30:21.513 INFO:tasks.workunit.client.0.smithi170.stdout:1/470: dread d9/d11/f43 [0,4194304] 0 2024-09-04T16:30:21.586 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:21 smithi170 ceph-mon[29272]: pgmap v30: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail; 76 MiB/s rd, 226 MiB/s wr, 427 op/s 2024-09-04T16:30:21.587 INFO:tasks.workunit.client.1.smithi193.stdout:0/910: mkdir d18/d25/d32/d57/d6c/db1/dc9/d131 0 2024-09-04T16:30:21.588 INFO:tasks.workunit.client.0.smithi170.stdout:7/598: mkdir d12/d16/d1d/d65/d82/dcb/dce 0 2024-09-04T16:30:21.591 INFO:tasks.workunit.client.0.smithi170.stdout:1/471: mknod d9/d11/d3e/d6a/d79/c96 0 2024-09-04T16:30:21.593 INFO:tasks.workunit.client.1.smithi193.stdout:6/882: link d5/d27/d3e/d8c/fad d5/d33/d4e/d51/d71/f11d 0 2024-09-04T16:30:21.593 INFO:tasks.workunit.client.1.smithi193.stdout:6/883: fdatasync d5/f11 0 2024-09-04T16:30:21.596 INFO:tasks.workunit.client.0.smithi170.stdout:1/472: rmdir d9/d11/d2f/d6b/d61 39 2024-09-04T16:30:21.597 INFO:tasks.workunit.client.1.smithi193.stdout:9/976: sync 2024-09-04T16:30:21.597 INFO:tasks.workunit.client.1.smithi193.stdout:3/913: write d0/d18/d1c/d25/d5e/d7e/f7c [2977872,101529] 0 2024-09-04T16:30:21.600 INFO:tasks.workunit.client.1.smithi193.stdout:3/914: dread d0/d18/d1c/d30/d8e/fd3 [0,4194304] 0 2024-09-04T16:30:21.602 INFO:tasks.workunit.client.0.smithi170.stdout:7/599: creat d12/d16/fcf x:0 0 0 2024-09-04T16:30:21.608 INFO:tasks.workunit.client.1.smithi193.stdout:2/890: link d2/d9/db/d10/d4e/l5b d2/d9/db/d10/d1e/d56/l12e 0 2024-09-04T16:30:21.610 INFO:tasks.workunit.client.0.smithi170.stdout:1/473: dread d9/d26/f46 [0,4194304] 0 2024-09-04T16:30:21.612 INFO:tasks.workunit.client.0.smithi170.stdout:7/600: dwrite d12/d15/d71/d42/d81/d5c/f86 [0,4194304] 0 2024-09-04T16:30:21.613 INFO:tasks.workunit.client.1.smithi193.stdout:9/977: creat d2/d18/d2f/d22/d30/dee/f134 x:0 0 0 2024-09-04T16:30:21.614 INFO:tasks.workunit.client.1.smithi193.stdout:4/841: dwrite d3/d1a/d111/d89/fbe [0,4194304] 0 2024-09-04T16:30:21.616 INFO:tasks.workunit.client.1.smithi193.stdout:8/928: mknod d2/c127 0 2024-09-04T16:30:21.617 INFO:tasks.workunit.client.0.smithi170.stdout:7/601: mkdir d12/d16/d1d/d65/dd0 0 2024-09-04T16:30:21.620 INFO:tasks.workunit.client.1.smithi193.stdout:0/911: symlink d18/d25/d32/d57/d6c/d128/l132 0 2024-09-04T16:30:21.621 INFO:tasks.workunit.client.0.smithi170.stdout:1/474: creat d9/d11/d2f/d6b/f97 x:0 0 0 2024-09-04T16:30:21.623 INFO:tasks.workunit.client.0.smithi170.stdout:1/475: fdatasync d9/d26/d77/d83/f86 0 2024-09-04T16:30:21.626 INFO:tasks.workunit.client.0.smithi170.stdout:7/602: dwrite d12/d16/d1d/d65/d82/fbb [0,4194304] 0 2024-09-04T16:30:21.629 INFO:tasks.workunit.client.1.smithi193.stdout:9/978: fdatasync d2/d18/d2f/d22/d30/d6a/d6e/d95/fb7 0 2024-09-04T16:30:21.630 INFO:tasks.workunit.client.1.smithi193.stdout:3/915: write d0/d7/de/d45/f8d [4407600,85159] 0 2024-09-04T16:30:21.632 INFO:tasks.workunit.client.0.smithi170.stdout:7/603: rename d12/d16/fb2 to d12/d16/db7/fd1 0 2024-09-04T16:30:21.633 INFO:tasks.workunit.client.1.smithi193.stdout:8/929: symlink d2/d20/d23/d34/d3e/d6f/d93/l128 0 2024-09-04T16:30:21.635 INFO:tasks.workunit.client.0.smithi170.stdout:1/476: unlink d9/l1b 0 2024-09-04T16:30:21.639 INFO:tasks.workunit.client.1.smithi193.stdout:0/912: rename d18/d25/d5f/d65/lb5 to d18/d109/d125/l133 0 2024-09-04T16:30:21.640 INFO:tasks.workunit.client.1.smithi193.stdout:0/913: read d18/d25/d3b/f40 [2823011,45338] 0 2024-09-04T16:30:21.640 INFO:tasks.workunit.client.0.smithi170.stdout:7/604: mknod d12/d16/d1d/d65/d82/cd2 0 2024-09-04T16:30:21.641 INFO:tasks.workunit.client.1.smithi193.stdout:2/891: write d2/d9/db/d10/d1e/da4/f105 [876748,34685] 0 2024-09-04T16:30:21.641 INFO:tasks.workunit.client.1.smithi193.stdout:0/914: read - d18/d79/d88/d9a/fe8 zero size 2024-09-04T16:30:21.644 INFO:tasks.workunit.client.1.smithi193.stdout:6/884: creat d5/d33/d4e/d51/d7b/f11e x:0 0 0 2024-09-04T16:30:21.648 INFO:tasks.workunit.client.1.smithi193.stdout:8/930: creat d2/d20/d23/d34/d46/d66/d10e/f129 x:0 0 0 2024-09-04T16:30:21.649 INFO:tasks.workunit.client.1.smithi193.stdout:5/910: getdents d1/d8/db/d36/d40/d46 0 2024-09-04T16:30:21.650 INFO:tasks.workunit.client.1.smithi193.stdout:5/911: chown d1/d8/db/d36/d40/fde 134091 1 2024-09-04T16:30:21.650 INFO:tasks.workunit.client.1.smithi193.stdout:2/892: chown d2/d9/db/d10/d51/d87/c116 7212 1 2024-09-04T16:30:21.651 INFO:tasks.workunit.client.1.smithi193.stdout:0/915: rmdir d18/d25/d5f/d65/dc4/dd5 39 2024-09-04T16:30:21.654 INFO:tasks.workunit.client.1.smithi193.stdout:3/916: truncate d0/d10/fe7 2246418 0 2024-09-04T16:30:21.656 INFO:tasks.workunit.client.1.smithi193.stdout:9/979: link d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/df1/f10a d2/d18/d2f/d22/d30/d6a/d6e/d81/d93/df4/dfa/f135 0 2024-09-04T16:30:21.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:21 smithi193 ceph-mon[36288]: pgmap v30: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail; 76 MiB/s rd, 226 MiB/s wr, 427 op/s 2024-09-04T16:30:21.656 INFO:tasks.workunit.client.1.smithi193.stdout:3/917: chown d0/d10/d24/d55/cb1 0 1 2024-09-04T16:30:21.657 INFO:tasks.workunit.client.1.smithi193.stdout:8/931: symlink d2/d57/l12a 0 2024-09-04T16:30:21.658 INFO:tasks.workunit.client.1.smithi193.stdout:9/980: chown d2/d18/d2f/d9a/fdc 32458 1 2024-09-04T16:30:21.658 INFO:tasks.workunit.client.1.smithi193.stdout:5/912: dwrite d1/d8/db/d36/d40/dc1/fed [0,4194304] 0 2024-09-04T16:30:21.658 INFO:tasks.workunit.client.1.smithi193.stdout:3/918: chown d0/d18/d1b/d3d/c3e 1055802710 1 2024-09-04T16:30:21.659 INFO:tasks.workunit.client.0.smithi170.stdout:1/477: dread d9/d11/d2f/d6b/d61/f6f [0,4194304] 0 2024-09-04T16:30:21.659 INFO:tasks.workunit.client.0.smithi170.stdout:7/605: dread d12/d16/f1f [0,4194304] 0 2024-09-04T16:30:21.659 INFO:tasks.workunit.client.1.smithi193.stdout:9/981: readlink d2/d56/d86/l12c 0 2024-09-04T16:30:21.660 INFO:tasks.workunit.client.0.smithi170.stdout:7/606: readlink d12/d15/d71/d42/d81/lba 0 2024-09-04T16:30:21.662 INFO:tasks.workunit.client.1.smithi193.stdout:2/893: mknod d2/d9/db/d65/c12f 0 2024-09-04T16:30:21.663 INFO:tasks.workunit.client.1.smithi193.stdout:4/842: getdents d3/d81 0 2024-09-04T16:30:21.664 INFO:tasks.workunit.client.1.smithi193.stdout:4/843: chown d3/d1a/d21/lf7 1136747 1 2024-09-04T16:30:21.665 INFO:tasks.workunit.client.1.smithi193.stdout:3/919: dwrite d0/d18/d1b/f36 [4194304,4194304] 0 2024-09-04T16:30:21.667 INFO:tasks.workunit.client.0.smithi170.stdout:1/478: rename d9/d26/c80 to d9/d11/d3e/d6a/c98 0 2024-09-04T16:30:21.668 INFO:tasks.workunit.client.1.smithi193.stdout:0/916: rmdir d18/d25/d32/d9c 39 2024-09-04T16:30:21.670 INFO:tasks.workunit.client.0.smithi170.stdout:7/607: chown d12/d16/f3f 3 1 2024-09-04T16:30:21.675 INFO:tasks.workunit.client.0.smithi170.stdout:7/608: rename d12/d15/d71/d42/d81/d5c/c6f to d12/d15/d41/cd3 0 2024-09-04T16:30:21.676 INFO:tasks.workunit.client.0.smithi170.stdout:1/479: symlink d9/d11/d2f/d6b/d7d/l99 0 2024-09-04T16:30:21.677 INFO:tasks.workunit.client.0.smithi170.stdout:1/480: stat d9/d11/d3e 0 2024-09-04T16:30:21.685 INFO:tasks.workunit.client.1.smithi193.stdout:3/920: symlink d0/d18/d1b/d3d/l128 0 2024-09-04T16:30:21.687 INFO:tasks.workunit.client.0.smithi170.stdout:7/609: rename d12/d16/fcf to d12/fd4 0 2024-09-04T16:30:21.688 INFO:tasks.workunit.client.0.smithi170.stdout:7/610: readlink d12/d15/d41/l99 0 2024-09-04T16:30:21.688 INFO:tasks.workunit.client.0.smithi170.stdout:1/481: dread d9/d26/f56 [0,4194304] 0 2024-09-04T16:30:21.690 INFO:tasks.workunit.client.0.smithi170.stdout:9/390: sync 2024-09-04T16:30:21.691 INFO:tasks.workunit.client.0.smithi170.stdout:9/391: chown d2/d3d/fc 269104182 1 2024-09-04T16:30:21.693 INFO:tasks.workunit.client.1.smithi193.stdout:5/913: mknod d1/d8/c12b 0 2024-09-04T16:30:21.695 INFO:tasks.workunit.client.0.smithi170.stdout:1/482: truncate d9/d11/d3e/f87 609619 0 2024-09-04T16:30:21.696 INFO:tasks.workunit.client.0.smithi170.stdout:9/392: symlink d2/d32/l70 0 2024-09-04T16:30:21.697 INFO:tasks.workunit.client.0.smithi170.stdout:9/393: read - d2/d32/f61 zero size 2024-09-04T16:30:21.697 INFO:tasks.workunit.client.1.smithi193.stdout:9/982: dwrite d2/d18/d2f/d22/d30/d6a/d6e/d95/fb7 [0,4194304] 0 2024-09-04T16:30:21.697 INFO:tasks.workunit.client.0.smithi170.stdout:9/394: chown d2/d11/d23/l5d 502484 1 2024-09-04T16:30:21.698 INFO:tasks.workunit.client.1.smithi193.stdout:6/885: getdents d5/de 0 2024-09-04T16:30:21.698 INFO:tasks.workunit.client.0.smithi170.stdout:7/611: write d12/f52 [114326,126826] 0 2024-09-04T16:30:21.699 INFO:tasks.workunit.client.0.smithi170.stdout:1/483: creat d9/d34/f9a x:0 0 0 2024-09-04T16:30:21.701 INFO:tasks.workunit.client.1.smithi193.stdout:8/932: truncate d2/d12/f43 6235401 0 2024-09-04T16:30:21.701 INFO:tasks.workunit.client.1.smithi193.stdout:2/894: dwrite d2/d9/db/d10/d51/d87/fa0 [0,4194304] 0 2024-09-04T16:30:21.703 INFO:tasks.workunit.client.0.smithi170.stdout:1/484: mkdir d9/d11/d9b 0 2024-09-04T16:30:21.704 INFO:tasks.workunit.client.0.smithi170.stdout:7/612: dread d12/d16/fb8 [0,4194304] 0 2024-09-04T16:30:21.705 INFO:tasks.workunit.client.1.smithi193.stdout:3/921: creat d0/d18/d114/f129 x:0 0 0 2024-09-04T16:30:21.705 INFO:tasks.workunit.client.1.smithi193.stdout:0/917: mknod d18/d25/d32/d9c/da9/c134 0 2024-09-04T16:30:21.707 INFO:tasks.workunit.client.0.smithi170.stdout:1/485: symlink d9/d26/d77/l9c 0 2024-09-04T16:30:21.709 INFO:tasks.workunit.client.1.smithi193.stdout:9/983: mkdir d2/d18/d2f/d22/d30/d52/dbb/d136 0 2024-09-04T16:30:21.710 INFO:tasks.workunit.client.1.smithi193.stdout:2/895: dwrite d2/d9/db/d10/d51/fed [0,4194304] 0 2024-09-04T16:30:21.710 INFO:tasks.workunit.client.1.smithi193.stdout:9/984: chown d2/d8/d25 27602723 1 2024-09-04T16:30:21.711 INFO:tasks.workunit.client.0.smithi170.stdout:7/613: write d12/d16/d1d/f80 [2416253,55050] 0 2024-09-04T16:30:21.712 INFO:tasks.workunit.client.1.smithi193.stdout:5/914: dread d1/d8/db/d15/d2b/d83/f114 [0,4194304] 0 2024-09-04T16:30:21.715 INFO:tasks.workunit.client.1.smithi193.stdout:3/922: creat d0/d18/d1c/d25/f12a x:0 0 0 2024-09-04T16:30:21.715 INFO:tasks.workunit.client.1.smithi193.stdout:5/915: chown d1/d8/db/d15/d2b/d83/d37/d58/d9e/da7/fbf 3552 1 2024-09-04T16:30:21.716 INFO:tasks.workunit.client.1.smithi193.stdout:3/923: chown d0/f66 62 1 2024-09-04T16:30:21.717 INFO:tasks.workunit.client.1.smithi193.stdout:4/844: link d3/d1a/d111/d89/dbd/le9 d3/d1a/d111/l118 0 2024-09-04T16:30:21.718 INFO:tasks.workunit.client.0.smithi170.stdout:7/614: creat d12/d15/d71/d42/d79/fd5 x:0 0 0 2024-09-04T16:30:21.721 INFO:tasks.workunit.client.0.smithi170.stdout:7/615: fsync fc 0 2024-09-04T16:30:21.722 INFO:tasks.workunit.client.1.smithi193.stdout:9/985: dwrite d2/d18/d2f/d22/d30/d6a/d6e/d95/fec [0,4194304] 0 2024-09-04T16:30:21.723 INFO:tasks.workunit.client.0.smithi170.stdout:9/395: dread d2/d11/f12 [0,4194304] 0 2024-09-04T16:30:21.723 INFO:tasks.workunit.client.1.smithi193.stdout:3/924: readlink d0/d7/de/l59 0 2024-09-04T16:30:21.723 INFO:tasks.workunit.client.0.smithi170.stdout:1/486: rename d9/c19 to d9/d11/d2f/d6b/c9d 0 2024-09-04T16:30:21.724 INFO:tasks.workunit.client.1.smithi193.stdout:0/918: creat d18/f135 x:0 0 0 2024-09-04T16:30:21.726 INFO:tasks.workunit.client.0.smithi170.stdout:7/616: creat d12/d16/db7/fd6 x:0 0 0 2024-09-04T16:30:21.729 INFO:tasks.workunit.client.1.smithi193.stdout:4/845: mknod d3/d1a/d111/d89/dbd/c119 0 2024-09-04T16:30:21.730 INFO:tasks.workunit.client.0.smithi170.stdout:1/487: dwrite d9/d11/d2f/f57 [0,4194304] 0 2024-09-04T16:30:21.732 INFO:tasks.workunit.client.1.smithi193.stdout:3/925: symlink d0/d9/d49/l12b 0 2024-09-04T16:30:21.733 INFO:tasks.workunit.client.0.smithi170.stdout:9/396: rename d2/d3d/d27/f2e to d2/d3d/d27/d65/d5b/f71 0 2024-09-04T16:30:21.734 INFO:tasks.workunit.client.0.smithi170.stdout:9/397: fsync d2/d3d/d27/d2b/d34/f6b 0 2024-09-04T16:30:21.734 INFO:tasks.workunit.client.0.smithi170.stdout:9/398: chown d2/d3d/fc 58 1 2024-09-04T16:30:21.736 INFO:tasks.workunit.client.1.smithi193.stdout:9/986: dwrite d2/d8/d25/f37 [0,4194304] 0 2024-09-04T16:30:21.737 INFO:tasks.workunit.client.1.smithi193.stdout:9/987: readlink d2/d18/d2f/d22/d30/d6a/d6e/de2/d107/l108 0 2024-09-04T16:30:21.738 INFO:tasks.workunit.client.1.smithi193.stdout:5/916: rename d1/d8/db/d15/d2b/d83/d37/d3f/d8e/f66 to d1/dd0/d102/f12c 0 2024-09-04T16:30:21.742 INFO:tasks.workunit.client.0.smithi170.stdout:9/399: unlink d2/d3d/d27/d2b/c4c 0 2024-09-04T16:30:21.742 INFO:tasks.workunit.client.1.smithi193.stdout:6/886: write d5/d33/d4e/d51/d68/fe1 [505681,102378] 0 2024-09-04T16:30:21.742 INFO:tasks.workunit.client.1.smithi193.stdout:3/926: fsync d0/d18/f50 0 2024-09-04T16:30:21.745 INFO:tasks.workunit.client.1.smithi193.stdout:9/988: creat d2/d8/d4d/f137 x:0 0 0 2024-09-04T16:30:21.745 INFO:tasks.workunit.client.1.smithi193.stdout:2/896: dread d2/fc [8388608,4194304] 0 2024-09-04T16:30:21.748 INFO:tasks.workunit.client.1.smithi193.stdout:4/846: rename d3/d1a/d111/d98/dcf/lde to d3/d1a/d111/d89/dbd/d116/l11a 0 2024-09-04T16:30:21.750 INFO:tasks.workunit.client.0.smithi170.stdout:9/400: dwrite d2/d11/f33 [0,4194304] 0 2024-09-04T16:30:21.752 INFO:tasks.workunit.client.0.smithi170.stdout:1/488: getdents d9/d11/d3e/d6a/d79/d7c 0 2024-09-04T16:30:21.756 INFO:tasks.workunit.client.1.smithi193.stdout:3/927: dwrite d0/d18/d1c/d51/d5a/da2/f123 [0,4194304] 0 2024-09-04T16:30:21.756 INFO:tasks.workunit.client.1.smithi193.stdout:6/887: mkdir d5/d33/d4e/d51/d68/d11f 0 2024-09-04T16:30:21.758 INFO:tasks.workunit.client.0.smithi170.stdout:9/401: rename d2/l21 to d2/d11/d23/l72 0 2024-09-04T16:30:21.759 INFO:tasks.workunit.client.0.smithi170.stdout:1/489: dwrite d9/d34/d5f/f71 [0,4194304] 0 2024-09-04T16:30:21.761 INFO:tasks.workunit.client.1.smithi193.stdout:6/888: write d5/d33/d4e/d51/d71/dcf/d10c/f11b [793640,11929] 0 2024-09-04T16:30:21.764 INFO:tasks.workunit.client.1.smithi193.stdout:5/917: dwrite d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/fb7 [0,4194304] 0 2024-09-04T16:30:21.765 INFO:tasks.workunit.client.0.smithi170.stdout:1/490: mkdir d9/d11/d2e/d9e 0 2024-09-04T16:30:21.767 INFO:tasks.workunit.client.0.smithi170.stdout:1/491: truncate d9/d26/d77/d83/f90 73695 0 2024-09-04T16:30:21.770 INFO:tasks.workunit.client.0.smithi170.stdout:9/402: rename d2/d3d/d27/d2b/d34/f45 to d2/d3d/d27/d65/d66/f73 0 2024-09-04T16:30:21.774 INFO:tasks.workunit.client.1.smithi193.stdout:2/897: creat d2/d9/db/d10/d1e/d26/dc1/f130 x:0 0 0 2024-09-04T16:30:21.776 INFO:tasks.workunit.client.1.smithi193.stdout:3/928: rename d0/d18/f50 to d0/d3b/f12c 0 2024-09-04T16:30:21.776 INFO:tasks.workunit.client.1.smithi193.stdout:9/989: write d2/d8/d15/fb8 [5444055,98347] 0 2024-09-04T16:30:21.776 INFO:tasks.workunit.client.0.smithi170.stdout:9/403: rmdir d2/d11/d23 39 2024-09-04T16:30:21.778 INFO:tasks.workunit.client.0.smithi170.stdout:9/404: chown d2/d3d/d27/f64 16 1 2024-09-04T16:30:21.778 INFO:tasks.workunit.client.1.smithi193.stdout:0/919: getdents d18/d25/d32/d57/d6c/db1/deb 0 2024-09-04T16:30:21.778 INFO:tasks.workunit.client.1.smithi193.stdout:3/929: rename d0/d18 to d0/d18/d1c/d25/d5e/d90/d103/d12d 22 2024-09-04T16:30:21.779 INFO:tasks.workunit.client.1.smithi193.stdout:0/920: write d18/d79/d88/fab [4156061,79454] 0 2024-09-04T16:30:21.779 INFO:tasks.workunit.client.1.smithi193.stdout:6/889: unlink d5/d27/f84 0 2024-09-04T16:30:21.780 INFO:tasks.workunit.client.1.smithi193.stdout:6/890: stat d5/de/lab 0 2024-09-04T16:30:21.782 INFO:tasks.workunit.client.1.smithi193.stdout:5/918: unlink d1/d8/db/d36/d40/dc1/fed 0 2024-09-04T16:30:21.783 INFO:tasks.workunit.client.1.smithi193.stdout:6/891: read d5/de/fbf [3308111,14609] 0 2024-09-04T16:30:21.784 INFO:tasks.workunit.client.1.smithi193.stdout:2/898: creat d2/d9/db/d10/d38/f131 x:0 0 0 2024-09-04T16:30:21.786 INFO:tasks.workunit.client.1.smithi193.stdout:3/930: rmdir d0/d18/d1c/d25/d5e/d68 39 2024-09-04T16:30:21.787 INFO:tasks.workunit.client.1.smithi193.stdout:0/921: mknod d18/d25/d32/d57/d6c/dfc/c136 0 2024-09-04T16:30:21.788 INFO:tasks.workunit.client.1.smithi193.stdout:8/933: sync 2024-09-04T16:30:21.788 INFO:tasks.workunit.client.1.smithi193.stdout:2/899: rmdir d2/d9 39 2024-09-04T16:30:21.789 INFO:tasks.workunit.client.1.smithi193.stdout:8/934: readlink d2/d20/d23/d51/l9d 0 2024-09-04T16:30:21.791 INFO:tasks.workunit.client.1.smithi193.stdout:9/990: mknod d2/d18/d2f/d22/c138 0 2024-09-04T16:30:21.791 INFO:tasks.workunit.client.1.smithi193.stdout:5/919: truncate d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/f7a 4868671 0 2024-09-04T16:30:21.792 INFO:tasks.workunit.client.0.smithi170.stdout:9/405: dread d2/d11/d23/f29 [0,4194304] 0 2024-09-04T16:30:21.796 INFO:tasks.workunit.client.1.smithi193.stdout:8/935: dread d2/f31 [0,4194304] 0 2024-09-04T16:30:21.800 INFO:tasks.workunit.client.1.smithi193.stdout:5/920: dwrite d1/dc3/f25 [0,4194304] 0 2024-09-04T16:30:21.801 INFO:tasks.workunit.client.0.smithi170.stdout:9/406: unlink d2/d3d/d27/d2b/d34/l69 0 2024-09-04T16:30:21.801 INFO:tasks.workunit.client.0.smithi170.stdout:9/407: fsync d2/d32/f41 0 2024-09-04T16:30:21.801 INFO:tasks.workunit.client.0.smithi170.stdout:9/408: write d2/d3d/d27/d65/f52 [113363,32693] 0 2024-09-04T16:30:21.806 INFO:tasks.workunit.client.1.smithi193.stdout:4/847: truncate d3/d1a/d111/f53 3995953 0 2024-09-04T16:30:21.808 INFO:tasks.workunit.client.1.smithi193.stdout:2/900: creat d2/d9/db/d10/d51/d79/f132 x:0 0 0 2024-09-04T16:30:21.808 INFO:tasks.workunit.client.1.smithi193.stdout:2/901: chown d2/d9/db/d10/d38/da5/fbb 9 1 2024-09-04T16:30:21.809 INFO:tasks.workunit.client.1.smithi193.stdout:2/902: fdatasync d2/d9/db/d65/f9e 0 2024-09-04T16:30:21.811 INFO:tasks.workunit.client.1.smithi193.stdout:2/903: write d2/d9/db/d10/d38/d63/fef [1008280,67276] 0 2024-09-04T16:30:21.811 INFO:tasks.workunit.client.1.smithi193.stdout:8/936: creat d2/d20/d23/d34/dd6/f12b x:0 0 0 2024-09-04T16:30:21.812 INFO:tasks.workunit.client.0.smithi170.stdout:9/409: mknod d2/d3d/d54/c74 0 2024-09-04T16:30:21.813 INFO:tasks.workunit.client.0.smithi170.stdout:9/410: fdatasync d2/d3d/d27/d2b/d34/f6b 0 2024-09-04T16:30:21.813 INFO:tasks.workunit.client.1.smithi193.stdout:5/921: mknod d1/d8/db/d36/c12d 0 2024-09-04T16:30:21.814 INFO:tasks.workunit.client.1.smithi193.stdout:9/991: truncate d2/d8/f4f 5440923 0 2024-09-04T16:30:21.816 INFO:tasks.workunit.client.1.smithi193.stdout:5/922: chown d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/dd8/d119 3 1 2024-09-04T16:30:21.816 INFO:tasks.workunit.client.0.smithi170.stdout:9/411: fsync d2/d3d/d27/d65/d56/f5a 0 2024-09-04T16:30:21.817 INFO:tasks.workunit.client.0.smithi170.stdout:9/412: fsync d2/d3d/d27/d2b/d34/f6b 0 2024-09-04T16:30:21.817 INFO:tasks.workunit.client.1.smithi193.stdout:2/904: dwrite d2/d9/db/d10/d1e/f96 [0,4194304] 0 2024-09-04T16:30:21.817 INFO:tasks.workunit.client.1.smithi193.stdout:3/931: write d0/f66 [993010,86128] 0 2024-09-04T16:30:21.822 INFO:tasks.workunit.client.1.smithi193.stdout:8/937: creat d2/d20/d23/d34/d4b/dd4/f12c x:0 0 0 2024-09-04T16:30:21.823 INFO:tasks.workunit.client.1.smithi193.stdout:0/922: getdents d18/d25/d5f/d107 0 2024-09-04T16:30:21.825 INFO:tasks.workunit.client.1.smithi193.stdout:0/923: write d18/d25/f2a [400272,88196] 0 2024-09-04T16:30:21.826 INFO:tasks.workunit.client.0.smithi170.stdout:9/413: link d2/d3d/d27/d65/f37 d2/d3d/d27/d65/d5b/f75 0 2024-09-04T16:30:21.827 INFO:tasks.workunit.client.1.smithi193.stdout:4/848: mkdir d3/d1a/d111/d47/d11b 0 2024-09-04T16:30:21.828 INFO:tasks.workunit.client.1.smithi193.stdout:4/849: chown d3/f10f 191 1 2024-09-04T16:30:21.832 INFO:tasks.workunit.client.1.smithi193.stdout:0/924: dwrite d18/d25/d5f/def/da0/fbc [0,4194304] 0 2024-09-04T16:30:21.832 INFO:tasks.workunit.client.1.smithi193.stdout:0/925: chown d18/d25/d32 17 1 2024-09-04T16:30:21.918 INFO:tasks.workunit.client.0.smithi170.stdout:9/414: creat d2/d32/f76 x:0 0 0 2024-09-04T16:30:21.918 INFO:tasks.workunit.client.1.smithi193.stdout:5/923: creat d1/d8/db/d15/d2b/d83/d37/d58/dc4/dda/f12e x:0 0 0 2024-09-04T16:30:21.919 INFO:tasks.workunit.client.1.smithi193.stdout:2/905: dwrite d2/d9/db/f72 [0,4194304] 0 2024-09-04T16:30:21.921 INFO:tasks.workunit.client.1.smithi193.stdout:2/906: chown d2/d9/db/d10/d51/dca/ff6 0 1 2024-09-04T16:30:21.922 INFO:tasks.workunit.client.1.smithi193.stdout:2/907: chown d2/d9/db/d10/c104 446323432 1 2024-09-04T16:30:21.938 INFO:tasks.workunit.client.1.smithi193.stdout:6/892: sync 2024-09-04T16:30:22.002 INFO:tasks.workunit.client.0.smithi170.stdout:2/352: sync 2024-09-04T16:30:22.005 INFO:tasks.workunit.client.1.smithi193.stdout:3/932: creat d0/d18/d1c/d25/da0/f12e x:0 0 0 2024-09-04T16:30:22.009 INFO:tasks.workunit.client.1.smithi193.stdout:8/938: rename d2/d20/d23/d51/c58 to d2/d20/d23/d1b/d4e/c12d 0 2024-09-04T16:30:22.013 INFO:tasks.workunit.client.1.smithi193.stdout:9/992: mknod d2/d8/c139 0 2024-09-04T16:30:22.014 INFO:tasks.workunit.client.1.smithi193.stdout:9/993: readlink d2/d18/d2f/d9a/ld5 0 2024-09-04T16:30:22.017 INFO:tasks.workunit.client.1.smithi193.stdout:2/908: creat d2/d9/db/d10/d4e/f133 x:0 0 0 2024-09-04T16:30:22.021 INFO:tasks.workunit.client.1.smithi193.stdout:9/994: symlink d2/deb/d11d/d131/dda/l13a 0 2024-09-04T16:30:22.026 INFO:tasks.workunit.client.1.smithi193.stdout:3/933: unlink d0/d18/d1c/d25/d5e/d7e/c80 0 2024-09-04T16:30:22.028 INFO:tasks.workunit.client.1.smithi193.stdout:2/909: mkdir d2/d9/d18/d7b/db5/d134 0 2024-09-04T16:30:22.029 INFO:tasks.workunit.client.1.smithi193.stdout:9/995: symlink d2/d18/d2f/d22/d30/dee/l13b 0 2024-09-04T16:30:22.031 INFO:tasks.workunit.client.1.smithi193.stdout:0/926: link d18/d25/d5f/def/lb6 d18/d25/d5f/def/dfa/l137 0 2024-09-04T16:30:22.033 INFO:tasks.workunit.client.1.smithi193.stdout:5/924: rmdir d1/d29/d74/d96/dfd/d123 0 2024-09-04T16:30:22.033 INFO:tasks.workunit.client.1.smithi193.stdout:2/910: dwrite d2/d9/db/d10/d1f/d4a/dc2/dc4/f126 [0,4194304] 0 2024-09-04T16:30:22.035 INFO:tasks.workunit.client.1.smithi193.stdout:3/934: creat d0/d18/d1c/d51/d5a/da2/f12f x:0 0 0 2024-09-04T16:30:22.037 INFO:tasks.workunit.client.1.smithi193.stdout:3/935: rename d0/d7/de/d45 to d0/d7/de/d45/d10b/d130 22 2024-09-04T16:30:22.041 INFO:tasks.workunit.client.1.smithi193.stdout:2/911: dwrite d2/d9/db/d10/d1e/ff7 [0,4194304] 0 2024-09-04T16:30:22.042 INFO:tasks.workunit.client.0.smithi170.stdout:9/415: mknod d2/d3d/d27/d65/c77 0 2024-09-04T16:30:22.045 INFO:tasks.workunit.client.1.smithi193.stdout:6/893: sync 2024-09-04T16:30:22.048 INFO:tasks.workunit.client.0.smithi170.stdout:9/416: creat d2/d3d/d27/d2b/d34/f78 x:0 0 0 2024-09-04T16:30:22.050 INFO:tasks.workunit.client.1.smithi193.stdout:4/850: dwrite d3/d1a/d111/d89/d115/fce [0,4194304] 0 2024-09-04T16:30:22.050 INFO:tasks.workunit.client.0.smithi170.stdout:9/417: write d2/d3d/d27/d65/f52 [1457601,42137] 0 2024-09-04T16:30:22.051 INFO:tasks.workunit.client.0.smithi170.stdout:2/353: symlink d3/l6a 0 2024-09-04T16:30:22.053 INFO:tasks.workunit.client.1.smithi193.stdout:5/925: mkdir d1/d8/db/d12f 0 2024-09-04T16:30:22.058 INFO:tasks.workunit.client.0.smithi170.stdout:9/418: dwrite d2/d3d/f20 [0,4194304] 0 2024-09-04T16:30:22.059 INFO:tasks.workunit.client.0.smithi170.stdout:9/419: write d2/d11/d23/f55 [434755,69067] 0 2024-09-04T16:30:22.060 INFO:tasks.workunit.client.0.smithi170.stdout:2/354: dread - d3/db/f3b zero size 2024-09-04T16:30:22.063 INFO:tasks.workunit.client.0.smithi170.stdout:0/472: sync 2024-09-04T16:30:22.068 INFO:tasks.workunit.client.1.smithi193.stdout:9/996: rename d2/d18/d2f/d22/d30/d6a/d6e/caf to d2/d18/d2f/d22/d30/d6a/d6e/c13c 0 2024-09-04T16:30:22.069 INFO:tasks.workunit.client.0.smithi170.stdout:9/420: dwrite d2/d32/f61 [0,4194304] 0 2024-09-04T16:30:22.069 INFO:tasks.workunit.client.0.smithi170.stdout:9/421: chown d2/d3d/d6d 43807 1 2024-09-04T16:30:22.070 INFO:tasks.workunit.client.0.smithi170.stdout:2/355: creat d3/db/d1c/f6b x:0 0 0 2024-09-04T16:30:22.070 INFO:tasks.workunit.client.0.smithi170.stdout:9/422: stat d2/d11/d23/l4e 0 2024-09-04T16:30:22.071 INFO:tasks.workunit.client.1.smithi193.stdout:4/851: write d3/f35 [4333548,56415] 0 2024-09-04T16:30:22.075 INFO:tasks.workunit.client.0.smithi170.stdout:0/473: unlink d11/f79 0 2024-09-04T16:30:22.079 INFO:tasks.workunit.client.0.smithi170.stdout:9/423: mkdir d2/d3d/d6d/d79 0 2024-09-04T16:30:22.080 INFO:tasks.workunit.client.0.smithi170.stdout:2/356: dread d3/f46 [0,4194304] 0 2024-09-04T16:30:22.082 INFO:tasks.workunit.client.1.smithi193.stdout:5/926: dwrite d1/d8/db/d36/d40/ff1 [4194304,4194304] 0 2024-09-04T16:30:22.083 INFO:tasks.workunit.client.1.smithi193.stdout:0/927: write d18/d25/d5f/d65/dc4/dd5/fe6 [175108,124534] 0 2024-09-04T16:30:22.083 INFO:tasks.workunit.client.1.smithi193.stdout:5/927: fdatasync d1/d8/f12 0 2024-09-04T16:30:22.084 INFO:tasks.workunit.client.1.smithi193.stdout:9/997: rmdir d2/d18/d2f/d22/d30/d6a/d6e/de2 39 2024-09-04T16:30:22.086 INFO:tasks.workunit.client.1.smithi193.stdout:4/852: rmdir d3/d1a 39 2024-09-04T16:30:22.086 INFO:tasks.workunit.client.1.smithi193.stdout:5/928: write d1/d8/db/d15/d2b/d83/d37/d58/d9e/dec/ffb [853853,109456] 0 2024-09-04T16:30:22.087 INFO:tasks.workunit.client.0.smithi170.stdout:2/357: mknod d3/d4/d14/c6c 0 2024-09-04T16:30:22.090 INFO:tasks.workunit.client.1.smithi193.stdout:2/912: write d2/d9/db/d10/d1e/da4/fc6 [4461960,36025] 0 2024-09-04T16:30:22.090 INFO:tasks.workunit.client.1.smithi193.stdout:8/939: sync 2024-09-04T16:30:22.093 INFO:tasks.workunit.client.1.smithi193.stdout:8/940: chown d2/d20/dc0/l9e 12 1 2024-09-04T16:30:22.095 INFO:tasks.workunit.client.1.smithi193.stdout:8/941: chown d2/d20/d23/d24/d3c/de7/l101 367351 1 2024-09-04T16:30:22.095 INFO:tasks.workunit.client.0.smithi170.stdout:2/358: truncate d3/d3c/d40/d48/f5b 787806 0 2024-09-04T16:30:22.096 INFO:tasks.workunit.client.1.smithi193.stdout:8/942: chown d2/d20/d23/f29 89605425 1 2024-09-04T16:30:22.097 INFO:tasks.workunit.client.1.smithi193.stdout:9/998: symlink d2/d18/d2f/d22/d30/d52/dfd/l13d 0 2024-09-04T16:30:22.097 INFO:tasks.workunit.client.1.smithi193.stdout:6/894: dwrite d5/d27/d3e/d43/f72 [0,4194304] 0 2024-09-04T16:30:22.098 INFO:tasks.workunit.client.1.smithi193.stdout:6/895: chown d5/d33/d4e/d51 251 1 2024-09-04T16:30:22.099 INFO:tasks.workunit.client.0.smithi170.stdout:2/359: rename d3/d7/c29 to d3/db/df/c6d 0 2024-09-04T16:30:22.100 INFO:tasks.workunit.client.1.smithi193.stdout:9/999: read d2/deb/d11d/f7f [2422274,45875] 0 2024-09-04T16:30:22.101 INFO:tasks.workunit.client.0.smithi170.stdout:0/474: write d11/d13/d71/f5f [2103009,104891] 0 2024-09-04T16:30:22.101 INFO:tasks.workunit.client.0.smithi170.stdout:2/360: read d3/f46 [79509,44257] 0 2024-09-04T16:30:22.101 INFO:tasks.workunit.client.1.smithi193.stdout:2/913: mkdir d2/d9/db/d10/d38/d63/d135 0 2024-09-04T16:30:22.102 INFO:tasks.workunit.client.0.smithi170.stdout:9/424: write d2/d11/d23/f29 [207302,70334] 0 2024-09-04T16:30:22.105 INFO:tasks.workunit.client.1.smithi193.stdout:3/936: creat d0/d7/de/f131 x:0 0 0 2024-09-04T16:30:22.106 INFO:tasks.workunit.client.1.smithi193.stdout:6/896: rmdir d5/d33/d4e/d51/d71 39 2024-09-04T16:30:22.106 INFO:tasks.workunit.client.1.smithi193.stdout:3/937: write d0/d18/d1c/d51/f10f [609214,126135] 0 2024-09-04T16:30:22.107 INFO:tasks.workunit.client.1.smithi193.stdout:4/853: creat d3/d1a/d111/d89/d115/f11c x:0 0 0 2024-09-04T16:30:22.108 INFO:tasks.workunit.client.0.smithi170.stdout:0/475: symlink d11/d13/d36/lb5 0 2024-09-04T16:30:22.108 INFO:tasks.workunit.client.1.smithi193.stdout:0/928: dread d18/f38 [0,4194304] 0 2024-09-04T16:30:22.108 INFO:tasks.workunit.client.0.smithi170.stdout:9/425: mkdir d2/d3d/d27/d65/d56/d7a 0 2024-09-04T16:30:22.109 INFO:tasks.workunit.client.1.smithi193.stdout:5/929: dread d1/d8/f12 [0,4194304] 0 2024-09-04T16:30:22.109 INFO:tasks.workunit.client.1.smithi193.stdout:0/929: stat d18/d25/c9b 0 2024-09-04T16:30:22.109 INFO:tasks.workunit.client.1.smithi193.stdout:2/914: symlink d2/d9/db/d10/d1f/d4a/dc2/l136 0 2024-09-04T16:30:22.110 INFO:tasks.workunit.client.0.smithi170.stdout:2/361: symlink d3/d3c/l6e 0 2024-09-04T16:30:22.112 INFO:tasks.workunit.client.0.smithi170.stdout:9/426: mknod d2/d3d/d27/d65/d5b/c7b 0 2024-09-04T16:30:22.114 INFO:tasks.workunit.client.1.smithi193.stdout:8/943: creat d2/f12e x:0 0 0 2024-09-04T16:30:22.114 INFO:tasks.workunit.client.1.smithi193.stdout:6/897: fsync d5/d33/d4e/d51/f54 0 2024-09-04T16:30:22.115 INFO:tasks.workunit.client.1.smithi193.stdout:4/854: symlink d3/d1a/d111/d98/dcf/l11d 0 2024-09-04T16:30:22.115 INFO:tasks.workunit.client.0.smithi170.stdout:9/427: dread d2/d3d/f1f [0,4194304] 0 2024-09-04T16:30:22.116 INFO:tasks.workunit.client.1.smithi193.stdout:2/915: chown d2/d9/db/d10/d1e/da4/f50 5751 1 2024-09-04T16:30:22.116 INFO:tasks.workunit.client.0.smithi170.stdout:0/476: creat d11/d13/d71/fb6 x:0 0 0 2024-09-04T16:30:22.117 INFO:tasks.workunit.client.1.smithi193.stdout:8/944: chown d2/d20/d23/d51/d76/dfa/c105 486 1 2024-09-04T16:30:22.119 INFO:tasks.workunit.client.0.smithi170.stdout:2/362: dwrite d3/d4/f52 [0,4194304] 0 2024-09-04T16:30:22.120 INFO:tasks.workunit.client.1.smithi193.stdout:0/930: dwrite d18/d25/d5f/def/dfa/f10e [0,4194304] 0 2024-09-04T16:30:22.121 INFO:tasks.workunit.client.0.smithi170.stdout:2/363: chown d3/db/f3b 1005942 1 2024-09-04T16:30:22.122 INFO:tasks.workunit.client.0.smithi170.stdout:9/428: symlink d2/d32/l7c 0 2024-09-04T16:30:22.122 INFO:tasks.workunit.client.0.smithi170.stdout:0/477: creat d11/d75/fb7 x:0 0 0 2024-09-04T16:30:22.128 INFO:tasks.workunit.client.0.smithi170.stdout:3/338: sync 2024-09-04T16:30:22.129 INFO:tasks.workunit.client.0.smithi170.stdout:9/429: write d2/d3d/d27/f53 [3435762,36513] 0 2024-09-04T16:30:22.129 INFO:tasks.workunit.client.0.smithi170.stdout:4/392: sync 2024-09-04T16:30:22.129 INFO:tasks.workunit.client.0.smithi170.stdout:6/323: sync 2024-09-04T16:30:22.131 INFO:tasks.workunit.client.0.smithi170.stdout:0/478: mkdir d11/d13/d4a/db8 0 2024-09-04T16:30:22.135 INFO:tasks.workunit.client.0.smithi170.stdout:2/364: dwrite d3/d3c/d40/d48/f5e [0,4194304] 0 2024-09-04T16:30:22.135 INFO:tasks.workunit.client.0.smithi170.stdout:3/339: write d13/d14/d1f/f60 [534492,23958] 0 2024-09-04T16:30:22.141 INFO:tasks.workunit.client.0.smithi170.stdout:4/393: dwrite d1/d6/d2b/d47/d78/f7f [0,4194304] 0 2024-09-04T16:30:22.143 INFO:tasks.workunit.client.0.smithi170.stdout:0/479: creat d11/d8e/fb9 x:0 0 0 2024-09-04T16:30:22.150 INFO:tasks.workunit.client.0.smithi170.stdout:0/480: dwrite d11/f68 [0,4194304] 0 2024-09-04T16:30:22.162 INFO:tasks.workunit.client.0.smithi170.stdout:9/430: fsync d2/d3d/d27/d65/f37 0 2024-09-04T16:30:22.163 INFO:tasks.workunit.client.0.smithi170.stdout:9/431: chown d2/d3d/d27/d2b/d34/c4b 110792986 1 2024-09-04T16:30:22.164 INFO:tasks.workunit.client.0.smithi170.stdout:2/365: mkdir d3/db/d62/d6f 0 2024-09-04T16:30:22.165 INFO:tasks.workunit.client.0.smithi170.stdout:6/324: mkdir d0/df/d1b/d3e/d47/d68/d2d/d67/d69 0 2024-09-04T16:30:22.167 INFO:tasks.workunit.client.0.smithi170.stdout:0/481: unlink d11/f1c 0 2024-09-04T16:30:22.168 INFO:tasks.workunit.client.0.smithi170.stdout:0/482: stat d11/d13/d36/l69 0 2024-09-04T16:30:22.168 INFO:tasks.workunit.client.0.smithi170.stdout:0/483: chown d11/d8e/fb9 8875392 1 2024-09-04T16:30:22.169 INFO:tasks.workunit.client.0.smithi170.stdout:0/484: dread - d11/d75/fb7 zero size 2024-09-04T16:30:22.169 INFO:tasks.workunit.client.0.smithi170.stdout:3/340: mknod d13/d14/d21/d46/c6d 0 2024-09-04T16:30:22.171 INFO:tasks.workunit.client.0.smithi170.stdout:3/341: write d13/d14/d21/d4c/f5c [2763086,92511] 0 2024-09-04T16:30:22.176 INFO:tasks.workunit.client.0.smithi170.stdout:1/492: sync 2024-09-04T16:30:22.176 INFO:tasks.workunit.client.0.smithi170.stdout:5/308: sync 2024-09-04T16:30:22.176 INFO:tasks.workunit.client.0.smithi170.stdout:7/617: sync 2024-09-04T16:30:22.176 INFO:tasks.workunit.client.0.smithi170.stdout:8/430: sync 2024-09-04T16:30:22.177 INFO:tasks.workunit.client.0.smithi170.stdout:9/432: write d2/d3d/d27/d65/f37 [452161,87237] 0 2024-09-04T16:30:22.179 INFO:tasks.workunit.client.0.smithi170.stdout:6/325: creat d0/d15/d56/f6a x:0 0 0 2024-09-04T16:30:22.179 INFO:tasks.workunit.client.0.smithi170.stdout:5/309: dread - d4/f53 zero size 2024-09-04T16:30:22.181 INFO:tasks.workunit.client.0.smithi170.stdout:0/485: chown d11/d13/d4a/d66/d8c/da8/ca9 7779923 1 2024-09-04T16:30:22.181 INFO:tasks.workunit.client.0.smithi170.stdout:5/310: stat d4/c4e 0 2024-09-04T16:30:22.183 INFO:tasks.workunit.client.0.smithi170.stdout:3/342: dwrite d13/d14/d21/f36 [0,4194304] 0 2024-09-04T16:30:22.184 INFO:tasks.workunit.client.0.smithi170.stdout:4/394: dwrite d1/d6/d2b/d33/f64 [0,4194304] 0 2024-09-04T16:30:22.184 INFO:tasks.workunit.client.0.smithi170.stdout:9/433: write d2/d3d/d27/d65/d5b/f75 [439492,12264] 0 2024-09-04T16:30:22.188 INFO:tasks.workunit.client.0.smithi170.stdout:8/431: truncate d6/d28/d16/d52/d73/d5d/f89 927459 0 2024-09-04T16:30:22.189 INFO:tasks.workunit.client.0.smithi170.stdout:0/486: chown d11/d13/f20 43878412 1 2024-09-04T16:30:22.195 INFO:tasks.workunit.client.1.smithi193.stdout:3/938: creat d0/d18/d1c/d51/d5a/dfc/f132 x:0 0 0 2024-09-04T16:30:22.196 INFO:tasks.workunit.client.0.smithi170.stdout:5/311: chown d4/d3a/f4d 118474123 1 2024-09-04T16:30:22.200 INFO:tasks.workunit.client.1.smithi193.stdout:5/930: mkdir d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/db9/d130 0 2024-09-04T16:30:22.204 INFO:tasks.workunit.client.0.smithi170.stdout:7/618: dread d12/d16/d1d/d65/d82/f85 [0,4194304] 0 2024-09-04T16:30:22.205 INFO:tasks.workunit.client.1.smithi193.stdout:4/855: creat d3/d1a/d111/d89/dbd/ddc/f11e x:0 0 0 2024-09-04T16:30:22.206 INFO:tasks.workunit.client.1.smithi193.stdout:4/856: write d3/f36 [61041,49213] 0 2024-09-04T16:30:22.207 INFO:tasks.workunit.client.0.smithi170.stdout:6/326: stat d0/f4 0 2024-09-04T16:30:22.207 INFO:tasks.workunit.client.0.smithi170.stdout:6/327: readlink d0/l60 0 2024-09-04T16:30:22.208 INFO:tasks.workunit.client.1.smithi193.stdout:8/945: mkdir d2/d20/d23/d34/d4b/db8/d12f 0 2024-09-04T16:30:22.209 INFO:tasks.workunit.client.1.smithi193.stdout:0/931: rmdir d18/d25/d5f/def 39 2024-09-04T16:30:22.210 INFO:tasks.workunit.client.0.smithi170.stdout:1/493: creat d9/d11/d2f/d6b/d7d/f9f x:0 0 0 2024-09-04T16:30:22.210 INFO:tasks.workunit.client.0.smithi170.stdout:4/395: creat d1/d6/d2b/d47/d78/f90 x:0 0 0 2024-09-04T16:30:22.212 INFO:tasks.workunit.client.1.smithi193.stdout:3/939: creat d0/d3b/f133 x:0 0 0 2024-09-04T16:30:22.213 INFO:tasks.workunit.client.1.smithi193.stdout:5/931: mkdir d1/d8/db/d15/d2b/d83/d37/d58/de0/d131 0 2024-09-04T16:30:22.214 INFO:tasks.workunit.client.0.smithi170.stdout:5/312: dread d4/f4a [0,4194304] 0 2024-09-04T16:30:22.214 INFO:tasks.workunit.client.1.smithi193.stdout:5/932: write d1/d8/db/fd5 [176014,37293] 0 2024-09-04T16:30:22.219 INFO:tasks.workunit.client.0.smithi170.stdout:2/366: getdents d3/d4 0 2024-09-04T16:30:22.220 INFO:tasks.workunit.client.1.smithi193.stdout:2/916: creat d2/d9/d18/d7b/db5/d134/f137 x:0 0 0 2024-09-04T16:30:22.222 INFO:tasks.workunit.client.1.smithi193.stdout:4/857: unlink d3/d1a/d111/d98/dcf/f105 0 2024-09-04T16:30:22.223 INFO:tasks.workunit.client.1.smithi193.stdout:2/917: dread d2/d9/db/d10/d51/fed [0,4194304] 0 2024-09-04T16:30:22.223 INFO:tasks.workunit.client.1.smithi193.stdout:4/858: dread - d3/d1a/d2a/f10e zero size 2024-09-04T16:30:22.224 INFO:tasks.workunit.client.0.smithi170.stdout:7/619: mknod d12/d15/d71/cd7 0 2024-09-04T16:30:22.224 INFO:tasks.workunit.client.1.smithi193.stdout:6/898: write d5/d33/d4e/d51/d71/f11d [120072,106194] 0 2024-09-04T16:30:22.226 INFO:tasks.workunit.client.0.smithi170.stdout:7/620: write d12/d16/d1d/d65/d82/fbb [2149519,116662] 0 2024-09-04T16:30:22.228 INFO:tasks.workunit.client.0.smithi170.stdout:1/494: write d9/d26/f56 [2554279,64086] 0 2024-09-04T16:30:22.229 INFO:tasks.workunit.client.1.smithi193.stdout:5/933: chown d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/cee 5 1 2024-09-04T16:30:22.230 INFO:tasks.workunit.client.1.smithi193.stdout:5/934: fsync d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/fcf 0 2024-09-04T16:30:22.230 INFO:tasks.workunit.client.0.smithi170.stdout:1/495: write d9/d11/d2e/f52 [4731689,56967] 0 2024-09-04T16:30:22.231 INFO:tasks.workunit.client.0.smithi170.stdout:1/496: chown d9/d11/d2f/d6b/d7d 25954 1 2024-09-04T16:30:22.232 INFO:tasks.workunit.client.0.smithi170.stdout:2/367: dread d3/f50 [0,4194304] 0 2024-09-04T16:30:22.235 INFO:tasks.workunit.client.1.smithi193.stdout:8/946: write d2/d12/fe [3805839,126388] 0 2024-09-04T16:30:22.235 INFO:tasks.workunit.client.1.smithi193.stdout:4/859: fdatasync d3/d39/f6b 0 2024-09-04T16:30:22.236 INFO:tasks.workunit.client.0.smithi170.stdout:8/432: truncate d6/d28/f1d 493256 0 2024-09-04T16:30:22.237 INFO:tasks.workunit.client.1.smithi193.stdout:5/935: dwrite d1/d8/db/d15/d2b/d83/d37/d58/f9a [0,4194304] 0 2024-09-04T16:30:22.239 INFO:tasks.workunit.client.0.smithi170.stdout:5/313: dread d4/d8/d1c/d26/d27/f38 [0,4194304] 0 2024-09-04T16:30:22.240 INFO:tasks.workunit.client.1.smithi193.stdout:5/936: dread - d1/d8/db/d15/d2b/d83/d37/d58/d9e/dec/f12a zero size 2024-09-04T16:30:22.240 INFO:tasks.workunit.client.1.smithi193.stdout:0/932: link d18/d25/f2a d18/d79/d88/f138 0 2024-09-04T16:30:22.242 INFO:tasks.workunit.client.0.smithi170.stdout:6/328: mknod d0/df/d1b/d3e/c6b 0 2024-09-04T16:30:22.244 INFO:tasks.workunit.client.1.smithi193.stdout:6/899: dwrite d5/f3f [0,4194304] 0 2024-09-04T16:30:22.246 INFO:tasks.workunit.client.0.smithi170.stdout:7/621: dread d12/d15/fa4 [0,4194304] 0 2024-09-04T16:30:22.248 INFO:tasks.workunit.client.0.smithi170.stdout:1/497: mknod d9/d11/d3e/d6a/ca0 0 2024-09-04T16:30:22.249 INFO:tasks.workunit.client.0.smithi170.stdout:1/498: readlink d9/d11/d2f/d6b/d61/l6e 0 2024-09-04T16:30:22.251 INFO:tasks.workunit.client.1.smithi193.stdout:2/918: mknod d2/d9/db/c138 0 2024-09-04T16:30:22.253 INFO:tasks.workunit.client.0.smithi170.stdout:0/487: fsync d11/d13/d2f/d3f/f4f 0 2024-09-04T16:30:22.254 INFO:tasks.workunit.client.1.smithi193.stdout:3/940: creat d0/d18/f134 x:0 0 0 2024-09-04T16:30:22.255 INFO:tasks.workunit.client.0.smithi170.stdout:3/343: getdents d13/d14/d17/d1c 0 2024-09-04T16:30:22.255 INFO:tasks.workunit.client.1.smithi193.stdout:5/937: dread d1/d8/db/d36/d40/fc5 [0,4194304] 0 2024-09-04T16:30:22.256 INFO:tasks.workunit.client.1.smithi193.stdout:0/933: fdatasync d18/d25/d5f/def/f10d 0 2024-09-04T16:30:22.259 INFO:tasks.workunit.client.0.smithi170.stdout:5/314: creat d4/d8/d1c/d23/f5d x:0 0 0 2024-09-04T16:30:22.261 INFO:tasks.workunit.client.1.smithi193.stdout:4/860: dread d3/f1c [0,4194304] 0 2024-09-04T16:30:22.262 INFO:tasks.workunit.client.0.smithi170.stdout:9/434: getdents d2/d3d/d27 0 2024-09-04T16:30:22.266 INFO:tasks.workunit.client.0.smithi170.stdout:8/433: creat d6/d28/d16/d52/d73/d5d/d8b/f96 x:0 0 0 2024-09-04T16:30:22.267 INFO:tasks.workunit.client.1.smithi193.stdout:3/941: creat d0/d3b/f135 x:0 0 0 2024-09-04T16:30:22.269 INFO:tasks.workunit.client.0.smithi170.stdout:2/368: write d3/d7/f4d [934248,95156] 0 2024-09-04T16:30:22.271 INFO:tasks.workunit.client.0.smithi170.stdout:6/329: dread d0/d17/f1c [4194304,4194304] 0 2024-09-04T16:30:22.274 INFO:tasks.workunit.client.0.smithi170.stdout:0/488: creat d11/d8e/fba x:0 0 0 2024-09-04T16:30:22.275 INFO:tasks.workunit.client.0.smithi170.stdout:0/489: write d11/d13/d35/fa5 [647244,86269] 0 2024-09-04T16:30:22.276 INFO:tasks.workunit.client.0.smithi170.stdout:3/344: mkdir d13/d14/d21/d46/d6e 0 2024-09-04T16:30:22.277 INFO:tasks.workunit.client.1.smithi193.stdout:6/900: write d5/d27/fd4 [5110706,85845] 0 2024-09-04T16:30:22.277 INFO:tasks.workunit.client.0.smithi170.stdout:3/345: readlink d13/d14/l43 0 2024-09-04T16:30:22.278 INFO:tasks.workunit.client.1.smithi193.stdout:6/901: write d5/d33/d4e/d51/d71/dcf/d10c/f11b [1695632,111364] 0 2024-09-04T16:30:22.279 INFO:tasks.workunit.client.1.smithi193.stdout:8/947: creat d2/d20/d23/d24/f130 x:0 0 0 2024-09-04T16:30:22.279 INFO:tasks.workunit.client.0.smithi170.stdout:9/435: creat d2/d3d/d27/d65/d5b/f7d x:0 0 0 2024-09-04T16:30:22.280 INFO:tasks.workunit.client.0.smithi170.stdout:9/436: readlink d2/d32/l3b 0 2024-09-04T16:30:22.280 INFO:tasks.workunit.client.1.smithi193.stdout:8/948: chown d2/d57/fa6 1274365 1 2024-09-04T16:30:22.281 INFO:tasks.workunit.client.0.smithi170.stdout:8/434: mkdir d6/d28/d5f/d70/d97 0 2024-09-04T16:30:22.282 INFO:tasks.workunit.client.1.smithi193.stdout:3/942: mkdir d0/d10/d24/d9a/de2/d136 0 2024-09-04T16:30:22.282 INFO:tasks.workunit.client.1.smithi193.stdout:2/919: dwrite d2/d9/db/d10/d4e/f81 [0,4194304] 0 2024-09-04T16:30:22.283 INFO:tasks.workunit.client.0.smithi170.stdout:7/622: unlink d12/d16/d1d/c26 0 2024-09-04T16:30:22.287 INFO:tasks.workunit.client.0.smithi170.stdout:1/499: creat d9/d11/d9b/fa1 x:0 0 0 2024-09-04T16:30:22.288 INFO:tasks.workunit.client.1.smithi193.stdout:0/934: truncate d18/f38 3938648 0 2024-09-04T16:30:22.289 INFO:tasks.workunit.client.0.smithi170.stdout:6/330: write d0/f14 [552893,106787] 0 2024-09-04T16:30:22.295 INFO:tasks.workunit.client.0.smithi170.stdout:1/500: dwrite d9/d26/f56 [0,4194304] 0 2024-09-04T16:30:22.296 INFO:tasks.workunit.client.1.smithi193.stdout:4/861: rename d3/d39/f42 to d3/d1a/d111/d98/dcf/f11f 0 2024-09-04T16:30:22.300 INFO:tasks.workunit.client.1.smithi193.stdout:6/902: mknod d5/d33/d4e/d51/d71/dcf/d10c/c120 0 2024-09-04T16:30:22.300 INFO:tasks.workunit.client.1.smithi193.stdout:6/903: chown d5/d27/d3e/d8c/fad 4 1 2024-09-04T16:30:22.301 INFO:tasks.workunit.client.0.smithi170.stdout:5/315: mkdir d4/db/d51/d5e 0 2024-09-04T16:30:22.303 INFO:tasks.workunit.client.1.smithi193.stdout:8/949: truncate d2/d12/f7a 198682 0 2024-09-04T16:30:22.305 INFO:tasks.workunit.client.0.smithi170.stdout:8/435: mknod d6/d28/d16/d77/c98 0 2024-09-04T16:30:22.306 INFO:tasks.workunit.client.0.smithi170.stdout:8/436: stat d6/d28/d5f/d70/f7b 0 2024-09-04T16:30:22.307 INFO:tasks.workunit.client.1.smithi193.stdout:0/935: rename d18/d25/d5f/d6a/lde to d18/d79/l139 0 2024-09-04T16:30:22.308 INFO:tasks.workunit.client.0.smithi170.stdout:7/623: rmdir d12/d16/d1d/d65/d82 39 2024-09-04T16:30:22.310 INFO:tasks.workunit.client.0.smithi170.stdout:7/624: read d12/d16/f3f [41562,9945] 0 2024-09-04T16:30:22.310 INFO:tasks.workunit.client.1.smithi193.stdout:3/943: dwrite d0/f47 [0,4194304] 0 2024-09-04T16:30:22.311 INFO:tasks.workunit.client.1.smithi193.stdout:4/862: unlink d3/d1a/f3d 0 2024-09-04T16:30:22.312 INFO:tasks.workunit.client.1.smithi193.stdout:6/904: mkdir d5/de/d15/d1b/d5f/da7/d121 0 2024-09-04T16:30:22.312 INFO:tasks.workunit.client.1.smithi193.stdout:5/938: dwrite d1/dd0/d102/f12c [0,4194304] 0 2024-09-04T16:30:22.313 INFO:tasks.workunit.client.0.smithi170.stdout:8/437: dwrite d6/d28/d20/d5e/f3e [8388608,4194304] 0 2024-09-04T16:30:22.314 INFO:tasks.workunit.client.1.smithi193.stdout:4/863: chown d3/d1a/d111/d98/fd3 44848610 1 2024-09-04T16:30:22.316 INFO:tasks.workunit.client.1.smithi193.stdout:4/864: write d3/d39/f6b [1727976,599] 0 2024-09-04T16:30:22.325 INFO:tasks.workunit.client.0.smithi170.stdout:1/501: creat d9/d26/d77/d83/fa2 x:0 0 0 2024-09-04T16:30:22.325 INFO:tasks.workunit.client.0.smithi170.stdout:0/490: symlink d11/d13/d71/d43/lbb 0 2024-09-04T16:30:22.326 INFO:tasks.workunit.client.0.smithi170.stdout:5/316: fdatasync d4/d3a/f4d 0 2024-09-04T16:30:22.333 INFO:tasks.workunit.client.1.smithi193.stdout:4/865: creat d3/d1a/d54/db1/f120 x:0 0 0 2024-09-04T16:30:22.335 INFO:tasks.workunit.client.0.smithi170.stdout:7/625: creat d12/d49/fd8 x:0 0 0 2024-09-04T16:30:22.335 INFO:tasks.workunit.client.1.smithi193.stdout:4/866: truncate d3/f6 4728429 0 2024-09-04T16:30:22.336 INFO:tasks.workunit.client.1.smithi193.stdout:0/936: mknod d18/d25/d32/d57/d6c/db1/dc9/d131/c13a 0 2024-09-04T16:30:22.336 INFO:tasks.workunit.client.1.smithi193.stdout:8/950: write d2/d20/d23/d24/d3c/d65/f72 [3787770,63203] 0 2024-09-04T16:30:22.336 INFO:tasks.workunit.client.1.smithi193.stdout:3/944: dread d0/d18/d1c/fb9 [0,4194304] 0 2024-09-04T16:30:22.337 INFO:tasks.workunit.client.0.smithi170.stdout:2/369: creat d3/d3c/f70 x:0 0 0 2024-09-04T16:30:22.338 INFO:tasks.workunit.client.1.smithi193.stdout:3/945: chown d0/d18/d1c/d25/d5e/d7e/cb7 361780 1 2024-09-04T16:30:22.338 INFO:tasks.workunit.client.0.smithi170.stdout:0/491: mkdir d11/d13/d4a/dbc 0 2024-09-04T16:30:22.340 INFO:tasks.workunit.client.1.smithi193.stdout:5/939: creat d1/d29/d18/f132 x:0 0 0 2024-09-04T16:30:22.341 INFO:tasks.workunit.client.1.smithi193.stdout:5/940: chown d1/d8/db/d15/d2b/dc6 100899 1 2024-09-04T16:30:22.342 INFO:tasks.workunit.client.0.smithi170.stdout:5/317: unlink d4/db/l16 0 2024-09-04T16:30:22.344 INFO:tasks.workunit.client.0.smithi170.stdout:5/318: chown d4/db/c24 22077048 1 2024-09-04T16:30:22.344 INFO:tasks.workunit.client.1.smithi193.stdout:8/951: creat d2/d20/d23/d1b/f131 x:0 0 0 2024-09-04T16:30:22.345 INFO:tasks.workunit.client.1.smithi193.stdout:8/952: chown d2/d20/dc0/f125 4224020 1 2024-09-04T16:30:22.345 INFO:tasks.workunit.client.1.smithi193.stdout:0/937: dread d18/d25/d32/d57/d6c/fbe [0,4194304] 0 2024-09-04T16:30:22.346 INFO:tasks.workunit.client.0.smithi170.stdout:0/492: dwrite d11/d75/f9e [0,4194304] 0 2024-09-04T16:30:22.347 INFO:tasks.workunit.client.1.smithi193.stdout:3/946: symlink d0/d10/d24/d9a/l137 0 2024-09-04T16:30:22.349 INFO:tasks.workunit.client.1.smithi193.stdout:3/947: write d0/d18/d1c/d51/d5a/da2/f12f [552698,119240] 0 2024-09-04T16:30:22.349 INFO:tasks.workunit.client.0.smithi170.stdout:8/438: mkdir d6/d28/d5f/d70/d97/d99 0 2024-09-04T16:30:22.350 INFO:tasks.workunit.client.1.smithi193.stdout:5/941: fsync d1/d29/f8d 0 2024-09-04T16:30:22.351 INFO:tasks.workunit.client.0.smithi170.stdout:1/502: truncate d9/d11/f1e 675905 0 2024-09-04T16:30:22.352 INFO:tasks.workunit.client.1.smithi193.stdout:8/953: stat d2/d12/f43 0 2024-09-04T16:30:22.352 INFO:tasks.workunit.client.0.smithi170.stdout:6/331: dread d0/d17/f1d [0,4194304] 0 2024-09-04T16:30:22.354 INFO:tasks.workunit.client.1.smithi193.stdout:6/905: link d5/d33/d4e/d51/d71/d82/l90 d5/de/d15/d1b/d5f/l122 0 2024-09-04T16:30:22.354 INFO:tasks.workunit.client.0.smithi170.stdout:6/332: stat d0/df/d1f 0 2024-09-04T16:30:22.354 INFO:tasks.workunit.client.0.smithi170.stdout:3/346: getdents d13/d14/d1f 0 2024-09-04T16:30:22.355 INFO:tasks.workunit.client.0.smithi170.stdout:5/319: fdatasync d4/f3b 0 2024-09-04T16:30:22.358 INFO:tasks.workunit.client.0.smithi170.stdout:6/333: chown d0/df/fa 10 1 2024-09-04T16:30:22.358 INFO:tasks.workunit.client.1.smithi193.stdout:0/938: mknod d18/d25/d32/d9c/d122/c13b 0 2024-09-04T16:30:22.359 INFO:tasks.workunit.client.0.smithi170.stdout:3/347: write d13/d14/d1f/f60 [4432165,27302] 0 2024-09-04T16:30:22.360 INFO:tasks.workunit.client.0.smithi170.stdout:9/437: getdents d2/d3d/d54 0 2024-09-04T16:30:22.362 INFO:tasks.workunit.client.0.smithi170.stdout:1/503: dwrite d9/d11/d2f/d6b/f70 [0,4194304] 0 2024-09-04T16:30:22.365 INFO:tasks.workunit.client.1.smithi193.stdout:5/942: rmdir d1/dc3 39 2024-09-04T16:30:22.367 INFO:tasks.workunit.client.1.smithi193.stdout:8/954: rmdir d2/d20/d23/d34/d46 39 2024-09-04T16:30:22.371 INFO:tasks.workunit.client.1.smithi193.stdout:4/867: truncate d3/f30 4141962 0 2024-09-04T16:30:22.371 INFO:tasks.workunit.client.1.smithi193.stdout:0/939: mkdir d18/d25/d32/d57/d6c/dfc/d13c 0 2024-09-04T16:30:22.374 INFO:tasks.workunit.client.0.smithi170.stdout:0/493: fdatasync d11/d13/d2f/f84 0 2024-09-04T16:30:22.376 INFO:tasks.workunit.client.1.smithi193.stdout:8/955: unlink d2/d20/dc0/d82/fdc 0 2024-09-04T16:30:22.379 INFO:tasks.workunit.client.0.smithi170.stdout:3/348: fdatasync d13/d14/d17/f64 0 2024-09-04T16:30:22.380 INFO:tasks.workunit.client.0.smithi170.stdout:7/626: dread d12/d15/d71/f7f [0,4194304] 0 2024-09-04T16:30:22.381 INFO:tasks.workunit.client.1.smithi193.stdout:0/940: fdatasync d18/d25/d5f/d65/dc4/dd5/df2/f11f 0 2024-09-04T16:30:22.384 INFO:tasks.workunit.client.1.smithi193.stdout:5/943: mkdir d1/d29/d18/d133 0 2024-09-04T16:30:22.386 INFO:tasks.workunit.client.0.smithi170.stdout:9/438: rename d2/d11/d23/f29 to d2/d3d/d27/d65/f7e 0 2024-09-04T16:30:22.386 INFO:tasks.workunit.client.0.smithi170.stdout:9/439: stat d2/d3d/d27/d65/d66 0 2024-09-04T16:30:22.387 INFO:tasks.workunit.client.1.smithi193.stdout:8/956: creat d2/d20/d23/d24/d3c/d65/dc8/f132 x:0 0 0 2024-09-04T16:30:22.390 INFO:tasks.workunit.client.1.smithi193.stdout:4/868: link d3/d1a/d111/d47/ffd d3/d1a/d111/d89/d113/f121 0 2024-09-04T16:30:22.393 INFO:tasks.workunit.client.0.smithi170.stdout:0/494: symlink d11/d13/d36/lbd 0 2024-09-04T16:30:22.394 INFO:tasks.workunit.client.1.smithi193.stdout:5/944: creat d1/d8/db/d15/d2b/d83/d37/d58/d9e/dec/f134 x:0 0 0 2024-09-04T16:30:22.395 INFO:tasks.workunit.client.0.smithi170.stdout:0/495: chown d11/d13/f20 3 1 2024-09-04T16:30:22.395 INFO:tasks.workunit.client.0.smithi170.stdout:3/349: dread d13/d14/f4b [0,4194304] 0 2024-09-04T16:30:22.396 INFO:tasks.workunit.client.1.smithi193.stdout:8/957: creat d2/d20/d23/d34/dd6/f133 x:0 0 0 2024-09-04T16:30:22.396 INFO:tasks.workunit.client.0.smithi170.stdout:5/320: dwrite d4/d8/d1c/d23/d39/f40 [0,4194304] 0 2024-09-04T16:30:22.396 INFO:tasks.workunit.client.1.smithi193.stdout:6/906: getdents d5/d33/d4e/d51/d71 0 2024-09-04T16:30:22.397 INFO:tasks.workunit.client.0.smithi170.stdout:3/350: write d13/d14/d1d/f27 [2778285,97356] 0 2024-09-04T16:30:22.398 INFO:tasks.workunit.client.1.smithi193.stdout:3/948: link d0/d10/cb3 d0/d9/c138 0 2024-09-04T16:30:22.401 INFO:tasks.workunit.client.0.smithi170.stdout:1/504: truncate d9/f2b 399460 0 2024-09-04T16:30:22.402 INFO:tasks.workunit.client.1.smithi193.stdout:0/941: symlink d18/d25/d5f/l13d 0 2024-09-04T16:30:22.403 INFO:tasks.workunit.client.1.smithi193.stdout:0/942: write d18/d25/d5f/fa1 [2838571,104674] 0 2024-09-04T16:30:22.404 INFO:tasks.workunit.client.0.smithi170.stdout:9/440: rename d2/d3d/d27/d65/d5b/c63 to d2/d3d/d27/d65/c7f 0 2024-09-04T16:30:22.405 INFO:tasks.workunit.client.0.smithi170.stdout:2/370: getdents d3/d4/d14 0 2024-09-04T16:30:22.405 INFO:tasks.workunit.client.0.smithi170.stdout:9/441: chown d2/d3d/d54/c74 6 1 2024-09-04T16:30:22.407 INFO:tasks.workunit.client.0.smithi170.stdout:8/439: creat d6/d26/f9a x:0 0 0 2024-09-04T16:30:22.408 INFO:tasks.workunit.client.1.smithi193.stdout:3/949: mknod d0/d18/d1c/d25/d5e/d7e/c139 0 2024-09-04T16:30:22.413 INFO:tasks.workunit.client.1.smithi193.stdout:8/958: dread d2/d20/d23/d34/d4b/db8/fbe [0,4194304] 0 2024-09-04T16:30:22.415 INFO:tasks.workunit.client.0.smithi170.stdout:5/321: unlink d4/d8/d1c/d29/c47 0 2024-09-04T16:30:22.415 INFO:tasks.workunit.client.0.smithi170.stdout:5/322: chown d4/d8/d1c/d23/d39/f40 7872 1 2024-09-04T16:30:22.416 INFO:tasks.workunit.client.1.smithi193.stdout:4/869: creat d3/d1a/d111/d98/f122 x:0 0 0 2024-09-04T16:30:22.417 INFO:tasks.workunit.client.1.smithi193.stdout:4/870: dread - d3/f86 zero size 2024-09-04T16:30:22.417 INFO:tasks.workunit.client.0.smithi170.stdout:7/627: unlink d12/d16/f7a 0 2024-09-04T16:30:22.418 INFO:tasks.workunit.client.1.smithi193.stdout:3/950: fsync d0/d18/d1c/d25/d5e/d7e/fa7 0 2024-09-04T16:30:22.419 INFO:tasks.workunit.client.1.smithi193.stdout:3/951: fdatasync d0/d18/d1c/d51/d6c/df8/fba 0 2024-09-04T16:30:22.420 INFO:tasks.workunit.client.1.smithi193.stdout:3/952: dread - d0/d18/f134 zero size 2024-09-04T16:30:22.421 INFO:tasks.workunit.client.0.smithi170.stdout:1/505: symlink d9/d11/d3e/d6a/d79/la3 0 2024-09-04T16:30:22.422 INFO:tasks.workunit.client.0.smithi170.stdout:9/442: rmdir d2/d3d/d4d 39 2024-09-04T16:30:22.424 INFO:tasks.workunit.client.0.smithi170.stdout:2/371: creat d3/d3c/d40/f71 x:0 0 0 2024-09-04T16:30:22.425 INFO:tasks.workunit.client.0.smithi170.stdout:2/372: truncate d3/d3c/d40/f41 1360149 0 2024-09-04T16:30:22.427 INFO:tasks.workunit.client.0.smithi170.stdout:8/440: rename d6/f92 to d6/d28/d16/d77/d93/f9b 0 2024-09-04T16:30:22.429 INFO:tasks.workunit.client.0.smithi170.stdout:6/334: getdents d0/d15/d56 0 2024-09-04T16:30:22.429 INFO:tasks.workunit.client.0.smithi170.stdout:6/335: chown d0/df/c8 35328239 1 2024-09-04T16:30:22.430 INFO:tasks.workunit.client.0.smithi170.stdout:6/336: fsync d0/df/d1b/d3e/d47/d68/d2d/d2e/f49 0 2024-09-04T16:30:22.431 INFO:tasks.workunit.client.0.smithi170.stdout:6/337: chown d0/df/d1f/f5e 4078 1 2024-09-04T16:30:22.435 INFO:tasks.workunit.client.0.smithi170.stdout:7/628: write d12/f1a [8569796,128789] 0 2024-09-04T16:30:22.436 INFO:tasks.workunit.client.1.smithi193.stdout:0/943: rename d18/d25/d32/c5a to d18/c13e 0 2024-09-04T16:30:22.437 INFO:tasks.workunit.client.1.smithi193.stdout:0/944: dread - d18/d109/f117 zero size 2024-09-04T16:30:22.437 INFO:tasks.workunit.client.0.smithi170.stdout:3/351: link f12 d13/d14/d21/d4d/f6f 0 2024-09-04T16:30:22.438 INFO:tasks.workunit.client.1.smithi193.stdout:6/907: getdents d5/d33/d85/da9 0 2024-09-04T16:30:22.438 INFO:tasks.workunit.client.0.smithi170.stdout:0/496: write d11/f50 [433969,607] 0 2024-09-04T16:30:22.441 INFO:tasks.workunit.client.0.smithi170.stdout:9/443: truncate d2/d11/f24 2407318 0 2024-09-04T16:30:22.441 INFO:tasks.workunit.client.1.smithi193.stdout:5/945: dwrite d1/d8/db/f4e [0,4194304] 0 2024-09-04T16:30:22.442 INFO:tasks.workunit.client.1.smithi193.stdout:4/871: getdents d3/d1a/d111/d47/d11b 0 2024-09-04T16:30:22.445 INFO:tasks.workunit.client.0.smithi170.stdout:3/352: dwrite d13/d14/d17/f64 [0,4194304] 0 2024-09-04T16:30:22.445 INFO:tasks.workunit.client.0.smithi170.stdout:9/444: truncate d2/d3d/d27/d2b/d34/f78 280349 0 2024-09-04T16:30:22.445 INFO:tasks.workunit.client.1.smithi193.stdout:3/953: unlink d0/d18/d1c/d51/d6c/l8c 0 2024-09-04T16:30:22.445 INFO:tasks.workunit.client.0.smithi170.stdout:3/353: fdatasync d13/f5f 0 2024-09-04T16:30:22.454 INFO:tasks.workunit.client.0.smithi170.stdout:3/354: dwrite d13/f5f [0,4194304] 0 2024-09-04T16:30:22.456 INFO:tasks.workunit.client.0.smithi170.stdout:1/506: truncate d9/f55 2982149 0 2024-09-04T16:30:22.458 INFO:tasks.workunit.client.0.smithi170.stdout:1/507: readlink d9/d34/l4f 0 2024-09-04T16:30:22.459 INFO:tasks.workunit.client.0.smithi170.stdout:3/355: write d13/d14/d17/f52 [456498,81470] 0 2024-09-04T16:30:22.459 INFO:tasks.workunit.client.1.smithi193.stdout:5/946: dwrite d1/dc3/f26 [0,4194304] 0 2024-09-04T16:30:22.460 INFO:tasks.workunit.client.0.smithi170.stdout:0/497: rename d11/d13/f46 to d11/d8e/fbe 0 2024-09-04T16:30:22.462 INFO:tasks.workunit.client.0.smithi170.stdout:4/396: sync 2024-09-04T16:30:22.462 INFO:tasks.workunit.client.1.smithi193.stdout:0/945: truncate d18/d25/d5f/def/f10d 365137 0 2024-09-04T16:30:22.464 INFO:tasks.workunit.client.0.smithi170.stdout:5/323: dwrite d4/f6 [0,4194304] 0 2024-09-04T16:30:22.468 INFO:tasks.workunit.client.1.smithi193.stdout:6/908: dread d5/d27/d3e/f89 [0,4194304] 0 2024-09-04T16:30:22.474 INFO:tasks.workunit.client.0.smithi170.stdout:6/338: write d0/df/fa [3505945,69702] 0 2024-09-04T16:30:22.475 INFO:tasks.workunit.client.1.smithi193.stdout:8/959: dwrite d2/d20/d23/d34/d3e/d6f/fde [0,4194304] 0 2024-09-04T16:30:22.478 INFO:tasks.workunit.client.1.smithi193.stdout:5/947: unlink d1/d8/db/d36/d40/d46/d84/fa3 0 2024-09-04T16:30:22.483 INFO:tasks.workunit.client.1.smithi193.stdout:5/948: truncate d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/db9/fe6 839780 0 2024-09-04T16:30:22.483 INFO:tasks.workunit.client.0.smithi170.stdout:7/629: dread d12/f14 [0,4194304] 0 2024-09-04T16:30:22.484 INFO:tasks.workunit.client.1.smithi193.stdout:4/872: creat d3/d1a/d111/d98/f123 x:0 0 0 2024-09-04T16:30:22.486 INFO:tasks.workunit.client.1.smithi193.stdout:6/909: mknod d5/d33/d85/da9/c123 0 2024-09-04T16:30:22.487 INFO:tasks.workunit.client.1.smithi193.stdout:6/910: readlink d5/d33/d4e/d51/d68/l108 0 2024-09-04T16:30:22.489 INFO:tasks.workunit.client.1.smithi193.stdout:3/954: creat d0/f13a x:0 0 0 2024-09-04T16:30:22.490 INFO:tasks.workunit.client.1.smithi193.stdout:3/955: chown d0/d18/d1c/f113 148 1 2024-09-04T16:30:22.491 INFO:tasks.workunit.client.0.smithi170.stdout:8/441: truncate d6/d28/d1a/d38/f88 764912 0 2024-09-04T16:30:22.492 INFO:tasks.workunit.client.1.smithi193.stdout:3/956: read d0/d18/d1c/d51/fca [4496234,6047] 0 2024-09-04T16:30:22.492 INFO:tasks.workunit.client.0.smithi170.stdout:8/442: chown d6/d28/d16/d52/d73/d5d/d8b 127119 1 2024-09-04T16:30:22.493 INFO:tasks.workunit.client.0.smithi170.stdout:8/443: chown d6/d26 726809 1 2024-09-04T16:30:22.494 INFO:tasks.workunit.client.0.smithi170.stdout:7/630: dwrite d12/d16/d1d/d65/fad [0,4194304] 0 2024-09-04T16:30:22.497 INFO:tasks.workunit.client.1.smithi193.stdout:0/946: creat d18/d25/d5f/d107/d111/d12a/f13f x:0 0 0 2024-09-04T16:30:22.498 INFO:tasks.workunit.client.1.smithi193.stdout:0/947: write d18/d79/d88/d9a/fe8 [929956,1551] 0 2024-09-04T16:30:22.499 INFO:tasks.workunit.client.0.smithi170.stdout:5/324: unlink d4/f4a 0 2024-09-04T16:30:22.500 INFO:tasks.workunit.client.1.smithi193.stdout:8/960: dread d2/d20/d23/d24/d3c/d65/dc8/de1/dd8/f118 [0,4194304] 0 2024-09-04T16:30:22.502 INFO:tasks.workunit.client.0.smithi170.stdout:2/373: link d3/d4/f21 d3/db/d62/d6f/f72 0 2024-09-04T16:30:22.506 INFO:tasks.workunit.client.0.smithi170.stdout:2/374: dread d3/d3c/f30 [0,4194304] 0 2024-09-04T16:30:22.508 INFO:tasks.workunit.client.0.smithi170.stdout:6/339: mkdir d0/d15/d56/d6c 0 2024-09-04T16:30:22.511 INFO:tasks.workunit.client.0.smithi170.stdout:3/356: dwrite d13/d14/f32 [4194304,4194304] 0 2024-09-04T16:30:22.511 INFO:tasks.workunit.client.0.smithi170.stdout:6/340: write d0/df/d1b/d3e/d47/d68/f41 [1959685,49881] 0 2024-09-04T16:30:22.518 INFO:tasks.workunit.client.1.smithi193.stdout:2/920: sync 2024-09-04T16:30:22.520 INFO:tasks.workunit.client.1.smithi193.stdout:8/961: dread d2/d20/d23/d24/f5d [0,4194304] 0 2024-09-04T16:30:22.521 INFO:tasks.workunit.client.1.smithi193.stdout:2/921: write d2/d9/db/d10/d1f/d77/d91/dff/f107 [350381,103327] 0 2024-09-04T16:30:22.522 INFO:tasks.workunit.client.0.smithi170.stdout:1/508: mknod d9/d11/d2f/d7f/d84/ca4 0 2024-09-04T16:30:22.524 INFO:tasks.workunit.client.0.smithi170.stdout:8/444: chown d6/d28/d16/d77/l82 4806157 1 2024-09-04T16:30:22.525 INFO:tasks.workunit.client.1.smithi193.stdout:5/949: symlink d1/d29/l135 0 2024-09-04T16:30:22.526 INFO:tasks.workunit.client.1.smithi193.stdout:4/873: mknod d3/d1a/d111/d89/d113/c124 0 2024-09-04T16:30:22.528 INFO:tasks.workunit.client.0.smithi170.stdout:7/631: write d12/d16/d1d/d65/d82/fbb [2971124,34960] 0 2024-09-04T16:30:22.533 INFO:tasks.workunit.client.0.smithi170.stdout:3/357: dread d13/d14/d1d/f27 [0,4194304] 0 2024-09-04T16:30:22.533 INFO:tasks.workunit.client.1.smithi193.stdout:3/957: symlink d0/d18/d1c/d25/d5e/l13b 0 2024-09-04T16:30:22.535 INFO:tasks.workunit.client.1.smithi193.stdout:0/948: mknod d18/d25/d32/c140 0 2024-09-04T16:30:22.537 INFO:tasks.workunit.client.0.smithi170.stdout:5/325: write d4/db/d37/f36 [116211,17541] 0 2024-09-04T16:30:22.537 INFO:tasks.workunit.client.0.smithi170.stdout:2/375: rmdir d3/d7 39 2024-09-04T16:30:22.538 INFO:tasks.workunit.client.0.smithi170.stdout:1/509: dwrite d9/f27 [4194304,4194304] 0 2024-09-04T16:30:22.538 INFO:tasks.workunit.client.1.smithi193.stdout:3/958: dwrite d0/d18/d1c/d25/d5e/d90/fdc [0,4194304] 0 2024-09-04T16:30:22.541 INFO:tasks.workunit.client.1.smithi193.stdout:2/922: symlink d2/d9/db/d10/d38/da5/l139 0 2024-09-04T16:30:22.542 INFO:tasks.workunit.client.0.smithi170.stdout:0/498: dwrite d11/d13/d2f/f33 [0,4194304] 0 2024-09-04T16:30:22.543 INFO:tasks.workunit.client.0.smithi170.stdout:8/445: dwrite d6/d28/d16/d52/d73/d5d/d8b/f96 [0,4194304] 0 2024-09-04T16:30:22.544 INFO:tasks.workunit.client.1.smithi193.stdout:5/950: mknod d1/d8/db/d15/d2b/d83/d37/d58/d9e/da7/c136 0 2024-09-04T16:30:22.546 INFO:tasks.workunit.client.1.smithi193.stdout:4/874: creat d3/d1a/d2a/db9/f125 x:0 0 0 2024-09-04T16:30:22.548 INFO:tasks.workunit.client.1.smithi193.stdout:6/911: creat d5/de/d15/d1b/d5f/da7/d121/f124 x:0 0 0 2024-09-04T16:30:22.551 INFO:tasks.workunit.client.1.smithi193.stdout:8/962: dwrite d2/d20/d23/d34/d46/d53/fa5 [8388608,4194304] 0 2024-09-04T16:30:22.554 INFO:tasks.workunit.client.0.smithi170.stdout:9/445: getdents d2/d32 0 2024-09-04T16:30:22.558 INFO:tasks.workunit.client.1.smithi193.stdout:4/875: symlink d3/d1a/d111/d89/dbd/d116/l126 0 2024-09-04T16:30:22.562 INFO:tasks.workunit.client.1.smithi193.stdout:8/963: readlink d2/d20/d23/d34/l4d 0 2024-09-04T16:30:22.563 INFO:tasks.workunit.client.1.smithi193.stdout:5/951: read d1/d29/d74/f122 [1200286,107226] 0 2024-09-04T16:30:22.565 INFO:tasks.workunit.client.0.smithi170.stdout:8/446: dwrite d6/d28/d16/f7e [0,4194304] 0 2024-09-04T16:30:22.565 INFO:tasks.workunit.client.0.smithi170.stdout:1/510: stat d9/d11/d3e/d6a/c98 0 2024-09-04T16:30:22.565 INFO:tasks.workunit.client.0.smithi170.stdout:8/447: dread - d6/d26/f9a zero size 2024-09-04T16:30:22.565 INFO:tasks.workunit.client.0.smithi170.stdout:1/511: chown d9/d34/d5f/c8e 75944095 1 2024-09-04T16:30:22.566 INFO:tasks.workunit.client.0.smithi170.stdout:5/326: truncate d4/db/f1d 1371204 0 2024-09-04T16:30:22.569 INFO:tasks.workunit.client.1.smithi193.stdout:3/959: creat d0/d18/d1b/d3d/d118/f13c x:0 0 0 2024-09-04T16:30:22.571 INFO:tasks.workunit.client.1.smithi193.stdout:8/964: rmdir d2/d20/d23/d24/d3c/d65/dc8/de1/dd8 39 2024-09-04T16:30:22.572 INFO:tasks.workunit.client.0.smithi170.stdout:7/632: symlink d12/d16/d1d/d65/dd0/ld9 0 2024-09-04T16:30:22.572 INFO:tasks.workunit.client.0.smithi170.stdout:8/448: dread d6/d28/d16/d24/d46/f74 [0,4194304] 0 2024-09-04T16:30:22.573 INFO:tasks.workunit.client.0.smithi170.stdout:1/512: unlink d9/d34/d5f/c8e 0 2024-09-04T16:30:22.575 INFO:tasks.workunit.client.1.smithi193.stdout:3/960: chown d0/d18/d1c/d25/d5e/d7e/l9f 1815986 1 2024-09-04T16:30:22.576 INFO:tasks.workunit.client.0.smithi170.stdout:3/358: rmdir d13/d14/d17/d1c/d67 0 2024-09-04T16:30:22.577 INFO:tasks.workunit.client.0.smithi170.stdout:3/359: chown d13/d14/l3c 728 1 2024-09-04T16:30:22.578 INFO:tasks.workunit.client.1.smithi193.stdout:8/965: getdents d2/d20/d23/d34/d124/d126 0 2024-09-04T16:30:22.579 INFO:tasks.workunit.client.0.smithi170.stdout:6/341: getdents d0/d15 0 2024-09-04T16:30:22.582 INFO:tasks.workunit.client.1.smithi193.stdout:3/961: dwrite d0/d18/d1b/d3d/d96/fd0 [0,4194304] 0 2024-09-04T16:30:22.583 INFO:tasks.workunit.client.0.smithi170.stdout:1/513: creat d9/d11/fa5 x:0 0 0 2024-09-04T16:30:22.584 INFO:tasks.workunit.client.0.smithi170.stdout:7/633: mknod d12/d16/d1d/d65/dd0/cda 0 2024-09-04T16:30:22.590 INFO:tasks.workunit.client.0.smithi170.stdout:2/376: rename d3/db/l5f to d3/d3c/l73 0 2024-09-04T16:30:22.590 INFO:tasks.workunit.client.1.smithi193.stdout:2/923: dread d2/d9/db/d10/d1e/d56/d59/f124 [0,4194304] 0 2024-09-04T16:30:22.592 INFO:tasks.workunit.client.1.smithi193.stdout:0/949: write d18/d25/d32/fed [4539557,99265] 0 2024-09-04T16:30:22.596 INFO:tasks.workunit.client.1.smithi193.stdout:3/962: truncate d0/d18/d1b/f8b 323246 0 2024-09-04T16:30:22.598 INFO:tasks.workunit.client.0.smithi170.stdout:1/514: creat d9/d11/d2f/d7f/d84/fa6 x:0 0 0 2024-09-04T16:30:22.599 INFO:tasks.workunit.client.0.smithi170.stdout:1/515: write d9/d26/d77/d83/f86 [1300442,96872] 0 2024-09-04T16:30:22.599 INFO:tasks.workunit.client.1.smithi193.stdout:6/912: dread d5/de/d15/d1b/f99 [0,4194304] 0 2024-09-04T16:30:22.600 INFO:tasks.workunit.client.1.smithi193.stdout:2/924: unlink d2/d9/db/d10/d38/cbc 0 2024-09-04T16:30:22.601 INFO:tasks.workunit.client.1.smithi193.stdout:2/925: stat d2/d9/db 0 2024-09-04T16:30:22.601 INFO:tasks.workunit.client.0.smithi170.stdout:0/499: write d11/d13/d71/f96 [1323375,120363] 0 2024-09-04T16:30:22.603 INFO:tasks.workunit.client.1.smithi193.stdout:3/963: rmdir d0/d18/d1c/d25/d5e/d90 39 2024-09-04T16:30:22.604 INFO:tasks.workunit.client.0.smithi170.stdout:2/377: chown d3/db/d4b/c4f 38 1 2024-09-04T16:30:22.605 INFO:tasks.workunit.client.1.smithi193.stdout:6/913: dread - d5/d33/d85/f94 zero size 2024-09-04T16:30:22.606 INFO:tasks.workunit.client.0.smithi170.stdout:2/378: write d3/db/d1c/f42 [1071459,109014] 0 2024-09-04T16:30:22.606 INFO:tasks.workunit.client.0.smithi170.stdout:3/360: getdents d13/d14/d21/d46/d6e 0 2024-09-04T16:30:22.607 INFO:tasks.workunit.client.1.smithi193.stdout:6/914: chown d5/de/d15/d1b/d5f/f78 45515909 1 2024-09-04T16:30:22.607 INFO:tasks.workunit.client.1.smithi193.stdout:4/876: dwrite d3/d1a/d2a/d83/f93 [0,4194304] 0 2024-09-04T16:30:22.609 INFO:tasks.workunit.client.1.smithi193.stdout:6/915: stat d5/d33/d4e/d51/d68 0 2024-09-04T16:30:22.609 INFO:tasks.workunit.client.1.smithi193.stdout:4/877: read - d3/d1a/d111/d89/dbd/ddc/f11e zero size 2024-09-04T16:30:22.610 INFO:tasks.workunit.client.1.smithi193.stdout:2/926: rename d2/fe to d2/d9/db/d10/d4e/f13a 0 2024-09-04T16:30:22.610 INFO:tasks.workunit.client.1.smithi193.stdout:2/927: chown d2/d9/db/f72 105 1 2024-09-04T16:30:22.617 INFO:tasks.workunit.client.0.smithi170.stdout:9/446: link d2/d3d/d6d/l6e d2/d3d/d4d/l80 0 2024-09-04T16:30:22.618 INFO:tasks.workunit.client.1.smithi193.stdout:6/916: rmdir d5/de 39 2024-09-04T16:30:22.621 INFO:tasks.workunit.client.0.smithi170.stdout:1/516: rename d9/f37 to d9/d11/d3e/d6a/fa7 0 2024-09-04T16:30:22.621 INFO:tasks.workunit.client.0.smithi170.stdout:2/379: dread d3/db/d62/d6f/f72 [0,4194304] 0 2024-09-04T16:30:22.622 INFO:tasks.workunit.client.1.smithi193.stdout:8/966: truncate d2/d20/f2d 2207446 0 2024-09-04T16:30:22.622 INFO:tasks.workunit.client.1.smithi193.stdout:3/964: dwrite d0/d9/dae/fc6 [0,4194304] 0 2024-09-04T16:30:22.622 INFO:tasks.workunit.client.1.smithi193.stdout:3/965: stat d0/l6 0 2024-09-04T16:30:22.622 INFO:tasks.workunit.client.1.smithi193.stdout:4/878: truncate d3/d1a/d21/f22 2561276 0 2024-09-04T16:30:22.622 INFO:tasks.workunit.client.0.smithi170.stdout:1/517: truncate d9/d34/d5f/f71 5088855 0 2024-09-04T16:30:22.623 INFO:tasks.workunit.client.1.smithi193.stdout:8/967: chown d2/d20/d23/d34/d3e/l54 981267430 1 2024-09-04T16:30:22.623 INFO:tasks.workunit.client.1.smithi193.stdout:4/879: dread - d3/d1a/d111/d98/de2/dec/ff2 zero size 2024-09-04T16:30:22.625 INFO:tasks.workunit.client.1.smithi193.stdout:4/880: fsync d3/f8e 0 2024-09-04T16:30:22.626 INFO:tasks.workunit.client.1.smithi193.stdout:8/968: truncate d2/d20/d23/d34/d4b/f4f 1803884 0 2024-09-04T16:30:22.626 INFO:tasks.workunit.client.1.smithi193.stdout:4/881: chown d3/d1a/d21/lf7 3 1 2024-09-04T16:30:22.627 INFO:tasks.workunit.client.1.smithi193.stdout:6/917: dread d5/ff [0,4194304] 0 2024-09-04T16:30:22.628 INFO:tasks.workunit.client.1.smithi193.stdout:8/969: dread d2/d20/d23/d24/df7/f10f [0,4194304] 0 2024-09-04T16:30:22.628 INFO:tasks.workunit.client.0.smithi170.stdout:5/327: link d4/d8/c58 d4/c5f 0 2024-09-04T16:30:22.630 INFO:tasks.workunit.client.1.smithi193.stdout:2/928: mkdir d2/d9/db/d10/d1f/d13b 0 2024-09-04T16:30:22.632 INFO:tasks.workunit.client.1.smithi193.stdout:2/929: write d2/d9/db/d10/d51/dca/f11a [778318,16662] 0 2024-09-04T16:30:22.632 INFO:tasks.workunit.client.0.smithi170.stdout:7/634: write d12/d15/d71/f7f [535221,73157] 0 2024-09-04T16:30:22.633 INFO:tasks.workunit.client.1.smithi193.stdout:2/930: write d2/d9/db/d10/d1f/d22/f93 [717011,76735] 0 2024-09-04T16:30:22.635 INFO:tasks.workunit.client.0.smithi170.stdout:1/518: dread d9/d11/d3e/f82 [0,4194304] 0 2024-09-04T16:30:22.643 INFO:tasks.workunit.client.0.smithi170.stdout:6/342: dwrite d0/df/d1b/f24 [0,4194304] 0 2024-09-04T16:30:22.643 INFO:tasks.workunit.client.0.smithi170.stdout:2/380: creat d3/db/d62/f74 x:0 0 0 2024-09-04T16:30:22.644 INFO:tasks.workunit.client.0.smithi170.stdout:6/343: dread - d0/df/d1f/f5e zero size 2024-09-04T16:30:22.654 INFO:tasks.workunit.client.0.smithi170.stdout:3/361: creat d13/d14/d1d/d2d/d6c/f70 x:0 0 0 2024-09-04T16:30:22.654 INFO:tasks.workunit.client.0.smithi170.stdout:3/362: chown d13/d14/d1f/c2f 107104 1 2024-09-04T16:30:22.657 INFO:tasks.workunit.client.0.smithi170.stdout:7/635: mknod d12/d16/d1d/d65/d82/cdb 0 2024-09-04T16:30:22.659 INFO:tasks.workunit.client.0.smithi170.stdout:1/519: mkdir d9/d11/d2f/d7f/da8 0 2024-09-04T16:30:22.662 INFO:tasks.workunit.client.0.smithi170.stdout:2/381: creat d3/db/d1c/f75 x:0 0 0 2024-09-04T16:30:22.663 INFO:tasks.workunit.client.0.smithi170.stdout:6/344: chown d0/ce 5 1 2024-09-04T16:30:22.664 INFO:tasks.workunit.client.1.smithi193.stdout:8/970: fdatasync d2/d20/d23/d24/d3c/d65/dc8/de1/dd8/f118 0 2024-09-04T16:30:22.666 INFO:tasks.workunit.client.1.smithi193.stdout:2/931: write d2/d9/db/d10/d38/dac/fb8 [4907124,87332] 0 2024-09-04T16:30:22.667 INFO:tasks.workunit.client.0.smithi170.stdout:5/328: getdents d4/db/d51/d5e 0 2024-09-04T16:30:22.668 INFO:tasks.workunit.client.0.smithi170.stdout:3/363: dread d13/d14/d1f/f60 [0,4194304] 0 2024-09-04T16:30:22.669 INFO:tasks.workunit.client.1.smithi193.stdout:4/882: truncate d3/d39/f6b 3817154 0 2024-09-04T16:30:22.671 INFO:tasks.workunit.client.0.smithi170.stdout:7/636: fdatasync d12/f18 0 2024-09-04T16:30:22.672 INFO:tasks.workunit.client.0.smithi170.stdout:3/364: dread d13/d14/d21/f2e [0,4194304] 0 2024-09-04T16:30:22.674 INFO:tasks.workunit.client.0.smithi170.stdout:1/520: unlink d9/d11/d9b/fa1 0 2024-09-04T16:30:22.676 INFO:tasks.workunit.client.0.smithi170.stdout:2/382: symlink d3/db/d62/l76 0 2024-09-04T16:30:22.677 INFO:tasks.workunit.client.1.smithi193.stdout:2/932: mknod d2/d9/d18/d7b/db5/c13c 0 2024-09-04T16:30:22.679 INFO:tasks.workunit.client.1.smithi193.stdout:2/933: write d2/d9/db/d10/d1e/d56/ffd [629613,45296] 0 2024-09-04T16:30:22.680 INFO:tasks.workunit.client.0.smithi170.stdout:6/345: fsync d0/df/d1b/f29 0 2024-09-04T16:30:22.682 INFO:tasks.workunit.client.0.smithi170.stdout:0/500: getdents d11/d13/d71/d43 0 2024-09-04T16:30:22.684 INFO:tasks.workunit.client.0.smithi170.stdout:5/329: symlink d4/d8/l60 0 2024-09-04T16:30:22.686 INFO:tasks.workunit.client.0.smithi170.stdout:5/330: read d4/f6 [1851671,92600] 0 2024-09-04T16:30:22.689 INFO:tasks.workunit.client.0.smithi170.stdout:6/346: dwrite d0/df/d1b/f24 [0,4194304] 0 2024-09-04T16:30:22.690 INFO:tasks.workunit.client.0.smithi170.stdout:6/347: chown d0/d17/d31/d64 91 1 2024-09-04T16:30:22.692 INFO:tasks.workunit.client.0.smithi170.stdout:0/501: dwrite d11/f50 [0,4194304] 0 2024-09-04T16:30:22.694 INFO:tasks.workunit.client.0.smithi170.stdout:6/348: write d0/df/d1b/f24 [475453,64960] 0 2024-09-04T16:30:22.694 INFO:tasks.workunit.client.1.smithi193.stdout:2/934: dread d2/d9/f36 [0,4194304] 0 2024-09-04T16:30:22.695 INFO:tasks.workunit.client.0.smithi170.stdout:3/365: mkdir d13/d14/d1d/d71 0 2024-09-04T16:30:22.695 INFO:tasks.workunit.client.1.smithi193.stdout:8/971: rename d2/d20/d23/d51/d76/dfa/c105 to d2/d20/d23/d34/d3e/d6f/c134 0 2024-09-04T16:30:22.696 INFO:tasks.workunit.client.0.smithi170.stdout:6/349: fsync d0/df/d1b/d3e/d47/d68/d2d/d2e/f66 0 2024-09-04T16:30:22.697 INFO:tasks.workunit.client.1.smithi193.stdout:8/972: fdatasync d2/d20/d23/d24/d3c/d65/dc8/f132 0 2024-09-04T16:30:22.698 INFO:tasks.workunit.client.1.smithi193.stdout:6/918: getdents d5/de/d15/d1b/d5f/da7/dd1 0 2024-09-04T16:30:22.699 INFO:tasks.workunit.client.0.smithi170.stdout:2/383: rmdir d3/db 39 2024-09-04T16:30:22.702 INFO:tasks.workunit.client.1.smithi193.stdout:2/935: unlink d2/d9/db/d10/d1f/d22/fbf 0 2024-09-04T16:30:22.703 INFO:tasks.workunit.client.0.smithi170.stdout:6/350: dwrite d0/df/d1b/d3e/d47/d68/f23 [0,4194304] 0 2024-09-04T16:30:22.706 INFO:tasks.workunit.client.0.smithi170.stdout:6/351: read d0/df/d1b/d3e/d47/d68/d2d/d2e/f43 [2286013,22962] 0 2024-09-04T16:30:22.707 INFO:tasks.workunit.client.1.smithi193.stdout:4/883: dwrite d3/f16 [0,4194304] 0 2024-09-04T16:30:22.708 INFO:tasks.workunit.client.1.smithi193.stdout:2/936: creat d2/d9/db/d10/d38/f13d x:0 0 0 2024-09-04T16:30:22.710 INFO:tasks.workunit.client.1.smithi193.stdout:6/919: creat d5/f125 x:0 0 0 2024-09-04T16:30:22.710 INFO:tasks.workunit.client.1.smithi193.stdout:4/884: truncate d3/d1a/d111/fbb 515787 0 2024-09-04T16:30:22.712 INFO:tasks.workunit.client.1.smithi193.stdout:2/937: fsync d2/d9/db/d10/d1e/f5a 0 2024-09-04T16:30:22.713 INFO:tasks.workunit.client.1.smithi193.stdout:4/885: write d3/d1a/d21/f37 [4248356,20434] 0 2024-09-04T16:30:22.713 INFO:tasks.workunit.client.1.smithi193.stdout:6/920: write d5/d33/d4e/d51/f10f [138727,50389] 0 2024-09-04T16:30:22.715 INFO:tasks.workunit.client.0.smithi170.stdout:3/366: dread d13/d14/f4b [0,4194304] 0 2024-09-04T16:30:22.716 INFO:tasks.workunit.client.0.smithi170.stdout:2/384: truncate d3/d3c/f5c 293606 0 2024-09-04T16:30:22.719 INFO:tasks.workunit.client.1.smithi193.stdout:6/921: mkdir d5/d33/d4e/d51/d7b/de0/d126 0 2024-09-04T16:30:22.722 INFO:tasks.workunit.client.1.smithi193.stdout:4/886: dwrite d3/f36 [0,4194304] 0 2024-09-04T16:30:22.722 INFO:tasks.workunit.client.1.smithi193.stdout:2/938: rename d2/d9/db/d10/d1e/da4/d9a/fe8 to d2/d9/db/d65/f13e 0 2024-09-04T16:30:22.726 INFO:tasks.workunit.client.0.smithi170.stdout:7/637: rename d12/d16/d1d/c87 to d12/d15/d71/d42/d79/d9d/d51/cdc 0 2024-09-04T16:30:22.729 INFO:tasks.workunit.client.0.smithi170.stdout:0/502: link d11/d13/d71/f90 d11/d8e/fbf 0 2024-09-04T16:30:22.730 INFO:tasks.workunit.client.1.smithi193.stdout:2/939: dwrite d2/d9/db/d10/d1e/d26/dc1/f130 [0,4194304] 0 2024-09-04T16:30:22.731 INFO:tasks.workunit.client.1.smithi193.stdout:6/922: truncate d5/de/d15/d1b/fd3 789182 0 2024-09-04T16:30:22.731 INFO:tasks.workunit.client.1.smithi193.stdout:2/940: fsync d2/d9/db/d10/d1f/f4c 0 2024-09-04T16:30:22.734 INFO:tasks.workunit.client.1.smithi193.stdout:4/887: rmdir d3/d1a/d2a 39 2024-09-04T16:30:22.735 INFO:tasks.workunit.client.0.smithi170.stdout:7/638: dwrite d12/d15/d71/f7f [0,4194304] 0 2024-09-04T16:30:22.735 INFO:tasks.workunit.client.1.smithi193.stdout:4/888: fdatasync d3/d39/d44/dd5/f71 0 2024-09-04T16:30:22.737 INFO:tasks.workunit.client.0.smithi170.stdout:3/367: creat d13/d14/d1f/f72 x:0 0 0 2024-09-04T16:30:22.744 INFO:tasks.workunit.client.1.smithi193.stdout:2/941: rename d2/l7e to d2/d9/db/d10/d38/l13f 0 2024-09-04T16:30:22.745 INFO:tasks.workunit.client.0.smithi170.stdout:5/331: dwrite d4/d3a/f4d [0,4194304] 0 2024-09-04T16:30:22.746 INFO:tasks.workunit.client.0.smithi170.stdout:7/639: dwrite d12/d15/d71/d42/d81/d5c/f94 [0,4194304] 0 2024-09-04T16:30:22.746 INFO:tasks.workunit.client.0.smithi170.stdout:5/332: chown d4/f53 793786800 1 2024-09-04T16:30:22.748 INFO:tasks.workunit.client.0.smithi170.stdout:2/385: mkdir d3/db/d1c/d77 0 2024-09-04T16:30:22.752 INFO:tasks.workunit.client.0.smithi170.stdout:7/640: dread d12/d16/d1d/d65/fad [0,4194304] 0 2024-09-04T16:30:22.754 INFO:tasks.workunit.client.0.smithi170.stdout:1/521: truncate d9/d26/f46 164471 0 2024-09-04T16:30:22.756 INFO:tasks.workunit.client.0.smithi170.stdout:0/503: fdatasync d11/d75/d77/f81 0 2024-09-04T16:30:22.757 INFO:tasks.workunit.client.0.smithi170.stdout:0/504: chown d11/d13/d71 88 1 2024-09-04T16:30:22.759 INFO:tasks.workunit.client.1.smithi193.stdout:4/889: unlink d3/d1a/d21/c87 0 2024-09-04T16:30:22.762 INFO:tasks.workunit.client.1.smithi193.stdout:2/942: dread d2/d9/db/d10/d1e/da4/d9a/fa9 [0,4194304] 0 2024-09-04T16:30:22.765 INFO:tasks.workunit.client.0.smithi170.stdout:5/333: rename d4/c15 to d4/d8/d1c/d26/d27/d48/d5a/c61 0 2024-09-04T16:30:22.765 INFO:tasks.workunit.client.0.smithi170.stdout:5/334: stat d4/d8/d1c/d23/f2f 0 2024-09-04T16:30:22.766 INFO:tasks.workunit.client.0.smithi170.stdout:7/641: symlink d12/d16/db7/ldd 0 2024-09-04T16:30:22.767 INFO:tasks.workunit.client.0.smithi170.stdout:7/642: dread - d12/d16/db7/fd6 zero size 2024-09-04T16:30:22.773 INFO:tasks.workunit.client.0.smithi170.stdout:6/352: dwrite d0/df/f28 [0,4194304] 0 2024-09-04T16:30:22.774 INFO:tasks.workunit.client.0.smithi170.stdout:0/505: creat d11/d13/d36/fc0 x:0 0 0 2024-09-04T16:30:22.774 INFO:tasks.workunit.client.0.smithi170.stdout:1/522: dwrite d9/d11/d2f/d6b/d61/f6f [0,4194304] 0 2024-09-04T16:30:22.783 INFO:tasks.workunit.client.1.smithi193.stdout:6/923: write d5/d27/d3e/f73 [9123879,67989] 0 2024-09-04T16:30:22.783 INFO:tasks.workunit.client.1.smithi193.stdout:4/890: getdents d3/d1a/d2a/db9 0 2024-09-04T16:30:22.785 INFO:tasks.workunit.client.0.smithi170.stdout:0/506: unlink d11/d13/d71/d43/c57 0 2024-09-04T16:30:22.787 INFO:tasks.workunit.client.0.smithi170.stdout:5/335: mkdir d4/d62 0 2024-09-04T16:30:22.788 INFO:tasks.workunit.client.1.smithi193.stdout:4/891: mkdir d3/d1a/d54/d127 0 2024-09-04T16:30:22.792 INFO:tasks.workunit.client.0.smithi170.stdout:0/507: creat d11/d13/d4a/d66/d6d/fc1 x:0 0 0 2024-09-04T16:30:22.794 INFO:tasks.workunit.client.0.smithi170.stdout:5/336: symlink d4/d8/d1c/d41/l63 0 2024-09-04T16:30:22.795 INFO:tasks.workunit.client.0.smithi170.stdout:5/337: write d4/d8/d1c/d23/f5d [989396,122676] 0 2024-09-04T16:30:22.795 INFO:tasks.workunit.client.1.smithi193.stdout:6/924: creat d5/d33/d4e/d51/d7b/de0/d126/f127 x:0 0 0 2024-09-04T16:30:22.796 INFO:tasks.workunit.client.0.smithi170.stdout:2/386: write f2 [3635447,114430] 0 2024-09-04T16:30:22.796 INFO:tasks.workunit.client.1.smithi193.stdout:4/892: dwrite d3/d1a/d2a/f10e [0,4194304] 0 2024-09-04T16:30:22.796 INFO:tasks.workunit.client.0.smithi170.stdout:0/508: creat d11/d13/d35/fc2 x:0 0 0 2024-09-04T16:30:22.801 INFO:tasks.workunit.client.0.smithi170.stdout:6/353: dread d0/f14 [0,4194304] 0 2024-09-04T16:30:22.802 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:22 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:22.802 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:22 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:22.802 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:22 smithi193 ceph-mon[36288]: Reconfiguring ceph-exporter.smithi193 (dependencies changed)... 2024-09-04T16:30:22.802 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:22 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi193", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-04T16:30:22.802 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:22 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi193", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-04T16:30:22.802 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:22 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:30:22.802 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:22 smithi193 ceph-mon[36288]: Deploying daemon ceph-exporter.smithi193 on smithi193 2024-09-04T16:30:22.802 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:22 smithi193 ceph-mon[36288]: pgmap v31: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail; 76 MiB/s rd, 226 MiB/s wr, 427 op/s 2024-09-04T16:30:22.803 INFO:tasks.workunit.client.1.smithi193.stdout:2/943: truncate d2/d9/db/d10/d1f/d77/d111/f10b 7126931 0 2024-09-04T16:30:22.804 INFO:tasks.workunit.client.1.smithi193.stdout:6/925: dread d5/de/d15/f24 [0,4194304] 0 2024-09-04T16:30:22.805 INFO:tasks.workunit.client.0.smithi170.stdout:5/338: symlink d4/d8/d1c/d26/d27/d43/d5b/l64 0 2024-09-04T16:30:22.806 INFO:tasks.workunit.client.1.smithi193.stdout:6/926: write d5/d27/fd4 [3806935,87184] 0 2024-09-04T16:30:22.807 INFO:tasks.workunit.client.0.smithi170.stdout:5/339: dread - d4/d8/d1c/d26/f5c zero size 2024-09-04T16:30:22.808 INFO:tasks.workunit.client.0.smithi170.stdout:5/340: fdatasync d4/d8/d1c/d26/f5c 0 2024-09-04T16:30:22.809 INFO:tasks.workunit.client.0.smithi170.stdout:5/341: stat d4/d8/d1c/d26/d27/d43 0 2024-09-04T16:30:22.810 INFO:tasks.workunit.client.0.smithi170.stdout:5/342: chown d4/d8/d1c/d23/l35 432362 1 2024-09-04T16:30:22.811 INFO:tasks.workunit.client.0.smithi170.stdout:0/509: creat d11/d13/fc3 x:0 0 0 2024-09-04T16:30:22.811 INFO:tasks.workunit.client.0.smithi170.stdout:5/343: fdatasync d4/f2b 0 2024-09-04T16:30:22.814 INFO:tasks.workunit.client.1.smithi193.stdout:2/944: link d2/d9/db/d10/d51/lb2 d2/d9/db/d10/d51/d79/l140 0 2024-09-04T16:30:22.815 INFO:tasks.workunit.client.1.smithi193.stdout:2/945: chown d2/d9/db/d10/d38/lb9 266044 1 2024-09-04T16:30:22.816 INFO:tasks.workunit.client.1.smithi193.stdout:6/927: creat d5/d27/d3e/f128 x:0 0 0 2024-09-04T16:30:22.816 INFO:tasks.workunit.client.0.smithi170.stdout:7/643: dwrite d12/d15/d71/d42/f60 [0,4194304] 0 2024-09-04T16:30:22.819 INFO:tasks.workunit.client.1.smithi193.stdout:6/928: creat d5/d33/d4e/d51/d68/de7/f129 x:0 0 0 2024-09-04T16:30:22.820 INFO:tasks.workunit.client.0.smithi170.stdout:7/644: rmdir d12/d15/d41 39 2024-09-04T16:30:22.821 INFO:tasks.workunit.client.1.smithi193.stdout:6/929: mkdir d5/d33/d4e/d51/d71/d82/d88/d12a 0 2024-09-04T16:30:22.824 INFO:tasks.workunit.client.1.smithi193.stdout:4/893: write d3/d1a/d111/d89/dbd/ddc/ff8 [4460090,34446] 0 2024-09-04T16:30:22.825 INFO:tasks.workunit.client.1.smithi193.stdout:6/930: creat d5/de/d15/d1b/f12b x:0 0 0 2024-09-04T16:30:22.826 INFO:tasks.workunit.client.0.smithi170.stdout:2/387: dwrite d3/db/f3b [0,4194304] 0 2024-09-04T16:30:22.827 INFO:tasks.workunit.client.0.smithi170.stdout:7/645: mknod d12/d15/d68/cde 0 2024-09-04T16:30:22.831 INFO:tasks.workunit.client.1.smithi193.stdout:6/931: symlink d5/d27/d3e/d43/d5d/l12c 0 2024-09-04T16:30:22.833 INFO:tasks.workunit.client.0.smithi170.stdout:7/646: link d12/d5a/fc8 d12/d5a/fdf 0 2024-09-04T16:30:22.835 INFO:tasks.workunit.client.1.smithi193.stdout:6/932: symlink d5/l12d 0 2024-09-04T16:30:22.835 INFO:tasks.workunit.client.0.smithi170.stdout:6/354: dwrite d0/f11 [0,4194304] 0 2024-09-04T16:30:22.837 INFO:tasks.workunit.client.1.smithi193.stdout:6/933: symlink d5/de/d15/d48/l12e 0 2024-09-04T16:30:22.839 INFO:tasks.workunit.client.0.smithi170.stdout:6/355: mkdir d0/d15/d56/d6d 0 2024-09-04T16:30:22.841 INFO:tasks.workunit.client.0.smithi170.stdout:6/356: fsync d0/f16 0 2024-09-04T16:30:22.844 INFO:tasks.workunit.client.0.smithi170.stdout:2/388: dread d3/d7/f4d [0,4194304] 0 2024-09-04T16:30:22.847 INFO:tasks.workunit.client.1.smithi193.stdout:4/894: dread d3/f10 [0,4194304] 0 2024-09-04T16:30:22.848 INFO:tasks.workunit.client.1.smithi193.stdout:5/952: sync 2024-09-04T16:30:22.849 INFO:tasks.workunit.client.1.smithi193.stdout:5/953: read d1/d8/db/d36/d40/fde [327796,18350] 0 2024-09-04T16:30:22.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:22 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:22.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:22 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:22.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:22 smithi170 ceph-mon[29272]: Reconfiguring ceph-exporter.smithi193 (dependencies changed)... 2024-09-04T16:30:22.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:22 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi193", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-04T16:30:22.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:22 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi193", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-04T16:30:22.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:22 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:30:22.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:22 smithi170 ceph-mon[29272]: Deploying daemon ceph-exporter.smithi193 on smithi193 2024-09-04T16:30:22.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:22 smithi170 ceph-mon[29272]: pgmap v31: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail; 76 MiB/s rd, 226 MiB/s wr, 427 op/s 2024-09-04T16:30:22.852 INFO:tasks.workunit.client.0.smithi170.stdout:5/344: dread d4/f2b [0,4194304] 0 2024-09-04T16:30:22.853 INFO:tasks.workunit.client.1.smithi193.stdout:4/895: creat d3/d81/df5/f128 x:0 0 0 2024-09-04T16:30:22.854 INFO:tasks.workunit.client.1.smithi193.stdout:5/954: readlink d1/d8/db/d36/d40/d46/l7e 0 2024-09-04T16:30:22.856 INFO:tasks.workunit.client.1.smithi193.stdout:5/955: chown d1/d8/db/d15/d2b/d83/d37/c70 132 1 2024-09-04T16:30:22.856 INFO:tasks.workunit.client.1.smithi193.stdout:5/956: fdatasync d1/d8/db/d15/f47 0 2024-09-04T16:30:22.857 INFO:tasks.workunit.client.0.smithi170.stdout:5/345: rename d4/d8/d1c/l31 to d4/d8/l65 0 2024-09-04T16:30:22.860 INFO:tasks.workunit.client.1.smithi193.stdout:5/957: read d1/d8/db/d36/d40/fc5 [2615233,97498] 0 2024-09-04T16:30:22.861 INFO:tasks.workunit.client.0.smithi170.stdout:5/346: creat d4/d8/d1c/d26/d27/d43/f66 x:0 0 0 2024-09-04T16:30:22.863 INFO:tasks.workunit.client.1.smithi193.stdout:6/934: dread d5/d27/d3e/d6e/fc8 [0,4194304] 0 2024-09-04T16:30:22.863 INFO:tasks.workunit.client.1.smithi193.stdout:4/896: dread d3/d1a/d2a/f8b [0,4194304] 0 2024-09-04T16:30:22.863 INFO:tasks.workunit.client.0.smithi170.stdout:5/347: creat d4/d8/d1c/d29/f67 x:0 0 0 2024-09-04T16:30:22.868 INFO:tasks.workunit.client.0.smithi170.stdout:5/348: creat d4/d8/d1c/d26/d27/f68 x:0 0 0 2024-09-04T16:30:22.868 INFO:tasks.workunit.client.0.smithi170.stdout:7/647: dwrite d12/d16/d1d/d65/fad [4194304,4194304] 0 2024-09-04T16:30:22.869 INFO:tasks.workunit.client.0.smithi170.stdout:5/349: write d4/f53 [956009,1841] 0 2024-09-04T16:30:22.869 INFO:tasks.workunit.client.0.smithi170.stdout:6/357: write d0/d15/f26 [1290169,13664] 0 2024-09-04T16:30:22.870 INFO:tasks.workunit.client.1.smithi193.stdout:6/935: mkdir d5/d27/d3e/d43/d5d/d12f 0 2024-09-04T16:30:22.871 INFO:tasks.workunit.client.0.smithi170.stdout:5/350: fdatasync d4/d8/d1c/d23/d39/f40 0 2024-09-04T16:30:22.871 INFO:tasks.workunit.client.0.smithi170.stdout:2/389: write d3/d3c/d40/d48/f5b [509224,84007] 0 2024-09-04T16:30:22.875 INFO:tasks.workunit.client.1.smithi193.stdout:5/958: link d1/d8/db/d36/d40/d46/f8b d1/d8/db/d15/d2b/d83/d37/d58/dc4/f137 0 2024-09-04T16:30:22.878 INFO:tasks.workunit.client.1.smithi193.stdout:6/936: symlink d5/de/l130 0 2024-09-04T16:30:22.879 INFO:tasks.workunit.client.0.smithi170.stdout:2/390: symlink d3/db/d1c/d47/l78 0 2024-09-04T16:30:22.880 INFO:tasks.workunit.client.0.smithi170.stdout:5/351: chown d4/d8/d1c/d23/d3e/c59 690330470 1 2024-09-04T16:30:22.881 INFO:tasks.workunit.client.0.smithi170.stdout:5/352: write d4/d8/d1c/d41/f4f [4658919,43215] 0 2024-09-04T16:30:22.885 INFO:tasks.workunit.client.0.smithi170.stdout:7/648: write d12/f14 [1258197,23013] 0 2024-09-04T16:30:22.885 INFO:tasks.workunit.client.1.smithi193.stdout:4/897: dwrite d3/d1a/d111/d98/fc3 [0,4194304] 0 2024-09-04T16:30:22.886 INFO:tasks.workunit.client.1.smithi193.stdout:5/959: dread d1/f5b [0,4194304] 0 2024-09-04T16:30:22.886 INFO:tasks.workunit.client.0.smithi170.stdout:2/391: getdents d3/db/d1c/d77 0 2024-09-04T16:30:22.886 INFO:tasks.workunit.client.1.smithi193.stdout:4/898: stat d3/d1a/d111/d89 0 2024-09-04T16:30:22.889 INFO:tasks.workunit.client.0.smithi170.stdout:2/392: unlink d3/c38 0 2024-09-04T16:30:22.890 INFO:tasks.workunit.client.0.smithi170.stdout:2/393: write d3/d3c/d40/d48/f5e [3368962,31494] 0 2024-09-04T16:30:22.891 INFO:tasks.workunit.client.0.smithi170.stdout:7/649: rename d12/d16/f25 to d12/d15/d71/fe0 0 2024-09-04T16:30:22.896 INFO:tasks.workunit.client.1.smithi193.stdout:6/937: readlink d5/de/d15/l2e 0 2024-09-04T16:30:22.897 INFO:tasks.workunit.client.0.smithi170.stdout:2/394: mkdir d3/d4/d79 0 2024-09-04T16:30:22.897 INFO:tasks.workunit.client.0.smithi170.stdout:5/353: getdents d4/db/d37 0 2024-09-04T16:30:22.898 INFO:tasks.workunit.client.0.smithi170.stdout:7/650: readlink d12/d49/lc4 0 2024-09-04T16:30:22.899 INFO:tasks.workunit.client.0.smithi170.stdout:5/354: write d4/d8/d1c/d29/f67 [341757,128602] 0 2024-09-04T16:30:22.901 INFO:tasks.workunit.client.1.smithi193.stdout:6/938: dwrite d5/d33/d4e/d51/f80 [0,4194304] 0 2024-09-04T16:30:22.904 INFO:tasks.workunit.client.1.smithi193.stdout:5/960: getdents d1/d29 0 2024-09-04T16:30:22.904 INFO:tasks.workunit.client.0.smithi170.stdout:5/355: dread d4/d8/d1c/d23/d39/f40 [0,4194304] 0 2024-09-04T16:30:22.905 INFO:tasks.workunit.client.1.smithi193.stdout:5/961: chown d1/d8/db/d15/d2b/d83/d37/d58/d9e/dec/f12a 39 1 2024-09-04T16:30:22.905 INFO:tasks.workunit.client.1.smithi193.stdout:4/899: link d3/d1a/d111/f53 d3/d1a/d111/f129 0 2024-09-04T16:30:22.908 INFO:tasks.workunit.client.1.smithi193.stdout:6/939: creat d5/d33/d4e/d51/f131 x:0 0 0 2024-09-04T16:30:22.909 INFO:tasks.workunit.client.1.smithi193.stdout:0/950: sync 2024-09-04T16:30:22.909 INFO:tasks.workunit.client.1.smithi193.stdout:3/966: sync 2024-09-04T16:30:22.911 INFO:tasks.workunit.client.1.smithi193.stdout:3/967: write d0/f47 [1138214,95452] 0 2024-09-04T16:30:22.911 INFO:tasks.workunit.client.1.smithi193.stdout:4/900: getdents d3/d1a/d54/d127 0 2024-09-04T16:30:22.912 INFO:tasks.workunit.client.1.smithi193.stdout:4/901: chown d3/d1a/d111/dae/fd6 50874 1 2024-09-04T16:30:22.913 INFO:tasks.workunit.client.1.smithi193.stdout:4/902: readlink d3/d1a/d54/db1/ld1 0 2024-09-04T16:30:22.914 INFO:tasks.workunit.client.1.smithi193.stdout:6/940: rename d5/de/d15/l42 to d5/d33/d4e/d51/d71/d82/l132 0 2024-09-04T16:30:22.919 INFO:tasks.workunit.client.1.smithi193.stdout:3/968: unlink d0/d18/d1c/d51/d7a/f98 0 2024-09-04T16:30:22.919 INFO:tasks.workunit.client.1.smithi193.stdout:3/969: dread - d0/d9/d49/d87/f124 zero size 2024-09-04T16:30:22.925 INFO:tasks.workunit.client.1.smithi193.stdout:3/970: rmdir d0 39 2024-09-04T16:30:22.927 INFO:tasks.workunit.client.0.smithi170.stdout:2/395: creat d3/d3c/f7a x:0 0 0 2024-09-04T16:30:22.930 INFO:tasks.workunit.client.1.smithi193.stdout:4/903: rename d3/d39/d44/dd5/cef to d3/d39/c12a 0 2024-09-04T16:30:22.932 INFO:tasks.workunit.client.0.smithi170.stdout:2/396: creat d3/db/df/f7b x:0 0 0 2024-09-04T16:30:22.932 INFO:tasks.workunit.client.1.smithi193.stdout:4/904: chown d3/d81/f99 11619 1 2024-09-04T16:30:22.933 INFO:tasks.workunit.client.1.smithi193.stdout:5/962: dwrite d1/f11 [0,4194304] 0 2024-09-04T16:30:22.934 INFO:tasks.workunit.client.0.smithi170.stdout:7/651: getdents d12/d16/d1d/d65/dd0 0 2024-09-04T16:30:22.935 INFO:tasks.workunit.client.0.smithi170.stdout:4/397: sync 2024-09-04T16:30:22.938 INFO:tasks.workunit.client.0.smithi170.stdout:2/397: creat d3/d4/d14/f7c x:0 0 0 2024-09-04T16:30:22.939 INFO:tasks.workunit.client.1.smithi193.stdout:6/941: getdents d5/d27/d3e 0 2024-09-04T16:30:22.943 INFO:tasks.workunit.client.1.smithi193.stdout:5/963: mkdir d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/d138 0 2024-09-04T16:30:22.946 INFO:tasks.workunit.client.0.smithi170.stdout:2/398: unlink d3/db/c1f 0 2024-09-04T16:30:22.947 INFO:tasks.workunit.client.1.smithi193.stdout:3/971: dread d0/d18/d1c/d30/f4e [0,4194304] 0 2024-09-04T16:30:22.948 INFO:tasks.workunit.client.0.smithi170.stdout:2/399: dread - d3/d3c/f7a zero size 2024-09-04T16:30:22.949 INFO:tasks.workunit.client.0.smithi170.stdout:5/356: dwrite d4/d8/d1c/d26/d27/d43/f44 [0,4194304] 0 2024-09-04T16:30:22.950 INFO:tasks.workunit.client.0.smithi170.stdout:2/400: write d3/db/f3b [4748020,128617] 0 2024-09-04T16:30:22.950 INFO:tasks.workunit.client.1.smithi193.stdout:0/951: truncate d18/d25/d32/dce/fe1 2174754 0 2024-09-04T16:30:22.954 INFO:tasks.workunit.client.0.smithi170.stdout:2/401: creat d3/db/df/d45/f7d x:0 0 0 2024-09-04T16:30:22.955 INFO:tasks.workunit.client.0.smithi170.stdout:2/402: stat d3/db/d1c/d47/l4a 0 2024-09-04T16:30:22.956 INFO:tasks.workunit.client.1.smithi193.stdout:3/972: unlink d0/d7/l14 0 2024-09-04T16:30:22.957 INFO:tasks.workunit.client.0.smithi170.stdout:5/357: symlink d4/d8/d1c/d26/d27/d43/d5b/l69 0 2024-09-04T16:30:22.958 INFO:tasks.workunit.client.0.smithi170.stdout:2/403: mknod d3/d7/c7e 0 2024-09-04T16:30:22.961 INFO:tasks.workunit.client.0.smithi170.stdout:5/358: creat d4/d8/d1c/d26/f6a x:0 0 0 2024-09-04T16:30:22.961 INFO:tasks.workunit.client.1.smithi193.stdout:0/952: unlink d18/d25/d3b/l7e 0 2024-09-04T16:30:22.962 INFO:tasks.workunit.client.1.smithi193.stdout:6/942: creat d5/d33/d4e/d51/d7b/f133 x:0 0 0 2024-09-04T16:30:22.963 INFO:tasks.workunit.client.0.smithi170.stdout:2/404: symlink d3/db/d4b/l7f 0 2024-09-04T16:30:22.965 INFO:tasks.workunit.client.1.smithi193.stdout:3/973: rename d0/d18/d1c/d51/d5a/ldb to d0/d18/d1c/d51/d5a/dfc/l13d 0 2024-09-04T16:30:22.966 INFO:tasks.workunit.client.0.smithi170.stdout:4/398: write d1/d6/d8/f9 [4813232,92693] 0 2024-09-04T16:30:22.966 INFO:tasks.workunit.client.1.smithi193.stdout:5/964: rmdir d1/d29/d18/d133 0 2024-09-04T16:30:22.969 INFO:tasks.workunit.client.1.smithi193.stdout:0/953: creat d18/d25/d5f/d107/d111/d12a/f141 x:0 0 0 2024-09-04T16:30:22.970 INFO:tasks.workunit.client.0.smithi170.stdout:7/652: dwrite d12/d15/d71/d42/d81/f5e [0,4194304] 0 2024-09-04T16:30:22.972 INFO:tasks.workunit.client.1.smithi193.stdout:6/943: truncate d5/d33/d4e/d51/d71/d82/fa5 4346611 0 2024-09-04T16:30:22.973 INFO:tasks.workunit.client.1.smithi193.stdout:0/954: truncate d18/d25/d32/dce/dd7/f10a 255874 0 2024-09-04T16:30:22.974 INFO:tasks.workunit.client.1.smithi193.stdout:3/974: rmdir d0/d18/d1c/d51/d5a/dfc 39 2024-09-04T16:30:22.975 INFO:tasks.workunit.client.0.smithi170.stdout:2/405: symlink d3/d4/d79/l80 0 2024-09-04T16:30:22.975 INFO:tasks.workunit.client.0.smithi170.stdout:2/406: rename d3 to d3/d4/d81 22 2024-09-04T16:30:22.977 INFO:tasks.workunit.client.1.smithi193.stdout:4/905: dwrite d3/f30 [0,4194304] 0 2024-09-04T16:30:22.983 INFO:tasks.workunit.client.1.smithi193.stdout:6/944: dwrite d5/d27/d3e/d8c/fe9 [0,4194304] 0 2024-09-04T16:30:22.983 INFO:tasks.workunit.client.1.smithi193.stdout:3/975: mkdir d0/d18/d1c/d30/d8e/d13e 0 2024-09-04T16:30:22.985 INFO:tasks.workunit.client.1.smithi193.stdout:6/945: write d5/d33/df1/f10e [524169,93504] 0 2024-09-04T16:30:22.986 INFO:tasks.workunit.client.1.smithi193.stdout:8/973: sync 2024-09-04T16:30:22.986 INFO:tasks.workunit.client.1.smithi193.stdout:2/946: sync 2024-09-04T16:30:22.991 INFO:tasks.workunit.client.0.smithi170.stdout:5/359: link d4/c13 d4/c6b 0 2024-09-04T16:30:22.994 INFO:tasks.workunit.client.0.smithi170.stdout:7/653: mknod d12/d15/d71/d42/d79/d9d/dc9/ce1 0 2024-09-04T16:30:22.997 INFO:tasks.workunit.client.1.smithi193.stdout:0/955: link d18/d25/d5f/d65/dc4/dd5/df2/f11f d18/d25/d5f/d107/f142 0 2024-09-04T16:30:23.002 INFO:tasks.workunit.client.0.smithi170.stdout:7/654: dread d12/d15/f28 [0,4194304] 0 2024-09-04T16:30:23.003 INFO:tasks.workunit.client.0.smithi170.stdout:7/655: readlink d12/d15/d71/d42/d81/l6a 0 2024-09-04T16:30:23.004 INFO:tasks.workunit.client.0.smithi170.stdout:5/360: link d4/db/f34 d4/d8/d1c/d26/d27/d48/d5a/f6c 0 2024-09-04T16:30:23.004 INFO:tasks.workunit.client.0.smithi170.stdout:7/656: dread - d12/d5a/fc8 zero size 2024-09-04T16:30:23.005 INFO:tasks.workunit.client.0.smithi170.stdout:5/361: truncate d4/d8/d1c/d26/f5c 505958 0 2024-09-04T16:30:23.006 INFO:tasks.workunit.client.1.smithi193.stdout:2/947: creat d2/d9/db/d10/d1f/d77/d91/f141 x:0 0 0 2024-09-04T16:30:23.006 INFO:tasks.workunit.client.0.smithi170.stdout:2/407: getdents d3/d3c 0 2024-09-04T16:30:23.010 INFO:tasks.workunit.client.0.smithi170.stdout:7/657: rename d12/d15/d68/cde to d12/d16/d1d/d65/d82/dcb/ce2 0 2024-09-04T16:30:23.010 INFO:tasks.workunit.client.0.smithi170.stdout:4/399: dread d1/d6/d22/f62 [0,4194304] 0 2024-09-04T16:30:23.011 INFO:tasks.workunit.client.1.smithi193.stdout:5/965: getdents d1/d29/d74/d96 0 2024-09-04T16:30:23.011 INFO:tasks.workunit.client.0.smithi170.stdout:7/658: readlink d12/d15/l8f 0 2024-09-04T16:30:23.013 INFO:tasks.workunit.client.0.smithi170.stdout:5/362: dwrite d4/d3a/f4d [0,4194304] 0 2024-09-04T16:30:23.019 INFO:tasks.workunit.client.0.smithi170.stdout:4/400: creat d1/d6/d8/d20/d35/d3e/d4e/d51/f91 x:0 0 0 2024-09-04T16:30:23.020 INFO:tasks.workunit.client.1.smithi193.stdout:8/974: stat d2/d20/d23/d24/d3c/dc9/lda 0 2024-09-04T16:30:23.021 INFO:tasks.workunit.client.0.smithi170.stdout:7/659: truncate d12/d15/d68/f78 696022 0 2024-09-04T16:30:23.022 INFO:tasks.workunit.client.1.smithi193.stdout:8/975: write d2/d20/d23/f1d [1063116,66000] 0 2024-09-04T16:30:23.024 INFO:tasks.workunit.client.1.smithi193.stdout:8/976: dread d2/d20/d23/d34/d46/f11e [0,4194304] 0 2024-09-04T16:30:23.025 INFO:tasks.workunit.client.1.smithi193.stdout:4/906: rmdir d3/d1a/d111/d47/d11b 0 2024-09-04T16:30:23.026 INFO:tasks.workunit.client.0.smithi170.stdout:4/401: write d1/d6/d2b/d33/f69 [6168493,1906] 0 2024-09-04T16:30:23.026 INFO:tasks.workunit.client.1.smithi193.stdout:5/966: mknod d1/d8/db/d36/c139 0 2024-09-04T16:30:23.029 INFO:tasks.workunit.client.0.smithi170.stdout:7/660: dwrite d12/d15/d71/d42/d81/d5c/f86 [0,4194304] 0 2024-09-04T16:30:23.030 INFO:tasks.workunit.client.1.smithi193.stdout:6/946: creat d5/d33/d4e/d51/f134 x:0 0 0 2024-09-04T16:30:23.030 INFO:tasks.workunit.client.1.smithi193.stdout:3/976: dwrite d0/d18/d1b/f8b [0,4194304] 0 2024-09-04T16:30:23.031 INFO:tasks.workunit.client.0.smithi170.stdout:7/661: chown d12/d16/d1d/d65/dd0 43 1 2024-09-04T16:30:23.032 INFO:tasks.workunit.client.0.smithi170.stdout:4/402: unlink d1/d6/d2b/f7e 0 2024-09-04T16:30:23.032 INFO:tasks.workunit.client.0.smithi170.stdout:7/662: fsync d12/d15/d71/d42/d79/fbd 0 2024-09-04T16:30:23.033 INFO:tasks.workunit.client.0.smithi170.stdout:2/408: getdents d3 0 2024-09-04T16:30:23.034 INFO:tasks.workunit.client.1.smithi193.stdout:3/977: write d0/d18/d1c/d51/d6c/d126/f110 [87988,57000] 0 2024-09-04T16:30:23.036 INFO:tasks.workunit.client.1.smithi193.stdout:4/907: dwrite d3/d39/d44/dd5/fa2 [0,4194304] 0 2024-09-04T16:30:23.038 INFO:tasks.workunit.client.0.smithi170.stdout:4/403: symlink d1/d6/d2b/d47/d78/l92 0 2024-09-04T16:30:23.039 INFO:tasks.workunit.client.1.smithi193.stdout:4/908: dread d3/d1a/d111/d89/dbd/fc5 [0,4194304] 0 2024-09-04T16:30:23.039 INFO:tasks.workunit.client.1.smithi193.stdout:3/978: read d0/d18/d1c/d51/d6c/ff7 [2235641,76496] 0 2024-09-04T16:30:23.040 INFO:tasks.workunit.client.1.smithi193.stdout:5/967: creat d1/d8/db/d36/d40/d46/dbe/f13a x:0 0 0 2024-09-04T16:30:23.041 INFO:tasks.workunit.client.1.smithi193.stdout:6/947: creat d5/d33/d85/da9/f135 x:0 0 0 2024-09-04T16:30:23.041 INFO:tasks.workunit.client.0.smithi170.stdout:2/409: fsync d3/d3c/f30 0 2024-09-04T16:30:23.043 INFO:tasks.workunit.client.1.smithi193.stdout:2/948: write d2/d9/db/d10/f8f [634828,64105] 0 2024-09-04T16:30:23.061 INFO:tasks.workunit.client.1.smithi193.stdout:4/909: unlink d3/f10f 0 2024-09-04T16:30:23.061 INFO:tasks.workunit.client.1.smithi193.stdout:4/910: readlink d3/d1a/d21/lf7 0 2024-09-04T16:30:23.061 INFO:tasks.workunit.client.1.smithi193.stdout:8/977: creat d2/d20/d23/ded/f135 x:0 0 0 2024-09-04T16:30:23.061 INFO:tasks.workunit.client.1.smithi193.stdout:3/979: mkdir d0/d9/d49/d13f 0 2024-09-04T16:30:23.061 INFO:tasks.workunit.client.1.smithi193.stdout:5/968: fsync d1/d8/db/d15/d2b/d83/f114 0 2024-09-04T16:30:23.061 INFO:tasks.workunit.client.1.smithi193.stdout:6/948: rename d5/d27/d3e/d6e/fc8 to d5/d27/d3e/d43/d5d/f136 0 2024-09-04T16:30:23.061 INFO:tasks.workunit.client.1.smithi193.stdout:2/949: truncate d2/d9/db/d10/d1e/d56/fae 531199 0 2024-09-04T16:30:23.061 INFO:tasks.workunit.client.1.smithi193.stdout:0/956: dwrite d18/f1d [0,4194304] 0 2024-09-04T16:30:23.062 INFO:tasks.workunit.client.0.smithi170.stdout:4/404: mkdir d1/d6/d22/d93 0 2024-09-04T16:30:23.062 INFO:tasks.workunit.client.0.smithi170.stdout:2/410: dwrite f0 [0,4194304] 0 2024-09-04T16:30:23.062 INFO:tasks.workunit.client.0.smithi170.stdout:7/663: link d12/d15/d71/d42/f60 d12/d15/d71/d42/d81/d5c/fe3 0 2024-09-04T16:30:23.062 INFO:tasks.workunit.client.0.smithi170.stdout:4/405: creat d1/d6/d8/d6c/f94 x:0 0 0 2024-09-04T16:30:23.062 INFO:tasks.workunit.client.0.smithi170.stdout:2/411: fdatasync d3/d4/f21 0 2024-09-04T16:30:23.062 INFO:tasks.workunit.client.0.smithi170.stdout:8/449: sync 2024-09-04T16:30:23.062 INFO:tasks.workunit.client.0.smithi170.stdout:9/447: sync 2024-09-04T16:30:23.062 INFO:tasks.workunit.client.0.smithi170.stdout:8/450: dread - d6/f57 zero size 2024-09-04T16:30:23.062 INFO:tasks.workunit.client.0.smithi170.stdout:4/406: truncate d1/f74 1016221 0 2024-09-04T16:30:23.062 INFO:tasks.workunit.client.1.smithi193.stdout:4/911: symlink d3/d1a/d54/l12b 0 2024-09-04T16:30:23.065 INFO:tasks.workunit.client.0.smithi170.stdout:2/412: rename d3/d3c/f70 to d3/d3c/f82 0 2024-09-04T16:30:23.070 INFO:tasks.workunit.client.0.smithi170.stdout:9/448: chown d2/d3d/d27/d65/c7f 1105 1 2024-09-04T16:30:23.071 INFO:tasks.workunit.client.1.smithi193.stdout:6/949: creat d5/d27/d3e/f137 x:0 0 0 2024-09-04T16:30:23.072 INFO:tasks.workunit.client.0.smithi170.stdout:8/451: write d6/d28/d16/d77/d93/f9b [3495877,76884] 0 2024-09-04T16:30:23.076 INFO:tasks.workunit.client.0.smithi170.stdout:4/407: rename d1/d6/d2b/d33 to d1/d6/d8/d20/d95 0 2024-09-04T16:30:23.077 INFO:tasks.workunit.client.1.smithi193.stdout:2/950: write d2/f35 [2828988,75717] 0 2024-09-04T16:30:23.080 INFO:tasks.workunit.client.0.smithi170.stdout:2/413: mkdir d3/db/d1c/d47/d83 0 2024-09-04T16:30:23.081 INFO:tasks.workunit.client.1.smithi193.stdout:4/912: creat d3/d39/d44/dd5/f12c x:0 0 0 2024-09-04T16:30:23.081 INFO:tasks.workunit.client.1.smithi193.stdout:4/913: chown d3/d1a/d111/d98/f122 23 1 2024-09-04T16:30:23.082 INFO:tasks.workunit.client.0.smithi170.stdout:8/452: dwrite d6/d28/d16/d24/d46/f4e [0,4194304] 0 2024-09-04T16:30:23.083 INFO:tasks.workunit.client.1.smithi193.stdout:4/914: chown d3/d1a/d21/d52/d7f/db6 27357 1 2024-09-04T16:30:23.083 INFO:tasks.workunit.client.1.smithi193.stdout:3/980: creat d0/d18/d1c/d25/d5e/d7e/db6/f140 x:0 0 0 2024-09-04T16:30:23.085 INFO:tasks.workunit.client.0.smithi170.stdout:8/453: write d6/d28/d20/d5e/f47 [3588789,85083] 0 2024-09-04T16:30:23.086 INFO:tasks.workunit.client.0.smithi170.stdout:4/408: dwrite d1/d6/f4f [0,4194304] 0 2024-09-04T16:30:23.093 INFO:tasks.workunit.client.0.smithi170.stdout:7/664: getdents d12/d16/d8d 0 2024-09-04T16:30:23.095 INFO:tasks.workunit.client.1.smithi193.stdout:0/957: chown d18/d25/d5f/d6a/l110 6649171 1 2024-09-04T16:30:23.096 INFO:tasks.workunit.client.0.smithi170.stdout:2/414: rename d3/db/d4b/c4f to d3/db/d4b/c84 0 2024-09-04T16:30:23.097 INFO:tasks.workunit.client.0.smithi170.stdout:9/449: dread d2/d3d/f57 [0,4194304] 0 2024-09-04T16:30:23.098 INFO:tasks.workunit.client.1.smithi193.stdout:4/915: fdatasync d3/d1a/d111/d89/f8c 0 2024-09-04T16:30:23.100 INFO:tasks.workunit.client.1.smithi193.stdout:3/981: rmdir d0/d18/d1c/d25/d5e/d7e/db6 39 2024-09-04T16:30:23.101 INFO:tasks.workunit.client.0.smithi170.stdout:8/454: mknod d6/d28/d20/d5e/c9c 0 2024-09-04T16:30:23.103 INFO:tasks.workunit.client.0.smithi170.stdout:8/455: write d6/d28/d16/f43 [4738287,43475] 0 2024-09-04T16:30:23.103 INFO:tasks.workunit.client.0.smithi170.stdout:4/409: rename d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d8d to d1/d6/d8/d20/d35/d54/d96 0 2024-09-04T16:30:23.104 INFO:tasks.workunit.client.1.smithi193.stdout:5/969: dwrite d1/d8/db/d15/d2b/d83/feb [0,4194304] 0 2024-09-04T16:30:23.104 INFO:tasks.workunit.client.0.smithi170.stdout:9/450: dread d2/d11/d23/f55 [0,4194304] 0 2024-09-04T16:30:23.105 INFO:tasks.workunit.client.0.smithi170.stdout:7/665: mkdir d12/d15/d71/d42/d79/d9d/dc9/de4 0 2024-09-04T16:30:23.113 INFO:tasks.workunit.client.1.smithi193.stdout:6/950: rename d5/d27/da0 to d5/d138 0 2024-09-04T16:30:23.118 INFO:tasks.workunit.client.0.smithi170.stdout:8/456: rename d6/d28/d16/f7e to d6/d28/d1a/d38/f9d 0 2024-09-04T16:30:23.120 INFO:tasks.workunit.client.0.smithi170.stdout:9/451: mkdir d2/d3d/d35/d81 0 2024-09-04T16:30:23.120 INFO:tasks.workunit.client.1.smithi193.stdout:3/982: creat d0/d18/d1b/d3d/d96/f141 x:0 0 0 2024-09-04T16:30:23.121 INFO:tasks.workunit.client.0.smithi170.stdout:9/452: fsync d2/d3d/d27/f64 0 2024-09-04T16:30:23.121 INFO:tasks.workunit.client.1.smithi193.stdout:2/951: rmdir d2/d9/db/d10/d4e/d10a 0 2024-09-04T16:30:23.122 INFO:tasks.workunit.client.0.smithi170.stdout:4/410: mkdir d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97 0 2024-09-04T16:30:23.122 INFO:tasks.workunit.client.1.smithi193.stdout:3/983: write d0/f47 [4060726,23205] 0 2024-09-04T16:30:23.124 INFO:tasks.workunit.client.1.smithi193.stdout:4/916: creat d3/d1a/d111/dae/dcd/f12d x:0 0 0 2024-09-04T16:30:23.125 INFO:tasks.workunit.client.0.smithi170.stdout:7/666: fdatasync d12/f30 0 2024-09-04T16:30:23.126 INFO:tasks.workunit.client.1.smithi193.stdout:0/958: rename d18/d25/d32/d57/lbd to d18/d25/d32/d57/d6c/db1/deb/l143 0 2024-09-04T16:30:23.127 INFO:tasks.workunit.client.0.smithi170.stdout:2/415: mknod d3/db/d1c/d47/d83/c85 0 2024-09-04T16:30:23.127 INFO:tasks.workunit.client.1.smithi193.stdout:6/951: dwrite d5/de/d15/d1b/f12b [0,4194304] 0 2024-09-04T16:30:23.162 INFO:tasks.workunit.client.0.smithi170.stdout:7/667: mkdir d12/d15/d71/d42/d79/de5 0 2024-09-04T16:30:23.169 INFO:tasks.workunit.client.0.smithi170.stdout:9/453: link d2/d3d/f57 d2/d3d/d4d/f82 0 2024-09-04T16:30:23.177 INFO:tasks.workunit.client.0.smithi170.stdout:2/416: write d3/db/d4b/f59 [600603,95180] 0 2024-09-04T16:30:23.179 INFO:tasks.workunit.client.0.smithi170.stdout:8/457: getdents d6/d28/d1a/d81 0 2024-09-04T16:30:23.179 INFO:tasks.workunit.client.1.smithi193.stdout:8/978: sync 2024-09-04T16:30:23.179 INFO:tasks.workunit.client.1.smithi193.stdout:8/979: dread - d2/d20/d23/d24/d3c/de7/f11d zero size 2024-09-04T16:30:23.183 INFO:tasks.workunit.client.0.smithi170.stdout:2/417: fdatasync d3/f46 0 2024-09-04T16:30:23.184 INFO:tasks.workunit.client.0.smithi170.stdout:4/411: truncate d1/f1e 2313655 0 2024-09-04T16:30:23.184 INFO:tasks.workunit.client.0.smithi170.stdout:7/668: dread d12/d15/d71/d42/d81/fbc [4194304,4194304] 0 2024-09-04T16:30:23.190 INFO:tasks.workunit.client.0.smithi170.stdout:4/412: stat c0 0 2024-09-04T16:30:23.190 INFO:tasks.workunit.client.0.smithi170.stdout:9/454: write d2/d11/f24 [3204884,13228] 0 2024-09-04T16:30:23.196 INFO:tasks.workunit.client.0.smithi170.stdout:9/455: creat d2/d3d/d27/d65/d5b/f83 x:0 0 0 2024-09-04T16:30:23.197 INFO:tasks.workunit.client.0.smithi170.stdout:8/458: dread d6/d28/d16/d52/f63 [0,4194304] 0 2024-09-04T16:30:23.198 INFO:tasks.workunit.client.0.smithi170.stdout:8/459: dread - d6/d26/f9a zero size 2024-09-04T16:30:23.199 INFO:tasks.workunit.client.0.smithi170.stdout:7/669: write d12/d15/d71/f70 [2565,26132] 0 2024-09-04T16:30:23.202 INFO:tasks.workunit.client.0.smithi170.stdout:4/413: mknod d1/d6/d8/d20/d35/d3e/d4e/c98 0 2024-09-04T16:30:23.204 INFO:tasks.workunit.client.0.smithi170.stdout:2/418: dread d3/d3c/d40/d48/f54 [0,4194304] 0 2024-09-04T16:30:23.204 INFO:tasks.workunit.client.0.smithi170.stdout:9/456: symlink d2/d3d/d54/l84 0 2024-09-04T16:30:23.206 INFO:tasks.workunit.client.0.smithi170.stdout:8/460: creat d6/d28/d1a/f9e x:0 0 0 2024-09-04T16:30:23.207 INFO:tasks.workunit.client.0.smithi170.stdout:7/670: mkdir d12/d15/d71/d42/d79/d9d/de6 0 2024-09-04T16:30:23.211 INFO:tasks.workunit.client.0.smithi170.stdout:2/419: mkdir d3/d4/d86 0 2024-09-04T16:30:23.212 INFO:tasks.workunit.client.0.smithi170.stdout:9/457: mkdir d2/d3d/d4d/d59/d85 0 2024-09-04T16:30:23.219 INFO:tasks.workunit.client.0.smithi170.stdout:2/420: truncate d3/d4/f21 151301 0 2024-09-04T16:30:23.221 INFO:tasks.workunit.client.0.smithi170.stdout:2/421: read d3/d4/f52 [1395574,122004] 0 2024-09-04T16:30:23.223 INFO:tasks.workunit.client.0.smithi170.stdout:4/414: dwrite d1/fc [0,4194304] 0 2024-09-04T16:30:23.225 INFO:tasks.workunit.client.0.smithi170.stdout:4/415: chown d1/d6/d8/d20/d35/d3e/d43/f5f 4500320 1 2024-09-04T16:30:23.229 INFO:tasks.workunit.client.0.smithi170.stdout:2/422: dread d3/d3c/d40/f41 [0,4194304] 0 2024-09-04T16:30:23.231 INFO:tasks.workunit.client.0.smithi170.stdout:7/671: dwrite d12/d49/f6b [0,4194304] 0 2024-09-04T16:30:23.234 INFO:tasks.workunit.client.0.smithi170.stdout:9/458: write d2/d3d/f10 [259302,74849] 0 2024-09-04T16:30:23.236 INFO:tasks.workunit.client.0.smithi170.stdout:8/461: truncate d6/f7a 289065 0 2024-09-04T16:30:23.237 INFO:tasks.workunit.client.0.smithi170.stdout:4/416: creat d1/d6/d2b/f99 x:0 0 0 2024-09-04T16:30:23.239 INFO:tasks.workunit.client.0.smithi170.stdout:2/423: creat d3/db/d62/f87 x:0 0 0 2024-09-04T16:30:23.240 INFO:tasks.workunit.client.0.smithi170.stdout:7/672: dread d12/d16/f3f [0,4194304] 0 2024-09-04T16:30:23.240 INFO:tasks.workunit.client.0.smithi170.stdout:2/424: write d3/d7/f3e [60077,120669] 0 2024-09-04T16:30:23.242 INFO:tasks.workunit.client.0.smithi170.stdout:8/462: mkdir d6/d28/d16/d77/d9f 0 2024-09-04T16:30:23.243 INFO:tasks.workunit.client.0.smithi170.stdout:9/459: rmdir d2/d3d/d27/d2b/d34 39 2024-09-04T16:30:23.245 INFO:tasks.workunit.client.0.smithi170.stdout:4/417: dread - d1/d6/d8/d20/d35/d3e/d4e/d51/f76 zero size 2024-09-04T16:30:23.247 INFO:tasks.workunit.client.0.smithi170.stdout:4/418: stat d1/d6/d8/d20/d95/f69 0 2024-09-04T16:30:23.248 INFO:tasks.workunit.client.0.smithi170.stdout:2/425: dwrite f0 [0,4194304] 0 2024-09-04T16:30:23.252 INFO:tasks.workunit.client.0.smithi170.stdout:7/673: creat d12/d5a/fe7 x:0 0 0 2024-09-04T16:30:23.257 INFO:tasks.workunit.client.0.smithi170.stdout:9/460: chown d2/d3d/d27/d2b/d34/f49 44473 1 2024-09-04T16:30:23.259 INFO:tasks.workunit.client.0.smithi170.stdout:9/461: write d2/d32/f76 [402802,17968] 0 2024-09-04T16:30:23.259 INFO:tasks.workunit.client.0.smithi170.stdout:8/463: dread d6/d28/d20/d5e/f3e [4194304,4194304] 0 2024-09-04T16:30:23.262 INFO:tasks.workunit.client.0.smithi170.stdout:7/674: rmdir d12/d15/d71 39 2024-09-04T16:30:23.265 INFO:tasks.workunit.client.0.smithi170.stdout:9/462: rmdir d2/d3d 39 2024-09-04T16:30:23.268 INFO:tasks.workunit.client.0.smithi170.stdout:7/675: write d12/fd4 [811401,54638] 0 2024-09-04T16:30:23.270 INFO:tasks.workunit.client.0.smithi170.stdout:4/419: rename d1/d6/f32 to d1/d6/d8/f9a 0 2024-09-04T16:30:23.277 INFO:tasks.workunit.client.0.smithi170.stdout:2/426: rename d3/db/d1c/c4e to d3/db/d1c/d47/d67/c88 0 2024-09-04T16:30:23.279 INFO:tasks.workunit.client.0.smithi170.stdout:4/420: creat d1/d6/d8/d20/d35/d3e/d43/f9b x:0 0 0 2024-09-04T16:30:23.280 INFO:tasks.workunit.client.0.smithi170.stdout:4/421: stat d1/d6/d8/d20/d35/d3e/d60 0 2024-09-04T16:30:23.280 INFO:tasks.workunit.client.0.smithi170.stdout:9/463: unlink d2/d3d/d27/c38 0 2024-09-04T16:30:23.282 INFO:tasks.workunit.client.0.smithi170.stdout:9/464: read d2/d11/f36 [622517,62261] 0 2024-09-04T16:30:23.289 INFO:tasks.workunit.client.0.smithi170.stdout:4/422: mkdir d1/d6/d8/d20/d95/d36/d9c 0 2024-09-04T16:30:23.292 INFO:tasks.workunit.client.0.smithi170.stdout:8/464: dwrite d6/d28/d1a/d38/f88 [0,4194304] 0 2024-09-04T16:30:23.297 INFO:tasks.workunit.client.0.smithi170.stdout:7/676: write d12/d15/d71/d42/d79/f92 [872072,124874] 0 2024-09-04T16:30:23.297 INFO:tasks.workunit.client.1.smithi193.stdout:5/970: dread - d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/dd8/f107 zero size 2024-09-04T16:30:23.298 INFO:tasks.workunit.client.0.smithi170.stdout:7/677: readlink d12/d15/d71/d42/d81/d5c/l7d 0 2024-09-04T16:30:23.299 INFO:tasks.workunit.client.1.smithi193.stdout:3/984: readlink d0/d18/d1c/d25/da0/lc3 0 2024-09-04T16:30:23.300 INFO:tasks.workunit.client.0.smithi170.stdout:8/465: unlink d6/d28/d16/d52/f63 0 2024-09-04T16:30:23.301 INFO:tasks.workunit.client.0.smithi170.stdout:2/427: write d3/d3c/d40/f41 [1704004,64191] 0 2024-09-04T16:30:23.304 INFO:tasks.workunit.client.0.smithi170.stdout:9/465: dread d2/d32/f41 [0,4194304] 0 2024-09-04T16:30:23.304 INFO:tasks.workunit.client.1.smithi193.stdout:4/917: rmdir d3/d1a/d111 39 2024-09-04T16:30:23.304 INFO:tasks.workunit.client.0.smithi170.stdout:7/678: read d12/d15/d71/f38 [3355710,59600] 0 2024-09-04T16:30:23.305 INFO:tasks.workunit.client.0.smithi170.stdout:2/428: mknod d3/d3c/d40/d48/d68/c89 0 2024-09-04T16:30:23.306 INFO:tasks.workunit.client.0.smithi170.stdout:2/429: fdatasync d3/db/d1c/f75 0 2024-09-04T16:30:23.306 INFO:tasks.workunit.client.1.smithi193.stdout:3/985: mkdir d0/d18/d1b/d3d/d118/d142 0 2024-09-04T16:30:23.306 INFO:tasks.workunit.client.1.smithi193.stdout:3/986: stat d0/d18/d1b 0 2024-09-04T16:30:23.307 INFO:tasks.workunit.client.0.smithi170.stdout:9/466: creat d2/d3d/d35/f86 x:0 0 0 2024-09-04T16:30:23.308 INFO:tasks.workunit.client.1.smithi193.stdout:0/959: symlink d18/d25/d5f/d65/dc4/l144 0 2024-09-04T16:30:23.309 INFO:tasks.workunit.client.0.smithi170.stdout:2/430: fsync d3/d3c/f82 0 2024-09-04T16:30:23.311 INFO:tasks.workunit.client.0.smithi170.stdout:7/679: mknod d12/d16/ce8 0 2024-09-04T16:30:23.313 INFO:tasks.workunit.client.0.smithi170.stdout:2/431: mknod d3/db/d62/c8a 0 2024-09-04T16:30:23.315 INFO:tasks.workunit.client.1.smithi193.stdout:2/952: link d2/d9/d18/l19 d2/d9/db/d10/d51/d79/l142 0 2024-09-04T16:30:23.318 INFO:tasks.workunit.client.0.smithi170.stdout:9/467: dwrite d2/d11/f36 [0,4194304] 0 2024-09-04T16:30:23.319 INFO:tasks.workunit.client.0.smithi170.stdout:9/468: readlink d2/d32/l70 0 2024-09-04T16:30:23.320 INFO:tasks.workunit.client.1.smithi193.stdout:3/987: dwrite d0/d18/d1c/d30/f4e [0,4194304] 0 2024-09-04T16:30:23.321 INFO:tasks.workunit.client.0.smithi170.stdout:7/680: dread d12/d15/d71/d42/d81/d5c/fe3 [0,4194304] 0 2024-09-04T16:30:23.322 INFO:tasks.workunit.client.1.smithi193.stdout:3/988: readlink d0/d18/d1c/d25/ld9 0 2024-09-04T16:30:23.322 INFO:tasks.workunit.client.1.smithi193.stdout:3/989: chown d0/d10 13833300 1 2024-09-04T16:30:23.324 INFO:tasks.workunit.client.1.smithi193.stdout:6/952: rename d5/d33/d4e/f59 to d5/d27/d3e/d43/d5d/f139 0 2024-09-04T16:30:23.325 INFO:tasks.workunit.client.0.smithi170.stdout:2/432: dread d3/d4/d14/f5d [0,4194304] 0 2024-09-04T16:30:23.327 INFO:tasks.workunit.client.0.smithi170.stdout:2/433: chown d3/d7 4184888 1 2024-09-04T16:30:23.328 INFO:tasks.workunit.client.1.smithi193.stdout:2/953: creat d2/d9/db/d10/d38/d7a/f143 x:0 0 0 2024-09-04T16:30:23.329 INFO:tasks.workunit.client.0.smithi170.stdout:9/469: dwrite d2/d11/f24 [0,4194304] 0 2024-09-04T16:30:23.331 INFO:tasks.workunit.client.0.smithi170.stdout:2/434: write d3/db/f3b [2381407,70613] 0 2024-09-04T16:30:23.334 INFO:tasks.workunit.client.0.smithi170.stdout:4/423: dwrite d1/d6/d8/d20/d35/d3e/d4e/d51/f7b [0,4194304] 0 2024-09-04T16:30:23.336 INFO:tasks.workunit.client.1.smithi193.stdout:8/980: sync 2024-09-04T16:30:23.338 INFO:tasks.workunit.client.0.smithi170.stdout:8/466: dread d6/d28/d20/d5e/f68 [0,4194304] 0 2024-09-04T16:30:23.339 INFO:tasks.workunit.client.1.smithi193.stdout:6/953: dread d5/d33/d4e/d51/d71/d82/fc4 [0,4194304] 0 2024-09-04T16:30:23.341 INFO:tasks.workunit.client.0.smithi170.stdout:7/681: creat d12/d16/d1d/d65/d82/dcb/fe9 x:0 0 0 2024-09-04T16:30:23.342 INFO:tasks.workunit.client.0.smithi170.stdout:7/682: write d12/d15/d68/fa0 [892925,95646] 0 2024-09-04T16:30:23.344 INFO:tasks.workunit.client.1.smithi193.stdout:5/971: truncate d1/d8/db/d15/d2b/d83/feb 2021159 0 2024-09-04T16:30:23.346 INFO:tasks.workunit.client.0.smithi170.stdout:8/467: dread d6/d28/d16/d24/d46/f4e [0,4194304] 0 2024-09-04T16:30:23.347 INFO:tasks.workunit.client.0.smithi170.stdout:8/468: readlink d6/d28/d16/d77/l82 0 2024-09-04T16:30:23.348 INFO:tasks.workunit.client.1.smithi193.stdout:4/918: write d3/d1a/d111/d47/ffd [4717257,448] 0 2024-09-04T16:30:23.349 INFO:tasks.workunit.client.1.smithi193.stdout:2/954: mkdir d2/d9/db/d10/d38/d144 0 2024-09-04T16:30:23.349 INFO:tasks.workunit.client.1.smithi193.stdout:8/981: dread d2/d20/d23/d34/d4b/f4f [0,4194304] 0 2024-09-04T16:30:23.350 INFO:tasks.workunit.client.0.smithi170.stdout:2/435: rename d3/d7/f66 to d3/d4/d79/f8b 0 2024-09-04T16:30:23.353 INFO:tasks.workunit.client.0.smithi170.stdout:4/424: mkdir d1/d6/d8/d9d 0 2024-09-04T16:30:23.356 INFO:tasks.workunit.client.1.smithi193.stdout:3/990: rename d0/d10/cb3 to d0/d18/d1c/d30/d8e/c143 0 2024-09-04T16:30:23.358 INFO:tasks.workunit.client.0.smithi170.stdout:2/436: read d3/d4/f21 [21793,19893] 0 2024-09-04T16:30:23.358 INFO:tasks.workunit.client.0.smithi170.stdout:2/437: stat d3/d3c/f7a 0 2024-09-04T16:30:23.359 INFO:tasks.workunit.client.1.smithi193.stdout:4/919: mkdir d3/d81/df5/d12e 0 2024-09-04T16:30:23.360 INFO:tasks.workunit.client.0.smithi170.stdout:7/683: rename d12/d15/d68/fa0 to d12/d49/fea 0 2024-09-04T16:30:23.363 INFO:tasks.workunit.client.1.smithi193.stdout:2/955: creat d2/d9/db/d10/d51/d79/db4/f145 x:0 0 0 2024-09-04T16:30:23.366 INFO:tasks.workunit.client.1.smithi193.stdout:2/956: fsync d2/d9/db/f72 0 2024-09-04T16:30:23.370 INFO:tasks.workunit.client.1.smithi193.stdout:8/982: dwrite d2/d20/d23/d34/d4b/db8/fbe [4194304,4194304] 0 2024-09-04T16:30:23.371 INFO:tasks.workunit.client.0.smithi170.stdout:6/358: sync 2024-09-04T16:30:23.371 INFO:tasks.workunit.client.0.smithi170.stdout:0/510: sync 2024-09-04T16:30:23.371 INFO:tasks.workunit.client.0.smithi170.stdout:5/363: sync 2024-09-04T16:30:23.371 INFO:tasks.workunit.client.0.smithi170.stdout:1/523: sync 2024-09-04T16:30:23.371 INFO:tasks.workunit.client.0.smithi170.stdout:3/368: sync 2024-09-04T16:30:23.372 INFO:tasks.workunit.client.0.smithi170.stdout:6/359: chown d0/d17/d39 3 1 2024-09-04T16:30:23.373 INFO:tasks.workunit.client.0.smithi170.stdout:2/438: creat d3/d3c/d40/d48/f8c x:0 0 0 2024-09-04T16:30:23.373 INFO:tasks.workunit.client.1.smithi193.stdout:2/957: rmdir d2/d9/db/d10/d38/da5 39 2024-09-04T16:30:23.374 INFO:tasks.workunit.client.1.smithi193.stdout:0/960: dwrite d18/d25/d32/d57/d6c/fd1 [0,4194304] 0 2024-09-04T16:30:23.374 INFO:tasks.workunit.client.0.smithi170.stdout:9/470: link d2/d11/d23/l39 d2/d3d/d27/d2b/l87 0 2024-09-04T16:30:23.379 INFO:tasks.workunit.client.0.smithi170.stdout:3/369: creat d13/d14/d1f/f73 x:0 0 0 2024-09-04T16:30:23.379 INFO:tasks.workunit.client.0.smithi170.stdout:0/511: dwrite d11/d13/d71/f56 [0,4194304] 0 2024-09-04T16:30:23.382 INFO:tasks.workunit.client.0.smithi170.stdout:5/364: creat d4/d8/d1c/f6d x:0 0 0 2024-09-04T16:30:23.383 INFO:tasks.workunit.client.1.smithi193.stdout:6/954: dwrite d5/d33/d4e/d51/d7b/fed [0,4194304] 0 2024-09-04T16:30:23.383 INFO:tasks.workunit.client.1.smithi193.stdout:4/920: mknod d3/d1a/d111/d98/c12f 0 2024-09-04T16:30:23.386 INFO:tasks.workunit.client.1.smithi193.stdout:8/983: dread - d2/d20/d23/d24/d3c/d65/dc8/de1/dd8/fe9 zero size 2024-09-04T16:30:23.388 INFO:tasks.workunit.client.0.smithi170.stdout:6/360: symlink d0/d15/d56/l6e 0 2024-09-04T16:30:23.392 INFO:tasks.workunit.client.1.smithi193.stdout:2/958: fsync d2/d9/db/d10/d51/d87/f8a 0 2024-09-04T16:30:23.393 INFO:tasks.workunit.client.0.smithi170.stdout:8/469: truncate d6/d28/d1a/d38/f9d 1887059 0 2024-09-04T16:30:23.393 INFO:tasks.workunit.client.0.smithi170.stdout:2/439: creat d3/f8d x:0 0 0 2024-09-04T16:30:23.394 INFO:tasks.workunit.client.0.smithi170.stdout:9/471: unlink d2/d3d/d35/f44 0 2024-09-04T16:30:23.395 INFO:tasks.workunit.client.1.smithi193.stdout:2/959: truncate d2/d9/d18/d7b/f120 12338 0 2024-09-04T16:30:23.395 INFO:tasks.workunit.client.0.smithi170.stdout:4/425: dwrite d1/d6/d8/d20/d35/d3e/d4e/d51/f76 [0,4194304] 0 2024-09-04T16:30:23.396 INFO:tasks.workunit.client.1.smithi193.stdout:5/972: dwrite d1/d8/db/d36/d40/d46/f8b [4194304,4194304] 0 2024-09-04T16:30:23.400 INFO:tasks.workunit.client.1.smithi193.stdout:0/961: rename d18/d79/l7f to d18/d25/d5f/d65/dc4/dd5/df2/d112/l145 0 2024-09-04T16:30:23.400 INFO:tasks.workunit.client.1.smithi193.stdout:6/955: chown d5/de/f17 29 1 2024-09-04T16:30:23.402 INFO:tasks.workunit.client.0.smithi170.stdout:3/370: creat d13/d14/d21/d4d/d4e/f74 x:0 0 0 2024-09-04T16:30:23.404 INFO:tasks.workunit.client.1.smithi193.stdout:4/921: mkdir d3/d39/d44/d130 0 2024-09-04T16:30:23.405 INFO:tasks.workunit.client.1.smithi193.stdout:4/922: write d3/d1a/d21/f37 [3137922,89903] 0 2024-09-04T16:30:23.406 INFO:tasks.workunit.client.0.smithi170.stdout:5/365: creat d4/d8/d1c/d26/d27/d43/d5b/f6e x:0 0 0 2024-09-04T16:30:23.407 INFO:tasks.workunit.client.0.smithi170.stdout:5/366: chown d4/c1f 87 1 2024-09-04T16:30:23.415 INFO:tasks.workunit.client.0.smithi170.stdout:8/470: symlink d6/d28/d16/d77/d93/la0 0 2024-09-04T16:30:23.417 INFO:tasks.workunit.client.1.smithi193.stdout:8/984: dread d2/d20/d23/d34/d3e/f50 [0,4194304] 0 2024-09-04T16:30:23.417 INFO:tasks.workunit.client.0.smithi170.stdout:4/426: symlink d1/d6/d2b/l9e 0 2024-09-04T16:30:23.421 INFO:tasks.workunit.client.1.smithi193.stdout:0/962: symlink d18/d25/d32/d57/d6c/dfc/l146 0 2024-09-04T16:30:23.422 INFO:tasks.workunit.client.0.smithi170.stdout:0/512: dwrite d11/d13/f8a [0,4194304] 0 2024-09-04T16:30:23.428 INFO:tasks.workunit.client.0.smithi170.stdout:2/440: readlink d3/db/d4b/l7f 0 2024-09-04T16:30:23.429 INFO:tasks.workunit.client.1.smithi193.stdout:6/956: write d5/de/d15/d9f/fb9 [2194085,87254] 0 2024-09-04T16:30:23.429 INFO:tasks.workunit.client.0.smithi170.stdout:8/471: rmdir d6/d28/d16/d52/d73/d5d/d8b 39 2024-09-04T16:30:23.431 INFO:tasks.workunit.client.1.smithi193.stdout:8/985: symlink d2/d20/dc0/d82/l136 0 2024-09-04T16:30:23.432 INFO:tasks.workunit.client.0.smithi170.stdout:4/427: symlink d1/d6/d2b/d47/l9f 0 2024-09-04T16:30:23.433 INFO:tasks.workunit.client.0.smithi170.stdout:3/371: write d13/d14/d1d/f23 [5034907,130144] 0 2024-09-04T16:30:23.435 INFO:tasks.workunit.client.1.smithi193.stdout:0/963: unlink d18/d25/d3b/laf 0 2024-09-04T16:30:23.440 INFO:tasks.workunit.client.0.smithi170.stdout:6/361: rename d0/df/d1f/f5e to d0/f6f 0 2024-09-04T16:30:23.440 INFO:tasks.workunit.client.0.smithi170.stdout:5/367: dwrite d4/f3b [0,4194304] 0 2024-09-04T16:30:23.440 INFO:tasks.workunit.client.1.smithi193.stdout:2/960: creat d2/d9/db/d10/d1f/f146 x:0 0 0 2024-09-04T16:30:23.441 INFO:tasks.workunit.client.1.smithi193.stdout:5/973: creat d1/d29/d18/f13b x:0 0 0 2024-09-04T16:30:23.444 INFO:tasks.workunit.client.1.smithi193.stdout:6/957: creat d5/d33/d4e/d51/d71/d82/f13a x:0 0 0 2024-09-04T16:30:23.445 INFO:tasks.workunit.client.1.smithi193.stdout:8/986: mknod d2/d20/d23/d34/d4b/db8/c137 0 2024-09-04T16:30:23.446 INFO:tasks.workunit.client.0.smithi170.stdout:5/368: dwrite d4/d8/d1c/d41/f4f [0,4194304] 0 2024-09-04T16:30:23.447 INFO:tasks.workunit.client.1.smithi193.stdout:0/964: stat c11 0 2024-09-04T16:30:23.447 INFO:tasks.workunit.client.1.smithi193.stdout:0/965: fdatasync d18/f135 0 2024-09-04T16:30:23.449 INFO:tasks.workunit.client.0.smithi170.stdout:4/428: rmdir d1/d6/d8/d6c 39 2024-09-04T16:30:23.454 INFO:tasks.workunit.client.0.smithi170.stdout:4/429: fdatasync d1/d6/d2b/d47/d78/f7f 0 2024-09-04T16:30:23.455 INFO:tasks.workunit.client.0.smithi170.stdout:8/472: dwrite d6/d28/d1a/f36 [0,4194304] 0 2024-09-04T16:30:23.456 INFO:tasks.workunit.client.1.smithi193.stdout:6/958: rename d5/de/d15/d1b/f5a to d5/d33/d85/da9/f13b 0 2024-09-04T16:30:23.457 INFO:tasks.workunit.client.1.smithi193.stdout:8/987: unlink d2/d20/d23/d34/dd6/da0/da8/db9/ff8 0 2024-09-04T16:30:23.459 INFO:tasks.workunit.client.1.smithi193.stdout:0/966: unlink d18/d25/c4b 0 2024-09-04T16:30:23.459 INFO:tasks.workunit.client.0.smithi170.stdout:6/362: mknod d0/df/d1f/c70 0 2024-09-04T16:30:23.460 INFO:tasks.workunit.client.1.smithi193.stdout:8/988: write d2/d20/d23/d34/d3e/d6f/fde [3257304,85028] 0 2024-09-04T16:30:23.461 INFO:tasks.workunit.client.0.smithi170.stdout:6/363: chown d0/df/d1b/d3e/d47/d68/d2d/l37 1600064 1 2024-09-04T16:30:23.461 INFO:tasks.workunit.client.1.smithi193.stdout:4/923: getdents d3/d1a/d111/d89 0 2024-09-04T16:30:23.462 INFO:tasks.workunit.client.0.smithi170.stdout:2/441: creat d3/d3c/d40/d48/f8e x:0 0 0 2024-09-04T16:30:23.463 INFO:tasks.workunit.client.1.smithi193.stdout:5/974: mkdir d1/d29/d74/d96/d98/d10d/d13c 0 2024-09-04T16:30:23.464 INFO:tasks.workunit.client.0.smithi170.stdout:5/369: symlink d4/db/l6f 0 2024-09-04T16:30:23.465 INFO:tasks.workunit.client.0.smithi170.stdout:3/372: getdents d13/d14/d1d/d71 0 2024-09-04T16:30:23.465 INFO:tasks.workunit.client.0.smithi170.stdout:0/513: read d11/d13/d71/d43/f60 [1183448,1418] 0 2024-09-04T16:30:23.466 INFO:tasks.workunit.client.1.smithi193.stdout:5/975: stat d1/dd0/de9/f124 0 2024-09-04T16:30:23.467 INFO:tasks.workunit.client.0.smithi170.stdout:4/430: symlink d1/d6/d8/d20/d95/d36/la0 0 2024-09-04T16:30:23.467 INFO:tasks.workunit.client.0.smithi170.stdout:3/373: readlink d13/d14/d1d/d2d/d3d/l59 0 2024-09-04T16:30:23.468 INFO:tasks.workunit.client.0.smithi170.stdout:3/374: dread - d13/d14/d1f/f72 zero size 2024-09-04T16:30:23.471 INFO:tasks.workunit.client.1.smithi193.stdout:6/959: dwrite d5/d33/d4e/d51/d7b/f133 [0,4194304] 0 2024-09-04T16:30:23.471 INFO:tasks.workunit.client.0.smithi170.stdout:9/472: rename d2/d3d/d4d/l80 to d2/d32/l88 0 2024-09-04T16:30:23.472 INFO:tasks.workunit.client.1.smithi193.stdout:8/989: truncate d2/d20/d23/d34/dd6/da0/da8/db9/f110 725970 0 2024-09-04T16:30:23.472 INFO:tasks.workunit.client.0.smithi170.stdout:9/473: write d2/d32/f41 [4101220,21178] 0 2024-09-04T16:30:23.473 INFO:tasks.workunit.client.0.smithi170.stdout:6/364: read d0/f5 [1186172,11467] 0 2024-09-04T16:30:23.474 INFO:tasks.workunit.client.1.smithi193.stdout:8/990: chown d2/d20/d23 883894 1 2024-09-04T16:30:23.475 INFO:tasks.workunit.client.1.smithi193.stdout:4/924: dwrite d3/d1a/d21/d52/fea [0,4194304] 0 2024-09-04T16:30:23.479 INFO:tasks.workunit.client.1.smithi193.stdout:6/960: truncate d5/d27/d3e/d43/d5d/f139 843339 0 2024-09-04T16:30:23.480 INFO:tasks.workunit.client.0.smithi170.stdout:9/474: dwrite d2/d3d/d35/f43 [0,4194304] 0 2024-09-04T16:30:23.481 INFO:tasks.workunit.client.1.smithi193.stdout:4/925: readlink d3/d39/d44/dd5/l117 0 2024-09-04T16:30:23.482 INFO:tasks.workunit.client.0.smithi170.stdout:9/475: chown d2/d3d/d27/d2b/d34/f49 487018 1 2024-09-04T16:30:23.482 INFO:tasks.workunit.client.1.smithi193.stdout:4/926: dread - d3/d81/f99 zero size 2024-09-04T16:30:23.484 INFO:tasks.workunit.client.1.smithi193.stdout:4/927: fsync d3/d1a/d2a/d83/f93 0 2024-09-04T16:30:23.486 INFO:tasks.workunit.client.1.smithi193.stdout:2/961: dwrite d2/d9/f90 [0,4194304] 0 2024-09-04T16:30:23.488 INFO:tasks.workunit.client.0.smithi170.stdout:4/431: truncate d1/d6/d8/d6c/f94 836812 0 2024-09-04T16:30:23.491 INFO:tasks.workunit.client.0.smithi170.stdout:8/473: creat d6/d28/d16/d77/d93/d95/fa1 x:0 0 0 2024-09-04T16:30:23.492 INFO:tasks.workunit.client.0.smithi170.stdout:3/375: rmdir d13/d14/d1d/d2d/d3d 39 2024-09-04T16:30:23.498 INFO:tasks.workunit.client.1.smithi193.stdout:4/928: fsync d3/d1a/fdd 0 2024-09-04T16:30:23.499 INFO:tasks.workunit.client.0.smithi170.stdout:2/442: fsync d3/f50 0 2024-09-04T16:30:23.501 INFO:tasks.workunit.client.1.smithi193.stdout:4/929: chown d3/d1a/d111/d89/d113 0 1 2024-09-04T16:30:23.501 INFO:tasks.workunit.client.1.smithi193.stdout:2/962: unlink d2/d9/db/d10/d4e/lbe 0 2024-09-04T16:30:23.502 INFO:tasks.workunit.client.0.smithi170.stdout:5/370: link d4/f3c d4/d8/d1c/d26/d27/f70 0 2024-09-04T16:30:23.504 INFO:tasks.workunit.client.0.smithi170.stdout:9/476: truncate d2/d11/f1b 2573305 0 2024-09-04T16:30:23.505 INFO:tasks.workunit.client.1.smithi193.stdout:5/976: link d1/d8/db/d36/d40/dc1/c128 d1/d8/db/d36/c13d 0 2024-09-04T16:30:23.505 INFO:tasks.workunit.client.0.smithi170.stdout:8/474: symlink d6/d28/d16/d24/d46/la2 0 2024-09-04T16:30:23.506 INFO:tasks.workunit.client.1.smithi193.stdout:0/967: dwrite fb [0,4194304] 0 2024-09-04T16:30:23.506 INFO:tasks.workunit.client.0.smithi170.stdout:3/376: rmdir d13/d14/d1d/d2d 39 2024-09-04T16:30:23.511 INFO:tasks.workunit.client.1.smithi193.stdout:2/963: creat d2/d9/db/d10/d38/dac/df2/f147 x:0 0 0 2024-09-04T16:30:23.513 INFO:tasks.workunit.client.0.smithi170.stdout:0/514: dwrite d11/d13/d2f/d3f/f65 [0,4194304] 0 2024-09-04T16:30:23.515 INFO:tasks.workunit.client.1.smithi193.stdout:8/991: getdents d2/d20 0 2024-09-04T16:30:23.517 INFO:tasks.workunit.client.0.smithi170.stdout:6/365: write d0/df/d1b/f29 [4930991,23587] 0 2024-09-04T16:30:23.519 INFO:tasks.workunit.client.1.smithi193.stdout:8/992: truncate d2/d20/d23/d34/d46/d66/d10e/f113 852001 0 2024-09-04T16:30:23.520 INFO:tasks.workunit.client.1.smithi193.stdout:5/977: chown d1/d8/db/d15/d2b/d83/d37/f9d 16381511 1 2024-09-04T16:30:23.520 INFO:tasks.workunit.client.0.smithi170.stdout:6/366: write d0/df/d1b/d3e/d47/d68/f41 [442388,39279] 0 2024-09-04T16:30:23.522 INFO:tasks.workunit.client.0.smithi170.stdout:2/443: write d3/d4/f20 [859317,62126] 0 2024-09-04T16:30:23.523 INFO:tasks.workunit.client.1.smithi193.stdout:5/978: chown d1/d8/db/d15/d2b/d83/d37/d58/d9e/dec/f134 290 1 2024-09-04T16:30:23.528 INFO:tasks.workunit.client.0.smithi170.stdout:5/371: mkdir d4/db/d51/d5e/d71 0 2024-09-04T16:30:23.529 INFO:tasks.workunit.client.1.smithi193.stdout:6/961: rename d5/d33/d4e/d51/d71/d82/l132 to d5/de/d15/l13c 0 2024-09-04T16:30:23.530 INFO:tasks.workunit.client.0.smithi170.stdout:0/515: symlink d11/d13/d4a/lc4 0 2024-09-04T16:30:23.531 INFO:tasks.workunit.client.1.smithi193.stdout:6/962: stat d5/d27/d3e/d43/l64 0 2024-09-04T16:30:23.531 INFO:tasks.workunit.client.1.smithi193.stdout:2/964: dread d2/d9/db/d10/d1f/d22/f93 [0,4194304] 0 2024-09-04T16:30:23.555 INFO:tasks.workunit.client.1.smithi193.stdout:0/968: mkdir d18/d25/d32/d9c/d122/d12b/d147 0 2024-09-04T16:30:23.556 INFO:tasks.workunit.client.1.smithi193.stdout:8/993: rmdir d2/d20/d23/d24/d3c/d65/dc8/de1/dd8 39 2024-09-04T16:30:23.560 INFO:tasks.workunit.client.0.smithi170.stdout:9/477: dwrite d2/d11/f12 [4194304,4194304] 0 2024-09-04T16:30:23.565 INFO:tasks.workunit.client.1.smithi193.stdout:6/963: stat d5/d27/c55 0 2024-09-04T16:30:23.567 INFO:tasks.workunit.client.0.smithi170.stdout:2/444: unlink d3/db/d1c/f6b 0 2024-09-04T16:30:23.567 INFO:tasks.workunit.client.0.smithi170.stdout:8/475: write d6/d28/f1d [607589,87777] 0 2024-09-04T16:30:23.568 INFO:tasks.workunit.client.1.smithi193.stdout:2/965: mkdir d2/d9/db/d10/d1f/d4a/dc2/d148 0 2024-09-04T16:30:23.569 INFO:tasks.workunit.client.0.smithi170.stdout:5/372: readlink d4/d8/l22 0 2024-09-04T16:30:23.572 INFO:tasks.workunit.client.0.smithi170.stdout:0/516: unlink d11/d13/d36/l4d 0 2024-09-04T16:30:23.573 INFO:tasks.workunit.client.0.smithi170.stdout:0/517: stat d11/f15 0 2024-09-04T16:30:23.573 INFO:tasks.workunit.client.1.smithi193.stdout:4/930: link d3/c84 d3/d1a/d111/dae/d10b/c131 0 2024-09-04T16:30:23.574 INFO:tasks.workunit.client.1.smithi193.stdout:4/931: stat d3/d1a/d111/f58 0 2024-09-04T16:30:23.575 INFO:tasks.workunit.client.1.smithi193.stdout:3/991: sync 2024-09-04T16:30:23.575 INFO:tasks.workunit.client.0.smithi170.stdout:6/367: dwrite d0/f4 [0,4194304] 0 2024-09-04T16:30:23.575 INFO:tasks.workunit.client.0.smithi170.stdout:3/377: creat d13/d14/f75 x:0 0 0 2024-09-04T16:30:23.576 INFO:tasks.workunit.client.1.smithi193.stdout:3/992: readlink d0/d18/d1c/d25/da0/dcd/l102 0 2024-09-04T16:30:23.576 INFO:tasks.workunit.client.1.smithi193.stdout:6/964: creat d5/d33/d4e/d51/d68/de7/f13d x:0 0 0 2024-09-04T16:30:23.578 INFO:tasks.workunit.client.1.smithi193.stdout:0/969: truncate d18/d79/d88/f138 2525229 0 2024-09-04T16:30:23.580 INFO:tasks.workunit.client.1.smithi193.stdout:8/994: symlink d2/d20/d23/d24/l138 0 2024-09-04T16:30:23.581 INFO:tasks.workunit.client.0.smithi170.stdout:5/373: symlink d4/db/d37/l72 0 2024-09-04T16:30:23.583 INFO:tasks.workunit.client.0.smithi170.stdout:0/518: mkdir d11/d13/d4a/dc5 0 2024-09-04T16:30:23.584 INFO:tasks.workunit.client.1.smithi193.stdout:8/995: dread d2/d20/d23/d24/d3c/d65/dc8/de1/f10c [0,4194304] 0 2024-09-04T16:30:23.585 INFO:tasks.workunit.client.1.smithi193.stdout:6/965: dwrite d5/f125 [0,4194304] 0 2024-09-04T16:30:23.586 INFO:tasks.workunit.client.0.smithi170.stdout:9/478: fdatasync d2/f17 0 2024-09-04T16:30:23.587 INFO:tasks.workunit.client.1.smithi193.stdout:2/966: mknod d2/d9/db/c149 0 2024-09-04T16:30:23.589 INFO:tasks.workunit.client.1.smithi193.stdout:2/967: read d2/d9/db/d10/d1e/d56/d59/f124 [642550,106697] 0 2024-09-04T16:30:23.589 INFO:tasks.workunit.client.0.smithi170.stdout:5/374: mknod d4/d3a/c73 0 2024-09-04T16:30:23.591 INFO:tasks.workunit.client.1.smithi193.stdout:5/979: getdents d1/d29/d18/d42 0 2024-09-04T16:30:23.591 INFO:tasks.workunit.client.1.smithi193.stdout:0/970: dread - d18/d25/d5f/d65/dc4/dd5/fe7 zero size 2024-09-04T16:30:23.591 INFO:tasks.workunit.client.0.smithi170.stdout:3/378: chown d13/d14/d1d/d2d/d3d/l5b 1561175 1 2024-09-04T16:30:23.592 INFO:tasks.workunit.client.0.smithi170.stdout:0/519: dwrite d11/d13/d4a/d66/d6d/fc1 [0,4194304] 0 2024-09-04T16:30:23.592 INFO:tasks.workunit.client.0.smithi170.stdout:3/379: chown d13/f51 0 1 2024-09-04T16:30:23.593 INFO:tasks.workunit.client.1.smithi193.stdout:0/971: readlink d18/d79/d88/d9a/l9d 0 2024-09-04T16:30:23.607 INFO:tasks.workunit.client.0.smithi170.stdout:0/520: creat d11/d13/d4a/d66/d8c/fc6 x:0 0 0 2024-09-04T16:30:23.611 INFO:tasks.workunit.client.0.smithi170.stdout:9/479: dread d2/fd [0,4194304] 0 2024-09-04T16:30:23.612 INFO:tasks.workunit.client.1.smithi193.stdout:6/966: dread d5/f19 [0,4194304] 0 2024-09-04T16:30:23.613 INFO:tasks.workunit.client.0.smithi170.stdout:3/380: dread d13/d14/d21/d4c/f5d [0,4194304] 0 2024-09-04T16:30:23.615 INFO:tasks.workunit.client.0.smithi170.stdout:3/381: write d13/d14/d21/d4d/d4e/f74 [744218,99701] 0 2024-09-04T16:30:23.615 INFO:tasks.workunit.client.0.smithi170.stdout:0/521: truncate d11/d13/f28 5243171 0 2024-09-04T16:30:23.619 INFO:tasks.workunit.client.0.smithi170.stdout:9/480: fsync d2/d3d/d27/d65/d5b/f71 0 2024-09-04T16:30:23.620 INFO:tasks.workunit.client.0.smithi170.stdout:8/476: truncate d6/d26/f2b 327411 0 2024-09-04T16:30:23.621 INFO:tasks.workunit.client.0.smithi170.stdout:9/481: write d2/d11/f33 [2767552,57795] 0 2024-09-04T16:30:23.621 INFO:tasks.workunit.client.1.smithi193.stdout:4/932: dwrite d3/f14 [0,4194304] 0 2024-09-04T16:30:23.622 INFO:tasks.workunit.client.0.smithi170.stdout:9/482: fsync d2/d3d/d27/f3a 0 2024-09-04T16:30:23.622 INFO:tasks.workunit.client.1.smithi193.stdout:5/980: mknod d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/db9/d130/c13e 0 2024-09-04T16:30:23.622 INFO:tasks.workunit.client.1.smithi193.stdout:4/933: chown d3/d39/d44/c66 433 1 2024-09-04T16:30:23.624 INFO:tasks.workunit.client.0.smithi170.stdout:3/382: unlink d13/d14/d21/d4c/c66 0 2024-09-04T16:30:23.626 INFO:tasks.workunit.client.1.smithi193.stdout:3/993: getdents d0/d18/d1c/d25/da0/dcd 0 2024-09-04T16:30:23.631 INFO:tasks.workunit.client.0.smithi170.stdout:5/375: dwrite d4/db/f1e [0,4194304] 0 2024-09-04T16:30:23.633 INFO:tasks.workunit.client.0.smithi170.stdout:5/376: chown d4/d8/d1c/d41/l57 621234585 1 2024-09-04T16:30:23.633 INFO:tasks.workunit.client.1.smithi193.stdout:2/968: dwrite d2/d9/db/d10/d51/d79/fdb [0,4194304] 0 2024-09-04T16:30:23.635 INFO:tasks.workunit.client.1.smithi193.stdout:5/981: creat d1/dd0/de9/f13f x:0 0 0 2024-09-04T16:30:23.636 INFO:tasks.workunit.client.1.smithi193.stdout:2/969: fdatasync d2/d9/d18/d7b/f120 0 2024-09-04T16:30:23.637 INFO:tasks.workunit.client.0.smithi170.stdout:8/477: rename d6/d28/d5f/d85/f94 to d6/d28/d20/d5e/fa3 0 2024-09-04T16:30:23.639 INFO:tasks.workunit.client.1.smithi193.stdout:6/967: dread d5/de/d15/d1b/f6f [0,4194304] 0 2024-09-04T16:30:23.644 INFO:tasks.workunit.client.1.smithi193.stdout:8/996: getdents d2/d20/d23/d34/d4b/dd4 0 2024-09-04T16:30:23.645 INFO:tasks.workunit.client.1.smithi193.stdout:8/997: chown d2/d20/d23/d1b/d4e/fcc 228 1 2024-09-04T16:30:23.645 INFO:tasks.workunit.client.0.smithi170.stdout:5/377: mkdir d4/d3a/d74 0 2024-09-04T16:30:23.647 INFO:tasks.workunit.client.1.smithi193.stdout:8/998: chown d2/d20/d23/d51/l9d 94440722 1 2024-09-04T16:30:23.647 INFO:tasks.workunit.client.1.smithi193.stdout:3/994: mknod d0/d9/d49/d7d/c144 0 2024-09-04T16:30:23.648 INFO:tasks.workunit.client.1.smithi193.stdout:3/995: chown d0/d10/d24/d9a/de2/c117 269018 1 2024-09-04T16:30:23.648 INFO:tasks.workunit.client.0.smithi170.stdout:5/378: write d4/db/f1e [2070007,126126] 0 2024-09-04T16:30:23.648 INFO:tasks.workunit.client.0.smithi170.stdout:9/483: dread d2/d11/f33 [0,4194304] 0 2024-09-04T16:30:23.649 INFO:tasks.workunit.client.1.smithi193.stdout:0/972: truncate d18/f4c 3541684 0 2024-09-04T16:30:23.649 INFO:tasks.workunit.client.0.smithi170.stdout:9/484: write d2/d3d/d27/d2b/f6a [281101,89590] 0 2024-09-04T16:30:23.650 INFO:tasks.workunit.client.0.smithi170.stdout:8/478: mkdir d6/d28/d20/d6e/da4 0 2024-09-04T16:30:23.652 INFO:tasks.workunit.client.0.smithi170.stdout:3/383: symlink d13/d14/d21/l76 0 2024-09-04T16:30:23.654 INFO:tasks.workunit.client.1.smithi193.stdout:2/970: dread - d2/d9/db/d10/d1f/fa6 zero size 2024-09-04T16:30:23.655 INFO:tasks.workunit.client.1.smithi193.stdout:4/934: mknod d3/d1a/d111/dae/d10b/c132 0 2024-09-04T16:30:23.656 INFO:tasks.workunit.client.1.smithi193.stdout:5/982: symlink d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/l140 0 2024-09-04T16:30:23.656 INFO:tasks.workunit.client.1.smithi193.stdout:3/996: dwrite d0/d18/d1c/d51/d5a/da2/f12f [0,4194304] 0 2024-09-04T16:30:23.657 INFO:tasks.workunit.client.0.smithi170.stdout:8/479: dwrite d6/d28/d1a/f42 [4194304,4194304] 0 2024-09-04T16:30:23.660 INFO:tasks.workunit.client.1.smithi193.stdout:8/999: rename d2/d20/d23/d34/dd6/f133 to d2/d20/d23/d24/d3c/d65/dc8/f139 0 2024-09-04T16:30:23.666 INFO:tasks.workunit.client.1.smithi193.stdout:4/935: fdatasync d3/d39/f77 0 2024-09-04T16:30:23.666 INFO:tasks.workunit.client.1.smithi193.stdout:2/971: mknod d2/d9/db/d10/d1e/d56/d59/c14a 0 2024-09-04T16:30:23.667 INFO:tasks.workunit.client.0.smithi170.stdout:8/480: dwrite d6/d28/d20/f8a [0,4194304] 0 2024-09-04T16:30:23.667 INFO:tasks.workunit.client.1.smithi193.stdout:4/936: chown d3/d1a/d111/d89/d115/fce 524637969 1 2024-09-04T16:30:23.668 INFO:tasks.workunit.client.1.smithi193.stdout:2/972: readlink d2/d9/db/d10/d1f/d77/d111/l10f 0 2024-09-04T16:30:23.668 INFO:tasks.workunit.client.1.smithi193.stdout:4/937: chown d3/d81/f9b 2120045665 1 2024-09-04T16:30:23.670 INFO:tasks.workunit.client.0.smithi170.stdout:9/485: creat d2/d3d/d3f/f89 x:0 0 0 2024-09-04T16:30:23.672 INFO:tasks.workunit.client.1.smithi193.stdout:3/997: fdatasync d0/d18/d1c/f113 0 2024-09-04T16:30:23.674 INFO:tasks.workunit.client.0.smithi170.stdout:8/481: dread d6/d28/d16/d52/f64 [8388608,4194304] 0 2024-09-04T16:30:23.676 INFO:tasks.workunit.client.1.smithi193.stdout:6/968: creat d5/de/d15/d1b/d5f/da7/db2/f13e x:0 0 0 2024-09-04T16:30:23.677 INFO:tasks.workunit.client.0.smithi170.stdout:9/486: fdatasync d2/d3d/d27/d65/d56/f5a 0 2024-09-04T16:30:23.678 INFO:tasks.workunit.client.0.smithi170.stdout:9/487: truncate d2/d11/f33 4896433 0 2024-09-04T16:30:23.681 INFO:tasks.workunit.client.0.smithi170.stdout:9/488: dread d2/d3d/f1f [0,4194304] 0 2024-09-04T16:30:23.682 INFO:tasks.workunit.client.0.smithi170.stdout:8/482: truncate d6/d28/d20/d5e/f5c 4066936 0 2024-09-04T16:30:23.684 INFO:tasks.workunit.client.0.smithi170.stdout:5/379: getdents d4 0 2024-09-04T16:30:23.686 INFO:tasks.workunit.client.1.smithi193.stdout:2/973: read d2/d9/db/d10/f5c [203955,80991] 0 2024-09-04T16:30:23.690 INFO:tasks.workunit.client.0.smithi170.stdout:8/483: write d6/d28/d20/d5e/f3e [754238,124255] 0 2024-09-04T16:30:23.690 INFO:tasks.workunit.client.1.smithi193.stdout:6/969: mknod d5/d33/d4e/d51/d7b/de0/c13f 0 2024-09-04T16:30:23.691 INFO:tasks.workunit.client.0.smithi170.stdout:8/484: chown d6/d28/d20/d5e 1 1 2024-09-04T16:30:23.691 INFO:tasks.workunit.client.0.smithi170.stdout:5/380: symlink d4/d8/d1c/d23/l75 0 2024-09-04T16:30:23.693 INFO:tasks.workunit.client.0.smithi170.stdout:9/489: creat d2/d3d/d4d/d59/d85/f8a x:0 0 0 2024-09-04T16:30:23.694 INFO:tasks.workunit.client.0.smithi170.stdout:3/384: write d13/d14/d17/f42 [656703,39541] 0 2024-09-04T16:30:23.695 INFO:tasks.workunit.client.0.smithi170.stdout:8/485: mknod d6/d28/d5f/d85/ca5 0 2024-09-04T16:30:23.696 INFO:tasks.workunit.client.0.smithi170.stdout:9/490: read d2/d3d/f1a [6044100,77854] 0 2024-09-04T16:30:23.697 INFO:tasks.workunit.client.0.smithi170.stdout:5/381: rename d4/d8/d1c/d26/f5c to d4/d8/d1c/d26/d27/d43/d5b/f76 0 2024-09-04T16:30:23.701 INFO:tasks.workunit.client.1.smithi193.stdout:4/938: creat d3/d1a/d111/d98/f133 x:0 0 0 2024-09-04T16:30:23.702 INFO:tasks.workunit.client.0.smithi170.stdout:9/491: rmdir d2/d3d/d4d/d59 39 2024-09-04T16:30:23.704 INFO:tasks.workunit.client.1.smithi193.stdout:4/939: write d3/d1a/d111/d47/ffd [3966448,111518] 0 2024-09-04T16:30:23.704 INFO:tasks.workunit.client.0.smithi170.stdout:8/486: creat d6/d28/d5f/d91/fa6 x:0 0 0 2024-09-04T16:30:23.705 INFO:tasks.workunit.client.1.smithi193.stdout:2/974: dwrite d2/d9/db/d10/d51/d87/f12d [0,4194304] 0 2024-09-04T16:30:23.707 INFO:tasks.workunit.client.1.smithi193.stdout:6/970: dwrite d5/de/d15/d48/f65 [4194304,4194304] 0 2024-09-04T16:30:23.707 INFO:tasks.workunit.client.1.smithi193.stdout:4/940: chown d3/d1a/d21/d52/fea 727 1 2024-09-04T16:30:23.710 INFO:tasks.workunit.client.0.smithi170.stdout:5/382: dwrite d4/d8/d1c/d26/d27/d43/f66 [0,4194304] 0 2024-09-04T16:30:23.711 INFO:tasks.workunit.client.1.smithi193.stdout:0/973: write d18/d25/d32/d57/d6d/f93 [414864,46956] 0 2024-09-04T16:30:23.713 INFO:tasks.workunit.client.0.smithi170.stdout:3/385: dread d13/d14/d21/d4c/f5c [0,4194304] 0 2024-09-04T16:30:23.715 INFO:tasks.workunit.client.0.smithi170.stdout:5/383: write d4/d8/d1c/d23/d39/f40 [2471340,18760] 0 2024-09-04T16:30:23.718 INFO:tasks.workunit.client.0.smithi170.stdout:8/487: dread d6/d28/d16/d52/f64 [4194304,4194304] 0 2024-09-04T16:30:23.719 INFO:tasks.workunit.client.0.smithi170.stdout:3/386: truncate d13/d14/d1f/f3e 2620649 0 2024-09-04T16:30:23.721 INFO:tasks.workunit.client.0.smithi170.stdout:9/492: dwrite d2/d11/d23/f30 [4194304,4194304] 0 2024-09-04T16:30:23.724 INFO:tasks.workunit.client.1.smithi193.stdout:4/941: creat d3/d39/d44/dd5/f134 x:0 0 0 2024-09-04T16:30:23.725 INFO:tasks.workunit.client.0.smithi170.stdout:8/488: write d6/d28/d16/d24/f87 [595216,24874] 0 2024-09-04T16:30:23.728 INFO:tasks.workunit.client.1.smithi193.stdout:0/974: mkdir d18/d25/d148 0 2024-09-04T16:30:23.728 INFO:tasks.workunit.client.1.smithi193.stdout:5/983: truncate d1/d8/db/d15/d2b/d83/d37/d58/dc4/f137 7095898 0 2024-09-04T16:30:23.730 INFO:tasks.workunit.client.1.smithi193.stdout:0/975: chown d18/d25/d32/d57/d6c/db1/deb/f100 15784 1 2024-09-04T16:30:23.731 INFO:tasks.workunit.client.0.smithi170.stdout:3/387: creat d13/d14/d21/d4c/f77 x:0 0 0 2024-09-04T16:30:23.733 INFO:tasks.workunit.client.0.smithi170.stdout:9/493: symlink d2/d3d/d6d/l8b 0 2024-09-04T16:30:23.734 INFO:tasks.workunit.client.0.smithi170.stdout:9/494: write d2/d3d/f57 [3931641,67262] 0 2024-09-04T16:30:23.736 INFO:tasks.workunit.client.1.smithi193.stdout:5/984: dwrite d1/d8/db/d15/d2b/d83/d37/d58/ffa [0,4194304] 0 2024-09-04T16:30:23.738 INFO:tasks.workunit.client.0.smithi170.stdout:5/384: symlink d4/d62/l77 0 2024-09-04T16:30:23.742 INFO:tasks.workunit.client.1.smithi193.stdout:6/971: link d5/d33/d4e/d51/d71/d82/d88/lef d5/de/d15/d1b/l140 0 2024-09-04T16:30:23.743 INFO:tasks.workunit.client.0.smithi170.stdout:8/489: fdatasync d6/d28/d1a/d38/f9d 0 2024-09-04T16:30:23.743 INFO:tasks.workunit.client.1.smithi193.stdout:2/975: dread d2/d9/db/d65/f6a [0,4194304] 0 2024-09-04T16:30:23.744 INFO:tasks.workunit.client.0.smithi170.stdout:8/490: write d6/d28/d5f/d70/f7d [274247,120335] 0 2024-09-04T16:30:23.745 INFO:tasks.workunit.client.1.smithi193.stdout:5/985: rename d1/d8/db/d15/d2b/d83/d37/f67 to d1/d29/d74/f141 0 2024-09-04T16:30:23.746 INFO:tasks.workunit.client.0.smithi170.stdout:8/491: chown d6/d28/d16/d52/f64 345458 1 2024-09-04T16:30:23.747 INFO:tasks.workunit.client.1.smithi193.stdout:6/972: dread d5/d27/d3e/d43/d5d/f139 [0,4194304] 0 2024-09-04T16:30:23.747 INFO:tasks.workunit.client.0.smithi170.stdout:5/385: mkdir d4/d78 0 2024-09-04T16:30:23.748 INFO:tasks.workunit.client.1.smithi193.stdout:6/973: dread - d5/d33/d4e/d51/d7b/de0/d126/f127 zero size 2024-09-04T16:30:23.749 INFO:tasks.workunit.client.1.smithi193.stdout:4/942: getdents d3/d1a/d54 0 2024-09-04T16:30:23.749 INFO:tasks.workunit.client.1.smithi193.stdout:6/974: chown d5/de/d15/d48/l12e 5236 1 2024-09-04T16:30:23.751 INFO:tasks.workunit.client.0.smithi170.stdout:9/495: creat d2/d3d/f8c x:0 0 0 2024-09-04T16:30:23.752 INFO:tasks.workunit.client.1.smithi193.stdout:6/975: rmdir d5/de/d15/d1b/d5f/da7 39 2024-09-04T16:30:23.752 INFO:tasks.workunit.client.0.smithi170.stdout:3/388: getdents d13/d14/d1d/d2d/d3d 0 2024-09-04T16:30:23.753 INFO:tasks.workunit.client.1.smithi193.stdout:5/986: mknod d1/d8/db/d15/d2b/d83/d37/d3f/d8e/d3e/dd8/d119/c142 0 2024-09-04T16:30:23.755 INFO:tasks.workunit.client.0.smithi170.stdout:3/389: symlink d13/d14/d21/d46/l78 0 2024-09-04T16:30:23.756 INFO:tasks.workunit.client.1.smithi193.stdout:5/987: stat d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/db9/c11c 0 2024-09-04T16:30:23.756 INFO:tasks.workunit.client.1.smithi193.stdout:5/988: stat d1/d8/db/d36/d40/c117 0 2024-09-04T16:30:23.757 INFO:tasks.workunit.client.0.smithi170.stdout:9/496: creat d2/d11/f8d x:0 0 0 2024-09-04T16:30:23.757 INFO:tasks.workunit.client.1.smithi193.stdout:4/943: link d3/d1a/d111/d89/dbd/d116/l126 d3/d39/d44/dd5/l135 0 2024-09-04T16:30:23.758 INFO:tasks.workunit.client.0.smithi170.stdout:3/390: symlink d13/d14/d21/d4d/d4e/d50/l79 0 2024-09-04T16:30:23.759 INFO:tasks.workunit.client.1.smithi193.stdout:6/976: rename d5/de/d15/d1b/d5f/da7/db2/fc3 to d5/d33/d4e/d51/d71/dcf/d10c/f141 0 2024-09-04T16:30:23.760 INFO:tasks.workunit.client.1.smithi193.stdout:5/989: dread - d1/d8/db/d15/d2b/d83/d37/d58/fe3 zero size 2024-09-04T16:30:23.760 INFO:tasks.workunit.client.0.smithi170.stdout:3/391: mkdir d13/d14/d1f/d7a 0 2024-09-04T16:30:23.761 INFO:tasks.workunit.client.1.smithi193.stdout:6/977: write d5/d27/d3e/d43/d5d/d97/fd2 [4702945,117244] 0 2024-09-04T16:30:23.764 INFO:tasks.workunit.client.0.smithi170.stdout:7/684: sync 2024-09-04T16:30:23.768 INFO:tasks.workunit.client.1.smithi193.stdout:6/978: rename d5/d27/d3e/d43/d5d/d97/fba to d5/d27/d3e/d43/f142 0 2024-09-04T16:30:23.768 INFO:tasks.workunit.client.1.smithi193.stdout:6/979: chown d5/d33/d4e/d51/d68 10447 1 2024-09-04T16:30:23.769 INFO:tasks.workunit.client.0.smithi170.stdout:3/392: dread d13/d14/d17/f42 [0,4194304] 0 2024-09-04T16:30:23.775 INFO:tasks.workunit.client.1.smithi193.stdout:5/990: getdents d1 0 2024-09-04T16:30:23.776 INFO:tasks.workunit.client.1.smithi193.stdout:6/980: mknod d5/d33/d4e/d51/d71/c143 0 2024-09-04T16:30:23.783 INFO:tasks.workunit.client.1.smithi193.stdout:0/976: dwrite d18/d25/d5f/d65/f99 [0,4194304] 0 2024-09-04T16:30:23.783 INFO:tasks.workunit.client.0.smithi170.stdout:3/393: dread d13/f1a [0,4194304] 0 2024-09-04T16:30:23.784 INFO:tasks.workunit.client.1.smithi193.stdout:0/977: chown d18/l34 123 1 2024-09-04T16:30:23.785 INFO:tasks.workunit.client.0.smithi170.stdout:5/386: write d4/d8/d1c/d26/f6a [885024,36065] 0 2024-09-04T16:30:23.785 INFO:tasks.workunit.client.0.smithi170.stdout:3/394: readlink d13/d14/d21/d46/l56 0 2024-09-04T16:30:23.785 INFO:tasks.workunit.client.1.smithi193.stdout:2/976: dread d2/d9/db/d10/d4e/f8d [0,4194304] 0 2024-09-04T16:30:23.790 INFO:tasks.workunit.client.1.smithi193.stdout:5/991: dread d1/d8/f12 [0,4194304] 0 2024-09-04T16:30:23.791 INFO:tasks.workunit.client.1.smithi193.stdout:0/978: dread d18/f21 [0,4194304] 0 2024-09-04T16:30:23.792 INFO:tasks.workunit.client.0.smithi170.stdout:5/387: rmdir d4/d8/d1c/d26 39 2024-09-04T16:30:23.794 INFO:tasks.workunit.client.1.smithi193.stdout:2/977: symlink d2/d9/l14b 0 2024-09-04T16:30:23.795 INFO:tasks.workunit.client.0.smithi170.stdout:9/497: truncate d2/d3d/f10 123768 0 2024-09-04T16:30:23.796 INFO:tasks.workunit.client.1.smithi193.stdout:4/944: truncate d3/d1a/d111/d89/fbe 2008592 0 2024-09-04T16:30:23.797 INFO:tasks.workunit.client.1.smithi193.stdout:3/998: sync 2024-09-04T16:30:23.799 INFO:tasks.workunit.client.1.smithi193.stdout:5/992: symlink d1/d8/db/d15/d2b/d83/d37/d58/d9e/da7/l143 0 2024-09-04T16:30:23.800 INFO:tasks.workunit.client.0.smithi170.stdout:3/395: dread d13/d14/d1d/f27 [0,4194304] 0 2024-09-04T16:30:23.801 INFO:tasks.workunit.client.0.smithi170.stdout:9/498: write d2/d3d/d4d/d59/d85/f8a [1045567,79394] 0 2024-09-04T16:30:23.802 INFO:tasks.workunit.client.0.smithi170.stdout:3/396: read fb [1148497,107529] 0 2024-09-04T16:30:23.803 INFO:tasks.workunit.client.0.smithi170.stdout:3/397: write d13/d14/d1d/f28 [498906,10413] 0 2024-09-04T16:30:23.806 INFO:tasks.workunit.client.1.smithi193.stdout:4/945: rename d3/d1a/d54/led to d3/d1a/d111/d89/l136 0 2024-09-04T16:30:23.807 INFO:tasks.workunit.client.0.smithi170.stdout:5/388: rmdir d4/d78 0 2024-09-04T16:30:23.808 INFO:tasks.workunit.client.1.smithi193.stdout:3/999: mknod d0/d18/d114/c145 0 2024-09-04T16:30:23.809 INFO:tasks.workunit.client.0.smithi170.stdout:9/499: fdatasync d2/d3d/d4d/f82 0 2024-09-04T16:30:23.810 INFO:tasks.workunit.client.0.smithi170.stdout:9/500: fdatasync d2/d11/f24 0 2024-09-04T16:30:23.810 INFO:tasks.workunit.client.1.smithi193.stdout:5/993: mkdir d1/d8/db/d15/d2b/d83/d37/d3f/d8e/dbb/db9/d130/d144 0 2024-09-04T16:30:23.811 INFO:tasks.workunit.client.1.smithi193.stdout:5/994: readlink d1/d8/db/d15/lfe 0 2024-09-04T16:30:23.816 INFO:tasks.workunit.client.1.smithi193.stdout:0/979: creat d18/d25/d5f/d65/f149 x:0 0 0 2024-09-04T16:30:23.817 INFO:tasks.workunit.client.1.smithi193.stdout:0/980: chown d18/d25/d32/d57/d6c/db1/fc7 1812294005 1 2024-09-04T16:30:23.817 INFO:tasks.workunit.client.1.smithi193.stdout:4/946: dread - d3/d1a/d21/fe1 zero size 2024-09-04T16:30:23.818 INFO:tasks.workunit.client.1.smithi193.stdout:4/947: chown d3/d39 6 1 2024-09-04T16:30:23.818 INFO:tasks.workunit.client.0.smithi170.stdout:5/389: stat d4/d3a/l56 0 2024-09-04T16:30:23.820 INFO:tasks.workunit.client.1.smithi193.stdout:2/978: creat d2/d9/db/d10/d1e/f14c x:0 0 0 2024-09-04T16:30:23.820 INFO:tasks.workunit.client.1.smithi193.stdout:0/981: truncate d18/d25/d5f/d65/dc4/dd5/fdf 4499578 0 2024-09-04T16:30:23.821 INFO:tasks.workunit.client.0.smithi170.stdout:3/398: creat d13/d14/d17/f7b x:0 0 0 2024-09-04T16:30:23.822 INFO:tasks.workunit.client.1.smithi193.stdout:5/995: creat d1/d29/f145 x:0 0 0 2024-09-04T16:30:23.822 INFO:tasks.workunit.client.0.smithi170.stdout:9/501: dwrite d2/d11/f26 [0,4194304] 0 2024-09-04T16:30:23.824 INFO:tasks.workunit.client.1.smithi193.stdout:6/981: mkdir d5/d33/d4e/d51/d71/d82/d144 0 2024-09-04T16:30:23.826 INFO:tasks.workunit.client.1.smithi193.stdout:4/948: truncate d3/d39/d44/dd5/fa5 1471541 0 2024-09-04T16:30:23.827 INFO:tasks.workunit.client.1.smithi193.stdout:2/979: symlink d2/d9/db/d10/d51/dca/l14d 0 2024-09-04T16:30:23.830 INFO:tasks.workunit.client.0.smithi170.stdout:9/502: dwrite d2/d3d/d27/d65/d66/f73 [0,4194304] 0 2024-09-04T16:30:23.830 INFO:tasks.workunit.client.1.smithi193.stdout:0/982: creat d18/d25/d5f/d65/dc4/dd5/df2/f14a x:0 0 0 2024-09-04T16:30:23.832 INFO:tasks.workunit.client.1.smithi193.stdout:5/996: truncate d1/d29/d18/d42/fcb 156775 0 2024-09-04T16:30:23.835 INFO:tasks.workunit.client.1.smithi193.stdout:6/982: mkdir d5/d33/d85/d145 0 2024-09-04T16:30:23.838 INFO:tasks.workunit.client.1.smithi193.stdout:4/949: symlink d3/d1a/d2a/l137 0 2024-09-04T16:30:23.840 INFO:tasks.workunit.client.1.smithi193.stdout:2/980: mkdir d2/d9/db/d10/d1e/d26/dc1/d14e 0 2024-09-04T16:30:23.842 INFO:tasks.workunit.client.1.smithi193.stdout:0/983: chown d18/c1b 29330508 1 2024-09-04T16:30:23.843 INFO:tasks.workunit.client.0.smithi170.stdout:5/390: link d4/d8/d1c/d41/f46 d4/d8/d1c/d26/d27/d48/d5a/f79 0 2024-09-04T16:30:23.844 INFO:tasks.workunit.client.1.smithi193.stdout:5/997: symlink d1/dd0/d102/d113/l146 0 2024-09-04T16:30:23.844 INFO:tasks.workunit.client.1.smithi193.stdout:5/998: chown d1/d29/d18/f13b 56 1 2024-09-04T16:30:23.845 INFO:tasks.workunit.client.1.smithi193.stdout:4/950: mkdir d3/d1a/d21/d52/d7f/d138 0 2024-09-04T16:30:23.846 INFO:tasks.workunit.client.0.smithi170.stdout:5/391: read d4/f53 [131360,108177] 0 2024-09-04T16:30:23.847 INFO:tasks.workunit.client.1.smithi193.stdout:2/981: rename d2/d9/db/d10/d51/dca/d125 to d2/d9/db/d10/d51/d79/d14f 0 2024-09-04T16:30:23.848 INFO:tasks.workunit.client.1.smithi193.stdout:0/984: mknod d18/d25/d32/d57/d6c/db1/dc9/d131/c14b 0 2024-09-04T16:30:23.849 INFO:tasks.workunit.client.0.smithi170.stdout:5/392: mknod d4/d8/d1c/d26/c7a 0 2024-09-04T16:30:23.850 INFO:tasks.workunit.client.1.smithi193.stdout:6/983: unlink d5/d33/d4e/d51/d71/cea 0 2024-09-04T16:30:23.851 INFO:tasks.workunit.client.1.smithi193.stdout:6/984: readlink d5/d33/d4e/le8 0 2024-09-04T16:30:23.852 INFO:tasks.workunit.client.0.smithi170.stdout:5/393: mknod d4/d8/c7b 0 2024-09-04T16:30:23.853 INFO:tasks.workunit.client.1.smithi193.stdout:4/951: dwrite d3/d1a/d21/d52/fea [4194304,4194304] 0 2024-09-04T16:30:23.855 INFO:tasks.workunit.client.0.smithi170.stdout:5/394: rmdir d4/d8/d1c/d26/d27 39 2024-09-04T16:30:23.856 INFO:tasks.workunit.client.0.smithi170.stdout:9/503: truncate d2/d3d/f10 3842536 0 2024-09-04T16:30:23.858 INFO:tasks.workunit.client.1.smithi193.stdout:2/982: mkdir d2/d9/db/d10/d1f/d77/de5/d150 0 2024-09-04T16:30:23.858 INFO:tasks.workunit.client.1.smithi193.stdout:2/983: readlink d2/l2f 0 2024-09-04T16:30:23.858 INFO:tasks.workunit.client.1.smithi193.stdout:5/999: getdents d1/d8/db/de1 0 2024-09-04T16:30:23.862 INFO:tasks.workunit.client.0.smithi170.stdout:9/504: creat d2/d3d/d27/f8e x:0 0 0 2024-09-04T16:30:23.864 INFO:tasks.workunit.client.0.smithi170.stdout:9/505: write d2/d3d/f8c [990131,82589] 0 2024-09-04T16:30:23.865 INFO:tasks.workunit.client.0.smithi170.stdout:5/395: mkdir d4/d8/d1c/d26/d27/d48/d7c 0 2024-09-04T16:30:23.866 INFO:tasks.workunit.client.1.smithi193.stdout:6/985: dwrite d5/d27/d3e/fe5 [0,4194304] 0 2024-09-04T16:30:23.866 INFO:tasks.workunit.client.0.smithi170.stdout:5/396: chown d4/d8/d1c/d23/d39/f40 27386 1 2024-09-04T16:30:23.871 INFO:tasks.workunit.client.0.smithi170.stdout:9/506: mkdir d2/d11/d8f 0 2024-09-04T16:30:23.874 INFO:tasks.workunit.client.0.smithi170.stdout:5/397: mkdir d4/d8/d1c/d26/d27/d7d 0 2024-09-04T16:30:23.875 INFO:tasks.workunit.client.1.smithi193.stdout:4/952: symlink d3/d1a/l139 0 2024-09-04T16:30:23.875 INFO:tasks.workunit.client.1.smithi193.stdout:4/953: stat d3/ff0 0 2024-09-04T16:30:23.876 INFO:tasks.workunit.client.1.smithi193.stdout:6/986: mknod d5/d33/df1/c146 0 2024-09-04T16:30:23.876 INFO:tasks.workunit.client.1.smithi193.stdout:4/954: stat d3/d1a/d2a/cb7 0 2024-09-04T16:30:23.878 INFO:tasks.workunit.client.0.smithi170.stdout:5/398: creat d4/d8/d1c/d23/d3e/f7e x:0 0 0 2024-09-04T16:30:23.879 INFO:tasks.workunit.client.1.smithi193.stdout:2/984: mkdir d2/d9/db/d10/d38/da5/d151 0 2024-09-04T16:30:23.880 INFO:tasks.workunit.client.1.smithi193.stdout:2/985: chown d2/d9/db/d10/d38/f13d 662182786 1 2024-09-04T16:30:23.883 INFO:tasks.workunit.client.1.smithi193.stdout:6/987: mknod d5/d33/d4e/d51/d7b/de0/d126/c147 0 2024-09-04T16:30:23.884 INFO:tasks.workunit.client.1.smithi193.stdout:0/985: link d18/l2d d18/d25/d32/d57/d6c/db1/deb/l14c 0 2024-09-04T16:30:23.885 INFO:tasks.workunit.client.0.smithi170.stdout:5/399: dwrite d4/d8/d1c/d29/f67 [0,4194304] 0 2024-09-04T16:30:23.886 INFO:tasks.workunit.client.1.smithi193.stdout:6/988: dread - d5/de/d15/ff9 zero size 2024-09-04T16:30:23.888 INFO:tasks.workunit.client.0.smithi170.stdout:5/400: mknod d4/d8/d1c/c7f 0 2024-09-04T16:30:23.889 INFO:tasks.workunit.client.1.smithi193.stdout:6/989: symlink d5/de/d15/dda/l148 0 2024-09-04T16:30:23.896 INFO:tasks.workunit.client.1.smithi193.stdout:6/990: getdents d5/de/d15/d1b/d5f 0 2024-09-04T16:30:23.897 INFO:tasks.workunit.client.1.smithi193.stdout:4/955: write d3/fc [2047466,6455] 0 2024-09-04T16:30:23.897 INFO:tasks.workunit.client.1.smithi193.stdout:6/991: chown d5/fff 7434411 1 2024-09-04T16:30:23.897 INFO:tasks.workunit.client.1.smithi193.stdout:4/956: dread - d3/d81/df5/f128 zero size 2024-09-04T16:30:23.901 INFO:tasks.workunit.client.1.smithi193.stdout:0/986: dread d18/d25/d3b/de9/fff [0,4194304] 0 2024-09-04T16:30:23.902 INFO:tasks.workunit.client.1.smithi193.stdout:6/992: rename d5/de/d15/d1b/d5f/da7/d121/f124 to d5/de/d15/d9f/f149 0 2024-09-04T16:30:23.903 INFO:tasks.workunit.client.0.smithi170.stdout:5/401: truncate d4/d8/d1c/d26/d27/d43/f66 1051446 0 2024-09-04T16:30:23.904 INFO:tasks.workunit.client.0.smithi170.stdout:5/402: read - d4/d8/d1c/d23/d3e/f7e zero size 2024-09-04T16:30:23.905 INFO:tasks.workunit.client.1.smithi193.stdout:0/987: fdatasync d18/d25/d32/d57/f56 0 2024-09-04T16:30:23.906 INFO:tasks.workunit.client.1.smithi193.stdout:6/993: dread d5/d27/d3e/d43/d5d/f136 [0,4194304] 0 2024-09-04T16:30:23.906 INFO:tasks.workunit.client.0.smithi170.stdout:5/403: read d4/f2b [5458920,78440] 0 2024-09-04T16:30:23.907 INFO:tasks.workunit.client.1.smithi193.stdout:6/994: chown d5/l22 69 1 2024-09-04T16:30:23.909 INFO:tasks.workunit.client.0.smithi170.stdout:5/404: unlink d4/f53 0 2024-09-04T16:30:23.914 INFO:tasks.workunit.client.1.smithi193.stdout:6/995: rmdir d5/d33/d4e/d51/d68/d11f 0 2024-09-04T16:30:23.914 INFO:tasks.workunit.client.1.smithi193.stdout:4/957: truncate d3/d1a/d111/d89/d113/f121 1392975 0 2024-09-04T16:30:23.916 INFO:tasks.workunit.client.0.smithi170.stdout:5/405: dwrite d4/d8/d1c/d41/f54 [0,4194304] 0 2024-09-04T16:30:23.923 INFO:tasks.workunit.client.1.smithi193.stdout:4/958: symlink d3/l13a 0 2024-09-04T16:30:23.925 INFO:tasks.workunit.client.0.smithi170.stdout:5/406: mknod d4/c80 0 2024-09-04T16:30:23.926 INFO:tasks.workunit.client.1.smithi193.stdout:0/988: dwrite d18/d25/d5f/d107/f142 [0,4194304] 0 2024-09-04T16:30:23.930 INFO:tasks.workunit.client.0.smithi170.stdout:5/407: dread d4/f2b [0,4194304] 0 2024-09-04T16:30:23.933 INFO:tasks.workunit.client.1.smithi193.stdout:0/989: mkdir d18/d25/d5f/d65/dc4/dd5/df2/d14d 0 2024-09-04T16:30:23.933 INFO:tasks.workunit.client.1.smithi193.stdout:6/996: write d5/d33/d85/f94 [703341,15198] 0 2024-09-04T16:30:23.934 INFO:tasks.workunit.client.1.smithi193.stdout:4/959: mkdir d3/d1a/d111/d47/d13b 0 2024-09-04T16:30:23.934 INFO:tasks.workunit.client.1.smithi193.stdout:6/997: stat d5/d27/d3e/d43/d5d 0 2024-09-04T16:30:23.935 INFO:tasks.workunit.client.0.smithi170.stdout:5/408: readlink d4/db/d37/l42 0 2024-09-04T16:30:23.936 INFO:tasks.workunit.client.0.smithi170.stdout:1/524: sync 2024-09-04T16:30:23.936 INFO:tasks.workunit.client.0.smithi170.stdout:4/432: sync 2024-09-04T16:30:23.937 INFO:tasks.workunit.client.1.smithi193.stdout:6/998: chown d5/d27/c6c 4 1 2024-09-04T16:30:23.938 INFO:tasks.workunit.client.1.smithi193.stdout:4/960: mkdir d3/d1a/d111/dae/dcd/d13c 0 2024-09-04T16:30:23.939 INFO:tasks.workunit.client.0.smithi170.stdout:5/409: creat d4/d8/d1c/d23/d39/f81 x:0 0 0 2024-09-04T16:30:23.939 INFO:tasks.workunit.client.1.smithi193.stdout:4/961: write d3/d1a/d111/d98/f123 [257326,77998] 0 2024-09-04T16:30:23.940 INFO:tasks.workunit.client.0.smithi170.stdout:5/410: write d4/db/f1e [714133,106897] 0 2024-09-04T16:30:23.942 INFO:tasks.workunit.client.0.smithi170.stdout:1/525: fdatasync d9/d11/d3e/f91 0 2024-09-04T16:30:23.944 INFO:tasks.workunit.client.1.smithi193.stdout:6/999: rename d5/d138 to d5/d33/d85/d145/d14a 0 2024-09-04T16:30:23.945 INFO:tasks.workunit.client.0.smithi170.stdout:4/433: mkdir d1/d6/d8/d20/d35/d54/da1 0 2024-09-04T16:30:23.946 INFO:tasks.workunit.client.0.smithi170.stdout:4/434: write d1/f7c [1130044,24104] 0 2024-09-04T16:30:23.948 INFO:tasks.workunit.client.0.smithi170.stdout:4/435: read - d1/d6/d8/f8a zero size 2024-09-04T16:30:23.949 INFO:tasks.workunit.client.1.smithi193.stdout:0/990: mkdir d18/d25/d5f/d6a/d7b/df5/d14e 0 2024-09-04T16:30:23.951 INFO:tasks.workunit.client.1.smithi193.stdout:4/962: creat d3/d1a/d21/d52/d7f/deb/f13d x:0 0 0 2024-09-04T16:30:23.954 INFO:tasks.workunit.client.0.smithi170.stdout:4/436: dwrite d1/d6/d8/d20/d95/f64 [0,4194304] 0 2024-09-04T16:30:23.955 INFO:tasks.workunit.client.0.smithi170.stdout:1/526: rename d9/d11/f3d to d9/d11/d2e/fa9 0 2024-09-04T16:30:23.960 INFO:tasks.workunit.client.0.smithi170.stdout:4/437: dwrite d1/f7c [0,4194304] 0 2024-09-04T16:30:23.961 INFO:tasks.workunit.client.0.smithi170.stdout:4/438: stat d1/d6/d2b/d47/c6e 0 2024-09-04T16:30:23.974 INFO:tasks.workunit.client.1.smithi193.stdout:2/986: sync 2024-09-04T16:30:23.989 INFO:tasks.workunit.client.1.smithi193.stdout:0/991: symlink d18/d25/d5f/d6a/d7b/df5/d14e/l14f 0 2024-09-04T16:30:23.990 INFO:tasks.workunit.client.0.smithi170.stdout:5/411: symlink d4/db/d51/d5e/d71/l82 0 2024-09-04T16:30:23.991 INFO:tasks.workunit.client.1.smithi193.stdout:4/963: mkdir d3/d39/d13e 0 2024-09-04T16:30:23.994 INFO:tasks.workunit.client.1.smithi193.stdout:2/987: mknod d2/d9/db/d10/d1f/d4a/c152 0 2024-09-04T16:30:23.995 INFO:tasks.workunit.client.1.smithi193.stdout:2/988: write d2/d9/db/d10/d51/d79/f132 [71066,122416] 0 2024-09-04T16:30:23.999 INFO:tasks.workunit.client.0.smithi170.stdout:5/412: creat d4/d8/d1c/d23/f83 x:0 0 0 2024-09-04T16:30:24.003 INFO:tasks.workunit.client.1.smithi193.stdout:2/989: creat d2/d9/db/d10/d51/dca/f153 x:0 0 0 2024-09-04T16:30:24.003 INFO:tasks.workunit.client.0.smithi170.stdout:1/527: dread d9/f55 [0,4194304] 0 2024-09-04T16:30:24.005 INFO:tasks.workunit.client.0.smithi170.stdout:5/413: rename d4/d8/d1c/d26/d27/d7d to d4/db/d51/d5e/d71/d84 0 2024-09-04T16:30:24.005 INFO:tasks.workunit.client.0.smithi170.stdout:4/439: link d1/d6/d22/c6a d1/d6/d8/d6c/ca2 0 2024-09-04T16:30:24.008 INFO:tasks.workunit.client.1.smithi193.stdout:2/990: symlink d2/d9/db/d10/d1f/d4a/dc2/d148/l154 0 2024-09-04T16:30:24.008 INFO:tasks.workunit.client.1.smithi193.stdout:4/964: dread d3/d1a/d111/f53 [0,4194304] 0 2024-09-04T16:30:24.009 INFO:tasks.workunit.client.0.smithi170.stdout:5/414: mkdir d4/d8/d1c/d26/d27/d43/d5b/d85 0 2024-09-04T16:30:24.010 INFO:tasks.workunit.client.0.smithi170.stdout:1/528: getdents d9/d11/d85 0 2024-09-04T16:30:24.011 INFO:tasks.workunit.client.0.smithi170.stdout:1/529: write d9/d11/d2f/f5c [2134128,16541] 0 2024-09-04T16:30:24.011 INFO:tasks.workunit.client.0.smithi170.stdout:5/415: rmdir d4/d8/d1c/d29 39 2024-09-04T16:30:24.013 INFO:tasks.workunit.client.1.smithi193.stdout:4/965: symlink d3/d1a/d54/l13f 0 2024-09-04T16:30:24.013 INFO:tasks.workunit.client.1.smithi193.stdout:0/992: truncate d18/d25/d32/d57/d6d/f72 807860 0 2024-09-04T16:30:24.015 INFO:tasks.workunit.client.1.smithi193.stdout:4/966: mknod d3/d39/d44/c140 0 2024-09-04T16:30:24.016 INFO:tasks.workunit.client.1.smithi193.stdout:0/993: symlink d18/d25/d5f/d65/dc4/dd5/df2/l150 0 2024-09-04T16:30:24.018 INFO:tasks.workunit.client.0.smithi170.stdout:1/530: dread d9/f2b [0,4194304] 0 2024-09-04T16:30:24.018 INFO:tasks.workunit.client.0.smithi170.stdout:5/416: creat d4/d8/d1c/d26/d27/d43/f86 x:0 0 0 2024-09-04T16:30:24.020 INFO:tasks.workunit.client.0.smithi170.stdout:4/440: link d1/d6/d2b/d47/f6f d1/d6/d8/d20/d95/d36/d79/fa3 0 2024-09-04T16:30:24.021 INFO:tasks.workunit.client.1.smithi193.stdout:0/994: dwrite f6 [8388608,4194304] 0 2024-09-04T16:30:24.027 INFO:tasks.workunit.client.0.smithi170.stdout:1/531: creat d9/d11/d3e/d6a/faa x:0 0 0 2024-09-04T16:30:24.028 INFO:tasks.workunit.client.1.smithi193.stdout:4/967: mknod d3/d1a/c141 0 2024-09-04T16:30:24.029 INFO:tasks.workunit.client.0.smithi170.stdout:5/417: rename d4/d8/d1c/d26/d27/d48/d5a/f6c to d4/d8/d1c/d26/d27/d43/f87 0 2024-09-04T16:30:24.030 INFO:tasks.workunit.client.1.smithi193.stdout:2/991: dwrite d2/d9/db/d10/d4e/f13a [0,4194304] 0 2024-09-04T16:30:24.032 INFO:tasks.workunit.client.1.smithi193.stdout:2/992: write d2/d9/db/d10/d1e/da4/fc6 [4009496,21000] 0 2024-09-04T16:30:24.032 INFO:tasks.workunit.client.1.smithi193.stdout:0/995: rename d18/d25/d32/d9c/da9/lf8 to d18/d25/d32/d57/d6c/db1/l151 0 2024-09-04T16:30:24.035 INFO:tasks.workunit.client.1.smithi193.stdout:0/996: chown d18/d25/d5f/d65/cc1 10694454 1 2024-09-04T16:30:24.036 INFO:tasks.workunit.client.0.smithi170.stdout:1/532: creat d9/d11/d3e/d6a/d79/d7c/fab x:0 0 0 2024-09-04T16:30:24.038 INFO:tasks.workunit.client.1.smithi193.stdout:4/968: dread d3/d39/fac [0,4194304] 0 2024-09-04T16:30:24.039 INFO:tasks.workunit.client.0.smithi170.stdout:1/533: creat d9/d11/fac x:0 0 0 2024-09-04T16:30:24.040 INFO:tasks.workunit.client.0.smithi170.stdout:5/418: truncate d4/f6 3827165 0 2024-09-04T16:30:24.042 INFO:tasks.workunit.client.0.smithi170.stdout:1/534: creat d9/d11/d2f/fad x:0 0 0 2024-09-04T16:30:24.043 INFO:tasks.workunit.client.1.smithi193.stdout:2/993: rename d2/d9/db/d10/d1f/d77/de5/lfc to d2/d9/db/d10/d1f/d77/l155 0 2024-09-04T16:30:24.044 INFO:tasks.workunit.client.1.smithi193.stdout:2/994: fdatasync d2/d9/db/d10/d1f/d77/d91/dff/f107 0 2024-09-04T16:30:24.047 INFO:tasks.workunit.client.0.smithi170.stdout:5/419: dread d4/f3b [0,4194304] 0 2024-09-04T16:30:24.048 INFO:tasks.workunit.client.1.smithi193.stdout:2/995: truncate d2/d9/db/d10/d1f/d4a/dc2/fc3 985939 0 2024-09-04T16:30:24.050 INFO:tasks.workunit.client.0.smithi170.stdout:5/420: write d4/f2c [1274951,88853] 0 2024-09-04T16:30:24.051 INFO:tasks.workunit.client.1.smithi193.stdout:2/996: symlink d2/d9/d18/d7b/l156 0 2024-09-04T16:30:24.056 INFO:tasks.workunit.client.0.smithi170.stdout:1/535: rename d9/d11/d3e to d9/d11/dae 0 2024-09-04T16:30:24.057 INFO:tasks.workunit.client.0.smithi170.stdout:1/536: chown d9/d11/dae/l75 4377109 1 2024-09-04T16:30:24.057 INFO:tasks.workunit.client.0.smithi170.stdout:5/421: mkdir d4/d8/d1c/d26/d27/d88 0 2024-09-04T16:30:24.057 INFO:tasks.workunit.client.0.smithi170.stdout:4/441: dread d1/f1e [0,4194304] 0 2024-09-04T16:30:24.057 INFO:tasks.workunit.client.1.smithi193.stdout:2/997: dwrite d2/d9/db/d10/d1e/f14c [0,4194304] 0 2024-09-04T16:30:24.065 INFO:tasks.workunit.client.0.smithi170.stdout:4/442: truncate d1/d6/d8/d20/d95/d36/d79/fa3 140090 0 2024-09-04T16:30:24.065 INFO:tasks.workunit.client.0.smithi170.stdout:4/443: chown d1/d6/d2b/d47 165960796 1 2024-09-04T16:30:24.066 INFO:tasks.workunit.client.1.smithi193.stdout:2/998: dwrite d2/d9/db/d10/d38/f70 [0,4194304] 0 2024-09-04T16:30:24.067 INFO:tasks.workunit.client.1.smithi193.stdout:0/997: dwrite d18/d25/d5f/def/dfa/f101 [0,4194304] 0 2024-09-04T16:30:24.067 INFO:tasks.workunit.client.0.smithi170.stdout:1/537: link d9/d11/d2f/f58 d9/d34/faf 0 2024-09-04T16:30:24.071 INFO:tasks.workunit.client.0.smithi170.stdout:1/538: mkdir d9/d11/d2e/db0 0 2024-09-04T16:30:24.073 INFO:tasks.workunit.client.1.smithi193.stdout:2/999: creat d2/d9/db/d10/d4e/f157 x:0 0 0 2024-09-04T16:30:24.073 INFO:tasks.workunit.client.0.smithi170.stdout:4/444: creat d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/fa4 x:0 0 0 2024-09-04T16:30:24.076 INFO:tasks.workunit.client.1.smithi193.stdout:0/998: rename d18/d25/d32/d57/d6c/db1/deb/f100 to d18/d25/d5f/d107/d111/d12a/f152 0 2024-09-04T16:30:24.079 INFO:tasks.workunit.client.0.smithi170.stdout:5/422: write d4/d8/d1c/d29/f2a [4450350,130466] 0 2024-09-04T16:30:24.083 INFO:tasks.workunit.client.0.smithi170.stdout:4/445: mkdir d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/da5 0 2024-09-04T16:30:24.084 INFO:tasks.workunit.client.0.smithi170.stdout:1/539: fsync d9/d11/d2e/fa9 0 2024-09-04T16:30:24.087 INFO:tasks.workunit.client.1.smithi193.stdout:0/999: dread d18/d25/d5f/d6a/d7b/fac [0,4194304] 0 2024-09-04T16:30:24.091 INFO:tasks.workunit.client.0.smithi170.stdout:5/423: write d4/d8/d1c/d26/d27/d43/f87 [5211779,90518] 0 2024-09-04T16:30:24.092 INFO:tasks.workunit.client.0.smithi170.stdout:4/446: write d1/d6/d2b/d47/f59 [4086030,123518] 0 2024-09-04T16:30:24.093 INFO:tasks.workunit.client.0.smithi170.stdout:4/447: fsync d1/d6/d8/d20/d95/f69 0 2024-09-04T16:30:24.094 INFO:tasks.workunit.client.0.smithi170.stdout:4/448: stat d1/d6/l1d 0 2024-09-04T16:30:24.094 INFO:tasks.workunit.client.0.smithi170.stdout:5/424: creat d4/d3a/d74/f89 x:0 0 0 2024-09-04T16:30:24.096 INFO:tasks.workunit.client.0.smithi170.stdout:4/449: write d1/d6/d8/d20/d35/d3e/d4e/d51/f91 [444998,125702] 0 2024-09-04T16:30:24.097 INFO:tasks.workunit.client.0.smithi170.stdout:5/425: getdents d4/db/d51/d5e 0 2024-09-04T16:30:24.102 INFO:tasks.workunit.client.0.smithi170.stdout:4/450: write d1/d6/f75 [698927,3493] 0 2024-09-04T16:30:24.102 INFO:tasks.workunit.client.0.smithi170.stdout:5/426: write d4/d8/d1c/d41/f46 [1175300,116512] 0 2024-09-04T16:30:24.104 INFO:tasks.workunit.client.0.smithi170.stdout:5/427: dread - d4/d8/d1c/d23/d3e/f7e zero size 2024-09-04T16:30:24.108 INFO:tasks.workunit.client.0.smithi170.stdout:4/451: truncate d1/d6/d8/f56 4151769 0 2024-09-04T16:30:24.110 INFO:tasks.workunit.client.0.smithi170.stdout:1/540: dread d9/d26/f5a [0,4194304] 0 2024-09-04T16:30:24.110 INFO:tasks.workunit.client.0.smithi170.stdout:5/428: dwrite d4/f2c [0,4194304] 0 2024-09-04T16:30:24.112 INFO:tasks.workunit.client.0.smithi170.stdout:1/541: fdatasync d9/f47 0 2024-09-04T16:30:24.113 INFO:tasks.workunit.client.0.smithi170.stdout:4/452: mknod d1/d6/d8/d20/d35/d3e/ca6 0 2024-09-04T16:30:24.114 INFO:tasks.workunit.client.0.smithi170.stdout:1/542: rmdir d9/d7b 39 2024-09-04T16:30:24.121 INFO:tasks.workunit.client.0.smithi170.stdout:4/453: dwrite d1/f31 [0,4194304] 0 2024-09-04T16:30:24.123 INFO:tasks.workunit.client.0.smithi170.stdout:1/543: rename d9/d11/d2f/d7f/l92 to d9/d7b/lb1 0 2024-09-04T16:30:24.126 INFO:tasks.workunit.client.0.smithi170.stdout:1/544: dread d9/f47 [0,4194304] 0 2024-09-04T16:30:24.127 INFO:tasks.workunit.client.0.smithi170.stdout:1/545: dread - d9/d26/d77/d83/fa2 zero size 2024-09-04T16:30:24.130 INFO:tasks.workunit.client.0.smithi170.stdout:1/546: creat d9/d11/dae/d6a/d79/d7c/fb2 x:0 0 0 2024-09-04T16:30:24.131 INFO:tasks.workunit.client.0.smithi170.stdout:4/454: getdents d1/d6/d2b/d47 0 2024-09-04T16:30:24.132 INFO:tasks.workunit.client.0.smithi170.stdout:2/445: sync 2024-09-04T16:30:24.132 INFO:tasks.workunit.client.1.smithi193.stdout:4/969: sync 2024-09-04T16:30:24.132 INFO:tasks.workunit.client.0.smithi170.stdout:2/446: dread - d3/db/df/f7b zero size 2024-09-04T16:30:24.136 INFO:tasks.workunit.client.0.smithi170.stdout:1/547: rename d9/d11/dae/d6a/faa to d9/d11/d2f/d6b/d7d/fb3 0 2024-09-04T16:30:24.137 INFO:tasks.workunit.client.0.smithi170.stdout:2/447: mknod d3/db/d62/c8f 0 2024-09-04T16:30:24.137 INFO:tasks.workunit.client.1.smithi193.stdout:4/970: dwrite d3/d39/d44/dd5/f12c [0,4194304] 0 2024-09-04T16:30:24.139 INFO:tasks.workunit.client.1.smithi193.stdout:4/971: chown d3/d1a/d111/d98/de2/ce6 1068817 1 2024-09-04T16:30:24.139 INFO:tasks.workunit.client.0.smithi170.stdout:1/548: creat d9/d26/d77/fb4 x:0 0 0 2024-09-04T16:30:24.143 INFO:tasks.workunit.client.0.smithi170.stdout:1/549: creat d9/d11/dae/d6a/d79/d7c/fb5 x:0 0 0 2024-09-04T16:30:24.145 INFO:tasks.workunit.client.0.smithi170.stdout:2/448: symlink d3/d7/l90 0 2024-09-04T16:30:24.146 INFO:tasks.workunit.client.0.smithi170.stdout:2/449: readlink d3/d3c/d40/d48/l60 0 2024-09-04T16:30:24.147 INFO:tasks.workunit.client.0.smithi170.stdout:1/550: mknod d9/d26/d77/cb6 0 2024-09-04T16:30:24.150 INFO:tasks.workunit.client.0.smithi170.stdout:2/450: creat d3/db/d1c/d47/d83/f91 x:0 0 0 2024-09-04T16:30:24.153 INFO:tasks.workunit.client.0.smithi170.stdout:2/451: symlink d3/d3c/l92 0 2024-09-04T16:30:24.154 INFO:tasks.workunit.client.0.smithi170.stdout:1/551: truncate d9/d11/d2f/f58 367633 0 2024-09-04T16:30:24.157 INFO:tasks.workunit.client.0.smithi170.stdout:2/452: rename d3/db/d4b to d3/db/d62/d6f/d93 0 2024-09-04T16:30:24.159 INFO:tasks.workunit.client.0.smithi170.stdout:4/455: dwrite d1/f1e [0,4194304] 0 2024-09-04T16:30:24.160 INFO:tasks.workunit.client.0.smithi170.stdout:4/456: write d1/d6/d8/d20/d95/f64 [2350867,82580] 0 2024-09-04T16:30:24.161 INFO:tasks.workunit.client.0.smithi170.stdout:1/552: link d9/d11/dae/d6a/d79/d7c/fb2 d9/d11/d2f/d7f/fb7 0 2024-09-04T16:30:24.162 INFO:tasks.workunit.client.0.smithi170.stdout:4/457: fdatasync d1/d6/d8/d20/d35/d3e/d4e/d51/f5c 0 2024-09-04T16:30:24.163 INFO:tasks.workunit.client.0.smithi170.stdout:1/553: stat d9/d11/d2f/d7f/d84 0 2024-09-04T16:30:24.166 INFO:tasks.workunit.client.0.smithi170.stdout:2/453: creat d3/f94 x:0 0 0 2024-09-04T16:30:24.167 INFO:tasks.workunit.client.0.smithi170.stdout:4/458: dread d1/f31 [0,4194304] 0 2024-09-04T16:30:24.167 INFO:tasks.workunit.client.0.smithi170.stdout:4/459: chown d1/f31 2002 1 2024-09-04T16:30:24.171 INFO:tasks.workunit.client.0.smithi170.stdout:1/554: link d9/d11/dae/d6a/d79/f95 d9/d11/d9b/fb8 0 2024-09-04T16:30:24.172 INFO:tasks.workunit.client.0.smithi170.stdout:4/460: mkdir d1/d6/d2b/d47/d78/da7 0 2024-09-04T16:30:24.173 INFO:tasks.workunit.client.0.smithi170.stdout:2/454: truncate d3/db/f2b 3789632 0 2024-09-04T16:30:24.175 INFO:tasks.workunit.client.0.smithi170.stdout:1/555: rename d9/d11/d2f/d7f/d84 to d9/d11/d2f/db9 0 2024-09-04T16:30:24.177 INFO:tasks.workunit.client.0.smithi170.stdout:2/455: mknod d3/db/d62/d6f/c95 0 2024-09-04T16:30:24.178 INFO:tasks.workunit.client.0.smithi170.stdout:4/461: creat d1/d6/d2b/d47/d78/da7/fa8 x:0 0 0 2024-09-04T16:30:24.179 INFO:tasks.workunit.client.0.smithi170.stdout:1/556: dread - d9/d11/dae/d6a/f81 zero size 2024-09-04T16:30:24.181 INFO:tasks.workunit.client.0.smithi170.stdout:1/557: write d9/d11/d2f/f64 [26655,91940] 0 2024-09-04T16:30:24.182 INFO:tasks.workunit.client.0.smithi170.stdout:4/462: symlink d1/d6/d2b/d47/d78/la9 0 2024-09-04T16:30:24.185 INFO:tasks.workunit.client.0.smithi170.stdout:2/456: dwrite d3/db/d1c/d47/d83/f91 [0,4194304] 0 2024-09-04T16:30:24.185 INFO:tasks.workunit.client.0.smithi170.stdout:1/558: symlink d9/d11/d2e/lba 0 2024-09-04T16:30:24.187 INFO:tasks.workunit.client.0.smithi170.stdout:4/463: mkdir d1/d6/d8/d20/d35/d3e/d60/daa 0 2024-09-04T16:30:24.188 INFO:tasks.workunit.client.0.smithi170.stdout:4/464: fsync d1/f1e 0 2024-09-04T16:30:24.189 INFO:tasks.workunit.client.0.smithi170.stdout:4/465: fdatasync d1/d6/d8/d20/d35/d3e/f46 0 2024-09-04T16:30:24.192 INFO:tasks.workunit.client.0.smithi170.stdout:2/457: write d3/d3c/f82 [244526,109803] 0 2024-09-04T16:30:24.194 INFO:tasks.workunit.client.0.smithi170.stdout:1/559: write d9/d11/dae/d6a/d79/f95 [698666,111513] 0 2024-09-04T16:30:24.195 INFO:tasks.workunit.client.0.smithi170.stdout:1/560: fsync d9/d26/f56 0 2024-09-04T16:30:24.196 INFO:tasks.workunit.client.0.smithi170.stdout:1/561: fdatasync d9/d11/f1a 0 2024-09-04T16:30:24.199 INFO:tasks.workunit.client.0.smithi170.stdout:4/466: fsync d1/d6/d8/d20/d35/d3e/d60/f61 0 2024-09-04T16:30:24.201 INFO:tasks.workunit.client.0.smithi170.stdout:4/467: read d1/d6/d8/d20/d35/d3e/d43/f5f [648555,79441] 0 2024-09-04T16:30:24.202 INFO:tasks.workunit.client.0.smithi170.stdout:2/458: rename d3/d3c/d40/f53 to d3/db/d62/d6f/f96 0 2024-09-04T16:30:24.203 INFO:tasks.workunit.client.0.smithi170.stdout:2/459: write d3/d3c/f7a [101907,41719] 0 2024-09-04T16:30:24.204 INFO:tasks.workunit.client.0.smithi170.stdout:2/460: dread d3/d3c/f5c [0,4194304] 0 2024-09-04T16:30:24.207 INFO:tasks.workunit.client.0.smithi170.stdout:1/562: chown d9/d26/f93 1274 1 2024-09-04T16:30:24.210 INFO:tasks.workunit.client.0.smithi170.stdout:4/468: creat d1/d6/d8/d20/d95/d36/d79/fab x:0 0 0 2024-09-04T16:30:24.211 INFO:tasks.workunit.client.0.smithi170.stdout:2/461: fdatasync d3/f65 0 2024-09-04T16:30:24.217 INFO:tasks.workunit.client.0.smithi170.stdout:2/462: mkdir d3/db/d1c/d47/d67/d97 0 2024-09-04T16:30:24.219 INFO:tasks.workunit.client.0.smithi170.stdout:2/463: write d3/db/d62/f87 [291256,118766] 0 2024-09-04T16:30:24.223 INFO:tasks.workunit.client.0.smithi170.stdout:2/464: creat d3/db/d1c/d47/d83/f98 x:0 0 0 2024-09-04T16:30:24.226 INFO:tasks.workunit.client.0.smithi170.stdout:4/469: rename d1/d6/d2b/d47/f6f to d1/d6/d8/d20/d95/fac 0 2024-09-04T16:30:24.227 INFO:tasks.workunit.client.0.smithi170.stdout:2/465: creat d3/db/d1c/d47/d67/f99 x:0 0 0 2024-09-04T16:30:24.229 INFO:tasks.workunit.client.1.smithi193.stdout:4/972: rename d3/d1a/d54/f5b to d3/d1a/f142 0 2024-09-04T16:30:24.231 INFO:tasks.workunit.client.0.smithi170.stdout:4/470: rename d1/d6/d8/d20/d35/d3e/d43/f9b to d1/d6/d22/fad 0 2024-09-04T16:30:24.233 INFO:tasks.workunit.client.1.smithi193.stdout:4/973: rename d3/d1a/d21/d52/fea to d3/d1a/d2a/db9/f143 0 2024-09-04T16:30:24.236 INFO:tasks.workunit.client.0.smithi170.stdout:4/471: mkdir d1/d6/d8/d20/dae 0 2024-09-04T16:30:24.239 INFO:tasks.workunit.client.0.smithi170.stdout:4/472: getdents d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/da5 0 2024-09-04T16:30:24.239 INFO:tasks.workunit.client.1.smithi193.stdout:4/974: dread d3/f18 [4194304,4194304] 0 2024-09-04T16:30:24.240 INFO:tasks.workunit.client.1.smithi193.stdout:4/975: stat d3/d81/df5/f128 0 2024-09-04T16:30:24.241 INFO:tasks.workunit.client.0.smithi170.stdout:4/473: creat d1/d6/d8/d20/d35/d54/d96/faf x:0 0 0 2024-09-04T16:30:24.242 INFO:tasks.workunit.client.1.smithi193.stdout:4/976: rename d3/d1a/d2a/c60 to d3/d81/df5/d12e/c144 0 2024-09-04T16:30:24.246 INFO:tasks.workunit.client.0.smithi170.stdout:4/474: dwrite d1/f7c [0,4194304] 0 2024-09-04T16:30:24.248 INFO:tasks.workunit.client.1.smithi193.stdout:4/977: link d3/d1a/d111/d89/fbe d3/d1a/d111/d47/d13b/f145 0 2024-09-04T16:30:24.248 INFO:tasks.workunit.client.0.smithi170.stdout:4/475: chown d1/d6/d8/d20/d95/f4d 129074181 1 2024-09-04T16:30:24.250 INFO:tasks.workunit.client.1.smithi193.stdout:4/978: chown d3/d1a/d111/d89/d113/f121 0 1 2024-09-04T16:30:24.253 INFO:tasks.workunit.client.0.smithi170.stdout:4/476: rename d1/c84 to d1/d6/d8/d6c/cb0 0 2024-09-04T16:30:24.255 INFO:tasks.workunit.client.1.smithi193.stdout:4/979: creat d3/d1a/d111/d89/d115/dd2/f146 x:0 0 0 2024-09-04T16:30:24.257 INFO:tasks.workunit.client.1.smithi193.stdout:4/980: creat d3/d1a/d111/d98/de2/f147 x:0 0 0 2024-09-04T16:30:24.261 INFO:tasks.workunit.client.1.smithi193.stdout:4/981: link d3/d1a/d111/f76 d3/d1a/d111/d89/dbd/ddc/f148 0 2024-09-04T16:30:24.267 INFO:tasks.workunit.client.0.smithi170.stdout:2/466: dread d3/db/d62/d6f/f96 [0,4194304] 0 2024-09-04T16:30:24.270 INFO:tasks.workunit.client.0.smithi170.stdout:1/563: dwrite d9/f22 [0,4194304] 0 2024-09-04T16:30:24.271 INFO:tasks.workunit.client.0.smithi170.stdout:2/467: creat d3/d3c/d40/d48/d68/f9a x:0 0 0 2024-09-04T16:30:24.272 INFO:tasks.workunit.client.0.smithi170.stdout:2/468: chown d3/f94 19617 1 2024-09-04T16:30:24.272 INFO:tasks.workunit.client.0.smithi170.stdout:4/477: dread d1/d6/d2b/d47/d78/f7f [0,4194304] 0 2024-09-04T16:30:24.278 INFO:tasks.workunit.client.0.smithi170.stdout:4/478: dread d1/f31 [0,4194304] 0 2024-09-04T16:30:24.280 INFO:tasks.workunit.client.0.smithi170.stdout:2/469: rename d3/d7/f26 to d3/db/df/d45/f9b 0 2024-09-04T16:30:24.282 INFO:tasks.workunit.client.0.smithi170.stdout:4/479: unlink d1/d6/d8/d20/d35/d3e/d4e/c98 0 2024-09-04T16:30:24.284 INFO:tasks.workunit.client.0.smithi170.stdout:4/480: rename d1/l41 to d1/d6/d8/d20/lb1 0 2024-09-04T16:30:24.285 INFO:tasks.workunit.client.1.smithi193.stdout:4/982: write d3/d1a/d2a/db9/ff6 [120912,22567] 0 2024-09-04T16:30:24.286 INFO:tasks.workunit.client.0.smithi170.stdout:4/481: creat d1/d6/d8/d20/d95/d36/d79/fb2 x:0 0 0 2024-09-04T16:30:24.287 INFO:tasks.workunit.client.0.smithi170.stdout:4/482: chown d1/d6/d8/d20/d95/d36/f28 37 1 2024-09-04T16:30:24.291 INFO:tasks.workunit.client.1.smithi193.stdout:4/983: link d3/d1a/d111/d47/d13b/f145 d3/d1a/d111/d98/de2/dec/f149 0 2024-09-04T16:30:24.291 INFO:tasks.workunit.client.1.smithi193.stdout:4/984: stat d3/d1a/d2a/db9/f143 0 2024-09-04T16:30:24.291 INFO:tasks.workunit.client.1.smithi193.stdout:4/985: stat d3/f6 0 2024-09-04T16:30:24.292 INFO:tasks.workunit.client.1.smithi193.stdout:4/986: fdatasync d3/d1a/d2a/d83/f93 0 2024-09-04T16:30:24.295 INFO:tasks.workunit.client.1.smithi193.stdout:4/987: mkdir d3/d39/d44/dd5/daa/d14a 0 2024-09-04T16:30:24.298 INFO:tasks.workunit.client.0.smithi170.stdout:1/564: dwrite d9/f55 [0,4194304] 0 2024-09-04T16:30:24.298 INFO:tasks.workunit.client.1.smithi193.stdout:4/988: unlink d3/d39/d44/dd5/fa2 0 2024-09-04T16:30:24.303 INFO:tasks.workunit.client.0.smithi170.stdout:1/565: creat d9/d26/d77/fbb x:0 0 0 2024-09-04T16:30:24.307 INFO:tasks.workunit.client.0.smithi170.stdout:1/566: read d9/d11/d2f/f64 [61169,46734] 0 2024-09-04T16:30:24.308 INFO:tasks.workunit.client.0.smithi170.stdout:4/483: dwrite d1/d6/d8/d20/d35/f6b [0,4194304] 0 2024-09-04T16:30:24.309 INFO:tasks.workunit.client.1.smithi193.stdout:4/989: getdents d3/d39/d44/dd5 0 2024-09-04T16:30:24.310 INFO:tasks.workunit.client.0.smithi170.stdout:2/470: dwrite d3/db/f2b [0,4194304] 0 2024-09-04T16:30:24.311 INFO:tasks.workunit.client.0.smithi170.stdout:2/471: readlink d3/d7/l31 0 2024-09-04T16:30:24.312 INFO:tasks.workunit.client.0.smithi170.stdout:2/472: read f0 [3673110,83926] 0 2024-09-04T16:30:24.313 INFO:tasks.workunit.client.0.smithi170.stdout:1/567: unlink l8 0 2024-09-04T16:30:24.314 INFO:tasks.workunit.client.1.smithi193.stdout:4/990: symlink d3/d1a/d111/dae/l14b 0 2024-09-04T16:30:24.314 INFO:tasks.workunit.client.0.smithi170.stdout:2/473: write d3/db/f3b [2189035,115833] 0 2024-09-04T16:30:24.315 INFO:tasks.workunit.client.1.smithi193.stdout:4/991: truncate d3/d1a/d111/d98/f133 666767 0 2024-09-04T16:30:24.315 INFO:tasks.workunit.client.0.smithi170.stdout:4/484: mkdir d1/d6/d2b/db3 0 2024-09-04T16:30:24.316 INFO:tasks.workunit.client.0.smithi170.stdout:2/474: fsync f0 0 2024-09-04T16:30:24.316 INFO:tasks.workunit.client.1.smithi193.stdout:4/992: chown d3/d1a/d111/dae/dcd 28 1 2024-09-04T16:30:24.317 INFO:tasks.workunit.client.0.smithi170.stdout:1/568: rename d9/f22 to d9/d34/fbc 0 2024-09-04T16:30:24.318 INFO:tasks.workunit.client.0.smithi170.stdout:4/485: stat d1/d6/d8/d6c/ca2 0 2024-09-04T16:30:24.323 INFO:tasks.workunit.client.0.smithi170.stdout:2/475: mkdir d3/d4/d79/d9c 0 2024-09-04T16:30:24.326 INFO:tasks.workunit.client.0.smithi170.stdout:1/569: dwrite d9/d11/d2f/d6b/f70 [4194304,4194304] 0 2024-09-04T16:30:24.327 INFO:tasks.workunit.client.0.smithi170.stdout:4/486: link d1/d6/d2b/d47/c6e d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/cb4 0 2024-09-04T16:30:24.333 INFO:tasks.workunit.client.0.smithi170.stdout:1/570: creat d9/fbd x:0 0 0 2024-09-04T16:30:24.334 INFO:tasks.workunit.client.0.smithi170.stdout:4/487: mknod d1/d6/d8/d20/d95/d36/d79/cb5 0 2024-09-04T16:30:24.335 INFO:tasks.workunit.client.0.smithi170.stdout:2/476: dwrite d3/db/df/d45/f9b [0,4194304] 0 2024-09-04T16:30:24.335 INFO:tasks.workunit.client.0.smithi170.stdout:1/571: mkdir d9/d34/dbe 0 2024-09-04T16:30:24.337 INFO:tasks.workunit.client.0.smithi170.stdout:1/572: chown d9/d26/d77/fb4 252085482 1 2024-09-04T16:30:24.339 INFO:tasks.workunit.client.0.smithi170.stdout:1/573: truncate d9/fbd 450486 0 2024-09-04T16:30:24.341 INFO:tasks.workunit.client.0.smithi170.stdout:1/574: mknod d9/d34/cbf 0 2024-09-04T16:30:24.344 INFO:tasks.workunit.client.0.smithi170.stdout:1/575: truncate d9/d34/d5f/f67 884674 0 2024-09-04T16:30:24.345 INFO:tasks.workunit.client.0.smithi170.stdout:1/576: readlink d9/d11/dae/l41 0 2024-09-04T16:30:24.346 INFO:tasks.workunit.client.0.smithi170.stdout:1/577: chown d9/d26/l73 4012 1 2024-09-04T16:30:24.348 INFO:tasks.workunit.client.0.smithi170.stdout:1/578: mknod d9/d11/cc0 0 2024-09-04T16:30:24.348 INFO:tasks.workunit.client.1.smithi193.stdout:4/993: dwrite d3/d1a/d21/f34 [4194304,4194304] 0 2024-09-04T16:30:24.349 INFO:tasks.workunit.client.0.smithi170.stdout:1/579: chown d9/f2b 0 1 2024-09-04T16:30:24.349 INFO:tasks.workunit.client.0.smithi170.stdout:4/488: write d1/d6/f12 [3259573,83626] 0 2024-09-04T16:30:24.350 INFO:tasks.workunit.client.0.smithi170.stdout:2/477: dread d3/d3c/d40/d48/f54 [0,4194304] 0 2024-09-04T16:30:24.351 INFO:tasks.workunit.client.1.smithi193.stdout:4/994: rmdir d3/d1a/d21/d52/d7f/db6/df9 39 2024-09-04T16:30:24.352 INFO:tasks.workunit.client.0.smithi170.stdout:4/489: read d1/d6/d8/d20/d95/f64 [3751250,13511] 0 2024-09-04T16:30:24.352 INFO:tasks.workunit.client.0.smithi170.stdout:2/478: write d3/d7/f3e [862407,12008] 0 2024-09-04T16:30:24.353 INFO:tasks.workunit.client.0.smithi170.stdout:2/479: readlink d3/d3c/l73 0 2024-09-04T16:30:24.354 INFO:tasks.workunit.client.0.smithi170.stdout:1/580: rename d9/d26/d77/f8d to d9/d7b/d8f/fc1 0 2024-09-04T16:30:24.355 INFO:tasks.workunit.client.1.smithi193.stdout:4/995: mknod d3/d1a/d111/d89/d115/c14c 0 2024-09-04T16:30:24.355 INFO:tasks.workunit.client.0.smithi170.stdout:4/490: write d1/d6/d8/d20/d95/d36/f3c [1085702,63736] 0 2024-09-04T16:30:24.359 INFO:tasks.workunit.client.0.smithi170.stdout:1/581: truncate d9/f2b 1420280 0 2024-09-04T16:30:24.361 INFO:tasks.workunit.client.1.smithi193.stdout:4/996: dread d3/d1a/d111/fbb [0,4194304] 0 2024-09-04T16:30:24.361 INFO:tasks.workunit.client.0.smithi170.stdout:4/491: mknod d1/d6/d8/cb6 0 2024-09-04T16:30:24.364 INFO:tasks.workunit.client.1.smithi193.stdout:4/997: mkdir d3/d1a/d111/d89/dbd/d116/d14d 0 2024-09-04T16:30:24.365 INFO:tasks.workunit.client.0.smithi170.stdout:6/368: sync 2024-09-04T16:30:24.366 INFO:tasks.workunit.client.0.smithi170.stdout:6/369: chown d0/f11 1 1 2024-09-04T16:30:24.367 INFO:tasks.workunit.client.1.smithi193.stdout:4/998: rename d3/d1a/d111/d47/c5d to d3/d1a/d2a/d83/c14e 0 2024-09-04T16:30:24.369 INFO:tasks.workunit.client.0.smithi170.stdout:6/370: symlink d0/d17/d31/d64/l71 0 2024-09-04T16:30:24.370 INFO:tasks.workunit.client.1.smithi193.stdout:4/999: truncate d3/d1a/d21/f4c 5118890 0 2024-09-04T16:30:24.371 INFO:tasks.workunit.client.0.smithi170.stdout:1/582: write d9/f54 [1036365,120946] 0 2024-09-04T16:30:24.374 INFO:tasks.workunit.client.0.smithi170.stdout:6/371: rename d0/f6f to d0/d17/d39/f72 0 2024-09-04T16:30:24.374 INFO:tasks.workunit.client.0.smithi170.stdout:4/492: link d1/d6/d8/d20/d95/f57 d1/d6/d8/d20/d35/d3e/d60/daa/fb7 0 2024-09-04T16:30:24.375 INFO:tasks.workunit.client.1.smithi193.stderr:+ rm -rf -- ./tmp.OXhN2ZnmDj 2024-09-04T16:30:24.376 INFO:tasks.workunit.client.0.smithi170.stdout:6/372: chown d0/df/d1b/d3e/d47/d68/f41 7 1 2024-09-04T16:30:24.376 INFO:tasks.workunit.client.0.smithi170.stdout:1/583: dread d9/d11/dae/d6a/d79/f95 [0,4194304] 0 2024-09-04T16:30:24.377 INFO:tasks.workunit.client.0.smithi170.stdout:4/493: truncate d1/d6/d2b/d47/d78/da7/fa8 1037898 0 2024-09-04T16:30:24.378 INFO:tasks.workunit.client.0.smithi170.stdout:1/584: readlink d9/d34/l44 0 2024-09-04T16:30:24.378 INFO:tasks.workunit.client.0.smithi170.stdout:2/480: dread d3/d7/f1d [4194304,4194304] 0 2024-09-04T16:30:24.379 INFO:tasks.workunit.client.0.smithi170.stdout:6/373: mkdir d0/df/d1b/d3e/d47/d68/d2d/d67/d73 0 2024-09-04T16:30:24.380 INFO:tasks.workunit.client.0.smithi170.stdout:1/585: mkdir d9/d11/d2f/dc2 0 2024-09-04T16:30:24.381 INFO:tasks.workunit.client.0.smithi170.stdout:2/481: creat d3/db/d62/d6f/f9d x:0 0 0 2024-09-04T16:30:24.384 INFO:tasks.workunit.client.0.smithi170.stdout:1/586: truncate d9/d26/f56 4436161 0 2024-09-04T16:30:24.385 INFO:tasks.workunit.client.0.smithi170.stdout:2/482: creat d3/d3c/d40/d48/f9e x:0 0 0 2024-09-04T16:30:24.386 INFO:tasks.workunit.client.0.smithi170.stdout:6/374: dwrite d0/df/d1b/d3e/d47/d68/f5d [0,4194304] 0 2024-09-04T16:30:24.393 INFO:tasks.workunit.client.0.smithi170.stdout:2/483: dwrite d3/d3c/d40/d48/f5b [0,4194304] 0 2024-09-04T16:30:24.397 INFO:tasks.workunit.client.0.smithi170.stdout:2/484: mkdir d3/db/d1c/d47/d83/d9f 0 2024-09-04T16:30:24.401 INFO:tasks.workunit.client.0.smithi170.stdout:2/485: rename d3/db/d1c/d47/l78 to d3/db/df/la0 0 2024-09-04T16:30:24.407 INFO:tasks.workunit.client.0.smithi170.stdout:6/375: dwrite d0/f5 [8388608,4194304] 0 2024-09-04T16:30:24.410 INFO:tasks.workunit.client.0.smithi170.stdout:6/376: truncate d0/df/d1b/d3e/d47/d68/d2d/d2e/f43 119503 0 2024-09-04T16:30:24.417 INFO:tasks.workunit.client.0.smithi170.stdout:2/486: write d3/d3c/f30 [1854134,7150] 0 2024-09-04T16:30:24.421 INFO:tasks.workunit.client.0.smithi170.stdout:2/487: creat d3/d4/d79/fa1 x:0 0 0 2024-09-04T16:30:24.421 INFO:tasks.workunit.client.0.smithi170.stdout:2/488: chown d3/db/df/d45/f7d 4163 1 2024-09-04T16:30:24.424 INFO:tasks.workunit.client.0.smithi170.stdout:2/489: creat d3/db/d1c/d47/d83/d9f/fa2 x:0 0 0 2024-09-04T16:30:24.427 INFO:tasks.workunit.client.0.smithi170.stdout:1/587: dread d9/f27 [4194304,4194304] 0 2024-09-04T16:30:24.442 INFO:tasks.workunit.client.0.smithi170.stdout:2/490: dread d3/db/d1c/f2a [0,4194304] 0 2024-09-04T16:30:24.443 INFO:tasks.workunit.client.0.smithi170.stdout:2/491: chown d3/d4/l51 678694589 1 2024-09-04T16:30:24.445 INFO:tasks.workunit.client.0.smithi170.stdout:1/588: dread d9/d11/d2f/d6b/f70 [0,4194304] 0 2024-09-04T16:30:24.451 INFO:tasks.workunit.client.0.smithi170.stdout:2/492: dwrite d3/d3c/d40/d48/f8c [0,4194304] 0 2024-09-04T16:30:24.454 INFO:tasks.workunit.client.0.smithi170.stdout:1/589: dwrite d9/f55 [0,4194304] 0 2024-09-04T16:30:24.456 INFO:tasks.workunit.client.0.smithi170.stdout:1/590: fdatasync d9/d26/d77/fbb 0 2024-09-04T16:30:24.457 INFO:tasks.workunit.client.0.smithi170.stdout:2/493: mknod d3/d4/d14/ca3 0 2024-09-04T16:30:24.462 INFO:tasks.workunit.client.0.smithi170.stdout:2/494: symlink d3/d4/d14/la4 0 2024-09-04T16:30:24.464 INFO:tasks.workunit.client.0.smithi170.stdout:1/591: symlink d9/d11/d2f/d6b/d7d/lc3 0 2024-09-04T16:30:24.464 INFO:tasks.workunit.client.0.smithi170.stdout:2/495: read d3/d3c/d40/f41 [511981,7710] 0 2024-09-04T16:30:24.466 INFO:tasks.workunit.client.0.smithi170.stdout:2/496: chown d3/d7/c7e 4141 1 2024-09-04T16:30:24.466 INFO:tasks.workunit.client.0.smithi170.stdout:1/592: write d9/f54 [1955920,4044] 0 2024-09-04T16:30:24.469 INFO:tasks.workunit.client.0.smithi170.stdout:2/497: mknod d3/db/df/ca5 0 2024-09-04T16:30:24.470 INFO:tasks.workunit.client.0.smithi170.stdout:2/498: fsync d3/d3c/d40/d48/f5b 0 2024-09-04T16:30:24.471 INFO:tasks.workunit.client.0.smithi170.stdout:2/499: stat d3/d3c/d40/l56 0 2024-09-04T16:30:24.475 INFO:tasks.workunit.client.0.smithi170.stdout:1/593: dread d9/d11/dae/f87 [0,4194304] 0 2024-09-04T16:30:24.477 INFO:tasks.workunit.client.0.smithi170.stdout:1/594: chown d9/d11/dae/d6a/d79/f8c 22 1 2024-09-04T16:30:24.479 INFO:tasks.workunit.client.0.smithi170.stdout:2/500: dwrite d3/db/df/f7b [0,4194304] 0 2024-09-04T16:30:24.480 INFO:tasks.workunit.client.0.smithi170.stdout:1/595: write d9/d11/dae/d6a/fa7 [1477601,120651] 0 2024-09-04T16:30:24.484 INFO:tasks.workunit.client.0.smithi170.stdout:1/596: rmdir d9/d11/dae/d6a/d79 39 2024-09-04T16:30:24.488 INFO:tasks.workunit.client.0.smithi170.stdout:2/501: getdents d3/db/df 0 2024-09-04T16:30:24.490 INFO:tasks.workunit.client.0.smithi170.stdout:2/502: symlink d3/d3c/la6 0 2024-09-04T16:30:24.495 INFO:tasks.workunit.client.0.smithi170.stdout:1/597: dwrite d9/d34/d5f/f67 [0,4194304] 0 2024-09-04T16:30:24.497 INFO:tasks.workunit.client.0.smithi170.stdout:1/598: getdents d9/d11/d85 0 2024-09-04T16:30:24.500 INFO:tasks.workunit.client.0.smithi170.stdout:1/599: mknod d9/d11/d2e/cc4 0 2024-09-04T16:30:24.502 INFO:tasks.workunit.client.0.smithi170.stdout:1/600: rmdir d9/d26/d77 39 2024-09-04T16:30:24.502 INFO:tasks.workunit.client.0.smithi170.stdout:2/503: truncate d3/d3c/f82 251559 0 2024-09-04T16:30:24.504 INFO:tasks.workunit.client.0.smithi170.stdout:2/504: truncate d3/d4/d14/f5d 1239124 0 2024-09-04T16:30:24.505 INFO:tasks.workunit.client.0.smithi170.stdout:2/505: dread - d3/db/d62/d6f/f9d zero size 2024-09-04T16:30:24.506 INFO:tasks.workunit.client.0.smithi170.stdout:1/601: mkdir d9/d11/d85/dc5 0 2024-09-04T16:30:24.509 INFO:tasks.workunit.client.0.smithi170.stdout:1/602: mkdir d9/d11/d2f/d6b/d7d/dc6 0 2024-09-04T16:30:24.511 INFO:tasks.workunit.client.0.smithi170.stdout:1/603: write d9/d11/d2f/d6b/d61/f6f [4695035,42710] 0 2024-09-04T16:30:24.512 INFO:tasks.workunit.client.0.smithi170.stdout:2/506: dwrite d3/d3c/d40/d48/f8e [0,4194304] 0 2024-09-04T16:30:24.518 INFO:tasks.workunit.client.0.smithi170.stdout:1/604: creat d9/d34/d5f/fc7 x:0 0 0 2024-09-04T16:30:24.519 INFO:tasks.workunit.client.0.smithi170.stdout:2/507: creat d3/d3c/d40/d48/fa7 x:0 0 0 2024-09-04T16:30:24.522 INFO:tasks.workunit.client.0.smithi170.stdout:2/508: unlink d3/d7/c7e 0 2024-09-04T16:30:24.524 INFO:tasks.workunit.client.0.smithi170.stdout:1/605: creat d9/d26/fc8 x:0 0 0 2024-09-04T16:30:24.526 INFO:tasks.workunit.client.0.smithi170.stdout:2/509: mknod d3/db/d1c/d47/d67/d97/ca8 0 2024-09-04T16:30:24.527 INFO:tasks.workunit.client.0.smithi170.stdout:2/510: chown d3/d3c/d40/l43 236496542 1 2024-09-04T16:30:24.527 INFO:tasks.workunit.client.0.smithi170.stdout:2/511: chown d3/d3c/d40/d48/f5b 83 1 2024-09-04T16:30:24.528 INFO:tasks.workunit.client.0.smithi170.stdout:1/606: creat d9/d34/dbe/fc9 x:0 0 0 2024-09-04T16:30:24.528 INFO:tasks.workunit.client.0.smithi170.stdout:2/512: read - d3/f94 zero size 2024-09-04T16:30:24.529 INFO:tasks.workunit.client.0.smithi170.stdout:2/513: chown d3/d3c/l6e 114563195 1 2024-09-04T16:30:24.529 INFO:tasks.workunit.client.0.smithi170.stdout:2/514: truncate d3/d7/f4d 1506476 0 2024-09-04T16:30:24.534 INFO:tasks.workunit.client.0.smithi170.stdout:2/515: dwrite d3/d4/d14/f7c [0,4194304] 0 2024-09-04T16:30:24.612 INFO:tasks.workunit.client.0.smithi170.stdout:1/607: unlink d9/d26/fc8 0 2024-09-04T16:30:24.614 INFO:tasks.workunit.client.0.smithi170.stdout:2/516: unlink d3/d4/l51 0 2024-09-04T16:30:24.615 INFO:tasks.workunit.client.0.smithi170.stdout:1/608: mkdir d9/d11/d85/dc5/dca 0 2024-09-04T16:30:24.615 INFO:tasks.workunit.client.0.smithi170.stdout:7/685: sync 2024-09-04T16:30:24.615 INFO:tasks.workunit.client.0.smithi170.stdout:8/492: sync 2024-09-04T16:30:24.616 INFO:tasks.workunit.client.0.smithi170.stdout:0/522: sync 2024-09-04T16:30:24.617 INFO:tasks.workunit.client.0.smithi170.stdout:1/609: chown d9/d11/d2f/d6b/d7d/f9f 607786 1 2024-09-04T16:30:24.618 INFO:tasks.workunit.client.0.smithi170.stdout:2/517: rename d3/d4/d14/f5d to d3/db/df/d45/fa9 0 2024-09-04T16:30:24.619 INFO:tasks.workunit.client.0.smithi170.stdout:2/518: chown d3/db/d1c/f23 110 1 2024-09-04T16:30:24.621 INFO:tasks.workunit.client.0.smithi170.stdout:8/493: creat d6/d28/d1a/fa7 x:0 0 0 2024-09-04T16:30:24.623 INFO:tasks.workunit.client.0.smithi170.stdout:7/686: dwrite d12/d16/db7/fd6 [0,4194304] 0 2024-09-04T16:30:24.629 INFO:tasks.workunit.client.0.smithi170.stdout:8/494: dwrite d6/d28/d20/f8a [0,4194304] 0 2024-09-04T16:30:24.633 INFO:tasks.workunit.client.0.smithi170.stdout:7/687: chown d12/d15/d71/fa2 846041 1 2024-09-04T16:30:24.633 INFO:tasks.workunit.client.0.smithi170.stdout:1/610: mknod d9/d11/dae/d6a/ccb 0 2024-09-04T16:30:24.636 INFO:tasks.workunit.client.0.smithi170.stdout:0/523: creat d11/d13/d2f/fc7 x:0 0 0 2024-09-04T16:30:24.639 INFO:tasks.workunit.client.0.smithi170.stdout:7/688: read - d12/d15/d41/fcc zero size 2024-09-04T16:30:24.640 INFO:tasks.workunit.client.0.smithi170.stdout:7/689: dread - d12/d5a/fdf zero size 2024-09-04T16:30:24.641 INFO:tasks.workunit.client.0.smithi170.stdout:1/611: dread - d9/d11/dae/d6a/d79/d7c/fb5 zero size 2024-09-04T16:30:24.642 INFO:tasks.workunit.client.0.smithi170.stdout:0/524: symlink d11/d13/d35/lc8 0 2024-09-04T16:30:24.643 INFO:tasks.workunit.client.0.smithi170.stdout:8/495: mknod d6/d28/d16/d24/ca8 0 2024-09-04T16:30:24.644 INFO:tasks.workunit.client.0.smithi170.stdout:2/519: getdents d3/db/d1c 0 2024-09-04T16:30:24.645 INFO:tasks.workunit.client.0.smithi170.stdout:7/690: mkdir d12/d16/db7/deb 0 2024-09-04T16:30:24.646 INFO:tasks.workunit.client.0.smithi170.stdout:0/525: mkdir d11/d13/d4a/dc9 0 2024-09-04T16:30:24.648 INFO:tasks.workunit.client.0.smithi170.stdout:1/612: rename d9/d26/c42 to d9/d11/d2f/db9/ccc 0 2024-09-04T16:30:24.648 INFO:tasks.workunit.client.0.smithi170.stdout:2/520: truncate d3/f46 1242254 0 2024-09-04T16:30:24.649 INFO:tasks.workunit.client.0.smithi170.stdout:1/613: readlink d9/d11/dae/d6a/d79/d7c/l94 0 2024-09-04T16:30:24.654 INFO:tasks.workunit.client.0.smithi170.stdout:2/521: rename d3/d3c/d40/d48/l60 to d3/db/d1c/d77/laa 0 2024-09-04T16:30:24.659 INFO:tasks.workunit.client.0.smithi170.stdout:1/614: dwrite d9/d11/dae/f82 [0,4194304] 0 2024-09-04T16:30:24.665 INFO:tasks.workunit.client.0.smithi170.stdout:7/691: dread d12/d16/d1d/f80 [0,4194304] 0 2024-09-04T16:30:24.665 INFO:tasks.workunit.client.0.smithi170.stdout:2/522: rename d3/db/d62/d6f/d93/f59 to d3/d4/d86/fab 0 2024-09-04T16:30:24.666 INFO:tasks.workunit.client.0.smithi170.stdout:8/496: link d6/d28/d16/d24/d46/c7f d6/d28/d16/d24/ca9 0 2024-09-04T16:30:24.668 INFO:tasks.workunit.client.0.smithi170.stdout:1/615: symlink d9/d11/d85/lcd 0 2024-09-04T16:30:24.672 INFO:tasks.workunit.client.0.smithi170.stdout:2/523: dwrite d3/db/d1c/f42 [0,4194304] 0 2024-09-04T16:30:24.676 INFO:tasks.workunit.client.0.smithi170.stdout:7/692: dread d12/d15/d68/f78 [0,4194304] 0 2024-09-04T16:30:24.680 INFO:tasks.workunit.client.0.smithi170.stdout:0/526: dwrite d11/d13/d2f/d3f/f63 [0,4194304] 0 2024-09-04T16:30:24.681 INFO:tasks.workunit.client.0.smithi170.stdout:0/527: fsync d11/d13/d71/f96 0 2024-09-04T16:30:24.683 INFO:tasks.workunit.client.0.smithi170.stdout:2/524: creat d3/db/df/d45/fac x:0 0 0 2024-09-04T16:30:24.685 INFO:tasks.workunit.client.0.smithi170.stdout:7/693: creat d12/d16/d8d/fec x:0 0 0 2024-09-04T16:30:24.689 INFO:tasks.workunit.client.0.smithi170.stdout:8/497: dwrite d6/d28/d20/d5e/f35 [0,4194304] 0 2024-09-04T16:30:24.692 INFO:tasks.workunit.client.0.smithi170.stdout:7/694: symlink d12/d15/d71/d42/d81/d5c/led 0 2024-09-04T16:30:24.693 INFO:tasks.workunit.client.0.smithi170.stdout:0/528: creat d11/d13/d4a/dc5/fca x:0 0 0 2024-09-04T16:30:24.693 INFO:tasks.workunit.client.0.smithi170.stdout:1/616: write d9/d26/f5a [3643264,56529] 0 2024-09-04T16:30:24.695 INFO:tasks.workunit.client.0.smithi170.stdout:7/695: symlink d12/d15/d68/lee 0 2024-09-04T16:30:24.699 INFO:tasks.workunit.client.0.smithi170.stdout:3/399: sync 2024-09-04T16:30:24.699 INFO:tasks.workunit.client.0.smithi170.stdout:9/507: sync 2024-09-04T16:30:24.700 INFO:tasks.workunit.client.0.smithi170.stdout:8/498: link d6/d28/d16/d24/d46/c8d d6/d28/d20/d6e/d76/caa 0 2024-09-04T16:30:24.704 INFO:tasks.workunit.client.0.smithi170.stdout:1/617: dwrite d9/d26/f36 [0,4194304] 0 2024-09-04T16:30:24.705 INFO:tasks.workunit.client.0.smithi170.stdout:7/696: dread d12/d16/fb8 [0,4194304] 0 2024-09-04T16:30:24.707 INFO:tasks.workunit.client.0.smithi170.stdout:8/499: creat d6/d28/d16/d77/d93/fab x:0 0 0 2024-09-04T16:30:24.709 INFO:tasks.workunit.client.0.smithi170.stdout:3/400: read d13/d14/d17/f64 [679346,37351] 0 2024-09-04T16:30:24.714 INFO:tasks.workunit.client.0.smithi170.stdout:9/508: dwrite d2/d3d/d35/f86 [0,4194304] 0 2024-09-04T16:30:24.714 INFO:tasks.workunit.client.0.smithi170.stdout:1/618: creat d9/d7b/d8f/fce x:0 0 0 2024-09-04T16:30:24.718 INFO:tasks.workunit.client.0.smithi170.stdout:1/619: fdatasync d9/d34/d5f/fc7 0 2024-09-04T16:30:24.720 INFO:tasks.workunit.client.0.smithi170.stdout:8/500: unlink d6/d28/d16/d24/d46/f4e 0 2024-09-04T16:30:24.721 INFO:tasks.workunit.client.0.smithi170.stdout:2/525: dwrite d3/d3c/d40/d48/f54 [0,4194304] 0 2024-09-04T16:30:24.723 INFO:tasks.workunit.client.0.smithi170.stdout:0/529: dwrite d11/d13/d2f/f92 [0,4194304] 0 2024-09-04T16:30:24.727 INFO:tasks.workunit.client.0.smithi170.stdout:2/526: truncate d3/db/d1c/d47/d67/f99 731656 0 2024-09-04T16:30:24.727 INFO:tasks.workunit.client.0.smithi170.stdout:9/509: mkdir d2/d3d/d3f/d90 0 2024-09-04T16:30:24.733 INFO:tasks.workunit.client.0.smithi170.stdout:3/401: creat d13/d14/d1d/d71/f7c x:0 0 0 2024-09-04T16:30:24.737 INFO:tasks.workunit.client.0.smithi170.stdout:2/527: chown d3/f46 293796975 1 2024-09-04T16:30:24.740 INFO:tasks.workunit.client.0.smithi170.stdout:9/510: unlink d2/d3d/d27/d65/f7e 0 2024-09-04T16:30:24.741 INFO:tasks.workunit.client.0.smithi170.stdout:3/402: dwrite d13/d14/d1f/f3e [0,4194304] 0 2024-09-04T16:30:24.741 INFO:tasks.workunit.client.0.smithi170.stdout:1/620: fdatasync d9/d26/f78 0 2024-09-04T16:30:24.744 INFO:tasks.workunit.client.0.smithi170.stdout:7/697: getdents d12/d15/d41 0 2024-09-04T16:30:24.744 INFO:tasks.workunit.client.0.smithi170.stdout:8/501: getdents d6/d28/d16/d24/d83 0 2024-09-04T16:30:24.749 INFO:tasks.workunit.client.0.smithi170.stdout:2/528: rmdir d3/db/d62/d6f/d93/d44 39 2024-09-04T16:30:24.750 INFO:tasks.workunit.client.0.smithi170.stdout:2/529: read - d3/d3c/d40/d48/d68/f9a zero size 2024-09-04T16:30:24.757 INFO:tasks.workunit.client.0.smithi170.stdout:3/403: dread d13/d14/d21/d4c/f5c [0,4194304] 0 2024-09-04T16:30:24.757 INFO:tasks.workunit.client.0.smithi170.stdout:0/530: dwrite d11/d13/d4a/d66/fa0 [0,4194304] 0 2024-09-04T16:30:24.758 INFO:tasks.workunit.client.0.smithi170.stdout:7/698: symlink d12/d15/d71/d42/d79/d9d/dc9/lef 0 2024-09-04T16:30:24.764 INFO:tasks.workunit.client.0.smithi170.stdout:3/404: rename d13 to d13/d14/d1d/d2d/d7d 22 2024-09-04T16:30:24.766 INFO:tasks.workunit.client.0.smithi170.stdout:0/531: dread d11/d13/d71/d43/f58 [0,4194304] 0 2024-09-04T16:30:24.767 INFO:tasks.workunit.client.0.smithi170.stdout:9/511: rmdir d2/d3d/d35/d81 0 2024-09-04T16:30:24.768 INFO:tasks.workunit.client.0.smithi170.stdout:8/502: mkdir d6/d28/d16/d77/d93/d95/dac 0 2024-09-04T16:30:24.769 INFO:tasks.workunit.client.0.smithi170.stdout:9/512: write d2/d3d/d4d/d59/d85/f8a [1571204,44774] 0 2024-09-04T16:30:24.769 INFO:tasks.workunit.client.0.smithi170.stdout:2/530: link d3/db/df/l28 d3/db/df/lad 0 2024-09-04T16:30:24.770 INFO:tasks.workunit.client.0.smithi170.stdout:8/503: stat d6/d28/d1a/d38/c67 0 2024-09-04T16:30:24.771 INFO:tasks.workunit.client.0.smithi170.stdout:7/699: mknod d12/d16/d1d/d65/d82/dcb/dce/cf0 0 2024-09-04T16:30:24.771 INFO:tasks.workunit.client.0.smithi170.stdout:8/504: dread - d6/d28/d16/d77/d93/d95/fa1 zero size 2024-09-04T16:30:24.772 INFO:tasks.workunit.client.0.smithi170.stdout:3/405: symlink d13/d14/d21/d4d/d4e/l7e 0 2024-09-04T16:30:24.772 INFO:tasks.workunit.client.0.smithi170.stdout:7/700: chown d12/d15/d71/d42/d79/d9d/d51 122 1 2024-09-04T16:30:24.773 INFO:tasks.workunit.client.0.smithi170.stdout:0/532: creat d11/d75/fcb x:0 0 0 2024-09-04T16:30:24.774 INFO:tasks.workunit.client.0.smithi170.stdout:8/505: fsync d6/d28/d20/d5e/f68 0 2024-09-04T16:30:24.774 INFO:tasks.workunit.client.0.smithi170.stdout:3/406: read d13/d14/d1f/f3e [2066591,123499] 0 2024-09-04T16:30:24.775 INFO:tasks.workunit.client.0.smithi170.stdout:0/533: dread - d11/d13/d4a/d66/d6d/fac zero size 2024-09-04T16:30:24.776 INFO:tasks.workunit.client.0.smithi170.stdout:2/531: dread d3/d3c/d40/d48/f8c [0,4194304] 0 2024-09-04T16:30:24.777 INFO:tasks.workunit.client.0.smithi170.stdout:2/532: chown d3/d3c/d40/d48/d68 687542229 1 2024-09-04T16:30:24.783 INFO:tasks.workunit.client.0.smithi170.stdout:0/534: rmdir d11/d13/d4a/d66/d8c/dae 39 2024-09-04T16:30:24.783 INFO:tasks.workunit.client.0.smithi170.stdout:7/701: dwrite d12/d15/d71/d42/d81/d5c/fcd [0,4194304] 0 2024-09-04T16:30:24.785 INFO:tasks.workunit.client.0.smithi170.stdout:0/535: chown d11/d13/d4a/d66 883141757 1 2024-09-04T16:30:24.789 INFO:tasks.workunit.client.0.smithi170.stdout:8/506: dwrite d6/d28/d20/d5e/fa3 [0,4194304] 0 2024-09-04T16:30:24.792 INFO:tasks.workunit.client.0.smithi170.stdout:2/533: rename d3/db/d1c/d47/d67 to d3/db/d1c/d47/d83/d9f/dae 0 2024-09-04T16:30:24.797 INFO:tasks.workunit.client.0.smithi170.stdout:3/407: write d13/f19 [4424375,12285] 0 2024-09-04T16:30:24.798 INFO:tasks.workunit.client.0.smithi170.stdout:3/408: chown d13/d14/d1f/c29 180707 1 2024-09-04T16:30:24.801 INFO:tasks.workunit.client.0.smithi170.stdout:0/536: mkdir d11/d13/d4a/d66/d6d/dcc 0 2024-09-04T16:30:24.802 INFO:tasks.workunit.client.0.smithi170.stdout:2/534: symlink d3/db/d1c/laf 0 2024-09-04T16:30:24.802 INFO:tasks.workunit.client.0.smithi170.stdout:9/513: link d2/d3d/d4d/d59/c68 d2/d3d/d35/c91 0 2024-09-04T16:30:24.805 INFO:tasks.workunit.client.0.smithi170.stdout:3/409: write d13/d14/d21/d4c/f5c [2046299,77399] 0 2024-09-04T16:30:24.808 INFO:tasks.workunit.client.0.smithi170.stdout:7/702: dwrite d12/d15/d71/fe0 [4194304,4194304] 0 2024-09-04T16:30:24.810 INFO:tasks.workunit.client.0.smithi170.stdout:2/535: creat d3/db/df/d45/fb0 x:0 0 0 2024-09-04T16:30:24.810 INFO:tasks.workunit.client.0.smithi170.stdout:3/410: write d13/d14/d1f/f73 [127698,39172] 0 2024-09-04T16:30:24.814 INFO:tasks.workunit.client.0.smithi170.stdout:8/507: getdents d6/d28/d5f 0 2024-09-04T16:30:24.815 INFO:tasks.workunit.client.0.smithi170.stdout:9/514: dwrite d2/d32/f61 [0,4194304] 0 2024-09-04T16:30:24.818 INFO:tasks.workunit.client.0.smithi170.stdout:0/537: rename d11/d13/d4a/d66/d6d/fc1 to d11/d13/fcd 0 2024-09-04T16:30:24.819 INFO:tasks.workunit.client.0.smithi170.stdout:9/515: read d2/d11/f24 [3620741,45515] 0 2024-09-04T16:30:24.820 INFO:tasks.workunit.client.0.smithi170.stdout:0/538: dread - d11/d13/fc3 zero size 2024-09-04T16:30:24.820 INFO:tasks.workunit.client.0.smithi170.stdout:7/703: creat d12/d15/d71/d42/d81/ff1 x:0 0 0 2024-09-04T16:30:24.821 INFO:tasks.workunit.client.0.smithi170.stdout:0/539: chown d11/d13/d2f/d3f/f59 362045285 1 2024-09-04T16:30:24.824 INFO:tasks.workunit.client.0.smithi170.stdout:3/411: mknod d13/d14/d21/c7f 0 2024-09-04T16:30:24.828 INFO:tasks.workunit.client.0.smithi170.stdout:7/704: creat d12/d16/d1d/d65/d82/ff2 x:0 0 0 2024-09-04T16:30:24.834 INFO:tasks.workunit.client.0.smithi170.stdout:0/540: mkdir d11/d75/dce 0 2024-09-04T16:30:24.839 INFO:tasks.workunit.client.0.smithi170.stdout:3/412: rename d13/d14/d21/c7f to d13/d14/d1d/d2d/d3d/c80 0 2024-09-04T16:30:24.841 INFO:tasks.workunit.client.0.smithi170.stdout:7/705: creat d12/d15/d41/ff3 x:0 0 0 2024-09-04T16:30:24.844 INFO:tasks.workunit.client.0.smithi170.stdout:2/536: rmdir d3/d4/d79/d9c 0 2024-09-04T16:30:24.844 INFO:tasks.workunit.client.0.smithi170.stdout:2/537: stat d3/d7/l31 0 2024-09-04T16:30:24.845 INFO:tasks.workunit.client.0.smithi170.stdout:2/538: chown d3/d7/c13 1 1 2024-09-04T16:30:24.846 INFO:tasks.workunit.client.0.smithi170.stdout:8/508: creat d6/d28/d16/d52/d73/d5d/fad x:0 0 0 2024-09-04T16:30:24.847 INFO:tasks.workunit.client.0.smithi170.stdout:4/494: sync 2024-09-04T16:30:24.847 INFO:tasks.workunit.client.0.smithi170.stdout:6/377: sync 2024-09-04T16:30:24.847 INFO:tasks.workunit.client.0.smithi170.stdout:5/429: sync 2024-09-04T16:30:24.848 INFO:tasks.workunit.client.0.smithi170.stdout:3/413: mknod d13/d14/d1d/d71/c81 0 2024-09-04T16:30:24.851 INFO:tasks.workunit.client.0.smithi170.stdout:7/706: unlink d12/d15/d41/c46 0 2024-09-04T16:30:24.852 INFO:tasks.workunit.client.0.smithi170.stdout:8/509: dread d6/d28/d20/f8a [0,4194304] 0 2024-09-04T16:30:24.853 INFO:tasks.workunit.client.0.smithi170.stdout:8/510: chown d6/d28/d16/d52/d73/d5d/f89 215 1 2024-09-04T16:30:24.854 INFO:tasks.workunit.client.0.smithi170.stdout:8/511: stat d6/d28/d20/d5e/f3e 0 2024-09-04T16:30:24.854 INFO:tasks.workunit.client.0.smithi170.stdout:8/512: fsync d6/d28/d1a/f42 0 2024-09-04T16:30:24.859 INFO:tasks.workunit.client.0.smithi170.stdout:8/513: dread d6/d28/d20/d5e/f35 [0,4194304] 0 2024-09-04T16:30:24.860 INFO:tasks.workunit.client.0.smithi170.stdout:0/541: dread d11/d13/d71/f4c [0,4194304] 0 2024-09-04T16:30:24.860 INFO:tasks.workunit.client.0.smithi170.stdout:3/414: mknod d13/d14/d21/d46/c82 0 2024-09-04T16:30:24.860 INFO:tasks.workunit.client.0.smithi170.stdout:9/516: truncate d2/d3d/d27/d65/f37 355768 0 2024-09-04T16:30:24.861 INFO:tasks.workunit.client.0.smithi170.stdout:3/415: fsync d13/d14/d1d/f61 0 2024-09-04T16:30:24.861 INFO:tasks.workunit.client.0.smithi170.stdout:9/517: fsync d2/d32/f41 0 2024-09-04T16:30:24.862 INFO:tasks.workunit.client.0.smithi170.stdout:3/416: fsync d13/f51 0 2024-09-04T16:30:24.863 INFO:tasks.workunit.client.0.smithi170.stdout:4/495: readlink d1/d6/d8/d20/d35/d3e/d60/l87 0 2024-09-04T16:30:24.864 INFO:tasks.workunit.client.0.smithi170.stdout:7/707: symlink d12/d15/d71/d42/d81/d5c/lf4 0 2024-09-04T16:30:24.864 INFO:tasks.workunit.client.0.smithi170.stdout:3/417: truncate d13/d14/d17/f64 5023580 0 2024-09-04T16:30:24.868 INFO:tasks.workunit.client.0.smithi170.stdout:3/418: readlink d13/d14/d21/d4d/d4e/d50/l79 0 2024-09-04T16:30:24.871 INFO:tasks.workunit.client.0.smithi170.stdout:6/378: creat d0/d15/d56/d6d/f74 x:0 0 0 2024-09-04T16:30:24.872 INFO:tasks.workunit.client.0.smithi170.stdout:4/496: dwrite d1/d6/f4f [4194304,4194304] 0 2024-09-04T16:30:24.873 INFO:tasks.workunit.client.0.smithi170.stdout:6/379: chown d0/df/d1b/d3e/d47/d68/f23 1678016 1 2024-09-04T16:30:24.874 INFO:tasks.workunit.client.0.smithi170.stdout:5/430: dread d4/f3c [0,4194304] 0 2024-09-04T16:30:24.878 INFO:tasks.workunit.client.0.smithi170.stdout:9/518: fdatasync d2/f17 0 2024-09-04T16:30:24.879 INFO:tasks.workunit.client.0.smithi170.stdout:9/519: stat d2/d11/d23 0 2024-09-04T16:30:24.881 INFO:tasks.workunit.client.0.smithi170.stdout:2/539: link d3/d3c/f7a d3/db/d62/d6f/d93/d44/fb1 0 2024-09-04T16:30:24.882 INFO:tasks.workunit.client.0.smithi170.stdout:6/380: dwrite d0/d17/d31/d64/f65 [0,4194304] 0 2024-09-04T16:30:24.889 INFO:tasks.workunit.client.0.smithi170.stdout:0/542: creat d11/d75/dce/fcf x:0 0 0 2024-09-04T16:30:24.889 INFO:tasks.workunit.client.0.smithi170.stdout:5/431: rmdir d4/db/d51/d5e/d71 39 2024-09-04T16:30:24.889 INFO:tasks.workunit.client.0.smithi170.stdout:3/419: dread d13/d14/f48 [0,4194304] 0 2024-09-04T16:30:24.891 INFO:tasks.workunit.client.0.smithi170.stdout:9/520: mknod d2/d3d/d27/d65/d5b/c92 0 2024-09-04T16:30:24.893 INFO:tasks.workunit.client.0.smithi170.stdout:6/381: dwrite d0/f5 [12582912,4194304] 0 2024-09-04T16:30:24.894 INFO:tasks.workunit.client.0.smithi170.stdout:9/521: chown d2/d3d/d54/c74 7 1 2024-09-04T16:30:24.894 INFO:tasks.workunit.client.0.smithi170.stdout:6/382: chown d0/ce 16908 1 2024-09-04T16:30:24.898 INFO:tasks.workunit.client.0.smithi170.stdout:2/540: rename d3/d3c/f7a to d3/d3c/d40/d48/d68/fb2 0 2024-09-04T16:30:24.899 INFO:tasks.workunit.client.0.smithi170.stdout:2/541: write d3/f65 [704762,109847] 0 2024-09-04T16:30:24.900 INFO:tasks.workunit.client.0.smithi170.stdout:8/514: creat d6/d28/fae x:0 0 0 2024-09-04T16:30:24.906 INFO:tasks.workunit.client.0.smithi170.stdout:0/543: creat d11/d13/d35/fd0 x:0 0 0 2024-09-04T16:30:24.907 INFO:tasks.workunit.client.0.smithi170.stdout:5/432: creat d4/db/f8a x:0 0 0 2024-09-04T16:30:24.908 INFO:tasks.workunit.client.0.smithi170.stdout:3/420: creat d13/d14/d1d/d2d/d3d/f83 x:0 0 0 2024-09-04T16:30:24.909 INFO:tasks.workunit.client.0.smithi170.stdout:3/421: chown d13/d14/d1f/f60 755260747 1 2024-09-04T16:30:24.911 INFO:tasks.workunit.client.0.smithi170.stdout:3/422: read d13/d14/d21/f2b [37810,108406] 0 2024-09-04T16:30:24.912 INFO:tasks.workunit.client.0.smithi170.stdout:0/544: dread d11/f15 [0,4194304] 0 2024-09-04T16:30:24.913 INFO:tasks.workunit.client.0.smithi170.stdout:6/383: symlink d0/d15/d56/d6d/l75 0 2024-09-04T16:30:24.917 INFO:tasks.workunit.client.0.smithi170.stdout:7/708: dwrite d12/d16/d1d/d65/d82/fb9 [0,4194304] 0 2024-09-04T16:30:24.919 INFO:tasks.workunit.client.0.smithi170.stdout:3/423: dwrite d13/d14/f4b [0,4194304] 0 2024-09-04T16:30:24.927 INFO:tasks.workunit.client.0.smithi170.stdout:9/522: write d2/f17 [1550322,59038] 0 2024-09-04T16:30:24.942 INFO:tasks.workunit.client.0.smithi170.stdout:2/542: creat d3/db/d62/d6f/fb3 x:0 0 0 2024-09-04T16:30:24.942 INFO:tasks.workunit.client.0.smithi170.stdout:8/515: creat d6/d28/d20/d5e/faf x:0 0 0 2024-09-04T16:30:24.943 INFO:tasks.workunit.client.0.smithi170.stdout:2/543: fdatasync d3/d3c/d40/d48/f5e 0 2024-09-04T16:30:24.949 INFO:tasks.workunit.client.0.smithi170.stdout:3/424: unlink f12 0 2024-09-04T16:30:24.949 INFO:tasks.workunit.client.0.smithi170.stdout:9/523: creat d2/d32/f93 x:0 0 0 2024-09-04T16:30:24.951 INFO:tasks.workunit.client.0.smithi170.stdout:5/433: rmdir d4/db/d51/d5e/d71 39 2024-09-04T16:30:24.952 INFO:tasks.workunit.client.0.smithi170.stdout:9/524: chown d2/d11/d23/f30 2731 1 2024-09-04T16:30:24.953 INFO:tasks.workunit.client.0.smithi170.stdout:7/709: dwrite d12/d16/fb8 [0,4194304] 0 2024-09-04T16:30:24.954 INFO:tasks.workunit.client.0.smithi170.stdout:2/544: rmdir d3/db/d1c/d47/d83 39 2024-09-04T16:30:24.954 INFO:tasks.workunit.client.0.smithi170.stdout:8/516: dread - d6/d26/f9a zero size 2024-09-04T16:30:24.956 INFO:tasks.workunit.client.0.smithi170.stdout:6/384: creat d0/d15/d56/d6c/f76 x:0 0 0 2024-09-04T16:30:24.956 INFO:tasks.workunit.client.0.smithi170.stdout:3/425: truncate d13/d14/d21/d4c/f5d 798358 0 2024-09-04T16:30:24.958 INFO:tasks.workunit.client.0.smithi170.stdout:3/426: fdatasync d13/d14/d21/d4c/f5c 0 2024-09-04T16:30:24.959 INFO:tasks.workunit.client.0.smithi170.stdout:9/525: creat d2/d3d/d6d/d79/f94 x:0 0 0 2024-09-04T16:30:24.960 INFO:tasks.workunit.client.0.smithi170.stdout:2/545: mknod d3/d4/d79/cb4 0 2024-09-04T16:30:24.961 INFO:tasks.workunit.client.0.smithi170.stdout:6/385: symlink d0/d17/d31/d64/l77 0 2024-09-04T16:30:24.963 INFO:tasks.workunit.client.0.smithi170.stdout:8/517: symlink d6/d26/lb0 0 2024-09-04T16:30:24.963 INFO:tasks.workunit.client.0.smithi170.stdout:9/526: fsync d2/d3d/d35/f86 0 2024-09-04T16:30:24.966 INFO:tasks.workunit.client.0.smithi170.stdout:7/710: dwrite d12/f14 [4194304,4194304] 0 2024-09-04T16:30:24.966 INFO:tasks.workunit.client.0.smithi170.stdout:8/518: write d6/d28/d20/f48 [3818037,68279] 0 2024-09-04T16:30:24.968 INFO:tasks.workunit.client.0.smithi170.stdout:6/386: creat d0/df/f78 x:0 0 0 2024-09-04T16:30:24.975 INFO:tasks.workunit.client.0.smithi170.stdout:9/527: mkdir d2/d11/d23/d95 0 2024-09-04T16:30:24.976 INFO:tasks.workunit.client.0.smithi170.stdout:8/519: dwrite d6/d28/d16/d24/f87 [0,4194304] 0 2024-09-04T16:30:24.978 INFO:tasks.workunit.client.0.smithi170.stdout:8/520: fsync d6/d28/d20/d5e/f47 0 2024-09-04T16:30:24.990 INFO:tasks.workunit.client.0.smithi170.stdout:3/427: getdents d13/d14/d1d/d2d/d58 0 2024-09-04T16:30:24.992 INFO:tasks.workunit.client.0.smithi170.stdout:0/545: write d11/d13/d71/f5d [177526,1049] 0 2024-09-04T16:30:24.997 INFO:tasks.workunit.client.0.smithi170.stdout:0/546: stat d11/d13/d2f/f84 0 2024-09-04T16:30:24.999 INFO:tasks.workunit.client.0.smithi170.stdout:3/428: link d13/d14/d1d/d2d/d58/f47 d13/f84 0 2024-09-04T16:30:25.007 INFO:tasks.workunit.client.0.smithi170.stdout:3/429: rename d13/d14/d21/d4c/l4f to d13/d14/d21/l85 0 2024-09-04T16:30:25.011 INFO:tasks.workunit.client.0.smithi170.stdout:2/546: dwrite d3/d3c/d40/d48/f8c [4194304,4194304] 0 2024-09-04T16:30:25.011 INFO:tasks.workunit.client.0.smithi170.stdout:3/430: rename c8 to d13/d14/d21/d4c/c86 0 2024-09-04T16:30:25.014 INFO:tasks.workunit.client.0.smithi170.stdout:2/547: truncate d3/db/df/d45/fac 497681 0 2024-09-04T16:30:25.015 INFO:tasks.workunit.client.0.smithi170.stdout:6/387: write d0/f9 [673725,118748] 0 2024-09-04T16:30:25.017 INFO:tasks.workunit.client.0.smithi170.stdout:8/521: write d6/d26/f2b [712305,88114] 0 2024-09-04T16:30:25.018 INFO:tasks.workunit.client.0.smithi170.stdout:2/548: write d3/f50 [4991725,61778] 0 2024-09-04T16:30:25.035 INFO:tasks.workunit.client.0.smithi170.stdout:7/711: dwrite d12/d15/d71/f3b [4194304,4194304] 0 2024-09-04T16:30:25.036 INFO:tasks.workunit.client.0.smithi170.stdout:6/388: getdents d0 0 2024-09-04T16:30:25.037 INFO:tasks.workunit.client.0.smithi170.stdout:2/549: stat d3/db/d62/f87 0 2024-09-04T16:30:25.037 INFO:tasks.workunit.client.0.smithi170.stdout:8/522: dread - d6/d28/d16/d77/d93/fab zero size 2024-09-04T16:30:25.038 INFO:tasks.workunit.client.0.smithi170.stdout:0/547: write d11/f6a [1657013,57647] 0 2024-09-04T16:30:25.041 INFO:tasks.workunit.client.0.smithi170.stdout:6/389: truncate d0/df/d1b/f4d 608705 0 2024-09-04T16:30:25.042 INFO:tasks.workunit.client.0.smithi170.stdout:6/390: fsync d0/f11 0 2024-09-04T16:30:25.044 INFO:tasks.workunit.client.0.smithi170.stdout:0/548: stat d11/d75/d77/f87 0 2024-09-04T16:30:25.046 INFO:tasks.workunit.client.0.smithi170.stdout:8/523: read - d6/d28/d20/d5e/f5b zero size 2024-09-04T16:30:25.047 INFO:tasks.workunit.client.0.smithi170.stdout:7/712: rmdir d12/d15/d71/d42/d79/d9d 39 2024-09-04T16:30:25.048 INFO:tasks.workunit.client.0.smithi170.stdout:7/713: chown d12/d16/d8d/fec 32420068 1 2024-09-04T16:30:25.048 INFO:tasks.workunit.client.0.smithi170.stdout:2/550: creat d3/db/d1c/d47/d83/d9f/fb5 x:0 0 0 2024-09-04T16:30:25.049 INFO:tasks.workunit.client.0.smithi170.stdout:2/551: stat d3/d3c/c2f 0 2024-09-04T16:30:25.050 INFO:tasks.workunit.client.0.smithi170.stdout:6/391: dread d0/df/d1b/f29 [4194304,4194304] 0 2024-09-04T16:30:25.050 INFO:tasks.workunit.client.0.smithi170.stdout:2/552: chown d3/d3c/d40/d48 2750240 1 2024-09-04T16:30:25.051 INFO:tasks.workunit.client.0.smithi170.stdout:3/431: dread d13/d14/d21/f36 [0,4194304] 0 2024-09-04T16:30:25.051 INFO:tasks.workunit.client.0.smithi170.stdout:8/524: creat d6/d28/d16/d52/fb1 x:0 0 0 2024-09-04T16:30:25.052 INFO:tasks.workunit.client.0.smithi170.stdout:7/714: mkdir d12/d16/d1d/df5 0 2024-09-04T16:30:25.053 INFO:tasks.workunit.client.0.smithi170.stdout:0/549: mknod d11/d13/d4a/d66/d6d/dcc/cd1 0 2024-09-04T16:30:25.054 INFO:tasks.workunit.client.0.smithi170.stdout:6/392: write d0/df/d1b/d3e/d47/d68/d2d/d2e/f66 [940484,49283] 0 2024-09-04T16:30:25.056 INFO:tasks.workunit.client.0.smithi170.stdout:8/525: creat d6/d28/d16/d24/d46/fb2 x:0 0 0 2024-09-04T16:30:25.059 INFO:tasks.workunit.client.0.smithi170.stdout:0/550: creat d11/d13/d4a/fd2 x:0 0 0 2024-09-04T16:30:25.060 INFO:tasks.workunit.client.0.smithi170.stdout:3/432: dwrite d13/d14/d21/d4c/f5d [0,4194304] 0 2024-09-04T16:30:25.063 INFO:tasks.workunit.client.0.smithi170.stdout:7/715: mkdir d12/d15/d71/d42/d79/d9d/dc9/df6 0 2024-09-04T16:30:25.063 INFO:tasks.workunit.client.0.smithi170.stdout:2/553: write d3/db/d62/d6f/d93/d44/fb1 [96443,47249] 0 2024-09-04T16:30:25.064 INFO:tasks.workunit.client.0.smithi170.stdout:8/526: creat d6/d28/d16/d52/d73/fb3 x:0 0 0 2024-09-04T16:30:25.066 INFO:tasks.workunit.client.0.smithi170.stdout:2/554: write d3/db/d1c/d47/d83/d9f/fa2 [98723,120742] 0 2024-09-04T16:30:25.066 INFO:tasks.workunit.client.0.smithi170.stdout:3/433: mkdir d13/d14/d1f/d87 0 2024-09-04T16:30:25.067 INFO:tasks.workunit.client.0.smithi170.stdout:2/555: fdatasync d3/db/d1c/d47/d83/d9f/fb5 0 2024-09-04T16:30:25.072 INFO:tasks.workunit.client.0.smithi170.stdout:3/434: stat d13/d14/c39 0 2024-09-04T16:30:25.072 INFO:tasks.workunit.client.0.smithi170.stdout:6/393: getdents d0/d17/d31 0 2024-09-04T16:30:25.077 INFO:tasks.workunit.client.0.smithi170.stdout:6/394: readlink d0/d17/l2f 0 2024-09-04T16:30:25.082 INFO:tasks.workunit.client.0.smithi170.stdout:3/435: mkdir d13/d14/d21/d4d/d4e/d88 0 2024-09-04T16:30:25.086 INFO:tasks.workunit.client.0.smithi170.stdout:7/716: dwrite d12/d15/d41/f83 [0,4194304] 0 2024-09-04T16:30:25.088 INFO:tasks.workunit.client.0.smithi170.stdout:8/527: dwrite d6/d28/d1a/d38/f9d [0,4194304] 0 2024-09-04T16:30:25.089 INFO:tasks.workunit.client.0.smithi170.stdout:2/556: getdents d3/db/d1c/d47/d83/d9f/dae/d97 0 2024-09-04T16:30:25.092 INFO:tasks.workunit.client.0.smithi170.stdout:7/717: read d12/d16/d1d/d65/d82/f91 [8138,44382] 0 2024-09-04T16:30:25.094 INFO:tasks.workunit.client.0.smithi170.stdout:2/557: fsync d3/f50 0 2024-09-04T16:30:25.096 INFO:tasks.workunit.client.0.smithi170.stdout:3/436: dread d13/d14/d21/f36 [0,4194304] 0 2024-09-04T16:30:25.096 INFO:tasks.workunit.client.0.smithi170.stdout:0/551: dread d11/d13/d71/f96 [0,4194304] 0 2024-09-04T16:30:25.098 INFO:tasks.workunit.client.0.smithi170.stdout:8/528: dread d6/d28/d20/d5e/f35 [4194304,4194304] 0 2024-09-04T16:30:25.099 INFO:tasks.workunit.client.0.smithi170.stdout:2/558: stat d3/d4/d79/cb4 0 2024-09-04T16:30:25.101 INFO:tasks.workunit.client.0.smithi170.stdout:6/395: dwrite d0/d17/f1d [4194304,4194304] 0 2024-09-04T16:30:25.103 INFO:tasks.workunit.client.0.smithi170.stdout:7/718: symlink d12/d16/d1d/d65/d82/da8/lf7 0 2024-09-04T16:30:25.103 INFO:tasks.workunit.client.0.smithi170.stdout:0/552: symlink d11/d13/d36/ld3 0 2024-09-04T16:30:25.105 INFO:tasks.workunit.client.0.smithi170.stdout:6/396: write d0/df/d1b/d3e/d47/d68/f41 [2652567,42701] 0 2024-09-04T16:30:25.105 INFO:tasks.workunit.client.0.smithi170.stdout:7/719: stat d12/d15/d71/d42/d79/d9d/dc9/lef 0 2024-09-04T16:30:25.112 INFO:tasks.workunit.client.0.smithi170.stdout:7/720: mkdir d12/d16/d1d/d65/d82/dcb/df8 0 2024-09-04T16:30:25.112 INFO:tasks.workunit.client.0.smithi170.stdout:8/529: link d6/d28/d16/c51 d6/d28/d16/d77/d8c/cb4 0 2024-09-04T16:30:25.113 INFO:tasks.workunit.client.0.smithi170.stdout:2/559: link d3/db/d1c/c36 d3/d4/d14/cb6 0 2024-09-04T16:30:25.114 INFO:tasks.workunit.client.0.smithi170.stdout:6/397: creat d0/df/d1b/d3e/d47/d68/d2d/d67/d69/f79 x:0 0 0 2024-09-04T16:30:25.114 INFO:tasks.workunit.client.0.smithi170.stdout:2/560: write d3/d3c/f30 [1352368,92024] 0 2024-09-04T16:30:25.115 INFO:tasks.workunit.client.0.smithi170.stdout:2/561: readlink d3/db/l58 0 2024-09-04T16:30:25.118 INFO:tasks.workunit.client.0.smithi170.stdout:7/721: creat d12/d15/d71/d42/d81/d5c/ff9 x:0 0 0 2024-09-04T16:30:25.123 INFO:tasks.workunit.client.0.smithi170.stdout:2/562: dwrite d3/db/df/d45/fb0 [0,4194304] 0 2024-09-04T16:30:25.126 INFO:tasks.workunit.client.0.smithi170.stdout:7/722: creat d12/d5a/ffa x:0 0 0 2024-09-04T16:30:25.127 INFO:tasks.workunit.client.0.smithi170.stdout:2/563: truncate d3/db/df/d45/fac 1075779 0 2024-09-04T16:30:25.129 INFO:tasks.workunit.client.0.smithi170.stdout:2/564: chown d3/db/d1c/d47/l64 208 1 2024-09-04T16:30:25.131 INFO:tasks.workunit.client.0.smithi170.stdout:0/553: write d11/d13/f24 [348179,87002] 0 2024-09-04T16:30:25.131 INFO:tasks.workunit.client.0.smithi170.stdout:0/554: stat d11/d13/d35/l5e 0 2024-09-04T16:30:25.133 INFO:tasks.workunit.client.0.smithi170.stdout:2/565: unlink d3/d3c/la6 0 2024-09-04T16:30:25.136 INFO:tasks.workunit.client.0.smithi170.stdout:3/437: truncate d13/d14/d21/d4c/f5d 3947283 0 2024-09-04T16:30:25.137 INFO:tasks.workunit.client.0.smithi170.stdout:7/723: mkdir d12/d15/d71/d42/d79/d9d/dc9/df6/dfb 0 2024-09-04T16:30:25.138 INFO:tasks.workunit.client.0.smithi170.stdout:7/724: stat d12/l1b 0 2024-09-04T16:30:25.141 INFO:tasks.workunit.client.0.smithi170.stdout:6/398: dread d0/f9 [0,4194304] 0 2024-09-04T16:30:25.143 INFO:tasks.workunit.client.0.smithi170.stdout:2/566: symlink d3/d3c/lb7 0 2024-09-04T16:30:25.143 INFO:tasks.workunit.client.0.smithi170.stdout:8/530: dread d6/f41 [0,4194304] 0 2024-09-04T16:30:25.143 INFO:tasks.workunit.client.0.smithi170.stdout:3/438: dwrite d13/f19 [0,4194304] 0 2024-09-04T16:30:25.146 INFO:tasks.workunit.client.0.smithi170.stdout:8/531: truncate d6/d28/d16/d77/d93/fab 247879 0 2024-09-04T16:30:25.149 INFO:tasks.workunit.client.0.smithi170.stdout:7/725: chown d12/d16/l20 6021795 1 2024-09-04T16:30:25.151 INFO:tasks.workunit.client.0.smithi170.stdout:0/555: mknod d11/d13/d4a/db8/cd4 0 2024-09-04T16:30:25.152 INFO:tasks.workunit.client.0.smithi170.stdout:6/399: creat d0/d15/d56/d6d/f7a x:0 0 0 2024-09-04T16:30:25.154 INFO:tasks.workunit.client.0.smithi170.stdout:2/567: mkdir d3/db/d1c/db8 0 2024-09-04T16:30:25.155 INFO:tasks.workunit.client.0.smithi170.stdout:2/568: write d3/db/d1c/d47/d83/f98 [884473,115757] 0 2024-09-04T16:30:25.159 INFO:tasks.workunit.client.0.smithi170.stdout:6/400: mknod d0/d15/d56/c7b 0 2024-09-04T16:30:25.161 INFO:tasks.workunit.client.0.smithi170.stdout:2/569: readlink d3/db/d1c/d77/laa 0 2024-09-04T16:30:25.164 INFO:tasks.workunit.client.0.smithi170.stdout:0/556: mknod d11/cd5 0 2024-09-04T16:30:25.168 INFO:tasks.workunit.client.0.smithi170.stdout:6/401: rename d0/df/d1b/f4d to d0/d17/d31/d64/d30/f7c 0 2024-09-04T16:30:25.169 INFO:tasks.workunit.client.0.smithi170.stdout:2/570: creat d3/db/d1c/d47/d83/d9f/dae/fb9 x:0 0 0 2024-09-04T16:30:25.174 INFO:tasks.workunit.client.0.smithi170.stdout:6/402: dread d0/df/d1b/d3e/d47/d68/f41 [0,4194304] 0 2024-09-04T16:30:25.175 INFO:tasks.workunit.client.0.smithi170.stdout:8/532: dread d6/d28/d16/d24/d46/f74 [0,4194304] 0 2024-09-04T16:30:25.176 INFO:tasks.workunit.client.0.smithi170.stdout:8/533: truncate d6/d28/f1d 1181693 0 2024-09-04T16:30:25.180 INFO:tasks.workunit.client.0.smithi170.stdout:1/621: sync 2024-09-04T16:30:25.185 INFO:tasks.workunit.client.0.smithi170.stdout:7/726: getdents d12 0 2024-09-04T16:30:25.186 INFO:tasks.workunit.client.0.smithi170.stdout:0/557: dread f4 [0,4194304] 0 2024-09-04T16:30:25.190 INFO:tasks.workunit.client.0.smithi170.stdout:3/439: write d13/d14/d1d/f27 [4978855,10742] 0 2024-09-04T16:30:25.190 INFO:tasks.workunit.client.0.smithi170.stdout:8/534: mknod d6/d28/d16/d52/d73/cb5 0 2024-09-04T16:30:25.192 INFO:tasks.workunit.client.0.smithi170.stdout:7/727: dwrite d12/d16/d8d/fec [0,4194304] 0 2024-09-04T16:30:25.193 INFO:tasks.workunit.client.0.smithi170.stdout:8/535: chown d6/d28/d5f/d70/f7d 959 1 2024-09-04T16:30:25.198 INFO:tasks.workunit.client.0.smithi170.stdout:2/571: mkdir d3/db/d62/d6f/d93/dba 0 2024-09-04T16:30:25.261 INFO:tasks.workunit.client.0.smithi170.stdout:6/403: mknod d0/df/d1b/d3e/d47/d68/d2d/d67/d73/c7d 0 2024-09-04T16:30:25.267 INFO:tasks.workunit.client.0.smithi170.stdout:7/728: mknod d12/d16/d1d/d65/dd0/cfc 0 2024-09-04T16:30:25.271 INFO:tasks.workunit.client.0.smithi170.stdout:3/440: mkdir d13/d14/d1d/d2d/d6c/d89 0 2024-09-04T16:30:25.272 INFO:tasks.workunit.client.0.smithi170.stdout:3/441: read d13/f1a [2572896,68891] 0 2024-09-04T16:30:25.280 INFO:tasks.workunit.client.0.smithi170.stdout:1/622: write d9/d11/dae/d6a/d79/d7c/fb2 [953827,39619] 0 2024-09-04T16:30:25.324 INFO:tasks.workunit.client.0.smithi170.stdout:3/442: creat d13/d14/d17/f8a x:0 0 0 2024-09-04T16:30:25.325 INFO:tasks.workunit.client.0.smithi170.stdout:4/497: sync 2024-09-04T16:30:25.326 INFO:tasks.workunit.client.0.smithi170.stdout:4/498: chown d1/d6/d8/f9 1977 1 2024-09-04T16:30:25.332 INFO:tasks.workunit.client.0.smithi170.stdout:0/558: unlink d11/d75/c9d 0 2024-09-04T16:30:25.334 INFO:tasks.workunit.client.0.smithi170.stdout:0/559: readlink d11/d13/l94 0 2024-09-04T16:30:25.358 INFO:tasks.workunit.client.0.smithi170.stdout:9/528: sync 2024-09-04T16:30:25.359 INFO:tasks.workunit.client.0.smithi170.stdout:5/434: sync 2024-09-04T16:30:25.363 INFO:tasks.workunit.client.0.smithi170.stdout:9/529: dread d2/d3d/d27/d2b/f6a [0,4194304] 0 2024-09-04T16:30:25.367 INFO:tasks.workunit.client.0.smithi170.stdout:5/435: dwrite d4/db/d37/f36 [0,4194304] 0 2024-09-04T16:30:25.378 INFO:tasks.workunit.client.0.smithi170.stdout:7/729: dread d12/d15/d71/d42/d79/d9d/fa6 [0,4194304] 0 2024-09-04T16:30:25.382 INFO:tasks.workunit.client.0.smithi170.stdout:0/560: link d11/f6a d11/d13/d71/fd6 0 2024-09-04T16:30:25.384 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:25 smithi193 ceph-mon[36288]: pgmap v32: 65 pgs: 65 active+clean; 2.9 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 120 MiB/s rd, 320 MiB/s wr, 638 op/s 2024-09-04T16:30:25.401 INFO:tasks.workunit.client.0.smithi170.stdout:8/536: truncate d6/d28/d20/d5e/f3e 3563955 0 2024-09-04T16:30:25.402 INFO:tasks.workunit.client.0.smithi170.stdout:2/572: truncate d3/d3c/d40/d48/f8c 1823876 0 2024-09-04T16:30:25.403 INFO:tasks.workunit.client.0.smithi170.stdout:8/537: rmdir d6/d28/d5f/d70 39 2024-09-04T16:30:25.406 INFO:tasks.workunit.client.0.smithi170.stdout:8/538: creat d6/d28/d5f/d70/d97/fb6 x:0 0 0 2024-09-04T16:30:25.407 INFO:tasks.workunit.client.0.smithi170.stdout:6/404: truncate d0/df/f28 1090948 0 2024-09-04T16:30:25.411 INFO:tasks.workunit.client.0.smithi170.stdout:8/539: link d6/d28/d1a/d81/f84 d6/d28/d16/d77/fb7 0 2024-09-04T16:30:25.412 INFO:tasks.workunit.client.0.smithi170.stdout:1/623: dwrite d9/d26/f93 [4194304,4194304] 0 2024-09-04T16:30:25.414 INFO:tasks.workunit.client.0.smithi170.stdout:7/730: unlink d12/l1b 0 2024-09-04T16:30:25.416 INFO:tasks.workunit.client.0.smithi170.stdout:1/624: mknod d9/d11/d2f/d7f/ccf 0 2024-09-04T16:30:25.416 INFO:tasks.workunit.client.0.smithi170.stdout:6/405: getdents d0/df/d1b/d3e/d47/d68/d2d/d67/d69 0 2024-09-04T16:30:25.420 INFO:tasks.workunit.client.0.smithi170.stdout:1/625: creat d9/d11/d85/fd0 x:0 0 0 2024-09-04T16:30:25.423 INFO:tasks.workunit.client.0.smithi170.stdout:1/626: rmdir d9/d11/d2f/d6b/d61 39 2024-09-04T16:30:25.426 INFO:tasks.workunit.client.0.smithi170.stdout:1/627: symlink d9/d26/ld1 0 2024-09-04T16:30:25.433 INFO:tasks.workunit.client.0.smithi170.stdout:3/443: rename d13/d14/d21/d4d/d4e/d50/d68 to d13/d14/d8b 0 2024-09-04T16:30:25.437 INFO:tasks.workunit.client.0.smithi170.stdout:4/499: rename d1/d6/d8/d20/d35/d54/d96/faf to d1/d6/d8/d20/d35/d3e/d43/fb8 0 2024-09-04T16:30:25.438 INFO:tasks.workunit.client.0.smithi170.stdout:4/500: stat d1/d6/d22/fad 0 2024-09-04T16:30:25.441 INFO:tasks.workunit.client.0.smithi170.stdout:5/436: rename d4/d8/d1c/d26/d27/d43/d5b/d85 to d4/d3a/d74/d8b 0 2024-09-04T16:30:25.442 INFO:tasks.workunit.client.0.smithi170.stdout:5/437: chown d4/d8/d1c/f6d 497 1 2024-09-04T16:30:25.442 INFO:tasks.workunit.client.0.smithi170.stdout:1/628: dread d9/d11/f3f [0,4194304] 0 2024-09-04T16:30:25.446 INFO:tasks.workunit.client.0.smithi170.stdout:5/438: rename d4/d8/c55 to d4/d8/c8c 0 2024-09-04T16:30:25.447 INFO:tasks.workunit.client.0.smithi170.stdout:5/439: readlink d4/d8/d1c/d41/l57 0 2024-09-04T16:30:25.448 INFO:tasks.workunit.client.0.smithi170.stdout:1/629: creat d9/d11/d2e/fd2 x:0 0 0 2024-09-04T16:30:25.449 INFO:tasks.workunit.client.0.smithi170.stdout:1/630: stat d9/d11/dae/d6a/d79/d7c/fab 0 2024-09-04T16:30:25.449 INFO:tasks.workunit.client.0.smithi170.stdout:3/444: rename d13/d14/d1f/c29 to d13/d14/c8c 0 2024-09-04T16:30:25.451 INFO:tasks.workunit.client.0.smithi170.stdout:3/445: creat d13/d14/d1f/f8d x:0 0 0 2024-09-04T16:30:25.456 INFO:tasks.workunit.client.0.smithi170.stdout:5/440: dwrite d4/d8/d1c/d26/d27/d43/d5b/f76 [0,4194304] 0 2024-09-04T16:30:25.459 INFO:tasks.workunit.client.0.smithi170.stdout:4/501: symlink d1/d6/d8/d20/d35/lb9 0 2024-09-04T16:30:25.463 INFO:tasks.workunit.client.0.smithi170.stdout:4/502: fdatasync d1/d6/d8/d20/d35/d3e/d4e/f45 0 2024-09-04T16:30:25.468 INFO:tasks.workunit.client.0.smithi170.stdout:4/503: unlink d1/l1a 0 2024-09-04T16:30:25.470 INFO:tasks.workunit.client.0.smithi170.stdout:5/441: dread d4/f6 [0,4194304] 0 2024-09-04T16:30:25.475 INFO:tasks.workunit.client.0.smithi170.stdout:1/631: rename d9/d34/l4f to d9/d11/dae/ld3 0 2024-09-04T16:30:25.476 INFO:tasks.workunit.client.0.smithi170.stdout:1/632: read - d9/d11/dae/f91 zero size 2024-09-04T16:30:25.478 INFO:tasks.workunit.client.0.smithi170.stdout:5/442: creat d4/d8/d1c/d26/d27/d48/d7c/f8d x:0 0 0 2024-09-04T16:30:25.479 INFO:tasks.workunit.client.0.smithi170.stdout:5/443: chown d4/d8/d1c/d23/d39/f81 7421 1 2024-09-04T16:30:25.482 INFO:tasks.workunit.client.0.smithi170.stdout:1/633: dwrite d9/d26/f5a [0,4194304] 0 2024-09-04T16:30:25.483 INFO:tasks.workunit.client.0.smithi170.stdout:1/634: stat d9/d11/d2e/cc4 0 2024-09-04T16:30:25.493 INFO:tasks.workunit.client.0.smithi170.stdout:5/444: dread d4/f2c [0,4194304] 0 2024-09-04T16:30:25.496 INFO:tasks.workunit.client.0.smithi170.stdout:0/561: dwrite d11/d8e/fbe [0,4194304] 0 2024-09-04T16:30:25.498 INFO:tasks.workunit.client.0.smithi170.stdout:5/445: mkdir d4/d8/d1c/d26/d27/d43/d8e 0 2024-09-04T16:30:25.498 INFO:tasks.workunit.client.0.smithi170.stdout:0/562: read - d11/d13/d4a/d66/d8c/fc6 zero size 2024-09-04T16:30:25.499 INFO:tasks.workunit.client.0.smithi170.stdout:1/635: fdatasync d9/d26/f5a 0 2024-09-04T16:30:25.500 INFO:tasks.workunit.client.0.smithi170.stdout:0/563: readlink d11/d13/d2f/d3f/l97 0 2024-09-04T16:30:25.503 INFO:tasks.workunit.client.0.smithi170.stdout:0/564: mkdir d11/d8e/dd7 0 2024-09-04T16:30:25.507 INFO:tasks.workunit.client.0.smithi170.stdout:1/636: dwrite d9/d11/d2f/f57 [0,4194304] 0 2024-09-04T16:30:25.509 INFO:tasks.workunit.client.0.smithi170.stdout:1/637: write d9/f55 [1151942,126798] 0 2024-09-04T16:30:25.510 INFO:tasks.workunit.client.0.smithi170.stdout:0/565: write d11/d13/d71/d43/fb4 [119744,77797] 0 2024-09-04T16:30:25.511 INFO:tasks.workunit.client.0.smithi170.stdout:1/638: fdatasync d9/d11/d2f/d6b/d7d/f9f 0 2024-09-04T16:30:25.520 INFO:tasks.workunit.client.0.smithi170.stdout:2/573: dwrite d3/d3c/f5c [0,4194304] 0 2024-09-04T16:30:25.521 INFO:tasks.workunit.client.0.smithi170.stdout:2/574: chown d3/db/df/c6d 3474317 1 2024-09-04T16:30:25.523 INFO:tasks.workunit.client.0.smithi170.stdout:2/575: dread - d3/db/d1c/d47/d83/d9f/dae/fb9 zero size 2024-09-04T16:30:25.528 INFO:tasks.workunit.client.0.smithi170.stdout:1/639: symlink d9/d11/ld4 0 2024-09-04T16:30:25.533 INFO:tasks.workunit.client.0.smithi170.stdout:0/566: dread d11/d13/f8a [0,4194304] 0 2024-09-04T16:30:25.534 INFO:tasks.workunit.client.0.smithi170.stdout:6/406: truncate d0/df/d1b/f24 3732238 0 2024-09-04T16:30:25.537 INFO:tasks.workunit.client.0.smithi170.stdout:2/576: dread d3/f46 [0,4194304] 0 2024-09-04T16:30:25.539 INFO:tasks.workunit.client.0.smithi170.stdout:5/446: dread d4/d8/d1c/d26/d27/f3f [0,4194304] 0 2024-09-04T16:30:25.541 INFO:tasks.workunit.client.0.smithi170.stdout:8/540: dwrite d6/d28/d16/d77/fb7 [0,4194304] 0 2024-09-04T16:30:25.541 INFO:tasks.workunit.client.0.smithi170.stdout:7/731: creat d12/d16/d8d/ffd x:0 0 0 2024-09-04T16:30:25.544 INFO:tasks.workunit.client.0.smithi170.stdout:0/567: mknod d11/cd8 0 2024-09-04T16:30:25.546 INFO:tasks.workunit.client.0.smithi170.stdout:0/568: dread - d11/d8e/fb9 zero size 2024-09-04T16:30:25.546 INFO:tasks.workunit.client.0.smithi170.stdout:7/732: write d12/d16/d1d/d65/d82/ff2 [172377,54095] 0 2024-09-04T16:30:25.547 INFO:tasks.workunit.client.0.smithi170.stdout:2/577: creat d3/db/d1c/d47/d83/d9f/fbb x:0 0 0 2024-09-04T16:30:25.547 INFO:tasks.workunit.client.0.smithi170.stdout:5/447: symlink d4/d8/d1c/d23/d39/l8f 0 2024-09-04T16:30:25.549 INFO:tasks.workunit.client.0.smithi170.stdout:8/541: mkdir d6/d28/d16/d77/d93/d95/db8 0 2024-09-04T16:30:25.551 INFO:tasks.workunit.client.0.smithi170.stdout:6/407: dwrite d0/d17/f1c [4194304,4194304] 0 2024-09-04T16:30:25.551 INFO:tasks.workunit.client.0.smithi170.stdout:1/640: dread d9/d34/fbc [0,4194304] 0 2024-09-04T16:30:25.551 INFO:tasks.workunit.client.0.smithi170.stdout:8/542: stat d6/d28/d1a/f42 0 2024-09-04T16:30:25.554 INFO:tasks.workunit.client.0.smithi170.stdout:7/733: symlink d12/d15/d41/lfe 0 2024-09-04T16:30:25.554 INFO:tasks.workunit.client.0.smithi170.stdout:2/578: mknod d3/db/d1c/db8/cbc 0 2024-09-04T16:30:25.557 INFO:tasks.workunit.client.0.smithi170.stdout:0/569: creat d11/d13/d4a/d66/d8c/da8/fd9 x:0 0 0 2024-09-04T16:30:25.558 INFO:tasks.workunit.client.0.smithi170.stdout:6/408: mkdir d0/df/d7e 0 2024-09-04T16:30:25.559 INFO:tasks.workunit.client.0.smithi170.stdout:5/448: creat d4/d8/d1c/d26/d27/d43/d5b/f90 x:0 0 0 2024-09-04T16:30:25.560 INFO:tasks.workunit.client.0.smithi170.stdout:2/579: chown d3/db/df/c6d 7337 1 2024-09-04T16:30:25.563 INFO:tasks.workunit.client.0.smithi170.stdout:3/446: dwrite d13/d14/d17/f42 [0,4194304] 0 2024-09-04T16:30:25.566 INFO:tasks.workunit.client.0.smithi170.stdout:7/734: unlink d12/d15/d71/d42/ca3 0 2024-09-04T16:30:25.566 INFO:tasks.workunit.client.0.smithi170.stdout:6/409: truncate d0/d15/d56/d6d/f74 511657 0 2024-09-04T16:30:25.566 INFO:tasks.workunit.client.0.smithi170.stdout:5/449: dread - d4/d8/d1c/d26/d27/d43/d5b/f90 zero size 2024-09-04T16:30:25.568 INFO:tasks.workunit.client.0.smithi170.stdout:8/543: dwrite d6/d28/d20/d5e/fa3 [0,4194304] 0 2024-09-04T16:30:25.570 INFO:tasks.workunit.client.0.smithi170.stdout:5/450: fdatasync d4/d8/d1c/d26/d27/d43/d5b/f76 0 2024-09-04T16:30:25.571 INFO:tasks.workunit.client.0.smithi170.stdout:2/580: rmdir d3 39 2024-09-04T16:30:25.581 INFO:tasks.workunit.client.0.smithi170.stdout:1/641: dread d9/d26/f36 [0,4194304] 0 2024-09-04T16:30:25.584 INFO:tasks.workunit.client.0.smithi170.stdout:4/504: dwrite d1/d6/d8/d20/d35/d3e/d60/daa/fb7 [0,4194304] 0 2024-09-04T16:30:25.584 INFO:tasks.workunit.client.0.smithi170.stdout:2/581: read - d3/f94 zero size 2024-09-04T16:30:25.588 INFO:tasks.workunit.client.0.smithi170.stdout:3/447: unlink d13/d14/c8c 0 2024-09-04T16:30:25.589 INFO:tasks.workunit.client.0.smithi170.stdout:6/410: fsync d0/df/d1b/d3e/d47/d68/d2d/d2e/f43 0 2024-09-04T16:30:25.591 INFO:tasks.workunit.client.0.smithi170.stdout:8/544: dwrite d6/d28/d20/d5e/f68 [0,4194304] 0 2024-09-04T16:30:25.592 INFO:tasks.workunit.client.0.smithi170.stdout:7/735: dwrite d12/d5a/ffa [0,4194304] 0 2024-09-04T16:30:25.593 INFO:tasks.workunit.client.0.smithi170.stdout:2/582: rmdir d3/d4/d79 39 2024-09-04T16:30:25.595 INFO:tasks.workunit.client.0.smithi170.stdout:3/448: symlink d13/d14/d1f/l8e 0 2024-09-04T16:30:25.595 INFO:tasks.workunit.client.0.smithi170.stdout:6/411: write d0/d17/f1c [2774360,107274] 0 2024-09-04T16:30:25.595 INFO:tasks.workunit.client.0.smithi170.stdout:8/545: chown d6/d28/d1a/fa7 3 1 2024-09-04T16:30:25.598 INFO:tasks.workunit.client.0.smithi170.stdout:4/505: read d1/d6/d8/f44 [36216,64343] 0 2024-09-04T16:30:25.599 INFO:tasks.workunit.client.0.smithi170.stdout:2/583: creat d3/db/fbd x:0 0 0 2024-09-04T16:30:25.599 INFO:tasks.workunit.client.0.smithi170.stdout:6/412: dread - d0/df/d1b/d3e/d47/d68/d2d/d67/d69/f79 zero size 2024-09-04T16:30:25.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:25 smithi170 ceph-mon[29272]: pgmap v32: 65 pgs: 65 active+clean; 2.9 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 120 MiB/s rd, 320 MiB/s wr, 638 op/s 2024-09-04T16:30:25.603 INFO:tasks.workunit.client.0.smithi170.stdout:5/451: getdents d4/db/d51/d5e 0 2024-09-04T16:30:25.603 INFO:tasks.workunit.client.0.smithi170.stdout:8/546: truncate d6/d28/d1a/f9e 583499 0 2024-09-04T16:30:25.604 INFO:tasks.workunit.client.0.smithi170.stdout:7/736: rmdir d12/d15 39 2024-09-04T16:30:25.605 INFO:tasks.workunit.client.0.smithi170.stdout:1/642: dread d9/f2b [0,4194304] 0 2024-09-04T16:30:25.606 INFO:tasks.workunit.client.0.smithi170.stdout:6/413: chown d0/df/d1b/d3e/d47/d68/d2d/f3d 842295136 1 2024-09-04T16:30:25.607 INFO:tasks.workunit.client.0.smithi170.stdout:3/449: rename d13/d14/d1d/f27 to d13/d14/d1d/d2d/d6c/f8f 0 2024-09-04T16:30:25.617 INFO:tasks.workunit.client.0.smithi170.stdout:8/547: unlink d6/d28/d16/d24/d46/l65 0 2024-09-04T16:30:25.619 INFO:tasks.workunit.client.0.smithi170.stdout:2/584: rename d3/d3c/d40/c63 to d3/db/d1c/db8/cbe 0 2024-09-04T16:30:25.621 INFO:tasks.workunit.client.0.smithi170.stdout:3/450: mknod d13/c90 0 2024-09-04T16:30:25.623 INFO:tasks.workunit.client.0.smithi170.stdout:8/548: dwrite d6/d28/d20/f48 [0,4194304] 0 2024-09-04T16:30:25.624 INFO:tasks.workunit.client.0.smithi170.stdout:2/585: read d3/d4/d14/f7c [2057575,6330] 0 2024-09-04T16:30:25.626 INFO:tasks.workunit.client.0.smithi170.stdout:2/586: write d3/d3c/d40/d48/f9e [194650,16651] 0 2024-09-04T16:30:25.626 INFO:tasks.workunit.client.0.smithi170.stdout:1/643: unlink d9/d11/dae/d6a/d79/d7c/fb5 0 2024-09-04T16:30:25.627 INFO:tasks.workunit.client.0.smithi170.stdout:2/587: dread - d3/db/df/d45/f7d zero size 2024-09-04T16:30:25.630 INFO:tasks.workunit.client.0.smithi170.stdout:2/588: write d3/db/d1c/d47/d83/f98 [1186659,78067] 0 2024-09-04T16:30:25.633 INFO:tasks.workunit.client.0.smithi170.stdout:0/570: dwrite d11/d8e/f9c [0,4194304] 0 2024-09-04T16:30:25.639 INFO:tasks.workunit.client.0.smithi170.stdout:5/452: link d4/d8/d1c/d26/d27/d48/d7c/f8d d4/d8/d1c/d26/d27/d48/d5a/f91 0 2024-09-04T16:30:25.640 INFO:tasks.workunit.client.0.smithi170.stdout:3/451: creat d13/d14/d1f/f91 x:0 0 0 2024-09-04T16:30:25.642 INFO:tasks.workunit.client.0.smithi170.stdout:7/737: dwrite d12/d16/d1d/d65/d82/fb9 [0,4194304] 0 2024-09-04T16:30:25.644 INFO:tasks.workunit.client.0.smithi170.stdout:8/549: rmdir d6/d28/d5f/d91 39 2024-09-04T16:30:25.646 INFO:tasks.workunit.client.0.smithi170.stdout:1/644: symlink d9/d34/ld5 0 2024-09-04T16:30:25.647 INFO:tasks.workunit.client.0.smithi170.stdout:1/645: stat d9/f2b 0 2024-09-04T16:30:25.650 INFO:tasks.workunit.client.0.smithi170.stdout:2/589: rename d3/d3c/f5c to d3/db/d1c/fbf 0 2024-09-04T16:30:25.651 INFO:tasks.workunit.client.0.smithi170.stdout:9/530: sync 2024-09-04T16:30:25.651 INFO:tasks.workunit.client.0.smithi170.stdout:2/590: chown d3/db/d1c 256173293 1 2024-09-04T16:30:25.653 INFO:tasks.workunit.client.0.smithi170.stdout:0/571: mkdir d11/d13/d4a/d66/d8c/da8/dda 0 2024-09-04T16:30:25.658 INFO:tasks.workunit.client.0.smithi170.stdout:5/453: rmdir d4/d8/d1c/d26/d27/d48/d7c 39 2024-09-04T16:30:25.659 INFO:tasks.workunit.client.0.smithi170.stdout:5/454: dread - d4/d8/d1c/d23/d39/f81 zero size 2024-09-04T16:30:25.660 INFO:tasks.workunit.client.0.smithi170.stdout:7/738: readlink d12/lc1 0 2024-09-04T16:30:25.661 INFO:tasks.workunit.client.0.smithi170.stdout:4/506: truncate d1/d6/f12 2274692 0 2024-09-04T16:30:25.662 INFO:tasks.workunit.client.0.smithi170.stdout:8/550: stat d6/c6a 0 2024-09-04T16:30:25.662 INFO:tasks.workunit.client.0.smithi170.stdout:5/455: chown d4/d8/d1c/d26/d27/d43/f44 25 1 2024-09-04T16:30:25.663 INFO:tasks.workunit.client.0.smithi170.stdout:8/551: fsync d6/d28/d1a/f9e 0 2024-09-04T16:30:25.663 INFO:tasks.workunit.client.0.smithi170.stdout:7/739: write d12/d16/d1d/d65/d82/dcb/fe9 [417053,93154] 0 2024-09-04T16:30:25.665 INFO:tasks.workunit.client.0.smithi170.stdout:8/552: write d6/d28/d1a/fa7 [386084,99526] 0 2024-09-04T16:30:25.666 INFO:tasks.workunit.client.0.smithi170.stdout:2/591: dread d3/db/d1c/d47/d83/f91 [0,4194304] 0 2024-09-04T16:30:25.667 INFO:tasks.workunit.client.0.smithi170.stdout:9/531: creat d2/d3d/d6d/d79/f96 x:0 0 0 2024-09-04T16:30:25.667 INFO:tasks.workunit.client.0.smithi170.stdout:8/553: chown d6/d28/d1a/f42 3 1 2024-09-04T16:30:25.669 INFO:tasks.workunit.client.0.smithi170.stdout:9/532: write d2/fd [409152,81663] 0 2024-09-04T16:30:25.669 INFO:tasks.workunit.client.0.smithi170.stdout:2/592: chown d3/db/d1c/d47/d83/d9f/dae 7485810 1 2024-09-04T16:30:25.671 INFO:tasks.workunit.client.0.smithi170.stdout:6/414: fsync d0/d17/d31/d64/d30/f7c 0 2024-09-04T16:30:25.671 INFO:tasks.workunit.client.0.smithi170.stdout:2/593: chown d3/db/df/d45/c5a 16 1 2024-09-04T16:30:25.672 INFO:tasks.workunit.client.0.smithi170.stdout:0/572: read d11/d13/d36/f40 [2748,118720] 0 2024-09-04T16:30:25.674 INFO:tasks.workunit.client.0.smithi170.stdout:4/507: dread d1/f74 [0,4194304] 0 2024-09-04T16:30:25.675 INFO:tasks.workunit.client.0.smithi170.stdout:1/646: dread d9/d11/d2e/f52 [0,4194304] 0 2024-09-04T16:30:25.675 INFO:tasks.workunit.client.0.smithi170.stdout:4/508: fdatasync d1/d6/d8/d20/d95/d36/f3c 0 2024-09-04T16:30:25.678 INFO:tasks.workunit.client.0.smithi170.stdout:5/456: creat d4/d3a/d74/f92 x:0 0 0 2024-09-04T16:30:25.679 INFO:tasks.workunit.client.0.smithi170.stdout:5/457: dread - d4/d8/d1c/d26/d27/d43/d5b/f90 zero size 2024-09-04T16:30:25.682 INFO:tasks.workunit.client.0.smithi170.stdout:8/554: read d6/d28/d16/d52/f64 [3044011,2873] 0 2024-09-04T16:30:25.688 INFO:tasks.workunit.client.0.smithi170.stdout:6/415: read d0/df/f3a [285956,112299] 0 2024-09-04T16:30:25.689 INFO:tasks.workunit.client.0.smithi170.stdout:1/647: creat d9/d34/d5f/fd6 x:0 0 0 2024-09-04T16:30:25.689 INFO:tasks.workunit.client.0.smithi170.stdout:7/740: truncate d12/d5a/fdf 420072 0 2024-09-04T16:30:25.691 INFO:tasks.workunit.client.0.smithi170.stdout:5/458: fdatasync d4/d3a/f4d 0 2024-09-04T16:30:25.694 INFO:tasks.workunit.client.0.smithi170.stdout:9/533: creat d2/d11/d23/d95/f97 x:0 0 0 2024-09-04T16:30:25.698 INFO:tasks.workunit.client.0.smithi170.stdout:2/594: dread d3/d4/d14/f7c [0,4194304] 0 2024-09-04T16:30:25.699 INFO:tasks.workunit.client.0.smithi170.stdout:6/416: rename d0/d17/d31/d64/d30/f5c to d0/d17/d5b/f7f 0 2024-09-04T16:30:25.700 INFO:tasks.workunit.client.0.smithi170.stdout:7/741: unlink d12/d16/f3f 0 2024-09-04T16:30:25.703 INFO:tasks.workunit.client.0.smithi170.stdout:3/452: creat d13/d14/d21/d46/f92 x:0 0 0 2024-09-04T16:30:25.705 INFO:tasks.workunit.client.0.smithi170.stdout:5/459: mkdir d4/db/d51/d5e/d71/d84/d93 0 2024-09-04T16:30:25.706 INFO:tasks.workunit.client.0.smithi170.stdout:9/534: symlink d2/d3d/d27/d65/d66/l98 0 2024-09-04T16:30:25.710 INFO:tasks.workunit.client.0.smithi170.stdout:2/595: symlink d3/db/d62/d6f/lc0 0 2024-09-04T16:30:25.711 INFO:tasks.workunit.client.0.smithi170.stdout:6/417: mknod d0/df/d1b/d3e/d47/d68/d2d/c80 0 2024-09-04T16:30:25.711 INFO:tasks.workunit.client.0.smithi170.stdout:2/596: dread - d3/db/d1c/d47/d83/d9f/fbb zero size 2024-09-04T16:30:25.712 INFO:tasks.workunit.client.0.smithi170.stdout:6/418: chown d0/df/d1b/d3e/c6b 3203 1 2024-09-04T16:30:25.713 INFO:tasks.workunit.client.0.smithi170.stdout:6/419: chown d0/df/d1f 6765668 1 2024-09-04T16:30:25.714 INFO:tasks.workunit.client.0.smithi170.stdout:6/420: chown d0/df/d1b/d3e/d47/d68/d2d/d2e 0 1 2024-09-04T16:30:25.715 INFO:tasks.workunit.client.0.smithi170.stdout:6/421: write d0/d15/d56/d6d/f74 [785728,112699] 0 2024-09-04T16:30:25.718 INFO:tasks.workunit.client.0.smithi170.stdout:6/422: write d0/df/d1b/d3e/d47/d68/d2d/f3d [2165107,123695] 0 2024-09-04T16:30:25.720 INFO:tasks.workunit.client.0.smithi170.stdout:5/460: dread d4/f2b [0,4194304] 0 2024-09-04T16:30:25.721 INFO:tasks.workunit.client.0.smithi170.stdout:1/648: truncate d9/d11/d2e/f89 263562 0 2024-09-04T16:30:25.723 INFO:tasks.workunit.client.0.smithi170.stdout:8/555: link d6/f57 d6/d28/d1a/d80/fb9 0 2024-09-04T16:30:25.724 INFO:tasks.workunit.client.0.smithi170.stdout:0/573: getdents d11/d13/d4a 0 2024-09-04T16:30:25.726 INFO:tasks.workunit.client.0.smithi170.stdout:0/574: chown d11/d75/fcb 42 1 2024-09-04T16:30:25.726 INFO:tasks.workunit.client.0.smithi170.stdout:2/597: mkdir d3/d3c/dc1 0 2024-09-04T16:30:25.729 INFO:tasks.workunit.client.0.smithi170.stdout:7/742: mkdir d12/d16/d1d/d65/dff 0 2024-09-04T16:30:25.731 INFO:tasks.workunit.client.0.smithi170.stdout:0/575: dread d11/d13/d2f/d3f/f4f [0,4194304] 0 2024-09-04T16:30:25.731 INFO:tasks.workunit.client.0.smithi170.stdout:6/423: read d0/df/f28 [737567,55902] 0 2024-09-04T16:30:25.733 INFO:tasks.workunit.client.0.smithi170.stdout:3/453: unlink d13/d14/c63 0 2024-09-04T16:30:25.735 INFO:tasks.workunit.client.0.smithi170.stdout:5/461: mkdir d4/d8/d1c/d23/d94 0 2024-09-04T16:30:25.736 INFO:tasks.workunit.client.0.smithi170.stdout:9/535: symlink d2/d3d/d27/d2b/l99 0 2024-09-04T16:30:25.738 INFO:tasks.workunit.client.0.smithi170.stdout:1/649: creat d9/d11/d2f/d7f/fd7 x:0 0 0 2024-09-04T16:30:25.742 INFO:tasks.workunit.client.0.smithi170.stdout:2/598: mkdir d3/db/d1c/d77/dc2 0 2024-09-04T16:30:25.748 INFO:tasks.workunit.client.0.smithi170.stdout:3/454: chown d13/d14/f48 243136813 1 2024-09-04T16:30:25.748 INFO:tasks.workunit.client.0.smithi170.stdout:0/576: dread d11/d13/d71/d43/f2e [0,4194304] 0 2024-09-04T16:30:25.748 INFO:tasks.workunit.client.0.smithi170.stdout:4/509: dread d1/d6/f12 [0,4194304] 0 2024-09-04T16:30:25.748 INFO:tasks.workunit.client.0.smithi170.stdout:0/577: readlink d11/d75/l8f 0 2024-09-04T16:30:25.749 INFO:tasks.workunit.client.0.smithi170.stdout:9/536: creat d2/d3d/d4d/d59/d85/f9a x:0 0 0 2024-09-04T16:30:25.751 INFO:tasks.workunit.client.0.smithi170.stdout:1/650: read - d9/d26/d77/fbb zero size 2024-09-04T16:30:25.752 INFO:tasks.workunit.client.0.smithi170.stdout:6/424: write d0/df/f28 [1340100,130428] 0 2024-09-04T16:30:25.753 INFO:tasks.workunit.client.0.smithi170.stdout:8/556: creat d6/d28/d16/d24/d83/fba x:0 0 0 2024-09-04T16:30:25.756 INFO:tasks.workunit.client.0.smithi170.stdout:2/599: rename d3/d7/f1d to d3/db/d1c/fc3 0 2024-09-04T16:30:25.760 INFO:tasks.workunit.client.0.smithi170.stdout:5/462: fsync d4/db/f1d 0 2024-09-04T16:30:25.761 INFO:tasks.workunit.client.0.smithi170.stdout:9/537: dwrite d2/d3d/d27/d2b/d34/f6b [0,4194304] 0 2024-09-04T16:30:25.761 INFO:tasks.workunit.client.0.smithi170.stdout:0/578: mkdir d11/d13/d4a/dc5/ddb 0 2024-09-04T16:30:25.763 INFO:tasks.workunit.client.0.smithi170.stdout:4/510: dread d1/d6/d22/f62 [0,4194304] 0 2024-09-04T16:30:25.764 INFO:tasks.workunit.client.0.smithi170.stdout:1/651: mkdir d9/d11/d85/dd8 0 2024-09-04T16:30:25.765 INFO:tasks.workunit.client.0.smithi170.stdout:0/579: fdatasync d11/d13/d4a/d66/fa0 0 2024-09-04T16:30:25.765 INFO:tasks.workunit.client.0.smithi170.stdout:6/425: creat d0/d15/d56/d6c/f81 x:0 0 0 2024-09-04T16:30:25.767 INFO:tasks.workunit.client.0.smithi170.stdout:0/580: chown d11/d8e/fab 1727989 1 2024-09-04T16:30:25.768 INFO:tasks.workunit.client.0.smithi170.stdout:8/557: dwrite d6/d28/d16/d52/d73/fb3 [0,4194304] 0 2024-09-04T16:30:25.769 INFO:tasks.workunit.client.0.smithi170.stdout:8/558: write d6/d28/d1a/f42 [874829,102669] 0 2024-09-04T16:30:25.772 INFO:tasks.workunit.client.0.smithi170.stdout:2/600: rename d3/d3c/d40/l43 to d3/d3c/lc4 0 2024-09-04T16:30:25.779 INFO:tasks.workunit.client.0.smithi170.stdout:9/538: mknod d2/d32/c9b 0 2024-09-04T16:30:25.780 INFO:tasks.workunit.client.0.smithi170.stdout:9/539: chown d2/d11/d23/f30 62 1 2024-09-04T16:30:25.781 INFO:tasks.workunit.client.0.smithi170.stdout:5/463: mknod d4/d3a/d74/d8b/c95 0 2024-09-04T16:30:25.783 INFO:tasks.workunit.client.0.smithi170.stdout:7/743: rmdir d12/d15/d71/d42/d79/d9d/dc9/de4 0 2024-09-04T16:30:25.786 INFO:tasks.workunit.client.0.smithi170.stdout:7/744: write d12/d15/d71/f3b [3437830,92912] 0 2024-09-04T16:30:25.790 INFO:tasks.workunit.client.0.smithi170.stdout:5/464: dwrite d4/db/f8a [0,4194304] 0 2024-09-04T16:30:25.792 INFO:tasks.workunit.client.0.smithi170.stdout:2/601: mkdir d3/db/dc5 0 2024-09-04T16:30:25.795 INFO:tasks.workunit.client.0.smithi170.stdout:4/511: dread d1/d6/d8/d20/d95/f4d [0,4194304] 0 2024-09-04T16:30:25.795 INFO:tasks.workunit.client.0.smithi170.stdout:9/540: creat d2/d3d/d27/d2b/d34/f9c x:0 0 0 2024-09-04T16:30:25.796 INFO:tasks.workunit.client.0.smithi170.stdout:9/541: fsync d2/d3d/d35/f86 0 2024-09-04T16:30:25.796 INFO:tasks.workunit.client.0.smithi170.stdout:4/512: chown d1/d6/l38 10592726 1 2024-09-04T16:30:25.799 INFO:tasks.workunit.client.0.smithi170.stdout:7/745: rmdir d12/d15/d71/d42/d79/d9d/dc9/df6 39 2024-09-04T16:30:25.801 INFO:tasks.workunit.client.0.smithi170.stdout:5/465: creat d4/d8/d1c/d26/d27/d43/d5b/f96 x:0 0 0 2024-09-04T16:30:25.802 INFO:tasks.workunit.client.0.smithi170.stdout:2/602: mknod d3/d7/cc6 0 2024-09-04T16:30:25.804 INFO:tasks.workunit.client.0.smithi170.stdout:9/542: write d2/d3d/d4d/f82 [534073,80369] 0 2024-09-04T16:30:25.806 INFO:tasks.workunit.client.0.smithi170.stdout:6/426: link d0/d15/d56/c4b d0/df/d1b/d3e/d47/d68/d2d/d67/c82 0 2024-09-04T16:30:25.808 INFO:tasks.workunit.client.0.smithi170.stdout:4/513: creat d1/d6/d2b/d47/d78/fba x:0 0 0 2024-09-04T16:30:25.809 INFO:tasks.workunit.client.0.smithi170.stdout:4/514: chown d1/d6/d8/d20/f88 15 1 2024-09-04T16:30:25.810 INFO:tasks.workunit.client.0.smithi170.stdout:9/543: dwrite d2/d32/f41 [0,4194304] 0 2024-09-04T16:30:25.811 INFO:tasks.workunit.client.0.smithi170.stdout:9/544: chown d2/d3d/f57 31524 1 2024-09-04T16:30:25.812 INFO:tasks.workunit.client.0.smithi170.stdout:9/545: fsync d2/d11/f24 0 2024-09-04T16:30:25.812 INFO:tasks.workunit.client.0.smithi170.stdout:1/652: rename d9/f13 to d9/d11/dae/d6a/fd9 0 2024-09-04T16:30:25.813 INFO:tasks.workunit.client.0.smithi170.stdout:7/746: creat d12/d15/d41/f100 x:0 0 0 2024-09-04T16:30:25.815 INFO:tasks.workunit.client.0.smithi170.stdout:5/466: fsync d4/f6 0 2024-09-04T16:30:25.817 INFO:tasks.workunit.client.0.smithi170.stdout:8/559: write d6/d28/d20/d5e/f5c [1937372,57273] 0 2024-09-04T16:30:25.820 INFO:tasks.workunit.client.0.smithi170.stdout:0/581: rename d11/d13/d2f/fc7 to d11/d13/d35/fdc 0 2024-09-04T16:30:25.823 INFO:tasks.workunit.client.0.smithi170.stdout:1/653: symlink d9/d11/d85/dc5/lda 0 2024-09-04T16:30:25.827 INFO:tasks.workunit.client.0.smithi170.stdout:2/603: write d3/d3c/f3a [1333444,71917] 0 2024-09-04T16:30:25.830 INFO:tasks.workunit.client.0.smithi170.stdout:9/546: creat d2/d3d/d27/d65/d56/d7a/f9d x:0 0 0 2024-09-04T16:30:25.831 INFO:tasks.workunit.client.0.smithi170.stdout:9/547: chown d2/d3d/d27/d2b/d34 791 1 2024-09-04T16:30:25.832 INFO:tasks.workunit.client.0.smithi170.stdout:9/548: write d2/d3d/d27/d65/d56/f60 [47446,87081] 0 2024-09-04T16:30:25.836 INFO:tasks.workunit.client.0.smithi170.stdout:3/455: rename d13/d14/d21/d4c/f55 to d13/d14/d1f/d87/f93 0 2024-09-04T16:30:25.839 INFO:tasks.workunit.client.0.smithi170.stdout:1/654: write d9/d11/f43 [5678484,24564] 0 2024-09-04T16:30:25.842 INFO:tasks.workunit.client.0.smithi170.stdout:4/515: dwrite d1/d6/d8/d20/d95/fac [0,4194304] 0 2024-09-04T16:30:25.843 INFO:tasks.workunit.client.0.smithi170.stdout:9/549: symlink d2/d3d/d27/d2b/d34/l9e 0 2024-09-04T16:30:25.850 INFO:tasks.workunit.client.0.smithi170.stdout:8/560: dwrite d6/d28/d5f/d70/f7b [0,4194304] 0 2024-09-04T16:30:25.851 INFO:tasks.workunit.client.0.smithi170.stdout:6/427: rename d0/df/d1f/c70 to d0/d15/c83 0 2024-09-04T16:30:25.852 INFO:tasks.workunit.client.0.smithi170.stdout:8/561: write d6/d28/d20/d5e/f47 [4535533,95431] 0 2024-09-04T16:30:25.853 INFO:tasks.workunit.client.0.smithi170.stdout:0/582: mkdir d11/d13/d4a/d66/d8c/ddd 0 2024-09-04T16:30:25.854 INFO:tasks.workunit.client.0.smithi170.stdout:6/428: read d0/f14 [2335352,82222] 0 2024-09-04T16:30:25.855 INFO:tasks.workunit.client.0.smithi170.stdout:2/604: write d3/db/df/f39 [72,70278] 0 2024-09-04T16:30:25.857 INFO:tasks.workunit.client.0.smithi170.stdout:1/655: symlink d9/d26/d77/ldb 0 2024-09-04T16:30:25.858 INFO:tasks.workunit.client.0.smithi170.stdout:9/550: chown d2/d11/f1b 1 1 2024-09-04T16:30:25.863 INFO:tasks.workunit.client.0.smithi170.stdout:3/456: creat d13/d14/d1d/d2d/d3d/f94 x:0 0 0 2024-09-04T16:30:25.866 INFO:tasks.workunit.client.0.smithi170.stdout:6/429: creat d0/d17/d31/d64/d30/f84 x:0 0 0 2024-09-04T16:30:25.867 INFO:tasks.workunit.client.0.smithi170.stdout:6/430: chown d0/df/d1b/l55 122411026 1 2024-09-04T16:30:25.869 INFO:tasks.workunit.client.0.smithi170.stdout:2/605: dread d3/db/df/f7b [0,4194304] 0 2024-09-04T16:30:25.871 INFO:tasks.workunit.client.0.smithi170.stdout:9/551: write d2/d11/f33 [4117962,10469] 0 2024-09-04T16:30:25.875 INFO:tasks.workunit.client.0.smithi170.stdout:3/457: write d13/d14/f32 [26313,32842] 0 2024-09-04T16:30:25.875 INFO:tasks.workunit.client.0.smithi170.stdout:8/562: creat d6/d28/d16/d77/d93/d95/db8/fbb x:0 0 0 2024-09-04T16:30:25.878 INFO:tasks.workunit.client.0.smithi170.stdout:6/431: creat d0/d15/d56/d6c/f85 x:0 0 0 2024-09-04T16:30:25.878 INFO:tasks.workunit.client.0.smithi170.stdout:0/583: write d11/d13/f20 [3895677,62329] 0 2024-09-04T16:30:25.879 INFO:tasks.workunit.client.0.smithi170.stdout:8/563: write d6/d28/d20/f48 [81452,62699] 0 2024-09-04T16:30:25.879 INFO:tasks.workunit.client.0.smithi170.stdout:4/516: dwrite d1/d6/f34 [4194304,4194304] 0 2024-09-04T16:30:25.884 INFO:tasks.workunit.client.0.smithi170.stdout:2/606: truncate d3/db/d1c/f2a 1892906 0 2024-09-04T16:30:25.884 INFO:tasks.workunit.client.0.smithi170.stdout:0/584: dread d11/d13/d2f/d3f/f59 [0,4194304] 0 2024-09-04T16:30:25.885 INFO:tasks.workunit.client.0.smithi170.stdout:5/467: rename d4/d8/d1c/d41/l63 to d4/l97 0 2024-09-04T16:30:25.890 INFO:tasks.workunit.client.0.smithi170.stdout:8/564: dwrite d6/d28/d16/d77/fb7 [0,4194304] 0 2024-09-04T16:30:25.892 INFO:tasks.workunit.client.0.smithi170.stdout:8/565: write d6/d28/d1a/f36 [1564048,40060] 0 2024-09-04T16:30:25.893 INFO:tasks.workunit.client.0.smithi170.stdout:9/552: symlink d2/l9f 0 2024-09-04T16:30:25.896 INFO:tasks.workunit.client.0.smithi170.stdout:6/432: dread d0/f5 [0,4194304] 0 2024-09-04T16:30:25.901 INFO:tasks.workunit.client.0.smithi170.stdout:1/656: rename d9/d11/d2e/cc4 to d9/d11/d2f/db9/cdc 0 2024-09-04T16:30:25.902 INFO:tasks.workunit.client.0.smithi170.stdout:5/468: symlink d4/d3a/d74/d8b/l98 0 2024-09-04T16:30:25.911 INFO:tasks.workunit.client.0.smithi170.stdout:9/553: creat d2/d3d/d27/fa0 x:0 0 0 2024-09-04T16:30:25.913 INFO:tasks.workunit.client.0.smithi170.stdout:9/554: write d2/d3d/d27/f53 [2940861,75259] 0 2024-09-04T16:30:25.915 INFO:tasks.workunit.client.0.smithi170.stdout:6/433: mknod d0/df/d1b/d3e/d47/d68/d2d/d67/d73/c86 0 2024-09-04T16:30:25.922 INFO:tasks.workunit.client.0.smithi170.stdout:8/566: dwrite d6/d28/d16/d24/d46/f74 [4194304,4194304] 0 2024-09-04T16:30:25.925 INFO:tasks.workunit.client.0.smithi170.stdout:0/585: dwrite d11/d13/f28 [0,4194304] 0 2024-09-04T16:30:25.925 INFO:tasks.workunit.client.0.smithi170.stdout:5/469: dread d4/d8/d1c/d26/d27/d43/f66 [0,4194304] 0 2024-09-04T16:30:25.936 INFO:tasks.workunit.client.0.smithi170.stdout:4/517: rmdir d1/d6/d8/d20/d35/d54/da1 0 2024-09-04T16:30:25.940 INFO:tasks.workunit.client.0.smithi170.stdout:9/555: creat d2/d11/d23/d95/fa1 x:0 0 0 2024-09-04T16:30:25.940 INFO:tasks.workunit.client.0.smithi170.stdout:9/556: chown d2/d3d/f8c 102405 1 2024-09-04T16:30:25.944 INFO:tasks.workunit.client.0.smithi170.stdout:8/567: symlink d6/d28/d1a/d81/lbc 0 2024-09-04T16:30:25.945 INFO:tasks.workunit.client.0.smithi170.stdout:0/586: write d11/d13/fcd [2327457,120531] 0 2024-09-04T16:30:25.946 INFO:tasks.workunit.client.0.smithi170.stdout:5/470: mknod d4/d8/c99 0 2024-09-04T16:30:25.947 INFO:tasks.workunit.client.0.smithi170.stdout:4/518: readlink d1/d6/d8/d20/l42 0 2024-09-04T16:30:25.948 INFO:tasks.workunit.client.0.smithi170.stdout:4/519: readlink d1/d6/d8/d20/d35/l4a 0 2024-09-04T16:30:25.949 INFO:tasks.workunit.client.0.smithi170.stdout:9/557: creat d2/d3d/d27/d65/d5b/fa2 x:0 0 0 2024-09-04T16:30:25.952 INFO:tasks.workunit.client.0.smithi170.stdout:3/458: rename d13/d14/d17/f52 to d13/d14/d21/d4d/f95 0 2024-09-04T16:30:25.955 INFO:tasks.workunit.client.0.smithi170.stdout:5/471: rmdir d4/d62 39 2024-09-04T16:30:25.956 INFO:tasks.workunit.client.0.smithi170.stdout:0/587: creat d11/d13/d71/fde x:0 0 0 2024-09-04T16:30:25.958 INFO:tasks.workunit.client.0.smithi170.stdout:2/607: rename d3/d3c/d40/d48/d68/fb2 to d3/db/df/fc7 0 2024-09-04T16:30:25.959 INFO:tasks.workunit.client.0.smithi170.stdout:9/558: dwrite d2/d3d/d6d/d79/f94 [0,4194304] 0 2024-09-04T16:30:25.959 INFO:tasks.workunit.client.0.smithi170.stdout:3/459: creat d13/d14/d1f/f96 x:0 0 0 2024-09-04T16:30:25.964 INFO:tasks.workunit.client.0.smithi170.stdout:5/472: unlink d4/d8/d1c/d26/d27/d43/d5b/f90 0 2024-09-04T16:30:25.965 INFO:tasks.workunit.client.0.smithi170.stdout:5/473: write d4/db/f1e [2124182,84797] 0 2024-09-04T16:30:25.966 INFO:tasks.workunit.client.0.smithi170.stdout:6/434: rename d0/d15/d56/l6e to d0/df/d1f/l87 0 2024-09-04T16:30:25.967 INFO:tasks.workunit.client.0.smithi170.stdout:2/608: fdatasync d3/db/d1c/fc3 0 2024-09-04T16:30:25.970 INFO:tasks.workunit.client.0.smithi170.stdout:4/520: truncate d1/d6/d8/d20/d35/d3e/d4e/d51/f5c 2298591 0 2024-09-04T16:30:25.971 INFO:tasks.workunit.client.0.smithi170.stdout:4/521: chown d1/d6/d2b/d47/d78/da7/fa8 57 1 2024-09-04T16:30:25.973 INFO:tasks.workunit.client.0.smithi170.stdout:4/522: write d1/d6/d8/d20/d95/fac [2787307,9390] 0 2024-09-04T16:30:25.974 INFO:tasks.workunit.client.0.smithi170.stdout:4/523: dread - d1/d6/d8/d20/d35/d3e/d60/f61 zero size 2024-09-04T16:30:25.976 INFO:tasks.workunit.client.0.smithi170.stdout:6/435: symlink d0/df/d1b/d3e/d47/d68/d2d/d67/d73/l88 0 2024-09-04T16:30:25.977 INFO:tasks.workunit.client.0.smithi170.stdout:3/460: mknod d13/d14/d1d/d2d/c97 0 2024-09-04T16:30:25.978 INFO:tasks.workunit.client.0.smithi170.stdout:2/609: creat d3/db/d1c/d47/d83/d9f/dae/fc8 x:0 0 0 2024-09-04T16:30:25.983 INFO:tasks.workunit.client.0.smithi170.stdout:6/436: dwrite d0/d15/d56/d6c/f76 [0,4194304] 0 2024-09-04T16:30:25.985 INFO:tasks.workunit.client.0.smithi170.stdout:4/524: rename d1/d6/d8/d20/d95/d36/f81 to d1/d6/d8/d20/d95/d36/fbb 0 2024-09-04T16:30:25.989 INFO:tasks.workunit.client.0.smithi170.stdout:4/525: dread d1/d6/f75 [0,4194304] 0 2024-09-04T16:30:25.991 INFO:tasks.workunit.client.0.smithi170.stdout:5/474: creat d4/d8/d1c/f9a x:0 0 0 2024-09-04T16:30:25.995 INFO:tasks.workunit.client.0.smithi170.stdout:3/461: mkdir d13/d14/d17/d1c/d98 0 2024-09-04T16:30:25.997 INFO:tasks.workunit.client.0.smithi170.stdout:9/559: getdents d2/d3d/d27/d65/d5b 0 2024-09-04T16:30:25.999 INFO:tasks.workunit.client.0.smithi170.stdout:2/610: rmdir d3/d4/d79 39 2024-09-04T16:30:26.001 INFO:tasks.workunit.client.0.smithi170.stdout:4/526: chown d1/d6/d8/d20/d95/c70 9186 1 2024-09-04T16:30:26.002 INFO:tasks.workunit.client.0.smithi170.stdout:4/527: chown d1/d6/d8/d20/d95/d36/d79/fb2 2162 1 2024-09-04T16:30:26.004 INFO:tasks.workunit.client.0.smithi170.stdout:0/588: truncate d11/d13/d2f/d3f/f63 215628 0 2024-09-04T16:30:26.006 INFO:tasks.workunit.client.0.smithi170.stdout:9/560: unlink d2/d3d/d27/d65/d5b/f7d 0 2024-09-04T16:30:26.008 INFO:tasks.workunit.client.0.smithi170.stdout:2/611: rename d3/db/d62/d6f/d93/d44 to d3/d4/d86/dc9 0 2024-09-04T16:30:26.009 INFO:tasks.workunit.client.0.smithi170.stdout:5/475: link d4/d8/d1c/d41/f4f d4/db/d51/d5e/d71/d84/f9b 0 2024-09-04T16:30:26.010 INFO:tasks.workunit.client.0.smithi170.stdout:0/589: dread d11/f25 [0,4194304] 0 2024-09-04T16:30:26.012 INFO:tasks.workunit.client.0.smithi170.stdout:6/437: creat d0/df/d1b/d3e/f89 x:0 0 0 2024-09-04T16:30:26.014 INFO:tasks.workunit.client.0.smithi170.stdout:3/462: fdatasync d13/d14/d21/d4c/f5d 0 2024-09-04T16:30:26.014 INFO:tasks.workunit.client.0.smithi170.stdout:3/463: dread - d13/d14/d1d/f61 zero size 2024-09-04T16:30:26.018 INFO:tasks.workunit.client.0.smithi170.stdout:2/612: mknod d3/db/d1c/d47/d83/d9f/dae/cca 0 2024-09-04T16:30:26.027 INFO:tasks.workunit.client.0.smithi170.stdout:4/528: symlink d1/d6/d8/d20/dae/lbc 0 2024-09-04T16:30:26.027 INFO:tasks.workunit.client.0.smithi170.stdout:4/529: chown d1/f1e 726 1 2024-09-04T16:30:26.028 INFO:tasks.workunit.client.0.smithi170.stdout:6/438: rename d0/df/d1b to d0/df/d1b/d3e/d8a 22 2024-09-04T16:30:26.029 INFO:tasks.workunit.client.0.smithi170.stdout:4/530: truncate d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/fa4 614294 0 2024-09-04T16:30:26.030 INFO:tasks.workunit.client.0.smithi170.stdout:3/464: creat d13/d14/d21/d4c/f99 x:0 0 0 2024-09-04T16:30:26.034 INFO:tasks.workunit.client.0.smithi170.stdout:2/613: creat d3/db/d62/fcb x:0 0 0 2024-09-04T16:30:26.037 INFO:tasks.workunit.client.0.smithi170.stdout:0/590: mknod d11/d13/d4a/d66/d8c/da8/dda/cdf 0 2024-09-04T16:30:26.037 INFO:tasks.workunit.client.0.smithi170.stdout:2/614: write d3/d3c/f3a [655926,87892] 0 2024-09-04T16:30:26.039 INFO:tasks.workunit.client.0.smithi170.stdout:4/531: dwrite d1/d6/d8/d20/d95/d36/d79/fab [0,4194304] 0 2024-09-04T16:30:26.041 INFO:tasks.workunit.client.0.smithi170.stdout:9/561: write d2/d3d/d27/d65/d5b/f75 [311533,125974] 0 2024-09-04T16:30:26.043 INFO:tasks.workunit.client.0.smithi170.stdout:4/532: stat d1/d6/d8/d20/d35/d3e/d4e/d51/f76 0 2024-09-04T16:30:26.043 INFO:tasks.workunit.client.0.smithi170.stdout:5/476: dwrite d4/db/fe [0,4194304] 0 2024-09-04T16:30:26.048 INFO:tasks.workunit.client.0.smithi170.stdout:3/465: creat d13/d14/d1f/d7a/f9a x:0 0 0 2024-09-04T16:30:26.051 INFO:tasks.workunit.client.0.smithi170.stdout:4/533: creat d1/d6/d8/d20/d35/d3e/d60/fbd x:0 0 0 2024-09-04T16:30:26.052 INFO:tasks.workunit.client.0.smithi170.stdout:4/534: dread - d1/d6/d2b/d47/d78/f90 zero size 2024-09-04T16:30:26.054 INFO:tasks.workunit.client.0.smithi170.stdout:2/615: creat d3/db/dc5/fcc x:0 0 0 2024-09-04T16:30:26.054 INFO:tasks.workunit.client.0.smithi170.stdout:4/535: fdatasync d1/d6/d8/d20/d95/f69 0 2024-09-04T16:30:26.056 INFO:tasks.workunit.client.0.smithi170.stdout:5/477: fsync d4/d8/d1c/d26/d27/d48/d7c/f8d 0 2024-09-04T16:30:26.056 INFO:tasks.workunit.client.0.smithi170.stdout:9/562: symlink d2/la3 0 2024-09-04T16:30:26.057 INFO:tasks.workunit.client.0.smithi170.stdout:9/563: write d2/d3d/d35/f86 [4400914,123580] 0 2024-09-04T16:30:26.059 INFO:tasks.workunit.client.0.smithi170.stdout:9/564: write d2/d3d/d4d/f82 [87325,55836] 0 2024-09-04T16:30:26.060 INFO:tasks.workunit.client.0.smithi170.stdout:0/591: getdents d11/d75/dce 0 2024-09-04T16:30:26.061 INFO:tasks.workunit.client.0.smithi170.stdout:9/565: write d2/d3d/d27/d2b/d34/f49 [4212185,126981] 0 2024-09-04T16:30:26.066 INFO:tasks.workunit.client.0.smithi170.stdout:5/478: creat d4/d8/d1c/d26/d27/d43/d5b/f9c x:0 0 0 2024-09-04T16:30:26.068 INFO:tasks.workunit.client.0.smithi170.stdout:5/479: chown d4/d8/d1c/d23/l75 18170984 1 2024-09-04T16:30:26.068 INFO:tasks.workunit.client.0.smithi170.stdout:4/536: write d1/d6/d8/d20/d95/f64 [347747,37925] 0 2024-09-04T16:30:26.068 INFO:tasks.workunit.client.0.smithi170.stdout:3/466: link d13/f25 d13/f9b 0 2024-09-04T16:30:26.068 INFO:tasks.workunit.client.0.smithi170.stdout:9/566: dwrite d2/d32/f76 [0,4194304] 0 2024-09-04T16:30:26.070 INFO:tasks.workunit.client.0.smithi170.stdout:4/537: write d1/f1e [3733556,95058] 0 2024-09-04T16:30:26.072 INFO:tasks.workunit.client.0.smithi170.stdout:2/616: symlink d3/d3c/dc1/lcd 0 2024-09-04T16:30:26.074 INFO:tasks.workunit.client.0.smithi170.stdout:3/467: mknod d13/d14/d1f/d87/c9c 0 2024-09-04T16:30:26.074 INFO:tasks.workunit.client.0.smithi170.stdout:5/480: creat d4/d8/d1c/d26/d27/d43/d5b/f9d x:0 0 0 2024-09-04T16:30:26.075 INFO:tasks.workunit.client.0.smithi170.stdout:0/592: fdatasync d11/d13/d36/f7a 0 2024-09-04T16:30:26.132 INFO:tasks.workunit.client.0.smithi170.stdout:2/617: symlink d3/d3c/dc1/lce 0 2024-09-04T16:30:26.132 INFO:tasks.workunit.client.0.smithi170.stdout:3/468: dread - d13/d14/d1d/d2d/f34 zero size 2024-09-04T16:30:26.133 INFO:tasks.workunit.client.0.smithi170.stdout:3/469: stat d13/d14/d17/f42 0 2024-09-04T16:30:26.134 INFO:tasks.workunit.client.0.smithi170.stdout:2/618: write d3/db/df/f39 [773576,105669] 0 2024-09-04T16:30:26.134 INFO:tasks.workunit.client.0.smithi170.stdout:3/470: chown d13/d14/d1d/f23 291346 1 2024-09-04T16:30:26.139 INFO:tasks.workunit.client.0.smithi170.stdout:4/538: truncate d1/d6/f34 1520306 0 2024-09-04T16:30:26.141 INFO:tasks.workunit.client.0.smithi170.stdout:5/481: write d4/d8/d1c/d26/d27/d43/f66 [326398,75026] 0 2024-09-04T16:30:26.144 INFO:tasks.workunit.client.0.smithi170.stdout:9/567: getdents d2/d11/d23/d95 0 2024-09-04T16:30:26.150 INFO:tasks.workunit.client.0.smithi170.stdout:9/568: dread d2/d3d/d27/d2b/d34/f6b [0,4194304] 0 2024-09-04T16:30:26.150 INFO:tasks.workunit.client.0.smithi170.stdout:5/482: creat d4/d3a/f9e x:0 0 0 2024-09-04T16:30:26.151 INFO:tasks.workunit.client.0.smithi170.stdout:3/471: write d13/f1a [1114229,57582] 0 2024-09-04T16:30:26.152 INFO:tasks.workunit.client.0.smithi170.stdout:3/472: chown d13/d14/d1f/d87/c9c 2199085 1 2024-09-04T16:30:26.159 INFO:tasks.workunit.client.0.smithi170.stdout:9/569: creat d2/d11/d23/d95/fa4 x:0 0 0 2024-09-04T16:30:26.162 INFO:tasks.workunit.client.0.smithi170.stdout:0/593: rename d11/c41 to d11/d13/ce0 0 2024-09-04T16:30:26.163 INFO:tasks.workunit.client.0.smithi170.stdout:4/539: truncate d1/d6/d8/d20/d35/d3e/d4e/d51/f91 378998 0 2024-09-04T16:30:26.171 INFO:tasks.workunit.client.0.smithi170.stdout:2/619: rename d3/db/d62/d6f/d93 to d3/d4/d14/dcf 0 2024-09-04T16:30:26.174 INFO:tasks.workunit.client.0.smithi170.stdout:0/594: unlink d11/d13/d4a/d66/d6d/dcc/cd1 0 2024-09-04T16:30:26.177 INFO:tasks.workunit.client.0.smithi170.stdout:4/540: unlink d1/d6/d8/d20/d95/f64 0 2024-09-04T16:30:26.182 INFO:tasks.workunit.client.0.smithi170.stdout:2/620: rmdir d3 39 2024-09-04T16:30:26.183 INFO:tasks.workunit.client.0.smithi170.stdout:0/595: mknod d11/d75/dce/ce1 0 2024-09-04T16:30:26.185 INFO:tasks.workunit.client.0.smithi170.stdout:3/473: creat d13/d14/d21/f9d x:0 0 0 2024-09-04T16:30:26.186 INFO:tasks.workunit.client.0.smithi170.stdout:3/474: readlink d13/d14/d21/d46/l56 0 2024-09-04T16:30:26.190 INFO:tasks.workunit.client.0.smithi170.stdout:3/475: dread d13/f84 [0,4194304] 0 2024-09-04T16:30:26.190 INFO:tasks.workunit.client.0.smithi170.stdout:4/541: write d1/d6/d22/f62 [3332713,97073] 0 2024-09-04T16:30:26.191 INFO:tasks.workunit.client.0.smithi170.stdout:3/476: write d13/d14/d21/d46/f92 [907321,16483] 0 2024-09-04T16:30:26.192 INFO:tasks.workunit.client.0.smithi170.stdout:4/542: readlink d1/d6/d8/d20/d95/l77 0 2024-09-04T16:30:26.192 INFO:tasks.workunit.client.0.smithi170.stdout:5/483: getdents d4/d8/d1c/d26/d27 0 2024-09-04T16:30:26.194 INFO:tasks.workunit.client.0.smithi170.stdout:5/484: fsync d4/d8/d1c/d41/f54 0 2024-09-04T16:30:26.195 INFO:tasks.workunit.client.0.smithi170.stdout:3/477: read d13/d14/d21/f36 [3217372,55711] 0 2024-09-04T16:30:26.210 INFO:tasks.workunit.client.0.smithi170.stdout:2/621: dread d3/d3c/d40/d48/f5b [0,4194304] 0 2024-09-04T16:30:26.251 INFO:tasks.workunit.client.0.smithi170.stdout:4/543: write d1/d6/d22/fad [957316,86787] 0 2024-09-04T16:30:26.253 INFO:tasks.workunit.client.0.smithi170.stdout:9/570: truncate d2/d3d/d27/f53 4252085 0 2024-09-04T16:30:26.254 INFO:tasks.workunit.client.0.smithi170.stdout:9/571: chown d2/d3d/d27/d65/d5b/f83 227611 1 2024-09-04T16:30:26.255 INFO:tasks.workunit.client.0.smithi170.stdout:9/572: readlink d2/d11/d23/l51 0 2024-09-04T16:30:26.258 INFO:tasks.workunit.client.0.smithi170.stdout:3/478: rename d13/d14/d1d/d2d/d3d to d13/d14/d21/d46/d9e 0 2024-09-04T16:30:26.260 INFO:tasks.workunit.client.0.smithi170.stdout:2/622: mkdir d3/db/d1c/db8/dd0 0 2024-09-04T16:30:26.262 INFO:tasks.workunit.client.0.smithi170.stdout:5/485: symlink d4/d8/d1c/d26/l9f 0 2024-09-04T16:30:26.264 INFO:tasks.workunit.client.0.smithi170.stdout:9/573: mkdir d2/d3d/d27/d65/d56/d7a/da5 0 2024-09-04T16:30:26.267 INFO:tasks.workunit.client.0.smithi170.stdout:4/544: dread d1/d6/d8/d20/d35/d3e/d43/f5f [4194304,4194304] 0 2024-09-04T16:30:26.269 INFO:tasks.workunit.client.0.smithi170.stdout:2/623: unlink d3/d3c/dc1/lcd 0 2024-09-04T16:30:26.270 INFO:tasks.workunit.client.0.smithi170.stdout:2/624: stat d3/db/df/d45 0 2024-09-04T16:30:26.273 INFO:tasks.workunit.client.0.smithi170.stdout:3/479: dwrite d13/d14/d21/f36 [0,4194304] 0 2024-09-04T16:30:26.273 INFO:tasks.workunit.client.0.smithi170.stdout:2/625: write d3/db/d62/d6f/f9d [107161,37853] 0 2024-09-04T16:30:26.274 INFO:tasks.workunit.client.0.smithi170.stdout:0/596: dwrite d11/d13/d71/f90 [0,4194304] 0 2024-09-04T16:30:26.274 INFO:tasks.workunit.client.0.smithi170.stdout:2/626: readlink d3/d7/l90 0 2024-09-04T16:30:26.275 INFO:tasks.workunit.client.0.smithi170.stdout:9/574: mknod d2/d3d/d27/d65/d66/ca6 0 2024-09-04T16:30:26.278 INFO:tasks.workunit.client.0.smithi170.stdout:4/545: mknod d1/d6/d8/d20/dae/cbe 0 2024-09-04T16:30:26.281 INFO:tasks.workunit.client.0.smithi170.stdout:2/627: read d3/d3c/d40/d48/f5e [1070407,23430] 0 2024-09-04T16:30:26.283 INFO:tasks.workunit.client.0.smithi170.stdout:0/597: creat d11/d75/fe2 x:0 0 0 2024-09-04T16:30:26.285 INFO:tasks.workunit.client.0.smithi170.stdout:3/480: dwrite d13/d14/d21/d4c/f5c [0,4194304] 0 2024-09-04T16:30:26.287 INFO:tasks.workunit.client.0.smithi170.stdout:9/575: creat d2/d3d/d27/d65/fa7 x:0 0 0 2024-09-04T16:30:26.288 INFO:tasks.workunit.client.0.smithi170.stdout:3/481: dread - d13/d14/d1d/d2d/d6c/f70 zero size 2024-09-04T16:30:26.291 INFO:tasks.workunit.client.0.smithi170.stdout:0/598: fsync d11/d13/d4a/d66/d6d/f91 0 2024-09-04T16:30:26.296 INFO:tasks.workunit.client.0.smithi170.stdout:2/628: creat d3/d4/d86/dc9/fd1 x:0 0 0 2024-09-04T16:30:26.296 INFO:tasks.workunit.client.0.smithi170.stdout:2/629: chown d3/d4/f20 3999722 1 2024-09-04T16:30:26.300 INFO:tasks.workunit.client.0.smithi170.stdout:5/486: write d4/d8/d1c/d29/f67 [5194358,58616] 0 2024-09-04T16:30:26.300 INFO:tasks.workunit.client.0.smithi170.stdout:5/487: readlink d4/d8/d1c/d23/l35 0 2024-09-04T16:30:26.302 INFO:tasks.workunit.client.0.smithi170.stdout:0/599: creat d11/d13/d4a/d66/d6d/fe3 x:0 0 0 2024-09-04T16:30:26.310 INFO:tasks.workunit.client.0.smithi170.stdout:9/576: link d2/d11/f36 d2/fa8 0 2024-09-04T16:30:26.311 INFO:tasks.workunit.client.0.smithi170.stdout:9/577: fdatasync d2/d11/f24 0 2024-09-04T16:30:26.314 INFO:tasks.workunit.client.0.smithi170.stdout:3/482: creat d13/d14/d17/f9f x:0 0 0 2024-09-04T16:30:26.315 INFO:tasks.workunit.client.0.smithi170.stdout:4/546: write d1/f31 [1993271,92784] 0 2024-09-04T16:30:26.316 INFO:tasks.workunit.client.0.smithi170.stdout:2/630: link d3/d4/d14/c6c d3/db/d62/cd2 0 2024-09-04T16:30:26.317 INFO:tasks.workunit.client.0.smithi170.stdout:4/547: write d1/d6/d8/f8a [157879,79949] 0 2024-09-04T16:30:26.317 INFO:tasks.workunit.client.0.smithi170.stdout:9/578: rmdir d2/d3d/d27/d2b/d34 39 2024-09-04T16:30:26.318 INFO:tasks.workunit.client.0.smithi170.stdout:5/488: getdents d4/db/d51/d5e 0 2024-09-04T16:30:26.319 INFO:tasks.workunit.client.0.smithi170.stdout:3/483: creat d13/d14/d1d/d2d/d58/fa0 x:0 0 0 2024-09-04T16:30:26.319 INFO:tasks.workunit.client.0.smithi170.stdout:4/548: chown d1/d6/d8/d20/d95/l77 4031825 1 2024-09-04T16:30:26.320 INFO:tasks.workunit.client.0.smithi170.stdout:2/631: mknod d3/db/dc5/cd3 0 2024-09-04T16:30:26.320 INFO:tasks.workunit.client.0.smithi170.stdout:5/489: stat d4/d8/d1c/d26/d27/d48/d7c 0 2024-09-04T16:30:26.322 INFO:tasks.workunit.client.0.smithi170.stdout:0/600: dread d11/d13/d71/f96 [0,4194304] 0 2024-09-04T16:30:26.322 INFO:tasks.workunit.client.0.smithi170.stdout:3/484: chown d13/d14/d1f/d7a/f9a 3908 1 2024-09-04T16:30:26.324 INFO:tasks.workunit.client.0.smithi170.stdout:3/485: chown d13/f84 24078 1 2024-09-04T16:30:26.324 INFO:tasks.workunit.client.0.smithi170.stdout:5/490: write d4/d8/d1c/d26/d27/d43/f44 [3311160,89537] 0 2024-09-04T16:30:26.324 INFO:tasks.workunit.client.0.smithi170.stdout:2/632: write d3/d3c/d40/d48/f5e [3998827,49523] 0 2024-09-04T16:30:26.327 INFO:tasks.workunit.client.0.smithi170.stdout:0/601: creat d11/d75/fe4 x:0 0 0 2024-09-04T16:30:26.329 INFO:tasks.workunit.client.0.smithi170.stdout:4/549: mkdir d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/dbf 0 2024-09-04T16:30:26.331 INFO:tasks.workunit.client.0.smithi170.stdout:3/486: creat d13/d14/d1f/d87/fa1 x:0 0 0 2024-09-04T16:30:26.334 INFO:tasks.workunit.client.0.smithi170.stdout:9/579: truncate d2/d3d/d27/d65/d5b/f75 69521 0 2024-09-04T16:30:26.335 INFO:tasks.workunit.client.0.smithi170.stdout:0/602: mkdir d11/d13/d36/de5 0 2024-09-04T16:30:26.337 INFO:tasks.workunit.client.0.smithi170.stdout:4/550: creat d1/d6/d8/d20/d35/d54/d96/fc0 x:0 0 0 2024-09-04T16:30:26.340 INFO:tasks.workunit.client.0.smithi170.stdout:5/491: symlink d4/db/d51/d5e/d71/d84/d93/la0 0 2024-09-04T16:30:26.341 INFO:tasks.workunit.client.0.smithi170.stdout:2/633: dread d3/d4/f20 [4194304,4194304] 0 2024-09-04T16:30:26.341 INFO:tasks.workunit.client.0.smithi170.stdout:9/580: rename d2/l9f to d2/d3d/d27/la9 0 2024-09-04T16:30:26.342 INFO:tasks.workunit.client.0.smithi170.stdout:5/492: write d4/d3a/f9e [625853,80869] 0 2024-09-04T16:30:26.344 INFO:tasks.workunit.client.0.smithi170.stdout:5/493: chown d4/d8/d1c/d26/d27/d48/d5a 932766460 1 2024-09-04T16:30:26.345 INFO:tasks.workunit.client.0.smithi170.stdout:5/494: dread - d4/d8/d1c/f6d zero size 2024-09-04T16:30:26.345 INFO:tasks.workunit.client.0.smithi170.stdout:7/747: sync 2024-09-04T16:30:26.350 INFO:tasks.workunit.client.0.smithi170.stdout:0/603: dread d11/d13/d2f/d3f/f65 [0,4194304] 0 2024-09-04T16:30:26.356 INFO:tasks.workunit.client.0.smithi170.stdout:5/495: rename d4/d3a/f4d to d4/d3a/d74/fa1 0 2024-09-04T16:30:26.357 INFO:tasks.workunit.client.0.smithi170.stdout:3/487: dwrite d13/d14/d1d/d2d/d58/f47 [0,4194304] 0 2024-09-04T16:30:26.358 INFO:tasks.workunit.client.0.smithi170.stdout:7/748: mknod d12/d16/d8d/c101 0 2024-09-04T16:30:26.362 INFO:tasks.workunit.client.0.smithi170.stdout:9/581: unlink d2/d11/d23/l39 0 2024-09-04T16:30:26.362 INFO:tasks.workunit.client.0.smithi170.stdout:9/582: stat d2/d11/f24 0 2024-09-04T16:30:26.363 INFO:tasks.workunit.client.0.smithi170.stdout:3/488: dread d13/d14/d17/f42 [0,4194304] 0 2024-09-04T16:30:26.365 INFO:tasks.workunit.client.0.smithi170.stdout:2/634: mkdir d3/d4/d14/dcf/dba/dd4 0 2024-09-04T16:30:26.370 INFO:tasks.workunit.client.0.smithi170.stdout:4/551: dwrite d1/d6/d8/f9a [0,4194304] 0 2024-09-04T16:30:26.372 INFO:tasks.workunit.client.0.smithi170.stdout:4/552: write d1/d6/d8/d20/d35/d54/d96/fc0 [384387,88576] 0 2024-09-04T16:30:26.376 INFO:tasks.workunit.client.0.smithi170.stdout:9/583: mknod d2/d3d/d27/caa 0 2024-09-04T16:30:26.379 INFO:tasks.workunit.client.0.smithi170.stdout:9/584: truncate d2/d3d/d27/d65/fa7 379963 0 2024-09-04T16:30:26.382 INFO:tasks.workunit.client.0.smithi170.stdout:0/604: dwrite d11/d13/d71/f4c [0,4194304] 0 2024-09-04T16:30:26.385 INFO:tasks.workunit.client.0.smithi170.stdout:4/553: mkdir d1/d6/d8/d20/dc1 0 2024-09-04T16:30:26.386 INFO:tasks.workunit.client.0.smithi170.stdout:7/749: getdents d12/d16/d1d/df5 0 2024-09-04T16:30:26.390 INFO:tasks.workunit.client.0.smithi170.stdout:2/635: unlink d3/db/df/l28 0 2024-09-04T16:30:26.391 INFO:tasks.workunit.client.0.smithi170.stdout:3/489: mkdir d13/d14/d21/d4d/d4e/d88/da2 0 2024-09-04T16:30:26.393 INFO:tasks.workunit.client.0.smithi170.stdout:9/585: creat d2/d3d/d27/d65/d56/fab x:0 0 0 2024-09-04T16:30:26.396 INFO:tasks.workunit.client.0.smithi170.stdout:0/605: creat d11/d13/d4a/d66/d8c/da8/dda/fe6 x:0 0 0 2024-09-04T16:30:26.397 INFO:tasks.workunit.client.0.smithi170.stdout:3/490: dread d13/d14/d1d/f28 [0,4194304] 0 2024-09-04T16:30:26.400 INFO:tasks.workunit.client.0.smithi170.stdout:4/554: dread d1/d6/d8/f9 [0,4194304] 0 2024-09-04T16:30:26.401 INFO:tasks.workunit.client.0.smithi170.stdout:9/586: mknod d2/d3d/d4d/d59/cac 0 2024-09-04T16:30:26.405 INFO:tasks.workunit.client.0.smithi170.stdout:0/606: dwrite d11/d13/d4a/fd2 [0,4194304] 0 2024-09-04T16:30:26.406 INFO:tasks.workunit.client.0.smithi170.stdout:0/607: stat d11/d13/d71/d43 0 2024-09-04T16:30:26.409 INFO:tasks.workunit.client.0.smithi170.stdout:6/439: sync 2024-09-04T16:30:26.409 INFO:tasks.workunit.client.0.smithi170.stdout:1/657: sync 2024-09-04T16:30:26.409 INFO:tasks.workunit.client.0.smithi170.stdout:8/568: sync 2024-09-04T16:30:26.409 INFO:tasks.workunit.client.0.smithi170.stdout:7/750: mknod d12/d15/c102 0 2024-09-04T16:30:26.410 INFO:tasks.workunit.client.0.smithi170.stdout:2/636: dread d3/d3c/d40/d48/f8c [0,4194304] 0 2024-09-04T16:30:26.411 INFO:tasks.workunit.client.0.smithi170.stdout:1/658: fdatasync d9/d11/d2f/d7f/fd7 0 2024-09-04T16:30:26.413 INFO:tasks.workunit.client.0.smithi170.stdout:5/496: getdents d4/d8/d1c/d26/d27 0 2024-09-04T16:30:26.414 INFO:tasks.workunit.client.0.smithi170.stdout:9/587: creat d2/d3d/d35/fad x:0 0 0 2024-09-04T16:30:26.415 INFO:tasks.workunit.client.0.smithi170.stdout:3/491: dread d13/d14/d21/f2e [0,4194304] 0 2024-09-04T16:30:26.416 INFO:tasks.workunit.client.0.smithi170.stdout:9/588: dread - d2/d3d/d35/fad zero size 2024-09-04T16:30:26.416 INFO:tasks.workunit.client.0.smithi170.stdout:3/492: chown d13/d14/d21 196497 1 2024-09-04T16:30:26.417 INFO:tasks.workunit.client.0.smithi170.stdout:9/589: dread - d2/d3d/d6d/d79/f96 zero size 2024-09-04T16:30:26.417 INFO:tasks.workunit.client.0.smithi170.stdout:8/569: creat d6/d28/d5f/d85/fbd x:0 0 0 2024-09-04T16:30:26.419 INFO:tasks.workunit.client.0.smithi170.stdout:6/440: write d0/df/d1b/d3e/d47/d68/f61 [696066,116048] 0 2024-09-04T16:30:26.420 INFO:tasks.workunit.client.0.smithi170.stdout:1/659: creat d9/d34/d5f/fdd x:0 0 0 2024-09-04T16:30:26.421 INFO:tasks.workunit.client.0.smithi170.stdout:4/555: getdents d1/d6/d22/d93 0 2024-09-04T16:30:26.421 INFO:tasks.workunit.client.0.smithi170.stdout:5/497: rmdir d4/d8/d1c/d23 39 2024-09-04T16:30:26.421 INFO:tasks.workunit.client.0.smithi170.stdout:8/570: truncate d6/d28/d16/d24/d46/fb2 133216 0 2024-09-04T16:30:26.423 INFO:tasks.workunit.client.0.smithi170.stdout:0/608: symlink d11/d13/le7 0 2024-09-04T16:30:26.425 INFO:tasks.workunit.client.0.smithi170.stdout:7/751: mknod d12/d15/c103 0 2024-09-04T16:30:26.426 INFO:tasks.workunit.client.0.smithi170.stdout:7/752: fdatasync d12/d15/d68/fac 0 2024-09-04T16:30:26.430 INFO:tasks.workunit.client.0.smithi170.stdout:1/660: mkdir d9/d11/d2f/d6b/d7d/dde 0 2024-09-04T16:30:26.430 INFO:tasks.workunit.client.0.smithi170.stdout:6/441: dwrite d0/f5 [0,4194304] 0 2024-09-04T16:30:26.431 INFO:tasks.workunit.client.0.smithi170.stdout:1/661: fdatasync d9/d11/d2f/d7f/fd7 0 2024-09-04T16:30:26.433 INFO:tasks.workunit.client.0.smithi170.stdout:5/498: chown d4/d8/l2e 63 1 2024-09-04T16:30:26.436 INFO:tasks.workunit.client.0.smithi170.stdout:3/493: mkdir d13/d14/da3 0 2024-09-04T16:30:26.436 INFO:tasks.workunit.client.0.smithi170.stdout:5/499: write d4/db/f34 [4604396,112596] 0 2024-09-04T16:30:26.439 INFO:tasks.workunit.client.0.smithi170.stdout:4/556: rename d1/d6/d8/c1f to d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/dbf/cc2 0 2024-09-04T16:30:26.440 INFO:tasks.workunit.client.0.smithi170.stdout:6/442: dwrite d0/f14 [0,4194304] 0 2024-09-04T16:30:26.441 INFO:tasks.workunit.client.0.smithi170.stdout:4/557: chown d1/d6/d8/d20/d35/d3e/d43 1124060 1 2024-09-04T16:30:26.444 INFO:tasks.workunit.client.0.smithi170.stdout:6/443: truncate d0/d15/d56/d6d/f74 1325593 0 2024-09-04T16:30:26.451 INFO:tasks.workunit.client.0.smithi170.stdout:9/590: link d2/d3d/d27/d65/d56/l5e d2/d3d/d4d/d59/d85/lae 0 2024-09-04T16:30:26.452 INFO:tasks.workunit.client.0.smithi170.stdout:9/591: chown d2/d3d/d27/f64 346020 1 2024-09-04T16:30:26.453 INFO:tasks.workunit.client.0.smithi170.stdout:1/662: mknod d9/d11/d85/dd8/cdf 0 2024-09-04T16:30:26.454 INFO:tasks.workunit.client.0.smithi170.stdout:3/494: dread d13/f5f [0,4194304] 0 2024-09-04T16:30:26.457 INFO:tasks.workunit.client.0.smithi170.stdout:8/571: creat d6/d28/d16/d24/fbe x:0 0 0 2024-09-04T16:30:26.460 INFO:tasks.workunit.client.0.smithi170.stdout:0/609: rmdir d11/d13/d4a/dc5/ddb 0 2024-09-04T16:30:26.461 INFO:tasks.workunit.client.0.smithi170.stdout:1/663: dwrite d9/d26/d77/d83/fa2 [0,4194304] 0 2024-09-04T16:30:26.462 INFO:tasks.workunit.client.0.smithi170.stdout:7/753: fsync d12/d5a/fc8 0 2024-09-04T16:30:26.463 INFO:tasks.workunit.client.0.smithi170.stdout:0/610: write d11/d13/d4a/d66/d8c/da8/fd9 [75203,2930] 0 2024-09-04T16:30:26.464 INFO:tasks.workunit.client.0.smithi170.stdout:5/500: write d4/d8/d1c/d26/d27/f38 [1027718,77914] 0 2024-09-04T16:30:26.468 INFO:tasks.workunit.client.0.smithi170.stdout:4/558: rename d1/d6/f14 to d1/d6/d8/d20/d35/d3e/d60/fc3 0 2024-09-04T16:30:26.470 INFO:tasks.workunit.client.0.smithi170.stdout:6/444: unlink d0/df/d1f/l87 0 2024-09-04T16:30:26.480 INFO:tasks.workunit.client.0.smithi170.stdout:3/495: mkdir d13/d14/d1d/da4 0 2024-09-04T16:30:26.482 INFO:tasks.workunit.client.0.smithi170.stdout:7/754: creat d12/d15/d71/d42/d81/d5c/f104 x:0 0 0 2024-09-04T16:30:26.485 INFO:tasks.workunit.client.0.smithi170.stdout:7/755: write d12/d15/d71/d42/d79/fd5 [725553,39689] 0 2024-09-04T16:30:26.485 INFO:tasks.workunit.client.0.smithi170.stdout:0/611: creat d11/d13/d4a/d66/d8c/da8/dda/fe8 x:0 0 0 2024-09-04T16:30:26.486 INFO:tasks.workunit.client.0.smithi170.stdout:0/612: stat d11/d8e/fb9 0 2024-09-04T16:30:26.487 INFO:tasks.workunit.client.0.smithi170.stdout:7/756: chown d12/d15/d41/fb0 36324837 1 2024-09-04T16:30:26.488 INFO:tasks.workunit.client.0.smithi170.stdout:4/559: symlink d1/d6/d8/d20/d35/d3e/d60/lc4 0 2024-09-04T16:30:26.489 INFO:tasks.workunit.client.0.smithi170.stdout:0/613: dread - d11/d13/d35/fc2 zero size 2024-09-04T16:30:26.489 INFO:tasks.workunit.client.0.smithi170.stdout:3/496: dwrite d13/d14/d1f/f72 [0,4194304] 0 2024-09-04T16:30:26.489 INFO:tasks.workunit.client.0.smithi170.stdout:6/445: creat d0/d15/d56/f8b x:0 0 0 2024-09-04T16:30:26.495 INFO:tasks.workunit.client.0.smithi170.stdout:4/560: dread d1/d6/d2b/d47/d78/da7/fa8 [0,4194304] 0 2024-09-04T16:30:26.496 INFO:tasks.workunit.client.0.smithi170.stdout:1/664: dwrite d9/d11/d2f/f64 [0,4194304] 0 2024-09-04T16:30:26.499 INFO:tasks.workunit.client.0.smithi170.stdout:4/561: write d1/d6/d2b/d47/d78/f7f [2960670,34770] 0 2024-09-04T16:30:26.503 INFO:tasks.workunit.client.0.smithi170.stdout:0/614: creat d11/d13/d4a/d66/d6d/fe9 x:0 0 0 2024-09-04T16:30:26.504 INFO:tasks.workunit.client.0.smithi170.stdout:6/446: creat d0/df/d1b/d3e/d47/d68/d2d/f8c x:0 0 0 2024-09-04T16:30:26.506 INFO:tasks.workunit.client.0.smithi170.stdout:6/447: write d0/d17/d31/d64/f65 [4444048,18358] 0 2024-09-04T16:30:26.507 INFO:tasks.workunit.client.0.smithi170.stdout:9/592: rename d2/d3d/d27/d2b/d34 to d2/d3d/d27/d2b/daf 0 2024-09-04T16:30:26.508 INFO:tasks.workunit.client.0.smithi170.stdout:3/497: truncate d13/d14/d21/d46/d9e/f5a 1022238 0 2024-09-04T16:30:26.509 INFO:tasks.workunit.client.0.smithi170.stdout:5/501: link d4/d8/d1c/d26/d27/d43/d5b/l64 d4/d8/la2 0 2024-09-04T16:30:26.510 INFO:tasks.workunit.client.0.smithi170.stdout:5/502: fsync d4/d8/d1c/d26/d27/d48/f52 0 2024-09-04T16:30:26.512 INFO:tasks.workunit.client.0.smithi170.stdout:5/503: chown d4/db/d51/d5e 130977 1 2024-09-04T16:30:26.515 INFO:tasks.workunit.client.0.smithi170.stdout:8/572: link d6/f41 d6/d28/d5f/d91/fbf 0 2024-09-04T16:30:26.518 INFO:tasks.workunit.client.0.smithi170.stdout:0/615: dread d11/d13/d36/f93 [0,4194304] 0 2024-09-04T16:30:26.522 INFO:tasks.workunit.client.0.smithi170.stdout:1/665: symlink d9/d11/d2e/d9e/le0 0 2024-09-04T16:30:26.523 INFO:tasks.workunit.client.0.smithi170.stdout:7/757: creat d12/d15/d71/d42/d79/f105 x:0 0 0 2024-09-04T16:30:26.529 INFO:tasks.workunit.client.0.smithi170.stdout:7/758: dwrite d12/d15/d71/d42/d81/f5e [0,4194304] 0 2024-09-04T16:30:26.529 INFO:tasks.workunit.client.0.smithi170.stdout:5/504: symlink d4/d8/d1c/d26/d27/d43/d5b/la3 0 2024-09-04T16:30:26.530 INFO:tasks.workunit.client.0.smithi170.stdout:7/759: chown d12/d16/d1d/d65/d82/fbb 130 1 2024-09-04T16:30:26.533 INFO:tasks.workunit.client.0.smithi170.stdout:8/573: mkdir d6/d28/d16/d77/d93/dc0 0 2024-09-04T16:30:26.536 INFO:tasks.workunit.client.0.smithi170.stdout:8/574: write d6/d28/d20/d5e/f68 [5138685,23715] 0 2024-09-04T16:30:26.536 INFO:tasks.workunit.client.0.smithi170.stdout:3/498: symlink d13/d14/d21/la5 0 2024-09-04T16:30:26.537 INFO:tasks.workunit.client.0.smithi170.stdout:1/666: mknod d9/d34/d5f/ce1 0 2024-09-04T16:30:26.537 INFO:tasks.workunit.client.0.smithi170.stdout:1/667: dread - d9/d11/fac zero size 2024-09-04T16:30:26.538 INFO:tasks.workunit.client.0.smithi170.stdout:3/499: write d13/d14/d21/d46/f92 [1161183,9112] 0 2024-09-04T16:30:26.539 INFO:tasks.workunit.client.0.smithi170.stdout:4/562: creat d1/d6/d8/d20/d95/fc5 x:0 0 0 2024-09-04T16:30:26.540 INFO:tasks.workunit.client.0.smithi170.stdout:1/668: truncate d9/d34/dbe/fc9 259035 0 2024-09-04T16:30:26.541 INFO:tasks.workunit.client.0.smithi170.stdout:7/760: symlink d12/d16/d1d/d65/d82/dcb/dce/l106 0 2024-09-04T16:30:26.541 INFO:tasks.workunit.client.0.smithi170.stdout:4/563: chown d1/d6/d8/d20/d95/f57 0 1 2024-09-04T16:30:26.542 INFO:tasks.workunit.client.0.smithi170.stdout:7/761: chown d12/d16/d1d/d65/f89 178811 1 2024-09-04T16:30:26.549 INFO:tasks.workunit.client.0.smithi170.stdout:3/500: truncate d13/d14/f75 242357 0 2024-09-04T16:30:26.550 INFO:tasks.workunit.client.0.smithi170.stdout:3/501: chown d13/d14/d21/d46/c82 1 1 2024-09-04T16:30:26.553 INFO:tasks.workunit.client.0.smithi170.stdout:4/564: unlink d1/d6/f4f 0 2024-09-04T16:30:26.554 INFO:tasks.workunit.client.0.smithi170.stdout:9/593: getdents d2/d3d/d6d 0 2024-09-04T16:30:26.556 INFO:tasks.workunit.client.0.smithi170.stdout:8/575: symlink d6/lc1 0 2024-09-04T16:30:26.556 INFO:tasks.workunit.client.0.smithi170.stdout:1/669: dwrite d9/d11/d2f/d6b/d61/f6f [0,4194304] 0 2024-09-04T16:30:26.557 INFO:tasks.workunit.client.0.smithi170.stdout:1/670: readlink d9/d34/l44 0 2024-09-04T16:30:26.560 INFO:tasks.workunit.client.0.smithi170.stdout:0/616: getdents d11/d13/d71 0 2024-09-04T16:30:26.565 INFO:tasks.workunit.client.0.smithi170.stdout:5/505: getdents d4/d8/d1c/d26/d27/d48/d5a 0 2024-09-04T16:30:26.568 INFO:tasks.workunit.client.0.smithi170.stdout:1/671: symlink d9/d11/d2f/d6b/d7d/le2 0 2024-09-04T16:30:26.571 INFO:tasks.workunit.client.0.smithi170.stdout:4/565: mknod d1/d6/d8/cc6 0 2024-09-04T16:30:26.572 INFO:tasks.workunit.client.0.smithi170.stdout:0/617: write d11/d13/d35/fdc [849006,115215] 0 2024-09-04T16:30:26.573 INFO:tasks.workunit.client.0.smithi170.stdout:7/762: link d12/d16/d1d/d65/d82/dcb/dce/l106 d12/d15/d71/d42/d79/d9d/d51/l107 0 2024-09-04T16:30:26.574 INFO:tasks.workunit.client.0.smithi170.stdout:8/576: symlink d6/d28/d16/d77/lc2 0 2024-09-04T16:30:26.576 INFO:tasks.workunit.client.0.smithi170.stdout:7/763: fdatasync d12/d16/db7/fd6 0 2024-09-04T16:30:26.577 INFO:tasks.workunit.client.0.smithi170.stdout:5/506: mkdir d4/d8/d1c/d26/d27/d88/da4 0 2024-09-04T16:30:26.578 INFO:tasks.workunit.client.0.smithi170.stdout:0/618: readlink d11/d13/d2f/d3f/l9b 0 2024-09-04T16:30:26.580 INFO:tasks.workunit.client.0.smithi170.stdout:1/672: symlink d9/d11/d2f/d6b/le3 0 2024-09-04T16:30:26.581 INFO:tasks.workunit.client.0.smithi170.stdout:8/577: fsync d6/d28/d16/d77/d93/d95/fa1 0 2024-09-04T16:30:26.583 INFO:tasks.workunit.client.0.smithi170.stdout:3/502: dwrite d13/d14/d1d/d2d/f34 [0,4194304] 0 2024-09-04T16:30:26.587 INFO:tasks.workunit.client.0.smithi170.stdout:4/566: dwrite d1/d6/d2b/f99 [0,4194304] 0 2024-09-04T16:30:26.588 INFO:tasks.workunit.client.0.smithi170.stdout:3/503: write d13/d14/d21/d4d/d4e/f74 [596445,64388] 0 2024-09-04T16:30:26.589 INFO:tasks.workunit.client.0.smithi170.stdout:9/594: dread d2/d3d/fc [0,4194304] 0 2024-09-04T16:30:26.593 INFO:tasks.workunit.client.0.smithi170.stdout:0/619: creat d11/d13/d36/fea x:0 0 0 2024-09-04T16:30:26.596 INFO:tasks.workunit.client.0.smithi170.stdout:1/673: creat d9/d11/d85/fe4 x:0 0 0 2024-09-04T16:30:26.601 INFO:tasks.workunit.client.0.smithi170.stdout:3/504: mknod d13/d14/d1f/d7a/ca6 0 2024-09-04T16:30:26.605 INFO:tasks.workunit.client.0.smithi170.stdout:0/620: rename d11/d13/d71/l2b to d11/d13/d4a/d66/d8c/ddd/leb 0 2024-09-04T16:30:26.605 INFO:tasks.workunit.client.0.smithi170.stdout:5/507: link d4/d8/l2e d4/db/la5 0 2024-09-04T16:30:26.607 INFO:tasks.workunit.client.0.smithi170.stdout:4/567: truncate d1/fc 3049124 0 2024-09-04T16:30:26.609 INFO:tasks.workunit.client.0.smithi170.stdout:0/621: fdatasync d11/d13/d36/fc0 0 2024-09-04T16:30:26.609 INFO:tasks.workunit.client.0.smithi170.stdout:8/578: rename d6/d28/d1a/d38/c61 to d6/d28/d16/d52/d73/d5d/d8b/cc3 0 2024-09-04T16:30:26.612 INFO:tasks.workunit.client.0.smithi170.stdout:7/764: dwrite d12/d16/d1d/d65/d82/f91 [0,4194304] 0 2024-09-04T16:30:26.613 INFO:tasks.workunit.client.0.smithi170.stdout:3/505: dwrite d13/d14/d21/f9d [0,4194304] 0 2024-09-04T16:30:26.616 INFO:tasks.workunit.client.0.smithi170.stdout:5/508: dread d4/d8/d1c/d26/f6a [0,4194304] 0 2024-09-04T16:30:26.619 INFO:tasks.workunit.client.0.smithi170.stdout:0/622: fsync d11/d13/d36/f93 0 2024-09-04T16:30:26.622 INFO:tasks.workunit.client.0.smithi170.stdout:4/568: rename d1/f31 to d1/d6/d8/d20/d35/d54/fc7 0 2024-09-04T16:30:26.623 INFO:tasks.workunit.client.0.smithi170.stdout:7/765: symlink d12/d16/d1d/d65/d82/l108 0 2024-09-04T16:30:26.625 INFO:tasks.workunit.client.0.smithi170.stdout:3/506: stat d13/d14/l4a 0 2024-09-04T16:30:26.628 INFO:tasks.workunit.client.0.smithi170.stdout:5/509: write d4/d8/d1c/d23/f5d [81309,86347] 0 2024-09-04T16:30:26.629 INFO:tasks.workunit.client.0.smithi170.stdout:5/510: chown d4/d3a/d74/f89 520360368 1 2024-09-04T16:30:26.630 INFO:tasks.workunit.client.0.smithi170.stdout:0/623: chown d11/d75/d77/l9f 39309820 1 2024-09-04T16:30:26.634 INFO:tasks.workunit.client.0.smithi170.stdout:7/766: truncate d12/d15/fa4 1125193 0 2024-09-04T16:30:26.635 INFO:tasks.workunit.client.0.smithi170.stdout:8/579: creat d6/d28/d5f/fc4 x:0 0 0 2024-09-04T16:30:26.636 INFO:tasks.workunit.client.0.smithi170.stdout:8/580: chown d6/d28/d16/d24/f87 14001272 1 2024-09-04T16:30:26.637 INFO:tasks.workunit.client.0.smithi170.stdout:3/507: unlink d13/d14/d1d/d71/f7c 0 2024-09-04T16:30:26.638 INFO:tasks.workunit.client.0.smithi170.stdout:3/508: truncate d13/f5f 5194230 0 2024-09-04T16:30:26.640 INFO:tasks.workunit.client.0.smithi170.stdout:3/509: read fb [1451117,57616] 0 2024-09-04T16:30:26.641 INFO:tasks.workunit.client.0.smithi170.stdout:7/767: dwrite d12/d16/d1d/d65/d82/dcb/fe9 [0,4194304] 0 2024-09-04T16:30:26.642 INFO:tasks.workunit.client.0.smithi170.stdout:0/624: mknod d11/d75/cec 0 2024-09-04T16:30:26.643 INFO:tasks.workunit.client.0.smithi170.stdout:0/625: readlink d11/d13/d35/lc8 0 2024-09-04T16:30:26.647 INFO:tasks.workunit.client.0.smithi170.stdout:8/581: mkdir d6/d28/d20/dc5 0 2024-09-04T16:30:26.652 INFO:tasks.workunit.client.0.smithi170.stdout:4/569: link d1/d6/d22/l72 d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/dbf/lc8 0 2024-09-04T16:30:26.652 INFO:tasks.workunit.client.0.smithi170.stdout:5/511: getdents d4/db/d51/d5e 0 2024-09-04T16:30:26.656 INFO:tasks.workunit.client.0.smithi170.stdout:7/768: dwrite d12/d15/d71/f3e [4194304,4194304] 0 2024-09-04T16:30:26.657 INFO:tasks.workunit.client.0.smithi170.stdout:7/769: fsync d12/d15/d41/fcc 0 2024-09-04T16:30:26.659 INFO:tasks.workunit.client.0.smithi170.stdout:7/770: fsync d12/d16/d8d/fec 0 2024-09-04T16:30:26.659 INFO:tasks.workunit.client.0.smithi170.stdout:8/582: creat d6/d28/d5f/d70/d97/d99/fc6 x:0 0 0 2024-09-04T16:30:26.661 INFO:tasks.workunit.client.0.smithi170.stdout:5/512: creat d4/db/d51/d5e/d71/fa6 x:0 0 0 2024-09-04T16:30:26.662 INFO:tasks.workunit.client.0.smithi170.stdout:0/626: readlink d11/d13/d71/d43/l32 0 2024-09-04T16:30:26.665 INFO:tasks.workunit.client.0.smithi170.stdout:7/771: unlink d12/d15/c102 0 2024-09-04T16:30:26.667 INFO:tasks.workunit.client.0.smithi170.stdout:8/583: creat d6/d28/d16/d52/fc7 x:0 0 0 2024-09-04T16:30:26.669 INFO:tasks.workunit.client.0.smithi170.stdout:0/627: creat d11/d13/d4a/d66/d8c/ddd/fed x:0 0 0 2024-09-04T16:30:26.669 INFO:tasks.workunit.client.0.smithi170.stdout:0/628: readlink d11/d13/d71/d43/l32 0 2024-09-04T16:30:26.671 INFO:tasks.workunit.client.0.smithi170.stdout:3/510: write d13/d14/d21/f2b [1212190,120861] 0 2024-09-04T16:30:26.810 INFO:tasks.workunit.client.0.smithi170.stdout:7/772: mkdir d12/d16/d109 0 2024-09-04T16:30:26.811 INFO:tasks.workunit.client.0.smithi170.stdout:4/570: write d1/f19 [425802,2559] 0 2024-09-04T16:30:26.814 INFO:tasks.workunit.client.0.smithi170.stdout:8/584: creat d6/d28/d16/d52/d73/d5d/fc8 x:0 0 0 2024-09-04T16:30:26.814 INFO:tasks.workunit.client.0.smithi170.stdout:0/629: dwrite d11/d13/f20 [0,4194304] 0 2024-09-04T16:30:26.816 INFO:tasks.workunit.client.0.smithi170.stdout:0/630: fsync d11/d75/fb7 0 2024-09-04T16:30:26.817 INFO:tasks.workunit.client.0.smithi170.stdout:4/571: fdatasync d1/d6/d8/fa 0 2024-09-04T16:30:26.819 INFO:tasks.workunit.client.0.smithi170.stdout:7/773: symlink d12/d16/l10a 0 2024-09-04T16:30:26.821 INFO:tasks.workunit.client.0.smithi170.stdout:8/585: write d6/d28/d16/d52/d73/d5d/d8b/f96 [3928214,98037] 0 2024-09-04T16:30:26.823 INFO:tasks.workunit.client.0.smithi170.stdout:3/511: dwrite d13/d14/d21/d4d/f95 [0,4194304] 0 2024-09-04T16:30:26.823 INFO:tasks.workunit.client.0.smithi170.stdout:7/774: read d12/d16/d8d/fa5 [30315,75619] 0 2024-09-04T16:30:26.831 INFO:tasks.workunit.client.0.smithi170.stdout:4/572: getdents d1/d6/d22/d93 0 2024-09-04T16:30:26.834 INFO:tasks.workunit.client.0.smithi170.stdout:7/775: symlink d12/d15/d71/d42/d79/d9d/d51/l10b 0 2024-09-04T16:30:26.836 INFO:tasks.workunit.client.0.smithi170.stdout:3/512: dwrite d13/f5f [4194304,4194304] 0 2024-09-04T16:30:26.837 INFO:tasks.workunit.client.0.smithi170.stdout:7/776: chown d12/d16/d8d/fa5 15832 1 2024-09-04T16:30:26.840 INFO:tasks.workunit.client.0.smithi170.stdout:0/631: dwrite d11/d13/d36/f93 [0,4194304] 0 2024-09-04T16:30:26.841 INFO:tasks.workunit.client.0.smithi170.stdout:0/632: read - d11/d8e/fb9 zero size 2024-09-04T16:30:26.843 INFO:tasks.workunit.client.0.smithi170.stdout:7/777: write d12/f52 [1575257,20409] 0 2024-09-04T16:30:26.845 INFO:tasks.workunit.client.0.smithi170.stdout:8/586: link d6/l17 d6/d28/d16/d24/d46/lc9 0 2024-09-04T16:30:26.845 INFO:tasks.workunit.client.0.smithi170.stdout:4/573: rename d1/d6/d8/d20/lb1 to d1/d6/d8/d20/d95/d36/lc9 0 2024-09-04T16:30:26.849 INFO:tasks.workunit.client.0.smithi170.stdout:8/587: write d6/d28/d16/d52/d73/d5d/d8b/f96 [4460030,96752] 0 2024-09-04T16:30:26.853 INFO:tasks.workunit.client.0.smithi170.stdout:7/778: dwrite d12/d16/d1d/d65/d82/dcb/fe9 [0,4194304] 0 2024-09-04T16:30:26.854 INFO:tasks.workunit.client.0.smithi170.stdout:3/513: rename d13/d14/d21/d4d/d4e/f74 to d13/d14/d21/d4d/d4e/d50/fa7 0 2024-09-04T16:30:26.856 INFO:tasks.workunit.client.0.smithi170.stdout:3/514: fdatasync d13/d14/d21/d46/d9e/f83 0 2024-09-04T16:30:26.857 INFO:tasks.workunit.client.0.smithi170.stdout:3/515: chown d13/d14/d17/f42 76 1 2024-09-04T16:30:26.858 INFO:tasks.workunit.client.0.smithi170.stdout:8/588: creat d6/d28/d16/d77/d93/d95/dac/fca x:0 0 0 2024-09-04T16:30:26.860 INFO:tasks.workunit.client.0.smithi170.stdout:7/779: unlink d12/d15/d71/d42/d81/ff1 0 2024-09-04T16:30:26.865 INFO:tasks.workunit.client.0.smithi170.stdout:8/589: unlink d6/d28/d16/d77/d93/f9b 0 2024-09-04T16:30:26.867 INFO:tasks.workunit.client.0.smithi170.stdout:3/516: mkdir d13/d14/d1d/da4/da8 0 2024-09-04T16:30:26.868 INFO:tasks.workunit.client.0.smithi170.stdout:7/780: dwrite d12/d16/db7/fd6 [4194304,4194304] 0 2024-09-04T16:30:26.871 INFO:tasks.workunit.client.0.smithi170.stdout:8/590: chown d6/d28/d20/d5e/c30 1031 1 2024-09-04T16:30:26.879 INFO:tasks.workunit.client.0.smithi170.stdout:8/591: creat d6/d28/d20/dc5/fcb x:0 0 0 2024-09-04T16:30:26.881 INFO:tasks.workunit.client.0.smithi170.stdout:3/517: getdents d13 0 2024-09-04T16:30:26.882 INFO:tasks.workunit.client.0.smithi170.stdout:4/574: dread d1/d6/d8/d20/d95/f8c [0,4194304] 0 2024-09-04T16:30:26.882 INFO:tasks.workunit.client.0.smithi170.stdout:0/633: dwrite d11/d13/d71/d43/f58 [0,4194304] 0 2024-09-04T16:30:26.885 INFO:tasks.workunit.client.0.smithi170.stdout:3/518: write d13/d14/d21/d4c/f77 [593712,76570] 0 2024-09-04T16:30:26.888 INFO:tasks.workunit.client.0.smithi170.stdout:7/781: dread d12/d15/d71/d42/d79/d9d/fa6 [0,4194304] 0 2024-09-04T16:30:26.893 INFO:tasks.workunit.client.0.smithi170.stdout:8/592: dwrite d6/d28/d1a/d38/f9d [0,4194304] 0 2024-09-04T16:30:26.895 INFO:tasks.workunit.client.0.smithi170.stdout:8/593: chown d6/d28/d16/d77/l82 1182929 1 2024-09-04T16:30:26.896 INFO:tasks.workunit.client.0.smithi170.stdout:3/519: mknod d13/d14/d21/d4d/d4e/ca9 0 2024-09-04T16:30:26.898 INFO:tasks.workunit.client.0.smithi170.stdout:3/520: write d13/d14/d21/d4d/f95 [4222675,120658] 0 2024-09-04T16:30:26.899 INFO:tasks.workunit.client.0.smithi170.stdout:3/521: write d13/d14/d1f/f8d [730319,48150] 0 2024-09-04T16:30:26.903 INFO:tasks.workunit.client.0.smithi170.stdout:3/522: creat d13/d14/d21/d46/faa x:0 0 0 2024-09-04T16:30:26.904 INFO:tasks.workunit.client.0.smithi170.stdout:3/523: write d13/d14/d1d/f61 [116547,48941] 0 2024-09-04T16:30:26.912 INFO:tasks.workunit.client.0.smithi170.stdout:3/524: mknod d13/d14/d1d/d2d/cab 0 2024-09-04T16:30:26.912 INFO:tasks.workunit.client.0.smithi170.stdout:0/634: dwrite d11/d13/d4a/d66/f83 [4194304,4194304] 0 2024-09-04T16:30:26.917 INFO:tasks.workunit.client.0.smithi170.stdout:7/782: dwrite fa [0,4194304] 0 2024-09-04T16:30:26.925 INFO:tasks.workunit.client.0.smithi170.stdout:3/525: rename d13/f1a to d13/d14/d1d/da4/fac 0 2024-09-04T16:30:26.926 INFO:tasks.workunit.client.0.smithi170.stdout:3/526: truncate d13/d14/d17/f8a 894493 0 2024-09-04T16:30:26.935 INFO:tasks.workunit.client.0.smithi170.stdout:7/783: creat d12/d15/f10c x:0 0 0 2024-09-04T16:30:26.936 INFO:tasks.workunit.client.0.smithi170.stdout:7/784: dread - d12/d15/d71/d42/d79/fbd zero size 2024-09-04T16:30:26.937 INFO:tasks.workunit.client.0.smithi170.stdout:3/527: symlink d13/d14/d1d/da4/da8/lad 0 2024-09-04T16:30:26.938 INFO:tasks.workunit.client.0.smithi170.stdout:0/635: link d11/d13/d2f/d3f/f4f d11/d13/d4a/d66/d8c/da8/fee 0 2024-09-04T16:30:26.939 INFO:tasks.workunit.client.0.smithi170.stdout:3/528: chown d13/d14/l1b 1545065581 1 2024-09-04T16:30:26.940 INFO:tasks.workunit.client.0.smithi170.stdout:3/529: write d13/d14/d1f/f73 [774454,71990] 0 2024-09-04T16:30:26.941 INFO:tasks.workunit.client.0.smithi170.stdout:3/530: write d13/d14/d1f/f8d [1760146,125849] 0 2024-09-04T16:30:26.947 INFO:tasks.workunit.client.0.smithi170.stdout:0/636: dwrite d11/d13/d2f/d3f/f65 [0,4194304] 0 2024-09-04T16:30:26.947 INFO:tasks.workunit.client.0.smithi170.stdout:7/785: symlink d12/d16/d1d/d65/dff/l10d 0 2024-09-04T16:30:26.948 INFO:tasks.workunit.client.0.smithi170.stdout:0/637: chown d11/d75 15768183 1 2024-09-04T16:30:26.950 INFO:tasks.workunit.client.0.smithi170.stdout:3/531: mknod d13/d14/d21/d46/d9e/cae 0 2024-09-04T16:30:26.952 INFO:tasks.workunit.client.0.smithi170.stdout:0/638: dread - d11/d13/d35/fad zero size 2024-09-04T16:30:26.952 INFO:tasks.workunit.client.0.smithi170.stdout:0/639: fsync d11/d13/f20 0 2024-09-04T16:30:26.953 INFO:tasks.workunit.client.0.smithi170.stdout:7/786: rmdir d12/d16/d1d/d65/d82/dcb 39 2024-09-04T16:30:26.954 INFO:tasks.workunit.client.0.smithi170.stdout:0/640: dread - d11/d13/d4a/d66/d6d/fe3 zero size 2024-09-04T16:30:26.956 INFO:tasks.workunit.client.0.smithi170.stdout:0/641: write d11/d13/d4a/dc5/fca [375266,68382] 0 2024-09-04T16:30:26.958 INFO:tasks.workunit.client.0.smithi170.stdout:3/532: creat d13/d14/d21/faf x:0 0 0 2024-09-04T16:30:26.959 INFO:tasks.workunit.client.0.smithi170.stdout:3/533: write d13/d14/f32 [4774471,122953] 0 2024-09-04T16:30:26.963 INFO:tasks.workunit.client.0.smithi170.stdout:3/534: creat d13/d14/d21/d4d/d4e/d50/fb0 x:0 0 0 2024-09-04T16:30:26.964 INFO:tasks.workunit.client.0.smithi170.stdout:0/642: link d11/d13/d2f/d3f/f4f d11/d13/d4a/dbc/fef 0 2024-09-04T16:30:26.965 INFO:tasks.workunit.client.0.smithi170.stdout:3/535: mknod d13/d14/d1d/da4/cb1 0 2024-09-04T16:30:26.966 INFO:tasks.workunit.client.0.smithi170.stdout:0/643: mkdir d11/d13/d4a/dc5/df0 0 2024-09-04T16:30:26.968 INFO:tasks.workunit.client.0.smithi170.stdout:3/536: rename d13/d14/da3 to d13/d14/d21/d46/db2 0 2024-09-04T16:30:26.969 INFO:tasks.workunit.client.0.smithi170.stdout:0/644: creat d11/d13/d4a/ff1 x:0 0 0 2024-09-04T16:30:26.970 INFO:tasks.workunit.client.0.smithi170.stdout:3/537: write d13/d14/f4b [2966068,59978] 0 2024-09-04T16:30:26.971 INFO:tasks.workunit.client.0.smithi170.stdout:3/538: chown d13/d14/d1f 58 1 2024-09-04T16:30:26.972 INFO:tasks.workunit.client.0.smithi170.stdout:3/539: dread - d13/d14/d21/d4d/d4e/d50/fb0 zero size 2024-09-04T16:30:26.973 INFO:tasks.workunit.client.0.smithi170.stdout:3/540: mkdir d13/d14/d1d/d71/db3 0 2024-09-04T16:30:26.974 INFO:tasks.workunit.client.0.smithi170.stdout:0/645: creat d11/ff2 x:0 0 0 2024-09-04T16:30:26.975 INFO:tasks.workunit.client.0.smithi170.stdout:3/541: creat d13/d14/d21/d4d/d4e/fb4 x:0 0 0 2024-09-04T16:30:26.976 INFO:tasks.workunit.client.0.smithi170.stdout:3/542: dread - d13/d14/d21/d4c/f99 zero size 2024-09-04T16:30:26.978 INFO:tasks.workunit.client.0.smithi170.stdout:3/543: rmdir d13 39 2024-09-04T16:30:26.982 INFO:tasks.workunit.client.0.smithi170.stdout:3/544: write d13/d14/d1d/d2d/d6c/f70 [165634,102085] 0 2024-09-04T16:30:26.982 INFO:tasks.workunit.client.0.smithi170.stdout:3/545: readlink d13/d14/d21/l44 0 2024-09-04T16:30:26.985 INFO:tasks.workunit.client.0.smithi170.stdout:3/546: truncate d13/d14/d21/d4d/d4e/fb4 917320 0 2024-09-04T16:30:26.990 INFO:tasks.workunit.client.0.smithi170.stdout:0/646: dread d11/d13/d4a/d66/d8c/da8/fee [0,4194304] 0 2024-09-04T16:30:26.991 INFO:tasks.workunit.client.0.smithi170.stdout:3/547: mknod d13/d14/d1d/cb5 0 2024-09-04T16:30:26.992 INFO:tasks.workunit.client.0.smithi170.stdout:7/787: write d12/f18 [2327993,9098] 0 2024-09-04T16:30:26.994 INFO:tasks.workunit.client.0.smithi170.stdout:3/548: write d13/d14/d1d/d2d/d58/f47 [1132348,19755] 0 2024-09-04T16:30:26.994 INFO:tasks.workunit.client.0.smithi170.stdout:0/647: creat d11/d13/d4a/d66/d6d/ff3 x:0 0 0 2024-09-04T16:30:26.995 INFO:tasks.workunit.client.0.smithi170.stdout:7/788: dread - d12/d15/d71/d42/d81/d5c/ff9 zero size 2024-09-04T16:30:27.001 INFO:tasks.workunit.client.0.smithi170.stdout:7/789: symlink d12/d16/l10e 0 2024-09-04T16:30:27.003 INFO:tasks.workunit.client.0.smithi170.stdout:7/790: chown d12/d15/d71/f56 25524 1 2024-09-04T16:30:27.011 INFO:tasks.workunit.client.0.smithi170.stdout:3/549: rename d13/d14/d21/d46 to d13/d14/d1d/d71/db3/db6 0 2024-09-04T16:30:27.012 INFO:tasks.workunit.client.0.smithi170.stdout:7/791: dwrite d12/fd4 [0,4194304] 0 2024-09-04T16:30:27.015 INFO:tasks.workunit.client.0.smithi170.stdout:3/550: write d13/d14/d1d/d71/db3/db6/d9e/f83 [602643,29592] 0 2024-09-04T16:30:27.018 INFO:tasks.workunit.client.0.smithi170.stdout:7/792: symlink d12/d49/l10f 0 2024-09-04T16:30:27.025 INFO:tasks.workunit.client.0.smithi170.stdout:7/793: rename d12/c9f to d12/d15/d71/d42/d79/c110 0 2024-09-04T16:30:27.058 INFO:tasks.workunit.client.0.smithi170.stdout:0/648: dread d11/d8e/f9c [0,4194304] 0 2024-09-04T16:30:27.060 INFO:tasks.workunit.client.0.smithi170.stdout:0/649: creat d11/d75/d77/ff4 x:0 0 0 2024-09-04T16:30:27.063 INFO:tasks.workunit.client.0.smithi170.stdout:0/650: rename d11/d13/d71/f53 to d11/d13/d36/de5/ff5 0 2024-09-04T16:30:27.068 INFO:tasks.workunit.client.0.smithi170.stdout:0/651: dwrite d11/d13/d4a/d66/fa0 [0,4194304] 0 2024-09-04T16:30:27.075 INFO:tasks.workunit.client.0.smithi170.stdout:0/652: dwrite d11/d75/fe2 [0,4194304] 0 2024-09-04T16:30:27.079 INFO:tasks.workunit.client.0.smithi170.stdout:0/653: dread d11/d13/d4a/fd2 [0,4194304] 0 2024-09-04T16:30:27.092 INFO:tasks.workunit.client.0.smithi170.stdout:0/654: rename d11/d75/fe2 to d11/d13/d4a/d66/d8c/ddd/ff6 0 2024-09-04T16:30:27.094 INFO:tasks.workunit.client.0.smithi170.stdout:0/655: creat d11/d13/d4a/dc5/df0/ff7 x:0 0 0 2024-09-04T16:30:27.094 INFO:tasks.workunit.client.0.smithi170.stdout:0/656: fdatasync d11/d13/f28 0 2024-09-04T16:30:27.098 INFO:tasks.workunit.client.0.smithi170.stdout:0/657: creat d11/d13/d4a/dc5/ff8 x:0 0 0 2024-09-04T16:30:27.102 INFO:tasks.workunit.client.0.smithi170.stdout:0/658: creat d11/d13/d4a/d66/d8c/dae/ff9 x:0 0 0 2024-09-04T16:30:27.108 INFO:tasks.workunit.client.0.smithi170.stdout:0/659: link d11/d13/d2f/d3f/f63 d11/d13/ffa 0 2024-09-04T16:30:27.110 INFO:tasks.workunit.client.0.smithi170.stdout:0/660: mknod d11/d13/d4a/dc5/df0/cfb 0 2024-09-04T16:30:27.113 INFO:tasks.workunit.client.0.smithi170.stdout:0/661: rename d11/d13/d4a/d66/d8c/da8/dda to d11/d13/d4a/d66/d8c/dae/dfc 0 2024-09-04T16:30:27.116 INFO:tasks.workunit.client.0.smithi170.stdout:0/662: unlink d11/d13/d4a/d66/d6d/ff3 0 2024-09-04T16:30:27.118 INFO:tasks.workunit.client.0.smithi170.stdout:0/663: write d11/d13/d71/f56 [3847420,101471] 0 2024-09-04T16:30:27.119 INFO:tasks.workunit.client.0.smithi170.stdout:0/664: truncate d11/d13/d36/fea 797677 0 2024-09-04T16:30:27.131 INFO:tasks.workunit.client.0.smithi170.stdout:0/665: dwrite d11/d13/d35/fad [0,4194304] 0 2024-09-04T16:30:27.133 INFO:tasks.workunit.client.0.smithi170.stdout:0/666: write d11/d8e/fbf [82393,2615] 0 2024-09-04T16:30:27.138 INFO:tasks.workunit.client.0.smithi170.stdout:0/667: mkdir d11/d13/d36/dfd 0 2024-09-04T16:30:27.142 INFO:tasks.workunit.client.0.smithi170.stdout:0/668: rename d11/d13/d4a/d66/l67 to d11/d8e/dd7/lfe 0 2024-09-04T16:30:27.156 INFO:tasks.workunit.client.0.smithi170.stdout:0/669: dread d11/d13/fcd [0,4194304] 0 2024-09-04T16:30:27.158 INFO:tasks.workunit.client.0.smithi170.stdout:0/670: creat d11/d13/d36/fff x:0 0 0 2024-09-04T16:30:27.175 INFO:tasks.workunit.client.0.smithi170.stdout:9/595: sync 2024-09-04T16:30:27.175 INFO:tasks.workunit.client.0.smithi170.stdout:6/448: sync 2024-09-04T16:30:27.175 INFO:tasks.workunit.client.0.smithi170.stdout:2/637: sync 2024-09-04T16:30:27.177 INFO:tasks.workunit.client.0.smithi170.stdout:9/596: read d2/d3d/d27/d65/f52 [1427460,21938] 0 2024-09-04T16:30:27.178 INFO:tasks.workunit.client.0.smithi170.stdout:7/794: read d12/d16/d1d/f80 [779667,41965] 0 2024-09-04T16:30:27.181 INFO:tasks.workunit.client.0.smithi170.stdout:2/638: mkdir d3/d4/d14/dcf/dba/dd5 0 2024-09-04T16:30:27.184 INFO:tasks.workunit.client.0.smithi170.stdout:6/449: rename d0/d15/d56/f6a to d0/f8d 0 2024-09-04T16:30:27.186 INFO:tasks.workunit.client.0.smithi170.stdout:2/639: dwrite d3/db/d62/f74 [0,4194304] 0 2024-09-04T16:30:27.188 INFO:tasks.workunit.client.0.smithi170.stdout:9/597: mkdir d2/d3d/d6d/d79/db0 0 2024-09-04T16:30:27.189 INFO:tasks.workunit.client.0.smithi170.stdout:9/598: dread - d2/d11/f8d zero size 2024-09-04T16:30:27.196 INFO:tasks.workunit.client.0.smithi170.stdout:7/795: mkdir d12/d15/d111 0 2024-09-04T16:30:27.199 INFO:tasks.workunit.client.0.smithi170.stdout:2/640: rename d3/db/d1c/d47/d83/d9f/dae/d97/ca8 to d3/d3c/d40/d48/d68/cd6 0 2024-09-04T16:30:27.204 INFO:tasks.workunit.client.0.smithi170.stdout:9/599: mknod d2/d3d/d3f/d90/cb1 0 2024-09-04T16:30:27.205 INFO:tasks.workunit.client.0.smithi170.stdout:7/796: creat d12/d16/d1d/df5/f112 x:0 0 0 2024-09-04T16:30:27.205 INFO:tasks.workunit.client.0.smithi170.stdout:2/641: dwrite d3/d4/d86/dc9/fd1 [0,4194304] 0 2024-09-04T16:30:27.207 INFO:tasks.workunit.client.0.smithi170.stdout:2/642: fdatasync f2 0 2024-09-04T16:30:27.212 INFO:tasks.workunit.client.0.smithi170.stdout:0/671: dwrite d11/d13/d4a/d66/d6d/f91 [4194304,4194304] 0 2024-09-04T16:30:27.212 INFO:tasks.workunit.client.0.smithi170.stdout:7/797: fsync d12/d15/d71/d42/f60 0 2024-09-04T16:30:27.214 INFO:tasks.workunit.client.0.smithi170.stdout:7/798: chown d12/d15/d41/c58 9 1 2024-09-04T16:30:27.223 INFO:tasks.workunit.client.0.smithi170.stdout:7/799: creat d12/d16/d1d/d65/dd0/f113 x:0 0 0 2024-09-04T16:30:27.234 INFO:tasks.workunit.client.0.smithi170.stdout:6/450: dread d0/d15/d56/d6d/f74 [0,4194304] 0 2024-09-04T16:30:27.241 INFO:tasks.workunit.client.0.smithi170.stdout:2/643: truncate d3/d7/f3e 1542252 0 2024-09-04T16:30:27.242 INFO:tasks.workunit.client.0.smithi170.stdout:9/600: dwrite d2/d3d/d4d/f82 [0,4194304] 0 2024-09-04T16:30:27.242 INFO:tasks.workunit.client.0.smithi170.stdout:2/644: stat d3/d4/f52 0 2024-09-04T16:30:27.243 INFO:tasks.workunit.client.0.smithi170.stdout:9/601: read d2/d3d/d4d/f82 [5867,52787] 0 2024-09-04T16:30:27.245 INFO:tasks.workunit.client.0.smithi170.stdout:2/645: truncate d3/db/d62/d6f/fb3 331139 0 2024-09-04T16:30:27.245 INFO:tasks.workunit.client.0.smithi170.stdout:0/672: truncate d11/d8e/f9c 3987728 0 2024-09-04T16:30:27.247 INFO:tasks.workunit.client.0.smithi170.stdout:0/673: write d11/d13/d4a/ff1 [908867,61349] 0 2024-09-04T16:30:27.248 INFO:tasks.workunit.client.0.smithi170.stdout:9/602: mknod d2/d3d/d54/cb2 0 2024-09-04T16:30:27.250 INFO:tasks.workunit.client.0.smithi170.stdout:0/674: readlink d11/d13/d36/l69 0 2024-09-04T16:30:27.252 INFO:tasks.workunit.client.0.smithi170.stdout:5/513: sync 2024-09-04T16:30:27.252 INFO:tasks.workunit.client.0.smithi170.stdout:1/674: sync 2024-09-04T16:30:27.257 INFO:tasks.workunit.client.0.smithi170.stdout:0/675: symlink d11/d13/d36/l100 0 2024-09-04T16:30:27.259 INFO:tasks.workunit.client.0.smithi170.stdout:9/603: creat d2/d3d/d4d/fb3 x:0 0 0 2024-09-04T16:30:27.260 INFO:tasks.workunit.client.0.smithi170.stdout:7/800: dwrite d12/d5a/fc8 [0,4194304] 0 2024-09-04T16:30:27.261 INFO:tasks.workunit.client.0.smithi170.stdout:1/675: creat d9/d26/d77/d83/fe5 x:0 0 0 2024-09-04T16:30:27.261 INFO:tasks.workunit.client.0.smithi170.stdout:0/676: dread - d11/d75/fb7 zero size 2024-09-04T16:30:27.262 INFO:tasks.workunit.client.0.smithi170.stdout:2/646: dwrite d3/db/d62/f87 [0,4194304] 0 2024-09-04T16:30:27.268 INFO:tasks.workunit.client.0.smithi170.stdout:6/451: dwrite d0/df/f3a [4194304,4194304] 0 2024-09-04T16:30:27.270 INFO:tasks.workunit.client.0.smithi170.stdout:2/647: read d3/d4/d86/fab [546128,46186] 0 2024-09-04T16:30:27.272 INFO:tasks.workunit.client.0.smithi170.stdout:0/677: stat d11/d13/d4a/d66/d8c/dae/dfc 0 2024-09-04T16:30:27.273 INFO:tasks.workunit.client.0.smithi170.stdout:5/514: dwrite d4/d8/d1c/f6d [0,4194304] 0 2024-09-04T16:30:27.281 INFO:tasks.workunit.client.0.smithi170.stdout:1/676: fsync d9/d26/d77/d83/f90 0 2024-09-04T16:30:27.281 INFO:tasks.workunit.client.0.smithi170.stdout:5/515: fdatasync d4/d8/d1c/d26/d27/d43/f44 0 2024-09-04T16:30:27.281 INFO:tasks.workunit.client.0.smithi170.stdout:7/801: truncate d12/d15/d68/f9a 1747641 0 2024-09-04T16:30:27.285 INFO:tasks.workunit.client.0.smithi170.stdout:9/604: dwrite d2/d32/f93 [0,4194304] 0 2024-09-04T16:30:27.286 INFO:tasks.workunit.client.0.smithi170.stdout:0/678: creat d11/d8e/dd7/f101 x:0 0 0 2024-09-04T16:30:27.289 INFO:tasks.workunit.client.0.smithi170.stdout:7/802: readlink d12/d15/d71/d42/d79/d9d/dc9/lef 0 2024-09-04T16:30:27.289 INFO:tasks.workunit.client.0.smithi170.stdout:9/605: chown d2/d3d/d27/d65/d5b/fa2 76 1 2024-09-04T16:30:27.290 INFO:tasks.workunit.client.0.smithi170.stdout:2/648: creat d3/db/dc5/fd7 x:0 0 0 2024-09-04T16:30:27.291 INFO:tasks.workunit.client.0.smithi170.stdout:2/649: dread - d3/db/d1c/f75 zero size 2024-09-04T16:30:27.297 INFO:tasks.workunit.client.0.smithi170.stdout:6/452: creat d0/df/d7e/f8e x:0 0 0 2024-09-04T16:30:27.298 INFO:tasks.workunit.client.0.smithi170.stdout:5/516: mknod d4/d8/d1c/d23/ca7 0 2024-09-04T16:30:27.299 INFO:tasks.workunit.client.0.smithi170.stdout:1/677: creat d9/d11/d2f/db9/fe6 x:0 0 0 2024-09-04T16:30:27.303 INFO:tasks.workunit.client.0.smithi170.stdout:2/650: rename d3/d3c/f3a to d3/d7/fd8 0 2024-09-04T16:30:27.303 INFO:tasks.workunit.client.0.smithi170.stdout:1/678: dread d9/d11/d2f/f64 [0,4194304] 0 2024-09-04T16:30:27.305 INFO:tasks.workunit.client.0.smithi170.stdout:1/679: chown d9/d11/dae/d6a/fa7 27589020 1 2024-09-04T16:30:27.305 INFO:tasks.workunit.client.0.smithi170.stdout:2/651: read d3/db/d62/d6f/fb3 [265649,120365] 0 2024-09-04T16:30:27.305 INFO:tasks.workunit.client.0.smithi170.stdout:1/680: chown d9/d34 1438317 1 2024-09-04T16:30:27.309 INFO:tasks.workunit.client.0.smithi170.stdout:5/517: mknod d4/d8/ca8 0 2024-09-04T16:30:27.318 INFO:tasks.workunit.client.0.smithi170.stdout:1/681: dread d9/d26/f36 [0,4194304] 0 2024-09-04T16:30:27.318 INFO:tasks.workunit.client.0.smithi170.stdout:6/453: creat d0/d17/d31/d64/f8f x:0 0 0 2024-09-04T16:30:27.319 INFO:tasks.workunit.client.0.smithi170.stdout:9/606: dwrite d2/fa8 [0,4194304] 0 2024-09-04T16:30:27.319 INFO:tasks.workunit.client.0.smithi170.stdout:7/803: dread d12/d15/d71/d42/d81/d5c/fe3 [0,4194304] 0 2024-09-04T16:30:27.321 INFO:tasks.workunit.client.0.smithi170.stdout:1/682: write d9/d34/d5f/fdd [278351,83065] 0 2024-09-04T16:30:27.327 INFO:tasks.workunit.client.0.smithi170.stdout:7/804: dwrite d12/d16/d1d/d65/d82/f9c [4194304,4194304] 0 2024-09-04T16:30:27.327 INFO:tasks.workunit.client.0.smithi170.stdout:6/454: mknod d0/df/d1b/d3e/d47/c90 0 2024-09-04T16:30:27.336 INFO:tasks.workunit.client.0.smithi170.stdout:7/805: dwrite d12/d16/db7/fd6 [0,4194304] 0 2024-09-04T16:30:27.337 INFO:tasks.workunit.client.0.smithi170.stdout:1/683: creat d9/d11/d2f/d7f/da8/fe7 x:0 0 0 2024-09-04T16:30:27.339 INFO:tasks.workunit.client.0.smithi170.stdout:6/455: unlink d0/ce 0 2024-09-04T16:30:27.340 INFO:tasks.workunit.client.0.smithi170.stdout:7/806: mkdir d12/d16/d1d/d65/d7b/d114 0 2024-09-04T16:30:27.342 INFO:tasks.workunit.client.0.smithi170.stdout:7/807: write d12/d16/d8d/fec [3204274,128369] 0 2024-09-04T16:30:27.345 INFO:tasks.workunit.client.0.smithi170.stdout:6/456: chown d0/df/d1b/d3e/d47/d68/d2d/f8c 1 1 2024-09-04T16:30:27.346 INFO:tasks.workunit.client.0.smithi170.stdout:1/684: rename d9/d11/dae/ld3 to d9/d7b/d8f/le8 0 2024-09-04T16:30:27.347 INFO:tasks.workunit.client.0.smithi170.stdout:7/808: mknod d12/d15/d71/d42/d79/d9d/d51/c115 0 2024-09-04T16:30:27.348 INFO:tasks.workunit.client.0.smithi170.stdout:6/457: dread - d0/d15/d56/d6c/f81 zero size 2024-09-04T16:30:27.350 INFO:tasks.workunit.client.0.smithi170.stdout:1/685: mknod d9/d34/ce9 0 2024-09-04T16:30:27.353 INFO:tasks.workunit.client.0.smithi170.stdout:6/458: write d0/f9 [3797192,122522] 0 2024-09-04T16:30:27.354 INFO:tasks.workunit.client.0.smithi170.stdout:9/607: truncate d2/d11/f36 2379527 0 2024-09-04T16:30:27.355 INFO:tasks.workunit.client.0.smithi170.stdout:6/459: fsync d0/df/f28 0 2024-09-04T16:30:27.355 INFO:tasks.workunit.client.0.smithi170.stdout:1/686: creat d9/d11/d2f/dc2/fea x:0 0 0 2024-09-04T16:30:27.359 INFO:tasks.workunit.client.0.smithi170.stdout:9/608: creat d2/d3d/d6d/fb4 x:0 0 0 2024-09-04T16:30:27.362 INFO:tasks.workunit.client.0.smithi170.stdout:9/609: fdatasync d2/d3d/f57 0 2024-09-04T16:30:27.363 INFO:tasks.workunit.client.0.smithi170.stdout:1/687: dwrite d9/d11/d2f/d7f/fd7 [0,4194304] 0 2024-09-04T16:30:27.365 INFO:tasks.workunit.client.0.smithi170.stdout:6/460: creat d0/d17/d31/d64/d30/f91 x:0 0 0 2024-09-04T16:30:27.366 INFO:tasks.workunit.client.0.smithi170.stdout:6/461: fdatasync d0/d17/d31/d64/d30/f91 0 2024-09-04T16:30:27.375 INFO:tasks.workunit.client.0.smithi170.stdout:9/610: truncate d2/d3d/d27/d65/f52 2402068 0 2024-09-04T16:30:27.377 INFO:tasks.workunit.client.0.smithi170.stdout:1/688: dread d9/f55 [0,4194304] 0 2024-09-04T16:30:27.379 INFO:tasks.workunit.client.0.smithi170.stdout:9/611: truncate d2/d3d/d27/d65/d5b/f83 55750 0 2024-09-04T16:30:27.380 INFO:tasks.workunit.client.0.smithi170.stdout:9/612: chown d2/d3d/d6d/d79/db0 252953 1 2024-09-04T16:30:27.381 INFO:tasks.workunit.client.0.smithi170.stdout:9/613: read d2/d3d/d27/f53 [2260615,11929] 0 2024-09-04T16:30:27.385 INFO:tasks.workunit.client.0.smithi170.stdout:9/614: dread d2/d3d/d27/f53 [0,4194304] 0 2024-09-04T16:30:27.388 INFO:tasks.workunit.client.0.smithi170.stdout:9/615: creat d2/d3d/d27/fb5 x:0 0 0 2024-09-04T16:30:27.390 INFO:tasks.workunit.client.0.smithi170.stdout:9/616: truncate d2/d3d/d27/d65/d56/d7a/f9d 735783 0 2024-09-04T16:30:27.391 INFO:tasks.workunit.client.0.smithi170.stdout:9/617: read d2/d3d/d27/d65/d56/f60 [108109,21367] 0 2024-09-04T16:30:27.392 INFO:tasks.workunit.client.0.smithi170.stdout:9/618: stat d2/d3d/d27/d65/d56/fab 0 2024-09-04T16:30:27.392 INFO:tasks.workunit.client.0.smithi170.stdout:6/462: write d0/f16 [1252602,60027] 0 2024-09-04T16:30:27.394 INFO:tasks.workunit.client.0.smithi170.stdout:6/463: chown d0/df/d1b/l55 8625 1 2024-09-04T16:30:27.395 INFO:tasks.workunit.client.0.smithi170.stdout:1/689: write d9/d11/dae/f91 [206161,37410] 0 2024-09-04T16:30:27.396 INFO:tasks.workunit.client.0.smithi170.stdout:9/619: mkdir d2/d3d/d27/d65/d56/d7a/db6 0 2024-09-04T16:30:27.397 INFO:tasks.workunit.client.0.smithi170.stdout:1/690: chown d9/d11/d2f/d6b/d7d 7 1 2024-09-04T16:30:27.398 INFO:tasks.workunit.client.0.smithi170.stdout:6/464: mknod d0/df/d1b/d3e/d47/d68/d2d/c92 0 2024-09-04T16:30:27.400 INFO:tasks.workunit.client.0.smithi170.stdout:6/465: mknod d0/df/d7e/c93 0 2024-09-04T16:30:27.401 INFO:tasks.workunit.client.0.smithi170.stdout:9/620: dread d2/d3d/fc [0,4194304] 0 2024-09-04T16:30:27.405 INFO:tasks.workunit.client.0.smithi170.stdout:6/466: stat d0/d17/d5b/f7f 0 2024-09-04T16:30:27.405 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:27 smithi193 ceph-mon[36288]: pgmap v33: 65 pgs: 65 active+clean; 2.9 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 87 MiB/s rd, 208 MiB/s wr, 433 op/s 2024-09-04T16:30:27.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:27 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:27.407 INFO:tasks.workunit.client.0.smithi170.stdout:6/467: unlink d0/df/d1b/f29 0 2024-09-04T16:30:27.409 INFO:tasks.workunit.client.0.smithi170.stdout:9/621: getdents d2/d3d 0 2024-09-04T16:30:27.409 INFO:tasks.workunit.client.0.smithi170.stdout:9/622: chown d2/d3d/c1e 134078 1 2024-09-04T16:30:27.411 INFO:tasks.workunit.client.0.smithi170.stdout:9/623: write d2/d3d/d4d/f82 [2536068,68787] 0 2024-09-04T16:30:27.415 INFO:tasks.workunit.client.0.smithi170.stdout:9/624: rename d2/d3d/f1f to d2/d3d/d27/d65/d56/d7a/fb7 0 2024-09-04T16:30:27.416 INFO:tasks.workunit.client.0.smithi170.stdout:6/468: dwrite d0/d17/f1c [4194304,4194304] 0 2024-09-04T16:30:27.419 INFO:tasks.workunit.client.0.smithi170.stdout:6/469: mknod d0/df/d7e/c94 0 2024-09-04T16:30:27.419 INFO:tasks.workunit.client.0.smithi170.stdout:6/470: chown d0 2372312 1 2024-09-04T16:30:27.425 INFO:tasks.workunit.client.0.smithi170.stdout:6/471: creat d0/df/d1b/d3e/f95 x:0 0 0 2024-09-04T16:30:27.428 INFO:tasks.workunit.client.0.smithi170.stdout:6/472: creat d0/df/d1b/d3e/d47/d68/d2d/d67/f96 x:0 0 0 2024-09-04T16:30:27.429 INFO:tasks.workunit.client.0.smithi170.stdout:6/473: write d0/d15/d56/d6c/f81 [272551,18187] 0 2024-09-04T16:30:27.431 INFO:tasks.workunit.client.0.smithi170.stdout:6/474: mknod d0/df/d1b/c97 0 2024-09-04T16:30:27.433 INFO:tasks.workunit.client.0.smithi170.stdout:6/475: truncate d0/df/d1b/d3e/d47/d68/f61 1769495 0 2024-09-04T16:30:27.438 INFO:tasks.workunit.client.0.smithi170.stdout:6/476: rmdir d0/d17/d31/d64 39 2024-09-04T16:30:27.439 INFO:tasks.workunit.client.0.smithi170.stdout:6/477: fsync d0/df/d1b/d3e/d47/d68/d2d/f8c 0 2024-09-04T16:30:27.444 INFO:tasks.workunit.client.0.smithi170.stdout:9/625: stat d2/d3d/d27/d65/d56/d7a/db6 0 2024-09-04T16:30:27.446 INFO:tasks.workunit.client.0.smithi170.stdout:6/478: dwrite d0/f4 [0,4194304] 0 2024-09-04T16:30:27.512 INFO:tasks.workunit.client.0.smithi170.stdout:9/626: creat d2/d3d/d27/d65/d56/d7a/da5/fb8 x:0 0 0 2024-09-04T16:30:27.514 INFO:tasks.workunit.client.0.smithi170.stdout:6/479: mkdir d0/d15/d56/d6c/d98 0 2024-09-04T16:30:27.516 INFO:tasks.workunit.client.0.smithi170.stdout:6/480: write d0/d15/d56/d6c/f76 [3880057,35649] 0 2024-09-04T16:30:27.519 INFO:tasks.workunit.client.0.smithi170.stdout:9/627: dwrite d2/d3d/d27/f3a [0,4194304] 0 2024-09-04T16:30:27.578 INFO:tasks.workunit.client.0.smithi170.stdout:6/481: mkdir d0/d17/d39/d99 0 2024-09-04T16:30:27.581 INFO:tasks.workunit.client.0.smithi170.stdout:6/482: write d0/d17/d31/d64/d30/f84 [198311,45345] 0 2024-09-04T16:30:27.582 INFO:tasks.workunit.client.0.smithi170.stdout:6/483: write d0/df/fa [2198952,98481] 0 2024-09-04T16:30:27.586 INFO:tasks.workunit.client.0.smithi170.stdout:6/484: unlink d0/df/d1b/d3e/d47/d68/l33 0 2024-09-04T16:30:27.587 INFO:tasks.workunit.client.0.smithi170.stdout:6/485: mknod d0/df/d1b/c9a 0 2024-09-04T16:30:27.591 INFO:tasks.workunit.client.0.smithi170.stdout:6/486: link d0/l60 d0/d17/d31/d64/d30/l9b 0 2024-09-04T16:30:27.593 INFO:tasks.workunit.client.0.smithi170.stdout:6/487: mkdir d0/df/d1f/d9c 0 2024-09-04T16:30:27.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:27 smithi170 ceph-mon[29272]: pgmap v33: 65 pgs: 65 active+clean; 2.9 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 87 MiB/s rd, 208 MiB/s wr, 433 op/s 2024-09-04T16:30:27.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:27 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:27.603 INFO:tasks.workunit.client.0.smithi170.stdout:6/488: dwrite d0/df/f10 [0,4194304] 0 2024-09-04T16:30:27.617 INFO:tasks.workunit.client.0.smithi170.stdout:6/489: dread d0/d15/f26 [0,4194304] 0 2024-09-04T16:30:27.622 INFO:tasks.workunit.client.0.smithi170.stdout:6/490: write d0/d17/f18 [1931382,102339] 0 2024-09-04T16:30:27.622 INFO:tasks.workunit.client.0.smithi170.stdout:6/491: fsync d0/df/f28 0 2024-09-04T16:30:27.625 INFO:tasks.workunit.client.0.smithi170.stdout:6/492: rmdir d0/df/d1b/d3e 39 2024-09-04T16:30:27.628 INFO:tasks.workunit.client.0.smithi170.stdout:6/493: symlink d0/df/d1b/d3e/d47/l9d 0 2024-09-04T16:30:27.631 INFO:tasks.workunit.client.0.smithi170.stdout:6/494: rename d0/l3 to d0/d15/l9e 0 2024-09-04T16:30:27.632 INFO:tasks.workunit.client.0.smithi170.stdout:6/495: write d0/df/d7e/f8e [97176,77187] 0 2024-09-04T16:30:27.634 INFO:tasks.workunit.client.0.smithi170.stdout:6/496: write d0/df/d1b/d3e/d47/d68/d2d/d67/d69/f79 [989244,116280] 0 2024-09-04T16:30:27.638 INFO:tasks.workunit.client.0.smithi170.stdout:6/497: unlink d0/d17/d31/d64/f65 0 2024-09-04T16:30:27.647 INFO:tasks.workunit.client.0.smithi170.stdout:6/498: write d0/df/d1b/f24 [1174177,127870] 0 2024-09-04T16:30:27.648 INFO:tasks.workunit.client.0.smithi170.stdout:6/499: chown d0/df/d1b/d3e/d47/d68/d2d/d67/d73 27487220 1 2024-09-04T16:30:27.650 INFO:tasks.workunit.client.0.smithi170.stdout:6/500: mkdir d0/d9f 0 2024-09-04T16:30:27.652 INFO:tasks.workunit.client.0.smithi170.stdout:6/501: fsync d0/d17/f1d 0 2024-09-04T16:30:27.674 INFO:tasks.workunit.client.0.smithi170.stdout:6/502: dread d0/df/d1b/d3e/d47/d68/d2d/d2e/f49 [0,4194304] 0 2024-09-04T16:30:27.678 INFO:tasks.workunit.client.0.smithi170.stdout:6/503: fsync d0/f2 0 2024-09-04T16:30:27.685 INFO:tasks.workunit.client.0.smithi170.stdout:6/504: truncate d0/df/f10 4128099 0 2024-09-04T16:30:27.687 INFO:tasks.workunit.client.0.smithi170.stdout:6/505: chown d0/c62 20014 1 2024-09-04T16:30:27.688 INFO:tasks.workunit.client.0.smithi170.stdout:6/506: mkdir d0/d15/d56/d6c/da0 0 2024-09-04T16:30:27.690 INFO:tasks.workunit.client.0.smithi170.stdout:6/507: creat d0/df/fa1 x:0 0 0 2024-09-04T16:30:27.692 INFO:tasks.workunit.client.0.smithi170.stdout:6/508: creat d0/d17/d5b/fa2 x:0 0 0 2024-09-04T16:30:27.694 INFO:tasks.workunit.client.0.smithi170.stdout:6/509: symlink d0/la3 0 2024-09-04T16:30:27.705 INFO:tasks.workunit.client.0.smithi170.stdout:6/510: truncate d0/df/d1b/d3e/d47/d68/d2d/d2e/f66 374485 0 2024-09-04T16:30:27.712 INFO:tasks.workunit.client.0.smithi170.stdout:6/511: link d0/df/d1b/d3e/d47/d68/f41 d0/df/d1b/d3e/d47/d68/d2d/d2e/fa4 0 2024-09-04T16:30:27.717 INFO:tasks.workunit.client.0.smithi170.stdout:6/512: dwrite d0/df/d1b/d3e/f95 [0,4194304] 0 2024-09-04T16:30:27.725 INFO:tasks.workunit.client.0.smithi170.stdout:6/513: creat d0/df/d1b/fa5 x:0 0 0 2024-09-04T16:30:27.738 INFO:tasks.workunit.client.0.smithi170.stdout:6/514: write d0/fd [4231788,92027] 0 2024-09-04T16:30:27.740 INFO:tasks.workunit.client.0.smithi170.stdout:6/515: write d0/df/f3a [7832568,32153] 0 2024-09-04T16:30:27.757 INFO:tasks.workunit.client.0.smithi170.stdout:6/516: dread d0/df/d1b/d3e/d47/d68/f5d [0,4194304] 0 2024-09-04T16:30:27.758 INFO:tasks.workunit.client.0.smithi170.stdout:4/575: sync 2024-09-04T16:30:27.758 INFO:tasks.workunit.client.0.smithi170.stdout:8/594: sync 2024-09-04T16:30:27.760 INFO:tasks.workunit.client.0.smithi170.stdout:8/595: chown d6/d28/d5f/d70/d97/fb6 226824 1 2024-09-04T16:30:27.764 INFO:tasks.workunit.client.0.smithi170.stdout:6/517: getdents d0/d17/d31/d64 0 2024-09-04T16:30:27.769 INFO:tasks.workunit.client.0.smithi170.stdout:8/596: write d6/d28/d5f/d91/fbf [4564959,24593] 0 2024-09-04T16:30:27.771 INFO:tasks.workunit.client.0.smithi170.stdout:8/597: read d6/d28/d16/d52/d73/fb3 [2843969,53518] 0 2024-09-04T16:30:27.772 INFO:tasks.workunit.client.0.smithi170.stdout:4/576: getdents d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97 0 2024-09-04T16:30:27.774 INFO:tasks.workunit.client.0.smithi170.stdout:6/518: write d0/d17/d31/d64/d30/f51 [2957459,72848] 0 2024-09-04T16:30:27.775 INFO:tasks.workunit.client.0.smithi170.stdout:6/519: fsync d0/df/d1b/f24 0 2024-09-04T16:30:27.776 INFO:tasks.workunit.client.0.smithi170.stdout:8/598: symlink d6/d28/d16/d24/d46/lcc 0 2024-09-04T16:30:27.776 INFO:tasks.workunit.client.0.smithi170.stdout:8/599: readlink l2 0 2024-09-04T16:30:27.780 INFO:tasks.workunit.client.0.smithi170.stdout:6/520: symlink d0/df/la6 0 2024-09-04T16:30:27.781 INFO:tasks.workunit.client.0.smithi170.stdout:6/521: write d0/df/d7e/f8e [995474,108398] 0 2024-09-04T16:30:27.783 INFO:tasks.workunit.client.0.smithi170.stdout:8/600: rename d6/d28/d1a/c8f to d6/d28/d1a/d38/ccd 0 2024-09-04T16:30:27.789 INFO:tasks.workunit.client.0.smithi170.stdout:8/601: dwrite d6/d28/d16/d77/fb7 [0,4194304] 0 2024-09-04T16:30:27.795 INFO:tasks.workunit.client.0.smithi170.stdout:8/602: creat d6/d28/d20/d6e/d76/fce x:0 0 0 2024-09-04T16:30:27.796 INFO:tasks.workunit.client.0.smithi170.stdout:4/577: link d1/d6/d8/c17 d1/d6/d2b/d47/d78/da7/cca 0 2024-09-04T16:30:27.798 INFO:tasks.workunit.client.0.smithi170.stdout:6/522: write d0/df/d1b/d3e/d47/d68/d2d/d2e/f43 [233702,64341] 0 2024-09-04T16:30:27.799 INFO:tasks.workunit.client.0.smithi170.stdout:8/603: fsync d6/d28/d20/f8a 0 2024-09-04T16:30:27.804 INFO:tasks.workunit.client.0.smithi170.stdout:4/578: mkdir d1/d6/d8/d20/d35/d3e/d4e/dcb 0 2024-09-04T16:30:27.806 INFO:tasks.workunit.client.0.smithi170.stdout:6/523: creat d0/df/d1b/d3e/d47/d68/d2d/fa7 x:0 0 0 2024-09-04T16:30:27.808 INFO:tasks.workunit.client.0.smithi170.stdout:8/604: creat d6/d28/d16/d52/d73/fcf x:0 0 0 2024-09-04T16:30:27.811 INFO:tasks.workunit.client.0.smithi170.stdout:4/579: mkdir d1/d6/d8/d20/d35/dcc 0 2024-09-04T16:30:27.812 INFO:tasks.workunit.client.0.smithi170.stdout:8/605: creat d6/d28/d16/d52/d73/d5d/d8b/fd0 x:0 0 0 2024-09-04T16:30:27.813 INFO:tasks.workunit.client.0.smithi170.stdout:8/606: chown d6/d28/d16/d52/d73/d5d 248 1 2024-09-04T16:30:27.813 INFO:tasks.workunit.client.0.smithi170.stdout:4/580: truncate d1/d6/d2b/d47/d78/f90 1031167 0 2024-09-04T16:30:27.820 INFO:tasks.workunit.client.0.smithi170.stdout:4/581: dwrite d1/d6/d8/d20/d95/d36/f3c [4194304,4194304] 0 2024-09-04T16:30:27.824 INFO:tasks.workunit.client.0.smithi170.stdout:6/524: dwrite d0/df/f10 [4194304,4194304] 0 2024-09-04T16:30:27.826 INFO:tasks.workunit.client.0.smithi170.stdout:6/525: chown d0/d15/d56/d6c 3 1 2024-09-04T16:30:27.829 INFO:tasks.workunit.client.0.smithi170.stdout:4/582: dread d1/d6/f75 [0,4194304] 0 2024-09-04T16:30:27.831 INFO:tasks.workunit.client.0.smithi170.stdout:6/526: rename d0/df/d1b/d3e/d47/d68/c4e to d0/d17/d31/d64/d30/ca8 0 2024-09-04T16:30:27.834 INFO:tasks.workunit.client.0.smithi170.stdout:4/583: mknod d1/d6/d8/d20/d95/d36/d9c/ccd 0 2024-09-04T16:30:27.841 INFO:tasks.workunit.client.0.smithi170.stdout:6/527: dwrite d0/df/fa1 [0,4194304] 0 2024-09-04T16:30:27.841 INFO:tasks.workunit.client.0.smithi170.stdout:6/528: stat d0/df/d1b/d3e/d47/c50 0 2024-09-04T16:30:27.842 INFO:tasks.workunit.client.0.smithi170.stdout:6/529: fdatasync d0/d15/d56/d6d/f7a 0 2024-09-04T16:30:27.843 INFO:tasks.workunit.client.0.smithi170.stdout:6/530: chown d0/d17/d31/d64/d30 2205387 1 2024-09-04T16:30:27.845 INFO:tasks.workunit.client.0.smithi170.stdout:6/531: mknod d0/df/d1f/ca9 0 2024-09-04T16:30:27.849 INFO:tasks.workunit.client.0.smithi170.stdout:6/532: creat d0/df/d1b/d3e/d47/d68/d2d/d2e/faa x:0 0 0 2024-09-04T16:30:27.853 INFO:tasks.workunit.client.0.smithi170.stdout:6/533: symlink d0/df/d1b/d3e/d47/d68/lab 0 2024-09-04T16:30:27.853 INFO:tasks.workunit.client.0.smithi170.stdout:6/534: chown d0/d15/d56/d6d/l75 1211 1 2024-09-04T16:30:27.861 INFO:tasks.workunit.client.0.smithi170.stdout:6/535: dwrite d0/df/d1b/d3e/d47/d68/d2d/d2e/faa [0,4194304] 0 2024-09-04T16:30:27.862 INFO:tasks.workunit.client.0.smithi170.stdout:6/536: read d0/d17/d31/d64/d30/f7c [220464,9726] 0 2024-09-04T16:30:27.863 INFO:tasks.workunit.client.0.smithi170.stdout:4/584: dread d1/d6/d8/d20/d35/d3e/d60/daa/fb7 [0,4194304] 0 2024-09-04T16:30:27.863 INFO:tasks.workunit.client.0.smithi170.stdout:4/585: write d1/d6/d22/f62 [3529340,27272] 0 2024-09-04T16:30:27.864 INFO:tasks.workunit.client.0.smithi170.stdout:4/586: fsync d1/d6/d8/f9a 0 2024-09-04T16:30:27.866 INFO:tasks.workunit.client.0.smithi170.stdout:6/537: readlink d0/d17/l59 0 2024-09-04T16:30:27.871 INFO:tasks.workunit.client.0.smithi170.stdout:4/587: fsync d1/d6/d8/d20/d95/d36/f28 0 2024-09-04T16:30:27.874 INFO:tasks.workunit.client.0.smithi170.stdout:6/538: rename d0/df/d1b/d3e/d47/d68/d2d/d67/d69 to d0/d15/d56/d6d/dac 0 2024-09-04T16:30:27.878 INFO:tasks.workunit.client.0.smithi170.stdout:4/588: creat d1/d6/d2b/d47/fce x:0 0 0 2024-09-04T16:30:27.880 INFO:tasks.workunit.client.0.smithi170.stdout:6/539: dread d0/df/d1b/d3e/d47/d68/f61 [0,4194304] 0 2024-09-04T16:30:27.885 INFO:tasks.workunit.client.0.smithi170.stdout:4/589: dwrite d1/d6/d8/d20/d95/d36/d79/fab [0,4194304] 0 2024-09-04T16:30:27.886 INFO:tasks.workunit.client.0.smithi170.stdout:6/540: rename d0/df/d1b/f24 to d0/d17/d39/d99/fad 0 2024-09-04T16:30:27.889 INFO:tasks.workunit.client.0.smithi170.stdout:4/590: creat d1/d6/d8/d20/d95/d36/fcf x:0 0 0 2024-09-04T16:30:27.890 INFO:tasks.workunit.client.0.smithi170.stdout:6/541: creat d0/df/d1f/fae x:0 0 0 2024-09-04T16:30:27.893 INFO:tasks.workunit.client.0.smithi170.stdout:4/591: symlink d1/d6/d22/d93/ld0 0 2024-09-04T16:30:27.894 INFO:tasks.workunit.client.0.smithi170.stdout:4/592: chown d1/d6/d8/d20/d35/d3e/d4e/d51/d8b 6497 1 2024-09-04T16:30:28.301 INFO:tasks.workunit.client.0.smithi170.stdout:3/551: sync 2024-09-04T16:30:28.301 INFO:tasks.workunit.client.0.smithi170.stdout:0/679: sync 2024-09-04T16:30:28.307 INFO:tasks.workunit.client.0.smithi170.stdout:3/552: dwrite d13/d14/d21/d4d/d4e/fb4 [0,4194304] 0 2024-09-04T16:30:28.309 INFO:tasks.workunit.client.0.smithi170.stdout:0/680: rename d11/d13/d35/fa3 to d11/d13/d71/d43/f102 0 2024-09-04T16:30:28.311 INFO:tasks.workunit.client.0.smithi170.stdout:3/553: mknod d13/d14/d1d/d71/cb7 0 2024-09-04T16:30:28.312 INFO:tasks.workunit.client.0.smithi170.stdout:0/681: rmdir d11/d13/d35 39 2024-09-04T16:30:28.319 INFO:tasks.workunit.client.0.smithi170.stdout:0/682: creat d11/d75/dce/f103 x:0 0 0 2024-09-04T16:30:28.323 INFO:tasks.workunit.client.0.smithi170.stdout:0/683: creat d11/d13/d36/dfd/f104 x:0 0 0 2024-09-04T16:30:28.336 INFO:tasks.workunit.client.0.smithi170.stdout:3/554: dwrite d13/d14/d21/d4d/f6f [8388608,4194304] 0 2024-09-04T16:30:28.339 INFO:tasks.workunit.client.0.smithi170.stdout:0/684: dwrite d11/d13/d4a/f88 [0,4194304] 0 2024-09-04T16:30:28.340 INFO:tasks.workunit.client.0.smithi170.stdout:0/685: stat d11/d75/cec 0 2024-09-04T16:30:28.353 INFO:tasks.workunit.client.0.smithi170.stdout:3/555: truncate d13/d14/d1d/d2d/d6c/f70 258259 0 2024-09-04T16:30:28.354 INFO:tasks.workunit.client.0.smithi170.stdout:3/556: truncate d13/d14/d1f/f73 1391408 0 2024-09-04T16:30:28.354 INFO:tasks.workunit.client.0.smithi170.stdout:3/557: readlink d13/d14/d1d/da4/da8/lad 0 2024-09-04T16:30:28.355 INFO:tasks.workunit.client.0.smithi170.stdout:3/558: stat d13/d14/d1d/f61 0 2024-09-04T16:30:28.355 INFO:tasks.workunit.client.0.smithi170.stdout:3/559: fsync d13/f51 0 2024-09-04T16:30:28.356 INFO:tasks.workunit.client.0.smithi170.stdout:3/560: read - d13/d14/d1d/d71/db3/db6/faa zero size 2024-09-04T16:30:28.357 INFO:tasks.workunit.client.0.smithi170.stdout:3/561: write d13/d14/d1f/f73 [479136,33165] 0 2024-09-04T16:30:28.365 INFO:tasks.workunit.client.0.smithi170.stdout:0/686: dread fe [0,4194304] 0 2024-09-04T16:30:28.369 INFO:tasks.workunit.client.0.smithi170.stdout:3/562: dread d13/d14/d1d/d2d/d6c/f70 [0,4194304] 0 2024-09-04T16:30:28.370 INFO:tasks.workunit.client.0.smithi170.stdout:3/563: chown d13/d14/d17/d1c/c22 4162 1 2024-09-04T16:30:28.373 INFO:tasks.workunit.client.0.smithi170.stdout:3/564: mknod d13/d14/d1d/d71/db3/db6/cb8 0 2024-09-04T16:30:28.374 INFO:tasks.workunit.client.0.smithi170.stdout:3/565: truncate d13/d14/d1f/d7a/f9a 490307 0 2024-09-04T16:30:28.376 INFO:tasks.workunit.client.0.smithi170.stdout:0/687: write d11/d13/d36/f7a [1176942,93374] 0 2024-09-04T16:30:28.378 INFO:tasks.workunit.client.0.smithi170.stdout:0/688: unlink d11/d13/d71/d43/f60 0 2024-09-04T16:30:28.380 INFO:tasks.workunit.client.0.smithi170.stdout:0/689: write d11/d8e/dd7/f101 [193436,83807] 0 2024-09-04T16:30:28.381 INFO:tasks.workunit.client.0.smithi170.stdout:0/690: write d11/d8e/fbe [424691,72241] 0 2024-09-04T16:30:28.386 INFO:tasks.workunit.client.0.smithi170.stdout:3/566: dwrite d13/d14/d21/d4c/f5d [0,4194304] 0 2024-09-04T16:30:28.387 INFO:tasks.workunit.client.0.smithi170.stdout:3/567: chown d13/d14/d1f/f3e 207066596 1 2024-09-04T16:30:28.389 INFO:tasks.workunit.client.0.smithi170.stdout:0/691: rmdir d11/d13/d4a/d66/d6d/dcc 0 2024-09-04T16:30:28.391 INFO:tasks.workunit.client.0.smithi170.stdout:3/568: rename d13/d14/d1f/f91 to d13/d14/d21/d4d/d4e/fb9 0 2024-09-04T16:30:28.392 INFO:tasks.workunit.client.0.smithi170.stdout:0/692: stat d11/d13/d35/l5e 0 2024-09-04T16:30:28.393 INFO:tasks.workunit.client.0.smithi170.stdout:3/569: symlink d13/lba 0 2024-09-04T16:30:28.401 INFO:tasks.workunit.client.0.smithi170.stdout:3/570: creat d13/d14/d17/fbb x:0 0 0 2024-09-04T16:30:28.402 INFO:tasks.workunit.client.0.smithi170.stdout:3/571: symlink d13/lbc 0 2024-09-04T16:30:28.402 INFO:tasks.workunit.client.0.smithi170.stdout:0/693: truncate d11/f68 2485260 0 2024-09-04T16:30:28.403 INFO:tasks.workunit.client.0.smithi170.stdout:3/572: mkdir d13/d14/d1d/d71/db3/dbd 0 2024-09-04T16:30:28.404 INFO:tasks.workunit.client.0.smithi170.stdout:3/573: chown d13/d14/d1d/d2d/f34 27164 1 2024-09-04T16:30:28.406 INFO:tasks.workunit.client.0.smithi170.stdout:0/694: truncate d11/d13/d71/d43/f3c 437666 0 2024-09-04T16:30:28.406 INFO:tasks.workunit.client.0.smithi170.stdout:0/695: dread - d11/d13/d35/fd0 zero size 2024-09-04T16:30:28.408 INFO:tasks.workunit.client.0.smithi170.stdout:3/574: rename d13/d14/d1d/d2d/c57 to d13/d14/d17/d1c/d98/cbe 0 2024-09-04T16:30:28.408 INFO:tasks.workunit.client.0.smithi170.stdout:3/575: chown d13/d14/d1f/f73 3744 1 2024-09-04T16:30:28.409 INFO:tasks.workunit.client.0.smithi170.stdout:3/576: write d13/d14/d17/fbb [501597,109166] 0 2024-09-04T16:30:28.409 INFO:tasks.workunit.client.0.smithi170.stdout:0/696: rename d11/d8e to d11/d13/d4a/d66/d6d/d105 0 2024-09-04T16:30:28.410 INFO:tasks.workunit.client.0.smithi170.stdout:3/577: chown d13/d14/d17/f7b 344 1 2024-09-04T16:30:28.411 INFO:tasks.workunit.client.0.smithi170.stdout:0/697: write d11/d13/d35/fd0 [234381,10947] 0 2024-09-04T16:30:28.412 INFO:tasks.workunit.client.0.smithi170.stdout:3/578: write d13/d14/d21/d4c/f77 [254264,62522] 0 2024-09-04T16:30:28.413 INFO:tasks.workunit.client.0.smithi170.stdout:0/698: write d11/d13/d35/fc2 [538236,66447] 0 2024-09-04T16:30:28.414 INFO:tasks.workunit.client.0.smithi170.stdout:0/699: fdatasync d11/d13/d36/f40 0 2024-09-04T16:30:28.418 INFO:tasks.workunit.client.0.smithi170.stdout:0/700: unlink d11/d13/d4a/dc5/df0/ff7 0 2024-09-04T16:30:28.440 INFO:tasks.workunit.client.0.smithi170.stdout:0/701: truncate d11/d13/d36/f93 3114310 0 2024-09-04T16:30:28.447 INFO:tasks.workunit.client.0.smithi170.stdout:0/702: dread d11/d13/d71/f5f [0,4194304] 0 2024-09-04T16:30:28.449 INFO:tasks.workunit.client.0.smithi170.stdout:0/703: symlink d11/d13/l106 0 2024-09-04T16:30:28.449 INFO:tasks.workunit.client.0.smithi170.stdout:0/704: chown d11 358788410 1 2024-09-04T16:30:28.450 INFO:tasks.workunit.client.0.smithi170.stdout:0/705: mkdir d11/d13/d36/d107 0 2024-09-04T16:30:28.452 INFO:tasks.workunit.client.0.smithi170.stdout:0/706: creat d11/d75/dce/f108 x:0 0 0 2024-09-04T16:30:28.500 INFO:tasks.workunit.client.0.smithi170.stdout:2/652: sync 2024-09-04T16:30:28.539 INFO:tasks.workunit.client.0.smithi170.stdout:0/707: symlink d11/d13/d4a/d66/d8c/ddd/l109 0 2024-09-04T16:30:28.542 INFO:tasks.workunit.client.0.smithi170.stdout:0/708: dread d11/d13/d36/f40 [0,4194304] 0 2024-09-04T16:30:28.543 INFO:tasks.workunit.client.0.smithi170.stdout:2/653: rename d3/d4/d79 to d3/d4/d86/dc9/dd9 0 2024-09-04T16:30:28.545 INFO:tasks.workunit.client.0.smithi170.stdout:0/709: creat d11/d13/d4a/d66/d8c/ddd/f10a x:0 0 0 2024-09-04T16:30:28.547 INFO:tasks.workunit.client.0.smithi170.stdout:0/710: mkdir d11/d13/d4a/dc5/d10b 0 2024-09-04T16:30:28.549 INFO:tasks.workunit.client.0.smithi170.stdout:0/711: write d11/d13/d71/d43/f58 [2382942,115739] 0 2024-09-04T16:30:28.553 INFO:tasks.workunit.client.0.smithi170.stdout:0/712: creat d11/d13/d4a/d66/d6d/f10c x:0 0 0 2024-09-04T16:30:28.555 INFO:tasks.workunit.client.0.smithi170.stdout:0/713: creat d11/d13/d36/de5/f10d x:0 0 0 2024-09-04T16:30:28.556 INFO:tasks.workunit.client.0.smithi170.stdout:0/714: fdatasync d11/d13/d2f/f92 0 2024-09-04T16:30:28.559 INFO:tasks.workunit.client.0.smithi170.stdout:0/715: rename d11/d75/fb7 to d11/d13/d4a/dc5/df0/f10e 0 2024-09-04T16:30:28.560 INFO:tasks.workunit.client.0.smithi170.stdout:2/654: dread d3/db/d1c/f42 [0,4194304] 0 2024-09-04T16:30:28.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:28 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:30:28.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:28 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:28.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:28 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-04T16:30:28.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:28 smithi170 ceph-mon[29272]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-04T16:30:28.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:28 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:30:28.621 INFO:tasks.workunit.client.0.smithi170.stdout:7/809: sync 2024-09-04T16:30:28.621 INFO:tasks.workunit.client.0.smithi170.stdout:5/518: sync 2024-09-04T16:30:28.622 INFO:tasks.workunit.client.0.smithi170.stdout:7/810: chown d12/d15/d41/ff3 2 1 2024-09-04T16:30:28.624 INFO:tasks.workunit.client.0.smithi170.stdout:0/716: dread d11/d13/d2f/fa7 [0,4194304] 0 2024-09-04T16:30:28.624 INFO:tasks.workunit.client.0.smithi170.stdout:2/655: link d3/f50 d3/d4/d86/dc9/dd9/fda 0 2024-09-04T16:30:28.628 INFO:tasks.workunit.client.0.smithi170.stdout:7/811: rename d12/d16/db7/fd1 to d12/d16/d109/f116 0 2024-09-04T16:30:28.630 INFO:tasks.workunit.client.0.smithi170.stdout:5/519: dread d4/db/f1d [0,4194304] 0 2024-09-04T16:30:28.632 INFO:tasks.workunit.client.0.smithi170.stdout:0/717: rename d11/d13/d4a/dc9 to d11/d13/d4a/d66/d6d/d105/d10f 0 2024-09-04T16:30:28.632 INFO:tasks.workunit.client.0.smithi170.stdout:5/520: write d4/d8/d1c/d26/d27/d43/d5b/f9d [545573,130740] 0 2024-09-04T16:30:28.633 INFO:tasks.workunit.client.0.smithi170.stdout:5/521: fdatasync d4/d8/d1c/d23/f83 0 2024-09-04T16:30:28.634 INFO:tasks.workunit.client.0.smithi170.stdout:2/656: write d3/db/df/d45/f9b [4705509,41619] 0 2024-09-04T16:30:28.639 INFO:tasks.workunit.client.0.smithi170.stdout:0/718: rename d11/ff2 to d11/d13/d4a/d66/d8c/da8/f110 0 2024-09-04T16:30:28.640 INFO:tasks.workunit.client.0.smithi170.stdout:0/719: chown d11/d13/d4a/db8/cd4 2036876 1 2024-09-04T16:30:28.641 INFO:tasks.workunit.client.0.smithi170.stdout:5/522: write d4/d3a/d74/fa1 [4596231,49007] 0 2024-09-04T16:30:28.641 INFO:tasks.workunit.client.0.smithi170.stdout:2/657: creat d3/d4/d86/dc9/fdb x:0 0 0 2024-09-04T16:30:28.642 INFO:tasks.workunit.client.0.smithi170.stdout:0/720: write d11/d13/d36/de5/f10d [775397,62532] 0 2024-09-04T16:30:28.644 INFO:tasks.workunit.client.0.smithi170.stdout:2/658: write d3/d3c/d40/d48/f54 [4721359,11128] 0 2024-09-04T16:30:28.649 INFO:tasks.workunit.client.0.smithi170.stdout:0/721: mkdir d11/d13/d4a/db8/d111 0 2024-09-04T16:30:28.650 INFO:tasks.workunit.client.0.smithi170.stdout:7/812: dwrite d12/d16/d1d/d65/d82/fbb [0,4194304] 0 2024-09-04T16:30:28.655 INFO:tasks.workunit.client.0.smithi170.stdout:5/523: link d4/db/d37/l42 d4/d8/d1c/d41/la9 0 2024-09-04T16:30:28.655 INFO:tasks.workunit.client.0.smithi170.stdout:7/813: dread d12/d16/d1d/d65/f89 [0,4194304] 0 2024-09-04T16:30:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:28 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:30:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:28 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:28 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-04T16:30:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:28 smithi193 ceph-mon[36288]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-04T16:30:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:28 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:30:28.657 INFO:tasks.workunit.client.0.smithi170.stdout:0/722: symlink d11/d13/d4a/db8/d111/l112 0 2024-09-04T16:30:28.659 INFO:tasks.workunit.client.0.smithi170.stdout:5/524: creat d4/d8/d1c/d41/faa x:0 0 0 2024-09-04T16:30:28.660 INFO:tasks.workunit.client.0.smithi170.stdout:2/659: write d3/db/d62/d6f/f96 [2648405,52082] 0 2024-09-04T16:30:28.662 INFO:tasks.workunit.client.0.smithi170.stdout:5/525: write d4/db/f1e [2981989,50586] 0 2024-09-04T16:30:28.666 INFO:tasks.workunit.client.0.smithi170.stdout:0/723: dwrite d11/d13/d36/f7a [0,4194304] 0 2024-09-04T16:30:28.667 INFO:tasks.workunit.client.0.smithi170.stdout:5/526: creat d4/db/d37/fab x:0 0 0 2024-09-04T16:30:28.672 INFO:tasks.workunit.client.0.smithi170.stdout:5/527: rename d4/d8/d1c/d26/c7a to d4/db/d37/cac 0 2024-09-04T16:30:28.672 INFO:tasks.workunit.client.0.smithi170.stdout:7/814: link d12/d16/lc3 d12/d15/d71/d42/d79/d9d/dc9/df6/l117 0 2024-09-04T16:30:28.673 INFO:tasks.workunit.client.0.smithi170.stdout:2/660: dwrite d3/d4/d86/dc9/fdb [0,4194304] 0 2024-09-04T16:30:28.674 INFO:tasks.workunit.client.0.smithi170.stdout:2/661: dread - d3/f8d zero size 2024-09-04T16:30:28.676 INFO:tasks.workunit.client.0.smithi170.stdout:0/724: mkdir d11/d13/d4a/d66/d8c/d113 0 2024-09-04T16:30:28.676 INFO:tasks.workunit.client.0.smithi170.stdout:5/528: symlink d4/d8/d1c/d23/lad 0 2024-09-04T16:30:28.678 INFO:tasks.workunit.client.0.smithi170.stdout:5/529: dread - d4/d8/d1c/d26/d27/d43/d5b/f96 zero size 2024-09-04T16:30:28.682 INFO:tasks.workunit.client.0.smithi170.stdout:7/815: write d12/d16/d1d/d65/d82/dcb/fe9 [4932213,49323] 0 2024-09-04T16:30:28.693 INFO:tasks.workunit.client.0.smithi170.stdout:0/725: creat d11/d13/d71/d43/f114 x:0 0 0 2024-09-04T16:30:28.694 INFO:tasks.workunit.client.0.smithi170.stdout:7/816: mkdir d12/d16/d1d/d65/d118 0 2024-09-04T16:30:28.695 INFO:tasks.workunit.client.0.smithi170.stdout:0/726: symlink d11/d13/d4a/db8/l115 0 2024-09-04T16:30:28.699 INFO:tasks.workunit.client.0.smithi170.stdout:5/530: write d4/d8/d1c/d41/f4f [5069094,92674] 0 2024-09-04T16:30:28.699 INFO:tasks.workunit.client.0.smithi170.stdout:0/727: getdents d11/d13/d4a/dc5/d10b 0 2024-09-04T16:30:28.700 INFO:tasks.workunit.client.0.smithi170.stdout:7/817: link d12/d15/f28 d12/d16/db7/deb/f119 0 2024-09-04T16:30:28.702 INFO:tasks.workunit.client.0.smithi170.stdout:5/531: fdatasync d4/d8/d1c/d41/f4f 0 2024-09-04T16:30:28.703 INFO:tasks.workunit.client.0.smithi170.stdout:7/818: truncate d12/d16/d1d/d65/d82/f85 1364607 0 2024-09-04T16:30:28.709 INFO:tasks.workunit.client.0.smithi170.stdout:0/728: link d11/d13/l106 d11/d13/d71/d43/l116 0 2024-09-04T16:30:28.709 INFO:tasks.workunit.client.0.smithi170.stdout:7/819: dread d12/d15/fa4 [0,4194304] 0 2024-09-04T16:30:28.715 INFO:tasks.workunit.client.0.smithi170.stdout:5/532: write d4/db/d37/f36 [5110686,124188] 0 2024-09-04T16:30:28.716 INFO:tasks.workunit.client.0.smithi170.stdout:0/729: link d11/d13/d36/lbd d11/d13/d4a/dc5/d10b/l117 0 2024-09-04T16:30:28.717 INFO:tasks.workunit.client.0.smithi170.stdout:0/730: fsync d11/d13/d4a/d66/d6d/fac 0 2024-09-04T16:30:28.719 INFO:tasks.workunit.client.0.smithi170.stdout:5/533: rename d4/f2c to d4/d3a/fae 0 2024-09-04T16:30:28.721 INFO:tasks.workunit.client.0.smithi170.stdout:5/534: readlink d4/d8/l22 0 2024-09-04T16:30:28.722 INFO:tasks.workunit.client.0.smithi170.stdout:0/731: fdatasync d11/d13/d71/f76 0 2024-09-04T16:30:28.724 INFO:tasks.workunit.client.0.smithi170.stdout:7/820: dwrite d12/d15/d71/f7f [0,4194304] 0 2024-09-04T16:30:28.729 INFO:tasks.workunit.client.0.smithi170.stdout:0/732: creat d11/d13/d36/f118 x:0 0 0 2024-09-04T16:30:28.734 INFO:tasks.workunit.client.0.smithi170.stdout:7/821: creat d12/d15/d71/d42/d79/f11a x:0 0 0 2024-09-04T16:30:28.735 INFO:tasks.workunit.client.0.smithi170.stdout:5/535: dread d4/d8/d1c/d26/d27/d48/f52 [0,4194304] 0 2024-09-04T16:30:28.736 INFO:tasks.workunit.client.0.smithi170.stdout:5/536: write d4/d8/d1c/d26/d27/d43/f86 [835250,40427] 0 2024-09-04T16:30:28.737 INFO:tasks.workunit.client.0.smithi170.stdout:0/733: symlink d11/d13/d71/l119 0 2024-09-04T16:30:28.737 INFO:tasks.workunit.client.0.smithi170.stdout:7/822: read fc [56175,77451] 0 2024-09-04T16:30:28.738 INFO:tasks.workunit.client.0.smithi170.stdout:5/537: chown d4/d8/d1c/d26/d27/d43/d5b/la3 168243 1 2024-09-04T16:30:28.739 INFO:tasks.workunit.client.0.smithi170.stdout:0/734: getdents d11/d13/d4a/d66/d6d/d105/d10f 0 2024-09-04T16:30:28.745 INFO:tasks.workunit.client.0.smithi170.stdout:0/735: rename d11/d13/d4a/d66/d6d/d105/dd7/lfe to d11/d13/d4a/d66/d8c/dae/l11a 0 2024-09-04T16:30:28.753 INFO:tasks.workunit.client.0.smithi170.stdout:0/736: dwrite d11/d13/d2f/fa7 [0,4194304] 0 2024-09-04T16:30:28.755 INFO:tasks.workunit.client.0.smithi170.stdout:5/538: dwrite d4/d8/d1c/d23/f2f [0,4194304] 0 2024-09-04T16:30:28.764 INFO:tasks.workunit.client.0.smithi170.stdout:0/737: dwrite d11/d13/d2f/fa7 [0,4194304] 0 2024-09-04T16:30:28.768 INFO:tasks.workunit.client.0.smithi170.stdout:1/691: sync 2024-09-04T16:30:28.771 INFO:tasks.workunit.client.0.smithi170.stdout:0/738: link d11/d13/d4a/d66/d6d/fac d11/d13/d36/f11b 0 2024-09-04T16:30:28.773 INFO:tasks.workunit.client.0.smithi170.stdout:1/692: rmdir d9 39 2024-09-04T16:30:28.776 INFO:tasks.workunit.client.0.smithi170.stdout:1/693: readlink d9/l20 0 2024-09-04T16:30:28.777 INFO:tasks.workunit.client.0.smithi170.stdout:0/739: link d11/d75/l8f d11/d13/d36/d107/l11c 0 2024-09-04T16:30:28.781 INFO:tasks.workunit.client.0.smithi170.stdout:5/539: dread d4/d3a/d74/fa1 [0,4194304] 0 2024-09-04T16:30:28.800 INFO:tasks.workunit.client.0.smithi170.stdout:1/694: truncate d9/d11/d9b/fb8 78906 0 2024-09-04T16:30:28.802 INFO:tasks.workunit.client.0.smithi170.stdout:0/740: write d11/d13/d4a/d66/d8c/da8/fee [1443606,120345] 0 2024-09-04T16:30:28.804 INFO:tasks.workunit.client.0.smithi170.stdout:1/695: dread d9/d11/d2f/f58 [0,4194304] 0 2024-09-04T16:30:28.805 INFO:tasks.workunit.client.0.smithi170.stdout:5/540: dread d4/d8/d1c/d26/d27/d43/f87 [0,4194304] 0 2024-09-04T16:30:28.806 INFO:tasks.workunit.client.0.smithi170.stdout:0/741: dread - d11/d13/d71/fb6 zero size 2024-09-04T16:30:28.807 INFO:tasks.workunit.client.0.smithi170.stdout:1/696: creat d9/d11/d2e/feb x:0 0 0 2024-09-04T16:30:28.808 INFO:tasks.workunit.client.0.smithi170.stdout:5/541: unlink d4/d3a/d74/fa1 0 2024-09-04T16:30:28.809 INFO:tasks.workunit.client.0.smithi170.stdout:5/542: readlink d4/d8/d1c/d23/l75 0 2024-09-04T16:30:28.810 INFO:tasks.workunit.client.0.smithi170.stdout:0/742: write d11/d13/d71/f4c [1014470,81718] 0 2024-09-04T16:30:28.811 INFO:tasks.workunit.client.0.smithi170.stdout:1/697: unlink d9/d34/faf 0 2024-09-04T16:30:28.814 INFO:tasks.workunit.client.0.smithi170.stdout:0/743: mkdir d11/d13/d36/de5/d11d 0 2024-09-04T16:30:28.817 INFO:tasks.workunit.client.0.smithi170.stdout:0/744: creat d11/d13/d36/de5/f11e x:0 0 0 2024-09-04T16:30:28.825 INFO:tasks.workunit.client.0.smithi170.stdout:0/745: dwrite d11/d13/d4a/d66/d8c/dae/dfc/fe8 [0,4194304] 0 2024-09-04T16:30:28.827 INFO:tasks.workunit.client.0.smithi170.stdout:0/746: write d11/d75/fe4 [943120,89047] 0 2024-09-04T16:30:28.829 INFO:tasks.workunit.client.0.smithi170.stdout:1/698: dread d9/d26/d77/d83/f86 [0,4194304] 0 2024-09-04T16:30:28.830 INFO:tasks.workunit.client.0.smithi170.stdout:1/699: chown d9/d11/d2f/f57 0 1 2024-09-04T16:30:28.835 INFO:tasks.workunit.client.0.smithi170.stdout:1/700: mknod d9/d11/d85/cec 0 2024-09-04T16:30:28.839 INFO:tasks.workunit.client.0.smithi170.stdout:5/543: dwrite d4/f6 [4194304,4194304] 0 2024-09-04T16:30:28.840 INFO:tasks.workunit.client.0.smithi170.stdout:5/544: chown d4/c80 24 1 2024-09-04T16:30:28.841 INFO:tasks.workunit.client.0.smithi170.stdout:5/545: write d4/db/d51/d5e/d71/d84/f9b [6162386,47437] 0 2024-09-04T16:30:28.843 INFO:tasks.workunit.client.0.smithi170.stdout:5/546: dread - d4/d8/d1c/d26/d27/d43/d5b/f96 zero size 2024-09-04T16:30:28.849 INFO:tasks.workunit.client.0.smithi170.stdout:1/701: write d9/d26/f56 [1956684,114881] 0 2024-09-04T16:30:28.850 INFO:tasks.workunit.client.0.smithi170.stdout:5/547: getdents d4/d8/d1c 0 2024-09-04T16:30:28.857 INFO:tasks.workunit.client.0.smithi170.stdout:5/548: dwrite d4/d8/d1c/d23/d3e/f7e [0,4194304] 0 2024-09-04T16:30:28.861 INFO:tasks.workunit.client.0.smithi170.stdout:5/549: mkdir d4/d3a/d74/daf 0 2024-09-04T16:30:28.864 INFO:tasks.workunit.client.0.smithi170.stdout:5/550: chown d4/l1b 33279812 1 2024-09-04T16:30:28.867 INFO:tasks.workunit.client.0.smithi170.stdout:1/702: dwrite d9/d11/d2e/fa9 [0,4194304] 0 2024-09-04T16:30:28.870 INFO:tasks.workunit.client.0.smithi170.stdout:5/551: dread d4/db/f34 [0,4194304] 0 2024-09-04T16:30:28.873 INFO:tasks.workunit.client.0.smithi170.stdout:1/703: creat d9/d11/d2e/d9e/fed x:0 0 0 2024-09-04T16:30:28.876 INFO:tasks.workunit.client.0.smithi170.stdout:5/552: creat d4/db/d51/d5e/d71/d84/fb0 x:0 0 0 2024-09-04T16:30:28.880 INFO:tasks.workunit.client.0.smithi170.stdout:1/704: getdents d9/d11/d2f/d6b/d7d/dc6 0 2024-09-04T16:30:28.881 INFO:tasks.workunit.client.0.smithi170.stdout:1/705: write d9/fbd [866550,83821] 0 2024-09-04T16:30:28.884 INFO:tasks.workunit.client.0.smithi170.stdout:1/706: truncate d9/d11/dae/d6a/d79/f8c 816263 0 2024-09-04T16:30:28.885 INFO:tasks.workunit.client.0.smithi170.stdout:1/707: chown d9/d11/f1a 100539623 1 2024-09-04T16:30:28.889 INFO:tasks.workunit.client.0.smithi170.stdout:5/553: dread d4/d3a/fae [0,4194304] 0 2024-09-04T16:30:28.889 INFO:tasks.workunit.client.0.smithi170.stdout:5/554: chown d4/d8/d1c/d41/la9 2 1 2024-09-04T16:30:28.892 INFO:tasks.workunit.client.0.smithi170.stdout:5/555: write d4/d8/d1c/d26/f6a [1747439,106348] 0 2024-09-04T16:30:28.895 INFO:tasks.workunit.client.0.smithi170.stdout:5/556: symlink d4/d8/d1c/d26/d27/d43/d5b/lb1 0 2024-09-04T16:30:28.898 INFO:tasks.workunit.client.0.smithi170.stdout:5/557: rename d4/d8/l22 to d4/db/d37/lb2 0 2024-09-04T16:30:28.899 INFO:tasks.workunit.client.0.smithi170.stdout:1/708: write d9/d11/fa5 [210256,4848] 0 2024-09-04T16:30:28.900 INFO:tasks.workunit.client.0.smithi170.stdout:5/558: fdatasync d4/d8/d1c/d26/f6a 0 2024-09-04T16:30:28.901 INFO:tasks.workunit.client.0.smithi170.stdout:5/559: chown d4/d8/d1c/d26/d27/d43/f86 908596927 1 2024-09-04T16:30:28.905 INFO:tasks.workunit.client.0.smithi170.stdout:5/560: mkdir d4/d8/d1c/d23/d94/db3 0 2024-09-04T16:30:28.906 INFO:tasks.workunit.client.0.smithi170.stdout:1/709: getdents d9/d11/d2f/dc2 0 2024-09-04T16:30:28.906 INFO:tasks.workunit.client.0.smithi170.stdout:1/710: fsync d9/d11/fa5 0 2024-09-04T16:30:28.907 INFO:tasks.workunit.client.0.smithi170.stdout:1/711: write d9/d11/d2f/f5c [4372313,105535] 0 2024-09-04T16:30:28.908 INFO:tasks.workunit.client.0.smithi170.stdout:5/561: fsync d4/f3b 0 2024-09-04T16:30:28.910 INFO:tasks.workunit.client.0.smithi170.stdout:5/562: creat d4/db/fb4 x:0 0 0 2024-09-04T16:30:28.916 INFO:tasks.workunit.client.0.smithi170.stdout:5/563: dwrite d4/f2b [8388608,4194304] 0 2024-09-04T16:30:28.917 INFO:tasks.workunit.client.0.smithi170.stdout:5/564: write d4/d8/d1c/d29/f2a [2521038,69751] 0 2024-09-04T16:30:28.925 INFO:tasks.workunit.client.0.smithi170.stdout:5/565: dread d4/d8/d1c/f6d [0,4194304] 0 2024-09-04T16:30:28.931 INFO:tasks.workunit.client.0.smithi170.stdout:1/712: truncate d9/d11/d2e/fa9 4155110 0 2024-09-04T16:30:28.932 INFO:tasks.workunit.client.0.smithi170.stdout:1/713: dread - d9/d11/d2f/d6b/d7d/fb3 zero size 2024-09-04T16:30:28.932 INFO:tasks.workunit.client.0.smithi170.stdout:1/714: chown d9/d26/d77/d83/f86 480389446 1 2024-09-04T16:30:28.960 INFO:tasks.workunit.client.0.smithi170.stdout:9/628: sync 2024-09-04T16:30:28.960 INFO:tasks.workunit.client.0.smithi170.stdout:5/566: mkdir d4/d3a/d74/d8b/db5 0 2024-09-04T16:30:28.961 INFO:tasks.workunit.client.0.smithi170.stdout:1/715: write d9/d11/f21 [3764906,43836] 0 2024-09-04T16:30:28.964 INFO:tasks.workunit.client.0.smithi170.stdout:9/629: write d2/d11/f36 [1830084,107310] 0 2024-09-04T16:30:28.969 INFO:tasks.workunit.client.0.smithi170.stdout:1/716: dread d9/f54 [0,4194304] 0 2024-09-04T16:30:28.972 INFO:tasks.workunit.client.0.smithi170.stdout:9/630: link d2/d3d/d27/d65/d5b/f83 d2/d3d/d4d/d59/d85/fb9 0 2024-09-04T16:30:28.973 INFO:tasks.workunit.client.0.smithi170.stdout:1/717: truncate d9/d11/f14 4551233 0 2024-09-04T16:30:28.974 INFO:tasks.workunit.client.0.smithi170.stdout:9/631: mkdir d2/d11/d23/dba 0 2024-09-04T16:30:28.976 INFO:tasks.workunit.client.0.smithi170.stdout:1/718: mkdir d9/d11/d85/dd8/dee 0 2024-09-04T16:30:28.980 INFO:tasks.workunit.client.0.smithi170.stdout:9/632: dwrite d2/fa8 [0,4194304] 0 2024-09-04T16:30:28.984 INFO:tasks.workunit.client.0.smithi170.stdout:9/633: creat d2/d3d/d4d/d59/fbb x:0 0 0 2024-09-04T16:30:28.985 INFO:tasks.workunit.client.0.smithi170.stdout:9/634: chown d2/lb 68044 1 2024-09-04T16:30:28.990 INFO:tasks.workunit.client.0.smithi170.stdout:9/635: dread d2/d3d/d27/d65/d56/d7a/fb7 [0,4194304] 0 2024-09-04T16:30:28.991 INFO:tasks.workunit.client.0.smithi170.stdout:9/636: read - d2/d11/d23/d95/fa4 zero size 2024-09-04T16:30:28.994 INFO:tasks.workunit.client.0.smithi170.stdout:5/567: truncate d4/d8/d1c/d23/f5d 363026 0 2024-09-04T16:30:28.995 INFO:tasks.workunit.client.0.smithi170.stdout:9/637: dread d2/d3d/d27/f53 [0,4194304] 0 2024-09-04T16:30:28.997 INFO:tasks.workunit.client.0.smithi170.stdout:9/638: mknod d2/d3d/d4d/d59/cbc 0 2024-09-04T16:30:28.998 INFO:tasks.workunit.client.0.smithi170.stdout:9/639: stat d2/d3d/d27/d2b/daf/f6b 0 2024-09-04T16:30:29.007 INFO:tasks.workunit.client.0.smithi170.stdout:9/640: link d2/d11/f26 d2/d3d/d27/d65/d56/d7a/fbd 0 2024-09-04T16:30:29.008 INFO:tasks.workunit.client.0.smithi170.stdout:1/719: dwrite d9/d11/d2f/db9/fa6 [0,4194304] 0 2024-09-04T16:30:29.012 INFO:tasks.workunit.client.0.smithi170.stdout:9/641: rmdir d2/d3d/d27/d65/d56 39 2024-09-04T16:30:29.013 INFO:tasks.workunit.client.0.smithi170.stdout:9/642: write d2/fa8 [5121300,42787] 0 2024-09-04T16:30:29.016 INFO:tasks.workunit.client.0.smithi170.stdout:1/720: truncate d9/d11/d2f/f58 280874 0 2024-09-04T16:30:29.018 INFO:tasks.workunit.client.0.smithi170.stdout:9/643: creat d2/d11/d23/d95/fbe x:0 0 0 2024-09-04T16:30:29.025 INFO:tasks.workunit.client.0.smithi170.stdout:1/721: symlink d9/d11/d2e/db0/lef 0 2024-09-04T16:30:29.030 INFO:tasks.workunit.client.0.smithi170.stdout:9/644: rename d2/d32/f76 to d2/d3d/d27/d65/d56/d7a/db6/fbf 0 2024-09-04T16:30:29.043 INFO:tasks.workunit.client.0.smithi170.stdout:9/645: write d2/d3d/d27/d65/d56/d7a/fbd [4970488,96572] 0 2024-09-04T16:30:29.045 INFO:tasks.workunit.client.0.smithi170.stdout:1/722: mknod d9/d11/d2f/d6b/d7d/dde/cf0 0 2024-09-04T16:30:29.048 INFO:tasks.workunit.client.0.smithi170.stdout:1/723: symlink d9/d34/lf1 0 2024-09-04T16:30:29.048 INFO:tasks.workunit.client.0.smithi170.stdout:9/646: dread d2/d3d/d27/d2b/daf/f78 [0,4194304] 0 2024-09-04T16:30:29.049 INFO:tasks.workunit.client.0.smithi170.stdout:1/724: chown d9/d11/d2f/d6b/d7d/f9f 524881 1 2024-09-04T16:30:29.050 INFO:tasks.workunit.client.0.smithi170.stdout:1/725: readlink d9/d11/d85/dc5/lda 0 2024-09-04T16:30:29.051 INFO:tasks.workunit.client.0.smithi170.stdout:9/647: creat d2/d11/d58/fc0 x:0 0 0 2024-09-04T16:30:29.055 INFO:tasks.workunit.client.0.smithi170.stdout:1/726: dread d9/d11/dae/d6a/d79/d7c/fb2 [0,4194304] 0 2024-09-04T16:30:29.057 INFO:tasks.workunit.client.0.smithi170.stdout:9/648: symlink d2/d11/d8f/lc1 0 2024-09-04T16:30:29.062 INFO:tasks.workunit.client.0.smithi170.stdout:1/727: unlink d9/d11/d2f/f58 0 2024-09-04T16:30:29.064 INFO:tasks.workunit.client.0.smithi170.stdout:9/649: mkdir d2/d3d/d27/d65/dc2 0 2024-09-04T16:30:29.067 INFO:tasks.workunit.client.0.smithi170.stdout:9/650: readlink d2/d3d/d27/d2b/l87 0 2024-09-04T16:30:29.073 INFO:tasks.workunit.client.0.smithi170.stdout:9/651: getdents d2/d3d/d27/d65/d56 0 2024-09-04T16:30:29.076 INFO:tasks.workunit.client.0.smithi170.stdout:9/652: stat d2/d3d/d3f/d90 0 2024-09-04T16:30:29.080 INFO:tasks.workunit.client.0.smithi170.stdout:9/653: dread d2/d11/f36 [0,4194304] 0 2024-09-04T16:30:29.082 INFO:tasks.workunit.client.0.smithi170.stdout:9/654: rename d2/la3 to d2/d3d/d27/d65/d66/lc3 0 2024-09-04T16:30:29.086 INFO:tasks.workunit.client.0.smithi170.stdout:1/728: dwrite d9/f47 [0,4194304] 0 2024-09-04T16:30:29.088 INFO:tasks.workunit.client.0.smithi170.stdout:1/729: truncate d9/d11/d2f/d7f/da8/fe7 292759 0 2024-09-04T16:30:29.092 INFO:tasks.workunit.client.0.smithi170.stdout:1/730: creat d9/d11/dae/d6a/d79/ff2 x:0 0 0 2024-09-04T16:30:29.097 INFO:tasks.workunit.client.0.smithi170.stdout:1/731: dread d9/d11/d2f/d7f/fd7 [0,4194304] 0 2024-09-04T16:30:29.101 INFO:tasks.workunit.client.0.smithi170.stdout:9/655: dwrite d2/d3d/d27/d65/f52 [0,4194304] 0 2024-09-04T16:30:29.159 INFO:tasks.workunit.client.0.smithi170.stdout:9/656: rename d2/d3d/d27/d2b/l87 to d2/d3d/d3f/lc4 0 2024-09-04T16:30:29.161 INFO:tasks.workunit.client.0.smithi170.stdout:8/607: sync 2024-09-04T16:30:29.161 INFO:tasks.workunit.client.0.smithi170.stdout:8/608: chown d6/d28/d20/d5e/faf 191 1 2024-09-04T16:30:29.163 INFO:tasks.workunit.client.0.smithi170.stdout:1/732: creat d9/d11/d85/dd8/dee/ff3 x:0 0 0 2024-09-04T16:30:29.177 INFO:tasks.workunit.client.0.smithi170.stdout:1/733: mknod d9/d11/d85/dc5/cf4 0 2024-09-04T16:30:29.177 INFO:tasks.workunit.client.0.smithi170.stdout:8/609: dwrite d6/d28/d16/d24/d46/fb2 [0,4194304] 0 2024-09-04T16:30:29.179 INFO:tasks.workunit.client.0.smithi170.stdout:8/610: fsync d6/d28/d16/d77/d93/fab 0 2024-09-04T16:30:29.180 INFO:tasks.workunit.client.0.smithi170.stdout:9/657: rename d2/d11/f24 to d2/fc5 0 2024-09-04T16:30:29.183 INFO:tasks.workunit.client.0.smithi170.stdout:1/734: mkdir d9/d11/dae/df5 0 2024-09-04T16:30:29.189 INFO:tasks.workunit.client.0.smithi170.stdout:1/735: fsync d9/d26/d77/d83/f86 0 2024-09-04T16:30:29.195 INFO:tasks.workunit.client.0.smithi170.stdout:1/736: rmdir d9/d11/d2f/d6b/d7d/dde 39 2024-09-04T16:30:29.195 INFO:tasks.workunit.client.0.smithi170.stdout:1/737: stat d9/d11/d2f/d6b/d61 0 2024-09-04T16:30:29.199 INFO:tasks.workunit.client.0.smithi170.stdout:1/738: mkdir d9/d11/d85/df6 0 2024-09-04T16:30:29.203 INFO:tasks.workunit.client.0.smithi170.stdout:9/658: dread d2/d3d/d27/d65/d56/d7a/db6/fbf [0,4194304] 0 2024-09-04T16:30:29.203 INFO:tasks.workunit.client.0.smithi170.stdout:1/739: mknod d9/d11/d2f/d7f/da8/cf7 0 2024-09-04T16:30:29.203 INFO:tasks.workunit.client.0.smithi170.stdout:9/659: chown d2/d11/d58 9 1 2024-09-04T16:30:29.209 INFO:tasks.workunit.client.0.smithi170.stdout:9/660: unlink d2/d11/d23/d95/fa4 0 2024-09-04T16:30:29.209 INFO:tasks.workunit.client.0.smithi170.stdout:1/740: mknod d9/cf8 0 2024-09-04T16:30:29.210 INFO:tasks.workunit.client.0.smithi170.stdout:1/741: write d9/d11/dae/d6a/fa7 [1297898,21918] 0 2024-09-04T16:30:29.211 INFO:tasks.workunit.client.0.smithi170.stdout:8/611: write d6/f57 [260083,88698] 0 2024-09-04T16:30:29.214 INFO:tasks.workunit.client.0.smithi170.stdout:8/612: chown d6/d28/d16/c22 96887 1 2024-09-04T16:30:29.218 INFO:tasks.workunit.client.0.smithi170.stdout:9/661: dread d2/d3d/f8c [0,4194304] 0 2024-09-04T16:30:29.219 INFO:tasks.workunit.client.0.smithi170.stdout:8/613: mkdir d6/d28/d16/d52/d73/d5d/d8b/dd1 0 2024-09-04T16:30:29.225 INFO:tasks.workunit.client.0.smithi170.stdout:1/742: dread d9/d26/d77/d83/fa2 [0,4194304] 0 2024-09-04T16:30:29.226 INFO:tasks.workunit.client.0.smithi170.stdout:9/662: dwrite d2/d11/d23/d95/fa1 [0,4194304] 0 2024-09-04T16:30:29.235 INFO:tasks.workunit.client.0.smithi170.stdout:8/614: getdents d6/d28 0 2024-09-04T16:30:29.236 INFO:tasks.workunit.client.0.smithi170.stdout:9/663: dwrite d2/fc5 [0,4194304] 0 2024-09-04T16:30:29.237 INFO:tasks.workunit.client.0.smithi170.stdout:8/615: dread - d6/d28/d16/d52/fb1 zero size 2024-09-04T16:30:29.242 INFO:tasks.workunit.client.0.smithi170.stdout:9/664: mknod d2/cc6 0 2024-09-04T16:30:29.243 INFO:tasks.workunit.client.0.smithi170.stdout:9/665: stat d2/d3d/d4d/d59 0 2024-09-04T16:30:29.248 INFO:tasks.workunit.client.0.smithi170.stdout:9/666: symlink d2/d11/d23/dba/lc7 0 2024-09-04T16:30:29.251 INFO:tasks.workunit.client.0.smithi170.stdout:1/743: truncate d9/d34/d5f/f67 297302 0 2024-09-04T16:30:29.253 INFO:tasks.workunit.client.0.smithi170.stdout:1/744: symlink d9/d7b/lf9 0 2024-09-04T16:30:29.256 INFO:tasks.workunit.client.0.smithi170.stdout:1/745: write d9/d26/d77/d83/fa2 [1653930,119332] 0 2024-09-04T16:30:29.258 INFO:tasks.workunit.client.0.smithi170.stdout:8/616: dwrite d6/d28/d1a/f54 [0,4194304] 0 2024-09-04T16:30:29.258 INFO:tasks.workunit.client.0.smithi170.stdout:1/746: rmdir d9/d7b 39 2024-09-04T16:30:29.259 INFO:tasks.workunit.client.0.smithi170.stdout:1/747: chown d9/d11/d2f/d6b/le3 12870863 1 2024-09-04T16:30:29.264 INFO:tasks.workunit.client.0.smithi170.stdout:1/748: link d9/cf8 d9/d11/d85/dd8/dee/cfa 0 2024-09-04T16:30:29.264 INFO:tasks.workunit.client.0.smithi170.stdout:8/617: dread d6/d28/d5f/d70/f7d [0,4194304] 0 2024-09-04T16:30:29.271 INFO:tasks.workunit.client.0.smithi170.stdout:1/749: dwrite d9/d11/dae/f82 [4194304,4194304] 0 2024-09-04T16:30:29.274 INFO:tasks.workunit.client.0.smithi170.stdout:8/618: link d6/d28/d5f/d85/l90 d6/d26/ld2 0 2024-09-04T16:30:29.274 INFO:tasks.workunit.client.0.smithi170.stdout:8/619: readlink d6/d28/d20/d5e/l31 0 2024-09-04T16:30:29.275 INFO:tasks.workunit.client.0.smithi170.stdout:1/750: mkdir d9/d26/dfb 0 2024-09-04T16:30:29.276 INFO:tasks.workunit.client.0.smithi170.stdout:8/620: creat d6/d28/d1a/d38/fd3 x:0 0 0 2024-09-04T16:30:29.278 INFO:tasks.workunit.client.0.smithi170.stdout:8/621: symlink d6/d28/d1a/ld4 0 2024-09-04T16:30:29.282 INFO:tasks.workunit.client.0.smithi170.stdout:8/622: read d6/d28/d1a/d38/f9d [1155584,8448] 0 2024-09-04T16:30:29.296 INFO:tasks.workunit.client.0.smithi170.stdout:8/623: write d6/d28/d5f/d91/fa6 [1019622,746] 0 2024-09-04T16:30:29.298 INFO:tasks.workunit.client.0.smithi170.stdout:8/624: write d6/d28/d5f/d91/fbf [1387427,109811] 0 2024-09-04T16:30:29.299 INFO:tasks.workunit.client.0.smithi170.stdout:8/625: rename d6/d28/d16/d24 to d6/d28/d16/d24/d83/dd5 22 2024-09-04T16:30:29.300 INFO:tasks.workunit.client.0.smithi170.stdout:8/626: chown d6/d28/d16/d52/d73/c69 6 1 2024-09-04T16:30:29.301 INFO:tasks.workunit.client.0.smithi170.stdout:8/627: fdatasync d6/d28/d16/d77/d93/d95/db8/fbb 0 2024-09-04T16:30:29.303 INFO:tasks.workunit.client.0.smithi170.stdout:8/628: truncate d6/d28/d16/d52/d73/d5d/fad 884075 0 2024-09-04T16:30:29.306 INFO:tasks.workunit.client.0.smithi170.stdout:8/629: mkdir d6/d28/d16/d52/d73/d5d/dd6 0 2024-09-04T16:30:29.312 INFO:tasks.workunit.client.0.smithi170.stdout:8/630: dwrite d6/d28/d1a/d38/fd3 [0,4194304] 0 2024-09-04T16:30:29.317 INFO:tasks.workunit.client.0.smithi170.stdout:8/631: link d6/d28/d5f/d70/f7b d6/d28/d20/d5e/fd7 0 2024-09-04T16:30:29.319 INFO:tasks.workunit.client.0.smithi170.stdout:8/632: dread d6/d28/d5f/d70/f7d [0,4194304] 0 2024-09-04T16:30:29.369 INFO:tasks.workunit.client.0.smithi170.stdout:4/593: sync 2024-09-04T16:30:29.369 INFO:tasks.workunit.client.0.smithi170.stdout:6/542: sync 2024-09-04T16:30:29.371 INFO:tasks.workunit.client.0.smithi170.stdout:6/543: symlink d0/d17/d5b/laf 0 2024-09-04T16:30:29.376 INFO:tasks.workunit.client.0.smithi170.stdout:4/594: creat d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/dbf/fd1 x:0 0 0 2024-09-04T16:30:29.379 INFO:tasks.workunit.client.0.smithi170.stdout:6/544: getdents d0/d15/d56/d6d 0 2024-09-04T16:30:29.386 INFO:tasks.workunit.client.0.smithi170.stdout:6/545: creat d0/df/d1b/d3e/d47/d68/fb0 x:0 0 0 2024-09-04T16:30:29.391 INFO:tasks.workunit.client.0.smithi170.stdout:6/546: mknod d0/df/d1b/d3e/d47/d68/d2d/cb1 0 2024-09-04T16:30:29.399 INFO:tasks.workunit.client.0.smithi170.stdout:4/595: dwrite d1/d6/d8/d20/d95/d36/fbb [0,4194304] 0 2024-09-04T16:30:29.400 INFO:tasks.workunit.client.0.smithi170.stdout:4/596: readlink d1/d6/d8/d20/d35/d3e/d43/l5a 0 2024-09-04T16:30:29.416 INFO:tasks.workunit.client.0.smithi170.stdout:4/597: dread d1/d6/d2b/f99 [0,4194304] 0 2024-09-04T16:30:29.420 INFO:tasks.workunit.client.0.smithi170.stdout:4/598: dread d1/d6/d8/d20/d35/d3e/d4e/d51/f91 [0,4194304] 0 2024-09-04T16:30:29.424 INFO:tasks.workunit.client.0.smithi170.stdout:4/599: mkdir d1/d6/d8/d20/dc1/dd2 0 2024-09-04T16:30:29.427 INFO:tasks.workunit.client.0.smithi170.stdout:4/600: mknod d1/d6/d8/d20/d35/d3e/d60/cd3 0 2024-09-04T16:30:29.430 INFO:tasks.workunit.client.0.smithi170.stdout:4/601: mkdir d1/d6/d2b/db3/dd4 0 2024-09-04T16:30:29.430 INFO:tasks.workunit.client.0.smithi170.stdout:4/602: write d1/d6/d8/f9a [172129,51646] 0 2024-09-04T16:30:29.439 INFO:tasks.workunit.client.0.smithi170.stdout:4/603: write d1/d6/f34 [2423851,5143] 0 2024-09-04T16:30:29.439 INFO:tasks.workunit.client.0.smithi170.stdout:4/604: chown d1/d6/d8/d20/d35/d3e/d4e 0 1 2024-09-04T16:30:29.441 INFO:tasks.workunit.client.0.smithi170.stdout:4/605: rmdir d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/dbf 39 2024-09-04T16:30:29.450 INFO:tasks.workunit.client.0.smithi170.stdout:4/606: dwrite d1/d6/d8/d20/d95/f4d [0,4194304] 0 2024-09-04T16:30:29.451 INFO:tasks.workunit.client.0.smithi170.stdout:4/607: readlink d1/d6/d2b/d47/l9f 0 2024-09-04T16:30:29.454 INFO:tasks.workunit.client.0.smithi170.stdout:4/608: mkdir d1/d6/d8/d20/dae/dd5 0 2024-09-04T16:30:29.584 INFO:tasks.workunit.client.0.smithi170.stdout:3/579: sync 2024-09-04T16:30:29.588 INFO:tasks.workunit.client.0.smithi170.stdout:3/580: rename d13/d14/d1d/d2d/d6c to d13/d14/d21/d4d/d4e/d88/dbf 0 2024-09-04T16:30:29.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:29 smithi170 ceph-mon[29272]: Upgrade: Need to upgrade myself (mgr.smithi193.gvfizn) 2024-09-04T16:30:29.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:29 smithi170 ceph-mon[29272]: Upgrade: Need to upgrade myself (mgr.smithi193.gvfizn) 2024-09-04T16:30:29.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:29 smithi170 ceph-mon[29272]: pgmap v34: 65 pgs: 65 active+clean; 3.3 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 121 MiB/s rd, 290 MiB/s wr, 623 op/s 2024-09-04T16:30:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:29 smithi193 ceph-mon[36288]: Upgrade: Need to upgrade myself (mgr.smithi193.gvfizn) 2024-09-04T16:30:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:29 smithi193 ceph-mon[36288]: Upgrade: Need to upgrade myself (mgr.smithi193.gvfizn) 2024-09-04T16:30:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:29 smithi193 ceph-mon[36288]: pgmap v34: 65 pgs: 65 active+clean; 3.3 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 121 MiB/s rd, 290 MiB/s wr, 623 op/s 2024-09-04T16:30:29.746 INFO:tasks.workunit.client.0.smithi170.stdout:3/581: dwrite d13/d14/d21/d4d/d4e/d88/dbf/f70 [0,4194304] 0 2024-09-04T16:30:29.754 INFO:tasks.workunit.client.0.smithi170.stdout:3/582: dwrite d13/d14/d21/d4d/f6f [0,4194304] 0 2024-09-04T16:30:29.757 INFO:tasks.workunit.client.0.smithi170.stdout:3/583: creat d13/d14/d21/d4d/d4e/fc0 x:0 0 0 2024-09-04T16:30:29.763 INFO:tasks.workunit.client.0.smithi170.stdout:2/662: sync 2024-09-04T16:30:29.766 INFO:tasks.workunit.client.0.smithi170.stdout:3/584: dwrite d13/d14/f75 [0,4194304] 0 2024-09-04T16:30:29.769 INFO:tasks.workunit.client.0.smithi170.stdout:2/663: creat d3/db/d1c/d47/d83/d9f/fdc x:0 0 0 2024-09-04T16:30:29.779 INFO:tasks.workunit.client.0.smithi170.stdout:2/664: truncate d3/db/d1c/f42 2256489 0 2024-09-04T16:30:29.782 INFO:tasks.workunit.client.0.smithi170.stdout:2/665: symlink d3/d4/ldd 0 2024-09-04T16:30:29.875 INFO:tasks.workunit.client.0.smithi170.stdout:2/666: creat d3/db/d1c/db8/dd0/fde x:0 0 0 2024-09-04T16:30:29.880 INFO:tasks.workunit.client.0.smithi170.stdout:3/585: dread d13/d14/d1d/d2d/f34 [0,4194304] 0 2024-09-04T16:30:29.880 INFO:tasks.workunit.client.0.smithi170.stdout:2/667: dwrite d3/d3c/d40/d48/f8e [0,4194304] 0 2024-09-04T16:30:29.881 INFO:tasks.workunit.client.0.smithi170.stdout:3/586: readlink d13/d14/d1f/l35 0 2024-09-04T16:30:29.882 INFO:tasks.workunit.client.0.smithi170.stdout:3/587: read - d13/d14/d1d/d71/db3/db6/faa zero size 2024-09-04T16:30:29.891 INFO:tasks.workunit.client.0.smithi170.stdout:2/668: link d3/d4/d86/dc9/c57 d3/cdf 0 2024-09-04T16:30:29.892 INFO:tasks.workunit.client.0.smithi170.stdout:2/669: fdatasync d3/d4/f20 0 2024-09-04T16:30:29.894 INFO:tasks.workunit.client.0.smithi170.stdout:3/588: dread d13/d14/d1d/da4/fac [0,4194304] 0 2024-09-04T16:30:30.028 INFO:tasks.workunit.client.0.smithi170.stdout:7/823: sync 2024-09-04T16:30:30.031 INFO:tasks.workunit.client.0.smithi170.stdout:7/824: mknod d12/d15/d71/d42/d79/d9d/dc9/c11b 0 2024-09-04T16:30:30.031 INFO:tasks.workunit.client.0.smithi170.stdout:7/825: fsync d12/d16/d1d/df5/f112 0 2024-09-04T16:30:30.034 INFO:tasks.workunit.client.0.smithi170.stdout:7/826: truncate d12/f88 3251747 0 2024-09-04T16:30:30.039 INFO:tasks.workunit.client.0.smithi170.stdout:7/827: getdents d12/d16/db7/deb 0 2024-09-04T16:30:30.039 INFO:tasks.workunit.client.0.smithi170.stdout:7/828: readlink l11 0 2024-09-04T16:30:30.104 INFO:tasks.workunit.client.0.smithi170.stdout:5/568: sync 2024-09-04T16:30:30.104 INFO:tasks.workunit.client.0.smithi170.stdout:0/747: sync 2024-09-04T16:30:30.138 INFO:tasks.workunit.client.0.smithi170.stdout:5/569: readlink d4/d8/d1c/d29/l50 0 2024-09-04T16:30:30.138 INFO:tasks.workunit.client.0.smithi170.stdout:0/748: mknod d11/d13/d35/c11f 0 2024-09-04T16:30:30.141 INFO:tasks.workunit.client.0.smithi170.stdout:7/829: dwrite d12/d15/d71/d42/d79/d9d/fa6 [4194304,4194304] 0 2024-09-04T16:30:30.142 INFO:tasks.workunit.client.0.smithi170.stdout:0/749: creat d11/d13/d4a/dc5/df0/f120 x:0 0 0 2024-09-04T16:30:30.144 INFO:tasks.workunit.client.0.smithi170.stdout:7/830: readlink d12/d16/lc3 0 2024-09-04T16:30:30.146 INFO:tasks.workunit.client.0.smithi170.stdout:5/570: dwrite d4/d8/d1c/d26/d27/d48/f52 [0,4194304] 0 2024-09-04T16:30:30.146 INFO:tasks.workunit.client.0.smithi170.stdout:7/831: chown d12/d15/d71/d42/d79/d9d/dc9/df6 0 1 2024-09-04T16:30:30.150 INFO:tasks.workunit.client.0.smithi170.stdout:5/571: truncate d4/d8/d1c/f6d 4572831 0 2024-09-04T16:30:30.156 INFO:tasks.workunit.client.0.smithi170.stdout:7/832: creat d12/d16/d1d/f11c x:0 0 0 2024-09-04T16:30:30.158 INFO:tasks.workunit.client.0.smithi170.stdout:5/572: readlink d4/d8/l2e 0 2024-09-04T16:30:30.163 INFO:tasks.workunit.client.0.smithi170.stdout:5/573: symlink d4/d8/d1c/d26/d27/d43/lb6 0 2024-09-04T16:30:30.167 INFO:tasks.workunit.client.0.smithi170.stdout:7/833: link d12/d15/d71/d42/d79/c8a d12/d16/d8d/c11d 0 2024-09-04T16:30:30.170 INFO:tasks.workunit.client.0.smithi170.stdout:7/834: symlink d12/d16/d1d/df5/l11e 0 2024-09-04T16:30:30.170 INFO:tasks.workunit.client.0.smithi170.stdout:5/574: link d4/d3a/d74/f89 d4/d3a/d74/d8b/fb7 0 2024-09-04T16:30:30.174 INFO:tasks.workunit.client.0.smithi170.stdout:5/575: symlink d4/d8/d1c/d23/d3e/lb8 0 2024-09-04T16:30:30.175 INFO:tasks.workunit.client.0.smithi170.stdout:5/576: write d4/d8/d1c/d26/d27/d43/f86 [511346,40799] 0 2024-09-04T16:30:30.181 INFO:tasks.workunit.client.0.smithi170.stdout:5/577: dread d4/d8/d1c/d26/d27/f38 [0,4194304] 0 2024-09-04T16:30:30.188 INFO:tasks.workunit.client.0.smithi170.stdout:5/578: creat d4/fb9 x:0 0 0 2024-09-04T16:30:30.196 INFO:tasks.workunit.client.0.smithi170.stdout:7/835: dwrite d12/d15/d71/f36 [0,4194304] 0 2024-09-04T16:30:30.267 INFO:tasks.workunit.client.0.smithi170.stdout:5/579: dwrite d4/d8/d1c/d23/d39/f40 [0,4194304] 0 2024-09-04T16:30:30.270 INFO:tasks.workunit.client.0.smithi170.stdout:7/836: rename lb to d12/l11f 0 2024-09-04T16:30:30.279 INFO:tasks.workunit.client.0.smithi170.stdout:7/837: creat d12/d16/d1d/d65/d82/dcb/df8/f120 x:0 0 0 2024-09-04T16:30:30.284 INFO:tasks.workunit.client.0.smithi170.stdout:7/838: truncate d12/d15/d71/d42/d79/d9d/d51/f8b 386592 0 2024-09-04T16:30:30.292 INFO:tasks.workunit.client.0.smithi170.stdout:7/839: dwrite d12/f14 [4194304,4194304] 0 2024-09-04T16:30:30.297 INFO:tasks.workunit.client.0.smithi170.stdout:7/840: symlink d12/d16/l121 0 2024-09-04T16:30:30.299 INFO:tasks.workunit.client.0.smithi170.stdout:7/841: write d12/d15/d71/d42/d79/f105 [658169,73321] 0 2024-09-04T16:30:30.304 INFO:tasks.workunit.client.0.smithi170.stdout:7/842: mkdir d12/d15/d68/d122 0 2024-09-04T16:30:30.304 INFO:tasks.workunit.client.0.smithi170.stdout:8/633: sync 2024-09-04T16:30:30.305 INFO:tasks.workunit.client.0.smithi170.stdout:8/634: chown d6/d28/d5f/d70/d97 122 1 2024-09-04T16:30:30.324 INFO:tasks.workunit.client.0.smithi170.stdout:8/635: dread d6/d28/d1a/f36 [0,4194304] 0 2024-09-04T16:30:30.353 INFO:tasks.workunit.client.0.smithi170.stdout:5/580: truncate d4/d8/d1c/d29/f2a 2749260 0 2024-09-04T16:30:30.360 INFO:tasks.workunit.client.0.smithi170.stdout:5/581: dwrite d4/db/d37/fab [0,4194304] 0 2024-09-04T16:30:30.369 INFO:tasks.workunit.client.0.smithi170.stdout:5/582: link d4/d8/d1c/d41/faa d4/d8/d1c/d26/d27/d88/da4/fba 0 2024-09-04T16:30:30.370 INFO:tasks.workunit.client.0.smithi170.stdout:5/583: fsync d4/d8/d1c/d26/d27/d43/f86 0 2024-09-04T16:30:30.372 INFO:tasks.workunit.client.0.smithi170.stdout:5/584: read d4/d8/d1c/d26/d27/d43/f87 [3904968,84218] 0 2024-09-04T16:30:30.376 INFO:tasks.workunit.client.0.smithi170.stdout:5/585: rename d4/d8/d1c/d23/l35 to d4/d8/d1c/d29/lbb 0 2024-09-04T16:30:30.381 INFO:tasks.workunit.client.0.smithi170.stdout:5/586: rename d4/d8/d1c/d41/f46 to d4/d8/d1c/d26/d27/d43/d5b/fbc 0 2024-09-04T16:30:30.382 INFO:tasks.workunit.client.0.smithi170.stdout:5/587: stat d4/d8/d1c/d26/d27 0 2024-09-04T16:30:30.405 INFO:tasks.workunit.client.0.smithi170.stdout:5/588: truncate d4/f2b 2235714 0 2024-09-04T16:30:30.407 INFO:tasks.workunit.client.0.smithi170.stdout:5/589: write d4/d8/d1c/d26/d27/d43/d5b/f9c [508203,111818] 0 2024-09-04T16:30:30.417 INFO:tasks.workunit.client.0.smithi170.stdout:5/590: rmdir d4/d8/d1c/d26/d27/d43/d8e 0 2024-09-04T16:30:30.423 INFO:tasks.workunit.client.0.smithi170.stdout:5/591: dwrite d4/d8/d1c/d26/d27/d43/f86 [0,4194304] 0 2024-09-04T16:30:30.424 INFO:tasks.workunit.client.0.smithi170.stdout:5/592: chown d4/db/d51/d5e/d71/l82 1 1 2024-09-04T16:30:30.428 INFO:tasks.workunit.client.0.smithi170.stdout:5/593: symlink d4/d8/d1c/d29/lbd 0 2024-09-04T16:30:30.430 INFO:tasks.workunit.client.0.smithi170.stdout:5/594: fsync d4/d8/d1c/d26/d27/f38 0 2024-09-04T16:30:30.432 INFO:tasks.workunit.client.0.smithi170.stdout:5/595: fsync d4/d8/d1c/d26/d27/f70 0 2024-09-04T16:30:30.433 INFO:tasks.workunit.client.0.smithi170.stdout:5/596: chown d4/d3a/d74/d8b/l98 1458 1 2024-09-04T16:30:30.435 INFO:tasks.workunit.client.0.smithi170.stdout:5/597: mkdir d4/d8/d1c/d41/dbe 0 2024-09-04T16:30:30.440 INFO:tasks.workunit.client.0.smithi170.stdout:5/598: link d4/d8/d1c/d26/d27/d48/f52 d4/db/fbf 0 2024-09-04T16:30:30.454 INFO:tasks.workunit.client.0.smithi170.stdout:5/599: dwrite d4/d3a/d74/f89 [0,4194304] 0 2024-09-04T16:30:30.461 INFO:tasks.workunit.client.0.smithi170.stdout:5/600: mkdir d4/d8/d1c/d26/d27/d88/da4/dc0 0 2024-09-04T16:30:30.464 INFO:tasks.workunit.client.0.smithi170.stdout:5/601: symlink d4/d62/lc1 0 2024-09-04T16:30:30.467 INFO:tasks.workunit.client.0.smithi170.stdout:5/602: creat d4/d8/d1c/d26/fc2 x:0 0 0 2024-09-04T16:30:30.471 INFO:tasks.workunit.client.0.smithi170.stdout:5/603: getdents d4/d8/d1c/d26/d27/d88/da4 0 2024-09-04T16:30:30.473 INFO:tasks.workunit.client.0.smithi170.stdout:5/604: creat d4/d8/d1c/d23/d3e/fc3 x:0 0 0 2024-09-04T16:30:30.474 INFO:tasks.workunit.client.0.smithi170.stdout:5/605: write d4/d3a/d74/f89 [1633241,62266] 0 2024-09-04T16:30:30.481 INFO:tasks.workunit.client.0.smithi170.stdout:5/606: dread d4/d8/d1c/d23/f5d [0,4194304] 0 2024-09-04T16:30:30.484 INFO:tasks.workunit.client.0.smithi170.stdout:5/607: rename d4/db/d51/d5e/d71/fa6 to d4/fc4 0 2024-09-04T16:30:30.485 INFO:tasks.workunit.client.0.smithi170.stdout:5/608: write d4/db/d51/d5e/d71/d84/fb0 [716703,79754] 0 2024-09-04T16:30:30.487 INFO:tasks.workunit.client.0.smithi170.stdout:5/609: fdatasync d4/d8/d1c/d41/faa 0 2024-09-04T16:30:30.488 INFO:tasks.workunit.client.0.smithi170.stdout:3/589: sync 2024-09-04T16:30:30.488 INFO:tasks.workunit.client.0.smithi170.stdout:2/670: sync 2024-09-04T16:30:30.488 INFO:tasks.workunit.client.0.smithi170.stdout:9/667: sync 2024-09-04T16:30:30.489 INFO:tasks.workunit.client.0.smithi170.stdout:0/750: sync 2024-09-04T16:30:30.489 INFO:tasks.workunit.client.0.smithi170.stdout:4/609: sync 2024-09-04T16:30:30.489 INFO:tasks.workunit.client.0.smithi170.stdout:6/547: sync 2024-09-04T16:30:30.489 INFO:tasks.workunit.client.0.smithi170.stdout:1/751: sync 2024-09-04T16:30:30.490 INFO:tasks.workunit.client.0.smithi170.stdout:1/752: chown d9/d11/d2e/d9e/le0 12181 1 2024-09-04T16:30:30.498 INFO:tasks.workunit.client.0.smithi170.stdout:2/671: chown d3/db/df/f39 461617872 1 2024-09-04T16:30:30.500 INFO:tasks.workunit.client.0.smithi170.stdout:5/610: dread d4/d8/d1c/d29/f2a [0,4194304] 0 2024-09-04T16:30:30.502 INFO:tasks.workunit.client.0.smithi170.stdout:3/590: write d13/d14/d1d/f28 [676987,90047] 0 2024-09-04T16:30:30.504 INFO:tasks.workunit.client.0.smithi170.stdout:5/611: read d4/d8/d1c/d26/d27/d43/d5b/f9c [573772,79521] 0 2024-09-04T16:30:30.506 INFO:tasks.workunit.client.0.smithi170.stdout:2/672: mkdir d3/d3c/de0 0 2024-09-04T16:30:30.508 INFO:tasks.workunit.client.0.smithi170.stdout:9/668: creat d2/d32/fc8 x:0 0 0 2024-09-04T16:30:30.510 INFO:tasks.workunit.client.0.smithi170.stdout:3/591: write d13/d14/d17/fbb [1140765,127498] 0 2024-09-04T16:30:30.513 INFO:tasks.workunit.client.0.smithi170.stdout:0/751: dwrite d11/d13/d4a/d66/d8c/da8/f110 [0,4194304] 0 2024-09-04T16:30:30.517 INFO:tasks.workunit.client.0.smithi170.stdout:6/548: link d0/c22 d0/df/d1f/d9c/cb2 0 2024-09-04T16:30:30.518 INFO:tasks.workunit.client.0.smithi170.stdout:3/592: chown d13/d14/d1d/da4/fac 20 1 2024-09-04T16:30:30.518 INFO:tasks.workunit.client.0.smithi170.stdout:4/610: dwrite d1/d6/d8/d20/d35/d3e/d43/fb8 [0,4194304] 0 2024-09-04T16:30:30.523 INFO:tasks.workunit.client.0.smithi170.stdout:1/753: dwrite d9/d26/d77/fb4 [0,4194304] 0 2024-09-04T16:30:30.524 INFO:tasks.workunit.client.0.smithi170.stdout:5/612: rename d4/d8/c12 to d4/d8/d1c/d26/d27/d43/d5b/cc5 0 2024-09-04T16:30:30.531 INFO:tasks.workunit.client.0.smithi170.stdout:3/593: creat d13/d14/d1d/da4/da8/fc1 x:0 0 0 2024-09-04T16:30:30.533 INFO:tasks.workunit.client.0.smithi170.stdout:4/611: dwrite d1/d6/d8/f8a [0,4194304] 0 2024-09-04T16:30:30.535 INFO:tasks.workunit.client.0.smithi170.stdout:0/752: truncate d11/d13/d4a/d66/d6d/d105/f98 963374 0 2024-09-04T16:30:30.539 INFO:tasks.workunit.client.0.smithi170.stdout:5/613: symlink d4/d3a/d74/d8b/lc6 0 2024-09-04T16:30:30.542 INFO:tasks.workunit.client.0.smithi170.stdout:2/673: link d3/db/df/f39 d3/db/d1c/d47/d83/d9f/dae/d97/fe1 0 2024-09-04T16:30:30.543 INFO:tasks.workunit.client.0.smithi170.stdout:9/669: rmdir d2/d3d/d27/d65/dc2 0 2024-09-04T16:30:30.545 INFO:tasks.workunit.client.0.smithi170.stdout:6/549: creat d0/df/d1f/d9c/fb3 x:0 0 0 2024-09-04T16:30:30.545 INFO:tasks.workunit.client.0.smithi170.stdout:3/594: unlink cc 0 2024-09-04T16:30:30.546 INFO:tasks.workunit.client.0.smithi170.stdout:3/595: fdatasync fb 0 2024-09-04T16:30:30.546 INFO:tasks.workunit.client.0.smithi170.stdout:4/612: fsync d1/d6/d2b/d47/d78/f8f 0 2024-09-04T16:30:30.547 INFO:tasks.workunit.client.0.smithi170.stdout:3/596: fdatasync d13/f51 0 2024-09-04T16:30:30.551 INFO:tasks.workunit.client.0.smithi170.stdout:0/753: mknod d11/d13/d2f/c121 0 2024-09-04T16:30:30.553 INFO:tasks.workunit.client.0.smithi170.stdout:2/674: symlink d3/d4/d14/dcf/dba/dd5/le2 0 2024-09-04T16:30:30.555 INFO:tasks.workunit.client.0.smithi170.stdout:5/614: rename d4/d8/d1c/d26/d27/d43/d5b/cc5 to d4/d8/cc7 0 2024-09-04T16:30:30.556 INFO:tasks.workunit.client.0.smithi170.stdout:3/597: dwrite d13/d14/d1f/f73 [0,4194304] 0 2024-09-04T16:30:30.560 INFO:tasks.workunit.client.0.smithi170.stdout:5/615: truncate d4/d8/d1c/d26/fc2 597378 0 2024-09-04T16:30:30.561 INFO:tasks.workunit.client.0.smithi170.stdout:0/754: dread d11/d13/d4a/d66/d8c/dae/dfc/fe8 [0,4194304] 0 2024-09-04T16:30:30.562 INFO:tasks.workunit.client.0.smithi170.stdout:1/754: dread d9/d11/d2f/f5c [0,4194304] 0 2024-09-04T16:30:30.567 INFO:tasks.workunit.client.0.smithi170.stdout:2/675: dread d3/db/d62/d6f/fb3 [0,4194304] 0 2024-09-04T16:30:30.568 INFO:tasks.workunit.client.0.smithi170.stdout:9/670: symlink d2/d3d/d6d/d79/db0/lc9 0 2024-09-04T16:30:30.569 INFO:tasks.workunit.client.0.smithi170.stdout:9/671: stat d2/d3d/d27 0 2024-09-04T16:30:30.569 INFO:tasks.workunit.client.0.smithi170.stdout:6/550: creat d0/d17/fb4 x:0 0 0 2024-09-04T16:30:30.573 INFO:tasks.workunit.client.0.smithi170.stdout:5/616: creat d4/db/d51/d5e/d71/d84/d93/fc8 x:0 0 0 2024-09-04T16:30:30.574 INFO:tasks.workunit.client.0.smithi170.stdout:6/551: dwrite d0/df/f10 [4194304,4194304] 0 2024-09-04T16:30:30.577 INFO:tasks.workunit.client.0.smithi170.stdout:4/613: mkdir d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/dbf/dd6 0 2024-09-04T16:30:30.580 INFO:tasks.workunit.client.0.smithi170.stdout:5/617: dwrite d4/f6 [4194304,4194304] 0 2024-09-04T16:30:30.582 INFO:tasks.workunit.client.0.smithi170.stdout:5/618: fsync d4/db/d37/f36 0 2024-09-04T16:30:30.582 INFO:tasks.workunit.client.0.smithi170.stdout:4/614: read d1/d6/d8/d20/d95/fac [3137443,60818] 0 2024-09-04T16:30:30.582 INFO:tasks.workunit.client.0.smithi170.stdout:4/615: stat d1/f1e 0 2024-09-04T16:30:30.588 INFO:tasks.workunit.client.0.smithi170.stdout:0/755: unlink d11/d13/d71/d43/l73 0 2024-09-04T16:30:30.589 INFO:tasks.workunit.client.0.smithi170.stdout:0/756: dread - d11/d75/dce/f103 zero size 2024-09-04T16:30:30.592 INFO:tasks.workunit.client.0.smithi170.stdout:4/616: rmdir d1/d6/d8/d20/d35/d54 39 2024-09-04T16:30:30.603 INFO:tasks.workunit.client.0.smithi170.stdout:5/619: symlink d4/d3a/d74/d8b/db5/lc9 0 2024-09-04T16:30:30.603 INFO:tasks.workunit.client.0.smithi170.stdout:0/757: dread d11/d13/d2f/d3f/f65 [0,4194304] 0 2024-09-04T16:30:30.604 INFO:tasks.workunit.client.0.smithi170.stdout:5/620: chown d4/d8/d1c/d26/d27/d43/d5b/f9c 7211 1 2024-09-04T16:30:30.605 INFO:tasks.workunit.client.0.smithi170.stdout:3/598: truncate d13/d14/d1d/d2d/d58/f47 1839746 0 2024-09-04T16:30:30.606 INFO:tasks.workunit.client.0.smithi170.stdout:1/755: getdents d9/d11/d2e/db0 0 2024-09-04T16:30:30.608 INFO:tasks.workunit.client.0.smithi170.stdout:2/676: link d3/db/d1c/d47/d83/f91 d3/fe3 0 2024-09-04T16:30:30.609 INFO:tasks.workunit.client.0.smithi170.stdout:6/552: truncate d0/d15/f26 1047381 0 2024-09-04T16:30:30.611 INFO:tasks.workunit.client.0.smithi170.stdout:9/672: getdents d2/d11/d8f 0 2024-09-04T16:30:30.616 INFO:tasks.workunit.client.0.smithi170.stdout:1/756: creat d9/d26/d77/ffc x:0 0 0 2024-09-04T16:30:30.617 INFO:tasks.workunit.client.0.smithi170.stdout:1/757: stat d9/d34/d5f/fc7 0 2024-09-04T16:30:30.619 INFO:tasks.workunit.client.0.smithi170.stdout:9/673: dwrite d2/d3d/d27/d65/d56/d7a/da5/fb8 [0,4194304] 0 2024-09-04T16:30:30.621 INFO:tasks.workunit.client.0.smithi170.stdout:5/621: mkdir d4/d8/d1c/d26/d27/d88/da4/dc0/dca 0 2024-09-04T16:30:30.629 INFO:tasks.workunit.client.0.smithi170.stdout:4/617: truncate d1/d6/d8/f9a 1451460 0 2024-09-04T16:30:30.633 INFO:tasks.workunit.client.0.smithi170.stdout:1/758: unlink d9/d26/d77/d83/fe5 0 2024-09-04T16:30:30.633 INFO:tasks.workunit.client.0.smithi170.stdout:3/599: write d13/d14/d21/f2e [1628751,49252] 0 2024-09-04T16:30:30.633 INFO:tasks.workunit.client.0.smithi170.stdout:9/674: chown d2/d3d/d35 31261 1 2024-09-04T16:30:30.634 INFO:tasks.workunit.client.0.smithi170.stdout:3/600: chown d13/d14/d1f/l35 241773 1 2024-09-04T16:30:30.639 INFO:tasks.workunit.client.0.smithi170.stdout:0/758: getdents d11/d75 0 2024-09-04T16:30:30.644 INFO:tasks.workunit.client.0.smithi170.stdout:0/759: dread d11/d13/d35/fc2 [0,4194304] 0 2024-09-04T16:30:30.649 INFO:tasks.workunit.client.0.smithi170.stdout:4/618: write d1/d6/d8/d20/d95/d36/f28 [310605,12469] 0 2024-09-04T16:30:30.651 INFO:tasks.workunit.client.0.smithi170.stdout:1/759: write d9/d26/d77/d83/f90 [667234,59503] 0 2024-09-04T16:30:30.652 INFO:tasks.workunit.client.0.smithi170.stdout:2/677: getdents d3/db/df 0 2024-09-04T16:30:30.654 INFO:tasks.workunit.client.0.smithi170.stdout:5/622: truncate d4/db/d37/fab 286734 0 2024-09-04T16:30:30.655 INFO:tasks.workunit.client.0.smithi170.stdout:5/623: chown d4/d8/d1c/d26/d27/d43/d5b/lb1 1929 1 2024-09-04T16:30:30.655 INFO:tasks.workunit.client.0.smithi170.stdout:9/675: symlink d2/d3d/d27/d2b/lca 0 2024-09-04T16:30:30.657 INFO:tasks.workunit.client.0.smithi170.stdout:3/601: dwrite d13/f25 [0,4194304] 0 2024-09-04T16:30:30.658 INFO:tasks.workunit.client.0.smithi170.stdout:4/619: creat d1/d6/d8/d20/d35/d3e/d4e/d51/fd7 x:0 0 0 2024-09-04T16:30:30.661 INFO:tasks.workunit.client.0.smithi170.stdout:1/760: symlink d9/d11/d85/dd8/dee/lfd 0 2024-09-04T16:30:30.668 INFO:tasks.workunit.client.0.smithi170.stdout:3/602: read d13/d14/d21/d4d/f6f [5087359,121690] 0 2024-09-04T16:30:30.670 INFO:tasks.workunit.client.0.smithi170.stdout:3/603: stat d13/d14/d1d/d71/db3/db6/l56 0 2024-09-04T16:30:30.671 INFO:tasks.workunit.client.0.smithi170.stdout:5/624: dread d4/d8/d1c/d23/f2f [0,4194304] 0 2024-09-04T16:30:30.672 INFO:tasks.workunit.client.0.smithi170.stdout:5/625: fsync d4/d8/d1c/d23/d39/f81 0 2024-09-04T16:30:30.673 INFO:tasks.workunit.client.0.smithi170.stdout:1/761: fdatasync d9/d34/d5f/fc7 0 2024-09-04T16:30:30.676 INFO:tasks.workunit.client.0.smithi170.stdout:9/676: mkdir d2/d3d/d27/d65/dcb 0 2024-09-04T16:30:30.677 INFO:tasks.workunit.client.0.smithi170.stdout:9/677: truncate d2/d3d/d6d/d79/f96 262304 0 2024-09-04T16:30:30.681 INFO:tasks.workunit.client.0.smithi170.stdout:6/553: dread d0/d15/f26 [0,4194304] 0 2024-09-04T16:30:30.682 INFO:tasks.workunit.client.0.smithi170.stdout:3/604: rmdir d13/d14/d1d/d71/db3/db6 39 2024-09-04T16:30:30.683 INFO:tasks.workunit.client.0.smithi170.stdout:6/554: readlink d0/d15/d56/d6d/l75 0 2024-09-04T16:30:30.683 INFO:tasks.workunit.client.0.smithi170.stdout:0/760: dwrite d11/d13/d2f/d3f/f63 [0,4194304] 0 2024-09-04T16:30:30.685 INFO:tasks.workunit.client.0.smithi170.stdout:5/626: mkdir d4/d8/d1c/d23/d94/dcb 0 2024-09-04T16:30:30.685 INFO:tasks.workunit.client.0.smithi170.stdout:1/762: rename d9/d11/d85/dd8/dee/lfd to d9/d11/d85/dc5/lfe 0 2024-09-04T16:30:30.686 INFO:tasks.workunit.client.0.smithi170.stdout:2/678: getdents d3/d3c/dc1 0 2024-09-04T16:30:30.688 INFO:tasks.workunit.client.0.smithi170.stdout:4/620: rmdir d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/da5 0 2024-09-04T16:30:30.689 INFO:tasks.workunit.client.0.smithi170.stdout:4/621: write d1/d6/d8/d20/d95/d36/f3c [3940955,84571] 0 2024-09-04T16:30:30.693 INFO:tasks.workunit.client.0.smithi170.stdout:0/761: fsync d11/d75/d77/f87 0 2024-09-04T16:30:30.694 INFO:tasks.workunit.client.0.smithi170.stdout:5/627: readlink d4/d8/la2 0 2024-09-04T16:30:30.695 INFO:tasks.workunit.client.0.smithi170.stdout:1/763: chown d9/d11/dae/d6a/d79/f95 34 1 2024-09-04T16:30:30.696 INFO:tasks.workunit.client.0.smithi170.stdout:5/628: write d4/f3c [4677264,114304] 0 2024-09-04T16:30:30.698 INFO:tasks.workunit.client.0.smithi170.stdout:4/622: mknod d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/dbf/cd8 0 2024-09-04T16:30:30.701 INFO:tasks.workunit.client.0.smithi170.stdout:3/605: symlink d13/d14/d1d/d71/db3/db6/d6e/lc2 0 2024-09-04T16:30:30.701 INFO:tasks.workunit.client.0.smithi170.stdout:6/555: dwrite d0/d17/d39/f72 [0,4194304] 0 2024-09-04T16:30:30.705 INFO:tasks.workunit.client.0.smithi170.stdout:2/679: truncate d3/db/d1c/f42 2263227 0 2024-09-04T16:30:30.705 INFO:tasks.workunit.client.0.smithi170.stdout:1/764: fdatasync d9/d11/dae/d6a/f81 0 2024-09-04T16:30:30.707 INFO:tasks.workunit.client.0.smithi170.stdout:0/762: creat d11/d13/d4a/dbc/f122 x:0 0 0 2024-09-04T16:30:30.707 INFO:tasks.workunit.client.0.smithi170.stdout:2/680: write d3/db/fbd [547060,29083] 0 2024-09-04T16:30:30.709 INFO:tasks.workunit.client.0.smithi170.stdout:0/763: dread - d11/d13/d4a/dc5/df0/f120 zero size 2024-09-04T16:30:30.711 INFO:tasks.workunit.client.0.smithi170.stdout:5/629: creat d4/d8/d1c/d26/d27/d48/d7c/fcc x:0 0 0 2024-09-04T16:30:30.715 INFO:tasks.workunit.client.0.smithi170.stdout:1/765: dwrite d9/d11/d2f/d6b/d61/f6f [0,4194304] 0 2024-09-04T16:30:30.715 INFO:tasks.workunit.client.0.smithi170.stdout:3/606: mknod d13/d14/d21/d4d/d4e/d50/cc3 0 2024-09-04T16:30:30.717 INFO:tasks.workunit.client.0.smithi170.stdout:3/607: truncate d13/d14/d21/d4d/d4e/fb9 163038 0 2024-09-04T16:30:30.719 INFO:tasks.workunit.client.0.smithi170.stdout:0/764: unlink d11/cd5 0 2024-09-04T16:30:30.721 INFO:tasks.workunit.client.0.smithi170.stdout:2/681: rename d3/f8d to d3/d4/d86/dc9/dd9/fe4 0 2024-09-04T16:30:30.722 INFO:tasks.workunit.client.0.smithi170.stdout:3/608: dread d13/d14/d1f/f73 [0,4194304] 0 2024-09-04T16:30:30.723 INFO:tasks.workunit.client.0.smithi170.stdout:2/682: read - d3/db/d1c/d47/d83/d9f/dae/fc8 zero size 2024-09-04T16:30:30.724 INFO:tasks.workunit.client.0.smithi170.stdout:2/683: stat d3/d7/c13 0 2024-09-04T16:30:30.732 INFO:tasks.workunit.client.0.smithi170.stdout:3/609: dwrite d13/d14/d1d/da4/da8/fc1 [0,4194304] 0 2024-09-04T16:30:30.733 INFO:tasks.workunit.client.0.smithi170.stdout:4/623: link d1/d6/d8/d20/l5b d1/d6/d8/d20/d35/dcc/ld9 0 2024-09-04T16:30:30.734 INFO:tasks.workunit.client.0.smithi170.stdout:3/610: chown d13/d14/d17/f64 4156609 1 2024-09-04T16:30:30.735 INFO:tasks.workunit.client.0.smithi170.stdout:2/684: dwrite d3/db/d1c/d47/d83/d9f/fb5 [0,4194304] 0 2024-09-04T16:30:30.738 INFO:tasks.workunit.client.0.smithi170.stdout:6/556: creat d0/df/d1b/d3e/fb5 x:0 0 0 2024-09-04T16:30:30.739 INFO:tasks.workunit.client.0.smithi170.stdout:1/766: symlink d9/lff 0 2024-09-04T16:30:30.747 INFO:tasks.workunit.client.0.smithi170.stdout:5/630: rename d4/f2b to d4/d8/d1c/d23/d94/dcb/fcd 0 2024-09-04T16:30:30.750 INFO:tasks.workunit.client.0.smithi170.stdout:4/624: read d1/d6/d8/d20/d35/d3e/f46 [4140327,26770] 0 2024-09-04T16:30:30.750 INFO:tasks.workunit.client.0.smithi170.stdout:0/765: dwrite d11/d13/d71/d43/f2e [0,4194304] 0 2024-09-04T16:30:30.752 INFO:tasks.workunit.client.0.smithi170.stdout:6/557: unlink d0/fd 0 2024-09-04T16:30:30.753 INFO:tasks.workunit.client.0.smithi170.stdout:1/767: dread - d9/d11/d2e/f5d zero size 2024-09-04T16:30:30.753 INFO:tasks.workunit.client.0.smithi170.stdout:0/766: fsync d11/d13/d4a/d66/d8c/fc6 0 2024-09-04T16:30:30.754 INFO:tasks.workunit.client.0.smithi170.stdout:5/631: creat d4/d3a/d74/fce x:0 0 0 2024-09-04T16:30:30.757 INFO:tasks.workunit.client.0.smithi170.stdout:3/611: creat d13/d14/d1d/d71/db3/dbd/fc4 x:0 0 0 2024-09-04T16:30:30.759 INFO:tasks.workunit.client.0.smithi170.stdout:3/612: fdatasync d13/d14/d1f/d7a/f9a 0 2024-09-04T16:30:30.760 INFO:tasks.workunit.client.0.smithi170.stdout:4/625: dread d1/d6/d8/d20/d95/f4d [0,4194304] 0 2024-09-04T16:30:30.762 INFO:tasks.workunit.client.0.smithi170.stdout:1/768: rename d9/d26/f46 to d9/d11/dae/df5/f100 0 2024-09-04T16:30:30.762 INFO:tasks.workunit.client.0.smithi170.stdout:5/632: dread d4/d3a/f9e [0,4194304] 0 2024-09-04T16:30:30.766 INFO:tasks.workunit.client.0.smithi170.stdout:5/633: truncate d4/db/d51/d5e/d71/d84/d93/fc8 793826 0 2024-09-04T16:30:30.769 INFO:tasks.workunit.client.0.smithi170.stdout:1/769: dwrite d9/d34/d5f/fd6 [0,4194304] 0 2024-09-04T16:30:30.771 INFO:tasks.workunit.client.0.smithi170.stdout:3/613: dread d13/d14/d21/d4c/f77 [0,4194304] 0 2024-09-04T16:30:30.773 INFO:tasks.workunit.client.0.smithi170.stdout:4/626: creat d1/d6/d8/d20/d95/d36/d9c/fda x:0 0 0 2024-09-04T16:30:30.775 INFO:tasks.workunit.client.0.smithi170.stdout:2/685: dwrite d3/d4/f21 [0,4194304] 0 2024-09-04T16:30:30.776 INFO:tasks.workunit.client.0.smithi170.stdout:5/634: creat d4/d3a/fcf x:0 0 0 2024-09-04T16:30:30.778 INFO:tasks.workunit.client.0.smithi170.stdout:4/627: readlink d1/d6/d8/d20/d35/d3e/d43/l5a 0 2024-09-04T16:30:30.783 INFO:tasks.workunit.client.0.smithi170.stdout:6/558: getdents d0 0 2024-09-04T16:30:30.784 INFO:tasks.workunit.client.0.smithi170.stdout:6/559: fsync d0/d15/d56/d6c/f76 0 2024-09-04T16:30:30.786 INFO:tasks.workunit.client.0.smithi170.stdout:3/614: creat d13/d14/d8b/fc5 x:0 0 0 2024-09-04T16:30:30.791 INFO:tasks.workunit.client.0.smithi170.stdout:0/767: truncate d11/d13/d4a/d66/fa0 2708270 0 2024-09-04T16:30:30.794 INFO:tasks.workunit.client.0.smithi170.stdout:6/560: creat d0/d15/d56/d6d/fb6 x:0 0 0 2024-09-04T16:30:30.795 INFO:tasks.workunit.client.0.smithi170.stdout:4/628: dwrite d1/d6/d8/d20/d95/f57 [0,4194304] 0 2024-09-04T16:30:30.798 INFO:tasks.workunit.client.0.smithi170.stdout:1/770: getdents d9/d11/dae/d6a/d79 0 2024-09-04T16:30:30.798 INFO:tasks.workunit.client.0.smithi170.stdout:5/635: getdents d4/d3a/d74/daf 0 2024-09-04T16:30:30.800 INFO:tasks.workunit.client.0.smithi170.stdout:0/768: creat d11/d13/d4a/d66/d6d/f123 x:0 0 0 2024-09-04T16:30:30.802 INFO:tasks.workunit.client.0.smithi170.stdout:2/686: rmdir d3/d4/d14/dcf/dba/dd4 0 2024-09-04T16:30:30.806 INFO:tasks.workunit.client.0.smithi170.stdout:3/615: mknod d13/d14/d21/d4d/d4e/d88/da2/cc6 0 2024-09-04T16:30:30.808 INFO:tasks.workunit.client.0.smithi170.stdout:6/561: dwrite d0/d17/d31/d64/d30/f91 [0,4194304] 0 2024-09-04T16:30:30.814 INFO:tasks.workunit.client.0.smithi170.stdout:5/636: symlink d4/d8/d1c/d26/d27/d48/d7c/ld0 0 2024-09-04T16:30:30.816 INFO:tasks.workunit.client.0.smithi170.stdout:0/769: mkdir d11/d13/d4a/db8/d111/d124 0 2024-09-04T16:30:30.818 INFO:tasks.workunit.client.0.smithi170.stdout:6/562: fsync d0/df/d1b/d3e/d47/d68/d2d/d2e/f49 0 2024-09-04T16:30:30.818 INFO:tasks.workunit.client.0.smithi170.stdout:6/563: chown d0/la3 579 1 2024-09-04T16:30:30.820 INFO:tasks.workunit.client.0.smithi170.stdout:6/564: write d0/df/d1b/d3e/d47/d68/d2d/d2e/f43 [402608,93248] 0 2024-09-04T16:30:30.821 INFO:tasks.workunit.client.0.smithi170.stdout:1/771: symlink d9/d11/d2f/d6b/d7d/dde/l101 0 2024-09-04T16:30:30.822 INFO:tasks.workunit.client.0.smithi170.stdout:6/565: fdatasync d0/d17/d31/d64/d30/f84 0 2024-09-04T16:30:30.824 INFO:tasks.workunit.client.0.smithi170.stdout:3/616: rename d13/d14/d21/d4d/d4e/d88/da2 to d13/d14/d21/d4d/d4e/d88/dc7 0 2024-09-04T16:30:30.825 INFO:tasks.workunit.client.0.smithi170.stdout:6/566: read - d0/df/d1b/d3e/d47/d68/fb0 zero size 2024-09-04T16:30:30.828 INFO:tasks.workunit.client.0.smithi170.stdout:5/637: unlink d4/d3a/fae 0 2024-09-04T16:30:30.829 INFO:tasks.workunit.client.0.smithi170.stdout:2/687: dread d3/d3c/d40/d48/f54 [0,4194304] 0 2024-09-04T16:30:30.830 INFO:tasks.workunit.client.0.smithi170.stdout:4/629: dwrite d1/d6/d8/d20/d35/d3e/d4e/d51/f7b [0,4194304] 0 2024-09-04T16:30:30.830 INFO:tasks.workunit.client.0.smithi170.stdout:2/688: chown d3/db/d1c/d77/dc2 960953010 1 2024-09-04T16:30:30.834 INFO:tasks.workunit.client.0.smithi170.stdout:3/617: fsync d13/d14/f48 0 2024-09-04T16:30:30.835 INFO:tasks.workunit.client.0.smithi170.stdout:0/770: fsync d11/d13/d71/d43/f3c 0 2024-09-04T16:30:30.839 INFO:tasks.workunit.client.0.smithi170.stdout:5/638: dread d4/db/d37/fab [0,4194304] 0 2024-09-04T16:30:30.839 INFO:tasks.workunit.client.0.smithi170.stdout:2/689: read d3/d4/f52 [1806779,43193] 0 2024-09-04T16:30:30.840 INFO:tasks.workunit.client.0.smithi170.stdout:2/690: chown d3/d7/fd8 12164 1 2024-09-04T16:30:30.841 INFO:tasks.workunit.client.0.smithi170.stdout:5/639: stat d4/d8/d1c/d26/d27/d48/d5a/f91 0 2024-09-04T16:30:30.841 INFO:tasks.workunit.client.0.smithi170.stdout:0/771: dread d11/d13/ffa [0,4194304] 0 2024-09-04T16:30:30.842 INFO:tasks.workunit.client.0.smithi170.stdout:2/691: write d3/db/d1c/f75 [91521,70344] 0 2024-09-04T16:30:30.843 INFO:tasks.workunit.client.0.smithi170.stdout:3/618: rmdir d13/d14/d1d/d71/db3/dbd 39 2024-09-04T16:30:30.847 INFO:tasks.workunit.client.0.smithi170.stdout:4/630: mknod d1/d6/d8/d20/dc1/dd2/cdb 0 2024-09-04T16:30:30.848 INFO:tasks.workunit.client.0.smithi170.stdout:4/631: dread - d1/d6/d2b/d47/fce zero size 2024-09-04T16:30:30.849 INFO:tasks.workunit.client.0.smithi170.stdout:1/772: rename d9/d11/d2e/d9e to d9/d102 0 2024-09-04T16:30:30.850 INFO:tasks.workunit.client.0.smithi170.stdout:5/640: mkdir d4/d3a/d74/dd1 0 2024-09-04T16:30:30.852 INFO:tasks.workunit.client.0.smithi170.stdout:0/772: unlink d11/d13/d71/d43/f2e 0 2024-09-04T16:30:30.853 INFO:tasks.workunit.client.0.smithi170.stdout:2/692: write d3/db/df/f7b [2737861,44634] 0 2024-09-04T16:30:30.854 INFO:tasks.workunit.client.0.smithi170.stdout:3/619: mkdir d13/d14/d1f/d7a/dc8 0 2024-09-04T16:30:30.855 INFO:tasks.workunit.client.0.smithi170.stdout:4/632: unlink d1/f19 0 2024-09-04T16:30:30.856 INFO:tasks.workunit.client.0.smithi170.stdout:1/773: creat d9/d11/d85/dd8/dee/f103 x:0 0 0 2024-09-04T16:30:30.857 INFO:tasks.workunit.client.0.smithi170.stdout:5/641: creat d4/d8/d1c/d23/d39/fd2 x:0 0 0 2024-09-04T16:30:30.858 INFO:tasks.workunit.client.0.smithi170.stdout:5/642: dread - d4/d3a/fcf zero size 2024-09-04T16:30:30.860 INFO:tasks.workunit.client.0.smithi170.stdout:0/773: symlink d11/d75/l125 0 2024-09-04T16:30:30.861 INFO:tasks.workunit.client.0.smithi170.stdout:6/567: truncate d0/d17/d39/d99/fad 1045555 0 2024-09-04T16:30:30.861 INFO:tasks.workunit.client.0.smithi170.stdout:0/774: write d11/d13/d4a/d66/d6d/fe9 [732152,105502] 0 2024-09-04T16:30:30.865 INFO:tasks.workunit.client.0.smithi170.stdout:3/620: unlink d13/d14/d1d/c26 0 2024-09-04T16:30:30.866 INFO:tasks.workunit.client.0.smithi170.stdout:3/621: write d13/d14/d21/f2e [595733,19630] 0 2024-09-04T16:30:30.867 INFO:tasks.workunit.client.0.smithi170.stdout:1/774: creat d9/d11/d2e/f104 x:0 0 0 2024-09-04T16:30:30.869 INFO:tasks.workunit.client.0.smithi170.stdout:5/643: creat d4/d3a/d74/d8b/db5/fd3 x:0 0 0 2024-09-04T16:30:30.870 INFO:tasks.workunit.client.0.smithi170.stdout:6/568: symlink d0/df/d7e/lb7 0 2024-09-04T16:30:30.872 INFO:tasks.workunit.client.0.smithi170.stdout:2/693: rename d3/d3c/lc4 to d3/db/dc5/le5 0 2024-09-04T16:30:30.873 INFO:tasks.workunit.client.0.smithi170.stdout:3/622: dwrite d13/d14/d21/d4c/f99 [0,4194304] 0 2024-09-04T16:30:30.874 INFO:tasks.workunit.client.0.smithi170.stdout:2/694: write d3/db/d62/f74 [203320,12702] 0 2024-09-04T16:30:30.874 INFO:tasks.workunit.client.0.smithi170.stdout:6/569: dread d0/d15/d56/d6c/f81 [0,4194304] 0 2024-09-04T16:30:30.877 INFO:tasks.workunit.client.0.smithi170.stdout:5/644: rmdir d4/d8/d1c/d26/d27/d48 39 2024-09-04T16:30:30.881 INFO:tasks.workunit.client.0.smithi170.stdout:0/775: getdents d11/d13/d4a/d66/d8c/d113 0 2024-09-04T16:30:30.883 INFO:tasks.workunit.client.0.smithi170.stdout:4/633: creat d1/d6/d8/d20/d95/fdc x:0 0 0 2024-09-04T16:30:30.886 INFO:tasks.workunit.client.0.smithi170.stdout:6/570: mkdir d0/d15/d56/d6c/db8 0 2024-09-04T16:30:30.896 INFO:tasks.workunit.client.0.smithi170.stdout:0/776: readlink d11/d75/l8f 0 2024-09-04T16:30:30.896 INFO:tasks.workunit.client.0.smithi170.stdout:0/777: chown d11/d13/d36/dfd 9 1 2024-09-04T16:30:30.897 INFO:tasks.workunit.client.0.smithi170.stdout:6/571: dread d0/df/fa1 [0,4194304] 0 2024-09-04T16:30:30.898 INFO:tasks.workunit.client.0.smithi170.stdout:7/843: sync 2024-09-04T16:30:30.903 INFO:tasks.workunit.client.0.smithi170.stdout:2/695: creat d3/db/d1c/d77/dc2/fe6 x:0 0 0 2024-09-04T16:30:30.903 INFO:tasks.workunit.client.0.smithi170.stdout:6/572: dwrite d0/f9 [0,4194304] 0 2024-09-04T16:30:30.906 INFO:tasks.workunit.client.0.smithi170.stdout:0/778: rmdir d11/d75/d77 39 2024-09-04T16:30:30.907 INFO:tasks.workunit.client.0.smithi170.stdout:0/779: write d11/d13/f28 [53289,73871] 0 2024-09-04T16:30:30.910 INFO:tasks.workunit.client.0.smithi170.stdout:3/623: rename d13/d14/d21/d4c/c62 to d13/d14/d1d/cc9 0 2024-09-04T16:30:30.913 INFO:tasks.workunit.client.0.smithi170.stdout:2/696: mkdir d3/d3c/de7 0 2024-09-04T16:30:30.916 INFO:tasks.workunit.client.0.smithi170.stdout:4/634: creat d1/d6/d8/d20/d35/fdd x:0 0 0 2024-09-04T16:30:30.917 INFO:tasks.workunit.client.0.smithi170.stdout:1/775: dwrite d9/d11/d9b/fb8 [0,4194304] 0 2024-09-04T16:30:30.918 INFO:tasks.workunit.client.0.smithi170.stdout:1/776: fsync d9/d11/d2f/d6b/d7d/f9f 0 2024-09-04T16:30:30.920 INFO:tasks.workunit.client.0.smithi170.stdout:0/780: unlink d11/d13/d4a/lc4 0 2024-09-04T16:30:30.921 INFO:tasks.workunit.client.0.smithi170.stdout:6/573: rename d0/f8d to d0/d15/d56/d6c/d98/fb9 0 2024-09-04T16:30:30.921 INFO:tasks.workunit.client.0.smithi170.stdout:8/636: sync 2024-09-04T16:30:30.921 INFO:tasks.workunit.client.0.smithi170.stdout:9/678: sync 2024-09-04T16:30:30.921 INFO:tasks.workunit.client.0.smithi170.stdout:9/679: readlink d2/d11/d23/l51 0 2024-09-04T16:30:30.926 INFO:tasks.workunit.client.0.smithi170.stdout:5/645: getdents d4/d8/d1c/d23/d39 0 2024-09-04T16:30:30.933 INFO:tasks.workunit.client.0.smithi170.stdout:2/697: mkdir d3/d3c/d40/d48/de8 0 2024-09-04T16:30:30.934 INFO:tasks.workunit.client.0.smithi170.stdout:4/635: readlink d1/d6/d8/d20/d95/d36/lc9 0 2024-09-04T16:30:30.935 INFO:tasks.workunit.client.0.smithi170.stdout:7/844: write d12/d16/d1d/d65/d82/fa1 [136352,115305] 0 2024-09-04T16:30:30.936 INFO:tasks.workunit.client.0.smithi170.stdout:0/781: fdatasync d11/d13/d2f/f31 0 2024-09-04T16:30:30.937 INFO:tasks.workunit.client.0.smithi170.stdout:9/680: dwrite d2/d3d/d27/fa0 [0,4194304] 0 2024-09-04T16:30:30.939 INFO:tasks.workunit.client.0.smithi170.stdout:4/636: fdatasync d1/d6/d8/d20/d95/d36/f3c 0 2024-09-04T16:30:30.944 INFO:tasks.workunit.client.0.smithi170.stdout:8/637: rename d6/d28/d1a/d38/fd3 to d6/d28/d20/d5e/fd8 0 2024-09-04T16:30:30.948 INFO:tasks.workunit.client.0.smithi170.stdout:9/681: dwrite d2/d3d/d27/f3a [0,4194304] 0 2024-09-04T16:30:30.958 INFO:tasks.workunit.client.0.smithi170.stdout:9/682: dwrite d2/d3d/d27/f3a [0,4194304] 0 2024-09-04T16:30:30.960 INFO:tasks.workunit.client.0.smithi170.stdout:4/637: dread d1/d6/f34 [0,4194304] 0 2024-09-04T16:30:30.965 INFO:tasks.workunit.client.0.smithi170.stdout:4/638: write d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/dbf/fd1 [926455,26263] 0 2024-09-04T16:30:30.966 INFO:tasks.workunit.client.0.smithi170.stdout:3/624: dwrite d13/d14/d1f/f60 [0,4194304] 0 2024-09-04T16:30:31.016 INFO:tasks.workunit.client.0.smithi170.stdout:5/646: symlink d4/db/ld4 0 2024-09-04T16:30:31.017 INFO:tasks.workunit.client.0.smithi170.stdout:5/647: readlink d4/d62/l77 0 2024-09-04T16:30:31.017 INFO:tasks.workunit.client.0.smithi170.stdout:1/777: mkdir d9/d105 0 2024-09-04T16:30:31.019 INFO:tasks.workunit.client.0.smithi170.stdout:7/845: mknod d12/d16/d1d/df5/c123 0 2024-09-04T16:30:31.020 INFO:tasks.workunit.client.0.smithi170.stdout:7/846: write d12/d16/d1d/d65/d82/dcb/fe9 [3165428,23629] 0 2024-09-04T16:30:31.025 INFO:tasks.workunit.client.0.smithi170.stdout:8/638: unlink d6/d28/d1a/f54 0 2024-09-04T16:30:31.027 INFO:tasks.workunit.client.0.smithi170.stdout:2/698: rename d3/d3c/d40/d48/f5b to d3/d3c/d40/fe9 0 2024-09-04T16:30:31.028 INFO:tasks.workunit.client.0.smithi170.stdout:6/574: chown d0/d17/d31/d64/l71 120 1 2024-09-04T16:30:31.029 INFO:tasks.workunit.client.0.smithi170.stdout:9/683: symlink d2/d3d/d6d/lcc 0 2024-09-04T16:30:31.029 INFO:tasks.workunit.client.0.smithi170.stdout:4/639: rmdir d1/d6/d8/d20/d95/d36 39 2024-09-04T16:30:31.029 INFO:tasks.workunit.client.0.smithi170.stdout:6/575: write d0/d17/d5b/fa2 [485946,272] 0 2024-09-04T16:30:31.031 INFO:tasks.workunit.client.0.smithi170.stdout:6/576: chown d0/d17/d31/d64/l77 614 1 2024-09-04T16:30:31.032 INFO:tasks.workunit.client.0.smithi170.stdout:3/625: mknod d13/d14/d21/d4d/d4e/d50/cca 0 2024-09-04T16:30:31.032 INFO:tasks.workunit.client.0.smithi170.stdout:6/577: fsync d0/d17/d31/d64/d30/f84 0 2024-09-04T16:30:31.034 INFO:tasks.workunit.client.0.smithi170.stdout:1/778: fsync d9/d11/f3f 0 2024-09-04T16:30:31.038 INFO:tasks.workunit.client.0.smithi170.stdout:8/639: creat d6/d28/d5f/d70/d97/d99/fd9 x:0 0 0 2024-09-04T16:30:31.039 INFO:tasks.workunit.client.0.smithi170.stdout:2/699: rmdir d3/db/d1c/db8/dd0 39 2024-09-04T16:30:31.040 INFO:tasks.workunit.client.0.smithi170.stdout:8/640: write d6/d28/d16/d77/d93/d95/dac/fca [312535,33885] 0 2024-09-04T16:30:31.041 INFO:tasks.workunit.client.0.smithi170.stdout:8/641: readlink d6/d28/d16/d24/d46/la2 0 2024-09-04T16:30:31.042 INFO:tasks.workunit.client.0.smithi170.stdout:4/640: mknod d1/d6/d8/d20/d35/d3e/d60/cde 0 2024-09-04T16:30:31.043 INFO:tasks.workunit.client.0.smithi170.stdout:2/700: write d3/db/d1c/d47/d83/d9f/fb5 [2108877,125678] 0 2024-09-04T16:30:31.044 INFO:tasks.workunit.client.0.smithi170.stdout:5/648: mknod d4/d8/d1c/d26/d27/d48/d5a/cd5 0 2024-09-04T16:30:31.047 INFO:tasks.workunit.client.0.smithi170.stdout:0/782: creat d11/d13/d71/d43/f126 x:0 0 0 2024-09-04T16:30:31.048 INFO:tasks.workunit.client.0.smithi170.stdout:5/649: dread d4/d8/d1c/d26/fc2 [0,4194304] 0 2024-09-04T16:30:31.049 INFO:tasks.workunit.client.0.smithi170.stdout:1/779: creat d9/d11/d2f/f106 x:0 0 0 2024-09-04T16:30:31.050 INFO:tasks.workunit.client.0.smithi170.stdout:7/847: symlink d12/d15/d71/d42/d79/de5/l124 0 2024-09-04T16:30:31.051 INFO:tasks.workunit.client.0.smithi170.stdout:5/650: fsync d4/d8/d1c/d23/d39/f40 0 2024-09-04T16:30:31.051 INFO:tasks.workunit.client.0.smithi170.stdout:6/578: dread d0/f9 [0,4194304] 0 2024-09-04T16:30:31.055 INFO:tasks.workunit.client.0.smithi170.stdout:8/642: dread d6/d28/d16/d52/d73/d5d/f89 [0,4194304] 0 2024-09-04T16:30:31.056 INFO:tasks.workunit.client.0.smithi170.stdout:8/643: readlink d6/d28/d1a/d81/lbc 0 2024-09-04T16:30:31.058 INFO:tasks.workunit.client.0.smithi170.stdout:9/684: dread d2/d3d/f57 [0,4194304] 0 2024-09-04T16:30:31.060 INFO:tasks.workunit.client.0.smithi170.stdout:2/701: dread d3/db/df/f7b [0,4194304] 0 2024-09-04T16:30:31.067 INFO:tasks.workunit.client.0.smithi170.stdout:7/848: rmdir d12/d16/d1d 39 2024-09-04T16:30:31.067 INFO:tasks.workunit.client.0.smithi170.stdout:1/780: mknod d9/d11/dae/d6a/d79/d7c/c107 0 2024-09-04T16:30:31.069 INFO:tasks.workunit.client.0.smithi170.stdout:5/651: mkdir d4/d8/d1c/d26/d27/d48/d7c/dd6 0 2024-09-04T16:30:31.069 INFO:tasks.workunit.client.0.smithi170.stdout:9/685: read d2/d3d/d27/d65/d56/f60 [19922,128600] 0 2024-09-04T16:30:31.081 INFO:tasks.workunit.client.0.smithi170.stdout:6/579: mknod d0/df/d1b/d3e/d47/d68/d2d/cba 0 2024-09-04T16:30:31.082 INFO:tasks.workunit.client.0.smithi170.stdout:9/686: dwrite d2/d3d/d27/d65/d56/d7a/da5/fb8 [4194304,4194304] 0 2024-09-04T16:30:31.084 INFO:tasks.workunit.client.0.smithi170.stdout:8/644: dwrite d6/d28/d16/d24/d46/f74 [4194304,4194304] 0 2024-09-04T16:30:31.086 INFO:tasks.workunit.client.0.smithi170.stdout:8/645: chown d6/d28/d16/d52/d73/cb5 52813297 1 2024-09-04T16:30:31.095 INFO:tasks.workunit.client.0.smithi170.stdout:5/652: fdatasync d4/d8/d1c/d26/d27/d43/d5b/f76 0 2024-09-04T16:30:31.095 INFO:tasks.workunit.client.0.smithi170.stdout:1/781: mkdir d9/d11/d2f/d6b/d61/d108 0 2024-09-04T16:30:31.095 INFO:tasks.workunit.client.0.smithi170.stdout:3/626: link d13/d14/d21/c6a d13/d14/d1d/d71/db3/ccb 0 2024-09-04T16:30:31.095 INFO:tasks.workunit.client.0.smithi170.stdout:1/782: chown d9/d34/cbf 3504763 1 2024-09-04T16:30:31.095 INFO:tasks.workunit.client.0.smithi170.stdout:4/641: link d1/d6/d8/d20/d95/l4b d1/d6/d22/d93/ldf 0 2024-09-04T16:30:31.096 INFO:tasks.workunit.client.0.smithi170.stdout:4/642: chown d1/d6/d8/d20/d35/d3e/d4e/d51/fd7 165296 1 2024-09-04T16:30:31.097 INFO:tasks.workunit.client.0.smithi170.stdout:9/687: rmdir d2/d3d/d6d 39 2024-09-04T16:30:31.102 INFO:tasks.workunit.client.0.smithi170.stdout:6/580: rename d0/df/d1f/f2c to d0/df/d1b/d3e/d47/d68/d2d/fbb 0 2024-09-04T16:30:31.104 INFO:tasks.workunit.client.0.smithi170.stdout:6/581: chown d0/d17/d5b/fa2 9860813 1 2024-09-04T16:30:31.104 INFO:tasks.workunit.client.0.smithi170.stdout:8/646: mknod d6/d28/d1a/d38/cda 0 2024-09-04T16:30:31.106 INFO:tasks.workunit.client.0.smithi170.stdout:3/627: read d13/d14/d17/f42 [10821,92078] 0 2024-09-04T16:30:31.107 INFO:tasks.workunit.client.0.smithi170.stdout:5/653: creat d4/d3a/fd7 x:0 0 0 2024-09-04T16:30:31.109 INFO:tasks.workunit.client.0.smithi170.stdout:4/643: dread d1/d6/f12 [0,4194304] 0 2024-09-04T16:30:31.112 INFO:tasks.workunit.client.0.smithi170.stdout:2/702: creat d3/db/d1c/d47/fea x:0 0 0 2024-09-04T16:30:31.112 INFO:tasks.workunit.client.0.smithi170.stdout:1/783: read - d9/d11/dae/d6a/d79/d7c/fab zero size 2024-09-04T16:30:31.119 INFO:tasks.workunit.client.0.smithi170.stdout:8/647: dread - d6/d26/f9a zero size 2024-09-04T16:30:31.120 INFO:tasks.workunit.client.0.smithi170.stdout:3/628: dread d13/d14/d1f/f60 [0,4194304] 0 2024-09-04T16:30:31.121 INFO:tasks.workunit.client.0.smithi170.stdout:1/784: fsync d9/d26/d77/d83/fa2 0 2024-09-04T16:30:31.124 INFO:tasks.workunit.client.0.smithi170.stdout:5/654: dwrite d4/d3a/d74/d8b/db5/fd3 [0,4194304] 0 2024-09-04T16:30:31.124 INFO:tasks.workunit.client.0.smithi170.stdout:2/703: mkdir d3/db/d1c/d47/d83/deb 0 2024-09-04T16:30:31.127 INFO:tasks.workunit.client.0.smithi170.stdout:1/785: write d9/d11/d2f/d6b/d7d/f9f [317801,125401] 0 2024-09-04T16:30:31.127 INFO:tasks.workunit.client.0.smithi170.stdout:5/655: readlink d4/d8/d1c/d41/l57 0 2024-09-04T16:30:31.131 INFO:tasks.workunit.client.0.smithi170.stdout:8/648: chown d6/f7a 9188880 1 2024-09-04T16:30:31.132 INFO:tasks.workunit.client.0.smithi170.stdout:5/656: dread - d4/d8/d1c/d41/faa zero size 2024-09-04T16:30:31.137 INFO:tasks.workunit.client.0.smithi170.stdout:9/688: mknod d2/d3d/d6d/d79/ccd 0 2024-09-04T16:30:31.142 INFO:tasks.workunit.client.0.smithi170.stdout:4/644: dwrite d1/d6/d8/d20/d35/d3e/d60/daa/fb7 [0,4194304] 0 2024-09-04T16:30:31.146 INFO:tasks.workunit.client.0.smithi170.stdout:1/786: dwrite d9/d11/d9b/fb8 [0,4194304] 0 2024-09-04T16:30:31.148 INFO:tasks.workunit.client.0.smithi170.stdout:1/787: truncate d9/d26/d77/d83/f90 1200847 0 2024-09-04T16:30:31.154 INFO:tasks.workunit.client.0.smithi170.stdout:8/649: creat d6/d28/d1a/d81/fdb x:0 0 0 2024-09-04T16:30:31.156 INFO:tasks.workunit.client.0.smithi170.stdout:9/689: symlink d2/d11/d23/d95/lce 0 2024-09-04T16:30:31.163 INFO:tasks.workunit.client.0.smithi170.stdout:5/657: dread - d4/d8/d1c/d26/d27/d48/d5a/f91 zero size 2024-09-04T16:30:31.168 INFO:tasks.workunit.client.0.smithi170.stdout:2/704: link d3/db/d62/d6f/f96 d3/db/d1c/d47/d83/d9f/fec 0 2024-09-04T16:30:31.175 INFO:tasks.workunit.client.0.smithi170.stdout:8/650: rename d6/d28/d5f/fc4 to d6/d28/d5f/d70/d97/fdc 0 2024-09-04T16:30:31.176 INFO:tasks.workunit.client.0.smithi170.stdout:8/651: dread - d6/d28/d16/d52/fb1 zero size 2024-09-04T16:30:31.178 INFO:tasks.workunit.client.0.smithi170.stdout:9/690: creat d2/d11/d8f/fcf x:0 0 0 2024-09-04T16:30:31.184 INFO:tasks.workunit.client.0.smithi170.stdout:8/652: dwrite d6/d28/d16/d52/d73/d5d/fc8 [0,4194304] 0 2024-09-04T16:30:31.184 INFO:tasks.workunit.client.0.smithi170.stdout:1/788: link d9/f54 d9/d11/d85/dd8/f109 0 2024-09-04T16:30:31.185 INFO:tasks.workunit.client.0.smithi170.stdout:1/789: readlink d9/d11/d2f/d6b/l6d 0 2024-09-04T16:30:31.186 INFO:tasks.workunit.client.0.smithi170.stdout:6/582: link d0/c22 d0/df/d1b/d3e/cbc 0 2024-09-04T16:30:31.189 INFO:tasks.workunit.client.0.smithi170.stdout:5/658: mknod d4/d3a/d74/daf/cd8 0 2024-09-04T16:30:31.191 INFO:tasks.workunit.client.0.smithi170.stdout:9/691: rmdir d2/d11/d23 39 2024-09-04T16:30:31.194 INFO:tasks.workunit.client.0.smithi170.stdout:2/705: mknod d3/db/d1c/db8/ced 0 2024-09-04T16:30:31.195 INFO:tasks.workunit.client.0.smithi170.stdout:8/653: chown d6/d26/l4b 791626 1 2024-09-04T16:30:31.198 INFO:tasks.workunit.client.0.smithi170.stdout:9/692: readlink d2/d3d/d54/l84 0 2024-09-04T16:30:31.200 INFO:tasks.workunit.client.0.smithi170.stdout:1/790: creat d9/d11/d85/df6/f10a x:0 0 0 2024-09-04T16:30:31.201 INFO:tasks.workunit.client.0.smithi170.stdout:0/783: dwrite d11/f68 [0,4194304] 0 2024-09-04T16:30:31.203 INFO:tasks.workunit.client.0.smithi170.stdout:7/849: truncate d12/d16/db7/fd6 1480704 0 2024-09-04T16:30:31.204 INFO:tasks.workunit.client.0.smithi170.stdout:0/784: dread - d11/d13/d4a/d66/d6d/fac zero size 2024-09-04T16:30:31.204 INFO:tasks.workunit.client.0.smithi170.stdout:6/583: mkdir d0/d17/dbd 0 2024-09-04T16:30:31.208 INFO:tasks.workunit.client.0.smithi170.stdout:4/645: getdents d1/d6/d8/d20/d35/d54/d96 0 2024-09-04T16:30:31.212 INFO:tasks.workunit.client.0.smithi170.stdout:0/785: read d11/d13/d36/f7a [1259952,30596] 0 2024-09-04T16:30:31.212 INFO:tasks.workunit.client.0.smithi170.stdout:4/646: readlink d1/d6/d8/d20/dae/lbc 0 2024-09-04T16:30:31.212 INFO:tasks.workunit.client.0.smithi170.stdout:9/693: mkdir d2/d3d/d6d/d79/dd0 0 2024-09-04T16:30:31.212 INFO:tasks.workunit.client.0.smithi170.stdout:1/791: unlink d9/d11/fa5 0 2024-09-04T16:30:31.219 INFO:tasks.workunit.client.0.smithi170.stdout:8/654: mkdir d6/d28/d20/d6e/da4/ddd 0 2024-09-04T16:30:31.223 INFO:tasks.workunit.client.0.smithi170.stdout:8/655: dread d6/f57 [0,4194304] 0 2024-09-04T16:30:31.224 INFO:tasks.workunit.client.0.smithi170.stdout:4/647: mkdir d1/d6/d8/d6c/de0 0 2024-09-04T16:30:31.228 INFO:tasks.workunit.client.0.smithi170.stdout:9/694: rename d2/d11/f26 to d2/d3d/d6d/fd1 0 2024-09-04T16:30:31.228 INFO:tasks.workunit.client.0.smithi170.stdout:3/629: dwrite d13/d14/d1f/f3e [0,4194304] 0 2024-09-04T16:30:31.230 INFO:tasks.workunit.client.0.smithi170.stdout:3/630: write d13/d14/d21/faf [741939,30381] 0 2024-09-04T16:30:31.230 INFO:tasks.workunit.client.0.smithi170.stdout:1/792: mkdir d9/d34/dbe/d10b 0 2024-09-04T16:30:31.231 INFO:tasks.workunit.client.0.smithi170.stdout:6/584: symlink d0/d15/lbe 0 2024-09-04T16:30:31.233 INFO:tasks.workunit.client.0.smithi170.stdout:6/585: chown d0/df/d1b/d3e/f95 2 1 2024-09-04T16:30:31.239 INFO:tasks.workunit.client.0.smithi170.stdout:4/648: creat d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/dbf/fe1 x:0 0 0 2024-09-04T16:30:31.242 INFO:tasks.workunit.client.0.smithi170.stdout:7/850: rename d12/d15/d71/d42/d81/d5c/l96 to d12/d16/d1d/d65/d118/l125 0 2024-09-04T16:30:31.244 INFO:tasks.workunit.client.0.smithi170.stdout:9/695: fdatasync d2/d3d/d4d/d59/fbb 0 2024-09-04T16:30:31.246 INFO:tasks.workunit.client.0.smithi170.stdout:3/631: mknod d13/d14/d1d/da4/ccc 0 2024-09-04T16:30:31.248 INFO:tasks.workunit.client.0.smithi170.stdout:3/632: write d13/d14/d21/d4c/f5d [2143255,50916] 0 2024-09-04T16:30:31.254 INFO:tasks.workunit.client.0.smithi170.stdout:5/659: write d4/d8/d1c/d26/d27/d43/d5b/f6e [589817,113924] 0 2024-09-04T16:30:31.255 INFO:tasks.workunit.client.0.smithi170.stdout:2/706: write d3/d3c/d40/f41 [157664,3242] 0 2024-09-04T16:30:31.256 INFO:tasks.workunit.client.0.smithi170.stdout:7/851: symlink d12/d16/db7/deb/l126 0 2024-09-04T16:30:31.258 INFO:tasks.workunit.client.0.smithi170.stdout:7/852: chown d12/d16/d1d/d65/d82/dcb/df8/f120 112 1 2024-09-04T16:30:31.262 INFO:tasks.workunit.client.0.smithi170.stdout:7/853: dread d12/d15/d71/d42/d79/fd5 [0,4194304] 0 2024-09-04T16:30:31.263 INFO:tasks.workunit.client.0.smithi170.stdout:7/854: chown d12/d16/d1d/d65/d82/cdb 24525 1 2024-09-04T16:30:31.264 INFO:tasks.workunit.client.0.smithi170.stdout:7/855: chown d12/d16/d109 7518491 1 2024-09-04T16:30:31.265 INFO:tasks.workunit.client.0.smithi170.stdout:1/793: link d9/d11/d2f/d6b/d7d/f9f d9/d11/f10c 0 2024-09-04T16:30:31.269 INFO:tasks.workunit.client.0.smithi170.stdout:5/660: unlink d4/d62/l77 0 2024-09-04T16:30:31.271 INFO:tasks.workunit.client.0.smithi170.stdout:5/661: write d4/d8/d1c/d23/d39/fd2 [317390,124957] 0 2024-09-04T16:30:31.273 INFO:tasks.workunit.client.0.smithi170.stdout:0/786: dwrite d11/f6a [0,4194304] 0 2024-09-04T16:30:31.274 INFO:tasks.workunit.client.0.smithi170.stdout:0/787: fsync d11/d13/d35/fd0 0 2024-09-04T16:30:31.275 INFO:tasks.workunit.client.0.smithi170.stdout:2/707: dread - d3/d3c/d40/d48/d68/f9a zero size 2024-09-04T16:30:31.277 INFO:tasks.workunit.client.0.smithi170.stdout:9/696: truncate d2/d3d/d27/d65/d5b/f71 1250092 0 2024-09-04T16:30:31.281 INFO:tasks.workunit.client.0.smithi170.stdout:7/856: creat d12/d15/d71/d42/d79/d9d/d51/f127 x:0 0 0 2024-09-04T16:30:31.282 INFO:tasks.workunit.client.0.smithi170.stdout:3/633: symlink d13/d14/d1d/lcd 0 2024-09-04T16:30:31.284 INFO:tasks.workunit.client.0.smithi170.stdout:1/794: mkdir d9/d11/d85/dd8/d10d 0 2024-09-04T16:30:31.284 INFO:tasks.workunit.client.0.smithi170.stdout:0/788: write d11/d13/d4a/d66/d8c/da8/f110 [2884569,50158] 0 2024-09-04T16:30:31.285 INFO:tasks.workunit.client.0.smithi170.stdout:5/662: dwrite d4/d8/d1c/d26/d27/f38 [0,4194304] 0 2024-09-04T16:30:31.286 INFO:tasks.workunit.client.0.smithi170.stdout:1/795: chown d9/d34/d5f/ce1 7435961 1 2024-09-04T16:30:31.288 INFO:tasks.workunit.client.0.smithi170.stdout:8/656: rename l2 to d6/d26/lde 0 2024-09-04T16:30:31.289 INFO:tasks.workunit.client.0.smithi170.stdout:0/789: write d11/d13/d4a/d66/d6d/d105/fbe [98896,95010] 0 2024-09-04T16:30:31.295 INFO:tasks.workunit.client.0.smithi170.stdout:2/708: mkdir d3/db/d1c/d47/d83/d9f/dae/dee 0 2024-09-04T16:30:31.296 INFO:tasks.workunit.client.0.smithi170.stdout:3/634: mknod d13/d14/d1d/d71/cce 0 2024-09-04T16:30:31.297 INFO:tasks.workunit.client.0.smithi170.stdout:6/586: dwrite d0/f9 [0,4194304] 0 2024-09-04T16:30:31.299 INFO:tasks.workunit.client.0.smithi170.stdout:5/663: symlink d4/d8/d1c/d29/ld9 0 2024-09-04T16:30:31.301 INFO:tasks.workunit.client.0.smithi170.stdout:4/649: dwrite d1/d6/d8/f8a [4194304,4194304] 0 2024-09-04T16:30:31.301 INFO:tasks.workunit.client.0.smithi170.stdout:1/796: creat d9/d34/dbe/f10e x:0 0 0 2024-09-04T16:30:31.302 INFO:tasks.workunit.client.0.smithi170.stdout:1/797: chown d9/d11/f1a 0 1 2024-09-04T16:30:31.303 INFO:tasks.workunit.client.0.smithi170.stdout:4/650: readlink d1/d6/d8/d20/d35/d3e/d43/l5a 0 2024-09-04T16:30:31.307 INFO:tasks.workunit.client.0.smithi170.stdout:8/657: symlink d6/d28/d16/d77/d93/d95/ldf 0 2024-09-04T16:30:31.310 INFO:tasks.workunit.client.0.smithi170.stdout:7/857: dread d12/d15/d71/d42/d79/d9d/d51/f8b [0,4194304] 0 2024-09-04T16:30:31.310 INFO:tasks.workunit.client.0.smithi170.stdout:8/658: write d6/d28/d16/d24/d46/fb2 [55375,52520] 0 2024-09-04T16:30:31.314 INFO:tasks.workunit.client.0.smithi170.stdout:0/790: creat d11/d13/d4a/d66/d6d/f127 x:0 0 0 2024-09-04T16:30:31.317 INFO:tasks.workunit.client.0.smithi170.stdout:4/651: dwrite d1/d6/d8/f8a [0,4194304] 0 2024-09-04T16:30:31.317 INFO:tasks.workunit.client.0.smithi170.stdout:0/791: dread - d11/d13/d4a/dc5/ff8 zero size 2024-09-04T16:30:31.324 INFO:tasks.workunit.client.0.smithi170.stdout:5/664: dread d4/d8/d1c/f6d [0,4194304] 0 2024-09-04T16:30:31.335 INFO:tasks.workunit.client.0.smithi170.stdout:6/587: mkdir d0/dbf 0 2024-09-04T16:30:31.336 INFO:tasks.workunit.client.0.smithi170.stdout:5/665: fsync d4/d8/d1c/d26/d27/d43/f87 0 2024-09-04T16:30:31.337 INFO:tasks.workunit.client.0.smithi170.stdout:5/666: dread - d4/d3a/fcf zero size 2024-09-04T16:30:31.339 INFO:tasks.workunit.client.0.smithi170.stdout:5/667: readlink d4/d8/d1c/d26/d27/d43/d5b/la3 0 2024-09-04T16:30:31.339 INFO:tasks.workunit.client.0.smithi170.stdout:0/792: dwrite d11/d13/d71/fd6 [0,4194304] 0 2024-09-04T16:30:31.339 INFO:tasks.workunit.client.0.smithi170.stdout:7/858: fdatasync d12/d16/d1d/d65/d82/f85 0 2024-09-04T16:30:31.342 INFO:tasks.workunit.client.0.smithi170.stdout:7/859: chown d12/d15/d71/d42/d81/l2c 21496091 1 2024-09-04T16:30:31.342 INFO:tasks.workunit.client.0.smithi170.stdout:2/709: rmdir d3/d3c/d40/d48/de8 0 2024-09-04T16:30:31.348 INFO:tasks.workunit.client.0.smithi170.stdout:8/659: write d6/d28/f1d [921298,127843] 0 2024-09-04T16:30:31.355 INFO:tasks.workunit.client.0.smithi170.stdout:5/668: mknod d4/d8/d1c/d26/d27/d48/d7c/cda 0 2024-09-04T16:30:31.357 INFO:tasks.workunit.client.0.smithi170.stdout:7/860: read d12/d15/d71/d42/d79/fd5 [517804,34100] 0 2024-09-04T16:30:31.358 INFO:tasks.workunit.client.0.smithi170.stdout:6/588: creat d0/d15/d56/fc0 x:0 0 0 2024-09-04T16:30:31.360 INFO:tasks.workunit.client.0.smithi170.stdout:8/660: creat d6/d28/d20/d6e/fe0 x:0 0 0 2024-09-04T16:30:31.363 INFO:tasks.workunit.client.0.smithi170.stdout:2/710: fsync d3/d7/f3e 0 2024-09-04T16:30:31.368 INFO:tasks.workunit.client.0.smithi170.stdout:8/661: rmdir d6/d28/d5f 39 2024-09-04T16:30:31.376 INFO:tasks.workunit.client.0.smithi170.stdout:2/711: creat d3/db/d1c/d47/d83/fef x:0 0 0 2024-09-04T16:30:31.377 INFO:tasks.workunit.client.0.smithi170.stdout:2/712: readlink d3/db/l58 0 2024-09-04T16:30:31.378 INFO:tasks.workunit.client.0.smithi170.stdout:2/713: chown d3/db/df/d45/fa9 20901741 1 2024-09-04T16:30:31.379 INFO:tasks.workunit.client.0.smithi170.stdout:6/589: mknod d0/df/d1b/d3e/d47/cc1 0 2024-09-04T16:30:31.380 INFO:tasks.workunit.client.0.smithi170.stdout:0/793: link d11/d13/d36/de5/ff5 d11/d13/d4a/d66/d8c/d113/f128 0 2024-09-04T16:30:31.381 INFO:tasks.workunit.client.0.smithi170.stdout:0/794: dread - d11/d75/dce/f108 zero size 2024-09-04T16:30:31.383 INFO:tasks.workunit.client.0.smithi170.stdout:8/662: fdatasync d6/f7a 0 2024-09-04T16:30:31.385 INFO:tasks.workunit.client.0.smithi170.stdout:5/669: dwrite d4/d8/d1c/d23/d94/dcb/fcd [0,4194304] 0 2024-09-04T16:30:31.387 INFO:tasks.workunit.client.0.smithi170.stdout:5/670: chown d4/d8/d1c/d26/d27/d43/d5b/l64 65 1 2024-09-04T16:30:31.387 INFO:tasks.workunit.client.0.smithi170.stdout:7/861: rename d12/d16/d1d/df5 to d12/d15/d71/d128 0 2024-09-04T16:30:31.396 INFO:tasks.workunit.client.0.smithi170.stdout:7/862: dwrite d12/d15/d71/d42/d81/d5c/f104 [0,4194304] 0 2024-09-04T16:30:31.398 INFO:tasks.workunit.client.0.smithi170.stdout:2/714: link d3/db/d62/f74 d3/d3c/dc1/ff0 0 2024-09-04T16:30:31.399 INFO:tasks.workunit.client.0.smithi170.stdout:7/863: write d12/d16/f98 [483614,8598] 0 2024-09-04T16:30:31.401 INFO:tasks.workunit.client.0.smithi170.stdout:0/795: write d11/d75/fcb [729554,10048] 0 2024-09-04T16:30:31.403 INFO:tasks.workunit.client.0.smithi170.stdout:6/590: truncate d0/d17/d31/f5a 705264 0 2024-09-04T16:30:31.409 INFO:tasks.workunit.client.0.smithi170.stdout:7/864: unlink d12/d15/d71/d42/d79/de5/l124 0 2024-09-04T16:30:31.415 INFO:tasks.workunit.client.0.smithi170.stdout:8/663: unlink d6/d28/d16/f43 0 2024-09-04T16:30:31.416 INFO:tasks.workunit.client.0.smithi170.stdout:5/671: rmdir d4/d8/d1c/d26/d27/d88/da4/dc0/dca 0 2024-09-04T16:30:31.420 INFO:tasks.workunit.client.0.smithi170.stdout:2/715: write d3/d3c/f30 [1304877,59584] 0 2024-09-04T16:30:31.426 INFO:tasks.workunit.client.0.smithi170.stdout:0/796: dwrite d11/d13/d4a/d66/d6d/fac [0,4194304] 0 2024-09-04T16:30:31.428 INFO:tasks.workunit.client.0.smithi170.stdout:6/591: write d0/f11 [2469145,46079] 0 2024-09-04T16:30:31.431 INFO:tasks.workunit.client.0.smithi170.stdout:2/716: rmdir d3/db/d1c/d77/dc2 39 2024-09-04T16:30:31.432 INFO:tasks.workunit.client.0.smithi170.stdout:7/865: truncate d12/d16/db7/fd6 799698 0 2024-09-04T16:30:31.433 INFO:tasks.workunit.client.0.smithi170.stdout:8/664: dwrite d6/d28/d5f/d91/fa6 [0,4194304] 0 2024-09-04T16:30:31.434 INFO:tasks.workunit.client.0.smithi170.stdout:5/672: write d4/d8/d1c/d26/d27/d48/f52 [500635,7287] 0 2024-09-04T16:30:31.434 INFO:tasks.workunit.client.0.smithi170.stdout:7/866: chown d12/d16/d1d/d65/d82/dcb/dce 126260117 1 2024-09-04T16:30:31.441 INFO:tasks.workunit.client.0.smithi170.stdout:0/797: unlink d11/d13/d4a/d66/d6d/d105/fbe 0 2024-09-04T16:30:31.442 INFO:tasks.workunit.client.0.smithi170.stdout:6/592: symlink d0/d15/d56/d6c/d98/lc2 0 2024-09-04T16:30:31.443 INFO:tasks.workunit.client.0.smithi170.stdout:5/673: symlink d4/db/d51/ldb 0 2024-09-04T16:30:31.443 INFO:tasks.workunit.client.0.smithi170.stdout:7/867: mknod d12/d16/d1d/d65/d118/c129 0 2024-09-04T16:30:31.445 INFO:tasks.workunit.client.0.smithi170.stdout:6/593: write d0/df/d1b/d3e/d47/d68/d2d/f8c [737058,80654] 0 2024-09-04T16:30:31.445 INFO:tasks.workunit.client.0.smithi170.stdout:8/665: mknod d6/d28/d1a/ce1 0 2024-09-04T16:30:31.447 INFO:tasks.workunit.client.0.smithi170.stdout:5/674: rmdir d4/d8 39 2024-09-04T16:30:31.447 INFO:tasks.workunit.client.0.smithi170.stdout:7/868: mknod d12/d15/d68/c12a 0 2024-09-04T16:30:31.448 INFO:tasks.workunit.client.0.smithi170.stdout:6/594: truncate d0/df/f78 859798 0 2024-09-04T16:30:31.450 INFO:tasks.workunit.client.0.smithi170.stdout:7/869: read d12/d15/d71/d42/d79/d9d/d51/f8b [136750,114284] 0 2024-09-04T16:30:31.450 INFO:tasks.workunit.client.0.smithi170.stdout:8/666: truncate d6/d28/d16/d52/d73/d5d/d8b/fd0 976962 0 2024-09-04T16:30:31.453 INFO:tasks.workunit.client.0.smithi170.stdout:6/595: dread d0/d15/d56/d6c/f81 [0,4194304] 0 2024-09-04T16:30:31.454 INFO:tasks.workunit.client.0.smithi170.stdout:0/798: rename c1 to d11/d13/c129 0 2024-09-04T16:30:31.455 INFO:tasks.workunit.client.0.smithi170.stdout:6/596: stat d0/df/d1b/d3e/d47/d68/d2d/cba 0 2024-09-04T16:30:31.456 INFO:tasks.workunit.client.0.smithi170.stdout:7/870: dread d12/d15/d68/f78 [0,4194304] 0 2024-09-04T16:30:31.457 INFO:tasks.workunit.client.0.smithi170.stdout:6/597: stat d0/df/d1b/d3e/d47/d68/d2d/d2e/f43 0 2024-09-04T16:30:31.461 INFO:tasks.workunit.client.0.smithi170.stdout:5/675: rename d4/d8/d1c/d26/f6a to d4/db/d51/d5e/d71/fdc 0 2024-09-04T16:30:31.463 INFO:tasks.workunit.client.0.smithi170.stdout:8/667: unlink d6/d26/lde 0 2024-09-04T16:30:31.463 INFO:tasks.workunit.client.0.smithi170.stdout:2/717: dwrite d3/d3c/d40/d48/f9e [0,4194304] 0 2024-09-04T16:30:31.466 INFO:tasks.workunit.client.0.smithi170.stdout:7/871: truncate d12/d15/d68/f78 2389693 0 2024-09-04T16:30:31.466 INFO:tasks.workunit.client.0.smithi170.stdout:6/598: symlink d0/d15/d56/d6c/lc3 0 2024-09-04T16:30:31.468 INFO:tasks.workunit.client.0.smithi170.stdout:7/872: chown d12/d16/d1d/d65/dff 0 1 2024-09-04T16:30:31.469 INFO:tasks.workunit.client.0.smithi170.stdout:5/676: symlink d4/db/d37/ldd 0 2024-09-04T16:30:31.472 INFO:tasks.workunit.client.0.smithi170.stdout:2/718: dwrite d3/d4/d86/dc9/fdb [0,4194304] 0 2024-09-04T16:30:31.472 INFO:tasks.workunit.client.0.smithi170.stdout:8/668: mkdir d6/d26/de2 0 2024-09-04T16:30:31.473 INFO:tasks.workunit.client.0.smithi170.stdout:8/669: readlink d6/d26/l6b 0 2024-09-04T16:30:31.475 INFO:tasks.workunit.client.0.smithi170.stdout:6/599: creat d0/d17/dbd/fc4 x:0 0 0 2024-09-04T16:30:31.479 INFO:tasks.workunit.client.0.smithi170.stdout:5/677: creat d4/db/d51/fde x:0 0 0 2024-09-04T16:30:31.482 INFO:tasks.workunit.client.0.smithi170.stdout:0/799: rename d11/d13/d4a/d66/d6d/d105/dd7 to d11/d13/d4a/d66/d8c/d12a 0 2024-09-04T16:30:31.483 INFO:tasks.workunit.client.0.smithi170.stdout:6/600: dwrite d0/d17/f1d [4194304,4194304] 0 2024-09-04T16:30:31.485 INFO:tasks.workunit.client.0.smithi170.stdout:0/800: fsync d11/d13/d71/d43/f126 0 2024-09-04T16:30:31.487 INFO:tasks.workunit.client.0.smithi170.stdout:2/719: creat d3/db/d62/d6f/ff1 x:0 0 0 2024-09-04T16:30:31.488 INFO:tasks.workunit.client.0.smithi170.stdout:8/670: mknod d6/d28/d1a/d38/ce3 0 2024-09-04T16:30:31.490 INFO:tasks.workunit.client.0.smithi170.stdout:7/873: getdents d12/d15/d68/d122 0 2024-09-04T16:30:31.491 INFO:tasks.workunit.client.0.smithi170.stdout:6/601: mknod d0/d17/d31/d64/d30/cc5 0 2024-09-04T16:30:31.491 INFO:tasks.workunit.client.0.smithi170.stdout:8/671: chown d6/d28/d16/d24/ca8 4426 1 2024-09-04T16:30:31.492 INFO:tasks.workunit.client.0.smithi170.stdout:5/678: mkdir d4/d8/d1c/d26/d27/d48/ddf 0 2024-09-04T16:30:31.494 INFO:tasks.workunit.client.0.smithi170.stdout:8/672: write d6/d28/d5f/d85/fbd [489558,106083] 0 2024-09-04T16:30:31.495 INFO:tasks.workunit.client.0.smithi170.stdout:6/602: creat d0/d17/dbd/fc6 x:0 0 0 2024-09-04T16:30:31.496 INFO:tasks.workunit.client.0.smithi170.stdout:7/874: mknod d12/c12b 0 2024-09-04T16:30:31.498 INFO:tasks.workunit.client.0.smithi170.stdout:0/801: dwrite d11/d13/d4a/d66/d8c/dae/dfc/fe6 [0,4194304] 0 2024-09-04T16:30:31.499 INFO:tasks.workunit.client.0.smithi170.stdout:5/679: rmdir d4/d8/d1c 39 2024-09-04T16:30:31.499 INFO:tasks.workunit.client.0.smithi170.stdout:7/875: chown d12/d15/d71/d42/d79/d9d/d51/c37 5 1 2024-09-04T16:30:31.502 INFO:tasks.workunit.client.0.smithi170.stdout:0/802: dread - d11/d13/d4a/d66/d8c/dae/ff9 zero size 2024-09-04T16:30:31.505 INFO:tasks.workunit.client.0.smithi170.stdout:2/720: dread d3/d7/fd8 [0,4194304] 0 2024-09-04T16:30:31.510 INFO:tasks.workunit.client.0.smithi170.stdout:6/603: symlink d0/d17/lc7 0 2024-09-04T16:30:31.511 INFO:tasks.workunit.client.0.smithi170.stdout:0/803: unlink d11/d13/d4a/d66/d6d/f10c 0 2024-09-04T16:30:31.512 INFO:tasks.workunit.client.0.smithi170.stdout:0/804: write d11/d13/d4a/d66/f83 [4901710,98566] 0 2024-09-04T16:30:31.513 INFO:tasks.workunit.client.0.smithi170.stdout:2/721: fdatasync d3/db/d1c/d77/dc2/fe6 0 2024-09-04T16:30:31.515 INFO:tasks.workunit.client.0.smithi170.stdout:6/604: creat d0/df/d1b/d3e/d47/d68/d2d/d67/fc8 x:0 0 0 2024-09-04T16:30:31.517 INFO:tasks.workunit.client.0.smithi170.stdout:0/805: rmdir d11/d13/d4a/db8 39 2024-09-04T16:30:31.586 INFO:tasks.workunit.client.0.smithi170.stdout:2/722: mknod d3/d3c/de7/cf2 0 2024-09-04T16:30:31.587 INFO:tasks.workunit.client.0.smithi170.stdout:0/806: write d11/d13/d35/fad [600434,17892] 0 2024-09-04T16:30:31.589 INFO:tasks.workunit.client.0.smithi170.stdout:6/605: write d0/f16 [712002,121449] 0 2024-09-04T16:30:31.591 INFO:tasks.workunit.client.0.smithi170.stdout:2/723: fdatasync d3/db/dc5/fd7 0 2024-09-04T16:30:31.593 INFO:tasks.workunit.client.0.smithi170.stdout:8/673: dwrite d6/d28/d1a/d38/f88 [0,4194304] 0 2024-09-04T16:30:31.594 INFO:tasks.workunit.client.0.smithi170.stdout:5/680: dwrite d4/d8/d1c/d26/d27/f3f [4194304,4194304] 0 2024-09-04T16:30:31.595 INFO:tasks.workunit.client.0.smithi170.stdout:7/876: dwrite d12/d15/d71/d42/d79/f92 [0,4194304] 0 2024-09-04T16:30:31.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:31 smithi170 ceph-mon[29272]: pgmap v35: 65 pgs: 65 active+clean; 3.3 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 78 MiB/s rd, 177 MiB/s wr, 399 op/s 2024-09-04T16:30:31.618 INFO:tasks.workunit.client.0.smithi170.stdout:0/807: mkdir d11/d13/d36/d12b 0 2024-09-04T16:30:31.618 INFO:tasks.workunit.client.0.smithi170.stdout:0/808: chown d11/d13/d4a/dc5 31771 1 2024-09-04T16:30:31.619 INFO:tasks.workunit.client.0.smithi170.stdout:0/809: dread - d11/d13/d4a/d66/d8c/fc6 zero size 2024-09-04T16:30:31.624 INFO:tasks.workunit.client.0.smithi170.stdout:2/724: truncate d3/fe3 2582997 0 2024-09-04T16:30:31.625 INFO:tasks.workunit.client.0.smithi170.stdout:2/725: dread - d3/db/d62/d6f/ff1 zero size 2024-09-04T16:30:31.626 INFO:tasks.workunit.client.0.smithi170.stdout:6/606: link d0/d17/d5b/fa2 d0/df/d1b/d3e/d47/d68/d2d/fc9 0 2024-09-04T16:30:31.627 INFO:tasks.workunit.client.0.smithi170.stdout:0/810: truncate d11/d13/d71/d43/f102 329244 0 2024-09-04T16:30:31.628 INFO:tasks.workunit.client.0.smithi170.stdout:5/681: dwrite d4/d8/d1c/f6d [0,4194304] 0 2024-09-04T16:30:31.632 INFO:tasks.workunit.client.0.smithi170.stdout:2/726: fsync d3/d3c/f82 0 2024-09-04T16:30:31.639 INFO:tasks.workunit.client.0.smithi170.stdout:0/811: creat d11/d13/d36/d107/f12c x:0 0 0 2024-09-04T16:30:31.639 INFO:tasks.workunit.client.0.smithi170.stdout:8/674: dwrite d6/d28/d16/d52/f64 [0,4194304] 0 2024-09-04T16:30:31.641 INFO:tasks.workunit.client.0.smithi170.stdout:0/812: write d11/d13/d35/fd0 [39911,124465] 0 2024-09-04T16:30:31.642 INFO:tasks.workunit.client.0.smithi170.stdout:5/682: mkdir d4/d8/d1c/d26/d27/d48/d7c/dd6/de0 0 2024-09-04T16:30:31.646 INFO:tasks.workunit.client.0.smithi170.stdout:8/675: write d6/d28/d1a/d38/f9d [1984877,37129] 0 2024-09-04T16:30:31.648 INFO:tasks.workunit.client.0.smithi170.stdout:0/813: dread - d11/d13/d71/fde zero size 2024-09-04T16:30:31.648 INFO:tasks.workunit.client.0.smithi170.stdout:6/607: write d0/d15/f45 [100698,83338] 0 2024-09-04T16:30:31.652 INFO:tasks.workunit.client.0.smithi170.stdout:6/608: creat d0/d17/dbd/fca x:0 0 0 2024-09-04T16:30:31.655 INFO:tasks.workunit.client.0.smithi170.stdout:0/814: symlink d11/d13/d2f/d3f/l12d 0 2024-09-04T16:30:31.655 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:31 smithi193 ceph-mon[36288]: pgmap v35: 65 pgs: 65 active+clean; 3.3 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 78 MiB/s rd, 177 MiB/s wr, 399 op/s 2024-09-04T16:30:31.657 INFO:tasks.workunit.client.0.smithi170.stdout:0/815: dread d11/d13/d36/f40 [0,4194304] 0 2024-09-04T16:30:31.658 INFO:tasks.workunit.client.0.smithi170.stdout:6/609: mkdir d0/d15/d56/d6d/dcb 0 2024-09-04T16:30:31.659 INFO:tasks.workunit.client.0.smithi170.stdout:5/683: link d4/d8/d1c/d26/d27/c45 d4/d3a/d74/dd1/ce1 0 2024-09-04T16:30:31.659 INFO:tasks.workunit.client.0.smithi170.stdout:6/610: truncate d0/d17/dbd/fc6 763313 0 2024-09-04T16:30:31.661 INFO:tasks.workunit.client.0.smithi170.stdout:6/611: write d0/df/d1f/d9c/fb3 [794817,87167] 0 2024-09-04T16:30:31.661 INFO:tasks.workunit.client.0.smithi170.stdout:0/816: symlink d11/d13/d4a/d66/d8c/d12a/l12e 0 2024-09-04T16:30:31.663 INFO:tasks.workunit.client.0.smithi170.stdout:5/684: rmdir d4/d3a/d74/d8b/db5 39 2024-09-04T16:30:31.664 INFO:tasks.workunit.client.0.smithi170.stdout:0/817: rmdir d11/d13/d4a/d66/d8c 39 2024-09-04T16:30:31.664 INFO:tasks.workunit.client.0.smithi170.stdout:0/818: stat d11/d13/d2f/d3f/l70 0 2024-09-04T16:30:31.666 INFO:tasks.workunit.client.0.smithi170.stdout:5/685: rename d4/d8/c4b to d4/db/ce2 0 2024-09-04T16:30:31.670 INFO:tasks.workunit.client.0.smithi170.stdout:6/612: getdents d0 0 2024-09-04T16:30:31.672 INFO:tasks.workunit.client.0.smithi170.stdout:6/613: write d0/f9 [3611123,3074] 0 2024-09-04T16:30:31.674 INFO:tasks.workunit.client.0.smithi170.stdout:0/819: dwrite d11/d75/d77/ff4 [0,4194304] 0 2024-09-04T16:30:31.675 INFO:tasks.workunit.client.0.smithi170.stdout:0/820: dread - d11/d13/d36/fff zero size 2024-09-04T16:30:31.676 INFO:tasks.workunit.client.0.smithi170.stdout:0/821: chown d11/d13 14678873 1 2024-09-04T16:30:31.677 INFO:tasks.workunit.client.0.smithi170.stdout:0/822: chown d11/d13/d71/d43/fb4 0 1 2024-09-04T16:30:31.684 INFO:tasks.workunit.client.0.smithi170.stdout:0/823: dwrite d11/d13/d36/f118 [0,4194304] 0 2024-09-04T16:30:31.692 INFO:tasks.workunit.client.0.smithi170.stdout:5/686: dwrite d4/d8/d1c/d26/d27/f68 [0,4194304] 0 2024-09-04T16:30:31.694 INFO:tasks.workunit.client.0.smithi170.stdout:0/824: dwrite d11/d13/d36/fff [0,4194304] 0 2024-09-04T16:30:31.703 INFO:tasks.workunit.client.0.smithi170.stdout:5/687: dwrite d4/f6 [0,4194304] 0 2024-09-04T16:30:31.711 INFO:tasks.workunit.client.0.smithi170.stdout:5/688: dread d4/d3a/d74/d8b/db5/fd3 [0,4194304] 0 2024-09-04T16:30:31.713 INFO:tasks.workunit.client.0.smithi170.stdout:5/689: mknod d4/d62/ce3 0 2024-09-04T16:30:31.714 INFO:tasks.workunit.client.0.smithi170.stdout:5/690: write d4/f6 [3641853,19417] 0 2024-09-04T16:30:31.721 INFO:tasks.workunit.client.0.smithi170.stdout:5/691: dwrite d4/d8/d1c/d26/d27/d43/d5b/f96 [0,4194304] 0 2024-09-04T16:30:31.723 INFO:tasks.workunit.client.0.smithi170.stdout:5/692: fdatasync d4/db/fbf 0 2024-09-04T16:30:31.736 INFO:tasks.workunit.client.0.smithi170.stdout:5/693: write d4/d8/d1c/d29/f2a [546669,37591] 0 2024-09-04T16:30:31.737 INFO:tasks.workunit.client.0.smithi170.stdout:5/694: symlink d4/d62/le4 0 2024-09-04T16:30:31.739 INFO:tasks.workunit.client.0.smithi170.stdout:5/695: write d4/d8/d1c/f6d [2205025,122616] 0 2024-09-04T16:30:31.739 INFO:tasks.workunit.client.0.smithi170.stdout:5/696: dread - d4/d8/d1c/d23/f83 zero size 2024-09-04T16:30:31.747 INFO:tasks.workunit.client.0.smithi170.stdout:5/697: truncate d4/d8/d1c/d26/d27/f3f 3807849 0 2024-09-04T16:30:31.754 INFO:tasks.workunit.client.0.smithi170.stdout:5/698: write d4/db/f8a [4805176,5055] 0 2024-09-04T16:30:31.758 INFO:tasks.workunit.client.0.smithi170.stdout:5/699: mkdir d4/d8/d1c/d26/d27/d48/de5 0 2024-09-04T16:30:31.761 INFO:tasks.workunit.client.0.smithi170.stdout:5/700: truncate d4/db/f34 4725946 0 2024-09-04T16:30:31.761 INFO:tasks.workunit.client.0.smithi170.stdout:5/701: chown d4/d8/l60 1627751 1 2024-09-04T16:30:31.767 INFO:tasks.workunit.client.0.smithi170.stdout:5/702: creat d4/d8/d1c/d26/fe6 x:0 0 0 2024-09-04T16:30:31.768 INFO:tasks.workunit.client.0.smithi170.stdout:5/703: dread - d4/db/d51/fde zero size 2024-09-04T16:30:31.773 INFO:tasks.workunit.client.0.smithi170.stdout:5/704: dwrite d4/db/d37/f36 [0,4194304] 0 2024-09-04T16:30:31.773 INFO:tasks.workunit.client.0.smithi170.stdout:5/705: chown d4/f3b 1033321 1 2024-09-04T16:30:31.786 INFO:tasks.workunit.client.0.smithi170.stdout:5/706: getdents d4/d8/d1c/d26 0 2024-09-04T16:30:31.787 INFO:tasks.workunit.client.0.smithi170.stdout:5/707: write d4/d8/d1c/d26/d27/d48/d7c/fcc [920910,16213] 0 2024-09-04T16:30:31.788 INFO:tasks.workunit.client.0.smithi170.stdout:5/708: fdatasync d4/db/fe 0 2024-09-04T16:30:31.789 INFO:tasks.workunit.client.0.smithi170.stdout:5/709: write d4/d8/d1c/d23/f83 [12568,23479] 0 2024-09-04T16:30:31.790 INFO:tasks.workunit.client.0.smithi170.stdout:5/710: readlink d4/d3a/l56 0 2024-09-04T16:30:31.800 INFO:tasks.workunit.client.0.smithi170.stdout:5/711: dread d4/db/fbf [0,4194304] 0 2024-09-04T16:30:31.816 INFO:tasks.workunit.client.0.smithi170.stdout:5/712: dread d4/d8/d1c/d23/d3e/f7e [0,4194304] 0 2024-09-04T16:30:31.819 INFO:tasks.workunit.client.0.smithi170.stdout:5/713: rename d4/d8/l65 to d4/db/d51/d5e/d71/d84/d93/le7 0 2024-09-04T16:30:31.823 INFO:tasks.workunit.client.0.smithi170.stdout:5/714: creat d4/d8/d1c/d26/d27/fe8 x:0 0 0 2024-09-04T16:30:31.824 INFO:tasks.workunit.client.0.smithi170.stdout:5/715: chown d4/d8/d1c/d26/d27/f68 7685629 1 2024-09-04T16:30:31.826 INFO:tasks.workunit.client.0.smithi170.stdout:5/716: creat d4/d8/d1c/d41/fe9 x:0 0 0 2024-09-04T16:30:31.828 INFO:tasks.workunit.client.0.smithi170.stdout:5/717: write d4/d8/d1c/d26/d27/d43/f86 [537632,19493] 0 2024-09-04T16:30:31.834 INFO:tasks.workunit.client.0.smithi170.stdout:5/718: dwrite d4/d3a/fcf [0,4194304] 0 2024-09-04T16:30:31.838 INFO:tasks.workunit.client.0.smithi170.stdout:5/719: mkdir d4/d8/dea 0 2024-09-04T16:30:31.840 INFO:tasks.workunit.client.0.smithi170.stdout:5/720: mknod d4/d3a/d74/d8b/db5/ceb 0 2024-09-04T16:30:31.842 INFO:tasks.workunit.client.0.smithi170.stdout:5/721: fdatasync d4/fc4 0 2024-09-04T16:30:31.843 INFO:tasks.workunit.client.0.smithi170.stdout:5/722: write d4/db/d51/d5e/d71/d84/d93/fc8 [1656218,50109] 0 2024-09-04T16:30:31.846 INFO:tasks.workunit.client.0.smithi170.stdout:5/723: creat d4/d8/d1c/d41/fec x:0 0 0 2024-09-04T16:30:31.849 INFO:tasks.workunit.client.0.smithi170.stdout:5/724: symlink d4/d8/d1c/d41/led 0 2024-09-04T16:30:31.855 INFO:tasks.workunit.client.0.smithi170.stdout:5/725: dwrite d4/d3a/d74/fce [0,4194304] 0 2024-09-04T16:30:31.860 INFO:tasks.workunit.client.0.smithi170.stdout:5/726: mkdir d4/d8/d1c/d23/d94/db3/dee 0 2024-09-04T16:30:31.861 INFO:tasks.workunit.client.0.smithi170.stdout:5/727: fdatasync d4/fb9 0 2024-09-04T16:30:31.863 INFO:tasks.workunit.client.0.smithi170.stdout:5/728: stat d4/d8/d1c/d29/lbb 0 2024-09-04T16:30:31.863 INFO:tasks.workunit.client.0.smithi170.stdout:5/729: dread - d4/fb9 zero size 2024-09-04T16:30:32.542 INFO:tasks.workunit.client.0.smithi170.stdout:9/697: sync 2024-09-04T16:30:32.544 INFO:tasks.workunit.client.0.smithi170.stdout:9/698: mknod d2/d3d/d3f/cd2 0 2024-09-04T16:30:32.546 INFO:tasks.workunit.client.0.smithi170.stdout:9/699: dread - d2/d3d/d27/f64 zero size 2024-09-04T16:30:32.547 INFO:tasks.workunit.client.0.smithi170.stdout:9/700: chown d2/d11/d23/f30 122776401 1 2024-09-04T16:30:32.548 INFO:tasks.workunit.client.0.smithi170.stdout:9/701: fsync d2/d3d/d27/f8e 0 2024-09-04T16:30:32.561 INFO:tasks.workunit.client.0.smithi170.stdout:9/702: dread d2/d11/f12 [4194304,4194304] 0 2024-09-04T16:30:32.562 INFO:tasks.workunit.client.0.smithi170.stdout:9/703: chown d2/d3d/d27/f64 363592 1 2024-09-04T16:30:32.565 INFO:tasks.workunit.client.0.smithi170.stdout:9/704: unlink d2/d3d/d27/d65/d66/ca6 0 2024-09-04T16:30:32.566 INFO:tasks.workunit.client.0.smithi170.stdout:9/705: stat d2/d3d/d3f/lc4 0 2024-09-04T16:30:32.573 INFO:tasks.workunit.client.0.smithi170.stdout:9/706: getdents d2/d3d/d27/d65/d66 0 2024-09-04T16:30:32.576 INFO:tasks.workunit.client.0.smithi170.stdout:9/707: truncate d2/d3d/d6d/d79/f94 3712659 0 2024-09-04T16:30:32.581 INFO:tasks.workunit.client.0.smithi170.stdout:9/708: rename d2/d3d/d27/f53 to d2/d3d/d4d/fd3 0 2024-09-04T16:30:32.582 INFO:tasks.workunit.client.0.smithi170.stdout:9/709: read d2/fc5 [3945153,101554] 0 2024-09-04T16:30:32.584 INFO:tasks.workunit.client.0.smithi170.stdout:9/710: mkdir d2/d11/d58/dd4 0 2024-09-04T16:30:32.599 INFO:tasks.workunit.client.0.smithi170.stdout:9/711: dwrite d2/d3d/d6d/d79/f94 [4194304,4194304] 0 2024-09-04T16:30:32.605 INFO:tasks.workunit.client.0.smithi170.stdout:9/712: creat d2/d11/d58/fd5 x:0 0 0 2024-09-04T16:30:32.608 INFO:tasks.workunit.client.0.smithi170.stdout:9/713: link d2/d3d/d6d/l8b d2/d11/d8f/ld6 0 2024-09-04T16:30:32.609 INFO:tasks.workunit.client.0.smithi170.stdout:9/714: stat d2/d3d/d54/cb2 0 2024-09-04T16:30:32.611 INFO:tasks.workunit.client.0.smithi170.stdout:9/715: mkdir d2/d3d/d27/d65/d56/dd7 0 2024-09-04T16:30:32.612 INFO:tasks.workunit.client.0.smithi170.stdout:1/798: sync 2024-09-04T16:30:32.612 INFO:tasks.workunit.client.0.smithi170.stdout:3/635: sync 2024-09-04T16:30:32.613 INFO:tasks.workunit.client.0.smithi170.stdout:3/636: rename d13/d14/d1f to d13/d14/d1f/d7a/dcf 22 2024-09-04T16:30:32.615 INFO:tasks.workunit.client.0.smithi170.stdout:3/637: fdatasync d13/d14/d1d/d71/db3/db6/faa 0 2024-09-04T16:30:32.616 INFO:tasks.workunit.client.0.smithi170.stdout:9/716: getdents d2/d11/d23 0 2024-09-04T16:30:32.617 INFO:tasks.workunit.client.0.smithi170.stdout:1/799: dread d9/fbd [0,4194304] 0 2024-09-04T16:30:32.618 INFO:tasks.workunit.client.0.smithi170.stdout:1/800: chown d9/f55 62 1 2024-09-04T16:30:32.619 INFO:tasks.workunit.client.0.smithi170.stdout:9/717: creat d2/d3d/d27/d65/d5b/fd8 x:0 0 0 2024-09-04T16:30:32.621 INFO:tasks.workunit.client.0.smithi170.stdout:1/801: mkdir d9/d11/d85/d10f 0 2024-09-04T16:30:32.623 INFO:tasks.workunit.client.0.smithi170.stdout:1/802: fdatasync d9/d11/d2f/f57 0 2024-09-04T16:30:32.623 INFO:tasks.workunit.client.0.smithi170.stdout:3/638: dwrite d13/d14/d1d/f28 [0,4194304] 0 2024-09-04T16:30:32.626 INFO:tasks.workunit.client.0.smithi170.stdout:1/803: symlink d9/d11/dae/d6a/d79/d7c/l110 0 2024-09-04T16:30:32.631 INFO:tasks.workunit.client.0.smithi170.stdout:1/804: mkdir d9/d26/d77/d111 0 2024-09-04T16:30:32.631 INFO:tasks.workunit.client.0.smithi170.stdout:1/805: readlink d9/d11/d2e/l51 0 2024-09-04T16:30:32.632 INFO:tasks.workunit.client.0.smithi170.stdout:1/806: dread - d9/d102/fed zero size 2024-09-04T16:30:32.641 INFO:tasks.workunit.client.0.smithi170.stdout:3/639: write d13/d14/d1f/f96 [646007,90203] 0 2024-09-04T16:30:32.645 INFO:tasks.workunit.client.0.smithi170.stdout:3/640: dread d13/d14/d21/d4c/f77 [0,4194304] 0 2024-09-04T16:30:32.649 INFO:tasks.workunit.client.0.smithi170.stdout:3/641: write d13/d14/d1d/d71/db3/dbd/fc4 [365356,128790] 0 2024-09-04T16:30:32.652 INFO:tasks.workunit.client.0.smithi170.stdout:1/807: dwrite d9/d11/d2f/fad [0,4194304] 0 2024-09-04T16:30:32.653 INFO:tasks.workunit.client.0.smithi170.stdout:3/642: dread - d13/d14/d1d/d2d/d58/fa0 zero size 2024-09-04T16:30:32.654 INFO:tasks.workunit.client.0.smithi170.stdout:1/808: chown d9/d11/dae/d6a/l76 7 1 2024-09-04T16:30:32.656 INFO:tasks.workunit.client.0.smithi170.stdout:3/643: write d13/d14/d1d/d2d/f34 [2819760,116464] 0 2024-09-04T16:30:32.660 INFO:tasks.workunit.client.0.smithi170.stdout:3/644: symlink d13/d14/d17/d1c/ld0 0 2024-09-04T16:30:32.662 INFO:tasks.workunit.client.0.smithi170.stdout:3/645: write d13/d14/d21/d4d/d4e/d88/dbf/f70 [4435890,53728] 0 2024-09-04T16:30:32.667 INFO:tasks.workunit.client.0.smithi170.stdout:3/646: creat d13/d14/d17/fd1 x:0 0 0 2024-09-04T16:30:32.670 INFO:tasks.workunit.client.0.smithi170.stdout:3/647: mkdir d13/d14/d21/dd2 0 2024-09-04T16:30:32.672 INFO:tasks.workunit.client.0.smithi170.stdout:3/648: write d13/d14/d17/fbb [430516,13050] 0 2024-09-04T16:30:32.672 INFO:tasks.workunit.client.0.smithi170.stdout:1/809: dread d9/d11/d2f/d6b/f70 [4194304,4194304] 0 2024-09-04T16:30:32.679 INFO:tasks.workunit.client.0.smithi170.stdout:1/810: dwrite d9/d34/d5f/fd6 [4194304,4194304] 0 2024-09-04T16:30:32.681 INFO:tasks.workunit.client.0.smithi170.stdout:1/811: rmdir d9/d34/d5f 39 2024-09-04T16:30:32.683 INFO:tasks.workunit.client.0.smithi170.stdout:3/649: link d13/d14/d21/d4c/c86 d13/d14/d17/d1c/cd3 0 2024-09-04T16:30:32.686 INFO:tasks.workunit.client.0.smithi170.stdout:1/812: rename d9/d26/d77/ffc to d9/d11/d2f/db9/f112 0 2024-09-04T16:30:32.688 INFO:tasks.workunit.client.0.smithi170.stdout:3/650: creat d13/d14/d21/d4d/d4e/d50/fd4 x:0 0 0 2024-09-04T16:30:32.689 INFO:tasks.workunit.client.0.smithi170.stdout:1/813: symlink d9/d11/d85/dd8/l113 0 2024-09-04T16:30:32.691 INFO:tasks.workunit.client.0.smithi170.stdout:1/814: creat d9/d26/d77/f114 x:0 0 0 2024-09-04T16:30:32.693 INFO:tasks.workunit.client.0.smithi170.stdout:3/651: getdents d13/d14/d21/d4d/d4e/d88 0 2024-09-04T16:30:32.696 INFO:tasks.workunit.client.0.smithi170.stdout:1/815: rename d9/d11/d2f/f5c to d9/d7b/d8f/f115 0 2024-09-04T16:30:32.698 INFO:tasks.workunit.client.0.smithi170.stdout:1/816: symlink d9/d11/d85/dc5/dca/l116 0 2024-09-04T16:30:32.699 INFO:tasks.workunit.client.0.smithi170.stdout:1/817: write d9/d11/d85/df6/f10a [247125,60988] 0 2024-09-04T16:30:32.701 INFO:tasks.workunit.client.0.smithi170.stdout:1/818: dread - d9/d34/dbe/f10e zero size 2024-09-04T16:30:32.703 INFO:tasks.workunit.client.0.smithi170.stdout:1/819: fsync d9/d11/f3f 0 2024-09-04T16:30:32.704 INFO:tasks.workunit.client.0.smithi170.stdout:3/652: dread d13/d14/d1d/da4/fac [0,4194304] 0 2024-09-04T16:30:32.711 INFO:tasks.workunit.client.0.smithi170.stdout:3/653: dwrite d13/d14/d21/d4d/d4e/d50/fb0 [0,4194304] 0 2024-09-04T16:30:32.714 INFO:tasks.workunit.client.0.smithi170.stdout:3/654: symlink d13/d14/d1d/d2d/d58/ld5 0 2024-09-04T16:30:32.716 INFO:tasks.workunit.client.0.smithi170.stdout:3/655: dread - d13/d14/d17/f7b zero size 2024-09-04T16:30:32.719 INFO:tasks.workunit.client.0.smithi170.stdout:3/656: creat d13/d14/d1f/d7a/dc8/fd6 x:0 0 0 2024-09-04T16:30:32.720 INFO:tasks.workunit.client.0.smithi170.stdout:1/820: write d9/d11/f14 [2535159,110134] 0 2024-09-04T16:30:32.728 INFO:tasks.workunit.client.0.smithi170.stdout:3/657: rename d13/d14/d1d/da4/da8/fc1 to d13/d14/d21/fd7 0 2024-09-04T16:30:32.732 INFO:tasks.workunit.client.0.smithi170.stdout:3/658: rename d13/d14/f75 to d13/d14/d1d/d71/db3/dbd/fd8 0 2024-09-04T16:30:32.734 INFO:tasks.workunit.client.0.smithi170.stdout:1/821: write d9/d11/dae/d6a/fd9 [3634638,121130] 0 2024-09-04T16:30:32.736 INFO:tasks.workunit.client.0.smithi170.stdout:3/659: symlink d13/d14/d17/d1c/ld9 0 2024-09-04T16:30:32.738 INFO:tasks.workunit.client.0.smithi170.stdout:1/822: symlink d9/d11/d85/dc5/l117 0 2024-09-04T16:30:32.739 INFO:tasks.workunit.client.0.smithi170.stdout:3/660: mkdir d13/d14/d17/d1c/dda 0 2024-09-04T16:30:32.741 INFO:tasks.workunit.client.0.smithi170.stdout:1/823: mkdir d9/d11/d85/d118 0 2024-09-04T16:30:32.743 INFO:tasks.workunit.client.0.smithi170.stdout:3/661: rename d13/d14/d17/l30 to d13/d14/d21/d4d/d4e/d88/dc7/ldb 0 2024-09-04T16:30:32.744 INFO:tasks.workunit.client.0.smithi170.stdout:1/824: mkdir d9/d119 0 2024-09-04T16:30:32.746 INFO:tasks.workunit.client.0.smithi170.stdout:1/825: mkdir d9/d26/d77/d83/d11a 0 2024-09-04T16:30:32.749 INFO:tasks.workunit.client.0.smithi170.stdout:1/826: rename d9/d11/d2f/d6b/d7d to d9/d102/d11b 0 2024-09-04T16:30:32.752 INFO:tasks.workunit.client.0.smithi170.stdout:1/827: mknod d9/d11/d2f/d7f/da8/c11c 0 2024-09-04T16:30:32.755 INFO:tasks.workunit.client.0.smithi170.stdout:1/828: chown d9/d26/f78 3 1 2024-09-04T16:30:32.756 INFO:tasks.workunit.client.0.smithi170.stdout:3/662: unlink d13/d14/d21/d4d/d4e/d88/dc7/ldb 0 2024-09-04T16:30:32.756 INFO:tasks.workunit.client.0.smithi170.stdout:1/829: chown d9/d11/dae/d6a/d79/f95 0 1 2024-09-04T16:30:32.756 INFO:tasks.workunit.client.0.smithi170.stdout:1/830: readlink d9/d26/d77/l9c 0 2024-09-04T16:30:32.762 INFO:tasks.workunit.client.0.smithi170.stdout:1/831: rmdir d9/d26/d77/d83/d11a 0 2024-09-04T16:30:32.763 INFO:tasks.workunit.client.0.smithi170.stdout:3/663: write d13/d14/d1d/d71/db3/db6/f92 [992046,79650] 0 2024-09-04T16:30:32.767 INFO:tasks.workunit.client.0.smithi170.stdout:3/664: dread d13/d14/d1f/f60 [0,4194304] 0 2024-09-04T16:30:32.768 INFO:tasks.workunit.client.0.smithi170.stdout:3/665: write d13/d14/d17/fd1 [846824,13776] 0 2024-09-04T16:30:32.768 INFO:tasks.workunit.client.0.smithi170.stdout:1/832: truncate d9/d11/f14 2509316 0 2024-09-04T16:30:32.769 INFO:tasks.workunit.client.0.smithi170.stdout:3/666: stat d13/d14/d1f/d87/fa1 0 2024-09-04T16:30:32.770 INFO:tasks.workunit.client.0.smithi170.stdout:3/667: readlink d13/d14/d17/d1c/ld9 0 2024-09-04T16:30:32.770 INFO:tasks.workunit.client.0.smithi170.stdout:1/833: symlink d9/d11/d9b/l11d 0 2024-09-04T16:30:32.772 INFO:tasks.workunit.client.0.smithi170.stdout:3/668: dread d13/d14/f48 [0,4194304] 0 2024-09-04T16:30:32.772 INFO:tasks.workunit.client.0.smithi170.stdout:1/834: creat d9/d11/f11e x:0 0 0 2024-09-04T16:30:32.775 INFO:tasks.workunit.client.0.smithi170.stdout:3/669: creat d13/d14/d1d/d71/db3/dbd/fdc x:0 0 0 2024-09-04T16:30:32.776 INFO:tasks.workunit.client.0.smithi170.stdout:1/835: mkdir d9/d105/d11f 0 2024-09-04T16:30:32.778 INFO:tasks.workunit.client.0.smithi170.stdout:1/836: symlink d9/d26/d77/l120 0 2024-09-04T16:30:32.781 INFO:tasks.workunit.client.0.smithi170.stdout:1/837: fdatasync d9/d11/d2f/f3b 0 2024-09-04T16:30:32.782 INFO:tasks.workunit.client.0.smithi170.stdout:3/670: dwrite d13/d14/d21/d4c/f5d [0,4194304] 0 2024-09-04T16:30:32.783 INFO:tasks.workunit.client.0.smithi170.stdout:3/671: write fb [2256285,47586] 0 2024-09-04T16:30:32.786 INFO:tasks.workunit.client.0.smithi170.stdout:8/676: sync 2024-09-04T16:30:32.786 INFO:tasks.workunit.client.0.smithi170.stdout:2/727: sync 2024-09-04T16:30:32.786 INFO:tasks.workunit.client.0.smithi170.stdout:0/825: sync 2024-09-04T16:30:32.786 INFO:tasks.workunit.client.0.smithi170.stdout:7/877: sync 2024-09-04T16:30:32.787 INFO:tasks.workunit.client.0.smithi170.stdout:4/652: sync 2024-09-04T16:30:32.787 INFO:tasks.workunit.client.0.smithi170.stdout:5/730: sync 2024-09-04T16:30:32.787 INFO:tasks.workunit.client.0.smithi170.stdout:6/614: sync 2024-09-04T16:30:32.789 INFO:tasks.workunit.client.0.smithi170.stdout:1/838: mknod d9/d11/d2f/d6b/d61/d108/c121 0 2024-09-04T16:30:32.790 INFO:tasks.workunit.client.0.smithi170.stdout:3/672: dread d13/d14/d21/d4d/d4e/d50/fa7 [0,4194304] 0 2024-09-04T16:30:32.798 INFO:tasks.workunit.client.0.smithi170.stdout:0/826: creat d11/d13/d4a/d66/d6d/d105/d10f/f12f x:0 0 0 2024-09-04T16:30:32.800 INFO:tasks.workunit.client.0.smithi170.stdout:2/728: dread d3/f50 [0,4194304] 0 2024-09-04T16:30:32.800 INFO:tasks.workunit.client.0.smithi170.stdout:0/827: write d11/d13/d71/d43/f114 [139411,112977] 0 2024-09-04T16:30:32.802 INFO:tasks.workunit.client.0.smithi170.stdout:1/839: mkdir d9/d102/d11b/dde/d122 0 2024-09-04T16:30:32.809 INFO:tasks.workunit.client.0.smithi170.stdout:6/615: write d0/df/d1b/d3e/d47/d68/f61 [2592820,2580] 0 2024-09-04T16:30:32.810 INFO:tasks.workunit.client.0.smithi170.stdout:6/616: stat d0/df/d7e/c94 0 2024-09-04T16:30:32.812 INFO:tasks.workunit.client.0.smithi170.stdout:5/731: mkdir d4/d8/d1c/d26/d27/d48/d7c/dd6/de0/def 0 2024-09-04T16:30:32.813 INFO:tasks.workunit.client.0.smithi170.stdout:3/673: write d13/d14/d1d/d71/db3/db6/f53 [3765716,47910] 0 2024-09-04T16:30:32.815 INFO:tasks.workunit.client.0.smithi170.stdout:8/677: write d6/d28/d20/d5e/f68 [376740,114246] 0 2024-09-04T16:30:32.816 INFO:tasks.workunit.client.0.smithi170.stdout:6/617: truncate d0/df/d1b/d3e/d47/d68/d2d/d67/fc8 360400 0 2024-09-04T16:30:32.818 INFO:tasks.workunit.client.0.smithi170.stdout:4/653: write d1/d6/d8/f56 [1796958,37449] 0 2024-09-04T16:30:32.818 INFO:tasks.workunit.client.0.smithi170.stdout:3/674: write d13/d14/d21/d4c/f99 [2324880,100141] 0 2024-09-04T16:30:32.819 INFO:tasks.workunit.client.0.smithi170.stdout:0/828: chown d11/d13/d4a/d66/d8c/da8/f110 11029751 1 2024-09-04T16:30:32.820 INFO:tasks.workunit.client.0.smithi170.stdout:6/618: fdatasync d0/d17/dbd/fc6 0 2024-09-04T16:30:32.822 INFO:tasks.workunit.client.0.smithi170.stdout:7/878: dwrite d12/f88 [0,4194304] 0 2024-09-04T16:30:32.823 INFO:tasks.workunit.client.0.smithi170.stdout:1/840: link d9/d7b/d8f/fc1 d9/d11/dae/d6a/d79/f123 0 2024-09-04T16:30:32.831 INFO:tasks.workunit.client.0.smithi170.stdout:2/729: dwrite d3/db/d1c/f23 [0,4194304] 0 2024-09-04T16:30:32.836 INFO:tasks.workunit.client.0.smithi170.stdout:1/841: mkdir d9/d11/d2f/d6b/d61/d124 0 2024-09-04T16:30:32.837 INFO:tasks.workunit.client.0.smithi170.stdout:4/654: read d1/d6/d8/d20/d35/d3e/d4e/d51/f76 [2226722,22080] 0 2024-09-04T16:30:32.838 INFO:tasks.workunit.client.0.smithi170.stdout:1/842: read d9/d11/d2f/d7f/fb7 [182551,24268] 0 2024-09-04T16:30:32.841 INFO:tasks.workunit.client.0.smithi170.stdout:0/829: dread d11/d75/f7d [0,4194304] 0 2024-09-04T16:30:32.849 INFO:tasks.workunit.client.0.smithi170.stdout:8/678: getdents d6/d28 0 2024-09-04T16:30:32.849 INFO:tasks.workunit.client.0.smithi170.stdout:8/679: readlink d6/d28/l19 0 2024-09-04T16:30:32.850 INFO:tasks.workunit.client.0.smithi170.stdout:7/879: write d12/d5a/ffa [1210080,5412] 0 2024-09-04T16:30:32.851 INFO:tasks.workunit.client.0.smithi170.stdout:5/732: link d4/d3a/d74/d8b/db5/ceb d4/d8/d1c/d26/d27/d88/da4/cf0 0 2024-09-04T16:30:32.852 INFO:tasks.workunit.client.0.smithi170.stdout:1/843: truncate d9/d34/f63 353823 0 2024-09-04T16:30:32.853 INFO:tasks.workunit.client.0.smithi170.stdout:0/830: truncate d11/fa1 299404 0 2024-09-04T16:30:32.854 INFO:tasks.workunit.client.0.smithi170.stdout:6/619: rmdir d0/d15/d56/d6d/dcb 0 2024-09-04T16:30:32.855 INFO:tasks.workunit.client.0.smithi170.stdout:4/655: mknod d1/d6/d2b/db3/dd4/ce2 0 2024-09-04T16:30:32.856 INFO:tasks.workunit.client.0.smithi170.stdout:8/680: symlink d6/d28/d20/d6e/d76/le4 0 2024-09-04T16:30:32.858 INFO:tasks.workunit.client.0.smithi170.stdout:7/880: symlink d12/d16/d1d/d65/dff/l12c 0 2024-09-04T16:30:32.860 INFO:tasks.workunit.client.0.smithi170.stdout:2/730: write d3/db/df/d45/fac [965457,70348] 0 2024-09-04T16:30:32.867 INFO:tasks.workunit.client.0.smithi170.stdout:8/681: symlink d6/d28/d20/le5 0 2024-09-04T16:30:32.868 INFO:tasks.workunit.client.0.smithi170.stdout:3/675: dwrite d13/d14/d1d/d2d/d58/f47 [0,4194304] 0 2024-09-04T16:30:32.869 INFO:tasks.workunit.client.0.smithi170.stdout:9/718: sync 2024-09-04T16:30:32.875 INFO:tasks.workunit.client.0.smithi170.stdout:6/620: mkdir d0/d17/d31/dcc 0 2024-09-04T16:30:32.876 INFO:tasks.workunit.client.0.smithi170.stdout:1/844: dread d9/d11/d2f/d6b/f70 [0,4194304] 0 2024-09-04T16:30:32.876 INFO:tasks.workunit.client.0.smithi170.stdout:5/733: write d4/d8/d1c/d26/d27/d48/d7c/f8d [612577,45009] 0 2024-09-04T16:30:32.877 INFO:tasks.workunit.client.0.smithi170.stdout:4/656: symlink d1/d6/d8/d20/d35/d3e/d4e/le3 0 2024-09-04T16:30:32.882 INFO:tasks.workunit.client.0.smithi170.stdout:7/881: link d12/d16/fb8 d12/d15/d71/d42/d79/d9d/de6/f12d 0 2024-09-04T16:30:32.882 INFO:tasks.workunit.client.0.smithi170.stdout:2/731: dread d3/d4/f52 [0,4194304] 0 2024-09-04T16:30:32.883 INFO:tasks.workunit.client.0.smithi170.stdout:0/831: dwrite d11/d75/d77/f87 [0,4194304] 0 2024-09-04T16:30:32.884 INFO:tasks.workunit.client.0.smithi170.stdout:8/682: fdatasync d6/d28/d1a/f42 0 2024-09-04T16:30:32.885 INFO:tasks.workunit.client.0.smithi170.stdout:3/676: creat d13/d14/d1f/d7a/dc8/fdd x:0 0 0 2024-09-04T16:30:32.886 INFO:tasks.workunit.client.0.smithi170.stdout:9/719: creat d2/d3d/d27/fd9 x:0 0 0 2024-09-04T16:30:32.887 INFO:tasks.workunit.client.0.smithi170.stdout:3/677: chown d13/d14/d1f/f60 30 1 2024-09-04T16:30:32.892 INFO:tasks.workunit.client.0.smithi170.stdout:1/845: unlink d9/d11/d2f/db9/f112 0 2024-09-04T16:30:32.895 INFO:tasks.workunit.client.0.smithi170.stdout:1/846: write d9/d26/d77/d83/f90 [1807534,130511] 0 2024-09-04T16:30:32.895 INFO:tasks.workunit.client.0.smithi170.stdout:1/847: chown d9/d11/d85/dc5/dca/l116 2 1 2024-09-04T16:30:32.898 INFO:tasks.workunit.client.0.smithi170.stdout:5/734: mkdir d4/db/d51/d5e/d71/d84/d93/df1 0 2024-09-04T16:30:32.899 INFO:tasks.workunit.client.0.smithi170.stdout:4/657: write d1/d6/d8/d20/d35/d54/fc7 [970958,51843] 0 2024-09-04T16:30:32.907 INFO:tasks.workunit.client.0.smithi170.stdout:5/735: dwrite d4/f3b [0,4194304] 0 2024-09-04T16:30:32.909 INFO:tasks.workunit.client.0.smithi170.stdout:3/678: dread d13/d14/d21/d4d/d4e/d88/dbf/f8f [0,4194304] 0 2024-09-04T16:30:32.913 INFO:tasks.workunit.client.0.smithi170.stdout:6/621: creat d0/d15/d56/d6c/da0/fcd x:0 0 0 2024-09-04T16:30:32.914 INFO:tasks.workunit.client.0.smithi170.stdout:4/658: dwrite d1/d6/d8/d20/d35/d3e/d4e/d51/f5c [0,4194304] 0 2024-09-04T16:30:32.920 INFO:tasks.workunit.client.0.smithi170.stdout:9/720: mknod d2/d11/d58/cda 0 2024-09-04T16:30:32.921 INFO:tasks.workunit.client.0.smithi170.stdout:7/882: write d12/d15/d71/f56 [2617428,37353] 0 2024-09-04T16:30:32.922 INFO:tasks.workunit.client.0.smithi170.stdout:5/736: dwrite d4/d8/d1c/d26/d27/f68 [0,4194304] 0 2024-09-04T16:30:32.924 INFO:tasks.workunit.client.0.smithi170.stdout:3/679: dwrite d13/f84 [0,4194304] 0 2024-09-04T16:30:32.926 INFO:tasks.workunit.client.0.smithi170.stdout:2/732: symlink d3/d3c/de0/lf3 0 2024-09-04T16:30:32.927 INFO:tasks.workunit.client.0.smithi170.stdout:6/622: read d0/df/fa [1525361,34204] 0 2024-09-04T16:30:32.928 INFO:tasks.workunit.client.0.smithi170.stdout:5/737: chown d4/db/d51/d5e/d71/d84/d93/df1 10 1 2024-09-04T16:30:32.928 INFO:tasks.workunit.client.0.smithi170.stdout:8/683: symlink d6/d28/d16/d77/d9f/le6 0 2024-09-04T16:30:32.932 INFO:tasks.workunit.client.0.smithi170.stdout:6/623: stat d0/d15/d56/c7b 0 2024-09-04T16:30:32.933 INFO:tasks.workunit.client.0.smithi170.stdout:9/721: symlink d2/d3d/d27/d65/d56/ldb 0 2024-09-04T16:30:32.934 INFO:tasks.workunit.client.0.smithi170.stdout:7/883: chown c8 62188 1 2024-09-04T16:30:32.938 INFO:tasks.workunit.client.0.smithi170.stdout:8/684: dread d6/d28/d1a/f9e [0,4194304] 0 2024-09-04T16:30:32.947 INFO:tasks.workunit.client.0.smithi170.stdout:2/733: mknod d3/db/d1c/d77/cf4 0 2024-09-04T16:30:32.949 INFO:tasks.workunit.client.0.smithi170.stdout:7/884: fsync d12/d15/d71/d42/d81/d5c/f94 0 2024-09-04T16:30:32.951 INFO:tasks.workunit.client.0.smithi170.stdout:1/848: dwrite d9/d11/d85/fd0 [0,4194304] 0 2024-09-04T16:30:32.952 INFO:tasks.workunit.client.0.smithi170.stdout:5/738: mknod d4/d8/d1c/d26/d27/d48/cf2 0 2024-09-04T16:30:32.953 INFO:tasks.workunit.client.0.smithi170.stdout:1/849: readlink d9/d26/l73 0 2024-09-04T16:30:32.953 INFO:tasks.workunit.client.0.smithi170.stdout:8/685: write d6/d28/d1a/f36 [2116626,40558] 0 2024-09-04T16:30:32.955 INFO:tasks.workunit.client.0.smithi170.stdout:1/850: write d9/d11/d2f/d6b/d61/f6f [643901,82551] 0 2024-09-04T16:30:32.958 INFO:tasks.workunit.client.0.smithi170.stdout:0/832: truncate d11/d13/d2f/d3f/f65 1254279 0 2024-09-04T16:30:32.959 INFO:tasks.workunit.client.0.smithi170.stdout:1/851: read d9/d11/dae/df5/f100 [88413,34938] 0 2024-09-04T16:30:32.960 INFO:tasks.workunit.client.0.smithi170.stdout:1/852: chown d9/f55 303194 1 2024-09-04T16:30:32.971 INFO:tasks.workunit.client.0.smithi170.stdout:3/680: write d13/d14/d21/d4d/f6f [11554732,100513] 0 2024-09-04T16:30:32.972 INFO:tasks.workunit.client.0.smithi170.stdout:4/659: dwrite d1/d6/d8/d20/d95/fc5 [0,4194304] 0 2024-09-04T16:30:33.021 INFO:tasks.workunit.client.0.smithi170.stdout:6/624: creat d0/d9f/fce x:0 0 0 2024-09-04T16:30:33.022 INFO:tasks.workunit.client.0.smithi170.stdout:2/734: symlink d3/d3c/dc1/lf5 0 2024-09-04T16:30:33.025 INFO:tasks.workunit.client.0.smithi170.stdout:7/885: symlink d12/d16/d8d/l12e 0 2024-09-04T16:30:33.028 INFO:tasks.workunit.client.0.smithi170.stdout:5/739: symlink d4/d8/d1c/d26/d27/d48/d7c/dd6/lf3 0 2024-09-04T16:30:33.037 INFO:tasks.workunit.client.0.smithi170.stdout:4/660: rename d1/d6/d8/d20/l42 to d1/d6/d8/d6c/le4 0 2024-09-04T16:30:33.038 INFO:tasks.workunit.client.0.smithi170.stdout:9/722: creat d2/d3d/d27/d65/fdc x:0 0 0 2024-09-04T16:30:33.040 INFO:tasks.workunit.client.0.smithi170.stdout:9/723: chown d2/d32/f93 1964 1 2024-09-04T16:30:33.044 INFO:tasks.workunit.client.0.smithi170.stdout:6/625: dread d0/f11 [0,4194304] 0 2024-09-04T16:30:33.045 INFO:tasks.workunit.client.0.smithi170.stdout:2/735: unlink d3/db/d1c/d47/d83/d9f/fb5 0 2024-09-04T16:30:33.046 INFO:tasks.workunit.client.0.smithi170.stdout:6/626: fdatasync d0/df/d1b/d3e/d47/d68/d2d/d67/fc8 0 2024-09-04T16:30:33.047 INFO:tasks.workunit.client.0.smithi170.stdout:2/736: fdatasync d3/db/d1c/d47/fea 0 2024-09-04T16:30:33.050 INFO:tasks.workunit.client.0.smithi170.stdout:7/886: truncate d12/d16/d1d/d65/f89 468016 0 2024-09-04T16:30:33.058 INFO:tasks.workunit.client.0.smithi170.stdout:3/681: mknod d13/d14/cde 0 2024-09-04T16:30:33.058 INFO:tasks.workunit.client.0.smithi170.stdout:4/661: mkdir d1/d6/d22/d93/de5 0 2024-09-04T16:30:33.060 INFO:tasks.workunit.client.0.smithi170.stdout:5/740: dread d4/d8/d1c/d26/d27/f38 [0,4194304] 0 2024-09-04T16:30:33.062 INFO:tasks.workunit.client.0.smithi170.stdout:3/682: fsync d13/d14/d21/d4d/d4e/d50/fb0 0 2024-09-04T16:30:33.063 INFO:tasks.workunit.client.0.smithi170.stdout:3/683: chown d13/d14/d1d/d2d/d58/fa0 55587 1 2024-09-04T16:30:33.066 INFO:tasks.workunit.client.0.smithi170.stdout:6/627: unlink d0/df/d1b/d3e/d47/d68/d2d/cba 0 2024-09-04T16:30:33.067 INFO:tasks.workunit.client.0.smithi170.stdout:6/628: chown d0/d15/d56 784014425 1 2024-09-04T16:30:33.069 INFO:tasks.workunit.client.0.smithi170.stdout:8/686: link d6/d28/d16/d24/d46/lcc d6/d28/d16/d77/d93/dc0/le7 0 2024-09-04T16:30:33.071 INFO:tasks.workunit.client.0.smithi170.stdout:1/853: creat d9/d34/f125 x:0 0 0 2024-09-04T16:30:33.072 INFO:tasks.workunit.client.0.smithi170.stdout:1/854: chown d9/d105/d11f 339730 1 2024-09-04T16:30:33.075 INFO:tasks.workunit.client.0.smithi170.stdout:5/741: truncate d4/db/f1d 2197693 0 2024-09-04T16:30:33.078 INFO:tasks.workunit.client.0.smithi170.stdout:1/855: dread d9/d11/d85/dd8/f109 [0,4194304] 0 2024-09-04T16:30:33.085 INFO:tasks.workunit.client.0.smithi170.stdout:6/629: dwrite d0/d15/d56/d6c/d98/fb9 [0,4194304] 0 2024-09-04T16:30:33.086 INFO:tasks.workunit.client.0.smithi170.stdout:6/630: stat d0/df/d1b/c97 0 2024-09-04T16:30:33.090 INFO:tasks.workunit.client.0.smithi170.stdout:5/742: dread d4/db/fe [0,4194304] 0 2024-09-04T16:30:33.090 INFO:tasks.workunit.client.0.smithi170.stdout:6/631: fdatasync d0/d17/d31/d64/d30/f7c 0 2024-09-04T16:30:33.091 INFO:tasks.workunit.client.0.smithi170.stdout:5/743: dread - d4/d8/d1c/d41/faa zero size 2024-09-04T16:30:33.093 INFO:tasks.workunit.client.0.smithi170.stdout:6/632: mkdir d0/df/d1f/dcf 0 2024-09-04T16:30:33.093 INFO:tasks.workunit.client.0.smithi170.stdout:5/744: read d4/d8/d1c/d26/d27/d48/d7c/f8d [481820,111795] 0 2024-09-04T16:30:33.097 INFO:tasks.workunit.client.0.smithi170.stdout:5/745: symlink d4/d8/d1c/d23/d94/dcb/lf4 0 2024-09-04T16:30:33.099 INFO:tasks.workunit.client.0.smithi170.stdout:5/746: read d4/d8/d1c/d26/d27/d48/d5a/f91 [119168,12558] 0 2024-09-04T16:30:33.099 INFO:tasks.workunit.client.0.smithi170.stdout:6/633: link d0/d17/f18 d0/d17/d31/dcc/fd0 0 2024-09-04T16:30:33.102 INFO:tasks.workunit.client.0.smithi170.stdout:6/634: write d0/df/f28 [514001,51093] 0 2024-09-04T16:30:33.103 INFO:tasks.workunit.client.0.smithi170.stdout:6/635: fdatasync d0/d17/d39/f72 0 2024-09-04T16:30:33.105 INFO:tasks.workunit.client.0.smithi170.stdout:5/747: symlink d4/d3a/d74/d8b/lf5 0 2024-09-04T16:30:33.105 INFO:tasks.workunit.client.0.smithi170.stdout:5/748: chown d4/d8/d1c/d26/d27/d43/d5b/f76 5 1 2024-09-04T16:30:33.108 INFO:tasks.workunit.client.0.smithi170.stdout:6/636: mknod d0/d17/d39/cd1 0 2024-09-04T16:30:33.109 INFO:tasks.workunit.client.0.smithi170.stdout:5/749: truncate d4/d8/d1c/d29/f67 4178226 0 2024-09-04T16:30:33.110 INFO:tasks.workunit.client.0.smithi170.stdout:5/750: dread d4/d8/d1c/d26/fc2 [0,4194304] 0 2024-09-04T16:30:33.112 INFO:tasks.workunit.client.0.smithi170.stdout:6/637: fsync d0/df/d1b/d3e/d47/d68/d2d/d2e/f66 0 2024-09-04T16:30:33.116 INFO:tasks.workunit.client.0.smithi170.stdout:6/638: rename d0/df/d1b/d3e/d47/d68/d2d/d2e/l3c to d0/d15/d56/d6c/ld2 0 2024-09-04T16:30:33.117 INFO:tasks.workunit.client.0.smithi170.stdout:5/751: creat d4/d3a/d74/d8b/ff6 x:0 0 0 2024-09-04T16:30:33.118 INFO:tasks.workunit.client.0.smithi170.stdout:6/639: creat d0/d17/d39/fd3 x:0 0 0 2024-09-04T16:30:33.120 INFO:tasks.workunit.client.0.smithi170.stdout:5/752: symlink d4/db/d51/d5e/d71/lf7 0 2024-09-04T16:30:33.121 INFO:tasks.workunit.client.0.smithi170.stdout:5/753: chown d4/db/ce2 6964344 1 2024-09-04T16:30:33.122 INFO:tasks.workunit.client.0.smithi170.stdout:6/640: creat d0/df/d1b/fd4 x:0 0 0 2024-09-04T16:30:33.122 INFO:tasks.workunit.client.0.smithi170.stdout:5/754: write d4/db/d37/f36 [788518,61976] 0 2024-09-04T16:30:33.124 INFO:tasks.workunit.client.0.smithi170.stdout:5/755: chown d4/d8/d1c/d26/d27/d43/d5b/l64 161 1 2024-09-04T16:30:33.126 INFO:tasks.workunit.client.0.smithi170.stdout:5/756: write d4/d8/d1c/d23/d94/dcb/fcd [4860304,88632] 0 2024-09-04T16:30:33.128 INFO:tasks.workunit.client.0.smithi170.stdout:5/757: dread - d4/d8/d1c/d41/faa zero size 2024-09-04T16:30:33.129 INFO:tasks.workunit.client.0.smithi170.stdout:6/641: dwrite d0/d17/fb4 [0,4194304] 0 2024-09-04T16:30:33.130 INFO:tasks.workunit.client.0.smithi170.stdout:6/642: chown d0/df/f28 39712 1 2024-09-04T16:30:33.131 INFO:tasks.workunit.client.0.smithi170.stdout:6/643: chown d0/df/d1b/d3e/d47/l9d 76940694 1 2024-09-04T16:30:33.132 INFO:tasks.workunit.client.0.smithi170.stdout:5/758: mkdir d4/d8/d1c/d26/df8 0 2024-09-04T16:30:33.133 INFO:tasks.workunit.client.0.smithi170.stdout:6/644: mknod d0/df/d1b/d3e/d47/cd5 0 2024-09-04T16:30:33.133 INFO:tasks.workunit.client.0.smithi170.stdout:6/645: stat d0/d15/d56/f8b 0 2024-09-04T16:30:33.134 INFO:tasks.workunit.client.0.smithi170.stdout:6/646: chown d0/d17/d31/d64/l77 8993379 1 2024-09-04T16:30:33.140 INFO:tasks.workunit.client.0.smithi170.stdout:0/833: dwrite d11/d13/ffa [0,4194304] 0 2024-09-04T16:30:33.147 INFO:tasks.workunit.client.0.smithi170.stdout:2/737: truncate d3/d3c/d40/d48/f54 4636645 0 2024-09-04T16:30:33.148 INFO:tasks.workunit.client.0.smithi170.stdout:8/687: write d6/d26/f9a [41553,118721] 0 2024-09-04T16:30:33.149 INFO:tasks.workunit.client.0.smithi170.stdout:1/856: write d9/d34/d5f/f71 [2024251,122460] 0 2024-09-04T16:30:33.153 INFO:tasks.workunit.client.0.smithi170.stdout:1/857: stat d9/d11/d2e/c4a 0 2024-09-04T16:30:33.154 INFO:tasks.workunit.client.0.smithi170.stdout:2/738: mknod d3/d3c/de0/cf6 0 2024-09-04T16:30:33.155 INFO:tasks.workunit.client.0.smithi170.stdout:4/662: dwrite d1/d6/d8/d20/d35/d3e/d60/f61 [0,4194304] 0 2024-09-04T16:30:33.158 INFO:tasks.workunit.client.0.smithi170.stdout:3/684: dwrite d13/d14/d17/f9f [0,4194304] 0 2024-09-04T16:30:33.166 INFO:tasks.workunit.client.0.smithi170.stdout:2/739: fdatasync d3/db/d62/d6f/f96 0 2024-09-04T16:30:33.168 INFO:tasks.workunit.client.0.smithi170.stdout:4/663: creat d1/d6/d8/d6c/fe6 x:0 0 0 2024-09-04T16:30:33.169 INFO:tasks.workunit.client.0.smithi170.stdout:8/688: dwrite d6/d28/d16/d52/d73/d5d/d8b/fd0 [0,4194304] 0 2024-09-04T16:30:33.279 INFO:tasks.workunit.client.0.smithi170.stdout:3/685: read d13/d14/d1f/f73 [1690602,108915] 0 2024-09-04T16:30:33.279 INFO:tasks.workunit.client.0.smithi170.stdout:2/740: rmdir d3/db/d1c/d47/d83/d9f/dae/d97 39 2024-09-04T16:30:33.280 INFO:tasks.workunit.client.0.smithi170.stdout:4/664: creat d1/d6/d8/d20/dc1/dd2/fe7 x:0 0 0 2024-09-04T16:30:33.280 INFO:tasks.workunit.client.0.smithi170.stdout:5/759: truncate d4/f6 7435830 0 2024-09-04T16:30:33.281 INFO:tasks.workunit.client.0.smithi170.stdout:6/647: write d0/d15/d56/d6d/f74 [552000,109170] 0 2024-09-04T16:30:33.282 INFO:tasks.workunit.client.0.smithi170.stdout:3/686: stat d13/d14/d1d/d71/db3/dbd/fd8 0 2024-09-04T16:30:33.283 INFO:tasks.workunit.client.0.smithi170.stdout:4/665: dread - d1/d6/d2b/d47/fce zero size 2024-09-04T16:30:33.285 INFO:tasks.workunit.client.0.smithi170.stdout:5/760: dread - d4/d8/d1c/d41/fec zero size 2024-09-04T16:30:33.287 INFO:tasks.workunit.client.0.smithi170.stdout:2/741: unlink d3/d4/d86/dc9/fd1 0 2024-09-04T16:30:33.287 INFO:tasks.workunit.client.0.smithi170.stdout:8/689: stat d6/d28/d16/d24/d46/c8d 0 2024-09-04T16:30:33.289 INFO:tasks.workunit.client.0.smithi170.stdout:0/834: dwrite d11/d13/d36/fea [0,4194304] 0 2024-09-04T16:30:33.291 INFO:tasks.workunit.client.0.smithi170.stdout:1/858: dwrite d9/d34/d5f/fc7 [0,4194304] 0 2024-09-04T16:30:33.363 INFO:tasks.workunit.client.0.smithi170.stdout:3/687: symlink d13/d14/d21/d4d/d4e/d50/ldf 0 2024-09-04T16:30:33.367 INFO:tasks.workunit.client.0.smithi170.stdout:4/666: mkdir d1/d6/d2b/db3/de8 0 2024-09-04T16:30:33.371 INFO:tasks.workunit.client.0.smithi170.stdout:6/648: write d0/d17/f1c [3506731,53352] 0 2024-09-04T16:30:33.375 INFO:tasks.workunit.client.0.smithi170.stdout:2/742: symlink d3/d3c/de7/lf7 0 2024-09-04T16:30:33.378 INFO:tasks.workunit.client.0.smithi170.stdout:8/690: rename d6/d28/d1a/d81 to d6/d28/d5f/d70/de8 0 2024-09-04T16:30:33.379 INFO:tasks.workunit.client.0.smithi170.stdout:1/859: fdatasync d9/f54 0 2024-09-04T16:30:33.383 INFO:tasks.workunit.client.0.smithi170.stdout:3/688: chown d13/d14/d21/d4c/c86 999377 1 2024-09-04T16:30:33.383 INFO:tasks.workunit.client.0.smithi170.stdout:3/689: chown d13/d14/d21/d4d/d4e/d88 12160 1 2024-09-04T16:30:33.385 INFO:tasks.workunit.client.0.smithi170.stdout:5/761: symlink d4/d8/d1c/d26/d27/d43/d5b/lf9 0 2024-09-04T16:30:33.387 INFO:tasks.workunit.client.0.smithi170.stdout:4/667: write d1/d6/d2b/d47/d78/f90 [161603,32461] 0 2024-09-04T16:30:33.391 INFO:tasks.workunit.client.0.smithi170.stdout:0/835: rename d11/d13/d36/c54 to d11/d13/d4a/d66/d8c/d12a/c130 0 2024-09-04T16:30:33.393 INFO:tasks.workunit.client.0.smithi170.stdout:0/836: write d11/d13/d71/fde [132857,24480] 0 2024-09-04T16:30:33.394 INFO:tasks.workunit.client.0.smithi170.stdout:6/649: dwrite d0/d17/d31/d64/f8f [0,4194304] 0 2024-09-04T16:30:33.394 INFO:tasks.workunit.client.0.smithi170.stdout:8/691: creat d6/d28/d16/fe9 x:0 0 0 2024-09-04T16:30:33.397 INFO:tasks.workunit.client.0.smithi170.stdout:1/860: mknod d9/d11/d85/df6/c126 0 2024-09-04T16:30:33.397 INFO:tasks.workunit.client.0.smithi170.stdout:1/861: stat d9/d34/l38 0 2024-09-04T16:30:33.398 INFO:tasks.workunit.client.0.smithi170.stdout:3/690: creat d13/d14/d21/d4d/d4e/d88/fe0 x:0 0 0 2024-09-04T16:30:33.398 INFO:tasks.workunit.client.0.smithi170.stdout:1/862: truncate d9/d11/dae/d6a/d79/f123 109045 0 2024-09-04T16:30:33.399 INFO:tasks.workunit.client.0.smithi170.stdout:5/762: mkdir d4/d8/d1c/d23/d39/dfa 0 2024-09-04T16:30:33.400 INFO:tasks.workunit.client.0.smithi170.stdout:5/763: chown d4/d8/d1c/d26/d27/d48/d7c/fcc 217089060 1 2024-09-04T16:30:33.404 INFO:tasks.workunit.client.0.smithi170.stdout:6/650: symlink d0/d15/d56/ld6 0 2024-09-04T16:30:33.407 INFO:tasks.workunit.client.0.smithi170.stdout:1/863: creat d9/d102/d11b/dde/f127 x:0 0 0 2024-09-04T16:30:33.409 INFO:tasks.workunit.client.0.smithi170.stdout:4/668: creat d1/d6/d22/d93/de5/fe9 x:0 0 0 2024-09-04T16:30:33.410 INFO:tasks.workunit.client.0.smithi170.stdout:2/743: creat d3/d4/d14/dcf/ff8 x:0 0 0 2024-09-04T16:30:33.411 INFO:tasks.workunit.client.0.smithi170.stdout:0/837: stat d11/d13/d2f/c6b 0 2024-09-04T16:30:33.416 INFO:tasks.workunit.client.0.smithi170.stdout:5/764: symlink d4/d8/d1c/d26/df8/lfb 0 2024-09-04T16:30:33.422 INFO:tasks.workunit.client.0.smithi170.stdout:6/651: creat d0/d17/d31/dcc/fd7 x:0 0 0 2024-09-04T16:30:33.423 INFO:tasks.workunit.client.0.smithi170.stdout:5/765: symlink d4/d3a/d74/lfc 0 2024-09-04T16:30:33.426 INFO:tasks.workunit.client.0.smithi170.stdout:2/744: fsync d3/db/d1c/d47/d83/d9f/dae/d97/fe1 0 2024-09-04T16:30:33.427 INFO:tasks.workunit.client.0.smithi170.stdout:8/692: getdents d6/d28/d5f/d70/de8 0 2024-09-04T16:30:33.428 INFO:tasks.workunit.client.0.smithi170.stdout:5/766: dread d4/d8/d1c/d23/d39/fd2 [0,4194304] 0 2024-09-04T16:30:33.429 INFO:tasks.workunit.client.0.smithi170.stdout:3/691: getdents d13/d14/d1f/d87 0 2024-09-04T16:30:33.431 INFO:tasks.workunit.client.0.smithi170.stdout:6/652: dread - d0/d15/d56/d6c/f85 zero size 2024-09-04T16:30:33.433 INFO:tasks.workunit.client.0.smithi170.stdout:1/864: dread d9/d26/f5a [0,4194304] 0 2024-09-04T16:30:33.436 INFO:tasks.workunit.client.0.smithi170.stdout:2/745: creat d3/db/ff9 x:0 0 0 2024-09-04T16:30:33.436 INFO:tasks.workunit.client.0.smithi170.stdout:0/838: dread d11/d13/d36/f7a [0,4194304] 0 2024-09-04T16:30:33.438 INFO:tasks.workunit.client.0.smithi170.stdout:8/693: rename d6/d28/d1a/fa7 to d6/d28/d1a/fea 0 2024-09-04T16:30:33.438 INFO:tasks.workunit.client.0.smithi170.stdout:4/669: write d1/d6/d8/d20/d95/d36/fcf [713692,12322] 0 2024-09-04T16:30:33.439 INFO:tasks.workunit.client.0.smithi170.stdout:5/767: creat d4/d3a/d74/d8b/db5/ffd x:0 0 0 2024-09-04T16:30:33.442 INFO:tasks.workunit.client.0.smithi170.stdout:5/768: write d4/db/fe [637667,44358] 0 2024-09-04T16:30:33.442 INFO:tasks.workunit.client.0.smithi170.stdout:4/670: chown d1/d6/d8/d20/d35/d3e/d60/l87 1514 1 2024-09-04T16:30:33.442 INFO:tasks.workunit.client.0.smithi170.stdout:3/692: dread d13/d14/d17/f42 [0,4194304] 0 2024-09-04T16:30:33.445 INFO:tasks.workunit.client.0.smithi170.stdout:4/671: truncate d1/d6/d8/d20/d95/d36/f3c 8455272 0 2024-09-04T16:30:33.448 INFO:tasks.workunit.client.0.smithi170.stdout:4/672: write d1/d6/d8/d20/d35/d54/fc7 [2559386,54262] 0 2024-09-04T16:30:33.449 INFO:tasks.workunit.client.0.smithi170.stdout:8/694: creat d6/d28/d16/d77/d9f/feb x:0 0 0 2024-09-04T16:30:33.450 INFO:tasks.workunit.client.0.smithi170.stdout:5/769: dwrite d4/d8/d1c/d23/d39/f81 [0,4194304] 0 2024-09-04T16:30:33.451 INFO:tasks.workunit.client.0.smithi170.stdout:4/673: readlink d1/d6/d8/d20/d35/d3e/d43/l5a 0 2024-09-04T16:30:33.459 INFO:tasks.workunit.client.0.smithi170.stdout:8/695: fdatasync d6/d28/d20/d5e/f47 0 2024-09-04T16:30:33.461 INFO:tasks.workunit.client.0.smithi170.stdout:5/770: creat d4/d8/d1c/d26/d27/d88/ffe x:0 0 0 2024-09-04T16:30:33.462 INFO:tasks.workunit.client.0.smithi170.stdout:6/653: link d0/df/d1b/d3e/f89 d0/df/d1f/d9c/fd8 0 2024-09-04T16:30:33.463 INFO:tasks.workunit.client.0.smithi170.stdout:6/654: write d0/df/f10 [7124860,5653] 0 2024-09-04T16:30:33.464 INFO:tasks.workunit.client.0.smithi170.stdout:3/693: getdents d13/d14/d1f/d87 0 2024-09-04T16:30:33.464 INFO:tasks.workunit.client.0.smithi170.stdout:6/655: chown d0/d17/d31/l32 10197 1 2024-09-04T16:30:33.467 INFO:tasks.workunit.client.0.smithi170.stdout:3/694: write fb [160912,110289] 0 2024-09-04T16:30:33.468 INFO:tasks.workunit.client.0.smithi170.stdout:4/674: symlink d1/d6/d8/d20/d35/d3e/d60/lea 0 2024-09-04T16:30:33.468 INFO:tasks.workunit.client.0.smithi170.stdout:1/865: write d9/d11/d2e/f89 [895656,19163] 0 2024-09-04T16:30:33.475 INFO:tasks.workunit.client.0.smithi170.stdout:5/771: dread d4/d8/d1c/d23/d39/fd2 [0,4194304] 0 2024-09-04T16:30:33.484 INFO:tasks.workunit.client.0.smithi170.stdout:6/656: write d0/d15/d56/f8b [771629,12737] 0 2024-09-04T16:30:33.485 INFO:tasks.workunit.client.0.smithi170.stdout:2/746: getdents d3/d4/d14 0 2024-09-04T16:30:33.487 INFO:tasks.workunit.client.0.smithi170.stdout:2/747: write d3/d4/f21 [126232,73201] 0 2024-09-04T16:30:33.489 INFO:tasks.workunit.client.0.smithi170.stdout:4/675: creat d1/d6/d8/d9d/feb x:0 0 0 2024-09-04T16:30:33.490 INFO:tasks.workunit.client.0.smithi170.stdout:3/695: dread d13/d14/d1d/d71/db3/db6/d9e/f5a [0,4194304] 0 2024-09-04T16:30:33.491 INFO:tasks.workunit.client.0.smithi170.stdout:5/772: dread d4/d8/d1c/d23/f2f [0,4194304] 0 2024-09-04T16:30:33.493 INFO:tasks.workunit.client.0.smithi170.stdout:2/748: unlink d3/d3c/de0/cf6 0 2024-09-04T16:30:33.495 INFO:tasks.workunit.client.0.smithi170.stdout:4/676: chown d1/d6/d8/d20/d35/d54/fc7 15816 1 2024-09-04T16:30:33.495 INFO:tasks.workunit.client.0.smithi170.stdout:3/696: chown d13/d14/d17/f9f 0 1 2024-09-04T16:30:33.496 INFO:tasks.workunit.client.0.smithi170.stdout:8/696: getdents d6/d28/d16/d77/d93/d95/dac 0 2024-09-04T16:30:33.498 INFO:tasks.workunit.client.0.smithi170.stdout:5/773: symlink d4/d8/d1c/d26/d27/d43/lff 0 2024-09-04T16:30:33.498 INFO:tasks.workunit.client.0.smithi170.stdout:6/657: dwrite d0/d15/d56/f8b [0,4194304] 0 2024-09-04T16:30:33.499 INFO:tasks.workunit.client.0.smithi170.stdout:2/749: write d3/db/d62/d6f/ff1 [500980,78739] 0 2024-09-04T16:30:33.501 INFO:tasks.workunit.client.0.smithi170.stdout:4/677: creat d1/d6/d22/d93/de5/fec x:0 0 0 2024-09-04T16:30:33.501 INFO:tasks.workunit.client.0.smithi170.stdout:1/866: dwrite d9/d11/d2f/d6b/f70 [4194304,4194304] 0 2024-09-04T16:30:33.504 INFO:tasks.workunit.client.0.smithi170.stdout:4/678: write d1/d6/d8/d20/d35/d3e/d60/daa/fb7 [1843868,60683] 0 2024-09-04T16:30:33.516 INFO:tasks.workunit.client.0.smithi170.stdout:8/697: write d6/d28/d1a/fea [860795,31209] 0 2024-09-04T16:30:33.516 INFO:tasks.workunit.client.0.smithi170.stdout:2/750: write d3/f46 [581170,82531] 0 2024-09-04T16:30:33.516 INFO:tasks.workunit.client.0.smithi170.stdout:4/679: dwrite d1/d6/d8/d20/f25 [0,4194304] 0 2024-09-04T16:30:33.516 INFO:tasks.workunit.client.0.smithi170.stdout:1/867: write d9/d26/f36 [1070897,117316] 0 2024-09-04T16:30:33.525 INFO:tasks.workunit.client.0.smithi170.stdout:5/774: link d4/db/d37/ldd d4/d8/d1c/d26/d27/d88/da4/dc0/l100 0 2024-09-04T16:30:33.527 INFO:tasks.workunit.client.0.smithi170.stdout:1/868: mknod d9/d26/d77/c128 0 2024-09-04T16:30:33.528 INFO:tasks.workunit.client.0.smithi170.stdout:3/697: dwrite d13/d14/d21/d4d/d4e/fc0 [0,4194304] 0 2024-09-04T16:30:33.529 INFO:tasks.workunit.client.0.smithi170.stdout:4/680: chown d1/d6/d8/d20/d35/d3e/d60/cd3 893 1 2024-09-04T16:30:33.531 INFO:tasks.workunit.client.0.smithi170.stdout:1/869: chown d9/d11/d2f/d6b/le3 85816075 1 2024-09-04T16:30:33.536 INFO:tasks.workunit.client.0.smithi170.stdout:3/698: symlink d13/d14/d1f/d7a/le1 0 2024-09-04T16:30:33.538 INFO:tasks.workunit.client.0.smithi170.stdout:4/681: truncate d1/d6/d8/fa 3058754 0 2024-09-04T16:30:33.539 INFO:tasks.workunit.client.0.smithi170.stdout:2/751: dread d3/fe3 [0,4194304] 0 2024-09-04T16:30:33.540 INFO:tasks.workunit.client.0.smithi170.stdout:5/775: link d4/d8/d1c/d23/d3e/f7e d4/d8/d1c/d26/d27/d43/f101 0 2024-09-04T16:30:33.541 INFO:tasks.workunit.client.0.smithi170.stdout:2/752: read d3/db/d1c/d47/d83/d9f/fec [2006293,20558] 0 2024-09-04T16:30:33.541 INFO:tasks.workunit.client.0.smithi170.stdout:1/870: creat d9/d26/d77/d83/f129 x:0 0 0 2024-09-04T16:30:33.543 INFO:tasks.workunit.client.0.smithi170.stdout:2/753: readlink d3/db/df/la0 0 2024-09-04T16:30:33.545 INFO:tasks.workunit.client.0.smithi170.stdout:3/699: dread d13/d14/d17/f8a [0,4194304] 0 2024-09-04T16:30:33.546 INFO:tasks.workunit.client.0.smithi170.stdout:1/871: symlink d9/d26/l12a 0 2024-09-04T16:30:33.547 INFO:tasks.workunit.client.0.smithi170.stdout:4/682: dwrite d1/d6/d8/d20/d35/d3e/f46 [4194304,4194304] 0 2024-09-04T16:30:33.547 INFO:tasks.workunit.client.0.smithi170.stdout:5/776: getdents d4/d8/d1c/d23/d94/db3/dee 0 2024-09-04T16:30:33.548 INFO:tasks.workunit.client.0.smithi170.stdout:1/872: stat d9/d11/d2e/f104 0 2024-09-04T16:30:33.551 INFO:tasks.workunit.client.0.smithi170.stdout:4/683: chown d1/d6/d2b/db3/dd4/ce2 764 1 2024-09-04T16:30:33.553 INFO:tasks.workunit.client.0.smithi170.stdout:3/700: symlink d13/d14/d1d/d71/db3/db6/db2/le2 0 2024-09-04T16:30:33.553 INFO:tasks.workunit.client.0.smithi170.stdout:1/873: creat d9/d11/d2f/d6b/d61/d108/f12b x:0 0 0 2024-09-04T16:30:33.556 INFO:tasks.workunit.client.0.smithi170.stdout:3/701: mkdir d13/d14/d8b/de3 0 2024-09-04T16:30:33.557 INFO:tasks.workunit.client.0.smithi170.stdout:8/698: dread d6/d28/d5f/d70/de8/f84 [0,4194304] 0 2024-09-04T16:30:33.560 INFO:tasks.workunit.client.0.smithi170.stdout:4/684: rename d1/d6/d8/d20/d35/d3e/d4e/d51/f7b to d1/d6/d8/d20/d35/d3e/d60/daa/fed 0 2024-09-04T16:30:33.561 INFO:tasks.workunit.client.0.smithi170.stdout:4/685: fsync d1/d6/d8/d20/d95/f57 0 2024-09-04T16:30:33.564 INFO:tasks.workunit.client.0.smithi170.stdout:3/702: creat d13/d14/d8b/fe4 x:0 0 0 2024-09-04T16:30:33.567 INFO:tasks.workunit.client.0.smithi170.stdout:8/699: rmdir d6/d28/d1a/d38 39 2024-09-04T16:30:33.570 INFO:tasks.workunit.client.0.smithi170.stdout:2/754: write d3/d3c/dc1/ff0 [4776314,13697] 0 2024-09-04T16:30:33.573 INFO:tasks.workunit.client.0.smithi170.stdout:1/874: rename d9/d11/dae/d6a/fa7 to d9/d11/d2f/dc2/f12c 0 2024-09-04T16:30:33.575 INFO:tasks.workunit.client.0.smithi170.stdout:1/875: write d9/d11/d85/dd8/dee/f103 [591319,54575] 0 2024-09-04T16:30:33.579 INFO:tasks.workunit.client.0.smithi170.stdout:3/703: fsync d13/d14/d17/f8a 0 2024-09-04T16:30:33.579 INFO:tasks.workunit.client.0.smithi170.stdout:3/704: stat d13/d14/d21/l44 0 2024-09-04T16:30:33.581 INFO:tasks.workunit.client.0.smithi170.stdout:8/700: stat d6/d28/d1a/d38/f88 0 2024-09-04T16:30:33.582 INFO:tasks.workunit.client.0.smithi170.stdout:2/755: mknod d3/db/dc5/cfa 0 2024-09-04T16:30:33.583 INFO:tasks.workunit.client.0.smithi170.stdout:5/777: truncate d4/d8/d1c/d29/f2a 523601 0 2024-09-04T16:30:33.586 INFO:tasks.workunit.client.0.smithi170.stdout:1/876: symlink d9/d11/d85/dc5/l12d 0 2024-09-04T16:30:33.589 INFO:tasks.workunit.client.0.smithi170.stdout:3/705: rmdir d13/d14/d8b 39 2024-09-04T16:30:33.591 INFO:tasks.workunit.client.0.smithi170.stdout:4/686: write d1/d6/d2b/d47/d78/da7/fa8 [1738296,20564] 0 2024-09-04T16:30:33.592 INFO:tasks.workunit.client.0.smithi170.stdout:8/701: write d6/d28/d16/d52/d73/fb3 [1797774,45026] 0 2024-09-04T16:30:33.599 INFO:tasks.workunit.client.0.smithi170.stdout:2/756: rename d3/db/d1c/db8/dd0/fde to d3/db/d1c/d77/dc2/ffb 0 2024-09-04T16:30:33.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:33 smithi170 ceph-mon[29272]: pgmap v36: 65 pgs: 65 active+clean; 3.3 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 78 MiB/s rd, 177 MiB/s wr, 400 op/s 2024-09-04T16:30:33.601 INFO:tasks.workunit.client.0.smithi170.stdout:3/706: mknod d13/d14/d17/ce5 0 2024-09-04T16:30:33.603 INFO:tasks.workunit.client.0.smithi170.stdout:8/702: getdents d6/d28/d16/d52/d73/d71 0 2024-09-04T16:30:33.608 INFO:tasks.workunit.client.0.smithi170.stdout:2/757: creat d3/db/d1c/d77/dc2/ffc x:0 0 0 2024-09-04T16:30:33.610 INFO:tasks.workunit.client.0.smithi170.stdout:4/687: write d1/d6/d2b/d47/f59 [3385103,127990] 0 2024-09-04T16:30:33.612 INFO:tasks.workunit.client.0.smithi170.stdout:1/877: getdents d9/d11/d2f/db9 0 2024-09-04T16:30:33.613 INFO:tasks.workunit.client.0.smithi170.stdout:5/778: dread d4/d8/d1c/d26/d27/f3f [0,4194304] 0 2024-09-04T16:30:33.614 INFO:tasks.workunit.client.0.smithi170.stdout:2/758: fdatasync d3/d3c/d40/d48/d68/f9a 0 2024-09-04T16:30:33.619 INFO:tasks.workunit.client.0.smithi170.stdout:1/878: symlink d9/d11/d2f/d7f/l12e 0 2024-09-04T16:30:33.622 INFO:tasks.workunit.client.0.smithi170.stdout:4/688: symlink d1/d6/d8/d20/d35/d3e/d4e/lee 0 2024-09-04T16:30:33.623 INFO:tasks.workunit.client.0.smithi170.stdout:8/703: dwrite d6/d28/d5f/d70/f7b [0,4194304] 0 2024-09-04T16:30:33.624 INFO:tasks.workunit.client.0.smithi170.stdout:5/779: getdents d4/d8/d1c/d26/d27/d48/ddf 0 2024-09-04T16:30:33.629 INFO:tasks.workunit.client.0.smithi170.stdout:3/707: dread d13/d14/f4b [0,4194304] 0 2024-09-04T16:30:33.631 INFO:tasks.workunit.client.0.smithi170.stdout:2/759: creat d3/db/d1c/d77/ffd x:0 0 0 2024-09-04T16:30:33.631 INFO:tasks.workunit.client.0.smithi170.stdout:4/689: read d1/d6/d22/f8e [2477387,111525] 0 2024-09-04T16:30:33.636 INFO:tasks.workunit.client.0.smithi170.stdout:3/708: truncate d13/d14/d21/f2b 1029292 0 2024-09-04T16:30:33.640 INFO:tasks.workunit.client.0.smithi170.stdout:4/690: chown d1/d6/d8/d20/d35/d3e/d4e/l82 0 1 2024-09-04T16:30:33.643 INFO:tasks.workunit.client.0.smithi170.stdout:5/780: dread d4/d8/d1c/f6d [0,4194304] 0 2024-09-04T16:30:33.644 INFO:tasks.workunit.client.0.smithi170.stdout:3/709: dread d13/d14/d17/fbb [0,4194304] 0 2024-09-04T16:30:33.644 INFO:tasks.workunit.client.0.smithi170.stdout:1/879: dwrite d9/d7b/d8f/fc1 [0,4194304] 0 2024-09-04T16:30:33.650 INFO:tasks.workunit.client.0.smithi170.stdout:4/691: readlink d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/dbf/lc8 0 2024-09-04T16:30:33.654 INFO:tasks.workunit.client.0.smithi170.stdout:1/880: truncate d9/d11/d2e/f45 4458276 0 2024-09-04T16:30:33.655 INFO:tasks.workunit.client.0.smithi170.stdout:8/704: dread d6/d28/d20/f8a [0,4194304] 0 2024-09-04T16:30:33.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:33 smithi193 ceph-mon[36288]: pgmap v36: 65 pgs: 65 active+clean; 3.3 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 78 MiB/s rd, 177 MiB/s wr, 400 op/s 2024-09-04T16:30:33.661 INFO:tasks.workunit.client.0.smithi170.stdout:3/710: dwrite d13/d14/d17/fd1 [0,4194304] 0 2024-09-04T16:30:33.666 INFO:tasks.workunit.client.0.smithi170.stdout:2/760: dread d3/db/f2b [0,4194304] 0 2024-09-04T16:30:33.666 INFO:tasks.workunit.client.0.smithi170.stdout:1/881: dwrite d9/d26/f36 [0,4194304] 0 2024-09-04T16:30:33.668 INFO:tasks.workunit.client.0.smithi170.stdout:8/705: creat d6/d28/d16/d24/d46/fec x:0 0 0 2024-09-04T16:30:33.669 INFO:tasks.workunit.client.0.smithi170.stdout:1/882: stat d9/d11/d2f/d6b/f97 0 2024-09-04T16:30:33.669 INFO:tasks.workunit.client.0.smithi170.stdout:2/761: readlink d3/db/d1c/d77/laa 0 2024-09-04T16:30:33.669 INFO:tasks.workunit.client.0.smithi170.stdout:5/781: dread d4/f6 [0,4194304] 0 2024-09-04T16:30:33.675 INFO:tasks.workunit.client.0.smithi170.stdout:2/762: chown d3/d3c/d40/d48/f8c 1611022 1 2024-09-04T16:30:33.681 INFO:tasks.workunit.client.0.smithi170.stdout:4/692: dread d1/d6/d8/d20/d95/d36/d79/fab [0,4194304] 0 2024-09-04T16:30:33.682 INFO:tasks.workunit.client.0.smithi170.stdout:2/763: fdatasync d3/db/df/d45/f7d 0 2024-09-04T16:30:33.684 INFO:tasks.workunit.client.0.smithi170.stdout:4/693: write d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/dbf/fd1 [1290382,103993] 0 2024-09-04T16:30:33.686 INFO:tasks.workunit.client.0.smithi170.stdout:4/694: write d1/d6/d8/d20/d95/fdc [321813,21435] 0 2024-09-04T16:30:33.687 INFO:tasks.workunit.client.0.smithi170.stdout:4/695: readlink d1/d6/d8/d20/l23 0 2024-09-04T16:30:33.688 INFO:tasks.workunit.client.0.smithi170.stdout:1/883: symlink d9/d11/d2f/d6b/l12f 0 2024-09-04T16:30:33.689 INFO:tasks.workunit.client.0.smithi170.stdout:4/696: chown d1/d6/d22/l67 13227 1 2024-09-04T16:30:33.693 INFO:tasks.workunit.client.0.smithi170.stdout:2/764: truncate d3/db/d1c/d47/d83/d9f/dae/fb9 106033 0 2024-09-04T16:30:33.694 INFO:tasks.workunit.client.0.smithi170.stdout:5/782: truncate d4/db/d51/d5e/d71/d84/f9b 2904599 0 2024-09-04T16:30:33.696 INFO:tasks.workunit.client.0.smithi170.stdout:3/711: dwrite d13/d14/d1f/f8d [0,4194304] 0 2024-09-04T16:30:33.697 INFO:tasks.workunit.client.0.smithi170.stdout:4/697: truncate d1/d6/d22/fad 1107735 0 2024-09-04T16:30:33.699 INFO:tasks.workunit.client.0.smithi170.stdout:8/706: dwrite d6/d28/d5f/d70/de8/f84 [0,4194304] 0 2024-09-04T16:30:33.699 INFO:tasks.workunit.client.0.smithi170.stdout:2/765: mkdir d3/d4/d86/dfe 0 2024-09-04T16:30:33.704 INFO:tasks.workunit.client.0.smithi170.stdout:3/712: mkdir d13/d14/d1d/d71/de6 0 2024-09-04T16:30:33.707 INFO:tasks.workunit.client.0.smithi170.stdout:1/884: dread d9/d11/d2f/d7f/fd7 [0,4194304] 0 2024-09-04T16:30:33.708 INFO:tasks.workunit.client.0.smithi170.stdout:8/707: mkdir d6/d28/d20/d6e/d76/ded 0 2024-09-04T16:30:33.709 INFO:tasks.workunit.client.0.smithi170.stdout:8/708: stat d6/d28/d16/d24/d46/c58 0 2024-09-04T16:30:33.710 INFO:tasks.workunit.client.0.smithi170.stdout:8/709: chown d6/d26/de2 11009359 1 2024-09-04T16:30:33.721 INFO:tasks.workunit.client.0.smithi170.stdout:3/713: read d13/d14/d21/f36 [1112659,64725] 0 2024-09-04T16:30:33.722 INFO:tasks.workunit.client.0.smithi170.stdout:2/766: rename d3/db/d1c/c25 to d3/db/d1c/cff 0 2024-09-04T16:30:33.726 INFO:tasks.workunit.client.0.smithi170.stdout:3/714: unlink d13/d14/d1d/d71/c81 0 2024-09-04T16:30:33.727 INFO:tasks.workunit.client.0.smithi170.stdout:5/783: dread d4/d8/d1c/d41/f54 [0,4194304] 0 2024-09-04T16:30:33.731 INFO:tasks.workunit.client.0.smithi170.stdout:3/715: symlink d13/d14/d1d/d71/db3/db6/d6e/le7 0 2024-09-04T16:30:33.735 INFO:tasks.workunit.client.0.smithi170.stdout:2/767: dwrite d3/db/df/f7b [4194304,4194304] 0 2024-09-04T16:30:33.736 INFO:tasks.workunit.client.0.smithi170.stdout:5/784: dread d4/f3b [0,4194304] 0 2024-09-04T16:30:33.736 INFO:tasks.workunit.client.0.smithi170.stdout:3/716: read d13/d14/d1d/d2d/d58/f47 [3824064,25957] 0 2024-09-04T16:30:33.739 INFO:tasks.workunit.client.0.smithi170.stdout:4/698: dwrite d1/d6/d8/d20/d35/d3e/d4e/d51/f76 [0,4194304] 0 2024-09-04T16:30:33.740 INFO:tasks.workunit.client.0.smithi170.stdout:1/885: truncate d9/d11/dae/f82 794990 0 2024-09-04T16:30:33.748 INFO:tasks.workunit.client.0.smithi170.stdout:8/710: dread d6/d28/d5f/d91/fbf [0,4194304] 0 2024-09-04T16:30:33.750 INFO:tasks.workunit.client.0.smithi170.stdout:5/785: dwrite d4/d8/d1c/d23/d39/f40 [0,4194304] 0 2024-09-04T16:30:33.751 INFO:tasks.workunit.client.0.smithi170.stdout:4/699: symlink d1/d6/d8/d20/d35/d54/d96/lef 0 2024-09-04T16:30:33.755 INFO:tasks.workunit.client.0.smithi170.stdout:4/700: read d1/d6/d8/d20/d35/d3e/d4e/f45 [3731678,17774] 0 2024-09-04T16:30:33.755 INFO:tasks.workunit.client.0.smithi170.stdout:1/886: creat d9/d11/d85/dc5/f130 x:0 0 0 2024-09-04T16:30:33.763 INFO:tasks.workunit.client.0.smithi170.stdout:5/786: unlink d4/d8/d1c/d23/f2f 0 2024-09-04T16:30:33.767 INFO:tasks.workunit.client.0.smithi170.stdout:8/711: dwrite d6/d28/d5f/d70/d97/fdc [0,4194304] 0 2024-09-04T16:30:33.773 INFO:tasks.workunit.client.0.smithi170.stdout:2/768: rename d3/f46 to d3/db/d1c/d47/f100 0 2024-09-04T16:30:33.776 INFO:tasks.workunit.client.0.smithi170.stdout:5/787: mkdir d4/d8/d1c/d26/d27/d43/d102 0 2024-09-04T16:30:33.777 INFO:tasks.workunit.client.0.smithi170.stdout:3/717: dwrite d13/d14/d21/f2b [0,4194304] 0 2024-09-04T16:30:33.785 INFO:tasks.workunit.client.0.smithi170.stdout:3/718: rmdir d13/d14/d1d/d71/db3/dbd 39 2024-09-04T16:30:33.786 INFO:tasks.workunit.client.0.smithi170.stdout:4/701: link d1/d6/f75 d1/d6/d8/d6c/de0/ff0 0 2024-09-04T16:30:33.789 INFO:tasks.workunit.client.0.smithi170.stdout:2/769: rename d3/db to d3/d3c/dc1/d101 0 2024-09-04T16:30:33.789 INFO:tasks.workunit.client.0.smithi170.stdout:1/887: link d9/d11/dae/d6a/d79/d7c/l94 d9/d11/dae/d6a/d79/l131 0 2024-09-04T16:30:33.791 INFO:tasks.workunit.client.0.smithi170.stdout:8/712: dread d6/d28/d16/d24/d46/f74 [0,4194304] 0 2024-09-04T16:30:33.794 INFO:tasks.workunit.client.0.smithi170.stdout:5/788: mkdir d4/d8/d1c/d26/d27/d43/d102/d103 0 2024-09-04T16:30:33.800 INFO:tasks.workunit.client.0.smithi170.stdout:5/789: stat d4/d8/d1c/d29/f67 0 2024-09-04T16:30:33.801 INFO:tasks.workunit.client.0.smithi170.stdout:5/790: chown d4/d8/d1c/d26/d27/d43/d5b/lb1 15306 1 2024-09-04T16:30:33.806 INFO:tasks.workunit.client.0.smithi170.stdout:2/770: write d3/d3c/dc1/d101/f2b [2505567,115009] 0 2024-09-04T16:30:33.807 INFO:tasks.workunit.client.0.smithi170.stdout:5/791: symlink d4/d8/d1c/d26/d27/d43/l104 0 2024-09-04T16:30:33.809 INFO:tasks.workunit.client.0.smithi170.stdout:4/702: creat d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/ff1 x:0 0 0 2024-09-04T16:30:33.810 INFO:tasks.workunit.client.0.smithi170.stdout:5/792: chown d4/d8/d1c/d26/d27/d88/da4/fba 843 1 2024-09-04T16:30:33.810 INFO:tasks.workunit.client.0.smithi170.stdout:1/888: link d9/d11/d85/dc5/lda d9/d11/d2f/l132 0 2024-09-04T16:30:33.811 INFO:tasks.workunit.client.0.smithi170.stdout:2/771: fdatasync d3/d3c/d40/f71 0 2024-09-04T16:30:33.812 INFO:tasks.workunit.client.0.smithi170.stdout:8/713: dread d6/d28/d1a/f36 [0,4194304] 0 2024-09-04T16:30:33.812 INFO:tasks.workunit.client.0.smithi170.stdout:1/889: chown d9/f27 2 1 2024-09-04T16:30:33.813 INFO:tasks.workunit.client.0.smithi170.stdout:4/703: creat d1/d6/d8/d20/dc1/ff2 x:0 0 0 2024-09-04T16:30:33.814 INFO:tasks.workunit.client.0.smithi170.stdout:2/772: write d3/d3c/dc1/d101/dc5/fd7 [80811,78194] 0 2024-09-04T16:30:33.863 INFO:tasks.workunit.client.0.smithi170.stdout:5/793: creat d4/d8/d1c/d26/df8/f105 x:0 0 0 2024-09-04T16:30:33.867 INFO:tasks.workunit.client.0.smithi170.stdout:8/714: dwrite d6/d28/d20/d5e/fd7 [4194304,4194304] 0 2024-09-04T16:30:33.867 INFO:tasks.workunit.client.0.smithi170.stdout:1/890: dwrite d9/d11/dae/d6a/d79/f123 [0,4194304] 0 2024-09-04T16:30:33.868 INFO:tasks.workunit.client.0.smithi170.stdout:1/891: stat d9/d11/d2e/fd2 0 2024-09-04T16:30:33.879 INFO:tasks.workunit.client.0.smithi170.stdout:2/773: rename d3/d3c/dc1/d101/df/d45/fac to d3/d3c/dc1/d101/dc5/f102 0 2024-09-04T16:30:33.881 INFO:tasks.workunit.client.0.smithi170.stdout:8/715: symlink d6/d28/d16/d77/d9f/lee 0 2024-09-04T16:30:33.882 INFO:tasks.workunit.client.0.smithi170.stdout:2/774: truncate d3/d3c/dc1/d101/df/fc7 159469 0 2024-09-04T16:30:33.882 INFO:tasks.workunit.client.0.smithi170.stdout:8/716: write d6/d26/f9a [56110,26197] 0 2024-09-04T16:30:33.883 INFO:tasks.workunit.client.0.smithi170.stdout:8/717: chown d6/d28/d16/d52/d73/cb5 246241 1 2024-09-04T16:30:33.885 INFO:tasks.workunit.client.0.smithi170.stdout:8/718: write d6/d28/d16/d52/f64 [4865993,13925] 0 2024-09-04T16:30:33.887 INFO:tasks.workunit.client.0.smithi170.stdout:5/794: rename d4/d8/d1c/d23 to d4/db/d51/d5e/d71/d84/d93/d106 0 2024-09-04T16:30:33.888 INFO:tasks.workunit.client.0.smithi170.stdout:5/795: readlink d4/d8/d1c/d26/d27/d48/d7c/ld0 0 2024-09-04T16:30:33.892 INFO:tasks.workunit.client.0.smithi170.stdout:4/704: dwrite d1/d6/d8/d20/d95/d36/d79/fab [0,4194304] 0 2024-09-04T16:30:33.895 INFO:tasks.workunit.client.0.smithi170.stdout:8/719: creat d6/d28/d5f/d70/d97/fef x:0 0 0 2024-09-04T16:30:33.896 INFO:tasks.workunit.client.0.smithi170.stdout:8/720: chown d6/d28/d16/d24/ca8 90 1 2024-09-04T16:30:33.897 INFO:tasks.workunit.client.0.smithi170.stdout:5/796: truncate d4/d8/d1c/d26/d27/d43/f66 898757 0 2024-09-04T16:30:33.901 INFO:tasks.workunit.client.0.smithi170.stdout:2/775: mknod d3/d4/d14/dcf/c103 0 2024-09-04T16:30:33.902 INFO:tasks.workunit.client.0.smithi170.stdout:2/776: truncate d3/d3c/dc1/ff0 4936487 0 2024-09-04T16:30:33.904 INFO:tasks.workunit.client.0.smithi170.stdout:5/797: chown d4/d8/d1c/d26/d27/d88/da4/cf0 216 1 2024-09-04T16:30:33.907 INFO:tasks.workunit.client.0.smithi170.stdout:2/777: mkdir d3/d4/d86/dfe/d104 0 2024-09-04T16:30:33.911 INFO:tasks.workunit.client.0.smithi170.stdout:8/721: getdents d6/d28/d16/d77/d93/dc0 0 2024-09-04T16:30:33.912 INFO:tasks.workunit.client.0.smithi170.stdout:4/705: truncate d1/d6/d8/d20/d35/d54/fc7 2349286 0 2024-09-04T16:30:33.916 INFO:tasks.workunit.client.0.smithi170.stdout:2/778: creat d3/d3c/dc1/d101/d1c/d77/f105 x:0 0 0 2024-09-04T16:30:33.918 INFO:tasks.workunit.client.0.smithi170.stdout:4/706: truncate d1/d6/d8/d20/d95/d36/d79/fb2 806098 0 2024-09-04T16:30:33.921 INFO:tasks.workunit.client.0.smithi170.stdout:2/779: dread d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/d97/fe1 [0,4194304] 0 2024-09-04T16:30:33.921 INFO:tasks.workunit.client.0.smithi170.stdout:8/722: link d6/d28/d16/c51 d6/d28/d20/cf0 0 2024-09-04T16:30:33.925 INFO:tasks.workunit.client.0.smithi170.stdout:2/780: dread d3/d3c/dc1/d101/dc5/fd7 [0,4194304] 0 2024-09-04T16:30:33.926 INFO:tasks.workunit.client.0.smithi170.stdout:4/707: dwrite d1/d6/d8/d20/dc1/dd2/fe7 [0,4194304] 0 2024-09-04T16:30:33.928 INFO:tasks.workunit.client.0.smithi170.stdout:8/723: mkdir d6/d28/d16/d77/d93/d95/db8/df1 0 2024-09-04T16:30:33.931 INFO:tasks.workunit.client.0.smithi170.stdout:4/708: symlink d1/d6/d8/d6c/lf3 0 2024-09-04T16:30:33.932 INFO:tasks.workunit.client.0.smithi170.stdout:8/724: mkdir d6/d28/d16/df2 0 2024-09-04T16:30:33.935 INFO:tasks.workunit.client.0.smithi170.stdout:2/781: dwrite d3/d3c/dc1/d101/d1c/d77/dc2/ffc [0,4194304] 0 2024-09-04T16:30:33.937 INFO:tasks.workunit.client.0.smithi170.stdout:2/782: stat d3/d3c/d40/d48/d68/c89 0 2024-09-04T16:30:33.939 INFO:tasks.workunit.client.0.smithi170.stdout:4/709: unlink d1/d6/d8/d20/d35/d3e/d60/fbd 0 2024-09-04T16:30:33.940 INFO:tasks.workunit.client.0.smithi170.stdout:8/725: fsync d6/d28/d20/d5e/f5b 0 2024-09-04T16:30:33.943 INFO:tasks.workunit.client.0.smithi170.stdout:4/710: symlink d1/d6/d8/d20/dc1/lf4 0 2024-09-04T16:30:33.952 INFO:tasks.workunit.client.0.smithi170.stdout:8/726: dread - d6/d28/d20/dc5/fcb zero size 2024-09-04T16:30:33.952 INFO:tasks.workunit.client.0.smithi170.stdout:4/711: rmdir d1/d6/d8/d20/d35/dcc 39 2024-09-04T16:30:33.975 INFO:tasks.workunit.client.0.smithi170.stdout:4/712: rmdir d1/d6/d8/d20/d95/d36/d79 39 2024-09-04T16:30:33.976 INFO:tasks.workunit.client.0.smithi170.stdout:8/727: creat d6/d28/d16/d52/d73/d71/ff3 x:0 0 0 2024-09-04T16:30:33.979 INFO:tasks.workunit.client.0.smithi170.stdout:4/713: symlink d1/d6/d8/lf5 0 2024-09-04T16:30:33.982 INFO:tasks.workunit.client.0.smithi170.stdout:4/714: rmdir d1/d6/d8/d9d 39 2024-09-04T16:30:33.983 INFO:tasks.workunit.client.0.smithi170.stdout:8/728: dwrite d6/d28/d16/d77/d9f/feb [0,4194304] 0 2024-09-04T16:30:33.986 INFO:tasks.workunit.client.0.smithi170.stdout:4/715: creat d1/d6/d22/d93/ff6 x:0 0 0 2024-09-04T16:30:33.987 INFO:tasks.workunit.client.0.smithi170.stdout:4/716: write d1/d6/d8/d20/d35/d3e/d43/f5f [3849554,46167] 0 2024-09-04T16:30:33.988 INFO:tasks.workunit.client.0.smithi170.stdout:8/729: mkdir d6/d28/d20/d5e/df4 0 2024-09-04T16:30:33.990 INFO:tasks.workunit.client.0.smithi170.stdout:4/717: fdatasync d1/d6/d22/f8e 0 2024-09-04T16:30:33.994 INFO:tasks.workunit.client.0.smithi170.stdout:4/718: unlink d1/d6/d8/d6c/de0/ff0 0 2024-09-04T16:30:33.997 INFO:tasks.workunit.client.0.smithi170.stdout:4/719: creat d1/d6/d8/d20/d35/d3e/d60/ff7 x:0 0 0 2024-09-04T16:30:34.000 INFO:tasks.workunit.client.0.smithi170.stdout:4/720: truncate d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/fa4 1125135 0 2024-09-04T16:30:34.004 INFO:tasks.workunit.client.0.smithi170.stdout:4/721: dread d1/d6/d8/d20/d35/d3e/d60/f61 [0,4194304] 0 2024-09-04T16:30:34.013 INFO:tasks.workunit.client.0.smithi170.stdout:4/722: getdents d1/d6/d8/d20/d35/d3e/d60/daa 0 2024-09-04T16:30:34.015 INFO:tasks.workunit.client.0.smithi170.stdout:4/723: chown d1/c2c 4 1 2024-09-04T16:30:34.019 INFO:tasks.workunit.client.0.smithi170.stdout:4/724: truncate d1/d6/d8/f9a 377750 0 2024-09-04T16:30:34.021 INFO:tasks.workunit.client.0.smithi170.stdout:4/725: chown d1/d6/d2b/d47/d78/da7/cca 410679 1 2024-09-04T16:30:34.034 INFO:tasks.workunit.client.0.smithi170.stdout:8/730: dwrite d6/d28/d20/dc5/fcb [0,4194304] 0 2024-09-04T16:30:34.040 INFO:tasks.workunit.client.0.smithi170.stdout:8/731: rename d6/d28/d16/d77/d9f/le6 to d6/d26/lf5 0 2024-09-04T16:30:34.052 INFO:tasks.workunit.client.0.smithi170.stdout:4/726: dwrite d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/fa4 [0,4194304] 0 2024-09-04T16:30:34.054 INFO:tasks.workunit.client.0.smithi170.stdout:4/727: write d1/d6/d8/d20/d95/d36/fbb [4533939,38623] 0 2024-09-04T16:30:34.061 INFO:tasks.workunit.client.0.smithi170.stdout:8/732: truncate d6/d28/d5f/d91/fa6 284876 0 2024-09-04T16:30:34.063 INFO:tasks.workunit.client.0.smithi170.stdout:4/728: dwrite d1/d6/d8/d20/d95/fdc [0,4194304] 0 2024-09-04T16:30:34.068 INFO:tasks.workunit.client.0.smithi170.stdout:8/733: fdatasync d6/d28/d1a/f36 0 2024-09-04T16:30:34.074 INFO:tasks.workunit.client.0.smithi170.stdout:4/729: mknod d1/d6/d8/d20/dae/dd5/cf8 0 2024-09-04T16:30:34.075 INFO:tasks.workunit.client.0.smithi170.stdout:4/730: chown d1/d6/d2b/d47/d78/f90 257973 1 2024-09-04T16:30:34.076 INFO:tasks.workunit.client.0.smithi170.stdout:8/734: mknod d6/d26/cf6 0 2024-09-04T16:30:34.080 INFO:tasks.workunit.client.0.smithi170.stdout:8/735: mkdir d6/d28/d5f/d85/df7 0 2024-09-04T16:30:34.084 INFO:tasks.workunit.client.0.smithi170.stdout:4/731: getdents d1/d6/d8/d20/d35/d3e/d60 0 2024-09-04T16:30:34.084 INFO:tasks.workunit.client.0.smithi170.stdout:8/736: creat d6/d28/d16/d77/d93/d95/db8/df1/ff8 x:0 0 0 2024-09-04T16:30:34.088 INFO:tasks.workunit.client.0.smithi170.stdout:8/737: mkdir d6/d28/d16/d77/d93/d95/db8/df9 0 2024-09-04T16:30:34.091 INFO:tasks.workunit.client.0.smithi170.stdout:8/738: mkdir d6/d28/d20/d5e/dfa 0 2024-09-04T16:30:34.102 INFO:tasks.workunit.client.0.smithi170.stdout:4/732: dread d1/d6/d8/d20/d95/fc5 [0,4194304] 0 2024-09-04T16:30:34.106 INFO:tasks.workunit.client.0.smithi170.stdout:4/733: truncate d1/d6/d8/d20/d35/d3e/d4e/d51/f5c 1990459 0 2024-09-04T16:30:34.117 INFO:tasks.workunit.client.0.smithi170.stdout:4/734: dwrite d1/d6/d8/d20/d35/d3e/d4e/f45 [0,4194304] 0 2024-09-04T16:30:34.121 INFO:tasks.workunit.client.0.smithi170.stdout:4/735: rename d1/d6/d8/d20/dae/cbe to d1/d6/d8/d20/d95/d36/d9c/cf9 0 2024-09-04T16:30:34.134 INFO:tasks.workunit.client.0.smithi170.stdout:4/736: dwrite d1/d6/d8/f9 [0,4194304] 0 2024-09-04T16:30:34.149 INFO:tasks.workunit.client.0.smithi170.stdout:4/737: dwrite d1/d6/d8/d20/f88 [0,4194304] 0 2024-09-04T16:30:34.154 INFO:tasks.workunit.client.0.smithi170.stdout:4/738: rename d1/d6/d8/c13 to d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/cfa 0 2024-09-04T16:30:34.247 INFO:tasks.workunit.client.0.smithi170.stdout:9/724: sync 2024-09-04T16:30:34.248 INFO:tasks.workunit.client.0.smithi170.stdout:7/887: sync 2024-09-04T16:30:34.248 INFO:tasks.workunit.client.0.smithi170.stdout:0/839: sync 2024-09-04T16:30:34.248 INFO:tasks.workunit.client.0.smithi170.stdout:0/840: readlink d11/d75/d77/l9f 0 2024-09-04T16:30:34.253 INFO:tasks.workunit.client.0.smithi170.stdout:7/888: dwrite d12/d16/d1d/d65/d82/dcb/df8/f120 [0,4194304] 0 2024-09-04T16:30:34.275 INFO:tasks.workunit.client.0.smithi170.stdout:0/841: dread fe [0,4194304] 0 2024-09-04T16:30:34.276 INFO:tasks.workunit.client.0.smithi170.stdout:0/842: chown d11/d13/d4a/d66/d8c/d113 3 1 2024-09-04T16:30:34.287 INFO:tasks.workunit.client.0.smithi170.stdout:9/725: unlink d2/d32/l70 0 2024-09-04T16:30:34.289 INFO:tasks.workunit.client.0.smithi170.stdout:4/739: link d1/d6/d8/d6c/f94 d1/d6/ffb 0 2024-09-04T16:30:34.295 INFO:tasks.workunit.client.0.smithi170.stdout:0/843: write d11/d13/d4a/ff1 [386618,125180] 0 2024-09-04T16:30:34.297 INFO:tasks.workunit.client.0.smithi170.stdout:7/889: dwrite d12/d15/d71/d42/f7e [0,4194304] 0 2024-09-04T16:30:34.303 INFO:tasks.workunit.client.0.smithi170.stdout:7/890: truncate d12/d49/fd8 435861 0 2024-09-04T16:30:34.305 INFO:tasks.workunit.client.0.smithi170.stdout:9/726: dread d2/d3d/d27/d65/d56/d7a/da5/fb8 [4194304,4194304] 0 2024-09-04T16:30:34.307 INFO:tasks.workunit.client.0.smithi170.stdout:4/740: dread d1/d6/d2b/d47/f59 [0,4194304] 0 2024-09-04T16:30:34.310 INFO:tasks.workunit.client.0.smithi170.stdout:0/844: rename d11/d13/d71/f96 to d11/d13/d4a/d66/d8c/d12a/f131 0 2024-09-04T16:30:34.310 INFO:tasks.workunit.client.0.smithi170.stdout:7/891: symlink d12/d16/db7/l12f 0 2024-09-04T16:30:34.311 INFO:tasks.workunit.client.0.smithi170.stdout:9/727: creat d2/d3d/d6d/fdd x:0 0 0 2024-09-04T16:30:34.314 INFO:tasks.workunit.client.0.smithi170.stdout:0/845: mknod d11/d13/d2f/d3f/c132 0 2024-09-04T16:30:34.315 INFO:tasks.workunit.client.0.smithi170.stdout:4/741: read d1/d6/d8/d20/d95/d36/d79/fb2 [720528,103223] 0 2024-09-04T16:30:34.316 INFO:tasks.workunit.client.0.smithi170.stdout:9/728: dread d2/fa8 [4194304,4194304] 0 2024-09-04T16:30:34.318 INFO:tasks.workunit.client.0.smithi170.stdout:4/742: dread - d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/dbf/fe1 zero size 2024-09-04T16:30:34.319 INFO:tasks.workunit.client.0.smithi170.stdout:9/729: creat d2/d3d/d3f/d90/fde x:0 0 0 2024-09-04T16:30:34.324 INFO:tasks.workunit.client.0.smithi170.stdout:4/743: creat d1/d6/d8/d20/ffc x:0 0 0 2024-09-04T16:30:34.324 INFO:tasks.workunit.client.0.smithi170.stdout:4/744: readlink d1/d6/d8/d20/l55 0 2024-09-04T16:30:34.326 INFO:tasks.workunit.client.0.smithi170.stdout:9/730: fdatasync d2/fa8 0 2024-09-04T16:30:34.329 INFO:tasks.workunit.client.0.smithi170.stdout:0/846: creat d11/d13/d4a/db8/d111/d124/f133 x:0 0 0 2024-09-04T16:30:34.333 INFO:tasks.workunit.client.0.smithi170.stdout:4/745: dwrite d1/d6/d8/f9 [0,4194304] 0 2024-09-04T16:30:34.336 INFO:tasks.workunit.client.0.smithi170.stdout:9/731: rename d2/d11/d23/d95/fa1 to d2/d3d/d54/fdf 0 2024-09-04T16:30:34.336 INFO:tasks.workunit.client.0.smithi170.stdout:7/892: dwrite d12/d16/db7/deb/f119 [0,4194304] 0 2024-09-04T16:30:34.337 INFO:tasks.workunit.client.0.smithi170.stdout:4/746: chown d1/d6/d8/d20/d35/d3e/d60/lc4 816919 1 2024-09-04T16:30:34.341 INFO:tasks.workunit.client.0.smithi170.stdout:7/893: fsync d12/d5a/fc8 0 2024-09-04T16:30:34.342 INFO:tasks.workunit.client.0.smithi170.stdout:4/747: read d1/d6/d8/f8a [5506877,114594] 0 2024-09-04T16:30:34.344 INFO:tasks.workunit.client.0.smithi170.stdout:0/847: dwrite d11/d13/d4a/d66/d8c/fc6 [0,4194304] 0 2024-09-04T16:30:34.349 INFO:tasks.workunit.client.0.smithi170.stdout:7/894: truncate d12/d49/f6b 4239168 0 2024-09-04T16:30:34.353 INFO:tasks.workunit.client.0.smithi170.stdout:4/748: creat d1/d6/d8/d20/d35/d54/ffd x:0 0 0 2024-09-04T16:30:34.359 INFO:tasks.workunit.client.0.smithi170.stdout:9/732: getdents d2/d3d/d6d 0 2024-09-04T16:30:34.362 INFO:tasks.workunit.client.0.smithi170.stdout:4/749: stat d1/d6/d8/d20/d95/d36/d79/c73 0 2024-09-04T16:30:34.363 INFO:tasks.workunit.client.0.smithi170.stdout:4/750: chown d1/d6/d22/f62 58634 1 2024-09-04T16:30:34.365 INFO:tasks.workunit.client.0.smithi170.stdout:0/848: getdents d11/d13/d4a/d66 0 2024-09-04T16:30:34.366 INFO:tasks.workunit.client.0.smithi170.stdout:4/751: creat d1/d6/d8/d20/d35/d54/ffe x:0 0 0 2024-09-04T16:30:34.374 INFO:tasks.workunit.client.0.smithi170.stdout:7/895: dwrite d12/d5a/fe7 [0,4194304] 0 2024-09-04T16:30:34.374 INFO:tasks.workunit.client.0.smithi170.stdout:4/752: creat d1/d6/d8/fff x:0 0 0 2024-09-04T16:30:34.380 INFO:tasks.workunit.client.0.smithi170.stdout:9/733: dread d2/fd [0,4194304] 0 2024-09-04T16:30:34.383 INFO:tasks.workunit.client.0.smithi170.stdout:4/753: creat d1/d6/d8/d20/d35/d3e/d4e/dcb/f100 x:0 0 0 2024-09-04T16:30:34.384 INFO:tasks.workunit.client.0.smithi170.stdout:4/754: dread - d1/d6/d8/fff zero size 2024-09-04T16:30:34.384 INFO:tasks.workunit.client.0.smithi170.stdout:7/896: mknod d12/d15/d71/d42/d79/d9d/dc9/df6/dfb/c130 0 2024-09-04T16:30:34.387 INFO:tasks.workunit.client.0.smithi170.stdout:0/849: dread d11/d75/d77/f81 [0,4194304] 0 2024-09-04T16:30:34.388 INFO:tasks.workunit.client.0.smithi170.stdout:7/897: symlink d12/d16/d1d/l131 0 2024-09-04T16:30:34.389 INFO:tasks.workunit.client.0.smithi170.stdout:4/755: creat d1/d6/d8/d20/dc1/f101 x:0 0 0 2024-09-04T16:30:34.391 INFO:tasks.workunit.client.0.smithi170.stdout:4/756: readlink d1/d6/d8/d20/d35/d3e/d60/lea 0 2024-09-04T16:30:34.393 INFO:tasks.workunit.client.0.smithi170.stdout:7/898: creat d12/d15/d71/d42/d81/f132 x:0 0 0 2024-09-04T16:30:34.394 INFO:tasks.workunit.client.0.smithi170.stdout:0/850: mkdir d11/d13/d4a/d66/d8c/d113/d134 0 2024-09-04T16:30:34.395 INFO:tasks.workunit.client.0.smithi170.stdout:4/757: mknod d1/d6/d8/d20/d35/d3e/d4e/c102 0 2024-09-04T16:30:34.397 INFO:tasks.workunit.client.0.smithi170.stdout:7/899: mknod d12/d15/d68/c133 0 2024-09-04T16:30:34.398 INFO:tasks.workunit.client.0.smithi170.stdout:7/900: readlink d12/d16/d1d/d65/d82/l108 0 2024-09-04T16:30:34.401 INFO:tasks.workunit.client.0.smithi170.stdout:4/758: rename d1/d6/l1d to d1/d6/d8/d20/l103 0 2024-09-04T16:30:34.405 INFO:tasks.workunit.client.0.smithi170.stdout:9/734: dread d2/d32/f41 [0,4194304] 0 2024-09-04T16:30:34.408 INFO:tasks.workunit.client.0.smithi170.stdout:7/901: creat d12/d15/d71/d42/f134 x:0 0 0 2024-09-04T16:30:34.410 INFO:tasks.workunit.client.0.smithi170.stdout:4/759: creat d1/d6/d8/d20/d35/d3e/d4e/f104 x:0 0 0 2024-09-04T16:30:34.410 INFO:tasks.workunit.client.0.smithi170.stdout:0/851: dread d11/d13/d2f/f33 [0,4194304] 0 2024-09-04T16:30:34.411 INFO:tasks.workunit.client.0.smithi170.stdout:0/852: chown d11/d13/d4a/d66/d8c/d12a/l12e 0 1 2024-09-04T16:30:34.412 INFO:tasks.workunit.client.0.smithi170.stdout:9/735: mkdir d2/d3d/d27/d65/dcb/de0 0 2024-09-04T16:30:34.413 INFO:tasks.workunit.client.0.smithi170.stdout:4/760: fsync d1/d6/d8/d20/f25 0 2024-09-04T16:30:34.416 INFO:tasks.workunit.client.0.smithi170.stdout:9/736: rmdir d2/d3d/d27/d65/dcb 39 2024-09-04T16:30:34.420 INFO:tasks.workunit.client.0.smithi170.stdout:9/737: mkdir d2/d11/d8f/de1 0 2024-09-04T16:30:34.422 INFO:tasks.workunit.client.0.smithi170.stdout:4/761: dwrite d1/d6/d8/d20/d95/d36/d9c/fda [0,4194304] 0 2024-09-04T16:30:34.424 INFO:tasks.workunit.client.0.smithi170.stdout:4/762: chown d1/d6/d8/d20/d35/d54/ffe 4122 1 2024-09-04T16:30:34.425 INFO:tasks.workunit.client.0.smithi170.stdout:7/902: write d12/d15/d71/d42/d81/d5c/fe3 [3091699,58644] 0 2024-09-04T16:30:34.429 INFO:tasks.workunit.client.0.smithi170.stdout:0/853: dread d11/d13/d4a/d66/d8c/ddd/ff6 [0,4194304] 0 2024-09-04T16:30:34.430 INFO:tasks.workunit.client.0.smithi170.stdout:9/738: dwrite d2/d3d/d6d/d79/f94 [4194304,4194304] 0 2024-09-04T16:30:34.431 INFO:tasks.workunit.client.0.smithi170.stdout:4/763: symlink d1/d6/d2b/d47/d78/da7/l105 0 2024-09-04T16:30:34.433 INFO:tasks.workunit.client.0.smithi170.stdout:7/903: mknod d12/d15/d71/d42/c135 0 2024-09-04T16:30:34.436 INFO:tasks.workunit.client.0.smithi170.stdout:0/854: creat d11/d13/d4a/d66/d8c/ddd/f135 x:0 0 0 2024-09-04T16:30:34.447 INFO:tasks.workunit.client.0.smithi170.stdout:4/764: unlink d1/d6/d8/d20/l5b 0 2024-09-04T16:30:34.448 INFO:tasks.workunit.client.0.smithi170.stdout:9/739: dread d2/d3d/f8c [0,4194304] 0 2024-09-04T16:30:34.449 INFO:tasks.workunit.client.0.smithi170.stdout:7/904: write d12/d16/d8d/ffd [994210,26634] 0 2024-09-04T16:30:34.456 INFO:tasks.workunit.client.0.smithi170.stdout:7/905: symlink d12/d15/d71/l136 0 2024-09-04T16:30:34.457 INFO:tasks.workunit.client.0.smithi170.stdout:9/740: rename d2/d3d/d27/d2b/f6a to d2/d3d/d27/d2b/fe2 0 2024-09-04T16:30:34.458 INFO:tasks.workunit.client.0.smithi170.stdout:0/855: dwrite d11/d13/d2f/fa7 [4194304,4194304] 0 2024-09-04T16:30:34.463 INFO:tasks.workunit.client.0.smithi170.stdout:7/906: symlink d12/d15/l137 0 2024-09-04T16:30:34.467 INFO:tasks.workunit.client.0.smithi170.stdout:9/741: creat d2/d11/d8f/fe3 x:0 0 0 2024-09-04T16:30:34.475 INFO:tasks.workunit.client.0.smithi170.stdout:0/856: getdents d11/d13/d35 0 2024-09-04T16:30:34.476 INFO:tasks.workunit.client.0.smithi170.stdout:0/857: chown d11/f6a 15411848 1 2024-09-04T16:30:34.478 INFO:tasks.workunit.client.0.smithi170.stdout:0/858: rename d11/d13/d4a/fd2 to d11/d13/d36/de5/d11d/f136 0 2024-09-04T16:30:34.485 INFO:tasks.workunit.client.0.smithi170.stdout:7/907: dwrite f7 [0,4194304] 0 2024-09-04T16:30:34.491 INFO:tasks.workunit.client.0.smithi170.stdout:7/908: creat d12/d16/d8d/f138 x:0 0 0 2024-09-04T16:30:34.493 INFO:tasks.workunit.client.0.smithi170.stdout:0/859: dread d11/d13/d71/d43/f58 [0,4194304] 0 2024-09-04T16:30:34.494 INFO:tasks.workunit.client.0.smithi170.stdout:7/909: mknod d12/d16/d1d/d65/d82/da8/c139 0 2024-09-04T16:30:34.495 INFO:tasks.workunit.client.0.smithi170.stdout:7/910: stat d12/d15/d71/d42/d81/l2c 0 2024-09-04T16:30:34.497 INFO:tasks.workunit.client.0.smithi170.stdout:7/911: readlink d12/l33 0 2024-09-04T16:30:34.500 INFO:tasks.workunit.client.0.smithi170.stdout:0/860: rename d11/d13/d2f/f31 to d11/d13/d4a/d66/d8c/ddd/f137 0 2024-09-04T16:30:34.502 INFO:tasks.workunit.client.0.smithi170.stdout:7/912: stat d12/d16/d1d/d65/d82/dcb/ce2 0 2024-09-04T16:30:34.503 INFO:tasks.workunit.client.0.smithi170.stdout:7/913: readlink d12/d15/d71/d42/d79/d9d/d51/l2b 0 2024-09-04T16:30:34.504 INFO:tasks.workunit.client.0.smithi170.stdout:0/861: creat d11/d13/d2f/d3f/f138 x:0 0 0 2024-09-04T16:30:34.505 INFO:tasks.workunit.client.0.smithi170.stdout:0/862: write d11/d13/d4a/d66/d8c/ddd/f135 [745802,87645] 0 2024-09-04T16:30:34.509 INFO:tasks.workunit.client.0.smithi170.stdout:0/863: dread d11/d75/fcb [0,4194304] 0 2024-09-04T16:30:34.690 INFO:tasks.workunit.client.0.smithi170.stdout:6/658: sync 2024-09-04T16:30:34.691 INFO:tasks.workunit.client.0.smithi170.stdout:6/659: dread - d0/df/d1b/d3e/fb5 zero size 2024-09-04T16:30:34.692 INFO:tasks.workunit.client.0.smithi170.stdout:6/660: stat d0/df/fa1 0 2024-09-04T16:30:34.692 INFO:tasks.workunit.client.0.smithi170.stdout:6/661: dread - d0/d15/d56/d6c/f85 zero size 2024-09-04T16:30:34.696 INFO:tasks.workunit.client.0.smithi170.stdout:6/662: fdatasync d0/df/d1b/d3e/d47/d68/f23 0 2024-09-04T16:30:34.698 INFO:tasks.workunit.client.0.smithi170.stdout:6/663: creat d0/d9f/fd9 x:0 0 0 2024-09-04T16:30:34.709 INFO:tasks.workunit.client.0.smithi170.stdout:6/664: dwrite d0/d17/d5b/fa2 [0,4194304] 0 2024-09-04T16:30:34.710 INFO:tasks.workunit.client.0.smithi170.stdout:6/665: chown d0/df/d1b/d3e/d47/d68/d2d/c92 695 1 2024-09-04T16:30:34.866 INFO:tasks.workunit.client.0.smithi170.stdout:3/719: sync 2024-09-04T16:30:34.868 INFO:tasks.workunit.client.0.smithi170.stdout:3/720: mknod d13/d14/d1f/d7a/ce8 0 2024-09-04T16:30:34.870 INFO:tasks.workunit.client.0.smithi170.stdout:3/721: write d13/d14/d1d/da4/fac [997880,112887] 0 2024-09-04T16:30:34.876 INFO:tasks.workunit.client.0.smithi170.stdout:3/722: write d13/d14/d1d/f23 [2507001,88839] 0 2024-09-04T16:30:34.877 INFO:tasks.workunit.client.0.smithi170.stdout:3/723: mknod d13/ce9 0 2024-09-04T16:30:34.967 INFO:tasks.workunit.client.0.smithi170.stdout:3/724: dwrite d13/d14/d1d/d2d/d58/fa0 [0,4194304] 0 2024-09-04T16:30:34.968 INFO:tasks.workunit.client.0.smithi170.stdout:3/725: fdatasync d13/d14/d21/d4d/d4e/fc0 0 2024-09-04T16:30:35.037 INFO:tasks.workunit.client.0.smithi170.stdout:3/726: creat d13/d14/d21/d4c/fea x:0 0 0 2024-09-04T16:30:35.037 INFO:tasks.workunit.client.0.smithi170.stdout:3/727: chown d13/ce9 94 1 2024-09-04T16:30:35.043 INFO:tasks.workunit.client.0.smithi170.stdout:3/728: link d13/d14/d1f/d7a/ce8 d13/d14/d17/ceb 0 2024-09-04T16:30:35.054 INFO:tasks.workunit.client.0.smithi170.stdout:3/729: truncate d13/d14/d1f/f60 3945883 0 2024-09-04T16:30:35.059 INFO:tasks.workunit.client.0.smithi170.stdout:3/730: mkdir d13/d14/d21/dec 0 2024-09-04T16:30:35.061 INFO:tasks.workunit.client.0.smithi170.stdout:3/731: unlink d13/d14/d1d/d71/db3/db6/c6d 0 2024-09-04T16:30:35.066 INFO:tasks.workunit.client.0.smithi170.stdout:3/732: dwrite d13/d14/d21/d4d/d4e/d50/fb0 [0,4194304] 0 2024-09-04T16:30:35.071 INFO:tasks.workunit.client.0.smithi170.stdout:3/733: mkdir d13/d14/d17/ded 0 2024-09-04T16:30:35.074 INFO:tasks.workunit.client.0.smithi170.stdout:1/892: sync 2024-09-04T16:30:35.074 INFO:tasks.workunit.client.0.smithi170.stdout:5/798: sync 2024-09-04T16:30:35.075 INFO:tasks.workunit.client.0.smithi170.stdout:3/734: creat d13/d14/d1d/d71/de6/fee x:0 0 0 2024-09-04T16:30:35.081 INFO:tasks.workunit.client.0.smithi170.stdout:3/735: mkdir d13/d14/d1f/def 0 2024-09-04T16:30:35.081 INFO:tasks.workunit.client.0.smithi170.stdout:1/893: creat d9/d11/d85/dc5/dca/f133 x:0 0 0 2024-09-04T16:30:35.083 INFO:tasks.workunit.client.0.smithi170.stdout:1/894: dread - d9/d11/d2e/f5d zero size 2024-09-04T16:30:35.086 INFO:tasks.workunit.client.0.smithi170.stdout:5/799: dread d4/d8/d1c/d26/d27/d48/d5a/f79 [0,4194304] 0 2024-09-04T16:30:35.094 INFO:tasks.workunit.client.0.smithi170.stdout:5/800: creat d4/d8/d1c/d26/d27/d88/f107 x:0 0 0 2024-09-04T16:30:35.096 INFO:tasks.workunit.client.0.smithi170.stdout:5/801: write d4/db/d51/d5e/d71/d84/d93/fc8 [1052549,109639] 0 2024-09-04T16:30:35.101 INFO:tasks.workunit.client.0.smithi170.stdout:1/895: dread d9/d11/d2f/fad [0,4194304] 0 2024-09-04T16:30:35.108 INFO:tasks.workunit.client.0.smithi170.stdout:5/802: mknod d4/d8/d1c/d26/d27/d48/ddf/c108 0 2024-09-04T16:30:35.123 INFO:tasks.workunit.client.0.smithi170.stdout:5/803: creat d4/d3a/d74/dd1/f109 x:0 0 0 2024-09-04T16:30:35.124 INFO:tasks.workunit.client.0.smithi170.stdout:5/804: stat d4/d8/d1c/d26/d27/d48/d7c/dd6/lf3 0 2024-09-04T16:30:35.127 INFO:tasks.workunit.client.0.smithi170.stdout:5/805: symlink d4/db/d51/d5e/d71/d84/d93/d106/l10a 0 2024-09-04T16:30:35.139 INFO:tasks.workunit.client.0.smithi170.stdout:8/739: sync 2024-09-04T16:30:35.140 INFO:tasks.workunit.client.0.smithi170.stdout:2/783: sync 2024-09-04T16:30:35.143 INFO:tasks.workunit.client.0.smithi170.stdout:2/784: rmdir d3/d4/d86/dc9/dd9 39 2024-09-04T16:30:35.147 INFO:tasks.workunit.client.0.smithi170.stdout:2/785: read d3/d3c/dc1/d101/d1c/f75 [50866,96753] 0 2024-09-04T16:30:35.149 INFO:tasks.workunit.client.0.smithi170.stdout:8/740: link d6/d28/d16/d52/d73/d5d/fad d6/d28/d16/df2/ffb 0 2024-09-04T16:30:35.153 INFO:tasks.workunit.client.0.smithi170.stdout:8/741: rename d6/d28/d20/d6e/d76/ded to d6/d28/d20/d6e/dfc 0 2024-09-04T16:30:35.155 INFO:tasks.workunit.client.0.smithi170.stdout:2/786: creat d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/f106 x:0 0 0 2024-09-04T16:30:35.160 INFO:tasks.workunit.client.0.smithi170.stdout:8/742: dread d6/d28/d5f/d70/f7d [0,4194304] 0 2024-09-04T16:30:35.161 INFO:tasks.workunit.client.0.smithi170.stdout:2/787: dwrite d3/d3c/dc1/d101/d62/f74 [4194304,4194304] 0 2024-09-04T16:30:35.163 INFO:tasks.workunit.client.0.smithi170.stdout:2/788: dread - d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/f106 zero size 2024-09-04T16:30:35.165 INFO:tasks.workunit.client.0.smithi170.stdout:8/743: unlink d6/d28/d16/d24/d46/c58 0 2024-09-04T16:30:35.170 INFO:tasks.workunit.client.0.smithi170.stdout:8/744: creat d6/d28/d16/ffd x:0 0 0 2024-09-04T16:30:35.174 INFO:tasks.workunit.client.0.smithi170.stdout:8/745: getdents d6/d28/d5f/d70/de8 0 2024-09-04T16:30:35.182 INFO:tasks.workunit.client.0.smithi170.stdout:3/736: dwrite d13/d14/d21/d4d/d4e/fb4 [4194304,4194304] 0 2024-09-04T16:30:35.182 INFO:tasks.workunit.client.0.smithi170.stdout:1/896: truncate d9/d11/dae/d6a/d79/f123 4009859 0 2024-09-04T16:30:35.194 INFO:tasks.workunit.client.0.smithi170.stdout:5/806: dwrite d4/f6 [4194304,4194304] 0 2024-09-04T16:30:35.199 INFO:tasks.workunit.client.0.smithi170.stdout:2/789: write d3/d3c/d40/d48/f54 [4696335,60622] 0 2024-09-04T16:30:35.199 INFO:tasks.workunit.client.0.smithi170.stdout:8/746: write d6/d28/d16/d52/d73/d5d/f89 [75024,100090] 0 2024-09-04T16:30:35.200 INFO:tasks.workunit.client.0.smithi170.stdout:3/737: dread d13/d14/d21/d4d/d4e/d88/dbf/f70 [0,4194304] 0 2024-09-04T16:30:35.241 INFO:tasks.workunit.client.0.smithi170.stdout:1/897: write d9/f54 [2207636,33948] 0 2024-09-04T16:30:35.246 INFO:tasks.workunit.client.0.smithi170.stdout:2/790: mkdir d3/d3c/dc1/d101/d1c/d77/dc2/d107 0 2024-09-04T16:30:35.247 INFO:tasks.workunit.client.0.smithi170.stdout:2/791: chown d3/d4/d14/dcf/l7f 153010 1 2024-09-04T16:30:35.251 INFO:tasks.workunit.client.0.smithi170.stdout:1/898: mkdir d9/d102/d11b/dde/d134 0 2024-09-04T16:30:35.263 INFO:tasks.workunit.client.0.smithi170.stdout:3/738: getdents d13 0 2024-09-04T16:30:35.264 INFO:tasks.workunit.client.0.smithi170.stdout:2/792: getdents d3/d3c/dc1/d101/d1c/d77/dc2/d107 0 2024-09-04T16:30:35.280 INFO:tasks.workunit.client.0.smithi170.stdout:3/739: dread d13/d14/f4b [0,4194304] 0 2024-09-04T16:30:35.293 INFO:tasks.workunit.client.0.smithi170.stdout:3/740: mkdir d13/d14/d17/df0 0 2024-09-04T16:30:35.294 INFO:tasks.workunit.client.0.smithi170.stdout:3/741: chown d13/d14/d1d/f28 7 1 2024-09-04T16:30:35.298 INFO:tasks.workunit.client.0.smithi170.stdout:3/742: mkdir d13/d14/d17/df0/df1 0 2024-09-04T16:30:35.298 INFO:tasks.workunit.client.0.smithi170.stdout:3/743: fsync d13/d14/d21/f2b 0 2024-09-04T16:30:35.302 INFO:tasks.workunit.client.0.smithi170.stdout:3/744: unlink d13/d14/d21/d4d/d4e/d50/fd4 0 2024-09-04T16:30:35.314 INFO:tasks.workunit.client.0.smithi170.stdout:8/747: write d6/f7a [1157411,16921] 0 2024-09-04T16:30:35.328 INFO:tasks.workunit.client.0.smithi170.stdout:1/899: write d9/d11/dae/f82 [1047211,83278] 0 2024-09-04T16:30:35.329 INFO:tasks.workunit.client.0.smithi170.stdout:1/900: stat d9/d26/f36 0 2024-09-04T16:30:35.334 INFO:tasks.workunit.client.0.smithi170.stdout:1/901: dread d9/d11/dae/d6a/d79/d7c/fb2 [0,4194304] 0 2024-09-04T16:30:35.336 INFO:tasks.workunit.client.0.smithi170.stdout:1/902: mknod d9/d11/dae/df5/c135 0 2024-09-04T16:30:35.338 INFO:tasks.workunit.client.0.smithi170.stdout:1/903: creat d9/d11/d85/dc5/dca/f136 x:0 0 0 2024-09-04T16:30:35.344 INFO:tasks.workunit.client.0.smithi170.stdout:1/904: rename d9/d11/d2f/f57 to d9/d11/dae/f137 0 2024-09-04T16:30:35.349 INFO:tasks.workunit.client.0.smithi170.stdout:3/745: mknod d13/d14/cf2 0 2024-09-04T16:30:35.350 INFO:tasks.workunit.client.0.smithi170.stdout:8/748: truncate d6/d28/d16/d52/d73/fb3 4183934 0 2024-09-04T16:30:35.353 INFO:tasks.workunit.client.0.smithi170.stdout:3/746: rename d13/d14/d21/l76 to d13/d14/d17/ded/lf3 0 2024-09-04T16:30:35.356 INFO:tasks.workunit.client.0.smithi170.stdout:8/749: dread d6/d28/d1a/d80/fb9 [0,4194304] 0 2024-09-04T16:30:35.361 INFO:tasks.workunit.client.0.smithi170.stdout:1/905: write d9/d26/f56 [317989,100624] 0 2024-09-04T16:30:35.363 INFO:tasks.workunit.client.0.smithi170.stdout:1/906: unlink d9/d11/cc0 0 2024-09-04T16:30:35.366 INFO:tasks.workunit.client.0.smithi170.stdout:8/750: write d6/d28/d16/d24/d83/fba [20214,41655] 0 2024-09-04T16:30:35.370 INFO:tasks.workunit.client.0.smithi170.stdout:8/751: mknod d6/d28/d20/d5e/cfe 0 2024-09-04T16:30:35.372 INFO:tasks.workunit.client.0.smithi170.stdout:8/752: read d6/d28/d16/d24/d46/fb2 [465797,114991] 0 2024-09-04T16:30:35.384 INFO:tasks.workunit.client.0.smithi170.stdout:0/864: sync 2024-09-04T16:30:35.384 INFO:tasks.workunit.client.0.smithi170.stdout:9/742: sync 2024-09-04T16:30:35.384 INFO:tasks.workunit.client.0.smithi170.stdout:6/666: sync 2024-09-04T16:30:35.384 INFO:tasks.workunit.client.0.smithi170.stdout:4/765: sync 2024-09-04T16:30:35.384 INFO:tasks.workunit.client.0.smithi170.stdout:7/914: sync 2024-09-04T16:30:35.385 INFO:tasks.workunit.client.0.smithi170.stdout:7/915: chown d12/d5a/l6e 5 1 2024-09-04T16:30:35.430 INFO:tasks.workunit.client.0.smithi170.stdout:4/766: creat d1/d6/d8/d20/d35/d3e/d60/f106 x:0 0 0 2024-09-04T16:30:35.431 INFO:tasks.workunit.client.0.smithi170.stdout:4/767: readlink d1/d6/d2b/d47/d78/l92 0 2024-09-04T16:30:35.433 INFO:tasks.workunit.client.0.smithi170.stdout:7/916: fsync d12/d15/d71/d42/d79/d9d/d51/f8b 0 2024-09-04T16:30:35.435 INFO:tasks.workunit.client.0.smithi170.stdout:0/865: mknod d11/d13/d2f/c139 0 2024-09-04T16:30:35.436 INFO:tasks.workunit.client.0.smithi170.stdout:6/667: creat d0/d17/fda x:0 0 0 2024-09-04T16:30:35.444 INFO:tasks.workunit.client.0.smithi170.stdout:6/668: symlink d0/d17/d31/d64/ldb 0 2024-09-04T16:30:35.445 INFO:tasks.workunit.client.0.smithi170.stdout:4/768: write d1/d6/d8/f44 [587276,119676] 0 2024-09-04T16:30:35.446 INFO:tasks.workunit.client.0.smithi170.stdout:9/743: dread d2/d3d/d35/f86 [0,4194304] 0 2024-09-04T16:30:35.450 INFO:tasks.workunit.client.0.smithi170.stdout:0/866: rename d11/d13/d71/c78 to d11/d13/d4a/d66/d8c/dae/c13a 0 2024-09-04T16:30:35.451 INFO:tasks.workunit.client.0.smithi170.stdout:4/769: dread d1/d6/d8/d20/d95/d36/d79/fab [0,4194304] 0 2024-09-04T16:30:35.451 INFO:tasks.workunit.client.0.smithi170.stdout:6/669: symlink d0/df/d1b/d3e/d47/d68/d2d/ldc 0 2024-09-04T16:30:35.452 INFO:tasks.workunit.client.0.smithi170.stdout:4/770: dread - d1/d6/d8/d6c/fe6 zero size 2024-09-04T16:30:35.460 INFO:tasks.workunit.client.0.smithi170.stdout:0/867: dwrite d11/d13/d4a/dbc/f122 [0,4194304] 0 2024-09-04T16:30:35.461 INFO:tasks.workunit.client.0.smithi170.stdout:6/670: dwrite d0/df/d1b/d3e/fb5 [0,4194304] 0 2024-09-04T16:30:35.462 INFO:tasks.workunit.client.0.smithi170.stdout:4/771: mkdir d1/d6/d8/d20/dc1/dd2/d107 0 2024-09-04T16:30:35.463 INFO:tasks.workunit.client.0.smithi170.stdout:7/917: link d12/d16/d1d/d65/d82/da8/c139 d12/d15/d71/d42/d79/d9d/dc9/c13a 0 2024-09-04T16:30:35.463 INFO:tasks.workunit.client.0.smithi170.stdout:0/868: write d11/d75/d77/ff4 [3875792,90655] 0 2024-09-04T16:30:35.464 INFO:tasks.workunit.client.0.smithi170.stdout:6/671: write d0/d17/d31/d64/d30/f91 [459651,38800] 0 2024-09-04T16:30:35.470 INFO:tasks.workunit.client.0.smithi170.stdout:4/772: dread d1/d6/d2b/d47/f59 [0,4194304] 0 2024-09-04T16:30:35.477 INFO:tasks.workunit.client.0.smithi170.stdout:9/744: dwrite d2/d3d/d27/d2b/daf/f9c [0,4194304] 0 2024-09-04T16:30:35.483 INFO:tasks.workunit.client.0.smithi170.stdout:4/773: dread d1/d6/f75 [0,4194304] 0 2024-09-04T16:30:35.487 INFO:tasks.workunit.client.0.smithi170.stdout:7/918: write d12/f30 [5055480,110037] 0 2024-09-04T16:30:35.492 INFO:tasks.workunit.client.0.smithi170.stdout:4/774: creat d1/d6/d8/d20/dae/dd5/f108 x:0 0 0 2024-09-04T16:30:35.492 INFO:tasks.workunit.client.0.smithi170.stdout:6/672: creat d0/df/d1b/d3e/fdd x:0 0 0 2024-09-04T16:30:35.495 INFO:tasks.workunit.client.0.smithi170.stdout:7/919: symlink d12/d16/d1d/d65/d82/dcb/dce/l13b 0 2024-09-04T16:30:35.499 INFO:tasks.workunit.client.0.smithi170.stdout:7/920: unlink d12/d15/l8f 0 2024-09-04T16:30:35.499 INFO:tasks.workunit.client.0.smithi170.stdout:6/673: dwrite d0/f16 [0,4194304] 0 2024-09-04T16:30:35.499 INFO:tasks.workunit.client.0.smithi170.stdout:7/921: chown d12/d15/d41 50725 1 2024-09-04T16:30:35.501 INFO:tasks.workunit.client.0.smithi170.stdout:4/775: creat d1/d6/d8/d20/dc1/dd2/d107/f109 x:0 0 0 2024-09-04T16:30:35.505 INFO:tasks.workunit.client.0.smithi170.stdout:6/674: dread d0/df/d1b/d3e/fb5 [0,4194304] 0 2024-09-04T16:30:35.507 INFO:tasks.workunit.client.0.smithi170.stdout:7/922: symlink d12/d16/db7/deb/l13c 0 2024-09-04T16:30:35.509 INFO:tasks.workunit.client.0.smithi170.stdout:7/923: chown d12/d16/d1d/d65/dd0/ld9 9104388 1 2024-09-04T16:30:35.512 INFO:tasks.workunit.client.0.smithi170.stdout:9/745: dwrite d2/d32/f61 [0,4194304] 0 2024-09-04T16:30:35.520 INFO:tasks.workunit.client.0.smithi170.stdout:7/924: mkdir d12/d15/d71/d42/d79/de5/d13d 0 2024-09-04T16:30:35.520 INFO:tasks.workunit.client.0.smithi170.stdout:4/776: write d1/d6/d8/d20/d95/d36/d79/fa3 [4564711,107069] 0 2024-09-04T16:30:35.521 INFO:tasks.workunit.client.0.smithi170.stdout:9/746: fsync d2/d3d/d27/d65/d56/d7a/fb7 0 2024-09-04T16:30:35.522 INFO:tasks.workunit.client.0.smithi170.stdout:7/925: chown d12/d15/d71/d42/d79/d9d/d51/f8b 217409 1 2024-09-04T16:30:35.523 INFO:tasks.workunit.client.0.smithi170.stdout:9/747: chown d2/d3d/d4d/d59/cac 92 1 2024-09-04T16:30:35.524 INFO:tasks.workunit.client.0.smithi170.stdout:7/926: chown d12/d16/d1d/d65/d82/da8/lf7 236352 1 2024-09-04T16:30:35.525 INFO:tasks.workunit.client.0.smithi170.stdout:7/927: chown d12/d16/d1d 4137632 1 2024-09-04T16:30:35.528 INFO:tasks.workunit.client.0.smithi170.stdout:4/777: symlink d1/d6/d2b/l10a 0 2024-09-04T16:30:35.528 INFO:tasks.workunit.client.0.smithi170.stdout:9/748: dwrite d2/fa8 [0,4194304] 0 2024-09-04T16:30:35.529 INFO:tasks.workunit.client.0.smithi170.stdout:6/675: write d0/df/d1b/d3e/d47/d68/f41 [2843520,14741] 0 2024-09-04T16:30:35.531 INFO:tasks.workunit.client.0.smithi170.stdout:6/676: write d0/d17/d31/d64/d30/f91 [2772560,63089] 0 2024-09-04T16:30:35.532 INFO:tasks.workunit.client.0.smithi170.stdout:4/778: symlink d1/d6/d8/d20/dae/dd5/l10b 0 2024-09-04T16:30:35.536 INFO:tasks.workunit.client.0.smithi170.stdout:4/779: mknod d1/d6/d2b/db3/c10c 0 2024-09-04T16:30:35.539 INFO:tasks.workunit.client.0.smithi170.stdout:6/677: mknod d0/d15/d56/d6c/d98/cde 0 2024-09-04T16:30:35.539 INFO:tasks.workunit.client.0.smithi170.stdout:6/678: stat d0/d17/f18 0 2024-09-04T16:30:35.541 INFO:tasks.workunit.client.0.smithi170.stdout:6/679: chown d0/df/d1b/d3e/d47/d68/d2d/d67 1966636691 1 2024-09-04T16:30:35.543 INFO:tasks.workunit.client.0.smithi170.stdout:7/928: link d12/d15/c9b d12/d16/d1d/d65/d7b/c13e 0 2024-09-04T16:30:35.546 INFO:tasks.workunit.client.0.smithi170.stdout:6/680: rename d0/df/d1b/d3e/d47/d68/f61 to d0/df/d1f/fdf 0 2024-09-04T16:30:35.547 INFO:tasks.workunit.client.0.smithi170.stdout:7/929: rmdir d12/d16/d8d 39 2024-09-04T16:30:35.548 INFO:tasks.workunit.client.0.smithi170.stdout:9/749: dwrite d2/d3d/d3f/f89 [0,4194304] 0 2024-09-04T16:30:35.550 INFO:tasks.workunit.client.0.smithi170.stdout:6/681: write d0/df/d1b/d3e/d47/d68/d2d/d2e/fa4 [1949791,19142] 0 2024-09-04T16:30:35.555 INFO:tasks.workunit.client.0.smithi170.stdout:9/750: creat d2/d11/d23/fe4 x:0 0 0 2024-09-04T16:30:35.557 INFO:tasks.workunit.client.0.smithi170.stdout:4/780: dwrite d1/d6/d22/f62 [0,4194304] 0 2024-09-04T16:30:35.559 INFO:tasks.workunit.client.0.smithi170.stdout:7/930: creat d12/d15/d71/d42/d79/d9d/f13f x:0 0 0 2024-09-04T16:30:35.561 INFO:tasks.workunit.client.0.smithi170.stdout:9/751: rmdir d2/d3d 39 2024-09-04T16:30:35.564 INFO:tasks.workunit.client.0.smithi170.stdout:6/682: symlink d0/df/d1b/d3e/le0 0 2024-09-04T16:30:35.566 INFO:tasks.workunit.client.0.smithi170.stdout:4/781: creat d1/d6/d2b/db3/de8/f10d x:0 0 0 2024-09-04T16:30:35.571 INFO:tasks.workunit.client.0.smithi170.stdout:7/931: dwrite d12/d15/d71/d42/f134 [0,4194304] 0 2024-09-04T16:30:35.580 INFO:tasks.workunit.client.0.smithi170.stdout:4/782: dwrite d1/d6/d8/f44 [0,4194304] 0 2024-09-04T16:30:35.587 INFO:tasks.workunit.client.0.smithi170.stdout:9/752: write d2/d11/d23/f30 [873235,103857] 0 2024-09-04T16:30:35.587 INFO:tasks.workunit.client.0.smithi170.stdout:7/932: dwrite d12/d15/d71/fe0 [0,4194304] 0 2024-09-04T16:30:35.590 INFO:tasks.workunit.client.0.smithi170.stdout:6/683: dread d0/df/d1b/d3e/d47/d68/f41 [0,4194304] 0 2024-09-04T16:30:35.592 INFO:tasks.workunit.client.0.smithi170.stdout:4/783: mknod d1/d6/d8/d20/dc1/dd2/c10e 0 2024-09-04T16:30:35.593 INFO:tasks.workunit.client.0.smithi170.stdout:9/753: dread - d2/d3d/d27/f64 zero size 2024-09-04T16:30:35.595 INFO:tasks.workunit.client.0.smithi170.stdout:9/754: fdatasync d2/d3d/d27/f3a 0 2024-09-04T16:30:35.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:35 smithi170 ceph-mon[29272]: pgmap v37: 65 pgs: 65 active+clean; 3.1 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 90 MiB/s rd, 216 MiB/s wr, 515 op/s 2024-09-04T16:30:35.602 INFO:tasks.workunit.client.0.smithi170.stdout:6/684: dwrite d0/df/d1b/d3e/d47/d68/d2d/d2e/fa4 [0,4194304] 0 2024-09-04T16:30:35.606 INFO:tasks.workunit.client.0.smithi170.stdout:7/933: dwrite d12/d15/d68/f9a [0,4194304] 0 2024-09-04T16:30:35.607 INFO:tasks.workunit.client.0.smithi170.stdout:6/685: truncate d0/df/d1b/d3e/d47/d68/d2d/f8c 1680600 0 2024-09-04T16:30:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:35 smithi193 ceph-mon[36288]: pgmap v37: 65 pgs: 65 active+clean; 3.1 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 90 MiB/s rd, 216 MiB/s wr, 515 op/s 2024-09-04T16:30:35.701 INFO:tasks.workunit.client.0.smithi170.stdout:5/807: sync 2024-09-04T16:30:35.702 INFO:tasks.workunit.client.0.smithi170.stdout:7/934: mkdir d12/d16/d1d/d140 0 2024-09-04T16:30:35.703 INFO:tasks.workunit.client.0.smithi170.stdout:6/686: read - d0/df/d1b/d3e/d47/d68/d2d/d67/f96 zero size 2024-09-04T16:30:35.704 INFO:tasks.workunit.client.0.smithi170.stdout:7/935: rmdir d12/d15 39 2024-09-04T16:30:35.705 INFO:tasks.workunit.client.0.smithi170.stdout:9/755: dwrite d2/d3d/d4d/fd3 [0,4194304] 0 2024-09-04T16:30:35.720 INFO:tasks.workunit.client.0.smithi170.stdout:5/808: dwrite d4/d8/d1c/d26/d27/d48/f52 [0,4194304] 0 2024-09-04T16:30:35.724 INFO:tasks.workunit.client.0.smithi170.stdout:5/809: fsync d4/d8/d1c/d26/d27/f38 0 2024-09-04T16:30:35.727 INFO:tasks.workunit.client.0.smithi170.stdout:9/756: dwrite d2/d32/fc8 [0,4194304] 0 2024-09-04T16:30:35.728 INFO:tasks.workunit.client.0.smithi170.stdout:6/687: rename d0/d15/d56/d6c/f81 to d0/d17/fe1 0 2024-09-04T16:30:35.728 INFO:tasks.workunit.client.0.smithi170.stdout:5/810: chown d4/db/d51/d5e/d71/d84/d93/d106/d39/f40 385402 1 2024-09-04T16:30:35.735 INFO:tasks.workunit.client.0.smithi170.stdout:6/688: link d0/f16 d0/d17/fe2 0 2024-09-04T16:30:35.740 INFO:tasks.workunit.client.0.smithi170.stdout:6/689: creat d0/d15/d56/fe3 x:0 0 0 2024-09-04T16:30:35.741 INFO:tasks.workunit.client.0.smithi170.stdout:9/757: write d2/d3d/d27/fb5 [76762,60299] 0 2024-09-04T16:30:35.744 INFO:tasks.workunit.client.0.smithi170.stdout:9/758: mkdir d2/d11/d8f/de1/de5 0 2024-09-04T16:30:35.744 INFO:tasks.workunit.client.0.smithi170.stdout:6/690: dread d0/df/d1b/d3e/d47/d68/d2d/d2e/f43 [0,4194304] 0 2024-09-04T16:30:35.745 INFO:tasks.workunit.client.0.smithi170.stdout:6/691: readlink d0/d17/d31/d64/l71 0 2024-09-04T16:30:35.747 INFO:tasks.workunit.client.0.smithi170.stdout:9/759: creat d2/d3d/d27/d2b/daf/fe6 x:0 0 0 2024-09-04T16:30:35.750 INFO:tasks.workunit.client.0.smithi170.stdout:6/692: symlink d0/d17/d31/d64/d30/le4 0 2024-09-04T16:30:35.751 INFO:tasks.workunit.client.0.smithi170.stdout:6/693: readlink d0/df/d1b/l55 0 2024-09-04T16:30:35.751 INFO:tasks.workunit.client.0.smithi170.stdout:9/760: symlink d2/d11/d58/dd4/le7 0 2024-09-04T16:30:35.752 INFO:tasks.workunit.client.0.smithi170.stdout:6/694: chown d0/d17/f1c 110182941 1 2024-09-04T16:30:35.755 INFO:tasks.workunit.client.0.smithi170.stdout:6/695: truncate d0/df/d1b/d3e/f89 274102 0 2024-09-04T16:30:35.757 INFO:tasks.workunit.client.0.smithi170.stdout:9/761: rename d2/d3d/d27/d65/f37 to d2/d11/d8f/fe8 0 2024-09-04T16:30:35.758 INFO:tasks.workunit.client.0.smithi170.stdout:6/696: symlink d0/df/d1b/d3e/d47/d68/d2d/d67/le5 0 2024-09-04T16:30:35.762 INFO:tasks.workunit.client.0.smithi170.stdout:9/762: dread d2/d3d/f57 [0,4194304] 0 2024-09-04T16:30:35.764 INFO:tasks.workunit.client.0.smithi170.stdout:6/697: getdents d0/df/d1b 0 2024-09-04T16:30:35.767 INFO:tasks.workunit.client.0.smithi170.stdout:6/698: mkdir d0/df/d1b/d3e/d47/de6 0 2024-09-04T16:30:35.781 INFO:tasks.workunit.client.0.smithi170.stdout:6/699: dread d0/f14 [0,4194304] 0 2024-09-04T16:30:35.781 INFO:tasks.workunit.client.0.smithi170.stdout:9/763: write d2/d11/f12 [5639686,46329] 0 2024-09-04T16:30:35.783 INFO:tasks.workunit.client.0.smithi170.stdout:6/700: creat d0/d17/dbd/fe7 x:0 0 0 2024-09-04T16:30:35.785 INFO:tasks.workunit.client.0.smithi170.stdout:9/764: creat d2/d3d/d27/d65/d56/d7a/fe9 x:0 0 0 2024-09-04T16:30:35.787 INFO:tasks.workunit.client.0.smithi170.stdout:9/765: mknod d2/d3d/d3f/d90/cea 0 2024-09-04T16:30:35.790 INFO:tasks.workunit.client.0.smithi170.stdout:6/701: dwrite d0/d17/d31/d64/d30/f84 [0,4194304] 0 2024-09-04T16:30:35.790 INFO:tasks.workunit.client.0.smithi170.stdout:9/766: fdatasync d2/d3d/d4d/d59/d85/fb9 0 2024-09-04T16:30:35.796 INFO:tasks.workunit.client.0.smithi170.stdout:6/702: dread d0/d17/d31/f5a [0,4194304] 0 2024-09-04T16:30:35.797 INFO:tasks.workunit.client.0.smithi170.stdout:9/767: creat d2/d3d/d27/d65/d56/d7a/da5/feb x:0 0 0 2024-09-04T16:30:35.800 INFO:tasks.workunit.client.0.smithi170.stdout:6/703: mknod d0/df/ce8 0 2024-09-04T16:30:35.802 INFO:tasks.workunit.client.0.smithi170.stdout:6/704: symlink d0/d17/d39/le9 0 2024-09-04T16:30:35.804 INFO:tasks.workunit.client.0.smithi170.stdout:9/768: link d2/d3d/d4d/d59/d85/f8a d2/d3d/d6d/d79/db0/fec 0 2024-09-04T16:30:35.806 INFO:tasks.workunit.client.0.smithi170.stdout:6/705: creat d0/dbf/fea x:0 0 0 2024-09-04T16:30:35.808 INFO:tasks.workunit.client.0.smithi170.stdout:6/706: rmdir d0/d17 39 2024-09-04T16:30:35.810 INFO:tasks.workunit.client.0.smithi170.stdout:9/769: rename d2/d3d/d27/d2b/l99 to d2/d3d/led 0 2024-09-04T16:30:35.813 INFO:tasks.workunit.client.0.smithi170.stdout:6/707: fdatasync d0/d17/d31/d64/d30/f51 0 2024-09-04T16:30:35.817 INFO:tasks.workunit.client.0.smithi170.stdout:9/770: dwrite d2/d3d/d27/d65/d56/d7a/da5/fb8 [4194304,4194304] 0 2024-09-04T16:30:35.819 INFO:tasks.workunit.client.0.smithi170.stdout:6/708: dread d0/df/d1b/d3e/d47/d68/d2d/d2e/f43 [0,4194304] 0 2024-09-04T16:30:35.889 INFO:tasks.workunit.client.0.smithi170.stdout:2/793: sync 2024-09-04T16:30:35.889 INFO:tasks.workunit.client.0.smithi170.stdout:3/747: sync 2024-09-04T16:30:35.890 INFO:tasks.workunit.client.0.smithi170.stdout:9/771: rename d2/d3d/d27/d65/d56 to d2/d3d/d27/d65/dcb/de0/dee 0 2024-09-04T16:30:35.891 INFO:tasks.workunit.client.0.smithi170.stdout:9/772: fsync d2/d11/d58/fd5 0 2024-09-04T16:30:35.891 INFO:tasks.workunit.client.0.smithi170.stdout:6/709: creat d0/d15/d56/d6c/feb x:0 0 0 2024-09-04T16:30:35.921 INFO:tasks.workunit.client.0.smithi170.stdout:2/794: unlink d3/d3c/dc1/d101/d1c/d77/dc2/fe6 0 2024-09-04T16:30:35.923 INFO:tasks.workunit.client.0.smithi170.stdout:9/773: mkdir d2/d3d/d6d/d79/def 0 2024-09-04T16:30:35.928 INFO:tasks.workunit.client.0.smithi170.stdout:2/795: symlink d3/d4/d86/dfe/l108 0 2024-09-04T16:30:35.930 INFO:tasks.workunit.client.0.smithi170.stdout:3/748: dwrite d13/d14/d17/f7b [0,4194304] 0 2024-09-04T16:30:35.932 INFO:tasks.workunit.client.0.smithi170.stdout:9/774: mkdir d2/d3d/d6d/d79/def/df0 0 2024-09-04T16:30:35.934 INFO:tasks.workunit.client.0.smithi170.stdout:6/710: creat d0/df/d1b/d3e/fec x:0 0 0 2024-09-04T16:30:35.937 INFO:tasks.workunit.client.0.smithi170.stdout:6/711: write d0/d15/d56/fc0 [135766,113378] 0 2024-09-04T16:30:35.938 INFO:tasks.workunit.client.0.smithi170.stdout:2/796: rename d3/d3c/dc1/d101/df/d45/f9b to d3/d3c/dc1/d101/d62/f109 0 2024-09-04T16:30:35.939 INFO:tasks.workunit.client.0.smithi170.stdout:2/797: chown d3/d3c/d40/l56 7954 1 2024-09-04T16:30:35.942 INFO:tasks.workunit.client.0.smithi170.stdout:6/712: dread d0/d17/d5b/fa2 [0,4194304] 0 2024-09-04T16:30:35.942 INFO:tasks.workunit.client.0.smithi170.stdout:2/798: read d3/d7/fd8 [3186810,23615] 0 2024-09-04T16:30:35.944 INFO:tasks.workunit.client.0.smithi170.stdout:9/775: mkdir d2/d11/d8f/df1 0 2024-09-04T16:30:35.946 INFO:tasks.workunit.client.0.smithi170.stdout:2/799: symlink d3/d7/l10a 0 2024-09-04T16:30:35.947 INFO:tasks.workunit.client.0.smithi170.stdout:6/713: symlink d0/d17/d39/led 0 2024-09-04T16:30:35.953 INFO:tasks.workunit.client.0.smithi170.stdout:2/800: dread d3/d3c/d40/f41 [0,4194304] 0 2024-09-04T16:30:35.954 INFO:tasks.workunit.client.0.smithi170.stdout:6/714: mknod d0/d17/d39/d99/cee 0 2024-09-04T16:30:35.955 INFO:tasks.workunit.client.0.smithi170.stdout:2/801: readlink d3/d3c/dc1/d101/l58 0 2024-09-04T16:30:35.956 INFO:tasks.workunit.client.0.smithi170.stdout:2/802: stat d3/d3c/dc1/d101/dc5/f102 0 2024-09-04T16:30:35.957 INFO:tasks.workunit.client.0.smithi170.stdout:3/749: dwrite d13/d14/d1f/f73 [4194304,4194304] 0 2024-09-04T16:30:35.957 INFO:tasks.workunit.client.0.smithi170.stdout:9/776: write d2/d32/f93 [4041547,52130] 0 2024-09-04T16:30:35.958 INFO:tasks.workunit.client.0.smithi170.stdout:2/803: stat d3/d3c/dc1/d101/ff9 0 2024-09-04T16:30:35.962 INFO:tasks.workunit.client.0.smithi170.stdout:2/804: fdatasync d3/d3c/dc1/d101/f3b 0 2024-09-04T16:30:35.963 INFO:tasks.workunit.client.0.smithi170.stdout:9/777: mknod d2/d11/d8f/de1/de5/cf2 0 2024-09-04T16:30:35.965 INFO:tasks.workunit.client.0.smithi170.stdout:6/715: dwrite d0/d9f/fce [0,4194304] 0 2024-09-04T16:30:35.970 INFO:tasks.workunit.client.0.smithi170.stdout:3/750: mknod d13/d14/d21/cf4 0 2024-09-04T16:30:36.016 INFO:tasks.workunit.client.0.smithi170.stdout:9/778: truncate d2/d3d/f20 4911250 0 2024-09-04T16:30:36.017 INFO:tasks.workunit.client.0.smithi170.stdout:9/779: chown d2/d3d/d6d/lcc 15980 1 2024-09-04T16:30:36.019 INFO:tasks.workunit.client.0.smithi170.stdout:2/805: rename d3/l55 to d3/d3c/dc1/l10b 0 2024-09-04T16:30:36.019 INFO:tasks.workunit.client.0.smithi170.stdout:9/780: dread d2/d3d/d27/d65/d5b/f83 [0,4194304] 0 2024-09-04T16:30:36.019 INFO:tasks.workunit.client.0.smithi170.stdout:6/716: dread d0/f16 [0,4194304] 0 2024-09-04T16:30:36.020 INFO:tasks.workunit.client.0.smithi170.stdout:9/781: readlink d2/d3d/d27/d2b/daf/l9e 0 2024-09-04T16:30:36.021 INFO:tasks.workunit.client.0.smithi170.stdout:3/751: dread d13/d14/d1d/d71/db3/dbd/fc4 [0,4194304] 0 2024-09-04T16:30:36.022 INFO:tasks.workunit.client.0.smithi170.stdout:6/717: rmdir d0/d17/d31/d64/d30 39 2024-09-04T16:30:36.025 INFO:tasks.workunit.client.0.smithi170.stdout:3/752: dread d13/d14/d1f/f73 [4194304,4194304] 0 2024-09-04T16:30:36.025 INFO:tasks.workunit.client.0.smithi170.stdout:6/718: mknod d0/d17/d5b/cef 0 2024-09-04T16:30:36.027 INFO:tasks.workunit.client.0.smithi170.stdout:3/753: write d13/d14/d1f/d7a/dc8/fdd [415063,98233] 0 2024-09-04T16:30:36.034 INFO:tasks.workunit.client.0.smithi170.stdout:6/719: dread - d0/dbf/fea zero size 2024-09-04T16:30:36.035 INFO:tasks.workunit.client.0.smithi170.stdout:3/754: truncate d13/f5f 8142278 0 2024-09-04T16:30:36.036 INFO:tasks.workunit.client.0.smithi170.stdout:6/720: chown d0/df/d1b/d3e/d47/d68/d2d/d67/d73/l88 57659729 1 2024-09-04T16:30:36.037 INFO:tasks.workunit.client.0.smithi170.stdout:3/755: mknod d13/d14/d17/df0/cf5 0 2024-09-04T16:30:36.038 INFO:tasks.workunit.client.0.smithi170.stdout:3/756: chown d13/d14/d1d/d2d/f34 195 1 2024-09-04T16:30:36.040 INFO:tasks.workunit.client.0.smithi170.stdout:3/757: mknod d13/d14/d21/d4d/d4e/d88/dbf/cf6 0 2024-09-04T16:30:36.040 INFO:tasks.workunit.client.0.smithi170.stdout:3/758: write d13/d14/d21/faf [707074,36166] 0 2024-09-04T16:30:36.044 INFO:tasks.workunit.client.0.smithi170.stdout:3/759: rename d13/d14/d21/f9d to d13/d14/d21/d4d/d4e/ff7 0 2024-09-04T16:30:36.046 INFO:tasks.workunit.client.0.smithi170.stdout:3/760: rmdir d13/d14/d1d/da4/da8 39 2024-09-04T16:30:36.050 INFO:tasks.workunit.client.0.smithi170.stdout:3/761: link d13/d14/d21/f36 d13/d14/d1d/da4/ff8 0 2024-09-04T16:30:36.053 INFO:tasks.workunit.client.0.smithi170.stdout:3/762: dread d13/d14/f4b [0,4194304] 0 2024-09-04T16:30:36.060 INFO:tasks.workunit.client.0.smithi170.stdout:3/763: rmdir d13/d14/d17/d1c/dda 0 2024-09-04T16:30:36.063 INFO:tasks.workunit.client.0.smithi170.stdout:3/764: unlink c9 0 2024-09-04T16:30:36.066 INFO:tasks.workunit.client.0.smithi170.stdout:9/782: truncate d2/d3d/d4d/f82 686428 0 2024-09-04T16:30:36.066 INFO:tasks.workunit.client.0.smithi170.stdout:2/806: dwrite d3/d3c/dc1/d101/d62/d6f/f9d [0,4194304] 0 2024-09-04T16:30:36.072 INFO:tasks.workunit.client.0.smithi170.stdout:6/721: write d0/df/d1b/d3e/d47/d68/d2d/fc9 [2436207,63753] 0 2024-09-04T16:30:36.075 INFO:tasks.workunit.client.0.smithi170.stdout:3/765: dwrite d13/d14/d1d/d71/db3/db6/faa [0,4194304] 0 2024-09-04T16:30:36.076 INFO:tasks.workunit.client.0.smithi170.stdout:1/907: sync 2024-09-04T16:30:36.079 INFO:tasks.workunit.client.0.smithi170.stdout:6/722: creat d0/d15/d56/d6c/db8/ff0 x:0 0 0 2024-09-04T16:30:36.083 INFO:tasks.workunit.client.0.smithi170.stdout:1/908: mkdir d9/d11/d2f/d6b/d61/d138 0 2024-09-04T16:30:36.084 INFO:tasks.workunit.client.0.smithi170.stdout:1/909: stat d9/d26/d77/fbb 0 2024-09-04T16:30:36.086 INFO:tasks.workunit.client.0.smithi170.stdout:3/766: dwrite d13/d14/d1f/d7a/dc8/fd6 [0,4194304] 0 2024-09-04T16:30:36.090 INFO:tasks.workunit.client.0.smithi170.stdout:6/723: mknod d0/df/d1b/d3e/d47/de6/cf1 0 2024-09-04T16:30:36.093 INFO:tasks.workunit.client.0.smithi170.stdout:3/767: creat d13/d14/d1d/d71/db3/db6/ff9 x:0 0 0 2024-09-04T16:30:36.094 INFO:tasks.workunit.client.0.smithi170.stdout:1/910: symlink d9/d11/dae/d6a/l139 0 2024-09-04T16:30:36.099 INFO:tasks.workunit.client.0.smithi170.stdout:3/768: creat d13/d14/d1d/ffa x:0 0 0 2024-09-04T16:30:36.100 INFO:tasks.workunit.client.0.smithi170.stdout:3/769: fdatasync d13/d14/d1f/d87/f93 0 2024-09-04T16:30:36.101 INFO:tasks.workunit.client.0.smithi170.stdout:1/911: dread d9/d11/f10c [0,4194304] 0 2024-09-04T16:30:36.104 INFO:tasks.workunit.client.0.smithi170.stdout:3/770: mknod d13/d14/d17/df0/df1/cfb 0 2024-09-04T16:30:36.107 INFO:tasks.workunit.client.0.smithi170.stdout:1/912: rename d9/d105/d11f to d9/d11/d85/dd8/dee/d13a 0 2024-09-04T16:30:36.109 INFO:tasks.workunit.client.0.smithi170.stdout:1/913: write d9/f54 [2385840,22585] 0 2024-09-04T16:30:36.110 INFO:tasks.workunit.client.0.smithi170.stdout:6/724: dread d0/d17/d39/f72 [0,4194304] 0 2024-09-04T16:30:36.110 INFO:tasks.workunit.client.0.smithi170.stdout:1/914: read d9/d11/f1e [640947,109909] 0 2024-09-04T16:30:36.114 INFO:tasks.workunit.client.0.smithi170.stdout:6/725: dread d0/d17/d5b/fa2 [0,4194304] 0 2024-09-04T16:30:36.114 INFO:tasks.workunit.client.0.smithi170.stdout:6/726: chown d0/df/c8 3549 1 2024-09-04T16:30:36.115 INFO:tasks.workunit.client.0.smithi170.stdout:6/727: chown d0/d17/dbd/fc4 61304313 1 2024-09-04T16:30:36.118 INFO:tasks.workunit.client.0.smithi170.stdout:1/915: truncate d9/d11/fac 401666 0 2024-09-04T16:30:36.119 INFO:tasks.workunit.client.0.smithi170.stdout:1/916: chown d9/d11/d2f/d6b/d61/d108/c121 248742894 1 2024-09-04T16:30:36.120 INFO:tasks.workunit.client.0.smithi170.stdout:1/917: write d9/d26/f36 [5029613,66507] 0 2024-09-04T16:30:36.121 INFO:tasks.workunit.client.0.smithi170.stdout:6/728: unlink d0/df/d7e/c93 0 2024-09-04T16:30:36.127 INFO:tasks.workunit.client.0.smithi170.stdout:1/918: mkdir d9/d7b/d8f/d13b 0 2024-09-04T16:30:36.128 INFO:tasks.workunit.client.0.smithi170.stdout:6/729: fdatasync d0/df/d1b/d3e/d47/d68/d2d/d2e/faa 0 2024-09-04T16:30:36.128 INFO:tasks.workunit.client.0.smithi170.stdout:1/919: chown d9/d11/d85/dd8/l113 13 1 2024-09-04T16:30:36.133 INFO:tasks.workunit.client.0.smithi170.stdout:6/730: mknod d0/df/d1f/dcf/cf2 0 2024-09-04T16:30:36.136 INFO:tasks.workunit.client.0.smithi170.stdout:2/807: write d3/d3c/dc1/d101/d1c/f2a [2743541,70253] 0 2024-09-04T16:30:36.139 INFO:tasks.workunit.client.0.smithi170.stdout:6/731: rename d0/df/l12 to d0/d17/dbd/lf3 0 2024-09-04T16:30:36.146 INFO:tasks.workunit.client.0.smithi170.stdout:6/732: mkdir d0/d17/d31/d64/df4 0 2024-09-04T16:30:36.149 INFO:tasks.workunit.client.0.smithi170.stdout:6/733: fsync d0/df/d1b/d3e/d47/d68/d2d/d67/f96 0 2024-09-04T16:30:36.152 INFO:tasks.workunit.client.0.smithi170.stdout:6/734: rmdir d0/d15/d56 39 2024-09-04T16:30:36.154 INFO:tasks.workunit.client.0.smithi170.stdout:2/808: dread d3/d3c/dc1/d101/d1c/fbf [0,4194304] 0 2024-09-04T16:30:36.159 INFO:tasks.workunit.client.0.smithi170.stdout:2/809: creat d3/d3c/dc1/d101/df/d45/f10c x:0 0 0 2024-09-04T16:30:36.161 INFO:tasks.workunit.client.0.smithi170.stdout:6/735: dread d0/df/f28 [0,4194304] 0 2024-09-04T16:30:36.166 INFO:tasks.workunit.client.0.smithi170.stdout:6/736: rmdir d0/df/d1b/d3e/d47/d68/d2d 39 2024-09-04T16:30:36.169 INFO:tasks.workunit.client.0.smithi170.stdout:2/810: link d3/d4/f52 d3/d3c/dc1/d101/d62/f10d 0 2024-09-04T16:30:36.173 INFO:tasks.workunit.client.0.smithi170.stdout:6/737: creat d0/df/d1b/d3e/d47/d68/d2d/d67/ff5 x:0 0 0 2024-09-04T16:30:36.174 INFO:tasks.workunit.client.0.smithi170.stdout:2/811: creat d3/d3c/d40/d48/f10e x:0 0 0 2024-09-04T16:30:36.182 INFO:tasks.workunit.client.0.smithi170.stdout:3/771: write d13/d14/d1f/f60 [4478527,63253] 0 2024-09-04T16:30:36.182 INFO:tasks.workunit.client.0.smithi170.stdout:2/812: dwrite d3/d3c/dc1/d101/df/fc7 [0,4194304] 0 2024-09-04T16:30:36.188 INFO:tasks.workunit.client.0.smithi170.stdout:2/813: creat d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/dee/f10f x:0 0 0 2024-09-04T16:30:36.189 INFO:tasks.workunit.client.0.smithi170.stdout:2/814: chown d3/d7/cc6 14430 1 2024-09-04T16:30:36.190 INFO:tasks.workunit.client.0.smithi170.stdout:1/920: truncate d9/d11/d9b/fb8 3105106 0 2024-09-04T16:30:36.193 INFO:tasks.workunit.client.0.smithi170.stdout:2/815: rename d3/d4/d14 to d3/d3c/dc1/d101/d62/d6f/d110 0 2024-09-04T16:30:36.198 INFO:tasks.workunit.client.0.smithi170.stdout:1/921: link d9/d26/f56 d9/d7b/d8f/f13c 0 2024-09-04T16:30:36.200 INFO:tasks.workunit.client.0.smithi170.stdout:1/922: chown d9/d11/d2f/d6b/d61/d124 9978396 1 2024-09-04T16:30:36.203 INFO:tasks.workunit.client.0.smithi170.stdout:2/816: dwrite d3/d3c/dc1/d101/dc5/f102 [0,4194304] 0 2024-09-04T16:30:36.205 INFO:tasks.workunit.client.0.smithi170.stdout:6/738: write d0/df/d1b/d3e/d47/d68/f5d [1817439,108996] 0 2024-09-04T16:30:36.206 INFO:tasks.workunit.client.0.smithi170.stdout:1/923: rename d9/f55 to d9/d11/d85/dc5/dca/f13d 0 2024-09-04T16:30:36.208 INFO:tasks.workunit.client.0.smithi170.stdout:2/817: creat d3/d3c/d40/d48/f111 x:0 0 0 2024-09-04T16:30:36.212 INFO:tasks.workunit.client.0.smithi170.stdout:1/924: creat d9/d26/d77/d83/f13e x:0 0 0 2024-09-04T16:30:36.214 INFO:tasks.workunit.client.0.smithi170.stdout:3/772: dwrite d13/d14/d1d/d71/db3/db6/d9e/f5a [0,4194304] 0 2024-09-04T16:30:36.217 INFO:tasks.workunit.client.0.smithi170.stdout:3/773: read d13/d14/d1f/d7a/dc8/fdd [25721,15238] 0 2024-09-04T16:30:36.221 INFO:tasks.workunit.client.0.smithi170.stdout:1/925: unlink d9/d11/dae/d6a/d79/d7c/c107 0 2024-09-04T16:30:36.228 INFO:tasks.workunit.client.0.smithi170.stdout:1/926: dread - d9/d11/d2e/fd2 zero size 2024-09-04T16:30:36.228 INFO:tasks.workunit.client.0.smithi170.stdout:3/774: dread d13/d14/d21/d4d/d4e/fb9 [0,4194304] 0 2024-09-04T16:30:36.231 INFO:tasks.workunit.client.0.smithi170.stdout:6/739: dread d0/d17/fb4 [0,4194304] 0 2024-09-04T16:30:36.231 INFO:tasks.workunit.client.0.smithi170.stdout:2/818: truncate d3/d3c/dc1/ff0 1483159 0 2024-09-04T16:30:36.232 INFO:tasks.workunit.client.0.smithi170.stdout:2/819: readlink d3/d7/l10a 0 2024-09-04T16:30:36.232 INFO:tasks.workunit.client.0.smithi170.stdout:8/753: sync 2024-09-04T16:30:36.232 INFO:tasks.workunit.client.0.smithi170.stdout:0/869: sync 2024-09-04T16:30:36.234 INFO:tasks.workunit.client.0.smithi170.stdout:3/775: symlink d13/d14/d1d/d71/de6/lfc 0 2024-09-04T16:30:36.235 INFO:tasks.workunit.client.0.smithi170.stdout:3/776: readlink d13/d14/d1d/d71/db3/db6/l56 0 2024-09-04T16:30:36.240 INFO:tasks.workunit.client.0.smithi170.stdout:2/820: truncate d3/d3c/dc1/d101/df/f39 1085141 0 2024-09-04T16:30:36.241 INFO:tasks.workunit.client.0.smithi170.stdout:0/870: mkdir d11/d13/d36/d12b/d13b 0 2024-09-04T16:30:36.243 INFO:tasks.workunit.client.0.smithi170.stdout:3/777: mknod d13/d14/d1d/d71/db3/db6/cfd 0 2024-09-04T16:30:36.243 INFO:tasks.workunit.client.0.smithi170.stdout:1/927: dwrite d9/d11/f43 [0,4194304] 0 2024-09-04T16:30:36.244 INFO:tasks.workunit.client.0.smithi170.stdout:3/778: stat d13/d14/d21/fd7 0 2024-09-04T16:30:36.245 INFO:tasks.workunit.client.0.smithi170.stdout:3/779: chown d13/d14/d1d/lcd 18262 1 2024-09-04T16:30:36.245 INFO:tasks.workunit.client.0.smithi170.stdout:8/754: mknod d6/d28/d20/d5e/df4/cff 0 2024-09-04T16:30:36.247 INFO:tasks.workunit.client.0.smithi170.stdout:0/871: symlink d11/d13/d36/de5/d11d/l13c 0 2024-09-04T16:30:36.247 INFO:tasks.workunit.client.0.smithi170.stdout:0/872: chown d11/d13/d35/c5b 1871733 1 2024-09-04T16:30:36.248 INFO:tasks.workunit.client.0.smithi170.stdout:0/873: chown d11/d13/d36/fff 500006 1 2024-09-04T16:30:36.250 INFO:tasks.workunit.client.0.smithi170.stdout:6/740: rename d0/d17/l2f to d0/d17/d31/d64/lf6 0 2024-09-04T16:30:36.252 INFO:tasks.workunit.client.0.smithi170.stdout:8/755: creat d6/d28/d5f/d70/d97/d99/f100 x:0 0 0 2024-09-04T16:30:36.253 INFO:tasks.workunit.client.0.smithi170.stdout:3/780: mknod d13/d14/d21/d4d/d4e/d88/dbf/cfe 0 2024-09-04T16:30:36.255 INFO:tasks.workunit.client.0.smithi170.stdout:8/756: rmdir d6/d28/d5f 39 2024-09-04T16:30:36.260 INFO:tasks.workunit.client.0.smithi170.stdout:0/874: dread d11/d13/d4a/d66/d6d/fe9 [0,4194304] 0 2024-09-04T16:30:36.263 INFO:tasks.workunit.client.0.smithi170.stdout:6/741: dwrite d0/d15/d56/d6d/f74 [0,4194304] 0 2024-09-04T16:30:36.264 INFO:tasks.workunit.client.0.smithi170.stdout:2/821: rename d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/f106 to d3/f112 0 2024-09-04T16:30:36.266 INFO:tasks.workunit.client.0.smithi170.stdout:3/781: dread d13/d14/d21/f2e [0,4194304] 0 2024-09-04T16:30:36.266 INFO:tasks.workunit.client.0.smithi170.stdout:2/822: write d3/d3c/dc1/d101/d1c/f23 [3138785,58548] 0 2024-09-04T16:30:36.269 INFO:tasks.workunit.client.0.smithi170.stdout:0/875: symlink d11/d13/d4a/d66/d8c/da8/l13d 0 2024-09-04T16:30:36.276 INFO:tasks.workunit.client.0.smithi170.stdout:9/783: sync 2024-09-04T16:30:36.276 INFO:tasks.workunit.client.0.smithi170.stdout:5/811: sync 2024-09-04T16:30:36.276 INFO:tasks.workunit.client.0.smithi170.stdout:7/936: sync 2024-09-04T16:30:36.276 INFO:tasks.workunit.client.0.smithi170.stdout:4/784: sync 2024-09-04T16:30:36.277 INFO:tasks.workunit.client.0.smithi170.stdout:8/757: dwrite d6/d28/d20/d5e/fd7 [4194304,4194304] 0 2024-09-04T16:30:36.279 INFO:tasks.workunit.client.0.smithi170.stdout:6/742: mknod d0/d15/cf7 0 2024-09-04T16:30:36.280 INFO:tasks.workunit.client.0.smithi170.stdout:1/928: dwrite d9/d102/d11b/fb3 [0,4194304] 0 2024-09-04T16:30:36.285 INFO:tasks.workunit.client.0.smithi170.stdout:6/743: write d0/df/d1b/d3e/d47/d68/d2d/f8c [1851079,120] 0 2024-09-04T16:30:36.285 INFO:tasks.workunit.client.0.smithi170.stdout:0/876: fsync d11/d75/f7d 0 2024-09-04T16:30:36.288 INFO:tasks.workunit.client.0.smithi170.stdout:9/784: mkdir d2/d3d/d54/df3 0 2024-09-04T16:30:36.288 INFO:tasks.workunit.client.0.smithi170.stdout:5/812: mknod d4/d3a/d74/daf/c10b 0 2024-09-04T16:30:36.289 INFO:tasks.workunit.client.0.smithi170.stdout:3/782: write d13/d14/d1f/f72 [5218335,113484] 0 2024-09-04T16:30:36.293 INFO:tasks.workunit.client.0.smithi170.stdout:4/785: creat d1/d6/d2b/d47/d78/da7/f10f x:0 0 0 2024-09-04T16:30:36.295 INFO:tasks.workunit.client.0.smithi170.stdout:2/823: write d3/d3c/dc1/d101/dc5/fcc [379303,68871] 0 2024-09-04T16:30:36.296 INFO:tasks.workunit.client.0.smithi170.stdout:2/824: readlink d3/d3c/dc1/d101/l58 0 2024-09-04T16:30:36.301 INFO:tasks.workunit.client.0.smithi170.stdout:7/937: write d12/d16/d1d/d65/d82/f91 [213100,65805] 0 2024-09-04T16:30:36.302 INFO:tasks.workunit.client.0.smithi170.stdout:8/758: rmdir d6/d28/d16/d24/d83 39 2024-09-04T16:30:36.305 INFO:tasks.workunit.client.0.smithi170.stdout:8/759: read d6/d28/d20/d5e/f68 [309033,102056] 0 2024-09-04T16:30:36.305 INFO:tasks.workunit.client.0.smithi170.stdout:5/813: creat d4/d8/d1c/d26/d27/d48/d7c/f10c x:0 0 0 2024-09-04T16:30:36.307 INFO:tasks.workunit.client.0.smithi170.stdout:5/814: write d4/d8/d1c/d26/d27/d43/d5b/f76 [2291032,110293] 0 2024-09-04T16:30:36.309 INFO:tasks.workunit.client.0.smithi170.stdout:9/785: creat d2/d3d/d27/d65/dcb/ff4 x:0 0 0 2024-09-04T16:30:36.311 INFO:tasks.workunit.client.0.smithi170.stdout:1/929: mkdir d9/d119/d13f 0 2024-09-04T16:30:36.312 INFO:tasks.workunit.client.0.smithi170.stdout:6/744: mkdir d0/d17/d31/d64/df4/df8 0 2024-09-04T16:30:36.313 INFO:tasks.workunit.client.0.smithi170.stdout:0/877: dwrite d11/d13/d4a/dc5/fca [0,4194304] 0 2024-09-04T16:30:36.315 INFO:tasks.workunit.client.0.smithi170.stdout:8/760: mknod d6/d28/d20/c101 0 2024-09-04T16:30:36.317 INFO:tasks.workunit.client.0.smithi170.stdout:8/761: chown d6/d28/d20/d6e 3129 1 2024-09-04T16:30:36.317 INFO:tasks.workunit.client.0.smithi170.stdout:4/786: creat d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/dbf/dd6/f110 x:0 0 0 2024-09-04T16:30:36.318 INFO:tasks.workunit.client.0.smithi170.stdout:9/786: read d2/d3d/d27/d65/fa7 [222499,88270] 0 2024-09-04T16:30:36.318 INFO:tasks.workunit.client.0.smithi170.stdout:2/825: creat d3/d3c/dc1/d101/d1c/d47/d83/deb/f113 x:0 0 0 2024-09-04T16:30:36.320 INFO:tasks.workunit.client.0.smithi170.stdout:1/930: symlink d9/d11/dae/l140 0 2024-09-04T16:30:36.324 INFO:tasks.workunit.client.0.smithi170.stdout:6/745: symlink d0/d15/d56/d6c/da0/lf9 0 2024-09-04T16:30:36.325 INFO:tasks.workunit.client.0.smithi170.stdout:0/878: unlink d11/d13/d4a/d66/d8c/ddd/f135 0 2024-09-04T16:30:36.327 INFO:tasks.workunit.client.0.smithi170.stdout:3/783: creat d13/d14/d1d/d2d/fff x:0 0 0 2024-09-04T16:30:36.328 INFO:tasks.workunit.client.0.smithi170.stdout:3/784: readlink d13/d14/d1d/d71/db3/db6/d6e/le7 0 2024-09-04T16:30:36.330 INFO:tasks.workunit.client.0.smithi170.stdout:8/762: rename d6/d28/d16/c22 to d6/d28/d20/c102 0 2024-09-04T16:30:36.331 INFO:tasks.workunit.client.0.smithi170.stdout:6/746: dread - d0/df/d1f/fae zero size 2024-09-04T16:30:36.332 INFO:tasks.workunit.client.0.smithi170.stdout:0/879: rmdir d11/d13/d36/de5 39 2024-09-04T16:30:36.332 INFO:tasks.workunit.client.0.smithi170.stdout:6/747: fsync d0/d17/d31/d64/f8f 0 2024-09-04T16:30:36.335 INFO:tasks.workunit.client.0.smithi170.stdout:9/787: rename d2/d11/d8f/de1/de5/cf2 to d2/d11/d8f/df1/cf5 0 2024-09-04T16:30:36.338 INFO:tasks.workunit.client.0.smithi170.stdout:5/815: getdents d4/d8/d1c 0 2024-09-04T16:30:36.339 INFO:tasks.workunit.client.0.smithi170.stdout:8/763: fdatasync d6/f41 0 2024-09-04T16:30:36.340 INFO:tasks.workunit.client.0.smithi170.stdout:4/787: dread d1/d6/d8/d20/d95/f57 [0,4194304] 0 2024-09-04T16:30:36.341 INFO:tasks.workunit.client.0.smithi170.stdout:6/748: read d0/df/d1b/d3e/f95 [4050568,3775] 0 2024-09-04T16:30:36.342 INFO:tasks.workunit.client.0.smithi170.stdout:4/788: truncate d1/d6/d8/f9 4922154 0 2024-09-04T16:30:36.342 INFO:tasks.workunit.client.0.smithi170.stdout:1/931: dread d9/d26/f5a [0,4194304] 0 2024-09-04T16:30:36.344 INFO:tasks.workunit.client.0.smithi170.stdout:4/789: stat d1/d6/d8/d20/d95/d36/d79/cb5 0 2024-09-04T16:30:36.345 INFO:tasks.workunit.client.0.smithi170.stdout:2/826: rename d3/d3c/dc1/d101/df/la0 to d3/d3c/dc1/d101/d62/l114 0 2024-09-04T16:30:36.346 INFO:tasks.workunit.client.0.smithi170.stdout:1/932: dread d9/d11/dae/d6a/d79/f8c [0,4194304] 0 2024-09-04T16:30:36.346 INFO:tasks.workunit.client.0.smithi170.stdout:6/749: dread d0/d17/d39/f72 [0,4194304] 0 2024-09-04T16:30:36.348 INFO:tasks.workunit.client.0.smithi170.stdout:9/788: dread d2/d3d/d27/d65/d5b/f75 [0,4194304] 0 2024-09-04T16:30:36.355 INFO:tasks.workunit.client.0.smithi170.stdout:1/933: mknod d9/d11/d2f/d6b/d61/d108/c141 0 2024-09-04T16:30:36.358 INFO:tasks.workunit.client.0.smithi170.stdout:6/750: rename d0/df/d1b/d3e/d47 to d0/df/d7e/dfa 0 2024-09-04T16:30:36.359 INFO:tasks.workunit.client.0.smithi170.stdout:9/789: stat d2/d3d/d4d/d59/d85/f8a 0 2024-09-04T16:30:36.359 INFO:tasks.workunit.client.0.smithi170.stdout:0/880: dwrite d11/d13/d2f/f84 [0,4194304] 0 2024-09-04T16:30:36.361 INFO:tasks.workunit.client.0.smithi170.stdout:5/816: dwrite d4/db/d51/d5e/d71/fdc [0,4194304] 0 2024-09-04T16:30:36.361 INFO:tasks.workunit.client.0.smithi170.stdout:3/785: getdents d13/d14/d21/d4d/d4e/d88 0 2024-09-04T16:30:36.362 INFO:tasks.workunit.client.0.smithi170.stdout:3/786: readlink d13/d14/d1d/l24 0 2024-09-04T16:30:36.365 INFO:tasks.workunit.client.0.smithi170.stdout:3/787: chown d13/d14/d21/d4d/f6f 3068 1 2024-09-04T16:30:36.365 INFO:tasks.workunit.client.0.smithi170.stdout:2/827: symlink d3/d3c/dc1/d101/d1c/db8/l115 0 2024-09-04T16:30:36.371 INFO:tasks.workunit.client.0.smithi170.stdout:8/764: creat d6/f103 x:0 0 0 2024-09-04T16:30:36.377 INFO:tasks.workunit.client.0.smithi170.stdout:0/881: truncate d11/d13/d2f/d3f/f4f 474721 0 2024-09-04T16:30:36.378 INFO:tasks.workunit.client.0.smithi170.stdout:2/828: creat d3/d3c/dc1/d101/d62/d6f/d110/f116 x:0 0 0 2024-09-04T16:30:36.381 INFO:tasks.workunit.client.0.smithi170.stdout:1/934: creat d9/d11/d85/d118/f142 x:0 0 0 2024-09-04T16:30:36.381 INFO:tasks.workunit.client.0.smithi170.stdout:3/788: rename d13/d14/d17/df0/cf5 to d13/d14/d21/d4d/d4e/d50/c100 0 2024-09-04T16:30:36.382 INFO:tasks.workunit.client.0.smithi170.stdout:6/751: mkdir d0/df/d7e/dfa/d68/dfb 0 2024-09-04T16:30:36.384 INFO:tasks.workunit.client.0.smithi170.stdout:9/790: creat d2/d3d/d54/df3/ff6 x:0 0 0 2024-09-04T16:30:36.385 INFO:tasks.workunit.client.0.smithi170.stdout:4/790: getdents d1/d6/d2b/d47/d78 0 2024-09-04T16:30:36.388 INFO:tasks.workunit.client.0.smithi170.stdout:8/765: creat d6/d28/d16/d52/d73/d71/f104 x:0 0 0 2024-09-04T16:30:36.389 INFO:tasks.workunit.client.0.smithi170.stdout:5/817: creat d4/d8/dea/f10d x:0 0 0 2024-09-04T16:30:36.392 INFO:tasks.workunit.client.0.smithi170.stdout:0/882: rename d11/d13/d4a/d66/d8c/dae/dfc to d11/d13/d2f/d3f/d13e 0 2024-09-04T16:30:36.396 INFO:tasks.workunit.client.0.smithi170.stdout:1/935: write d9/d11/d2f/d7f/fb7 [798220,46357] 0 2024-09-04T16:30:36.396 INFO:tasks.workunit.client.0.smithi170.stdout:6/752: mkdir d0/d15/d56/d6c/da0/dfc 0 2024-09-04T16:30:36.401 INFO:tasks.workunit.client.0.smithi170.stdout:4/791: mknod d1/d6/d8/d20/d35/d3e/d43/c111 0 2024-09-04T16:30:36.402 INFO:tasks.workunit.client.0.smithi170.stdout:4/792: dread - d1/d6/d8/d20/dc1/ff2 zero size 2024-09-04T16:30:36.406 INFO:tasks.workunit.client.0.smithi170.stdout:5/818: stat d4/d3a/d74/dd1/ce1 0 2024-09-04T16:30:36.407 INFO:tasks.workunit.client.0.smithi170.stdout:2/829: write d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/fc8 [265344,35119] 0 2024-09-04T16:30:36.409 INFO:tasks.workunit.client.0.smithi170.stdout:4/793: dwrite d1/d6/d8/d20/d35/d3e/d60/ff7 [0,4194304] 0 2024-09-04T16:30:36.411 INFO:tasks.workunit.client.0.smithi170.stdout:3/789: rename d13/d14/cf2 to d13/d14/d21/dec/c101 0 2024-09-04T16:30:36.413 INFO:tasks.workunit.client.0.smithi170.stdout:6/753: creat d0/d9f/ffd x:0 0 0 2024-09-04T16:30:36.415 INFO:tasks.workunit.client.0.smithi170.stdout:8/766: getdents d6/d28/d20/d5e/dfa 0 2024-09-04T16:30:36.418 INFO:tasks.workunit.client.0.smithi170.stdout:2/830: stat d3/d4/d86/dc9/dd9/l80 0 2024-09-04T16:30:36.420 INFO:tasks.workunit.client.0.smithi170.stdout:5/819: creat d4/d8/d1c/d29/f10e x:0 0 0 2024-09-04T16:30:36.420 INFO:tasks.workunit.client.0.smithi170.stdout:8/767: write d6/d28/d16/d52/f64 [5390379,38767] 0 2024-09-04T16:30:36.421 INFO:tasks.workunit.client.0.smithi170.stdout:5/820: stat d4/fc4 0 2024-09-04T16:30:36.424 INFO:tasks.workunit.client.0.smithi170.stdout:9/791: dwrite d2/d3d/d4d/d59/d85/f8a [0,4194304] 0 2024-09-04T16:30:36.424 INFO:tasks.workunit.client.0.smithi170.stdout:2/831: truncate d3/d3c/dc1/d101/f2b 5057636 0 2024-09-04T16:30:36.426 INFO:tasks.workunit.client.0.smithi170.stdout:2/832: stat d3/d3c/dc1/d101/dc5 0 2024-09-04T16:30:36.426 INFO:tasks.workunit.client.0.smithi170.stdout:4/794: dread d1/d6/d8/d20/d95/fdc [0,4194304] 0 2024-09-04T16:30:36.428 INFO:tasks.workunit.client.0.smithi170.stdout:9/792: truncate d2/d3d/d27/d65/d5b/fd8 375383 0 2024-09-04T16:30:36.431 INFO:tasks.workunit.client.0.smithi170.stdout:6/754: creat d0/d15/d56/d6d/dac/ffe x:0 0 0 2024-09-04T16:30:36.435 INFO:tasks.workunit.client.0.smithi170.stdout:4/795: dwrite d1/d6/d8/d20/d35/d3e/d60/daa/fb7 [0,4194304] 0 2024-09-04T16:30:36.438 INFO:tasks.workunit.client.0.smithi170.stdout:5/821: symlink d4/db/d51/l10f 0 2024-09-04T16:30:36.439 INFO:tasks.workunit.client.0.smithi170.stdout:5/822: fsync d4/d3a/fcf 0 2024-09-04T16:30:36.440 INFO:tasks.workunit.client.0.smithi170.stdout:5/823: dread - d4/d3a/fd7 zero size 2024-09-04T16:30:36.441 INFO:tasks.workunit.client.0.smithi170.stdout:0/883: rename d11/d13/d71/d43/l116 to d11/d13/d4a/d66/d6d/d105/d10f/l13f 0 2024-09-04T16:30:36.442 INFO:tasks.workunit.client.0.smithi170.stdout:5/824: fsync d4/db/d51/d5e/d71/d84/d93/d106/d39/f81 0 2024-09-04T16:30:36.443 INFO:tasks.workunit.client.0.smithi170.stdout:3/790: unlink d13/d14/c39 0 2024-09-04T16:30:36.446 INFO:tasks.workunit.client.0.smithi170.stdout:6/755: creat d0/df/d7e/dfa/d68/d2d/fff x:0 0 0 2024-09-04T16:30:36.448 INFO:tasks.workunit.client.0.smithi170.stdout:8/768: mknod d6/c105 0 2024-09-04T16:30:36.449 INFO:tasks.workunit.client.0.smithi170.stdout:4/796: rmdir d1/d6/d8/d20 39 2024-09-04T16:30:36.458 INFO:tasks.workunit.client.0.smithi170.stdout:2/833: mkdir d3/d3c/dc1/d101/d1c/d77/d117 0 2024-09-04T16:30:36.459 INFO:tasks.workunit.client.0.smithi170.stdout:3/791: mkdir d13/d14/d17/d1c/d102 0 2024-09-04T16:30:36.460 INFO:tasks.workunit.client.0.smithi170.stdout:2/834: write d3/d3c/d40/d48/f9e [3147849,117116] 0 2024-09-04T16:30:36.463 INFO:tasks.workunit.client.0.smithi170.stdout:9/793: unlink d2/d3d/d35/c91 0 2024-09-04T16:30:36.463 INFO:tasks.workunit.client.0.smithi170.stdout:0/884: dwrite d11/d75/f9e [0,4194304] 0 2024-09-04T16:30:36.469 INFO:tasks.workunit.client.0.smithi170.stdout:8/769: rename d6/d28/d16/d24/d46/fec to d6/d28/d20/d6e/da4/f106 0 2024-09-04T16:30:36.469 INFO:tasks.workunit.client.0.smithi170.stdout:8/770: chown d6/d28/d16/d52 38535603 1 2024-09-04T16:30:36.471 INFO:tasks.workunit.client.0.smithi170.stdout:8/771: write d6/f41 [3841652,35233] 0 2024-09-04T16:30:36.471 INFO:tasks.workunit.client.0.smithi170.stdout:2/835: fsync d3/d3c/d40/f71 0 2024-09-04T16:30:36.474 INFO:tasks.workunit.client.0.smithi170.stdout:3/792: symlink d13/d14/d1d/d71/db3/db6/db2/l103 0 2024-09-04T16:30:36.475 INFO:tasks.workunit.client.0.smithi170.stdout:5/825: truncate d4/db/d51/d5e/d71/d84/d93/d106/d3e/f7e 583121 0 2024-09-04T16:30:36.478 INFO:tasks.workunit.client.0.smithi170.stdout:4/797: creat d1/d6/d8/d20/d95/d36/d9c/f112 x:0 0 0 2024-09-04T16:30:36.482 INFO:tasks.workunit.client.0.smithi170.stdout:8/772: unlink d6/d28/d16/d24/fbe 0 2024-09-04T16:30:36.482 INFO:tasks.workunit.client.0.smithi170.stdout:8/773: fsync d6/d28/d16/d52/d73/d71/f104 0 2024-09-04T16:30:36.485 INFO:tasks.workunit.client.0.smithi170.stdout:6/756: creat d0/d17/f100 x:0 0 0 2024-09-04T16:30:36.488 INFO:tasks.workunit.client.0.smithi170.stdout:5/826: creat d4/d8/d1c/d26/d27/d43/d102/f110 x:0 0 0 2024-09-04T16:30:36.489 INFO:tasks.workunit.client.0.smithi170.stdout:5/827: chown d4/d3a 1105 1 2024-09-04T16:30:36.490 INFO:tasks.workunit.client.0.smithi170.stdout:5/828: truncate d4/d8/d1c/d26/d27/d88/f107 514972 0 2024-09-04T16:30:36.491 INFO:tasks.workunit.client.0.smithi170.stdout:9/794: rename d2/d3d/c48 to d2/d11/d23/cf7 0 2024-09-04T16:30:36.492 INFO:tasks.workunit.client.0.smithi170.stdout:4/798: mknod d1/d6/d2b/db3/dd4/c113 0 2024-09-04T16:30:36.492 INFO:tasks.workunit.client.0.smithi170.stdout:9/795: dread d2/d3d/d27/d65/d5b/f83 [0,4194304] 0 2024-09-04T16:30:36.494 INFO:tasks.workunit.client.0.smithi170.stdout:2/836: unlink d3/d3c/dc1/d101/d62/d6f/d110/c6c 0 2024-09-04T16:30:36.496 INFO:tasks.workunit.client.0.smithi170.stdout:3/793: creat d13/d14/d1d/da4/da8/f104 x:0 0 0 2024-09-04T16:30:36.498 INFO:tasks.workunit.client.0.smithi170.stdout:0/885: link d11/d13/le7 d11/d13/d4a/dc5/l140 0 2024-09-04T16:30:36.499 INFO:tasks.workunit.client.0.smithi170.stdout:4/799: dwrite d1/d6/d8/d6c/fe6 [0,4194304] 0 2024-09-04T16:30:36.501 INFO:tasks.workunit.client.0.smithi170.stdout:4/800: write d1/d6/d8/d20/d95/d36/fcf [1530474,107450] 0 2024-09-04T16:30:36.503 INFO:tasks.workunit.client.0.smithi170.stdout:5/829: rename d4/db/d51/d5e/d71/lf7 to d4/d8/d1c/d26/d27/d48/de5/l111 0 2024-09-04T16:30:36.504 INFO:tasks.workunit.client.0.smithi170.stdout:9/796: creat d2/d3d/d54/df3/ff8 x:0 0 0 2024-09-04T16:30:36.514 INFO:tasks.workunit.client.0.smithi170.stdout:3/794: dwrite d13/d14/d21/fd7 [0,4194304] 0 2024-09-04T16:30:36.514 INFO:tasks.workunit.client.0.smithi170.stdout:6/757: mknod d0/df/d7e/dfa/d68/c101 0 2024-09-04T16:30:36.521 INFO:tasks.workunit.client.0.smithi170.stdout:0/886: mknod d11/d13/d4a/d66/d8c/d12a/c141 0 2024-09-04T16:30:36.528 INFO:tasks.workunit.client.0.smithi170.stdout:8/774: symlink d6/d28/d5f/l107 0 2024-09-04T16:30:36.528 INFO:tasks.workunit.client.0.smithi170.stdout:0/887: dwrite d11/d13/d36/f11b [0,4194304] 0 2024-09-04T16:30:36.529 INFO:tasks.workunit.client.0.smithi170.stdout:5/830: truncate d4/d8/d1c/d26/d27/f70 4407733 0 2024-09-04T16:30:36.531 INFO:tasks.workunit.client.0.smithi170.stdout:6/758: symlink d0/d17/dbd/l102 0 2024-09-04T16:30:36.533 INFO:tasks.workunit.client.0.smithi170.stdout:6/759: chown d0/df/d1f/d9c 62623533 1 2024-09-04T16:30:36.534 INFO:tasks.workunit.client.0.smithi170.stdout:0/888: dread d11/d13/d4a/dbc/f122 [0,4194304] 0 2024-09-04T16:30:36.542 INFO:tasks.workunit.client.0.smithi170.stdout:4/801: getdents d1/d6/d2b/d47/d78 0 2024-09-04T16:30:36.544 INFO:tasks.workunit.client.0.smithi170.stdout:8/775: creat d6/d28/d16/d77/d8c/f108 x:0 0 0 2024-09-04T16:30:36.545 INFO:tasks.workunit.client.0.smithi170.stdout:9/797: write d2/d3d/d6d/fb4 [445468,38724] 0 2024-09-04T16:30:36.548 INFO:tasks.workunit.client.0.smithi170.stdout:0/889: mknod d11/d75/c142 0 2024-09-04T16:30:36.548 INFO:tasks.workunit.client.0.smithi170.stdout:8/776: dread d6/d28/d5f/d70/f7d [0,4194304] 0 2024-09-04T16:30:36.552 INFO:tasks.workunit.client.0.smithi170.stdout:9/798: creat d2/d3d/d3f/d90/ff9 x:0 0 0 2024-09-04T16:30:36.553 INFO:tasks.workunit.client.0.smithi170.stdout:6/760: dread d0/f5 [4194304,4194304] 0 2024-09-04T16:30:36.555 INFO:tasks.workunit.client.0.smithi170.stdout:3/795: dwrite d13/f25 [0,4194304] 0 2024-09-04T16:30:36.556 INFO:tasks.workunit.client.0.smithi170.stdout:9/799: creat d2/d3d/d54/df3/ffa x:0 0 0 2024-09-04T16:30:36.563 INFO:tasks.workunit.client.0.smithi170.stdout:6/761: creat d0/dbf/f103 x:0 0 0 2024-09-04T16:30:36.564 INFO:tasks.workunit.client.0.smithi170.stdout:5/831: truncate d4/db/d51/d5e/d71/d84/d93/d106/d39/f40 3926894 0 2024-09-04T16:30:36.567 INFO:tasks.workunit.client.0.smithi170.stdout:3/796: creat d13/d14/d1f/d87/f105 x:0 0 0 2024-09-04T16:30:36.570 INFO:tasks.workunit.client.0.smithi170.stdout:4/802: write d1/d6/d8/d20/d95/d36/f28 [340169,71389] 0 2024-09-04T16:30:36.639 INFO:tasks.workunit.client.0.smithi170.stdout:5/832: symlink d4/db/d37/l112 0 2024-09-04T16:30:36.640 INFO:tasks.workunit.client.0.smithi170.stdout:6/762: rename d0/df/d7e/dfa/d68/d2d/d2e/l35 to d0/d17/d39/d99/l104 0 2024-09-04T16:30:36.640 INFO:tasks.workunit.client.0.smithi170.stdout:0/890: getdents d11/d13/d36/de5/d11d 0 2024-09-04T16:30:36.642 INFO:tasks.workunit.client.0.smithi170.stdout:9/800: write d2/d3d/d6d/d79/f96 [349340,10302] 0 2024-09-04T16:30:36.643 INFO:tasks.workunit.client.0.smithi170.stdout:8/777: dread d6/d28/d16/d24/d46/fb2 [0,4194304] 0 2024-09-04T16:30:36.645 INFO:tasks.workunit.client.0.smithi170.stdout:9/801: dread d2/d3d/d27/d65/d5b/f75 [0,4194304] 0 2024-09-04T16:30:36.647 INFO:tasks.workunit.client.0.smithi170.stdout:0/891: unlink d11/d75/d77/f87 0 2024-09-04T16:30:36.649 INFO:tasks.workunit.client.0.smithi170.stdout:3/797: truncate d13/d14/d21/d4d/d4e/d88/dbf/f8f 3149431 0 2024-09-04T16:30:36.649 INFO:tasks.workunit.client.0.smithi170.stdout:3/798: chown d13/ce9 1038038444 1 2024-09-04T16:30:36.650 INFO:tasks.workunit.client.0.smithi170.stdout:3/799: write d13/d14/d1d/f28 [2842370,49201] 0 2024-09-04T16:30:36.650 INFO:tasks.workunit.client.0.smithi170.stdout:4/803: write d1/d6/d8/f9a [639213,64832] 0 2024-09-04T16:30:36.652 INFO:tasks.workunit.client.0.smithi170.stdout:6/763: unlink d0/df/d7e/dfa/d68/d2d/d67/d73/l88 0 2024-09-04T16:30:36.655 INFO:tasks.workunit.client.0.smithi170.stdout:9/802: creat d2/d3d/d27/d2b/daf/ffb x:0 0 0 2024-09-04T16:30:36.659 INFO:tasks.workunit.client.0.smithi170.stdout:5/833: symlink d4/db/d51/d5e/d71/d84/d93/d106/d39/dfa/l113 0 2024-09-04T16:30:36.661 INFO:tasks.workunit.client.0.smithi170.stdout:3/800: creat d13/d14/d21/d4d/d4e/d88/dbf/f106 x:0 0 0 2024-09-04T16:30:36.662 INFO:tasks.workunit.client.0.smithi170.stdout:3/801: write d13/d14/d1d/da4/fac [3566796,126865] 0 2024-09-04T16:30:36.662 INFO:tasks.workunit.client.0.smithi170.stdout:3/802: write fb [2160155,118235] 0 2024-09-04T16:30:36.669 INFO:tasks.workunit.client.0.smithi170.stdout:8/778: getdents d6/d28/d16/d77/d93/dc0 0 2024-09-04T16:30:36.670 INFO:tasks.workunit.client.0.smithi170.stdout:8/779: chown d6/d28/d20/d6e/d76/fce 2975405 1 2024-09-04T16:30:36.671 INFO:tasks.workunit.client.0.smithi170.stdout:9/803: unlink d2/d3d/d27/fd9 0 2024-09-04T16:30:36.671 INFO:tasks.workunit.client.0.smithi170.stdout:8/780: write d6/d28/d16/d52/fb1 [362428,60344] 0 2024-09-04T16:30:36.672 INFO:tasks.workunit.client.0.smithi170.stdout:9/804: stat d2/d11/d8f/fe8 0 2024-09-04T16:30:36.672 INFO:tasks.workunit.client.0.smithi170.stdout:8/781: chown d6/d28/d20/d5e/l31 856 1 2024-09-04T16:30:36.680 INFO:tasks.workunit.client.0.smithi170.stdout:9/805: creat d2/d3d/d35/ffc x:0 0 0 2024-09-04T16:30:36.682 INFO:tasks.workunit.client.0.smithi170.stdout:3/803: dread d13/d14/d17/fd1 [0,4194304] 0 2024-09-04T16:30:36.689 INFO:tasks.workunit.client.0.smithi170.stdout:6/764: write d0/f4 [2342267,52938] 0 2024-09-04T16:30:36.691 INFO:tasks.workunit.client.0.smithi170.stdout:3/804: mkdir d13/d14/d1d/d71/db3/db6/d107 0 2024-09-04T16:30:36.691 INFO:tasks.workunit.client.0.smithi170.stdout:0/892: dwrite d11/d13/d4a/d66/d6d/d105/f9c [0,4194304] 0 2024-09-04T16:30:36.693 INFO:tasks.workunit.client.0.smithi170.stdout:3/805: dread - d13/d14/d21/d4d/d4e/d88/dbf/f106 zero size 2024-09-04T16:30:36.696 INFO:tasks.workunit.client.0.smithi170.stdout:4/804: getdents d1/d6/d2b/db3 0 2024-09-04T16:30:36.697 INFO:tasks.workunit.client.0.smithi170.stdout:5/834: dwrite d4/f3c [0,4194304] 0 2024-09-04T16:30:36.699 INFO:tasks.workunit.client.0.smithi170.stdout:4/805: chown d1/d6/d8/d20/d35/d54/ffe 15404 1 2024-09-04T16:30:36.700 INFO:tasks.workunit.client.0.smithi170.stdout:8/782: creat d6/d26/f109 x:0 0 0 2024-09-04T16:30:36.700 INFO:tasks.workunit.client.0.smithi170.stdout:4/806: readlink d1/d6/d8/d20/d95/d36/d79/l86 0 2024-09-04T16:30:36.701 INFO:tasks.workunit.client.0.smithi170.stdout:0/893: truncate d11/d13/d71/f76 294684 0 2024-09-04T16:30:36.703 INFO:tasks.workunit.client.0.smithi170.stdout:3/806: fsync d13/d14/d8b/fe4 0 2024-09-04T16:30:36.706 INFO:tasks.workunit.client.0.smithi170.stdout:5/835: unlink d4/d8/d1c/d26/d27/d43/f44 0 2024-09-04T16:30:36.707 INFO:tasks.workunit.client.0.smithi170.stdout:6/765: mknod d0/d15/d56/d6c/da0/dfc/c105 0 2024-09-04T16:30:36.708 INFO:tasks.workunit.client.0.smithi170.stdout:9/806: write d2/d3d/fc [1088559,123706] 0 2024-09-04T16:30:36.710 INFO:tasks.workunit.client.0.smithi170.stdout:8/783: fsync d6/d28/f1d 0 2024-09-04T16:30:36.710 INFO:tasks.workunit.client.0.smithi170.stdout:0/894: creat d11/d13/d36/d12b/f143 x:0 0 0 2024-09-04T16:30:36.714 INFO:tasks.workunit.client.0.smithi170.stdout:5/836: mkdir d4/db/d51/d5e/d71/d84/d93/d106/d39/d114 0 2024-09-04T16:30:36.717 INFO:tasks.workunit.client.0.smithi170.stdout:8/784: creat d6/d28/d5f/d70/d97/f10a x:0 0 0 2024-09-04T16:30:36.719 INFO:tasks.workunit.client.0.smithi170.stdout:0/895: mknod d11/d13/d4a/d66/d6d/d105/c144 0 2024-09-04T16:30:36.723 INFO:tasks.workunit.client.0.smithi170.stdout:6/766: unlink d0/c22 0 2024-09-04T16:30:36.727 INFO:tasks.workunit.client.0.smithi170.stdout:5/837: creat d4/db/f115 x:0 0 0 2024-09-04T16:30:36.729 INFO:tasks.workunit.client.0.smithi170.stdout:5/838: stat d4/d8/d1c/d26/d27/d48/d7c/cda 0 2024-09-04T16:30:36.729 INFO:tasks.workunit.client.0.smithi170.stdout:6/767: dwrite d0/df/d7e/dfa/d68/d2d/d2e/f49 [0,4194304] 0 2024-09-04T16:30:36.734 INFO:tasks.workunit.client.0.smithi170.stdout:0/896: creat d11/d13/d4a/d66/d8c/d12a/f145 x:0 0 0 2024-09-04T16:30:36.740 INFO:tasks.workunit.client.0.smithi170.stdout:6/768: mkdir d0/d15/d56/d6c/da0/d106 0 2024-09-04T16:30:36.740 INFO:tasks.workunit.client.0.smithi170.stdout:3/807: write d13/f5f [2115221,78767] 0 2024-09-04T16:30:36.742 INFO:tasks.workunit.client.0.smithi170.stdout:8/785: creat d6/d28/d16/df2/f10b x:0 0 0 2024-09-04T16:30:36.742 INFO:tasks.workunit.client.0.smithi170.stdout:6/769: readlink d0/d17/d39/l4c 0 2024-09-04T16:30:36.742 INFO:tasks.workunit.client.0.smithi170.stdout:0/897: mknod d11/d13/d36/d12b/c146 0 2024-09-04T16:30:36.743 INFO:tasks.workunit.client.0.smithi170.stdout:3/808: fdatasync d13/d14/d1f/d87/f93 0 2024-09-04T16:30:36.743 INFO:tasks.workunit.client.0.smithi170.stdout:7/938: sync 2024-09-04T16:30:36.744 INFO:tasks.workunit.client.0.smithi170.stdout:4/807: link d1/d6/d8/d20/d35/d54/d96/fc0 d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/f114 0 2024-09-04T16:30:36.744 INFO:tasks.workunit.client.0.smithi170.stdout:9/807: getdents d2/d3d/d27 0 2024-09-04T16:30:36.747 INFO:tasks.workunit.client.0.smithi170.stdout:8/786: chown d6/d28/d16/d77/d8c/cb4 202520 1 2024-09-04T16:30:36.749 INFO:tasks.workunit.client.0.smithi170.stdout:6/770: fdatasync d0/d15/d56/d6c/f85 0 2024-09-04T16:30:36.752 INFO:tasks.workunit.client.0.smithi170.stdout:0/898: mkdir d11/d13/d4a/d66/d8c/d12a/d147 0 2024-09-04T16:30:36.754 INFO:tasks.workunit.client.0.smithi170.stdout:5/839: write d4/d8/d1c/d26/d27/d88/da4/fba [921957,40703] 0 2024-09-04T16:30:36.756 INFO:tasks.workunit.client.0.smithi170.stdout:4/808: mkdir d1/d6/d2b/db3/dd4/d115 0 2024-09-04T16:30:36.759 INFO:tasks.workunit.client.0.smithi170.stdout:4/809: truncate d1/d6/d8/d20/d35/d54/ffd 74037 0 2024-09-04T16:30:36.759 INFO:tasks.workunit.client.0.smithi170.stdout:3/809: dread d13/d14/d1d/d2d/d58/fa0 [0,4194304] 0 2024-09-04T16:30:36.759 INFO:tasks.workunit.client.0.smithi170.stdout:9/808: creat d2/d3d/d6d/ffd x:0 0 0 2024-09-04T16:30:36.761 INFO:tasks.workunit.client.0.smithi170.stdout:8/787: symlink d6/d28/d16/d77/d8c/l10c 0 2024-09-04T16:30:36.769 INFO:tasks.workunit.client.0.smithi170.stdout:7/939: write d12/d15/d41/fcc [591290,52933] 0 2024-09-04T16:30:36.772 INFO:tasks.workunit.client.0.smithi170.stdout:3/810: mknod d13/d14/d21/d4d/d4e/c108 0 2024-09-04T16:30:36.772 INFO:tasks.workunit.client.0.smithi170.stdout:9/809: dread - d2/d11/d23/d95/f97 zero size 2024-09-04T16:30:36.774 INFO:tasks.workunit.client.0.smithi170.stdout:8/788: creat d6/d28/d5f/d70/f10d x:0 0 0 2024-09-04T16:30:36.775 INFO:tasks.workunit.client.0.smithi170.stdout:8/789: dread - d6/d28/d16/df2/f10b zero size 2024-09-04T16:30:36.777 INFO:tasks.workunit.client.0.smithi170.stdout:7/940: creat d12/d15/d68/f141 x:0 0 0 2024-09-04T16:30:36.778 INFO:tasks.workunit.client.0.smithi170.stdout:5/840: rename d4/db/d37/l42 to d4/db/d51/d5e/l116 0 2024-09-04T16:30:36.779 INFO:tasks.workunit.client.0.smithi170.stdout:3/811: mkdir d13/d14/d1f/d109 0 2024-09-04T16:30:36.781 INFO:tasks.workunit.client.0.smithi170.stdout:3/812: read - d13/d14/d1f/d87/f105 zero size 2024-09-04T16:30:36.782 INFO:tasks.workunit.client.0.smithi170.stdout:0/899: creat d11/d75/f148 x:0 0 0 2024-09-04T16:30:36.783 INFO:tasks.workunit.client.0.smithi170.stdout:8/790: dwrite d6/d28/d5f/d70/d97/fdc [0,4194304] 0 2024-09-04T16:30:36.784 INFO:tasks.workunit.client.0.smithi170.stdout:7/941: symlink d12/d15/d71/d42/d81/l142 0 2024-09-04T16:30:36.785 INFO:tasks.workunit.client.0.smithi170.stdout:5/841: dread d4/d8/d1c/d41/faa [0,4194304] 0 2024-09-04T16:30:36.785 INFO:tasks.workunit.client.0.smithi170.stdout:0/900: fsync d11/d13/d4a/d66/d8c/da8/f110 0 2024-09-04T16:30:36.787 INFO:tasks.workunit.client.0.smithi170.stdout:4/810: link d1/d6/f75 d1/d6/d2b/db3/de8/f116 0 2024-09-04T16:30:36.789 INFO:tasks.workunit.client.0.smithi170.stdout:6/771: getdents d0/d17/d5b 0 2024-09-04T16:30:36.790 INFO:tasks.workunit.client.0.smithi170.stdout:8/791: stat d6/d26/ld2 0 2024-09-04T16:30:36.798 INFO:tasks.workunit.client.0.smithi170.stdout:7/942: mknod d12/d15/d68/c143 0 2024-09-04T16:30:36.800 INFO:tasks.workunit.client.0.smithi170.stdout:6/772: mknod d0/df/d1b/c107 0 2024-09-04T16:30:36.801 INFO:tasks.workunit.client.0.smithi170.stdout:8/792: readlink d6/d26/lf5 0 2024-09-04T16:30:36.801 INFO:tasks.workunit.client.0.smithi170.stdout:6/773: chown d0/df/d7e/dfa/l9d 1 1 2024-09-04T16:30:36.803 INFO:tasks.workunit.client.0.smithi170.stdout:3/813: rename d13/d14/d21/dec/c101 to d13/d14/d21/d4d/d4e/d88/c10a 0 2024-09-04T16:30:36.808 INFO:tasks.workunit.client.0.smithi170.stdout:0/901: dread d11/d13/d2f/d3f/d13e/fe6 [0,4194304] 0 2024-09-04T16:30:36.809 INFO:tasks.workunit.client.0.smithi170.stdout:4/811: symlink d1/d6/d2b/db3/dd4/d115/l117 0 2024-09-04T16:30:36.810 INFO:tasks.workunit.client.0.smithi170.stdout:7/943: dread d12/d16/d8d/fa5 [0,4194304] 0 2024-09-04T16:30:36.810 INFO:tasks.workunit.client.0.smithi170.stdout:6/774: symlink d0/df/d7e/dfa/d68/d2d/d67/l108 0 2024-09-04T16:30:36.812 INFO:tasks.workunit.client.0.smithi170.stdout:3/814: creat d13/d14/d1d/d2d/d58/f10b x:0 0 0 2024-09-04T16:30:36.813 INFO:tasks.workunit.client.0.smithi170.stdout:5/842: rmdir d4/d8/d1c/d41/dbe 0 2024-09-04T16:30:36.820 INFO:tasks.workunit.client.0.smithi170.stdout:3/815: dwrite d13/d14/d21/d4d/f6f [12582912,4194304] 0 2024-09-04T16:30:36.823 INFO:tasks.workunit.client.0.smithi170.stdout:0/902: mkdir d11/d75/d77/d149 0 2024-09-04T16:30:36.823 INFO:tasks.workunit.client.0.smithi170.stdout:7/944: fdatasync d12/d49/f6b 0 2024-09-04T16:30:36.825 INFO:tasks.workunit.client.0.smithi170.stdout:3/816: symlink d13/d14/d21/d4d/d4e/d88/l10c 0 2024-09-04T16:30:36.827 INFO:tasks.workunit.client.0.smithi170.stdout:0/903: creat d11/d75/dce/f14a x:0 0 0 2024-09-04T16:30:36.830 INFO:tasks.workunit.client.0.smithi170.stdout:6/775: getdents d0/d15/d56/d6d 0 2024-09-04T16:30:36.831 INFO:tasks.workunit.client.0.smithi170.stdout:6/776: readlink d0/d17/d31/d64/ldb 0 2024-09-04T16:30:36.832 INFO:tasks.workunit.client.0.smithi170.stdout:6/777: chown d0/d15/d56/d6d/f74 31 1 2024-09-04T16:30:36.833 INFO:tasks.workunit.client.0.smithi170.stdout:3/817: rmdir d13/d14/d8b 39 2024-09-04T16:30:36.835 INFO:tasks.workunit.client.0.smithi170.stdout:0/904: creat d11/d13/d4a/db8/d111/d124/f14b x:0 0 0 2024-09-04T16:30:36.837 INFO:tasks.workunit.client.0.smithi170.stdout:4/812: dread d1/d6/d8/d20/d35/d3e/d43/f5f [4194304,4194304] 0 2024-09-04T16:30:36.840 INFO:tasks.workunit.client.0.smithi170.stdout:7/945: symlink d12/d15/d71/d42/d79/d9d/dc9/l144 0 2024-09-04T16:30:36.841 INFO:tasks.workunit.client.0.smithi170.stdout:5/843: dread d4/db/f8a [0,4194304] 0 2024-09-04T16:30:36.843 INFO:tasks.workunit.client.0.smithi170.stdout:0/905: dread - d11/d13/d4a/d66/d8c/ddd/fed zero size 2024-09-04T16:30:36.845 INFO:tasks.workunit.client.0.smithi170.stdout:3/818: creat d13/d14/d1f/def/f10d x:0 0 0 2024-09-04T16:30:36.847 INFO:tasks.workunit.client.0.smithi170.stdout:7/946: mknod d12/d15/c145 0 2024-09-04T16:30:36.850 INFO:tasks.workunit.client.0.smithi170.stdout:4/813: dwrite d1/d6/d2b/d47/f59 [4194304,4194304] 0 2024-09-04T16:30:36.851 INFO:tasks.workunit.client.0.smithi170.stdout:5/844: link d4/d3a/d74/f89 d4/d8/d1c/d26/d27/d48/ddf/f117 0 2024-09-04T16:30:36.852 INFO:tasks.workunit.client.0.smithi170.stdout:5/845: chown d4/d3a/d74/d8b/db5 81525685 1 2024-09-04T16:30:36.852 INFO:tasks.workunit.client.0.smithi170.stdout:7/947: mknod d12/d49/c146 0 2024-09-04T16:30:36.855 INFO:tasks.workunit.client.0.smithi170.stdout:0/906: creat d11/f14c x:0 0 0 2024-09-04T16:30:36.859 INFO:tasks.workunit.client.0.smithi170.stdout:3/819: dwrite d13/d14/d21/d4d/d4e/d50/fa7 [0,4194304] 0 2024-09-04T16:30:36.861 INFO:tasks.workunit.client.0.smithi170.stdout:4/814: link d1/d6/d8/d20/d35/d3e/f46 d1/d6/d8/d20/d35/d3e/d4e/dcb/f118 0 2024-09-04T16:30:36.862 INFO:tasks.workunit.client.0.smithi170.stdout:5/846: creat d4/d8/d1c/d29/f118 x:0 0 0 2024-09-04T16:30:36.862 INFO:tasks.workunit.client.0.smithi170.stdout:4/815: readlink d1/d6/d2b/d47/l53 0 2024-09-04T16:30:36.864 INFO:tasks.workunit.client.0.smithi170.stdout:5/847: write d4/d8/d1c/d41/fe9 [71046,3181] 0 2024-09-04T16:30:36.865 INFO:tasks.workunit.client.0.smithi170.stdout:7/948: creat d12/f147 x:0 0 0 2024-09-04T16:30:36.866 INFO:tasks.workunit.client.0.smithi170.stdout:0/907: dwrite d11/d13/d4a/d66/d8c/fc6 [0,4194304] 0 2024-09-04T16:30:36.868 INFO:tasks.workunit.client.0.smithi170.stdout:4/816: mknod d1/d6/d8/d20/dae/dd5/c119 0 2024-09-04T16:30:36.869 INFO:tasks.workunit.client.0.smithi170.stdout:0/908: chown d11/d13/d4a/d66/d6d/d105/laf 4845 1 2024-09-04T16:30:36.870 INFO:tasks.workunit.client.0.smithi170.stdout:3/820: link d13/d14/d21/f2e d13/d14/d1f/d7a/f10e 0 2024-09-04T16:30:36.872 INFO:tasks.workunit.client.0.smithi170.stdout:3/821: chown d13/d14/d1d/d71/db3/db6/faa 32260627 1 2024-09-04T16:30:36.883 INFO:tasks.workunit.client.0.smithi170.stdout:3/822: dread d13/d14/d21/d4d/d4e/d50/fa7 [0,4194304] 0 2024-09-04T16:30:36.886 INFO:tasks.workunit.client.0.smithi170.stdout:0/909: creat d11/d13/d71/f14d x:0 0 0 2024-09-04T16:30:36.892 INFO:tasks.workunit.client.0.smithi170.stdout:0/910: rmdir d11/d75 39 2024-09-04T16:30:36.895 INFO:tasks.workunit.client.0.smithi170.stdout:7/949: rename d12/d15/d71/d42/d79/c8a to d12/d15/d71/d42/c148 0 2024-09-04T16:30:36.896 INFO:tasks.workunit.client.0.smithi170.stdout:3/823: rename d13/d14/d1f/d7a/ce8 to d13/d14/d1f/d7a/c10f 0 2024-09-04T16:30:36.897 INFO:tasks.workunit.client.0.smithi170.stdout:4/817: truncate d1/d6/d8/d20/d95/d36/f28 75680 0 2024-09-04T16:30:36.899 INFO:tasks.workunit.client.0.smithi170.stdout:5/848: dwrite d4/d8/d1c/d26/d27/d43/d5b/fbc [0,4194304] 0 2024-09-04T16:30:36.901 INFO:tasks.workunit.client.0.smithi170.stdout:0/911: rename d11/d13/d4a/db8/d111 to d11/d13/d4a/d66/d8c/dae/d14e 0 2024-09-04T16:30:36.902 INFO:tasks.workunit.client.0.smithi170.stdout:5/849: truncate d4/d8/dea/f10d 674122 0 2024-09-04T16:30:36.905 INFO:tasks.workunit.client.0.smithi170.stdout:3/824: mknod d13/d14/d17/ded/c110 0 2024-09-04T16:30:36.909 INFO:tasks.workunit.client.0.smithi170.stdout:0/912: mknod d11/d13/d4a/d66/d8c/da8/c14f 0 2024-09-04T16:30:36.913 INFO:tasks.workunit.client.0.smithi170.stdout:5/850: unlink d4/db/c30 0 2024-09-04T16:30:36.914 INFO:tasks.workunit.client.0.smithi170.stdout:7/950: dwrite d12/d15/faf [0,4194304] 0 2024-09-04T16:30:36.915 INFO:tasks.workunit.client.0.smithi170.stdout:3/825: fdatasync d13/d14/d1d/d71/db3/db6/d9e/f94 0 2024-09-04T16:30:36.924 INFO:tasks.workunit.client.0.smithi170.stdout:4/818: dwrite d1/d6/d8/d20/d95/d36/f28 [0,4194304] 0 2024-09-04T16:30:36.927 INFO:tasks.workunit.client.0.smithi170.stdout:7/951: mknod d12/d15/d68/d122/c149 0 2024-09-04T16:30:36.929 INFO:tasks.workunit.client.0.smithi170.stdout:7/952: chown d12/d15/d71/d42/d81/d5c/f86 838 1 2024-09-04T16:30:36.930 INFO:tasks.workunit.client.0.smithi170.stdout:0/913: creat d11/d75/d77/d149/f150 x:0 0 0 2024-09-04T16:30:36.931 INFO:tasks.workunit.client.0.smithi170.stdout:0/914: fdatasync d11/d13/d36/f118 0 2024-09-04T16:30:36.932 INFO:tasks.workunit.client.0.smithi170.stdout:7/953: symlink d12/d16/d1d/l14a 0 2024-09-04T16:30:36.935 INFO:tasks.workunit.client.0.smithi170.stdout:0/915: unlink d11/d75/d77/f81 0 2024-09-04T16:30:36.936 INFO:tasks.workunit.client.0.smithi170.stdout:7/954: mkdir d12/d16/d1d/d65/dd0/d14b 0 2024-09-04T16:30:36.937 INFO:tasks.workunit.client.0.smithi170.stdout:3/826: dwrite d13/d14/d1f/d7a/f9a [0,4194304] 0 2024-09-04T16:30:36.938 INFO:tasks.workunit.client.0.smithi170.stdout:3/827: write fb [997633,123803] 0 2024-09-04T16:30:36.941 INFO:tasks.workunit.client.0.smithi170.stdout:0/916: unlink d11/d13/d36/l100 0 2024-09-04T16:30:36.960 INFO:tasks.workunit.client.0.smithi170.stdout:0/917: mkdir d11/d13/d4a/d66/d8c/d12a/d151 0 2024-09-04T16:30:36.966 INFO:tasks.workunit.client.0.smithi170.stdout:7/955: dwrite d12/d15/d41/ff3 [0,4194304] 0 2024-09-04T16:30:36.967 INFO:tasks.workunit.client.0.smithi170.stdout:0/918: dwrite d11/d13/d2f/fa7 [8388608,4194304] 0 2024-09-04T16:30:36.981 INFO:tasks.workunit.client.0.smithi170.stdout:7/956: write d12/d16/d1d/d65/d82/ff2 [931945,37118] 0 2024-09-04T16:30:37.010 INFO:tasks.workunit.client.0.smithi170.stdout:0/919: rename d11/d13/d4a/dbc/fef to d11/d13/d4a/d66/d8c/d12a/d151/f152 0 2024-09-04T16:30:37.013 INFO:tasks.workunit.client.0.smithi170.stdout:0/920: link d11/d13/d2f/d3f/l97 d11/d75/d77/l153 0 2024-09-04T16:30:37.015 INFO:tasks.workunit.client.0.smithi170.stdout:0/921: truncate d11/d13/d71/fde 526379 0 2024-09-04T16:30:37.026 INFO:tasks.workunit.client.0.smithi170.stdout:0/922: dread d11/f68 [0,4194304] 0 2024-09-04T16:30:37.029 INFO:tasks.workunit.client.0.smithi170.stdout:0/923: mkdir d11/d13/d2f/d3f/d154 0 2024-09-04T16:30:37.030 INFO:tasks.workunit.client.0.smithi170.stdout:0/924: write d11/d13/d2f/d3f/f138 [395999,97511] 0 2024-09-04T16:30:37.032 INFO:tasks.workunit.client.0.smithi170.stdout:0/925: fdatasync d11/d13/d2f/fa7 0 2024-09-04T16:30:37.033 INFO:tasks.workunit.client.0.smithi170.stdout:7/957: dwrite d12/d15/d71/f70 [0,4194304] 0 2024-09-04T16:30:37.035 INFO:tasks.workunit.client.0.smithi170.stdout:7/958: chown d12/d16/d1d/d65/dff 986892745 1 2024-09-04T16:30:37.052 INFO:tasks.workunit.client.0.smithi170.stdout:7/959: write d12/d15/fa4 [1283822,46704] 0 2024-09-04T16:30:37.056 INFO:tasks.workunit.client.0.smithi170.stdout:7/960: mknod d12/d15/d71/d42/c14c 0 2024-09-04T16:30:37.056 INFO:tasks.workunit.client.0.smithi170.stdout:0/926: dwrite d11/d13/d4a/d66/d6d/d105/fba [0,4194304] 0 2024-09-04T16:30:37.076 INFO:tasks.workunit.client.0.smithi170.stdout:0/927: write d11/d13/d4a/dbc/f122 [4475523,83366] 0 2024-09-04T16:30:37.077 INFO:tasks.workunit.client.0.smithi170.stdout:7/961: write d12/d15/f24 [2465676,14655] 0 2024-09-04T16:30:37.077 INFO:tasks.workunit.client.0.smithi170.stdout:0/928: rmdir d11/d13/d2f 39 2024-09-04T16:30:37.085 INFO:tasks.workunit.client.0.smithi170.stdout:0/929: dwrite d11/d13/d36/d12b/f143 [0,4194304] 0 2024-09-04T16:30:37.089 INFO:tasks.workunit.client.0.smithi170.stdout:0/930: creat d11/d13/d4a/dc5/f155 x:0 0 0 2024-09-04T16:30:37.097 INFO:tasks.workunit.client.0.smithi170.stdout:7/962: write d12/d16/db7/fd6 [497929,16026] 0 2024-09-04T16:30:37.099 INFO:tasks.workunit.client.0.smithi170.stdout:7/963: dread - d12/d16/d1d/f11c zero size 2024-09-04T16:30:37.100 INFO:tasks.workunit.client.0.smithi170.stdout:7/964: write d12/d16/d1d/d65/d82/dcb/df8/f120 [1445538,71342] 0 2024-09-04T16:30:37.114 INFO:tasks.workunit.client.0.smithi170.stdout:0/931: truncate d11/d13/d4a/d66/d8c/fc6 4079774 0 2024-09-04T16:30:37.116 INFO:tasks.workunit.client.0.smithi170.stdout:7/965: dread d12/d5a/fdf [0,4194304] 0 2024-09-04T16:30:37.117 INFO:tasks.workunit.client.0.smithi170.stdout:0/932: rmdir d11/d13/d4a/d66/d8c 39 2024-09-04T16:30:37.120 INFO:tasks.workunit.client.0.smithi170.stdout:7/966: creat d12/d15/d71/d42/d79/d9d/d51/f14d x:0 0 0 2024-09-04T16:30:37.124 INFO:tasks.workunit.client.0.smithi170.stdout:7/967: fdatasync d12/d15/d71/f3b 0 2024-09-04T16:30:37.141 INFO:tasks.workunit.client.0.smithi170.stdout:0/933: write d11/d13/d4a/d66/d6d/d105/fb9 [1015400,120767] 0 2024-09-04T16:30:37.142 INFO:tasks.workunit.client.0.smithi170.stdout:7/968: write d12/d15/d71/d42/d81/fbc [7979832,122512] 0 2024-09-04T16:30:37.144 INFO:tasks.workunit.client.0.smithi170.stdout:7/969: stat d12/d15/d71/d42/d81/l2c 0 2024-09-04T16:30:37.153 INFO:tasks.workunit.client.0.smithi170.stdout:7/970: link d12/d15/d71/cd7 d12/d15/d111/c14e 0 2024-09-04T16:30:37.158 INFO:tasks.workunit.client.0.smithi170.stdout:7/971: link d12/d15/d71/f70 d12/d16/d1d/d65/d82/dcb/df8/f14f 0 2024-09-04T16:30:37.169 INFO:tasks.workunit.client.0.smithi170.stdout:0/934: dread d11/d13/d2f/d3f/f63 [0,4194304] 0 2024-09-04T16:30:37.177 INFO:tasks.workunit.client.0.smithi170.stdout:0/935: creat d11/d13/d4a/d66/d8c/f156 x:0 0 0 2024-09-04T16:30:37.177 INFO:tasks.workunit.client.0.smithi170.stdout:0/936: readlink d11/d75/l8f 0 2024-09-04T16:30:37.178 INFO:tasks.workunit.client.0.smithi170.stdout:7/972: dread d12/d15/d71/d42/d81/f5e [0,4194304] 0 2024-09-04T16:30:37.178 INFO:tasks.workunit.client.0.smithi170.stdout:7/973: fdatasync d12/d15/f28 0 2024-09-04T16:30:37.179 INFO:tasks.workunit.client.0.smithi170.stdout:7/974: chown d12/d15/d71/f70 540 1 2024-09-04T16:30:37.182 INFO:tasks.workunit.client.0.smithi170.stdout:0/937: rename d11/d13/d35 to d11/d13/d2f/d3f/d13e/d157 0 2024-09-04T16:30:37.186 INFO:tasks.workunit.client.0.smithi170.stdout:7/975: fsync d12/d5a/fae 0 2024-09-04T16:30:37.187 INFO:tasks.workunit.client.0.smithi170.stdout:0/938: truncate d11/d13/d4a/d66/fa0 1700435 0 2024-09-04T16:30:37.187 INFO:tasks.workunit.client.0.smithi170.stdout:7/976: truncate d12/d16/d8d/f138 1011212 0 2024-09-04T16:30:37.190 INFO:tasks.workunit.client.0.smithi170.stdout:0/939: dread d11/d13/d36/f40 [0,4194304] 0 2024-09-04T16:30:37.191 INFO:tasks.workunit.client.0.smithi170.stdout:7/977: symlink d12/d16/d1d/d65/d7b/d114/l150 0 2024-09-04T16:30:37.192 INFO:tasks.workunit.client.0.smithi170.stdout:7/978: dread - d12/d15/f10c zero size 2024-09-04T16:30:37.196 INFO:tasks.workunit.client.0.smithi170.stdout:7/979: truncate d12/d16/d1d/f11c 527229 0 2024-09-04T16:30:37.198 INFO:tasks.workunit.client.0.smithi170.stdout:7/980: read d12/d15/d71/f5b [216422,26612] 0 2024-09-04T16:30:37.202 INFO:tasks.workunit.client.0.smithi170.stdout:0/940: dwrite d11/f50 [0,4194304] 0 2024-09-04T16:30:37.205 INFO:tasks.workunit.client.0.smithi170.stdout:7/981: dread d12/d16/d1d/d65/d82/fa1 [0,4194304] 0 2024-09-04T16:30:37.207 INFO:tasks.workunit.client.0.smithi170.stdout:0/941: unlink d11/d13/d4a/d66/d6d/f91 0 2024-09-04T16:30:37.210 INFO:tasks.workunit.client.0.smithi170.stdout:7/982: creat d12/d16/d1d/d140/f151 x:0 0 0 2024-09-04T16:30:37.213 INFO:tasks.workunit.client.0.smithi170.stdout:7/983: unlink d12/d5a/fdf 0 2024-09-04T16:30:37.214 INFO:tasks.workunit.client.0.smithi170.stdout:7/984: chown d12/d49/fea 1663 1 2024-09-04T16:30:37.218 INFO:tasks.workunit.client.0.smithi170.stdout:7/985: creat d12/d16/d1d/d65/f152 x:0 0 0 2024-09-04T16:30:37.219 INFO:tasks.workunit.client.0.smithi170.stdout:7/986: write d12/d15/d71/d42/d79/d9d/f13f [611750,52239] 0 2024-09-04T16:30:37.228 INFO:tasks.workunit.client.0.smithi170.stdout:7/987: getdents d12/d15/d71/d42/d79/d9d/dc9 0 2024-09-04T16:30:37.236 INFO:tasks.workunit.client.0.smithi170.stdout:0/942: dwrite d11/d13/f24 [0,4194304] 0 2024-09-04T16:30:37.236 INFO:tasks.workunit.client.0.smithi170.stdout:7/988: getdents d12 0 2024-09-04T16:30:37.238 INFO:tasks.workunit.client.0.smithi170.stdout:0/943: write d11/d75/f9a [331419,66757] 0 2024-09-04T16:30:37.238 INFO:tasks.workunit.client.0.smithi170.stdout:1/936: sync 2024-09-04T16:30:37.240 INFO:tasks.workunit.client.0.smithi170.stdout:0/944: stat d11/d13/d71/d43/f3c 0 2024-09-04T16:30:37.247 INFO:tasks.workunit.client.0.smithi170.stdout:7/989: creat d12/d16/d1d/d65/f153 x:0 0 0 2024-09-04T16:30:37.248 INFO:tasks.workunit.client.0.smithi170.stdout:1/937: creat d9/d11/d85/dd8/d10d/f143 x:0 0 0 2024-09-04T16:30:37.250 INFO:tasks.workunit.client.0.smithi170.stdout:0/945: fsync d11/d13/d4a/d66/d6d/d105/f98 0 2024-09-04T16:30:37.251 INFO:tasks.workunit.client.0.smithi170.stdout:1/938: mknod d9/d11/d2f/d7f/c144 0 2024-09-04T16:30:37.255 INFO:tasks.workunit.client.0.smithi170.stdout:7/990: link d12/d15/d71/d42/d81/d5c/led d12/d15/d71/d42/d79/d9d/d51/l154 0 2024-09-04T16:30:37.257 INFO:tasks.workunit.client.0.smithi170.stdout:7/991: symlink d12/d16/d1d/d65/dd0/l155 0 2024-09-04T16:30:37.260 INFO:tasks.workunit.client.0.smithi170.stdout:7/992: unlink d12/d15/d71/c84 0 2024-09-04T16:30:37.264 INFO:tasks.workunit.client.0.smithi170.stdout:0/946: dread d11/d13/d2f/d3f/d13e/d157/fad [0,4194304] 0 2024-09-04T16:30:37.264 INFO:tasks.workunit.client.0.smithi170.stdout:0/947: fdatasync d11/d75/f9a 0 2024-09-04T16:30:37.268 INFO:tasks.workunit.client.0.smithi170.stdout:1/939: write d9/d26/f5a [835763,12456] 0 2024-09-04T16:30:37.269 INFO:tasks.workunit.client.0.smithi170.stdout:1/940: stat d9/d11/d2f/d6b/c88 0 2024-09-04T16:30:37.271 INFO:tasks.workunit.client.0.smithi170.stdout:0/948: mkdir d11/d13/d71/d158 0 2024-09-04T16:30:37.273 INFO:tasks.workunit.client.0.smithi170.stdout:1/941: mkdir d9/d34/d5f/d145 0 2024-09-04T16:30:37.274 INFO:tasks.workunit.client.0.smithi170.stdout:0/949: creat d11/d75/dce/f159 x:0 0 0 2024-09-04T16:30:37.277 INFO:tasks.workunit.client.0.smithi170.stdout:7/993: dwrite d12/d16/d8d/fa5 [0,4194304] 0 2024-09-04T16:30:37.278 INFO:tasks.workunit.client.0.smithi170.stdout:1/942: rename d9/f27 to d9/d11/d2f/d7f/da8/f146 0 2024-09-04T16:30:37.282 INFO:tasks.workunit.client.0.smithi170.stdout:0/950: creat d11/d75/dce/f15a x:0 0 0 2024-09-04T16:30:37.283 INFO:tasks.workunit.client.0.smithi170.stdout:7/994: dread - d12/d15/d41/f100 zero size 2024-09-04T16:30:37.284 INFO:tasks.workunit.client.0.smithi170.stdout:7/995: readlink d12/d15/d71/d42/l57 0 2024-09-04T16:30:37.285 INFO:tasks.workunit.client.0.smithi170.stdout:1/943: dwrite d9/d102/d11b/dde/f127 [0,4194304] 0 2024-09-04T16:30:37.285 INFO:tasks.workunit.client.0.smithi170.stdout:7/996: chown fa 53176 1 2024-09-04T16:30:37.293 INFO:tasks.workunit.client.0.smithi170.stdout:1/944: dwrite d9/d11/d2f/d7f/fb7 [0,4194304] 0 2024-09-04T16:30:37.296 INFO:tasks.workunit.client.0.smithi170.stdout:1/945: mknod d9/d11/d2f/db9/c147 0 2024-09-04T16:30:37.306 INFO:tasks.workunit.client.0.smithi170.stdout:0/951: dwrite d11/f15 [0,4194304] 0 2024-09-04T16:30:37.313 INFO:tasks.workunit.client.0.smithi170.stdout:0/952: dwrite d11/d75/dce/f159 [0,4194304] 0 2024-09-04T16:30:37.318 INFO:tasks.workunit.client.0.smithi170.stdout:7/997: dwrite d12/d16/d1d/d65/dd0/f113 [0,4194304] 0 2024-09-04T16:30:37.402 INFO:tasks.workunit.client.0.smithi170.stdout:1/946: truncate d9/d102/d11b/dde/f127 4017385 0 2024-09-04T16:30:37.410 INFO:tasks.workunit.client.0.smithi170.stdout:1/947: creat d9/d102/d11b/dc6/f148 x:0 0 0 2024-09-04T16:30:37.411 INFO:tasks.workunit.client.0.smithi170.stdout:0/953: creat d11/d13/d2f/f15b x:0 0 0 2024-09-04T16:30:37.413 INFO:tasks.workunit.client.0.smithi170.stdout:0/954: write d11/d13/d36/fea [1176809,92840] 0 2024-09-04T16:30:37.414 INFO:tasks.workunit.client.0.smithi170.stdout:1/948: truncate d9/d11/dae/f91 999637 0 2024-09-04T16:30:37.416 INFO:tasks.workunit.client.0.smithi170.stdout:7/998: truncate d12/d49/fea 714999 0 2024-09-04T16:30:37.419 INFO:tasks.workunit.client.0.smithi170.stdout:0/955: read d11/d13/d71/f4c [863289,96328] 0 2024-09-04T16:30:37.419 INFO:tasks.workunit.client.0.smithi170.stdout:1/949: mkdir d9/d11/d85/d149 0 2024-09-04T16:30:37.423 INFO:tasks.workunit.client.0.smithi170.stdout:1/950: creat d9/d11/d85/dd8/dee/d13a/f14a x:0 0 0 2024-09-04T16:30:37.425 INFO:tasks.workunit.client.0.smithi170.stdout:0/956: rename d11/d13/d4a/dc5/df0/f120 to d11/d13/d4a/d66/d8c/d12a/d151/f15c 0 2024-09-04T16:30:37.426 INFO:tasks.workunit.client.0.smithi170.stdout:0/957: write d11/d13/d4a/d66/d8c/d12a/f145 [745795,34679] 0 2024-09-04T16:30:37.429 INFO:tasks.workunit.client.0.smithi170.stdout:7/999: truncate d12/d5a/fc8 2635291 0 2024-09-04T16:30:37.431 INFO:tasks.workunit.client.0.smithi170.stdout:1/951: creat d9/d34/dbe/d10b/f14b x:0 0 0 2024-09-04T16:30:37.432 INFO:tasks.workunit.client.0.smithi170.stdout:0/958: symlink d11/d13/d4a/dc5/d10b/l15d 0 2024-09-04T16:30:37.432 INFO:tasks.workunit.client.0.smithi170.stdout:1/952: truncate d9/d34/f125 786656 0 2024-09-04T16:30:37.433 INFO:tasks.workunit.client.0.smithi170.stdout:0/959: stat d11/d13/d71/f14d 0 2024-09-04T16:30:37.433 INFO:tasks.workunit.client.0.smithi170.stdout:1/953: rename d9 to d9/d11/dae/df5/d14c 22 2024-09-04T16:30:37.436 INFO:tasks.workunit.client.0.smithi170.stdout:1/954: mkdir d9/d11/d85/dd8/dee/d13a/d14d 0 2024-09-04T16:30:37.439 INFO:tasks.workunit.client.0.smithi170.stdout:0/960: dwrite d11/d75/f148 [0,4194304] 0 2024-09-04T16:30:37.439 INFO:tasks.workunit.client.0.smithi170.stdout:1/955: mknod d9/d11/d2f/d6b/d61/d108/c14e 0 2024-09-04T16:30:37.440 INFO:tasks.workunit.client.0.smithi170.stdout:0/961: fsync d11/d75/d77/d149/f150 0 2024-09-04T16:30:37.445 INFO:tasks.workunit.client.0.smithi170.stdout:1/956: dread d9/d11/d85/df6/f10a [0,4194304] 0 2024-09-04T16:30:37.450 INFO:tasks.workunit.client.0.smithi170.stdout:0/962: dwrite d11/d13/d4a/d66/d8c/f156 [0,4194304] 0 2024-09-04T16:30:37.452 INFO:tasks.workunit.client.0.smithi170.stdout:1/957: rename d9/d34/fbc to d9/d11/dae/d6a/d79/d7c/f14f 0 2024-09-04T16:30:37.458 INFO:tasks.workunit.client.0.smithi170.stdout:1/958: symlink d9/d102/d11b/dde/l150 0 2024-09-04T16:30:37.461 INFO:tasks.workunit.client.0.smithi170.stdout:0/963: write d11/d13/d4a/d66/d8c/dae/ff9 [267860,123108] 0 2024-09-04T16:30:37.462 INFO:tasks.workunit.client.0.smithi170.stdout:1/959: read d9/d11/d2f/d7f/da8/f146 [6610021,74080] 0 2024-09-04T16:30:37.465 INFO:tasks.workunit.client.0.smithi170.stdout:1/960: unlink d9/d11/l2c 0 2024-09-04T16:30:37.470 INFO:tasks.workunit.client.0.smithi170.stdout:0/964: dread d11/d13/d36/de5/f10d [0,4194304] 0 2024-09-04T16:30:37.470 INFO:tasks.workunit.client.0.smithi170.stdout:0/965: chown d11/d13/d4a/d66/d6d 1996569 1 2024-09-04T16:30:37.473 INFO:tasks.workunit.client.0.smithi170.stdout:1/961: write d9/d11/dae/d6a/d79/ff2 [142391,115622] 0 2024-09-04T16:30:37.476 INFO:tasks.workunit.client.0.smithi170.stdout:1/962: mkdir d9/d11/d2f/d6b/d61/d108/d151 0 2024-09-04T16:30:37.479 INFO:tasks.workunit.client.0.smithi170.stdout:0/966: dwrite d11/d13/d4a/d66/d6d/f123 [0,4194304] 0 2024-09-04T16:30:37.480 INFO:tasks.workunit.client.0.smithi170.stdout:1/963: creat d9/d26/d77/f152 x:0 0 0 2024-09-04T16:30:37.483 INFO:tasks.workunit.client.0.smithi170.stdout:0/967: rmdir d11/d13/d2f/d3f 39 2024-09-04T16:30:37.490 INFO:tasks.workunit.client.0.smithi170.stdout:0/968: dwrite d11/d13/d2f/d3f/f138 [0,4194304] 0 2024-09-04T16:30:37.497 INFO:tasks.workunit.client.0.smithi170.stdout:1/964: truncate d9/d11/d2f/d6b/f70 1357352 0 2024-09-04T16:30:37.501 INFO:tasks.workunit.client.0.smithi170.stdout:0/969: write d11/d13/d71/f76 [285294,76423] 0 2024-09-04T16:30:37.505 INFO:tasks.workunit.client.0.smithi170.stdout:1/965: dwrite d9/d26/f5a [4194304,4194304] 0 2024-09-04T16:30:37.505 INFO:tasks.workunit.client.0.smithi170.stdout:0/970: creat d11/d13/d4a/d66/d8c/ddd/f15e x:0 0 0 2024-09-04T16:30:37.507 INFO:tasks.workunit.client.0.smithi170.stdout:1/966: dread - d9/d11/d2f/db9/fe6 zero size 2024-09-04T16:30:37.507 INFO:tasks.workunit.client.0.smithi170.stdout:1/967: fdatasync d9/d34/d5f/fc7 0 2024-09-04T16:30:37.511 INFO:tasks.workunit.client.0.smithi170.stdout:0/971: mknod d11/d13/d4a/d66/d8c/dae/d14e/c15f 0 2024-09-04T16:30:37.515 INFO:tasks.workunit.client.0.smithi170.stdout:0/972: creat d11/d13/d4a/dc5/d10b/f160 x:0 0 0 2024-09-04T16:30:37.519 INFO:tasks.workunit.client.0.smithi170.stdout:0/973: fdatasync d11/d13/d2f/d3f/d13e/d157/f4b 0 2024-09-04T16:30:37.522 INFO:tasks.workunit.client.0.smithi170.stdout:1/968: getdents d9/d11/dae/d6a/d79 0 2024-09-04T16:30:37.524 INFO:tasks.workunit.client.0.smithi170.stdout:0/974: dread - d11/d13/f7c zero size 2024-09-04T16:30:37.524 INFO:tasks.workunit.client.0.smithi170.stdout:0/975: stat d11/d75/d77 0 2024-09-04T16:30:37.527 INFO:tasks.workunit.client.0.smithi170.stdout:0/976: truncate d11/d13/d4a/d66/d6d/f127 8879 0 2024-09-04T16:30:37.531 INFO:tasks.workunit.client.0.smithi170.stdout:0/977: creat d11/d75/d77/f161 x:0 0 0 2024-09-04T16:30:37.535 INFO:tasks.workunit.client.0.smithi170.stdout:1/969: dwrite d9/d11/d2f/d6b/f97 [0,4194304] 0 2024-09-04T16:30:37.535 INFO:tasks.workunit.client.0.smithi170.stdout:0/978: chown d11/d13/d71/d43/lbb 2412 1 2024-09-04T16:30:37.538 INFO:tasks.workunit.client.0.smithi170.stdout:0/979: rmdir d11/d13/d4a/d66/d8c/d113 39 2024-09-04T16:30:37.539 INFO:tasks.workunit.client.0.smithi170.stdout:0/980: readlink d11/d13/d4a/d66/d8c/ddd/l109 0 2024-09-04T16:30:37.539 INFO:tasks.workunit.client.0.smithi170.stdout:1/970: truncate d9/d11/dae/f87 73553 0 2024-09-04T16:30:37.550 INFO:tasks.workunit.client.0.smithi170.stdout:0/981: dread d11/d13/d71/fd6 [0,4194304] 0 2024-09-04T16:30:37.554 INFO:tasks.workunit.client.0.smithi170.stdout:0/982: write d11/d13/d4a/d66/d6d/d105/f98 [953041,50119] 0 2024-09-04T16:30:37.565 INFO:tasks.workunit.client.0.smithi170.stdout:0/983: dwrite d11/d13/d4a/d66/d8c/d12a/d151/f15c [0,4194304] 0 2024-09-04T16:30:37.568 INFO:tasks.workunit.client.0.smithi170.stdout:0/984: symlink d11/d13/d36/de5/d11d/l162 0 2024-09-04T16:30:37.573 INFO:tasks.workunit.client.0.smithi170.stdout:0/985: creat d11/d13/d4a/f163 x:0 0 0 2024-09-04T16:30:37.579 INFO:tasks.workunit.client.0.smithi170.stdout:0/986: dread d11/d13/d2f/d3f/d13e/d157/fd0 [0,4194304] 0 2024-09-04T16:30:37.582 INFO:tasks.workunit.client.0.smithi170.stdout:0/987: rename d11/d13/d2f/d3f/d13e/d157/f4b to d11/d13/d36/de5/f164 0 2024-09-04T16:30:37.596 INFO:tasks.workunit.client.0.smithi170.stdout:0/988: dread d11/d75/f9e [0,4194304] 0 2024-09-04T16:30:37.598 INFO:tasks.workunit.client.0.smithi170.stdout:0/989: rmdir d11/d13/d4a/d66/d8c/dae/d14e 39 2024-09-04T16:30:37.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:37 smithi170 ceph-mon[29272]: pgmap v38: 65 pgs: 65 active+clean; 3.1 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 46 MiB/s rd, 121 MiB/s wr, 304 op/s 2024-09-04T16:30:37.605 INFO:tasks.workunit.client.0.smithi170.stdout:0/990: write d11/d13/d71/d43/f126 [13723,112630] 0 2024-09-04T16:30:37.608 INFO:tasks.workunit.client.0.smithi170.stdout:0/991: write d11/d13/d71/d43/f3c [516065,38435] 0 2024-09-04T16:30:37.611 INFO:tasks.workunit.client.0.smithi170.stdout:0/992: creat d11/d13/d4a/dc5/df0/f165 x:0 0 0 2024-09-04T16:30:37.613 INFO:tasks.workunit.client.0.smithi170.stdout:0/993: read - d11/d13/d4a/d66/d8c/dae/fb3 zero size 2024-09-04T16:30:37.617 INFO:tasks.workunit.client.0.smithi170.stdout:0/994: rename d11/d13/d4a/d66/d8c/dae/d14e/d124/f14b to d11/d13/d36/de5/d11d/f166 0 2024-09-04T16:30:37.626 INFO:tasks.workunit.client.0.smithi170.stdout:0/995: write d11/d13/d4a/d66/d8c/d113/f128 [146034,74745] 0 2024-09-04T16:30:37.630 INFO:tasks.workunit.client.0.smithi170.stdout:0/996: mknod d11/d13/d36/d12b/d13b/c167 0 2024-09-04T16:30:37.631 INFO:tasks.workunit.client.0.smithi170.stdout:0/997: chown d11/d13/d4a/d66/d6d/d105/f98 1 1 2024-09-04T16:30:37.631 INFO:tasks.workunit.client.0.smithi170.stdout:0/998: fsync d11/d13/d36/f11b 0 2024-09-04T16:30:37.633 INFO:tasks.workunit.client.0.smithi170.stdout:0/999: readlink d11/d13/d4a/dc5/d10b/l117 0 2024-09-04T16:30:37.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:37 smithi193 ceph-mon[36288]: pgmap v38: 65 pgs: 65 active+clean; 3.1 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 46 MiB/s rd, 121 MiB/s wr, 304 op/s 2024-09-04T16:30:37.656 INFO:tasks.workunit.client.0.smithi170.stdout:2/837: sync 2024-09-04T16:30:37.656 INFO:tasks.workunit.client.0.smithi170.stdout:9/810: sync 2024-09-04T16:30:37.657 INFO:tasks.workunit.client.0.smithi170.stdout:9/811: chown d2/d3d/d54/l84 5 1 2024-09-04T16:30:37.657 INFO:tasks.workunit.client.0.smithi170.stdout:9/812: chown d2/d3d 338664 1 2024-09-04T16:30:37.659 INFO:tasks.workunit.client.0.smithi170.stdout:2/838: mknod d3/d3c/dc1/d101/d1c/d77/dc2/d107/c118 0 2024-09-04T16:30:37.661 INFO:tasks.workunit.client.0.smithi170.stdout:2/839: fdatasync d3/d3c/dc1/d101/d1c/d47/f100 0 2024-09-04T16:30:37.664 INFO:tasks.workunit.client.0.smithi170.stdout:9/813: rmdir d2/d11/d8f/de1/de5 0 2024-09-04T16:30:37.664 INFO:tasks.workunit.client.0.smithi170.stdout:9/814: chown d2/d3d 2596 1 2024-09-04T16:30:37.666 INFO:tasks.workunit.client.0.smithi170.stdout:2/840: dread d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/f99 [0,4194304] 0 2024-09-04T16:30:37.666 INFO:tasks.workunit.client.0.smithi170.stdout:9/815: chown d2/d3d/d6d/l6e 2738525 1 2024-09-04T16:30:37.667 INFO:tasks.workunit.client.0.smithi170.stdout:9/816: chown d2/d11/d23/fe4 3 1 2024-09-04T16:30:37.673 INFO:tasks.workunit.client.0.smithi170.stdout:2/841: write d3/d3c/dc1/d101/df/d45/f10c [976601,18162] 0 2024-09-04T16:30:37.675 INFO:tasks.workunit.client.0.smithi170.stdout:9/817: write d2/d11/d23/d95/fbe [385481,122805] 0 2024-09-04T16:30:37.676 INFO:tasks.workunit.client.0.smithi170.stdout:2/842: symlink d3/d3c/dc1/d101/l119 0 2024-09-04T16:30:37.678 INFO:tasks.workunit.client.0.smithi170.stdout:9/818: dread d2/d3d/d27/d65/dcb/de0/dee/f5a [0,4194304] 0 2024-09-04T16:30:37.678 INFO:tasks.workunit.client.0.smithi170.stdout:2/843: truncate f0 195332 0 2024-09-04T16:30:37.681 INFO:tasks.workunit.client.0.smithi170.stdout:2/844: creat d3/d3c/dc1/d101/d1c/d47/d83/deb/f11a x:0 0 0 2024-09-04T16:30:37.684 INFO:tasks.workunit.client.0.smithi170.stdout:9/819: creat d2/d3d/d27/d65/dcb/de0/dee/dd7/ffe x:0 0 0 2024-09-04T16:30:37.687 INFO:tasks.workunit.client.0.smithi170.stdout:2/845: dwrite d3/d3c/dc1/d101/d1c/d47/fea [0,4194304] 0 2024-09-04T16:30:37.689 INFO:tasks.workunit.client.0.smithi170.stdout:2/846: creat d3/d3c/d40/d48/f11b x:0 0 0 2024-09-04T16:30:37.694 INFO:tasks.workunit.client.0.smithi170.stdout:2/847: truncate d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/dee/f10f 75396 0 2024-09-04T16:30:37.696 INFO:tasks.workunit.client.0.smithi170.stdout:2/848: write d3/d4/d86/dc9/fb1 [3036566,102283] 0 2024-09-04T16:30:37.698 INFO:tasks.workunit.client.0.smithi170.stdout:9/820: write d2/d3d/d27/d65/fa7 [324646,56658] 0 2024-09-04T16:30:37.701 INFO:tasks.workunit.client.0.smithi170.stdout:2/849: creat d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/d97/f11c x:0 0 0 2024-09-04T16:30:37.703 INFO:tasks.workunit.client.0.smithi170.stdout:9/821: mkdir d2/d3d/dff 0 2024-09-04T16:30:37.705 INFO:tasks.workunit.client.0.smithi170.stdout:2/850: mknod d3/d4/d86/dfe/c11d 0 2024-09-04T16:30:37.708 INFO:tasks.workunit.client.0.smithi170.stdout:9/822: symlink d2/d32/l100 0 2024-09-04T16:30:37.709 INFO:tasks.workunit.client.0.smithi170.stdout:9/823: read d2/d3d/d6d/fb4 [348181,53652] 0 2024-09-04T16:30:37.710 INFO:tasks.workunit.client.0.smithi170.stdout:2/851: chown d3/d3c/dc1/d101/d62/d6f/d110/dcf 23 1 2024-09-04T16:30:37.711 INFO:tasks.workunit.client.0.smithi170.stdout:2/852: chown d3/d3c/d40/d48/d68/c89 609818 1 2024-09-04T16:30:37.711 INFO:tasks.workunit.client.0.smithi170.stdout:9/824: mkdir d2/d11/d23/d95/d101 0 2024-09-04T16:30:37.715 INFO:tasks.workunit.client.0.smithi170.stdout:9/825: link d2/d3d/d4d/fd3 d2/d3d/d54/df3/f102 0 2024-09-04T16:30:37.716 INFO:tasks.workunit.client.0.smithi170.stdout:9/826: readlink d2/d3d/d27/d65/dcb/de0/dee/ldb 0 2024-09-04T16:30:37.716 INFO:tasks.workunit.client.0.smithi170.stdout:9/827: dread - d2/d11/d23/d95/f97 zero size 2024-09-04T16:30:37.719 INFO:tasks.workunit.client.0.smithi170.stdout:9/828: fdatasync d2/fd 0 2024-09-04T16:30:37.723 INFO:tasks.workunit.client.0.smithi170.stdout:2/853: write f0 [838667,120049] 0 2024-09-04T16:30:37.723 INFO:tasks.workunit.client.0.smithi170.stdout:9/829: link d2/d11/d23/d95/lce d2/d3d/d6d/d79/dd0/l103 0 2024-09-04T16:30:37.726 INFO:tasks.workunit.client.0.smithi170.stdout:2/854: fdatasync d3/d3c/d40/fe9 0 2024-09-04T16:30:37.726 INFO:tasks.workunit.client.0.smithi170.stdout:9/830: mknod d2/d11/d8f/df1/c104 0 2024-09-04T16:30:37.730 INFO:tasks.workunit.client.0.smithi170.stdout:2/855: symlink d3/d3c/dc1/d101/d62/d6f/d110/dcf/dba/dd5/l11e 0 2024-09-04T16:30:37.734 INFO:tasks.workunit.client.0.smithi170.stdout:2/856: rename d3/f50 to d3/d3c/dc1/d101/d62/f11f 0 2024-09-04T16:30:37.737 INFO:tasks.workunit.client.0.smithi170.stdout:2/857: unlink d3/d3c/dc1/d101/df/d45/fa9 0 2024-09-04T16:30:37.737 INFO:tasks.workunit.client.0.smithi170.stdout:2/858: readlink d3/d3c/dc1/d101/d62/d6f/d110/la4 0 2024-09-04T16:30:37.738 INFO:tasks.workunit.client.0.smithi170.stdout:2/859: dread - d3/d3c/dc1/d101/d1c/d77/f105 zero size 2024-09-04T16:30:37.740 INFO:tasks.workunit.client.0.smithi170.stdout:2/860: symlink d3/d3c/dc1/d101/d1c/d47/d83/l120 0 2024-09-04T16:30:37.741 INFO:tasks.workunit.client.0.smithi170.stdout:9/831: dread d2/d32/f93 [0,4194304] 0 2024-09-04T16:30:37.743 INFO:tasks.workunit.client.0.smithi170.stdout:9/832: symlink d2/d3d/d4d/d59/l105 0 2024-09-04T16:30:37.744 INFO:tasks.workunit.client.0.smithi170.stdout:2/861: truncate d3/d3c/dc1/d101/df/d45/f7d 769103 0 2024-09-04T16:30:37.745 INFO:tasks.workunit.client.0.smithi170.stdout:9/833: mknod d2/d3d/d27/d65/dcb/c106 0 2024-09-04T16:30:37.747 INFO:tasks.workunit.client.0.smithi170.stdout:9/834: dread - d2/d3d/d27/d65/dcb/de0/dee/fab zero size 2024-09-04T16:30:37.748 INFO:tasks.workunit.client.0.smithi170.stdout:9/835: mkdir d2/d3d/d54/df3/d107 0 2024-09-04T16:30:37.750 INFO:tasks.workunit.client.0.smithi170.stdout:9/836: mkdir d2/d3d/d27/d65/dcb/d108 0 2024-09-04T16:30:37.751 INFO:tasks.workunit.client.0.smithi170.stdout:9/837: dread - d2/d3d/d54/df3/ff8 zero size 2024-09-04T16:30:37.754 INFO:tasks.workunit.client.0.smithi170.stdout:9/838: creat d2/d3d/d27/d65/dcb/de0/dee/dd7/f109 x:0 0 0 2024-09-04T16:30:37.761 INFO:tasks.workunit.client.0.smithi170.stdout:2/862: write d3/d3c/dc1/d101/d62/d6f/d110/f7c [2379182,80577] 0 2024-09-04T16:30:37.765 INFO:tasks.workunit.client.0.smithi170.stdout:2/863: creat d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/dee/f121 x:0 0 0 2024-09-04T16:30:37.770 INFO:tasks.workunit.client.0.smithi170.stdout:9/839: dwrite d2/d3d/f10 [0,4194304] 0 2024-09-04T16:30:37.772 INFO:tasks.workunit.client.0.smithi170.stdout:9/840: chown d2/d3d/d27/d65/dcb/ff4 3 1 2024-09-04T16:30:37.773 INFO:tasks.workunit.client.0.smithi170.stdout:2/864: dwrite d3/d3c/dc1/d101/d1c/d77/dc2/ffc [0,4194304] 0 2024-09-04T16:30:37.778 INFO:tasks.workunit.client.0.smithi170.stdout:9/841: dread d2/d11/d23/d95/fbe [0,4194304] 0 2024-09-04T16:30:37.780 INFO:tasks.workunit.client.0.smithi170.stdout:9/842: write d2/fa8 [3697134,43550] 0 2024-09-04T16:30:37.782 INFO:tasks.workunit.client.0.smithi170.stdout:2/865: dwrite d3/d3c/dc1/d101/d62/d6f/ff1 [0,4194304] 0 2024-09-04T16:30:37.782 INFO:tasks.workunit.client.0.smithi170.stdout:9/843: creat d2/d3d/d27/f10a x:0 0 0 2024-09-04T16:30:37.784 INFO:tasks.workunit.client.0.smithi170.stdout:9/844: write d2/d11/d23/fe4 [719972,62272] 0 2024-09-04T16:30:37.786 INFO:tasks.workunit.client.0.smithi170.stdout:2/866: unlink d3/d4/d86/dc9/dd9/fa1 0 2024-09-04T16:30:37.786 INFO:tasks.workunit.client.0.smithi170.stdout:9/845: write d2/d3d/d27/d65/dcb/de0/dee/dd7/ffe [52892,101797] 0 2024-09-04T16:30:37.787 INFO:tasks.workunit.client.0.smithi170.stdout:2/867: chown d3/d3c/de7 226744273 1 2024-09-04T16:30:37.789 INFO:tasks.workunit.client.0.smithi170.stdout:2/868: read - d3/d4/d86/dc9/dd9/f8b zero size 2024-09-04T16:30:37.792 INFO:tasks.workunit.client.0.smithi170.stdout:2/869: mkdir d3/d3c/dc1/d101/d1c/d47/d83/d122 0 2024-09-04T16:30:37.796 INFO:tasks.workunit.client.0.smithi170.stdout:9/846: dwrite d2/d3d/d4d/fd3 [0,4194304] 0 2024-09-04T16:30:37.796 INFO:tasks.workunit.client.0.smithi170.stdout:2/870: mkdir d3/d4/d123 0 2024-09-04T16:30:37.797 INFO:tasks.workunit.client.0.smithi170.stdout:9/847: mkdir d2/d3d/d35/d10b 0 2024-09-04T16:30:37.798 INFO:tasks.workunit.client.0.smithi170.stdout:2/871: chown d3/d4/d86/dc9/dd9/fe4 1705893 1 2024-09-04T16:30:37.800 INFO:tasks.workunit.client.0.smithi170.stdout:2/872: write d3/d3c/dc1/d101/dc5/f102 [3984075,85962] 0 2024-09-04T16:30:37.800 INFO:tasks.workunit.client.0.smithi170.stdout:2/873: chown d3/d4/ldd 198319919 1 2024-09-04T16:30:37.802 INFO:tasks.workunit.client.0.smithi170.stdout:2/874: unlink d3/d3c/dc1/d101/d1c/d47/d83/c85 0 2024-09-04T16:30:37.803 INFO:tasks.workunit.client.0.smithi170.stdout:2/875: chown d3/d3c/dc1/d101/d1c/f23 45969 1 2024-09-04T16:30:37.803 INFO:tasks.workunit.client.0.smithi170.stdout:2/876: chown d3/fe3 334580472 1 2024-09-04T16:30:37.806 INFO:tasks.workunit.client.0.smithi170.stdout:2/877: rename d3/d3c/d40/d48 to d3/d3c/dc1/d101/dc5/d124 0 2024-09-04T16:30:37.812 INFO:tasks.workunit.client.0.smithi170.stdout:2/878: dwrite d3/d3c/dc1/d101/d62/d6f/f9d [4194304,4194304] 0 2024-09-04T16:30:37.817 INFO:tasks.workunit.client.0.smithi170.stdout:2/879: chown d3/d3c/dc1/d101/dc5/le5 1546649583 1 2024-09-04T16:30:37.818 INFO:tasks.workunit.client.0.smithi170.stdout:9/848: write d2/d11/d8f/fe8 [813569,98177] 0 2024-09-04T16:30:37.820 INFO:tasks.workunit.client.0.smithi170.stdout:9/849: write d2/d3d/d54/df3/ff8 [281907,17589] 0 2024-09-04T16:30:37.821 INFO:tasks.workunit.client.0.smithi170.stdout:2/880: truncate d3/d3c/dc1/d101/dc5/d124/f8e 4548154 0 2024-09-04T16:30:37.826 INFO:tasks.workunit.client.0.smithi170.stdout:9/850: dwrite d2/d3d/d27/f3a [0,4194304] 0 2024-09-04T16:30:37.833 INFO:tasks.workunit.client.0.smithi170.stdout:9/851: rename d2/d3d/d27/d65/d5b to d2/d3d/d27/d65/dcb/de0/dee/d10c 0 2024-09-04T16:30:37.834 INFO:tasks.workunit.client.0.smithi170.stdout:9/852: chown d2/d3d/d27/d65/dcb/de0/dee/d7a/da5 46 1 2024-09-04T16:30:37.835 INFO:tasks.workunit.client.0.smithi170.stdout:2/881: write d3/d3c/dc1/d101/d1c/fc3 [9290811,36810] 0 2024-09-04T16:30:37.838 INFO:tasks.workunit.client.0.smithi170.stdout:2/882: unlink d3/d3c/c2f 0 2024-09-04T16:30:37.838 INFO:tasks.workunit.client.0.smithi170.stdout:8/793: sync 2024-09-04T16:30:37.839 INFO:tasks.workunit.client.0.smithi170.stdout:8/794: write d6/f103 [590663,92486] 0 2024-09-04T16:30:37.839 INFO:tasks.workunit.client.0.smithi170.stdout:2/883: chown d3/d3c/dc1/d101/dc5/d124/f9e 87 1 2024-09-04T16:30:37.846 INFO:tasks.workunit.client.0.smithi170.stdout:8/795: mkdir d6/d28/d16/d24/d10e 0 2024-09-04T16:30:37.847 INFO:tasks.workunit.client.0.smithi170.stdout:9/853: dwrite d2/d3d/d6d/fb4 [0,4194304] 0 2024-09-04T16:30:37.854 INFO:tasks.workunit.client.0.smithi170.stdout:8/796: rename d6/d28/d16/ffd to d6/d28/d16/d52/d73/d5d/dd6/f10f 0 2024-09-04T16:30:37.856 INFO:tasks.workunit.client.0.smithi170.stdout:2/884: dwrite d3/d4/d86/fab [0,4194304] 0 2024-09-04T16:30:37.859 INFO:tasks.workunit.client.0.smithi170.stdout:8/797: fdatasync d6/d28/d20/f48 0 2024-09-04T16:30:37.863 INFO:tasks.workunit.client.0.smithi170.stdout:9/854: rename d2/d3d/d27/d65/dcb/de0/dee/ldb to d2/d3d/l10d 0 2024-09-04T16:30:37.865 INFO:tasks.workunit.client.0.smithi170.stdout:2/885: mknod d3/d4/d86/dc9/c125 0 2024-09-04T16:30:37.869 INFO:tasks.workunit.client.0.smithi170.stdout:9/855: creat d2/d3d/d4d/d59/f10e x:0 0 0 2024-09-04T16:30:37.871 INFO:tasks.workunit.client.0.smithi170.stdout:2/886: creat d3/d4/d86/f126 x:0 0 0 2024-09-04T16:30:37.872 INFO:tasks.workunit.client.0.smithi170.stdout:8/798: write d6/d28/d16/d77/d93/d95/dac/fca [1323012,130074] 0 2024-09-04T16:30:37.875 INFO:tasks.workunit.client.0.smithi170.stdout:8/799: dread - d6/d28/d16/d52/d73/d71/f104 zero size 2024-09-04T16:30:37.876 INFO:tasks.workunit.client.0.smithi170.stdout:9/856: dwrite d2/d3d/f10 [0,4194304] 0 2024-09-04T16:30:37.876 INFO:tasks.workunit.client.0.smithi170.stdout:2/887: creat d3/d3c/dc1/d101/d62/d6f/d110/dcf/dba/f127 x:0 0 0 2024-09-04T16:30:37.878 INFO:tasks.workunit.client.0.smithi170.stdout:9/857: write d2/d3d/d27/f3a [1321376,109847] 0 2024-09-04T16:30:37.879 INFO:tasks.workunit.client.0.smithi170.stdout:9/858: fsync d2/d11/f36 0 2024-09-04T16:30:37.884 INFO:tasks.workunit.client.0.smithi170.stdout:8/800: creat d6/d28/d5f/f110 x:0 0 0 2024-09-04T16:30:37.885 INFO:tasks.workunit.client.0.smithi170.stdout:8/801: fdatasync d6/d28/d5f/d70/de8/f84 0 2024-09-04T16:30:37.886 INFO:tasks.workunit.client.0.smithi170.stdout:9/859: unlink d2/d11/d23/l72 0 2024-09-04T16:30:37.891 INFO:tasks.workunit.client.0.smithi170.stdout:8/802: dwrite d6/f103 [0,4194304] 0 2024-09-04T16:30:37.893 INFO:tasks.workunit.client.0.smithi170.stdout:8/803: read - d6/d28/d20/d5e/f5b zero size 2024-09-04T16:30:37.893 INFO:tasks.workunit.client.0.smithi170.stdout:9/860: truncate d2/d3d/d27/d65/dcb/de0/dee/f5a 657694 0 2024-09-04T16:30:37.897 INFO:tasks.workunit.client.0.smithi170.stdout:2/888: dwrite d3/d3c/dc1/d101/d62/fcb [0,4194304] 0 2024-09-04T16:30:37.897 INFO:tasks.workunit.client.0.smithi170.stdout:8/804: creat d6/d28/d16/f111 x:0 0 0 2024-09-04T16:30:37.899 INFO:tasks.workunit.client.0.smithi170.stdout:6/778: sync 2024-09-04T16:30:37.899 INFO:tasks.workunit.client.0.smithi170.stdout:3/828: sync 2024-09-04T16:30:37.900 INFO:tasks.workunit.client.0.smithi170.stdout:4/819: sync 2024-09-04T16:30:37.900 INFO:tasks.workunit.client.0.smithi170.stdout:5/851: sync 2024-09-04T16:30:37.903 INFO:tasks.workunit.client.0.smithi170.stdout:2/889: truncate d3/d3c/dc1/d101/d62/d6f/d110/f116 154009 0 2024-09-04T16:30:37.903 INFO:tasks.workunit.client.0.smithi170.stdout:5/852: chown d4/d3a/d74/d8b/l98 0 1 2024-09-04T16:30:37.904 INFO:tasks.workunit.client.0.smithi170.stdout:8/805: creat d6/d28/d16/d24/d10e/f112 x:0 0 0 2024-09-04T16:30:37.905 INFO:tasks.workunit.client.0.smithi170.stdout:8/806: fdatasync d6/d28/d5f/d70/de8/f84 0 2024-09-04T16:30:37.909 INFO:tasks.workunit.client.0.smithi170.stdout:6/779: creat d0/d15/d56/d6d/f109 x:0 0 0 2024-09-04T16:30:37.912 INFO:tasks.workunit.client.0.smithi170.stdout:5/853: symlink d4/db/l119 0 2024-09-04T16:30:37.913 INFO:tasks.workunit.client.0.smithi170.stdout:3/829: truncate d13/d14/d21/f36 1986135 0 2024-09-04T16:30:37.915 INFO:tasks.workunit.client.0.smithi170.stdout:9/861: dread d2/d11/d23/f30 [4194304,4194304] 0 2024-09-04T16:30:37.916 INFO:tasks.workunit.client.0.smithi170.stdout:8/807: rename d6/d28/d20/d5e/fa3 to d6/d28/d16/d77/d93/d95/f113 0 2024-09-04T16:30:37.917 INFO:tasks.workunit.client.0.smithi170.stdout:8/808: write d6/d28/d5f/f110 [64704,117285] 0 2024-09-04T16:30:37.918 INFO:tasks.workunit.client.0.smithi170.stdout:4/820: write d1/d6/d8/d20/d35/fdd [233186,69434] 0 2024-09-04T16:30:37.919 INFO:tasks.workunit.client.0.smithi170.stdout:2/890: mkdir d3/d3c/dc1/d101/d1c/d77/d117/d128 0 2024-09-04T16:30:38.106 INFO:tasks.workunit.client.0.smithi170.stdout:6/780: symlink d0/d15/d56/l10a 0 2024-09-04T16:30:38.107 INFO:tasks.workunit.client.0.smithi170.stdout:4/821: write d1/d6/d8/d20/d95/d36/f28 [1079085,34087] 0 2024-09-04T16:30:38.108 INFO:tasks.workunit.client.0.smithi170.stdout:3/830: write d13/d14/d1d/d71/db3/dbd/fd8 [3675814,69935] 0 2024-09-04T16:30:38.121 INFO:tasks.workunit.client.0.smithi170.stdout:2/891: dread d3/d3c/d40/fe9 [0,4194304] 0 2024-09-04T16:30:38.131 INFO:tasks.workunit.client.0.smithi170.stdout:6/781: read d0/df/d7e/dfa/d68/d2d/d67/fc8 [299493,28487] 0 2024-09-04T16:30:38.131 INFO:tasks.workunit.client.0.smithi170.stdout:6/782: chown d0/d17/d31/d64/df4/df8 257 1 2024-09-04T16:30:38.132 INFO:tasks.workunit.client.0.smithi170.stdout:4/822: symlink d1/d6/d22/d93/de5/l11a 0 2024-09-04T16:30:38.134 INFO:tasks.workunit.client.0.smithi170.stdout:4/823: dread d1/d6/d8/d20/d35/d54/ffd [0,4194304] 0 2024-09-04T16:30:38.135 INFO:tasks.workunit.client.0.smithi170.stdout:9/862: link d2/d3d/d4d/d59/cbc d2/d3d/d27/d65/dcb/de0/dee/d10c/c10f 0 2024-09-04T16:30:38.135 INFO:tasks.workunit.client.0.smithi170.stdout:4/824: stat d1/d6/d8/d20/d35/d3e/d4e/d51/f91 0 2024-09-04T16:30:38.146 INFO:tasks.workunit.client.0.smithi170.stdout:9/863: creat d2/d3d/d27/d2b/daf/f110 x:0 0 0 2024-09-04T16:30:38.148 INFO:tasks.workunit.client.0.smithi170.stdout:4/825: rmdir d1/d6/d8/d20/dae 39 2024-09-04T16:30:38.149 INFO:tasks.workunit.client.0.smithi170.stdout:1/971: sync 2024-09-04T16:30:38.156 INFO:tasks.workunit.client.0.smithi170.stdout:4/826: rename d1/d6/d8/d20/d95/d36/f3c to d1/d6/d2b/d47/d78/f11b 0 2024-09-04T16:30:38.158 INFO:tasks.workunit.client.0.smithi170.stdout:2/892: getdents d3/d3c/dc1/d101/d1c/d77 0 2024-09-04T16:30:38.159 INFO:tasks.workunit.client.0.smithi170.stdout:9/864: getdents d2/d3d/d35/d10b 0 2024-09-04T16:30:38.163 INFO:tasks.workunit.client.0.smithi170.stdout:1/972: creat d9/f153 x:0 0 0 2024-09-04T16:30:38.166 INFO:tasks.workunit.client.0.smithi170.stdout:8/809: write d6/d28/d16/df2/ffb [1481902,53514] 0 2024-09-04T16:30:38.167 INFO:tasks.workunit.client.0.smithi170.stdout:8/810: fsync d6/d26/f9a 0 2024-09-04T16:30:38.175 INFO:tasks.workunit.client.0.smithi170.stdout:1/973: unlink d9/d11/d2f/dc2/fea 0 2024-09-04T16:30:38.175 INFO:tasks.workunit.client.0.smithi170.stdout:3/831: dwrite d13/d14/d21/d4d/d4e/d88/dbf/f8f [0,4194304] 0 2024-09-04T16:30:38.177 INFO:tasks.workunit.client.0.smithi170.stdout:9/865: unlink d2/d3d/led 0 2024-09-04T16:30:38.178 INFO:tasks.workunit.client.0.smithi170.stdout:6/783: write d0/df/d7e/dfa/d68/d2d/fbb [1223013,34975] 0 2024-09-04T16:30:38.182 INFO:tasks.workunit.client.0.smithi170.stdout:8/811: dread - d6/d28/d5f/d70/d97/d99/fc6 zero size 2024-09-04T16:30:38.186 INFO:tasks.workunit.client.0.smithi170.stdout:1/974: rmdir d9/d11/d2f/dc2 39 2024-09-04T16:30:38.187 INFO:tasks.workunit.client.0.smithi170.stdout:9/866: fsync d2/d32/f93 0 2024-09-04T16:30:38.188 INFO:tasks.workunit.client.0.smithi170.stdout:2/893: dwrite d3/d3c/dc1/d101/f3b [0,4194304] 0 2024-09-04T16:30:38.189 INFO:tasks.workunit.client.0.smithi170.stdout:3/832: write d13/d14/d21/d4d/d4e/d50/fa7 [3835406,97986] 0 2024-09-04T16:30:38.191 INFO:tasks.workunit.client.0.smithi170.stdout:8/812: symlink d6/d28/d16/d77/l114 0 2024-09-04T16:30:38.193 INFO:tasks.workunit.client.0.smithi170.stdout:6/784: rename d0/c62 to d0/df/d7e/dfa/d68/dfb/c10b 0 2024-09-04T16:30:38.193 INFO:tasks.workunit.client.0.smithi170.stdout:3/833: chown d13/d14/d1f/d7a/dc8 1826 1 2024-09-04T16:30:38.195 INFO:tasks.workunit.client.0.smithi170.stdout:4/827: dwrite d1/d6/d8/d20/d35/d3e/d60/fc3 [4194304,4194304] 0 2024-09-04T16:30:38.196 INFO:tasks.workunit.client.0.smithi170.stdout:9/867: symlink d2/d32/l111 0 2024-09-04T16:30:38.197 INFO:tasks.workunit.client.0.smithi170.stdout:3/834: fsync d13/d14/d17/f7b 0 2024-09-04T16:30:38.199 INFO:tasks.workunit.client.0.smithi170.stdout:8/813: mknod d6/d28/d16/d77/d9f/c115 0 2024-09-04T16:30:38.199 INFO:tasks.workunit.client.0.smithi170.stdout:4/828: write d1/d6/d8/f9a [847038,76815] 0 2024-09-04T16:30:38.205 INFO:tasks.workunit.client.0.smithi170.stdout:2/894: dwrite d3/d3c/dc1/d101/df/d45/f10c [0,4194304] 0 2024-09-04T16:30:38.208 INFO:tasks.workunit.client.0.smithi170.stdout:3/835: symlink d13/d14/d1d/d2d/d58/l111 0 2024-09-04T16:30:38.210 INFO:tasks.workunit.client.0.smithi170.stdout:4/829: creat d1/d6/d8/d20/d95/d36/d79/f11c x:0 0 0 2024-09-04T16:30:38.211 INFO:tasks.workunit.client.0.smithi170.stdout:8/814: mknod d6/d28/d16/d77/d93/d95/db8/c116 0 2024-09-04T16:30:38.212 INFO:tasks.workunit.client.0.smithi170.stdout:2/895: fsync d3/d3c/dc1/d101/dc5/fd7 0 2024-09-04T16:30:38.213 INFO:tasks.workunit.client.0.smithi170.stdout:4/830: fdatasync d1/d6/d22/d93/ff6 0 2024-09-04T16:30:38.213 INFO:tasks.workunit.client.0.smithi170.stdout:9/868: symlink d2/d3d/d6d/d79/def/df0/l112 0 2024-09-04T16:30:38.215 INFO:tasks.workunit.client.0.smithi170.stdout:1/975: dwrite d9/d11/dae/f91 [0,4194304] 0 2024-09-04T16:30:38.217 INFO:tasks.workunit.client.0.smithi170.stdout:9/869: truncate d2/d32/f93 5085663 0 2024-09-04T16:30:38.220 INFO:tasks.workunit.client.0.smithi170.stdout:8/815: creat d6/d28/d20/d6e/dfc/f117 x:0 0 0 2024-09-04T16:30:38.222 INFO:tasks.workunit.client.0.smithi170.stdout:5/854: sync 2024-09-04T16:30:38.223 INFO:tasks.workunit.client.0.smithi170.stdout:2/896: creat d3/d3c/dc1/d101/d62/d6f/d110/dcf/dba/dd5/f129 x:0 0 0 2024-09-04T16:30:38.223 INFO:tasks.workunit.client.0.smithi170.stdout:5/855: read - d4/db/f115 zero size 2024-09-04T16:30:38.224 INFO:tasks.workunit.client.0.smithi170.stdout:1/976: fdatasync d9/d11/d85/fe4 0 2024-09-04T16:30:38.224 INFO:tasks.workunit.client.0.smithi170.stdout:2/897: readlink d3/d3c/l73 0 2024-09-04T16:30:38.227 INFO:tasks.workunit.client.0.smithi170.stdout:9/870: symlink d2/d3d/d4d/l113 0 2024-09-04T16:30:38.229 INFO:tasks.workunit.client.0.smithi170.stdout:4/831: dwrite d1/d6/d2b/d47/d78/f11b [4194304,4194304] 0 2024-09-04T16:30:38.230 INFO:tasks.workunit.client.0.smithi170.stdout:4/832: fdatasync d1/d6/d22/d93/de5/fec 0 2024-09-04T16:30:38.233 INFO:tasks.workunit.client.0.smithi170.stdout:3/836: truncate d13/d14/d1f/f60 2606555 0 2024-09-04T16:30:38.237 INFO:tasks.workunit.client.0.smithi170.stdout:2/898: creat d3/d3c/dc1/d101/d62/d6f/d110/dcf/dba/dd5/f12a x:0 0 0 2024-09-04T16:30:38.237 INFO:tasks.workunit.client.0.smithi170.stdout:8/816: getdents d6/d28/d16/d52/d73/d5d 0 2024-09-04T16:30:38.239 INFO:tasks.workunit.client.0.smithi170.stdout:2/899: dread - d3/d3c/dc1/d101/d1c/d77/dc2/ffb zero size 2024-09-04T16:30:38.244 INFO:tasks.workunit.client.0.smithi170.stdout:6/785: dread d0/df/d7e/dfa/d68/f23 [0,4194304] 0 2024-09-04T16:30:38.245 INFO:tasks.workunit.client.0.smithi170.stdout:2/900: rename d3/d3c/dc1/d101/dc5/d124/d68/c89 to d3/d3c/dc1/d101/d1c/d47/d83/deb/c12b 0 2024-09-04T16:30:38.246 INFO:tasks.workunit.client.0.smithi170.stdout:8/817: symlink d6/d28/d5f/l118 0 2024-09-04T16:30:38.246 INFO:tasks.workunit.client.0.smithi170.stdout:1/977: link d9/d11/d2f/c7a d9/d11/d2f/d7f/c154 0 2024-09-04T16:30:38.248 INFO:tasks.workunit.client.0.smithi170.stdout:4/833: creat d1/d6/d8/d20/d95/f11d x:0 0 0 2024-09-04T16:30:38.248 INFO:tasks.workunit.client.0.smithi170.stdout:1/978: read d9/d34/d5f/f71 [4377193,100415] 0 2024-09-04T16:30:38.249 INFO:tasks.workunit.client.0.smithi170.stdout:5/856: link d4/d8/d1c/d26/df8/lfb d4/d3a/d74/d8b/l11a 0 2024-09-04T16:30:38.250 INFO:tasks.workunit.client.0.smithi170.stdout:9/871: write d2/f17 [1103287,105683] 0 2024-09-04T16:30:38.252 INFO:tasks.workunit.client.0.smithi170.stdout:6/786: rename d0/df/d7e/dfa/c50 to d0/d15/d56/d6c/db8/c10c 0 2024-09-04T16:30:38.260 INFO:tasks.workunit.client.0.smithi170.stdout:2/901: dwrite d3/f112 [0,4194304] 0 2024-09-04T16:30:38.260 INFO:tasks.workunit.client.0.smithi170.stdout:5/857: read d4/d3a/d74/fce [3987700,1399] 0 2024-09-04T16:30:38.260 INFO:tasks.workunit.client.0.smithi170.stdout:4/834: dwrite d1/d6/d8/d20/d95/f11d [0,4194304] 0 2024-09-04T16:30:38.263 INFO:tasks.workunit.client.0.smithi170.stdout:5/858: chown d4/d8/d1c/d26/d27/d48/d7c/dd6/de0 469497926 1 2024-09-04T16:30:38.263 INFO:tasks.workunit.client.0.smithi170.stdout:2/902: write d3/d3c/dc1/d101/d1c/d77/dc2/ffc [3101998,69838] 0 2024-09-04T16:30:38.264 INFO:tasks.workunit.client.0.smithi170.stdout:8/818: creat d6/d28/d16/d24/d83/f119 x:0 0 0 2024-09-04T16:30:38.273 INFO:tasks.workunit.client.0.smithi170.stdout:2/903: dwrite d3/d3c/dc1/d101/d1c/f23 [0,4194304] 0 2024-09-04T16:30:38.274 INFO:tasks.workunit.client.0.smithi170.stdout:9/872: mknod d2/d3d/d27/d65/dcb/de0/dee/d7a/c114 0 2024-09-04T16:30:38.276 INFO:tasks.workunit.client.0.smithi170.stdout:2/904: chown d3/d3c/dc1/d101/dc5/d124 44981 1 2024-09-04T16:30:38.288 INFO:tasks.workunit.client.0.smithi170.stdout:6/787: rename d0/df/d1b/c9a to d0/df/d7e/dfa/d68/d2d/d2e/c10d 0 2024-09-04T16:30:38.290 INFO:tasks.workunit.client.0.smithi170.stdout:8/819: dwrite d6/d28/d1a/fea [0,4194304] 0 2024-09-04T16:30:38.291 INFO:tasks.workunit.client.0.smithi170.stdout:1/979: link d9/d11/d9b/fb8 d9/d102/d11b/dde/d134/f155 0 2024-09-04T16:30:38.292 INFO:tasks.workunit.client.0.smithi170.stdout:5/859: dread d4/db/d51/d5e/d71/d84/fb0 [0,4194304] 0 2024-09-04T16:30:38.293 INFO:tasks.workunit.client.0.smithi170.stdout:9/873: dread d2/f17 [0,4194304] 0 2024-09-04T16:30:38.295 INFO:tasks.workunit.client.0.smithi170.stdout:6/788: fdatasync d0/d17/d31/d64/d30/f91 0 2024-09-04T16:30:38.298 INFO:tasks.workunit.client.0.smithi170.stdout:1/980: creat d9/d11/d85/f156 x:0 0 0 2024-09-04T16:30:38.299 INFO:tasks.workunit.client.0.smithi170.stdout:4/835: getdents d1/d6/d8/d20/d95/d36 0 2024-09-04T16:30:38.301 INFO:tasks.workunit.client.0.smithi170.stdout:2/905: write d3/f94 [71892,57831] 0 2024-09-04T16:30:38.302 INFO:tasks.workunit.client.0.smithi170.stdout:2/906: chown d3/d7 4 1 2024-09-04T16:30:38.303 INFO:tasks.workunit.client.0.smithi170.stdout:9/874: symlink d2/d3d/d54/df3/l115 0 2024-09-04T16:30:38.305 INFO:tasks.workunit.client.0.smithi170.stdout:1/981: mknod d9/d11/d85/d118/c157 0 2024-09-04T16:30:38.305 INFO:tasks.workunit.client.0.smithi170.stdout:4/836: chown d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97/f114 365780 1 2024-09-04T16:30:38.306 INFO:tasks.workunit.client.0.smithi170.stdout:1/982: chown d9/d26/d77/cb6 106 1 2024-09-04T16:30:38.306 INFO:tasks.workunit.client.0.smithi170.stdout:4/837: stat d1/d6/d22/d93 0 2024-09-04T16:30:38.308 INFO:tasks.workunit.client.0.smithi170.stdout:2/907: unlink d3/d4/f52 0 2024-09-04T16:30:38.308 INFO:tasks.workunit.client.0.smithi170.stdout:4/838: write d1/d6/d8/d20/d95/d36/fcf [1161356,20737] 0 2024-09-04T16:30:38.312 INFO:tasks.workunit.client.0.smithi170.stdout:1/983: fdatasync d9/d11/d9b/fb8 0 2024-09-04T16:30:38.314 INFO:tasks.workunit.client.0.smithi170.stdout:1/984: fdatasync d9/d11/d2e/f89 0 2024-09-04T16:30:38.314 INFO:tasks.workunit.client.0.smithi170.stdout:8/820: write d6/d28/d5f/d70/de8/fdb [496736,87571] 0 2024-09-04T16:30:38.318 INFO:tasks.workunit.client.0.smithi170.stdout:2/908: dwrite d3/d3c/dc1/d101/d62/d6f/f9d [8388608,4194304] 0 2024-09-04T16:30:38.321 INFO:tasks.workunit.client.0.smithi170.stdout:6/789: write d0/d17/dbd/fc4 [46496,118443] 0 2024-09-04T16:30:38.322 INFO:tasks.workunit.client.0.smithi170.stdout:8/821: chown d6/c6a 92964432 1 2024-09-04T16:30:38.324 INFO:tasks.workunit.client.0.smithi170.stdout:1/985: fsync d9/d11/d2e/f104 0 2024-09-04T16:30:38.326 INFO:tasks.workunit.client.0.smithi170.stdout:5/860: dwrite d4/d3a/d74/fce [0,4194304] 0 2024-09-04T16:30:38.326 INFO:tasks.workunit.client.0.smithi170.stdout:4/839: dread d1/d6/d8/d20/d95/d36/d79/fa3 [0,4194304] 0 2024-09-04T16:30:38.331 INFO:tasks.workunit.client.0.smithi170.stdout:2/909: rename d3/d4/f21 to d3/d3c/dc1/d101/d62/d6f/d110/f12c 0 2024-09-04T16:30:38.331 INFO:tasks.workunit.client.0.smithi170.stdout:4/840: write d1/d6/d2b/d47/d78/f90 [1355253,48146] 0 2024-09-04T16:30:38.334 INFO:tasks.workunit.client.0.smithi170.stdout:9/875: dwrite d2/d11/d23/d95/f97 [0,4194304] 0 2024-09-04T16:30:38.340 INFO:tasks.workunit.client.0.smithi170.stdout:1/986: fsync d9/d26/d77/fb4 0 2024-09-04T16:30:38.344 INFO:tasks.workunit.client.0.smithi170.stdout:9/876: dwrite d2/d3d/d27/f10a [0,4194304] 0 2024-09-04T16:30:38.345 INFO:tasks.workunit.client.0.smithi170.stdout:9/877: read - d2/d3d/d6d/ffd zero size 2024-09-04T16:30:38.349 INFO:tasks.workunit.client.0.smithi170.stdout:6/790: read d0/d17/f1d [2038412,85660] 0 2024-09-04T16:30:38.350 INFO:tasks.workunit.client.0.smithi170.stdout:6/791: dread - d0/d15/d56/d6d/f7a zero size 2024-09-04T16:30:38.352 INFO:tasks.workunit.client.0.smithi170.stdout:2/910: truncate d3/d3c/dc1/d101/d1c/d47/d83/f98 304631 0 2024-09-04T16:30:38.356 INFO:tasks.workunit.client.0.smithi170.stdout:1/987: fsync d9/d34/dbe/fc9 0 2024-09-04T16:30:38.358 INFO:tasks.workunit.client.0.smithi170.stdout:8/822: creat d6/d28/d5f/f11a x:0 0 0 2024-09-04T16:30:38.359 INFO:tasks.workunit.client.0.smithi170.stdout:9/878: creat d2/d3d/d27/d65/dcb/f116 x:0 0 0 2024-09-04T16:30:38.361 INFO:tasks.workunit.client.0.smithi170.stdout:5/861: link d4/db/d51/d5e/d71/fdc d4/d8/d1c/d26/d27/d43/d5b/f11b 0 2024-09-04T16:30:38.363 INFO:tasks.workunit.client.0.smithi170.stdout:6/792: symlink d0/d15/d56/d6c/db8/l10e 0 2024-09-04T16:30:38.372 INFO:tasks.workunit.client.0.smithi170.stdout:5/862: symlink d4/db/d51/d5e/d71/d84/l11c 0 2024-09-04T16:30:38.376 INFO:tasks.workunit.client.0.smithi170.stdout:4/841: rename d1/d6/d8/d20/d35/d3e/d4e/d51/d8b/d97 to d1/d6/d11e 0 2024-09-04T16:30:38.377 INFO:tasks.workunit.client.0.smithi170.stdout:1/988: mknod d9/d11/d2f/d6b/d61/d138/c158 0 2024-09-04T16:30:38.378 INFO:tasks.workunit.client.0.smithi170.stdout:8/823: write d6/d28/d5f/d70/d97/fb6 [350903,114546] 0 2024-09-04T16:30:38.379 INFO:tasks.workunit.client.0.smithi170.stdout:9/879: creat d2/d3d/d35/d10b/f117 x:0 0 0 2024-09-04T16:30:38.381 INFO:tasks.workunit.client.0.smithi170.stdout:9/880: chown d2/d3d/d6d/d79/dd0 77704 1 2024-09-04T16:30:38.381 INFO:tasks.workunit.client.0.smithi170.stdout:5/863: creat d4/db/d51/d5e/d71/f11d x:0 0 0 2024-09-04T16:30:38.382 INFO:tasks.workunit.client.0.smithi170.stdout:1/989: dread d9/d102/d11b/f9f [0,4194304] 0 2024-09-04T16:30:38.382 INFO:tasks.workunit.client.0.smithi170.stdout:6/793: fsync d0/f9 0 2024-09-04T16:30:38.383 INFO:tasks.workunit.client.0.smithi170.stdout:9/881: chown d2/d3d/d27/d65/c67 562037 1 2024-09-04T16:30:38.385 INFO:tasks.workunit.client.0.smithi170.stdout:5/864: chown d4/d8/d1c/d26/d27/d43/d5b/f11b 233 1 2024-09-04T16:30:38.385 INFO:tasks.workunit.client.0.smithi170.stdout:2/911: rename d3/d4/d86/dfe/d104 to d3/d3c/dc1/d101/d1c/d47/d83/deb/d12d 0 2024-09-04T16:30:38.385 INFO:tasks.workunit.client.0.smithi170.stdout:6/794: write d0/d9f/fce [1370122,76500] 0 2024-09-04T16:30:38.386 INFO:tasks.workunit.client.0.smithi170.stdout:8/824: dread d6/d28/d16/d77/d93/d95/dac/fca [0,4194304] 0 2024-09-04T16:30:38.386 INFO:tasks.workunit.client.0.smithi170.stdout:6/795: chown d0/d15 128 1 2024-09-04T16:30:38.388 INFO:tasks.workunit.client.0.smithi170.stdout:2/912: chown d3/d3c/dc1/d101/ff9 362 1 2024-09-04T16:30:38.389 INFO:tasks.workunit.client.0.smithi170.stdout:8/825: truncate d6/d28/d5f/d70/f7b 8722071 0 2024-09-04T16:30:38.392 INFO:tasks.workunit.client.0.smithi170.stdout:2/913: stat d3/d3c/dc1/d101/d1c/d47/d83/d9f/fbb 0 2024-09-04T16:30:38.401 INFO:tasks.workunit.client.0.smithi170.stdout:1/990: write d9/d26/d77/fbb [242102,39997] 0 2024-09-04T16:30:38.405 INFO:tasks.workunit.client.0.smithi170.stdout:9/882: write d2/d3d/d35/f86 [4276759,38488] 0 2024-09-04T16:30:38.405 INFO:tasks.workunit.client.0.smithi170.stdout:8/826: readlink d6/d28/d16/d77/d93/dc0/le7 0 2024-09-04T16:30:38.407 INFO:tasks.workunit.client.0.smithi170.stdout:5/865: write d4/d8/d1c/d26/d27/d43/f86 [4565439,128316] 0 2024-09-04T16:30:38.414 INFO:tasks.workunit.client.0.smithi170.stdout:8/827: mkdir d6/d28/d16/d52/d73/d5d/d11b 0 2024-09-04T16:30:38.415 INFO:tasks.workunit.client.0.smithi170.stdout:8/828: chown d6/d28/d1a/d38/ce3 258 1 2024-09-04T16:30:38.420 INFO:tasks.workunit.client.0.smithi170.stdout:5/866: unlink d4/d8/d1c/d26/d27/d48/d5a/f79 0 2024-09-04T16:30:38.420 INFO:tasks.workunit.client.0.smithi170.stdout:8/829: dwrite d6/d28/d20/d5e/fd7 [4194304,4194304] 0 2024-09-04T16:30:38.424 INFO:tasks.workunit.client.0.smithi170.stdout:4/842: rename d1/d6/d8/d20/d35/d3e/d4e/d51/f76 to d1/d6/d8/d20/d35/d3e/f11f 0 2024-09-04T16:30:38.427 INFO:tasks.workunit.client.0.smithi170.stdout:1/991: creat d9/d7b/d8f/d13b/f159 x:0 0 0 2024-09-04T16:30:38.427 INFO:tasks.workunit.client.0.smithi170.stdout:8/830: dread d6/d28/d16/df2/ffb [0,4194304] 0 2024-09-04T16:30:38.428 INFO:tasks.workunit.client.0.smithi170.stdout:1/992: chown d9/d11/d2e/f89 4426 1 2024-09-04T16:30:38.430 INFO:tasks.workunit.client.0.smithi170.stdout:2/914: write d3/d3c/dc1/d101/d62/d6f/f72 [639110,122260] 0 2024-09-04T16:30:38.431 INFO:tasks.workunit.client.0.smithi170.stdout:5/867: mkdir d4/d8/d1c/d26/df8/d11e 0 2024-09-04T16:30:38.432 INFO:tasks.workunit.client.0.smithi170.stdout:2/915: chown d3/d3c/dc1/d101/d62/d6f/d110/dcf/dba/f127 0 1 2024-09-04T16:30:38.435 INFO:tasks.workunit.client.0.smithi170.stdout:6/796: getdents d0/d15/d56/d6d 0 2024-09-04T16:30:38.435 INFO:tasks.workunit.client.0.smithi170.stdout:4/843: rmdir d1/d6/d8/d20/d35/d54 39 2024-09-04T16:30:38.436 INFO:tasks.workunit.client.0.smithi170.stdout:9/883: link d2/d11/d23/f55 d2/d3d/d27/d65/dcb/de0/dee/d7a/da5/f118 0 2024-09-04T16:30:38.436 INFO:tasks.workunit.client.0.smithi170.stdout:6/797: fsync d0/d9f/fce 0 2024-09-04T16:30:38.437 INFO:tasks.workunit.client.0.smithi170.stdout:6/798: chown d0/df/d7e/dfa/d68/d2d/d2e 0 1 2024-09-04T16:30:38.438 INFO:tasks.workunit.client.0.smithi170.stdout:8/831: rename d6/d28/d16/d77/fb7 to d6/d28/d16/d77/d93/d95/dac/f11c 0 2024-09-04T16:30:38.439 INFO:tasks.workunit.client.0.smithi170.stdout:5/868: chown d4/d8/l2e 61255402 1 2024-09-04T16:30:38.441 INFO:tasks.workunit.client.0.smithi170.stdout:2/916: creat d3/d3c/de7/f12e x:0 0 0 2024-09-04T16:30:38.443 INFO:tasks.workunit.client.0.smithi170.stdout:6/799: rmdir d0/d15/d56/d6d/dac 39 2024-09-04T16:30:38.444 INFO:tasks.workunit.client.0.smithi170.stdout:6/800: write d0/d15/d56/fe3 [410682,67036] 0 2024-09-04T16:30:38.445 INFO:tasks.workunit.client.0.smithi170.stdout:9/884: truncate d2/d3d/d4d/d59/d85/fb9 118098 0 2024-09-04T16:30:38.447 INFO:tasks.workunit.client.0.smithi170.stdout:9/885: truncate d2/d11/d23/fe4 1372786 0 2024-09-04T16:30:38.451 INFO:tasks.workunit.client.0.smithi170.stdout:4/844: mknod d1/c120 0 2024-09-04T16:30:38.452 INFO:tasks.workunit.client.0.smithi170.stdout:5/869: dread d4/f6 [0,4194304] 0 2024-09-04T16:30:38.452 INFO:tasks.workunit.client.0.smithi170.stdout:2/917: mknod d3/d3c/de0/c12f 0 2024-09-04T16:30:38.454 INFO:tasks.workunit.client.0.smithi170.stdout:8/832: dwrite d6/d28/d16/df2/ffb [0,4194304] 0 2024-09-04T16:30:38.454 INFO:tasks.workunit.client.0.smithi170.stdout:4/845: write d1/d6/d2b/d47/d78/f90 [2246257,114753] 0 2024-09-04T16:30:38.458 INFO:tasks.workunit.client.0.smithi170.stdout:9/886: rmdir d2/d3d/d6d/d79/def 39 2024-09-04T16:30:38.461 INFO:tasks.workunit.client.0.smithi170.stdout:2/918: write d3/d3c/dc1/d101/d1c/fbf [350087,100808] 0 2024-09-04T16:30:38.461 INFO:tasks.workunit.client.0.smithi170.stdout:4/846: write d1/d6/d8/fff [188090,101535] 0 2024-09-04T16:30:38.463 INFO:tasks.workunit.client.0.smithi170.stdout:8/833: symlink d6/d28/d1a/l11d 0 2024-09-04T16:30:38.465 INFO:tasks.workunit.client.0.smithi170.stdout:9/887: dread - d2/d3d/d27/d65/dcb/de0/dee/d7a/fe9 zero size 2024-09-04T16:30:38.466 INFO:tasks.workunit.client.0.smithi170.stdout:6/801: dwrite d0/df/d1f/fdf [0,4194304] 0 2024-09-04T16:30:38.468 INFO:tasks.workunit.client.0.smithi170.stdout:6/802: chown d0/dbf/fea 0 1 2024-09-04T16:30:38.474 INFO:tasks.workunit.client.0.smithi170.stdout:9/888: mkdir d2/d11/d23/d95/d119 0 2024-09-04T16:30:38.474 INFO:tasks.workunit.client.0.smithi170.stdout:2/919: dwrite d3/d3c/dc1/d101/dc5/d124/f9e [0,4194304] 0 2024-09-04T16:30:38.476 INFO:tasks.workunit.client.0.smithi170.stdout:9/889: fsync d2/d3d/d27/d65/dcb/de0/dee/d7a/fe9 0 2024-09-04T16:30:38.478 INFO:tasks.workunit.client.0.smithi170.stdout:5/870: write d4/db/d51/d5e/d71/d84/d93/d106/d39/f40 [1405358,72148] 0 2024-09-04T16:30:38.484 INFO:tasks.workunit.client.0.smithi170.stdout:5/871: fsync d4/db/f1e 0 2024-09-04T16:30:38.485 INFO:tasks.workunit.client.0.smithi170.stdout:8/834: dwrite d6/d28/d20/f8a [0,4194304] 0 2024-09-04T16:30:38.485 INFO:tasks.workunit.client.0.smithi170.stdout:5/872: fsync d4/db/fe 0 2024-09-04T16:30:38.486 INFO:tasks.workunit.client.0.smithi170.stdout:8/835: readlink d6/d28/d5f/l118 0 2024-09-04T16:30:38.488 INFO:tasks.workunit.client.0.smithi170.stdout:2/920: write d3/d3c/d40/f71 [602619,30400] 0 2024-09-04T16:30:38.488 INFO:tasks.workunit.client.0.smithi170.stdout:4/847: link d1/d6/d8/fa d1/d6/d8/d6c/f121 0 2024-09-04T16:30:38.489 INFO:tasks.workunit.client.0.smithi170.stdout:9/890: write d2/fc5 [1331046,50831] 0 2024-09-04T16:30:38.491 INFO:tasks.workunit.client.0.smithi170.stdout:6/803: rename d0/d9f/fce to d0/d17/f10f 0 2024-09-04T16:30:38.493 INFO:tasks.workunit.client.0.smithi170.stdout:2/921: dread d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/dee/f10f [0,4194304] 0 2024-09-04T16:30:38.494 INFO:tasks.workunit.client.0.smithi170.stdout:2/922: chown d3/d3c/dc1/d101/d1c/d47 19 1 2024-09-04T16:30:38.496 INFO:tasks.workunit.client.0.smithi170.stdout:5/873: mkdir d4/d8/d1c/d26/d27/d88/da4/d11f 0 2024-09-04T16:30:38.497 INFO:tasks.workunit.client.0.smithi170.stdout:8/836: mkdir d6/d28/d16/d77/d93/d95/dac/d11e 0 2024-09-04T16:30:38.497 INFO:tasks.workunit.client.0.smithi170.stdout:8/837: readlink d6/d28/d20/l3d 0 2024-09-04T16:30:38.499 INFO:tasks.workunit.client.0.smithi170.stdout:4/848: mknod d1/d6/d2b/db3/c122 0 2024-09-04T16:30:38.501 INFO:tasks.workunit.client.0.smithi170.stdout:6/804: fsync d0/d15/d56/d6c/f76 0 2024-09-04T16:30:38.501 INFO:tasks.workunit.client.0.smithi170.stdout:8/838: read d6/d28/d20/d5e/f35 [4237403,102964] 0 2024-09-04T16:30:38.503 INFO:tasks.workunit.client.0.smithi170.stdout:5/874: readlink d4/db/d37/lb2 0 2024-09-04T16:30:38.506 INFO:tasks.workunit.client.0.smithi170.stdout:2/923: dread d3/d3c/dc1/d101/fbd [0,4194304] 0 2024-09-04T16:30:38.506 INFO:tasks.workunit.client.0.smithi170.stdout:9/891: getdents d2/d3d/dff 0 2024-09-04T16:30:38.511 INFO:tasks.workunit.client.0.smithi170.stdout:5/875: dwrite d4/f3c [4194304,4194304] 0 2024-09-04T16:30:38.514 INFO:tasks.workunit.client.0.smithi170.stdout:9/892: dwrite d2/fa8 [0,4194304] 0 2024-09-04T16:30:38.520 INFO:tasks.workunit.client.0.smithi170.stdout:5/876: chown d4/d8/d1c/d26/d27/d88/da4/dc0/l100 1990 1 2024-09-04T16:30:38.521 INFO:tasks.workunit.client.0.smithi170.stdout:9/893: dread d2/d3d/d4d/fd3 [0,4194304] 0 2024-09-04T16:30:38.523 INFO:tasks.workunit.client.0.smithi170.stdout:5/877: write d4/d8/d1c/d26/df8/f105 [318996,113857] 0 2024-09-04T16:30:38.527 INFO:tasks.workunit.client.0.smithi170.stdout:6/805: dread d0/df/d7e/dfa/d68/d2d/fc9 [0,4194304] 0 2024-09-04T16:30:38.528 INFO:tasks.workunit.client.0.smithi170.stdout:4/849: creat d1/d6/d8/d20/d95/f123 x:0 0 0 2024-09-04T16:30:38.529 INFO:tasks.workunit.client.0.smithi170.stdout:6/806: write d0/df/d7e/dfa/d68/d2d/f8c [1524052,34749] 0 2024-09-04T16:30:38.529 INFO:tasks.workunit.client.0.smithi170.stdout:2/924: fsync d3/d3c/dc1/d101/d62/f10d 0 2024-09-04T16:30:38.530 INFO:tasks.workunit.client.0.smithi170.stdout:4/850: dread - d1/d6/d8/d20/ffc zero size 2024-09-04T16:30:38.531 INFO:tasks.workunit.client.0.smithi170.stdout:9/894: fdatasync d2/d3d/d54/fdf 0 2024-09-04T16:30:38.533 INFO:tasks.workunit.client.0.smithi170.stdout:8/839: creat d6/d28/d16/d52/d73/d5d/d11b/f11f x:0 0 0 2024-09-04T16:30:38.536 INFO:tasks.workunit.client.0.smithi170.stdout:6/807: mknod d0/d15/d56/c110 0 2024-09-04T16:30:38.538 INFO:tasks.workunit.client.0.smithi170.stdout:4/851: creat d1/d6/d22/d93/f124 x:0 0 0 2024-09-04T16:30:38.539 INFO:tasks.workunit.client.0.smithi170.stdout:9/895: dread - d2/d3d/d27/d65/dcb/de0/dee/d10c/fa2 zero size 2024-09-04T16:30:38.542 INFO:tasks.workunit.client.0.smithi170.stdout:8/840: creat d6/d28/d16/d77/d93/dc0/f120 x:0 0 0 2024-09-04T16:30:38.551 INFO:tasks.workunit.client.0.smithi170.stdout:8/841: symlink d6/d28/d16/d77/d93/d95/db8/l121 0 2024-09-04T16:30:38.552 INFO:tasks.workunit.client.0.smithi170.stdout:2/925: creat d3/d3c/dc1/d101/d62/f130 x:0 0 0 2024-09-04T16:30:38.555 INFO:tasks.workunit.client.0.smithi170.stdout:5/878: dwrite d4/d8/d1c/d26/fc2 [0,4194304] 0 2024-09-04T16:30:38.555 INFO:tasks.workunit.client.0.smithi170.stdout:2/926: dread - d3/d3c/dc1/d101/d1c/d47/d83/deb/f113 zero size 2024-09-04T16:30:38.557 INFO:tasks.workunit.client.0.smithi170.stdout:5/879: chown d4/d8/d1c/d26/d27/d88/da4/d11f 71737 1 2024-09-04T16:30:38.557 INFO:tasks.workunit.client.0.smithi170.stdout:4/852: rmdir d1/d6/d8/d20/dae 39 2024-09-04T16:30:38.559 INFO:tasks.workunit.client.0.smithi170.stdout:8/842: creat d6/d28/d16/d24/d46/f122 x:0 0 0 2024-09-04T16:30:38.561 INFO:tasks.workunit.client.0.smithi170.stdout:4/853: write d1/d6/d11e/fa4 [2173797,86660] 0 2024-09-04T16:30:38.562 INFO:tasks.workunit.client.0.smithi170.stdout:5/880: write d4/d8/d1c/d26/d27/d88/ffe [513189,16915] 0 2024-09-04T16:30:38.564 INFO:tasks.workunit.client.0.smithi170.stdout:8/843: stat d6/d28/f1d 0 2024-09-04T16:30:38.564 INFO:tasks.workunit.client.0.smithi170.stdout:2/927: creat d3/d3c/dc1/d101/f131 x:0 0 0 2024-09-04T16:30:38.566 INFO:tasks.workunit.client.0.smithi170.stdout:9/896: dwrite d2/d3d/d54/df3/f102 [4194304,4194304] 0 2024-09-04T16:30:38.569 INFO:tasks.workunit.client.0.smithi170.stdout:6/808: rename d0/df/d1b/d3e to d0/d17/d31/d64/d111 0 2024-09-04T16:30:38.575 INFO:tasks.workunit.client.0.smithi170.stdout:2/928: creat d3/d3c/dc1/d101/d1c/d77/dc2/f132 x:0 0 0 2024-09-04T16:30:38.576 INFO:tasks.workunit.client.0.smithi170.stdout:2/929: stat d3/d3c/dc1/d101/f2b 0 2024-09-04T16:30:38.580 INFO:tasks.workunit.client.0.smithi170.stdout:5/881: write d4/d8/d1c/d26/d27/d43/d5b/f96 [2193907,36599] 0 2024-09-04T16:30:38.581 INFO:tasks.workunit.client.0.smithi170.stdout:6/809: symlink d0/d15/d56/l112 0 2024-09-04T16:30:38.584 INFO:tasks.workunit.client.0.smithi170.stdout:8/844: creat d6/d28/d5f/d85/df7/f123 x:0 0 0 2024-09-04T16:30:38.586 INFO:tasks.workunit.client.0.smithi170.stdout:2/930: dwrite d3/d3c/dc1/d101/dc5/fcc [0,4194304] 0 2024-09-04T16:30:38.587 INFO:tasks.workunit.client.0.smithi170.stdout:4/854: creat d1/d6/d8/d20/d35/d3e/d4e/f125 x:0 0 0 2024-09-04T16:30:38.589 INFO:tasks.workunit.client.0.smithi170.stdout:8/845: mkdir d6/d28/d16/d77/d93/d95/dac/d124 0 2024-09-04T16:30:38.592 INFO:tasks.workunit.client.0.smithi170.stdout:9/897: dwrite d2/d3d/d27/f64 [0,4194304] 0 2024-09-04T16:30:38.596 INFO:tasks.workunit.client.0.smithi170.stdout:2/931: fsync d3/d3c/d40/f41 0 2024-09-04T16:30:38.598 INFO:tasks.workunit.client.0.smithi170.stdout:6/810: creat d0/d17/d31/d64/d111/f113 x:0 0 0 2024-09-04T16:30:38.598 INFO:tasks.workunit.client.0.smithi170.stdout:2/932: write d3/d3c/dc1/d101/d62/d6f/f72 [5026996,66328] 0 2024-09-04T16:30:38.600 INFO:tasks.workunit.client.0.smithi170.stdout:5/882: write d4/db/d51/d5e/d71/d84/fb0 [1370803,35686] 0 2024-09-04T16:30:38.600 INFO:tasks.workunit.client.0.smithi170.stdout:8/846: truncate d6/d28/d20/f48 2165093 0 2024-09-04T16:30:38.605 INFO:tasks.workunit.client.0.smithi170.stdout:6/811: creat d0/df/d7e/dfa/d68/d2d/d2e/f114 x:0 0 0 2024-09-04T16:30:38.610 INFO:tasks.workunit.client.0.smithi170.stdout:2/933: dread d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/fb9 [0,4194304] 0 2024-09-04T16:30:38.612 INFO:tasks.workunit.client.0.smithi170.stdout:8/847: chown d6/d28/d20/f48 670793 1 2024-09-04T16:30:38.616 INFO:tasks.workunit.client.0.smithi170.stdout:4/855: rename d1/d6/f75 to d1/d6/d8/d20/d35/d3e/d4e/f126 0 2024-09-04T16:30:38.618 INFO:tasks.workunit.client.0.smithi170.stdout:8/848: dread - d6/d28/d16/d52/fc7 zero size 2024-09-04T16:30:38.619 INFO:tasks.workunit.client.0.smithi170.stdout:8/849: dread - d6/d28/d5f/d70/d97/fef zero size 2024-09-04T16:30:38.620 INFO:tasks.workunit.client.0.smithi170.stdout:5/883: creat d4/d8/d1c/d26/d27/d48/f120 x:0 0 0 2024-09-04T16:30:38.620 INFO:tasks.workunit.client.0.smithi170.stdout:8/850: dread - d6/d28/d5f/d70/d97/d99/f100 zero size 2024-09-04T16:30:38.622 INFO:tasks.workunit.client.0.smithi170.stdout:2/934: creat d3/d4/d123/f133 x:0 0 0 2024-09-04T16:30:38.624 INFO:tasks.workunit.client.0.smithi170.stdout:6/812: write d0/d15/d56/f8b [4742743,70380] 0 2024-09-04T16:30:38.625 INFO:tasks.workunit.client.0.smithi170.stdout:8/851: mkdir d6/d28/d16/d52/d73/d5d/d11b/d125 0 2024-09-04T16:30:38.625 INFO:tasks.workunit.client.0.smithi170.stdout:2/935: chown d3/d3c/dc1/d101/dc5/d124/f10e 42 1 2024-09-04T16:30:38.627 INFO:tasks.workunit.client.0.smithi170.stdout:9/898: dwrite d2/d3d/d27/d2b/fe2 [0,4194304] 0 2024-09-04T16:30:38.628 INFO:tasks.workunit.client.0.smithi170.stdout:8/852: chown d6/d28/d1a/d38/ce3 12 1 2024-09-04T16:30:38.632 INFO:tasks.workunit.client.0.smithi170.stdout:4/856: getdents d1/d6 0 2024-09-04T16:30:38.635 INFO:tasks.workunit.client.0.smithi170.stdout:6/813: fdatasync d0/d17/d5b/fa2 0 2024-09-04T16:30:38.636 INFO:tasks.workunit.client.0.smithi170.stdout:2/936: symlink d3/d3c/dc1/d101/dc5/d124/l134 0 2024-09-04T16:30:38.638 INFO:tasks.workunit.client.0.smithi170.stdout:8/853: fsync d6/d28/d16/d77/d93/d95/dac/fca 0 2024-09-04T16:30:38.647 INFO:tasks.workunit.client.0.smithi170.stdout:8/854: dread d6/d28/d5f/d70/d97/fdc [0,4194304] 0 2024-09-04T16:30:38.649 INFO:tasks.workunit.client.0.smithi170.stdout:8/855: truncate d6/d28/d5f/d70/f10d 526908 0 2024-09-04T16:30:38.649 INFO:tasks.workunit.client.0.smithi170.stdout:8/856: readlink d6/d28/d1a/l11d 0 2024-09-04T16:30:38.765 INFO:tasks.workunit.client.0.smithi170.stdout:6/814: mkdir d0/d17/d39/d99/d115 0 2024-09-04T16:30:38.775 INFO:tasks.workunit.client.0.smithi170.stdout:2/937: dread d3/d3c/dc1/d101/df/f7b [0,4194304] 0 2024-09-04T16:30:38.843 INFO:tasks.workunit.client.0.smithi170.stdout:9/899: truncate d2/d3d/f20 2200927 0 2024-09-04T16:30:38.846 INFO:tasks.workunit.client.0.smithi170.stdout:6/815: symlink d0/d15/d56/d6c/d98/l116 0 2024-09-04T16:30:38.848 INFO:tasks.workunit.client.0.smithi170.stdout:8/857: creat d6/d28/d16/d77/d93/d95/db8/df9/f126 x:0 0 0 2024-09-04T16:30:38.849 INFO:tasks.workunit.client.0.smithi170.stdout:8/858: chown d6/d28/d1a/ld4 702 1 2024-09-04T16:30:38.854 INFO:tasks.workunit.client.0.smithi170.stdout:9/900: rename d2/d3d/d6d/l8b to d2/d11/d58/l11a 0 2024-09-04T16:30:38.861 INFO:tasks.workunit.client.0.smithi170.stdout:2/938: creat d3/d4/d86/dc9/f135 x:0 0 0 2024-09-04T16:30:38.864 INFO:tasks.workunit.client.0.smithi170.stdout:9/901: readlink d2/d3d/d6d/d79/dd0/l103 0 2024-09-04T16:30:38.868 INFO:tasks.workunit.client.0.smithi170.stdout:4/857: dwrite d1/d6/d8/d20/d35/d54/fc7 [0,4194304] 0 2024-09-04T16:30:38.868 INFO:tasks.workunit.client.0.smithi170.stdout:2/939: creat d3/d3c/dc1/d101/d62/d6f/f136 x:0 0 0 2024-09-04T16:30:38.870 INFO:tasks.workunit.client.0.smithi170.stdout:8/859: write d6/d28/d1a/d80/fb9 [579088,101140] 0 2024-09-04T16:30:38.871 INFO:tasks.workunit.client.0.smithi170.stdout:9/902: symlink d2/d3d/d35/l11b 0 2024-09-04T16:30:38.873 INFO:tasks.workunit.client.0.smithi170.stdout:6/816: getdents d0/d15/d56/d6c 0 2024-09-04T16:30:38.877 INFO:tasks.workunit.client.0.smithi170.stdout:4/858: creat d1/d6/d2b/f127 x:0 0 0 2024-09-04T16:30:38.883 INFO:tasks.workunit.client.0.smithi170.stdout:9/903: creat d2/d3d/d27/d65/dcb/de0/dee/d7a/da5/f11c x:0 0 0 2024-09-04T16:30:38.884 INFO:tasks.workunit.client.0.smithi170.stdout:6/817: rmdir d0/d15/d56/d6c/db8 39 2024-09-04T16:30:38.885 INFO:tasks.workunit.client.0.smithi170.stdout:2/940: read d3/d3c/dc1/d101/d62/f109 [1020336,85491] 0 2024-09-04T16:30:38.886 INFO:tasks.workunit.client.0.smithi170.stdout:4/859: creat d1/d6/d8/d20/d35/d3e/d4e/d51/f128 x:0 0 0 2024-09-04T16:30:38.888 INFO:tasks.workunit.client.0.smithi170.stdout:9/904: symlink d2/d3d/d6d/l11d 0 2024-09-04T16:30:38.892 INFO:tasks.workunit.client.0.smithi170.stdout:2/941: creat d3/d3c/dc1/d101/df/d45/f137 x:0 0 0 2024-09-04T16:30:38.893 INFO:tasks.workunit.client.0.smithi170.stdout:2/942: dread - d3/d3c/dc1/d101/d1c/d77/dc2/ffb zero size 2024-09-04T16:30:38.894 INFO:tasks.workunit.client.0.smithi170.stdout:2/943: readlink d3/d7/l10a 0 2024-09-04T16:30:38.897 INFO:tasks.workunit.client.0.smithi170.stdout:8/860: getdents d6/d26 0 2024-09-04T16:30:38.897 INFO:tasks.workunit.client.0.smithi170.stdout:6/818: dread d0/d15/d56/d6d/f74 [0,4194304] 0 2024-09-04T16:30:38.899 INFO:tasks.workunit.client.0.smithi170.stdout:6/819: chown d0/df/d7e/dfa/d68 861081294 1 2024-09-04T16:30:38.899 INFO:tasks.workunit.client.0.smithi170.stdout:9/905: unlink d2/d3d/d6d/d79/def/df0/l112 0 2024-09-04T16:30:38.901 INFO:tasks.workunit.client.0.smithi170.stdout:2/944: creat d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/d97/f138 x:0 0 0 2024-09-04T16:30:38.902 INFO:tasks.workunit.client.0.smithi170.stdout:8/861: creat d6/d28/d16/d52/d73/d71/f127 x:0 0 0 2024-09-04T16:30:38.902 INFO:tasks.workunit.client.0.smithi170.stdout:2/945: dread - d3/d3c/dc1/d101/d1c/d77/f105 zero size 2024-09-04T16:30:38.903 INFO:tasks.workunit.client.0.smithi170.stdout:6/820: creat d0/df/f117 x:0 0 0 2024-09-04T16:30:38.908 INFO:tasks.workunit.client.0.smithi170.stdout:6/821: rename d0/df/d7e/dfa/d68/d2d/d67/l108 to d0/d17/d39/d99/l118 0 2024-09-04T16:30:38.916 INFO:tasks.workunit.client.0.smithi170.stdout:2/946: rmdir d3/d3c/dc1/d101/d1c/db8/dd0 0 2024-09-04T16:30:38.917 INFO:tasks.workunit.client.0.smithi170.stdout:9/906: truncate d2/d3d/d4d/f82 651310 0 2024-09-04T16:30:38.918 INFO:tasks.workunit.client.0.smithi170.stdout:2/947: write d3/d3c/dc1/d101/f3b [4463697,130788] 0 2024-09-04T16:30:38.921 INFO:tasks.workunit.client.0.smithi170.stdout:8/862: rename d6/d28/d16/d52/d73/d5d/d8b/cc3 to d6/d28/d16/d77/d93/d95/c128 0 2024-09-04T16:30:38.922 INFO:tasks.workunit.client.0.smithi170.stdout:6/822: write d0/f16 [2019263,66877] 0 2024-09-04T16:30:38.924 INFO:tasks.workunit.client.0.smithi170.stdout:2/948: mkdir d3/d3c/dc1/d101/d1c/d47/d83/deb/d12d/d139 0 2024-09-04T16:30:38.926 INFO:tasks.workunit.client.0.smithi170.stdout:9/907: rename d2/d3d/d54 to d2/d3d/d4d/d59/d11e 0 2024-09-04T16:30:38.927 INFO:tasks.workunit.client.0.smithi170.stdout:9/908: chown d2/d3d/d27/d65/dcb/f116 86595 1 2024-09-04T16:30:38.927 INFO:tasks.workunit.client.0.smithi170.stdout:8/863: creat d6/d28/d5f/d70/d97/d99/f129 x:0 0 0 2024-09-04T16:30:38.930 INFO:tasks.workunit.client.0.smithi170.stdout:2/949: mknod d3/d3c/dc1/d101/d1c/d47/d83/c13a 0 2024-09-04T16:30:38.931 INFO:tasks.workunit.client.0.smithi170.stdout:2/950: chown d3/d3c/f82 80 1 2024-09-04T16:30:38.938 INFO:tasks.workunit.client.0.smithi170.stdout:2/951: rmdir d3/d3c/dc1/d101/d1c/d47/d83/d9f 39 2024-09-04T16:30:38.939 INFO:tasks.workunit.client.0.smithi170.stdout:2/952: fdatasync d3/d3c/dc1/d101/d1c/fbf 0 2024-09-04T16:30:38.941 INFO:tasks.workunit.client.0.smithi170.stdout:6/823: write d0/df/d7e/dfa/d68/d2d/fc9 [2951734,36635] 0 2024-09-04T16:30:38.942 INFO:tasks.workunit.client.0.smithi170.stdout:6/824: dread - d0/dbf/f103 zero size 2024-09-04T16:30:38.944 INFO:tasks.workunit.client.0.smithi170.stdout:2/953: rmdir d3/d3c/dc1/d101/dc5/d124/d68 39 2024-09-04T16:30:38.946 INFO:tasks.workunit.client.0.smithi170.stdout:8/864: write d6/d28/d20/d5e/f5c [1361148,43380] 0 2024-09-04T16:30:38.951 INFO:tasks.workunit.client.0.smithi170.stdout:9/909: dwrite d2/d3d/d27/d65/fdc [0,4194304] 0 2024-09-04T16:30:38.952 INFO:tasks.workunit.client.0.smithi170.stdout:9/910: chown d2/d3d/d35/f86 58909 1 2024-09-04T16:30:38.958 INFO:tasks.workunit.client.0.smithi170.stdout:6/825: rename d0/d15/d56/d6d/dac/f79 to d0/d17/d31/d64/f119 0 2024-09-04T16:30:38.960 INFO:tasks.workunit.client.0.smithi170.stdout:9/911: mkdir d2/d3d/d35/d11f 0 2024-09-04T16:30:38.962 INFO:tasks.workunit.client.0.smithi170.stdout:2/954: write d3/d3c/dc1/d101/d1c/d47/d83/d9f/fdc [869470,16427] 0 2024-09-04T16:30:38.965 INFO:tasks.workunit.client.0.smithi170.stdout:9/912: symlink d2/d11/d23/d95/l120 0 2024-09-04T16:30:38.968 INFO:tasks.workunit.client.0.smithi170.stdout:8/865: dwrite d6/d28/d5f/d70/f7d [0,4194304] 0 2024-09-04T16:30:38.974 INFO:tasks.workunit.client.0.smithi170.stdout:2/955: mknod d3/d3c/dc1/d101/d1c/d47/d83/c13b 0 2024-09-04T16:30:38.974 INFO:tasks.workunit.client.0.smithi170.stdout:8/866: dread d6/f57 [0,4194304] 0 2024-09-04T16:30:38.980 INFO:tasks.workunit.client.0.smithi170.stdout:6/826: dwrite d0/d15/d56/d6c/f85 [0,4194304] 0 2024-09-04T16:30:38.981 INFO:tasks.workunit.client.0.smithi170.stdout:8/867: chown d6/d28/d16/d77/d93/d95/c128 379480 1 2024-09-04T16:30:38.982 INFO:tasks.workunit.client.0.smithi170.stdout:9/913: link d2/d3d/d3f/d90/cea d2/d3d/d6d/d79/dd0/c121 0 2024-09-04T16:30:38.984 INFO:tasks.workunit.client.0.smithi170.stdout:6/827: unlink d0/d9f/fd9 0 2024-09-04T16:30:38.987 INFO:tasks.workunit.client.0.smithi170.stdout:8/868: mknod d6/d28/d16/d52/d73/c12a 0 2024-09-04T16:30:38.988 INFO:tasks.workunit.client.0.smithi170.stdout:2/956: creat d3/d3c/dc1/d101/d1c/d47/d83/d122/f13c x:0 0 0 2024-09-04T16:30:38.990 INFO:tasks.workunit.client.0.smithi170.stdout:2/957: chown d3/d3c/dc1/d101/d1c/db8/l115 247973191 1 2024-09-04T16:30:38.993 INFO:tasks.workunit.client.0.smithi170.stdout:9/914: mknod d2/d3d/c122 0 2024-09-04T16:30:38.994 INFO:tasks.workunit.client.0.smithi170.stdout:8/869: creat d6/d28/d16/d52/d73/d5d/d11b/d125/f12b x:0 0 0 2024-09-04T16:30:38.998 INFO:tasks.workunit.client.0.smithi170.stdout:6/828: creat d0/d17/d31/f11a x:0 0 0 2024-09-04T16:30:39.007 INFO:tasks.workunit.client.0.smithi170.stdout:9/915: getdents d2/d11/d58/dd4 0 2024-09-04T16:30:39.007 INFO:tasks.workunit.client.0.smithi170.stdout:6/829: creat d0/df/d1b/f11b x:0 0 0 2024-09-04T16:30:39.010 INFO:tasks.workunit.client.0.smithi170.stdout:8/870: dread d6/f41 [0,4194304] 0 2024-09-04T16:30:39.012 INFO:tasks.workunit.client.0.smithi170.stdout:2/958: dwrite d3/d3c/dc1/d101/d62/d6f/f96 [0,4194304] 0 2024-09-04T16:30:39.014 INFO:tasks.workunit.client.0.smithi170.stdout:2/959: chown d3/d4/d86/dc9/dd9/fe4 79027 1 2024-09-04T16:30:39.014 INFO:tasks.workunit.client.0.smithi170.stdout:9/916: truncate d2/d3d/d27/d65/d66/f73 323459 0 2024-09-04T16:30:39.019 INFO:tasks.workunit.client.0.smithi170.stdout:2/960: symlink d3/d3c/dc1/d101/d62/d6f/d110/dcf/dba/l13d 0 2024-09-04T16:30:39.020 INFO:tasks.workunit.client.0.smithi170.stdout:9/917: chown d2/d3d/d4d/fd3 72216365 1 2024-09-04T16:30:39.025 INFO:tasks.workunit.client.0.smithi170.stdout:9/918: dread d2/d3d/d27/f64 [0,4194304] 0 2024-09-04T16:30:39.025 INFO:tasks.workunit.client.0.smithi170.stdout:2/961: link d3/d3c/dc1/d101/d1c/d47/f100 d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/dee/f13e 0 2024-09-04T16:30:39.027 INFO:tasks.workunit.client.0.smithi170.stdout:9/919: chown d2/d3d/d27/d65/dcb/de0/dee/d10c/c92 166007148 1 2024-09-04T16:30:39.027 INFO:tasks.workunit.client.0.smithi170.stdout:2/962: dread - d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/dee/f121 zero size 2024-09-04T16:30:39.029 INFO:tasks.workunit.client.0.smithi170.stdout:2/963: read d3/d3c/dc1/d101/f3b [3607972,20976] 0 2024-09-04T16:30:39.033 INFO:tasks.workunit.client.0.smithi170.stdout:8/871: dread d6/d28/d5f/d70/de8/f84 [0,4194304] 0 2024-09-04T16:30:39.035 INFO:tasks.workunit.client.0.smithi170.stdout:9/920: dwrite d2/d3d/d35/d10b/f117 [0,4194304] 0 2024-09-04T16:30:39.036 INFO:tasks.workunit.client.0.smithi170.stdout:8/872: truncate d6/d28/d5f/f11a 651403 0 2024-09-04T16:30:39.044 INFO:tasks.workunit.client.0.smithi170.stdout:9/921: write d2/d11/d23/f30 [6969146,13771] 0 2024-09-04T16:30:39.046 INFO:tasks.workunit.client.0.smithi170.stdout:9/922: chown d2/d3d/d35/l6c 5529713 1 2024-09-04T16:30:39.046 INFO:tasks.workunit.client.0.smithi170.stdout:9/923: chown d2/d11/d8f/de1 1 1 2024-09-04T16:30:39.103 INFO:tasks.workunit.client.0.smithi170.stdout:9/924: creat d2/d11/d8f/df1/f123 x:0 0 0 2024-09-04T16:30:39.103 INFO:tasks.workunit.client.0.smithi170.stdout:2/964: getdents d3/d3c/dc1/d101/d1c/d47/d83/deb/d12d 0 2024-09-04T16:30:39.104 INFO:tasks.workunit.client.0.smithi170.stdout:2/965: chown d3/d4/d86/dc9/dd9/f8b 383065 1 2024-09-04T16:30:39.105 INFO:tasks.workunit.client.0.smithi170.stdout:2/966: read - d3/d3c/dc1/d101/d1c/d77/f105 zero size 2024-09-04T16:30:39.105 INFO:tasks.workunit.client.0.smithi170.stdout:2/967: stat d3/d3c/dc1/lf5 0 2024-09-04T16:30:39.106 INFO:tasks.workunit.client.0.smithi170.stdout:9/925: mknod d2/d3d/d27/d65/dcb/d108/c124 0 2024-09-04T16:30:39.143 INFO:tasks.workunit.client.0.smithi170.stdout:2/968: symlink d3/d3c/d40/l13f 0 2024-09-04T16:30:39.146 INFO:tasks.workunit.client.0.smithi170.stdout:9/926: creat d2/d3d/d35/f125 x:0 0 0 2024-09-04T16:30:39.149 INFO:tasks.workunit.client.0.smithi170.stdout:2/969: getdents d3/d3c/dc1/d101/d62/d6f/d110 0 2024-09-04T16:30:39.153 INFO:tasks.workunit.client.0.smithi170.stdout:2/970: truncate d3/d3c/dc1/d101/dc5/d124/fa7 139967 0 2024-09-04T16:30:39.158 INFO:tasks.workunit.client.0.smithi170.stdout:2/971: dread d3/d3c/d40/fe9 [0,4194304] 0 2024-09-04T16:30:39.164 INFO:tasks.workunit.client.0.smithi170.stdout:2/972: chown d3/d3c/dc1/d101/d1c/d77/cf4 59389 1 2024-09-04T16:30:39.177 INFO:tasks.workunit.client.0.smithi170.stdout:2/973: dread d3/d3c/d40/f71 [0,4194304] 0 2024-09-04T16:30:39.187 INFO:tasks.workunit.client.0.smithi170.stdout:2/974: mknod d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/c140 0 2024-09-04T16:30:39.195 INFO:tasks.workunit.client.0.smithi170.stdout:2/975: link d3/d3c/dc1/d101/df/d45/f10c d3/d3c/d40/f141 0 2024-09-04T16:30:39.196 INFO:tasks.workunit.client.0.smithi170.stdout:2/976: chown d3/d3c/de7/f12e 47 1 2024-09-04T16:30:39.199 INFO:tasks.workunit.client.0.smithi170.stdout:2/977: fdatasync d3/d3c/dc1/d101/d62/d6f/d110/dcf/dba/dd5/f12a 0 2024-09-04T16:30:39.201 INFO:tasks.workunit.client.0.smithi170.stdout:9/927: truncate d2/d3d/d4d/d59/d85/f8a 316912 0 2024-09-04T16:30:39.206 INFO:tasks.workunit.client.0.smithi170.stdout:9/928: dread d2/d3d/f10 [0,4194304] 0 2024-09-04T16:30:39.213 INFO:tasks.workunit.client.0.smithi170.stdout:9/929: read d2/d3d/d27/d2b/daf/f9c [2331211,67913] 0 2024-09-04T16:30:39.218 INFO:tasks.workunit.client.0.smithi170.stdout:9/930: mknod d2/d3d/d27/d65/c126 0 2024-09-04T16:30:39.220 INFO:tasks.workunit.client.0.smithi170.stdout:2/978: dwrite d3/d7/f4d [0,4194304] 0 2024-09-04T16:30:39.223 INFO:tasks.workunit.client.0.smithi170.stdout:9/931: truncate d2/d3d/d27/d65/dcb/de0/dee/d7a/da5/f11c 630660 0 2024-09-04T16:30:39.229 INFO:tasks.workunit.client.0.smithi170.stdout:9/932: dread d2/d3d/d27/d65/fdc [0,4194304] 0 2024-09-04T16:30:39.234 INFO:tasks.workunit.client.0.smithi170.stdout:9/933: creat d2/d3d/d6d/d79/def/f127 x:0 0 0 2024-09-04T16:30:39.236 INFO:tasks.workunit.client.0.smithi170.stdout:9/934: mkdir d2/d3d/d27/d128 0 2024-09-04T16:30:39.237 INFO:tasks.workunit.client.0.smithi170.stdout:9/935: dread - d2/d11/d8f/fe3 zero size 2024-09-04T16:30:39.237 INFO:tasks.workunit.client.0.smithi170.stdout:9/936: chown d2/d11/d23/d95/lce 209903700 1 2024-09-04T16:30:39.241 INFO:tasks.workunit.client.0.smithi170.stdout:9/937: rename d2/d11/d8f/de1 to d2/d11/d8f/df1/d129 0 2024-09-04T16:30:39.243 INFO:tasks.workunit.client.0.smithi170.stdout:9/938: write d2/d3d/d27/d2b/daf/f110 [1020569,45173] 0 2024-09-04T16:30:39.244 INFO:tasks.workunit.client.0.smithi170.stdout:2/979: dwrite d3/fe3 [0,4194304] 0 2024-09-04T16:30:39.250 INFO:tasks.workunit.client.0.smithi170.stdout:9/939: unlink d2/d3d/d27/f10a 0 2024-09-04T16:30:39.253 INFO:tasks.workunit.client.0.smithi170.stdout:2/980: dread d3/d3c/dc1/d101/d62/fcb [0,4194304] 0 2024-09-04T16:30:39.254 INFO:tasks.workunit.client.0.smithi170.stdout:2/981: chown d3/d4/d86/dc9/fdb 4849398 1 2024-09-04T16:30:39.257 INFO:tasks.workunit.client.0.smithi170.stdout:9/940: creat d2/d3d/d35/f12a x:0 0 0 2024-09-04T16:30:39.257 INFO:tasks.workunit.client.0.smithi170.stdout:2/982: rmdir d3/d3c/dc1/d101/d1c/db8 39 2024-09-04T16:30:39.258 INFO:tasks.workunit.client.0.smithi170.stdout:1/993: sync 2024-09-04T16:30:39.258 INFO:tasks.workunit.client.0.smithi170.stdout:5/884: sync 2024-09-04T16:30:39.258 INFO:tasks.workunit.client.0.smithi170.stdout:3/837: sync 2024-09-04T16:30:39.264 INFO:tasks.workunit.client.0.smithi170.stdout:9/941: rename d2/d3d/d27/d65/dcb/d108 to d2/d11/d8f/d12b 0 2024-09-04T16:30:39.266 INFO:tasks.workunit.client.0.smithi170.stdout:2/983: dwrite d3/d3c/dc1/d101/d1c/d47/fea [0,4194304] 0 2024-09-04T16:30:39.266 INFO:tasks.workunit.client.0.smithi170.stdout:5/885: mknod d4/d3a/d74/dd1/c121 0 2024-09-04T16:30:39.268 INFO:tasks.workunit.client.0.smithi170.stdout:3/838: write d13/d14/d21/d4d/d4e/d88/dbf/f70 [3773500,64538] 0 2024-09-04T16:30:39.268 INFO:tasks.workunit.client.0.smithi170.stdout:5/886: chown d4/d8/d1c/d26/d27/d48/d5a 3774 1 2024-09-04T16:30:39.272 INFO:tasks.workunit.client.0.smithi170.stdout:9/942: mkdir d2/d3d/d6d/d79/def/d12c 0 2024-09-04T16:30:39.272 INFO:tasks.workunit.client.0.smithi170.stdout:1/994: write d9/fbd [523990,58983] 0 2024-09-04T16:30:39.273 INFO:tasks.workunit.client.0.smithi170.stdout:2/984: creat d3/d3c/dc1/d101/d62/d6f/d110/f142 x:0 0 0 2024-09-04T16:30:39.275 INFO:tasks.workunit.client.0.smithi170.stdout:3/839: unlink d13/f9b 0 2024-09-04T16:30:39.281 INFO:tasks.workunit.client.0.smithi170.stdout:2/985: creat d3/d3c/dc1/d101/d1c/d47/d83/d122/f143 x:0 0 0 2024-09-04T16:30:39.287 INFO:tasks.workunit.client.0.smithi170.stdout:5/887: truncate d4/d8/d1c/d26/d27/d43/d5b/fbc 4421529 0 2024-09-04T16:30:39.293 INFO:tasks.workunit.client.0.smithi170.stdout:2/986: rmdir d3/d3c/dc1/d101/d1c/d47/d83/d9f 39 2024-09-04T16:30:39.295 INFO:tasks.workunit.client.0.smithi170.stdout:2/987: chown d3/d4/d86/dc9/dd9/f8b 1744 1 2024-09-04T16:30:39.295 INFO:tasks.workunit.client.0.smithi170.stdout:1/995: dwrite d9/d11/d9b/fb8 [0,4194304] 0 2024-09-04T16:30:39.299 INFO:tasks.workunit.client.0.smithi170.stdout:3/840: link d13/d14/d17/f9f d13/d14/d1f/d109/f112 0 2024-09-04T16:30:39.301 INFO:tasks.workunit.client.0.smithi170.stdout:5/888: symlink d4/d8/l122 0 2024-09-04T16:30:39.303 INFO:tasks.workunit.client.0.smithi170.stdout:5/889: readlink d4/db/d37/l72 0 2024-09-04T16:30:39.304 INFO:tasks.workunit.client.0.smithi170.stdout:1/996: link d9/d11/dae/d6a/d79/f95 d9/d34/f15a 0 2024-09-04T16:30:39.306 INFO:tasks.workunit.client.0.smithi170.stdout:9/943: dwrite d2/d3d/d6d/d79/db0/fec [0,4194304] 0 2024-09-04T16:30:39.308 INFO:tasks.workunit.client.0.smithi170.stdout:5/890: write d4/d8/d1c/d26/d27/d48/d7c/f10c [293491,71370] 0 2024-09-04T16:30:39.309 INFO:tasks.workunit.client.0.smithi170.stdout:3/841: rename d13/d14/d1d/d71/db3/db6/d9e/f83 to d13/f113 0 2024-09-04T16:30:39.316 INFO:tasks.workunit.client.0.smithi170.stdout:9/944: dwrite d2/d3d/d27/f3a [0,4194304] 0 2024-09-04T16:30:39.317 INFO:tasks.workunit.client.0.smithi170.stdout:1/997: rename d9/d11/d2f/d6b/l6d to d9/d11/d85/d10f/l15b 0 2024-09-04T16:30:39.322 INFO:tasks.workunit.client.0.smithi170.stdout:3/842: dwrite d13/d14/d21/f2b [4194304,4194304] 0 2024-09-04T16:30:39.325 INFO:tasks.workunit.client.0.smithi170.stdout:9/945: rename d2/d32/f93 to d2/d11/d23/dba/f12d 0 2024-09-04T16:30:39.329 INFO:tasks.workunit.client.0.smithi170.stdout:1/998: mkdir d9/d119/d15c 0 2024-09-04T16:30:39.332 INFO:tasks.workunit.client.0.smithi170.stdout:3/843: fsync d13/d14/d21/d4c/f77 0 2024-09-04T16:30:39.333 INFO:tasks.workunit.client.0.smithi170.stdout:1/999: chown d9/d11/d2f/dc2 2842233 1 2024-09-04T16:30:39.334 INFO:tasks.workunit.client.0.smithi170.stdout:5/891: dread d4/d8/d1c/d41/f4f [0,4194304] 0 2024-09-04T16:30:39.339 INFO:tasks.workunit.client.0.smithi170.stdout:3/844: link d13/f25 d13/d14/d8b/de3/f114 0 2024-09-04T16:30:39.343 INFO:tasks.workunit.client.0.smithi170.stdout:3/845: creat d13/d14/d21/dd2/f115 x:0 0 0 2024-09-04T16:30:39.345 INFO:tasks.workunit.client.0.smithi170.stdout:9/946: write d2/d3d/d35/fad [588564,21606] 0 2024-09-04T16:30:39.348 INFO:tasks.workunit.client.0.smithi170.stdout:3/846: mknod d13/d14/d17/c116 0 2024-09-04T16:30:39.349 INFO:tasks.workunit.client.0.smithi170.stdout:9/947: symlink d2/d3d/d27/d65/dcb/de0/dee/dd7/l12e 0 2024-09-04T16:30:39.356 INFO:tasks.workunit.client.0.smithi170.stdout:5/892: dread d4/db/f1e [0,4194304] 0 2024-09-04T16:30:39.359 INFO:tasks.workunit.client.0.smithi170.stdout:5/893: mkdir d4/d8/d123 0 2024-09-04T16:30:39.361 INFO:tasks.workunit.client.0.smithi170.stdout:9/948: dwrite d2/d3d/d27/d65/dcb/de0/dee/d7a/db6/fbf [0,4194304] 0 2024-09-04T16:30:39.364 INFO:tasks.workunit.client.0.smithi170.stdout:5/894: rename d4/d8/d1c/d26/d27/d43 to d4/d8/d1c/d26/df8/d124 0 2024-09-04T16:30:39.365 INFO:tasks.workunit.client.0.smithi170.stdout:5/895: dread - d4/d8/d1c/d26/d27/d48/f120 zero size 2024-09-04T16:30:39.368 INFO:tasks.workunit.client.0.smithi170.stdout:5/896: rmdir d4/d8/d1c/d26/d27/d48/ddf 39 2024-09-04T16:30:39.370 INFO:tasks.workunit.client.0.smithi170.stdout:5/897: chown d4/db/d51/d5e/d71/d84/d93/d106/d39/dfa/l113 6745295 1 2024-09-04T16:30:39.385 INFO:tasks.workunit.client.0.smithi170.stdout:5/898: dwrite d4/d8/d1c/d41/f4f [0,4194304] 0 2024-09-04T16:30:39.388 INFO:tasks.workunit.client.0.smithi170.stdout:9/949: dread d2/d3d/d27/d65/dcb/de0/dee/d7a/fbd [0,4194304] 0 2024-09-04T16:30:39.391 INFO:tasks.workunit.client.0.smithi170.stdout:5/899: fdatasync d4/d3a/d74/d8b/fb7 0 2024-09-04T16:30:39.393 INFO:tasks.workunit.client.0.smithi170.stdout:5/900: chown d4/d8/d1c/d26/d27/d88/da4/fba 392 1 2024-09-04T16:30:39.399 INFO:tasks.workunit.client.0.smithi170.stdout:5/901: unlink d4/d8/d1c/d29/f2a 0 2024-09-04T16:30:39.402 INFO:tasks.workunit.client.0.smithi170.stdout:5/902: mkdir d4/d8/d125 0 2024-09-04T16:30:39.403 INFO:tasks.workunit.client.0.smithi170.stdout:5/903: chown d4/d8/d1c/d29/lbd 153324 1 2024-09-04T16:30:39.403 INFO:tasks.workunit.client.0.smithi170.stdout:5/904: readlink d4/d8/d1c/d26/d27/d48/d7c/ld0 0 2024-09-04T16:30:39.407 INFO:tasks.workunit.client.0.smithi170.stdout:5/905: dread d4/d8/d1c/d26/d27/d48/d7c/f10c [0,4194304] 0 2024-09-04T16:30:39.409 INFO:tasks.workunit.client.0.smithi170.stdout:5/906: creat d4/d8/d1c/d26/df8/f126 x:0 0 0 2024-09-04T16:30:39.411 INFO:tasks.workunit.client.0.smithi170.stdout:5/907: rmdir d4/d8/d1c 39 2024-09-04T16:30:39.418 INFO:tasks.workunit.client.0.smithi170.stdout:5/908: truncate d4/d8/d1c/d26/d27/d48/d7c/f10c 180206 0 2024-09-04T16:30:39.420 INFO:tasks.workunit.client.0.smithi170.stdout:5/909: write d4/f6 [4491161,13459] 0 2024-09-04T16:30:39.424 INFO:tasks.workunit.client.0.smithi170.stdout:5/910: fsync d4/d8/d1c/d26/df8/d124/f101 0 2024-09-04T16:30:39.425 INFO:tasks.workunit.client.0.smithi170.stdout:5/911: truncate d4/db/f115 2302 0 2024-09-04T16:30:39.430 INFO:tasks.workunit.client.0.smithi170.stdout:5/912: rmdir d4/d8/dea 39 2024-09-04T16:30:39.433 INFO:tasks.workunit.client.0.smithi170.stdout:5/913: mkdir d4/d8/d1c/d26/d27/d48/d7c/dd6/de0/d127 0 2024-09-04T16:30:39.433 INFO:tasks.workunit.client.0.smithi170.stdout:5/914: chown d4/db/d51/d5e/d71/d84 34 1 2024-09-04T16:30:39.435 INFO:tasks.workunit.client.0.smithi170.stdout:5/915: mknod d4/d3a/d74/dd1/c128 0 2024-09-04T16:30:39.436 INFO:tasks.workunit.client.0.smithi170.stdout:5/916: chown d4/db/d51/fde 4221 1 2024-09-04T16:30:39.437 INFO:tasks.workunit.client.0.smithi170.stdout:5/917: dread - d4/db/d51/d5e/d71/f11d zero size 2024-09-04T16:30:39.439 INFO:tasks.workunit.client.0.smithi170.stdout:5/918: getdents d4/d3a/d74/daf 0 2024-09-04T16:30:39.443 INFO:tasks.workunit.client.0.smithi170.stdout:5/919: link d4/d8/d1c/d26/df8/d124/f66 d4/d8/d1c/d41/f129 0 2024-09-04T16:30:39.446 INFO:tasks.workunit.client.0.smithi170.stdout:5/920: rmdir d4/d8/d1c/d26/d27/d48/ddf 39 2024-09-04T16:30:39.446 INFO:tasks.workunit.client.0.smithi170.stdout:4/860: sync 2024-09-04T16:30:39.446 INFO:tasks.workunit.client.0.smithi170.stdout:8/873: sync 2024-09-04T16:30:39.447 INFO:tasks.workunit.client.0.smithi170.stdout:6/830: sync 2024-09-04T16:30:39.448 INFO:tasks.workunit.client.0.smithi170.stdout:8/874: chown d6/d28/d5f/d70/f7b 4 1 2024-09-04T16:30:39.449 INFO:tasks.workunit.client.0.smithi170.stdout:6/831: dread - d0/df/d7e/dfa/d68/d2d/fff zero size 2024-09-04T16:30:39.450 INFO:tasks.workunit.client.0.smithi170.stdout:4/861: mkdir d1/d129 0 2024-09-04T16:30:39.451 INFO:tasks.workunit.client.0.smithi170.stdout:8/875: fsync d6/d28/d5f/d70/d97/fdc 0 2024-09-04T16:30:39.452 INFO:tasks.workunit.client.0.smithi170.stdout:6/832: readlink d0/d17/d39/d99/l118 0 2024-09-04T16:30:39.452 INFO:tasks.workunit.client.0.smithi170.stdout:8/876: read - d6/d28/d20/d5e/f5b zero size 2024-09-04T16:30:39.453 INFO:tasks.workunit.client.0.smithi170.stdout:6/833: dread - d0/d17/fda zero size 2024-09-04T16:30:39.454 INFO:tasks.workunit.client.0.smithi170.stdout:8/877: dread - d6/d28/d16/d52/d73/d71/f104 zero size 2024-09-04T16:30:39.454 INFO:tasks.workunit.client.0.smithi170.stdout:6/834: chown d0/d15/d56/d6c/da0/d106 7843969 1 2024-09-04T16:30:39.455 INFO:tasks.workunit.client.0.smithi170.stdout:4/862: fsync d1/d6/d8/d20/dc1/dd2/fe7 0 2024-09-04T16:30:39.457 INFO:tasks.workunit.client.0.smithi170.stdout:5/921: dread d4/d8/d1c/d26/df8/d124/f66 [0,4194304] 0 2024-09-04T16:30:39.457 INFO:tasks.workunit.client.0.smithi170.stdout:8/878: write d6/d28/d5f/d70/d97/d99/f100 [133649,45871] 0 2024-09-04T16:30:39.458 INFO:tasks.workunit.client.0.smithi170.stdout:6/835: write d0/d17/d31/d64/d30/f84 [4781366,114845] 0 2024-09-04T16:30:39.463 INFO:tasks.workunit.client.0.smithi170.stdout:8/879: fdatasync d6/d28/d20/d5e/f47 0 2024-09-04T16:30:39.465 INFO:tasks.workunit.client.0.smithi170.stdout:5/922: symlink d4/d8/d1c/d41/l12a 0 2024-09-04T16:30:39.465 INFO:tasks.workunit.client.0.smithi170.stdout:8/880: read d6/d28/d20/d5e/f47 [4404774,86972] 0 2024-09-04T16:30:39.466 INFO:tasks.workunit.client.0.smithi170.stdout:5/923: dread - d4/d8/d1c/d26/df8/f126 zero size 2024-09-04T16:30:39.468 INFO:tasks.workunit.client.0.smithi170.stdout:5/924: chown d4/d8/d1c/d26/d27/d48/d7c/fcc 1840 1 2024-09-04T16:30:39.469 INFO:tasks.workunit.client.0.smithi170.stdout:6/836: mkdir d0/d17/d31/d64/df4/df8/d11c 0 2024-09-04T16:30:39.470 INFO:tasks.workunit.client.0.smithi170.stdout:4/863: creat d1/d6/d8/d20/d35/d3e/f12a x:0 0 0 2024-09-04T16:30:39.471 INFO:tasks.workunit.client.0.smithi170.stdout:4/864: write d1/d6/d8/d20/d95/f11d [2360082,118371] 0 2024-09-04T16:30:39.472 INFO:tasks.workunit.client.0.smithi170.stdout:8/881: rename d6/d28/d16/d52/fb1 to d6/d28/d5f/d70/d97/d99/f12c 0 2024-09-04T16:30:39.473 INFO:tasks.workunit.client.0.smithi170.stdout:4/865: stat d1/d6/d8/d20/d35/fdd 0 2024-09-04T16:30:39.473 INFO:tasks.workunit.client.0.smithi170.stdout:8/882: dread - d6/d26/f109 zero size 2024-09-04T16:30:39.474 INFO:tasks.workunit.client.0.smithi170.stdout:4/866: write d1/d6/d2b/db3/de8/f10d [347587,79357] 0 2024-09-04T16:30:39.475 INFO:tasks.workunit.client.0.smithi170.stdout:5/925: creat d4/db/d51/d5e/d71/d84/d93/d106/f12b x:0 0 0 2024-09-04T16:30:39.476 INFO:tasks.workunit.client.0.smithi170.stdout:5/926: stat d4/db/d37 0 2024-09-04T16:30:39.476 INFO:tasks.workunit.client.0.smithi170.stdout:6/837: creat d0/df/d1f/f11d x:0 0 0 2024-09-04T16:30:39.478 INFO:tasks.workunit.client.0.smithi170.stdout:5/927: chown d4/db/d51/d5e/d71/d84/d93/d106/d39/f81 437 1 2024-09-04T16:30:39.479 INFO:tasks.workunit.client.0.smithi170.stdout:5/928: fdatasync d4/d8/d1c/d26/d27/f38 0 2024-09-04T16:30:39.480 INFO:tasks.workunit.client.0.smithi170.stdout:6/838: chown d0/d17/c5f 16373 1 2024-09-04T16:30:39.482 INFO:tasks.workunit.client.0.smithi170.stdout:8/883: symlink d6/d28/d16/d24/l12d 0 2024-09-04T16:30:39.483 INFO:tasks.workunit.client.0.smithi170.stdout:8/884: chown d6/d28/d5f/d70/d97/d99 1278 1 2024-09-04T16:30:39.487 INFO:tasks.workunit.client.0.smithi170.stdout:4/867: dread d1/d6/d8/fa [0,4194304] 0 2024-09-04T16:30:39.490 INFO:tasks.workunit.client.0.smithi170.stdout:5/929: symlink d4/db/d51/d5e/d71/d84/d93/df1/l12c 0 2024-09-04T16:30:39.498 INFO:tasks.workunit.client.0.smithi170.stdout:4/868: write d1/d6/d11e/dbf/fd1 [1475724,37096] 0 2024-09-04T16:30:39.499 INFO:tasks.workunit.client.0.smithi170.stdout:5/930: write d4/db/d51/d5e/d71/d84/d93/d106/d3e/f7e [1318697,74030] 0 2024-09-04T16:30:39.500 INFO:tasks.workunit.client.0.smithi170.stdout:6/839: dwrite d0/d17/d31/d64/d111/f89 [0,4194304] 0 2024-09-04T16:30:39.501 INFO:tasks.workunit.client.0.smithi170.stdout:6/840: chown d0/d17/dbd 3021 1 2024-09-04T16:30:39.504 INFO:tasks.workunit.client.0.smithi170.stdout:6/841: unlink d0/d17/d31/d64/l71 0 2024-09-04T16:30:39.505 INFO:tasks.workunit.client.0.smithi170.stdout:5/931: truncate d4/d3a/d74/d8b/db5/fd3 2190120 0 2024-09-04T16:30:39.509 INFO:tasks.workunit.client.0.smithi170.stdout:6/842: truncate d0/d17/d31/d64/d30/f51 3379310 0 2024-09-04T16:30:39.509 INFO:tasks.workunit.client.0.smithi170.stdout:5/932: chown d4/d3a/d74/d8b/db5/fd3 0 1 2024-09-04T16:30:39.510 INFO:tasks.workunit.client.0.smithi170.stdout:6/843: truncate d0/dbf/fea 511954 0 2024-09-04T16:30:39.512 INFO:tasks.workunit.client.0.smithi170.stdout:4/869: getdents d1/d6/d8/d20/d35/d3e/d4e 0 2024-09-04T16:30:39.515 INFO:tasks.workunit.client.0.smithi170.stdout:6/844: symlink d0/df/d7e/dfa/d68/dfb/l11e 0 2024-09-04T16:30:39.516 INFO:tasks.workunit.client.0.smithi170.stdout:4/870: mkdir d1/d6/d8/d20/d95/d36/d12b 0 2024-09-04T16:30:39.517 INFO:tasks.workunit.client.0.smithi170.stdout:4/871: stat d1/d6/d8/d20/dc1/dd2/c10e 0 2024-09-04T16:30:39.518 INFO:tasks.workunit.client.0.smithi170.stdout:6/845: mkdir d0/df/d7e/dfa/d68/d2d/d2e/d11f 0 2024-09-04T16:30:39.524 INFO:tasks.workunit.client.0.smithi170.stdout:6/846: symlink d0/d15/d56/d6c/da0/dfc/l120 0 2024-09-04T16:30:39.529 INFO:tasks.workunit.client.0.smithi170.stdout:6/847: symlink d0/df/d1f/dcf/l121 0 2024-09-04T16:30:39.530 INFO:tasks.workunit.client.0.smithi170.stdout:4/872: dread d1/d6/d2b/d47/f59 [4194304,4194304] 0 2024-09-04T16:30:39.533 INFO:tasks.workunit.client.0.smithi170.stdout:6/848: truncate d0/d15/d56/d6c/db8/ff0 895365 0 2024-09-04T16:30:39.539 INFO:tasks.workunit.client.0.smithi170.stdout:4/873: dwrite d1/d6/d11e/dbf/fe1 [0,4194304] 0 2024-09-04T16:30:39.543 INFO:tasks.workunit.client.0.smithi170.stdout:5/933: dwrite d4/d3a/d74/d8b/db5/fd3 [0,4194304] 0 2024-09-04T16:30:39.544 INFO:tasks.workunit.client.0.smithi170.stdout:6/849: write d0/df/f10 [6962497,97874] 0 2024-09-04T16:30:39.546 INFO:tasks.workunit.client.0.smithi170.stdout:4/874: mkdir d1/d6/d8/d9d/d12c 0 2024-09-04T16:30:39.550 INFO:tasks.workunit.client.0.smithi170.stdout:5/934: creat d4/d8/d1c/d26/df8/d124/d102/f12d x:0 0 0 2024-09-04T16:30:39.550 INFO:tasks.workunit.client.0.smithi170.stdout:6/850: symlink d0/d15/d56/d6c/da0/dfc/l122 0 2024-09-04T16:30:39.554 INFO:tasks.workunit.client.0.smithi170.stdout:4/875: symlink d1/d6/d2b/db3/dd4/d115/l12d 0 2024-09-04T16:30:39.555 INFO:tasks.workunit.client.0.smithi170.stdout:5/935: dread d4/d8/d1c/d26/d27/f70 [4194304,4194304] 0 2024-09-04T16:30:39.555 INFO:tasks.workunit.client.0.smithi170.stdout:4/876: stat d1/d6/d8/d6c/fe6 0 2024-09-04T16:30:39.556 INFO:tasks.workunit.client.0.smithi170.stdout:6/851: mknod d0/d15/d56/d6c/da0/c123 0 2024-09-04T16:30:39.557 INFO:tasks.workunit.client.0.smithi170.stdout:6/852: truncate d0/d17/d31/f11a 732830 0 2024-09-04T16:30:39.558 INFO:tasks.workunit.client.0.smithi170.stdout:4/877: mkdir d1/d6/d2b/db3/d12e 0 2024-09-04T16:30:39.559 INFO:tasks.workunit.client.0.smithi170.stdout:5/936: dread d4/d8/d1c/d26/df8/f105 [0,4194304] 0 2024-09-04T16:30:39.560 INFO:tasks.workunit.client.0.smithi170.stdout:5/937: fsync d4/db/d51/d5e/d71/d84/fb0 0 2024-09-04T16:30:39.561 INFO:tasks.workunit.client.0.smithi170.stdout:6/853: readlink d0/d17/d31/d64/lf6 0 2024-09-04T16:30:39.561 INFO:tasks.workunit.client.0.smithi170.stdout:5/938: fsync d4/d8/d1c/d41/f4f 0 2024-09-04T16:30:39.563 INFO:tasks.workunit.client.0.smithi170.stdout:5/939: write d4/db/d51/d5e/d71/d84/f9b [3301684,68053] 0 2024-09-04T16:30:39.568 INFO:tasks.workunit.client.0.smithi170.stdout:6/854: rmdir d0/df/d1f 39 2024-09-04T16:30:39.569 INFO:tasks.workunit.client.0.smithi170.stdout:4/878: mkdir d1/d12f 0 2024-09-04T16:30:39.570 INFO:tasks.workunit.client.0.smithi170.stdout:5/940: unlink d4/d3a/l56 0 2024-09-04T16:30:39.573 INFO:tasks.workunit.client.0.smithi170.stdout:6/855: rename d0/df/d7e/dfa/d68/d2d/d2e to d0/d17/d31/d64/df4/d124 0 2024-09-04T16:30:39.574 INFO:tasks.workunit.client.0.smithi170.stdout:4/879: unlink d1/d6/d8/d20/d95/fc5 0 2024-09-04T16:30:39.578 INFO:tasks.workunit.client.0.smithi170.stdout:5/941: getdents d4/d8/d125 0 2024-09-04T16:30:39.580 INFO:tasks.workunit.client.0.smithi170.stdout:5/942: truncate d4/d8/d1c/d26/d27/d48/f120 639997 0 2024-09-04T16:30:39.583 INFO:tasks.workunit.client.0.smithi170.stdout:6/856: getdents d0/df/d1b 0 2024-09-04T16:30:39.584 INFO:tasks.workunit.client.0.smithi170.stdout:5/943: creat d4/db/d51/d5e/d71/d84/d93/d106/f12e x:0 0 0 2024-09-04T16:30:39.587 INFO:tasks.workunit.client.0.smithi170.stdout:5/944: mknod d4/db/c12f 0 2024-09-04T16:30:39.590 INFO:tasks.workunit.client.0.smithi170.stdout:4/880: dwrite d1/d6/d8/d20/d35/d3e/d60/daa/fed [4194304,4194304] 0 2024-09-04T16:30:39.595 INFO:tasks.workunit.client.0.smithi170.stdout:6/857: dwrite d0/d17/d31/dcc/fd0 [0,4194304] 0 2024-09-04T16:30:39.596 INFO:tasks.workunit.client.0.smithi170.stdout:4/881: rename d1/d6/d8/d20/d35/d54 to d1/d6/d8/d9d/d130 0 2024-09-04T16:30:39.597 INFO:tasks.workunit.client.0.smithi170.stdout:5/945: dread d4/d8/d1c/d26/df8/d124/d5b/f9c [0,4194304] 0 2024-09-04T16:30:39.600 INFO:tasks.workunit.client.0.smithi170.stdout:5/946: fsync d4/db/fe 0 2024-09-04T16:30:39.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:39 smithi170 ceph-mon[29272]: pgmap v39: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 70 MiB/s rd, 168 MiB/s wr, 448 op/s 2024-09-04T16:30:39.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:39 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:39.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:39 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi170.fbszap", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-04T16:30:39.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:39 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi170.fbszap", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-04T16:30:39.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:39 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-04T16:30:39.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:39 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:30:39.612 INFO:tasks.workunit.client.0.smithi170.stdout:4/882: truncate d1/d6/d8/d20/d95/d36/fcf 753353 0 2024-09-04T16:30:39.615 INFO:tasks.workunit.client.0.smithi170.stdout:6/858: dwrite d0/f5 [8388608,4194304] 0 2024-09-04T16:30:39.615 INFO:tasks.workunit.client.0.smithi170.stdout:5/947: dwrite d4/db/d51/d5e/d71/d84/d93/d106/f5d [0,4194304] 0 2024-09-04T16:30:39.618 INFO:tasks.workunit.client.0.smithi170.stdout:5/948: chown d4/d8/d1c/d26/d27/d48/f120 5396348 1 2024-09-04T16:30:39.624 INFO:tasks.workunit.client.0.smithi170.stdout:6/859: mknod d0/c125 0 2024-09-04T16:30:39.625 INFO:tasks.workunit.client.0.smithi170.stdout:4/883: dread d1/d6/d8/d20/d35/d3e/d4e/d51/f91 [0,4194304] 0 2024-09-04T16:30:39.637 INFO:tasks.workunit.client.0.smithi170.stdout:6/860: dwrite d0/d17/d5b/f7f [0,4194304] 0 2024-09-04T16:30:39.640 INFO:tasks.workunit.client.0.smithi170.stdout:6/861: mknod d0/df/d7e/dfa/de6/c126 0 2024-09-04T16:30:39.642 INFO:tasks.workunit.client.0.smithi170.stdout:4/884: dread d1/d6/d8/f44 [0,4194304] 0 2024-09-04T16:30:39.642 INFO:tasks.workunit.client.0.smithi170.stdout:6/862: rmdir d0/d17/d31/d64/df4/df8 39 2024-09-04T16:30:39.643 INFO:tasks.workunit.client.0.smithi170.stdout:4/885: write d1/d6/d8/fff [1008476,4255] 0 2024-09-04T16:30:39.647 INFO:tasks.workunit.client.0.smithi170.stdout:4/886: mkdir d1/d6/d8/d20/dc1/dd2/d131 0 2024-09-04T16:30:39.652 INFO:tasks.workunit.client.0.smithi170.stdout:4/887: symlink d1/d6/d8/d20/dc1/dd2/d131/l132 0 2024-09-04T16:30:39.654 INFO:tasks.workunit.client.0.smithi170.stdout:5/949: dwrite d4/db/f1d [0,4194304] 0 2024-09-04T16:30:39.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:39 smithi193 ceph-mon[36288]: pgmap v39: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 70 MiB/s rd, 168 MiB/s wr, 448 op/s 2024-09-04T16:30:39.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:39 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:39.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:39 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi170.fbszap", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-04T16:30:39.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:39 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi170.fbszap", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-04T16:30:39.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:39 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-04T16:30:39.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:39 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:30:39.656 INFO:tasks.workunit.client.0.smithi170.stdout:4/888: readlink d1/d6/d8/d20/d95/d36/la0 0 2024-09-04T16:30:39.660 INFO:tasks.workunit.client.0.smithi170.stdout:4/889: mknod d1/d6/d8/d20/d35/d3e/d4e/dcb/c133 0 2024-09-04T16:30:39.662 INFO:tasks.workunit.client.0.smithi170.stdout:4/890: rmdir d1/d6/d8/d20/dc1 39 2024-09-04T16:30:39.666 INFO:tasks.workunit.client.0.smithi170.stdout:6/863: write d0/df/d7e/dfa/d68/d2d/fa7 [921211,122048] 0 2024-09-04T16:30:39.669 INFO:tasks.workunit.client.0.smithi170.stdout:4/891: dwrite d1/d6/d8/d20/d35/d3e/d60/daa/fb7 [0,4194304] 0 2024-09-04T16:30:39.670 INFO:tasks.workunit.client.0.smithi170.stdout:6/864: mknod d0/d15/d56/d6c/da0/c127 0 2024-09-04T16:30:39.674 INFO:tasks.workunit.client.0.smithi170.stdout:4/892: mkdir d1/d6/d2b/db3/de8/d134 0 2024-09-04T16:30:39.675 INFO:tasks.workunit.client.0.smithi170.stdout:5/950: dwrite d4/d3a/d74/d8b/ff6 [0,4194304] 0 2024-09-04T16:30:39.683 INFO:tasks.workunit.client.0.smithi170.stdout:4/893: rename d1/d6/d8/d20/d35/d3e/f12a to d1/d6/d2b/db3/dd4/f135 0 2024-09-04T16:30:39.688 INFO:tasks.workunit.client.0.smithi170.stdout:6/865: dread d0/d17/fe2 [0,4194304] 0 2024-09-04T16:30:39.690 INFO:tasks.workunit.client.0.smithi170.stdout:4/894: unlink d1/d6/d8/d20/d35/d3e/d4e/dcb/f118 0 2024-09-04T16:30:39.694 INFO:tasks.workunit.client.0.smithi170.stdout:5/951: write d4/d8/d1c/d26/df8/d124/f87 [3851843,51604] 0 2024-09-04T16:30:39.696 INFO:tasks.workunit.client.0.smithi170.stdout:6/866: symlink d0/d17/d31/d64/d111/l128 0 2024-09-04T16:30:39.698 INFO:tasks.workunit.client.0.smithi170.stdout:4/895: mkdir d1/d6/d8/d20/d136 0 2024-09-04T16:30:39.699 INFO:tasks.workunit.client.0.smithi170.stdout:5/952: creat d4/db/d51/d5e/d71/d84/d93/d106/d94/db3/f130 x:0 0 0 2024-09-04T16:30:39.701 INFO:tasks.workunit.client.0.smithi170.stdout:6/867: creat d0/df/d7e/dfa/d68/d2d/d67/f129 x:0 0 0 2024-09-04T16:30:39.703 INFO:tasks.workunit.client.0.smithi170.stdout:5/953: read d4/d8/d1c/d26/d27/d88/da4/fba [16449,51009] 0 2024-09-04T16:30:39.706 INFO:tasks.workunit.client.0.smithi170.stdout:6/868: dread d0/df/d7e/dfa/d68/d2d/fa7 [0,4194304] 0 2024-09-04T16:30:39.709 INFO:tasks.workunit.client.0.smithi170.stdout:5/954: dread d4/db/d51/d5e/d71/d84/d93/d106/f5d [0,4194304] 0 2024-09-04T16:30:39.710 INFO:tasks.workunit.client.0.smithi170.stdout:5/955: dread - d4/d8/d1c/d29/f10e zero size 2024-09-04T16:30:39.712 INFO:tasks.workunit.client.0.smithi170.stdout:6/869: getdents d0/df/d7e 0 2024-09-04T16:30:39.717 INFO:tasks.workunit.client.0.smithi170.stdout:5/956: dwrite d4/db/d51/d5e/d71/d84/d93/d106/d94/db3/f130 [0,4194304] 0 2024-09-04T16:30:39.718 INFO:tasks.workunit.client.0.smithi170.stdout:6/870: dread d0/d17/d31/d64/d30/f84 [4194304,4194304] 0 2024-09-04T16:30:39.722 INFO:tasks.workunit.client.0.smithi170.stdout:5/957: symlink d4/db/d51/l131 0 2024-09-04T16:30:39.722 INFO:tasks.workunit.client.0.smithi170.stdout:4/896: dwrite d1/d6/d8/d20/d95/d36/d79/fab [0,4194304] 0 2024-09-04T16:30:39.723 INFO:tasks.workunit.client.0.smithi170.stdout:4/897: readlink d1/d6/d22/d93/ld0 0 2024-09-04T16:30:39.729 INFO:tasks.workunit.client.0.smithi170.stdout:6/871: truncate d0/d17/d31/d64/f119 1102282 0 2024-09-04T16:30:39.730 INFO:tasks.workunit.client.0.smithi170.stdout:4/898: creat d1/d6/d8/d20/d136/f137 x:0 0 0 2024-09-04T16:30:39.734 INFO:tasks.workunit.client.0.smithi170.stdout:5/958: getdents d4/d8/d1c/d26/df8/d124 0 2024-09-04T16:30:39.736 INFO:tasks.workunit.client.0.smithi170.stdout:4/899: write d1/d6/d2b/db3/dd4/f135 [842813,81632] 0 2024-09-04T16:30:39.739 INFO:tasks.workunit.client.0.smithi170.stdout:4/900: fdatasync d1/d6/d8/d20/dc1/ff2 0 2024-09-04T16:30:39.747 INFO:tasks.workunit.client.0.smithi170.stdout:5/959: write d4/db/d51/d5e/d71/d84/d93/d106/d3e/fc3 [662264,49940] 0 2024-09-04T16:30:39.748 INFO:tasks.workunit.client.0.smithi170.stdout:4/901: write d1/d6/d2b/d47/d78/fba [406230,71290] 0 2024-09-04T16:30:39.750 INFO:tasks.workunit.client.0.smithi170.stdout:6/872: dwrite d0/df/fa [0,4194304] 0 2024-09-04T16:30:39.755 INFO:tasks.workunit.client.0.smithi170.stdout:4/902: fsync d1/d6/d22/d93/de5/fe9 0 2024-09-04T16:30:39.756 INFO:tasks.workunit.client.0.smithi170.stdout:5/960: mknod d4/d8/d125/c132 0 2024-09-04T16:30:39.758 INFO:tasks.workunit.client.0.smithi170.stdout:6/873: dwrite d0/df/d7e/dfa/d68/d2d/d67/f129 [0,4194304] 0 2024-09-04T16:30:39.763 INFO:tasks.workunit.client.0.smithi170.stdout:5/961: unlink d4/l1b 0 2024-09-04T16:30:39.764 INFO:tasks.workunit.client.0.smithi170.stdout:4/903: rmdir d1/d6/d8/d20/d35/d3e/d60 39 2024-09-04T16:30:39.767 INFO:tasks.workunit.client.0.smithi170.stdout:6/874: rmdir d0/df/d7e/dfa 39 2024-09-04T16:30:39.768 INFO:tasks.workunit.client.0.smithi170.stdout:4/904: rmdir d1/d6/d8/d20/d35/d3e/d4e 39 2024-09-04T16:30:39.772 INFO:tasks.workunit.client.0.smithi170.stdout:5/962: rename d4/d8/d1c/d29 to d4/db/d51/d5e/d71/d84/d93/d106/d94/db3/dee/d133 0 2024-09-04T16:30:39.779 INFO:tasks.workunit.client.0.smithi170.stdout:4/905: rename d1/d6/d8/d20/d35/d3e/d4e/dcb/f100 to d1/d6/d8/d20/d95/d36/f138 0 2024-09-04T16:30:39.788 INFO:tasks.workunit.client.0.smithi170.stdout:4/906: write d1/d6/d8/d9d/d130/ffd [1085383,77994] 0 2024-09-04T16:30:39.790 INFO:tasks.workunit.client.0.smithi170.stdout:5/963: dwrite d4/d8/d1c/d41/f129 [0,4194304] 0 2024-09-04T16:30:39.795 INFO:tasks.workunit.client.0.smithi170.stdout:5/964: creat d4/d8/d1c/d41/f134 x:0 0 0 2024-09-04T16:30:39.796 INFO:tasks.workunit.client.0.smithi170.stdout:4/907: mkdir d1/d6/d8/d20/d35/d139 0 2024-09-04T16:30:39.799 INFO:tasks.workunit.client.0.smithi170.stdout:4/908: mkdir d1/d6/d8/d20/d35/d3e/d4e/d13a 0 2024-09-04T16:30:39.804 INFO:tasks.workunit.client.0.smithi170.stdout:4/909: unlink d1/d6/d8/d20/d35/d3e/d60/f106 0 2024-09-04T16:30:39.812 INFO:tasks.workunit.client.0.smithi170.stdout:5/965: dwrite d4/d8/d1c/d41/fec [0,4194304] 0 2024-09-04T16:30:39.813 INFO:tasks.workunit.client.0.smithi170.stdout:5/966: write d4/d3a/d74/d8b/ff6 [889549,30051] 0 2024-09-04T16:30:39.820 INFO:tasks.workunit.client.0.smithi170.stdout:5/967: dread d4/d8/d1c/d41/fec [0,4194304] 0 2024-09-04T16:30:39.821 INFO:tasks.workunit.client.0.smithi170.stdout:5/968: chown d4/db/fb4 6056097 1 2024-09-04T16:30:39.821 INFO:tasks.workunit.client.0.smithi170.stdout:5/969: readlink d4/d8/d1c/d41/l12a 0 2024-09-04T16:30:39.822 INFO:tasks.workunit.client.0.smithi170.stdout:4/910: creat d1/d6/d8/d20/d35/d3e/d4e/d13a/f13b x:0 0 0 2024-09-04T16:30:39.824 INFO:tasks.workunit.client.0.smithi170.stdout:5/970: fsync d4/d8/d1c/d26/d27/f3f 0 2024-09-04T16:30:39.826 INFO:tasks.workunit.client.0.smithi170.stdout:4/911: creat d1/d6/d22/d93/f13c x:0 0 0 2024-09-04T16:30:39.829 INFO:tasks.workunit.client.0.smithi170.stdout:5/971: fsync d4/d8/d1c/d26/fe6 0 2024-09-04T16:30:39.889 INFO:tasks.workunit.client.0.smithi170.stdout:4/912: fsync d1/d6/d2b/db3/de8/f116 0 2024-09-04T16:30:39.889 INFO:tasks.workunit.client.0.smithi170.stdout:5/972: chown d4/db/l119 62520 1 2024-09-04T16:30:39.904 INFO:tasks.workunit.client.0.smithi170.stdout:5/973: write d4/d8/d1c/d26/d27/fe8 [148617,21912] 0 2024-09-04T16:30:39.911 INFO:tasks.workunit.client.0.smithi170.stdout:5/974: dread d4/d8/d1c/d26/df8/d124/f101 [0,4194304] 0 2024-09-04T16:30:39.913 INFO:tasks.workunit.client.0.smithi170.stdout:5/975: truncate d4/d8/d1c/d26/df8/d124/d5b/f9c 1652991 0 2024-09-04T16:30:39.915 INFO:tasks.workunit.client.0.smithi170.stdout:5/976: mkdir d4/d8/d1c/d26/df8/d124/d102/d103/d135 0 2024-09-04T16:30:39.919 INFO:tasks.workunit.client.0.smithi170.stdout:5/977: symlink d4/d8/d1c/d26/d27/d48/ddf/l136 0 2024-09-04T16:30:39.921 INFO:tasks.workunit.client.0.smithi170.stdout:5/978: chown d4/d8/d1c/d26/df8/d124/d5b/lb1 3312566 1 2024-09-04T16:30:39.925 INFO:tasks.workunit.client.0.smithi170.stdout:5/979: link d4/d8/d1c/d26/d27/d48/d5a/c61 d4/d8/d1c/d26/d27/d88/da4/dc0/c137 0 2024-09-04T16:30:39.926 INFO:tasks.workunit.client.0.smithi170.stdout:5/980: write d4/d3a/d74/d8b/ff6 [3651390,63535] 0 2024-09-04T16:30:39.930 INFO:tasks.workunit.client.0.smithi170.stdout:5/981: unlink d4/db/d51/d5e/d71/d84/d93/d106/f12e 0 2024-09-04T16:30:39.932 INFO:tasks.workunit.client.0.smithi170.stdout:5/982: fdatasync d4/d8/d1c/d26/d27/f3f 0 2024-09-04T16:30:39.934 INFO:tasks.workunit.client.0.smithi170.stdout:5/983: symlink d4/d3a/d74/daf/l138 0 2024-09-04T16:30:39.937 INFO:tasks.workunit.client.0.smithi170.stdout:5/984: truncate d4/db/d37/f36 1647886 0 2024-09-04T16:30:40.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:40 smithi170 ceph-mon[29272]: Upgrade: Updating mgr.smithi170.fbszap 2024-09-04T16:30:40.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:40 smithi170 ceph-mon[29272]: Deploying daemon mgr.smithi170.fbszap on smithi170 2024-09-04T16:30:40.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:40 smithi193 ceph-mon[36288]: Upgrade: Updating mgr.smithi170.fbszap 2024-09-04T16:30:40.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:40 smithi193 ceph-mon[36288]: Deploying daemon mgr.smithi170.fbszap on smithi170 2024-09-04T16:30:40.754 INFO:tasks.workunit.client.0.smithi170.stdout:2/988: sync 2024-09-04T16:30:40.760 INFO:tasks.workunit.client.0.smithi170.stdout:2/989: write d3/d3c/dc1/d101/dc5/d124/d68/f9a [16444,37438] 0 2024-09-04T16:30:40.763 INFO:tasks.workunit.client.0.smithi170.stdout:2/990: rename d3/d3c/dc1/d101/c61 to d3/d3c/c144 0 2024-09-04T16:30:40.764 INFO:tasks.workunit.client.0.smithi170.stdout:2/991: fsync d3/d3c/dc1/d101/f3b 0 2024-09-04T16:30:40.768 INFO:tasks.workunit.client.0.smithi170.stdout:2/992: write d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/d97/f138 [177685,87974] 0 2024-09-04T16:30:40.770 INFO:tasks.workunit.client.0.smithi170.stdout:2/993: fdatasync d3/d3c/dc1/d101/d62/d6f/d110/dcf/dba/f127 0 2024-09-04T16:30:40.770 INFO:tasks.workunit.client.0.smithi170.stdout:2/994: chown d3/d3c/dc1 473 1 2024-09-04T16:30:40.775 INFO:tasks.workunit.client.0.smithi170.stdout:2/995: getdents d3/d3c/dc1/d101/d1c/d47/d83/d9f/dae/d97 0 2024-09-04T16:30:40.786 INFO:tasks.workunit.client.0.smithi170.stdout:2/996: dread d3/d3c/dc1/d101/d1c/f2a [0,4194304] 0 2024-09-04T16:30:40.786 INFO:tasks.workunit.client.0.smithi170.stdout:2/997: stat d3/d3c/d40/f41 0 2024-09-04T16:30:40.788 INFO:tasks.workunit.client.0.smithi170.stdout:2/998: mknod d3/d3c/dc1/d101/d1c/d47/d83/d122/c145 0 2024-09-04T16:30:40.790 INFO:tasks.workunit.client.0.smithi170.stdout:2/999: truncate d3/d4/f20 8823619 0 2024-09-04T16:30:40.802 INFO:tasks.workunit.client.0.smithi170.stdout:8/885: sync 2024-09-04T16:30:40.802 INFO:tasks.workunit.client.0.smithi170.stdout:9/950: sync 2024-09-04T16:30:40.802 INFO:tasks.workunit.client.0.smithi170.stdout:3/847: sync 2024-09-04T16:30:40.809 INFO:tasks.workunit.client.0.smithi170.stdout:8/886: truncate d6/d28/d20/d6e/d76/fce 423756 0 2024-09-04T16:30:40.810 INFO:tasks.workunit.client.0.smithi170.stdout:3/848: dwrite d13/d14/d17/f7b [0,4194304] 0 2024-09-04T16:30:40.812 INFO:tasks.workunit.client.0.smithi170.stdout:8/887: creat d6/d28/d20/d6e/dfc/f12e x:0 0 0 2024-09-04T16:30:40.820 INFO:tasks.workunit.client.0.smithi170.stdout:3/849: dwrite d13/d14/d21/f2b [4194304,4194304] 0 2024-09-04T16:30:40.821 INFO:tasks.workunit.client.0.smithi170.stdout:9/951: dread d2/d3d/d4d/d59/d11e/fdf [0,4194304] 0 2024-09-04T16:30:40.825 INFO:tasks.workunit.client.0.smithi170.stdout:3/850: unlink d13/d14/d1f/d87/c9c 0 2024-09-04T16:30:40.826 INFO:tasks.workunit.client.0.smithi170.stdout:3/851: fdatasync d13/f5f 0 2024-09-04T16:30:40.828 INFO:tasks.workunit.client.0.smithi170.stdout:9/952: dread d2/d3d/d4d/d59/d85/fb9 [0,4194304] 0 2024-09-04T16:30:40.829 INFO:tasks.workunit.client.0.smithi170.stdout:3/852: chown d13/d14/d1d/d2d/d58/ld5 1093 1 2024-09-04T16:30:40.830 INFO:tasks.workunit.client.0.smithi170.stdout:9/953: rmdir d2/d3d/d3f/d90 39 2024-09-04T16:30:40.832 INFO:tasks.workunit.client.0.smithi170.stdout:3/853: unlink d13/d14/d21/d4d/f6f 0 2024-09-04T16:30:40.832 INFO:tasks.workunit.client.0.smithi170.stdout:8/888: dread d6/d28/d16/d77/d93/d95/f113 [0,4194304] 0 2024-09-04T16:30:40.832 INFO:tasks.workunit.client.0.smithi170.stdout:9/954: chown d2/d3d/d27/d65/dcb/de0/dee/d7a/db6/fbf 57 1 2024-09-04T16:30:40.833 INFO:tasks.workunit.client.0.smithi170.stdout:8/889: chown d6/d28/d20/d5e/dfa 72165223 1 2024-09-04T16:30:40.833 INFO:tasks.workunit.client.0.smithi170.stdout:9/955: chown d2/d11/d23/d95/lce 11556 1 2024-09-04T16:30:40.834 INFO:tasks.workunit.client.0.smithi170.stdout:9/956: chown d2/d3d/d4d/f82 56 1 2024-09-04T16:30:40.835 INFO:tasks.workunit.client.0.smithi170.stdout:8/890: write d6/d28/d16/d24/d83/fba [393259,114385] 0 2024-09-04T16:30:40.837 INFO:tasks.workunit.client.0.smithi170.stdout:9/957: chown d2/d3d/d27/d65/dcb/de0/dee/f60 23 1 2024-09-04T16:30:40.838 INFO:tasks.workunit.client.0.smithi170.stdout:8/891: write d6/d28/d16/d52/d73/d5d/d11b/f11f [596608,89760] 0 2024-09-04T16:30:40.839 INFO:tasks.workunit.client.0.smithi170.stdout:9/958: creat d2/d3d/d6d/d79/db0/f12f x:0 0 0 2024-09-04T16:30:40.842 INFO:tasks.workunit.client.0.smithi170.stdout:9/959: mkdir d2/d3d/d4d/d59/d85/d130 0 2024-09-04T16:30:40.844 INFO:tasks.workunit.client.0.smithi170.stdout:9/960: write d2/d3d/d27/f64 [795204,62126] 0 2024-09-04T16:30:40.846 INFO:tasks.workunit.client.0.smithi170.stdout:9/961: unlink d2/d11/d23/l5d 0 2024-09-04T16:30:40.853 INFO:tasks.workunit.client.0.smithi170.stdout:9/962: rmdir d2/d11/d23/d95/d101 0 2024-09-04T16:30:40.859 INFO:tasks.workunit.client.0.smithi170.stdout:9/963: creat d2/d3d/d6d/d79/dd0/f131 x:0 0 0 2024-09-04T16:30:40.861 INFO:tasks.workunit.client.0.smithi170.stdout:9/964: read d2/d11/d23/dba/f12d [1216984,77089] 0 2024-09-04T16:30:40.862 INFO:tasks.workunit.client.0.smithi170.stdout:9/965: readlink d2/d3d/d4d/d59/l105 0 2024-09-04T16:30:40.869 INFO:tasks.workunit.client.0.smithi170.stdout:3/854: dwrite d13/f84 [0,4194304] 0 2024-09-04T16:30:40.871 INFO:tasks.workunit.client.0.smithi170.stdout:3/855: chown d13/d14/d21/d4d/d4e/c5e 3 1 2024-09-04T16:30:40.872 INFO:tasks.workunit.client.0.smithi170.stdout:8/892: dwrite d6/f57 [0,4194304] 0 2024-09-04T16:30:40.876 INFO:tasks.workunit.client.0.smithi170.stdout:8/893: chown d6/d28/d5f/d70/de8/lbc 1773000 1 2024-09-04T16:30:40.876 INFO:tasks.workunit.client.0.smithi170.stdout:3/856: symlink d13/d14/d21/d4d/d4e/l117 0 2024-09-04T16:30:40.876 INFO:tasks.workunit.client.0.smithi170.stdout:6/875: sync 2024-09-04T16:30:40.877 INFO:tasks.workunit.client.0.smithi170.stdout:5/985: sync 2024-09-04T16:30:40.877 INFO:tasks.workunit.client.0.smithi170.stdout:4/913: sync 2024-09-04T16:30:40.881 INFO:tasks.workunit.client.0.smithi170.stdout:9/966: dwrite d2/d11/d23/f55 [0,4194304] 0 2024-09-04T16:30:40.881 INFO:tasks.workunit.client.0.smithi170.stdout:4/914: readlink d1/d6/d8/d20/d35/l4a 0 2024-09-04T16:30:40.889 INFO:tasks.workunit.client.0.smithi170.stdout:5/986: dread d4/db/d51/d5e/d71/d84/d93/d106/f5d [0,4194304] 0 2024-09-04T16:30:40.891 INFO:tasks.workunit.client.0.smithi170.stdout:3/857: rename d13/d14/d17/f9f to d13/d14/d21/dd2/f118 0 2024-09-04T16:30:40.895 INFO:tasks.workunit.client.0.smithi170.stdout:9/967: dwrite d2/d3d/d27/d65/dcb/de0/dee/d7a/da5/f11c [0,4194304] 0 2024-09-04T16:30:40.896 INFO:tasks.workunit.client.0.smithi170.stdout:5/987: fdatasync d4/d3a/d74/f89 0 2024-09-04T16:30:40.899 INFO:tasks.workunit.client.0.smithi170.stdout:9/968: read d2/d11/d23/f55 [709324,2175] 0 2024-09-04T16:30:40.901 INFO:tasks.workunit.client.0.smithi170.stdout:4/915: truncate d1/d6/d8/d20/d95/d36/d9c/fda 1368600 0 2024-09-04T16:30:40.902 INFO:tasks.workunit.client.0.smithi170.stdout:8/894: dread d6/d28/d1a/f42 [4194304,4194304] 0 2024-09-04T16:30:40.904 INFO:tasks.workunit.client.0.smithi170.stdout:9/969: truncate d2/d3d/d27/d65/dcb/de0/dee/d7a/da5/feb 639938 0 2024-09-04T16:30:40.905 INFO:tasks.workunit.client.0.smithi170.stdout:9/970: write d2/d11/d8f/fe8 [291121,11108] 0 2024-09-04T16:30:40.909 INFO:tasks.workunit.client.0.smithi170.stdout:3/858: mknod d13/d14/d17/d1c/d102/c119 0 2024-09-04T16:30:40.916 INFO:tasks.workunit.client.0.smithi170.stdout:5/988: dwrite d4/d8/d1c/d26/d27/d48/ddf/f117 [0,4194304] 0 2024-09-04T16:30:40.917 INFO:tasks.workunit.client.0.smithi170.stdout:9/971: rename d2/d3d/f10 to d2/d3d/d27/d65/dcb/de0/dee/d7a/db6/f132 0 2024-09-04T16:30:40.920 INFO:tasks.workunit.client.0.smithi170.stdout:9/972: write d2/d3d/d27/d65/dcb/de0/dee/d7a/fe9 [974639,2391] 0 2024-09-04T16:30:40.926 INFO:tasks.workunit.client.0.smithi170.stdout:5/989: rename d4/d8/d1c/d26/df8/d124/lb6 to d4/d8/d1c/d26/d27/d48/d5a/l139 0 2024-09-04T16:30:40.927 INFO:tasks.workunit.client.0.smithi170.stdout:9/973: symlink d2/d11/d58/l133 0 2024-09-04T16:30:40.928 INFO:tasks.workunit.client.0.smithi170.stdout:5/990: readlink d4/d8/d1c/d26/df8/d124/d5b/lf9 0 2024-09-04T16:30:40.929 INFO:tasks.workunit.client.0.smithi170.stdout:5/991: write d4/db/f1d [2302433,100408] 0 2024-09-04T16:30:40.933 INFO:tasks.workunit.client.0.smithi170.stdout:3/859: write d13/d14/d1d/f61 [553641,32602] 0 2024-09-04T16:30:40.934 INFO:tasks.workunit.client.0.smithi170.stdout:8/895: getdents d6/d28/d16/d52/d73/d5d/d11b 0 2024-09-04T16:30:40.935 INFO:tasks.workunit.client.0.smithi170.stdout:9/974: dwrite d2/d3d/d6d/d79/db0/f12f [0,4194304] 0 2024-09-04T16:30:40.938 INFO:tasks.workunit.client.0.smithi170.stdout:3/860: chown d13/d14/d1f/d87/f105 52 1 2024-09-04T16:30:40.945 INFO:tasks.workunit.client.0.smithi170.stdout:5/992: link d4/f6 d4/db/d51/d5e/d71/d84/d93/d106/d39/dfa/f13a 0 2024-09-04T16:30:40.946 INFO:tasks.workunit.client.0.smithi170.stdout:5/993: chown d4/d8/d1c/d26/df8/d124/d102/f110 56005 1 2024-09-04T16:30:40.948 INFO:tasks.workunit.client.0.smithi170.stdout:8/896: truncate d6/d28/d5f/d70/d97/d99/fd9 667417 0 2024-09-04T16:30:40.952 INFO:tasks.workunit.client.0.smithi170.stdout:5/994: truncate d4/d8/d1c/d26/d27/d48/d7c/fcc 518628 0 2024-09-04T16:30:40.959 INFO:tasks.workunit.client.0.smithi170.stdout:3/861: truncate fb 2251638 0 2024-09-04T16:30:40.960 INFO:tasks.workunit.client.0.smithi170.stdout:9/975: creat d2/d3d/f134 x:0 0 0 2024-09-04T16:30:40.963 INFO:tasks.workunit.client.0.smithi170.stdout:8/897: mknod d6/d28/d16/d52/d73/d5d/d8b/dd1/c12f 0 2024-09-04T16:30:40.964 INFO:tasks.workunit.client.0.smithi170.stdout:8/898: chown d6/d28/d5f/d70/d97 1036 1 2024-09-04T16:30:40.964 INFO:tasks.workunit.client.0.smithi170.stdout:5/995: fsync d4/db/f8a 0 2024-09-04T16:30:40.970 INFO:tasks.workunit.client.0.smithi170.stdout:8/899: dwrite d6/f103 [0,4194304] 0 2024-09-04T16:30:40.971 INFO:tasks.workunit.client.0.smithi170.stdout:9/976: creat d2/d3d/d6d/d79/def/df0/f135 x:0 0 0 2024-09-04T16:30:40.977 INFO:tasks.workunit.client.0.smithi170.stdout:3/862: rename d13/d14/d1d/d71/db3/ccb to d13/d14/d1d/d71/db3/db6/d9e/c11a 0 2024-09-04T16:30:40.978 INFO:tasks.workunit.client.0.smithi170.stdout:3/863: write d13/d14/d1f/f72 [1273790,93481] 0 2024-09-04T16:30:40.981 INFO:tasks.workunit.client.0.smithi170.stdout:8/900: dread d6/d28/d16/d77/d93/fab [0,4194304] 0 2024-09-04T16:30:40.983 INFO:tasks.workunit.client.0.smithi170.stdout:5/996: rename d4/d8/c7b to d4/db/d51/d5e/d71/d84/d93/d106/d94/c13b 0 2024-09-04T16:30:40.983 INFO:tasks.workunit.client.0.smithi170.stdout:5/997: chown d4/d3a 74470989 1 2024-09-04T16:30:40.987 INFO:tasks.workunit.client.0.smithi170.stdout:9/977: creat d2/d3d/d3f/f136 x:0 0 0 2024-09-04T16:30:40.988 INFO:tasks.workunit.client.0.smithi170.stdout:8/901: dwrite d6/d28/d16/d24/d83/fba [0,4194304] 0 2024-09-04T16:30:40.989 INFO:tasks.workunit.client.0.smithi170.stdout:5/998: mkdir d4/d8/dea/d13c 0 2024-09-04T16:30:40.991 INFO:tasks.workunit.client.0.smithi170.stdout:5/999: stat d4/d3a/d74/d8b/db5/lc9 0 2024-09-04T16:30:40.993 INFO:tasks.workunit.client.0.smithi170.stdout:8/902: rename d6/d28/d5f/d85/ca5 to d6/d28/d20/d6e/c130 0 2024-09-04T16:30:40.996 INFO:tasks.workunit.client.0.smithi170.stdout:8/903: creat d6/d28/d16/d77/d8c/f131 x:0 0 0 2024-09-04T16:30:41.003 INFO:tasks.workunit.client.0.smithi170.stdout:8/904: dwrite d6/d28/d20/d5e/f3e [0,4194304] 0 2024-09-04T16:30:41.005 INFO:tasks.workunit.client.0.smithi170.stdout:8/905: chown d6/d28/d20/d5e/dfa 2451001 1 2024-09-04T16:30:41.006 INFO:tasks.workunit.client.0.smithi170.stdout:3/864: dwrite d13/d14/d21/dd2/f118 [0,4194304] 0 2024-09-04T16:30:41.006 INFO:tasks.workunit.client.0.smithi170.stdout:8/906: write d6/d28/d5f/f110 [1105525,119860] 0 2024-09-04T16:30:41.008 INFO:tasks.workunit.client.0.smithi170.stdout:8/907: dread - d6/d28/d5f/d70/d97/d99/fc6 zero size 2024-09-04T16:30:41.011 INFO:tasks.workunit.client.0.smithi170.stdout:3/865: creat d13/d14/d1d/d71/db3/db6/d107/f11b x:0 0 0 2024-09-04T16:30:41.015 INFO:tasks.workunit.client.0.smithi170.stdout:9/978: dread d2/d3d/f20 [0,4194304] 0 2024-09-04T16:30:41.017 INFO:tasks.workunit.client.0.smithi170.stdout:3/866: rename d13/d14/d1d/da4/fac to d13/d14/d1f/def/f11c 0 2024-09-04T16:30:41.025 INFO:tasks.workunit.client.0.smithi170.stdout:9/979: dwrite d2/d3d/d27/d2b/daf/fe6 [0,4194304] 0 2024-09-04T16:30:41.026 INFO:tasks.workunit.client.0.smithi170.stdout:9/980: write d2/d3d/d6d/fd1 [4782951,8102] 0 2024-09-04T16:30:41.029 INFO:tasks.workunit.client.0.smithi170.stdout:3/867: dwrite d13/d14/d1d/d2d/fff [0,4194304] 0 2024-09-04T16:30:41.031 INFO:tasks.workunit.client.0.smithi170.stdout:9/981: stat d2/d3d/d3f/d90/ff9 0 2024-09-04T16:30:41.039 INFO:tasks.workunit.client.0.smithi170.stdout:8/908: dwrite d6/d28/d16/d77/d93/d95/f113 [0,4194304] 0 2024-09-04T16:30:41.041 INFO:tasks.workunit.client.0.smithi170.stdout:3/868: symlink d13/d14/d1d/l11d 0 2024-09-04T16:30:41.046 INFO:tasks.workunit.client.0.smithi170.stdout:8/909: mknod d6/d28/d16/d52/d73/d5d/d11b/c132 0 2024-09-04T16:30:41.046 INFO:tasks.workunit.client.0.smithi170.stdout:3/869: mkdir d13/d14/d1d/d71/db3/db6/d6e/d11e 0 2024-09-04T16:30:41.055 INFO:tasks.workunit.client.0.smithi170.stdout:3/870: dwrite d13/d14/d21/f2b [0,4194304] 0 2024-09-04T16:30:41.059 INFO:tasks.workunit.client.0.smithi170.stdout:8/910: dwrite d6/d28/d16/d52/d73/d71/f127 [0,4194304] 0 2024-09-04T16:30:41.065 INFO:tasks.workunit.client.0.smithi170.stdout:9/982: dread d2/d3d/d27/f64 [0,4194304] 0 2024-09-04T16:30:41.070 INFO:tasks.workunit.client.0.smithi170.stdout:8/911: mknod d6/d28/d1a/c133 0 2024-09-04T16:30:41.073 INFO:tasks.workunit.client.0.smithi170.stdout:9/983: creat d2/d11/d23/d95/d119/f137 x:0 0 0 2024-09-04T16:30:41.075 INFO:tasks.workunit.client.0.smithi170.stdout:3/871: write d13/d14/d21/d4d/d4e/d50/fb0 [198583,128853] 0 2024-09-04T16:30:41.076 INFO:tasks.workunit.client.0.smithi170.stdout:9/984: mkdir d2/d3d/d35/d10b/d138 0 2024-09-04T16:30:41.077 INFO:tasks.workunit.client.0.smithi170.stdout:3/872: chown d13/d14/d21/d4d/d4e/d88/dbf/f8f 293 1 2024-09-04T16:30:41.077 INFO:tasks.workunit.client.0.smithi170.stdout:8/912: creat d6/d28/d16/d77/d93/d95/dac/d11e/f134 x:0 0 0 2024-09-04T16:30:41.078 INFO:tasks.workunit.client.0.smithi170.stdout:9/985: rmdir d2/d11/d8f/df1 39 2024-09-04T16:30:41.080 INFO:tasks.workunit.client.0.smithi170.stdout:3/873: creat d13/d14/d1f/def/f11f x:0 0 0 2024-09-04T16:30:41.082 INFO:tasks.workunit.client.0.smithi170.stdout:8/913: rename d6/f103 to d6/d28/d16/d52/d73/d5d/d8b/f135 0 2024-09-04T16:30:41.085 INFO:tasks.workunit.client.0.smithi170.stdout:9/986: rename d2/d3d/d6d/d79/db0/f12f to d2/d3d/d6d/d79/def/f139 0 2024-09-04T16:30:41.086 INFO:tasks.workunit.client.0.smithi170.stdout:3/874: dwrite d13/d14/d1f/def/f10d [0,4194304] 0 2024-09-04T16:30:41.089 INFO:tasks.workunit.client.0.smithi170.stdout:3/875: rename d13/d14/d1d/d71/db3 to d13/d14/d1d/d71/db3/db6/db2/d120 22 2024-09-04T16:30:41.089 INFO:tasks.workunit.client.0.smithi170.stdout:3/876: stat d13/d14/d21/d4c/f99 0 2024-09-04T16:30:41.090 INFO:tasks.workunit.client.0.smithi170.stdout:8/914: truncate d6/d28/d16/d52/d73/d5d/d8b/f96 4490605 0 2024-09-04T16:30:41.090 INFO:tasks.workunit.client.0.smithi170.stdout:3/877: chown d13/d14/d8b/de3 678836674 1 2024-09-04T16:30:41.093 INFO:tasks.workunit.client.0.smithi170.stdout:9/987: unlink d2/d11/d23/d95/fbe 0 2024-09-04T16:30:41.093 INFO:tasks.workunit.client.0.smithi170.stdout:9/988: chown d2/d3d/d3f/d90/fde 23 1 2024-09-04T16:30:41.097 INFO:tasks.workunit.client.0.smithi170.stdout:3/878: creat d13/d14/d1d/da4/f121 x:0 0 0 2024-09-04T16:30:41.099 INFO:tasks.workunit.client.0.smithi170.stdout:8/915: dread d6/d28/d5f/d70/d97/fb6 [0,4194304] 0 2024-09-04T16:30:41.100 INFO:tasks.workunit.client.0.smithi170.stdout:3/879: rmdir d13/d14/d1f/d7a/dc8 39 2024-09-04T16:30:41.101 INFO:tasks.workunit.client.0.smithi170.stdout:9/989: dwrite d2/d3d/d6d/d79/def/f127 [0,4194304] 0 2024-09-04T16:30:41.101 INFO:tasks.workunit.client.0.smithi170.stdout:8/916: fdatasync d6/d28/d16/d52/d73/d71/f104 0 2024-09-04T16:30:41.106 INFO:tasks.workunit.client.0.smithi170.stdout:3/880: unlink d13/d14/d17/fbb 0 2024-09-04T16:30:41.106 INFO:tasks.workunit.client.0.smithi170.stdout:3/881: chown d13/d14/d1d/c31 108313 1 2024-09-04T16:30:41.107 INFO:tasks.workunit.client.0.smithi170.stdout:9/990: mknod d2/d3d/d4d/d59/d11e/df3/c13a 0 2024-09-04T16:30:41.110 INFO:tasks.workunit.client.0.smithi170.stdout:3/882: unlink d13/d14/d1d/l45 0 2024-09-04T16:30:41.113 INFO:tasks.workunit.client.0.smithi170.stdout:9/991: mkdir d2/d3d/d4d/d59/d11e/df3/d107/d13b 0 2024-09-04T16:30:41.115 INFO:tasks.workunit.client.0.smithi170.stdout:3/883: creat d13/d14/d21/d4d/d4e/d88/dc7/f122 x:0 0 0 2024-09-04T16:30:41.117 INFO:tasks.workunit.client.0.smithi170.stdout:8/917: rename d6/d28/d16/d52/d73/d5d/dd6/f10f to d6/d28/d16/d52/d73/d5d/f136 0 2024-09-04T16:30:41.124 INFO:tasks.workunit.client.0.smithi170.stdout:8/918: truncate d6/d28/d20/d6e/da4/f106 718471 0 2024-09-04T16:30:41.127 INFO:tasks.workunit.client.0.smithi170.stdout:8/919: read d6/d28/d20/d5e/fd7 [8718997,117785] 0 2024-09-04T16:30:41.170 INFO:tasks.workunit.client.0.smithi170.stdout:9/992: creat d2/d3d/d4d/d59/d85/d130/f13c x:0 0 0 2024-09-04T16:30:41.171 INFO:tasks.workunit.client.0.smithi170.stdout:3/884: truncate fb 2166742 0 2024-09-04T16:30:41.175 INFO:tasks.workunit.client.0.smithi170.stdout:9/993: mknod d2/d11/d58/dd4/c13d 0 2024-09-04T16:30:41.179 INFO:tasks.workunit.client.0.smithi170.stdout:9/994: read d2/d3d/d27/d65/dcb/de0/dee/d7a/db6/f132 [138246,122147] 0 2024-09-04T16:30:41.184 INFO:tasks.workunit.client.0.smithi170.stdout:9/995: link d2/d32/l111 d2/d32/l13e 0 2024-09-04T16:30:41.187 INFO:tasks.workunit.client.0.smithi170.stdout:8/920: dread d6/d28/d1a/d38/f9d [0,4194304] 0 2024-09-04T16:30:41.188 INFO:tasks.workunit.client.0.smithi170.stdout:9/996: truncate d2/d3d/d27/d65/dcb/de0/dee/d7a/db6/f132 685684 0 2024-09-04T16:30:41.194 INFO:tasks.workunit.client.0.smithi170.stdout:8/921: dwrite d6/d28/d16/d24/d83/fba [0,4194304] 0 2024-09-04T16:30:41.198 INFO:tasks.workunit.client.0.smithi170.stdout:8/922: truncate d6/d28/d16/d77/d9f/feb 5096279 0 2024-09-04T16:30:41.205 INFO:tasks.workunit.client.0.smithi170.stdout:8/923: dwrite d6/d28/d1a/d80/fb9 [0,4194304] 0 2024-09-04T16:30:41.210 INFO:tasks.workunit.client.0.smithi170.stdout:8/924: mknod d6/d28/d16/d77/d93/d95/db8/df9/c137 0 2024-09-04T16:30:41.213 INFO:tasks.workunit.client.0.smithi170.stdout:3/885: write d13/d14/d21/d4c/f99 [1823419,11336] 0 2024-09-04T16:30:41.217 INFO:tasks.workunit.client.0.smithi170.stdout:3/886: creat d13/d14/d21/d4c/f123 x:0 0 0 2024-09-04T16:30:41.219 INFO:tasks.workunit.client.0.smithi170.stdout:8/925: getdents d6/d28/d1a 0 2024-09-04T16:30:41.222 INFO:tasks.workunit.client.0.smithi170.stdout:3/887: symlink d13/d14/d21/d4d/d4e/d88/dc7/l124 0 2024-09-04T16:30:41.223 INFO:tasks.workunit.client.0.smithi170.stdout:9/997: dwrite d2/d3d/d27/d65/dcb/de0/dee/f60 [0,4194304] 0 2024-09-04T16:30:41.225 INFO:tasks.workunit.client.0.smithi170.stdout:8/926: unlink d6/d28/d20/c7c 0 2024-09-04T16:30:41.228 INFO:tasks.workunit.client.0.smithi170.stdout:3/888: fsync d13/d14/d1d/d2d/f34 0 2024-09-04T16:30:41.229 INFO:tasks.workunit.client.0.smithi170.stdout:9/998: unlink d2/d3d/d35/ffc 0 2024-09-04T16:30:41.230 INFO:tasks.workunit.client.0.smithi170.stdout:9/999: chown d2/d3d/d6d/fb4 721125 1 2024-09-04T16:30:41.232 INFO:tasks.workunit.client.0.smithi170.stdout:8/927: mknod d6/d28/d5f/d85/df7/c138 0 2024-09-04T16:30:41.236 INFO:tasks.workunit.client.0.smithi170.stdout:3/889: mkdir d13/d125 0 2024-09-04T16:30:41.237 INFO:tasks.workunit.client.0.smithi170.stdout:8/928: symlink d6/d28/d16/d52/d73/d5d/d11b/d125/l139 0 2024-09-04T16:30:41.240 INFO:tasks.workunit.client.0.smithi170.stdout:3/890: mkdir d13/d14/d1d/d71/db3/d126 0 2024-09-04T16:30:41.242 INFO:tasks.workunit.client.0.smithi170.stdout:8/929: symlink d6/d26/de2/l13a 0 2024-09-04T16:30:41.249 INFO:tasks.workunit.client.0.smithi170.stdout:8/930: getdents d6/d28/d20/d6e/dfc 0 2024-09-04T16:30:41.253 INFO:tasks.workunit.client.0.smithi170.stdout:8/931: rename d6/d28/d20/dc5/fcb to d6/d28/d16/d77/d93/d95/dac/f13b 0 2024-09-04T16:30:41.255 INFO:tasks.workunit.client.0.smithi170.stdout:8/932: dread - d6/d28/fae zero size 2024-09-04T16:30:41.256 INFO:tasks.workunit.client.0.smithi170.stdout:8/933: read - d6/d28/d16/d52/d73/d5d/f136 zero size 2024-09-04T16:30:41.259 INFO:tasks.workunit.client.0.smithi170.stdout:3/891: dwrite d13/d14/d1d/d71/db3/db6/f53 [4194304,4194304] 0 2024-09-04T16:30:41.261 INFO:tasks.workunit.client.0.smithi170.stdout:3/892: dread - d13/d14/d21/d4c/fea zero size 2024-09-04T16:30:41.277 INFO:tasks.workunit.client.0.smithi170.stdout:3/893: dread d13/d14/d1f/d7a/dc8/fd6 [0,4194304] 0 2024-09-04T16:30:41.281 INFO:tasks.workunit.client.0.smithi170.stdout:3/894: write d13/d14/d21/d4c/f77 [662918,111177] 0 2024-09-04T16:30:41.284 INFO:tasks.workunit.client.0.smithi170.stdout:3/895: read d13/d14/d21/d4d/d4e/ff7 [3270404,48771] 0 2024-09-04T16:30:41.288 INFO:tasks.workunit.client.0.smithi170.stdout:3/896: rename d13/d14/d17/d1c/cd3 to d13/d14/d1d/d71/de6/c127 0 2024-09-04T16:30:41.290 INFO:tasks.workunit.client.0.smithi170.stdout:3/897: creat d13/d14/d17/d1c/d98/f128 x:0 0 0 2024-09-04T16:30:41.303 INFO:tasks.workunit.client.0.smithi170.stdout:3/898: dwrite d13/f113 [0,4194304] 0 2024-09-04T16:30:41.310 INFO:tasks.workunit.client.0.smithi170.stdout:3/899: getdents d13/d14/d17/df0/df1 0 2024-09-04T16:30:41.312 INFO:tasks.workunit.client.0.smithi170.stdout:3/900: symlink d13/d14/d17/df0/df1/l129 0 2024-09-04T16:30:41.314 INFO:tasks.workunit.client.0.smithi170.stdout:3/901: creat d13/d14/d1f/def/f12a x:0 0 0 2024-09-04T16:30:41.316 INFO:tasks.workunit.client.0.smithi170.stdout:3/902: fdatasync d13/f19 0 2024-09-04T16:30:41.320 INFO:tasks.workunit.client.0.smithi170.stdout:3/903: rename d13/d14/d8b/fc5 to d13/d14/d21/d4d/d4e/d88/dbf/d89/f12b 0 2024-09-04T16:30:41.328 INFO:tasks.workunit.client.0.smithi170.stdout:3/904: truncate d13/d14/d21/fd7 214465 0 2024-09-04T16:30:41.339 INFO:tasks.workunit.client.0.smithi170.stdout:3/905: dwrite d13/d14/d17/f8a [0,4194304] 0 2024-09-04T16:30:41.341 INFO:tasks.workunit.client.0.smithi170.stdout:3/906: write d13/d14/d1d/d71/db3/db6/f53 [3536316,32795] 0 2024-09-04T16:30:41.344 INFO:tasks.workunit.client.0.smithi170.stdout:3/907: rmdir d13/d14/d1d/d71/db3/db6/d107 39 2024-09-04T16:30:41.347 INFO:tasks.workunit.client.0.smithi170.stdout:3/908: truncate d13/d14/d21/f36 856176 0 2024-09-04T16:30:41.359 INFO:tasks.workunit.client.0.smithi170.stdout:3/909: truncate d13/d14/d1d/da4/ff8 1717342 0 2024-09-04T16:30:41.369 INFO:tasks.workunit.client.0.smithi170.stdout:3/910: write d13/d14/d17/f64 [911719,112345] 0 2024-09-04T16:30:41.372 INFO:tasks.workunit.client.0.smithi170.stdout:3/911: mknod d13/d14/d21/d4d/d4e/d50/c12c 0 2024-09-04T16:30:41.372 INFO:tasks.workunit.client.0.smithi170.stdout:3/912: readlink d13/lbc 0 2024-09-04T16:30:41.375 INFO:tasks.workunit.client.0.smithi170.stdout:3/913: rename d13/d14/d1d/d71/db3/db6/db2/l103 to d13/d14/d17/d1c/d98/l12d 0 2024-09-04T16:30:41.380 INFO:tasks.workunit.client.0.smithi170.stdout:3/914: dwrite d13/d14/d21/d4c/f77 [0,4194304] 0 2024-09-04T16:30:41.382 INFO:tasks.workunit.client.0.smithi170.stdout:3/915: mknod d13/c12e 0 2024-09-04T16:30:41.385 INFO:tasks.workunit.client.0.smithi170.stdout:3/916: mkdir d13/d14/d1d/d71/db3/db6/d6e/d12f 0 2024-09-04T16:30:41.385 INFO:tasks.workunit.client.0.smithi170.stdout:3/917: chown d13/d14/d1d/d71 81012395 1 2024-09-04T16:30:41.389 INFO:tasks.workunit.client.0.smithi170.stdout:3/918: getdents d13/d14/d1f/d7a 0 2024-09-04T16:30:41.392 INFO:tasks.workunit.client.0.smithi170.stdout:3/919: mkdir d13/d14/d21/d130 0 2024-09-04T16:30:41.393 INFO:tasks.workunit.client.0.smithi170.stdout:3/920: chown d13/d14/d1d/d71/db3/db6/ff9 462311236 1 2024-09-04T16:30:41.399 INFO:tasks.workunit.client.0.smithi170.stdout:3/921: dwrite d13/d14/d1d/d71/db3/db6/d9e/f5a [4194304,4194304] 0 2024-09-04T16:30:41.401 INFO:tasks.workunit.client.0.smithi170.stdout:3/922: truncate d13/d14/d1f/d87/f105 275577 0 2024-09-04T16:30:41.402 INFO:tasks.workunit.client.0.smithi170.stdout:3/923: truncate d13/d14/d21/dd2/f115 879626 0 2024-09-04T16:30:41.404 INFO:tasks.workunit.client.0.smithi170.stdout:3/924: truncate d13/d14/d21/d4c/f123 580731 0 2024-09-04T16:30:41.415 INFO:tasks.workunit.client.0.smithi170.stdout:3/925: dwrite d13/d14/d1d/d71/de6/fee [0,4194304] 0 2024-09-04T16:30:41.419 INFO:tasks.workunit.client.0.smithi170.stdout:3/926: creat d13/d14/d21/dec/f131 x:0 0 0 2024-09-04T16:30:41.421 INFO:tasks.workunit.client.0.smithi170.stdout:3/927: stat d13/d14/d21/c6a 0 2024-09-04T16:30:41.422 INFO:tasks.workunit.client.0.smithi170.stdout:3/928: read - d13/d14/d1d/d71/db3/db6/d9e/f94 zero size 2024-09-04T16:30:41.422 INFO:tasks.workunit.client.0.smithi170.stdout:3/929: readlink d13/d14/d1d/l11d 0 2024-09-04T16:30:41.427 INFO:tasks.workunit.client.0.smithi170.stdout:3/930: unlink d13/d14/d1f/d7a/dc8/fd6 0 2024-09-04T16:30:41.433 INFO:tasks.workunit.client.0.smithi170.stdout:3/931: dwrite d13/d14/d1d/da4/da8/f104 [0,4194304] 0 2024-09-04T16:30:41.444 INFO:tasks.workunit.client.0.smithi170.stdout:3/932: dwrite d13/d14/d21/d4d/d4e/fc0 [4194304,4194304] 0 2024-09-04T16:30:41.449 INFO:tasks.workunit.client.0.smithi170.stdout:3/933: mknod d13/d14/d21/d4d/d4e/d88/dc7/c132 0 2024-09-04T16:30:41.452 INFO:tasks.workunit.client.0.smithi170.stdout:3/934: creat d13/d125/f133 x:0 0 0 2024-09-04T16:30:41.454 INFO:tasks.workunit.client.0.smithi170.stdout:3/935: creat d13/d14/d1d/d71/db3/db6/d9e/f134 x:0 0 0 2024-09-04T16:30:41.455 INFO:tasks.workunit.client.0.smithi170.stdout:3/936: write d13/d14/d1f/d87/f93 [5153785,23140] 0 2024-09-04T16:30:41.456 INFO:tasks.workunit.client.0.smithi170.stdout:3/937: fsync d13/d14/d1f/def/f11f 0 2024-09-04T16:30:41.461 INFO:tasks.workunit.client.0.smithi170.stdout:3/938: creat d13/d14/d1d/d71/db3/db6/d107/f135 x:0 0 0 2024-09-04T16:30:41.462 INFO:tasks.workunit.client.0.smithi170.stdout:3/939: dread - d13/d14/d1d/d71/db3/db6/d107/f11b zero size 2024-09-04T16:30:41.467 INFO:tasks.workunit.client.0.smithi170.stdout:3/940: getdents d13/d14/d17/df0/df1 0 2024-09-04T16:30:41.471 INFO:tasks.workunit.client.0.smithi170.stdout:3/941: dread d13/d14/d21/d4d/d4e/fc0 [4194304,4194304] 0 2024-09-04T16:30:41.485 INFO:tasks.workunit.client.0.smithi170.stdout:3/942: dread d13/d14/d1f/d7a/f9a [0,4194304] 0 2024-09-04T16:30:41.500 INFO:tasks.workunit.client.0.smithi170.stdout:3/943: dwrite d13/d14/d21/f36 [0,4194304] 0 2024-09-04T16:30:41.501 INFO:tasks.workunit.client.0.smithi170.stdout:3/944: write d13/f5f [3063476,53502] 0 2024-09-04T16:30:41.505 INFO:tasks.workunit.client.0.smithi170.stdout:3/945: mkdir d13/d14/d21/dec/d136 0 2024-09-04T16:30:41.518 INFO:tasks.workunit.client.0.smithi170.stdout:3/946: dread d13/d14/d17/f42 [0,4194304] 0 2024-09-04T16:30:41.520 INFO:tasks.workunit.client.0.smithi170.stdout:3/947: mknod d13/d14/d21/d130/c137 0 2024-09-04T16:30:41.521 INFO:tasks.workunit.client.0.smithi170.stdout:3/948: dread - d13/d14/d17/d1c/d98/f128 zero size 2024-09-04T16:30:41.521 INFO:tasks.workunit.client.0.smithi170.stdout:3/949: readlink d13/d14/l4a 0 2024-09-04T16:30:41.521 INFO:tasks.workunit.client.0.smithi170.stdout:3/950: chown d13/d14/f4b 118 1 2024-09-04T16:30:41.523 INFO:tasks.workunit.client.0.smithi170.stdout:3/951: dread - d13/d14/d21/d4d/d4e/d88/fe0 zero size 2024-09-04T16:30:41.527 INFO:tasks.workunit.client.0.smithi170.stdout:3/952: link d13/d14/d1d/da4/f121 d13/d14/d17/df0/df1/f138 0 2024-09-04T16:30:41.529 INFO:tasks.workunit.client.0.smithi170.stdout:3/953: dread - d13/d14/d21/d4d/d4e/d88/dbf/d89/f12b zero size 2024-09-04T16:30:41.531 INFO:tasks.workunit.client.0.smithi170.stdout:3/954: symlink d13/d14/d1d/d71/db3/db6/db2/l139 0 2024-09-04T16:30:41.544 INFO:tasks.workunit.client.0.smithi170.stdout:3/955: dwrite d13/d14/d1d/f23 [4194304,4194304] 0 2024-09-04T16:30:41.545 INFO:tasks.workunit.client.0.smithi170.stdout:6/876: sync 2024-09-04T16:30:41.545 INFO:tasks.workunit.client.0.smithi170.stdout:4/916: sync 2024-09-04T16:30:41.549 INFO:tasks.workunit.client.0.smithi170.stdout:6/877: unlink d0/d15/d56/d6d/f109 0 2024-09-04T16:30:41.552 INFO:tasks.workunit.client.0.smithi170.stdout:3/956: dwrite d13/d14/d1d/d2d/fff [0,4194304] 0 2024-09-04T16:30:41.553 INFO:tasks.workunit.client.0.smithi170.stdout:3/957: chown d13/d14/d17/d1c/ld0 350302305 1 2024-09-04T16:30:41.554 INFO:tasks.workunit.client.0.smithi170.stdout:6/878: mkdir d0/d17/d31/d12a 0 2024-09-04T16:30:41.554 INFO:tasks.workunit.client.0.smithi170.stdout:3/958: fsync d13/d14/d21/d4d/d4e/d88/dc7/f122 0 2024-09-04T16:30:41.559 INFO:tasks.workunit.client.0.smithi170.stdout:3/959: mkdir d13/d14/d21/dec/d13a 0 2024-09-04T16:30:41.561 INFO:tasks.workunit.client.0.smithi170.stdout:6/879: creat d0/f12b x:0 0 0 2024-09-04T16:30:41.571 INFO:tasks.workunit.client.0.smithi170.stdout:6/880: write d0/d15/d56/d6c/d98/fb9 [957096,125778] 0 2024-09-04T16:30:41.573 INFO:tasks.workunit.client.0.smithi170.stdout:6/881: read d0/d15/d56/d6c/db8/ff0 [789921,49743] 0 2024-09-04T16:30:41.577 INFO:tasks.workunit.client.0.smithi170.stdout:3/960: dwrite d13/d14/d1d/ffa [0,4194304] 0 2024-09-04T16:30:41.577 INFO:tasks.workunit.client.0.smithi170.stdout:3/961: readlink d13/d14/d1f/l8e 0 2024-09-04T16:30:41.578 INFO:tasks.workunit.client.0.smithi170.stdout:6/882: mknod d0/d15/d56/d6d/c12c 0 2024-09-04T16:30:41.581 INFO:tasks.workunit.client.0.smithi170.stdout:3/962: fsync d13/d14/d1d/d71/db3/dbd/fdc 0 2024-09-04T16:30:41.584 INFO:tasks.workunit.client.0.smithi170.stdout:6/883: rename d0/d17/fda to d0/d15/d56/d6d/dac/f12d 0 2024-09-04T16:30:41.585 INFO:tasks.workunit.client.0.smithi170.stdout:6/884: dread - d0/dbf/f103 zero size 2024-09-04T16:30:41.587 INFO:tasks.workunit.client.0.smithi170.stdout:3/963: creat d13/d14/d21/dec/f13b x:0 0 0 2024-09-04T16:30:41.590 INFO:tasks.workunit.client.0.smithi170.stdout:3/964: mkdir d13/d14/d17/d1c/d102/d13c 0 2024-09-04T16:30:41.591 INFO:tasks.workunit.client.0.smithi170.stdout:3/965: write d13/d14/d21/d4d/d4e/d88/dbf/f8f [4483265,33] 0 2024-09-04T16:30:41.592 INFO:tasks.workunit.client.0.smithi170.stdout:3/966: readlink d13/d14/d17/df0/df1/l129 0 2024-09-04T16:30:41.593 INFO:tasks.workunit.client.0.smithi170.stdout:3/967: fsync d13/d14/d1f/def/f10d 0 2024-09-04T16:30:41.593 INFO:tasks.workunit.client.0.smithi170.stdout:6/885: rename d0/df/d7e/dfa/d68/d2d/fa7 to d0/d17/d39/d99/f12e 0 2024-09-04T16:30:41.594 INFO:tasks.workunit.client.0.smithi170.stdout:6/886: stat d0/df/d7e/dfa/d68/f5d 0 2024-09-04T16:30:41.595 INFO:tasks.workunit.client.0.smithi170.stdout:3/968: write d13/d14/d1f/def/f12a [401948,84922] 0 2024-09-04T16:30:41.596 INFO:tasks.workunit.client.0.smithi170.stdout:3/969: readlink d13/d14/d1d/d71/db3/db6/d9e/l59 0 2024-09-04T16:30:41.601 INFO:tasks.workunit.client.0.smithi170.stdout:3/970: read d13/d14/d21/fd7 [163144,87270] 0 2024-09-04T16:30:41.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:41 smithi170 ceph-mon[29272]: pgmap v40: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 36 MiB/s rd, 86 MiB/s wr, 259 op/s 2024-09-04T16:30:41.604 INFO:tasks.workunit.client.0.smithi170.stdout:3/971: creat d13/d14/d21/dec/d136/f13d x:0 0 0 2024-09-04T16:30:41.607 INFO:tasks.workunit.client.0.smithi170.stdout:3/972: dread d13/d14/d17/f64 [4194304,4194304] 0 2024-09-04T16:30:41.611 INFO:tasks.workunit.client.0.smithi170.stdout:6/887: dwrite d0/d17/d39/d99/fad [0,4194304] 0 2024-09-04T16:30:41.617 INFO:tasks.workunit.client.0.smithi170.stdout:3/973: truncate d13/d14/d21/d4d/d4e/fc0 1686277 0 2024-09-04T16:30:41.617 INFO:tasks.workunit.client.0.smithi170.stdout:6/888: creat d0/d17/f12f x:0 0 0 2024-09-04T16:30:41.619 INFO:tasks.workunit.client.0.smithi170.stdout:3/974: mknod d13/d14/d21/d4d/d4e/d88/dbf/c13e 0 2024-09-04T16:30:41.624 INFO:tasks.workunit.client.0.smithi170.stdout:3/975: rename d13/d14/d1d/d71/db3/db6/ff9 to d13/d14/d1d/f13f 0 2024-09-04T16:30:41.642 INFO:tasks.workunit.client.0.smithi170.stdout:6/889: dwrite d0/d17/d31/d64/f119 [0,4194304] 0 2024-09-04T16:30:41.647 INFO:tasks.workunit.client.0.smithi170.stdout:3/976: dwrite d13/d14/f48 [0,4194304] 0 2024-09-04T16:30:41.648 INFO:tasks.workunit.client.0.smithi170.stdout:6/890: rename d0/d17/f18 to d0/d15/d56/d6c/d98/f130 0 2024-09-04T16:30:41.651 INFO:tasks.workunit.client.0.smithi170.stdout:6/891: dread d0/d17/d31/f11a [0,4194304] 0 2024-09-04T16:30:41.653 INFO:tasks.workunit.client.0.smithi170.stdout:6/892: chown d0/d17/d39/d99/cee 26 1 2024-09-04T16:30:41.655 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:41 smithi193 ceph-mon[36288]: pgmap v40: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 36 MiB/s rd, 86 MiB/s wr, 259 op/s 2024-09-04T16:30:41.660 INFO:tasks.workunit.client.0.smithi170.stdout:6/893: dwrite d0/df/d7e/dfa/d68/d2d/f8c [0,4194304] 0 2024-09-04T16:30:41.662 INFO:tasks.workunit.client.0.smithi170.stdout:3/977: rmdir d13/d14/d1d/d71/db3/db6/d6e/d12f 0 2024-09-04T16:30:41.665 INFO:tasks.workunit.client.0.smithi170.stdout:6/894: dread d0/df/fa [0,4194304] 0 2024-09-04T16:30:41.665 INFO:tasks.workunit.client.0.smithi170.stdout:3/978: chown d13/d14/d17/ceb 1 1 2024-09-04T16:30:41.666 INFO:tasks.workunit.client.0.smithi170.stdout:3/979: truncate d13/d14/d1f/d109/f112 4719200 0 2024-09-04T16:30:41.672 INFO:tasks.workunit.client.0.smithi170.stdout:6/895: dwrite d0/d15/d56/fe3 [0,4194304] 0 2024-09-04T16:30:41.675 INFO:tasks.workunit.client.0.smithi170.stdout:6/896: rmdir d0/df/d7e/dfa/d68/d2d/d67 39 2024-09-04T16:30:41.676 INFO:tasks.workunit.client.0.smithi170.stdout:6/897: chown d0/df/d7e/dfa/d68/c101 3567 1 2024-09-04T16:30:41.681 INFO:tasks.workunit.client.0.smithi170.stdout:6/898: mkdir d0/df/d131 0 2024-09-04T16:30:41.955 INFO:tasks.workunit.client.0.smithi170.stdout:8/934: sync 2024-09-04T16:30:41.956 INFO:tasks.workunit.client.0.smithi170.stdout:4/917: sync 2024-09-04T16:30:41.959 INFO:tasks.workunit.client.0.smithi170.stdout:4/918: mknod d1/d6/d2b/db3/c13d 0 2024-09-04T16:30:41.960 INFO:tasks.workunit.client.0.smithi170.stdout:8/935: mkdir d6/d28/d20/d6e/da4/d13c 0 2024-09-04T16:30:41.963 INFO:tasks.workunit.client.0.smithi170.stdout:8/936: truncate d6/d28/d5f/d70/d97/fdc 3893394 0 2024-09-04T16:30:41.964 INFO:tasks.workunit.client.0.smithi170.stdout:8/937: write d6/d28/d5f/d70/d97/f10a [127923,12682] 0 2024-09-04T16:30:41.969 INFO:tasks.workunit.client.0.smithi170.stdout:8/938: write d6/d28/d20/d5e/fd8 [4387429,20006] 0 2024-09-04T16:30:41.978 INFO:tasks.workunit.client.0.smithi170.stdout:4/919: truncate d1/d6/d2b/d47/d78/f90 592616 0 2024-09-04T16:30:41.980 INFO:tasks.workunit.client.0.smithi170.stdout:4/920: write d1/d6/d8/d20/d35/d3e/d60/fc3 [1642883,23893] 0 2024-09-04T16:30:41.984 INFO:tasks.workunit.client.0.smithi170.stdout:8/939: dwrite d6/d28/d16/d77/d9f/feb [0,4194304] 0 2024-09-04T16:30:41.991 INFO:tasks.workunit.client.0.smithi170.stdout:8/940: mkdir d6/d28/d16/d77/d93/dc0/d13d 0 2024-09-04T16:30:41.992 INFO:tasks.workunit.client.0.smithi170.stdout:8/941: dread - d6/d28/d16/d77/d8c/f108 zero size 2024-09-04T16:30:41.995 INFO:tasks.workunit.client.0.smithi170.stdout:8/942: write d6/f41 [4941201,120047] 0 2024-09-04T16:30:42.001 INFO:tasks.workunit.client.0.smithi170.stdout:4/921: dwrite d1/d6/d8/d20/dc1/dd2/d107/f109 [0,4194304] 0 2024-09-04T16:30:42.004 INFO:tasks.workunit.client.0.smithi170.stdout:4/922: mknod d1/d6/d8/d20/d95/d36/d79/c13e 0 2024-09-04T16:30:42.006 INFO:tasks.workunit.client.0.smithi170.stdout:8/943: write d6/d28/d1a/f36 [4202378,92086] 0 2024-09-04T16:30:42.008 INFO:tasks.workunit.client.0.smithi170.stdout:4/923: mknod d1/d6/d11e/c13f 0 2024-09-04T16:30:42.009 INFO:tasks.workunit.client.0.smithi170.stdout:4/924: stat d1/d6/d8/d20/d95/fac 0 2024-09-04T16:30:42.010 INFO:tasks.workunit.client.0.smithi170.stdout:8/944: creat d6/d28/d16/d52/d73/d5d/d8b/dd1/f13e x:0 0 0 2024-09-04T16:30:42.011 INFO:tasks.workunit.client.0.smithi170.stdout:8/945: chown d6/d28/d1a 0 1 2024-09-04T16:30:42.011 INFO:tasks.workunit.client.0.smithi170.stdout:4/925: creat d1/d6/d8/d20/d95/d36/d9c/f140 x:0 0 0 2024-09-04T16:30:42.013 INFO:tasks.workunit.client.0.smithi170.stdout:4/926: write d1/d6/d8/d20/dc1/dd2/d107/f109 [5183774,98025] 0 2024-09-04T16:30:42.014 INFO:tasks.workunit.client.0.smithi170.stdout:8/946: creat d6/d28/d20/d6e/da4/f13f x:0 0 0 2024-09-04T16:30:42.019 INFO:tasks.workunit.client.0.smithi170.stdout:8/947: dread d6/d28/d5f/d70/d97/d99/f12c [0,4194304] 0 2024-09-04T16:30:42.020 INFO:tasks.workunit.client.0.smithi170.stdout:8/948: chown d6/d28/d16/d77/d93/d95/dac 29 1 2024-09-04T16:30:42.022 INFO:tasks.workunit.client.0.smithi170.stdout:8/949: creat d6/d28/d5f/d70/de8/f140 x:0 0 0 2024-09-04T16:30:42.027 INFO:tasks.workunit.client.0.smithi170.stdout:4/927: dwrite d1/d6/d8/d20/d35/d3e/d60/daa/fed [0,4194304] 0 2024-09-04T16:30:42.029 INFO:tasks.workunit.client.0.smithi170.stdout:8/950: dwrite d6/d28/d16/d52/d73/d5d/d11b/f11f [0,4194304] 0 2024-09-04T16:30:42.030 INFO:tasks.workunit.client.0.smithi170.stdout:4/928: write d1/d6/d11e/dbf/fe1 [295863,37379] 0 2024-09-04T16:30:42.036 INFO:tasks.workunit.client.0.smithi170.stdout:4/929: fsync d1/d6/d8/d20/f88 0 2024-09-04T16:30:42.036 INFO:tasks.workunit.client.0.smithi170.stdout:8/951: fsync d6/d28/d5f/d70/d97/fb6 0 2024-09-04T16:30:42.038 INFO:tasks.workunit.client.0.smithi170.stdout:4/930: write d1/d6/d8/d9d/d130/fc7 [4480907,28225] 0 2024-09-04T16:30:42.044 INFO:tasks.workunit.client.0.smithi170.stdout:8/952: dread d6/d28/d5f/d70/d97/d99/fd9 [0,4194304] 0 2024-09-04T16:30:42.044 INFO:tasks.workunit.client.0.smithi170.stdout:8/953: chown d6/d26/l6b 541281 1 2024-09-04T16:30:42.046 INFO:tasks.workunit.client.0.smithi170.stdout:8/954: read - d6/d28/d5f/f86 zero size 2024-09-04T16:30:42.046 INFO:tasks.workunit.client.0.smithi170.stdout:6/899: sync 2024-09-04T16:30:42.046 INFO:tasks.workunit.client.0.smithi170.stdout:3/980: sync 2024-09-04T16:30:42.048 INFO:tasks.workunit.client.0.smithi170.stdout:4/931: rename d1/d6/d22/d93/ldf to d1/d6/d8/d20/l141 0 2024-09-04T16:30:42.051 INFO:tasks.workunit.client.0.smithi170.stdout:8/955: symlink d6/d28/d20/l141 0 2024-09-04T16:30:42.051 INFO:tasks.workunit.client.0.smithi170.stdout:3/981: symlink d13/d14/d21/dec/l140 0 2024-09-04T16:30:42.051 INFO:tasks.workunit.client.0.smithi170.stdout:8/956: stat d6/d28/d16/d24/l4c 0 2024-09-04T16:30:42.052 INFO:tasks.workunit.client.0.smithi170.stdout:6/900: mkdir d0/df/d132 0 2024-09-04T16:30:42.058 INFO:tasks.workunit.client.0.smithi170.stdout:4/932: dread d1/d6/d8/d20/d35/d3e/d4e/f126 [0,4194304] 0 2024-09-04T16:30:42.060 INFO:tasks.workunit.client.0.smithi170.stdout:8/957: dwrite d6/d28/d16/d77/d93/dc0/f120 [0,4194304] 0 2024-09-04T16:30:42.070 INFO:tasks.workunit.client.0.smithi170.stdout:4/933: creat d1/d6/d8/d20/d95/d36/d79/f142 x:0 0 0 2024-09-04T16:30:42.077 INFO:tasks.workunit.client.0.smithi170.stdout:6/901: write d0/df/f3a [5356295,111935] 0 2024-09-04T16:30:42.083 INFO:tasks.workunit.client.0.smithi170.stdout:3/982: dwrite d13/d14/d1d/d71/db3/dbd/fc4 [0,4194304] 0 2024-09-04T16:30:42.084 INFO:tasks.workunit.client.0.smithi170.stdout:3/983: chown d13/d14/d21/d130/c137 828151 1 2024-09-04T16:30:42.086 INFO:tasks.workunit.client.0.smithi170.stdout:4/934: getdents d1/d6/d8/d20/d136 0 2024-09-04T16:30:42.086 INFO:tasks.workunit.client.0.smithi170.stdout:6/902: creat d0/df/d7e/dfa/d68/d2d/f133 x:0 0 0 2024-09-04T16:30:42.089 INFO:tasks.workunit.client.0.smithi170.stdout:4/935: write d1/d6/d11e/dbf/fe1 [346268,62148] 0 2024-09-04T16:30:42.092 INFO:tasks.workunit.client.0.smithi170.stdout:8/958: dwrite d6/d28/d5f/d70/d97/d99/fd9 [0,4194304] 0 2024-09-04T16:30:42.093 INFO:tasks.workunit.client.0.smithi170.stdout:6/903: creat d0/d17/d5b/f134 x:0 0 0 2024-09-04T16:30:42.098 INFO:tasks.workunit.client.0.smithi170.stdout:3/984: creat d13/d14/d1d/d71/db3/db6/f141 x:0 0 0 2024-09-04T16:30:42.099 INFO:tasks.workunit.client.0.smithi170.stdout:8/959: symlink d6/l142 0 2024-09-04T16:30:42.102 INFO:tasks.workunit.client.0.smithi170.stdout:6/904: creat d0/d17/d31/f135 x:0 0 0 2024-09-04T16:30:42.103 INFO:tasks.workunit.client.0.smithi170.stdout:8/960: unlink d6/d28/d20/d5e/df4/cff 0 2024-09-04T16:30:42.110 INFO:tasks.workunit.client.0.smithi170.stdout:6/905: dwrite d0/d9f/ffd [0,4194304] 0 2024-09-04T16:30:42.111 INFO:tasks.workunit.client.0.smithi170.stdout:8/961: getdents d6/d28/d16/d52/d73/d5d 0 2024-09-04T16:30:42.117 INFO:tasks.workunit.client.0.smithi170.stdout:8/962: mkdir d6/d28/d16/d77/d93/d95/db8/df1/d143 0 2024-09-04T16:30:42.128 INFO:tasks.workunit.client.0.smithi170.stdout:6/906: dwrite d0/df/d7e/dfa/d68/d2d/d67/f129 [0,4194304] 0 2024-09-04T16:30:42.129 INFO:tasks.workunit.client.0.smithi170.stdout:8/963: creat d6/d28/d16/d77/d9f/f144 x:0 0 0 2024-09-04T16:30:42.131 INFO:tasks.workunit.client.0.smithi170.stdout:4/936: dread d1/d6/d8/d20/d35/d3e/d43/f5f [0,4194304] 0 2024-09-04T16:30:42.187 INFO:tasks.workunit.client.0.smithi170.stdout:8/964: fdatasync d6/d28/d1a/d38/f9d 0 2024-09-04T16:30:42.197 INFO:tasks.workunit.client.0.smithi170.stdout:8/965: unlink d6/d28/d16/d52/d73/cb5 0 2024-09-04T16:30:42.197 INFO:tasks.workunit.client.0.smithi170.stdout:4/937: dwrite d1/d6/d8/d20/d95/d36/f28 [0,4194304] 0 2024-09-04T16:30:42.199 INFO:tasks.workunit.client.0.smithi170.stdout:8/966: write d6/d28/d16/d24/d83/fba [217535,68302] 0 2024-09-04T16:30:42.202 INFO:tasks.workunit.client.0.smithi170.stdout:6/907: rename d0/d17/d31/d64/f8f to d0/d17/d31/d64/df4/df8/d11c/f136 0 2024-09-04T16:30:42.204 INFO:tasks.workunit.client.0.smithi170.stdout:6/908: dread - d0/df/d1b/fa5 zero size 2024-09-04T16:30:42.217 INFO:tasks.workunit.client.0.smithi170.stdout:8/967: mkdir d6/d28/d1a/d80/d145 0 2024-09-04T16:30:42.218 INFO:tasks.workunit.client.0.smithi170.stdout:6/909: dread d0/d15/d56/f8b [0,4194304] 0 2024-09-04T16:30:42.219 INFO:tasks.workunit.client.0.smithi170.stdout:8/968: creat d6/d28/d20/d6e/f146 x:0 0 0 2024-09-04T16:30:42.222 INFO:tasks.workunit.client.0.smithi170.stdout:8/969: symlink d6/d28/d16/d77/d93/d95/db8/df9/l147 0 2024-09-04T16:30:42.224 INFO:tasks.workunit.client.0.smithi170.stdout:8/970: dread - d6/d28/d16/d77/d93/d95/dac/d11e/f134 zero size 2024-09-04T16:30:42.227 INFO:tasks.workunit.client.0.smithi170.stdout:8/971: stat d6/d28/d20/d6e/d76/fce 0 2024-09-04T16:30:42.232 INFO:tasks.workunit.client.0.smithi170.stdout:6/910: dread d0/df/d1f/d9c/fb3 [0,4194304] 0 2024-09-04T16:30:42.235 INFO:tasks.workunit.client.0.smithi170.stdout:8/972: dwrite d6/d28/d16/df2/ffb [0,4194304] 0 2024-09-04T16:30:42.239 INFO:tasks.workunit.client.0.smithi170.stdout:6/911: getdents d0/d15/d56/d6c/da0/d106 0 2024-09-04T16:30:42.241 INFO:tasks.workunit.client.0.smithi170.stdout:8/973: rmdir d6/d28/d16 39 2024-09-04T16:30:42.244 INFO:tasks.workunit.client.0.smithi170.stdout:6/912: unlink d0/d17/d31/dcc/fd0 0 2024-09-04T16:30:42.245 INFO:tasks.workunit.client.0.smithi170.stdout:6/913: chown d0/d17/d31/d64/d111/f89 31700587 1 2024-09-04T16:30:42.247 INFO:tasks.workunit.client.0.smithi170.stdout:8/974: dread d6/d28/d1a/d80/fb9 [0,4194304] 0 2024-09-04T16:30:42.251 INFO:tasks.workunit.client.0.smithi170.stdout:6/914: rename d0/df/d1b to d0/d17/d31/d64/d30/d137 0 2024-09-04T16:30:42.254 INFO:tasks.workunit.client.0.smithi170.stdout:6/915: symlink d0/df/d132/l138 0 2024-09-04T16:30:42.255 INFO:tasks.workunit.client.0.smithi170.stdout:6/916: dread - d0/d15/d56/d6d/f7a zero size 2024-09-04T16:30:42.257 INFO:tasks.workunit.client.0.smithi170.stdout:8/975: dread d6/d28/d16/d77/d9f/feb [0,4194304] 0 2024-09-04T16:30:42.258 INFO:tasks.workunit.client.0.smithi170.stdout:8/976: chown d6/d28/d16/d52/d73/fcf 3373 1 2024-09-04T16:30:42.267 INFO:tasks.workunit.client.0.smithi170.stdout:8/977: dwrite d6/d28/d16/d77/d9f/f144 [0,4194304] 0 2024-09-04T16:30:42.274 INFO:tasks.workunit.client.0.smithi170.stdout:6/917: dread d0/df/d7e/dfa/d68/f41 [0,4194304] 0 2024-09-04T16:30:42.279 INFO:tasks.workunit.client.0.smithi170.stdout:6/918: readlink d0/d17/dbd/lf3 0 2024-09-04T16:30:42.280 INFO:tasks.workunit.client.0.smithi170.stdout:4/938: dwrite d1/f74 [0,4194304] 0 2024-09-04T16:30:42.280 INFO:tasks.workunit.client.0.smithi170.stdout:8/978: dwrite d6/d28/d16/d24/d46/f74 [0,4194304] 0 2024-09-04T16:30:42.282 INFO:tasks.workunit.client.0.smithi170.stdout:6/919: chown d0/d15/f45 455122559 1 2024-09-04T16:30:42.283 INFO:tasks.workunit.client.0.smithi170.stdout:8/979: write d6/d28/d5f/d70/d97/fef [621848,104099] 0 2024-09-04T16:30:42.283 INFO:tasks.workunit.client.0.smithi170.stdout:8/980: readlink d6/d28/d20/le5 0 2024-09-04T16:30:42.285 INFO:tasks.workunit.client.0.smithi170.stdout:4/939: creat d1/d6/d11e/dbf/dd6/f143 x:0 0 0 2024-09-04T16:30:42.291 INFO:tasks.workunit.client.0.smithi170.stdout:8/981: dread d6/d28/d16/d52/d73/d71/f127 [0,4194304] 0 2024-09-04T16:30:42.295 INFO:tasks.workunit.client.0.smithi170.stdout:4/940: dread - d1/d6/d8/d20/dae/dd5/f108 zero size 2024-09-04T16:30:42.300 INFO:tasks.workunit.client.0.smithi170.stdout:8/982: symlink d6/d28/d16/d77/d93/dc0/d13d/l148 0 2024-09-04T16:30:42.301 INFO:tasks.workunit.client.0.smithi170.stdout:4/941: truncate d1/d6/d8/d20/d35/d3e/d4e/f45 4403351 0 2024-09-04T16:30:42.302 INFO:tasks.workunit.client.0.smithi170.stdout:8/983: write d6/d28/d16/d52/d73/d5d/fad [920440,128859] 0 2024-09-04T16:30:42.307 INFO:tasks.workunit.client.0.smithi170.stdout:6/920: truncate d0/d15/d56/d6d/f74 951922 0 2024-09-04T16:30:42.309 INFO:tasks.workunit.client.0.smithi170.stdout:6/921: mkdir d0/d17/d39/d99/d139 0 2024-09-04T16:30:42.312 INFO:tasks.workunit.client.0.smithi170.stdout:4/942: write d1/d6/d2b/d47/d78/f7f [5098164,29697] 0 2024-09-04T16:30:42.317 INFO:tasks.workunit.client.0.smithi170.stdout:4/943: unlink d1/d6/d8/c16 0 2024-09-04T16:30:42.318 INFO:tasks.workunit.client.0.smithi170.stdout:8/984: dwrite d6/d28/d5f/d70/d97/d99/fc6 [0,4194304] 0 2024-09-04T16:30:42.319 INFO:tasks.workunit.client.0.smithi170.stdout:6/922: write d0/df/f78 [929596,47153] 0 2024-09-04T16:30:42.325 INFO:tasks.workunit.client.0.smithi170.stdout:8/985: dread d6/d28/d16/df2/ffb [0,4194304] 0 2024-09-04T16:30:42.325 INFO:tasks.workunit.client.0.smithi170.stdout:4/944: creat d1/d6/d8/d20/d35/d3e/d60/f144 x:0 0 0 2024-09-04T16:30:42.327 INFO:tasks.workunit.client.0.smithi170.stdout:8/986: chown d6/d28/d16/d52/d73/d5d/f136 59299 1 2024-09-04T16:30:42.331 INFO:tasks.workunit.client.0.smithi170.stdout:8/987: rmdir d6/d28/d16/d24 39 2024-09-04T16:30:42.336 INFO:tasks.workunit.client.0.smithi170.stdout:6/923: getdents d0/d15/d56 0 2024-09-04T16:30:42.338 INFO:tasks.workunit.client.0.smithi170.stdout:8/988: write d6/f7a [1921530,51937] 0 2024-09-04T16:30:42.342 INFO:tasks.workunit.client.0.smithi170.stdout:4/945: dwrite d1/d6/d8/d9d/feb [0,4194304] 0 2024-09-04T16:30:42.343 INFO:tasks.workunit.client.0.smithi170.stdout:4/946: fdatasync d1/d6/d11e/dbf/fe1 0 2024-09-04T16:30:42.343 INFO:tasks.workunit.client.0.smithi170.stdout:6/924: write d0/d17/d31/f11a [1158036,104536] 0 2024-09-04T16:30:42.352 INFO:tasks.workunit.client.0.smithi170.stdout:4/947: unlink d1/d6/d2b/d47/l53 0 2024-09-04T16:30:42.353 INFO:tasks.workunit.client.0.smithi170.stdout:8/989: dread d6/d28/d16/d77/d93/d95/dac/fca [0,4194304] 0 2024-09-04T16:30:42.354 INFO:tasks.workunit.client.0.smithi170.stdout:6/925: write d0/d17/d31/d64/d30/f84 [4758603,78892] 0 2024-09-04T16:30:42.356 INFO:tasks.workunit.client.0.smithi170.stdout:4/948: symlink d1/d6/d8/d20/dc1/dd2/d131/l145 0 2024-09-04T16:30:42.357 INFO:tasks.workunit.client.0.smithi170.stdout:8/990: fsync d6/d28/d16/d77/d93/fab 0 2024-09-04T16:30:42.357 INFO:tasks.workunit.client.0.smithi170.stdout:4/949: fdatasync d1/d6/d8/d20/d95/f11d 0 2024-09-04T16:30:42.358 INFO:tasks.workunit.client.0.smithi170.stdout:6/926: rename d0/df/d7e/dfa/d68/d2d/ldc to d0/df/d7e/dfa/d68/d2d/d67/d73/l13a 0 2024-09-04T16:30:42.361 INFO:tasks.workunit.client.0.smithi170.stdout:6/927: dread d0/df/d7e/dfa/d68/d2d/d67/fc8 [0,4194304] 0 2024-09-04T16:30:42.362 INFO:tasks.workunit.client.0.smithi170.stdout:6/928: dread - d0/d15/d56/d6d/fb6 zero size 2024-09-04T16:30:42.363 INFO:tasks.workunit.client.0.smithi170.stdout:4/950: truncate d1/d6/d2b/d47/d78/da7/f10f 254261 0 2024-09-04T16:30:42.369 INFO:tasks.workunit.client.0.smithi170.stdout:6/929: rename d0/f14 to d0/d17/d39/d99/f13b 0 2024-09-04T16:30:42.371 INFO:tasks.workunit.client.0.smithi170.stdout:6/930: truncate d0/d17/d31/d64/d111/fdd 737332 0 2024-09-04T16:30:42.372 INFO:tasks.workunit.client.0.smithi170.stdout:6/931: fsync d0/d17/d31/d64/d30/f91 0 2024-09-04T16:30:42.373 INFO:tasks.workunit.client.0.smithi170.stdout:8/991: dread d6/d28/d20/d5e/f35 [0,4194304] 0 2024-09-04T16:30:42.374 INFO:tasks.workunit.client.0.smithi170.stdout:4/951: write d1/d6/d22/f62 [4489730,108648] 0 2024-09-04T16:30:42.376 INFO:tasks.workunit.client.0.smithi170.stdout:6/932: mkdir d0/df/d7e/dfa/d68/d2d/d67/d13c 0 2024-09-04T16:30:42.378 INFO:tasks.workunit.client.0.smithi170.stdout:4/952: truncate d1/d6/d11e/ff1 996193 0 2024-09-04T16:30:42.378 INFO:tasks.workunit.client.0.smithi170.stdout:6/933: symlink d0/d17/d31/d64/df4/df8/d11c/l13d 0 2024-09-04T16:30:42.380 INFO:tasks.workunit.client.0.smithi170.stdout:6/934: chown d0/df/d7e/dfa/d68/fb0 243 1 2024-09-04T16:30:42.380 INFO:tasks.workunit.client.0.smithi170.stdout:6/935: chown d0/d15/d56/d6c/da0/c123 19362899 1 2024-09-04T16:30:42.381 INFO:tasks.workunit.client.0.smithi170.stdout:6/936: fsync d0/d17/dbd/fc4 0 2024-09-04T16:30:42.383 INFO:tasks.workunit.client.0.smithi170.stdout:4/953: mkdir d1/d6/d8/d20/dae/dd5/d146 0 2024-09-04T16:30:42.383 INFO:tasks.workunit.client.0.smithi170.stdout:4/954: chown d1/d6/d8/c30 963 1 2024-09-04T16:30:42.388 INFO:tasks.workunit.client.0.smithi170.stdout:6/937: read d0/d15/d56/d6c/d98/f130 [2883729,56249] 0 2024-09-04T16:30:42.388 INFO:tasks.workunit.client.0.smithi170.stdout:4/955: unlink d1/d6/d2b/db3/c13d 0 2024-09-04T16:30:42.389 INFO:tasks.workunit.client.0.smithi170.stdout:8/992: dwrite d6/d28/d16/d52/d73/d5d/f89 [0,4194304] 0 2024-09-04T16:30:42.390 INFO:tasks.workunit.client.0.smithi170.stdout:4/956: chown d1/d6/d8/d20/dc1/ff2 439776927 1 2024-09-04T16:30:42.394 INFO:tasks.workunit.client.0.smithi170.stdout:6/938: rename d0/d17/d5b to d0/d15/d56/d6d/dac/d13e 0 2024-09-04T16:30:42.396 INFO:tasks.workunit.client.0.smithi170.stdout:8/993: unlink d6/d28/d20/d5e/fd8 0 2024-09-04T16:30:42.398 INFO:tasks.workunit.client.0.smithi170.stdout:8/994: dread d6/d28/d5f/d70/d97/d99/f12c [0,4194304] 0 2024-09-04T16:30:42.400 INFO:tasks.workunit.client.0.smithi170.stdout:4/957: mknod d1/d6/d2b/d47/c147 0 2024-09-04T16:30:42.406 INFO:tasks.workunit.client.0.smithi170.stdout:4/958: creat d1/d6/d8/d20/d35/d3e/d60/daa/f148 x:0 0 0 2024-09-04T16:30:42.410 INFO:tasks.workunit.client.0.smithi170.stdout:6/939: dread d0/d15/f45 [4194304,4194304] 0 2024-09-04T16:30:42.412 INFO:tasks.workunit.client.0.smithi170.stdout:6/940: chown d0/d15/d56/l112 352 1 2024-09-04T16:30:42.413 INFO:tasks.workunit.client.0.smithi170.stdout:4/959: dwrite d1/d6/d8/d20/d35/d3e/d60/daa/f148 [0,4194304] 0 2024-09-04T16:30:42.417 INFO:tasks.workunit.client.0.smithi170.stdout:4/960: mkdir d1/d6/d2b/db3/d149 0 2024-09-04T16:30:42.417 INFO:tasks.workunit.client.0.smithi170.stdout:3/985: sync 2024-09-04T16:30:42.424 INFO:tasks.workunit.client.0.smithi170.stdout:3/986: mknod d13/d14/d17/d1c/d102/d13c/c142 0 2024-09-04T16:30:42.430 INFO:tasks.workunit.client.0.smithi170.stdout:3/987: dread d13/d14/d21/d4c/f123 [0,4194304] 0 2024-09-04T16:30:42.430 INFO:tasks.workunit.client.0.smithi170.stdout:8/995: dwrite d6/d28/d16/d77/d93/d95/dac/f13b [4194304,4194304] 0 2024-09-04T16:30:42.432 INFO:tasks.workunit.client.0.smithi170.stdout:6/941: dwrite d0/d17/d31/d64/d111/fb5 [0,4194304] 0 2024-09-04T16:30:42.435 INFO:tasks.workunit.client.0.smithi170.stdout:4/961: dwrite d1/fc [0,4194304] 0 2024-09-04T16:30:42.443 INFO:tasks.workunit.client.0.smithi170.stdout:4/962: creat d1/d6/d8/d20/dc1/dd2/d107/f14a x:0 0 0 2024-09-04T16:30:42.446 INFO:tasks.workunit.client.0.smithi170.stdout:8/996: rename d6/d28/d16/d77/d93/d95/db8/df9/l147 to d6/d28/d5f/d70/l149 0 2024-09-04T16:30:42.449 INFO:tasks.workunit.client.0.smithi170.stdout:8/997: read - d6/d28/d20/d6e/f146 zero size 2024-09-04T16:30:42.449 INFO:tasks.workunit.client.0.smithi170.stdout:3/988: dwrite d13/d14/d1d/f28 [4194304,4194304] 0 2024-09-04T16:30:42.450 INFO:tasks.workunit.client.0.smithi170.stdout:6/942: rename d0/d17/d39/f72 to d0/d17/d31/d64/df4/df8/d11c/f13f 0 2024-09-04T16:30:42.452 INFO:tasks.workunit.client.0.smithi170.stdout:8/998: symlink d6/d28/d16/d52/d73/d71/l14a 0 2024-09-04T16:30:42.455 INFO:tasks.workunit.client.0.smithi170.stdout:3/989: creat d13/d14/d1d/d71/db3/dbd/f143 x:0 0 0 2024-09-04T16:30:42.456 INFO:tasks.workunit.client.0.smithi170.stdout:6/943: rmdir d0/df/d7e/dfa/de6 39 2024-09-04T16:30:42.458 INFO:tasks.workunit.client.0.smithi170.stdout:3/990: creat d13/d14/d17/ded/f144 x:0 0 0 2024-09-04T16:30:42.461 INFO:tasks.workunit.client.0.smithi170.stdout:8/999: mknod d6/d28/d16/d24/d10e/c14b 0 2024-09-04T16:30:42.463 INFO:tasks.workunit.client.0.smithi170.stdout:3/991: fsync d13/d14/d1d/d71/db3/db6/d9e/f94 0 2024-09-04T16:30:42.465 INFO:tasks.workunit.client.0.smithi170.stdout:3/992: write d13/d14/d1f/f72 [2551857,98021] 0 2024-09-04T16:30:42.465 INFO:tasks.workunit.client.0.smithi170.stdout:4/963: dwrite d1/d6/f12 [0,4194304] 0 2024-09-04T16:30:42.474 INFO:tasks.workunit.client.0.smithi170.stdout:3/993: unlink d13/d14/d8b/de3/f114 0 2024-09-04T16:30:42.476 INFO:tasks.workunit.client.0.smithi170.stdout:6/944: dwrite d0/df/d7e/dfa/d68/d2d/f3d [4194304,4194304] 0 2024-09-04T16:30:42.477 INFO:tasks.workunit.client.0.smithi170.stdout:3/994: write d13/d14/d1d/d71/db3/db6/d9e/f5a [7564938,77693] 0 2024-09-04T16:30:42.478 INFO:tasks.workunit.client.0.smithi170.stdout:3/995: dread - d13/d14/d21/d4d/d4e/d88/fe0 zero size 2024-09-04T16:30:42.480 INFO:tasks.workunit.client.0.smithi170.stdout:3/996: fsync d13/d14/d1d/d71/de6/fee 0 2024-09-04T16:30:42.483 INFO:tasks.workunit.client.0.smithi170.stdout:6/945: read d0/df/d7e/dfa/d68/d2d/f3d [3151948,108] 0 2024-09-04T16:30:42.485 INFO:tasks.workunit.client.0.smithi170.stdout:6/946: readlink d0/d15/d56/d6d/dac/d13e/laf 0 2024-09-04T16:30:42.489 INFO:tasks.workunit.client.0.smithi170.stdout:4/964: dread d1/d6/d8/d20/d35/d3e/d60/f61 [0,4194304] 0 2024-09-04T16:30:42.491 INFO:tasks.workunit.client.0.smithi170.stdout:4/965: dread - d1/d6/d8/d20/dae/dd5/f108 zero size 2024-09-04T16:30:42.492 INFO:tasks.workunit.client.0.smithi170.stdout:4/966: fdatasync d1/d6/d8/d20/dc1/ff2 0 2024-09-04T16:30:42.492 INFO:tasks.workunit.client.0.smithi170.stdout:6/947: creat d0/d17/d31/d64/df4/f140 x:0 0 0 2024-09-04T16:30:42.494 INFO:tasks.workunit.client.0.smithi170.stdout:3/997: dwrite d13/d14/d1f/f73 [4194304,4194304] 0 2024-09-04T16:30:42.504 INFO:tasks.workunit.client.0.smithi170.stdout:4/967: dwrite d1/d6/d8/d6c/fe6 [4194304,4194304] 0 2024-09-04T16:30:42.510 INFO:tasks.workunit.client.0.smithi170.stdout:4/968: mknod d1/d12f/c14b 0 2024-09-04T16:30:42.511 INFO:tasks.workunit.client.0.smithi170.stdout:4/969: fsync d1/d6/d8/d20/d35/d3e/d60/daa/fed 0 2024-09-04T16:30:42.511 INFO:tasks.workunit.client.0.smithi170.stdout:6/948: truncate d0/df/d7e/dfa/d68/d2d/d67/f129 3305904 0 2024-09-04T16:30:42.513 INFO:tasks.workunit.client.0.smithi170.stdout:3/998: truncate d13/d14/d1d/d2d/d58/f47 2098924 0 2024-09-04T16:30:42.515 INFO:tasks.workunit.client.0.smithi170.stdout:4/970: mknod d1/d6/d8/d20/dae/dd5/c14c 0 2024-09-04T16:30:42.518 INFO:tasks.workunit.client.0.smithi170.stdout:6/949: mkdir d0/d15/d56/d6c/d141 0 2024-09-04T16:30:42.524 INFO:tasks.workunit.client.0.smithi170.stdout:4/971: dwrite d1/d6/d8/d20/d35/d3e/d60/f144 [0,4194304] 0 2024-09-04T16:30:42.567 INFO:tasks.workunit.client.0.smithi170.stdout:4/972: creat d1/d129/f14d x:0 0 0 2024-09-04T16:30:42.568 INFO:tasks.workunit.client.0.smithi170.stdout:3/999: dwrite d13/d14/d21/faf [0,4194304] 0 2024-09-04T16:30:42.573 INFO:tasks.workunit.client.0.smithi170.stdout:4/973: getdents d1/d6/d22 0 2024-09-04T16:30:42.579 INFO:tasks.workunit.client.0.smithi170.stdout:4/974: dwrite d1/d6/d8/f9a [0,4194304] 0 2024-09-04T16:30:42.585 INFO:tasks.workunit.client.0.smithi170.stdout:4/975: readlink d1/d6/d8/d6c/le4 0 2024-09-04T16:30:42.600 INFO:tasks.workunit.client.0.smithi170.stdout:4/976: dread d1/d6/d8/f9 [0,4194304] 0 2024-09-04T16:30:42.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:42 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:30:42.603 INFO:tasks.workunit.client.0.smithi170.stdout:4/977: symlink d1/d6/d8/d20/d35/l14e 0 2024-09-04T16:30:42.607 INFO:tasks.workunit.client.0.smithi170.stdout:4/978: link d1/f7c d1/d6/d2b/d47/d78/f14f 0 2024-09-04T16:30:42.612 INFO:tasks.workunit.client.0.smithi170.stdout:4/979: write d1/d6/d22/fad [753185,129964] 0 2024-09-04T16:30:42.615 INFO:tasks.workunit.client.0.smithi170.stdout:4/980: unlink d1/d6/d8/d20/dae/dd5/l10b 0 2024-09-04T16:30:42.616 INFO:tasks.workunit.client.0.smithi170.stdout:4/981: symlink d1/d6/d8/d9d/l150 0 2024-09-04T16:30:42.627 INFO:tasks.workunit.client.0.smithi170.stdout:4/982: dwrite d1/d6/d2b/d47/d78/f90 [0,4194304] 0 2024-09-04T16:30:42.631 INFO:tasks.workunit.client.0.smithi170.stdout:4/983: fsync d1/d6/d8/d20/d95/d36/d9c/f112 0 2024-09-04T16:30:42.636 INFO:tasks.workunit.client.0.smithi170.stdout:4/984: rename d1/d6/d8/d20/d35/d3e/d60/lc4 to d1/d6/d8/d6c/de0/l151 0 2024-09-04T16:30:42.637 INFO:tasks.workunit.client.0.smithi170.stdout:4/985: readlink d1/d6/d2b/d47/l89 0 2024-09-04T16:30:42.645 INFO:tasks.workunit.client.0.smithi170.stdout:4/986: dwrite d1/d6/d8/d20/d95/f69 [4194304,4194304] 0 2024-09-04T16:30:42.646 INFO:tasks.workunit.client.0.smithi170.stdout:4/987: fdatasync d1/d6/d8/d20/d95/d36/d9c/f140 0 2024-09-04T16:30:42.650 INFO:tasks.workunit.client.0.smithi170.stdout:4/988: rename d1/d6/d8/d20/d35/d3e/d60 to d1/d6/d8/d20/d35/d3e/d152 0 2024-09-04T16:30:42.653 INFO:tasks.workunit.client.0.smithi170.stdout:4/989: creat d1/d6/d8/d20/d95/d36/f153 x:0 0 0 2024-09-04T16:30:42.655 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:42 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:30:42.662 INFO:tasks.workunit.client.0.smithi170.stdout:4/990: write d1/d6/d8/f8a [1300706,73173] 0 2024-09-04T16:30:42.665 INFO:tasks.workunit.client.0.smithi170.stdout:4/991: creat d1/d6/d8/d9d/d130/f154 x:0 0 0 2024-09-04T16:30:42.666 INFO:tasks.workunit.client.0.smithi170.stdout:4/992: write d1/d6/d8/d20/d95/d36/f28 [28826,92253] 0 2024-09-04T16:30:42.669 INFO:tasks.workunit.client.0.smithi170.stdout:4/993: creat d1/d6/d8/d20/d35/d3e/d152/daa/f155 x:0 0 0 2024-09-04T16:30:42.671 INFO:tasks.workunit.client.0.smithi170.stdout:4/994: symlink d1/d6/d8/d20/dc1/dd2/d107/l156 0 2024-09-04T16:30:42.673 INFO:tasks.workunit.client.0.smithi170.stdout:4/995: creat d1/d6/d2b/f157 x:0 0 0 2024-09-04T16:30:42.674 INFO:tasks.workunit.client.0.smithi170.stdout:4/996: symlink d1/d6/d8/d20/d35/l158 0 2024-09-04T16:30:42.678 INFO:tasks.workunit.client.0.smithi170.stdout:4/997: dread d1/d6/d8/f9 [0,4194304] 0 2024-09-04T16:30:43.276 INFO:tasks.workunit.client.0.smithi170.stdout:6/950: sync 2024-09-04T16:30:43.277 INFO:tasks.workunit.client.0.smithi170.stdout:6/951: write d0/d17/d31/d64/df4/d124/f114 [270960,20586] 0 2024-09-04T16:30:43.280 INFO:tasks.workunit.client.0.smithi170.stdout:6/952: mknod d0/d17/d31/d64/df4/df8/c142 0 2024-09-04T16:30:43.281 INFO:tasks.workunit.client.0.smithi170.stdout:6/953: fdatasync d0/df/d7e/dfa/d68/d2d/fbb 0 2024-09-04T16:30:43.288 INFO:tasks.workunit.client.0.smithi170.stdout:6/954: dwrite d0/df/d7e/dfa/d68/d2d/fff [0,4194304] 0 2024-09-04T16:30:43.290 INFO:tasks.workunit.client.0.smithi170.stdout:6/955: rmdir d0/df/d1f 39 2024-09-04T16:30:43.294 INFO:tasks.workunit.client.0.smithi170.stdout:4/998: sync 2024-09-04T16:30:43.297 INFO:tasks.workunit.client.0.smithi170.stdout:4/999: mknod d1/d6/d8/d20/d35/d3e/d4e/d13a/c159 0 2024-09-04T16:30:43.302 INFO:tasks.workunit.client.0.smithi170.stdout:6/956: write d0/d17/d31/d64/df4/d124/f49 [692345,127384] 0 2024-09-04T16:30:43.304 INFO:tasks.workunit.client.0.smithi170.stdout:6/957: mkdir d0/d9f/d143 0 2024-09-04T16:30:43.308 INFO:tasks.workunit.client.0.smithi170.stdout:6/958: dread d0/d17/d31/f11a [0,4194304] 0 2024-09-04T16:30:43.309 INFO:tasks.workunit.client.0.smithi170.stdout:6/959: chown d0/d15/d56/d6c/da0/d106 55 1 2024-09-04T16:30:43.319 INFO:tasks.workunit.client.0.smithi170.stdout:6/960: dwrite d0/d15/d56/fc0 [0,4194304] 0 2024-09-04T16:30:43.325 INFO:tasks.workunit.client.0.smithi170.stdout:6/961: mkdir d0/df/d144 0 2024-09-04T16:30:43.347 INFO:tasks.workunit.client.0.smithi170.stdout:6/962: dread d0/d15/d56/d6d/dac/d13e/f7f [0,4194304] 0 2024-09-04T16:30:43.350 INFO:tasks.workunit.client.0.smithi170.stdout:6/963: mknod d0/d17/d39/d99/d139/c145 0 2024-09-04T16:30:43.356 INFO:tasks.workunit.client.0.smithi170.stdout:6/964: dwrite d0/d17/d31/f11a [0,4194304] 0 2024-09-04T16:30:43.365 INFO:tasks.workunit.client.0.smithi170.stdout:6/965: mkdir d0/df/d1f/d9c/d146 0 2024-09-04T16:30:43.374 INFO:tasks.workunit.client.0.smithi170.stdout:6/966: rename d0/d17/d31/d64/d30/l9b to d0/d17/d31/d64/d30/l147 0 2024-09-04T16:30:43.374 INFO:tasks.workunit.client.0.smithi170.stdout:6/967: chown d0/d17/d31/d64/d30 1625800 1 2024-09-04T16:30:43.379 INFO:tasks.workunit.client.0.smithi170.stdout:6/968: unlink d0/d17/c4f 0 2024-09-04T16:30:43.383 INFO:tasks.workunit.client.0.smithi170.stdout:6/969: mkdir d0/df/d144/d148 0 2024-09-04T16:30:43.383 INFO:tasks.workunit.client.0.smithi170.stdout:6/970: stat d0/d17/dbd/l102 0 2024-09-04T16:30:43.385 INFO:tasks.workunit.client.0.smithi170.stdout:6/971: mknod d0/df/d1f/c149 0 2024-09-04T16:30:43.390 INFO:tasks.workunit.client.0.smithi170.stdout:6/972: rename d0/d17/d31/d64/df4/d124/l34 to d0/d9f/l14a 0 2024-09-04T16:30:43.391 INFO:tasks.workunit.client.0.smithi170.stdout:6/973: write d0/df/d7e/dfa/d68/d2d/fc9 [1395141,86515] 0 2024-09-04T16:30:43.392 INFO:tasks.workunit.client.0.smithi170.stdout:6/974: chown d0/d17/d39/d99/fad 9822854 1 2024-09-04T16:30:43.394 INFO:tasks.workunit.client.0.smithi170.stdout:6/975: fdatasync d0/df/d7e/dfa/d68/f5d 0 2024-09-04T16:30:43.396 INFO:tasks.workunit.client.0.smithi170.stdout:6/976: rmdir d0/d9f 39 2024-09-04T16:30:43.401 INFO:tasks.workunit.client.0.smithi170.stdout:6/977: symlink d0/d15/d56/d6c/l14b 0 2024-09-04T16:30:43.404 INFO:tasks.workunit.client.0.smithi170.stdout:6/978: symlink d0/d17/d31/d64/df4/d124/l14c 0 2024-09-04T16:30:43.406 INFO:tasks.workunit.client.0.smithi170.stdout:6/979: mknod d0/d17/d31/d64/d30/c14d 0 2024-09-04T16:30:43.407 INFO:tasks.workunit.client.0.smithi170.stdout:6/980: write d0/d17/d31/d64/d111/f113 [664385,4939] 0 2024-09-04T16:30:43.408 INFO:tasks.workunit.client.0.smithi170.stdout:6/981: chown d0/d15/d56/d6d/dac/d13e/cef 1245404641 1 2024-09-04T16:30:43.411 INFO:tasks.workunit.client.0.smithi170.stdout:6/982: creat d0/d17/d31/f14e x:0 0 0 2024-09-04T16:30:43.411 INFO:tasks.workunit.client.0.smithi170.stdout:6/983: chown d0/d17/d31/c53 0 1 2024-09-04T16:30:43.412 INFO:tasks.workunit.client.0.smithi170.stdout:6/984: write d0/dbf/fea [174420,49842] 0 2024-09-04T16:30:43.414 INFO:tasks.workunit.client.0.smithi170.stdout:6/985: write d0/d17/d31/d64/d111/f89 [4160775,109175] 0 2024-09-04T16:30:43.416 INFO:tasks.workunit.client.0.smithi170.stdout:6/986: unlink d0/d15/d56/c110 0 2024-09-04T16:30:43.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:43 smithi170 ceph-mon[29272]: pgmap v41: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 36 MiB/s rd, 86 MiB/s wr, 259 op/s 2024-09-04T16:30:43.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:43 smithi193 ceph-mon[36288]: pgmap v41: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 36 MiB/s rd, 86 MiB/s wr, 259 op/s 2024-09-04T16:30:43.957 INFO:tasks.workunit.client.0.smithi170.stdout:6/987: sync 2024-09-04T16:30:43.960 INFO:tasks.workunit.client.0.smithi170.stdout:6/988: symlink d0/df/d7e/dfa/d68/l14f 0 2024-09-04T16:30:43.962 INFO:tasks.workunit.client.0.smithi170.stdout:6/989: mknod d0/df/d7e/dfa/c150 0 2024-09-04T16:30:43.964 INFO:tasks.workunit.client.0.smithi170.stdout:6/990: mknod d0/df/d7e/dfa/d68/d2d/d67/d73/c151 0 2024-09-04T16:30:43.979 INFO:tasks.workunit.client.0.smithi170.stdout:6/991: dwrite d0/d17/d31/d64/d111/f95 [0,4194304] 0 2024-09-04T16:30:43.982 INFO:tasks.workunit.client.0.smithi170.stdout:6/992: mknod d0/d17/d31/dcc/c152 0 2024-09-04T16:30:43.985 INFO:tasks.workunit.client.0.smithi170.stdout:6/993: mkdir d0/df/d7e/d153 0 2024-09-04T16:30:44.211 INFO:tasks.workunit.client.0.smithi170.stdout:6/994: sync 2024-09-04T16:30:44.233 INFO:tasks.workunit.client.0.smithi170.stdout:6/995: dwrite d0/d17/fe1 [0,4194304] 0 2024-09-04T16:30:44.250 INFO:tasks.workunit.client.0.smithi170.stdout:6/996: dread d0/df/d7e/dfa/d68/f5d [0,4194304] 0 2024-09-04T16:30:44.261 INFO:tasks.workunit.client.0.smithi170.stdout:6/997: dread d0/df/d7e/dfa/d68/d2d/fc9 [0,4194304] 0 2024-09-04T16:30:44.262 INFO:tasks.workunit.client.0.smithi170.stdout:6/998: chown d0/d15/d56/d6c/db8 17 1 2024-09-04T16:30:44.264 INFO:tasks.workunit.client.0.smithi170.stdout:6/999: mkdir d0/d15/d56/d6c/da0/d154 0 2024-09-04T16:30:44.267 INFO:tasks.workunit.client.0.smithi170.stderr:+ rm -rf -- ./tmp.x118SjEil0 2024-09-04T16:30:44.300 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-04T16:30:44.300 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-04T16:30:44.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.470+0000 7ff72e44f640 1 -- 172.21.15.170:0/112173469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff728101a40 msgr2=0x7ff728101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:44.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.470+0000 7ff72e44f640 1 --2- 172.21.15.170:0/112173469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff728101a40 0x7ff728101ec0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009880 tx=0x7ff71c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:30:44.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.470+0000 7ff72e44f640 1 -- 172.21.15.170:0/112173469 shutdown_connections 2024-09-04T16:30:44.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.470+0000 7ff72e44f640 1 --2- 172.21.15.170:0/112173469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff728101a40 0x7ff728101ec0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:44.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.470+0000 7ff72e44f640 1 --2- 172.21.15.170:0/112173469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff728100840 0x7ff728100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:44.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.470+0000 7ff72e44f640 1 -- 172.21.15.170:0/112173469 >> 172.21.15.170:0/112173469 conn(0x7ff7280fbff0 msgr2=0x7ff7280fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:44.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.470+0000 7ff72e44f640 1 -- 172.21.15.170:0/112173469 shutdown_connections 2024-09-04T16:30:44.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.470+0000 7ff72e44f640 1 -- 172.21.15.170:0/112173469 wait complete. 2024-09-04T16:30:44.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.471+0000 7ff72e44f640 1 Processor -- start 2024-09-04T16:30:44.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.471+0000 7ff72e44f640 1 -- start start 2024-09-04T16:30:44.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.472+0000 7ff72e44f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff728100840 0x7ff72806a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:44.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.472+0000 7ff72e44f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff728101a40 0x7ff72819c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:44.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.472+0000 7ff72e44f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff728109680 con 0x7ff728101a40 2024-09-04T16:30:44.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.472+0000 7ff72e44f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff728109500 con 0x7ff728100840 2024-09-04T16:30:44.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.472+0000 7ff7277fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff728101a40 0x7ff72819c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:44.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.472+0000 7ff727fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff728100840 0x7ff72806a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:44.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.472+0000 7ff7277fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff728101a40 0x7ff72819c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51618/0 (socket says 172.21.15.170:51618) 2024-09-04T16:30:44.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.472+0000 7ff7277fe640 1 -- 172.21.15.170:0/3595465153 learned_addr learned my addr 172.21.15.170:0/3595465153 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:30:44.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.472+0000 7ff7277fe640 1 -- 172.21.15.170:0/3595465153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff728100840 msgr2=0x7ff72806a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:44.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.472+0000 7ff7277fe640 1 --2- 172.21.15.170:0/3595465153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff728100840 0x7ff72806a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:44.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.472+0000 7ff7277fe640 1 -- 172.21.15.170:0/3595465153 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72819c7b0 con 0x7ff728101a40 2024-09-04T16:30:44.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.472+0000 7ff727fff640 1 --2- 172.21.15.170:0/3595465153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff728100840 0x7ff72806a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:30:44.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.472+0000 7ff7277fe640 1 --2- 172.21.15.170:0/3595465153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff728101a40 0x7ff72819c1f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009230 tx=0x7ff71c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:44.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.473+0000 7ff7257fa640 1 -- 172.21.15.170:0/3595465153 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff71c03f070 con 0x7ff728101a40 2024-09-04T16:30:44.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.473+0000 7ff7257fa640 1 -- 172.21.15.170:0/3595465153 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff71c004a90 con 0x7ff728101a40 2024-09-04T16:30:44.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.473+0000 7ff7257fa640 1 -- 172.21.15.170:0/3595465153 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff71c035030 con 0x7ff728101a40 2024-09-04T16:30:44.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.473+0000 7ff72e44f640 1 -- 172.21.15.170:0/3595465153 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff72819ca40 con 0x7ff728101a40 2024-09-04T16:30:44.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.473+0000 7ff72e44f640 1 -- 172.21.15.170:0/3595465153 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff72819cf70 con 0x7ff728101a40 2024-09-04T16:30:44.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.474+0000 7ff72e44f640 1 -- 172.21.15.170:0/3595465153 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff728100c40 con 0x7ff728101a40 2024-09-04T16:30:44.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.475+0000 7ff7257fa640 1 -- 172.21.15.170:0/3595465153 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 25) ==== 97250+0+0 (secure 0 0 0) 0x7ff71c042070 con 0x7ff728101a40 2024-09-04T16:30:44.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.476+0000 7ff7257fa640 1 --2- 172.21.15.170:0/3595465153 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7ff710073fc0 0x7ff710076480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:44.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.476+0000 7ff7257fa640 1 -- 172.21.15.170:0/3595465153 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7ff71c0b60a0 con 0x7ff728101a40 2024-09-04T16:30:44.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.476+0000 7ff727fff640 1 --2- 172.21.15.170:0/3595465153 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7ff710073fc0 0x7ff710076480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:44.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.476+0000 7ff727fff640 1 --2- 172.21.15.170:0/3595465153 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7ff710073fc0 0x7ff710076480 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff7281018a0 tx=0x7ff718005f90 comp rx=0 tx=0).ready entity=mgr.14682 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:44.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.481+0000 7ff7257fa640 1 -- 172.21.15.170:0/3595465153 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7ff71c081b50 con 0x7ff728101a40 2024-09-04T16:30:44.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:44 smithi170 ceph-mon[29272]: pgmap v42: 65 pgs: 65 active+clean; 2.8 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 50 MiB/s rd, 131 MiB/s wr, 378 op/s 2024-09-04T16:30:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:44 smithi193 ceph-mon[36288]: pgmap v42: 65 pgs: 65 active+clean; 2.8 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 50 MiB/s rd, 131 MiB/s wr, 378 op/s 2024-09-04T16:30:44.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.738+0000 7ff72e44f640 1 -- 172.21.15.170:0/3595465153 --> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff7280626f0 con 0x7ff710073fc0 2024-09-04T16:30:44.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.740+0000 7ff7257fa640 1 -- 172.21.15.170:0/3595465153 <== mgr.14682 v2:172.21.15.193:6828/4218378172 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7ff7280626f0 con 0x7ff710073fc0 2024-09-04T16:30:44.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.742+0000 7ff72e44f640 1 -- 172.21.15.170:0/3595465153 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7ff710073fc0 msgr2=0x7ff710076480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:44.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.742+0000 7ff72e44f640 1 --2- 172.21.15.170:0/3595465153 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7ff710073fc0 0x7ff710076480 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff7281018a0 tx=0x7ff718005f90 comp rx=0 tx=0).stop 2024-09-04T16:30:44.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.742+0000 7ff72e44f640 1 -- 172.21.15.170:0/3595465153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff728101a40 msgr2=0x7ff72819c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:44.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.742+0000 7ff72e44f640 1 --2- 172.21.15.170:0/3595465153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff728101a40 0x7ff72819c1f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009230 tx=0x7ff71c004570 comp rx=0 tx=0).stop 2024-09-04T16:30:44.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.742+0000 7ff72e44f640 1 -- 172.21.15.170:0/3595465153 shutdown_connections 2024-09-04T16:30:44.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.742+0000 7ff72e44f640 1 --2- 172.21.15.170:0/3595465153 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7ff710073fc0 0x7ff710076480 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:44.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.742+0000 7ff72e44f640 1 --2- 172.21.15.170:0/3595465153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff728101a40 0x7ff72819c1f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:44.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.742+0000 7ff72e44f640 1 --2- 172.21.15.170:0/3595465153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff728100840 0x7ff72806a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:44.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.742+0000 7ff72e44f640 1 -- 172.21.15.170:0/3595465153 >> 172.21.15.170:0/3595465153 conn(0x7ff7280fbff0 msgr2=0x7ff728104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:44.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.742+0000 7ff72e44f640 1 -- 172.21.15.170:0/3595465153 shutdown_connections 2024-09-04T16:30:44.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.742+0000 7ff72e44f640 1 -- 172.21.15.170:0/3595465153 wait complete. 2024-09-04T16:30:44.756 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:30:44.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.842+0000 7faa2f7dd640 1 -- 172.21.15.170:0/2125479343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa28101a40 msgr2=0x7faa28101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:44.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.842+0000 7faa2f7dd640 1 --2- 172.21.15.170:0/2125479343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa28101a40 0x7faa28101ec0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faa18009880 tx=0x7faa1802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:30:44.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.842+0000 7faa2f7dd640 1 -- 172.21.15.170:0/2125479343 shutdown_connections 2024-09-04T16:30:44.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.842+0000 7faa2f7dd640 1 --2- 172.21.15.170:0/2125479343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa28101a40 0x7faa28101ec0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:44.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.842+0000 7faa2f7dd640 1 --2- 172.21.15.170:0/2125479343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa28100840 0x7faa28100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:44.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.842+0000 7faa2f7dd640 1 -- 172.21.15.170:0/2125479343 >> 172.21.15.170:0/2125479343 conn(0x7faa280fbff0 msgr2=0x7faa280fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:44.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.842+0000 7faa2f7dd640 1 -- 172.21.15.170:0/2125479343 shutdown_connections 2024-09-04T16:30:44.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.842+0000 7faa2f7dd640 1 -- 172.21.15.170:0/2125479343 wait complete. 2024-09-04T16:30:44.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.843+0000 7faa2f7dd640 1 Processor -- start 2024-09-04T16:30:44.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.843+0000 7faa2f7dd640 1 -- start start 2024-09-04T16:30:44.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.843+0000 7faa2f7dd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa28100840 0x7faa28199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:44.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.843+0000 7faa2f7dd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa28101a40 0x7faa28199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:44.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.843+0000 7faa2f7dd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faa28109660 con 0x7faa28100840 2024-09-04T16:30:44.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.843+0000 7faa2f7dd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faa281094e0 con 0x7faa28101a40 2024-09-04T16:30:44.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.843+0000 7faa2d579640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa28100840 0x7faa28199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:44.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.843+0000 7faa2d579640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa28100840 0x7faa28199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51642/0 (socket says 172.21.15.170:51642) 2024-09-04T16:30:44.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.843+0000 7faa2d579640 1 -- 172.21.15.170:0/1181414574 learned_addr learned my addr 172.21.15.170:0/1181414574 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:30:44.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.843+0000 7faa2cd78640 1 --2- 172.21.15.170:0/1181414574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa28101a40 0x7faa28199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.843+0000 7faa2d579640 1 -- 172.21.15.170:0/1181414574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa28101a40 msgr2=0x7faa28199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.843+0000 7faa2d579640 1 --2- 172.21.15.170:0/1181414574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa28101a40 0x7faa28199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.843+0000 7faa2d579640 1 -- 172.21.15.170:0/1181414574 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2819a2f0 con 0x7faa28100840 2024-09-04T16:30:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.844+0000 7faa2d579640 1 --2- 172.21.15.170:0/1181414574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa28100840 0x7faa28199730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faa2400d6f0 tx=0x7faa2400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.844+0000 7faa1e7fc640 1 -- 172.21.15.170:0/1181414574 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa24017070 con 0x7faa28100840 2024-09-04T16:30:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.844+0000 7faa1e7fc640 1 -- 172.21.15.170:0/1181414574 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa2400de00 con 0x7faa28100840 2024-09-04T16:30:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.844+0000 7faa1e7fc640 1 -- 172.21.15.170:0/1181414574 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa24003bc0 con 0x7faa28100840 2024-09-04T16:30:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.844+0000 7faa2f7dd640 1 -- 172.21.15.170:0/1181414574 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa2819ed30 con 0x7faa28100840 2024-09-04T16:30:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.844+0000 7faa2f7dd640 1 -- 172.21.15.170:0/1181414574 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa2819f1d0 con 0x7faa28100840 2024-09-04T16:30:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.845+0000 7faa2f7dd640 1 -- 172.21.15.170:0/1181414574 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa28100c40 con 0x7faa28100840 2024-09-04T16:30:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.846+0000 7faa1e7fc640 1 -- 172.21.15.170:0/1181414574 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 25) ==== 97250+0+0 (secure 0 0 0) 0x7faa24009a30 con 0x7faa28100840 2024-09-04T16:30:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.846+0000 7faa1e7fc640 1 --2- 172.21.15.170:0/1181414574 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7faa14073fc0 0x7faa14076480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:44.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.846+0000 7faa1e7fc640 1 -- 172.21.15.170:0/1181414574 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7faa24094fd0 con 0x7faa28100840 2024-09-04T16:30:44.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.846+0000 7faa2cd78640 1 --2- 172.21.15.170:0/1181414574 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7faa14073fc0 0x7faa14076480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:44.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.847+0000 7faa2cd78640 1 --2- 172.21.15.170:0/1181414574 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7faa14073fc0 0x7faa14076480 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faa18000c00 tx=0x7faa18005b50 comp rx=0 tx=0).ready entity=mgr.14682 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:44.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:44.851+0000 7faa1e7fc640 1 -- 172.21.15.170:0/1181414574 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7faa24060bb0 con 0x7faa28100840 2024-09-04T16:30:45.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.137+0000 7faa2f7dd640 1 -- 172.21.15.170:0/1181414574 --> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faa2806a2d0 con 0x7faa14073fc0 2024-09-04T16:30:45.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.138+0000 7faa1e7fc640 1 -- 172.21.15.170:0/1181414574 <== mgr.14682 v2:172.21.15.193:6828/4218378172 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7faa2806a2d0 con 0x7faa14073fc0 2024-09-04T16:30:45.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.142+0000 7faa2f7dd640 1 -- 172.21.15.170:0/1181414574 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7faa14073fc0 msgr2=0x7faa14076480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:45.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.142+0000 7faa2f7dd640 1 --2- 172.21.15.170:0/1181414574 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7faa14073fc0 0x7faa14076480 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faa18000c00 tx=0x7faa18005b50 comp rx=0 tx=0).stop 2024-09-04T16:30:45.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.142+0000 7faa2f7dd640 1 -- 172.21.15.170:0/1181414574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa28100840 msgr2=0x7faa28199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:45.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.142+0000 7faa2f7dd640 1 --2- 172.21.15.170:0/1181414574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa28100840 0x7faa28199730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faa2400d6f0 tx=0x7faa2400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:30:45.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.142+0000 7faa2f7dd640 1 -- 172.21.15.170:0/1181414574 shutdown_connections 2024-09-04T16:30:45.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.142+0000 7faa2f7dd640 1 --2- 172.21.15.170:0/1181414574 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7faa14073fc0 0x7faa14076480 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:45.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.142+0000 7faa2f7dd640 1 --2- 172.21.15.170:0/1181414574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa28101a40 0x7faa28199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:45.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.142+0000 7faa2f7dd640 1 --2- 172.21.15.170:0/1181414574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa28100840 0x7faa28199730 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:45.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.142+0000 7faa2f7dd640 1 -- 172.21.15.170:0/1181414574 >> 172.21.15.170:0/1181414574 conn(0x7faa280fbff0 msgr2=0x7faa28069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:45.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.142+0000 7faa2f7dd640 1 -- 172.21.15.170:0/1181414574 shutdown_connections 2024-09-04T16:30:45.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.142+0000 7faa2f7dd640 1 -- 172.21.15.170:0/1181414574 wait complete. 2024-09-04T16:30:45.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.259+0000 7f03a9b0e640 1 -- 172.21.15.170:0/3540145271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a4108400 msgr2=0x7f03a4108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:45.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.259+0000 7f03a9b0e640 1 --2- 172.21.15.170:0/3540145271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a4108400 0x7f03a4108800 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f039c009c20 tx=0x7f039c02a9a0 comp rx=0 tx=0).stop 2024-09-04T16:30:45.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.260+0000 7f03a9b0e640 1 -- 172.21.15.170:0/3540145271 shutdown_connections 2024-09-04T16:30:45.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.260+0000 7f03a9b0e640 1 --2- 172.21.15.170:0/3540145271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03a4109170 0x7f03a41095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:45.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.260+0000 7f03a9b0e640 1 --2- 172.21.15.170:0/3540145271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a4108400 0x7f03a4108800 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:45.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.260+0000 7f03a9b0e640 1 -- 172.21.15.170:0/3540145271 >> 172.21.15.170:0/3540145271 conn(0x7f03a4077270 msgr2=0x7f03a40796b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:45.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.262+0000 7f03a9b0e640 1 -- 172.21.15.170:0/3540145271 shutdown_connections 2024-09-04T16:30:45.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.262+0000 7f03a9b0e640 1 -- 172.21.15.170:0/3540145271 wait complete. 2024-09-04T16:30:45.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.263+0000 7f03a9b0e640 1 Processor -- start 2024-09-04T16:30:45.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.264+0000 7f03a9b0e640 1 -- start start 2024-09-04T16:30:45.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.264+0000 7f03a9b0e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03a4108400 0x7f03a40820f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:45.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.264+0000 7f03a9b0e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a4109170 0x7f03a4082630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:45.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.264+0000 7f03a9b0e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f03a4110e30 con 0x7f03a4109170 2024-09-04T16:30:45.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.264+0000 7f03a9b0e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f03a4110cb0 con 0x7f03a4108400 2024-09-04T16:30:45.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.265+0000 7f03a37fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03a4108400 0x7f03a40820f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:45.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.265+0000 7f03a2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a4109170 0x7f03a4082630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:45.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.265+0000 7f03a2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a4109170 0x7f03a4082630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:39614/0 (socket says 172.21.15.170:39614) 2024-09-04T16:30:45.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.265+0000 7f03a2ffd640 1 -- 172.21.15.170:0/1716955437 learned_addr learned my addr 172.21.15.170:0/1716955437 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:30:45.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.266+0000 7f03a37fe640 1 -- 172.21.15.170:0/1716955437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a4109170 msgr2=0x7f03a4082630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:45.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.266+0000 7f03a37fe640 1 --2- 172.21.15.170:0/1716955437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a4109170 0x7f03a4082630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:45.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.266+0000 7f03a37fe640 1 -- 172.21.15.170:0/1716955437 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a4082ce0 con 0x7f03a4108400 2024-09-04T16:30:45.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.266+0000 7f03a37fe640 1 --2- 172.21.15.170:0/1716955437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03a4108400 0x7f03a40820f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f039c02aec0 tx=0x7f039c02f810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:45.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.267+0000 7f03a0ff9640 1 -- 172.21.15.170:0/1716955437 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f039c047070 con 0x7f03a4108400 2024-09-04T16:30:45.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.267+0000 7f03a9b0e640 1 -- 172.21.15.170:0/1716955437 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a41ab9b0 con 0x7f03a4108400 2024-09-04T16:30:45.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.267+0000 7f03a9b0e640 1 -- 172.21.15.170:0/1716955437 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a41abf30 con 0x7f03a4108400 2024-09-04T16:30:45.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.267+0000 7f03a0ff9640 1 -- 172.21.15.170:0/1716955437 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f039c003e30 con 0x7f03a4108400 2024-09-04T16:30:45.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.267+0000 7f03a0ff9640 1 -- 172.21.15.170:0/1716955437 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f039c033050 con 0x7f03a4108400 2024-09-04T16:30:45.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.270+0000 7f03a0ff9640 1 -- 172.21.15.170:0/1716955437 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 97250+0+0 (secure 0 0 0) 0x7f039c036070 con 0x7f03a4108400 2024-09-04T16:30:45.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.271+0000 7f03a0ff9640 1 --2- 172.21.15.170:0/1716955437 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f038c0740c0 0x7f038c076580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:45.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.271+0000 7f03a2ffd640 1 --2- 172.21.15.170:0/1716955437 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f038c0740c0 0x7f038c076580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:45.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.271+0000 7f03a0ff9640 1 -- 172.21.15.170:0/1716955437 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f039c03e030 con 0x7f03a4108400 2024-09-04T16:30:45.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.271+0000 7f03a2ffd640 1 --2- 172.21.15.170:0/1716955437 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f038c0740c0 0x7f038c076580 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f03a41a7860 tx=0x7f03940091c0 comp rx=0 tx=0).ready entity=mgr.14682 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:45.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.273+0000 7f03a9b0e640 1 -- 172.21.15.170:0/1716955437 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0390005290 con 0x7f03a4108400 2024-09-04T16:30:45.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.282+0000 7f03a0ff9640 1 -- 172.21.15.170:0/1716955437 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f039c082ba0 con 0x7f03a4108400 2024-09-04T16:30:45.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.573+0000 7f03a9b0e640 1 -- 172.21.15.170:0/1716955437 --> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0390000bc0 con 0x7f038c0740c0 2024-09-04T16:30:45.576 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:45 smithi170 ceph-mon[29272]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:30:45.576 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:45 smithi170 ceph-mon[29272]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:30:45.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.583+0000 7f03a0ff9640 1 -- 172.21.15.170:0/1716955437 <== mgr.14682 v2:172.21.15.193:6828/4218378172 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f0390000bc0 con 0x7f038c0740c0 2024-09-04T16:30:45.584 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:30:45.584 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (7m) 64s ago 8m 25.1M - 0.25.0 c8568f914cd2 e85db6a2e731 2024-09-04T16:30:45.584 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 starting - - - - 2024-09-04T16:30:45.584 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 starting - - - - 2024-09-04T16:30:45.584 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (8m) 64s ago 8m 6891k - 19.1.1-252-g48920dab b708f9119ac7 aa2ec5c5776a 2024-09-04T16:30:45.584 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (7m) 70s ago 7m 6895k - 19.1.1-252-g48920dab b708f9119ac7 a24f0ce3b3fb 2024-09-04T16:30:45.584 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (6m) 64s ago 8m 79.2M - 9.4.12 2bacad6d85d8 5bffd3332aba 2024-09-04T16:30:45.584 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (3m) 64s ago 3m 22.0M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:30:45.584 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (3m) 64s ago 3m 140M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:30:45.584 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (3m) 70s ago 3m 13.1M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:30:45.585 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (3m) 70s ago 3m 12.4M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:30:45.585 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:9283,8765,8443 running (9m) 64s ago 9m 249M - 19.1.1-252-g48920dab b708f9119ac7 3f0663652a64 2024-09-04T16:30:45.585 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (91s) 70s ago 7m 496M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 5d9c73a5a6dd 2024-09-04T16:30:45.585 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (9m) 64s ago 10m 54.0M 2048M 19.1.1-252-g48920dab b708f9119ac7 194ff39cc041 2024-09-04T16:30:45.585 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (7m) 70s ago 7m 41.0M 2048M 19.1.1-252-g48920dab b708f9119ac7 38c8e99ca323 2024-09-04T16:30:45.585 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (8m) 64s ago 8m 15.8M - 1.5.0 0da6a335fe13 e311ba1b18bc 2024-09-04T16:30:45.585 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (7m) 70s ago 7m 16.2M - 1.5.0 0da6a335fe13 09fd1aa1fdb6 2024-09-04T16:30:45.585 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (6m) 64s ago 6m 81.5M 1216M 19.1.1-252-g48920dab b708f9119ac7 6c2ea484615d 2024-09-04T16:30:45.585 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (6m) 64s ago 6m 88.1M 1216M 19.1.1-252-g48920dab b708f9119ac7 20469ba5727b 2024-09-04T16:30:45.585 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (5m) 64s ago 5m 71.5M 1216M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:30:45.585 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (5m) 70s ago 5m 88.2M 2240M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:30:45.585 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (4m) 70s ago 4m 78.7M 2240M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:30:45.585 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (4m) 70s ago 4m 80.3M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:30:45.585 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 starting - - - - 2024-09-04T16:30:45.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.586+0000 7f03a9b0e640 1 -- 172.21.15.170:0/1716955437 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f038c0740c0 msgr2=0x7f038c076580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:45.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.586+0000 7f03a9b0e640 1 --2- 172.21.15.170:0/1716955437 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f038c0740c0 0x7f038c076580 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f03a41a7860 tx=0x7f03940091c0 comp rx=0 tx=0).stop 2024-09-04T16:30:45.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.586+0000 7f03a9b0e640 1 -- 172.21.15.170:0/1716955437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03a4108400 msgr2=0x7f03a40820f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:45.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.586+0000 7f03a9b0e640 1 --2- 172.21.15.170:0/1716955437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03a4108400 0x7f03a40820f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f039c02aec0 tx=0x7f039c02f810 comp rx=0 tx=0).stop 2024-09-04T16:30:45.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.586+0000 7f03a9b0e640 1 -- 172.21.15.170:0/1716955437 shutdown_connections 2024-09-04T16:30:45.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.586+0000 7f03a9b0e640 1 --2- 172.21.15.170:0/1716955437 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f038c0740c0 0x7f038c076580 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:45.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.586+0000 7f03a9b0e640 1 --2- 172.21.15.170:0/1716955437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a4109170 0x7f03a4082630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:45.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.586+0000 7f03a9b0e640 1 --2- 172.21.15.170:0/1716955437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03a4108400 0x7f03a40820f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:45.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.586+0000 7f03a9b0e640 1 -- 172.21.15.170:0/1716955437 >> 172.21.15.170:0/1716955437 conn(0x7f03a4077270 msgr2=0x7f03a410c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:45.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.586+0000 7f03a9b0e640 1 -- 172.21.15.170:0/1716955437 shutdown_connections 2024-09-04T16:30:45.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.586+0000 7f03a9b0e640 1 -- 172.21.15.170:0/1716955437 wait complete. 2024-09-04T16:30:45.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:45 smithi193 ceph-mon[36288]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:30:45.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:45 smithi193 ceph-mon[36288]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:30:45.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.683+0000 7f4fcccda640 1 -- 172.21.15.170:0/753588723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fc8101a70 msgr2=0x7f4fc8101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:45.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.683+0000 7f4fcccda640 1 --2- 172.21.15.170:0/753588723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fc8101a70 0x7f4fc8101ef0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009880 tx=0x7f4fbc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:30:45.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.684+0000 7f4fcccda640 1 -- 172.21.15.170:0/753588723 shutdown_connections 2024-09-04T16:30:45.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.684+0000 7f4fcccda640 1 --2- 172.21.15.170:0/753588723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fc8101a70 0x7f4fc8101ef0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:45.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.684+0000 7f4fcccda640 1 --2- 172.21.15.170:0/753588723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4fc8100870 0x7f4fc8100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:45.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.684+0000 7f4fcccda640 1 -- 172.21.15.170:0/753588723 >> 172.21.15.170:0/753588723 conn(0x7f4fc80fc020 msgr2=0x7f4fc80fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:45.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.684+0000 7f4fcccda640 1 -- 172.21.15.170:0/753588723 shutdown_connections 2024-09-04T16:30:45.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.684+0000 7f4fcccda640 1 -- 172.21.15.170:0/753588723 wait complete. 2024-09-04T16:30:45.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.684+0000 7f4fcccda640 1 Processor -- start 2024-09-04T16:30:45.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.684+0000 7f4fcccda640 1 -- start start 2024-09-04T16:30:45.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.685+0000 7f4fcccda640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fc8100870 0x7f4fc81974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:45.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.685+0000 7f4fcccda640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4fc8101a70 0x7f4fc8197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:45.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.685+0000 7f4fcccda640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81096b0 con 0x7f4fc8100870 2024-09-04T16:30:45.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.685+0000 7f4fcccda640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc8109530 con 0x7f4fc8101a70 2024-09-04T16:30:45.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.685+0000 7f4fc659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fc8100870 0x7f4fc81974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:45.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.685+0000 7f4fc659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fc8100870 0x7f4fc81974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:39630/0 (socket says 172.21.15.170:39630) 2024-09-04T16:30:45.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.685+0000 7f4fc659c640 1 -- 172.21.15.170:0/716718379 learned_addr learned my addr 172.21.15.170:0/716718379 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:30:45.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.685+0000 7f4fc5d9b640 1 --2- 172.21.15.170:0/716718379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4fc8101a70 0x7f4fc8197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:45.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.685+0000 7f4fc659c640 1 -- 172.21.15.170:0/716718379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4fc8101a70 msgr2=0x7f4fc8197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:45.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.685+0000 7f4fc659c640 1 --2- 172.21.15.170:0/716718379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4fc8101a70 0x7f4fc8197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:45.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.685+0000 7f4fc659c640 1 -- 172.21.15.170:0/716718379 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc8198080 con 0x7f4fc8100870 2024-09-04T16:30:45.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.685+0000 7f4fc5d9b640 1 --2- 172.21.15.170:0/716718379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4fc8101a70 0x7f4fc8197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:30:45.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.685+0000 7f4fc659c640 1 --2- 172.21.15.170:0/716718379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fc8100870 0x7f4fc81974c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800e940 tx=0x7f4fb800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:45.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.686+0000 7f4fb77fe640 1 -- 172.21.15.170:0/716718379 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4fb800cac0 con 0x7f4fc8100870 2024-09-04T16:30:45.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.686+0000 7f4fcccda640 1 -- 172.21.15.170:0/716718379 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc819cac0 con 0x7f4fc8100870 2024-09-04T16:30:45.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.686+0000 7f4fb77fe640 1 -- 172.21.15.170:0/716718379 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4fb800cc60 con 0x7f4fc8100870 2024-09-04T16:30:45.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.686+0000 7f4fb77fe640 1 -- 172.21.15.170:0/716718379 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4fb8003e30 con 0x7f4fc8100870 2024-09-04T16:30:45.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.686+0000 7f4fcccda640 1 -- 172.21.15.170:0/716718379 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc819d050 con 0x7f4fc8100870 2024-09-04T16:30:45.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.688+0000 7f4fcccda640 1 -- 172.21.15.170:0/716718379 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc8100c70 con 0x7f4fc8100870 2024-09-04T16:30:45.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.688+0000 7f4fb77fe640 1 -- 172.21.15.170:0/716718379 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 25) ==== 97250+0+0 (secure 0 0 0) 0x7f4fb8004000 con 0x7f4fc8100870 2024-09-04T16:30:45.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.689+0000 7f4fb77fe640 1 --2- 172.21.15.170:0/716718379 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f4fb0073f60 0x7f4fb0076420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:45.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.689+0000 7f4fb77fe640 1 -- 172.21.15.170:0/716718379 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f4fb8095b90 con 0x7f4fc8100870 2024-09-04T16:30:45.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.689+0000 7f4fc5d9b640 1 --2- 172.21.15.170:0/716718379 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f4fb0073f60 0x7f4fb0076420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:45.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.689+0000 7f4fc5d9b640 1 --2- 172.21.15.170:0/716718379 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f4fb0073f60 0x7f4fb0076420 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8198970 tx=0x7f4fbc005a20 comp rx=0 tx=0).ready entity=mgr.14682 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:45.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:45.695+0000 7f4fb77fe640 1 -- 172.21.15.170:0/716718379 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f4fb805d580 con 0x7f4fc8100870 2024-09-04T16:30:46.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.077+0000 7f4fcccda640 1 -- 172.21.15.170:0/716718379 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4fc819d8e0 con 0x7f4fc8100870 2024-09-04T16:30:46.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.077+0000 7f4fb77fe640 1 -- 172.21.15.170:0/716718379 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f4fb80616f0 con 0x7f4fc8100870 2024-09-04T16:30:46.078 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:30:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:30:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 2 2024-09-04T16:30:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:30:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:30:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 1, 2024-09-04T16:30:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 1 2024-09-04T16:30:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:30:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:30:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 6 2024-09-04T16:30:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:30:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:30:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:30:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:30:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:30:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 13, 2024-09-04T16:30:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 1 2024-09-04T16:30:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:30:46.079 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:30:46.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.080+0000 7f4fcccda640 1 -- 172.21.15.170:0/716718379 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f4fb0073f60 msgr2=0x7f4fb0076420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:46.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.080+0000 7f4fcccda640 1 --2- 172.21.15.170:0/716718379 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f4fb0073f60 0x7f4fb0076420 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8198970 tx=0x7f4fbc005a20 comp rx=0 tx=0).stop 2024-09-04T16:30:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.080+0000 7f4fcccda640 1 -- 172.21.15.170:0/716718379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fc8100870 msgr2=0x7f4fc81974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.080+0000 7f4fcccda640 1 --2- 172.21.15.170:0/716718379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fc8100870 0x7f4fc81974c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800e940 tx=0x7f4fb800ee00 comp rx=0 tx=0).stop 2024-09-04T16:30:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.080+0000 7f4fcccda640 1 -- 172.21.15.170:0/716718379 shutdown_connections 2024-09-04T16:30:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.080+0000 7f4fcccda640 1 --2- 172.21.15.170:0/716718379 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7f4fb0073f60 0x7f4fb0076420 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.080+0000 7f4fcccda640 1 --2- 172.21.15.170:0/716718379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4fc8101a70 0x7f4fc8197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.080+0000 7f4fcccda640 1 --2- 172.21.15.170:0/716718379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fc8100870 0x7f4fc81974c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.080+0000 7f4fcccda640 1 -- 172.21.15.170:0/716718379 >> 172.21.15.170:0/716718379 conn(0x7f4fc80fc020 msgr2=0x7f4fc806a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.080+0000 7f4fcccda640 1 -- 172.21.15.170:0/716718379 shutdown_connections 2024-09-04T16:30:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.080+0000 7f4fcccda640 1 -- 172.21.15.170:0/716718379 wait complete. 2024-09-04T16:30:46.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.216+0000 7fec8ce47640 1 -- 172.21.15.170:0/3016627382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec88076ba0 msgr2=0x7fec88076fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:46.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.216+0000 7fec8ce47640 1 --2- 172.21.15.170:0/3016627382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec88076ba0 0x7fec88076fa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec80009c20 tx=0x7fec8002a9a0 comp rx=0 tx=0).stop 2024-09-04T16:30:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.217+0000 7fec8ce47640 1 -- 172.21.15.170:0/3016627382 shutdown_connections 2024-09-04T16:30:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.217+0000 7fec8ce47640 1 --2- 172.21.15.170:0/3016627382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec88077df0 0x7fec88078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.217+0000 7fec8ce47640 1 --2- 172.21.15.170:0/3016627382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec88076ba0 0x7fec88076fa0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.217+0000 7fec8ce47640 1 -- 172.21.15.170:0/3016627382 >> 172.21.15.170:0/3016627382 conn(0x7fec880ff310 msgr2=0x7fec88101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.218+0000 7fec8ce47640 1 -- 172.21.15.170:0/3016627382 shutdown_connections 2024-09-04T16:30:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.218+0000 7fec8ce47640 1 -- 172.21.15.170:0/3016627382 wait complete. 2024-09-04T16:30:46.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.219+0000 7fec8ce47640 1 Processor -- start 2024-09-04T16:30:46.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.219+0000 7fec8ce47640 1 -- start start 2024-09-04T16:30:46.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.219+0000 7fec8ce47640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec88076ba0 0x7fec8819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:46.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.219+0000 7fec8ce47640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec88077df0 0x7fec8819e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:46.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.219+0000 7fec8ce47640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fec88110e10 con 0x7fec88077df0 2024-09-04T16:30:46.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.219+0000 7fec8ce47640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fec88110c90 con 0x7fec88076ba0 2024-09-04T16:30:46.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.219+0000 7fec85d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec88077df0 0x7fec8819e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:46.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.219+0000 7fec85d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec88077df0 0x7fec8819e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:39648/0 (socket says 172.21.15.170:39648) 2024-09-04T16:30:46.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.219+0000 7fec85d9b640 1 -- 172.21.15.170:0/3022065549 learned_addr learned my addr 172.21.15.170:0/3022065549 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:30:46.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.219+0000 7fec8659c640 1 --2- 172.21.15.170:0/3022065549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec88076ba0 0x7fec8819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:46.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.220+0000 7fec85d9b640 1 -- 172.21.15.170:0/3022065549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec88076ba0 msgr2=0x7fec8819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:46.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.220+0000 7fec85d9b640 1 --2- 172.21.15.170:0/3022065549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec88076ba0 0x7fec8819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:46.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.220+0000 7fec85d9b640 1 -- 172.21.15.170:0/3022065549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec8819e760 con 0x7fec88077df0 2024-09-04T16:30:46.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.220+0000 7fec85d9b640 1 --2- 172.21.15.170:0/3022065549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec88077df0 0x7fec8819e0e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00b420 tx=0x7fec7c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:46.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.220+0000 7fec777fe640 1 -- 172.21.15.170:0/3022065549 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec7c011630 con 0x7fec88077df0 2024-09-04T16:30:46.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.220+0000 7fec777fe640 1 -- 172.21.15.170:0/3022065549 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fec7c016070 con 0x7fec88077df0 2024-09-04T16:30:46.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.220+0000 7fec8ce47640 1 -- 172.21.15.170:0/3022065549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec881a31a0 con 0x7fec88077df0 2024-09-04T16:30:46.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.222+0000 7fec777fe640 1 -- 172.21.15.170:0/3022065549 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec7c010d40 con 0x7fec88077df0 2024-09-04T16:30:46.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.222+0000 7fec8ce47640 1 -- 172.21.15.170:0/3022065549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec881a37b0 con 0x7fec88077df0 2024-09-04T16:30:46.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.223+0000 7fec777fe640 1 -- 172.21.15.170:0/3022065549 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 25) ==== 97250+0+0 (secure 0 0 0) 0x7fec7c01b460 con 0x7fec88077df0 2024-09-04T16:30:46.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.223+0000 7fec8ce47640 1 -- 172.21.15.170:0/3022065549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec88077020 con 0x7fec88077df0 2024-09-04T16:30:46.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.224+0000 7fec777fe640 1 --2- 172.21.15.170:0/3022065549 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fec70073df0 0x7fec700762b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:30:46.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.225+0000 7fec8659c640 1 --2- 172.21.15.170:0/3022065549 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fec70073df0 0x7fec700762b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:30:46.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.225+0000 7fec777fe640 1 -- 172.21.15.170:0/3022065549 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fec7c094910 con 0x7fec88077df0 2024-09-04T16:30:46.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.225+0000 7fec8659c640 1 --2- 172.21.15.170:0/3022065549 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fec70073df0 0x7fec700762b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fec80006010 tx=0x7fec80004a80 comp rx=0 tx=0).ready entity=mgr.14682 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:30:46.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.231+0000 7fec777fe640 1 -- 172.21.15.170:0/3022065549 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fec7c020060 con 0x7fec88077df0 2024-09-04T16:30:46.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.520+0000 7fec8ce47640 1 -- 172.21.15.170:0/3022065549 --> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fec88062630 con 0x7fec70073df0 2024-09-04T16:30:46.521 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:46 smithi170 ceph-mon[29272]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:30:46.521 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:46 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/716718379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:30:46.521 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:46 smithi170 ceph-mon[29272]: pgmap v43: 65 pgs: 65 active+clean; 2.8 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 38 MiB/s rd, 92 MiB/s wr, 263 op/s 2024-09-04T16:30:46.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.521+0000 7fec777fe640 1 -- 172.21.15.170:0/3022065549 <== mgr.14682 v2:172.21.15.193:6828/4218378172 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7fec88062630 con 0x7fec70073df0 2024-09-04T16:30:46.522 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:30:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:30:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:30:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-04T16:30:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [], 2024-09-04T16:30:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "1/2 daemons upgraded", 2024-09-04T16:30:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mgr daemons", 2024-09-04T16:30:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:30:46.522 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:30:46.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.523+0000 7fec8ce47640 1 -- 172.21.15.170:0/3022065549 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fec70073df0 msgr2=0x7fec700762b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:46.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.523+0000 7fec8ce47640 1 --2- 172.21.15.170:0/3022065549 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fec70073df0 0x7fec700762b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fec80006010 tx=0x7fec80004a80 comp rx=0 tx=0).stop 2024-09-04T16:30:46.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.523+0000 7fec8ce47640 1 -- 172.21.15.170:0/3022065549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec88077df0 msgr2=0x7fec8819e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:30:46.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.523+0000 7fec8ce47640 1 --2- 172.21.15.170:0/3022065549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec88077df0 0x7fec8819e0e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00b420 tx=0x7fec7c00b8e0 comp rx=0 tx=0).stop 2024-09-04T16:30:46.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.524+0000 7fec8ce47640 1 -- 172.21.15.170:0/3022065549 shutdown_connections 2024-09-04T16:30:46.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.524+0000 7fec8ce47640 1 --2- 172.21.15.170:0/3022065549 >> [v2:172.21.15.193:6828/4218378172,v1:172.21.15.193:6829/4218378172] conn(0x7fec70073df0 0x7fec700762b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:46.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.524+0000 7fec8ce47640 1 --2- 172.21.15.170:0/3022065549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec88077df0 0x7fec8819e0e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:46.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.524+0000 7fec8ce47640 1 --2- 172.21.15.170:0/3022065549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec88076ba0 0x7fec8819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:30:46.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.524+0000 7fec8ce47640 1 -- 172.21.15.170:0/3022065549 >> 172.21.15.170:0/3022065549 conn(0x7fec880ff310 msgr2=0x7fec8810e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:30:46.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.524+0000 7fec8ce47640 1 -- 172.21.15.170:0/3022065549 shutdown_connections 2024-09-04T16:30:46.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:30:46.524+0000 7fec8ce47640 1 -- 172.21.15.170:0/3022065549 wait complete. 2024-09-04T16:30:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:46 smithi193 ceph-mon[36288]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:30:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:46 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/716718379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:30:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:46 smithi193 ceph-mon[36288]: pgmap v43: 65 pgs: 65 active+clean; 2.8 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 38 MiB/s rd, 92 MiB/s wr, 263 op/s 2024-09-04T16:30:47.349 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:47 smithi170 ceph-mon[29272]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:30:47.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:47 smithi193 ceph-mon[36288]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:30:48.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:48 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:48.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:48 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:48.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:48 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:30:48.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:48 smithi170 ceph-mon[29272]: pgmap v44: 65 pgs: 65 active+clean; 2.2 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 40 MiB/s rd, 100 MiB/s wr, 338 op/s 2024-09-04T16:30:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:48 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:48 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:48 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:30:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:48 smithi193 ceph-mon[36288]: pgmap v44: 65 pgs: 65 active+clean; 2.2 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 40 MiB/s rd, 100 MiB/s wr, 338 op/s 2024-09-04T16:30:51.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:51 smithi170 ceph-mon[29272]: pgmap v45: 65 pgs: 65 active+clean; 2.2 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 16 MiB/s rd, 53 MiB/s wr, 194 op/s 2024-09-04T16:30:51.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:51 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:51.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:51 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:51 smithi193 ceph-mon[36288]: pgmap v45: 65 pgs: 65 active+clean; 2.2 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 16 MiB/s rd, 53 MiB/s wr, 194 op/s 2024-09-04T16:30:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:51 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:51 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:53.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:53 smithi170 ceph-mon[29272]: pgmap v46: 65 pgs: 65 active+clean; 2.2 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 16 MiB/s rd, 53 MiB/s wr, 194 op/s 2024-09-04T16:30:53.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:53 smithi193 ceph-mon[36288]: pgmap v46: 65 pgs: 65 active+clean; 2.2 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 16 MiB/s rd, 53 MiB/s wr, 194 op/s 2024-09-04T16:30:54.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:54 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:54.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:54 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:54.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:54 smithi170 ceph-mon[29272]: pgmap v47: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 16 MiB/s rd, 54 MiB/s wr, 248 op/s 2024-09-04T16:30:54.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:54 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:54.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:54 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:54 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:54 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:54 smithi193 ceph-mon[36288]: pgmap v47: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 16 MiB/s rd, 54 MiB/s wr, 248 op/s 2024-09-04T16:30:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:54 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:54 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:55.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:55 smithi170 ceph-mon[29272]: Standby manager daemon smithi170.fbszap restarted 2024-09-04T16:30:55.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:55 smithi170 ceph-mon[29272]: Standby manager daemon smithi170.fbszap started 2024-09-04T16:30:55.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:55 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.fbszap/crt"}]: dispatch 2024-09-04T16:30:55.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:55 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-04T16:30:55.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:55 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.fbszap/key"}]: dispatch 2024-09-04T16:30:55.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:55 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-04T16:30:55.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:55 smithi193 ceph-mon[36288]: Standby manager daemon smithi170.fbszap restarted 2024-09-04T16:30:55.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:55 smithi193 ceph-mon[36288]: Standby manager daemon smithi170.fbszap started 2024-09-04T16:30:55.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:55 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.fbszap/crt"}]: dispatch 2024-09-04T16:30:55.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:55 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-04T16:30:55.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:55 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.fbszap/key"}]: dispatch 2024-09-04T16:30:55.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:55 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-04T16:30:56.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:56 smithi193 ceph-mon[36288]: mgrmap e26: smithi193.gvfizn(active, since 89s), standbys: smithi170.fbszap 2024-09-04T16:30:56.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:56 smithi193 ceph-mon[36288]: pgmap v48: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 1.9 MiB/s rd, 8.0 MiB/s wr, 128 op/s 2024-09-04T16:30:56.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:56 smithi170 ceph-mon[29272]: mgrmap e26: smithi193.gvfizn(active, since 89s), standbys: smithi170.fbszap 2024-09-04T16:30:56.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:56 smithi170 ceph-mon[29272]: pgmap v48: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 1.9 MiB/s rd, 8.0 MiB/s wr, 128 op/s 2024-09-04T16:30:57.774 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:57 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:30:57.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:57 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:30:59.494 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:59.494 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:59.494 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:30:59.494 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:30:59.495 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:59.495 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: pgmap v49: 65 pgs: 65 active+clean; 1.1 GiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 1.9 MiB/s rd, 8.7 MiB/s wr, 182 op/s 2024-09-04T16:30:59.495 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:30:59.495 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mgr fail", "who": "smithi193.gvfizn"}]: dispatch 2024-09-04T16:30:59.495 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mgr fail", "who": "smithi193.gvfizn"}]: dispatch 2024-09-04T16:30:59.495 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: Activating manager daemon smithi170.fbszap 2024-09-04T16:30:59.495 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd='[{"prefix": "mgr fail", "who": "smithi193.gvfizn"}]': finished 2024-09-04T16:30:59.495 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: osdmap e47: 6 total, 6 up, 6 in 2024-09-04T16:30:59.495 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: mgrmap e27: smithi170.fbszap(active, starting, since 0.00597441s) 2024-09-04T16:30:59.495 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-09-04T16:30:59.495 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:30:59.495 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.zkhdil"}]: dispatch 2024-09-04T16:30:59.495 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.rzbrux"}]: dispatch 2024-09-04T16:30:59.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi193.kabapr"}]: dispatch 2024-09-04T16:30:59.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi193.xostco"}]: dispatch 2024-09-04T16:30:59.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr metadata", "who": "smithi170.fbszap", "id": "smithi170.fbszap"}]: dispatch 2024-09-04T16:30:59.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-04T16:30:59.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-04T16:30:59.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-04T16:30:59.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-04T16:30:59.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-04T16:30:59.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-04T16:30:59.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-04T16:30:59.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-04T16:30:59.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-04T16:30:59.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: Manager daemon smithi170.fbszap is now available 2024-09-04T16:30:59.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:30:59.497 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:30:59.497 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:30:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-04T16:30:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:59.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:30:59.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:30:59.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' 2024-09-04T16:30:59.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: pgmap v49: 65 pgs: 65 active+clean; 1.1 GiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 1.9 MiB/s rd, 8.7 MiB/s wr, 182 op/s 2024-09-04T16:30:59.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:30:59.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14682 172.21.15.193:0/4241079240' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mgr fail", "who": "smithi193.gvfizn"}]: dispatch 2024-09-04T16:30:59.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "mgr fail", "who": "smithi193.gvfizn"}]: dispatch 2024-09-04T16:30:59.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: Activating manager daemon smithi170.fbszap 2024-09-04T16:30:59.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14682 ' entity='mgr.smithi193.gvfizn' cmd='[{"prefix": "mgr fail", "who": "smithi193.gvfizn"}]': finished 2024-09-04T16:30:59.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: osdmap e47: 6 total, 6 up, 6 in 2024-09-04T16:30:59.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: mgrmap e27: smithi170.fbszap(active, starting, since 0.00597441s) 2024-09-04T16:30:59.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-09-04T16:30:59.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:30:59.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.zkhdil"}]: dispatch 2024-09-04T16:30:59.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.rzbrux"}]: dispatch 2024-09-04T16:30:59.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi193.kabapr"}]: dispatch 2024-09-04T16:30:59.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi193.xostco"}]: dispatch 2024-09-04T16:30:59.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr metadata", "who": "smithi170.fbszap", "id": "smithi170.fbszap"}]: dispatch 2024-09-04T16:30:59.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-04T16:30:59.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-04T16:30:59.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-04T16:30:59.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-04T16:30:59.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-04T16:30:59.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-04T16:30:59.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-04T16:30:59.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-04T16:30:59.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-04T16:30:59.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: Manager daemon smithi170.fbszap is now available 2024-09-04T16:30:59.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:30:59.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:30:59.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:30:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-04T16:31:00.486 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:00 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.fbszap/mirror_snapshot_schedule"}]: dispatch 2024-09-04T16:31:00.486 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:00 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.fbszap/trash_purge_schedule"}]: dispatch 2024-09-04T16:31:00.486 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:00 smithi170 ceph-mon[29272]: mgrmap e28: smithi170.fbszap(active, since 1.01524s) 2024-09-04T16:31:00.486 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:00 smithi170 ceph-mon[29272]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-04T16:31:00.486 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:00 smithi170 ceph-mon[29272]: pgmap v3: 65 pgs: 65 active+clean; 857 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail 2024-09-04T16:31:00.598 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:00 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.fbszap/mirror_snapshot_schedule"}]: dispatch 2024-09-04T16:31:00.598 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:00 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.fbszap/trash_purge_schedule"}]: dispatch 2024-09-04T16:31:00.598 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:00 smithi193 ceph-mon[36288]: mgrmap e28: smithi170.fbszap(active, since 1.01524s) 2024-09-04T16:31:00.598 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:00 smithi193 ceph-mon[36288]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-04T16:31:00.599 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:00 smithi193 ceph-mon[36288]: pgmap v3: 65 pgs: 65 active+clean; 857 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail 2024-09-04T16:31:01.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:01 smithi170 ceph-mon[29272]: [04/Sep/2024:16:31:00] ENGINE Bus STARTING 2024-09-04T16:31:01.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:01 smithi193 ceph-mon[36288]: [04/Sep/2024:16:31:00] ENGINE Bus STARTING 2024-09-04T16:31:02.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:02 smithi170 ceph-mon[29272]: [04/Sep/2024:16:31:00] ENGINE Serving on http://172.21.15.170:8765 2024-09-04T16:31:02.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:02 smithi170 ceph-mon[29272]: [04/Sep/2024:16:31:00] ENGINE Serving on https://172.21.15.170:7150 2024-09-04T16:31:02.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:02 smithi170 ceph-mon[29272]: [04/Sep/2024:16:31:00] ENGINE Bus STARTED 2024-09-04T16:31:02.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:02 smithi170 ceph-mon[29272]: [04/Sep/2024:16:31:00] ENGINE Error in HTTPServer.serve 2024-09-04T16:31:02.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Traceback (most recent call last): 2024-09-04T16:31:02.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-04T16:31:02.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self._connections.run(self.expiration_interval) 2024-09-04T16:31:02.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-04T16:31:02.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self._run(expiration_interval) 2024-09-04T16:31:02.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-04T16:31:02.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-04T16:31:02.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-04T16:31:02.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-04T16:31:02.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-04T16:31:02.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: s = self.context.wrap_socket( 2024-09-04T16:31:02.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-04T16:31:02.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: return self.sslsocket_class._create( 2024-09-04T16:31:02.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-04T16:31:02.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self.do_handshake() 2024-09-04T16:31:02.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-04T16:31:02.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: self._sslobj.do_handshake() 2024-09-04T16:31:02.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-04T16:31:02.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:02 smithi170 ceph-mon[29272]: mgrmap e29: smithi170.fbszap(active, since 3s) 2024-09-04T16:31:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:02 smithi193 ceph-mon[36288]: [04/Sep/2024:16:31:00] ENGINE Serving on http://172.21.15.170:8765 2024-09-04T16:31:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:02 smithi193 ceph-mon[36288]: [04/Sep/2024:16:31:00] ENGINE Serving on https://172.21.15.170:7150 2024-09-04T16:31:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:02 smithi193 ceph-mon[36288]: [04/Sep/2024:16:31:00] ENGINE Bus STARTED 2024-09-04T16:31:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:02 smithi193 ceph-mon[36288]: [04/Sep/2024:16:31:00] ENGINE Error in HTTPServer.serve 2024-09-04T16:31:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Traceback (most recent call last): 2024-09-04T16:31:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-04T16:31:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: self._connections.run(self.expiration_interval) 2024-09-04T16:31:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-04T16:31:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: self._run(expiration_interval) 2024-09-04T16:31:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-04T16:31:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-04T16:31:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-04T16:31:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-04T16:31:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-04T16:31:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: s = self.context.wrap_socket( 2024-09-04T16:31:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-04T16:31:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: return self.sslsocket_class._create( 2024-09-04T16:31:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-04T16:31:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: self.do_handshake() 2024-09-04T16:31:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-04T16:31:02.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: self._sslobj.do_handshake() 2024-09-04T16:31:02.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-04T16:31:02.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:02 smithi193 ceph-mon[36288]: mgrmap e29: smithi170.fbszap(active, since 3s) 2024-09-04T16:31:03.502 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:03 smithi170 ceph-mon[29272]: pgmap v5: 65 pgs: 65 active+clean; 857 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail 2024-09-04T16:31:03.503 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:03 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:03.503 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:03 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:03.527 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-04T16:31:03.527 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-04T16:31:03.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:03 smithi193 ceph-mon[36288]: pgmap v5: 65 pgs: 65 active+clean; 857 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail 2024-09-04T16:31:03.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:03 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:03.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:03 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:04 smithi170 ceph-mon[29272]: mgrmap e30: smithi170.fbszap(active, since 5s) 2024-09-04T16:31:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:04 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:04 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:04 smithi193 ceph-mon[36288]: mgrmap e30: smithi170.fbszap(active, since 5s) 2024-09-04T16:31:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:04 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:04 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:05.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:05 smithi170 ceph-mon[29272]: pgmap v6: 65 pgs: 65 active+clean; 857 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail 2024-09-04T16:31:05.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:05 smithi170 ceph-mon[29272]: Standby manager daemon smithi193.gvfizn started 2024-09-04T16:31:05.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:05 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.193:0/2641042054' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi193.gvfizn/crt"}]: dispatch 2024-09-04T16:31:05.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:05 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.193:0/2641042054' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-04T16:31:05.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:05 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.193:0/2641042054' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi193.gvfizn/key"}]: dispatch 2024-09-04T16:31:05.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:05 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.193:0/2641042054' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-04T16:31:05.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:05 smithi193 ceph-mon[36288]: pgmap v6: 65 pgs: 65 active+clean; 857 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail 2024-09-04T16:31:05.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:05 smithi193 ceph-mon[36288]: Standby manager daemon smithi193.gvfizn started 2024-09-04T16:31:05.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:05 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.193:0/2641042054' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi193.gvfizn/crt"}]: dispatch 2024-09-04T16:31:05.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:05 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.193:0/2641042054' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-04T16:31:05.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:05 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.193:0/2641042054' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi193.gvfizn/key"}]: dispatch 2024-09-04T16:31:05.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:05 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.193:0/2641042054' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-04T16:31:06.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:06 smithi170 ceph-mon[29272]: mgrmap e31: smithi170.fbszap(active, since 7s), standbys: smithi193.gvfizn 2024-09-04T16:31:06.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:06 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr metadata", "who": "smithi193.gvfizn", "id": "smithi193.gvfizn"}]: dispatch 2024-09-04T16:31:06.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:06 smithi193 ceph-mon[36288]: mgrmap e31: smithi170.fbszap(active, since 7s), standbys: smithi193.gvfizn 2024-09-04T16:31:06.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:06 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr metadata", "who": "smithi193.gvfizn", "id": "smithi193.gvfizn"}]: dispatch 2024-09-04T16:31:07.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:07 smithi170 ceph-mon[29272]: pgmap v7: 65 pgs: 65 active+clean; 416 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 1.2 MiB/s wr, 101 op/s 2024-09-04T16:31:07.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:07 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:07.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:07 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:07.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:07 smithi193 ceph-mon[36288]: pgmap v7: 65 pgs: 65 active+clean; 416 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 1.2 MiB/s wr, 101 op/s 2024-09-04T16:31:07.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:07 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:07.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:07 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:09.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:08 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:09.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:08 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:09.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:08 smithi170 ceph-mon[29272]: pgmap v8: 65 pgs: 65 active+clean; 416 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 920 KiB/s wr, 78 op/s 2024-09-04T16:31:09.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:08 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:09.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:08 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:09.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:08 smithi193 ceph-mon[36288]: pgmap v8: 65 pgs: 65 active+clean; 416 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 920 KiB/s wr, 78 op/s 2024-09-04T16:31:11.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:11 smithi193 ceph-mon[36288]: pgmap v9: 65 pgs: 65 active+clean; 289 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 1.5 MiB/s wr, 122 op/s 2024-09-04T16:31:11.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:11 smithi170 ceph-mon[29272]: pgmap v9: 65 pgs: 65 active+clean; 289 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 1.5 MiB/s wr, 122 op/s 2024-09-04T16:31:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:13 smithi193 ceph-mon[36288]: pgmap v10: 65 pgs: 65 active+clean; 289 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.4 MiB/s wr, 112 op/s 2024-09-04T16:31:13.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:13 smithi170 ceph-mon[29272]: pgmap v10: 65 pgs: 65 active+clean; 289 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.4 MiB/s wr, 112 op/s 2024-09-04T16:31:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:14 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:31:14.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:14 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:31:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:15 smithi193 ceph-mon[36288]: pgmap v11: 65 pgs: 65 active+clean; 289 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.4 MiB/s wr, 112 op/s 2024-09-04T16:31:15.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:15 smithi170 ceph-mon[29272]: pgmap v11: 65 pgs: 65 active+clean; 289 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.4 MiB/s wr, 112 op/s 2024-09-04T16:31:16.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.623+0000 7f8ad9a15640 1 -- 172.21.15.170:0/3140151876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ad4100b60 msgr2=0x7f8ad4100fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:16.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.623+0000 7f8ad9a15640 1 --2- 172.21.15.170:0/3140151876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ad4100b60 0x7f8ad4100fc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009880 tx=0x7f8ac802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:31:16.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.623+0000 7f8ad9a15640 1 -- 172.21.15.170:0/3140151876 shutdown_connections 2024-09-04T16:31:16.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.623+0000 7f8ad9a15640 1 --2- 172.21.15.170:0/3140151876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ad4100b60 0x7f8ad4100fc0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:16.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.623+0000 7f8ad9a15640 1 --2- 172.21.15.170:0/3140151876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ad4100220 0x7f8ad4100620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:16.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.623+0000 7f8ad9a15640 1 -- 172.21.15.170:0/3140151876 >> 172.21.15.170:0/3140151876 conn(0x7f8ad40fbff0 msgr2=0x7f8ad40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:16.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.623+0000 7f8ad9a15640 1 -- 172.21.15.170:0/3140151876 shutdown_connections 2024-09-04T16:31:16.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.623+0000 7f8ad9a15640 1 -- 172.21.15.170:0/3140151876 wait complete. 2024-09-04T16:31:16.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.624+0000 7f8ad9a15640 1 Processor -- start 2024-09-04T16:31:16.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.624+0000 7f8ad9a15640 1 -- start start 2024-09-04T16:31:16.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.624+0000 7f8ad9a15640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ad4100220 0x7f8ad4199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:16.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.624+0000 7f8ad9a15640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ad4100b60 0x7f8ad4199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:16.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.624+0000 7f8ad9a15640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad410c970 con 0x7f8ad4100220 2024-09-04T16:31:16.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.624+0000 7f8ad9a15640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad410c7f0 con 0x7f8ad4100b60 2024-09-04T16:31:16.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.624+0000 7f8ad2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ad4100220 0x7f8ad4199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:16.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.625+0000 7f8ad2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ad4100220 0x7f8ad4199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56172/0 (socket says 172.21.15.170:56172) 2024-09-04T16:31:16.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.625+0000 7f8ad2ffd640 1 -- 172.21.15.170:0/1063235012 learned_addr learned my addr 172.21.15.170:0/1063235012 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:31:16.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.625+0000 7f8ad27fc640 1 --2- 172.21.15.170:0/1063235012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ad4100b60 0x7f8ad4199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:16.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.625+0000 7f8ad27fc640 1 -- 172.21.15.170:0/1063235012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ad4100220 msgr2=0x7f8ad4199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:16.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.625+0000 7f8ad27fc640 1 --2- 172.21.15.170:0/1063235012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ad4100220 0x7f8ad4199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:16.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.625+0000 7f8ad27fc640 1 -- 172.21.15.170:0/1063235012 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad419a220 con 0x7f8ad4100b60 2024-09-04T16:31:16.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.625+0000 7f8ad2ffd640 1 --2- 172.21.15.170:0/1063235012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ad4100220 0x7f8ad4199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:31:16.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.625+0000 7f8ad27fc640 1 --2- 172.21.15.170:0/1063235012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ad4100b60 0x7f8ad4199ba0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8006010 tx=0x7f8ac80045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:16.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.625+0000 7f8ad8a13640 1 -- 172.21.15.170:0/1063235012 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ac803f070 con 0x7f8ad4100b60 2024-09-04T16:31:16.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.625+0000 7f8ad9a15640 1 -- 172.21.15.170:0/1063235012 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad419ec00 con 0x7f8ad4100b60 2024-09-04T16:31:16.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.625+0000 7f8ad8a13640 1 -- 172.21.15.170:0/1063235012 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ac80049d0 con 0x7f8ad4100b60 2024-09-04T16:31:16.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.626+0000 7f8ad8a13640 1 -- 172.21.15.170:0/1063235012 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ac8035030 con 0x7f8ad4100b60 2024-09-04T16:31:16.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.626+0000 7f8ad9a15640 1 -- 172.21.15.170:0/1063235012 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad419f190 con 0x7f8ad4100b60 2024-09-04T16:31:16.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.627+0000 7f8ad8a13640 1 -- 172.21.15.170:0/1063235012 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 31) ==== 102200+0+0 (secure 0 0 0) 0x7f8ac8042070 con 0x7f8ad4100b60 2024-09-04T16:31:16.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.627+0000 7f8ad9a15640 1 -- 172.21.15.170:0/1063235012 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad4100620 con 0x7f8ad4100b60 2024-09-04T16:31:16.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.628+0000 7f8ad8a13640 1 --2- 172.21.15.170:0/1063235012 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8abc079fb0 0x7f8abc07c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:16.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.628+0000 7f8ad8a13640 1 -- 172.21.15.170:0/1063235012 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f8ac80bd5c0 con 0x7f8ad4100b60 2024-09-04T16:31:16.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.628+0000 7f8ad2ffd640 1 --2- 172.21.15.170:0/1063235012 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8abc079fb0 0x7f8abc07c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:16.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.628+0000 7f8ad2ffd640 1 --2- 172.21.15.170:0/1063235012 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8abc079fb0 0x7f8abc07c470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4011500 tx=0x7f8ac4005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:16.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.632+0000 7f8ad8a13640 1 -- 172.21.15.170:0/1063235012 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f8ac8089050 con 0x7f8ad4100b60 2024-09-04T16:31:16.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.919+0000 7f8ad9a15640 1 -- 172.21.15.170:0/1063235012 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8ad4062630 con 0x7f8abc079fb0 2024-09-04T16:31:16.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.922+0000 7f8ad8a13640 1 -- 172.21.15.170:0/1063235012 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f8ad4062630 con 0x7f8abc079fb0 2024-09-04T16:31:16.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.926+0000 7f8ad9a15640 1 -- 172.21.15.170:0/1063235012 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8abc079fb0 msgr2=0x7f8abc07c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:16.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.926+0000 7f8ad9a15640 1 --2- 172.21.15.170:0/1063235012 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8abc079fb0 0x7f8abc07c470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4011500 tx=0x7f8ac4005f90 comp rx=0 tx=0).stop 2024-09-04T16:31:16.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.926+0000 7f8ad9a15640 1 -- 172.21.15.170:0/1063235012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ad4100b60 msgr2=0x7f8ad4199ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:16.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.926+0000 7f8ad9a15640 1 --2- 172.21.15.170:0/1063235012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ad4100b60 0x7f8ad4199ba0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8006010 tx=0x7f8ac80045e0 comp rx=0 tx=0).stop 2024-09-04T16:31:16.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.926+0000 7f8ad9a15640 1 -- 172.21.15.170:0/1063235012 shutdown_connections 2024-09-04T16:31:16.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.926+0000 7f8ad9a15640 1 --2- 172.21.15.170:0/1063235012 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8abc079fb0 0x7f8abc07c470 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:16.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.926+0000 7f8ad9a15640 1 --2- 172.21.15.170:0/1063235012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ad4100b60 0x7f8ad4199ba0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:16.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.926+0000 7f8ad9a15640 1 --2- 172.21.15.170:0/1063235012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ad4100220 0x7f8ad4199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:16.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.926+0000 7f8ad9a15640 1 -- 172.21.15.170:0/1063235012 >> 172.21.15.170:0/1063235012 conn(0x7f8ad40fbff0 msgr2=0x7f8ad4108ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:16.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.927+0000 7f8ad9a15640 1 -- 172.21.15.170:0/1063235012 shutdown_connections 2024-09-04T16:31:16.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:16.927+0000 7f8ad9a15640 1 -- 172.21.15.170:0/1063235012 wait complete. 2024-09-04T16:31:16.942 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:31:17.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.038+0000 7f057df17640 1 -- 172.21.15.170:0/555405361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0578100870 msgr2=0x7f0578100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:17.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.038+0000 7f057df17640 1 --2- 172.21.15.170:0/555405361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0578100870 0x7f0578100c70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0568009880 tx=0x7f056802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.039+0000 7f057df17640 1 -- 172.21.15.170:0/555405361 shutdown_connections 2024-09-04T16:31:17.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.039+0000 7f057df17640 1 --2- 172.21.15.170:0/555405361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0578101a70 0x7f0578101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.039+0000 7f057df17640 1 --2- 172.21.15.170:0/555405361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0578100870 0x7f0578100c70 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.039+0000 7f057df17640 1 -- 172.21.15.170:0/555405361 >> 172.21.15.170:0/555405361 conn(0x7f05780fc020 msgr2=0x7f05780fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:17.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.039+0000 7f057df17640 1 -- 172.21.15.170:0/555405361 shutdown_connections 2024-09-04T16:31:17.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.039+0000 7f057df17640 1 -- 172.21.15.170:0/555405361 wait complete. 2024-09-04T16:31:17.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.039+0000 7f057df17640 1 Processor -- start 2024-09-04T16:31:17.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.040+0000 7f057df17640 1 -- start start 2024-09-04T16:31:17.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.040+0000 7f057df17640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0578100870 0x7f057806ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:17.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.040+0000 7f057df17640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0578101a70 0x7f057819c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:17.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.040+0000 7f057df17640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0578109690 con 0x7f0578100870 2024-09-04T16:31:17.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.040+0000 7f057df17640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0578109510 con 0x7f0578101a70 2024-09-04T16:31:17.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.040+0000 7f0576ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0578101a70 0x7f057819c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:17.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.040+0000 7f05777fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0578100870 0x7f057806ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:17.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.040+0000 7f0576ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0578101a70 0x7f057819c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.170:57630/0 (socket says 172.21.15.170:57630) 2024-09-04T16:31:17.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.040+0000 7f0576ffd640 1 -- 172.21.15.170:0/2146488099 learned_addr learned my addr 172.21.15.170:0/2146488099 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:31:17.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.040+0000 7f05777fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0578100870 0x7f057806ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56190/0 (socket says 172.21.15.170:56190) 2024-09-04T16:31:17.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.041+0000 7f0576ffd640 1 -- 172.21.15.170:0/2146488099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0578100870 msgr2=0x7f057806ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:17.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.041+0000 7f0576ffd640 1 --2- 172.21.15.170:0/2146488099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0578100870 0x7f057806ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.041+0000 7f0576ffd640 1 -- 172.21.15.170:0/2146488099 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057819c7a0 con 0x7f0578101a70 2024-09-04T16:31:17.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.041+0000 7f05777fe640 1 --2- 172.21.15.170:0/2146488099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0578100870 0x7f057806ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:31:17.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.041+0000 7f0576ffd640 1 --2- 172.21.15.170:0/2146488099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0578101a70 0x7f057819c1e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f056c00d900 tx=0x7f056c00ddc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:17.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.041+0000 7f0574ff9640 1 -- 172.21.15.170:0/2146488099 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f056c017030 con 0x7f0578101a70 2024-09-04T16:31:17.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.041+0000 7f057df17640 1 -- 172.21.15.170:0/2146488099 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f057819ca90 con 0x7f0578101a70 2024-09-04T16:31:17.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.041+0000 7f0574ff9640 1 -- 172.21.15.170:0/2146488099 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f056c004020 con 0x7f0578101a70 2024-09-04T16:31:17.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.041+0000 7f0574ff9640 1 -- 172.21.15.170:0/2146488099 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f056c005620 con 0x7f0578101a70 2024-09-04T16:31:17.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.041+0000 7f057df17640 1 -- 172.21.15.170:0/2146488099 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f057819d020 con 0x7f0578101a70 2024-09-04T16:31:17.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.043+0000 7f057df17640 1 -- 172.21.15.170:0/2146488099 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0578100c70 con 0x7f0578101a70 2024-09-04T16:31:17.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.043+0000 7f0574ff9640 1 -- 172.21.15.170:0/2146488099 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 31) ==== 102200+0+0 (secure 0 0 0) 0x7f056c009a30 con 0x7f0578101a70 2024-09-04T16:31:17.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.043+0000 7f0574ff9640 1 --2- 172.21.15.170:0/2146488099 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f056007a000 0x7f056007c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:17.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.044+0000 7f0574ff9640 1 -- 172.21.15.170:0/2146488099 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f056c018070 con 0x7f0578101a70 2024-09-04T16:31:17.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.044+0000 7f05777fe640 1 --2- 172.21.15.170:0/2146488099 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f056007a000 0x7f056007c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:17.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.044+0000 7f05777fe640 1 --2- 172.21.15.170:0/2146488099 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f056007a000 0x7f056007c4c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0568009230 tx=0x7f05680058d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:17.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.048+0000 7f0574ff9640 1 -- 172.21.15.170:0/2146488099 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f056c0642d0 con 0x7f0578101a70 2024-09-04T16:31:17.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.298+0000 7f057df17640 1 -- 172.21.15.170:0/2146488099 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0578062630 con 0x7f056007a000 2024-09-04T16:31:17.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.300+0000 7f0574ff9640 1 -- 172.21.15.170:0/2146488099 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f0578062630 con 0x7f056007a000 2024-09-04T16:31:17.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.302+0000 7f057df17640 1 -- 172.21.15.170:0/2146488099 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f056007a000 msgr2=0x7f056007c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.302+0000 7f057df17640 1 --2- 172.21.15.170:0/2146488099 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f056007a000 0x7f056007c4c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0568009230 tx=0x7f05680058d0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.302+0000 7f057df17640 1 -- 172.21.15.170:0/2146488099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0578101a70 msgr2=0x7f057819c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.302+0000 7f057df17640 1 --2- 172.21.15.170:0/2146488099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0578101a70 0x7f057819c1e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f056c00d900 tx=0x7f056c00ddc0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.302+0000 7f057df17640 1 -- 172.21.15.170:0/2146488099 shutdown_connections 2024-09-04T16:31:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.302+0000 7f057df17640 1 --2- 172.21.15.170:0/2146488099 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f056007a000 0x7f056007c4c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.302+0000 7f057df17640 1 --2- 172.21.15.170:0/2146488099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0578101a70 0x7f057819c1e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.302+0000 7f057df17640 1 --2- 172.21.15.170:0/2146488099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0578100870 0x7f057806ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.302+0000 7f057df17640 1 -- 172.21.15.170:0/2146488099 >> 172.21.15.170:0/2146488099 conn(0x7f05780fc020 msgr2=0x7f0578104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.302+0000 7f057df17640 1 -- 172.21.15.170:0/2146488099 shutdown_connections 2024-09-04T16:31:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.302+0000 7f057df17640 1 -- 172.21.15.170:0/2146488099 wait complete. 2024-09-04T16:31:17.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.391+0000 7fa4a409d640 1 -- 172.21.15.170:0/1320784788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa49c102430 msgr2=0x7fa49c104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:17.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.391+0000 7fa4a409d640 1 --2- 172.21.15.170:0/1320784788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa49c102430 0x7fa49c104820 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa498009880 tx=0x7fa49802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.391+0000 7fa4a409d640 1 -- 172.21.15.170:0/1320784788 shutdown_connections 2024-09-04T16:31:17.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.391+0000 7fa4a409d640 1 --2- 172.21.15.170:0/1320784788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa49c104d60 0x7fa49c107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.391+0000 7fa4a409d640 1 --2- 172.21.15.170:0/1320784788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa49c102430 0x7fa49c104820 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.391+0000 7fa4a409d640 1 -- 172.21.15.170:0/1320784788 >> 172.21.15.170:0/1320784788 conn(0x7fa49c0fbff0 msgr2=0x7fa49c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:17.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.391+0000 7fa4a409d640 1 -- 172.21.15.170:0/1320784788 shutdown_connections 2024-09-04T16:31:17.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.392+0000 7fa4a409d640 1 -- 172.21.15.170:0/1320784788 wait complete. 2024-09-04T16:31:17.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.392+0000 7fa4a409d640 1 Processor -- start 2024-09-04T16:31:17.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.392+0000 7fa4a409d640 1 -- start start 2024-09-04T16:31:17.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.392+0000 7fa4a409d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa49c102430 0x7fa49c197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:17.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.393+0000 7fa4a409d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa49c104d60 0x7fa49c1979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:17.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.393+0000 7fa4a409d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c10a750 con 0x7fa49c102430 2024-09-04T16:31:17.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.393+0000 7fa4a409d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c10a5d0 con 0x7fa49c104d60 2024-09-04T16:31:17.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.393+0000 7fa4a1e39640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa49c102430 0x7fa49c197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:17.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.393+0000 7fa4a1e39640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa49c102430 0x7fa49c197470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56210/0 (socket says 172.21.15.170:56210) 2024-09-04T16:31:17.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.393+0000 7fa4a1e39640 1 -- 172.21.15.170:0/2046463499 learned_addr learned my addr 172.21.15.170:0/2046463499 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:31:17.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.393+0000 7fa4a1638640 1 --2- 172.21.15.170:0/2046463499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa49c104d60 0x7fa49c1979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:17.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.393+0000 7fa4a1e39640 1 -- 172.21.15.170:0/2046463499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa49c104d60 msgr2=0x7fa49c1979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:17.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.393+0000 7fa4a1e39640 1 --2- 172.21.15.170:0/2046463499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa49c104d60 0x7fa49c1979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.393+0000 7fa4a1e39640 1 -- 172.21.15.170:0/2046463499 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c198030 con 0x7fa49c102430 2024-09-04T16:31:17.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.393+0000 7fa4a1638640 1 --2- 172.21.15.170:0/2046463499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa49c104d60 0x7fa49c1979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:31:17.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.393+0000 7fa4a1e39640 1 --2- 172.21.15.170:0/2046463499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa49c102430 0x7fa49c197470 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa498006010 tx=0x7fa498004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:17.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.393+0000 7fa492ffd640 1 -- 172.21.15.170:0/2046463499 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa49803f070 con 0x7fa49c102430 2024-09-04T16:31:17.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.393+0000 7fa492ffd640 1 -- 172.21.15.170:0/2046463499 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa4980049d0 con 0x7fa49c102430 2024-09-04T16:31:17.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.393+0000 7fa492ffd640 1 -- 172.21.15.170:0/2046463499 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa498035030 con 0x7fa49c102430 2024-09-04T16:31:17.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.393+0000 7fa4a409d640 1 -- 172.21.15.170:0/2046463499 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49c19ca70 con 0x7fa49c102430 2024-09-04T16:31:17.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.394+0000 7fa4a409d640 1 -- 172.21.15.170:0/2046463499 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49c19d000 con 0x7fa49c102430 2024-09-04T16:31:17.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.395+0000 7fa4a409d640 1 -- 172.21.15.170:0/2046463499 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa49c102810 con 0x7fa49c102430 2024-09-04T16:31:17.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.396+0000 7fa492ffd640 1 -- 172.21.15.170:0/2046463499 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 31) ==== 102200+0+0 (secure 0 0 0) 0x7fa498042070 con 0x7fa49c102430 2024-09-04T16:31:17.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.396+0000 7fa492ffd640 1 --2- 172.21.15.170:0/2046463499 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa488079fb0 0x7fa48807c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:17.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.396+0000 7fa492ffd640 1 -- 172.21.15.170:0/2046463499 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fa4980bd740 con 0x7fa49c102430 2024-09-04T16:31:17.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.396+0000 7fa4a1638640 1 --2- 172.21.15.170:0/2046463499 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa488079fb0 0x7fa48807c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:17.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.397+0000 7fa4a1638640 1 --2- 172.21.15.170:0/2046463499 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa488079fb0 0x7fa48807c470 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa49c198920 tx=0x7fa48c005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:17.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.405+0000 7fa492ffd640 1 -- 172.21.15.170:0/2046463499 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fa498089170 con 0x7fa49c102430 2024-09-04T16:31:17.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:17 smithi170 ceph-mon[29272]: pgmap v12: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58 KiB/s rd, 2.2 MiB/s wr, 145 op/s 2024-09-04T16:31:17.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:17 smithi193 ceph-mon[36288]: pgmap v12: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58 KiB/s rd, 2.2 MiB/s wr, 145 op/s 2024-09-04T16:31:17.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.667+0000 7fa4a409d640 1 -- 172.21.15.170:0/2046463499 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa49c1057c0 con 0x7fa488079fb0 2024-09-04T16:31:17.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.679+0000 7fa492ffd640 1 -- 172.21.15.170:0/2046463499 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fa49c1057c0 con 0x7fa488079fb0 2024-09-04T16:31:17.680 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:31:17.680 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (7m) 10s ago 9m 25.2M - 0.25.0 c8568f914cd2 e85db6a2e731 2024-09-04T16:31:17.680 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (86s) 10s ago 9m 8627k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:31:17.680 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (50s) 14s ago 8m 7968k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:31:17.680 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (9m) 10s ago 9m 6891k - 19.1.1-252-g48920dab b708f9119ac7 aa2ec5c5776a 2024-09-04T16:31:17.681 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (8m) 14s ago 8m 6895k - 19.1.1-252-g48920dab b708f9119ac7 a24f0ce3b3fb 2024-09-04T16:31:17.681 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (7m) 10s ago 8m 79.7M - 9.4.12 2bacad6d85d8 5bffd3332aba 2024-09-04T16:31:17.681 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (3m) 10s ago 3m 25.7M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:31:17.681 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (3m) 10s ago 3m 245M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:31:17.681 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (3m) 14s ago 3m 14.9M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:31:17.681 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (3m) 14s ago 3m 14.2M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:31:17.681 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (30s) 10s ago 10m 489M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:31:17.681 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (2m) 14s ago 8m 143M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 5d9c73a5a6dd 2024-09-04T16:31:17.681 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (10m) 10s ago 10m 57.3M 2048M 19.1.1-252-g48920dab b708f9119ac7 194ff39cc041 2024-09-04T16:31:17.681 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (8m) 14s ago 8m 43.9M 2048M 19.1.1-252-g48920dab b708f9119ac7 38c8e99ca323 2024-09-04T16:31:17.681 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (9m) 10s ago 9m 15.6M - 1.5.0 0da6a335fe13 e311ba1b18bc 2024-09-04T16:31:17.681 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (8m) 14s ago 8m 15.7M - 1.5.0 0da6a335fe13 09fd1aa1fdb6 2024-09-04T16:31:17.681 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (7m) 10s ago 7m 182M 1216M 19.1.1-252-g48920dab b708f9119ac7 6c2ea484615d 2024-09-04T16:31:17.682 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (6m) 10s ago 6m 194M 1216M 19.1.1-252-g48920dab b708f9119ac7 20469ba5727b 2024-09-04T16:31:17.682 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (6m) 10s ago 6m 153M 1216M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:31:17.682 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (5m) 14s ago 5m 206M 2240M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:31:17.682 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (5m) 14s ago 5m 185M 2240M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:31:17.682 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (4m) 14s ago 4m 163M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:31:17.682 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (59s) 10s ago 8m 44.7M - 2.43.0 a07b618ecd1d 50e895b6a22d 2024-09-04T16:31:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.681+0000 7fa4a409d640 1 -- 172.21.15.170:0/2046463499 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa488079fb0 msgr2=0x7fa48807c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.681+0000 7fa4a409d640 1 --2- 172.21.15.170:0/2046463499 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa488079fb0 0x7fa48807c470 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa49c198920 tx=0x7fa48c005f90 comp rx=0 tx=0).stop 2024-09-04T16:31:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.681+0000 7fa4a409d640 1 -- 172.21.15.170:0/2046463499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa49c102430 msgr2=0x7fa49c197470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.681+0000 7fa4a409d640 1 --2- 172.21.15.170:0/2046463499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa49c102430 0x7fa49c197470 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa498006010 tx=0x7fa498004570 comp rx=0 tx=0).stop 2024-09-04T16:31:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.681+0000 7fa4a409d640 1 -- 172.21.15.170:0/2046463499 shutdown_connections 2024-09-04T16:31:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.682+0000 7fa4a409d640 1 --2- 172.21.15.170:0/2046463499 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa488079fb0 0x7fa48807c470 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.682+0000 7fa4a409d640 1 --2- 172.21.15.170:0/2046463499 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa49c104d60 0x7fa49c1979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.682+0000 7fa4a409d640 1 --2- 172.21.15.170:0/2046463499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa49c102430 0x7fa49c197470 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.682+0000 7fa4a409d640 1 -- 172.21.15.170:0/2046463499 >> 172.21.15.170:0/2046463499 conn(0x7fa49c0fbff0 msgr2=0x7fa49c0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.682+0000 7fa4a409d640 1 -- 172.21.15.170:0/2046463499 shutdown_connections 2024-09-04T16:31:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.682+0000 7fa4a409d640 1 -- 172.21.15.170:0/2046463499 wait complete. 2024-09-04T16:31:17.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.802+0000 7f2d49a93640 1 -- 172.21.15.170:0/1735280090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d44104da0 msgr2=0x7f2d44107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:17.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.802+0000 7f2d49a93640 1 --2- 172.21.15.170:0/1735280090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d44104da0 0x7f2d44107190 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009880 tx=0x7f2d3802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.802+0000 7f2d49a93640 1 -- 172.21.15.170:0/1735280090 shutdown_connections 2024-09-04T16:31:17.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.802+0000 7f2d49a93640 1 --2- 172.21.15.170:0/1735280090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d44104da0 0x7f2d44107190 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.802+0000 7f2d49a93640 1 --2- 172.21.15.170:0/1735280090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d44102470 0x7f2d44104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.802+0000 7f2d49a93640 1 -- 172.21.15.170:0/1735280090 >> 172.21.15.170:0/1735280090 conn(0x7f2d440fbff0 msgr2=0x7f2d440fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:17.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.802+0000 7f2d49a93640 1 -- 172.21.15.170:0/1735280090 shutdown_connections 2024-09-04T16:31:17.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.802+0000 7f2d49a93640 1 -- 172.21.15.170:0/1735280090 wait complete. 2024-09-04T16:31:17.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.802+0000 7f2d49a93640 1 Processor -- start 2024-09-04T16:31:17.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.803+0000 7f2d49a93640 1 -- start start 2024-09-04T16:31:17.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.803+0000 7f2d49a93640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d44102470 0x7f2d44101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:17.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.803+0000 7f2d49a93640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d44104da0 0x7f2d44100420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:17.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.803+0000 7f2d49a93640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4410a780 con 0x7f2d44104da0 2024-09-04T16:31:17.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.803+0000 7f2d49a93640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4410a600 con 0x7f2d44102470 2024-09-04T16:31:17.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.803+0000 7f2d42ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d44104da0 0x7f2d44100420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:17.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.803+0000 7f2d42ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d44104da0 0x7f2d44100420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56234/0 (socket says 172.21.15.170:56234) 2024-09-04T16:31:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.803+0000 7f2d42ffd640 1 -- 172.21.15.170:0/2510400708 learned_addr learned my addr 172.21.15.170:0/2510400708 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:31:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.803+0000 7f2d437fe640 1 --2- 172.21.15.170:0/2510400708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d44102470 0x7f2d44101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.803+0000 7f2d42ffd640 1 -- 172.21.15.170:0/2510400708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d44102470 msgr2=0x7f2d44101d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.803+0000 7f2d42ffd640 1 --2- 172.21.15.170:0/2510400708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d44102470 0x7f2d44101d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.803+0000 7f2d42ffd640 1 -- 172.21.15.170:0/2510400708 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d44100960 con 0x7f2d44104da0 2024-09-04T16:31:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.803+0000 7f2d42ffd640 1 --2- 172.21.15.170:0/2510400708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d44104da0 0x7f2d44100420 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2d38006010 tx=0x7f2d380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.804+0000 7f2d40ff9640 1 -- 172.21.15.170:0/2510400708 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d3803f070 con 0x7f2d44104da0 2024-09-04T16:31:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.804+0000 7f2d40ff9640 1 -- 172.21.15.170:0/2510400708 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2d380044d0 con 0x7f2d44104da0 2024-09-04T16:31:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.804+0000 7f2d49a93640 1 -- 172.21.15.170:0/2510400708 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d44100bf0 con 0x7f2d44104da0 2024-09-04T16:31:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.804+0000 7f2d40ff9640 1 -- 172.21.15.170:0/2510400708 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d38035030 con 0x7f2d44104da0 2024-09-04T16:31:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.804+0000 7f2d49a93640 1 -- 172.21.15.170:0/2510400708 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d44101120 con 0x7f2d44104da0 2024-09-04T16:31:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.805+0000 7f2d49a93640 1 -- 172.21.15.170:0/2510400708 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d44102850 con 0x7f2d44104da0 2024-09-04T16:31:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.805+0000 7f2d40ff9640 1 -- 172.21.15.170:0/2510400708 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 31) ==== 102200+0+0 (secure 0 0 0) 0x7f2d38042070 con 0x7f2d44104da0 2024-09-04T16:31:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.806+0000 7f2d40ff9640 1 --2- 172.21.15.170:0/2510400708 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2d2c079f50 0x7f2d2c07c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.806+0000 7f2d40ff9640 1 -- 172.21.15.170:0/2510400708 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f2d380bd870 con 0x7f2d44104da0 2024-09-04T16:31:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.806+0000 7f2d437fe640 1 --2- 172.21.15.170:0/2510400708 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2d2c079f50 0x7f2d2c07c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.806+0000 7f2d437fe640 1 --2- 172.21.15.170:0/2510400708 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2d2c079f50 0x7f2d2c07c410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2d340058c0 tx=0x7f2d3400a250 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:17.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:17.810+0000 7f2d40ff9640 1 -- 172.21.15.170:0/2510400708 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f2d38089280 con 0x7f2d44104da0 2024-09-04T16:31:18.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.189+0000 7f2d49a93640 1 -- 172.21.15.170:0/2510400708 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f2d4419f680 con 0x7f2d44104da0 2024-09-04T16:31:18.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.189+0000 7f2d40ff9640 1 -- 172.21.15.170:0/2510400708 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f2d3808dca0 con 0x7f2d44104da0 2024-09-04T16:31:18.190 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:31:18.190 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:31:18.190 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 2 2024-09-04T16:31:18.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:31:18.190 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:31:18.190 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:31:18.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:31:18.190 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:31:18.190 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 6 2024-09-04T16:31:18.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:31:18.191 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:31:18.191 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:31:18.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:31:18.191 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:31:18.191 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 12, 2024-09-04T16:31:18.191 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:31:18.191 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:31:18.191 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:31:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.192+0000 7f2d49a93640 1 -- 172.21.15.170:0/2510400708 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2d2c079f50 msgr2=0x7f2d2c07c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.192+0000 7f2d49a93640 1 --2- 172.21.15.170:0/2510400708 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2d2c079f50 0x7f2d2c07c410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2d340058c0 tx=0x7f2d3400a250 comp rx=0 tx=0).stop 2024-09-04T16:31:18.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.192+0000 7f2d49a93640 1 -- 172.21.15.170:0/2510400708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d44104da0 msgr2=0x7f2d44100420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:18.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.192+0000 7f2d49a93640 1 --2- 172.21.15.170:0/2510400708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d44104da0 0x7f2d44100420 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2d38006010 tx=0x7f2d380048f0 comp rx=0 tx=0).stop 2024-09-04T16:31:18.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.192+0000 7f2d49a93640 1 -- 172.21.15.170:0/2510400708 shutdown_connections 2024-09-04T16:31:18.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.192+0000 7f2d49a93640 1 --2- 172.21.15.170:0/2510400708 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2d2c079f50 0x7f2d2c07c410 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:18.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.192+0000 7f2d49a93640 1 --2- 172.21.15.170:0/2510400708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d44104da0 0x7f2d44100420 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:18.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.192+0000 7f2d49a93640 1 --2- 172.21.15.170:0/2510400708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d44102470 0x7f2d44101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:18.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.192+0000 7f2d49a93640 1 -- 172.21.15.170:0/2510400708 >> 172.21.15.170:0/2510400708 conn(0x7f2d440fbff0 msgr2=0x7f2d440fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:18.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.192+0000 7f2d49a93640 1 -- 172.21.15.170:0/2510400708 shutdown_connections 2024-09-04T16:31:18.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.192+0000 7f2d49a93640 1 -- 172.21.15.170:0/2510400708 wait complete. 2024-09-04T16:31:18.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.286+0000 7fc766f75640 1 -- 172.21.15.170:0/1505252732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc760100840 msgr2=0x7fc760100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:18.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.286+0000 7fc766f75640 1 --2- 172.21.15.170:0/1505252732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc760100840 0x7fc760100c40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc754009880 tx=0x7fc75402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:31:18.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.286+0000 7fc766f75640 1 -- 172.21.15.170:0/1505252732 shutdown_connections 2024-09-04T16:31:18.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.286+0000 7fc766f75640 1 --2- 172.21.15.170:0/1505252732 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc760101a40 0x7fc760101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:18.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.286+0000 7fc766f75640 1 --2- 172.21.15.170:0/1505252732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc760100840 0x7fc760100c40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:18.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.286+0000 7fc766f75640 1 -- 172.21.15.170:0/1505252732 >> 172.21.15.170:0/1505252732 conn(0x7fc7600fbff0 msgr2=0x7fc7600fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:18.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.286+0000 7fc766f75640 1 -- 172.21.15.170:0/1505252732 shutdown_connections 2024-09-04T16:31:18.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.286+0000 7fc766f75640 1 -- 172.21.15.170:0/1505252732 wait complete. 2024-09-04T16:31:18.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.287+0000 7fc766f75640 1 Processor -- start 2024-09-04T16:31:18.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.287+0000 7fc766f75640 1 -- start start 2024-09-04T16:31:18.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.287+0000 7fc766f75640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc760100840 0x7fc76006a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:18.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.287+0000 7fc766f75640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc760101a40 0x7fc76019c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:18.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.287+0000 7fc766f75640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc7601096e0 con 0x7fc760101a40 2024-09-04T16:31:18.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.287+0000 7fc766f75640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc760109560 con 0x7fc760100840 2024-09-04T16:31:18.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.287+0000 7fc75ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc760101a40 0x7fc76019c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:18.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.287+0000 7fc75ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc760101a40 0x7fc76019c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56254/0 (socket says 172.21.15.170:56254) 2024-09-04T16:31:18.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.287+0000 7fc75ffff640 1 -- 172.21.15.170:0/2129790070 learned_addr learned my addr 172.21.15.170:0/2129790070 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:31:18.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.287+0000 7fc764d11640 1 --2- 172.21.15.170:0/2129790070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc760100840 0x7fc76006a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:18.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.287+0000 7fc75ffff640 1 -- 172.21.15.170:0/2129790070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc760100840 msgr2=0x7fc76006a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:18.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.287+0000 7fc75ffff640 1 --2- 172.21.15.170:0/2129790070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc760100840 0x7fc76006a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:18.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.287+0000 7fc75ffff640 1 -- 172.21.15.170:0/2129790070 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76019c830 con 0x7fc760101a40 2024-09-04T16:31:18.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.287+0000 7fc75ffff640 1 --2- 172.21.15.170:0/2129790070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc760101a40 0x7fc76019c270 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00b420 tx=0x7fc74c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:18.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.288+0000 7fc75dffb640 1 -- 172.21.15.170:0/2129790070 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc74c011630 con 0x7fc760101a40 2024-09-04T16:31:18.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.288+0000 7fc75dffb640 1 -- 172.21.15.170:0/2129790070 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc74c016070 con 0x7fc760101a40 2024-09-04T16:31:18.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.288+0000 7fc766f75640 1 -- 172.21.15.170:0/2129790070 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc76019cb20 con 0x7fc760101a40 2024-09-04T16:31:18.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.288+0000 7fc75dffb640 1 -- 172.21.15.170:0/2129790070 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc74c010d30 con 0x7fc760101a40 2024-09-04T16:31:18.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.288+0000 7fc766f75640 1 -- 172.21.15.170:0/2129790070 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc76019d130 con 0x7fc760101a40 2024-09-04T16:31:18.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.289+0000 7fc766f75640 1 -- 172.21.15.170:0/2129790070 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc760100c40 con 0x7fc760101a40 2024-09-04T16:31:18.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.289+0000 7fc75dffb640 1 -- 172.21.15.170:0/2129790070 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 31) ==== 102200+0+0 (secure 0 0 0) 0x7fc74c01b460 con 0x7fc760101a40 2024-09-04T16:31:18.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.290+0000 7fc75dffb640 1 --2- 172.21.15.170:0/2129790070 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc750079fb0 0x7fc75007c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:18.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.290+0000 7fc75dffb640 1 -- 172.21.15.170:0/2129790070 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fc74c09c320 con 0x7fc760101a40 2024-09-04T16:31:18.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.290+0000 7fc764d11640 1 --2- 172.21.15.170:0/2129790070 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc750079fb0 0x7fc75007c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:18.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.291+0000 7fc764d11640 1 --2- 172.21.15.170:0/2129790070 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc750079fb0 0x7fc75007c470 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc754009230 tx=0x7fc7540058d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:18.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.295+0000 7fc75dffb640 1 -- 172.21.15.170:0/2129790070 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fc74c063bb0 con 0x7fc760101a40 2024-09-04T16:31:18.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.534+0000 7fc766f75640 1 -- 172.21.15.170:0/2129790070 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc760062630 con 0x7fc750079fb0 2024-09-04T16:31:18.535 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:18 smithi170 ceph-mon[29272]: from='client.24507 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:31:18.535 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:18 smithi170 ceph-mon[29272]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:31:18.535 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:18 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2510400708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:18.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.535+0000 7fc75dffb640 1 -- 172.21.15.170:0/2129790070 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7fc760062630 con 0x7fc750079fb0 2024-09-04T16:31:18.535 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:31:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:31:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:31:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-04T16:31:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:31:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-04T16:31:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:31:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "2/2 daemons upgraded", 2024-09-04T16:31:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "", 2024-09-04T16:31:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:31:18.536 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:31:18.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.538+0000 7fc766f75640 1 -- 172.21.15.170:0/2129790070 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc750079fb0 msgr2=0x7fc75007c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:18.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.538+0000 7fc766f75640 1 --2- 172.21.15.170:0/2129790070 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc750079fb0 0x7fc75007c470 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc754009230 tx=0x7fc7540058d0 comp rx=0 tx=0).stop 2024-09-04T16:31:18.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.538+0000 7fc766f75640 1 -- 172.21.15.170:0/2129790070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc760101a40 msgr2=0x7fc76019c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:18.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.538+0000 7fc766f75640 1 --2- 172.21.15.170:0/2129790070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc760101a40 0x7fc76019c270 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00b420 tx=0x7fc74c00b8e0 comp rx=0 tx=0).stop 2024-09-04T16:31:18.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.538+0000 7fc766f75640 1 -- 172.21.15.170:0/2129790070 shutdown_connections 2024-09-04T16:31:18.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.538+0000 7fc766f75640 1 --2- 172.21.15.170:0/2129790070 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc750079fb0 0x7fc75007c470 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:18.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.538+0000 7fc766f75640 1 --2- 172.21.15.170:0/2129790070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc760101a40 0x7fc76019c270 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:18.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.538+0000 7fc766f75640 1 --2- 172.21.15.170:0/2129790070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc760100840 0x7fc76006a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:18.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.538+0000 7fc766f75640 1 -- 172.21.15.170:0/2129790070 >> 172.21.15.170:0/2129790070 conn(0x7fc7600fbff0 msgr2=0x7fc760104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:18.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.538+0000 7fc766f75640 1 -- 172.21.15.170:0/2129790070 shutdown_connections 2024-09-04T16:31:18.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:18.538+0000 7fc766f75640 1 -- 172.21.15.170:0/2129790070 wait complete. 2024-09-04T16:31:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:18 smithi193 ceph-mon[36288]: from='client.24507 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:31:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:18 smithi193 ceph-mon[36288]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:31:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:18 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2510400708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:19.586 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:19 smithi170 ceph-mon[29272]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:31:19.586 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:19 smithi170 ceph-mon[29272]: pgmap v13: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 86 op/s 2024-09-04T16:31:19.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:19 smithi193 ceph-mon[36288]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:31:19.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:19 smithi193 ceph-mon[36288]: pgmap v13: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 86 op/s 2024-09-04T16:31:20.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:20 smithi193 ceph-mon[36288]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:31:20.781 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:20 smithi170 ceph-mon[29272]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:31:21.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:21 smithi193 ceph-mon[36288]: pgmap v14: 65 pgs: 65 active+clean; 298 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 2.3 MiB/s wr, 128 op/s 2024-09-04T16:31:21.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:21 smithi170 ceph-mon[29272]: pgmap v14: 65 pgs: 65 active+clean; 298 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 2.3 MiB/s wr, 128 op/s 2024-09-04T16:31:22.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:22 smithi170 ceph-mon[29272]: pgmap v15: 65 pgs: 65 active+clean; 298 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 75 op/s 2024-09-04T16:31:22.854 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:22 smithi193 ceph-mon[36288]: pgmap v15: 65 pgs: 65 active+clean; 298 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 75 op/s 2024-09-04T16:31:25.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:25 smithi193 ceph-mon[36288]: pgmap v16: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 33 KiB/s rd, 1.8 MiB/s wr, 89 op/s 2024-09-04T16:31:25.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:25 smithi170 ceph-mon[29272]: pgmap v16: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 33 KiB/s rd, 1.8 MiB/s wr, 89 op/s 2024-09-04T16:31:27.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:27 smithi193 ceph-mon[36288]: pgmap v17: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 2.3 MiB/s wr, 113 op/s 2024-09-04T16:31:27.785 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:27 smithi170 ceph-mon[29272]: pgmap v17: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 2.3 MiB/s wr, 113 op/s 2024-09-04T16:31:29.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:28 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:29.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:28 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:29.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:28 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:31:29.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:28 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:31:29.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:28 smithi170 ceph-mon[29272]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-04T16:31:29.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:28 smithi170 ceph-mon[29272]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-04T16:31:29.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:28 smithi170 ceph-mon[29272]: Updating smithi193:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:31:29.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:28 smithi170 ceph-mon[29272]: Updating smithi170:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:31:29.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:28 smithi170 ceph-mon[29272]: pgmap v18: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 79 op/s 2024-09-04T16:31:29.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:28 smithi170 ceph-mon[29272]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-09-04T16:31:29.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:28 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:29.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:28 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:29.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:28 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:31:29.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:28 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:31:29.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:28 smithi193 ceph-mon[36288]: Updating smithi170:/etc/ceph/ceph.conf 2024-09-04T16:31:29.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:28 smithi193 ceph-mon[36288]: Updating smithi193:/etc/ceph/ceph.conf 2024-09-04T16:31:29.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:28 smithi193 ceph-mon[36288]: Updating smithi193:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:31:29.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:28 smithi193 ceph-mon[36288]: Updating smithi170:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-04T16:31:29.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:28 smithi193 ceph-mon[36288]: pgmap v18: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 79 op/s 2024-09-04T16:31:29.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:28 smithi193 ceph-mon[36288]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-09-04T16:31:30.287 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:29 smithi170 ceph-mon[29272]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-04T16:31:30.287 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:29 smithi170 ceph-mon[29272]: Updating smithi193:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-04T16:31:30.287 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:29 smithi170 ceph-mon[29272]: Updating smithi170:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-04T16:31:30.287 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:29 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:30.287 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:29 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:30.287 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:29 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:30.287 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:29 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:30.287 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:29 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:30.287 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:29 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:31:30.287 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:29 smithi170 ceph-mon[29272]: Reconfiguring prometheus.smithi170 (dependencies changed)... 2024-09-04T16:31:30.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:29 smithi193 ceph-mon[36288]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-09-04T16:31:30.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:29 smithi193 ceph-mon[36288]: Updating smithi193:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-04T16:31:30.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:29 smithi193 ceph-mon[36288]: Updating smithi170:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-04T16:31:30.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:29 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:30.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:29 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:30.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:29 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:30.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:29 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:30.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:29 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:30.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:29 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:31:30.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:29 smithi193 ceph-mon[36288]: Reconfiguring prometheus.smithi170 (dependencies changed)... 2024-09-04T16:31:31.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:30 smithi170 ceph-mon[29272]: Reconfiguring daemon prometheus.smithi170 on smithi170 2024-09-04T16:31:31.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:30 smithi170 ceph-mon[29272]: pgmap v19: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.3 MiB/s wr, 369 op/s 2024-09-04T16:31:31.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:30 smithi193 ceph-mon[36288]: Reconfiguring daemon prometheus.smithi170 on smithi170 2024-09-04T16:31:31.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:30 smithi193 ceph-mon[36288]: pgmap v19: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.3 MiB/s wr, 369 op/s 2024-09-04T16:31:33.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:33 smithi193 ceph-mon[36288]: pgmap v20: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 328 op/s 2024-09-04T16:31:33.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:33 smithi170 ceph-mon[29272]: pgmap v20: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 328 op/s 2024-09-04T16:31:35.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:35 smithi170 ceph-mon[29272]: pgmap v21: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.8 MiB/s wr, 417 op/s 2024-09-04T16:31:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:35 smithi193 ceph-mon[36288]: pgmap v21: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.8 MiB/s wr, 417 op/s 2024-09-04T16:31:37.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:37 smithi193 ceph-mon[36288]: pgmap v22: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.3 MiB/s wr, 535 op/s 2024-09-04T16:31:37.690 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:37 smithi170 ceph-mon[29272]: pgmap v22: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.3 MiB/s wr, 535 op/s 2024-09-04T16:31:39.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:39 smithi193 ceph-mon[36288]: pgmap v23: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.8 MiB/s wr, 512 op/s 2024-09-04T16:31:39.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:39 smithi170 ceph-mon[29272]: pgmap v23: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.8 MiB/s wr, 512 op/s 2024-09-04T16:31:41.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:41 smithi193 ceph-mon[36288]: pgmap v24: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.6 MiB/s wr, 629 op/s 2024-09-04T16:31:41.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:41 smithi170 ceph-mon[29272]: pgmap v24: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.6 MiB/s wr, 629 op/s 2024-09-04T16:31:43.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:43 smithi170 ceph-mon[29272]: pgmap v25: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.8 MiB/s wr, 339 op/s 2024-09-04T16:31:43.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:43 smithi193 ceph-mon[36288]: pgmap v25: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.8 MiB/s wr, 339 op/s 2024-09-04T16:31:44.636 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:44 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:31:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:44 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:31:45.650 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:45 smithi193 ceph-mon[36288]: pgmap v26: 65 pgs: 65 active+clean; 296 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 2.4 MiB/s wr, 402 op/s 2024-09-04T16:31:45.650 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:45 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:45.650 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:45 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:45.650 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:45 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-04T16:31:45.650 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:45 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:31:45.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:45 smithi170 ceph-mon[29272]: pgmap v26: 65 pgs: 65 active+clean; 296 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 2.4 MiB/s wr, 402 op/s 2024-09-04T16:31:45.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:45 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:45.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:45 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:45 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-04T16:31:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:45 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:31:46.653 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:46 smithi193 ceph-mon[36288]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-04T16:31:46.654 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:46 smithi193 ceph-mon[36288]: pgmap v27: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.1 MiB/s wr, 374 op/s 2024-09-04T16:31:46.788 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:46 smithi170 ceph-mon[29272]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-04T16:31:46.788 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:46 smithi170 ceph-mon[29272]: pgmap v27: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.1 MiB/s wr, 374 op/s 2024-09-04T16:31:47.506 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:47 smithi193 ceph-mon[36288]: Upgrade: Updating mgr.smithi193.gvfizn 2024-09-04T16:31:47.507 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:47 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi193.gvfizn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-04T16:31:47.507 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:47 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-04T16:31:47.507 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:47 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:31:47.507 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:47 smithi193 ceph-mon[36288]: Deploying daemon mgr.smithi193.gvfizn on smithi193 2024-09-04T16:31:47.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:47 smithi170 ceph-mon[29272]: Upgrade: Updating mgr.smithi193.gvfizn 2024-09-04T16:31:47.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:47 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi193.gvfizn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-04T16:31:47.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:47 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-04T16:31:47.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:47 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:31:47.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:47 smithi170 ceph-mon[29272]: Deploying daemon mgr.smithi193.gvfizn on smithi193 2024-09-04T16:31:48.535 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:48 smithi193 ceph-mon[36288]: pgmap v28: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 241 op/s 2024-09-04T16:31:48.669 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:48 smithi170 ceph-mon[29272]: pgmap v28: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 241 op/s 2024-09-04T16:31:48.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.668+0000 7fda508a2640 1 -- 172.21.15.170:0/2168884290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda4c101a40 msgr2=0x7fda4c101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:48.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.668+0000 7fda508a2640 1 --2- 172.21.15.170:0/2168884290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda4c101a40 0x7fda4c101ec0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fda340097e0 tx=0x7fda3402a3f0 comp rx=0 tx=0).stop 2024-09-04T16:31:48.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.668+0000 7fda508a2640 1 -- 172.21.15.170:0/2168884290 shutdown_connections 2024-09-04T16:31:48.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.668+0000 7fda508a2640 1 --2- 172.21.15.170:0/2168884290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda4c101a40 0x7fda4c101ec0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:48.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.668+0000 7fda508a2640 1 --2- 172.21.15.170:0/2168884290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda4c100840 0x7fda4c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:48.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.668+0000 7fda508a2640 1 -- 172.21.15.170:0/2168884290 >> 172.21.15.170:0/2168884290 conn(0x7fda4c0fbff0 msgr2=0x7fda4c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:48.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.669+0000 7fda508a2640 1 -- 172.21.15.170:0/2168884290 shutdown_connections 2024-09-04T16:31:48.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.669+0000 7fda508a2640 1 -- 172.21.15.170:0/2168884290 wait complete. 2024-09-04T16:31:48.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.670+0000 7fda508a2640 1 Processor -- start 2024-09-04T16:31:48.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.670+0000 7fda508a2640 1 -- start start 2024-09-04T16:31:48.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.670+0000 7fda508a2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda4c100840 0x7fda4c196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:48.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.670+0000 7fda508a2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda4c101a40 0x7fda4c1968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:48.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.670+0000 7fda508a2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fda4c109660 con 0x7fda4c100840 2024-09-04T16:31:48.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.670+0000 7fda508a2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fda4c1094e0 con 0x7fda4c101a40 2024-09-04T16:31:48.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.671+0000 7fda43fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda4c101a40 0x7fda4c1968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:48.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.671+0000 7fda4a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda4c100840 0x7fda4c196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:48.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.671+0000 7fda43fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda4c101a40 0x7fda4c1968a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.170:48850/0 (socket says 172.21.15.170:48850) 2024-09-04T16:31:48.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.671+0000 7fda43fff640 1 -- 172.21.15.170:0/366621356 learned_addr learned my addr 172.21.15.170:0/366621356 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:31:48.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.671+0000 7fda43fff640 1 -- 172.21.15.170:0/366621356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda4c100840 msgr2=0x7fda4c196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:48.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.671+0000 7fda43fff640 1 --2- 172.21.15.170:0/366621356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda4c100840 0x7fda4c196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:48.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.671+0000 7fda43fff640 1 -- 172.21.15.170:0/366621356 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda4c196f20 con 0x7fda4c101a40 2024-09-04T16:31:48.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.671+0000 7fda4a59c640 1 --2- 172.21.15.170:0/366621356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda4c100840 0x7fda4c196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:31:48.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.671+0000 7fda43fff640 1 --2- 172.21.15.170:0/366621356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda4c101a40 0x7fda4c1968a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda34009900 tx=0x7fda340043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:48.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.672+0000 7fda437fe640 1 -- 172.21.15.170:0/366621356 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda34048070 con 0x7fda4c101a40 2024-09-04T16:31:48.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.672+0000 7fda437fe640 1 -- 172.21.15.170:0/366621356 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda34030c00 con 0x7fda4c101a40 2024-09-04T16:31:48.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.672+0000 7fda437fe640 1 -- 172.21.15.170:0/366621356 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda34003cd0 con 0x7fda4c101a40 2024-09-04T16:31:48.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.672+0000 7fda508a2640 1 -- 172.21.15.170:0/366621356 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda4c069b30 con 0x7fda4c101a40 2024-09-04T16:31:48.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.672+0000 7fda508a2640 1 -- 172.21.15.170:0/366621356 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda4c06a0c0 con 0x7fda4c101a40 2024-09-04T16:31:48.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.673+0000 7fda508a2640 1 -- 172.21.15.170:0/366621356 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda4c109e40 con 0x7fda4c101a40 2024-09-04T16:31:48.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.674+0000 7fda437fe640 1 -- 172.21.15.170:0/366621356 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 31) ==== 102200+0+0 (secure 0 0 0) 0x7fda3404b070 con 0x7fda4c101a40 2024-09-04T16:31:48.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.675+0000 7fda437fe640 1 --2- 172.21.15.170:0/366621356 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fda2c079fb0 0x7fda2c07c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:48.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.675+0000 7fda437fe640 1 -- 172.21.15.170:0/366621356 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fda34040070 con 0x7fda4c101a40 2024-09-04T16:31:48.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.675+0000 7fda4a59c640 1 --2- 172.21.15.170:0/366621356 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fda2c079fb0 0x7fda2c07c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:48.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.676+0000 7fda4a59c640 1 --2- 172.21.15.170:0/366621356 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fda2c079fb0 0x7fda2c07c470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0096c0 tx=0x7fda3c009260 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:48.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.680+0000 7fda437fe640 1 -- 172.21.15.170:0/366621356 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fda3408ab40 con 0x7fda4c101a40 2024-09-04T16:31:48.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.948+0000 7fda508a2640 1 -- 172.21.15.170:0/366621356 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fda4c1904a0 con 0x7fda2c079fb0 2024-09-04T16:31:48.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.949+0000 7fda437fe640 1 -- 172.21.15.170:0/366621356 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7fda4c1904a0 con 0x7fda2c079fb0 2024-09-04T16:31:48.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.952+0000 7fda508a2640 1 -- 172.21.15.170:0/366621356 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fda2c079fb0 msgr2=0x7fda2c07c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:48.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.952+0000 7fda508a2640 1 --2- 172.21.15.170:0/366621356 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fda2c079fb0 0x7fda2c07c470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0096c0 tx=0x7fda3c009260 comp rx=0 tx=0).stop 2024-09-04T16:31:48.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.952+0000 7fda508a2640 1 -- 172.21.15.170:0/366621356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda4c101a40 msgr2=0x7fda4c1968a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:48.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.952+0000 7fda508a2640 1 --2- 172.21.15.170:0/366621356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda4c101a40 0x7fda4c1968a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda34009900 tx=0x7fda340043b0 comp rx=0 tx=0).stop 2024-09-04T16:31:48.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.952+0000 7fda508a2640 1 -- 172.21.15.170:0/366621356 shutdown_connections 2024-09-04T16:31:48.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.952+0000 7fda508a2640 1 --2- 172.21.15.170:0/366621356 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fda2c079fb0 0x7fda2c07c470 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:48.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.952+0000 7fda508a2640 1 --2- 172.21.15.170:0/366621356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda4c101a40 0x7fda4c1968a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:48.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.952+0000 7fda508a2640 1 --2- 172.21.15.170:0/366621356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda4c100840 0x7fda4c196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:48.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.952+0000 7fda508a2640 1 -- 172.21.15.170:0/366621356 >> 172.21.15.170:0/366621356 conn(0x7fda4c0fbff0 msgr2=0x7fda4c104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:48.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.952+0000 7fda508a2640 1 -- 172.21.15.170:0/366621356 shutdown_connections 2024-09-04T16:31:48.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:48.952+0000 7fda508a2640 1 -- 172.21.15.170:0/366621356 wait complete. 2024-09-04T16:31:48.965 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:31:49.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.060+0000 7f5fef217640 1 -- 172.21.15.170:0/794038563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fe8102410 msgr2=0x7f5fe8104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:49.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.060+0000 7f5fef217640 1 --2- 172.21.15.170:0/794038563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fe8102410 0x7f5fe8104800 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0098b0 tx=0x7f5fdc02a4d0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.060+0000 7f5fef217640 1 -- 172.21.15.170:0/794038563 shutdown_connections 2024-09-04T16:31:49.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.060+0000 7f5fef217640 1 --2- 172.21.15.170:0/794038563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fe8104d40 0x7f5fe8107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.060+0000 7f5fef217640 1 --2- 172.21.15.170:0/794038563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fe8102410 0x7f5fe8104800 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.060+0000 7f5fef217640 1 -- 172.21.15.170:0/794038563 >> 172.21.15.170:0/794038563 conn(0x7f5fe80fc010 msgr2=0x7f5fe80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:49.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.060+0000 7f5fef217640 1 -- 172.21.15.170:0/794038563 shutdown_connections 2024-09-04T16:31:49.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.060+0000 7f5fef217640 1 -- 172.21.15.170:0/794038563 wait complete. 2024-09-04T16:31:49.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.061+0000 7f5fef217640 1 Processor -- start 2024-09-04T16:31:49.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.061+0000 7f5fef217640 1 -- start start 2024-09-04T16:31:49.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.061+0000 7f5fef217640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fe8102410 0x7f5fe8197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:49.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.061+0000 7f5fef217640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fe8104d40 0x7f5fe8197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:49.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.061+0000 7f5fef217640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe810a800 con 0x7f5fe8102410 2024-09-04T16:31:49.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.061+0000 7f5fef217640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe810a680 con 0x7f5fe8104d40 2024-09-04T16:31:49.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.061+0000 7f5fecfb3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fe8102410 0x7f5fe8197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:49.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.061+0000 7f5fecfb3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fe8102410 0x7f5fe8197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33352/0 (socket says 172.21.15.170:33352) 2024-09-04T16:31:49.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.061+0000 7f5fecfb3640 1 -- 172.21.15.170:0/1545512953 learned_addr learned my addr 172.21.15.170:0/1545512953 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:31:49.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.061+0000 7f5fe7fff640 1 --2- 172.21.15.170:0/1545512953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fe8104d40 0x7f5fe8197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:49.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.062+0000 7f5fecfb3640 1 -- 172.21.15.170:0/1545512953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fe8104d40 msgr2=0x7f5fe8197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:49.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.062+0000 7f5fecfb3640 1 --2- 172.21.15.170:0/1545512953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fe8104d40 0x7f5fe8197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.062+0000 7f5fecfb3640 1 -- 172.21.15.170:0/1545512953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe8197ec0 con 0x7f5fe8102410 2024-09-04T16:31:49.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.062+0000 7f5fe7fff640 1 --2- 172.21.15.170:0/1545512953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fe8104d40 0x7f5fe8197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:31:49.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.062+0000 7f5fecfb3640 1 --2- 172.21.15.170:0/1545512953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fe8102410 0x7f5fe8197300 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009230 tx=0x7f5fdc005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:49.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.062+0000 7f5fe5ffb640 1 -- 172.21.15.170:0/1545512953 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fdc03f030 con 0x7f5fe8102410 2024-09-04T16:31:49.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.062+0000 7f5fef217640 1 -- 172.21.15.170:0/1545512953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe819c8a0 con 0x7f5fe8102410 2024-09-04T16:31:49.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.062+0000 7f5fe5ffb640 1 -- 172.21.15.170:0/1545512953 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5fdc004b80 con 0x7f5fe8102410 2024-09-04T16:31:49.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.062+0000 7f5fe5ffb640 1 -- 172.21.15.170:0/1545512953 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fdc035070 con 0x7f5fe8102410 2024-09-04T16:31:49.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.062+0000 7f5fef217640 1 -- 172.21.15.170:0/1545512953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe819ce30 con 0x7f5fe8102410 2024-09-04T16:31:49.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.064+0000 7f5fef217640 1 -- 172.21.15.170:0/1545512953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe819d150 con 0x7f5fe8102410 2024-09-04T16:31:49.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.064+0000 7f5fe5ffb640 1 -- 172.21.15.170:0/1545512953 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 31) ==== 102200+0+0 (secure 0 0 0) 0x7f5fdc042030 con 0x7f5fe8102410 2024-09-04T16:31:49.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.065+0000 7f5fe5ffb640 1 --2- 172.21.15.170:0/1545512953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5fd8079fa0 0x7f5fd807c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:49.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.065+0000 7f5fe5ffb640 1 -- 172.21.15.170:0/1545512953 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f5fdc040070 con 0x7f5fe8102410 2024-09-04T16:31:49.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.067+0000 7f5fe7fff640 1 --2- 172.21.15.170:0/1545512953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5fd8079fa0 0x7f5fd807c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:49.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.067+0000 7f5fe7fff640 1 --2- 172.21.15.170:0/1545512953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5fd8079fa0 0x7f5fd807c460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5fe81987b0 tx=0x7f5fd4005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:49.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.070+0000 7f5fe5ffb640 1 -- 172.21.15.170:0/1545512953 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f5fdc0890b0 con 0x7f5fe8102410 2024-09-04T16:31:49.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.337+0000 7f5fef217640 1 -- 172.21.15.170:0/1545512953 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5fe81055e0 con 0x7f5fd8079fa0 2024-09-04T16:31:49.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.338+0000 7f5fe5ffb640 1 -- 172.21.15.170:0/1545512953 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f5fe81055e0 con 0x7f5fd8079fa0 2024-09-04T16:31:49.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.341+0000 7f5fef217640 1 -- 172.21.15.170:0/1545512953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5fd8079fa0 msgr2=0x7f5fd807c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:49.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.341+0000 7f5fef217640 1 --2- 172.21.15.170:0/1545512953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5fd8079fa0 0x7f5fd807c460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5fe81987b0 tx=0x7f5fd4005f90 comp rx=0 tx=0).stop 2024-09-04T16:31:49.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.341+0000 7f5fef217640 1 -- 172.21.15.170:0/1545512953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fe8102410 msgr2=0x7f5fe8197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:49.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.341+0000 7f5fef217640 1 --2- 172.21.15.170:0/1545512953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fe8102410 0x7f5fe8197300 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009230 tx=0x7f5fdc005d50 comp rx=0 tx=0).stop 2024-09-04T16:31:49.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.341+0000 7f5fef217640 1 -- 172.21.15.170:0/1545512953 shutdown_connections 2024-09-04T16:31:49.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.341+0000 7f5fef217640 1 --2- 172.21.15.170:0/1545512953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5fd8079fa0 0x7f5fd807c460 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.341+0000 7f5fef217640 1 --2- 172.21.15.170:0/1545512953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fe8104d40 0x7f5fe8197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.341+0000 7f5fef217640 1 --2- 172.21.15.170:0/1545512953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fe8102410 0x7f5fe8197300 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.341+0000 7f5fef217640 1 -- 172.21.15.170:0/1545512953 >> 172.21.15.170:0/1545512953 conn(0x7f5fe80fc010 msgr2=0x7f5fe80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:49.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.342+0000 7f5fef217640 1 -- 172.21.15.170:0/1545512953 shutdown_connections 2024-09-04T16:31:49.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.342+0000 7f5fef217640 1 -- 172.21.15.170:0/1545512953 wait complete. 2024-09-04T16:31:49.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.450+0000 7ffa81043640 1 -- 172.21.15.170:0/853507457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa7c102b80 msgr2=0x7ffa7c103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:49.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.450+0000 7ffa81043640 1 --2- 172.21.15.170:0/853507457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa7c102b80 0x7ffa7c103000 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009880 tx=0x7ffa7002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.450+0000 7ffa81043640 1 -- 172.21.15.170:0/853507457 shutdown_connections 2024-09-04T16:31:49.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.450+0000 7ffa81043640 1 --2- 172.21.15.170:0/853507457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa7c102b80 0x7ffa7c103000 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.450+0000 7ffa81043640 1 --2- 172.21.15.170:0/853507457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa7c101980 0x7ffa7c101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.450+0000 7ffa81043640 1 -- 172.21.15.170:0/853507457 >> 172.21.15.170:0/853507457 conn(0x7ffa7c0fd110 msgr2=0x7ffa7c0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:49.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.450+0000 7ffa81043640 1 -- 172.21.15.170:0/853507457 shutdown_connections 2024-09-04T16:31:49.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.450+0000 7ffa81043640 1 -- 172.21.15.170:0/853507457 wait complete. 2024-09-04T16:31:49.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.451+0000 7ffa81043640 1 Processor -- start 2024-09-04T16:31:49.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.451+0000 7ffa81043640 1 -- start start 2024-09-04T16:31:49.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.452+0000 7ffa81043640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa7c101980 0x7ffa7c197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:49.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.452+0000 7ffa81043640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa7c102b80 0x7ffa7c1979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:49.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.452+0000 7ffa81043640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7c10a7a0 con 0x7ffa7c101980 2024-09-04T16:31:49.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.452+0000 7ffa81043640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7c10a620 con 0x7ffa7c102b80 2024-09-04T16:31:49.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.452+0000 7ffa7ad9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa7c101980 0x7ffa7c197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:49.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.452+0000 7ffa7ad9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa7c101980 0x7ffa7c197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33362/0 (socket says 172.21.15.170:33362) 2024-09-04T16:31:49.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.452+0000 7ffa7ad9d640 1 -- 172.21.15.170:0/1569144668 learned_addr learned my addr 172.21.15.170:0/1569144668 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:31:49.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.452+0000 7ffa7a59c640 1 --2- 172.21.15.170:0/1569144668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa7c102b80 0x7ffa7c1979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:49.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.452+0000 7ffa7ad9d640 1 -- 172.21.15.170:0/1569144668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa7c102b80 msgr2=0x7ffa7c1979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:49.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.452+0000 7ffa7ad9d640 1 --2- 172.21.15.170:0/1569144668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa7c102b80 0x7ffa7c1979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.452+0000 7ffa7ad9d640 1 -- 172.21.15.170:0/1569144668 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa7c198040 con 0x7ffa7c101980 2024-09-04T16:31:49.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.452+0000 7ffa7ad9d640 1 --2- 172.21.15.170:0/1569144668 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa7c101980 0x7ffa7c197480 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00e940 tx=0x7ffa6c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:49.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.453+0000 7ffa63fff640 1 -- 172.21.15.170:0/1569144668 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa6c00cac0 con 0x7ffa7c101980 2024-09-04T16:31:49.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.453+0000 7ffa63fff640 1 -- 172.21.15.170:0/1569144668 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa6c00cc60 con 0x7ffa7c101980 2024-09-04T16:31:49.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.453+0000 7ffa81043640 1 -- 172.21.15.170:0/1569144668 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa7c19ca80 con 0x7ffa7c101980 2024-09-04T16:31:49.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.453+0000 7ffa63fff640 1 -- 172.21.15.170:0/1569144668 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa6c003de0 con 0x7ffa7c101980 2024-09-04T16:31:49.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.453+0000 7ffa81043640 1 -- 172.21.15.170:0/1569144668 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa7c19cfe0 con 0x7ffa7c101980 2024-09-04T16:31:49.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.454+0000 7ffa61ffb640 1 -- 172.21.15.170:0/1569144668 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa7c10af80 con 0x7ffa7c101980 2024-09-04T16:31:49.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.455+0000 7ffa63fff640 1 -- 172.21.15.170:0/1569144668 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 31) ==== 102200+0+0 (secure 0 0 0) 0x7ffa6c003f80 con 0x7ffa7c101980 2024-09-04T16:31:49.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.455+0000 7ffa63fff640 1 --2- 172.21.15.170:0/1569144668 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffa64079f50 0x7ffa6407c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:49.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.455+0000 7ffa63fff640 1 -- 172.21.15.170:0/1569144668 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7ffa6c09d380 con 0x7ffa7c101980 2024-09-04T16:31:49.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.456+0000 7ffa7a59c640 1 --2- 172.21.15.170:0/1569144668 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffa64079f50 0x7ffa6407c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:49.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.456+0000 7ffa7a59c640 1 --2- 172.21.15.170:0/1569144668 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffa64079f50 0x7ffa6407c410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffa70000c00 tx=0x7ffa700058d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:49.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.461+0000 7ffa63fff640 1 -- 172.21.15.170:0/1569144668 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7ffa6c064c20 con 0x7ffa7c101980 2024-09-04T16:31:49.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:49 smithi170 ceph-mon[29272]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:31:49.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:49 smithi170 ceph-mon[29272]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:31:49.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:49 smithi193 ceph-mon[36288]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:31:49.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:49 smithi193 ceph-mon[36288]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:31:49.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.762+0000 7ffa61ffb640 1 -- 172.21.15.170:0/1569144668 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ffa7c062630 con 0x7ffa64079f50 2024-09-04T16:31:49.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.773+0000 7ffa63fff640 1 -- 172.21.15.170:0/1569144668 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7ffa7c062630 con 0x7ffa64079f50 2024-09-04T16:31:49.774 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:31:49.774 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (8m) 42s ago 9m 25.2M - 0.25.0 c8568f914cd2 e85db6a2e731 2024-09-04T16:31:49.774 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (118s) 42s ago 9m 8627k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:31:49.774 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (83s) 46s ago 8m 7968k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:31:49.774 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (9m) 42s ago 9m 6891k - 19.1.1-252-g48920dab b708f9119ac7 aa2ec5c5776a 2024-09-04T16:31:49.774 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (8m) 46s ago 8m 6895k - 19.1.1-252-g48920dab b708f9119ac7 a24f0ce3b3fb 2024-09-04T16:31:49.774 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (8m) 42s ago 9m 79.7M - 9.4.12 2bacad6d85d8 5bffd3332aba 2024-09-04T16:31:49.774 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (4m) 42s ago 4m 25.7M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:31:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (4m) 42s ago 4m 245M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:31:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (4m) 46s ago 4m 14.9M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:31:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (4m) 46s ago 4m 14.2M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:31:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (62s) 42s ago 10m 489M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:31:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (2m) 46s ago 8m 143M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 5d9c73a5a6dd 2024-09-04T16:31:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (11m) 42s ago 11m 57.3M 2048M 19.1.1-252-g48920dab b708f9119ac7 194ff39cc041 2024-09-04T16:31:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (8m) 46s ago 8m 43.9M 2048M 19.1.1-252-g48920dab b708f9119ac7 38c8e99ca323 2024-09-04T16:31:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (9m) 42s ago 9m 15.6M - 1.5.0 0da6a335fe13 e311ba1b18bc 2024-09-04T16:31:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (8m) 46s ago 8m 15.7M - 1.5.0 0da6a335fe13 09fd1aa1fdb6 2024-09-04T16:31:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (7m) 42s ago 7m 182M 1216M 19.1.1-252-g48920dab b708f9119ac7 6c2ea484615d 2024-09-04T16:31:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (7m) 42s ago 7m 194M 1216M 19.1.1-252-g48920dab b708f9119ac7 20469ba5727b 2024-09-04T16:31:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (6m) 42s ago 6m 153M 1216M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:31:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (6m) 46s ago 6m 206M 2240M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:31:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (5m) 46s ago 5m 185M 2240M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:31:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (5m) 46s ago 5m 163M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:31:49.776 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 starting - - - - 2024-09-04T16:31:49.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.776+0000 7ffa61ffb640 1 -- 172.21.15.170:0/1569144668 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffa64079f50 msgr2=0x7ffa6407c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:49.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.776+0000 7ffa61ffb640 1 --2- 172.21.15.170:0/1569144668 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffa64079f50 0x7ffa6407c410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffa70000c00 tx=0x7ffa700058d0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.776+0000 7ffa61ffb640 1 -- 172.21.15.170:0/1569144668 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa7c101980 msgr2=0x7ffa7c197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:49.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.776+0000 7ffa61ffb640 1 --2- 172.21.15.170:0/1569144668 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa7c101980 0x7ffa7c197480 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00e940 tx=0x7ffa6c00ee00 comp rx=0 tx=0).stop 2024-09-04T16:31:49.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.776+0000 7ffa61ffb640 1 -- 172.21.15.170:0/1569144668 shutdown_connections 2024-09-04T16:31:49.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.776+0000 7ffa61ffb640 1 --2- 172.21.15.170:0/1569144668 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffa64079f50 0x7ffa6407c410 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.776+0000 7ffa61ffb640 1 --2- 172.21.15.170:0/1569144668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffa7c102b80 0x7ffa7c1979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.776+0000 7ffa61ffb640 1 --2- 172.21.15.170:0/1569144668 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa7c101980 0x7ffa7c197480 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.776+0000 7ffa61ffb640 1 -- 172.21.15.170:0/1569144668 >> 172.21.15.170:0/1569144668 conn(0x7ffa7c0fd110 msgr2=0x7ffa7c106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:49.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.777+0000 7ffa61ffb640 1 -- 172.21.15.170:0/1569144668 shutdown_connections 2024-09-04T16:31:49.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.777+0000 7ffa61ffb640 1 -- 172.21.15.170:0/1569144668 wait complete. 2024-09-04T16:31:49.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.873+0000 7f4c233a2640 1 -- 172.21.15.170:0/2967299654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c1c102210 msgr2=0x7f4c1c104600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:49.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.873+0000 7f4c233a2640 1 --2- 172.21.15.170:0/2967299654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c1c102210 0x7f4c1c104600 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4c180098b0 tx=0x7f4c1802a4d0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.873+0000 7f4c233a2640 1 -- 172.21.15.170:0/2967299654 shutdown_connections 2024-09-04T16:31:49.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.873+0000 7f4c233a2640 1 --2- 172.21.15.170:0/2967299654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c1c104b40 0x7f4c1c106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.873+0000 7f4c233a2640 1 --2- 172.21.15.170:0/2967299654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c1c102210 0x7f4c1c104600 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.873+0000 7f4c233a2640 1 -- 172.21.15.170:0/2967299654 >> 172.21.15.170:0/2967299654 conn(0x7f4c1c0fbe10 msgr2=0x7f4c1c0fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:49.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.874+0000 7f4c233a2640 1 -- 172.21.15.170:0/2967299654 shutdown_connections 2024-09-04T16:31:49.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.874+0000 7f4c233a2640 1 -- 172.21.15.170:0/2967299654 wait complete. 2024-09-04T16:31:49.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.874+0000 7f4c233a2640 1 Processor -- start 2024-09-04T16:31:49.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.874+0000 7f4c233a2640 1 -- start start 2024-09-04T16:31:49.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.874+0000 7f4c233a2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c1c102210 0x7f4c1c101b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:49.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.874+0000 7f4c233a2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c1c104b40 0x7f4c1c1001c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:49.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.875+0000 7f4c233a2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1c10a5e0 con 0x7f4c1c102210 2024-09-04T16:31:49.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.875+0000 7f4c233a2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1c10a460 con 0x7f4c1c104b40 2024-09-04T16:31:49.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.875+0000 7f4c223a0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c1c102210 0x7f4c1c101b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:49.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.875+0000 7f4c223a0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c1c102210 0x7f4c1c101b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33376/0 (socket says 172.21.15.170:33376) 2024-09-04T16:31:49.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.875+0000 7f4c223a0640 1 -- 172.21.15.170:0/1714168856 learned_addr learned my addr 172.21.15.170:0/1714168856 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:31:49.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.875+0000 7f4c21b9f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c1c104b40 0x7f4c1c1001c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:49.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.875+0000 7f4c223a0640 1 -- 172.21.15.170:0/1714168856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c1c104b40 msgr2=0x7f4c1c1001c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:49.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.875+0000 7f4c223a0640 1 --2- 172.21.15.170:0/1714168856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c1c104b40 0x7f4c1c1001c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:49.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.875+0000 7f4c223a0640 1 -- 172.21.15.170:0/1714168856 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1c100700 con 0x7f4c1c102210 2024-09-04T16:31:49.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.875+0000 7f4c21b9f640 1 --2- 172.21.15.170:0/1714168856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c1c104b40 0x7f4c1c1001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:31:49.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.875+0000 7f4c223a0640 1 --2- 172.21.15.170:0/1714168856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c1c102210 0x7f4c1c101b00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4c180099d0 tx=0x7f4c180045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:49.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.876+0000 7f4c137fe640 1 -- 172.21.15.170:0/1714168856 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c1803f070 con 0x7f4c1c102210 2024-09-04T16:31:49.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.876+0000 7f4c233a2640 1 -- 172.21.15.170:0/1714168856 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1c100990 con 0x7f4c1c102210 2024-09-04T16:31:49.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.876+0000 7f4c137fe640 1 -- 172.21.15.170:0/1714168856 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4c180049d0 con 0x7f4c1c102210 2024-09-04T16:31:49.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.876+0000 7f4c137fe640 1 -- 172.21.15.170:0/1714168856 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c18035030 con 0x7f4c1c102210 2024-09-04T16:31:49.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.876+0000 7f4c233a2640 1 -- 172.21.15.170:0/1714168856 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c1c100ec0 con 0x7f4c1c102210 2024-09-04T16:31:49.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.877+0000 7f4c233a2640 1 -- 172.21.15.170:0/1714168856 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c1c1025f0 con 0x7f4c1c102210 2024-09-04T16:31:49.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.878+0000 7f4c137fe640 1 -- 172.21.15.170:0/1714168856 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 31) ==== 102200+0+0 (secure 0 0 0) 0x7f4c18042070 con 0x7f4c1c102210 2024-09-04T16:31:49.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.878+0000 7f4c137fe640 1 --2- 172.21.15.170:0/1714168856 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c08079fb0 0x7f4c0807c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:49.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.878+0000 7f4c137fe640 1 -- 172.21.15.170:0/1714168856 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f4c180bd6b0 con 0x7f4c1c102210 2024-09-04T16:31:49.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.878+0000 7f4c21b9f640 1 --2- 172.21.15.170:0/1714168856 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c08079fb0 0x7f4c0807c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:49.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.879+0000 7f4c21b9f640 1 --2- 172.21.15.170:0/1714168856 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c08079fb0 0x7f4c0807c470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c101880 tx=0x7f4c0c005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:49.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:49.883+0000 7f4c137fe640 1 -- 172.21.15.170:0/1714168856 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f4c18089140 con 0x7f4c1c102210 2024-09-04T16:31:50.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.227+0000 7f4c233a2640 1 -- 172.21.15.170:0/1714168856 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4c1c19f460 con 0x7f4c1c102210 2024-09-04T16:31:50.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.227+0000 7f4c137fe640 1 -- 172.21.15.170:0/1714168856 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f4c1808db60 con 0x7f4c1c102210 2024-09-04T16:31:50.228 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:31:50.228 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:31:50.228 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 2 2024-09-04T16:31:50.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:31:50.228 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:31:50.228 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:31:50.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:31:50.229 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:31:50.229 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 6 2024-09-04T16:31:50.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:31:50.229 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:31:50.229 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:31:50.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:31:50.229 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:31:50.229 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 12, 2024-09-04T16:31:50.229 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:31:50.229 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:31:50.229 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:31:50.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.230+0000 7f4c233a2640 1 -- 172.21.15.170:0/1714168856 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c08079fb0 msgr2=0x7f4c0807c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:50.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.230+0000 7f4c233a2640 1 --2- 172.21.15.170:0/1714168856 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c08079fb0 0x7f4c0807c470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c101880 tx=0x7f4c0c005f90 comp rx=0 tx=0).stop 2024-09-04T16:31:50.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.230+0000 7f4c233a2640 1 -- 172.21.15.170:0/1714168856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c1c102210 msgr2=0x7f4c1c101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:50.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.230+0000 7f4c233a2640 1 --2- 172.21.15.170:0/1714168856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c1c102210 0x7f4c1c101b00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4c180099d0 tx=0x7f4c180045e0 comp rx=0 tx=0).stop 2024-09-04T16:31:50.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.230+0000 7f4c233a2640 1 -- 172.21.15.170:0/1714168856 shutdown_connections 2024-09-04T16:31:50.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.230+0000 7f4c233a2640 1 --2- 172.21.15.170:0/1714168856 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c08079fb0 0x7f4c0807c470 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:50.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.230+0000 7f4c233a2640 1 --2- 172.21.15.170:0/1714168856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c1c104b40 0x7f4c1c1001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:50.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.230+0000 7f4c233a2640 1 --2- 172.21.15.170:0/1714168856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c1c102210 0x7f4c1c101b00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:50.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.230+0000 7f4c233a2640 1 -- 172.21.15.170:0/1714168856 >> 172.21.15.170:0/1714168856 conn(0x7f4c1c0fbe10 msgr2=0x7f4c1c0fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:50.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.230+0000 7f4c233a2640 1 -- 172.21.15.170:0/1714168856 shutdown_connections 2024-09-04T16:31:50.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.230+0000 7f4c233a2640 1 -- 172.21.15.170:0/1714168856 wait complete. 2024-09-04T16:31:50.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.336+0000 7f90d0d1c640 1 -- 172.21.15.170:0/4268415443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90cc100880 msgr2=0x7f90cc100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:50.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.336+0000 7f90d0d1c640 1 --2- 172.21.15.170:0/4268415443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90cc100880 0x7f90cc100c80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009880 tx=0x7f90bc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:31:50.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.336+0000 7f90d0d1c640 1 -- 172.21.15.170:0/4268415443 shutdown_connections 2024-09-04T16:31:50.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.336+0000 7f90d0d1c640 1 --2- 172.21.15.170:0/4268415443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90cc101a80 0x7f90cc101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:50.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.336+0000 7f90d0d1c640 1 --2- 172.21.15.170:0/4268415443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90cc100880 0x7f90cc100c80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:50.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.336+0000 7f90d0d1c640 1 -- 172.21.15.170:0/4268415443 >> 172.21.15.170:0/4268415443 conn(0x7f90cc0fc010 msgr2=0x7f90cc0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:50.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.336+0000 7f90d0d1c640 1 -- 172.21.15.170:0/4268415443 shutdown_connections 2024-09-04T16:31:50.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.336+0000 7f90d0d1c640 1 -- 172.21.15.170:0/4268415443 wait complete. 2024-09-04T16:31:50.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.337+0000 7f90d0d1c640 1 Processor -- start 2024-09-04T16:31:50.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.337+0000 7f90d0d1c640 1 -- start start 2024-09-04T16:31:50.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.338+0000 7f90d0d1c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90cc100880 0x7f90cc06ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:50.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.338+0000 7f90d0d1c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90cc101a80 0x7f90cc199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:50.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.338+0000 7f90d0d1c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc1096a0 con 0x7f90cc100880 2024-09-04T16:31:50.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.338+0000 7f90d0d1c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc109520 con 0x7f90cc101a80 2024-09-04T16:31:50.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.338+0000 7f90ca59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90cc100880 0x7f90cc06ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:50.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.338+0000 7f90c9d9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90cc101a80 0x7f90cc199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:50.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.338+0000 7f90ca59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90cc100880 0x7f90cc06ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33402/0 (socket says 172.21.15.170:33402) 2024-09-04T16:31:50.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.338+0000 7f90ca59c640 1 -- 172.21.15.170:0/2153940313 learned_addr learned my addr 172.21.15.170:0/2153940313 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:31:50.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.338+0000 7f90c9d9b640 1 -- 172.21.15.170:0/2153940313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90cc100880 msgr2=0x7f90cc06ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:50.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.338+0000 7f90c9d9b640 1 --2- 172.21.15.170:0/2153940313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90cc100880 0x7f90cc06ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:50.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.338+0000 7f90c9d9b640 1 -- 172.21.15.170:0/2153940313 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90cc19a580 con 0x7f90cc101a80 2024-09-04T16:31:50.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.338+0000 7f90ca59c640 1 --2- 172.21.15.170:0/2153940313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90cc100880 0x7f90cc06ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:31:50.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.338+0000 7f90c9d9b640 1 --2- 172.21.15.170:0/2153940313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90cc101a80 0x7f90cc199fc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f90c000d700 tx=0x7f90c000dbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:50.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.339+0000 7f90bb7fe640 1 -- 172.21.15.170:0/2153940313 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90c0017070 con 0x7f90cc101a80 2024-09-04T16:31:50.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.339+0000 7f90bb7fe640 1 -- 172.21.15.170:0/2153940313 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f90c00054e0 con 0x7f90cc101a80 2024-09-04T16:31:50.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.339+0000 7f90bb7fe640 1 -- 172.21.15.170:0/2153940313 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90c0009a60 con 0x7f90cc101a80 2024-09-04T16:31:50.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.339+0000 7f90d0d1c640 1 -- 172.21.15.170:0/2153940313 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90cc19a870 con 0x7f90cc101a80 2024-09-04T16:31:50.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.339+0000 7f90d0d1c640 1 -- 172.21.15.170:0/2153940313 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90cc19ae00 con 0x7f90cc101a80 2024-09-04T16:31:50.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.340+0000 7f90d0d1c640 1 -- 172.21.15.170:0/2153940313 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90cc100c80 con 0x7f90cc101a80 2024-09-04T16:31:50.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.341+0000 7f90bb7fe640 1 -- 172.21.15.170:0/2153940313 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 31) ==== 102200+0+0 (secure 0 0 0) 0x7f90c0009c90 con 0x7f90cc101a80 2024-09-04T16:31:50.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.341+0000 7f90bb7fe640 1 --2- 172.21.15.170:0/2153940313 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f90b407a000 0x7f90b407c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:31:50.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.341+0000 7f90bb7fe640 1 -- 172.21.15.170:0/2153940313 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f90c009c860 con 0x7f90cc101a80 2024-09-04T16:31:50.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.341+0000 7f90ca59c640 1 --2- 172.21.15.170:0/2153940313 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f90b407a000 0x7f90b407c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:31:50.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.342+0000 7f90ca59c640 1 --2- 172.21.15.170:0/2153940313 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f90b407a000 0x7f90b407c4c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0096c0 tx=0x7f90bc005a20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:31:50.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.346+0000 7f90bb7fe640 1 -- 172.21.15.170:0/2153940313 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f90c0064050 con 0x7f90cc101a80 2024-09-04T16:31:50.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:50 smithi170 ceph-mon[29272]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:31:50.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:50 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1714168856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:50.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:50 smithi170 ceph-mon[29272]: pgmap v29: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 2.1 MiB/s wr, 368 op/s 2024-09-04T16:31:50.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.652+0000 7f90d0d1c640 1 -- 172.21.15.170:0/2153940313 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f90cc190290 con 0x7f90b407a000 2024-09-04T16:31:50.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.653+0000 7f90bb7fe640 1 -- 172.21.15.170:0/2153940313 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f90cc190290 con 0x7f90b407a000 2024-09-04T16:31:50.654 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:31:50.654 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:31:50.654 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:31:50.654 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-04T16:31:50.654 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:31:50.654 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-04T16:31:50.654 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:31:50.654 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "2/2 daemons upgraded", 2024-09-04T16:31:50.654 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mgr daemons", 2024-09-04T16:31:50.655 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:31:50.655 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:31:50.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.656+0000 7f90d0d1c640 1 -- 172.21.15.170:0/2153940313 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f90b407a000 msgr2=0x7f90b407c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:50.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.656+0000 7f90d0d1c640 1 --2- 172.21.15.170:0/2153940313 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f90b407a000 0x7f90b407c4c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0096c0 tx=0x7f90bc005a20 comp rx=0 tx=0).stop 2024-09-04T16:31:50.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.656+0000 7f90d0d1c640 1 -- 172.21.15.170:0/2153940313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90cc101a80 msgr2=0x7f90cc199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:31:50.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.656+0000 7f90d0d1c640 1 --2- 172.21.15.170:0/2153940313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90cc101a80 0x7f90cc199fc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f90c000d700 tx=0x7f90c000dbc0 comp rx=0 tx=0).stop 2024-09-04T16:31:50.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.656+0000 7f90d0d1c640 1 -- 172.21.15.170:0/2153940313 shutdown_connections 2024-09-04T16:31:50.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.656+0000 7f90d0d1c640 1 --2- 172.21.15.170:0/2153940313 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f90b407a000 0x7f90b407c4c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:50.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.656+0000 7f90d0d1c640 1 --2- 172.21.15.170:0/2153940313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90cc101a80 0x7f90cc199fc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:50.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.656+0000 7f90d0d1c640 1 --2- 172.21.15.170:0/2153940313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90cc100880 0x7f90cc06ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:31:50.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.656+0000 7f90d0d1c640 1 -- 172.21.15.170:0/2153940313 >> 172.21.15.170:0/2153940313 conn(0x7f90cc0fc010 msgr2=0x7f90cc104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:31:50.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.656+0000 7f90d0d1c640 1 -- 172.21.15.170:0/2153940313 shutdown_connections 2024-09-04T16:31:50.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:31:50.656+0000 7f90d0d1c640 1 -- 172.21.15.170:0/2153940313 wait complete. 2024-09-04T16:31:50.676 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:50 smithi193 ceph-mon[36288]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:31:50.676 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:50 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1714168856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:50.676 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:50 smithi193 ceph-mon[36288]: pgmap v29: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 2.1 MiB/s wr, 368 op/s 2024-09-04T16:31:52.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:51 smithi170 ceph-mon[29272]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:31:52.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:51 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:52.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:51 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:52.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:51 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:31:52.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:51 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:52.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:51 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:52.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:51 smithi193 ceph-mon[36288]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:31:52.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:51 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:52.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:51 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:52.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:51 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:31:52.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:51 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:52.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:51 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:52.997 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:52 smithi193 ceph-mon[36288]: pgmap v30: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 250 op/s 2024-09-04T16:31:53.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:52 smithi170 ceph-mon[29272]: pgmap v30: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 250 op/s 2024-09-04T16:31:54.195 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-04T16:31:54.195 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-04T16:31:54.514 DEBUG:teuthology.parallel:result is None 2024-09-04T16:31:55.238 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:54 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:55.238 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:54 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:55.238 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:54 smithi193 ceph-mon[36288]: pgmap v31: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.5 MiB/s wr, 280 op/s 2024-09-04T16:31:55.238 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:54 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:55.238 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:54 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:55.340 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:54 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:55.340 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:54 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:55.341 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:54 smithi170 ceph-mon[29272]: pgmap v31: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.5 MiB/s wr, 280 op/s 2024-09-04T16:31:55.341 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:54 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:55.341 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:54 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:57.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:57 smithi193 ceph-mon[36288]: pgmap v32: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.4 MiB/s wr, 264 op/s 2024-09-04T16:31:57.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:57 smithi193 ceph-mon[36288]: Standby manager daemon smithi193.gvfizn restarted 2024-09-04T16:31:57.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:57 smithi193 ceph-mon[36288]: Standby manager daemon smithi193.gvfizn started 2024-09-04T16:31:57.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:57 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.193:0/1006790366' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi193.gvfizn/crt"}]: dispatch 2024-09-04T16:31:57.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:57 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.193:0/1006790366' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-04T16:31:57.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:57 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.193:0/1006790366' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi193.gvfizn/key"}]: dispatch 2024-09-04T16:31:57.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:57 smithi193 ceph-mon[36288]: from='mgr.? 172.21.15.193:0/1006790366' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-04T16:31:57.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:57 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:57.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:57 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:57.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:57 smithi170 ceph-mon[29272]: pgmap v32: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.4 MiB/s wr, 264 op/s 2024-09-04T16:31:57.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:57 smithi170 ceph-mon[29272]: Standby manager daemon smithi193.gvfizn restarted 2024-09-04T16:31:57.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:57 smithi170 ceph-mon[29272]: Standby manager daemon smithi193.gvfizn started 2024-09-04T16:31:57.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:57 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.193:0/1006790366' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi193.gvfizn/crt"}]: dispatch 2024-09-04T16:31:57.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:57 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.193:0/1006790366' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-04T16:31:57.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:57 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.193:0/1006790366' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi193.gvfizn/key"}]: dispatch 2024-09-04T16:31:57.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:57 smithi170 ceph-mon[29272]: from='mgr.? 172.21.15.193:0/1006790366' entity='mgr.smithi193.gvfizn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-04T16:31:57.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:57 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:57.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:57 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: mgrmap e32: smithi170.fbszap(active, since 59s), standbys: smithi193.gvfizn 2024-09-04T16:31:58.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:31:58.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:31:58.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:31:58.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:58.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi170.fbszap"}]: dispatch 2024-09-04T16:31:58.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi170.fbszap"}]': finished 2024-09-04T16:31:58.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi193.gvfizn"}]: dispatch 2024-09-04T16:31:58.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi193.gvfizn"}]': finished 2024-09-04T16:31:58.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:58.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:58.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:58.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:58.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:58.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:58.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:58 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.731 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: mgrmap e32: smithi170.fbszap(active, since 59s), standbys: smithi193.gvfizn 2024-09-04T16:31:58.732 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.732 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.732 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:31:58.732 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:31:58.732 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.732 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:31:58.732 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:58.732 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.732 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi170.fbszap"}]: dispatch 2024-09-04T16:31:58.732 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi170.fbszap"}]': finished 2024-09-04T16:31:58.732 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi193.gvfizn"}]: dispatch 2024-09-04T16:31:58.733 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi193.gvfizn"}]': finished 2024-09-04T16:31:58.733 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:58.733 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.733 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:58.733 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.733 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:58.733 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.733 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:58.733 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.733 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:58.733 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:58.733 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:31:58.733 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:58 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:31:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:59 smithi193 ceph-mon[36288]: Upgrade: Setting container_image for all mgr 2024-09-04T16:31:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:59 smithi193 ceph-mon[36288]: Upgrade: Setting container_image for all rgw 2024-09-04T16:31:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:59 smithi193 ceph-mon[36288]: Upgrade: Setting container_image for all rbd-mirror 2024-09-04T16:31:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:59 smithi193 ceph-mon[36288]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-04T16:31:59.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:59 smithi193 ceph-mon[36288]: Upgrade: Setting container_image for all iscsi 2024-09-04T16:31:59.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:59 smithi193 ceph-mon[36288]: Upgrade: Setting container_image for all nfs 2024-09-04T16:31:59.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:59 smithi193 ceph-mon[36288]: Upgrade: Setting container_image for all nvmeof 2024-09-04T16:31:59.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:59 smithi193 ceph-mon[36288]: pgmap v33: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 203 op/s 2024-09-04T16:31:59.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:31:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:31:59.793 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:59 smithi170 ceph-mon[29272]: Upgrade: Setting container_image for all mgr 2024-09-04T16:31:59.793 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:59 smithi170 ceph-mon[29272]: Upgrade: Setting container_image for all rgw 2024-09-04T16:31:59.793 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:59 smithi170 ceph-mon[29272]: Upgrade: Setting container_image for all rbd-mirror 2024-09-04T16:31:59.793 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:59 smithi170 ceph-mon[29272]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-04T16:31:59.793 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:59 smithi170 ceph-mon[29272]: Upgrade: Setting container_image for all iscsi 2024-09-04T16:31:59.793 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:59 smithi170 ceph-mon[29272]: Upgrade: Setting container_image for all nfs 2024-09-04T16:31:59.793 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:59 smithi170 ceph-mon[29272]: Upgrade: Setting container_image for all nvmeof 2024-09-04T16:31:59.794 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:59 smithi170 ceph-mon[29272]: pgmap v33: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 203 op/s 2024-09-04T16:31:59.794 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:31:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:32:01.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:01 smithi170 ceph-mon[29272]: pgmap v34: 65 pgs: 65 active+clean; 282 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.8 MiB/s wr, 273 op/s 2024-09-04T16:32:01.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:01 smithi193 ceph-mon[36288]: pgmap v34: 65 pgs: 65 active+clean; 282 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.8 MiB/s wr, 273 op/s 2024-09-04T16:32:03.352 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-04T16:32:03.352 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-04T16:32:03.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:03 smithi193 ceph-mon[36288]: Upgrade: Updating node-exporter.smithi170 (1/2) 2024-09-04T16:32:03.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:03 smithi193 ceph-mon[36288]: Deploying daemon node-exporter.smithi170 on smithi170 2024-09-04T16:32:03.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:03 smithi193 ceph-mon[36288]: pgmap v35: 65 pgs: 65 active+clean; 282 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 147 op/s 2024-09-04T16:32:03.702 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:03 smithi170 ceph-mon[29272]: Upgrade: Updating node-exporter.smithi170 (1/2) 2024-09-04T16:32:03.702 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:03 smithi170 ceph-mon[29272]: Deploying daemon node-exporter.smithi170 on smithi170 2024-09-04T16:32:03.702 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:03 smithi170 ceph-mon[29272]: pgmap v35: 65 pgs: 65 active+clean; 282 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 147 op/s 2024-09-04T16:32:03.703 DEBUG:teuthology.parallel:result is None 2024-09-04T16:32:03.703 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-04T16:32:03.734 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-04T16:32:03.734 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-04T16:32:03.769 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-04T16:32:03.770 DEBUG:teuthology.parallel:result is None 2024-09-04T16:32:05.582 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:05 smithi170 ceph-mon[29272]: pgmap v36: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 173 op/s 2024-09-04T16:32:05.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:05 smithi193 ceph-mon[36288]: pgmap v36: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 173 op/s 2024-09-04T16:32:06.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:06 smithi170 ceph-mon[29272]: pgmap v37: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.4 MiB/s wr, 188 op/s 2024-09-04T16:32:06.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:06 smithi193 ceph-mon[36288]: pgmap v37: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.4 MiB/s wr, 188 op/s 2024-09-04T16:32:09.506 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:09 smithi170 ceph-mon[29272]: pgmap v38: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 934 KiB/s wr, 140 op/s 2024-09-04T16:32:09.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:09 smithi193 ceph-mon[36288]: pgmap v38: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 934 KiB/s wr, 140 op/s 2024-09-04T16:32:11.061 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:10 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:11.062 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:10 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:11.062 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:10 smithi193 ceph-mon[36288]: pgmap v39: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 984 KiB/s wr, 164 op/s 2024-09-04T16:32:11.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:10 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:11.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:10 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:11.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:10 smithi170 ceph-mon[29272]: pgmap v39: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 984 KiB/s wr, 164 op/s 2024-09-04T16:32:12.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:11 smithi170 ceph-mon[29272]: Upgrade: Updating node-exporter.smithi193 (2/2) 2024-09-04T16:32:12.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:11 smithi170 ceph-mon[29272]: Deploying daemon node-exporter.smithi193 on smithi193 2024-09-04T16:32:12.117 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:11 smithi193 ceph-mon[36288]: Upgrade: Updating node-exporter.smithi193 (2/2) 2024-09-04T16:32:12.117 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:11 smithi193 ceph-mon[36288]: Deploying daemon node-exporter.smithi193 on smithi193 2024-09-04T16:32:13.024 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:12 smithi193 ceph-mon[36288]: pgmap v40: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 482 KiB/s wr, 94 op/s 2024-09-04T16:32:13.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:12 smithi170 ceph-mon[29272]: pgmap v40: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 482 KiB/s wr, 94 op/s 2024-09-04T16:32:14.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:14 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:32:14.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:14 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:32:15.484 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:15 smithi170 ceph-mon[29272]: pgmap v41: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 482 KiB/s wr, 94 op/s 2024-09-04T16:32:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:15 smithi193 ceph-mon[36288]: pgmap v41: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 482 KiB/s wr, 94 op/s 2024-09-04T16:32:17.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:17 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:17.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:17 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:17.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:17 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:32:17.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:17 smithi170 ceph-mon[29272]: pgmap v42: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 388 KiB/s wr, 67 op/s 2024-09-04T16:32:17.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:17 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:17.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:17 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:17.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:17 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:32:17.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:17 smithi193 ceph-mon[36288]: pgmap v42: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 388 KiB/s wr, 67 op/s 2024-09-04T16:32:19.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:19 smithi193 ceph-mon[36288]: pgmap v43: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 5.3 KiB/s rd, 50 KiB/s wr, 23 op/s 2024-09-04T16:32:19.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:19 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:19.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:19 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:19.833 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:19 smithi170 ceph-mon[29272]: pgmap v43: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 5.3 KiB/s rd, 50 KiB/s wr, 23 op/s 2024-09-04T16:32:19.834 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:19 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:19.834 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:19 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:20.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.741+0000 7ff04244c640 1 -- 172.21.15.170:0/1324447072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff03c101a80 msgr2=0x7ff03c101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:20.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.741+0000 7ff04244c640 1 --2- 172.21.15.170:0/1324447072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff03c101a80 0x7ff03c101f00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff024009880 tx=0x7ff02402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:32:20.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.741+0000 7ff04244c640 1 -- 172.21.15.170:0/1324447072 shutdown_connections 2024-09-04T16:32:20.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.741+0000 7ff04244c640 1 --2- 172.21.15.170:0/1324447072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff03c101a80 0x7ff03c101f00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:20.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.741+0000 7ff04244c640 1 --2- 172.21.15.170:0/1324447072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff03c100880 0x7ff03c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:20.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.742+0000 7ff04244c640 1 -- 172.21.15.170:0/1324447072 >> 172.21.15.170:0/1324447072 conn(0x7ff03c0fc010 msgr2=0x7ff03c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:20.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.742+0000 7ff04244c640 1 -- 172.21.15.170:0/1324447072 shutdown_connections 2024-09-04T16:32:20.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.742+0000 7ff04244c640 1 -- 172.21.15.170:0/1324447072 wait complete. 2024-09-04T16:32:20.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.742+0000 7ff04244c640 1 Processor -- start 2024-09-04T16:32:20.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.742+0000 7ff04244c640 1 -- start start 2024-09-04T16:32:20.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.742+0000 7ff04244c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff03c100880 0x7ff03c06adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:20.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.742+0000 7ff04244c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff03c101a80 0x7ff03c19c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:20.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.742+0000 7ff04244c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c1096c0 con 0x7ff03c100880 2024-09-04T16:32:20.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.742+0000 7ff04244c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c109540 con 0x7ff03c101a80 2024-09-04T16:32:20.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.742+0000 7ff03bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff03c100880 0x7ff03c06adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:20.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.742+0000 7ff03bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff03c100880 0x7ff03c06adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55408/0 (socket says 172.21.15.170:55408) 2024-09-04T16:32:20.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.742+0000 7ff03bfff640 1 -- 172.21.15.170:0/600417350 learned_addr learned my addr 172.21.15.170:0/600417350 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:32:20.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.743+0000 7ff033fff640 1 --2- 172.21.15.170:0/600417350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff03c101a80 0x7ff03c19c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:20.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.743+0000 7ff03bfff640 1 -- 172.21.15.170:0/600417350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff03c101a80 msgr2=0x7ff03c19c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:20.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.743+0000 7ff03bfff640 1 --2- 172.21.15.170:0/600417350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff03c101a80 0x7ff03c19c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:20.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.743+0000 7ff03bfff640 1 -- 172.21.15.170:0/600417350 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03c19c7d0 con 0x7ff03c100880 2024-09-04T16:32:20.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.743+0000 7ff03bfff640 1 --2- 172.21.15.170:0/600417350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff03c100880 0x7ff03c06adf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff02c00e940 tx=0x7ff02c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:20.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.743+0000 7ff039ffb640 1 -- 172.21.15.170:0/600417350 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff02c00cac0 con 0x7ff03c100880 2024-09-04T16:32:20.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.743+0000 7ff039ffb640 1 -- 172.21.15.170:0/600417350 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff02c00cc60 con 0x7ff03c100880 2024-09-04T16:32:20.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.743+0000 7ff039ffb640 1 -- 172.21.15.170:0/600417350 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff02c003e20 con 0x7ff03c100880 2024-09-04T16:32:20.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.743+0000 7ff04244c640 1 -- 172.21.15.170:0/600417350 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff03c19cac0 con 0x7ff03c100880 2024-09-04T16:32:20.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.743+0000 7ff04244c640 1 -- 172.21.15.170:0/600417350 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff03c1962c0 con 0x7ff03c100880 2024-09-04T16:32:20.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.744+0000 7ff04244c640 1 -- 172.21.15.170:0/600417350 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff03c100c80 con 0x7ff03c100880 2024-09-04T16:32:20.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.745+0000 7ff039ffb640 1 -- 172.21.15.170:0/600417350 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 32) ==== 102200+0+0 (secure 0 0 0) 0x7ff02c004000 con 0x7ff03c100880 2024-09-04T16:32:20.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.745+0000 7ff039ffb640 1 --2- 172.21.15.170:0/600417350 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff028079f50 0x7ff02807c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:20.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.745+0000 7ff039ffb640 1 -- 172.21.15.170:0/600417350 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7ff02c09d220 con 0x7ff03c100880 2024-09-04T16:32:20.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.745+0000 7ff033fff640 1 --2- 172.21.15.170:0/600417350 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff028079f50 0x7ff02807c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:20.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.746+0000 7ff033fff640 1 --2- 172.21.15.170:0/600417350 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff028079f50 0x7ff02807c410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff024000c00 tx=0x7ff0240058d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:20.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.750+0000 7ff039ffb640 1 -- 172.21.15.170:0/600417350 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7ff02c064a30 con 0x7ff03c100880 2024-09-04T16:32:20.770 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:20 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:20.770 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:20 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:20.771 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:20 smithi170 ceph-mon[29272]: pgmap v44: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 5.3 KiB/s rd, 50 KiB/s wr, 23 op/s 2024-09-04T16:32:20.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.942+0000 7ff04244c640 1 -- 172.21.15.170:0/600417350 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff03c106000 con 0x7ff028079f50 2024-09-04T16:32:20.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.943+0000 7ff039ffb640 1 -- 172.21.15.170:0/600417350 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7ff03c106000 con 0x7ff028079f50 2024-09-04T16:32:20.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.945+0000 7ff04244c640 1 -- 172.21.15.170:0/600417350 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff028079f50 msgr2=0x7ff02807c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:20.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.945+0000 7ff04244c640 1 --2- 172.21.15.170:0/600417350 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff028079f50 0x7ff02807c410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff024000c00 tx=0x7ff0240058d0 comp rx=0 tx=0).stop 2024-09-04T16:32:20.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.945+0000 7ff04244c640 1 -- 172.21.15.170:0/600417350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff03c100880 msgr2=0x7ff03c06adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:20.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.945+0000 7ff04244c640 1 --2- 172.21.15.170:0/600417350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff03c100880 0x7ff03c06adf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff02c00e940 tx=0x7ff02c00ee00 comp rx=0 tx=0).stop 2024-09-04T16:32:20.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.946+0000 7ff04244c640 1 -- 172.21.15.170:0/600417350 shutdown_connections 2024-09-04T16:32:20.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.946+0000 7ff04244c640 1 --2- 172.21.15.170:0/600417350 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff028079f50 0x7ff02807c410 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:20.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.946+0000 7ff04244c640 1 --2- 172.21.15.170:0/600417350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff03c101a80 0x7ff03c19c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:20.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.946+0000 7ff04244c640 1 --2- 172.21.15.170:0/600417350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff03c100880 0x7ff03c06adf0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:20.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.946+0000 7ff04244c640 1 -- 172.21.15.170:0/600417350 >> 172.21.15.170:0/600417350 conn(0x7ff03c0fc010 msgr2=0x7ff03c0fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:20.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.946+0000 7ff04244c640 1 -- 172.21.15.170:0/600417350 shutdown_connections 2024-09-04T16:32:20.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:20.946+0000 7ff04244c640 1 -- 172.21.15.170:0/600417350 wait complete. 2024-09-04T16:32:20.954 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:32:21.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.038+0000 7f4bd01df640 1 -- 172.21.15.170:0/265743546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bc8104d70 msgr2=0x7f4bc81051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:21.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.038+0000 7f4bd01df640 1 --2- 172.21.15.170:0/265743546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bc8104d70 0x7f4bc81051f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009880 tx=0x7f4bb802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.038+0000 7f4bd01df640 1 -- 172.21.15.170:0/265743546 shutdown_connections 2024-09-04T16:32:21.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.038+0000 7f4bd01df640 1 --2- 172.21.15.170:0/265743546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bc8104d70 0x7f4bc81051f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.038+0000 7f4bd01df640 1 --2- 172.21.15.170:0/265743546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bc8103b70 0x7f4bc8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.038+0000 7f4bd01df640 1 -- 172.21.15.170:0/265743546 >> 172.21.15.170:0/265743546 conn(0x7f4bc80ff320 msgr2=0x7f4bc8101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:21.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.038+0000 7f4bd01df640 1 -- 172.21.15.170:0/265743546 shutdown_connections 2024-09-04T16:32:21.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.038+0000 7f4bd01df640 1 -- 172.21.15.170:0/265743546 wait complete. 2024-09-04T16:32:21.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.039+0000 7f4bd01df640 1 Processor -- start 2024-09-04T16:32:21.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.039+0000 7f4bd01df640 1 -- start start 2024-09-04T16:32:21.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.039+0000 7f4bd01df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bc8103b70 0x7f4bc8199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:21.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.039+0000 7f4bd01df640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bc8104d70 0x7f4bc8199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:21.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.040+0000 7f4bcd77a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bc8104d70 0x7f4bc8199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:21.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.040+0000 7f4bcd77a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bc8104d70 0x7f4bc8199bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55432/0 (socket says 172.21.15.170:55432) 2024-09-04T16:32:21.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.040+0000 7f4bd01df640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc810c990 con 0x7f4bc8104d70 2024-09-04T16:32:21.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.040+0000 7f4bd01df640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc810c810 con 0x7f4bc8103b70 2024-09-04T16:32:21.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.040+0000 7f4bcd77a640 1 -- 172.21.15.170:0/1972579756 learned_addr learned my addr 172.21.15.170:0/1972579756 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:32:21.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.040+0000 7f4bcdf7b640 1 --2- 172.21.15.170:0/1972579756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bc8103b70 0x7f4bc8199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:21.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.040+0000 7f4bcdf7b640 1 -- 172.21.15.170:0/1972579756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bc8104d70 msgr2=0x7f4bc8199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:21.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.040+0000 7f4bcdf7b640 1 --2- 172.21.15.170:0/1972579756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bc8104d70 0x7f4bc8199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.040+0000 7f4bcdf7b640 1 -- 172.21.15.170:0/1972579756 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc819a230 con 0x7f4bc8103b70 2024-09-04T16:32:21.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.040+0000 7f4bcd77a640 1 --2- 172.21.15.170:0/1972579756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bc8104d70 0x7f4bc8199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:32:21.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.040+0000 7f4bcdf7b640 1 --2- 172.21.15.170:0/1972579756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bc8103b70 0x7f4bc8199670 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0005fd0 tx=0x7f4bb000ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:21.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.041+0000 7f4bc6ffd640 1 -- 172.21.15.170:0/1972579756 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bb000cb20 con 0x7f4bc8103b70 2024-09-04T16:32:21.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.041+0000 7f4bc6ffd640 1 -- 172.21.15.170:0/1972579756 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4bb000ccc0 con 0x7f4bc8103b70 2024-09-04T16:32:21.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.041+0000 7f4bc6ffd640 1 -- 172.21.15.170:0/1972579756 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bb001a830 con 0x7f4bc8103b70 2024-09-04T16:32:21.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.041+0000 7f4bd01df640 1 -- 172.21.15.170:0/1972579756 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc819ec70 con 0x7f4bc8103b70 2024-09-04T16:32:21.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.041+0000 7f4bd01df640 1 -- 172.21.15.170:0/1972579756 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc819f1b0 con 0x7f4bc8103b70 2024-09-04T16:32:21.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.043+0000 7f4bd01df640 1 -- 172.21.15.170:0/1972579756 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc8103f70 con 0x7f4bc8103b70 2024-09-04T16:32:21.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.044+0000 7f4bc6ffd640 1 -- 172.21.15.170:0/1972579756 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 32) ==== 102200+0+0 (secure 0 0 0) 0x7f4bb001a9d0 con 0x7f4bc8103b70 2024-09-04T16:32:21.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.044+0000 7f4bc6ffd640 1 --2- 172.21.15.170:0/1972579756 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4bb4079fb0 0x7f4bb407c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:21.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.044+0000 7f4bc6ffd640 1 -- 172.21.15.170:0/1972579756 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f4bb009d1b0 con 0x7f4bc8103b70 2024-09-04T16:32:21.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.044+0000 7f4bcd77a640 1 --2- 172.21.15.170:0/1972579756 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4bb4079fb0 0x7f4bb407c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:21.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.045+0000 7f4bcd77a640 1 --2- 172.21.15.170:0/1972579756 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4bb4079fb0 0x7f4bb407c470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80096c0 tx=0x7f4bb8005a20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:21.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.051+0000 7f4bc6ffd640 1 -- 172.21.15.170:0/1972579756 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f4bb0016030 con 0x7f4bc8103b70 2024-09-04T16:32:21.056 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:20 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:21.056 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:20 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:21.056 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:20 smithi193 ceph-mon[36288]: pgmap v44: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 5.3 KiB/s rd, 50 KiB/s wr, 23 op/s 2024-09-04T16:32:21.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.287+0000 7f4bd01df640 1 -- 172.21.15.170:0/1972579756 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4bc80626f0 con 0x7f4bb4079fb0 2024-09-04T16:32:21.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.288+0000 7f4bc6ffd640 1 -- 172.21.15.170:0/1972579756 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f4bc80626f0 con 0x7f4bb4079fb0 2024-09-04T16:32:21.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.290+0000 7f4bd01df640 1 -- 172.21.15.170:0/1972579756 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4bb4079fb0 msgr2=0x7f4bb407c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:21.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.290+0000 7f4bd01df640 1 --2- 172.21.15.170:0/1972579756 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4bb4079fb0 0x7f4bb407c470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80096c0 tx=0x7f4bb8005a20 comp rx=0 tx=0).stop 2024-09-04T16:32:21.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.290+0000 7f4bd01df640 1 -- 172.21.15.170:0/1972579756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bc8103b70 msgr2=0x7f4bc8199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:21.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.290+0000 7f4bd01df640 1 --2- 172.21.15.170:0/1972579756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bc8103b70 0x7f4bc8199670 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0005fd0 tx=0x7f4bb000ee00 comp rx=0 tx=0).stop 2024-09-04T16:32:21.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.290+0000 7f4bd01df640 1 -- 172.21.15.170:0/1972579756 shutdown_connections 2024-09-04T16:32:21.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.290+0000 7f4bd01df640 1 --2- 172.21.15.170:0/1972579756 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4bb4079fb0 0x7f4bb407c470 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.290+0000 7f4bd01df640 1 --2- 172.21.15.170:0/1972579756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bc8104d70 0x7f4bc8199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.290+0000 7f4bd01df640 1 --2- 172.21.15.170:0/1972579756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4bc8103b70 0x7f4bc8199670 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.290+0000 7f4bd01df640 1 -- 172.21.15.170:0/1972579756 >> 172.21.15.170:0/1972579756 conn(0x7f4bc80ff320 msgr2=0x7f4bc8108230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:21.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.290+0000 7f4bd01df640 1 -- 172.21.15.170:0/1972579756 shutdown_connections 2024-09-04T16:32:21.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.291+0000 7f4bd01df640 1 -- 172.21.15.170:0/1972579756 wait complete. 2024-09-04T16:32:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.375+0000 7fe36be0a640 1 -- 172.21.15.170:0/1203503968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe364101a70 msgr2=0x7fe364101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.375+0000 7fe36be0a640 1 --2- 172.21.15.170:0/1203503968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe364101a70 0x7fe364101ef0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe354009880 tx=0x7fe35402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.376+0000 7fe36be0a640 1 -- 172.21.15.170:0/1203503968 shutdown_connections 2024-09-04T16:32:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.376+0000 7fe36be0a640 1 --2- 172.21.15.170:0/1203503968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe364101a70 0x7fe364101ef0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.376+0000 7fe36be0a640 1 --2- 172.21.15.170:0/1203503968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe364100870 0x7fe364100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.376+0000 7fe36be0a640 1 -- 172.21.15.170:0/1203503968 >> 172.21.15.170:0/1203503968 conn(0x7fe3640fc020 msgr2=0x7fe3640fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.376+0000 7fe36be0a640 1 -- 172.21.15.170:0/1203503968 shutdown_connections 2024-09-04T16:32:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.376+0000 7fe36be0a640 1 -- 172.21.15.170:0/1203503968 wait complete. 2024-09-04T16:32:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.376+0000 7fe36be0a640 1 Processor -- start 2024-09-04T16:32:21.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.376+0000 7fe36be0a640 1 -- start start 2024-09-04T16:32:21.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.376+0000 7fe36be0a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe364100870 0x7fe36406ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:21.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.376+0000 7fe36be0a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe364101a70 0x7fe36419c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:21.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.376+0000 7fe36be0a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe3641096b0 con 0x7fe364100870 2024-09-04T16:32:21.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.376+0000 7fe36be0a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe364109530 con 0x7fe364101a70 2024-09-04T16:32:21.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.377+0000 7fe369ba6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe364100870 0x7fe36406ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:21.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.377+0000 7fe369ba6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe364100870 0x7fe36406ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55450/0 (socket says 172.21.15.170:55450) 2024-09-04T16:32:21.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.377+0000 7fe369ba6640 1 -- 172.21.15.170:0/4134263480 learned_addr learned my addr 172.21.15.170:0/4134263480 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:32:21.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.377+0000 7fe3693a5640 1 --2- 172.21.15.170:0/4134263480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe364101a70 0x7fe36419c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:21.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.377+0000 7fe369ba6640 1 -- 172.21.15.170:0/4134263480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe364101a70 msgr2=0x7fe36419c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:21.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.377+0000 7fe369ba6640 1 --2- 172.21.15.170:0/4134263480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe364101a70 0x7fe36419c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.377+0000 7fe369ba6640 1 -- 172.21.15.170:0/4134263480 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe36419c780 con 0x7fe364100870 2024-09-04T16:32:21.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.377+0000 7fe369ba6640 1 --2- 172.21.15.170:0/4134263480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe364100870 0x7fe36406ae80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe36000e940 tx=0x7fe36000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:21.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.377+0000 7fe35affd640 1 -- 172.21.15.170:0/4134263480 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe36000cac0 con 0x7fe364100870 2024-09-04T16:32:21.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.377+0000 7fe35affd640 1 -- 172.21.15.170:0/4134263480 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe36000cc60 con 0x7fe364100870 2024-09-04T16:32:21.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.377+0000 7fe35affd640 1 -- 172.21.15.170:0/4134263480 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe360003e30 con 0x7fe364100870 2024-09-04T16:32:21.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.377+0000 7fe36be0a640 1 -- 172.21.15.170:0/4134263480 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe36419ca70 con 0x7fe364100870 2024-09-04T16:32:21.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.377+0000 7fe36be0a640 1 -- 172.21.15.170:0/4134263480 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe36419cfd0 con 0x7fe364100870 2024-09-04T16:32:21.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.378+0000 7fe36be0a640 1 -- 172.21.15.170:0/4134263480 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe364100c70 con 0x7fe364100870 2024-09-04T16:32:21.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.379+0000 7fe35affd640 1 -- 172.21.15.170:0/4134263480 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 32) ==== 102200+0+0 (secure 0 0 0) 0x7fe360004000 con 0x7fe364100870 2024-09-04T16:32:21.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.380+0000 7fe35affd640 1 --2- 172.21.15.170:0/4134263480 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe350079f50 0x7fe35007c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:21.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.380+0000 7fe35affd640 1 -- 172.21.15.170:0/4134263480 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fe36009d280 con 0x7fe364100870 2024-09-04T16:32:21.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.380+0000 7fe3693a5640 1 --2- 172.21.15.170:0/4134263480 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe350079f50 0x7fe35007c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:21.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.381+0000 7fe3693a5640 1 --2- 172.21.15.170:0/4134263480 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe350079f50 0x7fe35007c410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe354000c00 tx=0x7fe3540058d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:21.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.384+0000 7fe35affd640 1 -- 172.21.15.170:0/4134263480 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fe360064a90 con 0x7fe364100870 2024-09-04T16:32:21.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.575+0000 7fe36be0a640 1 -- 172.21.15.170:0/4134263480 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe364062630 con 0x7fe350079f50 2024-09-04T16:32:21.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.584+0000 7fe35affd640 1 -- 172.21.15.170:0/4134263480 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fe364062630 con 0x7fe350079f50 2024-09-04T16:32:21.584 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:32:21.584 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (8m) 0s ago 10m 24.9M - 0.25.0 c8568f914cd2 e85db6a2e731 2024-09-04T16:32:21.585 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (2m) 0s ago 10m 8732k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:32:21.585 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (114s) 2s ago 9m 8112k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:32:21.585 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (10m) 0s ago 10m 6891k - 19.1.1-252-g48920dab b708f9119ac7 aa2ec5c5776a 2024-09-04T16:32:21.585 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (9m) 2s ago 9m 6895k - 19.1.1-252-g48920dab b708f9119ac7 a24f0ce3b3fb 2024-09-04T16:32:21.585 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (8m) 0s ago 9m 78.1M - 9.4.12 2bacad6d85d8 5bffd3332aba 2024-09-04T16:32:21.585 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (4m) 0s ago 4m 27.2M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:32:21.585 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (4m) 0s ago 4m 147M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:32:21.585 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (4m) 2s ago 4m 15.5M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:32:21.585 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (4m) 2s ago 4m 14.9M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:32:21.585 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (94s) 0s ago 11m 510M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:32:21.585 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (31s) 2s ago 9m 454M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:32:21.585 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (11m) 0s ago 11m 62.9M 2048M 19.1.1-252-g48920dab b708f9119ac7 194ff39cc041 2024-09-04T16:32:21.585 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (9m) 2s ago 9m 49.7M 2048M 19.1.1-252-g48920dab b708f9119ac7 38c8e99ca323 2024-09-04T16:32:21.586 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (12s) 0s ago 10m 8384k - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:32:21.586 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (5s) 2s ago 9m 5246k - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:32:21.586 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (8m) 0s ago 8m 209M 1216M 19.1.1-252-g48920dab b708f9119ac7 6c2ea484615d 2024-09-04T16:32:21.586 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (7m) 0s ago 7m 227M 1216M 19.1.1-252-g48920dab b708f9119ac7 20469ba5727b 2024-09-04T16:32:21.586 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (7m) 0s ago 7m 182M 1216M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:32:21.586 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (6m) 2s ago 6m 245M 2240M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:32:21.586 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (6m) 2s ago 6m 209M 2240M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:32:21.586 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (5m) 2s ago 5m 189M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:32:21.586 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (37s) 0s ago 9m 53.2M - 2.43.0 a07b618ecd1d 48c98bb132f2 2024-09-04T16:32:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.587+0000 7fe36be0a640 1 -- 172.21.15.170:0/4134263480 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe350079f50 msgr2=0x7fe35007c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.587+0000 7fe36be0a640 1 --2- 172.21.15.170:0/4134263480 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe350079f50 0x7fe35007c410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe354000c00 tx=0x7fe3540058d0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.587+0000 7fe36be0a640 1 -- 172.21.15.170:0/4134263480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe364100870 msgr2=0x7fe36406ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.587+0000 7fe36be0a640 1 --2- 172.21.15.170:0/4134263480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe364100870 0x7fe36406ae80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe36000e940 tx=0x7fe36000ee00 comp rx=0 tx=0).stop 2024-09-04T16:32:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.587+0000 7fe36be0a640 1 -- 172.21.15.170:0/4134263480 shutdown_connections 2024-09-04T16:32:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.587+0000 7fe36be0a640 1 --2- 172.21.15.170:0/4134263480 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe350079f50 0x7fe35007c410 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.587+0000 7fe36be0a640 1 --2- 172.21.15.170:0/4134263480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe364101a70 0x7fe36419c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.587+0000 7fe36be0a640 1 --2- 172.21.15.170:0/4134263480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe364100870 0x7fe36406ae80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.587+0000 7fe36be0a640 1 -- 172.21.15.170:0/4134263480 >> 172.21.15.170:0/4134263480 conn(0x7fe3640fc020 msgr2=0x7fe364104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:21.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.587+0000 7fe36be0a640 1 -- 172.21.15.170:0/4134263480 shutdown_connections 2024-09-04T16:32:21.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.587+0000 7fe36be0a640 1 -- 172.21.15.170:0/4134263480 wait complete. 2024-09-04T16:32:21.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.672+0000 7f7770526640 1 -- 172.21.15.170:0/421083604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7768104dc0 msgr2=0x7f77681071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:21.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.672+0000 7f7770526640 1 --2- 172.21.15.170:0/421083604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7768104dc0 0x7f77681071b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7758009880 tx=0x7f775802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.672+0000 7f7770526640 1 -- 172.21.15.170:0/421083604 shutdown_connections 2024-09-04T16:32:21.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.672+0000 7f7770526640 1 --2- 172.21.15.170:0/421083604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7768104dc0 0x7f77681071b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.672+0000 7f7770526640 1 --2- 172.21.15.170:0/421083604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7768102490 0x7f7768104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.672+0000 7f7770526640 1 -- 172.21.15.170:0/421083604 >> 172.21.15.170:0/421083604 conn(0x7f77680fbff0 msgr2=0x7f77680fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:21.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.672+0000 7f7770526640 1 -- 172.21.15.170:0/421083604 shutdown_connections 2024-09-04T16:32:21.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.672+0000 7f7770526640 1 -- 172.21.15.170:0/421083604 wait complete. 2024-09-04T16:32:21.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.673+0000 7f7770526640 1 Processor -- start 2024-09-04T16:32:21.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.673+0000 7f7770526640 1 -- start start 2024-09-04T16:32:21.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.673+0000 7f7770526640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7768102490 0x7f77681974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:21.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.673+0000 7f7770526640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7768104dc0 0x7f7768197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:21.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.673+0000 7f7770526640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f776810a780 con 0x7f7768104dc0 2024-09-04T16:32:21.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.673+0000 7f7770526640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f776810a600 con 0x7f7768102490 2024-09-04T16:32:21.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.673+0000 7f776dac1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7768104dc0 0x7f7768197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:21.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.673+0000 7f776dac1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7768104dc0 0x7f7768197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55468/0 (socket says 172.21.15.170:55468) 2024-09-04T16:32:21.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.673+0000 7f776dac1640 1 -- 172.21.15.170:0/2013021011 learned_addr learned my addr 172.21.15.170:0/2013021011 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:32:21.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.673+0000 7f776e2c2640 1 --2- 172.21.15.170:0/2013021011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7768102490 0x7f77681974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:21.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.674+0000 7f776dac1640 1 -- 172.21.15.170:0/2013021011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7768102490 msgr2=0x7f77681974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:21.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.674+0000 7f776dac1640 1 --2- 172.21.15.170:0/2013021011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7768102490 0x7f77681974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.674+0000 7f776dac1640 1 -- 172.21.15.170:0/2013021011 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7768198090 con 0x7f7768104dc0 2024-09-04T16:32:21.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.674+0000 7f776dac1640 1 --2- 172.21.15.170:0/2013021011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7768104dc0 0x7f7768197a10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7758006010 tx=0x7f77580045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:21.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.674+0000 7f775f7fe640 1 -- 172.21.15.170:0/2013021011 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f775803f070 con 0x7f7768104dc0 2024-09-04T16:32:21.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.674+0000 7f775f7fe640 1 -- 172.21.15.170:0/2013021011 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7758004a50 con 0x7f7768104dc0 2024-09-04T16:32:21.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.674+0000 7f7770526640 1 -- 172.21.15.170:0/2013021011 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776819ca70 con 0x7f7768104dc0 2024-09-04T16:32:21.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.674+0000 7f775f7fe640 1 -- 172.21.15.170:0/2013021011 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7758035030 con 0x7f7768104dc0 2024-09-04T16:32:21.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.674+0000 7f7770526640 1 -- 172.21.15.170:0/2013021011 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f776819d000 con 0x7f7768104dc0 2024-09-04T16:32:21.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.676+0000 7f7770526640 1 -- 172.21.15.170:0/2013021011 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7768102870 con 0x7f7768104dc0 2024-09-04T16:32:21.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.676+0000 7f775f7fe640 1 -- 172.21.15.170:0/2013021011 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 32) ==== 102200+0+0 (secure 0 0 0) 0x7f7758042070 con 0x7f7768104dc0 2024-09-04T16:32:21.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.676+0000 7f775f7fe640 1 --2- 172.21.15.170:0/2013021011 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7754079fb0 0x7f775407c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:21.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.677+0000 7f775f7fe640 1 -- 172.21.15.170:0/2013021011 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f77580bd6c0 con 0x7f7768104dc0 2024-09-04T16:32:21.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.677+0000 7f776e2c2640 1 --2- 172.21.15.170:0/2013021011 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7754079fb0 0x7f775407c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:21.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.677+0000 7f776e2c2640 1 --2- 172.21.15.170:0/2013021011 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7754079fb0 0x7f775407c470 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7764005fd0 tx=0x7f776400b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:21.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.681+0000 7f775f7fe640 1 -- 172.21.15.170:0/2013021011 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f7758089150 con 0x7f7768104dc0 2024-09-04T16:32:21.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.949+0000 7f7770526640 1 -- 172.21.15.170:0/2013021011 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f776819d2d0 con 0x7f7768104dc0 2024-09-04T16:32:21.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.950+0000 7f775f7fe640 1 -- 172.21.15.170:0/2013021011 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f775808db70 con 0x7f7768104dc0 2024-09-04T16:32:21.950 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:32:21.951 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:32:21.951 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 2 2024-09-04T16:32:21.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:32:21.951 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:32:21.951 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:32:21.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:32:21.951 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:32:21.951 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 6 2024-09-04T16:32:21.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:32:21.951 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:32:21.951 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:32:21.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:32:21.951 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:32:21.952 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 12, 2024-09-04T16:32:21.952 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:32:21.952 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:32:21.952 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:32:21.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.952+0000 7f7770526640 1 -- 172.21.15.170:0/2013021011 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7754079fb0 msgr2=0x7f775407c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:21.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.952+0000 7f7770526640 1 --2- 172.21.15.170:0/2013021011 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7754079fb0 0x7f775407c470 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7764005fd0 tx=0x7f776400b390 comp rx=0 tx=0).stop 2024-09-04T16:32:21.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.952+0000 7f7770526640 1 -- 172.21.15.170:0/2013021011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7768104dc0 msgr2=0x7f7768197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:21.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.952+0000 7f7770526640 1 --2- 172.21.15.170:0/2013021011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7768104dc0 0x7f7768197a10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7758006010 tx=0x7f77580045e0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.952+0000 7f7770526640 1 -- 172.21.15.170:0/2013021011 shutdown_connections 2024-09-04T16:32:21.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.952+0000 7f7770526640 1 --2- 172.21.15.170:0/2013021011 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7754079fb0 0x7f775407c470 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.952+0000 7f7770526640 1 --2- 172.21.15.170:0/2013021011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7768104dc0 0x7f7768197a10 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.952+0000 7f7770526640 1 --2- 172.21.15.170:0/2013021011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7768102490 0x7f77681974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:21.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.952+0000 7f7770526640 1 -- 172.21.15.170:0/2013021011 >> 172.21.15.170:0/2013021011 conn(0x7f77680fbff0 msgr2=0x7f77680fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:21.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.952+0000 7f7770526640 1 -- 172.21.15.170:0/2013021011 shutdown_connections 2024-09-04T16:32:21.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:21.952+0000 7f7770526640 1 -- 172.21.15.170:0/2013021011 wait complete. 2024-09-04T16:32:22.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.039+0000 7fe3d89fd640 1 -- 172.21.15.170:0/2824493378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3d4104dc0 msgr2=0x7fe3d41071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:22.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.039+0000 7fe3d89fd640 1 --2- 172.21.15.170:0/2824493378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3d4104dc0 0x7fe3d41071b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc009880 tx=0x7fe3bc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:32:22.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.039+0000 7fe3d89fd640 1 -- 172.21.15.170:0/2824493378 shutdown_connections 2024-09-04T16:32:22.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.039+0000 7fe3d89fd640 1 --2- 172.21.15.170:0/2824493378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3d4104dc0 0x7fe3d41071b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:22.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.039+0000 7fe3d89fd640 1 --2- 172.21.15.170:0/2824493378 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3d4102490 0x7fe3d4104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:22.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.039+0000 7fe3d89fd640 1 -- 172.21.15.170:0/2824493378 >> 172.21.15.170:0/2824493378 conn(0x7fe3d40fbff0 msgr2=0x7fe3d40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:22.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.039+0000 7fe3d89fd640 1 -- 172.21.15.170:0/2824493378 shutdown_connections 2024-09-04T16:32:22.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.039+0000 7fe3d89fd640 1 -- 172.21.15.170:0/2824493378 wait complete. 2024-09-04T16:32:22.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.040+0000 7fe3d89fd640 1 Processor -- start 2024-09-04T16:32:22.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.040+0000 7fe3d89fd640 1 -- start start 2024-09-04T16:32:22.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.040+0000 7fe3d89fd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3d4102490 0x7fe3d41974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:22.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.040+0000 7fe3d89fd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3d4104dc0 0x7fe3d4197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:22.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.040+0000 7fe3d89fd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d410a760 con 0x7fe3d4104dc0 2024-09-04T16:32:22.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.040+0000 7fe3d89fd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d410a5e0 con 0x7fe3d4102490 2024-09-04T16:32:22.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.040+0000 7fe3cbfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3d4104dc0 0x7fe3d4197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:22.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.040+0000 7fe3cbfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3d4104dc0 0x7fe3d4197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55480/0 (socket says 172.21.15.170:55480) 2024-09-04T16:32:22.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.040+0000 7fe3cbfff640 1 -- 172.21.15.170:0/1206348999 learned_addr learned my addr 172.21.15.170:0/1206348999 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:32:22.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.040+0000 7fe3d259c640 1 --2- 172.21.15.170:0/1206348999 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3d4102490 0x7fe3d41974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:22.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.041+0000 7fe3cbfff640 1 -- 172.21.15.170:0/1206348999 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3d4102490 msgr2=0x7fe3d41974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:22.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.041+0000 7fe3cbfff640 1 --2- 172.21.15.170:0/1206348999 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3d4102490 0x7fe3d41974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:22.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.041+0000 7fe3cbfff640 1 -- 172.21.15.170:0/1206348999 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d4198080 con 0x7fe3d4104dc0 2024-09-04T16:32:22.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.041+0000 7fe3cbfff640 1 --2- 172.21.15.170:0/1206348999 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3d4104dc0 0x7fe3d4197a00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc006010 tx=0x7fe3bc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:22.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.041+0000 7fe3cb7fe640 1 -- 172.21.15.170:0/1206348999 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3bc03f070 con 0x7fe3d4104dc0 2024-09-04T16:32:22.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.041+0000 7fe3d89fd640 1 -- 172.21.15.170:0/1206348999 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d419ca60 con 0x7fe3d4104dc0 2024-09-04T16:32:22.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.041+0000 7fe3cb7fe640 1 -- 172.21.15.170:0/1206348999 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe3bc004a50 con 0x7fe3d4104dc0 2024-09-04T16:32:22.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.041+0000 7fe3cb7fe640 1 -- 172.21.15.170:0/1206348999 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3bc035030 con 0x7fe3d4104dc0 2024-09-04T16:32:22.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.041+0000 7fe3d89fd640 1 -- 172.21.15.170:0/1206348999 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d419cff0 con 0x7fe3d4104dc0 2024-09-04T16:32:22.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.042+0000 7fe3d89fd640 1 -- 172.21.15.170:0/1206348999 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d4102870 con 0x7fe3d4104dc0 2024-09-04T16:32:22.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.043+0000 7fe3cb7fe640 1 -- 172.21.15.170:0/1206348999 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 32) ==== 102200+0+0 (secure 0 0 0) 0x7fe3bc042070 con 0x7fe3d4104dc0 2024-09-04T16:32:22.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.044+0000 7fe3cb7fe640 1 --2- 172.21.15.170:0/1206348999 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe3c0079f50 0x7fe3c007c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:22.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.044+0000 7fe3cb7fe640 1 -- 172.21.15.170:0/1206348999 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fe3bc0bd790 con 0x7fe3d4104dc0 2024-09-04T16:32:22.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.044+0000 7fe3d259c640 1 --2- 172.21.15.170:0/1206348999 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe3c0079f50 0x7fe3c007c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:22.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.044+0000 7fe3d259c640 1 --2- 172.21.15.170:0/1206348999 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe3c0079f50 0x7fe3c007c410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400bbe0 tx=0x7fe3c400b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:22.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.048+0000 7fe3cb7fe640 1 -- 172.21.15.170:0/1206348999 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fe3bc004c00 con 0x7fe3d4104dc0 2024-09-04T16:32:22.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.290+0000 7fe3d89fd640 1 -- 172.21.15.170:0/1206348999 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe3d4105940 con 0x7fe3c0079f50 2024-09-04T16:32:22.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.292+0000 7fe3cb7fe640 1 -- 172.21.15.170:0/1206348999 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7fe3d4105940 con 0x7fe3c0079f50 2024-09-04T16:32:22.292 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:32:22.293 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:32:22.293 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:32:22.293 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-04T16:32:22.293 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:32:22.293 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-04T16:32:22.293 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:32:22.293 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "2/2 daemons upgraded", 2024-09-04T16:32:22.293 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-04T16:32:22.293 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:32:22.293 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:32:22.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.294+0000 7fe3d89fd640 1 -- 172.21.15.170:0/1206348999 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe3c0079f50 msgr2=0x7fe3c007c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:22.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.294+0000 7fe3d89fd640 1 --2- 172.21.15.170:0/1206348999 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe3c0079f50 0x7fe3c007c410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400bbe0 tx=0x7fe3c400b390 comp rx=0 tx=0).stop 2024-09-04T16:32:22.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.294+0000 7fe3d89fd640 1 -- 172.21.15.170:0/1206348999 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3d4104dc0 msgr2=0x7fe3d4197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:22.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.294+0000 7fe3d89fd640 1 --2- 172.21.15.170:0/1206348999 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3d4104dc0 0x7fe3d4197a00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc006010 tx=0x7fe3bc0045e0 comp rx=0 tx=0).stop 2024-09-04T16:32:22.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.294+0000 7fe3d89fd640 1 -- 172.21.15.170:0/1206348999 shutdown_connections 2024-09-04T16:32:22.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.294+0000 7fe3d89fd640 1 --2- 172.21.15.170:0/1206348999 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe3c0079f50 0x7fe3c007c410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:22.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.294+0000 7fe3d89fd640 1 --2- 172.21.15.170:0/1206348999 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3d4104dc0 0x7fe3d4197a00 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:22.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.294+0000 7fe3d89fd640 1 --2- 172.21.15.170:0/1206348999 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3d4102490 0x7fe3d41974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:22.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.294+0000 7fe3d89fd640 1 -- 172.21.15.170:0/1206348999 >> 172.21.15.170:0/1206348999 conn(0x7fe3d40fbff0 msgr2=0x7fe3d40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:22.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.294+0000 7fe3d89fd640 1 -- 172.21.15.170:0/1206348999 shutdown_connections 2024-09-04T16:32:22.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:22.294+0000 7fe3d89fd640 1 -- 172.21.15.170:0/1206348999 wait complete. 2024-09-04T16:32:22.348 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:22 smithi193 ceph-mon[36288]: from='client.14848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:32:22.349 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:22 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:22.349 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:22 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:22.349 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:22 smithi193 ceph-mon[36288]: from='client.24551 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:32:22.349 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:22 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:22.349 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:22 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:22.349 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:22 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2013021011' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:22.506 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:22 smithi170 ceph-mon[29272]: from='client.14848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:32:22.506 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:22 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:22.507 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:22 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:22.507 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:22 smithi170 ceph-mon[29272]: from='client.24551 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:32:22.507 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:22 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:22.507 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:22 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:22.507 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:22 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2013021011' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:23 smithi170 ceph-mon[29272]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:32:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:23 smithi170 ceph-mon[29272]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:32:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:23 smithi170 ceph-mon[29272]: pgmap v45: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-04T16:32:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:23 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:23 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:23.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:23 smithi193 ceph-mon[36288]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:32:23.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:23 smithi193 ceph-mon[36288]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:32:23.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:23 smithi193 ceph-mon[36288]: pgmap v45: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-04T16:32:23.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:23 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:23.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:23 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:25.486 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:25 smithi170 ceph-mon[29272]: pgmap v46: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-04T16:32:25.486 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:25 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:25.486 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:25 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:25.486 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:25 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:32:25.486 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:25 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:32:25.486 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:25 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:25.486 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:25 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:32:25.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:25 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:25.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:25 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:25.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:25 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:25.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:25 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:25.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:25 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:25.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:25 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:25.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:25 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:25.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:25 smithi193 ceph-mon[36288]: pgmap v46: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-04T16:32:25.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:25 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:25.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:25 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:25.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:25 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:32:25.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:25 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:32:25.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:25 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:25.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:25 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:32:25.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:25 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:25.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:25 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:25.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:25 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:25.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:25 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:25.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:25 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:25.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:25 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:25.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:25 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:26 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:26.776 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:26 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:27.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:27 smithi193 ceph-mon[36288]: pgmap v47: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:27.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:27 smithi170 ceph-mon[29272]: pgmap v47: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:28 smithi193 ceph-mon[36288]: Upgrade: Updating prometheus.smithi170 2024-09-04T16:32:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:28 smithi193 ceph-mon[36288]: Deploying daemon prometheus.smithi170 on smithi170 2024-09-04T16:32:28.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:28 smithi170 ceph-mon[29272]: Upgrade: Updating prometheus.smithi170 2024-09-04T16:32:28.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:28 smithi170 ceph-mon[29272]: Deploying daemon prometheus.smithi170 on smithi170 2024-09-04T16:32:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:29 smithi193 ceph-mon[36288]: pgmap v48: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:29 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:32:29.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:29 smithi170 ceph-mon[29272]: pgmap v48: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:29.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:29 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:32:31.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:31 smithi170 ceph-mon[29272]: pgmap v49: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:32:31.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:31 smithi193 ceph-mon[36288]: pgmap v49: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:32:32.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:32 smithi170 ceph-mon[29272]: mgrmap e33: smithi170.fbszap(active, since 93s), standbys: smithi193.gvfizn 2024-09-04T16:32:32.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:32 smithi170 ceph-mon[29272]: pgmap v50: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:32:32.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:32 smithi193 ceph-mon[36288]: mgrmap e33: smithi170.fbszap(active, since 93s), standbys: smithi193.gvfizn 2024-09-04T16:32:32.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:32 smithi193 ceph-mon[36288]: pgmap v50: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:32:35.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:35 smithi170 ceph-mon[29272]: pgmap v51: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:32:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:35 smithi193 ceph-mon[36288]: pgmap v51: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:32:37.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:37 smithi170 ceph-mon[29272]: pgmap v52: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:32:37.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:37 smithi193 ceph-mon[36288]: pgmap v52: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:32:39.553 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:39 smithi170 ceph-mon[29272]: pgmap v53: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:32:39.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:39 smithi193 ceph-mon[36288]: pgmap v53: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:32:41.205 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:40 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:41.205 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:40 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:41.205 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:40 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:32:41.206 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:40 smithi170 ceph-mon[29272]: pgmap v54: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:32:41.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:40 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:41.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:40 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:41.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:40 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:32:41.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:40 smithi193 ceph-mon[36288]: pgmap v54: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-04T16:32:43.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:43 smithi193 ceph-mon[36288]: pgmap v55: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:43 smithi170 ceph-mon[29272]: pgmap v55: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:44.396 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:44 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:32:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:44 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:32:45.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:45 smithi193 ceph-mon[36288]: pgmap v56: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:45.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:45 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:45.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:45 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:45.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:45 smithi170 ceph-mon[29272]: pgmap v56: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:45 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:45 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:46.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:46 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:46.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:46 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:46.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:46 smithi170 ceph-mon[29272]: pgmap v57: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:46.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:46 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:46.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:46 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:46.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:46 smithi193 ceph-mon[36288]: pgmap v57: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:49.544 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: pgmap v58: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:49.544 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:49.544 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:49.544 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:32:49.545 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:32:49.545 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:49.545 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-04T16:32:49.545 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:32:49.545 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.545 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.546 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.546 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.546 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.546 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.546 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.546 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.547 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:49 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.645 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: pgmap v58: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:49.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:49.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:49.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:32:49.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:32:49.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:32:49.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-04T16:32:49.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:32:49.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.647 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.647 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.647 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.647 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:49.647 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:49 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:50.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:50 smithi170 ceph-mon[29272]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-04T16:32:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:50 smithi193 ceph-mon[36288]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-04T16:32:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:51 smithi193 ceph-mon[36288]: pgmap v59: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:51.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:51 smithi170 ceph-mon[29272]: pgmap v59: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:52.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.379+0000 7fb2395a5640 1 -- 172.21.15.170:0/3209221105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb234102f60 msgr2=0x7fb234103360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:52.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.379+0000 7fb2395a5640 1 --2- 172.21.15.170:0/3209221105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb234102f60 0x7fb234103360 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb224009880 tx=0x7fb22402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.379+0000 7fb2395a5640 1 -- 172.21.15.170:0/3209221105 shutdown_connections 2024-09-04T16:32:52.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.379+0000 7fb2395a5640 1 --2- 172.21.15.170:0/3209221105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb234103930 0x7fb2340ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.379+0000 7fb2395a5640 1 --2- 172.21.15.170:0/3209221105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb234102f60 0x7fb234103360 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.379+0000 7fb2395a5640 1 -- 172.21.15.170:0/3209221105 >> 172.21.15.170:0/3209221105 conn(0x7fb2340fb7b0 msgr2=0x7fb2340fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:52.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.379+0000 7fb2395a5640 1 -- 172.21.15.170:0/3209221105 shutdown_connections 2024-09-04T16:32:52.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.379+0000 7fb2395a5640 1 -- 172.21.15.170:0/3209221105 wait complete. 2024-09-04T16:32:52.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.379+0000 7fb2395a5640 1 Processor -- start 2024-09-04T16:32:52.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.380+0000 7fb2395a5640 1 -- start start 2024-09-04T16:32:52.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.380+0000 7fb2395a5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb234102f60 0x7fb2341974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:52.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.380+0000 7fb2395a5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb234103930 0x7fb234197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:52.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.380+0000 7fb2395a5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb23410a7e0 con 0x7fb234103930 2024-09-04T16:32:52.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.380+0000 7fb2395a5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb23410a660 con 0x7fb234102f60 2024-09-04T16:32:52.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.380+0000 7fb2327fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb234103930 0x7fb234197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:52.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.380+0000 7fb2327fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb234103930 0x7fb234197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37636/0 (socket says 172.21.15.170:37636) 2024-09-04T16:32:52.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.380+0000 7fb2327fc640 1 -- 172.21.15.170:0/1513000431 learned_addr learned my addr 172.21.15.170:0/1513000431 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:32:52.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.380+0000 7fb232ffd640 1 --2- 172.21.15.170:0/1513000431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb234102f60 0x7fb2341974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:52.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.380+0000 7fb2327fc640 1 -- 172.21.15.170:0/1513000431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb234102f60 msgr2=0x7fb2341974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:52.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.380+0000 7fb2327fc640 1 --2- 172.21.15.170:0/1513000431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb234102f60 0x7fb2341974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.380+0000 7fb2327fc640 1 -- 172.21.15.170:0/1513000431 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb234198000 con 0x7fb234103930 2024-09-04T16:32:52.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.380+0000 7fb2327fc640 1 --2- 172.21.15.170:0/1513000431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb234103930 0x7fb234197a10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00c8f0 tx=0x7fb21c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:52.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.381+0000 7fb22bfff640 1 -- 172.21.15.170:0/1513000431 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb21c014070 con 0x7fb234103930 2024-09-04T16:32:52.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.381+0000 7fb2395a5640 1 -- 172.21.15.170:0/1513000431 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23419ca70 con 0x7fb234103930 2024-09-04T16:32:52.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.381+0000 7fb22bfff640 1 -- 172.21.15.170:0/1513000431 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb21c007c60 con 0x7fb234103930 2024-09-04T16:32:52.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.381+0000 7fb22bfff640 1 -- 172.21.15.170:0/1513000431 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb21c003c30 con 0x7fb234103930 2024-09-04T16:32:52.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.381+0000 7fb2395a5640 1 -- 172.21.15.170:0/1513000431 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb23419cfd0 con 0x7fb234103930 2024-09-04T16:32:52.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.382+0000 7fb2395a5640 1 -- 172.21.15.170:0/1513000431 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb234103360 con 0x7fb234103930 2024-09-04T16:32:52.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.382+0000 7fb22bfff640 1 -- 172.21.15.170:0/1513000431 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fb21c017070 con 0x7fb234103930 2024-09-04T16:32:52.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.383+0000 7fb22bfff640 1 --2- 172.21.15.170:0/1513000431 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb220079e30 0x7fb22007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:52.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.383+0000 7fb22bfff640 1 -- 172.21.15.170:0/1513000431 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fb21c09c760 con 0x7fb234103930 2024-09-04T16:32:52.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.383+0000 7fb232ffd640 1 --2- 172.21.15.170:0/1513000431 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb220079e30 0x7fb22007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:52.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.383+0000 7fb232ffd640 1 --2- 172.21.15.170:0/1513000431 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb220079e30 0x7fb22007c2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb224006010 tx=0x7fb224000bc0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:52.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.387+0000 7fb22bfff640 1 -- 172.21.15.170:0/1513000431 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fb21c064220 con 0x7fb234103930 2024-09-04T16:32:52.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.579+0000 7fb2395a5640 1 -- 172.21.15.170:0/1513000431 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb234107280 con 0x7fb220079e30 2024-09-04T16:32:52.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.580+0000 7fb22bfff640 1 -- 172.21.15.170:0/1513000431 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7fb234107280 con 0x7fb220079e30 2024-09-04T16:32:52.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.583+0000 7fb2395a5640 1 -- 172.21.15.170:0/1513000431 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb220079e30 msgr2=0x7fb22007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:52.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.583+0000 7fb2395a5640 1 --2- 172.21.15.170:0/1513000431 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb220079e30 0x7fb22007c2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb224006010 tx=0x7fb224000bc0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.583+0000 7fb2395a5640 1 -- 172.21.15.170:0/1513000431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb234103930 msgr2=0x7fb234197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:52.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.583+0000 7fb2395a5640 1 --2- 172.21.15.170:0/1513000431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb234103930 0x7fb234197a10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00c8f0 tx=0x7fb21c00cdb0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.583+0000 7fb2395a5640 1 -- 172.21.15.170:0/1513000431 shutdown_connections 2024-09-04T16:32:52.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.583+0000 7fb2395a5640 1 --2- 172.21.15.170:0/1513000431 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb220079e30 0x7fb22007c2f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.583+0000 7fb2395a5640 1 --2- 172.21.15.170:0/1513000431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb234103930 0x7fb234197a10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.583+0000 7fb2395a5640 1 --2- 172.21.15.170:0/1513000431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb234102f60 0x7fb2341974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.583+0000 7fb2395a5640 1 -- 172.21.15.170:0/1513000431 >> 172.21.15.170:0/1513000431 conn(0x7fb2340fb7b0 msgr2=0x7fb2340fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:52.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.583+0000 7fb2395a5640 1 -- 172.21.15.170:0/1513000431 shutdown_connections 2024-09-04T16:32:52.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.583+0000 7fb2395a5640 1 -- 172.21.15.170:0/1513000431 wait complete. 2024-09-04T16:32:52.593 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:32:52.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:52 smithi193 ceph-mon[36288]: Upgrade: Updating alertmanager.smithi170 2024-09-04T16:32:52.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:52 smithi193 ceph-mon[36288]: Deploying daemon alertmanager.smithi170 on smithi170 2024-09-04T16:32:52.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.668+0000 7f3e48568640 1 -- 172.21.15.170:0/1703208877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e40101a40 msgr2=0x7f3e40101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:52.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.668+0000 7f3e48568640 1 --2- 172.21.15.170:0/1703208877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e40101a40 0x7f3e40101ec0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009880 tx=0x7f3e3002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.668+0000 7f3e48568640 1 -- 172.21.15.170:0/1703208877 shutdown_connections 2024-09-04T16:32:52.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.668+0000 7f3e48568640 1 --2- 172.21.15.170:0/1703208877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e40101a40 0x7f3e40101ec0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.668+0000 7f3e48568640 1 --2- 172.21.15.170:0/1703208877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e40100840 0x7f3e40100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.668+0000 7f3e48568640 1 -- 172.21.15.170:0/1703208877 >> 172.21.15.170:0/1703208877 conn(0x7f3e400fbff0 msgr2=0x7f3e400fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:52.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.668+0000 7f3e48568640 1 -- 172.21.15.170:0/1703208877 shutdown_connections 2024-09-04T16:32:52.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.668+0000 7f3e48568640 1 -- 172.21.15.170:0/1703208877 wait complete. 2024-09-04T16:32:52.670 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:52 smithi170 ceph-mon[29272]: Upgrade: Updating alertmanager.smithi170 2024-09-04T16:32:52.670 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:52 smithi170 ceph-mon[29272]: Deploying daemon alertmanager.smithi170 on smithi170 2024-09-04T16:32:52.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.669+0000 7f3e48568640 1 Processor -- start 2024-09-04T16:32:52.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.669+0000 7f3e48568640 1 -- start start 2024-09-04T16:32:52.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.669+0000 7f3e48568640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e40100840 0x7f3e401974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:52.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.669+0000 7f3e48568640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e40101a40 0x7f3e40197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:52.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.669+0000 7f3e48568640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3e40109680 con 0x7f3e40100840 2024-09-04T16:32:52.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.669+0000 7f3e48568640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3e40109500 con 0x7f3e40101a40 2024-09-04T16:32:52.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.669+0000 7f3e46304640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e40100840 0x7f3e401974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:52.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.669+0000 7f3e46304640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e40100840 0x7f3e401974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37658/0 (socket says 172.21.15.170:37658) 2024-09-04T16:32:52.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.669+0000 7f3e46304640 1 -- 172.21.15.170:0/3600109889 learned_addr learned my addr 172.21.15.170:0/3600109889 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:32:52.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.669+0000 7f3e45b03640 1 --2- 172.21.15.170:0/3600109889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e40101a40 0x7f3e40197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:52.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.669+0000 7f3e46304640 1 -- 172.21.15.170:0/3600109889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e40101a40 msgr2=0x7f3e40197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:52.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.669+0000 7f3e46304640 1 --2- 172.21.15.170:0/3600109889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e40101a40 0x7f3e40197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.669+0000 7f3e46304640 1 -- 172.21.15.170:0/3600109889 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e40198090 con 0x7f3e40100840 2024-09-04T16:32:52.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.669+0000 7f3e45b03640 1 --2- 172.21.15.170:0/3600109889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e40101a40 0x7f3e40197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:32:52.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.669+0000 7f3e46304640 1 --2- 172.21.15.170:0/3600109889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e40100840 0x7f3e401974d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00d8d0 tx=0x7f3e3c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:52.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.670+0000 7f3e377fe640 1 -- 172.21.15.170:0/3600109889 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e3c017070 con 0x7f3e40100840 2024-09-04T16:32:52.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.670+0000 7f3e48568640 1 -- 172.21.15.170:0/3600109889 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e4019cad0 con 0x7f3e40100840 2024-09-04T16:32:52.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.670+0000 7f3e377fe640 1 -- 172.21.15.170:0/3600109889 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e3c00be10 con 0x7f3e40100840 2024-09-04T16:32:52.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.670+0000 7f3e377fe640 1 -- 172.21.15.170:0/3600109889 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e3c00f3c0 con 0x7f3e40100840 2024-09-04T16:32:52.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.670+0000 7f3e48568640 1 -- 172.21.15.170:0/3600109889 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e4019d060 con 0x7f3e40100840 2024-09-04T16:32:52.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.671+0000 7f3e48568640 1 -- 172.21.15.170:0/3600109889 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e40100c40 con 0x7f3e40100840 2024-09-04T16:32:52.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.671+0000 7f3e377fe640 1 -- 172.21.15.170:0/3600109889 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f3e3c01a070 con 0x7f3e40100840 2024-09-04T16:32:52.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.672+0000 7f3e377fe640 1 --2- 172.21.15.170:0/3600109889 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3e2c079e30 0x7f3e2c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:52.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.672+0000 7f3e377fe640 1 -- 172.21.15.170:0/3600109889 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f3e3c09c670 con 0x7f3e40100840 2024-09-04T16:32:52.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.672+0000 7f3e45b03640 1 --2- 172.21.15.170:0/3600109889 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3e2c079e30 0x7f3e2c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:52.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.673+0000 7f3e45b03640 1 --2- 172.21.15.170:0/3600109889 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3e2c079e30 0x7f3e2c07c2f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3e40198980 tx=0x7f3e30005a20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:52.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.677+0000 7f3e377fe640 1 -- 172.21.15.170:0/3600109889 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f3e3c064130 con 0x7f3e40100840 2024-09-04T16:32:52.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.880+0000 7f3e48568640 1 -- 172.21.15.170:0/3600109889 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3e4006a2f0 con 0x7f3e2c079e30 2024-09-04T16:32:52.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.881+0000 7f3e377fe640 1 -- 172.21.15.170:0/3600109889 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7f3e4006a2f0 con 0x7f3e2c079e30 2024-09-04T16:32:52.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.883+0000 7f3e48568640 1 -- 172.21.15.170:0/3600109889 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3e2c079e30 msgr2=0x7f3e2c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:52.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.883+0000 7f3e48568640 1 --2- 172.21.15.170:0/3600109889 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3e2c079e30 0x7f3e2c07c2f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3e40198980 tx=0x7f3e30005a20 comp rx=0 tx=0).stop 2024-09-04T16:32:52.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.883+0000 7f3e48568640 1 -- 172.21.15.170:0/3600109889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e40100840 msgr2=0x7f3e401974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:52.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.883+0000 7f3e48568640 1 --2- 172.21.15.170:0/3600109889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e40100840 0x7f3e401974d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00d8d0 tx=0x7f3e3c00dd90 comp rx=0 tx=0).stop 2024-09-04T16:32:52.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.883+0000 7f3e48568640 1 -- 172.21.15.170:0/3600109889 shutdown_connections 2024-09-04T16:32:52.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.883+0000 7f3e48568640 1 --2- 172.21.15.170:0/3600109889 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3e2c079e30 0x7f3e2c07c2f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.883+0000 7f3e48568640 1 --2- 172.21.15.170:0/3600109889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e40101a40 0x7f3e40197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.883+0000 7f3e48568640 1 --2- 172.21.15.170:0/3600109889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e40100840 0x7f3e401974d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.883+0000 7f3e48568640 1 -- 172.21.15.170:0/3600109889 >> 172.21.15.170:0/3600109889 conn(0x7f3e400fbff0 msgr2=0x7f3e40069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:52.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.884+0000 7f3e48568640 1 -- 172.21.15.170:0/3600109889 shutdown_connections 2024-09-04T16:32:52.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.884+0000 7f3e48568640 1 -- 172.21.15.170:0/3600109889 wait complete. 2024-09-04T16:32:52.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.970+0000 7fd0a9669640 1 -- 172.21.15.170:0/1147547064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0a41023d0 msgr2=0x7fd0a41047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:52.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.970+0000 7fd0a9669640 1 --2- 172.21.15.170:0/1147547064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0a41023d0 0x7fd0a41047c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd0940098b0 tx=0x7fd09402a4d0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.970+0000 7fd0a9669640 1 -- 172.21.15.170:0/1147547064 shutdown_connections 2024-09-04T16:32:52.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.970+0000 7fd0a9669640 1 --2- 172.21.15.170:0/1147547064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd0a4104d00 0x7fd0a41070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.970+0000 7fd0a9669640 1 --2- 172.21.15.170:0/1147547064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0a41023d0 0x7fd0a41047c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.970+0000 7fd0a9669640 1 -- 172.21.15.170:0/1147547064 >> 172.21.15.170:0/1147547064 conn(0x7fd0a40fbff0 msgr2=0x7fd0a40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:52.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.970+0000 7fd0a9669640 1 -- 172.21.15.170:0/1147547064 shutdown_connections 2024-09-04T16:32:52.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.970+0000 7fd0a9669640 1 -- 172.21.15.170:0/1147547064 wait complete. 2024-09-04T16:32:52.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.970+0000 7fd0a9669640 1 Processor -- start 2024-09-04T16:32:52.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.971+0000 7fd0a9669640 1 -- start start 2024-09-04T16:32:52.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.971+0000 7fd0a9669640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0a41023d0 0x7fd0a4101cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:52.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.971+0000 7fd0a9669640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd0a4104d00 0x7fd0a4100380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:52.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.971+0000 7fd0a9669640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a410a7a0 con 0x7fd0a41023d0 2024-09-04T16:32:52.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.971+0000 7fd0a9669640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a410a620 con 0x7fd0a4104d00 2024-09-04T16:32:52.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.971+0000 7fd0a2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0a41023d0 0x7fd0a4101cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:52.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.971+0000 7fd0a2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0a41023d0 0x7fd0a4101cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37670/0 (socket says 172.21.15.170:37670) 2024-09-04T16:32:52.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.971+0000 7fd0a2ffd640 1 -- 172.21.15.170:0/1109118979 learned_addr learned my addr 172.21.15.170:0/1109118979 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:32:52.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.971+0000 7fd0a27fc640 1 --2- 172.21.15.170:0/1109118979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd0a4104d00 0x7fd0a4100380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:52.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.971+0000 7fd0a2ffd640 1 -- 172.21.15.170:0/1109118979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd0a4104d00 msgr2=0x7fd0a4100380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:52.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.971+0000 7fd0a2ffd640 1 --2- 172.21.15.170:0/1109118979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd0a4104d00 0x7fd0a4100380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:52.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.971+0000 7fd0a2ffd640 1 -- 172.21.15.170:0/1109118979 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a41008c0 con 0x7fd0a41023d0 2024-09-04T16:32:52.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.971+0000 7fd0a27fc640 1 --2- 172.21.15.170:0/1109118979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd0a4104d00 0x7fd0a4100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:32:52.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.971+0000 7fd0a2ffd640 1 --2- 172.21.15.170:0/1109118979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0a41023d0 0x7fd0a4101cc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd0940099d0 tx=0x7fd0940048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:52.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.972+0000 7fd08bfff640 1 -- 172.21.15.170:0/1109118979 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd09403f070 con 0x7fd0a41023d0 2024-09-04T16:32:52.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.972+0000 7fd0a9669640 1 -- 172.21.15.170:0/1109118979 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a4100b50 con 0x7fd0a41023d0 2024-09-04T16:32:52.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.972+0000 7fd08bfff640 1 -- 172.21.15.170:0/1109118979 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd094004c70 con 0x7fd0a41023d0 2024-09-04T16:32:52.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.972+0000 7fd08bfff640 1 -- 172.21.15.170:0/1109118979 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd094035030 con 0x7fd0a41023d0 2024-09-04T16:32:52.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.972+0000 7fd0a9669640 1 -- 172.21.15.170:0/1109118979 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a4101080 con 0x7fd0a41023d0 2024-09-04T16:32:52.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.973+0000 7fd0a9669640 1 -- 172.21.15.170:0/1109118979 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0a41027b0 con 0x7fd0a41023d0 2024-09-04T16:32:52.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.974+0000 7fd08bfff640 1 -- 172.21.15.170:0/1109118979 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fd094042070 con 0x7fd0a41023d0 2024-09-04T16:32:52.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.974+0000 7fd08bfff640 1 --2- 172.21.15.170:0/1109118979 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd08c079e30 0x7fd08c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:52.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.974+0000 7fd08bfff640 1 -- 172.21.15.170:0/1109118979 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fd0940bd720 con 0x7fd0a41023d0 2024-09-04T16:32:52.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.974+0000 7fd0a27fc640 1 --2- 172.21.15.170:0/1109118979 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd08c079e30 0x7fd08c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:52.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.975+0000 7fd0a27fc640 1 --2- 172.21.15.170:0/1109118979 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd08c079e30 0x7fd08c07c2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4101a40 tx=0x7fd098005d30 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:52.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:52.979+0000 7fd08bfff640 1 -- 172.21.15.170:0/1109118979 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fd0940851e0 con 0x7fd0a41023d0 2024-09-04T16:32:53.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.194+0000 7fd0a9669640 1 -- 172.21.15.170:0/1109118979 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd0a4105740 con 0x7fd08c079e30 2024-09-04T16:32:53.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.205+0000 7fd08bfff640 1 -- 172.21.15.170:0/1109118979 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fd0a4105740 con 0x7fd08c079e30 2024-09-04T16:32:53.206 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:32:53.206 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (9m) 8s ago 10m 24.9M - 0.25.0 c8568f914cd2 e85db6a2e731 2024-09-04T16:32:53.206 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (3m) 8s ago 10m 8762k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:32:53.206 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (2m) 34s ago 9m 8112k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:32:53.206 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (10m) 8s ago 10m 6891k - 19.1.1-252-g48920dab b708f9119ac7 aa2ec5c5776a 2024-09-04T16:32:53.206 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (9m) 34s ago 9m 6895k - 19.1.1-252-g48920dab b708f9119ac7 a24f0ce3b3fb 2024-09-04T16:32:53.206 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (9m) 8s ago 10m 78.2M - 9.4.12 2bacad6d85d8 5bffd3332aba 2024-09-04T16:32:53.206 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (5m) 8s ago 5m 27.1M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:32:53.207 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (5m) 8s ago 5m 147M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:32:53.207 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (5m) 34s ago 5m 15.5M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:32:53.207 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (5m) 34s ago 5m 14.9M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:32:53.207 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (2m) 8s ago 12m 512M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:32:53.207 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (63s) 34s ago 9m 454M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:32:53.207 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (12m) 8s ago 12m 59.1M 2048M 19.1.1-252-g48920dab b708f9119ac7 194ff39cc041 2024-09-04T16:32:53.207 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (9m) 34s ago 9m 49.7M 2048M 19.1.1-252-g48920dab b708f9119ac7 38c8e99ca323 2024-09-04T16:32:53.207 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (43s) 8s ago 10m 9861k - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:32:53.207 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (37s) 34s ago 9m 5246k - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:32:53.207 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (8m) 8s ago 8m 209M 1216M 19.1.1-252-g48920dab b708f9119ac7 6c2ea484615d 2024-09-04T16:32:53.207 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (8m) 8s ago 8m 227M 1216M 19.1.1-252-g48920dab b708f9119ac7 20469ba5727b 2024-09-04T16:32:53.207 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (7m) 8s ago 7m 182M 1216M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:32:53.207 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (7m) 34s ago 7m 245M 2240M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:32:53.207 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (6m) 34s ago 6m 209M 2240M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:32:53.208 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (6m) 34s ago 6m 189M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:32:53.208 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (13s) 8s ago 10m 41.3M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:32:53.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.208+0000 7fd0a9669640 1 -- 172.21.15.170:0/1109118979 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd08c079e30 msgr2=0x7fd08c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:53.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.208+0000 7fd0a9669640 1 --2- 172.21.15.170:0/1109118979 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd08c079e30 0x7fd08c07c2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4101a40 tx=0x7fd098005d30 comp rx=0 tx=0).stop 2024-09-04T16:32:53.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.208+0000 7fd0a9669640 1 -- 172.21.15.170:0/1109118979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0a41023d0 msgr2=0x7fd0a4101cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:53.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.208+0000 7fd0a9669640 1 --2- 172.21.15.170:0/1109118979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0a41023d0 0x7fd0a4101cc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd0940099d0 tx=0x7fd0940048f0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.208+0000 7fd0a9669640 1 -- 172.21.15.170:0/1109118979 shutdown_connections 2024-09-04T16:32:53.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.208+0000 7fd0a9669640 1 --2- 172.21.15.170:0/1109118979 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd08c079e30 0x7fd08c07c2f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.208+0000 7fd0a9669640 1 --2- 172.21.15.170:0/1109118979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd0a4104d00 0x7fd0a4100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.208+0000 7fd0a9669640 1 --2- 172.21.15.170:0/1109118979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0a41023d0 0x7fd0a4101cc0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.208+0000 7fd0a9669640 1 -- 172.21.15.170:0/1109118979 >> 172.21.15.170:0/1109118979 conn(0x7fd0a40fbff0 msgr2=0x7fd0a40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:53.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.208+0000 7fd0a9669640 1 -- 172.21.15.170:0/1109118979 shutdown_connections 2024-09-04T16:32:53.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.208+0000 7fd0a9669640 1 -- 172.21.15.170:0/1109118979 wait complete. 2024-09-04T16:32:53.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.294+0000 7fa418d30640 1 -- 172.21.15.170:0/2550546246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa414101a80 msgr2=0x7fa414101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:53.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.294+0000 7fa418d30640 1 --2- 172.21.15.170:0/2550546246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa414101a80 0x7fa414101f00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009880 tx=0x7fa3fc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.294+0000 7fa418d30640 1 -- 172.21.15.170:0/2550546246 shutdown_connections 2024-09-04T16:32:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.294+0000 7fa418d30640 1 --2- 172.21.15.170:0/2550546246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa414101a80 0x7fa414101f00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.294+0000 7fa418d30640 1 --2- 172.21.15.170:0/2550546246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa414100880 0x7fa414100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.294+0000 7fa418d30640 1 -- 172.21.15.170:0/2550546246 >> 172.21.15.170:0/2550546246 conn(0x7fa4140fc010 msgr2=0x7fa4140fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.295+0000 7fa418d30640 1 -- 172.21.15.170:0/2550546246 shutdown_connections 2024-09-04T16:32:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.295+0000 7fa418d30640 1 -- 172.21.15.170:0/2550546246 wait complete. 2024-09-04T16:32:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.295+0000 7fa418d30640 1 Processor -- start 2024-09-04T16:32:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.296+0000 7fa418d30640 1 -- start start 2024-09-04T16:32:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.296+0000 7fa418d30640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa414100880 0x7fa41406ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.296+0000 7fa418d30640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa414101a80 0x7fa41419c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.296+0000 7fa418d30640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa4141096a0 con 0x7fa414100880 2024-09-04T16:32:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.296+0000 7fa418d30640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa414109520 con 0x7fa414101a80 2024-09-04T16:32:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.296+0000 7fa41259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa414100880 0x7fa41406ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.296+0000 7fa41259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa414100880 0x7fa41406ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37692/0 (socket says 172.21.15.170:37692) 2024-09-04T16:32:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.296+0000 7fa41259c640 1 -- 172.21.15.170:0/1011361374 learned_addr learned my addr 172.21.15.170:0/1011361374 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:32:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.296+0000 7fa411d9b640 1 --2- 172.21.15.170:0/1011361374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa414101a80 0x7fa41419c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.296+0000 7fa41259c640 1 -- 172.21.15.170:0/1011361374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa414101a80 msgr2=0x7fa41419c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.296+0000 7fa41259c640 1 --2- 172.21.15.170:0/1011361374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa414101a80 0x7fa41419c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.296+0000 7fa41259c640 1 -- 172.21.15.170:0/1011361374 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa41419c790 con 0x7fa414100880 2024-09-04T16:32:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.296+0000 7fa41259c640 1 --2- 172.21.15.170:0/1011361374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa414100880 0x7fa41406ae30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa40400ea00 tx=0x7fa40400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.297+0000 7fa40b7fe640 1 -- 172.21.15.170:0/1011361374 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa40400cb80 con 0x7fa414100880 2024-09-04T16:32:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.297+0000 7fa40b7fe640 1 -- 172.21.15.170:0/1011361374 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa40400cd20 con 0x7fa414100880 2024-09-04T16:32:53.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.297+0000 7fa418d30640 1 -- 172.21.15.170:0/1011361374 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa41419ca80 con 0x7fa414100880 2024-09-04T16:32:53.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.297+0000 7fa40b7fe640 1 -- 172.21.15.170:0/1011361374 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa40401a960 con 0x7fa414100880 2024-09-04T16:32:53.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.297+0000 7fa418d30640 1 -- 172.21.15.170:0/1011361374 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa41419cfe0 con 0x7fa414100880 2024-09-04T16:32:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.298+0000 7fa418d30640 1 -- 172.21.15.170:0/1011361374 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa414109ea0 con 0x7fa414100880 2024-09-04T16:32:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.298+0000 7fa40b7fe640 1 -- 172.21.15.170:0/1011361374 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fa40401ab00 con 0x7fa414100880 2024-09-04T16:32:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.299+0000 7fa40b7fe640 1 --2- 172.21.15.170:0/1011361374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa400079e80 0x7fa40007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.299+0000 7fa40b7fe640 1 -- 172.21.15.170:0/1011361374 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fa40409d080 con 0x7fa414100880 2024-09-04T16:32:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.299+0000 7fa411d9b640 1 --2- 172.21.15.170:0/1011361374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa400079e80 0x7fa40007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.299+0000 7fa411d9b640 1 --2- 172.21.15.170:0/1011361374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa400079e80 0x7fa40007c340 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc000c00 tx=0x7fa3fc0058d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.303+0000 7fa40b7fe640 1 -- 172.21.15.170:0/1011361374 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fa404016030 con 0x7fa414100880 2024-09-04T16:32:53.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.573+0000 7fa418d30640 1 -- 172.21.15.170:0/1011361374 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa414062df0 con 0x7fa414100880 2024-09-04T16:32:53.574 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:53 smithi170 ceph-mon[29272]: pgmap v60: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:53.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.574+0000 7fa40b7fe640 1 -- 172.21.15.170:0/1011361374 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fa404064b30 con 0x7fa414100880 2024-09-04T16:32:53.575 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:32:53.575 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:32:53.575 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 2 2024-09-04T16:32:53.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:32:53.575 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:32:53.575 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:32:53.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:32:53.575 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:32:53.575 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 6 2024-09-04T16:32:53.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:32:53.576 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:32:53.576 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:32:53.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:32:53.576 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:32:53.576 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 12, 2024-09-04T16:32:53.576 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:32:53.576 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:32:53.576 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:32:53.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.576+0000 7fa418d30640 1 -- 172.21.15.170:0/1011361374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa400079e80 msgr2=0x7fa40007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:53.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.576+0000 7fa418d30640 1 --2- 172.21.15.170:0/1011361374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa400079e80 0x7fa40007c340 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc000c00 tx=0x7fa3fc0058d0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.576+0000 7fa418d30640 1 -- 172.21.15.170:0/1011361374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa414100880 msgr2=0x7fa41406ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:53.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.576+0000 7fa418d30640 1 --2- 172.21.15.170:0/1011361374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa414100880 0x7fa41406ae30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa40400ea00 tx=0x7fa40400eec0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.576+0000 7fa418d30640 1 -- 172.21.15.170:0/1011361374 shutdown_connections 2024-09-04T16:32:53.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.576+0000 7fa418d30640 1 --2- 172.21.15.170:0/1011361374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa400079e80 0x7fa40007c340 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.576+0000 7fa418d30640 1 --2- 172.21.15.170:0/1011361374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa414101a80 0x7fa41419c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.576+0000 7fa418d30640 1 --2- 172.21.15.170:0/1011361374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa414100880 0x7fa41406ae30 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.576+0000 7fa418d30640 1 -- 172.21.15.170:0/1011361374 >> 172.21.15.170:0/1011361374 conn(0x7fa4140fc010 msgr2=0x7fa414104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:53.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.576+0000 7fa418d30640 1 -- 172.21.15.170:0/1011361374 shutdown_connections 2024-09-04T16:32:53.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.576+0000 7fa418d30640 1 -- 172.21.15.170:0/1011361374 wait complete. 2024-09-04T16:32:53.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:53 smithi193 ceph-mon[36288]: pgmap v60: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:53.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.666+0000 7f2d23418640 1 -- 172.21.15.170:0/3536983328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d1c104d40 msgr2=0x7f2d1c107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:53.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.666+0000 7f2d23418640 1 --2- 172.21.15.170:0/3536983328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d1c104d40 0x7f2d1c107130 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0098b0 tx=0x7f2d0c02a4d0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.667+0000 7f2d23418640 1 -- 172.21.15.170:0/3536983328 shutdown_connections 2024-09-04T16:32:53.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.667+0000 7f2d23418640 1 --2- 172.21.15.170:0/3536983328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d1c104d40 0x7f2d1c107130 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.667+0000 7f2d23418640 1 --2- 172.21.15.170:0/3536983328 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d1c102410 0x7f2d1c104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.667+0000 7f2d23418640 1 -- 172.21.15.170:0/3536983328 >> 172.21.15.170:0/3536983328 conn(0x7f2d1c0fc010 msgr2=0x7f2d1c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:53.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.667+0000 7f2d23418640 1 -- 172.21.15.170:0/3536983328 shutdown_connections 2024-09-04T16:32:53.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.667+0000 7f2d23418640 1 -- 172.21.15.170:0/3536983328 wait complete. 2024-09-04T16:32:53.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.667+0000 7f2d23418640 1 Processor -- start 2024-09-04T16:32:53.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.667+0000 7f2d23418640 1 -- start start 2024-09-04T16:32:53.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.668+0000 7f2d23418640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d1c102410 0x7f2d1c1974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:53.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.668+0000 7f2d23418640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d1c104d40 0x7f2d1c197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:53.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.668+0000 7f2d23418640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c10a7d0 con 0x7f2d1c104d40 2024-09-04T16:32:53.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.668+0000 7f2d23418640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c10a650 con 0x7f2d1c102410 2024-09-04T16:32:53.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.668+0000 7f2d209b3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d1c104d40 0x7f2d1c197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:53.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.668+0000 7f2d209b3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d1c104d40 0x7f2d1c197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37716/0 (socket says 172.21.15.170:37716) 2024-09-04T16:32:53.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.668+0000 7f2d209b3640 1 -- 172.21.15.170:0/3655209877 learned_addr learned my addr 172.21.15.170:0/3655209877 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:32:53.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.668+0000 7f2d211b4640 1 --2- 172.21.15.170:0/3655209877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d1c102410 0x7f2d1c1974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:53.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.668+0000 7f2d209b3640 1 -- 172.21.15.170:0/3655209877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d1c102410 msgr2=0x7f2d1c1974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:53.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.668+0000 7f2d209b3640 1 --2- 172.21.15.170:0/3655209877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d1c102410 0x7f2d1c1974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.668+0000 7f2d209b3640 1 -- 172.21.15.170:0/3655209877 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1c1980b0 con 0x7f2d1c104d40 2024-09-04T16:32:53.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.668+0000 7f2d209b3640 1 --2- 172.21.15.170:0/3655209877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d1c104d40 0x7f2d1c197a30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009230 tx=0x7f2d0c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:53.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.669+0000 7f2d127fc640 1 -- 172.21.15.170:0/3655209877 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d0c03f070 con 0x7f2d1c104d40 2024-09-04T16:32:53.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.669+0000 7f2d127fc640 1 -- 172.21.15.170:0/3655209877 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2d0c0049d0 con 0x7f2d1c104d40 2024-09-04T16:32:53.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.669+0000 7f2d23418640 1 -- 172.21.15.170:0/3655209877 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1c19ca90 con 0x7f2d1c104d40 2024-09-04T16:32:53.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.669+0000 7f2d127fc640 1 -- 172.21.15.170:0/3655209877 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d0c035030 con 0x7f2d1c104d40 2024-09-04T16:32:53.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.669+0000 7f2d23418640 1 -- 172.21.15.170:0/3655209877 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d1c19d020 con 0x7f2d1c104d40 2024-09-04T16:32:53.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.670+0000 7f2d23418640 1 -- 172.21.15.170:0/3655209877 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d1c1027f0 con 0x7f2d1c104d40 2024-09-04T16:32:53.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.671+0000 7f2d127fc640 1 -- 172.21.15.170:0/3655209877 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f2d0c042070 con 0x7f2d1c104d40 2024-09-04T16:32:53.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.672+0000 7f2d127fc640 1 --2- 172.21.15.170:0/3655209877 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2d08079e80 0x7f2d0807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:32:53.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.672+0000 7f2d127fc640 1 -- 172.21.15.170:0/3655209877 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f2d0c0bd380 con 0x7f2d1c104d40 2024-09-04T16:32:53.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.672+0000 7f2d211b4640 1 --2- 172.21.15.170:0/3655209877 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2d08079e80 0x7f2d0807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:32:53.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.673+0000 7f2d211b4640 1 --2- 172.21.15.170:0/3655209877 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2d08079e80 0x7f2d0807c340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009bd0 tx=0x7f2d18005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:32:53.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.677+0000 7f2d127fc640 1 -- 172.21.15.170:0/3655209877 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f2d0c089030 con 0x7f2d1c104d40 2024-09-04T16:32:53.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.889+0000 7f2d23418640 1 -- 172.21.15.170:0/3655209877 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2d1c105740 con 0x7f2d08079e80 2024-09-04T16:32:53.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.891+0000 7f2d127fc640 1 -- 172.21.15.170:0/3655209877 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7f2d1c105740 con 0x7f2d08079e80 2024-09-04T16:32:53.891 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:32:53.891 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:32:53.891 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:32:53.891 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-04T16:32:53.891 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:32:53.892 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-04T16:32:53.892 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:32:53.892 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "2/2 daemons upgraded", 2024-09-04T16:32:53.892 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-04T16:32:53.892 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:32:53.892 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:32:53.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.893+0000 7f2d23418640 1 -- 172.21.15.170:0/3655209877 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2d08079e80 msgr2=0x7f2d0807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:53.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.893+0000 7f2d23418640 1 --2- 172.21.15.170:0/3655209877 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2d08079e80 0x7f2d0807c340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009bd0 tx=0x7f2d18005f90 comp rx=0 tx=0).stop 2024-09-04T16:32:53.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.893+0000 7f2d23418640 1 -- 172.21.15.170:0/3655209877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d1c104d40 msgr2=0x7f2d1c197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:32:53.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.893+0000 7f2d23418640 1 --2- 172.21.15.170:0/3655209877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d1c104d40 0x7f2d1c197a30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009230 tx=0x7f2d0c0045e0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.893+0000 7f2d23418640 1 -- 172.21.15.170:0/3655209877 shutdown_connections 2024-09-04T16:32:53.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.893+0000 7f2d23418640 1 --2- 172.21.15.170:0/3655209877 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2d08079e80 0x7f2d0807c340 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.893+0000 7f2d23418640 1 --2- 172.21.15.170:0/3655209877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d1c104d40 0x7f2d1c197a30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.893+0000 7f2d23418640 1 --2- 172.21.15.170:0/3655209877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d1c102410 0x7f2d1c1974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:32:53.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.893+0000 7f2d23418640 1 -- 172.21.15.170:0/3655209877 >> 172.21.15.170:0/3655209877 conn(0x7f2d1c0fc010 msgr2=0x7f2d1c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:32:53.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.893+0000 7f2d23418640 1 -- 172.21.15.170:0/3655209877 shutdown_connections 2024-09-04T16:32:53.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:32:53.893+0000 7f2d23418640 1 -- 172.21.15.170:0/3655209877 wait complete. 2024-09-04T16:32:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:54 smithi193 ceph-mon[36288]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:32:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:54 smithi193 ceph-mon[36288]: from='client.14872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:32:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:54 smithi193 ceph-mon[36288]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:32:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:54 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1011361374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:54.819 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:54 smithi170 ceph-mon[29272]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:32:54.819 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:54 smithi170 ceph-mon[29272]: from='client.14872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:32:54.820 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:54 smithi170 ceph-mon[29272]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:32:54.820 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:54 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1011361374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:32:55.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:55 smithi193 ceph-mon[36288]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:32:55.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:55 smithi193 ceph-mon[36288]: pgmap v61: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:55.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:55 smithi170 ceph-mon[29272]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:32:55.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:55 smithi170 ceph-mon[29272]: pgmap v61: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:56.735 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:56 smithi170 ceph-mon[29272]: pgmap v62: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:56.771 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:56 smithi193 ceph-mon[36288]: pgmap v62: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:59.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:59 smithi170 ceph-mon[29272]: pgmap v63: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:59.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:32:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:32:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:59 smithi193 ceph-mon[36288]: pgmap v63: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:32:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:32:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:33:01.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:01 smithi193 ceph-mon[36288]: pgmap v64: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:01.728 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:01 smithi170 ceph-mon[29272]: pgmap v64: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:03.589 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:03 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:03.589 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:03 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:03.589 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:03 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:33:03.589 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:03 smithi170 ceph-mon[29272]: pgmap v65: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:03.590 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:03 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:03.590 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:03 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:03.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:03 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:03.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:03 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:03.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:03 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:33:03.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:03 smithi193 ceph-mon[36288]: pgmap v65: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:03.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:03 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:03.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:03 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:05.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:05 smithi170 ceph-mon[29272]: pgmap v66: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:05.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:05 smithi193 ceph-mon[36288]: pgmap v66: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:07.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:07 smithi193 ceph-mon[36288]: pgmap v67: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:07.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:07 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:07.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:07 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:07.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:07 smithi170 ceph-mon[29272]: pgmap v67: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:07.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:07 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:07.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:07 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:08.808 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:08 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:08.808 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:08 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:08.809 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:08 smithi170 ceph-mon[29272]: pgmap v68: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:09.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:08 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:09.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:08 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:09.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:08 smithi193 ceph-mon[36288]: pgmap v68: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:11.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: pgmap v69: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:11.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:11.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:11.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:33:11.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:33:11.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:11.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-04T16:33:11.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:33:11.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:11 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.658 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: pgmap v69: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:11.658 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:11.658 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:11.658 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:33:11.658 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:33:11.658 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:11.659 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-04T16:33:11.659 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:33:11.659 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.659 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.659 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.659 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.659 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.659 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.659 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.659 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.659 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:11.659 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:11 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:12.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:12 smithi170 ceph-mon[29272]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-04T16:33:12.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:12 smithi193 ceph-mon[36288]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-04T16:33:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:13 smithi193 ceph-mon[36288]: pgmap v70: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:13 smithi193 ceph-mon[36288]: Upgrade: Updating grafana.smithi170 2024-09-04T16:33:13.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:13 smithi170 ceph-mon[29272]: pgmap v70: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:13.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:13 smithi170 ceph-mon[29272]: Upgrade: Updating grafana.smithi170 2024-09-04T16:33:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:14 smithi193 ceph-mon[36288]: Deploying daemon grafana.smithi170 on smithi170 2024-09-04T16:33:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:14 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:33:14.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:14 smithi170 ceph-mon[29272]: Deploying daemon grafana.smithi170 on smithi170 2024-09-04T16:33:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:14 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:33:15.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:15 smithi170 ceph-mon[29272]: pgmap v71: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:15.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:15 smithi193 ceph-mon[36288]: pgmap v71: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:16.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:16 smithi170 ceph-mon[29272]: pgmap v72: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:16.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:16 smithi193 ceph-mon[36288]: pgmap v72: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:19.648 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:19 smithi170 ceph-mon[29272]: pgmap v73: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:19.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:19 smithi193 ceph-mon[36288]: pgmap v73: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:21.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:21 smithi193 ceph-mon[36288]: pgmap v74: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:21.679 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:21 smithi170 ceph-mon[29272]: pgmap v74: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:23 smithi170 ceph-mon[29272]: pgmap v75: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:23.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:23 smithi193 ceph-mon[36288]: pgmap v75: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:23.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.984+0000 7f1288618640 1 -- 172.21.15.170:0/457220241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1280100870 msgr2=0x7f1280100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:23.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.984+0000 7f1288618640 1 --2- 172.21.15.170:0/457220241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1280100870 0x7f1280100c70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f127c009880 tx=0x7f127c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:33:23.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.984+0000 7f1288618640 1 -- 172.21.15.170:0/457220241 shutdown_connections 2024-09-04T16:33:23.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.984+0000 7f1288618640 1 --2- 172.21.15.170:0/457220241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1280101a70 0x7f1280101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:23.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.984+0000 7f1288618640 1 --2- 172.21.15.170:0/457220241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1280100870 0x7f1280100c70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:23.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.984+0000 7f1288618640 1 -- 172.21.15.170:0/457220241 >> 172.21.15.170:0/457220241 conn(0x7f12800fc020 msgr2=0x7f12800fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:33:23.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.984+0000 7f1288618640 1 -- 172.21.15.170:0/457220241 shutdown_connections 2024-09-04T16:33:23.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.984+0000 7f1288618640 1 -- 172.21.15.170:0/457220241 wait complete. 2024-09-04T16:33:23.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.985+0000 7f1288618640 1 Processor -- start 2024-09-04T16:33:23.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.985+0000 7f1288618640 1 -- start start 2024-09-04T16:33:23.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.985+0000 7f1288618640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1280100870 0x7f12801974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:23.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.985+0000 7f1288618640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1280101a70 0x7f1280197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:23.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.985+0000 7f1288618640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1280109690 con 0x7f1280101a70 2024-09-04T16:33:23.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.985+0000 7f1288618640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1280109510 con 0x7f1280100870 2024-09-04T16:33:23.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.985+0000 7f12863b4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1280100870 0x7f12801974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:23.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.985+0000 7f12863b4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1280100870 0x7f12801974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.170:54904/0 (socket says 172.21.15.170:54904) 2024-09-04T16:33:23.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.985+0000 7f12863b4640 1 -- 172.21.15.170:0/4158432934 learned_addr learned my addr 172.21.15.170:0/4158432934 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:33:23.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.986+0000 7f1285bb3640 1 --2- 172.21.15.170:0/4158432934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1280101a70 0x7f1280197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:23.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.986+0000 7f12863b4640 1 -- 172.21.15.170:0/4158432934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1280101a70 msgr2=0x7f1280197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:23.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.986+0000 7f12863b4640 1 --2- 172.21.15.170:0/4158432934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1280101a70 0x7f1280197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:23.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.986+0000 7f12863b4640 1 -- 172.21.15.170:0/4158432934 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1280198090 con 0x7f1280100870 2024-09-04T16:33:23.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.986+0000 7f1285bb3640 1 --2- 172.21.15.170:0/4158432934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1280101a70 0x7f1280197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:33:23.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.986+0000 7f12863b4640 1 --2- 172.21.15.170:0/4158432934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1280100870 0x7f12801974d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f127c006010 tx=0x7f127c0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:33:23.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.986+0000 7f12777fe640 1 -- 172.21.15.170:0/4158432934 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f127c03f070 con 0x7f1280100870 2024-09-04T16:33:23.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.986+0000 7f1288618640 1 -- 172.21.15.170:0/4158432934 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f128019ca70 con 0x7f1280100870 2024-09-04T16:33:23.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.986+0000 7f12777fe640 1 -- 172.21.15.170:0/4158432934 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f127c004a50 con 0x7f1280100870 2024-09-04T16:33:23.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.986+0000 7f1288618640 1 -- 172.21.15.170:0/4158432934 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f128019d000 con 0x7f1280100870 2024-09-04T16:33:23.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.986+0000 7f12777fe640 1 -- 172.21.15.170:0/4158432934 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f127c035030 con 0x7f1280100870 2024-09-04T16:33:23.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.988+0000 7f1288618640 1 -- 172.21.15.170:0/4158432934 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1264005290 con 0x7f1280100870 2024-09-04T16:33:23.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.988+0000 7f12777fe640 1 -- 172.21.15.170:0/4158432934 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f127c042070 con 0x7f1280100870 2024-09-04T16:33:23.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.989+0000 7f12777fe640 1 --2- 172.21.15.170:0/4158432934 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f126c079e80 0x7f126c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:23.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.989+0000 7f12777fe640 1 -- 172.21.15.170:0/4158432934 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f127c0bd400 con 0x7f1280100870 2024-09-04T16:33:23.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.989+0000 7f1285bb3640 1 --2- 172.21.15.170:0/4158432934 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f126c079e80 0x7f126c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:23.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.989+0000 7f1285bb3640 1 --2- 172.21.15.170:0/4158432934 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f126c079e80 0x7f126c07c340 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1280198980 tx=0x7f127000b410 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:33:23.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:23.993+0000 7f12777fe640 1 -- 172.21.15.170:0/4158432934 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f127c004c00 con 0x7f1280100870 2024-09-04T16:33:24.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.215+0000 7f1288618640 1 -- 172.21.15.170:0/4158432934 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1264000bc0 con 0x7f126c079e80 2024-09-04T16:33:24.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.221+0000 7f12777fe640 1 -- 172.21.15.170:0/4158432934 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f1264000bc0 con 0x7f126c079e80 2024-09-04T16:33:24.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.224+0000 7f1288618640 1 -- 172.21.15.170:0/4158432934 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f126c079e80 msgr2=0x7f126c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:24.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.224+0000 7f1288618640 1 --2- 172.21.15.170:0/4158432934 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f126c079e80 0x7f126c07c340 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1280198980 tx=0x7f127000b410 comp rx=0 tx=0).stop 2024-09-04T16:33:24.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.224+0000 7f1288618640 1 -- 172.21.15.170:0/4158432934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1280100870 msgr2=0x7f12801974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:24.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.224+0000 7f1288618640 1 --2- 172.21.15.170:0/4158432934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1280100870 0x7f12801974d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f127c006010 tx=0x7f127c0045e0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.224+0000 7f1288618640 1 -- 172.21.15.170:0/4158432934 shutdown_connections 2024-09-04T16:33:24.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.224+0000 7f1288618640 1 --2- 172.21.15.170:0/4158432934 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f126c079e80 0x7f126c07c340 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.224+0000 7f1288618640 1 --2- 172.21.15.170:0/4158432934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1280101a70 0x7f1280197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.224+0000 7f1288618640 1 --2- 172.21.15.170:0/4158432934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1280100870 0x7f12801974d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.224+0000 7f1288618640 1 -- 172.21.15.170:0/4158432934 >> 172.21.15.170:0/4158432934 conn(0x7f12800fc020 msgr2=0x7f128006a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:33:24.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.224+0000 7f1288618640 1 -- 172.21.15.170:0/4158432934 shutdown_connections 2024-09-04T16:33:24.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.225+0000 7f1288618640 1 -- 172.21.15.170:0/4158432934 wait complete. 2024-09-04T16:33:24.238 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:33:24.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.333+0000 7fc5367d4640 1 -- 172.21.15.170:0/2197088727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc530101a40 msgr2=0x7fc530101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:24.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.333+0000 7fc5367d4640 1 --2- 172.21.15.170:0/2197088727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc530101a40 0x7fc530101ec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc524009880 tx=0x7fc52402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.333+0000 7fc5367d4640 1 -- 172.21.15.170:0/2197088727 shutdown_connections 2024-09-04T16:33:24.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.333+0000 7fc5367d4640 1 --2- 172.21.15.170:0/2197088727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc530101a40 0x7fc530101ec0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.333+0000 7fc5367d4640 1 --2- 172.21.15.170:0/2197088727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc530100840 0x7fc530100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.333+0000 7fc5367d4640 1 -- 172.21.15.170:0/2197088727 >> 172.21.15.170:0/2197088727 conn(0x7fc5300fbff0 msgr2=0x7fc5300fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:33:24.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.334+0000 7fc5367d4640 1 -- 172.21.15.170:0/2197088727 shutdown_connections 2024-09-04T16:33:24.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.334+0000 7fc5367d4640 1 -- 172.21.15.170:0/2197088727 wait complete. 2024-09-04T16:33:24.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.335+0000 7fc5367d4640 1 Processor -- start 2024-09-04T16:33:24.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.335+0000 7fc5367d4640 1 -- start start 2024-09-04T16:33:24.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.335+0000 7fc5367d4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc530100840 0x7fc5301972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:24.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.335+0000 7fc5367d4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc530101a40 0x7fc5301977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:24.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.335+0000 7fc5367d4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc530109680 con 0x7fc530100840 2024-09-04T16:33:24.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.335+0000 7fc5367d4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc530109500 con 0x7fc530101a40 2024-09-04T16:33:24.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.335+0000 7fc52ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc530100840 0x7fc5301972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:24.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.335+0000 7fc52ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc530100840 0x7fc5301972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48024/0 (socket says 172.21.15.170:48024) 2024-09-04T16:33:24.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.335+0000 7fc52ffff640 1 -- 172.21.15.170:0/4031762872 learned_addr learned my addr 172.21.15.170:0/4031762872 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:33:24.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.336+0000 7fc52f7fe640 1 --2- 172.21.15.170:0/4031762872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc530101a40 0x7fc5301977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:24.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.336+0000 7fc52ffff640 1 -- 172.21.15.170:0/4031762872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc530101a40 msgr2=0x7fc5301977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:24.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.336+0000 7fc52ffff640 1 --2- 172.21.15.170:0/4031762872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc530101a40 0x7fc5301977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.336+0000 7fc52ffff640 1 -- 172.21.15.170:0/4031762872 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc530197e70 con 0x7fc530100840 2024-09-04T16:33:24.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.336+0000 7fc52ffff640 1 --2- 172.21.15.170:0/4031762872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc530100840 0x7fc5301972b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc52000e940 tx=0x7fc52000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:33:24.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.336+0000 7fc52d7fa640 1 -- 172.21.15.170:0/4031762872 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc52000cac0 con 0x7fc530100840 2024-09-04T16:33:24.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.336+0000 7fc52d7fa640 1 -- 172.21.15.170:0/4031762872 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc52000cc60 con 0x7fc530100840 2024-09-04T16:33:24.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.336+0000 7fc5367d4640 1 -- 172.21.15.170:0/4031762872 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc53019c8b0 con 0x7fc530100840 2024-09-04T16:33:24.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.336+0000 7fc52d7fa640 1 -- 172.21.15.170:0/4031762872 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc520003e30 con 0x7fc530100840 2024-09-04T16:33:24.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.336+0000 7fc5367d4640 1 -- 172.21.15.170:0/4031762872 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc53019ce40 con 0x7fc530100840 2024-09-04T16:33:24.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.338+0000 7fc5367d4640 1 -- 172.21.15.170:0/4031762872 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc53019d0a0 con 0x7fc530100840 2024-09-04T16:33:24.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.339+0000 7fc52d7fa640 1 -- 172.21.15.170:0/4031762872 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fc520004000 con 0x7fc530100840 2024-09-04T16:33:24.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.340+0000 7fc52d7fa640 1 --2- 172.21.15.170:0/4031762872 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc518079ed0 0x7fc51807c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:24.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.340+0000 7fc52d7fa640 1 -- 172.21.15.170:0/4031762872 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fc52009cfa0 con 0x7fc530100840 2024-09-04T16:33:24.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.341+0000 7fc52f7fe640 1 --2- 172.21.15.170:0/4031762872 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc518079ed0 0x7fc51807c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:24.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.341+0000 7fc52f7fe640 1 --2- 172.21.15.170:0/4031762872 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc518079ed0 0x7fc51807c390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc530198760 tx=0x7fc524000bc0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:33:24.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.345+0000 7fc52d7fa640 1 -- 172.21.15.170:0/4031762872 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fc520064a40 con 0x7fc530100840 2024-09-04T16:33:24.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.544+0000 7fc5367d4640 1 -- 172.21.15.170:0/4031762872 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc5300fe1a0 con 0x7fc518079ed0 2024-09-04T16:33:24.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.546+0000 7fc52d7fa640 1 -- 172.21.15.170:0/4031762872 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7fc5300fe1a0 con 0x7fc518079ed0 2024-09-04T16:33:24.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.548+0000 7fc5367d4640 1 -- 172.21.15.170:0/4031762872 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc518079ed0 msgr2=0x7fc51807c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:24.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.548+0000 7fc5367d4640 1 --2- 172.21.15.170:0/4031762872 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc518079ed0 0x7fc51807c390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc530198760 tx=0x7fc524000bc0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.548+0000 7fc5367d4640 1 -- 172.21.15.170:0/4031762872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc530100840 msgr2=0x7fc5301972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:24.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.548+0000 7fc5367d4640 1 --2- 172.21.15.170:0/4031762872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc530100840 0x7fc5301972b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc52000e940 tx=0x7fc52000ee00 comp rx=0 tx=0).stop 2024-09-04T16:33:24.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.549+0000 7fc5367d4640 1 -- 172.21.15.170:0/4031762872 shutdown_connections 2024-09-04T16:33:24.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.549+0000 7fc5367d4640 1 --2- 172.21.15.170:0/4031762872 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc518079ed0 0x7fc51807c390 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.549+0000 7fc5367d4640 1 --2- 172.21.15.170:0/4031762872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc530101a40 0x7fc5301977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.549+0000 7fc5367d4640 1 --2- 172.21.15.170:0/4031762872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc530100840 0x7fc5301972b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.549+0000 7fc5367d4640 1 -- 172.21.15.170:0/4031762872 >> 172.21.15.170:0/4031762872 conn(0x7fc5300fbff0 msgr2=0x7fc5300fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:33:24.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.549+0000 7fc5367d4640 1 -- 172.21.15.170:0/4031762872 shutdown_connections 2024-09-04T16:33:24.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.549+0000 7fc5367d4640 1 -- 172.21.15.170:0/4031762872 wait complete. 2024-09-04T16:33:24.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.634+0000 7fdec5e8b640 1 -- 172.21.15.170:0/4196360559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec0103b90 msgr2=0x7fdec0103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:24.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.634+0000 7fdec5e8b640 1 --2- 172.21.15.170:0/4196360559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec0103b90 0x7fdec0103f90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdeb0009880 tx=0x7fdeb002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.634+0000 7fdec5e8b640 1 -- 172.21.15.170:0/4196360559 shutdown_connections 2024-09-04T16:33:24.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.634+0000 7fdec5e8b640 1 --2- 172.21.15.170:0/4196360559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdec0104d90 0x7fdec0105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.634+0000 7fdec5e8b640 1 --2- 172.21.15.170:0/4196360559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec0103b90 0x7fdec0103f90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.634+0000 7fdec5e8b640 1 -- 172.21.15.170:0/4196360559 >> 172.21.15.170:0/4196360559 conn(0x7fdec00ff320 msgr2=0x7fdec0101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:33:24.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.634+0000 7fdec5e8b640 1 -- 172.21.15.170:0/4196360559 shutdown_connections 2024-09-04T16:33:24.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.634+0000 7fdec5e8b640 1 -- 172.21.15.170:0/4196360559 wait complete. 2024-09-04T16:33:24.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.635+0000 7fdec5e8b640 1 Processor -- start 2024-09-04T16:33:24.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.635+0000 7fdec5e8b640 1 -- start start 2024-09-04T16:33:24.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.635+0000 7fdec5e8b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec0103b90 0x7fdec01996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:24.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.635+0000 7fdec5e8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdec0104d90 0x7fdec0199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:24.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.635+0000 7fdec5e8b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdec010c9b0 con 0x7fdec0103b90 2024-09-04T16:33:24.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.635+0000 7fdec5e8b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdec010c830 con 0x7fdec0104d90 2024-09-04T16:33:24.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.635+0000 7fdebf7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec0103b90 0x7fdec01996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:24.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.636+0000 7fdebf7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec0103b90 0x7fdec01996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48050/0 (socket says 172.21.15.170:48050) 2024-09-04T16:33:24.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.636+0000 7fdebf7fe640 1 -- 172.21.15.170:0/1446698575 learned_addr learned my addr 172.21.15.170:0/1446698575 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:33:24.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.636+0000 7fdebeffd640 1 --2- 172.21.15.170:0/1446698575 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdec0104d90 0x7fdec0199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:24.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.636+0000 7fdebf7fe640 1 -- 172.21.15.170:0/1446698575 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdec0104d90 msgr2=0x7fdec0199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:24.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.636+0000 7fdebf7fe640 1 --2- 172.21.15.170:0/1446698575 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdec0104d90 0x7fdec0199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.636+0000 7fdebf7fe640 1 -- 172.21.15.170:0/1446698575 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec019a2b0 con 0x7fdec0103b90 2024-09-04T16:33:24.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.636+0000 7fdebf7fe640 1 --2- 172.21.15.170:0/1446698575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec0103b90 0x7fdec01996f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdeb0006010 tx=0x7fdeb00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:33:24.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.636+0000 7fdebcff9640 1 -- 172.21.15.170:0/1446698575 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdeb003f070 con 0x7fdec0103b90 2024-09-04T16:33:24.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.636+0000 7fdebcff9640 1 -- 172.21.15.170:0/1446698575 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdeb0004a50 con 0x7fdec0103b90 2024-09-04T16:33:24.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.636+0000 7fdec5e8b640 1 -- 172.21.15.170:0/1446698575 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec019ec90 con 0x7fdec0103b90 2024-09-04T16:33:24.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.636+0000 7fdebcff9640 1 -- 172.21.15.170:0/1446698575 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdeb0035030 con 0x7fdec0103b90 2024-09-04T16:33:24.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.636+0000 7fdec5e8b640 1 -- 172.21.15.170:0/1446698575 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec019f170 con 0x7fdec0103b90 2024-09-04T16:33:24.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.637+0000 7fdec5e8b640 1 -- 172.21.15.170:0/1446698575 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdec0103f90 con 0x7fdec0103b90 2024-09-04T16:33:24.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.638+0000 7fdebcff9640 1 -- 172.21.15.170:0/1446698575 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fdeb0042070 con 0x7fdec0103b90 2024-09-04T16:33:24.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.638+0000 7fdebcff9640 1 --2- 172.21.15.170:0/1446698575 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdea8079e30 0x7fdea807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:24.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.639+0000 7fdebcff9640 1 -- 172.21.15.170:0/1446698575 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fdeb00bd510 con 0x7fdec0103b90 2024-09-04T16:33:24.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.639+0000 7fdebeffd640 1 --2- 172.21.15.170:0/1446698575 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdea8079e30 0x7fdea807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:24.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.639+0000 7fdebeffd640 1 --2- 172.21.15.170:0/1446698575 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdea8079e30 0x7fdea807c2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdec019aba0 tx=0x7fdeb400b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:33:24.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.643+0000 7fdebcff9640 1 -- 172.21.15.170:0/1446698575 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fdeb0004c00 con 0x7fdec0103b90 2024-09-04T16:33:24.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.834+0000 7fdec5e8b640 1 -- 172.21.15.170:0/1446698575 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fdec00626f0 con 0x7fdea8079e30 2024-09-04T16:33:24.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.844+0000 7fdebcff9640 1 -- 172.21.15.170:0/1446698575 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fdec00626f0 con 0x7fdea8079e30 2024-09-04T16:33:24.845 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:33:24.845 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (23s) 17s ago 11m 16.5M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:33:24.845 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (3m) 17s ago 11m 8791k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:33:24.845 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (2m) 65s ago 10m 8112k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:33:24.845 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (11m) 17s ago 11m 6891k - 19.1.1-252-g48920dab b708f9119ac7 aa2ec5c5776a 2024-09-04T16:33:24.845 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (10m) 65s ago 10m 6895k - 19.1.1-252-g48920dab b708f9119ac7 a24f0ce3b3fb 2024-09-04T16:33:24.846 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 starting - - - - 2024-09-04T16:33:24.846 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (5m) 17s ago 5m 27.1M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:33:24.846 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (6m) 17s ago 5m 147M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:33:24.846 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (5m) 65s ago 5m 15.5M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:33:24.846 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (5m) 65s ago 5m 14.9M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:33:24.846 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (2m) 17s ago 12m 513M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:33:24.846 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (94s) 65s ago 10m 454M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:33:24.846 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (12m) 17s ago 12m 59.9M 2048M 19.1.1-252-g48920dab b708f9119ac7 194ff39cc041 2024-09-04T16:33:24.846 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (10m) 65s ago 10m 49.7M 2048M 19.1.1-252-g48920dab b708f9119ac7 38c8e99ca323 2024-09-04T16:33:24.846 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (75s) 17s ago 11m 11.2M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:33:24.846 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (69s) 65s ago 10m 5246k - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:33:24.846 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (9m) 17s ago 9m 210M 1216M 19.1.1-252-g48920dab b708f9119ac7 6c2ea484615d 2024-09-04T16:33:24.846 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (8m) 17s ago 8m 227M 1216M 19.1.1-252-g48920dab b708f9119ac7 20469ba5727b 2024-09-04T16:33:24.847 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (8m) 17s ago 8m 183M 1216M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:33:24.847 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (7m) 65s ago 7m 245M 2240M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:33:24.847 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (7m) 65s ago 7m 209M 2240M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:33:24.847 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (6m) 65s ago 6m 189M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:33:24.847 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (45s) 17s ago 10m 44.0M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:33:24.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.846+0000 7fdec5e8b640 1 -- 172.21.15.170:0/1446698575 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdea8079e30 msgr2=0x7fdea807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:24.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.846+0000 7fdec5e8b640 1 --2- 172.21.15.170:0/1446698575 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdea8079e30 0x7fdea807c2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdec019aba0 tx=0x7fdeb400b390 comp rx=0 tx=0).stop 2024-09-04T16:33:24.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.846+0000 7fdec5e8b640 1 -- 172.21.15.170:0/1446698575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec0103b90 msgr2=0x7fdec01996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:24.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.846+0000 7fdec5e8b640 1 --2- 172.21.15.170:0/1446698575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec0103b90 0x7fdec01996f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdeb0006010 tx=0x7fdeb00045e0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.846+0000 7fdec5e8b640 1 -- 172.21.15.170:0/1446698575 shutdown_connections 2024-09-04T16:33:24.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.846+0000 7fdec5e8b640 1 --2- 172.21.15.170:0/1446698575 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdea8079e30 0x7fdea807c2f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.846+0000 7fdec5e8b640 1 --2- 172.21.15.170:0/1446698575 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdec0104d90 0x7fdec0199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.846+0000 7fdec5e8b640 1 --2- 172.21.15.170:0/1446698575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec0103b90 0x7fdec01996f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.846+0000 7fdec5e8b640 1 -- 172.21.15.170:0/1446698575 >> 172.21.15.170:0/1446698575 conn(0x7fdec00ff320 msgr2=0x7fdec0108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:33:24.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.847+0000 7fdec5e8b640 1 -- 172.21.15.170:0/1446698575 shutdown_connections 2024-09-04T16:33:24.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.847+0000 7fdec5e8b640 1 -- 172.21.15.170:0/1446698575 wait complete. 2024-09-04T16:33:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.929+0000 7f3a8a84c640 1 -- 172.21.15.170:0/3475104957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a84101a40 msgr2=0x7f3a84101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.929+0000 7f3a8a84c640 1 --2- 172.21.15.170:0/3475104957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a84101a40 0x7f3a84101ec0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009880 tx=0x7f3a7802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.930+0000 7f3a8a84c640 1 -- 172.21.15.170:0/3475104957 shutdown_connections 2024-09-04T16:33:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.930+0000 7f3a8a84c640 1 --2- 172.21.15.170:0/3475104957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a84101a40 0x7f3a84101ec0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.930+0000 7f3a8a84c640 1 --2- 172.21.15.170:0/3475104957 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a84100840 0x7f3a84100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.930+0000 7f3a8a84c640 1 -- 172.21.15.170:0/3475104957 >> 172.21.15.170:0/3475104957 conn(0x7f3a840fbff0 msgr2=0x7f3a840fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:33:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.930+0000 7f3a8a84c640 1 -- 172.21.15.170:0/3475104957 shutdown_connections 2024-09-04T16:33:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.930+0000 7f3a8a84c640 1 -- 172.21.15.170:0/3475104957 wait complete. 2024-09-04T16:33:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.930+0000 7f3a8a84c640 1 Processor -- start 2024-09-04T16:33:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.930+0000 7f3a8a84c640 1 -- start start 2024-09-04T16:33:24.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a8a84c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a84100840 0x7f3a841974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:24.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a8a84c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a84101a40 0x7f3a841979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:24.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a8a84c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3a84109660 con 0x7f3a84101a40 2024-09-04T16:33:24.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a8a84c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3a841094e0 con 0x7f3a84100840 2024-09-04T16:33:24.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a837fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a84101a40 0x7f3a841979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:24.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a837fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a84101a40 0x7f3a841979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48070/0 (socket says 172.21.15.170:48070) 2024-09-04T16:33:24.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a837fe640 1 -- 172.21.15.170:0/2276168168 learned_addr learned my addr 172.21.15.170:0/2276168168 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:33:24.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a83fff640 1 --2- 172.21.15.170:0/2276168168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a84100840 0x7f3a841974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:24.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a837fe640 1 -- 172.21.15.170:0/2276168168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a84100840 msgr2=0x7f3a841974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:24.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a837fe640 1 --2- 172.21.15.170:0/2276168168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a84100840 0x7f3a841974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:24.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a837fe640 1 -- 172.21.15.170:0/2276168168 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a84198070 con 0x7f3a84101a40 2024-09-04T16:33:24.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a83fff640 1 --2- 172.21.15.170:0/2276168168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a84100840 0x7f3a841974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:33:24.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a837fe640 1 --2- 172.21.15.170:0/2276168168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a84101a40 0x7f3a841979f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3a78005940 tx=0x7f3a78032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:33:24.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a817fa640 1 -- 172.21.15.170:0/2276168168 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a7803f030 con 0x7f3a84101a40 2024-09-04T16:33:24.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a817fa640 1 -- 172.21.15.170:0/2276168168 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a78004b80 con 0x7f3a84101a40 2024-09-04T16:33:24.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a8a84c640 1 -- 172.21.15.170:0/2276168168 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8419ca50 con 0x7f3a84101a40 2024-09-04T16:33:24.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a817fa640 1 -- 172.21.15.170:0/2276168168 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a78035070 con 0x7f3a84101a40 2024-09-04T16:33:24.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.931+0000 7f3a8a84c640 1 -- 172.21.15.170:0/2276168168 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a8419cfe0 con 0x7f3a84101a40 2024-09-04T16:33:24.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.932+0000 7f3a8a84c640 1 -- 172.21.15.170:0/2276168168 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a84100c40 con 0x7f3a84101a40 2024-09-04T16:33:24.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.933+0000 7f3a817fa640 1 -- 172.21.15.170:0/2276168168 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f3a78042030 con 0x7f3a84101a40 2024-09-04T16:33:24.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.934+0000 7f3a817fa640 1 --2- 172.21.15.170:0/2276168168 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3a6c079e30 0x7f3a6c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:24.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.934+0000 7f3a817fa640 1 -- 172.21.15.170:0/2276168168 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f3a78040070 con 0x7f3a84101a40 2024-09-04T16:33:24.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.934+0000 7f3a83fff640 1 --2- 172.21.15.170:0/2276168168 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3a6c079e30 0x7f3a6c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:24.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.934+0000 7f3a83fff640 1 --2- 172.21.15.170:0/2276168168 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3a6c079e30 0x7f3a6c07c2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3a74005d00 tx=0x7f3a74005c90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:33:24.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:24.938+0000 7f3a817fa640 1 -- 172.21.15.170:0/2276168168 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f3a78084f00 con 0x7f3a84101a40 2024-09-04T16:33:25.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:24 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:25.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:24 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:25.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:24 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:33:25.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:24 smithi170 ceph-mon[29272]: from='client.24579 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:33:25.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:24 smithi170 ceph-mon[29272]: pgmap v76: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:25.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:24 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:25.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:24 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:25.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:24 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:33:25.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:24 smithi193 ceph-mon[36288]: from='client.24579 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:33:25.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:24 smithi193 ceph-mon[36288]: pgmap v76: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:25.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.203+0000 7f3a8a84c640 1 -- 172.21.15.170:0/2276168168 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3a8419d240 con 0x7f3a84101a40 2024-09-04T16:33:25.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.204+0000 7f3a817fa640 1 -- 172.21.15.170:0/2276168168 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f3a7808d3b0 con 0x7f3a84101a40 2024-09-04T16:33:25.204 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:33:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:33:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 2 2024-09-04T16:33:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:33:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:33:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:33:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:33:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:33:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 6 2024-09-04T16:33:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:33:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:33:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:33:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:33:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:33:25.206 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 12, 2024-09-04T16:33:25.206 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:33:25.206 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:33:25.206 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:33:25.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.206+0000 7f3a8a84c640 1 -- 172.21.15.170:0/2276168168 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3a6c079e30 msgr2=0x7f3a6c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:25.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.206+0000 7f3a8a84c640 1 --2- 172.21.15.170:0/2276168168 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3a6c079e30 0x7f3a6c07c2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3a74005d00 tx=0x7f3a74005c90 comp rx=0 tx=0).stop 2024-09-04T16:33:25.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.206+0000 7f3a8a84c640 1 -- 172.21.15.170:0/2276168168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a84101a40 msgr2=0x7f3a841979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:25.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.206+0000 7f3a8a84c640 1 --2- 172.21.15.170:0/2276168168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a84101a40 0x7f3a841979f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3a78005940 tx=0x7f3a78032c80 comp rx=0 tx=0).stop 2024-09-04T16:33:25.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.206+0000 7f3a8a84c640 1 -- 172.21.15.170:0/2276168168 shutdown_connections 2024-09-04T16:33:25.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.206+0000 7f3a8a84c640 1 --2- 172.21.15.170:0/2276168168 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3a6c079e30 0x7f3a6c07c2f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:25.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.206+0000 7f3a8a84c640 1 --2- 172.21.15.170:0/2276168168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a84101a40 0x7f3a841979f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:25.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.206+0000 7f3a8a84c640 1 --2- 172.21.15.170:0/2276168168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a84100840 0x7f3a841974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:25.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.206+0000 7f3a8a84c640 1 -- 172.21.15.170:0/2276168168 >> 172.21.15.170:0/2276168168 conn(0x7f3a840fbff0 msgr2=0x7f3a84069c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:33:25.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.206+0000 7f3a8a84c640 1 -- 172.21.15.170:0/2276168168 shutdown_connections 2024-09-04T16:33:25.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.206+0000 7f3a8a84c640 1 -- 172.21.15.170:0/2276168168 wait complete. 2024-09-04T16:33:25.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.289+0000 7efdbb1dc640 1 -- 172.21.15.170:0/1994998207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdb4100880 msgr2=0x7efdb4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:25.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.289+0000 7efdbb1dc640 1 --2- 172.21.15.170:0/1994998207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdb4100880 0x7efdb4100c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7efda8009880 tx=0x7efda802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:33:25.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.289+0000 7efdbb1dc640 1 -- 172.21.15.170:0/1994998207 shutdown_connections 2024-09-04T16:33:25.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.289+0000 7efdbb1dc640 1 --2- 172.21.15.170:0/1994998207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdb4101a80 0x7efdb4101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:25.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.289+0000 7efdbb1dc640 1 --2- 172.21.15.170:0/1994998207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdb4100880 0x7efdb4100c80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:25.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.289+0000 7efdbb1dc640 1 -- 172.21.15.170:0/1994998207 >> 172.21.15.170:0/1994998207 conn(0x7efdb40fc010 msgr2=0x7efdb40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:33:25.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.289+0000 7efdbb1dc640 1 -- 172.21.15.170:0/1994998207 shutdown_connections 2024-09-04T16:33:25.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.289+0000 7efdbb1dc640 1 -- 172.21.15.170:0/1994998207 wait complete. 2024-09-04T16:33:25.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.290+0000 7efdbb1dc640 1 Processor -- start 2024-09-04T16:33:25.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.290+0000 7efdbb1dc640 1 -- start start 2024-09-04T16:33:25.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.290+0000 7efdbb1dc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdb4100880 0x7efdb406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:25.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.290+0000 7efdbb1dc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdb4101a80 0x7efdb419c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:25.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.290+0000 7efdbb1dc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efdb4109720 con 0x7efdb4100880 2024-09-04T16:33:25.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.290+0000 7efdbb1dc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efdb41095a0 con 0x7efdb4101a80 2024-09-04T16:33:25.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.290+0000 7efdb8f78640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdb4100880 0x7efdb406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:25.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.290+0000 7efdb8f78640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdb4100880 0x7efdb406adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54092/0 (socket says 172.21.15.170:54092) 2024-09-04T16:33:25.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.290+0000 7efdb8f78640 1 -- 172.21.15.170:0/3103364400 learned_addr learned my addr 172.21.15.170:0/3103364400 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:33:25.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.290+0000 7efdb3fff640 1 --2- 172.21.15.170:0/3103364400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdb4101a80 0x7efdb419c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:25.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.290+0000 7efdb8f78640 1 -- 172.21.15.170:0/3103364400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdb4101a80 msgr2=0x7efdb419c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:25.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.290+0000 7efdb8f78640 1 --2- 172.21.15.170:0/3103364400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdb4101a80 0x7efdb419c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:25.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.290+0000 7efdb8f78640 1 -- 172.21.15.170:0/3103364400 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb419c830 con 0x7efdb4100880 2024-09-04T16:33:25.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.291+0000 7efdb8f78640 1 --2- 172.21.15.170:0/3103364400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdb4100880 0x7efdb406adf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efda8006010 tx=0x7efda80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:33:25.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.291+0000 7efdb1ffb640 1 -- 172.21.15.170:0/3103364400 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efda803f070 con 0x7efdb4100880 2024-09-04T16:33:25.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.291+0000 7efdb1ffb640 1 -- 172.21.15.170:0/3103364400 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efda80044d0 con 0x7efdb4100880 2024-09-04T16:33:25.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.291+0000 7efdbb1dc640 1 -- 172.21.15.170:0/3103364400 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb419cac0 con 0x7efdb4100880 2024-09-04T16:33:25.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.291+0000 7efdb1ffb640 1 -- 172.21.15.170:0/3103364400 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efda8035030 con 0x7efdb4100880 2024-09-04T16:33:25.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.291+0000 7efdbb1dc640 1 -- 172.21.15.170:0/3103364400 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb419d070 con 0x7efdb4100880 2024-09-04T16:33:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.292+0000 7efdbb1dc640 1 -- 172.21.15.170:0/3103364400 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb4100c80 con 0x7efdb4100880 2024-09-04T16:33:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.293+0000 7efdb1ffb640 1 -- 172.21.15.170:0/3103364400 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7efda8042070 con 0x7efdb4100880 2024-09-04T16:33:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.293+0000 7efdb1ffb640 1 --2- 172.21.15.170:0/3103364400 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efda4079e30 0x7efda407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.293+0000 7efdb1ffb640 1 -- 172.21.15.170:0/3103364400 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7efda80bd730 con 0x7efdb4100880 2024-09-04T16:33:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.293+0000 7efdb3fff640 1 --2- 172.21.15.170:0/3103364400 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efda4079e30 0x7efda407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.294+0000 7efdb3fff640 1 --2- 172.21.15.170:0/3103364400 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efda4079e30 0x7efda407c2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efdb406ab70 tx=0x7efda0008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:33:25.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.298+0000 7efdb1ffb640 1 -- 172.21.15.170:0/3103364400 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7efda8085160 con 0x7efdb4100880 2024-09-04T16:33:25.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.495+0000 7efdbb1dc640 1 -- 172.21.15.170:0/3103364400 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efdb4062740 con 0x7efda4079e30 2024-09-04T16:33:25.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.496+0000 7efdb1ffb640 1 -- 172.21.15.170:0/3103364400 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7efdb4062740 con 0x7efda4079e30 2024-09-04T16:33:25.497 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:33:25.497 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:33:25.497 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:33:25.497 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-04T16:33:25.497 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:33:25.497 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-04T16:33:25.497 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:33:25.497 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "2/2 daemons upgraded", 2024-09-04T16:33:25.498 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading grafana daemons", 2024-09-04T16:33:25.498 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:33:25.498 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:33:25.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.499+0000 7efdbb1dc640 1 -- 172.21.15.170:0/3103364400 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efda4079e30 msgr2=0x7efda407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:25.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.499+0000 7efdbb1dc640 1 --2- 172.21.15.170:0/3103364400 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efda4079e30 0x7efda407c2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efdb406ab70 tx=0x7efda0008040 comp rx=0 tx=0).stop 2024-09-04T16:33:25.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.499+0000 7efdbb1dc640 1 -- 172.21.15.170:0/3103364400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdb4100880 msgr2=0x7efdb406adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:25.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.499+0000 7efdbb1dc640 1 --2- 172.21.15.170:0/3103364400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdb4100880 0x7efdb406adf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efda8006010 tx=0x7efda80048f0 comp rx=0 tx=0).stop 2024-09-04T16:33:25.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.499+0000 7efdbb1dc640 1 -- 172.21.15.170:0/3103364400 shutdown_connections 2024-09-04T16:33:25.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.499+0000 7efdbb1dc640 1 --2- 172.21.15.170:0/3103364400 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efda4079e30 0x7efda407c2f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:25.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.499+0000 7efdbb1dc640 1 --2- 172.21.15.170:0/3103364400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdb4101a80 0x7efdb419c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:25.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.499+0000 7efdbb1dc640 1 --2- 172.21.15.170:0/3103364400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdb4100880 0x7efdb406adf0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:25.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.499+0000 7efdbb1dc640 1 -- 172.21.15.170:0/3103364400 >> 172.21.15.170:0/3103364400 conn(0x7efdb40fc010 msgr2=0x7efdb4104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:33:25.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.499+0000 7efdbb1dc640 1 -- 172.21.15.170:0/3103364400 shutdown_connections 2024-09-04T16:33:25.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:25.499+0000 7efdbb1dc640 1 -- 172.21.15.170:0/3103364400 wait complete. 2024-09-04T16:33:26.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:25 smithi193 ceph-mon[36288]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:33:26.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:25 smithi193 ceph-mon[36288]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:33:26.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:25 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/2276168168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:26.183 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:25 smithi170 ceph-mon[29272]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:33:26.183 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:25 smithi170 ceph-mon[29272]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:33:26.183 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:25 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/2276168168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:27.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:26 smithi193 ceph-mon[36288]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:33:27.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:26 smithi193 ceph-mon[36288]: pgmap v77: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:27.218 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:26 smithi170 ceph-mon[29272]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:33:27.218 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:26 smithi170 ceph-mon[29272]: pgmap v77: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:29 smithi193 ceph-mon[36288]: pgmap v78: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:29 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:33:29.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:29 smithi170 ceph-mon[29272]: pgmap v78: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:29.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:29 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:33:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:30 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:30 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:30 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:30 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:30 smithi193 ceph-mon[36288]: pgmap v79: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:30.777 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:30 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:30.777 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:30 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:30.777 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:30 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:30.777 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:30 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:30.777 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:30 smithi170 ceph-mon[29272]: pgmap v79: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:33.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:33 smithi170 ceph-mon[29272]: pgmap v80: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:33.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:33 smithi193 ceph-mon[36288]: pgmap v80: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:34.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:34.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:34.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:33:34.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:33:34.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:34.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-04T16:33:34.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-04T16:33:34.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:33:34.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: Upgrade: Finalizing container_image settings 2024-09-04T16:33:34.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:34.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-04T16:33:34.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-04T16:33:34.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-04T16:33:34.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-04T16:33:34.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-04T16:33:34.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-04T16:33:34.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-04T16:33:34.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-04T16:33:34.856 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-04T16:33:34.856 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-04T16:33:34.856 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-04T16:33:34.856 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-04T16:33:34.856 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-04T16:33:34.856 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-04T16:33:34.856 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-04T16:33:34.856 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-04T16:33:34.856 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-04T16:33:34.856 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-04T16:33:34.856 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-04T16:33:34.856 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-04T16:33:34.857 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-04T16:33:34.857 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-04T16:33:34.857 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-04T16:33:34.857 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-04T16:33:34.857 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-04T16:33:34.857 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: Upgrade: Complete! 2024-09-04T16:33:34.857 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-04T16:33:34.857 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-04T16:33:34.857 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:33:34.857 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:33:34.858 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:33:34.858 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:34.858 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:33:34.858 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:33:34.858 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:33:34.858 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:34.858 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:34.858 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:34 smithi170 ceph-mon[29272]: pgmap v81: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:34.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:34.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:34.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:33:34.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:33:34.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:34.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-04T16:33:34.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-04T16:33:34.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:33:34.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:34.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: Upgrade: Finalizing container_image settings 2024-09-04T16:33:34.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:34.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-04T16:33:34.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-04T16:33:34.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-04T16:33:34.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-04T16:33:34.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-04T16:33:34.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-04T16:33:34.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-04T16:33:34.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-04T16:33:34.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-04T16:33:34.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-04T16:33:34.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-04T16:33:34.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-04T16:33:34.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-04T16:33:34.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-04T16:33:34.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-04T16:33:34.910 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-04T16:33:34.911 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-04T16:33:34.911 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-04T16:33:34.911 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-04T16:33:34.911 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-04T16:33:34.911 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-04T16:33:34.911 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-04T16:33:34.911 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-04T16:33:34.911 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-04T16:33:34.911 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-04T16:33:34.911 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: Upgrade: Complete! 2024-09-04T16:33:34.911 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-04T16:33:34.911 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-04T16:33:34.911 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:33:34.912 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:33:34.912 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:33:34.912 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:34.912 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:33:34.912 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:33:34.912 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:33:34.912 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:34.912 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:33:34.912 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:34 smithi193 ceph-mon[36288]: pgmap v81: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:37.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:37 smithi193 ceph-mon[36288]: pgmap v82: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:37.818 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:37 smithi170 ceph-mon[29272]: pgmap v82: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:39.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:39 smithi170 ceph-mon[29272]: pgmap v83: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:39.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:39 smithi193 ceph-mon[36288]: pgmap v83: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:41.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:41 smithi193 ceph-mon[36288]: pgmap v84: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:41.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:41 smithi170 ceph-mon[29272]: pgmap v84: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:43.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:43 smithi170 ceph-mon[29272]: pgmap v85: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:43.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:43 smithi193 ceph-mon[36288]: pgmap v85: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:44 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:33:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:44 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:33:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:45 smithi170 ceph-mon[29272]: pgmap v86: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:45.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:45 smithi193 ceph-mon[36288]: pgmap v86: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:46.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:46 smithi170 ceph-mon[29272]: pgmap v87: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:46.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:46 smithi193 ceph-mon[36288]: pgmap v87: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:49.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:49 smithi193 ceph-mon[36288]: pgmap v88: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:49.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:49 smithi170 ceph-mon[29272]: pgmap v88: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:51.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:51 smithi170 ceph-mon[29272]: pgmap v89: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:51.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:51 smithi193 ceph-mon[36288]: pgmap v89: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:53.709 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:53 smithi193 ceph-mon[36288]: pgmap v90: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:53.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:53 smithi170 ceph-mon[29272]: pgmap v90: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:54.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:54 smithi170 ceph-mon[29272]: pgmap v91: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:54 smithi193 ceph-mon[36288]: pgmap v91: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:55.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.592+0000 7fb73233d640 1 -- 172.21.15.170:0/4081014964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb72c0ffc40 msgr2=0x7fb72c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:55.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.592+0000 7fb73233d640 1 --2- 172.21.15.170:0/4081014964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb72c0ffc40 0x7fb72c100040 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009880 tx=0x7fb71c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:33:55.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.593+0000 7fb73233d640 1 -- 172.21.15.170:0/4081014964 shutdown_connections 2024-09-04T16:33:55.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.593+0000 7fb73233d640 1 --2- 172.21.15.170:0/4081014964 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb72c102c20 0x7fb72c1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:55.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.593+0000 7fb73233d640 1 --2- 172.21.15.170:0/4081014964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb72c0ffc40 0x7fb72c100040 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:55.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.593+0000 7fb73233d640 1 -- 172.21.15.170:0/4081014964 >> 172.21.15.170:0/4081014964 conn(0x7fb72c0fb790 msgr2=0x7fb72c0fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:33:55.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.593+0000 7fb73233d640 1 -- 172.21.15.170:0/4081014964 shutdown_connections 2024-09-04T16:33:55.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.593+0000 7fb73233d640 1 -- 172.21.15.170:0/4081014964 wait complete. 2024-09-04T16:33:55.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.593+0000 7fb73233d640 1 Processor -- start 2024-09-04T16:33:55.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.593+0000 7fb73233d640 1 -- start start 2024-09-04T16:33:55.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.594+0000 7fb73233d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb72c0ffc40 0x7fb72c102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:55.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.594+0000 7fb73233d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb72c102c20 0x7fb72c100bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:55.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.594+0000 7fb73233d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c10a7a0 con 0x7fb72c102c20 2024-09-04T16:33:55.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.594+0000 7fb73233d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c10a620 con 0x7fb72c0ffc40 2024-09-04T16:33:55.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.594+0000 7fb72b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb72c102c20 0x7fb72c100bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:55.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.594+0000 7fb72b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb72c102c20 0x7fb72c100bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58864/0 (socket says 172.21.15.170:58864) 2024-09-04T16:33:55.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.594+0000 7fb72b7fe640 1 -- 172.21.15.170:0/954155730 learned_addr learned my addr 172.21.15.170:0/954155730 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:33:55.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.594+0000 7fb72bfff640 1 --2- 172.21.15.170:0/954155730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb72c0ffc40 0x7fb72c102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:55.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.594+0000 7fb72b7fe640 1 -- 172.21.15.170:0/954155730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb72c0ffc40 msgr2=0x7fb72c102510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:55.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.594+0000 7fb72b7fe640 1 --2- 172.21.15.170:0/954155730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb72c0ffc40 0x7fb72c102510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:55.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.594+0000 7fb72b7fe640 1 -- 172.21.15.170:0/954155730 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c101110 con 0x7fb72c102c20 2024-09-04T16:33:55.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.594+0000 7fb72b7fe640 1 --2- 172.21.15.170:0/954155730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb72c102c20 0x7fb72c100bd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb72000d8d0 tx=0x7fb72000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:33:55.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.594+0000 7fb7297fa640 1 -- 172.21.15.170:0/954155730 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb720017070 con 0x7fb72c102c20 2024-09-04T16:33:55.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.594+0000 7fb7297fa640 1 -- 172.21.15.170:0/954155730 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb720010460 con 0x7fb72c102c20 2024-09-04T16:33:55.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.594+0000 7fb73233d640 1 -- 172.21.15.170:0/954155730 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72c101400 con 0x7fb72c102c20 2024-09-04T16:33:55.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.595+0000 7fb7297fa640 1 -- 172.21.15.170:0/954155730 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb72000f5f0 con 0x7fb72c102c20 2024-09-04T16:33:55.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.595+0000 7fb73233d640 1 -- 172.21.15.170:0/954155730 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72c101990 con 0x7fb72c102c20 2024-09-04T16:33:55.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.596+0000 7fb73233d640 1 -- 172.21.15.170:0/954155730 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb72c100040 con 0x7fb72c102c20 2024-09-04T16:33:55.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.596+0000 7fb7297fa640 1 -- 172.21.15.170:0/954155730 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fb720009a30 con 0x7fb72c102c20 2024-09-04T16:33:55.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.597+0000 7fb7297fa640 1 --2- 172.21.15.170:0/954155730 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb714079e30 0x7fb71407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:55.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.597+0000 7fb7297fa640 1 -- 172.21.15.170:0/954155730 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fb72009c8e0 con 0x7fb72c102c20 2024-09-04T16:33:55.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.597+0000 7fb72bfff640 1 --2- 172.21.15.170:0/954155730 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb714079e30 0x7fb71407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:55.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.598+0000 7fb72bfff640 1 --2- 172.21.15.170:0/954155730 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb714079e30 0x7fb71407c2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb71c000c00 tx=0x7fb71c005a20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:33:55.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.602+0000 7fb7297fa640 1 -- 172.21.15.170:0/954155730 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fb7200643a0 con 0x7fb72c102c20 2024-09-04T16:33:55.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.794+0000 7fb73233d640 1 -- 172.21.15.170:0/954155730 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb72c1071b0 con 0x7fb714079e30 2024-09-04T16:33:55.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.795+0000 7fb7297fa640 1 -- 172.21.15.170:0/954155730 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7fb72c1071b0 con 0x7fb714079e30 2024-09-04T16:33:55.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.797+0000 7fb73233d640 1 -- 172.21.15.170:0/954155730 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb714079e30 msgr2=0x7fb71407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:55.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.797+0000 7fb73233d640 1 --2- 172.21.15.170:0/954155730 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb714079e30 0x7fb71407c2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb71c000c00 tx=0x7fb71c005a20 comp rx=0 tx=0).stop 2024-09-04T16:33:55.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.797+0000 7fb73233d640 1 -- 172.21.15.170:0/954155730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb72c102c20 msgr2=0x7fb72c100bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:55.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.797+0000 7fb73233d640 1 --2- 172.21.15.170:0/954155730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb72c102c20 0x7fb72c100bd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb72000d8d0 tx=0x7fb72000dd90 comp rx=0 tx=0).stop 2024-09-04T16:33:55.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.797+0000 7fb73233d640 1 -- 172.21.15.170:0/954155730 shutdown_connections 2024-09-04T16:33:55.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.797+0000 7fb73233d640 1 --2- 172.21.15.170:0/954155730 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb714079e30 0x7fb71407c2f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:55.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.797+0000 7fb73233d640 1 --2- 172.21.15.170:0/954155730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb72c102c20 0x7fb72c100bd0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:55.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.797+0000 7fb73233d640 1 --2- 172.21.15.170:0/954155730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb72c0ffc40 0x7fb72c102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:55.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.797+0000 7fb73233d640 1 -- 172.21.15.170:0/954155730 >> 172.21.15.170:0/954155730 conn(0x7fb72c0fb790 msgr2=0x7fb72c0fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:33:55.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.797+0000 7fb73233d640 1 -- 172.21.15.170:0/954155730 shutdown_connections 2024-09-04T16:33:55.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:55.798+0000 7fb73233d640 1 -- 172.21.15.170:0/954155730 wait complete. 2024-09-04T16:33:56.563 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-04T16:33:56.819 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:33:57.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.281+0000 7f650e076640 1 -- 172.21.15.170:0/609782284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65081007e0 msgr2=0x7f6508100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:57.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.281+0000 7f650e076640 1 --2- 172.21.15.170:0/609782284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65081007e0 0x7f6508100c40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009880 tx=0x7f64f802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:33:57.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.281+0000 7f650e076640 1 -- 172.21.15.170:0/609782284 shutdown_connections 2024-09-04T16:33:57.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.281+0000 7f650e076640 1 --2- 172.21.15.170:0/609782284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65081007e0 0x7f6508100c40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:57.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.281+0000 7f650e076640 1 --2- 172.21.15.170:0/609782284 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65081067e0 0x7f6508106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:57.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.281+0000 7f650e076640 1 -- 172.21.15.170:0/609782284 >> 172.21.15.170:0/609782284 conn(0x7f65080fc4c0 msgr2=0x7f65080fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:33:57.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.281+0000 7f650e076640 1 -- 172.21.15.170:0/609782284 shutdown_connections 2024-09-04T16:33:57.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.281+0000 7f650e076640 1 -- 172.21.15.170:0/609782284 wait complete. 2024-09-04T16:33:57.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.282+0000 7f650e076640 1 Processor -- start 2024-09-04T16:33:57.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.282+0000 7f650e076640 1 -- start start 2024-09-04T16:33:57.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.282+0000 7f650e076640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65081007e0 0x7f650819c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:57.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.282+0000 7f650e076640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65081067e0 0x7f650819caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:57.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.282+0000 7f650e076640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f650810dc90 con 0x7f65081067e0 2024-09-04T16:33:57.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.282+0000 7f650e076640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f650810db10 con 0x7f65081007e0 2024-09-04T16:33:57.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.282+0000 7f6506ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65081067e0 0x7f650819caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:57.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.282+0000 7f6506ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65081067e0 0x7f650819caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58892/0 (socket says 172.21.15.170:58892) 2024-09-04T16:33:57.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.282+0000 7f6506ffd640 1 -- 172.21.15.170:0/746839129 learned_addr learned my addr 172.21.15.170:0/746839129 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:33:57.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.283+0000 7f65077fe640 1 --2- 172.21.15.170:0/746839129 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65081007e0 0x7f650819c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:57.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.283+0000 7f6506ffd640 1 -- 172.21.15.170:0/746839129 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65081007e0 msgr2=0x7f650819c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:57.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.283+0000 7f6506ffd640 1 --2- 172.21.15.170:0/746839129 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65081007e0 0x7f650819c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:57.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.283+0000 7f6506ffd640 1 -- 172.21.15.170:0/746839129 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6508196680 con 0x7f65081067e0 2024-09-04T16:33:57.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.283+0000 7f6506ffd640 1 --2- 172.21.15.170:0/746839129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65081067e0 0x7f650819caf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f64f8031460 tx=0x7f64f80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:33:57.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.283+0000 7f6504ff9640 1 -- 172.21.15.170:0/746839129 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64f803f070 con 0x7f65081067e0 2024-09-04T16:33:57.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.283+0000 7f6504ff9640 1 -- 172.21.15.170:0/746839129 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64f80035f0 con 0x7f65081067e0 2024-09-04T16:33:57.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.283+0000 7f6504ff9640 1 -- 172.21.15.170:0/746839129 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64f8035030 con 0x7f65081067e0 2024-09-04T16:33:57.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.283+0000 7f650e076640 1 -- 172.21.15.170:0/746839129 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6508196910 con 0x7f65081067e0 2024-09-04T16:33:57.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.283+0000 7f650e076640 1 -- 172.21.15.170:0/746839129 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6508196e10 con 0x7f65081067e0 2024-09-04T16:33:57.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.285+0000 7f650e076640 1 -- 172.21.15.170:0/746839129 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6508101f20 con 0x7f65081067e0 2024-09-04T16:33:57.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.285+0000 7f6504ff9640 1 -- 172.21.15.170:0/746839129 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f64f8042070 con 0x7f65081067e0 2024-09-04T16:33:57.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.285+0000 7f6504ff9640 1 --2- 172.21.15.170:0/746839129 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f64f0079e80 0x7f64f007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:57.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.285+0000 7f6504ff9640 1 -- 172.21.15.170:0/746839129 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f64f80bd250 con 0x7f65081067e0 2024-09-04T16:33:57.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.286+0000 7f65077fe640 1 --2- 172.21.15.170:0/746839129 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f64f0079e80 0x7f64f007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:57.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.286+0000 7f65077fe640 1 --2- 172.21.15.170:0/746839129 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f64f0079e80 0x7f64f007c340 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f64fc005d00 tx=0x7f64fc00b410 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:33:57.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.290+0000 7f6504ff9640 1 -- 172.21.15.170:0/746839129 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f64f8088f00 con 0x7f65081067e0 2024-09-04T16:33:57.472 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:57 smithi170 ceph-mon[29272]: from='client.14908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:33:57.472 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:57 smithi170 ceph-mon[29272]: pgmap v92: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:57.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.542+0000 7f650e076640 1 -- 172.21.15.170:0/746839129 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6508108d70 con 0x7f65081067e0 2024-09-04T16:33:57.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.543+0000 7f6504ff9640 1 -- 172.21.15.170:0/746839129 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f64f808d240 con 0x7f65081067e0 2024-09-04T16:33:57.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.546+0000 7f650e076640 1 -- 172.21.15.170:0/746839129 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f64f0079e80 msgr2=0x7f64f007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:57.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.546+0000 7f650e076640 1 --2- 172.21.15.170:0/746839129 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f64f0079e80 0x7f64f007c340 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f64fc005d00 tx=0x7f64fc00b410 comp rx=0 tx=0).stop 2024-09-04T16:33:57.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.546+0000 7f650e076640 1 -- 172.21.15.170:0/746839129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65081067e0 msgr2=0x7f650819caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:57.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.546+0000 7f650e076640 1 --2- 172.21.15.170:0/746839129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65081067e0 0x7f650819caf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f64f8031460 tx=0x7f64f80045e0 comp rx=0 tx=0).stop 2024-09-04T16:33:57.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.546+0000 7f650e076640 1 -- 172.21.15.170:0/746839129 shutdown_connections 2024-09-04T16:33:57.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.546+0000 7f650e076640 1 --2- 172.21.15.170:0/746839129 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f64f0079e80 0x7f64f007c340 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:57.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.546+0000 7f650e076640 1 --2- 172.21.15.170:0/746839129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65081067e0 0x7f650819caf0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:57.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.546+0000 7f650e076640 1 --2- 172.21.15.170:0/746839129 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65081007e0 0x7f650819c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:57.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.546+0000 7f650e076640 1 -- 172.21.15.170:0/746839129 >> 172.21.15.170:0/746839129 conn(0x7f65080fc4c0 msgr2=0x7f65080fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:33:57.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.546+0000 7f650e076640 1 -- 172.21.15.170:0/746839129 shutdown_connections 2024-09-04T16:33:57.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:57.546+0000 7f650e076640 1 -- 172.21.15.170:0/746839129 wait complete. 2024-09-04T16:33:57.560 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:33:57.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:57 smithi193 ceph-mon[36288]: from='client.14908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:33:57.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:57 smithi193 ceph-mon[36288]: pgmap v92: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:58.189 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-04T16:33:58.454 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:33:58.716 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:58 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/746839129' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:58.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:58 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/746839129' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:58.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.903+0000 7f8d9e6d6640 1 -- 172.21.15.170:0/1326661806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d98101930 msgr2=0x7f8d98101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:58.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.903+0000 7f8d9e6d6640 1 --2- 172.21.15.170:0/1326661806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d98101930 0x7f8d98101d90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009880 tx=0x7f8d8c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:33:58.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.903+0000 7f8d9e6d6640 1 -- 172.21.15.170:0/1326661806 shutdown_connections 2024-09-04T16:33:58.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.903+0000 7f8d9e6d6640 1 --2- 172.21.15.170:0/1326661806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d98101930 0x7f8d98101d90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:58.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.903+0000 7f8d9e6d6640 1 --2- 172.21.15.170:0/1326661806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d98107930 0x7f8d98107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:58.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.903+0000 7f8d9e6d6640 1 -- 172.21.15.170:0/1326661806 >> 172.21.15.170:0/1326661806 conn(0x7f8d980fd630 msgr2=0x7f8d980ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:33:58.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.903+0000 7f8d9e6d6640 1 -- 172.21.15.170:0/1326661806 shutdown_connections 2024-09-04T16:33:58.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.903+0000 7f8d9e6d6640 1 -- 172.21.15.170:0/1326661806 wait complete. 2024-09-04T16:33:58.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.904+0000 7f8d9e6d6640 1 Processor -- start 2024-09-04T16:33:58.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.904+0000 7f8d9e6d6640 1 -- start start 2024-09-04T16:33:58.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.904+0000 7f8d9e6d6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d98101930 0x7f8d9819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:58.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.904+0000 7f8d9e6d6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d98107930 0x7f8d9819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:58.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.904+0000 7f8d9e6d6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9810ee00 con 0x7f8d98107930 2024-09-04T16:33:58.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.904+0000 7f8d9e6d6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9810ec80 con 0x7f8d98101930 2024-09-04T16:33:58.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.904+0000 7f8d977fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d98107930 0x7f8d9819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:58.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.904+0000 7f8d977fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d98107930 0x7f8d9819dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58908/0 (socket says 172.21.15.170:58908) 2024-09-04T16:33:58.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.904+0000 7f8d977fe640 1 -- 172.21.15.170:0/1788516162 learned_addr learned my addr 172.21.15.170:0/1788516162 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:33:58.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.905+0000 7f8d97fff640 1 --2- 172.21.15.170:0/1788516162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d98101930 0x7f8d9819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:58.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.905+0000 7f8d977fe640 1 -- 172.21.15.170:0/1788516162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d98101930 msgr2=0x7f8d9819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:58.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.905+0000 7f8d977fe640 1 --2- 172.21.15.170:0/1788516162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d98101930 0x7f8d9819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:58.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.905+0000 7f8d977fe640 1 -- 172.21.15.170:0/1788516162 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d98197810 con 0x7f8d98107930 2024-09-04T16:33:58.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.905+0000 7f8d977fe640 1 --2- 172.21.15.170:0/1788516162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d98107930 0x7f8d9819dbd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c031460 tx=0x7f8d8c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:33:58.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.905+0000 7f8d957fa640 1 -- 172.21.15.170:0/1788516162 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d8c03f070 con 0x7f8d98107930 2024-09-04T16:33:58.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.905+0000 7f8d9e6d6640 1 -- 172.21.15.170:0/1788516162 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d98197aa0 con 0x7f8d98107930 2024-09-04T16:33:58.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.905+0000 7f8d957fa640 1 -- 172.21.15.170:0/1788516162 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d8c0035f0 con 0x7f8d98107930 2024-09-04T16:33:58.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.905+0000 7f8d957fa640 1 -- 172.21.15.170:0/1788516162 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d8c035030 con 0x7f8d98107930 2024-09-04T16:33:58.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.905+0000 7f8d9e6d6640 1 -- 172.21.15.170:0/1788516162 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d98197fd0 con 0x7f8d98107930 2024-09-04T16:33:58.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.906+0000 7f8d9e6d6640 1 -- 172.21.15.170:0/1788516162 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d98103070 con 0x7f8d98107930 2024-09-04T16:33:58.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.907+0000 7f8d957fa640 1 -- 172.21.15.170:0/1788516162 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f8d8c042070 con 0x7f8d98107930 2024-09-04T16:33:58.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.907+0000 7f8d957fa640 1 --2- 172.21.15.170:0/1788516162 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d80079e30 0x7f8d8007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:33:58.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.907+0000 7f8d957fa640 1 -- 172.21.15.170:0/1788516162 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f8d8c0bd3b0 con 0x7f8d98107930 2024-09-04T16:33:58.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.907+0000 7f8d97fff640 1 --2- 172.21.15.170:0/1788516162 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d80079e30 0x7f8d8007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:33:58.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.908+0000 7f8d97fff640 1 --2- 172.21.15.170:0/1788516162 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d80079e30 0x7f8d8007c2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8d88005fd0 tx=0x7f8d88005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:33:58.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:58.912+0000 7f8d957fa640 1 -- 172.21.15.170:0/1788516162 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f8d8c084e70 con 0x7f8d98107930 2024-09-04T16:33:59.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:59.157+0000 7f8d9e6d6640 1 -- 172.21.15.170:0/1788516162 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8d98109ea0 con 0x7f8d98107930 2024-09-04T16:33:59.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:59.158+0000 7f8d957fa640 1 -- 172.21.15.170:0/1788516162 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f8d8c08d320 con 0x7f8d98107930 2024-09-04T16:33:59.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:59.160+0000 7f8d9e6d6640 1 -- 172.21.15.170:0/1788516162 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d80079e30 msgr2=0x7f8d8007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:59.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:59.160+0000 7f8d9e6d6640 1 --2- 172.21.15.170:0/1788516162 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d80079e30 0x7f8d8007c2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8d88005fd0 tx=0x7f8d88005850 comp rx=0 tx=0).stop 2024-09-04T16:33:59.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:59.160+0000 7f8d9e6d6640 1 -- 172.21.15.170:0/1788516162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d98107930 msgr2=0x7f8d9819dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:33:59.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:59.160+0000 7f8d9e6d6640 1 --2- 172.21.15.170:0/1788516162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d98107930 0x7f8d9819dbd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c031460 tx=0x7f8d8c0045e0 comp rx=0 tx=0).stop 2024-09-04T16:33:59.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:59.160+0000 7f8d9e6d6640 1 -- 172.21.15.170:0/1788516162 shutdown_connections 2024-09-04T16:33:59.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:59.160+0000 7f8d9e6d6640 1 --2- 172.21.15.170:0/1788516162 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d80079e30 0x7f8d8007c2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:59.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:59.160+0000 7f8d9e6d6640 1 --2- 172.21.15.170:0/1788516162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d98107930 0x7f8d9819dbd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:59.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:59.160+0000 7f8d9e6d6640 1 --2- 172.21.15.170:0/1788516162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d98101930 0x7f8d9819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:33:59.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:59.160+0000 7f8d9e6d6640 1 -- 172.21.15.170:0/1788516162 >> 172.21.15.170:0/1788516162 conn(0x7f8d980fd630 msgr2=0x7f8d980fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:33:59.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:59.160+0000 7f8d9e6d6640 1 -- 172.21.15.170:0/1788516162 shutdown_connections 2024-09-04T16:33:59.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:33:59.160+0000 7f8d9e6d6640 1 -- 172.21.15.170:0/1788516162 wait complete. 2024-09-04T16:33:59.170 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)" 2024-09-04T16:33:59.784 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:59 smithi170 ceph-mon[29272]: pgmap v93: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:59.784 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:59 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1788516162' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:59.784 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:33:59 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:33:59.814 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-04T16:33:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:59 smithi193 ceph-mon[36288]: pgmap v93: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:33:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:59 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1788516162' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:33:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:33:59 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:34:00.065 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:34:00.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.534+0000 7fc093bcc640 1 -- 172.21.15.170:0/639768189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc08c106820 msgr2=0x7fc08c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:00.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.534+0000 7fc093bcc640 1 --2- 172.21.15.170:0/639768189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc08c106820 0x7fc08c106c00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc080009880 tx=0x7fc08002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:34:00.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.534+0000 7fc093bcc640 1 -- 172.21.15.170:0/639768189 shutdown_connections 2024-09-04T16:34:00.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.534+0000 7fc093bcc640 1 --2- 172.21.15.170:0/639768189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc08c100820 0x7fc08c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:00.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.534+0000 7fc093bcc640 1 --2- 172.21.15.170:0/639768189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc08c106820 0x7fc08c106c00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:00.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.534+0000 7fc093bcc640 1 -- 172.21.15.170:0/639768189 >> 172.21.15.170:0/639768189 conn(0x7fc08c0fc520 msgr2=0x7fc08c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:00.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.534+0000 7fc093bcc640 1 -- 172.21.15.170:0/639768189 shutdown_connections 2024-09-04T16:34:00.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.534+0000 7fc093bcc640 1 -- 172.21.15.170:0/639768189 wait complete. 2024-09-04T16:34:00.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.534+0000 7fc093bcc640 1 Processor -- start 2024-09-04T16:34:00.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.534+0000 7fc093bcc640 1 -- start start 2024-09-04T16:34:00.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc093bcc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc08c100820 0x7fc08c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:00.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc093bcc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc08c106820 0x7fc08c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:00.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc093bcc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c10dcf0 con 0x7fc08c100820 2024-09-04T16:34:00.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc093bcc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c10db70 con 0x7fc08c106820 2024-09-04T16:34:00.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc091968640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc08c100820 0x7fc08c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:00.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc091968640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc08c100820 0x7fc08c19d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58936/0 (socket says 172.21.15.170:58936) 2024-09-04T16:34:00.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc091968640 1 -- 172.21.15.170:0/146602856 learned_addr learned my addr 172.21.15.170:0/146602856 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:00.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc091167640 1 --2- 172.21.15.170:0/146602856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc08c106820 0x7fc08c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:00.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc091968640 1 -- 172.21.15.170:0/146602856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc08c106820 msgr2=0x7fc08c19dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:00.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc091968640 1 --2- 172.21.15.170:0/146602856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc08c106820 0x7fc08c19dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:00.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc091968640 1 -- 172.21.15.170:0/146602856 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c197810 con 0x7fc08c100820 2024-09-04T16:34:00.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc091968640 1 --2- 172.21.15.170:0/146602856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc08c100820 0x7fc08c19d690 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc080031460 tx=0x7fc0800045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:00.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc07effd640 1 -- 172.21.15.170:0/146602856 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc08003f070 con 0x7fc08c100820 2024-09-04T16:34:00.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc093bcc640 1 -- 172.21.15.170:0/146602856 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc08c197aa0 con 0x7fc08c100820 2024-09-04T16:34:00.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc07effd640 1 -- 172.21.15.170:0/146602856 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc0800035f0 con 0x7fc08c100820 2024-09-04T16:34:00.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc07effd640 1 -- 172.21.15.170:0/146602856 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc080035030 con 0x7fc08c100820 2024-09-04T16:34:00.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.535+0000 7fc093bcc640 1 -- 172.21.15.170:0/146602856 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc08c197fd0 con 0x7fc08c100820 2024-09-04T16:34:00.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.537+0000 7fc093bcc640 1 -- 172.21.15.170:0/146602856 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc08c101f60 con 0x7fc08c100820 2024-09-04T16:34:00.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.537+0000 7fc07effd640 1 -- 172.21.15.170:0/146602856 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fc080042070 con 0x7fc08c100820 2024-09-04T16:34:00.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.537+0000 7fc07effd640 1 --2- 172.21.15.170:0/146602856 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc078079e30 0x7fc07807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:00.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.538+0000 7fc07effd640 1 -- 172.21.15.170:0/146602856 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fc0800bd300 con 0x7fc08c100820 2024-09-04T16:34:00.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.538+0000 7fc091167640 1 --2- 172.21.15.170:0/146602856 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc078079e30 0x7fc07807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:00.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.538+0000 7fc091167640 1 --2- 172.21.15.170:0/146602856 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc078079e30 0x7fc07807c2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc08c105f90 tx=0x7fc08800b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:00.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.542+0000 7fc07effd640 1 -- 172.21.15.170:0/146602856 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fc080088f30 con 0x7fc08c100820 2024-09-04T16:34:00.740 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:00 smithi193 ceph-mon[36288]: pgmap v94: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:00.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.786+0000 7fc093bcc640 1 -- 172.21.15.170:0/146602856 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc08c109da0 con 0x7fc08c100820 2024-09-04T16:34:00.787 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:00 smithi170 ceph-mon[29272]: pgmap v94: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:00.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.787+0000 7fc07effd640 1 -- 172.21.15.170:0/146602856 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fc08008d270 con 0x7fc08c100820 2024-09-04T16:34:00.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.789+0000 7fc093bcc640 1 -- 172.21.15.170:0/146602856 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc078079e30 msgr2=0x7fc07807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:00.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.789+0000 7fc093bcc640 1 --2- 172.21.15.170:0/146602856 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc078079e30 0x7fc07807c2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc08c105f90 tx=0x7fc08800b390 comp rx=0 tx=0).stop 2024-09-04T16:34:00.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.789+0000 7fc093bcc640 1 -- 172.21.15.170:0/146602856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc08c100820 msgr2=0x7fc08c19d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:00.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.789+0000 7fc093bcc640 1 --2- 172.21.15.170:0/146602856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc08c100820 0x7fc08c19d690 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc080031460 tx=0x7fc0800045e0 comp rx=0 tx=0).stop 2024-09-04T16:34:00.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.790+0000 7fc093bcc640 1 -- 172.21.15.170:0/146602856 shutdown_connections 2024-09-04T16:34:00.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.790+0000 7fc093bcc640 1 --2- 172.21.15.170:0/146602856 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc078079e30 0x7fc07807c2f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:00.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.790+0000 7fc093bcc640 1 --2- 172.21.15.170:0/146602856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc08c106820 0x7fc08c19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:00.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.790+0000 7fc093bcc640 1 --2- 172.21.15.170:0/146602856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc08c100820 0x7fc08c19d690 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:00.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.790+0000 7fc093bcc640 1 -- 172.21.15.170:0/146602856 >> 172.21.15.170:0/146602856 conn(0x7fc08c0fc520 msgr2=0x7fc08c06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:00.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.790+0000 7fc093bcc640 1 -- 172.21.15.170:0/146602856 shutdown_connections 2024-09-04T16:34:00.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:00.790+0000 7fc093bcc640 1 -- 172.21.15.170:0/146602856 wait complete. 2024-09-04T16:34:00.799 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:34:01.475 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-04T16:34:01.730 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:34:01.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:01 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/146602856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:34:01.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:01 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/146602856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:34:02.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.228+0000 7f0c359fe640 1 -- 172.21.15.170:0/3131386726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c30074f40 msgr2=0x7f0c3010dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.228+0000 7f0c359fe640 1 --2- 172.21.15.170:0/3131386726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c30074f40 0x7f0c3010dbf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009880 tx=0x7f0c2402a530 comp rx=0 tx=0).stop 2024-09-04T16:34:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.228+0000 7f0c359fe640 1 -- 172.21.15.170:0/3131386726 shutdown_connections 2024-09-04T16:34:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.228+0000 7f0c359fe640 1 --2- 172.21.15.170:0/3131386726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c30074f40 0x7f0c3010dbf0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.228+0000 7f0c359fe640 1 --2- 172.21.15.170:0/3131386726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c30074620 0x7f0c30074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.228+0000 7f0c359fe640 1 -- 172.21.15.170:0/3131386726 >> 172.21.15.170:0/3131386726 conn(0x7f0c300fd630 msgr2=0x7f0c300ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.228+0000 7f0c359fe640 1 -- 172.21.15.170:0/3131386726 shutdown_connections 2024-09-04T16:34:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.228+0000 7f0c359fe640 1 -- 172.21.15.170:0/3131386726 wait complete. 2024-09-04T16:34:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.229+0000 7f0c359fe640 1 Processor -- start 2024-09-04T16:34:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.229+0000 7f0c359fe640 1 -- start start 2024-09-04T16:34:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.229+0000 7f0c359fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c30074620 0x7f0c3019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.229+0000 7f0c359fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c30074f40 0x7f0c3019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.229+0000 7f0c359fe640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0c30110fe0 con 0x7f0c30074f40 2024-09-04T16:34:02.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.229+0000 7f0c359fe640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0c30110e60 con 0x7f0c30074620 2024-09-04T16:34:02.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.229+0000 7f0c2e7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c30074f40 0x7f0c3019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:02.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.229+0000 7f0c2e7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c30074f40 0x7f0c3019fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58964/0 (socket says 172.21.15.170:58964) 2024-09-04T16:34:02.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.229+0000 7f0c2e7fc640 1 -- 172.21.15.170:0/3709226046 learned_addr learned my addr 172.21.15.170:0/3709226046 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:02.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.229+0000 7f0c2effd640 1 --2- 172.21.15.170:0/3709226046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c30074620 0x7f0c3019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:02.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.229+0000 7f0c2e7fc640 1 -- 172.21.15.170:0/3709226046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c30074620 msgr2=0x7f0c3019f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:02.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.229+0000 7f0c2e7fc640 1 --2- 172.21.15.170:0/3709226046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c30074620 0x7f0c3019f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:02.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.229+0000 7f0c2e7fc640 1 -- 172.21.15.170:0/3709226046 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c301999d0 con 0x7f0c30074f40 2024-09-04T16:34:02.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.230+0000 7f0c2e7fc640 1 --2- 172.21.15.170:0/3709226046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c30074f40 0x7f0c3019fd50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0c24031460 tx=0x7f0c240045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:02.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.230+0000 7f0c349fc640 1 -- 172.21.15.170:0/3709226046 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c2403f070 con 0x7f0c30074f40 2024-09-04T16:34:02.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.230+0000 7f0c359fe640 1 -- 172.21.15.170:0/3709226046 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c30199c60 con 0x7f0c30074f40 2024-09-04T16:34:02.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.230+0000 7f0c349fc640 1 -- 172.21.15.170:0/3709226046 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0c240035f0 con 0x7f0c30074f40 2024-09-04T16:34:02.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.230+0000 7f0c349fc640 1 -- 172.21.15.170:0/3709226046 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c24035030 con 0x7f0c30074f40 2024-09-04T16:34:02.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.230+0000 7f0c359fe640 1 -- 172.21.15.170:0/3709226046 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c3019a190 con 0x7f0c30074f40 2024-09-04T16:34:02.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.231+0000 7f0c359fe640 1 -- 172.21.15.170:0/3709226046 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c30075cd0 con 0x7f0c30074f40 2024-09-04T16:34:02.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.232+0000 7f0c349fc640 1 -- 172.21.15.170:0/3709226046 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f0c24042070 con 0x7f0c30074f40 2024-09-04T16:34:02.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.232+0000 7f0c349fc640 1 --2- 172.21.15.170:0/3709226046 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0c18079e30 0x7f0c1807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:02.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.232+0000 7f0c349fc640 1 -- 172.21.15.170:0/3709226046 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f0c240bd300 con 0x7f0c30074f40 2024-09-04T16:34:02.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.232+0000 7f0c2effd640 1 --2- 172.21.15.170:0/3709226046 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0c18079e30 0x7f0c1807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:02.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.232+0000 7f0c2effd640 1 --2- 172.21.15.170:0/3709226046 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0c18079e30 0x7f0c1807c2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0c3019ab10 tx=0x7f0c2000b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:02.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.236+0000 7f0c349fc640 1 -- 172.21.15.170:0/3709226046 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f0c24088f30 con 0x7f0c30074f40 2024-09-04T16:34:02.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:02.426+0000 7f0c359fe640 1 -- 172.21.15.170:0/3709226046 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754", "target": ["mon-mgr", ""]}) -- 0x7f0c3019af00 con 0x7f0c18079e30 2024-09-04T16:34:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:02 smithi170 ceph-mon[29272]: pgmap v95: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:02.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:02 smithi193 ceph-mon[36288]: pgmap v95: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:03.706 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:03 smithi170 ceph-mon[29272]: from='client.14924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:03.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:03 smithi193 ceph-mon[36288]: from='client.14924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:04.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:04.354+0000 7f0c349fc640 1 -- 172.21.15.170:0/3709226046 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5741 (secure 0 0 0) 0x7f0c3019af00 con 0x7f0c18079e30 2024-09-04T16:34:04.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:04.357+0000 7f0c359fe640 1 -- 172.21.15.170:0/3709226046 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0c18079e30 msgr2=0x7f0c1807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:04.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:04.357+0000 7f0c359fe640 1 --2- 172.21.15.170:0/3709226046 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0c18079e30 0x7f0c1807c2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0c3019ab10 tx=0x7f0c2000b390 comp rx=0 tx=0).stop 2024-09-04T16:34:04.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:04.357+0000 7f0c359fe640 1 -- 172.21.15.170:0/3709226046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c30074f40 msgr2=0x7f0c3019fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:04.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:04.357+0000 7f0c359fe640 1 --2- 172.21.15.170:0/3709226046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c30074f40 0x7f0c3019fd50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0c24031460 tx=0x7f0c240045e0 comp rx=0 tx=0).stop 2024-09-04T16:34:04.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:04.357+0000 7f0c359fe640 1 -- 172.21.15.170:0/3709226046 shutdown_connections 2024-09-04T16:34:04.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:04.357+0000 7f0c359fe640 1 --2- 172.21.15.170:0/3709226046 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0c18079e30 0x7f0c1807c2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:04.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:04.357+0000 7f0c359fe640 1 --2- 172.21.15.170:0/3709226046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c30074f40 0x7f0c3019fd50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:04.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:04.357+0000 7f0c359fe640 1 --2- 172.21.15.170:0/3709226046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c30074620 0x7f0c3019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:04.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:04.357+0000 7f0c359fe640 1 -- 172.21.15.170:0/3709226046 >> 172.21.15.170:0/3709226046 conn(0x7f0c300fd630 msgr2=0x7f0c301083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:04.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:04.357+0000 7f0c359fe640 1 -- 172.21.15.170:0/3709226046 shutdown_connections 2024-09-04T16:34:04.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:04.357+0000 7f0c359fe640 1 -- 172.21.15.170:0/3709226046 wait complete. 2024-09-04T16:34:04.366 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:34:04.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:04 smithi170 ceph-mon[29272]: pgmap v96: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:04.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:04 smithi193 ceph-mon[36288]: pgmap v96: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:05.014 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph orch ps' 2024-09-04T16:34:05.263 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:34:05.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.811+0000 7f7313286640 1 -- 172.21.15.170:0/3080836512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f730c102ae0 msgr2=0x7f730c102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:05.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.811+0000 7f7313286640 1 --2- 172.21.15.170:0/3080836512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f730c102ae0 0x7f730c102ec0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7308009880 tx=0x7f730802a530 comp rx=0 tx=0).stop 2024-09-04T16:34:05.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.811+0000 7f7313286640 1 -- 172.21.15.170:0/3080836512 shutdown_connections 2024-09-04T16:34:05.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.811+0000 7f7313286640 1 --2- 172.21.15.170:0/3080836512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f730c103400 0x7f730c10b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.811+0000 7f7313286640 1 --2- 172.21.15.170:0/3080836512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f730c102ae0 0x7f730c102ec0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.811+0000 7f7313286640 1 -- 172.21.15.170:0/3080836512 >> 172.21.15.170:0/3080836512 conn(0x7f730c0fc520 msgr2=0x7f730c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.811+0000 7f7313286640 1 -- 172.21.15.170:0/3080836512 shutdown_connections 2024-09-04T16:34:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.811+0000 7f7313286640 1 -- 172.21.15.170:0/3080836512 wait complete. 2024-09-04T16:34:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.812+0000 7f7313286640 1 Processor -- start 2024-09-04T16:34:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.812+0000 7f7313286640 1 -- start start 2024-09-04T16:34:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.812+0000 7f7313286640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f730c102ae0 0x7f730c100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.812+0000 7f7313286640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f730c103400 0x7f730c100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.812+0000 7f7313286640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f730c10ee10 con 0x7f730c102ae0 2024-09-04T16:34:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.812+0000 7f7313286640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f730c10ec90 con 0x7f730c103400 2024-09-04T16:34:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.812+0000 7f7311022640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f730c102ae0 0x7f730c100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.812+0000 7f7311022640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f730c102ae0 0x7f730c100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:52186/0 (socket says 172.21.15.170:52186) 2024-09-04T16:34:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.812+0000 7f7311022640 1 -- 172.21.15.170:0/2127608907 learned_addr learned my addr 172.21.15.170:0/2127608907 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.812+0000 7f7310821640 1 --2- 172.21.15.170:0/2127608907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f730c103400 0x7f730c100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.812+0000 7f7311022640 1 -- 172.21.15.170:0/2127608907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f730c103400 msgr2=0x7f730c100c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.812+0000 7f7311022640 1 --2- 172.21.15.170:0/2127608907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f730c103400 0x7f730c100c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.812+0000 7f7311022640 1 -- 172.21.15.170:0/2127608907 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c1011c0 con 0x7f730c102ae0 2024-09-04T16:34:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.812+0000 7f7310821640 1 --2- 172.21.15.170:0/2127608907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f730c103400 0x7f730c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:34:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.813+0000 7f7311022640 1 --2- 172.21.15.170:0/2127608907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f730c102ae0 0x7f730c100740 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7308031460 tx=0x7f73080045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.813+0000 7f73027fc640 1 -- 172.21.15.170:0/2127608907 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f730803f070 con 0x7f730c102ae0 2024-09-04T16:34:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.813+0000 7f73027fc640 1 -- 172.21.15.170:0/2127608907 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f73080035f0 con 0x7f730c102ae0 2024-09-04T16:34:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.813+0000 7f7313286640 1 -- 172.21.15.170:0/2127608907 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730c101450 con 0x7f730c102ae0 2024-09-04T16:34:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.813+0000 7f73027fc640 1 -- 172.21.15.170:0/2127608907 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7308035030 con 0x7f730c102ae0 2024-09-04T16:34:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.813+0000 7f7313286640 1 -- 172.21.15.170:0/2127608907 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730c1a3ee0 con 0x7f730c102ae0 2024-09-04T16:34:05.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.814+0000 7f7313286640 1 -- 172.21.15.170:0/2127608907 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f730c06abe0 con 0x7f730c102ae0 2024-09-04T16:34:05.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.815+0000 7f73027fc640 1 -- 172.21.15.170:0/2127608907 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f7308042070 con 0x7f730c102ae0 2024-09-04T16:34:05.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.815+0000 7f73027fc640 1 --2- 172.21.15.170:0/2127608907 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f72f8079e30 0x7f72f807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:05.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.816+0000 7f7310821640 1 --2- 172.21.15.170:0/2127608907 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f72f8079e30 0x7f72f807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:05.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.816+0000 7f73027fc640 1 -- 172.21.15.170:0/2127608907 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f73080bd3b0 con 0x7f730c102ae0 2024-09-04T16:34:05.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.816+0000 7f7310821640 1 --2- 172.21.15.170:0/2127608907 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f72f8079e30 0x7f72f807c2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f730c1021d0 tx=0x7f72fc009670 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:05.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:05.820+0000 7f73027fc640 1 -- 172.21.15.170:0/2127608907 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f7308084e70 con 0x7f730c102ae0 2024-09-04T16:34:06.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:06.000+0000 7f7313286640 1 -- 172.21.15.170:0/2127608907 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f730c062630 con 0x7f72f8079e30 2024-09-04T16:34:06.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:06.010+0000 7f73027fc640 1 -- 172.21.15.170:0/2127608907 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f730c062630 con 0x7f72f8079e30 2024-09-04T16:34:06.010 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:34:06.011 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (64s) 36s ago 11m 16.7M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:34:06.011 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (4m) 36s ago 12m 8820k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:34:06.011 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (3m) 106s ago 11m 8112k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:34:06.011 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (12m) 36s ago 12m 6891k - 19.1.1-252-g48920dab b708f9119ac7 aa2ec5c5776a 2024-09-04T16:34:06.011 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (11m) 106s ago 11m 6895k - 19.1.1-252-g48920dab b708f9119ac7 a24f0ce3b3fb 2024-09-04T16:34:06.011 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (42s) 36s ago 11m 50.1M - c8b91775d855 6e3778aab5e6 2024-09-04T16:34:06.011 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (6m) 36s ago 6m 27.1M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:34:06.011 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (6m) 36s ago 6m 147M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:34:06.011 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (6m) 106s ago 6m 15.5M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:34:06.011 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (6m) 106s ago 6m 14.9M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:34:06.011 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (3m) 36s ago 13m 521M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:34:06.012 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (2m) 106s ago 11m 454M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:34:06.012 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (13m) 36s ago 13m 60.3M 2048M 19.1.1-252-g48920dab b708f9119ac7 194ff39cc041 2024-09-04T16:34:06.012 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (10m) 106s ago 10m 49.7M 2048M 19.1.1-252-g48920dab b708f9119ac7 38c8e99ca323 2024-09-04T16:34:06.012 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (116s) 36s ago 12m 10.3M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:34:06.012 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (110s) 106s ago 11m 5246k - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:34:06.012 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (9m) 36s ago 9m 210M 1216M 19.1.1-252-g48920dab b708f9119ac7 6c2ea484615d 2024-09-04T16:34:06.012 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (9m) 36s ago 9m 227M 1216M 19.1.1-252-g48920dab b708f9119ac7 20469ba5727b 2024-09-04T16:34:06.012 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (8m) 36s ago 8m 181M 1216M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:34:06.012 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (8m) 106s ago 8m 245M 2240M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:34:06.012 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (8m) 106s ago 8m 209M 2240M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:34:06.012 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (7m) 106s ago 7m 189M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:34:06.012 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (86s) 36s ago 11m 44.9M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:34:06.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:06.012+0000 7f7313286640 1 -- 172.21.15.170:0/2127608907 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f72f8079e30 msgr2=0x7f72f807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:06.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:06.012+0000 7f7313286640 1 --2- 172.21.15.170:0/2127608907 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f72f8079e30 0x7f72f807c2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f730c1021d0 tx=0x7f72fc009670 comp rx=0 tx=0).stop 2024-09-04T16:34:06.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:06.012+0000 7f7313286640 1 -- 172.21.15.170:0/2127608907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f730c102ae0 msgr2=0x7f730c100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:06.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:06.012+0000 7f7313286640 1 --2- 172.21.15.170:0/2127608907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f730c102ae0 0x7f730c100740 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7308031460 tx=0x7f73080045e0 comp rx=0 tx=0).stop 2024-09-04T16:34:06.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:06.012+0000 7f7313286640 1 -- 172.21.15.170:0/2127608907 shutdown_connections 2024-09-04T16:34:06.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:06.012+0000 7f7313286640 1 --2- 172.21.15.170:0/2127608907 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f72f8079e30 0x7f72f807c2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:06.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:06.012+0000 7f7313286640 1 --2- 172.21.15.170:0/2127608907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f730c103400 0x7f730c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:06.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:06.012+0000 7f7313286640 1 --2- 172.21.15.170:0/2127608907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f730c102ae0 0x7f730c100740 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:06.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:06.012+0000 7f7313286640 1 -- 172.21.15.170:0/2127608907 >> 172.21.15.170:0/2127608907 conn(0x7f730c0fc520 msgr2=0x7f730c108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:06.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:06.012+0000 7f7313286640 1 -- 172.21.15.170:0/2127608907 shutdown_connections 2024-09-04T16:34:06.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:06.012+0000 7f7313286640 1 -- 172.21.15.170:0/2127608907 wait complete. 2024-09-04T16:34:06.723 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-04T16:34:06.724 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi170.front.sepia.ceph.com 2024-09-04T16:34:06.725 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-04T16:34:06.978 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:34:07.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.431+0000 7f5a87f5a640 1 -- 172.21.15.170:0/755068442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a80100820 msgr2=0x7f5a80100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:07.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.431+0000 7f5a87f5a640 1 --2- 172.21.15.170:0/755068442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a80100820 0x7f5a80100c80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5a70009880 tx=0x7f5a7002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:34:07.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.431+0000 7f5a87f5a640 1 -- 172.21.15.170:0/755068442 shutdown_connections 2024-09-04T16:34:07.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.431+0000 7f5a87f5a640 1 --2- 172.21.15.170:0/755068442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a80100820 0x7f5a80100c80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:07.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.431+0000 7f5a87f5a640 1 --2- 172.21.15.170:0/755068442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a80106820 0x7f5a80106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:07.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.431+0000 7f5a87f5a640 1 -- 172.21.15.170:0/755068442 >> 172.21.15.170:0/755068442 conn(0x7f5a800fc520 msgr2=0x7f5a800fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:07.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.431+0000 7f5a87f5a640 1 -- 172.21.15.170:0/755068442 shutdown_connections 2024-09-04T16:34:07.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.431+0000 7f5a87f5a640 1 -- 172.21.15.170:0/755068442 wait complete. 2024-09-04T16:34:07.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.431+0000 7f5a87f5a640 1 Processor -- start 2024-09-04T16:34:07.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.431+0000 7f5a87f5a640 1 -- start start 2024-09-04T16:34:07.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.431+0000 7f5a87f5a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a80100820 0x7f5a8019c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:07.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.431+0000 7f5a87f5a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a80106820 0x7f5a8019cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:07.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.431+0000 7f5a87f5a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8010dcd0 con 0x7f5a80100820 2024-09-04T16:34:07.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.431+0000 7f5a87f5a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8010db50 con 0x7f5a80106820 2024-09-04T16:34:07.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.432+0000 7f5a85cf6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a80100820 0x7f5a8019c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:07.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.432+0000 7f5a85cf6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a80100820 0x7f5a8019c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:52204/0 (socket says 172.21.15.170:52204) 2024-09-04T16:34:07.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.432+0000 7f5a85cf6640 1 -- 172.21.15.170:0/3379801191 learned_addr learned my addr 172.21.15.170:0/3379801191 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:07.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.432+0000 7f5a854f5640 1 --2- 172.21.15.170:0/3379801191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a80106820 0x7f5a8019cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:07.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.432+0000 7f5a85cf6640 1 -- 172.21.15.170:0/3379801191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a80106820 msgr2=0x7f5a8019cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:07.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.432+0000 7f5a85cf6640 1 --2- 172.21.15.170:0/3379801191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a80106820 0x7f5a8019cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:07.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.432+0000 7f5a85cf6640 1 -- 172.21.15.170:0/3379801191 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a801966b0 con 0x7f5a80100820 2024-09-04T16:34:07.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.432+0000 7f5a854f5640 1 --2- 172.21.15.170:0/3379801191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a80106820 0x7f5a8019cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:34:07.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.432+0000 7f5a85cf6640 1 --2- 172.21.15.170:0/3379801191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a80100820 0x7f5a8019c5e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00c810 tx=0x7f5a7c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:07.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.432+0000 7f5a76ffd640 1 -- 172.21.15.170:0/3379801191 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a7c004020 con 0x7f5a80100820 2024-09-04T16:34:07.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.432+0000 7f5a87f5a640 1 -- 172.21.15.170:0/3379801191 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a801969a0 con 0x7f5a80100820 2024-09-04T16:34:07.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.432+0000 7f5a76ffd640 1 -- 172.21.15.170:0/3379801191 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5a7c0041c0 con 0x7f5a80100820 2024-09-04T16:34:07.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.432+0000 7f5a76ffd640 1 -- 172.21.15.170:0/3379801191 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a7c0047a0 con 0x7f5a80100820 2024-09-04T16:34:07.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.432+0000 7f5a87f5a640 1 -- 172.21.15.170:0/3379801191 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a80196f00 con 0x7f5a80100820 2024-09-04T16:34:07.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.433+0000 7f5a87f5a640 1 -- 172.21.15.170:0/3379801191 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a80101f60 con 0x7f5a80100820 2024-09-04T16:34:07.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.434+0000 7f5a76ffd640 1 -- 172.21.15.170:0/3379801191 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5a7c0079b0 con 0x7f5a80100820 2024-09-04T16:34:07.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.434+0000 7f5a76ffd640 1 --2- 172.21.15.170:0/3379801191 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5a6c079e30 0x7f5a6c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:07.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.434+0000 7f5a76ffd640 1 -- 172.21.15.170:0/3379801191 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f5a7c09c950 con 0x7f5a80100820 2024-09-04T16:34:07.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.434+0000 7f5a854f5640 1 --2- 172.21.15.170:0/3379801191 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5a6c079e30 0x7f5a6c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:07.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.435+0000 7f5a854f5640 1 --2- 172.21.15.170:0/3379801191 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5a6c079e30 0x7f5a6c07c2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5a80197f00 tx=0x7f5a70009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:07.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.439+0000 7f5a76ffd640 1 -- 172.21.15.170:0/3379801191 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f5a7c014030 con 0x7f5a80100820 2024-09-04T16:34:07.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:07 smithi170 ceph-mon[29272]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:07.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:07 smithi170 ceph-mon[29272]: pgmap v97: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:07.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.615+0000 7f5a87f5a640 1 -- 172.21.15.170:0/3379801191 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) -- 0x7f5a80108db0 con 0x7f5a80100820 2024-09-04T16:34:07.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.618+0000 7f5a76ffd640 1 -- 172.21.15.170:0/3379801191 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v66)=0 v66) ==== 125+0+0 (secure 0 0 0) 0x7f5a7c064410 con 0x7f5a80100820 2024-09-04T16:34:07.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.621+0000 7f5a87f5a640 1 -- 172.21.15.170:0/3379801191 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5a6c079e30 msgr2=0x7f5a6c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:07.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.621+0000 7f5a87f5a640 1 --2- 172.21.15.170:0/3379801191 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5a6c079e30 0x7f5a6c07c2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5a80197f00 tx=0x7f5a70009560 comp rx=0 tx=0).stop 2024-09-04T16:34:07.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.621+0000 7f5a87f5a640 1 -- 172.21.15.170:0/3379801191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a80100820 msgr2=0x7f5a8019c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:07.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.621+0000 7f5a87f5a640 1 --2- 172.21.15.170:0/3379801191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a80100820 0x7f5a8019c5e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00c810 tx=0x7f5a7c00ccd0 comp rx=0 tx=0).stop 2024-09-04T16:34:07.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.621+0000 7f5a87f5a640 1 -- 172.21.15.170:0/3379801191 shutdown_connections 2024-09-04T16:34:07.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.621+0000 7f5a87f5a640 1 --2- 172.21.15.170:0/3379801191 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5a6c079e30 0x7f5a6c07c2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:07.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.621+0000 7f5a87f5a640 1 --2- 172.21.15.170:0/3379801191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a80106820 0x7f5a8019cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:07.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.621+0000 7f5a87f5a640 1 --2- 172.21.15.170:0/3379801191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a80100820 0x7f5a8019c5e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:07.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.621+0000 7f5a87f5a640 1 -- 172.21.15.170:0/3379801191 >> 172.21.15.170:0/3379801191 conn(0x7f5a800fc520 msgr2=0x7f5a800fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:07.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.621+0000 7f5a87f5a640 1 -- 172.21.15.170:0/3379801191 shutdown_connections 2024-09-04T16:34:07.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:07.621+0000 7f5a87f5a640 1 -- 172.21.15.170:0/3379801191 wait complete. 2024-09-04T16:34:07.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:07 smithi193 ceph-mon[36288]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:07.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:07 smithi193 ceph-mon[36288]: pgmap v97: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:08.371 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-04T16:34:08.372 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi170.front.sepia.ceph.com 2024-09-04T16:34:08.372 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-04T16:34:08.621 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:34:08.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:08 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3379801191' entity='client.admin' 2024-09-04T16:34:08.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:08 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:34:08.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:08 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:34:08.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:08 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:34:08.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:08 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:08.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:08 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-04T16:34:08.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:08 smithi170 ceph-mon[29272]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-04T16:34:08.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:08 smithi170 ceph-mon[29272]: pgmap v98: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:08 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3379801191' entity='client.admin' 2024-09-04T16:34:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:08 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:34:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:08 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:34:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:08 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:34:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:08 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:08 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-04T16:34:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:08 smithi193 ceph-mon[36288]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-04T16:34:08.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:08 smithi193 ceph-mon[36288]: pgmap v98: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:09.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.081+0000 7f6ff1a46640 1 -- 172.21.15.170:0/2202816007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fec1018f0 msgr2=0x7f6fec101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:09.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.081+0000 7f6ff1a46640 1 --2- 172.21.15.170:0/2202816007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fec1018f0 0x7f6fec101d50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009880 tx=0x7f6fd402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:34:09.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.081+0000 7f6ff1a46640 1 -- 172.21.15.170:0/2202816007 shutdown_connections 2024-09-04T16:34:09.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.081+0000 7f6ff1a46640 1 --2- 172.21.15.170:0/2202816007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fec1018f0 0x7f6fec101d50 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:09.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.081+0000 7f6ff1a46640 1 --2- 172.21.15.170:0/2202816007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6fec1078f0 0x7f6fec107cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:09.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.081+0000 7f6ff1a46640 1 -- 172.21.15.170:0/2202816007 >> 172.21.15.170:0/2202816007 conn(0x7f6fec0fd630 msgr2=0x7f6fec0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:09.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.081+0000 7f6ff1a46640 1 -- 172.21.15.170:0/2202816007 shutdown_connections 2024-09-04T16:34:09.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.081+0000 7f6ff1a46640 1 -- 172.21.15.170:0/2202816007 wait complete. 2024-09-04T16:34:09.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.082+0000 7f6ff1a46640 1 Processor -- start 2024-09-04T16:34:09.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.082+0000 7f6ff1a46640 1 -- start start 2024-09-04T16:34:09.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6ff1a46640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fec1018f0 0x7f6fec19f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:09.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6ff1a46640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6fec1078f0 0x7f6fec19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:09.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6ff1a46640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec075700 con 0x7f6fec1018f0 2024-09-04T16:34:09.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6ff1a46640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec075580 con 0x7f6fec1078f0 2024-09-04T16:34:09.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6feaffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fec1018f0 0x7f6fec19f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:09.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6feaffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fec1018f0 0x7f6fec19f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:52220/0 (socket says 172.21.15.170:52220) 2024-09-04T16:34:09.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6feaffd640 1 -- 172.21.15.170:0/2993491327 learned_addr learned my addr 172.21.15.170:0/2993491327 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:09.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6fea7fc640 1 --2- 172.21.15.170:0/2993491327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6fec1078f0 0x7f6fec19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:09.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6feaffd640 1 -- 172.21.15.170:0/2993491327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6fec1078f0 msgr2=0x7f6fec19fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:09.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6feaffd640 1 --2- 172.21.15.170:0/2993491327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6fec1078f0 0x7f6fec19fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:09.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6feaffd640 1 -- 172.21.15.170:0/2993491327 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fec199a80 con 0x7f6fec1018f0 2024-09-04T16:34:09.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6fea7fc640 1 --2- 172.21.15.170:0/2993491327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6fec1078f0 0x7f6fec19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:34:09.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6feaffd640 1 --2- 172.21.15.170:0/2993491327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fec1018f0 0x7f6fec19f8c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00ba50 tx=0x7f6fdc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:09.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6ff0a44640 1 -- 172.21.15.170:0/2993491327 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6fdc019070 con 0x7f6fec1018f0 2024-09-04T16:34:09.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6ff1a46640 1 -- 172.21.15.170:0/2993491327 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fec199d70 con 0x7f6fec1018f0 2024-09-04T16:34:09.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6ff0a44640 1 -- 172.21.15.170:0/2993491327 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6fdc00ce20 con 0x7f6fec1018f0 2024-09-04T16:34:09.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.083+0000 7f6ff0a44640 1 -- 172.21.15.170:0/2993491327 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6fdc0075a0 con 0x7f6fec1018f0 2024-09-04T16:34:09.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.084+0000 7f6ff1a46640 1 -- 172.21.15.170:0/2993491327 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fec19a2d0 con 0x7f6fec1018f0 2024-09-04T16:34:09.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.084+0000 7f6ff1a46640 1 -- 172.21.15.170:0/2993491327 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fec103030 con 0x7f6fec1018f0 2024-09-04T16:34:09.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.085+0000 7f6ff0a44640 1 -- 172.21.15.170:0/2993491327 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f6fdc01c070 con 0x7f6fec1018f0 2024-09-04T16:34:09.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.086+0000 7f6ff0a44640 1 --2- 172.21.15.170:0/2993491327 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6fd8079e40 0x7f6fd807c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:09.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.086+0000 7f6ff0a44640 1 -- 172.21.15.170:0/2993491327 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f6fdc09c2f0 con 0x7f6fec1018f0 2024-09-04T16:34:09.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.086+0000 7f6fea7fc640 1 --2- 172.21.15.170:0/2993491327 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6fd8079e40 0x7f6fd807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:09.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.086+0000 7f6fea7fc640 1 --2- 172.21.15.170:0/2993491327 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6fd8079e40 0x7f6fd807c300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6fec19b270 tx=0x7f6fd4031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:09.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.090+0000 7f6ff0a44640 1 -- 172.21.15.170:0/2993491327 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f6fdc063db0 con 0x7f6fec1018f0 2024-09-04T16:34:09.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.265+0000 7f6ff1a46640 1 -- 172.21.15.170:0/2993491327 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7f6fec19afe0 con 0x7f6fec1018f0 2024-09-04T16:34:09.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.266+0000 7f6ff0a44640 1 -- 172.21.15.170:0/2993491327 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v66)=0 v66) ==== 155+0+0 (secure 0 0 0) 0x7f6fdc067f20 con 0x7f6fec1018f0 2024-09-04T16:34:09.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.268+0000 7f6ff1a46640 1 -- 172.21.15.170:0/2993491327 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6fd8079e40 msgr2=0x7f6fd807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:09.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.268+0000 7f6ff1a46640 1 --2- 172.21.15.170:0/2993491327 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6fd8079e40 0x7f6fd807c300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6fec19b270 tx=0x7f6fd4031400 comp rx=0 tx=0).stop 2024-09-04T16:34:09.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.268+0000 7f6ff1a46640 1 -- 172.21.15.170:0/2993491327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fec1018f0 msgr2=0x7f6fec19f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:09.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.268+0000 7f6ff1a46640 1 --2- 172.21.15.170:0/2993491327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fec1018f0 0x7f6fec19f8c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00ba50 tx=0x7f6fdc00bf10 comp rx=0 tx=0).stop 2024-09-04T16:34:09.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.268+0000 7f6ff1a46640 1 -- 172.21.15.170:0/2993491327 shutdown_connections 2024-09-04T16:34:09.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.268+0000 7f6ff1a46640 1 --2- 172.21.15.170:0/2993491327 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6fd8079e40 0x7f6fd807c300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:09.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.268+0000 7f6ff1a46640 1 --2- 172.21.15.170:0/2993491327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6fec1078f0 0x7f6fec19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:09.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.268+0000 7f6ff1a46640 1 --2- 172.21.15.170:0/2993491327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6fec1018f0 0x7f6fec19f8c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:09.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.268+0000 7f6ff1a46640 1 -- 172.21.15.170:0/2993491327 >> 172.21.15.170:0/2993491327 conn(0x7f6fec0fd630 msgr2=0x7f6fec0fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:09.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.268+0000 7f6ff1a46640 1 -- 172.21.15.170:0/2993491327 shutdown_connections 2024-09-04T16:34:09.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:09.268+0000 7f6ff1a46640 1 -- 172.21.15.170:0/2993491327 wait complete. 2024-09-04T16:34:09.915 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-04T16:34:10.168 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:34:10.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.664+0000 7ff8eedc7640 1 -- 172.21.15.170:0/2449096379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8e8100820 msgr2=0x7ff8e8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:10.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.664+0000 7ff8eedc7640 1 --2- 172.21.15.170:0/2449096379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8e8100820 0x7ff8e8100c80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc009880 tx=0x7ff8dc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:34:10.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.664+0000 7ff8eedc7640 1 -- 172.21.15.170:0/2449096379 shutdown_connections 2024-09-04T16:34:10.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.664+0000 7ff8eedc7640 1 --2- 172.21.15.170:0/2449096379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8e8100820 0x7ff8e8100c80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:10.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.664+0000 7ff8eedc7640 1 --2- 172.21.15.170:0/2449096379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8e8106820 0x7ff8e8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:10.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.664+0000 7ff8eedc7640 1 -- 172.21.15.170:0/2449096379 >> 172.21.15.170:0/2449096379 conn(0x7ff8e80fc520 msgr2=0x7ff8e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:10.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.665+0000 7ff8eedc7640 1 -- 172.21.15.170:0/2449096379 shutdown_connections 2024-09-04T16:34:10.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.665+0000 7ff8eedc7640 1 -- 172.21.15.170:0/2449096379 wait complete. 2024-09-04T16:34:10.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.665+0000 7ff8eedc7640 1 Processor -- start 2024-09-04T16:34:10.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.665+0000 7ff8eedc7640 1 -- start start 2024-09-04T16:34:10.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.665+0000 7ff8eedc7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8e8100820 0x7ff8e8198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:10.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.665+0000 7ff8eedc7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8e8106820 0x7ff8e8198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:10.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.665+0000 7ff8eedc7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e810dcf0 con 0x7ff8e8106820 2024-09-04T16:34:10.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.665+0000 7ff8eedc7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e810db70 con 0x7ff8e8100820 2024-09-04T16:34:10.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.666+0000 7ff8e7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8e8106820 0x7ff8e8198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:10.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.666+0000 7ff8e7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8e8106820 0x7ff8e8198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:52240/0 (socket says 172.21.15.170:52240) 2024-09-04T16:34:10.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.666+0000 7ff8e7fff640 1 -- 172.21.15.170:0/2066973842 learned_addr learned my addr 172.21.15.170:0/2066973842 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:10.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.666+0000 7ff8ecb63640 1 --2- 172.21.15.170:0/2066973842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8e8100820 0x7ff8e8198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:10.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.666+0000 7ff8e7fff640 1 -- 172.21.15.170:0/2066973842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8e8100820 msgr2=0x7ff8e8198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:10.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.666+0000 7ff8e7fff640 1 --2- 172.21.15.170:0/2066973842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8e8100820 0x7ff8e8198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:10.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.666+0000 7ff8e7fff640 1 -- 172.21.15.170:0/2066973842 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e8199340 con 0x7ff8e8106820 2024-09-04T16:34:10.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.666+0000 7ff8e7fff640 1 --2- 172.21.15.170:0/2066973842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8e8106820 0x7ff8e8198d40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc031460 tx=0x7ff8dc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:10.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.666+0000 7ff8e5ffb640 1 -- 172.21.15.170:0/2066973842 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff8dc03f070 con 0x7ff8e8106820 2024-09-04T16:34:10.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.666+0000 7ff8e5ffb640 1 -- 172.21.15.170:0/2066973842 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff8dc004cf0 con 0x7ff8e8106820 2024-09-04T16:34:10.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.666+0000 7ff8eedc7640 1 -- 172.21.15.170:0/2066973842 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e81995d0 con 0x7ff8e8106820 2024-09-04T16:34:10.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.666+0000 7ff8e5ffb640 1 -- 172.21.15.170:0/2066973842 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff8dc035030 con 0x7ff8e8106820 2024-09-04T16:34:10.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.667+0000 7ff8eedc7640 1 -- 172.21.15.170:0/2066973842 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e81a1b80 con 0x7ff8e8106820 2024-09-04T16:34:10.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.668+0000 7ff8eedc7640 1 -- 172.21.15.170:0/2066973842 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e8101f60 con 0x7ff8e8106820 2024-09-04T16:34:10.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.668+0000 7ff8e5ffb640 1 -- 172.21.15.170:0/2066973842 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ff8dc042070 con 0x7ff8e8106820 2024-09-04T16:34:10.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.669+0000 7ff8e5ffb640 1 --2- 172.21.15.170:0/2066973842 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff8d0079e30 0x7ff8d007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:10.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.669+0000 7ff8e5ffb640 1 -- 172.21.15.170:0/2066973842 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7ff8dc0bd4d0 con 0x7ff8e8106820 2024-09-04T16:34:10.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.669+0000 7ff8ecb63640 1 --2- 172.21.15.170:0/2066973842 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff8d0079e30 0x7ff8d007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:10.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.670+0000 7ff8ecb63640 1 --2- 172.21.15.170:0/2066973842 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff8d0079e30 0x7ff8d007c2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8005fd0 tx=0x7ff8d8005e20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:10.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.674+0000 7ff8e5ffb640 1 -- 172.21.15.170:0/2066973842 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7ff8dc084f30 con 0x7ff8e8106820 2024-09-04T16:34:10.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.847+0000 7ff8eedc7640 1 -- 172.21.15.170:0/2066973842 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7ff8e8108d90 con 0x7ff8e8106820 2024-09-04T16:34:10.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.848+0000 7ff8e5ffb640 1 -- 172.21.15.170:0/2066973842 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v66)=0 v66) ==== 163+0+0 (secure 0 0 0) 0x7ff8dc08d3e0 con 0x7ff8e8106820 2024-09-04T16:34:10.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.850+0000 7ff8eedc7640 1 -- 172.21.15.170:0/2066973842 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff8d0079e30 msgr2=0x7ff8d007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:10.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.850+0000 7ff8eedc7640 1 --2- 172.21.15.170:0/2066973842 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff8d0079e30 0x7ff8d007c2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8005fd0 tx=0x7ff8d8005e20 comp rx=0 tx=0).stop 2024-09-04T16:34:10.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.850+0000 7ff8eedc7640 1 -- 172.21.15.170:0/2066973842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8e8106820 msgr2=0x7ff8e8198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:10.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.850+0000 7ff8eedc7640 1 --2- 172.21.15.170:0/2066973842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8e8106820 0x7ff8e8198d40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc031460 tx=0x7ff8dc0048f0 comp rx=0 tx=0).stop 2024-09-04T16:34:10.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.850+0000 7ff8eedc7640 1 -- 172.21.15.170:0/2066973842 shutdown_connections 2024-09-04T16:34:10.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.850+0000 7ff8eedc7640 1 --2- 172.21.15.170:0/2066973842 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff8d0079e30 0x7ff8d007c2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:10.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.850+0000 7ff8eedc7640 1 --2- 172.21.15.170:0/2066973842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8e8106820 0x7ff8e8198d40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:10.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.850+0000 7ff8eedc7640 1 --2- 172.21.15.170:0/2066973842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8e8100820 0x7ff8e8198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:10.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.850+0000 7ff8eedc7640 1 -- 172.21.15.170:0/2066973842 >> 172.21.15.170:0/2066973842 conn(0x7ff8e80fc520 msgr2=0x7ff8e80fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:10.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.850+0000 7ff8eedc7640 1 -- 172.21.15.170:0/2066973842 shutdown_connections 2024-09-04T16:34:10.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:10.850+0000 7ff8eedc7640 1 -- 172.21.15.170:0/2066973842 wait complete. 2024-09-04T16:34:11.452 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:11 smithi170 ceph-mon[29272]: pgmap v99: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:11.481 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-04T16:34:11.730 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:34:11.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:11 smithi193 ceph-mon[36288]: pgmap v99: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:12.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.219+0000 7fbb064a4640 1 -- 172.21.15.170:0/2406393039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb001033c0 msgr2=0x7fbb0010b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:12.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.219+0000 7fbb064a4640 1 --2- 172.21.15.170:0/2406393039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb001033c0 0x7fbb0010b8b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009880 tx=0x7fbaf402a530 comp rx=0 tx=0).stop 2024-09-04T16:34:12.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.219+0000 7fbb064a4640 1 -- 172.21.15.170:0/2406393039 shutdown_connections 2024-09-04T16:34:12.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.219+0000 7fbb064a4640 1 --2- 172.21.15.170:0/2406393039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb001033c0 0x7fbb0010b8b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:12.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.219+0000 7fbb064a4640 1 --2- 172.21.15.170:0/2406393039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb00102aa0 0x7fbb00102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:12.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.219+0000 7fbb064a4640 1 -- 172.21.15.170:0/2406393039 >> 172.21.15.170:0/2406393039 conn(0x7fbb000fc4c0 msgr2=0x7fbb000fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:12.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.219+0000 7fbb064a4640 1 -- 172.21.15.170:0/2406393039 shutdown_connections 2024-09-04T16:34:12.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.219+0000 7fbb064a4640 1 -- 172.21.15.170:0/2406393039 wait complete. 2024-09-04T16:34:12.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.220+0000 7fbb064a4640 1 Processor -- start 2024-09-04T16:34:12.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.220+0000 7fbb064a4640 1 -- start start 2024-09-04T16:34:12.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.220+0000 7fbb064a4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb00102aa0 0x7fbb0019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:12.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.220+0000 7fbb064a4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb001033c0 0x7fbb0019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:12.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.220+0000 7fbb064a4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0010edb0 con 0x7fbb001033c0 2024-09-04T16:34:12.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.220+0000 7fbb064a4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0010ec30 con 0x7fbb00102aa0 2024-09-04T16:34:12.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.220+0000 7fbaff7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb001033c0 0x7fbb0019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:12.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.220+0000 7fbafffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb00102aa0 0x7fbb0019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:12.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.220+0000 7fbaff7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb001033c0 0x7fbb0019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:52256/0 (socket says 172.21.15.170:52256) 2024-09-04T16:34:12.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.220+0000 7fbaff7fe640 1 -- 172.21.15.170:0/11654267 learned_addr learned my addr 172.21.15.170:0/11654267 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:12.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.221+0000 7fbaff7fe640 1 -- 172.21.15.170:0/11654267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb00102aa0 msgr2=0x7fbb0019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:12.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.221+0000 7fbaff7fe640 1 --2- 172.21.15.170:0/11654267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb00102aa0 0x7fbb0019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:12.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.221+0000 7fbaff7fe640 1 -- 172.21.15.170:0/11654267 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb001977c0 con 0x7fbb001033c0 2024-09-04T16:34:12.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.221+0000 7fbafffff640 1 --2- 172.21.15.170:0/11654267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb00102aa0 0x7fbb0019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:34:12.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.221+0000 7fbaff7fe640 1 --2- 172.21.15.170:0/11654267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb001033c0 0x7fbb0019db80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4031460 tx=0x7fbaf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:12.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.221+0000 7fbafd7fa640 1 -- 172.21.15.170:0/11654267 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbaf403f070 con 0x7fbb001033c0 2024-09-04T16:34:12.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.221+0000 7fbb064a4640 1 -- 172.21.15.170:0/11654267 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb00197a50 con 0x7fbb001033c0 2024-09-04T16:34:12.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.221+0000 7fbafd7fa640 1 -- 172.21.15.170:0/11654267 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbaf4004ac0 con 0x7fbb001033c0 2024-09-04T16:34:12.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.221+0000 7fbafd7fa640 1 -- 172.21.15.170:0/11654267 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbaf4035030 con 0x7fbb001033c0 2024-09-04T16:34:12.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.221+0000 7fbb064a4640 1 -- 172.21.15.170:0/11654267 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb00197f80 con 0x7fbb001033c0 2024-09-04T16:34:12.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.223+0000 7fbb064a4640 1 -- 172.21.15.170:0/11654267 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb0006a410 con 0x7fbb001033c0 2024-09-04T16:34:12.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.224+0000 7fbafd7fa640 1 -- 172.21.15.170:0/11654267 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fbaf4042070 con 0x7fbb001033c0 2024-09-04T16:34:12.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.224+0000 7fbafd7fa640 1 --2- 172.21.15.170:0/11654267 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbae8079e30 0x7fbae807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:12.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.224+0000 7fbafd7fa640 1 -- 172.21.15.170:0/11654267 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fbaf40bd390 con 0x7fbb001033c0 2024-09-04T16:34:12.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.224+0000 7fbafffff640 1 --2- 172.21.15.170:0/11654267 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbae8079e30 0x7fbae807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:12.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.225+0000 7fbafffff640 1 --2- 172.21.15.170:0/11654267 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbae8079e30 0x7fbae807c2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000afb0 tx=0x7fbaf000a2d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:12.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.229+0000 7fbafd7fa640 1 -- 172.21.15.170:0/11654267 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fbaf4084e50 con 0x7fbb001033c0 2024-09-04T16:34:12.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.405+0000 7fbb064a4640 1 -- 172.21.15.170:0/11654267 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7fbb00105f40 con 0x7fbb001033c0 2024-09-04T16:34:12.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.406+0000 7fbafd7fa640 1 -- 172.21.15.170:0/11654267 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v66)=0 v66) ==== 135+0+0 (secure 0 0 0) 0x7fbaf408d300 con 0x7fbb001033c0 2024-09-04T16:34:12.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.408+0000 7fbb064a4640 1 -- 172.21.15.170:0/11654267 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbae8079e30 msgr2=0x7fbae807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:12.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.408+0000 7fbb064a4640 1 --2- 172.21.15.170:0/11654267 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbae8079e30 0x7fbae807c2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000afb0 tx=0x7fbaf000a2d0 comp rx=0 tx=0).stop 2024-09-04T16:34:12.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.408+0000 7fbb064a4640 1 -- 172.21.15.170:0/11654267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb001033c0 msgr2=0x7fbb0019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:12.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.408+0000 7fbb064a4640 1 --2- 172.21.15.170:0/11654267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb001033c0 0x7fbb0019db80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4031460 tx=0x7fbaf40046c0 comp rx=0 tx=0).stop 2024-09-04T16:34:12.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.408+0000 7fbb064a4640 1 -- 172.21.15.170:0/11654267 shutdown_connections 2024-09-04T16:34:12.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.408+0000 7fbb064a4640 1 --2- 172.21.15.170:0/11654267 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbae8079e30 0x7fbae807c2f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:12.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.408+0000 7fbb064a4640 1 --2- 172.21.15.170:0/11654267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb001033c0 0x7fbb0019db80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:12.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.408+0000 7fbb064a4640 1 --2- 172.21.15.170:0/11654267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb00102aa0 0x7fbb0019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:12.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.408+0000 7fbb064a4640 1 -- 172.21.15.170:0/11654267 >> 172.21.15.170:0/11654267 conn(0x7fbb000fc4c0 msgr2=0x7fbb00108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:12.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.408+0000 7fbb064a4640 1 -- 172.21.15.170:0/11654267 shutdown_connections 2024-09-04T16:34:12.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:12.408+0000 7fbb064a4640 1 -- 172.21.15.170:0/11654267 wait complete. 2024-09-04T16:34:13.091 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-04T16:34:13.349 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:34:13.771 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:13 smithi170 ceph-mon[29272]: pgmap v100: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:13.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.855+0000 7f84b5645640 1 -- 172.21.15.170:0/416078622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84b0103400 msgr2=0x7f84b010b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:13.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.855+0000 7f84b5645640 1 --2- 172.21.15.170:0/416078622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84b0103400 0x7f84b010b8f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009880 tx=0x7f84a402a530 comp rx=0 tx=0).stop 2024-09-04T16:34:13.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.855+0000 7f84b5645640 1 -- 172.21.15.170:0/416078622 shutdown_connections 2024-09-04T16:34:13.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.855+0000 7f84b5645640 1 --2- 172.21.15.170:0/416078622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84b0103400 0x7f84b010b8f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:13.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.855+0000 7f84b5645640 1 --2- 172.21.15.170:0/416078622 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b0102ae0 0x7f84b0102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:13.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.855+0000 7f84b5645640 1 -- 172.21.15.170:0/416078622 >> 172.21.15.170:0/416078622 conn(0x7f84b00fc520 msgr2=0x7f84b00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:13.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.855+0000 7f84b5645640 1 -- 172.21.15.170:0/416078622 shutdown_connections 2024-09-04T16:34:13.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.855+0000 7f84b5645640 1 -- 172.21.15.170:0/416078622 wait complete. 2024-09-04T16:34:13.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.856+0000 7f84b5645640 1 Processor -- start 2024-09-04T16:34:13.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.856+0000 7f84b5645640 1 -- start start 2024-09-04T16:34:13.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.856+0000 7f84b5645640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b0102ae0 0x7f84b0100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:13.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.856+0000 7f84b5645640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84b0103400 0x7f84b0100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:13.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.856+0000 7f84b5645640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f84b010ee10 con 0x7f84b0103400 2024-09-04T16:34:13.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.856+0000 7f84b5645640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f84b010ec90 con 0x7f84b0102ae0 2024-09-04T16:34:13.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.856+0000 7f84ae7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84b0103400 0x7f84b0100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:13.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.856+0000 7f84ae7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84b0103400 0x7f84b0100c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:52270/0 (socket says 172.21.15.170:52270) 2024-09-04T16:34:13.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.856+0000 7f84ae7fc640 1 -- 172.21.15.170:0/3127670309 learned_addr learned my addr 172.21.15.170:0/3127670309 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:13.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.856+0000 7f84aeffd640 1 --2- 172.21.15.170:0/3127670309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b0102ae0 0x7f84b0100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:13.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.856+0000 7f84ae7fc640 1 -- 172.21.15.170:0/3127670309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b0102ae0 msgr2=0x7f84b0100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:13.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.856+0000 7f84ae7fc640 1 --2- 172.21.15.170:0/3127670309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b0102ae0 0x7f84b0100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:13.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.856+0000 7f84ae7fc640 1 -- 172.21.15.170:0/3127670309 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b01011c0 con 0x7f84b0103400 2024-09-04T16:34:13.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.856+0000 7f84aeffd640 1 --2- 172.21.15.170:0/3127670309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b0102ae0 0x7f84b0100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:34:13.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.857+0000 7f84ae7fc640 1 --2- 172.21.15.170:0/3127670309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84b0103400 0x7f84b0100c80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f84a4031460 tx=0x7f84a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:13.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.857+0000 7f8497fff640 1 -- 172.21.15.170:0/3127670309 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84a403f070 con 0x7f84b0103400 2024-09-04T16:34:13.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.857+0000 7f84b5645640 1 -- 172.21.15.170:0/3127670309 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b0101450 con 0x7f84b0103400 2024-09-04T16:34:13.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.857+0000 7f8497fff640 1 -- 172.21.15.170:0/3127670309 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84a4004ac0 con 0x7f84b0103400 2024-09-04T16:34:13.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.857+0000 7f8497fff640 1 -- 172.21.15.170:0/3127670309 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84a4035030 con 0x7f84b0103400 2024-09-04T16:34:13.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.857+0000 7f84b5645640 1 -- 172.21.15.170:0/3127670309 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b01a3de0 con 0x7f84b0103400 2024-09-04T16:34:13.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.858+0000 7f84b5645640 1 -- 172.21.15.170:0/3127670309 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b006abe0 con 0x7f84b0103400 2024-09-04T16:34:13.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.859+0000 7f8497fff640 1 -- 172.21.15.170:0/3127670309 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f84a4042070 con 0x7f84b0103400 2024-09-04T16:34:13.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.859+0000 7f8497fff640 1 --2- 172.21.15.170:0/3127670309 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8498079e30 0x7f849807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:13.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.859+0000 7f84aeffd640 1 --2- 172.21.15.170:0/3127670309 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8498079e30 0x7f849807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:13.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.859+0000 7f8497fff640 1 -- 172.21.15.170:0/3127670309 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f84a40bd400 con 0x7f84b0103400 2024-09-04T16:34:13.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.860+0000 7f84aeffd640 1 --2- 172.21.15.170:0/3127670309 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8498079e30 0x7f849807c2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f84a0005fd0 tx=0x7f84a0005ea0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:13.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:13.864+0000 7f8497fff640 1 -- 172.21.15.170:0/3127670309 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f84a4084ec0 con 0x7f84b0103400 2024-09-04T16:34:13.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:13 smithi193 ceph-mon[36288]: pgmap v100: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:14.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:14.055+0000 7f84b5645640 1 -- 172.21.15.170:0/3127670309 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754", "target": ["mon-mgr", ""]}) -- 0x7f84b0105ff0 con 0x7f8498079e30 2024-09-04T16:34:14.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:14.060+0000 7f8497fff640 1 -- 172.21.15.170:0/3127670309 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f84a000a2b0 con 0x7f8498079e30 2024-09-04T16:34:14.061 INFO:teuthology.orchestra.run.smithi170.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:34:14.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:14.062+0000 7f84b5645640 1 -- 172.21.15.170:0/3127670309 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8498079e30 msgr2=0x7f849807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:14.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:14.062+0000 7f84b5645640 1 --2- 172.21.15.170:0/3127670309 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8498079e30 0x7f849807c2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f84a0005fd0 tx=0x7f84a0005ea0 comp rx=0 tx=0).stop 2024-09-04T16:34:14.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:14.062+0000 7f84b5645640 1 -- 172.21.15.170:0/3127670309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84b0103400 msgr2=0x7f84b0100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:14.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:14.062+0000 7f84b5645640 1 --2- 172.21.15.170:0/3127670309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84b0103400 0x7f84b0100c80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f84a4031460 tx=0x7f84a40046c0 comp rx=0 tx=0).stop 2024-09-04T16:34:14.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:14.063+0000 7f84b5645640 1 -- 172.21.15.170:0/3127670309 shutdown_connections 2024-09-04T16:34:14.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:14.063+0000 7f84b5645640 1 --2- 172.21.15.170:0/3127670309 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8498079e30 0x7f849807c2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:14.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:14.063+0000 7f84b5645640 1 --2- 172.21.15.170:0/3127670309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84b0103400 0x7f84b0100c80 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:14.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:14.063+0000 7f84b5645640 1 --2- 172.21.15.170:0/3127670309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b0102ae0 0x7f84b0100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:14.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:14.063+0000 7f84b5645640 1 -- 172.21.15.170:0/3127670309 >> 172.21.15.170:0/3127670309 conn(0x7f84b00fc520 msgr2=0x7f84b0108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:14.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:14.063+0000 7f84b5645640 1 -- 172.21.15.170:0/3127670309 shutdown_connections 2024-09-04T16:34:14.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:14.063+0000 7f84b5645640 1 -- 172.21.15.170:0/3127670309 wait complete. 2024-09-04T16:34:14.772 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-04T16:34:14.772 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi170.front.sepia.ceph.com 2024-09-04T16:34:14.773 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-04T16:34:15.042 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:34:15.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:15 smithi170 ceph-mon[29272]: from='client.14948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:15.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:15 smithi170 ceph-mon[29272]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:34:15.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:15 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:15.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:15 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:34:15.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:15 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:34:15.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:15 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:34:15.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:15 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:15.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:15 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:34:15.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:15 smithi170 ceph-mon[29272]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:34:15.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:15 smithi170 ceph-mon[29272]: pgmap v101: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:15.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:15 smithi193 ceph-mon[36288]: from='client.14948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:15.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:15 smithi193 ceph-mon[36288]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:34:15.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:15 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:15.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:15 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:34:15.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:15 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:34:15.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:15 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:34:15.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:15 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:15.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:15 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:34:15.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:15 smithi193 ceph-mon[36288]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f9fcca5273b6971f640393d33a94730179073754 2024-09-04T16:34:15.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:15 smithi193 ceph-mon[36288]: pgmap v101: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:15.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.642+0000 7f9450a19640 1 -- 172.21.15.170:0/191309161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f944c1008d0 msgr2=0x7f944c100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:15.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.642+0000 7f9450a19640 1 --2- 172.21.15.170:0/191309161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f944c1008d0 0x7f944c100cb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f943c009880 tx=0x7f943c02a530 comp rx=0 tx=0).stop 2024-09-04T16:34:15.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.642+0000 7f9450a19640 1 -- 172.21.15.170:0/191309161 shutdown_connections 2024-09-04T16:34:15.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.642+0000 7f9450a19640 1 --2- 172.21.15.170:0/191309161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f944c1011f0 0x7f944c1056c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:15.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.642+0000 7f9450a19640 1 --2- 172.21.15.170:0/191309161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f944c1008d0 0x7f944c100cb0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:15.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.642+0000 7f9450a19640 1 -- 172.21.15.170:0/191309161 >> 172.21.15.170:0/191309161 conn(0x7f944c0fc520 msgr2=0x7f944c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:15.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.642+0000 7f9450a19640 1 -- 172.21.15.170:0/191309161 shutdown_connections 2024-09-04T16:34:15.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.642+0000 7f9450a19640 1 -- 172.21.15.170:0/191309161 wait complete. 2024-09-04T16:34:15.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.643+0000 7f9450a19640 1 Processor -- start 2024-09-04T16:34:15.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.643+0000 7f9450a19640 1 -- start start 2024-09-04T16:34:15.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.643+0000 7f9450a19640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f944c1008d0 0x7f944c19dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:15.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.643+0000 7f9450a19640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f944c1011f0 0x7f944c19e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:15.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.643+0000 7f9450a19640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f944c1153f0 con 0x7f944c1011f0 2024-09-04T16:34:15.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.643+0000 7f9450a19640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f944c115270 con 0x7f944c1008d0 2024-09-04T16:34:15.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.643+0000 7f9443fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f944c1011f0 0x7f944c19e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:15.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.643+0000 7f9443fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f944c1011f0 0x7f944c19e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33850/0 (socket says 172.21.15.170:33850) 2024-09-04T16:34:15.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.643+0000 7f9443fff640 1 -- 172.21.15.170:0/283629827 learned_addr learned my addr 172.21.15.170:0/283629827 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:15.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.644+0000 7f944a59c640 1 --2- 172.21.15.170:0/283629827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f944c1008d0 0x7f944c19dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:15.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.644+0000 7f9443fff640 1 -- 172.21.15.170:0/283629827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f944c1008d0 msgr2=0x7f944c19dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:15.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.644+0000 7f9443fff640 1 --2- 172.21.15.170:0/283629827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f944c1008d0 0x7f944c19dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:15.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.644+0000 7f9443fff640 1 -- 172.21.15.170:0/283629827 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c1a28a0 con 0x7f944c1011f0 2024-09-04T16:34:15.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.644+0000 7f9443fff640 1 --2- 172.21.15.170:0/283629827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f944c1011f0 0x7f944c19e510 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f943400c8c0 tx=0x7f943400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:15.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.644+0000 7f94437fe640 1 -- 172.21.15.170:0/283629827 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9434004020 con 0x7f944c1011f0 2024-09-04T16:34:15.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.644+0000 7f9450a19640 1 -- 172.21.15.170:0/283629827 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f944c1a2b90 con 0x7f944c1011f0 2024-09-04T16:34:15.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.644+0000 7f94437fe640 1 -- 172.21.15.170:0/283629827 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94340041c0 con 0x7f944c1011f0 2024-09-04T16:34:15.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.644+0000 7f94437fe640 1 -- 172.21.15.170:0/283629827 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94340047a0 con 0x7f944c1011f0 2024-09-04T16:34:15.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.644+0000 7f9450a19640 1 -- 172.21.15.170:0/283629827 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944c1a3120 con 0x7f944c1011f0 2024-09-04T16:34:15.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.645+0000 7f9450a19640 1 -- 172.21.15.170:0/283629827 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f944c06abe0 con 0x7f944c1011f0 2024-09-04T16:34:15.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.646+0000 7f94437fe640 1 -- 172.21.15.170:0/283629827 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f94340079b0 con 0x7f944c1011f0 2024-09-04T16:34:15.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.646+0000 7f94437fe640 1 --2- 172.21.15.170:0/283629827 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9438079e30 0x7f943807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:15.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.646+0000 7f94437fe640 1 -- 172.21.15.170:0/283629827 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f943409c920 con 0x7f944c1011f0 2024-09-04T16:34:15.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.646+0000 7f944a59c640 1 --2- 172.21.15.170:0/283629827 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9438079e30 0x7f943807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:15.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.647+0000 7f944a59c640 1 --2- 172.21.15.170:0/283629827 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9438079e30 0x7f943807c2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f943c031460 tx=0x7f943c009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:15.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.651+0000 7f94437fe640 1 -- 172.21.15.170:0/283629827 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f9434014030 con 0x7f944c1011f0 2024-09-04T16:34:15.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.845+0000 7f9450a19640 1 -- 172.21.15.170:0/283629827 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f944c1a3430 con 0x7f9438079e30 2024-09-04T16:34:15.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.846+0000 7f94437fe640 1 -- 172.21.15.170:0/283629827 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f944c1a3430 con 0x7f9438079e30 2024-09-04T16:34:15.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.848+0000 7f9450a19640 1 -- 172.21.15.170:0/283629827 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9438079e30 msgr2=0x7f943807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:15.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.848+0000 7f9450a19640 1 --2- 172.21.15.170:0/283629827 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9438079e30 0x7f943807c2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f943c031460 tx=0x7f943c009560 comp rx=0 tx=0).stop 2024-09-04T16:34:15.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.848+0000 7f9450a19640 1 -- 172.21.15.170:0/283629827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f944c1011f0 msgr2=0x7f944c19e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:15.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.848+0000 7f9450a19640 1 --2- 172.21.15.170:0/283629827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f944c1011f0 0x7f944c19e510 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f943400c8c0 tx=0x7f943400cd80 comp rx=0 tx=0).stop 2024-09-04T16:34:15.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.848+0000 7f9450a19640 1 -- 172.21.15.170:0/283629827 shutdown_connections 2024-09-04T16:34:15.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.848+0000 7f9450a19640 1 --2- 172.21.15.170:0/283629827 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9438079e30 0x7f943807c2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:15.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.848+0000 7f9450a19640 1 --2- 172.21.15.170:0/283629827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f944c1011f0 0x7f944c19e510 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:15.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.848+0000 7f9450a19640 1 --2- 172.21.15.170:0/283629827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f944c1008d0 0x7f944c19dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:15.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.848+0000 7f9450a19640 1 -- 172.21.15.170:0/283629827 >> 172.21.15.170:0/283629827 conn(0x7f944c0fc520 msgr2=0x7f944c112bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:15.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.848+0000 7f9450a19640 1 -- 172.21.15.170:0/283629827 shutdown_connections 2024-09-04T16:34:15.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.848+0000 7f9450a19640 1 -- 172.21.15.170:0/283629827 wait complete. 2024-09-04T16:34:15.858 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:34:15.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.936+0000 7fc78c08d640 1 -- 172.21.15.170:0/3971686700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc784100820 msgr2=0x7fc784100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:15.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.936+0000 7fc78c08d640 1 --2- 172.21.15.170:0/3971686700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc784100820 0x7fc784100c80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc774009880 tx=0x7fc77402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:34:15.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.936+0000 7fc78c08d640 1 -- 172.21.15.170:0/3971686700 shutdown_connections 2024-09-04T16:34:15.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.936+0000 7fc78c08d640 1 --2- 172.21.15.170:0/3971686700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc784100820 0x7fc784100c80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:15.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.936+0000 7fc78c08d640 1 --2- 172.21.15.170:0/3971686700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc784106820 0x7fc784106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:15.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.936+0000 7fc78c08d640 1 -- 172.21.15.170:0/3971686700 >> 172.21.15.170:0/3971686700 conn(0x7fc7840fc520 msgr2=0x7fc7840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:15.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.936+0000 7fc78c08d640 1 -- 172.21.15.170:0/3971686700 shutdown_connections 2024-09-04T16:34:15.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.936+0000 7fc78c08d640 1 -- 172.21.15.170:0/3971686700 wait complete. 2024-09-04T16:34:15.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.937+0000 7fc78c08d640 1 Processor -- start 2024-09-04T16:34:15.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.937+0000 7fc78c08d640 1 -- start start 2024-09-04T16:34:15.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.937+0000 7fc78c08d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc784100820 0x7fc7840fcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:15.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.937+0000 7fc78c08d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc784106820 0x7fc7840fd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:15.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.937+0000 7fc78c08d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc78410dcd0 con 0x7fc784106820 2024-09-04T16:34:15.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.937+0000 7fc78c08d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc78410db50 con 0x7fc784100820 2024-09-04T16:34:15.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.937+0000 7fc789628640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc784106820 0x7fc7840fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:15.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.937+0000 7fc789628640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc784106820 0x7fc7840fd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33870/0 (socket says 172.21.15.170:33870) 2024-09-04T16:34:15.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.937+0000 7fc789628640 1 -- 172.21.15.170:0/1216304037 learned_addr learned my addr 172.21.15.170:0/1216304037 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:15.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.937+0000 7fc789e29640 1 --2- 172.21.15.170:0/1216304037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc784100820 0x7fc7840fcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:15.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.937+0000 7fc789628640 1 -- 172.21.15.170:0/1216304037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc784100820 msgr2=0x7fc7840fcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:15.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.937+0000 7fc789628640 1 --2- 172.21.15.170:0/1216304037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc784100820 0x7fc7840fcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:15.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.937+0000 7fc789628640 1 -- 172.21.15.170:0/1216304037 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7840fd640 con 0x7fc784106820 2024-09-04T16:34:15.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.937+0000 7fc789628640 1 --2- 172.21.15.170:0/1216304037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc784106820 0x7fc7840fd100 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc774031460 tx=0x7fc7740045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:15.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.938+0000 7fc77affd640 1 -- 172.21.15.170:0/1216304037 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc77403f070 con 0x7fc784106820 2024-09-04T16:34:15.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.938+0000 7fc77affd640 1 -- 172.21.15.170:0/1216304037 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc7740035f0 con 0x7fc784106820 2024-09-04T16:34:15.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.938+0000 7fc78c08d640 1 -- 172.21.15.170:0/1216304037 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7840fd8d0 con 0x7fc784106820 2024-09-04T16:34:15.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.938+0000 7fc77affd640 1 -- 172.21.15.170:0/1216304037 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc774035030 con 0x7fc784106820 2024-09-04T16:34:15.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.938+0000 7fc78c08d640 1 -- 172.21.15.170:0/1216304037 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7841a3db0 con 0x7fc784106820 2024-09-04T16:34:15.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.939+0000 7fc78c08d640 1 -- 172.21.15.170:0/1216304037 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc784101f60 con 0x7fc784106820 2024-09-04T16:34:15.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.939+0000 7fc77affd640 1 -- 172.21.15.170:0/1216304037 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fc774042070 con 0x7fc784106820 2024-09-04T16:34:15.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.940+0000 7fc77affd640 1 --2- 172.21.15.170:0/1216304037 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc770079e30 0x7fc77007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:15.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.940+0000 7fc77affd640 1 -- 172.21.15.170:0/1216304037 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fc7740bd300 con 0x7fc784106820 2024-09-04T16:34:15.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.940+0000 7fc789e29640 1 --2- 172.21.15.170:0/1216304037 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc770079e30 0x7fc77007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:15.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.941+0000 7fc789e29640 1 --2- 172.21.15.170:0/1216304037 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc770079e30 0x7fc77007c2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc78000bbe0 tx=0x7fc78000b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:15.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:15.944+0000 7fc77affd640 1 -- 172.21.15.170:0/1216304037 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7fc774088f30 con 0x7fc784106820 2024-09-04T16:34:16.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.147+0000 7fc78c08d640 1 -- 172.21.15.170:0/1216304037 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc784062630 con 0x7fc770079e30 2024-09-04T16:34:16.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.148+0000 7fc77affd640 1 -- 172.21.15.170:0/1216304037 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7fc784062630 con 0x7fc770079e30 2024-09-04T16:34:16.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.150+0000 7fc78c08d640 1 -- 172.21.15.170:0/1216304037 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc770079e30 msgr2=0x7fc77007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:16.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.150+0000 7fc78c08d640 1 --2- 172.21.15.170:0/1216304037 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc770079e30 0x7fc77007c2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc78000bbe0 tx=0x7fc78000b390 comp rx=0 tx=0).stop 2024-09-04T16:34:16.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.150+0000 7fc78c08d640 1 -- 172.21.15.170:0/1216304037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc784106820 msgr2=0x7fc7840fd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:16.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.150+0000 7fc78c08d640 1 --2- 172.21.15.170:0/1216304037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc784106820 0x7fc7840fd100 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc774031460 tx=0x7fc7740045e0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.150+0000 7fc78c08d640 1 -- 172.21.15.170:0/1216304037 shutdown_connections 2024-09-04T16:34:16.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.150+0000 7fc78c08d640 1 --2- 172.21.15.170:0/1216304037 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc770079e30 0x7fc77007c2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.150+0000 7fc78c08d640 1 --2- 172.21.15.170:0/1216304037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc784106820 0x7fc7840fd100 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.150+0000 7fc78c08d640 1 --2- 172.21.15.170:0/1216304037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc784100820 0x7fc7840fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.150+0000 7fc78c08d640 1 -- 172.21.15.170:0/1216304037 >> 172.21.15.170:0/1216304037 conn(0x7fc7840fc520 msgr2=0x7fc78406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:16.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.150+0000 7fc78c08d640 1 -- 172.21.15.170:0/1216304037 shutdown_connections 2024-09-04T16:34:16.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.150+0000 7fc78c08d640 1 -- 172.21.15.170:0/1216304037 wait complete. 2024-09-04T16:34:16.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.232+0000 7f27fa221640 1 -- 172.21.15.170:0/3814392459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27f4102b60 msgr2=0x7f27f4102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:16.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.232+0000 7f27fa221640 1 --2- 172.21.15.170:0/3814392459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27f4102b60 0x7f27f4102f40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009880 tx=0x7f27e402a530 comp rx=0 tx=0).stop 2024-09-04T16:34:16.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.232+0000 7f27fa221640 1 -- 172.21.15.170:0/3814392459 shutdown_connections 2024-09-04T16:34:16.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.232+0000 7f27fa221640 1 --2- 172.21.15.170:0/3814392459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27f4103480 0x7f27f410b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.232+0000 7f27fa221640 1 --2- 172.21.15.170:0/3814392459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27f4102b60 0x7f27f4102f40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.232+0000 7f27fa221640 1 -- 172.21.15.170:0/3814392459 >> 172.21.15.170:0/3814392459 conn(0x7f27f40fc520 msgr2=0x7f27f40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:16.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.232+0000 7f27fa221640 1 -- 172.21.15.170:0/3814392459 shutdown_connections 2024-09-04T16:34:16.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.232+0000 7f27fa221640 1 -- 172.21.15.170:0/3814392459 wait complete. 2024-09-04T16:34:16.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.233+0000 7f27fa221640 1 Processor -- start 2024-09-04T16:34:16.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.233+0000 7f27fa221640 1 -- start start 2024-09-04T16:34:16.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.233+0000 7f27fa221640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27f4102b60 0x7f27f41007c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:16.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.233+0000 7f27fa221640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27f4103480 0x7f27f4100d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:16.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.233+0000 7f27fa221640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f27f410edf0 con 0x7f27f4102b60 2024-09-04T16:34:16.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.233+0000 7f27fa221640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f27f410ec70 con 0x7f27f4103480 2024-09-04T16:34:16.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.233+0000 7f27f37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27f4102b60 0x7f27f41007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:16.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.233+0000 7f27f37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27f4102b60 0x7f27f41007c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33878/0 (socket says 172.21.15.170:33878) 2024-09-04T16:34:16.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.233+0000 7f27f37fe640 1 -- 172.21.15.170:0/2553227573 learned_addr learned my addr 172.21.15.170:0/2553227573 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:16.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.233+0000 7f27f2ffd640 1 --2- 172.21.15.170:0/2553227573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27f4103480 0x7f27f4100d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:16.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.234+0000 7f27f37fe640 1 -- 172.21.15.170:0/2553227573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27f4103480 msgr2=0x7f27f4100d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:16.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.234+0000 7f27f37fe640 1 --2- 172.21.15.170:0/2553227573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27f4103480 0x7f27f4100d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.234+0000 7f27f37fe640 1 -- 172.21.15.170:0/2553227573 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f4101240 con 0x7f27f4102b60 2024-09-04T16:34:16.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.234+0000 7f27f37fe640 1 --2- 172.21.15.170:0/2553227573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27f4102b60 0x7f27f41007c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f27e4004f90 tx=0x7f27e40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:16.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.234+0000 7f27f0ff9640 1 -- 172.21.15.170:0/2553227573 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f27e403f070 con 0x7f27f4102b60 2024-09-04T16:34:16.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.234+0000 7f27f0ff9640 1 -- 172.21.15.170:0/2553227573 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f27e4004cf0 con 0x7f27f4102b60 2024-09-04T16:34:16.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.234+0000 7f27fa221640 1 -- 172.21.15.170:0/2553227573 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f41014d0 con 0x7f27f4102b60 2024-09-04T16:34:16.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.234+0000 7f27f0ff9640 1 -- 172.21.15.170:0/2553227573 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f27e4035030 con 0x7f27f4102b60 2024-09-04T16:34:16.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.234+0000 7f27fa221640 1 -- 172.21.15.170:0/2553227573 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f41a3e10 con 0x7f27f4102b60 2024-09-04T16:34:16.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.235+0000 7f27fa221640 1 -- 172.21.15.170:0/2553227573 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27f406ab60 con 0x7f27f4102b60 2024-09-04T16:34:16.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.236+0000 7f27f0ff9640 1 -- 172.21.15.170:0/2553227573 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f27e4042070 con 0x7f27f4102b60 2024-09-04T16:34:16.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.236+0000 7f27f0ff9640 1 --2- 172.21.15.170:0/2553227573 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f27dc079e30 0x7f27dc07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:16.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.236+0000 7f27f0ff9640 1 -- 172.21.15.170:0/2553227573 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f27e40bd4b0 con 0x7f27f4102b60 2024-09-04T16:34:16.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.236+0000 7f27f2ffd640 1 --2- 172.21.15.170:0/2553227573 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f27dc079e30 0x7f27dc07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:16.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.237+0000 7f27f2ffd640 1 --2- 172.21.15.170:0/2553227573 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f27dc079e30 0x7f27dc07c2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f27e8005e10 tx=0x7f27e8005da0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:16.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.241+0000 7f27f0ff9640 1 -- 172.21.15.170:0/2553227573 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f27e4084f70 con 0x7f27f4102b60 2024-09-04T16:34:16.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.429+0000 7f27fa221640 1 -- 172.21.15.170:0/2553227573 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f27f4062630 con 0x7f27dc079e30 2024-09-04T16:34:16.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.438+0000 7f27f0ff9640 1 -- 172.21.15.170:0/2553227573 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f27f4062630 con 0x7f27dc079e30 2024-09-04T16:34:16.440 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:34:16.440 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (74s) 46s ago 12m 16.7M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:34:16.440 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (4m) 46s ago 12m 8820k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:34:16.440 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (3m) 117s ago 11m 8112k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:34:16.440 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (12m) 46s ago 12m 6891k - 19.1.1-252-g48920dab b708f9119ac7 aa2ec5c5776a 2024-09-04T16:34:16.440 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (11m) 117s ago 11m 6895k - 19.1.1-252-g48920dab b708f9119ac7 a24f0ce3b3fb 2024-09-04T16:34:16.440 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (53s) 46s ago 11m 50.1M - c8b91775d855 6e3778aab5e6 2024-09-04T16:34:16.440 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (6m) 46s ago 6m 27.1M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:34:16.440 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (6m) 46s ago 6m 147M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:34:16.440 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (6m) 117s ago 6m 15.5M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:34:16.440 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (6m) 117s ago 6m 14.9M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:34:16.440 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (3m) 46s ago 13m 521M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:34:16.441 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (2m) 117s ago 11m 454M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:34:16.441 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (13m) 46s ago 13m 60.3M 2048M 19.1.1-252-g48920dab b708f9119ac7 194ff39cc041 2024-09-04T16:34:16.441 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (11m) 117s ago 11m 49.7M 2048M 19.1.1-252-g48920dab b708f9119ac7 38c8e99ca323 2024-09-04T16:34:16.441 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (2m) 46s ago 12m 10.3M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:34:16.441 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (2m) 117s ago 11m 5246k - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:34:16.441 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (10m) 46s ago 10m 210M 1216M 19.1.1-252-g48920dab b708f9119ac7 6c2ea484615d 2024-09-04T16:34:16.441 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (9m) 46s ago 9m 227M 1216M 19.1.1-252-g48920dab b708f9119ac7 20469ba5727b 2024-09-04T16:34:16.441 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (9m) 46s ago 9m 181M 1216M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:34:16.441 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (8m) 117s ago 8m 245M 2240M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:34:16.441 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (8m) 117s ago 8m 209M 2240M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:34:16.441 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (7m) 117s ago 7m 189M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:34:16.441 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (96s) 46s ago 11m 44.9M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:34:16.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.441+0000 7f27fa221640 1 -- 172.21.15.170:0/2553227573 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f27dc079e30 msgr2=0x7f27dc07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:16.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.441+0000 7f27fa221640 1 --2- 172.21.15.170:0/2553227573 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f27dc079e30 0x7f27dc07c2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f27e8005e10 tx=0x7f27e8005da0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.441+0000 7f27fa221640 1 -- 172.21.15.170:0/2553227573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27f4102b60 msgr2=0x7f27f41007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:16.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.441+0000 7f27fa221640 1 --2- 172.21.15.170:0/2553227573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27f4102b60 0x7f27f41007c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f27e4004f90 tx=0x7f27e40048f0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.441+0000 7f27fa221640 1 -- 172.21.15.170:0/2553227573 shutdown_connections 2024-09-04T16:34:16.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.441+0000 7f27fa221640 1 --2- 172.21.15.170:0/2553227573 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f27dc079e30 0x7f27dc07c2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.441+0000 7f27fa221640 1 --2- 172.21.15.170:0/2553227573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27f4103480 0x7f27f4100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.441+0000 7f27fa221640 1 --2- 172.21.15.170:0/2553227573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27f4102b60 0x7f27f41007c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.441+0000 7f27fa221640 1 -- 172.21.15.170:0/2553227573 >> 172.21.15.170:0/2553227573 conn(0x7f27f40fc520 msgr2=0x7f27f4108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:16.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.441+0000 7f27fa221640 1 -- 172.21.15.170:0/2553227573 shutdown_connections 2024-09-04T16:34:16.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.441+0000 7f27fa221640 1 -- 172.21.15.170:0/2553227573 wait complete. 2024-09-04T16:34:16.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.524+0000 7f42e8e51640 1 -- 172.21.15.170:0/3392904677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42e41007e0 msgr2=0x7f42e4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:16.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.524+0000 7f42e8e51640 1 --2- 172.21.15.170:0/3392904677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42e41007e0 0x7f42e4100c40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f42d8009c20 tx=0x7f42d802a970 comp rx=0 tx=0).stop 2024-09-04T16:34:16.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.524+0000 7f42e8e51640 1 -- 172.21.15.170:0/3392904677 shutdown_connections 2024-09-04T16:34:16.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.524+0000 7f42e8e51640 1 --2- 172.21.15.170:0/3392904677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42e41007e0 0x7f42e4100c40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.524+0000 7f42e8e51640 1 --2- 172.21.15.170:0/3392904677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42e41067e0 0x7f42e4106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.524+0000 7f42e8e51640 1 -- 172.21.15.170:0/3392904677 >> 172.21.15.170:0/3392904677 conn(0x7f42e40fc4c0 msgr2=0x7f42e40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:16.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.524+0000 7f42e8e51640 1 -- 172.21.15.170:0/3392904677 shutdown_connections 2024-09-04T16:34:16.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.524+0000 7f42e8e51640 1 -- 172.21.15.170:0/3392904677 wait complete. 2024-09-04T16:34:16.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.524+0000 7f42e8e51640 1 Processor -- start 2024-09-04T16:34:16.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.525+0000 7f42e8e51640 1 -- start start 2024-09-04T16:34:16.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.525+0000 7f42e8e51640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42e41007e0 0x7f42e419d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:16.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.525+0000 7f42e8e51640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42e41067e0 0x7f42e419dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:16.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.525+0000 7f42e8e51640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f42e410dd10 con 0x7f42e41067e0 2024-09-04T16:34:16.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.525+0000 7f42e8e51640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42e410db90 con 0x7f42e41007e0 2024-09-04T16:34:16.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.525+0000 7f42e1d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42e41067e0 0x7f42e419dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:16.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.525+0000 7f42e1d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42e41067e0 0x7f42e419dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33898/0 (socket says 172.21.15.170:33898) 2024-09-04T16:34:16.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.525+0000 7f42e1d9b640 1 -- 172.21.15.170:0/756736494 learned_addr learned my addr 172.21.15.170:0/756736494 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:16.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.525+0000 7f42e259c640 1 --2- 172.21.15.170:0/756736494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42e41007e0 0x7f42e419d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:16.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.525+0000 7f42e1d9b640 1 -- 172.21.15.170:0/756736494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42e41007e0 msgr2=0x7f42e419d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:16.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.525+0000 7f42e1d9b640 1 --2- 172.21.15.170:0/756736494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42e41007e0 0x7f42e419d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.525+0000 7f42e1d9b640 1 -- 172.21.15.170:0/756736494 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e41978e0 con 0x7f42e41067e0 2024-09-04T16:34:16.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.525+0000 7f42e1d9b640 1 --2- 172.21.15.170:0/756736494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42e41067e0 0x7f42e419dc60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f42d8005cc0 tx=0x7f42d802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:16.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.526+0000 7f42d37fe640 1 -- 172.21.15.170:0/756736494 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42d8047070 con 0x7f42e41067e0 2024-09-04T16:34:16.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.526+0000 7f42e8e51640 1 -- 172.21.15.170:0/756736494 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e4197b70 con 0x7f42e41067e0 2024-09-04T16:34:16.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.526+0000 7f42d37fe640 1 -- 172.21.15.170:0/756736494 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42d802f7e0 con 0x7f42e41067e0 2024-09-04T16:34:16.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.526+0000 7f42d37fe640 1 -- 172.21.15.170:0/756736494 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42d8034070 con 0x7f42e41067e0 2024-09-04T16:34:16.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.526+0000 7f42e8e51640 1 -- 172.21.15.170:0/756736494 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e41980a0 con 0x7f42e41067e0 2024-09-04T16:34:16.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.527+0000 7f42e8e51640 1 -- 172.21.15.170:0/756736494 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e4101f20 con 0x7f42e41067e0 2024-09-04T16:34:16.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.527+0000 7f42d37fe640 1 -- 172.21.15.170:0/756736494 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f42d804a070 con 0x7f42e41067e0 2024-09-04T16:34:16.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.528+0000 7f42d37fe640 1 --2- 172.21.15.170:0/756736494 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42cc079e30 0x7f42cc07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:16.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.528+0000 7f42d37fe640 1 -- 172.21.15.170:0/756736494 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f42d80bd920 con 0x7f42e41067e0 2024-09-04T16:34:16.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.528+0000 7f42e259c640 1 --2- 172.21.15.170:0/756736494 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42cc079e30 0x7f42cc07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:16.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.528+0000 7f42e259c640 1 --2- 172.21.15.170:0/756736494 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42cc079e30 0x7f42cc07c2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f42e4198a20 tx=0x7f42dc008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:16.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.532+0000 7f42d37fe640 1 -- 172.21.15.170:0/756736494 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f42d803f070 con 0x7f42e41067e0 2024-09-04T16:34:16.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.788+0000 7f42e8e51640 1 -- 172.21.15.170:0/756736494 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f42e4198e10 con 0x7f42e41067e0 2024-09-04T16:34:16.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.788+0000 7f42d37fe640 1 -- 172.21.15.170:0/756736494 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f42d80853e0 con 0x7f42e41067e0 2024-09-04T16:34:16.789 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:34:16.789 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:34:16.789 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 2 2024-09-04T16:34:16.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:34:16.790 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:34:16.790 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:34:16.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:34:16.790 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:34:16.790 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 6 2024-09-04T16:34:16.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:34:16.790 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:34:16.790 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:34:16.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:34:16.790 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:34:16.790 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 12, 2024-09-04T16:34:16.790 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:34:16.790 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:34:16.790 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:34:16.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.791+0000 7f42e8e51640 1 -- 172.21.15.170:0/756736494 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42cc079e30 msgr2=0x7f42cc07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:16.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.791+0000 7f42e8e51640 1 --2- 172.21.15.170:0/756736494 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42cc079e30 0x7f42cc07c2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f42e4198a20 tx=0x7f42dc008040 comp rx=0 tx=0).stop 2024-09-04T16:34:16.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.791+0000 7f42e8e51640 1 -- 172.21.15.170:0/756736494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42e41067e0 msgr2=0x7f42e419dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:16.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.791+0000 7f42e8e51640 1 --2- 172.21.15.170:0/756736494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42e41067e0 0x7f42e419dc60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f42d8005cc0 tx=0x7f42d802f5f0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.791+0000 7f42e8e51640 1 -- 172.21.15.170:0/756736494 shutdown_connections 2024-09-04T16:34:16.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.791+0000 7f42e8e51640 1 --2- 172.21.15.170:0/756736494 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42cc079e30 0x7f42cc07c2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.791+0000 7f42e8e51640 1 --2- 172.21.15.170:0/756736494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42e41067e0 0x7f42e419dc60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.791+0000 7f42e8e51640 1 --2- 172.21.15.170:0/756736494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42e41007e0 0x7f42e419d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.791+0000 7f42e8e51640 1 -- 172.21.15.170:0/756736494 >> 172.21.15.170:0/756736494 conn(0x7f42e40fc4c0 msgr2=0x7f42e4069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:16.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.791+0000 7f42e8e51640 1 -- 172.21.15.170:0/756736494 shutdown_connections 2024-09-04T16:34:16.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.791+0000 7f42e8e51640 1 -- 172.21.15.170:0/756736494 wait complete. 2024-09-04T16:34:16.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.880+0000 7f03a7f99640 1 -- 172.21.15.170:0/1478854282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a0107910 msgr2=0x7f03a0107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:16.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.880+0000 7f03a7f99640 1 --2- 172.21.15.170:0/1478854282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a0107910 0x7f03a0107cf0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f039c009880 tx=0x7f039c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.880+0000 7f03a7f99640 1 -- 172.21.15.170:0/1478854282 shutdown_connections 2024-09-04T16:34:16.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.880+0000 7f03a7f99640 1 --2- 172.21.15.170:0/1478854282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03a0101910 0x7f03a0101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.880+0000 7f03a7f99640 1 --2- 172.21.15.170:0/1478854282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a0107910 0x7f03a0107cf0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.880+0000 7f03a7f99640 1 -- 172.21.15.170:0/1478854282 >> 172.21.15.170:0/1478854282 conn(0x7f03a00fd5f0 msgr2=0x7f03a00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:16.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.880+0000 7f03a7f99640 1 -- 172.21.15.170:0/1478854282 shutdown_connections 2024-09-04T16:34:16.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.880+0000 7f03a7f99640 1 -- 172.21.15.170:0/1478854282 wait complete. 2024-09-04T16:34:16.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.880+0000 7f03a7f99640 1 Processor -- start 2024-09-04T16:34:16.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.881+0000 7f03a7f99640 1 -- start start 2024-09-04T16:34:16.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.881+0000 7f03a7f99640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a0101910 0x7f03a019d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:16.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.881+0000 7f03a7f99640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03a0107910 0x7f03a019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:16.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.881+0000 7f03a7f99640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f03a010edc0 con 0x7f03a0101910 2024-09-04T16:34:16.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.881+0000 7f03a7f99640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f03a010ec40 con 0x7f03a0107910 2024-09-04T16:34:16.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.881+0000 7f03a5d35640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a0101910 0x7f03a019d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:16.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.881+0000 7f03a5d35640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a0101910 0x7f03a019d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33922/0 (socket says 172.21.15.170:33922) 2024-09-04T16:34:16.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.881+0000 7f03a5d35640 1 -- 172.21.15.170:0/1495684996 learned_addr learned my addr 172.21.15.170:0/1495684996 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:16.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.881+0000 7f03a5534640 1 --2- 172.21.15.170:0/1495684996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03a0107910 0x7f03a019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:16.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.881+0000 7f03a5d35640 1 -- 172.21.15.170:0/1495684996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03a0107910 msgr2=0x7f03a019db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:16.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.881+0000 7f03a5d35640 1 --2- 172.21.15.170:0/1495684996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03a0107910 0x7f03a019db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:16.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.881+0000 7f03a5d35640 1 -- 172.21.15.170:0/1495684996 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a0197780 con 0x7f03a0101910 2024-09-04T16:34:16.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.881+0000 7f03a5d35640 1 --2- 172.21.15.170:0/1495684996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a0101910 0x7f03a019d600 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f039c031460 tx=0x7f039c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:16.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.882+0000 7f0396ffd640 1 -- 172.21.15.170:0/1495684996 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f039c03f070 con 0x7f03a0101910 2024-09-04T16:34:16.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.882+0000 7f03a7f99640 1 -- 172.21.15.170:0/1495684996 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a0197a10 con 0x7f03a0101910 2024-09-04T16:34:16.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.882+0000 7f0396ffd640 1 -- 172.21.15.170:0/1495684996 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f039c0035f0 con 0x7f03a0101910 2024-09-04T16:34:16.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.882+0000 7f0396ffd640 1 -- 172.21.15.170:0/1495684996 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f039c035030 con 0x7f03a0101910 2024-09-04T16:34:16.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.882+0000 7f03a7f99640 1 -- 172.21.15.170:0/1495684996 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a0197f40 con 0x7f03a0101910 2024-09-04T16:34:16.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.883+0000 7f03a7f99640 1 -- 172.21.15.170:0/1495684996 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a0103050 con 0x7f03a0101910 2024-09-04T16:34:16.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.883+0000 7f0396ffd640 1 -- 172.21.15.170:0/1495684996 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f039c042070 con 0x7f03a0101910 2024-09-04T16:34:16.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.884+0000 7f0396ffd640 1 --2- 172.21.15.170:0/1495684996 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f038c079e80 0x7f038c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:16.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.884+0000 7f03a5534640 1 --2- 172.21.15.170:0/1495684996 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f038c079e80 0x7f038c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:16.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.884+0000 7f0396ffd640 1 -- 172.21.15.170:0/1495684996 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f039c0bd3a0 con 0x7f03a0101910 2024-09-04T16:34:16.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.885+0000 7f03a5534640 1 --2- 172.21.15.170:0/1495684996 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f038c079e80 0x7f038c07c340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0390005fd0 tx=0x7f0390005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:16.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:16.889+0000 7f0396ffd640 1 -- 172.21.15.170:0/1495684996 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f039c084e40 con 0x7f03a0101910 2024-09-04T16:34:17.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.112+0000 7f03a7f99640 1 -- 172.21.15.170:0/1495684996 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f03a0104b20 con 0x7f03a0101910 2024-09-04T16:34:17.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.112+0000 7f0396ffd640 1 -- 172.21.15.170:0/1495684996 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2036 (secure 0 0 0) 0x7f039c088fb0 con 0x7f03a0101910 2024-09-04T16:34:17.114 INFO:teuthology.orchestra.run.smithi170.stdout:e15 2024-09-04T16:34:17.114 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:27:39:151187+0000 2024-09-04T16:34:17.114 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:34:17.114 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:34:17.114 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:34:17.114 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:34:17.115 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:34:17.115 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:34:17.115 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 15 2024-09-04T16:34:17.115 INFO:teuthology.orchestra.run.smithi170.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-04T16:34:17.115 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:34:17.115 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:27:39.151182+0000 2024-09-04T16:34:17.115 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:34:17.115 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:34:17.115 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:34:17.115 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:34:17.115 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:34:17.115 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:34:17.115 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:34:17.115 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:34:17.116 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 45 2024-09-04T16:34:17.116 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:34:17.116 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:34:17.116 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:34:17.116 INFO:teuthology.orchestra.run.smithi170.stdout:up {0=14562,1=14578} 2024-09-04T16:34:17.116 INFO:teuthology.orchestra.run.smithi170.stdout:failed 2024-09-04T16:34:17.116 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:34:17.116 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:34:17.116 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:34:17.116 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:34:17.116 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:34:17.116 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:34:17.116 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:34:17.116 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:34:17.117 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 14562 members: 14562,14578 2024-09-04T16:34:17.117 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{0:14562} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:34:17.117 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{1:14578} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:34:17.117 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:34:17.117 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:34:17.117 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:34:17.117 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:34:17.117 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:24315} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.193:6826/288890560,v1:172.21.15.193:6827/288890560] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:34:17.117 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:24319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1128257367,v1:172.21.15.193:6825/1128257367] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:34:17.118 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 15 2024-09-04T16:34:17.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.115+0000 7f03a7f99640 1 -- 172.21.15.170:0/1495684996 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f038c079e80 msgr2=0x7f038c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:17.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.115+0000 7f03a7f99640 1 --2- 172.21.15.170:0/1495684996 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f038c079e80 0x7f038c07c340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0390005fd0 tx=0x7f0390005850 comp rx=0 tx=0).stop 2024-09-04T16:34:17.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.115+0000 7f03a7f99640 1 -- 172.21.15.170:0/1495684996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a0101910 msgr2=0x7f03a019d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:17.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.115+0000 7f03a7f99640 1 --2- 172.21.15.170:0/1495684996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a0101910 0x7f03a019d600 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f039c031460 tx=0x7f039c0045e0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.115+0000 7f03a7f99640 1 -- 172.21.15.170:0/1495684996 shutdown_connections 2024-09-04T16:34:17.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.115+0000 7f03a7f99640 1 --2- 172.21.15.170:0/1495684996 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f038c079e80 0x7f038c07c340 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.115+0000 7f03a7f99640 1 --2- 172.21.15.170:0/1495684996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03a0107910 0x7f03a019db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.115+0000 7f03a7f99640 1 --2- 172.21.15.170:0/1495684996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03a0101910 0x7f03a019d600 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.115+0000 7f03a7f99640 1 -- 172.21.15.170:0/1495684996 >> 172.21.15.170:0/1495684996 conn(0x7f03a00fd5f0 msgr2=0x7f03a00feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:17.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.115+0000 7f03a7f99640 1 -- 172.21.15.170:0/1495684996 shutdown_connections 2024-09-04T16:34:17.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.115+0000 7f03a7f99640 1 -- 172.21.15.170:0/1495684996 wait complete. 2024-09-04T16:34:17.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.198+0000 7efd17a67640 1 -- 172.21.15.170:0/263586688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd101018f0 msgr2=0x7efd10101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:17.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.198+0000 7efd17a67640 1 --2- 172.21.15.170:0/263586688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd101018f0 0x7efd10101d50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7efd00009880 tx=0x7efd0002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.198+0000 7efd17a67640 1 -- 172.21.15.170:0/263586688 shutdown_connections 2024-09-04T16:34:17.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.198+0000 7efd17a67640 1 --2- 172.21.15.170:0/263586688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd101018f0 0x7efd10101d50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.198+0000 7efd17a67640 1 --2- 172.21.15.170:0/263586688 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd101078f0 0x7efd10107cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.198+0000 7efd17a67640 1 -- 172.21.15.170:0/263586688 >> 172.21.15.170:0/263586688 conn(0x7efd100fd630 msgr2=0x7efd100ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:17.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.198+0000 7efd17a67640 1 -- 172.21.15.170:0/263586688 shutdown_connections 2024-09-04T16:34:17.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.198+0000 7efd17a67640 1 -- 172.21.15.170:0/263586688 wait complete. 2024-09-04T16:34:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.199+0000 7efd17a67640 1 Processor -- start 2024-09-04T16:34:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.199+0000 7efd17a67640 1 -- start start 2024-09-04T16:34:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.199+0000 7efd17a67640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd101018f0 0x7efd1019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.199+0000 7efd17a67640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd101078f0 0x7efd1019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.199+0000 7efd17a67640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efd1010edc0 con 0x7efd101018f0 2024-09-04T16:34:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.199+0000 7efd17a67640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efd1010ec40 con 0x7efd101078f0 2024-09-04T16:34:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.199+0000 7efd15803640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd101018f0 0x7efd1019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.199+0000 7efd15803640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd101018f0 0x7efd1019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33944/0 (socket says 172.21.15.170:33944) 2024-09-04T16:34:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.199+0000 7efd15803640 1 -- 172.21.15.170:0/3199090307 learned_addr learned my addr 172.21.15.170:0/3199090307 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.199+0000 7efd15002640 1 --2- 172.21.15.170:0/3199090307 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd101078f0 0x7efd1019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.199+0000 7efd15803640 1 -- 172.21.15.170:0/3199090307 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd101078f0 msgr2=0x7efd1019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.199+0000 7efd15803640 1 --2- 172.21.15.170:0/3199090307 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd101078f0 0x7efd1019db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.199+0000 7efd15803640 1 -- 172.21.15.170:0/3199090307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd101977b0 con 0x7efd101018f0 2024-09-04T16:34:17.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.200+0000 7efd15803640 1 --2- 172.21.15.170:0/3199090307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd101018f0 0x7efd1019d630 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00d6f0 tx=0x7efd0c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:17.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.200+0000 7efd06ffd640 1 -- 172.21.15.170:0/3199090307 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd0c017070 con 0x7efd101018f0 2024-09-04T16:34:17.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.200+0000 7efd06ffd640 1 -- 172.21.15.170:0/3199090307 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efd0c00de00 con 0x7efd101018f0 2024-09-04T16:34:17.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.200+0000 7efd17a67640 1 -- 172.21.15.170:0/3199090307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd10197aa0 con 0x7efd101018f0 2024-09-04T16:34:17.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.200+0000 7efd06ffd640 1 -- 172.21.15.170:0/3199090307 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd0c004bb0 con 0x7efd101018f0 2024-09-04T16:34:17.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.200+0000 7efd17a67640 1 -- 172.21.15.170:0/3199090307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd10198000 con 0x7efd101018f0 2024-09-04T16:34:17.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.201+0000 7efd17a67640 1 -- 172.21.15.170:0/3199090307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd10103030 con 0x7efd101018f0 2024-09-04T16:34:17.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.202+0000 7efd06ffd640 1 -- 172.21.15.170:0/3199090307 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7efd0c009a30 con 0x7efd101018f0 2024-09-04T16:34:17.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.202+0000 7efd06ffd640 1 --2- 172.21.15.170:0/3199090307 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efcfc079e90 0x7efcfc07c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:17.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.202+0000 7efd06ffd640 1 -- 172.21.15.170:0/3199090307 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7efd0c09c4b0 con 0x7efd101018f0 2024-09-04T16:34:17.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.202+0000 7efd15002640 1 --2- 172.21.15.170:0/3199090307 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efcfc079e90 0x7efcfc07c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:17.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.203+0000 7efd15002640 1 --2- 172.21.15.170:0/3199090307 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efcfc079e90 0x7efcfc07c350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd10198b00 tx=0x7efd00031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:17.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.207+0000 7efd06ffd640 1 -- 172.21.15.170:0/3199090307 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7efd0c068160 con 0x7efd101018f0 2024-09-04T16:34:17.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.408+0000 7efd17a67640 1 -- 172.21.15.170:0/3199090307 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efd101982b0 con 0x7efcfc079e90 2024-09-04T16:34:17.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.410+0000 7efd06ffd640 1 -- 172.21.15.170:0/3199090307 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7efd101982b0 con 0x7efcfc079e90 2024-09-04T16:34:17.410 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:34:17.410 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:34:17.410 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:34:17.410 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:34:17.410 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:34:17.411 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-04T16:34:17.411 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:34:17.411 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "2/23 daemons upgraded", 2024-09-04T16:34:17.411 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mon daemons", 2024-09-04T16:34:17.411 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:34:17.411 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:34:17.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.412+0000 7efd17a67640 1 -- 172.21.15.170:0/3199090307 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efcfc079e90 msgr2=0x7efcfc07c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:17.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.412+0000 7efd17a67640 1 --2- 172.21.15.170:0/3199090307 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efcfc079e90 0x7efcfc07c350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd10198b00 tx=0x7efd00031400 comp rx=0 tx=0).stop 2024-09-04T16:34:17.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.412+0000 7efd17a67640 1 -- 172.21.15.170:0/3199090307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd101018f0 msgr2=0x7efd1019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:17.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.412+0000 7efd17a67640 1 --2- 172.21.15.170:0/3199090307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd101018f0 0x7efd1019d630 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00d6f0 tx=0x7efd0c00dbb0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.412+0000 7efd17a67640 1 -- 172.21.15.170:0/3199090307 shutdown_connections 2024-09-04T16:34:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.412+0000 7efd17a67640 1 --2- 172.21.15.170:0/3199090307 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efcfc079e90 0x7efcfc07c350 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.412+0000 7efd17a67640 1 --2- 172.21.15.170:0/3199090307 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd101078f0 0x7efd1019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.412+0000 7efd17a67640 1 --2- 172.21.15.170:0/3199090307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd101018f0 0x7efd1019d630 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.412+0000 7efd17a67640 1 -- 172.21.15.170:0/3199090307 >> 172.21.15.170:0/3199090307 conn(0x7efd100fd630 msgr2=0x7efd100fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.412+0000 7efd17a67640 1 -- 172.21.15.170:0/3199090307 shutdown_connections 2024-09-04T16:34:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.412+0000 7efd17a67640 1 -- 172.21.15.170:0/3199090307 wait complete. 2024-09-04T16:34:17.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.496+0000 7f2a414b8640 1 -- 172.21.15.170:0/1448626037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a3c102aa0 msgr2=0x7f2a3c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:17.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.496+0000 7f2a414b8640 1 --2- 172.21.15.170:0/1448626037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a3c102aa0 0x7f2a3c102e80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009880 tx=0x7f2a2c02a530 comp rx=0 tx=0).stop 2024-09-04T16:34:17.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.496+0000 7f2a414b8640 1 -- 172.21.15.170:0/1448626037 shutdown_connections 2024-09-04T16:34:17.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.496+0000 7f2a414b8640 1 --2- 172.21.15.170:0/1448626037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a3c1033c0 0x7f2a3c10b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.496+0000 7f2a414b8640 1 --2- 172.21.15.170:0/1448626037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a3c102aa0 0x7f2a3c102e80 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.496+0000 7f2a414b8640 1 -- 172.21.15.170:0/1448626037 >> 172.21.15.170:0/1448626037 conn(0x7f2a3c0fc4c0 msgr2=0x7f2a3c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:17.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.496+0000 7f2a414b8640 1 -- 172.21.15.170:0/1448626037 shutdown_connections 2024-09-04T16:34:17.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.496+0000 7f2a414b8640 1 -- 172.21.15.170:0/1448626037 wait complete. 2024-09-04T16:34:17.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.497+0000 7f2a414b8640 1 Processor -- start 2024-09-04T16:34:17.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.497+0000 7f2a414b8640 1 -- start start 2024-09-04T16:34:17.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.497+0000 7f2a414b8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a3c102aa0 0x7f2a3c19d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:17.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.497+0000 7f2a414b8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a3c1033c0 0x7f2a3c19dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:17.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.497+0000 7f2a414b8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c10edd0 con 0x7f2a3c102aa0 2024-09-04T16:34:17.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.497+0000 7f2a414b8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c10ec50 con 0x7f2a3c1033c0 2024-09-04T16:34:17.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.497+0000 7f2a3affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a3c102aa0 0x7f2a3c19d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:17.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.497+0000 7f2a3affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a3c102aa0 0x7f2a3c19d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33964/0 (socket says 172.21.15.170:33964) 2024-09-04T16:34:17.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.497+0000 7f2a3affd640 1 -- 172.21.15.170:0/3970750130 learned_addr learned my addr 172.21.15.170:0/3970750130 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:17.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.497+0000 7f2a3a7fc640 1 --2- 172.21.15.170:0/3970750130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a3c1033c0 0x7f2a3c19dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:17.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.498+0000 7f2a3affd640 1 -- 172.21.15.170:0/3970750130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a3c1033c0 msgr2=0x7f2a3c19dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:17.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.498+0000 7f2a3affd640 1 --2- 172.21.15.170:0/3970750130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a3c1033c0 0x7f2a3c19dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.498+0000 7f2a3affd640 1 -- 172.21.15.170:0/3970750130 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3c197900 con 0x7f2a3c102aa0 2024-09-04T16:34:17.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.498+0000 7f2a3affd640 1 --2- 172.21.15.170:0/3970750130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a3c102aa0 0x7f2a3c19d740 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c031460 tx=0x7f2a2c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:17.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.498+0000 7f2a23fff640 1 -- 172.21.15.170:0/3970750130 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a2c03f070 con 0x7f2a3c102aa0 2024-09-04T16:34:17.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.498+0000 7f2a414b8640 1 -- 172.21.15.170:0/3970750130 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a3c197b90 con 0x7f2a3c102aa0 2024-09-04T16:34:17.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.498+0000 7f2a414b8640 1 -- 172.21.15.170:0/3970750130 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a3c1980c0 con 0x7f2a3c102aa0 2024-09-04T16:34:17.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.498+0000 7f2a23fff640 1 -- 172.21.15.170:0/3970750130 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a2c0054e0 con 0x7f2a3c102aa0 2024-09-04T16:34:17.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.498+0000 7f2a23fff640 1 -- 172.21.15.170:0/3970750130 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a2c049060 con 0x7f2a3c102aa0 2024-09-04T16:34:17.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.499+0000 7f2a414b8640 1 -- 172.21.15.170:0/3970750130 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a28005290 con 0x7f2a3c102aa0 2024-09-04T16:34:17.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.500+0000 7f2a23fff640 1 -- 172.21.15.170:0/3970750130 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f2a2c042070 con 0x7f2a3c102aa0 2024-09-04T16:34:17.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.500+0000 7f2a23fff640 1 --2- 172.21.15.170:0/3970750130 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a24079e30 0x7f2a2407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:17.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.500+0000 7f2a23fff640 1 -- 172.21.15.170:0/3970750130 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f2a2c0bd150 con 0x7f2a3c102aa0 2024-09-04T16:34:17.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.500+0000 7f2a3a7fc640 1 --2- 172.21.15.170:0/3970750130 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a24079e30 0x7f2a2407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:17.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.501+0000 7f2a3a7fc640 1 --2- 172.21.15.170:0/3970750130 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a24079e30 0x7f2a2407c2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0fee60 tx=0x7f2a3000b2e0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:17.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.509+0000 7f2a23fff640 1 -- 172.21.15.170:0/3970750130 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195471 (secure 0 0 0) 0x7f2a2c088d80 con 0x7f2a3c102aa0 2024-09-04T16:34:17.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.757+0000 7f2a414b8640 1 -- 172.21.15.170:0/3970750130 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f2a28005850 con 0x7f2a3c102aa0 2024-09-04T16:34:17.758 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:17 smithi170 ceph-mon[29272]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:17.758 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:17 smithi170 ceph-mon[29272]: from='client.14956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:17.758 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:17 smithi170 ceph-mon[29272]: pgmap v102: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:17.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:17 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/756736494' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:34:17.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:17 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:17.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:17 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:34:17.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:17 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:34:17.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:17 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:17.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:17 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-04T16:34:17.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:17 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/1495684996' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-04T16:34:17.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.757+0000 7f2a23fff640 1 -- 172.21.15.170:0/3970750130 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f2a2c08d7a0 con 0x7f2a3c102aa0 2024-09-04T16:34:17.760 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-04T16:34:17.760 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:34:17.760 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:34:17.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.759+0000 7f2a414b8640 1 -- 172.21.15.170:0/3970750130 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a24079e30 msgr2=0x7f2a2407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:17.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.759+0000 7f2a414b8640 1 --2- 172.21.15.170:0/3970750130 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a24079e30 0x7f2a2407c2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0fee60 tx=0x7f2a3000b2e0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.759+0000 7f2a414b8640 1 -- 172.21.15.170:0/3970750130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a3c102aa0 msgr2=0x7f2a3c19d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:17.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.759+0000 7f2a414b8640 1 --2- 172.21.15.170:0/3970750130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a3c102aa0 0x7f2a3c19d740 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c031460 tx=0x7f2a2c0045e0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.760+0000 7f2a414b8640 1 -- 172.21.15.170:0/3970750130 shutdown_connections 2024-09-04T16:34:17.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.760+0000 7f2a414b8640 1 --2- 172.21.15.170:0/3970750130 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a24079e30 0x7f2a2407c2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.760+0000 7f2a414b8640 1 --2- 172.21.15.170:0/3970750130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a3c1033c0 0x7f2a3c19dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.760+0000 7f2a414b8640 1 --2- 172.21.15.170:0/3970750130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a3c102aa0 0x7f2a3c19d740 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:17.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.760+0000 7f2a414b8640 1 -- 172.21.15.170:0/3970750130 >> 172.21.15.170:0/3970750130 conn(0x7f2a3c0fc4c0 msgr2=0x7f2a3c108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:17.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.760+0000 7f2a414b8640 1 -- 172.21.15.170:0/3970750130 shutdown_connections 2024-09-04T16:34:17.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:17.760+0000 7f2a414b8640 1 -- 172.21.15.170:0/3970750130 wait complete. 2024-09-04T16:34:17.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:17 smithi193 ceph-mon[36288]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:17.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:17 smithi193 ceph-mon[36288]: from='client.14956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:17.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:17 smithi193 ceph-mon[36288]: pgmap v102: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:17.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:17 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/756736494' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:34:17.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:17 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:17 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:34:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:17 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:34:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:17 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:17 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-04T16:34:17.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:17 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/1495684996' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-04T16:34:18.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:18 smithi170 ceph-mon[29272]: from='client.14960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:18.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:18 smithi170 ceph-mon[29272]: Upgrade: Target is version 19.3.0-4702-gf9fcca52 (squid) 2024-09-04T16:34:18.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:18 smithi170 ceph-mon[29272]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, digests ['quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4'] 2024-09-04T16:34:18.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:18 smithi170 ceph-mon[29272]: Upgrade: Setting container_image for all mgr 2024-09-04T16:34:18.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:18 smithi170 ceph-mon[29272]: from='client.14972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:18.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:18 smithi170 ceph-mon[29272]: from='client.? 172.21.15.170:0/3970750130' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-04T16:34:18.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:18 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:18.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:18 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-04T16:34:18.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:18 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-04T16:34:18.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:18 smithi170 ceph-mon[29272]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:34:18.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:18 smithi193 ceph-mon[36288]: from='client.14960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:18.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:18 smithi193 ceph-mon[36288]: Upgrade: Target is version 19.3.0-4702-gf9fcca52 (squid) 2024-09-04T16:34:18.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:18 smithi193 ceph-mon[36288]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, digests ['quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4'] 2024-09-04T16:34:18.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:18 smithi193 ceph-mon[36288]: Upgrade: Setting container_image for all mgr 2024-09-04T16:34:18.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:18 smithi193 ceph-mon[36288]: from='client.14972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:18.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:18 smithi193 ceph-mon[36288]: from='client.? 172.21.15.170:0/3970750130' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-04T16:34:18.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:18 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:18.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:18 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-04T16:34:18.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:18 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-04T16:34:18.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:18 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:34:19.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:19 smithi170 ceph-mon[29272]: Upgrade: Updating mon.smithi170 2024-09-04T16:34:19.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:19 smithi170 ceph-mon[29272]: Deploying daemon mon.smithi170 on smithi170 2024-09-04T16:34:19.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:19 smithi170 ceph-mon[29272]: pgmap v103: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:19.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:19 smithi193 ceph-mon[36288]: Upgrade: Updating mon.smithi170 2024-09-04T16:34:19.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:19 smithi193 ceph-mon[36288]: Deploying daemon mon.smithi170 on smithi170 2024-09-04T16:34:19.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:19 smithi193 ceph-mon[36288]: pgmap v103: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:20.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:19 smithi170 systemd[1]: Stopping Ceph mon.smithi170 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:34:20.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:20 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170[29268]: 2024-09-04T16:34:20.203+0000 7f8ba55b4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi170 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T16:34:20.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:20 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170[29268]: 2024-09-04T16:34:20.203+0000 7f8ba55b4640 -1 mon.smithi170@0(leader) e2 *** Got Signal Terminated *** 2024-09-04T16:34:20.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:20 smithi170 podman[113682]: 2024-09-04 16:34:20.315907557 +0000 UTC m=+0.199355705 container died 194ff39cc041c031a9ab44df9ae890f2392cc9b76de6726c9d520ee0306045e4 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-48920da, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-04T16:34:20.921 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:20 smithi170 podman[113682]: 2024-09-04 16:34:20.720518172 +0000 UTC m=+0.603966315 container cleanup 194ff39cc041c031a9ab44df9ae890f2392cc9b76de6726c9d520ee0306045e4 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-48920da, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-04T16:34:20.922 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:20 smithi170 bash[113682]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170 2024-09-04T16:34:21.217 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:20 smithi170 podman[113706]: 2024-09-04 16:34:20.921844898 +0000 UTC m=+0.605929114 container remove 194ff39cc041c031a9ab44df9ae890f2392cc9b76de6726c9d520ee0306045e4 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-48920da, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-04T16:34:21.217 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mon.smithi170.service: Deactivated successfully. 2024-09-04T16:34:21.217 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 systemd[1]: Stopped Ceph mon.smithi170 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:34:21.217 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mon.smithi170.service: Consumed 13.165s CPU time. 2024-09-04T16:34:21.470 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 systemd[1]: Starting Ceph mon.smithi170 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:34:21.751 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 podman[113836]: 2024-09-04 16:34:21.373305603 +0000 UTC m=+0.015896002 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:34:21.752 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 podman[113836]: 2024-09-04 16:34:21.523443984 +0000 UTC m=+0.166034366 container create ea912d4e404df353420a41b291877cf59257c30a5165dc1c548fda2d709195db (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-04T16:34:21.752 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 podman[113836]: 2024-09-04 16:34:21.751870018 +0000 UTC m=+0.394460403 container init ea912d4e404df353420a41b291877cf59257c30a5165dc1c548fda2d709195db (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_CLEAN=True, ceph=True) 2024-09-04T16:34:22.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 podman[113836]: 2024-09-04 16:34:21.755110432 +0000 UTC m=+0.397700822 container start ea912d4e404df353420a41b291877cf59257c30a5165dc1c548fda2d709195db (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-04T16:34:22.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: set uid:gid to 167:167 (ceph:ceph) 2024-09-04T16:34:22.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev), process ceph-mon, pid 2 2024-09-04T16:34:22.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: pidfile_write: ignore empty --pid-file 2024-09-04T16:34:22.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: load: jerasure load: lrc 2024-09-04T16:34:22.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: RocksDB version: 7.9.2 2024-09-04T16:34:22.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Git sha 0 2024-09-04T16:34:22.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Compile date 2024-09-04 14:08:26 2024-09-04T16:34:22.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: DB SUMMARY 2024-09-04T16:34:22.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: DB Session ID: M3HRATJYUBK8FAHUX77N 2024-09-04T16:34:22.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: CURRENT file: CURRENT 2024-09-04T16:34:22.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: IDENTITY file: IDENTITY 2024-09-04T16:34:22.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1519 Bytes 2024-09-04T16:34:22.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi170/store.db dir, Total Num: 1, files: 000032.sst 2024-09-04T16:34:22.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi170/store.db: 000030.log size: 2327946 ; 2024-09-04T16:34:22.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.error_if_exists: 0 2024-09-04T16:34:22.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.create_if_missing: 0 2024-09-04T16:34:22.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.paranoid_checks: 1 2024-09-04T16:34:22.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-04T16:34:22.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-04T16:34:22.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-04T16:34:22.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.env: 0x562a505eb160 2024-09-04T16:34:22.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.fs: PosixFileSystem 2024-09-04T16:34:22.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.info_log: 0x562a51ae5a60 2024-09-04T16:34:22.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_file_opening_threads: 16 2024-09-04T16:34:22.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.statistics: (nil) 2024-09-04T16:34:22.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.use_fsync: 0 2024-09-04T16:34:22.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_log_file_size: 0 2024-09-04T16:34:22.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-04T16:34:22.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-04T16:34:22.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.keep_log_file_num: 1000 2024-09-04T16:34:22.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.recycle_log_file_num: 0 2024-09-04T16:34:22.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.allow_fallocate: 1 2024-09-04T16:34:22.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.allow_mmap_reads: 0 2024-09-04T16:34:22.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.allow_mmap_writes: 0 2024-09-04T16:34:22.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.use_direct_reads: 0 2024-09-04T16:34:22.106 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-04T16:34:22.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.create_missing_column_families: 0 2024-09-04T16:34:22.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.db_log_dir: 2024-09-04T16:34:22.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.wal_dir: 2024-09-04T16:34:22.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-04T16:34:22.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-04T16:34:22.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-04T16:34:22.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-04T16:34:22.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-04T16:34:22.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-04T16:34:22.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.advise_random_on_open: 1 2024-09-04T16:34:22.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.db_write_buffer_size: 0 2024-09-04T16:34:22.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.write_buffer_manager: 0x562a51ae8e60 2024-09-04T16:34:22.107 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-04T16:34:22.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-04T16:34:22.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-04T16:34:22.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.rate_limiter: (nil) 2024-09-04T16:34:22.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-04T16:34:22.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.wal_recovery_mode: 2 2024-09-04T16:34:22.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.enable_thread_tracking: 0 2024-09-04T16:34:22.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.enable_pipelined_write: 0 2024-09-04T16:34:22.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.unordered_write: 0 2024-09-04T16:34:22.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-04T16:34:22.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-04T16:34:22.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-04T16:34:22.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-04T16:34:22.108 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.row_cache: None 2024-09-04T16:34:22.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.wal_filter: None 2024-09-04T16:34:22.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-04T16:34:22.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.allow_ingest_behind: 0 2024-09-04T16:34:22.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.two_write_queues: 0 2024-09-04T16:34:22.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.manual_wal_flush: 0 2024-09-04T16:34:22.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.wal_compression: 0 2024-09-04T16:34:22.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.atomic_flush: 0 2024-09-04T16:34:22.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-04T16:34:22.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-04T16:34:22.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-04T16:34:22.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.log_readahead_size: 0 2024-09-04T16:34:22.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-04T16:34:22.109 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.best_efforts_recovery: 0 2024-09-04T16:34:22.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-04T16:34:22.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-04T16:34:22.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.allow_data_in_errors: 0 2024-09-04T16:34:22.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.db_host_id: __hostname__ 2024-09-04T16:34:22.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-04T16:34:22.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_background_jobs: 2 2024-09-04T16:34:22.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_background_compactions: -1 2024-09-04T16:34:22.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_subcompactions: 1 2024-09-04T16:34:22.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-04T16:34:22.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-04T16:34:22.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-04T16:34:22.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_total_wal_size: 0 2024-09-04T16:34:22.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-04T16:34:22.110 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-04T16:34:22.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-04T16:34:22.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-04T16:34:22.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_open_files: -1 2024-09-04T16:34:22.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.bytes_per_sync: 0 2024-09-04T16:34:22.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-04T16:34:22.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-04T16:34:22.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compaction_readahead_size: 0 2024-09-04T16:34:22.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_background_flushes: -1 2024-09-04T16:34:22.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Compression algorithms supported: 2024-09-04T16:34:22.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: kZSTD supported: 0 2024-09-04T16:34:22.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: kXpressCompression supported: 0 2024-09-04T16:34:22.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: kBZip2Compression supported: 0 2024-09-04T16:34:22.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-04T16:34:22.111 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: kLZ4Compression supported: 1 2024-09-04T16:34:22.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: kZlibCompression supported: 1 2024-09-04T16:34:22.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: kLZ4HCCompression supported: 1 2024-09-04T16:34:22.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: kSnappyCompression supported: 1 2024-09-04T16:34:22.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-04T16:34:22.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-04T16:34:22.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi170/store.db/MANIFEST-000015 2024-09-04T16:34:22.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-04T16:34:22.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-04T16:34:22.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.merge_operator: 2024-09-04T16:34:22.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compaction_filter: None 2024-09-04T16:34:22.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compaction_filter_factory: None 2024-09-04T16:34:22.112 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.sst_partitioner_factory: None 2024-09-04T16:34:22.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-04T16:34:22.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-04T16:34:22.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562a51ae56e0) 2024-09-04T16:34:22.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: cache_index_and_filter_blocks: 1 2024-09-04T16:34:22.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-04T16:34:22.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-04T16:34:22.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: pin_top_level_index_and_filter: 1 2024-09-04T16:34:22.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: index_type: 0 2024-09-04T16:34:22.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: data_block_index_type: 0 2024-09-04T16:34:22.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: index_shortening: 1 2024-09-04T16:34:22.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-04T16:34:22.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: checksum: 4 2024-09-04T16:34:22.113 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: no_block_cache: 0 2024-09-04T16:34:22.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_cache: 0x562a51ad8850 2024-09-04T16:34:22.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_cache_name: BinnedLRUCache 2024-09-04T16:34:22.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_cache_options: 2024-09-04T16:34:22.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: capacity : 536870912 2024-09-04T16:34:22.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: num_shard_bits : 4 2024-09-04T16:34:22.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: strict_capacity_limit : 0 2024-09-04T16:34:22.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: high_pri_pool_ratio: 0.000 2024-09-04T16:34:22.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_cache_compressed: (nil) 2024-09-04T16:34:22.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: persistent_cache: (nil) 2024-09-04T16:34:22.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_size: 4096 2024-09-04T16:34:22.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_size_deviation: 10 2024-09-04T16:34:22.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_restart_interval: 16 2024-09-04T16:34:22.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: index_block_restart_interval: 1 2024-09-04T16:34:22.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: metadata_block_size: 4096 2024-09-04T16:34:22.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: partition_filters: 0 2024-09-04T16:34:22.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: use_delta_encoding: 1 2024-09-04T16:34:22.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: filter_policy: bloomfilter 2024-09-04T16:34:22.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: whole_key_filtering: 1 2024-09-04T16:34:22.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: verify_compression: 0 2024-09-04T16:34:22.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: read_amp_bytes_per_bit: 0 2024-09-04T16:34:22.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: format_version: 5 2024-09-04T16:34:22.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: enable_index_compression: 1 2024-09-04T16:34:22.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_align: 0 2024-09-04T16:34:22.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: max_auto_readahead_size: 262144 2024-09-04T16:34:22.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: prepopulate_block_cache: 0 2024-09-04T16:34:22.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: initial_auto_readahead_size: 8192 2024-09-04T16:34:22.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: num_file_reads_for_auto_readahead: 2 2024-09-04T16:34:22.115 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.write_buffer_size: 33554432 2024-09-04T16:34:22.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_write_buffer_number: 2 2024-09-04T16:34:22.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compression: NoCompression 2024-09-04T16:34:22.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.bottommost_compression: Disabled 2024-09-04T16:34:22.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.prefix_extractor: nullptr 2024-09-04T16:34:22.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-04T16:34:22.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.num_levels: 7 2024-09-04T16:34:22.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-04T16:34:22.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-04T16:34:22.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-04T16:34:22.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-04T16:34:22.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-04T16:34:22.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-04T16:34:22.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-04T16:34:22.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-04T16:34:22.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-04T16:34:22.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-04T16:34:22.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-04T16:34:22.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-04T16:34:22.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-04T16:34:22.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compression_opts.level: 32767 2024-09-04T16:34:22.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compression_opts.strategy: 0 2024-09-04T16:34:22.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-04T16:34:22.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-04T16:34:22.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-04T16:34:22.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-04T16:34:22.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compression_opts.enabled: false 2024-09-04T16:34:22.117 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-04T16:34:22.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-04T16:34:22.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-04T16:34:22.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-04T16:34:22.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.target_file_size_base: 67108864 2024-09-04T16:34:22.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-04T16:34:22.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-04T16:34:22.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-04T16:34:22.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-04T16:34:22.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-04T16:34:22.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-04T16:34:22.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-04T16:34:22.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-04T16:34:22.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-04T16:34:22.118 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-04T16:34:22.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-04T16:34:22.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-04T16:34:22.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-04T16:34:22.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-04T16:34:22.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.arena_block_size: 1048576 2024-09-04T16:34:22.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-04T16:34:22.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-04T16:34:22.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.disable_auto_compactions: 0 2024-09-04T16:34:22.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-04T16:34:22.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-04T16:34:22.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-04T16:34:22.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-04T16:34:22.119 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-04T16:34:22.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-04T16:34:22.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-04T16:34:22.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-04T16:34:22.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-04T16:34:22.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-04T16:34:22.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-04T16:34:22.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.inplace_update_support: 0 2024-09-04T16:34:22.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-04T16:34:22.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-04T16:34:22.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-04T16:34:22.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-04T16:34:22.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.bloom_locality: 0 2024-09-04T16:34:22.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.max_successive_merges: 0 2024-09-04T16:34:22.120 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-04T16:34:22.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.paranoid_file_checks: 0 2024-09-04T16:34:22.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.force_consistency_checks: 1 2024-09-04T16:34:22.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.report_bg_io_stats: 0 2024-09-04T16:34:22.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.ttl: 2592000 2024-09-04T16:34:22.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-04T16:34:22.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-04T16:34:22.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-04T16:34:22.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.enable_blob_files: false 2024-09-04T16:34:22.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.min_blob_size: 0 2024-09-04T16:34:22.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.blob_file_size: 268435456 2024-09-04T16:34:22.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-04T16:34:22.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-04T16:34:22.121 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-04T16:34:22.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-04T16:34:22.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-04T16:34:22.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.blob_file_starting_level: 0 2024-09-04T16:34:22.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-04T16:34:22.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-04T16:34:22.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi170/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12048, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-04T16:34:22.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-04T16:34:22.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2ff660b3-4277-464e-9f22-6edc170e21a3 2024-09-04T16:34:22.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725467661781697, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-04T16:34:22.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-04T16:34:22.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725467661789143, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 2038691, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12049, "largest_seqno": 13728, "table_properties": {"data_size": 2030698, "index_size": 5031, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1925, "raw_key_size": 17292, "raw_average_key_size": 23, "raw_value_size": 2014701, "raw_average_value_size": 2707, "num_data_blocks": 231, "num_entries": 744, "num_filter_entries": 744, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725467661, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2ff660b3-4277-464e-9f22-6edc170e21a3", "db_session_id": "M3HRATJYUBK8FAHUX77N", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-04T16:34:22.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725467661789235, "job": 1, "event": "recovery_finished"} 2024-09-04T16:34:22.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-04T16:34:22.122 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-04T16:34:22.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi170/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-04T16:34:22.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562a51b08e00 2024-09-04T16:34:22.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: DB pointer 0x562a51c08000 2024-09-04T16:34:22.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-04T16:34:22.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-04T16:34:22.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ** DB Stats ** 2024-09-04T16:34:22.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-04T16:34:22.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-04T16:34:22.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-04T16:34:22.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-04T16:34:22.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-04T16:34:22.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-04T16:34:22.123 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-04T16:34:22.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-09-04T16:34:22.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-04T16:34:22.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-04T16:34:22.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-04T16:34:22.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: L0 1/0 1.94 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 522.5 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-04T16:34:22.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: L6 1/0 7.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-04T16:34:22.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Sum 2/0 9.12 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 522.5 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-04T16:34:22.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 522.5 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-04T16:34:22.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-09-04T16:34:22.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ** Compaction Stats [default] ** 2024-09-04T16:34:22.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-04T16:34:22.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-04T16:34:22.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 522.5 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-04T16:34:22.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-09-04T16:34:22.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-04T16:34:22.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-09-04T16:34:22.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-04T16:34:22.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-04T16:34:22.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-04T16:34:22.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-04T16:34:22.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-04T16:34:22.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-04T16:34:22.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Cumulative compaction: 0.00 GB write, 194.87 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-04T16:34:22.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Interval compaction: 0.00 GB write, 194.87 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-04T16:34:22.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-04T16:34:22.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Block cache BinnedLRUCache@0x562a51ad8850#2 capacity: 512.00 MB usage: 7.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-04T16:34:22.125 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,5.08 KB,0.000968575%) Misc(1,0.00 KB,0%) 2024-09-04T16:34:22.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-09-04T16:34:22.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-04T16:34:22.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: starting mon.smithi170 rank 0 at public addrs [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] at bind addrs [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi170 fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:34:22.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: mon.smithi170@-1(???) e2 preinit fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:34:22.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: mon.smithi170@-1(???).mds e15 new map 2024-09-04T16:34:22.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: mon.smithi170@-1(???).mds e15 print_map 2024-09-04T16:34:22.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: e15 2024-09-04T16:34:22.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: btime 2024-09-04T16:27:39:151187+0000 2024-09-04T16:34:22.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:34:22.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:34:22.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: legacy client fscid: 1 2024-09-04T16:34:22.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-09-04T16:34:22.126 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Filesystem 'cephfs' (1) 2024-09-04T16:34:22.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: fs_name cephfs 2024-09-04T16:34:22.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: epoch 15 2024-09-04T16:34:22.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-04T16:34:22.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:34:22.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: modified 2024-09-04T16:27:39.151182+0000 2024-09-04T16:34:22.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: tableserver 0 2024-09-04T16:34:22.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: root 0 2024-09-04T16:34:22.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: session_timeout 60 2024-09-04T16:34:22.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: session_autoclose 300 2024-09-04T16:34:22.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: max_file_size 1099511627776 2024-09-04T16:34:22.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: max_xattr_size 65536 2024-09-04T16:34:22.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: required_client_features {} 2024-09-04T16:34:22.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: last_failure 0 2024-09-04T16:34:22.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: last_failure_osd_epoch 45 2024-09-04T16:34:22.127 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:34:22.128 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: max_mds 2 2024-09-04T16:34:22.128 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: in 0,1 2024-09-04T16:34:22.128 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: up {0=14562,1=14578} 2024-09-04T16:34:22.128 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: failed 2024-09-04T16:34:22.128 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: damaged 2024-09-04T16:34:22.128 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: stopped 2024-09-04T16:34:22.128 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: data_pools [3] 2024-09-04T16:34:22.128 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: metadata_pool 2 2024-09-04T16:34:22.128 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: inline_data enabled 2024-09-04T16:34:22.128 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: balancer 2024-09-04T16:34:22.128 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: bal_rank_mask -1 2024-09-04T16:34:22.128 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: standby_count_wanted 1 2024-09-04T16:34:22.128 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: qdb_cluster leader: 14562 members: 14562,14578 2024-09-04T16:34:22.129 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: [mds.cephfs.smithi170.zkhdil{0:14562} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:34:22.129 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: [mds.cephfs.smithi170.rzbrux{1:14578} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:34:22.129 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-09-04T16:34:22.129 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-09-04T16:34:22.129 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Standby daemons: 2024-09-04T16:34:22.129 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-09-04T16:34:22.129 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: [mds.cephfs.smithi193.kabapr{-1:24315} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.193:6826/288890560,v1:172.21.15.193:6827/288890560] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:34:22.129 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: [mds.cephfs.smithi193.xostco{-1:24319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1128257367,v1:172.21.15.193:6825/1128257367] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:34:22.129 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: mon.smithi170@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-04T16:34:22.130 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: mon.smithi170@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-04T16:34:22.130 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: mon.smithi170@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-04T16:34:22.130 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: mon.smithi170@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-04T16:34:22.130 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 ceph-mon[113855]: mon.smithi170@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-04T16:34:22.130 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 bash[113836]: ea912d4e404df353420a41b291877cf59257c30a5165dc1c548fda2d709195db 2024-09-04T16:34:22.130 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:21 smithi170 systemd[1]: Started Ceph mon.smithi170 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:34:25.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-09-04T16:34:25.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:34:25.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-04T16:34:25.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-04T16:34:25.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: pgmap v104: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:25.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: pgmap v105: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:25.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: pgmap v106: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:25.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: mon.smithi170 calling monitor election 2024-09-04T16:34:25.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: mon.smithi170 is new leader, mons smithi170,smithi193 in quorum (ranks 0,1) 2024-09-04T16:34:25.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: monmap epoch 2 2024-09-04T16:34:25.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:34:25.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: last_changed 2024-09-04T16:23:09.098925+0000 2024-09-04T16:34:25.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: created 2024-09-04T16:20:42.443608+0000 2024-09-04T16:34:25.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: min_mon_release 19 (squid) 2024-09-04T16:34:25.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: election_strategy: 1 2024-09-04T16:34:25.158 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.smithi170 2024-09-04T16:34:25.158 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.smithi193 2024-09-04T16:34:25.158 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:active} 2 up:standby 2024-09-04T16:34:25.158 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: osdmap e47: 6 total, 6 up, 6 in 2024-09-04T16:34:25.158 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: mgrmap e33: smithi170.fbszap(active, since 3m), standbys: smithi193.gvfizn 2024-09-04T16:34:25.158 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-04T16:34:25.158 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:34:25.158 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:34:25.158 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: from='mgr.14774 ' entity='' 2024-09-04T16:34:25.158 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:25.158 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:24 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:34:25.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-09-04T16:34:25.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "mon metadata", "id": "smithi193"}]: dispatch 2024-09-04T16:34:25.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-04T16:34:25.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-04T16:34:25.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: pgmap v104: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:25.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: pgmap v105: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:25.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: pgmap v106: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:25.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: mon.smithi170 calling monitor election 2024-09-04T16:34:25.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: mon.smithi170 is new leader, mons smithi170,smithi193 in quorum (ranks 0,1) 2024-09-04T16:34:25.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: monmap epoch 2 2024-09-04T16:34:25.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:34:25.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: last_changed 2024-09-04T16:23:09.098925+0000 2024-09-04T16:34:25.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: created 2024-09-04T16:20:42.443608+0000 2024-09-04T16:34:25.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: min_mon_release 19 (squid) 2024-09-04T16:34:25.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: election_strategy: 1 2024-09-04T16:34:25.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.smithi170 2024-09-04T16:34:25.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.smithi193 2024-09-04T16:34:25.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:active} 2 up:standby 2024-09-04T16:34:25.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: osdmap e47: 6 total, 6 up, 6 in 2024-09-04T16:34:25.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: mgrmap e33: smithi170.fbszap(active, since 3m), standbys: smithi193.gvfizn 2024-09-04T16:34:25.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-04T16:34:25.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:34:25.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:34:25.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: from='mgr.14774 ' entity='' 2024-09-04T16:34:25.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:25.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:24 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:34:27.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:27 smithi170 ceph-mon[113855]: pgmap v107: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:27.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:27 smithi193 ceph-mon[36288]: pgmap v107: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:29.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:29 smithi170 ceph-mon[113855]: pgmap v108: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:34:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:29 smithi193 ceph-mon[36288]: pgmap v108: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:29 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-04T16:34:31.097 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:30 smithi170 ceph-mon[113855]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:31.098 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:30 smithi170 ceph-mon[113855]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:31.098 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:30 smithi170 ceph-mon[113855]: pgmap v109: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:31.098 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:30 smithi170 ceph-mon[113855]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:31.098 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:30 smithi170 ceph-mon[113855]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:31.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:30 smithi193 ceph-mon[36288]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:31.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:30 smithi193 ceph-mon[36288]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:31.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:30 smithi193 ceph-mon[36288]: pgmap v109: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:31.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:30 smithi193 ceph-mon[36288]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:31.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:30 smithi193 ceph-mon[36288]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:33.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:33 smithi170 ceph-mon[113855]: pgmap v110: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:33.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:33 smithi193 ceph-mon[36288]: pgmap v110: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:34 smithi193 ceph-mon[36288]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:34 smithi193 ceph-mon[36288]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:34:34.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:34:34.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:34 smithi193 ceph-mon[36288]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:34.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:34:34.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:34:34.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:34 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-04T16:34:34.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:34 smithi193 ceph-mon[36288]: pgmap v111: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:34.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:34 smithi170 ceph-mon[113855]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:34.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:34 smithi170 ceph-mon[113855]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:34.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:34:34.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-04T16:34:34.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:34 smithi170 ceph-mon[113855]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:34.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-04T16:34:34.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-04T16:34:34.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-04T16:34:34.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:34 smithi170 ceph-mon[113855]: pgmap v111: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:36.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:36 smithi170 ceph-mon[113855]: Upgrade: Updating mon.smithi193 2024-09-04T16:34:36.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:36 smithi170 ceph-mon[113855]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:36.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:36 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-04T16:34:36.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:36 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-04T16:34:36.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:36 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:34:36.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:36 smithi170 ceph-mon[113855]: Deploying daemon mon.smithi193 on smithi193 2024-09-04T16:34:36.354 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:36 smithi193 ceph-mon[36288]: Upgrade: Updating mon.smithi193 2024-09-04T16:34:36.354 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:36 smithi193 ceph-mon[36288]: from='mgr.14774 ' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:36.355 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:36 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-04T16:34:36.355 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:36 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-04T16:34:36.355 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:36 smithi193 ceph-mon[36288]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-04T16:34:36.355 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:36 smithi193 ceph-mon[36288]: Deploying daemon mon.smithi193 on smithi193 2024-09-04T16:34:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:36 smithi193 systemd[1]: Stopping Ceph mon.smithi193 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:34:37.234 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:36 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi193[36256]: 2024-09-04T16:34:36.908+0000 7f5118fcc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi193 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T16:34:37.234 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:36 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi193[36256]: 2024-09-04T16:34:36.908+0000 7f5118fcc640 -1 mon.smithi193@1(peon) e2 *** Got Signal Terminated *** 2024-09-04T16:34:37.234 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:36 smithi193 podman[82387]: 2024-09-04 16:34:36.949868555 +0000 UTC m=+0.156670198 container died 38c8e99ca3231bf51b2e13172e747b99404f1fb0cb43bacc46aa18df8acb5249 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi193, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-48920da, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True) 2024-09-04T16:34:37.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:37 smithi193 podman[82387]: 2024-09-04 16:34:37.409331066 +0000 UTC m=+0.616132753 container cleanup 38c8e99ca3231bf51b2e13172e747b99404f1fb0cb43bacc46aa18df8acb5249 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi193, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-48920da, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-04T16:34:37.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:37 smithi193 bash[82387]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi193 2024-09-04T16:34:38.052 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:37 smithi193 podman[82400]: 2024-09-04 16:34:37.660474509 +0000 UTC m=+0.701812033 container remove 38c8e99ca3231bf51b2e13172e747b99404f1fb0cb43bacc46aa18df8acb5249 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi193, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-48920da, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731) 2024-09-04T16:34:38.052 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:37 smithi193 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mon.smithi193.service: Deactivated successfully. 2024-09-04T16:34:38.053 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:37 smithi193 systemd[1]: Stopped Ceph mon.smithi193 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:34:38.053 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:37 smithi193 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mon.smithi193.service: Consumed 7.084s CPU time. 2024-09-04T16:34:38.389 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 systemd[1]: Starting Ceph mon.smithi193 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:34:38.390 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 podman[82528]: 2024-09-04 16:34:38.1643107 +0000 UTC m=+0.015434317 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:34:38.390 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 podman[82528]: 2024-09-04 16:34:38.278964101 +0000 UTC m=+0.130087760 container create 6a9e9faed0c8c6a0fd937d7338cd4786efa9ef4764a0e4e51aa244f0f5c35173 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi193, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-04T16:34:38.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 podman[82528]: 2024-09-04 16:34:38.489954814 +0000 UTC m=+0.341078440 container init 6a9e9faed0c8c6a0fd937d7338cd4786efa9ef4764a0e4e51aa244f0f5c35173 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi193, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-04T16:34:38.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 podman[82528]: 2024-09-04 16:34:38.493456173 +0000 UTC m=+0.344579791 container start 6a9e9faed0c8c6a0fd937d7338cd4786efa9ef4764a0e4e51aa244f0f5c35173 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi193, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-04T16:34:38.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: set uid:gid to 167:167 (ceph:ceph) 2024-09-04T16:34:38.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev), process ceph-mon, pid 2 2024-09-04T16:34:38.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: pidfile_write: ignore empty --pid-file 2024-09-04T16:34:38.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: load: jerasure load: lrc 2024-09-04T16:34:38.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: RocksDB version: 7.9.2 2024-09-04T16:34:38.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Git sha 0 2024-09-04T16:34:38.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Compile date 2024-09-04 14:08:26 2024-09-04T16:34:38.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: DB SUMMARY 2024-09-04T16:34:38.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: DB Session ID: 15E0HU201JUXAKLXNICD 2024-09-04T16:34:38.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: CURRENT file: CURRENT 2024-09-04T16:34:38.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: IDENTITY file: IDENTITY 2024-09-04T16:34:38.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1412 Bytes 2024-09-04T16:34:38.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi193/store.db dir, Total Num: 1, files: 000027.sst 2024-09-04T16:34:38.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi193/store.db: 000025.log size: 4035624 ; 2024-09-04T16:34:38.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.error_if_exists: 0 2024-09-04T16:34:38.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.create_if_missing: 0 2024-09-04T16:34:38.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.paranoid_checks: 1 2024-09-04T16:34:38.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-04T16:34:38.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-04T16:34:38.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-04T16:34:38.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.env: 0x55ff47d52160 2024-09-04T16:34:38.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.fs: PosixFileSystem 2024-09-04T16:34:38.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.info_log: 0x55ff492dfa60 2024-09-04T16:34:38.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_file_opening_threads: 16 2024-09-04T16:34:38.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.statistics: (nil) 2024-09-04T16:34:38.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.use_fsync: 0 2024-09-04T16:34:38.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_log_file_size: 0 2024-09-04T16:34:38.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-04T16:34:38.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-04T16:34:38.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.keep_log_file_num: 1000 2024-09-04T16:34:38.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.recycle_log_file_num: 0 2024-09-04T16:34:38.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.allow_fallocate: 1 2024-09-04T16:34:38.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.allow_mmap_reads: 0 2024-09-04T16:34:38.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.allow_mmap_writes: 0 2024-09-04T16:34:38.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.use_direct_reads: 0 2024-09-04T16:34:38.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-04T16:34:38.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.create_missing_column_families: 0 2024-09-04T16:34:38.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.db_log_dir: 2024-09-04T16:34:38.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.wal_dir: 2024-09-04T16:34:38.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-04T16:34:38.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-04T16:34:38.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-04T16:34:38.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-04T16:34:38.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-04T16:34:38.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-04T16:34:38.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.advise_random_on_open: 1 2024-09-04T16:34:38.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.db_write_buffer_size: 0 2024-09-04T16:34:38.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.write_buffer_manager: 0x55ff492e2e60 2024-09-04T16:34:38.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-04T16:34:38.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-04T16:34:38.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-04T16:34:38.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.rate_limiter: (nil) 2024-09-04T16:34:38.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-04T16:34:38.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.wal_recovery_mode: 2 2024-09-04T16:34:38.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.enable_thread_tracking: 0 2024-09-04T16:34:38.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.enable_pipelined_write: 0 2024-09-04T16:34:38.664 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.unordered_write: 0 2024-09-04T16:34:38.664 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-04T16:34:38.664 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-04T16:34:38.664 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-04T16:34:38.664 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-04T16:34:38.664 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.row_cache: None 2024-09-04T16:34:38.664 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.wal_filter: None 2024-09-04T16:34:38.664 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-04T16:34:38.664 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.allow_ingest_behind: 0 2024-09-04T16:34:38.664 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.two_write_queues: 0 2024-09-04T16:34:38.664 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.manual_wal_flush: 0 2024-09-04T16:34:38.664 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.wal_compression: 0 2024-09-04T16:34:38.664 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.atomic_flush: 0 2024-09-04T16:34:38.665 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-04T16:34:38.665 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-04T16:34:38.665 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-04T16:34:38.665 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.log_readahead_size: 0 2024-09-04T16:34:38.665 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-04T16:34:38.665 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.best_efforts_recovery: 0 2024-09-04T16:34:38.665 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-04T16:34:38.665 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-04T16:34:38.665 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.allow_data_in_errors: 0 2024-09-04T16:34:38.665 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.db_host_id: __hostname__ 2024-09-04T16:34:38.665 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-04T16:34:38.665 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_background_jobs: 2 2024-09-04T16:34:38.665 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_background_compactions: -1 2024-09-04T16:34:38.665 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_subcompactions: 1 2024-09-04T16:34:38.666 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-04T16:34:38.666 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-04T16:34:38.666 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-04T16:34:38.666 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_total_wal_size: 0 2024-09-04T16:34:38.666 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-04T16:34:38.666 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-04T16:34:38.666 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-04T16:34:38.666 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-04T16:34:38.666 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_open_files: -1 2024-09-04T16:34:38.666 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.bytes_per_sync: 0 2024-09-04T16:34:38.666 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-04T16:34:38.666 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-04T16:34:38.666 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compaction_readahead_size: 0 2024-09-04T16:34:38.667 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_background_flushes: -1 2024-09-04T16:34:38.667 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Compression algorithms supported: 2024-09-04T16:34:38.667 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: kZSTD supported: 0 2024-09-04T16:34:38.667 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: kXpressCompression supported: 0 2024-09-04T16:34:38.667 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: kBZip2Compression supported: 0 2024-09-04T16:34:38.667 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-04T16:34:38.667 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: kLZ4Compression supported: 1 2024-09-04T16:34:38.667 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: kZlibCompression supported: 1 2024-09-04T16:34:38.667 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: kLZ4HCCompression supported: 1 2024-09-04T16:34:38.667 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: kSnappyCompression supported: 1 2024-09-04T16:34:38.667 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-04T16:34:38.667 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-04T16:34:38.668 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi193/store.db/MANIFEST-000010 2024-09-04T16:34:38.668 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-04T16:34:38.668 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-04T16:34:38.668 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.merge_operator: 2024-09-04T16:34:38.668 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compaction_filter: None 2024-09-04T16:34:38.668 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compaction_filter_factory: None 2024-09-04T16:34:38.668 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.sst_partitioner_factory: None 2024-09-04T16:34:38.668 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-04T16:34:38.668 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-04T16:34:38.668 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ff492df6e0) 2024-09-04T16:34:38.668 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: cache_index_and_filter_blocks: 1 2024-09-04T16:34:38.668 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-04T16:34:38.668 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-04T16:34:38.669 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: pin_top_level_index_and_filter: 1 2024-09-04T16:34:38.669 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: index_type: 0 2024-09-04T16:34:38.669 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: data_block_index_type: 0 2024-09-04T16:34:38.669 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: index_shortening: 1 2024-09-04T16:34:38.669 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-04T16:34:38.669 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: checksum: 4 2024-09-04T16:34:38.669 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: no_block_cache: 0 2024-09-04T16:34:38.669 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: block_cache: 0x55ff492d2850 2024-09-04T16:34:38.669 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: block_cache_name: BinnedLRUCache 2024-09-04T16:34:38.669 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: block_cache_options: 2024-09-04T16:34:38.669 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: capacity : 536870912 2024-09-04T16:34:38.669 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: num_shard_bits : 4 2024-09-04T16:34:38.669 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: strict_capacity_limit : 0 2024-09-04T16:34:38.670 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: high_pri_pool_ratio: 0.000 2024-09-04T16:34:38.670 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: block_cache_compressed: (nil) 2024-09-04T16:34:38.670 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: persistent_cache: (nil) 2024-09-04T16:34:38.670 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: block_size: 4096 2024-09-04T16:34:38.670 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: block_size_deviation: 10 2024-09-04T16:34:38.670 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: block_restart_interval: 16 2024-09-04T16:34:38.670 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: index_block_restart_interval: 1 2024-09-04T16:34:38.670 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: metadata_block_size: 4096 2024-09-04T16:34:38.670 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: partition_filters: 0 2024-09-04T16:34:38.670 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: use_delta_encoding: 1 2024-09-04T16:34:38.670 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: filter_policy: bloomfilter 2024-09-04T16:34:38.670 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: whole_key_filtering: 1 2024-09-04T16:34:38.671 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: verify_compression: 0 2024-09-04T16:34:38.671 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: read_amp_bytes_per_bit: 0 2024-09-04T16:34:38.671 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: format_version: 5 2024-09-04T16:34:38.671 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: enable_index_compression: 1 2024-09-04T16:34:38.671 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: block_align: 0 2024-09-04T16:34:38.671 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: max_auto_readahead_size: 262144 2024-09-04T16:34:38.671 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: prepopulate_block_cache: 0 2024-09-04T16:34:38.671 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: initial_auto_readahead_size: 8192 2024-09-04T16:34:38.671 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: num_file_reads_for_auto_readahead: 2 2024-09-04T16:34:38.672 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.write_buffer_size: 33554432 2024-09-04T16:34:38.672 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_write_buffer_number: 2 2024-09-04T16:34:38.672 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compression: NoCompression 2024-09-04T16:34:38.672 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.bottommost_compression: Disabled 2024-09-04T16:34:38.676 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.prefix_extractor: nullptr 2024-09-04T16:34:38.676 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-04T16:34:38.676 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.num_levels: 7 2024-09-04T16:34:38.676 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-04T16:34:38.676 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-04T16:34:38.676 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-04T16:34:38.676 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-04T16:34:38.677 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-04T16:34:38.677 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-04T16:34:38.677 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-04T16:34:38.677 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-04T16:34:38.677 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-04T16:34:38.677 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-04T16:34:38.677 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-04T16:34:38.677 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-04T16:34:38.678 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-04T16:34:38.678 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compression_opts.level: 32767 2024-09-04T16:34:38.678 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compression_opts.strategy: 0 2024-09-04T16:34:38.678 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-04T16:34:38.678 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-04T16:34:38.678 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-04T16:34:38.678 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-04T16:34:38.678 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compression_opts.enabled: false 2024-09-04T16:34:38.678 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-04T16:34:38.678 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-04T16:34:38.678 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-04T16:34:38.679 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-04T16:34:38.679 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.target_file_size_base: 67108864 2024-09-04T16:34:38.679 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-04T16:34:38.679 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-04T16:34:38.679 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-04T16:34:38.679 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-04T16:34:38.679 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-04T16:34:38.679 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-04T16:34:38.679 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-04T16:34:38.679 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-04T16:34:38.679 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-04T16:34:38.679 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-04T16:34:38.680 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-04T16:34:38.680 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-04T16:34:38.680 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-04T16:34:38.680 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-04T16:34:38.680 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.arena_block_size: 1048576 2024-09-04T16:34:38.680 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-04T16:34:38.680 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-04T16:34:38.680 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.disable_auto_compactions: 0 2024-09-04T16:34:38.681 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-04T16:34:38.681 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-04T16:34:38.681 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-04T16:34:38.681 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-04T16:34:38.681 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-04T16:34:38.681 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-04T16:34:38.681 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-04T16:34:38.681 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-04T16:34:38.681 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-04T16:34:38.681 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-04T16:34:38.681 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-04T16:34:38.681 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.inplace_update_support: 0 2024-09-04T16:34:38.682 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-04T16:34:38.683 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-04T16:34:38.683 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-04T16:34:38.683 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-04T16:34:38.683 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.bloom_locality: 0 2024-09-04T16:34:38.683 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.max_successive_merges: 0 2024-09-04T16:34:38.683 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-04T16:34:38.683 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.paranoid_file_checks: 0 2024-09-04T16:34:38.683 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.force_consistency_checks: 1 2024-09-04T16:34:38.683 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.report_bg_io_stats: 0 2024-09-04T16:34:38.683 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.ttl: 2592000 2024-09-04T16:34:38.683 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-04T16:34:38.684 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-04T16:34:38.684 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-04T16:34:38.684 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.enable_blob_files: false 2024-09-04T16:34:38.684 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.min_blob_size: 0 2024-09-04T16:34:38.684 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.blob_file_size: 268435456 2024-09-04T16:34:38.684 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-04T16:34:38.684 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-04T16:34:38.684 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-04T16:34:38.684 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-04T16:34:38.684 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-04T16:34:38.684 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.blob_file_starting_level: 0 2024-09-04T16:34:38.684 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-04T16:34:38.684 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-04T16:34:38.684 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi193/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12234, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-04T16:34:38.685 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-04T16:34:38.685 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 443a1b06-dc11-47b3-a280-c8962391c2af 2024-09-04T16:34:38.685 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725467678521192, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-04T16:34:38.685 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-04T16:34:38.685 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725467678532768, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2337714, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12239, "largest_seqno": 14369, "table_properties": {"data_size": 2328763, "index_size": 5729, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2181, "raw_key_size": 19870, "raw_average_key_size": 23, "raw_value_size": 2310474, "raw_average_value_size": 2711, "num_data_blocks": 263, "num_entries": 852, "num_filter_entries": 852, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725467678, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "443a1b06-dc11-47b3-a280-c8962391c2af", "db_session_id": "15E0HU201JUXAKLXNICD", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-04T16:34:38.685 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725467678532930, "job": 1, "event": "recovery_finished"} 2024-09-04T16:34:38.685 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-04T16:34:38.685 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-04T16:34:38.685 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi193/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-04T16:34:38.685 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ff49302e00 2024-09-04T16:34:38.685 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: DB pointer 0x55ff49402000 2024-09-04T16:34:38.685 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-04T16:34:38.685 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-04T16:34:38.686 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: ** DB Stats ** 2024-09-04T16:34:38.686 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-04T16:34:38.686 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-04T16:34:38.686 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-04T16:34:38.686 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-04T16:34:38.686 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-04T16:34:38.686 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-04T16:34:38.686 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-04T16:34:38.686 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: 2024-09-04T16:34:38.686 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: ** Compaction Stats [default] ** 2024-09-04T16:34:38.686 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-04T16:34:38.686 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-04T16:34:38.686 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: L0 1/0 2.23 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 578.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-04T16:34:38.686 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: L6 1/0 7.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-04T16:34:38.687 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Sum 2/0 9.41 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 578.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-04T16:34:38.687 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 578.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-04T16:34:38.687 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: 2024-09-04T16:34:38.687 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: ** Compaction Stats [default] ** 2024-09-04T16:34:38.687 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-04T16:34:38.687 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-04T16:34:38.687 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 578.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-04T16:34:38.687 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: 2024-09-04T16:34:38.687 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-04T16:34:38.687 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: 2024-09-04T16:34:38.687 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-04T16:34:38.687 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-04T16:34:38.687 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-04T16:34:38.687 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-04T16:34:38.687 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-04T16:34:38.688 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-04T16:34:38.688 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Cumulative compaction: 0.00 GB write, 136.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-04T16:34:38.688 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Interval compaction: 0.00 GB write, 136.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-04T16:34:38.688 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-04T16:34:38.688 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Block cache BinnedLRUCache@0x55ff492d2850#2 capacity: 512.00 MB usage: 8.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2024-09-04T16:34:38.688 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.28 KB,0.000435114%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-09-04T16:34:38.688 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: 2024-09-04T16:34:38.688 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-04T16:34:38.688 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: starting mon.smithi193 rank 1 at public addrs [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] at bind addrs [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi193 fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:34:38.688 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: mon.smithi193@-1(???) e2 preinit fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:34:38.688 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: mon.smithi193@-1(???).mds e15 new map 2024-09-04T16:34:38.688 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: mon.smithi193@-1(???).mds e15 print_map 2024-09-04T16:34:38.688 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: e15 2024-09-04T16:34:38.689 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: btime 2024-09-04T16:27:39:151187+0000 2024-09-04T16:34:38.689 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:34:38.689 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:34:38.689 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: legacy client fscid: 1 2024-09-04T16:34:38.689 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: 2024-09-04T16:34:38.689 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Filesystem 'cephfs' (1) 2024-09-04T16:34:38.689 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: fs_name cephfs 2024-09-04T16:34:38.689 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: epoch 15 2024-09-04T16:34:38.689 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-04T16:34:38.689 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:34:38.689 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: modified 2024-09-04T16:27:39.151182+0000 2024-09-04T16:34:38.689 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: tableserver 0 2024-09-04T16:34:38.689 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: root 0 2024-09-04T16:34:38.690 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: session_timeout 60 2024-09-04T16:34:38.690 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: session_autoclose 300 2024-09-04T16:34:38.690 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: max_file_size 1099511627776 2024-09-04T16:34:38.690 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: max_xattr_size 65536 2024-09-04T16:34:38.690 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: required_client_features {} 2024-09-04T16:34:38.690 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: last_failure 0 2024-09-04T16:34:38.690 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: last_failure_osd_epoch 45 2024-09-04T16:34:38.690 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:34:38.690 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: max_mds 2 2024-09-04T16:34:38.690 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: in 0,1 2024-09-04T16:34:38.690 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: up {0=14562,1=14578} 2024-09-04T16:34:38.691 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: failed 2024-09-04T16:34:38.691 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: damaged 2024-09-04T16:34:38.691 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: stopped 2024-09-04T16:34:38.691 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: data_pools [3] 2024-09-04T16:34:38.691 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: metadata_pool 2 2024-09-04T16:34:38.691 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: inline_data enabled 2024-09-04T16:34:38.691 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: balancer 2024-09-04T16:34:38.691 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: bal_rank_mask -1 2024-09-04T16:34:38.691 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: standby_count_wanted 1 2024-09-04T16:34:38.691 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: qdb_cluster leader: 14562 members: 14562,14578 2024-09-04T16:34:38.691 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: [mds.cephfs.smithi170.zkhdil{0:14562} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:34:38.691 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: [mds.cephfs.smithi170.rzbrux{1:14578} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:34:38.692 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: 2024-09-04T16:34:38.692 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: 2024-09-04T16:34:38.692 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: Standby daemons: 2024-09-04T16:34:38.692 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: 2024-09-04T16:34:38.692 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: [mds.cephfs.smithi193.kabapr{-1:24315} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.193:6826/288890560,v1:172.21.15.193:6827/288890560] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:34:38.692 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout: [mds.cephfs.smithi193.xostco{-1:24319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1128257367,v1:172.21.15.193:6825/1128257367] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:34:38.692 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: mon.smithi193@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-04T16:34:38.692 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: mon.smithi193@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-04T16:34:38.692 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: mon.smithi193@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-04T16:34:38.692 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: mon.smithi193@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-04T16:34:38.693 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 ceph-mon[82547]: mon.smithi193@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-04T16:34:38.693 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 bash[82528]: 6a9e9faed0c8c6a0fd937d7338cd4786efa9ef4764a0e4e51aa244f0f5c35173 2024-09-04T16:34:38.693 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:38 smithi193 systemd[1]: Started Ceph mon.smithi193 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:34:41.366 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-04T16:34:41.367 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-04T16:34:41.367 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: pgmap v113: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:41.367 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: mon.smithi193 calling monitor election 2024-09-04T16:34:41.367 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: mon.smithi170 calling monitor election 2024-09-04T16:34:41.367 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: mon.smithi170 is new leader, mons smithi170,smithi193 in quorum (ranks 0,1) 2024-09-04T16:34:41.368 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: monmap epoch 2 2024-09-04T16:34:41.368 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:34:41.368 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: last_changed 2024-09-04T16:23:09.098925+0000 2024-09-04T16:34:41.368 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: created 2024-09-04T16:20:42.443608+0000 2024-09-04T16:34:41.368 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: min_mon_release 19 (squid) 2024-09-04T16:34:41.368 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: election_strategy: 1 2024-09-04T16:34:41.368 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.smithi170 2024-09-04T16:34:41.369 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.smithi193 2024-09-04T16:34:41.369 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:active} 2 up:standby 2024-09-04T16:34:41.369 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: osdmap e47: 6 total, 6 up, 6 in 2024-09-04T16:34:41.369 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: mgrmap e33: smithi170.fbszap(active, since 3m), standbys: smithi193.gvfizn 2024-09-04T16:34:41.369 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-04T16:34:41.369 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:34:41.369 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:34:41.370 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:41.370 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:41.371 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:34:41.371 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:41 smithi193 ceph-mon[82547]: pgmap v114: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:41.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-04T16:34:41.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-04T16:34:41.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: pgmap v113: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:41.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: mon.smithi193 calling monitor election 2024-09-04T16:34:41.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: mon.smithi170 calling monitor election 2024-09-04T16:34:41.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: mon.smithi170 is new leader, mons smithi170,smithi193 in quorum (ranks 0,1) 2024-09-04T16:34:41.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: monmap epoch 2 2024-09-04T16:34:41.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T16:34:41.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: last_changed 2024-09-04T16:23:09.098925+0000 2024-09-04T16:34:41.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: created 2024-09-04T16:20:42.443608+0000 2024-09-04T16:34:41.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: min_mon_release 19 (squid) 2024-09-04T16:34:41.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: election_strategy: 1 2024-09-04T16:34:41.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: 0: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.smithi170 2024-09-04T16:34:41.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: 1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.smithi193 2024-09-04T16:34:41.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:active} 2 up:standby 2024-09-04T16:34:41.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: osdmap e47: 6 total, 6 up, 6 in 2024-09-04T16:34:41.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: mgrmap e33: smithi170.fbszap(active, since 3m), standbys: smithi193.gvfizn 2024-09-04T16:34:41.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-04T16:34:41.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:34:41.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:34:41.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:41.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:41.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:34:41.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:41 smithi170 ceph-mon[113855]: pgmap v114: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:43.850 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:43 smithi193 ceph-mon[82547]: pgmap v115: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:43.850 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:43 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:43.850 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:43 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:43.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:43 smithi170 ceph-mon[113855]: pgmap v115: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:43.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:43 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:43.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:43 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:44.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:34:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:44 smithi170 ceph-mon[113855]: pgmap v116: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:44.870 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:44.870 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:44.870 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:34:44.870 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:44 smithi193 ceph-mon[82547]: pgmap v116: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:47.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.847+0000 7f9bf6315640 1 -- 172.21.15.170:0/3696794660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bf0102b20 msgr2=0x7f9bf0102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:47.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.847+0000 7f9bf6315640 1 --2- 172.21.15.170:0/3696794660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bf0102b20 0x7f9bf0102f00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009880 tx=0x7f9be002a530 comp rx=0 tx=0).stop 2024-09-04T16:34:47.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.847+0000 7f9bf6315640 1 -- 172.21.15.170:0/3696794660 shutdown_connections 2024-09-04T16:34:47.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.847+0000 7f9bf6315640 1 --2- 172.21.15.170:0/3696794660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9bf0103440 0x7f9bf010b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:47.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.847+0000 7f9bf6315640 1 --2- 172.21.15.170:0/3696794660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bf0102b20 0x7f9bf0102f00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:47.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.847+0000 7f9bf6315640 1 -- 172.21.15.170:0/3696794660 >> 172.21.15.170:0/3696794660 conn(0x7f9bf00fc4c0 msgr2=0x7f9bf00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:47.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.847+0000 7f9bf6315640 1 -- 172.21.15.170:0/3696794660 shutdown_connections 2024-09-04T16:34:47.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.847+0000 7f9bf6315640 1 -- 172.21.15.170:0/3696794660 wait complete. 2024-09-04T16:34:47.848 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:47 smithi170 ceph-mon[113855]: pgmap v117: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:47.849 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:47.849 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:47.849 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:34:47.849 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:34:47.849 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:47.849 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:34:47.849 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:34:47.849 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:34:47.849 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:47.849 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi170"} : dispatch 2024-09-04T16:34:47.849 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi170"}]': finished 2024-09-04T16:34:47.849 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi193"} : dispatch 2024-09-04T16:34:47.849 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi193"}]': finished 2024-09-04T16:34:47.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.847+0000 7f9bf6315640 1 Processor -- start 2024-09-04T16:34:47.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.848+0000 7f9bf6315640 1 -- start start 2024-09-04T16:34:47.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.848+0000 7f9bf6315640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9bf0102b20 0x7f9bf019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:47.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.848+0000 7f9bf6315640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bf0103440 0x7f9bf019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:47.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.848+0000 7f9bf6315640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf010edb0 con 0x7f9bf0103440 2024-09-04T16:34:47.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.848+0000 7f9bf6315640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf010ec30 con 0x7f9bf0102b20 2024-09-04T16:34:47.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.848+0000 7f9be7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bf0103440 0x7f9bf019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:47.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.848+0000 7f9be7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bf0103440 0x7f9bf019db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60160/0 (socket says 172.21.15.170:60160) 2024-09-04T16:34:47.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.848+0000 7f9be7fff640 1 -- 172.21.15.170:0/3536836146 learned_addr learned my addr 172.21.15.170:0/3536836146 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:47.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.848+0000 7f9beffff640 1 --2- 172.21.15.170:0/3536836146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9bf0102b20 0x7f9bf019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:47.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.848+0000 7f9be7fff640 1 -- 172.21.15.170:0/3536836146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9bf0102b20 msgr2=0x7f9bf019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:47.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.848+0000 7f9be7fff640 1 --2- 172.21.15.170:0/3536836146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9bf0102b20 0x7f9bf019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:47.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.848+0000 7f9be7fff640 1 -- 172.21.15.170:0/3536836146 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf01977a0 con 0x7f9bf0103440 2024-09-04T16:34:47.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.849+0000 7f9be7fff640 1 --2- 172.21.15.170:0/3536836146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bf0103440 0x7f9bf019db60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800d8d0 tx=0x7f9bd800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:47.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.849+0000 7f9bedffb640 1 -- 172.21.15.170:0/3536836146 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9bd8017070 con 0x7f9bf0103440 2024-09-04T16:34:47.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.849+0000 7f9bedffb640 1 -- 172.21.15.170:0/3536836146 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9bd8010460 con 0x7f9bf0103440 2024-09-04T16:34:47.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.849+0000 7f9bedffb640 1 -- 172.21.15.170:0/3536836146 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9bd800f5f0 con 0x7f9bf0103440 2024-09-04T16:34:47.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.849+0000 7f9bf6315640 1 -- 172.21.15.170:0/3536836146 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf0197a90 con 0x7f9bf0103440 2024-09-04T16:34:47.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.849+0000 7f9bf6315640 1 -- 172.21.15.170:0/3536836146 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf0197f60 con 0x7f9bf0103440 2024-09-04T16:34:47.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.850+0000 7f9bf6315640 1 -- 172.21.15.170:0/3536836146 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf006a390 con 0x7f9bf0103440 2024-09-04T16:34:47.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.851+0000 7f9bedffb640 1 -- 172.21.15.170:0/3536836146 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f9bd8009a30 con 0x7f9bf0103440 2024-09-04T16:34:47.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.851+0000 7f9bedffb640 1 --2- 172.21.15.170:0/3536836146 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9bdc079e30 0x7f9bdc07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:47.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.851+0000 7f9bedffb640 1 -- 172.21.15.170:0/3536836146 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f9bd809c830 con 0x7f9bf0103440 2024-09-04T16:34:47.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.851+0000 7f9beffff640 1 --2- 172.21.15.170:0/3536836146 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9bdc079e30 0x7f9bdc07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:47.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.852+0000 7f9beffff640 1 --2- 172.21.15.170:0/3536836146 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9bdc079e30 0x7f9bdc07c2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9be00096c0 tx=0x7f9be0004f30 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:47.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:47.856+0000 7f9bedffb640 1 -- 172.21.15.170:0/3536836146 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9bd8068460 con 0x7f9bf0103440 2024-09-04T16:34:47.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:47 smithi193 ceph-mon[82547]: pgmap v117: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:47.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:47.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:47.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:34:47.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:34:47.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:47.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:34:47.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:34:47.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:34:47.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:47.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi170"} : dispatch 2024-09-04T16:34:47.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi170"}]': finished 2024-09-04T16:34:47.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi193"} : dispatch 2024-09-04T16:34:47.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi193"}]': finished 2024-09-04T16:34:48.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.053+0000 7f9bf6315640 1 -- 172.21.15.170:0/3536836146 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9bf0198270 con 0x7f9bdc079e30 2024-09-04T16:34:48.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.054+0000 7f9bedffb640 1 -- 172.21.15.170:0/3536836146 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f9bf0198270 con 0x7f9bdc079e30 2024-09-04T16:34:48.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.056+0000 7f9bf6315640 1 -- 172.21.15.170:0/3536836146 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9bdc079e30 msgr2=0x7f9bdc07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:48.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.056+0000 7f9bf6315640 1 --2- 172.21.15.170:0/3536836146 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9bdc079e30 0x7f9bdc07c2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9be00096c0 tx=0x7f9be0004f30 comp rx=0 tx=0).stop 2024-09-04T16:34:48.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.056+0000 7f9bf6315640 1 -- 172.21.15.170:0/3536836146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bf0103440 msgr2=0x7f9bf019db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:48.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.056+0000 7f9bf6315640 1 --2- 172.21.15.170:0/3536836146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bf0103440 0x7f9bf019db60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800d8d0 tx=0x7f9bd800dd90 comp rx=0 tx=0).stop 2024-09-04T16:34:48.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.056+0000 7f9bf6315640 1 -- 172.21.15.170:0/3536836146 shutdown_connections 2024-09-04T16:34:48.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.056+0000 7f9bf6315640 1 --2- 172.21.15.170:0/3536836146 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9bdc079e30 0x7f9bdc07c2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.056+0000 7f9bf6315640 1 --2- 172.21.15.170:0/3536836146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bf0103440 0x7f9bf019db60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.056+0000 7f9bf6315640 1 --2- 172.21.15.170:0/3536836146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9bf0102b20 0x7f9bf019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.056+0000 7f9bf6315640 1 -- 172.21.15.170:0/3536836146 >> 172.21.15.170:0/3536836146 conn(0x7f9bf00fc4c0 msgr2=0x7f9bf0103cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:48.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.057+0000 7f9bf6315640 1 -- 172.21.15.170:0/3536836146 shutdown_connections 2024-09-04T16:34:48.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.057+0000 7f9bf6315640 1 -- 172.21.15.170:0/3536836146 wait complete. 2024-09-04T16:34:48.066 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:34:48.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.143+0000 7fc6cec95640 1 -- 172.21.15.170:0/3448144736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c81067e0 msgr2=0x7fc6c8106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:48.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.143+0000 7fc6cec95640 1 --2- 172.21.15.170:0/3448144736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c81067e0 0x7fc6c8106bc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009880 tx=0x7fc6bc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.143+0000 7fc6cec95640 1 -- 172.21.15.170:0/3448144736 shutdown_connections 2024-09-04T16:34:48.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.143+0000 7fc6cec95640 1 --2- 172.21.15.170:0/3448144736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6c81007e0 0x7fc6c8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.143+0000 7fc6cec95640 1 --2- 172.21.15.170:0/3448144736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c81067e0 0x7fc6c8106bc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.143+0000 7fc6cec95640 1 -- 172.21.15.170:0/3448144736 >> 172.21.15.170:0/3448144736 conn(0x7fc6c80fc4c0 msgr2=0x7fc6c80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:48.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.143+0000 7fc6cec95640 1 -- 172.21.15.170:0/3448144736 shutdown_connections 2024-09-04T16:34:48.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.143+0000 7fc6cec95640 1 -- 172.21.15.170:0/3448144736 wait complete. 2024-09-04T16:34:48.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.144+0000 7fc6cec95640 1 Processor -- start 2024-09-04T16:34:48.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.144+0000 7fc6cec95640 1 -- start start 2024-09-04T16:34:48.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.144+0000 7fc6cec95640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6c81007e0 0x7fc6c8198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:48.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.144+0000 7fc6cec95640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c81067e0 0x7fc6c8198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:48.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.144+0000 7fc6cec95640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c810dcb0 con 0x7fc6c81067e0 2024-09-04T16:34:48.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.144+0000 7fc6cec95640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c810db30 con 0x7fc6c81007e0 2024-09-04T16:34:48.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.145+0000 7fc6c7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c81067e0 0x7fc6c8198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:48.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.145+0000 7fc6cca31640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6c81007e0 0x7fc6c8198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:48.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.145+0000 7fc6c7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c81067e0 0x7fc6c8198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60176/0 (socket says 172.21.15.170:60176) 2024-09-04T16:34:48.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.145+0000 7fc6c7fff640 1 -- 172.21.15.170:0/2476314766 learned_addr learned my addr 172.21.15.170:0/2476314766 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:48.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.145+0000 7fc6c7fff640 1 -- 172.21.15.170:0/2476314766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6c81007e0 msgr2=0x7fc6c8198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:48.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.145+0000 7fc6c7fff640 1 --2- 172.21.15.170:0/2476314766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6c81007e0 0x7fc6c8198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.145+0000 7fc6c7fff640 1 -- 172.21.15.170:0/2476314766 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c8199360 con 0x7fc6c81067e0 2024-09-04T16:34:48.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.145+0000 7fc6c7fff640 1 --2- 172.21.15.170:0/2476314766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c81067e0 0x7fc6c8198d60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400d6f0 tx=0x7fc6b400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:48.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.145+0000 7fc6c5ffb640 1 -- 172.21.15.170:0/2476314766 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6b4017070 con 0x7fc6c81067e0 2024-09-04T16:34:48.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.145+0000 7fc6c5ffb640 1 -- 172.21.15.170:0/2476314766 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc6b400de00 con 0x7fc6c81067e0 2024-09-04T16:34:48.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.145+0000 7fc6cec95640 1 -- 172.21.15.170:0/2476314766 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c8199650 con 0x7fc6c81067e0 2024-09-04T16:34:48.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.145+0000 7fc6c5ffb640 1 -- 172.21.15.170:0/2476314766 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6b4004bb0 con 0x7fc6c81067e0 2024-09-04T16:34:48.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.146+0000 7fc6cec95640 1 -- 172.21.15.170:0/2476314766 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c81a1c50 con 0x7fc6c81067e0 2024-09-04T16:34:48.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.147+0000 7fc6cec95640 1 -- 172.21.15.170:0/2476314766 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c8101f20 con 0x7fc6c81067e0 2024-09-04T16:34:48.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.147+0000 7fc6c5ffb640 1 -- 172.21.15.170:0/2476314766 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fc6b4009a30 con 0x7fc6c81067e0 2024-09-04T16:34:48.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.148+0000 7fc6c5ffb640 1 --2- 172.21.15.170:0/2476314766 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc6b8079e80 0x7fc6b807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:48.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.148+0000 7fc6cca31640 1 --2- 172.21.15.170:0/2476314766 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc6b8079e80 0x7fc6b807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:48.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.148+0000 7fc6c5ffb640 1 -- 172.21.15.170:0/2476314766 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fc6b409c4b0 con 0x7fc6c81067e0 2024-09-04T16:34:48.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.148+0000 7fc6cca31640 1 --2- 172.21.15.170:0/2476314766 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc6b8079e80 0x7fc6b807c340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0096c0 tx=0x7fc6bc031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:48.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.152+0000 7fc6c5ffb640 1 -- 172.21.15.170:0/2476314766 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc6c8199650 con 0x7fc6c81067e0 2024-09-04T16:34:48.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.359+0000 7fc6cec95640 1 -- 172.21.15.170:0/2476314766 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc6c8062630 con 0x7fc6b8079e80 2024-09-04T16:34:48.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.360+0000 7fc6c5ffb640 1 -- 172.21.15.170:0/2476314766 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7fc6c8062630 con 0x7fc6b8079e80 2024-09-04T16:34:48.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.363+0000 7fc6cec95640 1 -- 172.21.15.170:0/2476314766 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc6b8079e80 msgr2=0x7fc6b807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:48.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.363+0000 7fc6cec95640 1 --2- 172.21.15.170:0/2476314766 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc6b8079e80 0x7fc6b807c340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0096c0 tx=0x7fc6bc031400 comp rx=0 tx=0).stop 2024-09-04T16:34:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.363+0000 7fc6cec95640 1 -- 172.21.15.170:0/2476314766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c81067e0 msgr2=0x7fc6c8198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.363+0000 7fc6cec95640 1 --2- 172.21.15.170:0/2476314766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c81067e0 0x7fc6c8198d60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400d6f0 tx=0x7fc6b400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.363+0000 7fc6cec95640 1 -- 172.21.15.170:0/2476314766 shutdown_connections 2024-09-04T16:34:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.363+0000 7fc6cec95640 1 --2- 172.21.15.170:0/2476314766 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc6b8079e80 0x7fc6b807c340 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.363+0000 7fc6cec95640 1 --2- 172.21.15.170:0/2476314766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6c81067e0 0x7fc6c8198d60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.363+0000 7fc6cec95640 1 --2- 172.21.15.170:0/2476314766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6c81007e0 0x7fc6c8198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.363+0000 7fc6cec95640 1 -- 172.21.15.170:0/2476314766 >> 172.21.15.170:0/2476314766 conn(0x7fc6c80fc4c0 msgr2=0x7fc6c80fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.363+0000 7fc6cec95640 1 -- 172.21.15.170:0/2476314766 shutdown_connections 2024-09-04T16:34:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.363+0000 7fc6cec95640 1 -- 172.21.15.170:0/2476314766 wait complete. 2024-09-04T16:34:48.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.454+0000 7f8d8569f640 1 -- 172.21.15.170:0/2534223356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d80102aa0 msgr2=0x7f8d80102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:48.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.454+0000 7f8d8569f640 1 --2- 172.21.15.170:0/2534223356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d80102aa0 0x7f8d80102e80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8d70009880 tx=0x7f8d7002a530 comp rx=0 tx=0).stop 2024-09-04T16:34:48.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.454+0000 7f8d8569f640 1 -- 172.21.15.170:0/2534223356 shutdown_connections 2024-09-04T16:34:48.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.454+0000 7f8d8569f640 1 --2- 172.21.15.170:0/2534223356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d801033c0 0x7f8d8010b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.454+0000 7f8d8569f640 1 --2- 172.21.15.170:0/2534223356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d80102aa0 0x7f8d80102e80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.454+0000 7f8d8569f640 1 -- 172.21.15.170:0/2534223356 >> 172.21.15.170:0/2534223356 conn(0x7f8d800fc4c0 msgr2=0x7f8d800fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:48.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.454+0000 7f8d8569f640 1 -- 172.21.15.170:0/2534223356 shutdown_connections 2024-09-04T16:34:48.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.454+0000 7f8d8569f640 1 -- 172.21.15.170:0/2534223356 wait complete. 2024-09-04T16:34:48.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.454+0000 7f8d8569f640 1 Processor -- start 2024-09-04T16:34:48.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.455+0000 7f8d8569f640 1 -- start start 2024-09-04T16:34:48.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.455+0000 7f8d8569f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d80102aa0 0x7f8d80100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.455+0000 7f8d8569f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d801033c0 0x7f8d80100c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.455+0000 7f8d8569f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8010edb0 con 0x7f8d801033c0 2024-09-04T16:34:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.455+0000 7f8d8569f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8010ec30 con 0x7f8d80102aa0 2024-09-04T16:34:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.455+0000 7f8d7e7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d801033c0 0x7f8d80100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.455+0000 7f8d7e7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d801033c0 0x7f8d80100c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60196/0 (socket says 172.21.15.170:60196) 2024-09-04T16:34:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.455+0000 7f8d7e7fc640 1 -- 172.21.15.170:0/242450578 learned_addr learned my addr 172.21.15.170:0/242450578 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.455+0000 7f8d7effd640 1 --2- 172.21.15.170:0/242450578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d80102aa0 0x7f8d80100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.455+0000 7f8d7e7fc640 1 -- 172.21.15.170:0/242450578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d80102aa0 msgr2=0x7f8d80100700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.455+0000 7f8d7e7fc640 1 --2- 172.21.15.170:0/242450578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d80102aa0 0x7f8d80100700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.455+0000 7f8d7e7fc640 1 -- 172.21.15.170:0/242450578 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d80101180 con 0x7f8d801033c0 2024-09-04T16:34:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.455+0000 7f8d7e7fc640 1 --2- 172.21.15.170:0/242450578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d801033c0 0x7f8d80100c40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400d6c0 tx=0x7f8d7400db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.455+0000 7f8d67fff640 1 -- 172.21.15.170:0/242450578 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d74017070 con 0x7f8d801033c0 2024-09-04T16:34:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.456+0000 7f8d8569f640 1 -- 172.21.15.170:0/242450578 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d80101470 con 0x7f8d801033c0 2024-09-04T16:34:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.456+0000 7f8d67fff640 1 -- 172.21.15.170:0/242450578 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d74009ce0 con 0x7f8d801033c0 2024-09-04T16:34:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.456+0000 7f8d67fff640 1 -- 172.21.15.170:0/242450578 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d7400f3c0 con 0x7f8d801033c0 2024-09-04T16:34:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.456+0000 7f8d8569f640 1 -- 172.21.15.170:0/242450578 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d801a3e20 con 0x7f8d801033c0 2024-09-04T16:34:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.457+0000 7f8d8569f640 1 -- 172.21.15.170:0/242450578 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d8006a410 con 0x7f8d801033c0 2024-09-04T16:34:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.457+0000 7f8d67fff640 1 -- 172.21.15.170:0/242450578 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f8d74010460 con 0x7f8d801033c0 2024-09-04T16:34:48.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.458+0000 7f8d67fff640 1 --2- 172.21.15.170:0/242450578 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d68079e30 0x7f8d6807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:48.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.458+0000 7f8d67fff640 1 -- 172.21.15.170:0/242450578 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f8d7409c7d0 con 0x7f8d801033c0 2024-09-04T16:34:48.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.458+0000 7f8d7effd640 1 --2- 172.21.15.170:0/242450578 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d68079e30 0x7f8d6807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:48.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.459+0000 7f8d7effd640 1 --2- 172.21.15.170:0/242450578 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d68079e30 0x7f8d6807c2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8d700096c0 tx=0x7f8d70031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:48.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.462+0000 7f8d67fff640 1 -- 172.21.15.170:0/242450578 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8d74064290 con 0x7f8d801033c0 2024-09-04T16:34:48.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.649+0000 7f8d8569f640 1 -- 172.21.15.170:0/242450578 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8d80062630 con 0x7f8d68079e30 2024-09-04T16:34:48.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.659+0000 7f8d67fff640 1 -- 172.21.15.170:0/242450578 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f8d80062630 con 0x7f8d68079e30 2024-09-04T16:34:48.660 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:34:48.660 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (107s) 18s ago 12m 22.0M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:34:48.660 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (4m) 18s ago 12m 8900k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:34:48.660 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (4m) 5s ago 11m 8300k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:34:48.660 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (12m) 18s ago 12m 6891k - 19.1.1-252-g48920dab b708f9119ac7 aa2ec5c5776a 2024-09-04T16:34:48.660 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (11m) 5s ago 11m 6895k - 19.1.1-252-g48920dab b708f9119ac7 a24f0ce3b3fb 2024-09-04T16:34:48.660 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (85s) 18s ago 12m 74.3M - c8b91775d855 6e3778aab5e6 2024-09-04T16:34:48.660 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (7m) 18s ago 7m 27.4M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:34:48.660 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (7m) 18s ago 7m 146M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:34:48.660 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (7m) 5s ago 7m 16.8M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:34:48.660 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (7m) 5s ago 7m 16.3M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:34:48.660 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (4m) 18s ago 13m 523M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:34:48.660 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (2m) 5s ago 11m 456M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:34:48.661 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (27s) 18s ago 14m 24.3M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:34:48.661 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (10s) 5s ago 11m 19.6M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:34:48.661 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (2m) 18s ago 12m 11.0M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:34:48.661 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (2m) 5s ago 11m 11.8M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:34:48.661 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (10m) 18s ago 10m 211M 1216M 19.1.1-252-g48920dab b708f9119ac7 6c2ea484615d 2024-09-04T16:34:48.661 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (10m) 18s ago 10m 228M 1216M 19.1.1-252-g48920dab b708f9119ac7 20469ba5727b 2024-09-04T16:34:48.661 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (9m) 18s ago 9m 183M 1216M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:34:48.661 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (9m) 5s ago 9m 247M 2240M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:34:48.661 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (8m) 5s ago 8m 210M 2240M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:34:48.661 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (8m) 5s ago 8m 190M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:34:48.661 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (2m) 18s ago 12m 49.2M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:34:48.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.661+0000 7f8d8569f640 1 -- 172.21.15.170:0/242450578 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d68079e30 msgr2=0x7f8d6807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:48.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.661+0000 7f8d8569f640 1 --2- 172.21.15.170:0/242450578 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d68079e30 0x7f8d6807c2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8d700096c0 tx=0x7f8d70031400 comp rx=0 tx=0).stop 2024-09-04T16:34:48.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.661+0000 7f8d8569f640 1 -- 172.21.15.170:0/242450578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d801033c0 msgr2=0x7f8d80100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:48.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.661+0000 7f8d8569f640 1 --2- 172.21.15.170:0/242450578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d801033c0 0x7f8d80100c40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400d6c0 tx=0x7f8d7400db80 comp rx=0 tx=0).stop 2024-09-04T16:34:48.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.661+0000 7f8d8569f640 1 -- 172.21.15.170:0/242450578 shutdown_connections 2024-09-04T16:34:48.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.661+0000 7f8d8569f640 1 --2- 172.21.15.170:0/242450578 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d68079e30 0x7f8d6807c2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.661+0000 7f8d8569f640 1 --2- 172.21.15.170:0/242450578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d801033c0 0x7f8d80100c40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.661+0000 7f8d8569f640 1 --2- 172.21.15.170:0/242450578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d80102aa0 0x7f8d80100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.661+0000 7f8d8569f640 1 -- 172.21.15.170:0/242450578 >> 172.21.15.170:0/242450578 conn(0x7f8d800fc4c0 msgr2=0x7f8d80108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:48.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.661+0000 7f8d8569f640 1 -- 172.21.15.170:0/242450578 shutdown_connections 2024-09-04T16:34:48.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.661+0000 7f8d8569f640 1 -- 172.21.15.170:0/242450578 wait complete. 2024-09-04T16:34:48.696 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:48 smithi170 ceph-mon[113855]: Upgrade: Setting container_image for all mon 2024-09-04T16:34:48.697 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:48 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:48.697 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:48 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi170", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-04T16:34:48.697 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:48 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:34:48.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.748+0000 7f5f5059f640 1 -- 172.21.15.170:0/1287376529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f48100820 msgr2=0x7f5f48100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:48.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.748+0000 7f5f5059f640 1 --2- 172.21.15.170:0/1287376529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f48100820 0x7f5f48100c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009880 tx=0x7f5f3c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.748+0000 7f5f5059f640 1 -- 172.21.15.170:0/1287376529 shutdown_connections 2024-09-04T16:34:48.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.748+0000 7f5f5059f640 1 --2- 172.21.15.170:0/1287376529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f48100820 0x7f5f48100c80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.748+0000 7f5f5059f640 1 --2- 172.21.15.170:0/1287376529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f48106820 0x7f5f48106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.748+0000 7f5f5059f640 1 -- 172.21.15.170:0/1287376529 >> 172.21.15.170:0/1287376529 conn(0x7f5f480fc520 msgr2=0x7f5f480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:48.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.748+0000 7f5f5059f640 1 -- 172.21.15.170:0/1287376529 shutdown_connections 2024-09-04T16:34:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.748+0000 7f5f5059f640 1 -- 172.21.15.170:0/1287376529 wait complete. 2024-09-04T16:34:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.748+0000 7f5f5059f640 1 Processor -- start 2024-09-04T16:34:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.748+0000 7f5f5059f640 1 -- start start 2024-09-04T16:34:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.748+0000 7f5f5059f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f48100820 0x7f5f480fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f5059f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f48106820 0x7f5f480fd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f5059f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4810dcd0 con 0x7f5f48106820 2024-09-04T16:34:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f5059f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4810db50 con 0x7f5f48100820 2024-09-04T16:34:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f4db3a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f48106820 0x7f5f480fd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f4db3a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f48106820 0x7f5f480fd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60216/0 (socket says 172.21.15.170:60216) 2024-09-04T16:34:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f4db3a640 1 -- 172.21.15.170:0/962232823 learned_addr learned my addr 172.21.15.170:0/962232823 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f4e33b640 1 --2- 172.21.15.170:0/962232823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f48100820 0x7f5f480fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f4db3a640 1 -- 172.21.15.170:0/962232823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f48100820 msgr2=0x7f5f480fcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f4db3a640 1 --2- 172.21.15.170:0/962232823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f48100820 0x7f5f480fcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f4db3a640 1 -- 172.21.15.170:0/962232823 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f480fd6a0 con 0x7f5f48106820 2024-09-04T16:34:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f4e33b640 1 --2- 172.21.15.170:0/962232823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f48100820 0x7f5f480fcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:34:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f4db3a640 1 --2- 172.21.15.170:0/962232823 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f48106820 0x7f5f480fd160 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c031460 tx=0x7f5f3c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f477fe640 1 -- 172.21.15.170:0/962232823 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f3c03f070 con 0x7f5f48106820 2024-09-04T16:34:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f5059f640 1 -- 172.21.15.170:0/962232823 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f480fd930 con 0x7f5f48106820 2024-09-04T16:34:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f477fe640 1 -- 172.21.15.170:0/962232823 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f3c0035f0 con 0x7f5f48106820 2024-09-04T16:34:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f477fe640 1 -- 172.21.15.170:0/962232823 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f3c035030 con 0x7f5f48106820 2024-09-04T16:34:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.749+0000 7f5f5059f640 1 -- 172.21.15.170:0/962232823 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f481a3d80 con 0x7f5f48106820 2024-09-04T16:34:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.750+0000 7f5f5059f640 1 -- 172.21.15.170:0/962232823 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f48101f60 con 0x7f5f48106820 2024-09-04T16:34:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.751+0000 7f5f477fe640 1 -- 172.21.15.170:0/962232823 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5f3c042070 con 0x7f5f48106820 2024-09-04T16:34:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.752+0000 7f5f477fe640 1 --2- 172.21.15.170:0/962232823 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f30079e30 0x7f5f3007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.752+0000 7f5f4e33b640 1 --2- 172.21.15.170:0/962232823 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f30079e30 0x7f5f3007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.752+0000 7f5f477fe640 1 -- 172.21.15.170:0/962232823 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f5f3c0bd3b0 con 0x7f5f48106820 2024-09-04T16:34:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.752+0000 7f5f4e33b640 1 --2- 172.21.15.170:0/962232823 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f30079e30 0x7f5f3007c2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5f38005fd0 tx=0x7f5f38009520 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:48.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:48.756+0000 7f5f477fe640 1 -- 172.21.15.170:0/962232823 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5f3c084e70 con 0x7f5f48106820 2024-09-04T16:34:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:48 smithi193 ceph-mon[82547]: Upgrade: Setting container_image for all mon 2024-09-04T16:34:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:48 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:48 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi170", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-04T16:34:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:48 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:34:49.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.007+0000 7f5f5059f640 1 -- 172.21.15.170:0/962232823 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5f4802d7c0 con 0x7f5f48106820 2024-09-04T16:34:49.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.008+0000 7f5f477fe640 1 -- 172.21.15.170:0/962232823 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+733 (secure 0 0 0) 0x7f5f3c08d320 con 0x7f5f48106820 2024-09-04T16:34:49.009 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:34:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:34:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:34:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:34:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:34:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:34:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:34:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:34:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 6 2024-09-04T16:34:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:34:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:34:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:34:49.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:34:49.010 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:34:49.010 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 10, 2024-09-04T16:34:49.010 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:34:49.010 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:34:49.010 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:34:49.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.010+0000 7f5f5059f640 1 -- 172.21.15.170:0/962232823 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f30079e30 msgr2=0x7f5f3007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:49.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.010+0000 7f5f5059f640 1 --2- 172.21.15.170:0/962232823 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f30079e30 0x7f5f3007c2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5f38005fd0 tx=0x7f5f38009520 comp rx=0 tx=0).stop 2024-09-04T16:34:49.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.010+0000 7f5f5059f640 1 -- 172.21.15.170:0/962232823 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f48106820 msgr2=0x7f5f480fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:49.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.010+0000 7f5f5059f640 1 --2- 172.21.15.170:0/962232823 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f48106820 0x7f5f480fd160 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c031460 tx=0x7f5f3c0045e0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.010+0000 7f5f5059f640 1 -- 172.21.15.170:0/962232823 shutdown_connections 2024-09-04T16:34:49.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.010+0000 7f5f5059f640 1 --2- 172.21.15.170:0/962232823 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f30079e30 0x7f5f3007c2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.010+0000 7f5f5059f640 1 --2- 172.21.15.170:0/962232823 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f48106820 0x7f5f480fd160 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.010+0000 7f5f5059f640 1 --2- 172.21.15.170:0/962232823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f48100820 0x7f5f480fcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.010+0000 7f5f5059f640 1 -- 172.21.15.170:0/962232823 >> 172.21.15.170:0/962232823 conn(0x7f5f480fc520 msgr2=0x7f5f4806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:49.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.010+0000 7f5f5059f640 1 -- 172.21.15.170:0/962232823 shutdown_connections 2024-09-04T16:34:49.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.010+0000 7f5f5059f640 1 -- 172.21.15.170:0/962232823 wait complete. 2024-09-04T16:34:49.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.095+0000 7f37ad650640 1 -- 172.21.15.170:0/1961011192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a81007e0 msgr2=0x7f37a8100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:49.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.095+0000 7f37ad650640 1 --2- 172.21.15.170:0/1961011192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a81007e0 0x7f37a8100c40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f379c009880 tx=0x7f379c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.095+0000 7f37ad650640 1 -- 172.21.15.170:0/1961011192 shutdown_connections 2024-09-04T16:34:49.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.095+0000 7f37ad650640 1 --2- 172.21.15.170:0/1961011192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a81007e0 0x7f37a8100c40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.095+0000 7f37ad650640 1 --2- 172.21.15.170:0/1961011192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37a81067e0 0x7f37a8106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.095+0000 7f37ad650640 1 -- 172.21.15.170:0/1961011192 >> 172.21.15.170:0/1961011192 conn(0x7f37a80fc4c0 msgr2=0x7f37a80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:49.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.095+0000 7f37ad650640 1 -- 172.21.15.170:0/1961011192 shutdown_connections 2024-09-04T16:34:49.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.095+0000 7f37ad650640 1 -- 172.21.15.170:0/1961011192 wait complete. 2024-09-04T16:34:49.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.095+0000 7f37ad650640 1 Processor -- start 2024-09-04T16:34:49.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.096+0000 7f37ad650640 1 -- start start 2024-09-04T16:34:49.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.096+0000 7f37ad650640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37a81007e0 0x7f37a819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.096+0000 7f37ad650640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a81067e0 0x7f37a819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.096+0000 7f37ad650640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f37a810dc90 con 0x7f37a81067e0 2024-09-04T16:34:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.096+0000 7f37ad650640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f37a810db10 con 0x7f37a81007e0 2024-09-04T16:34:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.096+0000 7f37a67fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a81067e0 0x7f37a819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.096+0000 7f37a67fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a81067e0 0x7f37a819db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60232/0 (socket says 172.21.15.170:60232) 2024-09-04T16:34:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.096+0000 7f37a67fc640 1 -- 172.21.15.170:0/483498080 learned_addr learned my addr 172.21.15.170:0/483498080 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.096+0000 7f37a6ffd640 1 --2- 172.21.15.170:0/483498080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37a81007e0 0x7f37a819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.096+0000 7f37a67fc640 1 -- 172.21.15.170:0/483498080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37a81007e0 msgr2=0x7f37a819d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.096+0000 7f37a67fc640 1 --2- 172.21.15.170:0/483498080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37a81007e0 0x7f37a819d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.096+0000 7f37a67fc640 1 -- 172.21.15.170:0/483498080 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a81977a0 con 0x7f37a81067e0 2024-09-04T16:34:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.096+0000 7f37a67fc640 1 --2- 172.21.15.170:0/483498080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a81067e0 0x7f37a819db60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f379c031460 tx=0x7f379c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.097+0000 7f378ffff640 1 -- 172.21.15.170:0/483498080 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f379c03f070 con 0x7f37a81067e0 2024-09-04T16:34:49.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.097+0000 7f378ffff640 1 -- 172.21.15.170:0/483498080 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f379c0035f0 con 0x7f37a81067e0 2024-09-04T16:34:49.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.097+0000 7f37ad650640 1 -- 172.21.15.170:0/483498080 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a8197a30 con 0x7f37a81067e0 2024-09-04T16:34:49.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.097+0000 7f378ffff640 1 -- 172.21.15.170:0/483498080 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f379c035030 con 0x7f37a81067e0 2024-09-04T16:34:49.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.097+0000 7f37ad650640 1 -- 172.21.15.170:0/483498080 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a8197f60 con 0x7f37a81067e0 2024-09-04T16:34:49.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.098+0000 7f37ad650640 1 -- 172.21.15.170:0/483498080 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37a8101f20 con 0x7f37a81067e0 2024-09-04T16:34:49.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.098+0000 7f378ffff640 1 -- 172.21.15.170:0/483498080 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f379c042070 con 0x7f37a81067e0 2024-09-04T16:34:49.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.099+0000 7f378ffff640 1 --2- 172.21.15.170:0/483498080 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3790079e30 0x7f379007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:49.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.099+0000 7f378ffff640 1 -- 172.21.15.170:0/483498080 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f379c0bd300 con 0x7f37a81067e0 2024-09-04T16:34:49.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.099+0000 7f37a6ffd640 1 --2- 172.21.15.170:0/483498080 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3790079e30 0x7f379007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:49.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.100+0000 7f37a6ffd640 1 --2- 172.21.15.170:0/483498080 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3790079e30 0x7f379007c2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f379800bbe0 tx=0x7f379800b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:49.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.103+0000 7f378ffff640 1 -- 172.21.15.170:0/483498080 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f379c088f30 con 0x7f37a81067e0 2024-09-04T16:34:49.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.326+0000 7f37ad650640 1 -- 172.21.15.170:0/483498080 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f37a8109d80 con 0x7f37a81067e0 2024-09-04T16:34:49.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.327+0000 7f378ffff640 1 -- 172.21.15.170:0/483498080 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2036 (secure 0 0 0) 0x7f379c08d950 con 0x7f37a81067e0 2024-09-04T16:34:49.328 INFO:teuthology.orchestra.run.smithi170.stdout:e15 2024-09-04T16:34:49.328 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:27:39:151187+0000 2024-09-04T16:34:49.328 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:34:49.328 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:34:49.328 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:34:49.328 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:34:49.329 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:34:49.329 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:34:49.329 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 15 2024-09-04T16:34:49.329 INFO:teuthology.orchestra.run.smithi170.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-04T16:34:49.329 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:34:49.329 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:27:39.151182+0000 2024-09-04T16:34:49.329 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:34:49.329 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:34:49.329 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:34:49.329 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:34:49.329 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:34:49.329 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:34:49.329 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:34:49.329 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:34:49.330 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 45 2024-09-04T16:34:49.330 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:34:49.330 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:34:49.330 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:34:49.330 INFO:teuthology.orchestra.run.smithi170.stdout:up {0=14562,1=14578} 2024-09-04T16:34:49.330 INFO:teuthology.orchestra.run.smithi170.stdout:failed 2024-09-04T16:34:49.330 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:34:49.330 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:34:49.330 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:34:49.330 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:34:49.330 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:34:49.330 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:34:49.330 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:34:49.330 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:34:49.331 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 14562 members: 14562,14578 2024-09-04T16:34:49.331 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{0:14562} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:34:49.331 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{1:14578} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:34:49.331 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:34:49.331 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:34:49.331 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:34:49.331 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:34:49.331 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:24315} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.193:6826/288890560,v1:172.21.15.193:6827/288890560] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:34:49.331 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:24319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1128257367,v1:172.21.15.193:6825/1128257367] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:34:49.332 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 15 2024-09-04T16:34:49.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.330+0000 7f37ad650640 1 -- 172.21.15.170:0/483498080 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3790079e30 msgr2=0x7f379007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:49.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.330+0000 7f37ad650640 1 --2- 172.21.15.170:0/483498080 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3790079e30 0x7f379007c2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f379800bbe0 tx=0x7f379800b390 comp rx=0 tx=0).stop 2024-09-04T16:34:49.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.330+0000 7f37ad650640 1 -- 172.21.15.170:0/483498080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a81067e0 msgr2=0x7f37a819db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:49.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.330+0000 7f37ad650640 1 --2- 172.21.15.170:0/483498080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a81067e0 0x7f37a819db60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f379c031460 tx=0x7f379c0045e0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.330+0000 7f37ad650640 1 -- 172.21.15.170:0/483498080 shutdown_connections 2024-09-04T16:34:49.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.330+0000 7f37ad650640 1 --2- 172.21.15.170:0/483498080 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3790079e30 0x7f379007c2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.330+0000 7f37ad650640 1 --2- 172.21.15.170:0/483498080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37a81067e0 0x7f37a819db60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.330+0000 7f37ad650640 1 --2- 172.21.15.170:0/483498080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37a81007e0 0x7f37a819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.330+0000 7f37ad650640 1 -- 172.21.15.170:0/483498080 >> 172.21.15.170:0/483498080 conn(0x7f37a80fc4c0 msgr2=0x7f37a8069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:49.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.330+0000 7f37ad650640 1 -- 172.21.15.170:0/483498080 shutdown_connections 2024-09-04T16:34:49.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.330+0000 7f37ad650640 1 -- 172.21.15.170:0/483498080 wait complete. 2024-09-04T16:34:49.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.415+0000 7ffb96d8e640 1 -- 172.21.15.170:0/460402116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb90107910 msgr2=0x7ffb90107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:49.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.415+0000 7ffb96d8e640 1 --2- 172.21.15.170:0/460402116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb90107910 0x7ffb90107cf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009880 tx=0x7ffb8802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.415+0000 7ffb96d8e640 1 -- 172.21.15.170:0/460402116 shutdown_connections 2024-09-04T16:34:49.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.415+0000 7ffb96d8e640 1 --2- 172.21.15.170:0/460402116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb90101910 0x7ffb90101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.415+0000 7ffb96d8e640 1 --2- 172.21.15.170:0/460402116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb90107910 0x7ffb90107cf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.415+0000 7ffb96d8e640 1 -- 172.21.15.170:0/460402116 >> 172.21.15.170:0/460402116 conn(0x7ffb900fd5f0 msgr2=0x7ffb900ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:49.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.415+0000 7ffb96d8e640 1 -- 172.21.15.170:0/460402116 shutdown_connections 2024-09-04T16:34:49.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.415+0000 7ffb96d8e640 1 -- 172.21.15.170:0/460402116 wait complete. 2024-09-04T16:34:49.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.415+0000 7ffb96d8e640 1 Processor -- start 2024-09-04T16:34:49.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.416+0000 7ffb96d8e640 1 -- start start 2024-09-04T16:34:49.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.416+0000 7ffb96d8e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb90101910 0x7ffb900744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:49.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.416+0000 7ffb96d8e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb90107910 0x7ffb90074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:49.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.416+0000 7ffb96d8e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9010ee40 con 0x7ffb90101910 2024-09-04T16:34:49.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.416+0000 7ffb96d8e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9010ecc0 con 0x7ffb90107910 2024-09-04T16:34:49.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.416+0000 7ffb94b2a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb90101910 0x7ffb900744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:49.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.416+0000 7ffb94b2a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb90101910 0x7ffb900744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60240/0 (socket says 172.21.15.170:60240) 2024-09-04T16:34:49.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.416+0000 7ffb94b2a640 1 -- 172.21.15.170:0/3577327939 learned_addr learned my addr 172.21.15.170:0/3577327939 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:49.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.416+0000 7ffb8ffff640 1 --2- 172.21.15.170:0/3577327939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb90107910 0x7ffb90074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:49.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.416+0000 7ffb94b2a640 1 -- 172.21.15.170:0/3577327939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb90107910 msgr2=0x7ffb90074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:49.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.416+0000 7ffb94b2a640 1 --2- 172.21.15.170:0/3577327939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb90107910 0x7ffb90074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.416+0000 7ffb94b2a640 1 -- 172.21.15.170:0/3577327939 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb90074f70 con 0x7ffb90101910 2024-09-04T16:34:49.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.416+0000 7ffb94b2a640 1 --2- 172.21.15.170:0/3577327939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb90101910 0x7ffb900744f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ffb88031460 tx=0x7ffb880048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:49.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.417+0000 7ffb8dffb640 1 -- 172.21.15.170:0/3577327939 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffb8803f070 con 0x7ffb90101910 2024-09-04T16:34:49.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.417+0000 7ffb8dffb640 1 -- 172.21.15.170:0/3577327939 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffb88004cf0 con 0x7ffb90101910 2024-09-04T16:34:49.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.417+0000 7ffb96d8e640 1 -- 172.21.15.170:0/3577327939 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb90075200 con 0x7ffb90101910 2024-09-04T16:34:49.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.417+0000 7ffb8dffb640 1 -- 172.21.15.170:0/3577327939 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffb88035030 con 0x7ffb90101910 2024-09-04T16:34:49.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.417+0000 7ffb96d8e640 1 -- 172.21.15.170:0/3577327939 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb901a3e10 con 0x7ffb90101910 2024-09-04T16:34:49.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.418+0000 7ffb96d8e640 1 -- 172.21.15.170:0/3577327939 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb90103050 con 0x7ffb90101910 2024-09-04T16:34:49.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.422+0000 7ffb8dffb640 1 -- 172.21.15.170:0/3577327939 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ffb88042070 con 0x7ffb90101910 2024-09-04T16:34:49.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.422+0000 7ffb8dffb640 1 --2- 172.21.15.170:0/3577327939 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffb7c079e80 0x7ffb7c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:49.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.422+0000 7ffb8dffb640 1 -- 172.21.15.170:0/3577327939 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7ffb880bdb50 con 0x7ffb90101910 2024-09-04T16:34:49.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.422+0000 7ffb8ffff640 1 --2- 172.21.15.170:0/3577327939 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffb7c079e80 0x7ffb7c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:49.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.423+0000 7ffb8ffff640 1 --2- 172.21.15.170:0/3577327939 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffb7c079e80 0x7ffb7c07c340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffb90075f80 tx=0x7ffb800094f0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:49.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.426+0000 7ffb8dffb640 1 -- 172.21.15.170:0/3577327939 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ffb880bde20 con 0x7ffb90101910 2024-09-04T16:34:49.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:49 smithi170 ceph-mon[113855]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:49.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:49 smithi170 ceph-mon[113855]: Upgrade: Updating crash.smithi170 (1/2) 2024-09-04T16:34:49.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:49 smithi170 ceph-mon[113855]: Deploying daemon crash.smithi170 on smithi170 2024-09-04T16:34:49.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:49 smithi170 ceph-mon[113855]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:49.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:49 smithi170 ceph-mon[113855]: pgmap v118: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:49.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:49 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/962232823' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:34:49.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:49 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/483498080' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:34:49.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.621+0000 7ffb96d8e640 1 -- 172.21.15.170:0/3577327939 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ffb90109ef0 con 0x7ffb7c079e80 2024-09-04T16:34:49.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.623+0000 7ffb8dffb640 1 -- 172.21.15.170:0/3577327939 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7ffb800173f0 con 0x7ffb7c079e80 2024-09-04T16:34:49.623 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:34:49.623 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:34:49.624 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:34:49.624 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:34:49.624 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:34:49.624 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-04T16:34:49.624 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-04T16:34:49.624 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:34:49.624 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "4/23 daemons upgraded", 2024-09-04T16:34:49.624 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading crash daemons", 2024-09-04T16:34:49.624 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:34:49.624 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:34:49.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.625+0000 7ffb96d8e640 1 -- 172.21.15.170:0/3577327939 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffb7c079e80 msgr2=0x7ffb7c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:49.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.625+0000 7ffb96d8e640 1 --2- 172.21.15.170:0/3577327939 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffb7c079e80 0x7ffb7c07c340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffb90075f80 tx=0x7ffb800094f0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.625+0000 7ffb96d8e640 1 -- 172.21.15.170:0/3577327939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb90101910 msgr2=0x7ffb900744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:49.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.625+0000 7ffb96d8e640 1 --2- 172.21.15.170:0/3577327939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb90101910 0x7ffb900744f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ffb88031460 tx=0x7ffb880048f0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.625+0000 7ffb96d8e640 1 -- 172.21.15.170:0/3577327939 shutdown_connections 2024-09-04T16:34:49.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.625+0000 7ffb96d8e640 1 --2- 172.21.15.170:0/3577327939 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffb7c079e80 0x7ffb7c07c340 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.625+0000 7ffb96d8e640 1 --2- 172.21.15.170:0/3577327939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb90107910 0x7ffb90074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.625+0000 7ffb96d8e640 1 --2- 172.21.15.170:0/3577327939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb90101910 0x7ffb900744f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.625+0000 7ffb96d8e640 1 -- 172.21.15.170:0/3577327939 >> 172.21.15.170:0/3577327939 conn(0x7ffb900fd5f0 msgr2=0x7ffb900fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:49.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.625+0000 7ffb96d8e640 1 -- 172.21.15.170:0/3577327939 shutdown_connections 2024-09-04T16:34:49.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.625+0000 7ffb96d8e640 1 -- 172.21.15.170:0/3577327939 wait complete. 2024-09-04T16:34:49.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.707+0000 7faf8125c640 1 -- 172.21.15.170:0/2678503812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf7c106820 msgr2=0x7faf7c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:49.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.707+0000 7faf8125c640 1 --2- 172.21.15.170:0/2678503812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf7c106820 0x7faf7c106c00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009880 tx=0x7faf6c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.707+0000 7faf8125c640 1 -- 172.21.15.170:0/2678503812 shutdown_connections 2024-09-04T16:34:49.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.707+0000 7faf8125c640 1 --2- 172.21.15.170:0/2678503812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf7c100820 0x7faf7c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.707+0000 7faf8125c640 1 --2- 172.21.15.170:0/2678503812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf7c106820 0x7faf7c106c00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.707+0000 7faf8125c640 1 -- 172.21.15.170:0/2678503812 >> 172.21.15.170:0/2678503812 conn(0x7faf7c0fc520 msgr2=0x7faf7c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:49.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.707+0000 7faf8125c640 1 -- 172.21.15.170:0/2678503812 shutdown_connections 2024-09-04T16:34:49.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.707+0000 7faf8125c640 1 -- 172.21.15.170:0/2678503812 wait complete. 2024-09-04T16:34:49.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.708+0000 7faf8125c640 1 Processor -- start 2024-09-04T16:34:49.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.708+0000 7faf8125c640 1 -- start start 2024-09-04T16:34:49.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.708+0000 7faf8125c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf7c100820 0x7faf7c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:49.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.708+0000 7faf8125c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf7c106820 0x7faf7c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:49.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.708+0000 7faf8125c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c10dcd0 con 0x7faf7c100820 2024-09-04T16:34:49.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.708+0000 7faf8125c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c10db50 con 0x7faf7c106820 2024-09-04T16:34:49.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.709+0000 7faf7ad9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf7c100820 0x7faf7c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:49.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.709+0000 7faf7ad9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf7c100820 0x7faf7c1987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60258/0 (socket says 172.21.15.170:60258) 2024-09-04T16:34:49.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.709+0000 7faf7ad9d640 1 -- 172.21.15.170:0/1813471385 learned_addr learned my addr 172.21.15.170:0/1813471385 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:34:49.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.709+0000 7faf7a59c640 1 --2- 172.21.15.170:0/1813471385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf7c106820 0x7faf7c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:49.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.709+0000 7faf7ad9d640 1 -- 172.21.15.170:0/1813471385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf7c106820 msgr2=0x7faf7c198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:49.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.709+0000 7faf7ad9d640 1 --2- 172.21.15.170:0/1813471385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf7c106820 0x7faf7c198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.709+0000 7faf7ad9d640 1 -- 172.21.15.170:0/1813471385 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7c199320 con 0x7faf7c100820 2024-09-04T16:34:49.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.709+0000 7faf7a59c640 1 --2- 172.21.15.170:0/1813471385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf7c106820 0x7faf7c198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:34:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.709+0000 7faf7ad9d640 1 --2- 172.21.15.170:0/1813471385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf7c100820 0x7faf7c1987e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faf6c031460 tx=0x7faf6c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.709+0000 7faf63fff640 1 -- 172.21.15.170:0/1813471385 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf6c03f070 con 0x7faf7c100820 2024-09-04T16:34:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.709+0000 7faf63fff640 1 -- 172.21.15.170:0/1813471385 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf6c0035f0 con 0x7faf7c100820 2024-09-04T16:34:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.709+0000 7faf8125c640 1 -- 172.21.15.170:0/1813471385 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf7c1995b0 con 0x7faf7c100820 2024-09-04T16:34:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.709+0000 7faf63fff640 1 -- 172.21.15.170:0/1813471385 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf6c035030 con 0x7faf7c100820 2024-09-04T16:34:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.709+0000 7faf8125c640 1 -- 172.21.15.170:0/1813471385 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf7c1a1b60 con 0x7faf7c100820 2024-09-04T16:34:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.710+0000 7faf8125c640 1 -- 172.21.15.170:0/1813471385 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf7c101f60 con 0x7faf7c100820 2024-09-04T16:34:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.711+0000 7faf63fff640 1 -- 172.21.15.170:0/1813471385 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7faf6c042070 con 0x7faf7c100820 2024-09-04T16:34:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.711+0000 7faf63fff640 1 --2- 172.21.15.170:0/1813471385 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faf64079e80 0x7faf6407c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:34:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.711+0000 7faf63fff640 1 -- 172.21.15.170:0/1813471385 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7faf6c0bd300 con 0x7faf7c100820 2024-09-04T16:34:49.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.712+0000 7faf7a59c640 1 --2- 172.21.15.170:0/1813471385 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faf64079e80 0x7faf6407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:34:49.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.712+0000 7faf7a59c640 1 --2- 172.21.15.170:0/1813471385 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faf64079e80 0x7faf6407c340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faf700058c0 tx=0x7faf70005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:34:49.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.716+0000 7faf63fff640 1 -- 172.21.15.170:0/1813471385 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faf6c084e40 con 0x7faf7c100820 2024-09-04T16:34:49.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:49 smithi193 ceph-mon[82547]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:49.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:49 smithi193 ceph-mon[82547]: Upgrade: Updating crash.smithi170 (1/2) 2024-09-04T16:34:49.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:49 smithi193 ceph-mon[82547]: Deploying daemon crash.smithi170 on smithi170 2024-09-04T16:34:49.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:49 smithi193 ceph-mon[82547]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:49.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:49 smithi193 ceph-mon[82547]: pgmap v118: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:49.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:49 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/962232823' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:34:49.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:49 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/483498080' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:34:49.974 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-04T16:34:49.974 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:34:49.975 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:34:49.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.972+0000 7faf8125c640 1 -- 172.21.15.170:0/1813471385 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7faf7c103a30 con 0x7faf7c100820 2024-09-04T16:34:49.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.973+0000 7faf63fff640 1 -- 172.21.15.170:0/1813471385 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7faf6c088fb0 con 0x7faf7c100820 2024-09-04T16:34:49.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.975+0000 7faf8125c640 1 -- 172.21.15.170:0/1813471385 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faf64079e80 msgr2=0x7faf6407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:49.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.975+0000 7faf8125c640 1 --2- 172.21.15.170:0/1813471385 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faf64079e80 0x7faf6407c340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faf700058c0 tx=0x7faf70005850 comp rx=0 tx=0).stop 2024-09-04T16:34:49.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.975+0000 7faf8125c640 1 -- 172.21.15.170:0/1813471385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf7c100820 msgr2=0x7faf7c1987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:34:49.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.975+0000 7faf8125c640 1 --2- 172.21.15.170:0/1813471385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf7c100820 0x7faf7c1987e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faf6c031460 tx=0x7faf6c0045e0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.975+0000 7faf8125c640 1 -- 172.21.15.170:0/1813471385 shutdown_connections 2024-09-04T16:34:49.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.975+0000 7faf8125c640 1 --2- 172.21.15.170:0/1813471385 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faf64079e80 0x7faf6407c340 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.975+0000 7faf8125c640 1 --2- 172.21.15.170:0/1813471385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf7c106820 0x7faf7c198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.975+0000 7faf8125c640 1 --2- 172.21.15.170:0/1813471385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf7c100820 0x7faf7c1987e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:34:49.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.975+0000 7faf8125c640 1 -- 172.21.15.170:0/1813471385 >> 172.21.15.170:0/1813471385 conn(0x7faf7c0fc520 msgr2=0x7faf7c0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:34:49.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.975+0000 7faf8125c640 1 -- 172.21.15.170:0/1813471385 shutdown_connections 2024-09-04T16:34:49.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:34:49.975+0000 7faf8125c640 1 -- 172.21.15.170:0/1813471385 wait complete. 2024-09-04T16:34:50.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:50 smithi170 ceph-mon[113855]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:50.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:50 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1813471385' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:34:50.892 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:50 smithi193 ceph-mon[82547]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:50.892 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:50 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1813471385' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:34:51.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:51 smithi170 ceph-mon[113855]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:51.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:51 smithi170 ceph-mon[113855]: pgmap v119: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:51.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:51 smithi193 ceph-mon[82547]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:34:51.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:51 smithi193 ceph-mon[82547]: pgmap v119: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:53.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:53 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:53.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:53 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:53.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:53 smithi193 ceph-mon[82547]: pgmap v120: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:53.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:53 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:53.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:53 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:53.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:53 smithi170 ceph-mon[113855]: pgmap v120: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:54.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:54 smithi170 ceph-mon[113855]: Upgrade: Updating crash.smithi193 (2/2) 2024-09-04T16:34:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:54 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:54 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi193", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-04T16:34:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:54 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:34:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:54 smithi170 ceph-mon[113855]: Deploying daemon crash.smithi193 on smithi193 2024-09-04T16:34:54.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:54 smithi193 ceph-mon[82547]: Upgrade: Updating crash.smithi193 (2/2) 2024-09-04T16:34:54.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:54 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:54.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:54 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi193", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-04T16:34:54.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:54 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:34:54.646 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:54 smithi193 ceph-mon[82547]: Deploying daemon crash.smithi193 on smithi193 2024-09-04T16:34:55.460 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:55 smithi193 ceph-mon[82547]: pgmap v121: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:55.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:55 smithi170 ceph-mon[113855]: pgmap v121: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:57.558 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:57 smithi170 ceph-mon[113855]: pgmap v122: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:57.558 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:57 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:57.558 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:57 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:57.558 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:57 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:34:57.650 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:57 smithi193 ceph-mon[82547]: pgmap v122: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:57.651 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:57 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:57.651 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:57 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:34:57.651 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:57 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:34:59.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:59 smithi170 ceph-mon[113855]: pgmap v123: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:34:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:34:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:59 smithi193 ceph-mon[82547]: pgmap v123: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:34:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:34:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:35:00.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:00 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:00.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:00 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:00.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:00 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:00.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:00 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:00.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:00 smithi170 ceph-mon[113855]: pgmap v124: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:00.854 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:00 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:00.854 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:00 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:00.854 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:00 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:00.854 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:00 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:00.854 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:00 smithi193 ceph-mon[82547]: pgmap v124: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:03.148 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:02 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:03.149 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:02 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:03.149 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:02 smithi193 ceph-mon[82547]: pgmap v125: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:03.149 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:02 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:03.149 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:02 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:03.301 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:02 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:03.301 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:02 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:03.301 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:02 smithi170 ceph-mon[113855]: pgmap v125: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:03.301 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:02 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:03.301 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:02 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:04.491 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:04 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:04.491 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:04 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:04 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:04 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:05.577 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:05 smithi170 ceph-mon[113855]: pgmap v126: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:05.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:05 smithi193 ceph-mon[82547]: pgmap v126: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:07.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:07.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:07.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:35:07.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:35:07.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:07.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:35:07.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:35:07.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:35:07.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:35:07.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: Upgrade: Setting container_image for all crash 2024-09-04T16:35:07.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:07.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi170"} : dispatch 2024-09-04T16:35:07.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi170"}]': finished 2024-09-04T16:35:07.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi193"} : dispatch 2024-09-04T16:35:07.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi193"}]': finished 2024-09-04T16:35:07.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-04T16:35:07.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-04T16:35:07.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: Upgrade: osd.0 is safe to restart 2024-09-04T16:35:07.354 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:07 smithi170 ceph-mon[113855]: pgmap v127: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:07.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:07.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:07.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:35:07.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:35:07.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:07.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:35:07.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:35:07.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:35:07.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:35:07.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: Upgrade: Setting container_image for all crash 2024-09-04T16:35:07.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:07.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi170"} : dispatch 2024-09-04T16:35:07.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi170"}]': finished 2024-09-04T16:35:07.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi193"} : dispatch 2024-09-04T16:35:07.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi193"}]': finished 2024-09-04T16:35:07.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-04T16:35:07.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-04T16:35:07.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: Upgrade: osd.0 is safe to restart 2024-09-04T16:35:07.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:07 smithi193 ceph-mon[82547]: pgmap v127: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:08 smithi193 ceph-mon[82547]: Upgrade: Updating osd.0 2024-09-04T16:35:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:08 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:08 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-04T16:35:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:08 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:35:08.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:08 smithi193 ceph-mon[82547]: Deploying daemon osd.0 on smithi170 2024-09-04T16:35:08.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:08 smithi193 ceph-mon[82547]: pgmap v128: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:09.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:08 smithi170 ceph-mon[113855]: Upgrade: Updating osd.0 2024-09-04T16:35:09.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:08 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:09.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:08 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-04T16:35:09.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:08 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:35:09.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:08 smithi170 ceph-mon[113855]: Deploying daemon osd.0 on smithi170 2024-09-04T16:35:09.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:08 smithi170 ceph-mon[113855]: pgmap v128: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:11.102 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:10 smithi170 systemd[1]: Stopping Ceph osd.0 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:35:11.102 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:11 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0[50859]: 2024-09-04T16:35:11.001+0000 7fdb0bd81640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T16:35:11.102 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:11 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0[50859]: 2024-09-04T16:35:11.001+0000 7fdb0bd81640 -1 osd.0 47 *** Got signal Terminated *** 2024-09-04T16:35:11.102 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:11 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0[50859]: 2024-09-04T16:35:11.001+0000 7fdb0bd81640 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-04T16:35:11.778 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:11 smithi170 ceph-mon[113855]: pgmap v129: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:11.778 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:11 smithi170 ceph-mon[113855]: osd.0 marked itself down and dead 2024-09-04T16:35:11.814 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:11 smithi193 ceph-mon[82547]: pgmap v129: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:11.815 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:11 smithi193 ceph-mon[82547]: osd.0 marked itself down and dead 2024-09-04T16:35:12.070 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:11 smithi170 podman[122640]: 2024-09-04 16:35:11.778352428 +0000 UTC m=+0.872385803 container died 6c2ea484615d4911f7658c0aa0a9df895374e0693db081f825818ce2fe7f9c79 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-48920da, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-04T16:35:12.351 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:12 smithi170 podman[122640]: 2024-09-04 16:35:12.168787943 +0000 UTC m=+1.262821317 container cleanup 6c2ea484615d4911f7658c0aa0a9df895374e0693db081f825818ce2fe7f9c79 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-48920da, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-04T16:35:12.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:12 smithi170 bash[122640]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0 2024-09-04T16:35:12.735 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:12 smithi170 ceph-mon[113855]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-04T16:35:12.735 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:12 smithi170 ceph-mon[113855]: osdmap e48: 6 total, 5 up, 6 in 2024-09-04T16:35:12.735 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:12 smithi170 podman[122654]: 2024-09-04 16:35:12.403598759 +0000 UTC m=+0.622110832 container remove 6c2ea484615d4911f7658c0aa0a9df895374e0693db081f825818ce2fe7f9c79 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-48920da, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-04T16:35:12.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:12 smithi193 ceph-mon[82547]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-04T16:35:12.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:12 smithi193 ceph-mon[82547]: osdmap e48: 6 total, 5 up, 6 in 2024-09-04T16:35:12.999 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:12 smithi170 podman[122744]: 2024-09-04 16:35:12.637964232 +0000 UTC m=+0.016252784 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:35:12.999 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:12 smithi170 podman[122744]: 2024-09-04 16:35:12.754681942 +0000 UTC m=+0.132970489 container create b23d8afb656f37f4c4b4b2a2cee6338bb6d8011e6a204901a707b27fab5514f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-04T16:35:13.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:12 smithi170 podman[122744]: 2024-09-04 16:35:12.999574839 +0000 UTC m=+0.377863392 container init b23d8afb656f37f4c4b4b2a2cee6338bb6d8011e6a204901a707b27fab5514f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-04T16:35:13.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:13 smithi170 podman[122744]: 2024-09-04 16:35:13.003470148 +0000 UTC m=+0.381758700 container start b23d8afb656f37f4c4b4b2a2cee6338bb6d8011e6a204901a707b27fab5514f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-04T16:35:13.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:13 smithi170 podman[122744]: 2024-09-04 16:35:13.082622499 +0000 UTC m=+0.460911057 container attach b23d8afb656f37f4c4b4b2a2cee6338bb6d8011e6a204901a707b27fab5514f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-deactivate, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-04T16:35:13.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:13 smithi170 podman[122744]: 2024-09-04 16:35:13.19450798 +0000 UTC m=+0.572796541 container died b23d8afb656f37f4c4b4b2a2cee6338bb6d8011e6a204901a707b27fab5514f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-04T16:35:13.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:13 smithi170 ceph-mon[113855]: pgmap v131: 65 pgs: 9 stale+active+clean, 56 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:13.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:13 smithi170 ceph-mon[113855]: osdmap e49: 6 total, 5 up, 6 in 2024-09-04T16:35:13.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:13 smithi193 ceph-mon[82547]: pgmap v131: 65 pgs: 9 stale+active+clean, 56 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:13.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:13 smithi193 ceph-mon[82547]: osdmap e49: 6 total, 5 up, 6 in 2024-09-04T16:35:14.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:14 smithi170 podman[122767]: 2024-09-04 16:35:14.02043344 +0000 UTC m=+0.816233853 container remove b23d8afb656f37f4c4b4b2a2cee6338bb6d8011e6a204901a707b27fab5514f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-04T16:35:14.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:14 smithi170 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-04T16:35:14.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:14 smithi170 systemd[1]: Stopped Ceph osd.0 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:35:14.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:14 smithi170 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.0.service: Consumed 54.831s CPU time. 2024-09-04T16:35:14.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:14 smithi170 systemd[1]: Starting Ceph osd.0 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:35:14.749 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:14 smithi170 podman[122868]: 2024-09-04 16:35:14.37959722 +0000 UTC m=+0.016378233 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:35:14.749 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:14 smithi170 podman[122868]: 2024-09-04 16:35:14.496541162 +0000 UTC m=+0.133322214 container create f3e16b4bd2b8d625054c200fb61a9b01e98e38359a4722f0fe671c9466ac2bea (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-09-04T16:35:14.749 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:14 smithi170 podman[122868]: 2024-09-04 16:35:14.749589063 +0000 UTC m=+0.386370080 container init f3e16b4bd2b8d625054c200fb61a9b01e98e38359a4722f0fe671c9466ac2bea (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-activate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-04T16:35:15.113 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:14 smithi170 podman[122868]: 2024-09-04 16:35:14.752937936 +0000 UTC m=+0.389718943 container start f3e16b4bd2b8d625054c200fb61a9b01e98e38359a4722f0fe671c9466ac2bea (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-04T16:35:15.113 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:14 smithi170 podman[122868]: 2024-09-04 16:35:14.832932802 +0000 UTC m=+0.469713810 container attach f3e16b4bd2b8d625054c200fb61a9b01e98e38359a4722f0fe671c9466ac2bea (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-activate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-04T16:35:15.114 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:14 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-activate[122883]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:35:15.114 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:14 smithi170 bash[122868]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:35:15.114 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:14 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-activate[122883]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:35:15.114 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:14 smithi170 bash[122868]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:35:15.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:15 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:15.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:15 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:35:15.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:15 smithi170 ceph-mon[113855]: pgmap v133: 65 pgs: 11 active+undersized, 1 stale+active+clean, 11 active+undersized+degraded, 42 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25/312 objects degraded (8.013%) 2024-09-04T16:35:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:15 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:15.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:15 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:35:15.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:15 smithi193 ceph-mon[82547]: pgmap v133: 65 pgs: 11 active+undersized, 1 stale+active+clean, 11 active+undersized+degraded, 42 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25/312 objects degraded (8.013%) 2024-09-04T16:35:15.910 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:15 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-activate[122883]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-04T16:35:15.910 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:15 smithi170 bash[122868]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-04T16:35:15.910 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:15 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-activate[122883]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-04T16:35:15.910 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:15 smithi170 bash[122868]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-04T16:35:16.173 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:15 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-activate[122883]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-04T16:35:16.173 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:15 smithi170 bash[122868]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-04T16:35:16.174 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:15 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-activate[122883]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-04T16:35:16.174 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:15 smithi170 bash[122868]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-04T16:35:16.174 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:15 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-activate[122883]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-04T16:35:16.174 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:15 smithi170 bash[122868]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-04T16:35:16.174 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:15 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-activate[122883]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-04T16:35:16.174 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:15 smithi170 bash[122868]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-04T16:35:16.174 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:15 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-activate[122883]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-04T16:35:16.174 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:15 smithi170 bash[122868]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-04T16:35:16.174 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:15 smithi170 podman[122868]: 2024-09-04 16:35:15.939275658 +0000 UTC m=+1.576056674 container died f3e16b4bd2b8d625054c200fb61a9b01e98e38359a4722f0fe671c9466ac2bea (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-04T16:35:16.570 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:16 smithi170 ceph-mon[113855]: Health check failed: Degraded data redundancy: 25/312 objects degraded (8.013%), 11 pgs degraded (PG_DEGRADED) 2024-09-04T16:35:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:16 smithi193 ceph-mon[82547]: Health check failed: Degraded data redundancy: 25/312 objects degraded (8.013%), 11 pgs degraded (PG_DEGRADED) 2024-09-04T16:35:16.829 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:16 smithi170 podman[123019]: 2024-09-04 16:35:16.570142631 +0000 UTC m=+0.625278937 container remove f3e16b4bd2b8d625054c200fb61a9b01e98e38359a4722f0fe671c9466ac2bea (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-04T16:35:16.829 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:16 smithi170 podman[123080]: 2024-09-04 16:35:16.694342734 +0000 UTC m=+0.016589098 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:35:16.829 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:16 smithi170 podman[123080]: 2024-09-04 16:35:16.829685034 +0000 UTC m=+0.151931388 container create 22f8c54550e023a988cc1fcaf58de6ef22211457331dec2c63e96c24d6a38075 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, CEPH_POINT_RELEASE=) 2024-09-04T16:35:17.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:17 smithi170 ceph-mon[113855]: pgmap v134: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-04T16:35:17.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:17 smithi170 podman[123080]: 2024-09-04 16:35:17.083090202 +0000 UTC m=+0.405336554 container init 22f8c54550e023a988cc1fcaf58de6ef22211457331dec2c63e96c24d6a38075 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-04T16:35:17.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:17 smithi170 podman[123080]: 2024-09-04 16:35:17.086285926 +0000 UTC m=+0.408532279 container start 22f8c54550e023a988cc1fcaf58de6ef22211457331dec2c63e96c24d6a38075 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-04T16:35:17.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:17 smithi170 ceph-osd[123099]: -- 172.21.15.170:0/3088105859 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55658f16a1e0 con 0x55658f0fa000 2024-09-04T16:35:17.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:17 smithi170 bash[123080]: 22f8c54550e023a988cc1fcaf58de6ef22211457331dec2c63e96c24d6a38075 2024-09-04T16:35:17.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:17 smithi170 systemd[1]: Started Ceph osd.0 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:35:17.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:17 smithi193 ceph-mon[82547]: pgmap v134: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-04T16:35:18.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:18 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:18.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:18 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:18.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:18 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:35:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:18 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:18 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:18 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:35:19.023 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:18 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0[123095]: 2024-09-04T16:35:18.740+0000 7f1330f67640 -1 Falling back to public interface 2024-09-04T16:35:19.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:19 smithi170 ceph-mon[113855]: pgmap v135: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-04T16:35:19.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:19 smithi193 ceph-mon[82547]: pgmap v135: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-04T16:35:20.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.066+0000 7f3aa1944640 1 -- 172.21.15.170:0/1919614414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a9c1007e0 msgr2=0x7f3a9c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:20.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.066+0000 7f3aa1944640 1 --2- 172.21.15.170:0/1919614414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a9c1007e0 0x7f3a9c100c40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009880 tx=0x7f3a8402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.066+0000 7f3aa1944640 1 -- 172.21.15.170:0/1919614414 shutdown_connections 2024-09-04T16:35:20.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.066+0000 7f3aa1944640 1 --2- 172.21.15.170:0/1919614414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a9c1007e0 0x7f3a9c100c40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.066+0000 7f3aa1944640 1 --2- 172.21.15.170:0/1919614414 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a9c1067e0 0x7f3a9c106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.066+0000 7f3aa1944640 1 -- 172.21.15.170:0/1919614414 >> 172.21.15.170:0/1919614414 conn(0x7f3a9c0fc4c0 msgr2=0x7f3a9c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:20.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.066+0000 7f3aa1944640 1 -- 172.21.15.170:0/1919614414 shutdown_connections 2024-09-04T16:35:20.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.066+0000 7f3aa1944640 1 -- 172.21.15.170:0/1919614414 wait complete. 2024-09-04T16:35:20.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.067+0000 7f3aa1944640 1 Processor -- start 2024-09-04T16:35:20.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.067+0000 7f3aa1944640 1 -- start start 2024-09-04T16:35:20.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.067+0000 7f3aa1944640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a9c1007e0 0x7f3a9c19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:20.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.067+0000 7f3aa1944640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a9c1067e0 0x7f3a9c19caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:20.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.068+0000 7f3aa1944640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c10dc90 con 0x7f3a9c1007e0 2024-09-04T16:35:20.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.068+0000 7f3aa1944640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c10db10 con 0x7f3a9c1067e0 2024-09-04T16:35:20.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.068+0000 7f3a9affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a9c1007e0 0x7f3a9c19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:20.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.068+0000 7f3a9affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a9c1007e0 0x7f3a9c19c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42224/0 (socket says 172.21.15.170:42224) 2024-09-04T16:35:20.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.068+0000 7f3a9affd640 1 -- 172.21.15.170:0/2629908726 learned_addr learned my addr 172.21.15.170:0/2629908726 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:35:20.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.068+0000 7f3a93fff640 1 --2- 172.21.15.170:0/2629908726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a9c1067e0 0x7f3a9c19caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:20.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.068+0000 7f3a9affd640 1 -- 172.21.15.170:0/2629908726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a9c1067e0 msgr2=0x7f3a9c19caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:20.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.068+0000 7f3a9affd640 1 --2- 172.21.15.170:0/2629908726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a9c1067e0 0x7f3a9c19caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.068+0000 7f3a9affd640 1 -- 172.21.15.170:0/2629908726 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9c196680 con 0x7f3a9c1007e0 2024-09-04T16:35:20.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.068+0000 7f3a9affd640 1 --2- 172.21.15.170:0/2629908726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a9c1007e0 0x7f3a9c19c5b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00c8a0 tx=0x7f3a8c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:20.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.068+0000 7f3aa0942640 1 -- 172.21.15.170:0/2629908726 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a8c0079b0 con 0x7f3a9c1007e0 2024-09-04T16:35:20.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.068+0000 7f3aa1944640 1 -- 172.21.15.170:0/2629908726 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9c196970 con 0x7f3a9c1007e0 2024-09-04T16:35:20.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.068+0000 7f3aa0942640 1 -- 172.21.15.170:0/2629908726 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a8c007b50 con 0x7f3a9c1007e0 2024-09-04T16:35:20.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.068+0000 7f3aa0942640 1 -- 172.21.15.170:0/2629908726 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a8c018700 con 0x7f3a9c1007e0 2024-09-04T16:35:20.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.068+0000 7f3aa1944640 1 -- 172.21.15.170:0/2629908726 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a9c196f00 con 0x7f3a9c1007e0 2024-09-04T16:35:20.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.069+0000 7f3aa1944640 1 -- 172.21.15.170:0/2629908726 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a9c101f20 con 0x7f3a9c1007e0 2024-09-04T16:35:20.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.070+0000 7f3aa0942640 1 -- 172.21.15.170:0/2629908726 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f3a8c0188c0 con 0x7f3a9c1007e0 2024-09-04T16:35:20.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.071+0000 7f3aa0942640 1 --2- 172.21.15.170:0/2629908726 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3a88079e30 0x7f3a8807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:20.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.071+0000 7f3aa0942640 1 -- 172.21.15.170:0/2629908726 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f3a8c09cc90 con 0x7f3a9c1007e0 2024-09-04T16:35:20.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.071+0000 7f3a93fff640 1 --2- 172.21.15.170:0/2629908726 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3a88079e30 0x7f3a8807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:20.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.072+0000 7f3a93fff640 1 --2- 172.21.15.170:0/2629908726 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3a88079e30 0x7f3a8807c2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c197ed0 tx=0x7f3a84031420 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:20.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.075+0000 7f3aa0942640 1 -- 172.21.15.170:0/2629908726 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3a8c014030 con 0x7f3a9c1007e0 2024-09-04T16:35:20.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.270+0000 7f3aa1944640 1 -- 172.21.15.170:0/2629908726 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3a9c197270 con 0x7f3a88079e30 2024-09-04T16:35:20.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.271+0000 7f3aa0942640 1 -- 172.21.15.170:0/2629908726 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f3a9c197270 con 0x7f3a88079e30 2024-09-04T16:35:20.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.273+0000 7f3aa1944640 1 -- 172.21.15.170:0/2629908726 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3a88079e30 msgr2=0x7f3a8807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:20.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.273+0000 7f3aa1944640 1 --2- 172.21.15.170:0/2629908726 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3a88079e30 0x7f3a8807c2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c197ed0 tx=0x7f3a84031420 comp rx=0 tx=0).stop 2024-09-04T16:35:20.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.273+0000 7f3aa1944640 1 -- 172.21.15.170:0/2629908726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a9c1007e0 msgr2=0x7f3a9c19c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:20.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.273+0000 7f3aa1944640 1 --2- 172.21.15.170:0/2629908726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a9c1007e0 0x7f3a9c19c5b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00c8a0 tx=0x7f3a8c00cd60 comp rx=0 tx=0).stop 2024-09-04T16:35:20.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.273+0000 7f3aa1944640 1 -- 172.21.15.170:0/2629908726 shutdown_connections 2024-09-04T16:35:20.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.273+0000 7f3aa1944640 1 --2- 172.21.15.170:0/2629908726 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3a88079e30 0x7f3a8807c2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.273+0000 7f3aa1944640 1 --2- 172.21.15.170:0/2629908726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a9c1067e0 0x7f3a9c19caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.273+0000 7f3aa1944640 1 --2- 172.21.15.170:0/2629908726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a9c1007e0 0x7f3a9c19c5b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.273+0000 7f3aa1944640 1 -- 172.21.15.170:0/2629908726 >> 172.21.15.170:0/2629908726 conn(0x7f3a9c0fc4c0 msgr2=0x7f3a9c0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:20.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.273+0000 7f3aa1944640 1 -- 172.21.15.170:0/2629908726 shutdown_connections 2024-09-04T16:35:20.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.273+0000 7f3aa1944640 1 -- 172.21.15.170:0/2629908726 wait complete. 2024-09-04T16:35:20.284 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:35:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.362+0000 7f2f350a9640 1 -- 172.21.15.170:0/1094513494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30103420 msgr2=0x7f2f3010b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.362+0000 7f2f350a9640 1 --2- 172.21.15.170:0/1094513494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30103420 0x7f2f3010b910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2f240098b0 tx=0x7f2f2402a560 comp rx=0 tx=0).stop 2024-09-04T16:35:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.362+0000 7f2f350a9640 1 -- 172.21.15.170:0/1094513494 shutdown_connections 2024-09-04T16:35:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.362+0000 7f2f350a9640 1 --2- 172.21.15.170:0/1094513494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30103420 0x7f2f3010b910 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.362+0000 7f2f350a9640 1 --2- 172.21.15.170:0/1094513494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f30102b00 0x7f2f30102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.362+0000 7f2f350a9640 1 -- 172.21.15.170:0/1094513494 >> 172.21.15.170:0/1094513494 conn(0x7f2f300fc4c0 msgr2=0x7f2f300fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.362+0000 7f2f350a9640 1 -- 172.21.15.170:0/1094513494 shutdown_connections 2024-09-04T16:35:20.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.362+0000 7f2f350a9640 1 -- 172.21.15.170:0/1094513494 wait complete. 2024-09-04T16:35:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.363+0000 7f2f350a9640 1 Processor -- start 2024-09-04T16:35:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.363+0000 7f2f350a9640 1 -- start start 2024-09-04T16:35:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.363+0000 7f2f350a9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30102b00 0x7f2f3019d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.363+0000 7f2f350a9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f30103420 0x7f2f3019dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.363+0000 7f2f350a9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2f3010ee30 con 0x7f2f30102b00 2024-09-04T16:35:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.363+0000 7f2f350a9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2f3010ecb0 con 0x7f2f30103420 2024-09-04T16:35:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.363+0000 7f2f2ed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30102b00 0x7f2f3019d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.363+0000 7f2f2ed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30102b00 0x7f2f3019d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42238/0 (socket says 172.21.15.170:42238) 2024-09-04T16:35:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.363+0000 7f2f2ed9d640 1 -- 172.21.15.170:0/1507978172 learned_addr learned my addr 172.21.15.170:0/1507978172 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:35:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.363+0000 7f2f2e59c640 1 --2- 172.21.15.170:0/1507978172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f30103420 0x7f2f3019dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.364+0000 7f2f2ed9d640 1 -- 172.21.15.170:0/1507978172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f30103420 msgr2=0x7f2f3019dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.364+0000 7f2f2ed9d640 1 --2- 172.21.15.170:0/1507978172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f30103420 0x7f2f3019dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.364+0000 7f2f2ed9d640 1 -- 172.21.15.170:0/1507978172 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f301978e0 con 0x7f2f30102b00 2024-09-04T16:35:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.364+0000 7f2f2ed9d640 1 --2- 172.21.15.170:0/1507978172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30102b00 0x7f2f3019d720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000b420 tx=0x7f2f2000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.364+0000 7f2f17fff640 1 -- 172.21.15.170:0/1507978172 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f20011630 con 0x7f2f30102b00 2024-09-04T16:35:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.364+0000 7f2f350a9640 1 -- 172.21.15.170:0/1507978172 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f30197bd0 con 0x7f2f30102b00 2024-09-04T16:35:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.364+0000 7f2f17fff640 1 -- 172.21.15.170:0/1507978172 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f20016070 con 0x7f2f30102b00 2024-09-04T16:35:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.364+0000 7f2f17fff640 1 -- 172.21.15.170:0/1507978172 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f20010d40 con 0x7f2f30102b00 2024-09-04T16:35:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.364+0000 7f2f350a9640 1 -- 172.21.15.170:0/1507978172 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f30198130 con 0x7f2f30102b00 2024-09-04T16:35:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.365+0000 7f2f350a9640 1 -- 172.21.15.170:0/1507978172 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f3006a3b0 con 0x7f2f30102b00 2024-09-04T16:35:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.366+0000 7f2f17fff640 1 -- 172.21.15.170:0/1507978172 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f2f200117d0 con 0x7f2f30102b00 2024-09-04T16:35:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.366+0000 7f2f17fff640 1 --2- 172.21.15.170:0/1507978172 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f18079e80 0x7f2f1807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.367+0000 7f2f17fff640 1 -- 172.21.15.170:0/1507978172 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f2f2009c670 con 0x7f2f30102b00 2024-09-04T16:35:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.367+0000 7f2f2e59c640 1 --2- 172.21.15.170:0/1507978172 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f18079e80 0x7f2f1807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:20.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.367+0000 7f2f2e59c640 1 --2- 172.21.15.170:0/1507978172 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f18079e80 0x7f2f1807c340 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2f24000c00 tx=0x7f2f24031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:20.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.370+0000 7f2f17fff640 1 -- 172.21.15.170:0/1507978172 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2f20064250 con 0x7f2f30102b00 2024-09-04T16:35:20.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.576+0000 7f2f350a9640 1 -- 172.21.15.170:0/1507978172 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2f30198e10 con 0x7f2f18079e80 2024-09-04T16:35:20.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.577+0000 7f2f17fff640 1 -- 172.21.15.170:0/1507978172 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f2f30198e10 con 0x7f2f18079e80 2024-09-04T16:35:20.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.580+0000 7f2f350a9640 1 -- 172.21.15.170:0/1507978172 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f18079e80 msgr2=0x7f2f1807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:20.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.580+0000 7f2f350a9640 1 --2- 172.21.15.170:0/1507978172 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f18079e80 0x7f2f1807c340 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2f24000c00 tx=0x7f2f24031400 comp rx=0 tx=0).stop 2024-09-04T16:35:20.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.580+0000 7f2f350a9640 1 -- 172.21.15.170:0/1507978172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30102b00 msgr2=0x7f2f3019d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:20.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.580+0000 7f2f350a9640 1 --2- 172.21.15.170:0/1507978172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30102b00 0x7f2f3019d720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000b420 tx=0x7f2f2000b8e0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.580+0000 7f2f350a9640 1 -- 172.21.15.170:0/1507978172 shutdown_connections 2024-09-04T16:35:20.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.580+0000 7f2f350a9640 1 --2- 172.21.15.170:0/1507978172 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f18079e80 0x7f2f1807c340 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.580+0000 7f2f350a9640 1 --2- 172.21.15.170:0/1507978172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f30103420 0x7f2f3019dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.580+0000 7f2f350a9640 1 --2- 172.21.15.170:0/1507978172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30102b00 0x7f2f3019d720 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.580+0000 7f2f350a9640 1 -- 172.21.15.170:0/1507978172 >> 172.21.15.170:0/1507978172 conn(0x7f2f300fc4c0 msgr2=0x7f2f30103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:20.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.580+0000 7f2f350a9640 1 -- 172.21.15.170:0/1507978172 shutdown_connections 2024-09-04T16:35:20.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.580+0000 7f2f350a9640 1 -- 172.21.15.170:0/1507978172 wait complete. 2024-09-04T16:35:20.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.664+0000 7ff7be35a640 1 -- 172.21.15.170:0/2468155501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b8101930 msgr2=0x7ff7b8101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:20.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.664+0000 7ff7be35a640 1 --2- 172.21.15.170:0/2468155501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b8101930 0x7ff7b8101d90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009880 tx=0x7ff7a002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.664+0000 7ff7be35a640 1 -- 172.21.15.170:0/2468155501 shutdown_connections 2024-09-04T16:35:20.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.664+0000 7ff7be35a640 1 --2- 172.21.15.170:0/2468155501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b8101930 0x7ff7b8101d90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.664+0000 7ff7be35a640 1 --2- 172.21.15.170:0/2468155501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7b8107930 0x7ff7b8107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.664+0000 7ff7be35a640 1 -- 172.21.15.170:0/2468155501 >> 172.21.15.170:0/2468155501 conn(0x7ff7b80fd630 msgr2=0x7ff7b80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:20.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.664+0000 7ff7be35a640 1 -- 172.21.15.170:0/2468155501 shutdown_connections 2024-09-04T16:35:20.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.664+0000 7ff7be35a640 1 -- 172.21.15.170:0/2468155501 wait complete. 2024-09-04T16:35:20.666 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:20 smithi170 ceph-mon[113855]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:35:20.666 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:20 smithi170 ceph-mon[113855]: pgmap v136: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-04T16:35:20.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.664+0000 7ff7be35a640 1 Processor -- start 2024-09-04T16:35:20.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.665+0000 7ff7be35a640 1 -- start start 2024-09-04T16:35:20.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.665+0000 7ff7be35a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b8101930 0x7ff7b819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:20.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.665+0000 7ff7be35a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7b8107930 0x7ff7b819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:20.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.665+0000 7ff7be35a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b810ee60 con 0x7ff7b8101930 2024-09-04T16:35:20.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.665+0000 7ff7be35a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b810ece0 con 0x7ff7b8107930 2024-09-04T16:35:20.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.665+0000 7ff7b7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b8101930 0x7ff7b819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:20.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.665+0000 7ff7b7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b8101930 0x7ff7b819d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42260/0 (socket says 172.21.15.170:42260) 2024-09-04T16:35:20.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.665+0000 7ff7b7fff640 1 -- 172.21.15.170:0/2778269798 learned_addr learned my addr 172.21.15.170:0/2778269798 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:35:20.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.665+0000 7ff7b77fe640 1 --2- 172.21.15.170:0/2778269798 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7b8107930 0x7ff7b819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:20.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.665+0000 7ff7b7fff640 1 -- 172.21.15.170:0/2778269798 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7b8107930 msgr2=0x7ff7b819dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:20.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.665+0000 7ff7b7fff640 1 --2- 172.21.15.170:0/2778269798 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7b8107930 0x7ff7b819dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.665+0000 7ff7b7fff640 1 -- 172.21.15.170:0/2778269798 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b8197870 con 0x7ff7b8101930 2024-09-04T16:35:20.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.666+0000 7ff7b7fff640 1 --2- 172.21.15.170:0/2778269798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b8101930 0x7ff7b819d6b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800b420 tx=0x7ff7a800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:20.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.666+0000 7ff7b57fa640 1 -- 172.21.15.170:0/2778269798 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7a8011630 con 0x7ff7b8101930 2024-09-04T16:35:20.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.666+0000 7ff7b57fa640 1 -- 172.21.15.170:0/2778269798 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7a8016070 con 0x7ff7b8101930 2024-09-04T16:35:20.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.666+0000 7ff7be35a640 1 -- 172.21.15.170:0/2778269798 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b8197b60 con 0x7ff7b8101930 2024-09-04T16:35:20.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.666+0000 7ff7b57fa640 1 -- 172.21.15.170:0/2778269798 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7a8010d40 con 0x7ff7b8101930 2024-09-04T16:35:20.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.666+0000 7ff7be35a640 1 -- 172.21.15.170:0/2778269798 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b81980c0 con 0x7ff7b8101930 2024-09-04T16:35:20.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.667+0000 7ff7be35a640 1 -- 172.21.15.170:0/2778269798 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b8103070 con 0x7ff7b8101930 2024-09-04T16:35:20.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.668+0000 7ff7b57fa640 1 -- 172.21.15.170:0/2778269798 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ff7a80117d0 con 0x7ff7b8101930 2024-09-04T16:35:20.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.668+0000 7ff7b57fa640 1 --2- 172.21.15.170:0/2778269798 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7a4079e40 0x7ff7a407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:20.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.668+0000 7ff7b57fa640 1 -- 172.21.15.170:0/2778269798 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7ff7a809c1a0 con 0x7ff7b8101930 2024-09-04T16:35:20.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.668+0000 7ff7b77fe640 1 --2- 172.21.15.170:0/2778269798 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7a4079e40 0x7ff7a407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:20.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.669+0000 7ff7b77fe640 1 --2- 172.21.15.170:0/2778269798 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7a4079e40 0x7ff7a407c300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8199060 tx=0x7ff7a00095c0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:20.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.672+0000 7ff7b57fa640 1 -- 172.21.15.170:0/2778269798 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff7a8063c60 con 0x7ff7b8101930 2024-09-04T16:35:20.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.868+0000 7ff7be35a640 1 -- 172.21.15.170:0/2778269798 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff7b8198da0 con 0x7ff7a4079e40 2024-09-04T16:35:20.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.878+0000 7ff7b57fa640 1 -- 172.21.15.170:0/2778269798 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7ff7b8198da0 con 0x7ff7a4079e40 2024-09-04T16:35:20.879 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:35:20.879 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (2m) 18s ago 13m 22.0M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:35:20.879 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (5m) 18s ago 13m 8942k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:35:20.879 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (4m) 21s ago 12m 8326k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:35:20.879 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (29s) 18s ago 13m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:35:20.879 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (24s) 21s ago 12m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:35:20.879 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (117s) 18s ago 12m 77.5M - c8b91775d855 6e3778aab5e6 2024-09-04T16:35:20.879 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (7m) 18s ago 7m 27.1M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:35:20.879 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (7m) 18s ago 7m 146M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:35:20.880 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (7m) 21s ago 7m 16.9M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:35:20.880 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (7m) 21s ago 7m 16.5M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:35:20.880 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (4m) 18s ago 14m 523M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:35:20.880 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (3m) 21s ago 12m 456M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:35:20.880 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (59s) 18s ago 14m 37.2M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:35:20.880 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (42s) 21s ago 12m 25.2M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:35:20.880 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (3m) 18s ago 13m 10.0M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:35:20.880 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (3m) 21s ago 12m 12.5M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:35:20.880 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 starting - - - 1216M 2024-09-04T16:35:20.880 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (10m) 18s ago 10m 229M 1216M 19.1.1-252-g48920dab b708f9119ac7 20469ba5727b 2024-09-04T16:35:20.880 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (10m) 18s ago 10m 183M 1216M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:35:20.881 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (9m) 21s ago 9m 249M 2240M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:35:20.881 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (9m) 21s ago 9m 210M 2240M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:35:20.883 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (8m) 21s ago 8m 191M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:35:20.883 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (2m) 18s ago 12m 49.3M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:35:20.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.880+0000 7ff7be35a640 1 -- 172.21.15.170:0/2778269798 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7a4079e40 msgr2=0x7ff7a407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:20.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.880+0000 7ff7be35a640 1 --2- 172.21.15.170:0/2778269798 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7a4079e40 0x7ff7a407c300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8199060 tx=0x7ff7a00095c0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.880+0000 7ff7be35a640 1 -- 172.21.15.170:0/2778269798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b8101930 msgr2=0x7ff7b819d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:20.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.880+0000 7ff7be35a640 1 --2- 172.21.15.170:0/2778269798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b8101930 0x7ff7b819d6b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800b420 tx=0x7ff7a800b8e0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.880+0000 7ff7be35a640 1 -- 172.21.15.170:0/2778269798 shutdown_connections 2024-09-04T16:35:20.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.880+0000 7ff7be35a640 1 --2- 172.21.15.170:0/2778269798 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7a4079e40 0x7ff7a407c300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.880+0000 7ff7be35a640 1 --2- 172.21.15.170:0/2778269798 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7b8107930 0x7ff7b819dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.880+0000 7ff7be35a640 1 --2- 172.21.15.170:0/2778269798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b8101930 0x7ff7b819d6b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.880+0000 7ff7be35a640 1 -- 172.21.15.170:0/2778269798 >> 172.21.15.170:0/2778269798 conn(0x7ff7b80fd630 msgr2=0x7ff7b80fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:20.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.880+0000 7ff7be35a640 1 -- 172.21.15.170:0/2778269798 shutdown_connections 2024-09-04T16:35:20.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.881+0000 7ff7be35a640 1 -- 172.21.15.170:0/2778269798 wait complete. 2024-09-04T16:35:20.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:20 smithi193 ceph-mon[82547]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:35:20.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:20 smithi193 ceph-mon[82547]: pgmap v136: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-04T16:35:20.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.963+0000 7efeffc21640 1 -- 172.21.15.170:0/2342265470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef8107930 msgr2=0x7efef8107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:20.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.963+0000 7efeffc21640 1 --2- 172.21.15.170:0/2342265470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef8107930 0x7efef8107d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efef4009880 tx=0x7efef402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.963+0000 7efeffc21640 1 -- 172.21.15.170:0/2342265470 shutdown_connections 2024-09-04T16:35:20.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.963+0000 7efeffc21640 1 --2- 172.21.15.170:0/2342265470 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efef8101930 0x7efef8101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.963+0000 7efeffc21640 1 --2- 172.21.15.170:0/2342265470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef8107930 0x7efef8107d10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.963+0000 7efeffc21640 1 -- 172.21.15.170:0/2342265470 >> 172.21.15.170:0/2342265470 conn(0x7efef80fd630 msgr2=0x7efef80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:20.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.963+0000 7efeffc21640 1 -- 172.21.15.170:0/2342265470 shutdown_connections 2024-09-04T16:35:20.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.963+0000 7efeffc21640 1 -- 172.21.15.170:0/2342265470 wait complete. 2024-09-04T16:35:20.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.964+0000 7efeffc21640 1 Processor -- start 2024-09-04T16:35:20.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.964+0000 7efeffc21640 1 -- start start 2024-09-04T16:35:20.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.964+0000 7efeffc21640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efef8101930 0x7efef819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:20.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.964+0000 7efeffc21640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef8107930 0x7efef819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:20.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.964+0000 7efeffc21640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efef810ee00 con 0x7efef8107930 2024-09-04T16:35:20.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.964+0000 7efeffc21640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efef810ec80 con 0x7efef8101930 2024-09-04T16:35:20.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.964+0000 7efefd1bc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef8107930 0x7efef819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:20.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.964+0000 7efefd1bc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef8107930 0x7efef819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42274/0 (socket says 172.21.15.170:42274) 2024-09-04T16:35:20.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.964+0000 7efefd1bc640 1 -- 172.21.15.170:0/3847369649 learned_addr learned my addr 172.21.15.170:0/3847369649 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:35:20.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.964+0000 7efefd9bd640 1 --2- 172.21.15.170:0/3847369649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efef8101930 0x7efef819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:20.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.964+0000 7efefd1bc640 1 -- 172.21.15.170:0/3847369649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efef8101930 msgr2=0x7efef819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:20.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.964+0000 7efefd1bc640 1 --2- 172.21.15.170:0/3847369649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efef8101930 0x7efef819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:20.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.964+0000 7efefd1bc640 1 -- 172.21.15.170:0/3847369649 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef81977f0 con 0x7efef8107930 2024-09-04T16:35:20.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.965+0000 7efefd1bc640 1 --2- 172.21.15.170:0/3847369649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef8107930 0x7efef819dbb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efee800e970 tx=0x7efee800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:20.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.965+0000 7efeeeffd640 1 -- 172.21.15.170:0/3847369649 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efee800cac0 con 0x7efef8107930 2024-09-04T16:35:20.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.965+0000 7efeffc21640 1 -- 172.21.15.170:0/3847369649 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efef8197ae0 con 0x7efef8107930 2024-09-04T16:35:20.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.965+0000 7efeeeffd640 1 -- 172.21.15.170:0/3847369649 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efee80054e0 con 0x7efef8107930 2024-09-04T16:35:20.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.965+0000 7efeeeffd640 1 -- 172.21.15.170:0/3847369649 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efee8010430 con 0x7efef8107930 2024-09-04T16:35:20.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.965+0000 7efeffc21640 1 -- 172.21.15.170:0/3847369649 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efef8198070 con 0x7efef8107930 2024-09-04T16:35:20.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.966+0000 7efeffc21640 1 -- 172.21.15.170:0/3847369649 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efef8103070 con 0x7efef8107930 2024-09-04T16:35:20.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.966+0000 7efeeeffd640 1 -- 172.21.15.170:0/3847369649 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7efee8004e80 con 0x7efef8107930 2024-09-04T16:35:20.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.967+0000 7efeeeffd640 1 --2- 172.21.15.170:0/3847369649 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efee4079e30 0x7efee407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:20.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.967+0000 7efeeeffd640 1 -- 172.21.15.170:0/3847369649 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7efee809d0d0 con 0x7efef8107930 2024-09-04T16:35:20.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.967+0000 7efefd9bd640 1 --2- 172.21.15.170:0/3847369649 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efee4079e30 0x7efee407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:20.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.967+0000 7efefd9bd640 1 --2- 172.21.15.170:0/3847369649 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efee4079e30 0x7efee407c2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efef40096c0 tx=0x7efef4031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:20.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:20.971+0000 7efeeeffd640 1 -- 172.21.15.170:0/3847369649 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efee8064b90 con 0x7efef8107930 2024-09-04T16:35:21.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.274+0000 7efeffc21640 1 -- 172.21.15.170:0/3847369649 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7efef8109ea0 con 0x7efef8107930 2024-09-04T16:35:21.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.275+0000 7efeeeffd640 1 -- 172.21.15.170:0/3847369649 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+732 (secure 0 0 0) 0x7efee8068d00 con 0x7efef8107930 2024-09-04T16:35:21.276 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:35:21.276 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:35:21.276 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:35:21.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:35:21.276 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:35:21.276 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:35:21.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:35:21.276 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:35:21.276 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 5 2024-09-04T16:35:21.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:35:21.276 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:35:21.277 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:35:21.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:35:21.277 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:35:21.277 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 9, 2024-09-04T16:35:21.277 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:35:21.277 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:35:21.277 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:35:21.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.278+0000 7efeffc21640 1 -- 172.21.15.170:0/3847369649 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efee4079e30 msgr2=0x7efee407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:21.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.278+0000 7efeffc21640 1 --2- 172.21.15.170:0/3847369649 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efee4079e30 0x7efee407c2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efef40096c0 tx=0x7efef4031400 comp rx=0 tx=0).stop 2024-09-04T16:35:21.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.278+0000 7efeffc21640 1 -- 172.21.15.170:0/3847369649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef8107930 msgr2=0x7efef819dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:21.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.278+0000 7efeffc21640 1 --2- 172.21.15.170:0/3847369649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef8107930 0x7efef819dbb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efee800e970 tx=0x7efee800ed70 comp rx=0 tx=0).stop 2024-09-04T16:35:21.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.278+0000 7efeffc21640 1 -- 172.21.15.170:0/3847369649 shutdown_connections 2024-09-04T16:35:21.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.278+0000 7efeffc21640 1 --2- 172.21.15.170:0/3847369649 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efee4079e30 0x7efee407c2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.278+0000 7efeffc21640 1 --2- 172.21.15.170:0/3847369649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef8107930 0x7efef819dbb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.278+0000 7efeffc21640 1 --2- 172.21.15.170:0/3847369649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efef8101930 0x7efef819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.278+0000 7efeffc21640 1 -- 172.21.15.170:0/3847369649 >> 172.21.15.170:0/3847369649 conn(0x7efef80fd630 msgr2=0x7efef80fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:21.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.279+0000 7efeffc21640 1 -- 172.21.15.170:0/3847369649 shutdown_connections 2024-09-04T16:35:21.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.279+0000 7efeffc21640 1 -- 172.21.15.170:0/3847369649 wait complete. 2024-09-04T16:35:21.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.364+0000 7f07867c0640 1 -- 172.21.15.170:0/1470548744 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07801007e0 msgr2=0x7f0780100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:21.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.364+0000 7f07867c0640 1 --2- 172.21.15.170:0/1470548744 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07801007e0 0x7f0780100c40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0768009880 tx=0x7f076802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.364+0000 7f07867c0640 1 -- 172.21.15.170:0/1470548744 shutdown_connections 2024-09-04T16:35:21.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.364+0000 7f07867c0640 1 --2- 172.21.15.170:0/1470548744 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07801007e0 0x7f0780100c40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.364+0000 7f07867c0640 1 --2- 172.21.15.170:0/1470548744 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07801067e0 0x7f0780106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.364+0000 7f07867c0640 1 -- 172.21.15.170:0/1470548744 >> 172.21.15.170:0/1470548744 conn(0x7f07800fc4c0 msgr2=0x7f07800fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:21.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.364+0000 7f07867c0640 1 -- 172.21.15.170:0/1470548744 shutdown_connections 2024-09-04T16:35:21.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.364+0000 7f07867c0640 1 -- 172.21.15.170:0/1470548744 wait complete. 2024-09-04T16:35:21.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.364+0000 7f07867c0640 1 Processor -- start 2024-09-04T16:35:21.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.365+0000 7f07867c0640 1 -- start start 2024-09-04T16:35:21.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.365+0000 7f07867c0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07801007e0 0x7f078019d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:21.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.365+0000 7f07867c0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07801067e0 0x7f078019db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:21.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.365+0000 7f07867c0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f078010dc90 con 0x7f07801007e0 2024-09-04T16:35:21.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.365+0000 7f07867c0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f078010db10 con 0x7f07801067e0 2024-09-04T16:35:21.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.365+0000 7f077ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07801007e0 0x7f078019d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:21.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.365+0000 7f077ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07801007e0 0x7f078019d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42296/0 (socket says 172.21.15.170:42296) 2024-09-04T16:35:21.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.365+0000 7f077ffff640 1 -- 172.21.15.170:0/4203845738 learned_addr learned my addr 172.21.15.170:0/4203845738 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:35:21.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.365+0000 7f077f7fe640 1 --2- 172.21.15.170:0/4203845738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07801067e0 0x7f078019db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:21.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.365+0000 7f077ffff640 1 -- 172.21.15.170:0/4203845738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07801067e0 msgr2=0x7f078019db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:21.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.365+0000 7f077ffff640 1 --2- 172.21.15.170:0/4203845738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07801067e0 0x7f078019db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.365+0000 7f077ffff640 1 -- 172.21.15.170:0/4203845738 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0780197790 con 0x7f07801007e0 2024-09-04T16:35:21.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.365+0000 7f077f7fe640 1 --2- 172.21.15.170:0/4203845738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07801067e0 0x7f078019db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:35:21.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.365+0000 7f077ffff640 1 --2- 172.21.15.170:0/4203845738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07801007e0 0x7f078019d610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f077000d8d0 tx=0x7f077000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:21.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.366+0000 7f077d7fa640 1 -- 172.21.15.170:0/4203845738 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0770017070 con 0x7f07801007e0 2024-09-04T16:35:21.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.366+0000 7f07867c0640 1 -- 172.21.15.170:0/4203845738 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0780197a80 con 0x7f07801007e0 2024-09-04T16:35:21.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.366+0000 7f077d7fa640 1 -- 172.21.15.170:0/4203845738 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0770010460 con 0x7f07801007e0 2024-09-04T16:35:21.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.366+0000 7f077d7fa640 1 -- 172.21.15.170:0/4203845738 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f077000f5f0 con 0x7f07801007e0 2024-09-04T16:35:21.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.366+0000 7f07867c0640 1 -- 172.21.15.170:0/4203845738 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0780198010 con 0x7f07801007e0 2024-09-04T16:35:21.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.367+0000 7f07867c0640 1 -- 172.21.15.170:0/4203845738 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0780101f20 con 0x7f07801007e0 2024-09-04T16:35:21.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.367+0000 7f077d7fa640 1 -- 172.21.15.170:0/4203845738 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f0770009a30 con 0x7f07801007e0 2024-09-04T16:35:21.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.368+0000 7f077d7fa640 1 --2- 172.21.15.170:0/4203845738 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f076c079e30 0x7f076c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:21.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.368+0000 7f077f7fe640 1 --2- 172.21.15.170:0/4203845738 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f076c079e30 0x7f076c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:21.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.368+0000 7f077d7fa640 1 -- 172.21.15.170:0/4203845738 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f077009c8e0 con 0x7f07801007e0 2024-09-04T16:35:21.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.369+0000 7f077f7fe640 1 --2- 172.21.15.170:0/4203845738 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f076c079e30 0x7f076c07c2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0768031460 tx=0x7f07680095f0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:21.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.372+0000 7f077d7fa640 1 -- 172.21.15.170:0/4203845738 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f07700643a0 con 0x7f07801007e0 2024-09-04T16:35:21.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.588+0000 7f07867c0640 1 -- 172.21.15.170:0/4203845738 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f07801982c0 con 0x7f07801007e0 2024-09-04T16:35:21.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.589+0000 7f077d7fa640 1 -- 172.21.15.170:0/4203845738 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2036 (secure 0 0 0) 0x7f0770068510 con 0x7f07801007e0 2024-09-04T16:35:21.590 INFO:teuthology.orchestra.run.smithi170.stdout:e15 2024-09-04T16:35:21.590 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:27:39:151187+0000 2024-09-04T16:35:21.590 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:35:21.590 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:35:21.590 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:35:21.590 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:35:21.590 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:35:21.590 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:35:21.590 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 15 2024-09-04T16:35:21.590 INFO:teuthology.orchestra.run.smithi170.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-04T16:35:21.590 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:35:21.591 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:27:39.151182+0000 2024-09-04T16:35:21.591 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:35:21.591 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:35:21.591 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:35:21.591 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:35:21.591 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:35:21.591 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:35:21.591 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:35:21.591 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:35:21.591 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 45 2024-09-04T16:35:21.591 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:35:21.591 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:35:21.591 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:35:21.592 INFO:teuthology.orchestra.run.smithi170.stdout:up {0=14562,1=14578} 2024-09-04T16:35:21.592 INFO:teuthology.orchestra.run.smithi170.stdout:failed 2024-09-04T16:35:21.592 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:35:21.592 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:35:21.592 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:35:21.592 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:35:21.592 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:35:21.592 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:35:21.592 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:35:21.592 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:35:21.592 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 14562 members: 14562,14578 2024-09-04T16:35:21.592 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{0:14562} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:35:21.592 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{1:14578} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:35:21.593 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:35:21.593 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:35:21.593 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:35:21.593 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:35:21.593 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:24315} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.193:6826/288890560,v1:172.21.15.193:6827/288890560] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:35:21.593 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:24319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1128257367,v1:172.21.15.193:6825/1128257367] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:35:21.594 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 15 2024-09-04T16:35:21.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.591+0000 7f07867c0640 1 -- 172.21.15.170:0/4203845738 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f076c079e30 msgr2=0x7f076c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:21.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.591+0000 7f07867c0640 1 --2- 172.21.15.170:0/4203845738 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f076c079e30 0x7f076c07c2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0768031460 tx=0x7f07680095f0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.591+0000 7f07867c0640 1 -- 172.21.15.170:0/4203845738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07801007e0 msgr2=0x7f078019d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:21.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.591+0000 7f07867c0640 1 --2- 172.21.15.170:0/4203845738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07801007e0 0x7f078019d610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f077000d8d0 tx=0x7f077000dd90 comp rx=0 tx=0).stop 2024-09-04T16:35:21.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.591+0000 7f07867c0640 1 -- 172.21.15.170:0/4203845738 shutdown_connections 2024-09-04T16:35:21.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.591+0000 7f07867c0640 1 --2- 172.21.15.170:0/4203845738 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f076c079e30 0x7f076c07c2f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.591+0000 7f07867c0640 1 --2- 172.21.15.170:0/4203845738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07801067e0 0x7f078019db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.591+0000 7f07867c0640 1 --2- 172.21.15.170:0/4203845738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07801007e0 0x7f078019d610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.591+0000 7f07867c0640 1 -- 172.21.15.170:0/4203845738 >> 172.21.15.170:0/4203845738 conn(0x7f07800fc4c0 msgr2=0x7f0780104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:21.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.591+0000 7f07867c0640 1 -- 172.21.15.170:0/4203845738 shutdown_connections 2024-09-04T16:35:21.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.591+0000 7f07867c0640 1 -- 172.21.15.170:0/4203845738 wait complete. 2024-09-04T16:35:21.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.678+0000 7f56f5995640 1 -- 172.21.15.170:0/2027641706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56f0107920 msgr2=0x7f56f0107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:21.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.678+0000 7f56f5995640 1 --2- 172.21.15.170:0/2027641706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56f0107920 0x7f56f0107d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009880 tx=0x7f56e002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.678+0000 7f56f5995640 1 -- 172.21.15.170:0/2027641706 shutdown_connections 2024-09-04T16:35:21.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.678+0000 7f56f5995640 1 --2- 172.21.15.170:0/2027641706 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f56f0101920 0x7f56f0101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.678+0000 7f56f5995640 1 --2- 172.21.15.170:0/2027641706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56f0107920 0x7f56f0107d00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.678+0000 7f56f5995640 1 -- 172.21.15.170:0/2027641706 >> 172.21.15.170:0/2027641706 conn(0x7f56f00fd620 msgr2=0x7f56f00ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:21.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.678+0000 7f56f5995640 1 -- 172.21.15.170:0/2027641706 shutdown_connections 2024-09-04T16:35:21.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.678+0000 7f56f5995640 1 -- 172.21.15.170:0/2027641706 wait complete. 2024-09-04T16:35:21.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.679+0000 7f56f5995640 1 Processor -- start 2024-09-04T16:35:21.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.679+0000 7f56f5995640 1 -- start start 2024-09-04T16:35:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.679+0000 7f56f5995640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56f0101920 0x7f56f019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.679+0000 7f56f5995640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f56f0107920 0x7f56f019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.679+0000 7f56f5995640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f56f010edf0 con 0x7f56f0101920 2024-09-04T16:35:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.679+0000 7f56f5995640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f56f010ec70 con 0x7f56f0107920 2024-09-04T16:35:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.679+0000 7f56eeffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56f0101920 0x7f56f019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.680+0000 7f56eeffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56f0101920 0x7f56f019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42310/0 (socket says 172.21.15.170:42310) 2024-09-04T16:35:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.680+0000 7f56eeffd640 1 -- 172.21.15.170:0/2200279342 learned_addr learned my addr 172.21.15.170:0/2200279342 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:35:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.680+0000 7f56ee7fc640 1 --2- 172.21.15.170:0/2200279342 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f56f0107920 0x7f56f019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.680+0000 7f56eeffd640 1 -- 172.21.15.170:0/2200279342 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f56f0107920 msgr2=0x7f56f019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.680+0000 7f56eeffd640 1 --2- 172.21.15.170:0/2200279342 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f56f0107920 0x7f56f019dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.680+0000 7f56eeffd640 1 -- 172.21.15.170:0/2200279342 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f01977f0 con 0x7f56f0101920 2024-09-04T16:35:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.680+0000 7f56eeffd640 1 --2- 172.21.15.170:0/2200279342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56f0101920 0x7f56f019d670 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f56e0031460 tx=0x7f56e0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.680+0000 7f56f4993640 1 -- 172.21.15.170:0/2200279342 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f56e003f070 con 0x7f56f0101920 2024-09-04T16:35:21.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.680+0000 7f56f5995640 1 -- 172.21.15.170:0/2200279342 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f0197a80 con 0x7f56f0101920 2024-09-04T16:35:21.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.680+0000 7f56f4993640 1 -- 172.21.15.170:0/2200279342 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f56e00035f0 con 0x7f56f0101920 2024-09-04T16:35:21.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.680+0000 7f56f5995640 1 -- 172.21.15.170:0/2200279342 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f0197fb0 con 0x7f56f0101920 2024-09-04T16:35:21.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.680+0000 7f56f4993640 1 -- 172.21.15.170:0/2200279342 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f56e0035030 con 0x7f56f0101920 2024-09-04T16:35:21.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.681+0000 7f56f5995640 1 -- 172.21.15.170:0/2200279342 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f0103060 con 0x7f56f0101920 2024-09-04T16:35:21.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.682+0000 7f56f4993640 1 -- 172.21.15.170:0/2200279342 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f56e0042070 con 0x7f56f0101920 2024-09-04T16:35:21.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.683+0000 7f56f4993640 1 --2- 172.21.15.170:0/2200279342 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f56d8079e30 0x7f56d807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:21.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.683+0000 7f56f4993640 1 -- 172.21.15.170:0/2200279342 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f56e00bd2d0 con 0x7f56f0101920 2024-09-04T16:35:21.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.683+0000 7f56ee7fc640 1 --2- 172.21.15.170:0/2200279342 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f56d8079e30 0x7f56d807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:21.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.683+0000 7f56ee7fc640 1 --2- 172.21.15.170:0/2200279342 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f56d8079e30 0x7f56d807c2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f56f00ffbd0 tx=0x7f56e4005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:21.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.687+0000 7f56f4993640 1 -- 172.21.15.170:0/2200279342 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f56e0088f00 con 0x7f56f0101920 2024-09-04T16:35:21.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:21 smithi170 ceph-mon[113855]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:35:21.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:21 smithi170 ceph-mon[113855]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:35:21.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:21 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3847369649' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:35:21.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.894+0000 7f56f5995640 1 -- 172.21.15.170:0/2200279342 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f56f0198260 con 0x7f56d8079e30 2024-09-04T16:35:21.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.896+0000 7f56f4993640 1 -- 172.21.15.170:0/2200279342 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f56f0198260 con 0x7f56d8079e30 2024-09-04T16:35:21.896 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:35:21.896 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:35:21.896 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:35:21.897 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:35:21.897 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:35:21.897 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-04T16:35:21.897 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:35:21.897 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-04T16:35:21.897 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:35:21.897 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "6/23 daemons upgraded", 2024-09-04T16:35:21.897 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-04T16:35:21.897 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:35:21.897 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:35:21.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.898+0000 7f56f5995640 1 -- 172.21.15.170:0/2200279342 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f56d8079e30 msgr2=0x7f56d807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:21.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.898+0000 7f56f5995640 1 --2- 172.21.15.170:0/2200279342 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f56d8079e30 0x7f56d807c2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f56f00ffbd0 tx=0x7f56e4005f90 comp rx=0 tx=0).stop 2024-09-04T16:35:21.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.898+0000 7f56f5995640 1 -- 172.21.15.170:0/2200279342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56f0101920 msgr2=0x7f56f019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:21.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.898+0000 7f56f5995640 1 --2- 172.21.15.170:0/2200279342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56f0101920 0x7f56f019d670 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f56e0031460 tx=0x7f56e0004530 comp rx=0 tx=0).stop 2024-09-04T16:35:21.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.898+0000 7f56f5995640 1 -- 172.21.15.170:0/2200279342 shutdown_connections 2024-09-04T16:35:21.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.898+0000 7f56f5995640 1 --2- 172.21.15.170:0/2200279342 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f56d8079e30 0x7f56d807c2f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.898+0000 7f56f5995640 1 --2- 172.21.15.170:0/2200279342 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f56f0107920 0x7f56f019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.898+0000 7f56f5995640 1 --2- 172.21.15.170:0/2200279342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56f0101920 0x7f56f019d670 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.898+0000 7f56f5995640 1 -- 172.21.15.170:0/2200279342 >> 172.21.15.170:0/2200279342 conn(0x7f56f00fd620 msgr2=0x7f56f00fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:21.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.898+0000 7f56f5995640 1 -- 172.21.15.170:0/2200279342 shutdown_connections 2024-09-04T16:35:21.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.898+0000 7f56f5995640 1 -- 172.21.15.170:0/2200279342 wait complete. 2024-09-04T16:35:21.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:21 smithi193 ceph-mon[82547]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:35:21.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:21 smithi193 ceph-mon[82547]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:35:21.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:21 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3847369649' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:35:21.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.983+0000 7f05d0ba8640 1 -- 172.21.15.170:0/3748460446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05cc1007e0 msgr2=0x7f05cc100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:21.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.983+0000 7f05d0ba8640 1 --2- 172.21.15.170:0/3748460446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05cc1007e0 0x7f05cc100c40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009c20 tx=0x7f05c002a970 comp rx=0 tx=0).stop 2024-09-04T16:35:21.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.983+0000 7f05d0ba8640 1 -- 172.21.15.170:0/3748460446 shutdown_connections 2024-09-04T16:35:21.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.983+0000 7f05d0ba8640 1 --2- 172.21.15.170:0/3748460446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05cc1007e0 0x7f05cc100c40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.983+0000 7f05d0ba8640 1 --2- 172.21.15.170:0/3748460446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05cc1067e0 0x7f05cc106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.983+0000 7f05d0ba8640 1 -- 172.21.15.170:0/3748460446 >> 172.21.15.170:0/3748460446 conn(0x7f05cc0fc4c0 msgr2=0x7f05cc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:21.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.983+0000 7f05d0ba8640 1 -- 172.21.15.170:0/3748460446 shutdown_connections 2024-09-04T16:35:21.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.983+0000 7f05d0ba8640 1 -- 172.21.15.170:0/3748460446 wait complete. 2024-09-04T16:35:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.984+0000 7f05d0ba8640 1 Processor -- start 2024-09-04T16:35:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.984+0000 7f05d0ba8640 1 -- start start 2024-09-04T16:35:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.984+0000 7f05d0ba8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05cc1007e0 0x7f05cc1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.984+0000 7f05d0ba8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05cc1067e0 0x7f05cc198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.984+0000 7f05d0ba8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc10dcb0 con 0x7f05cc1007e0 2024-09-04T16:35:21.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.984+0000 7f05d0ba8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc10db30 con 0x7f05cc1067e0 2024-09-04T16:35:21.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.984+0000 7f05ca59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05cc1007e0 0x7f05cc1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:21.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.984+0000 7f05ca59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05cc1007e0 0x7f05cc1987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42326/0 (socket says 172.21.15.170:42326) 2024-09-04T16:35:21.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.984+0000 7f05ca59c640 1 -- 172.21.15.170:0/2174856896 learned_addr learned my addr 172.21.15.170:0/2174856896 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:35:21.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.984+0000 7f05c9d9b640 1 --2- 172.21.15.170:0/2174856896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05cc1067e0 0x7f05cc198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:21.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.985+0000 7f05ca59c640 1 -- 172.21.15.170:0/2174856896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05cc1067e0 msgr2=0x7f05cc198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:21.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.985+0000 7f05ca59c640 1 --2- 172.21.15.170:0/2174856896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05cc1067e0 0x7f05cc198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:21.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.985+0000 7f05ca59c640 1 -- 172.21.15.170:0/2174856896 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05cc199320 con 0x7f05cc1007e0 2024-09-04T16:35:21.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.985+0000 7f05ca59c640 1 --2- 172.21.15.170:0/2174856896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05cc1007e0 0x7f05cc1987e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f05c400e970 tx=0x7f05c400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:21.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.985+0000 7f05bb7fe640 1 -- 172.21.15.170:0/2174856896 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05c400cac0 con 0x7f05cc1007e0 2024-09-04T16:35:21.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.985+0000 7f05d0ba8640 1 -- 172.21.15.170:0/2174856896 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05cc199610 con 0x7f05cc1007e0 2024-09-04T16:35:21.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.985+0000 7f05bb7fe640 1 -- 172.21.15.170:0/2174856896 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05c40054e0 con 0x7f05cc1007e0 2024-09-04T16:35:21.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.985+0000 7f05bb7fe640 1 -- 172.21.15.170:0/2174856896 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05c4010430 con 0x7f05cc1007e0 2024-09-04T16:35:21.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.985+0000 7f05d0ba8640 1 -- 172.21.15.170:0/2174856896 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05cc1a1c10 con 0x7f05cc1007e0 2024-09-04T16:35:21.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.986+0000 7f05d0ba8640 1 -- 172.21.15.170:0/2174856896 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05cc101f20 con 0x7f05cc1007e0 2024-09-04T16:35:21.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.987+0000 7f05bb7fe640 1 -- 172.21.15.170:0/2174856896 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f05c4004e80 con 0x7f05cc1007e0 2024-09-04T16:35:21.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.987+0000 7f05bb7fe640 1 --2- 172.21.15.170:0/2174856896 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f05b4079e30 0x7f05b407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:21.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.987+0000 7f05bb7fe640 1 -- 172.21.15.170:0/2174856896 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f05c409d020 con 0x7f05cc1007e0 2024-09-04T16:35:21.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.987+0000 7f05c9d9b640 1 --2- 172.21.15.170:0/2174856896 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f05b4079e30 0x7f05b407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:21.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.988+0000 7f05c9d9b640 1 --2- 172.21.15.170:0/2174856896 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f05b4079e30 0x7f05b407c2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009430 tx=0x7f05c003c040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:21.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:21.992+0000 7f05bb7fe640 1 -- 172.21.15.170:0/2174856896 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f05cc199610 con 0x7f05cc1007e0 2024-09-04T16:35:22.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:22.248+0000 7f05d0ba8640 1 -- 172.21.15.170:0/2174856896 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f05cc108d50 con 0x7f05cc1007e0 2024-09-04T16:35:22.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:22.248+0000 7f05bb7fe640 1 -- 172.21.15.170:0/2174856896 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1573 (secure 0 0 0) 0x7f05c4064ae0 con 0x7f05cc1007e0 2024-09-04T16:35:22.249 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 58/312 objects degraded (18.590%), 20 pgs degraded 2024-09-04T16:35:22.249 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:35:22.249 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:35:22.249 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-04T16:35:22.249 INFO:teuthology.orchestra.run.smithi170.stdout: osd.0 (root=default,host=smithi170) is down 2024-09-04T16:35:22.249 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 58/312 objects degraded (18.590%), 20 pgs degraded 2024-09-04T16:35:22.250 INFO:teuthology.orchestra.run.smithi170.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-04T16:35:22.250 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-04T16:35:22.250 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-04T16:35:22.250 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-04T16:35:22.250 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-04T16:35:22.250 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-04T16:35:22.250 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-04T16:35:22.250 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-04T16:35:22.250 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-04T16:35:22.250 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-04T16:35:22.250 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-04T16:35:22.250 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-04T16:35:22.250 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-09-04T16:35:22.250 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-04T16:35:22.251 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-04T16:35:22.251 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-04T16:35:22.251 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-04T16:35:22.251 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-04T16:35:22.251 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-04T16:35:22.251 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-04T16:35:22.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:22.252+0000 7f05d0ba8640 1 -- 172.21.15.170:0/2174856896 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f05b4079e30 msgr2=0x7f05b407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:22.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:22.252+0000 7f05d0ba8640 1 --2- 172.21.15.170:0/2174856896 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f05b4079e30 0x7f05b407c2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009430 tx=0x7f05c003c040 comp rx=0 tx=0).stop 2024-09-04T16:35:22.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:22.252+0000 7f05d0ba8640 1 -- 172.21.15.170:0/2174856896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05cc1007e0 msgr2=0x7f05cc1987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:22.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:22.252+0000 7f05d0ba8640 1 --2- 172.21.15.170:0/2174856896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05cc1007e0 0x7f05cc1987e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f05c400e970 tx=0x7f05c400ed70 comp rx=0 tx=0).stop 2024-09-04T16:35:22.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:22.252+0000 7f05d0ba8640 1 -- 172.21.15.170:0/2174856896 shutdown_connections 2024-09-04T16:35:22.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:22.252+0000 7f05d0ba8640 1 --2- 172.21.15.170:0/2174856896 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f05b4079e30 0x7f05b407c2f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:22.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:22.252+0000 7f05d0ba8640 1 --2- 172.21.15.170:0/2174856896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05cc1067e0 0x7f05cc198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:22.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:22.252+0000 7f05d0ba8640 1 --2- 172.21.15.170:0/2174856896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05cc1007e0 0x7f05cc1987e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:22.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:22.252+0000 7f05d0ba8640 1 -- 172.21.15.170:0/2174856896 >> 172.21.15.170:0/2174856896 conn(0x7f05cc0fc4c0 msgr2=0x7f05cc0fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:22.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:22.252+0000 7f05d0ba8640 1 -- 172.21.15.170:0/2174856896 shutdown_connections 2024-09-04T16:35:22.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:22.252+0000 7f05d0ba8640 1 -- 172.21.15.170:0/2174856896 wait complete. 2024-09-04T16:35:22.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:22 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/4203845738' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:35:22.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:22 smithi170 ceph-mon[113855]: Health check update: Degraded data redundancy: 58/312 objects degraded (18.590%), 20 pgs degraded (PG_DEGRADED) 2024-09-04T16:35:22.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:22 smithi170 ceph-mon[113855]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:35:22.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:22 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2174856896' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:35:22.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:22 smithi170 ceph-mon[113855]: pgmap v137: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-04T16:35:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:22 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/4203845738' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:35:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:22 smithi193 ceph-mon[82547]: Health check update: Degraded data redundancy: 58/312 objects degraded (18.590%), 20 pgs degraded (PG_DEGRADED) 2024-09-04T16:35:22.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:22 smithi193 ceph-mon[82547]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:35:22.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:22 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2174856896' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:35:22.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:22 smithi193 ceph-mon[82547]: pgmap v137: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-04T16:35:24.095 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:23 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:24.095 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:23 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:24.095 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:23 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:24.095 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:23 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:24.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:23 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:24.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:23 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:24.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:23 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:24.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:23 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:24.351 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:24 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0[123095]: 2024-09-04T16:35:24.094+0000 7f1330f67640 -1 osd.0 47 log_to_monitors true 2024-09-04T16:35:25.002 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:24 smithi170 ceph-mon[113855]: from='osd.0 [v2:172.21.15.170:6802/2208542885,v1:172.21.15.170:6803/2208542885]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-04T16:35:25.002 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:24 smithi170 ceph-mon[113855]: pgmap v138: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-04T16:35:25.003 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 16:35:24 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0[123095]: 2024-09-04T16:35:24.742+0000 7f1328d11640 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-04T16:35:25.057 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:24 smithi193 ceph-mon[82547]: from='osd.0 [v2:172.21.15.170:6802/2208542885,v1:172.21.15.170:6803/2208542885]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-04T16:35:25.057 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:24 smithi193 ceph-mon[82547]: pgmap v138: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-04T16:35:26.081 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:25 smithi170 ceph-mon[113855]: from='osd.0 [v2:172.21.15.170:6802/2208542885,v1:172.21.15.170:6803/2208542885]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-04T16:35:26.081 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:25 smithi170 ceph-mon[113855]: osdmap e50: 6 total, 5 up, 6 in 2024-09-04T16:35:26.081 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:25 smithi170 ceph-mon[113855]: from='osd.0 [v2:172.21.15.170:6802/2208542885,v1:172.21.15.170:6803/2208542885]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]} : dispatch 2024-09-04T16:35:26.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:25 smithi193 ceph-mon[82547]: from='osd.0 [v2:172.21.15.170:6802/2208542885,v1:172.21.15.170:6803/2208542885]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-04T16:35:26.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:25 smithi193 ceph-mon[82547]: osdmap e50: 6 total, 5 up, 6 in 2024-09-04T16:35:26.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:25 smithi193 ceph-mon[82547]: from='osd.0 [v2:172.21.15.170:6802/2208542885,v1:172.21.15.170:6803/2208542885]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]} : dispatch 2024-09-04T16:35:27.049 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:26 smithi193 ceph-mon[82547]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-04T16:35:27.049 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:26 smithi193 ceph-mon[82547]: osd.0 [v2:172.21.15.170:6802/2208542885,v1:172.21.15.170:6803/2208542885] boot 2024-09-04T16:35:27.049 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:26 smithi193 ceph-mon[82547]: osdmap e51: 6 total, 6 up, 6 in 2024-09-04T16:35:27.049 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:26 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-04T16:35:27.049 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:26 smithi193 ceph-mon[82547]: pgmap v141: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-04T16:35:27.049 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:26 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:27.049 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:26 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:27.049 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:26 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:35:27.049 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:26 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:35:27.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:26 smithi170 ceph-mon[113855]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-04T16:35:27.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:26 smithi170 ceph-mon[113855]: osd.0 [v2:172.21.15.170:6802/2208542885,v1:172.21.15.170:6803/2208542885] boot 2024-09-04T16:35:27.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:26 smithi170 ceph-mon[113855]: osdmap e51: 6 total, 6 up, 6 in 2024-09-04T16:35:27.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:26 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-04T16:35:27.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:26 smithi170 ceph-mon[113855]: pgmap v141: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-04T16:35:27.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:26 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:27.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:26 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:27.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:26 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:35:27.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:26 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:35:28.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:27 smithi170 ceph-mon[113855]: osdmap e52: 6 total, 6 up, 6 in 2024-09-04T16:35:28.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:27 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:28.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:27 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:35:28.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:27 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:35:28.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:27 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:35:28.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:27 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:35:28.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:27 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-04T16:35:28.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:27 smithi170 ceph-mon[113855]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-04T16:35:28.104 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:27 smithi170 ceph-mon[113855]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-04T16:35:28.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:27 smithi193 ceph-mon[82547]: osdmap e52: 6 total, 6 up, 6 in 2024-09-04T16:35:28.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:27 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:28.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:27 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:35:28.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:27 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:35:28.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:27 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:35:28.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:27 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:35:28.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:27 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-04T16:35:28.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:27 smithi193 ceph-mon[82547]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-04T16:35:28.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:27 smithi193 ceph-mon[82547]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-04T16:35:29.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:28 smithi170 ceph-mon[113855]: pgmap v143: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-04T16:35:29.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:28 smithi193 ceph-mon[82547]: pgmap v143: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 58/312 objects degraded (18.590%) 2024-09-04T16:35:30.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:30.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:35:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:35:31.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:31 smithi170 ceph-mon[113855]: pgmap v144: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:31.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:31 smithi193 ceph-mon[82547]: pgmap v144: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:32.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:32 smithi193 ceph-mon[82547]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/312 objects degraded (18.590%), 20 pgs degraded) 2024-09-04T16:35:32.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:32 smithi170 ceph-mon[113855]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/312 objects degraded (18.590%), 20 pgs degraded) 2024-09-04T16:35:33.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:33 smithi170 ceph-mon[113855]: pgmap v145: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:33.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:33 smithi193 ceph-mon[82547]: pgmap v145: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:34.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:34 smithi170 ceph-mon[113855]: pgmap v146: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:34.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:34 smithi193 ceph-mon[82547]: pgmap v146: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:36.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:36 smithi193 ceph-mon[82547]: pgmap v147: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:36.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:36 smithi170 ceph-mon[113855]: pgmap v147: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:38 smithi170 ceph-mon[113855]: pgmap v148: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:38 smithi193 ceph-mon[82547]: pgmap v148: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:40.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:40 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:40.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:40 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:41.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:41 smithi170 ceph-mon[113855]: pgmap v149: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:41.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:41 smithi193 ceph-mon[82547]: pgmap v149: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:42.556 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:42 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-04T16:35:42.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:42 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-04T16:35:43.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:43 smithi170 ceph-mon[113855]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-04T16:35:43.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:43 smithi170 ceph-mon[113855]: Upgrade: osd.1 is safe to restart 2024-09-04T16:35:43.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:43 smithi170 ceph-mon[113855]: pgmap v150: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:43.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:43 smithi193 ceph-mon[82547]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-04T16:35:43.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:43 smithi193 ceph-mon[82547]: Upgrade: osd.1 is safe to restart 2024-09-04T16:35:43.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:43 smithi193 ceph-mon[82547]: pgmap v150: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:44 smithi170 ceph-mon[113855]: Upgrade: Updating osd.1 2024-09-04T16:35:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-04T16:35:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:35:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:44 smithi170 ceph-mon[113855]: Deploying daemon osd.1 on smithi170 2024-09-04T16:35:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:35:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:44 smithi193 ceph-mon[82547]: Upgrade: Updating osd.1 2024-09-04T16:35:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-04T16:35:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:35:44.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:44 smithi193 ceph-mon[82547]: Deploying daemon osd.1 on smithi170 2024-09-04T16:35:44.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:44.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:35:45.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:45 smithi170 ceph-mon[113855]: pgmap v151: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:45.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:45 smithi193 ceph-mon[82547]: pgmap v151: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:46.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:46 smithi170 ceph-mon[113855]: pgmap v152: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:46.602 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:46 smithi170 systemd[1]: Stopping Ceph osd.1 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:35:46.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:46 smithi193 ceph-mon[82547]: pgmap v152: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:47.102 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:46 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1[58108]: 2024-09-04T16:35:46.716+0000 7fd8fc2e4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T16:35:47.102 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:46 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1[58108]: 2024-09-04T16:35:46.716+0000 7fd8fc2e4640 -1 osd.1 52 *** Got signal Terminated *** 2024-09-04T16:35:47.102 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:46 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1[58108]: 2024-09-04T16:35:46.716+0000 7fd8fc2e4640 -1 osd.1 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-04T16:35:47.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:47 smithi193 ceph-mon[82547]: osd.1 marked itself down and dead 2024-09-04T16:35:47.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:47 smithi170 ceph-mon[113855]: osd.1 marked itself down and dead 2024-09-04T16:35:48.200 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:47 smithi170 podman[128464]: 2024-09-04 16:35:47.899778919 +0000 UTC m=+1.309139364 container died 20469ba5727bea044487e080fffdf357a0a7655dff040d5218c18dbfd6b5ada4 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1, RELEASE=squid-48920da, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-04T16:35:48.480 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:48 smithi170 podman[128464]: 2024-09-04 16:35:48.299658012 +0000 UTC m=+1.709018462 container cleanup 20469ba5727bea044487e080fffdf357a0a7655dff040d5218c18dbfd6b5ada4 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-48920da, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-09-04T16:35:48.481 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:48 smithi170 bash[128464]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1 2024-09-04T16:35:48.851 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:48 smithi170 podman[128479]: 2024-09-04 16:35:48.559793811 +0000 UTC m=+0.649418272 container remove 20469ba5727bea044487e080fffdf357a0a7655dff040d5218c18dbfd6b5ada4 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1, RELEASE=squid-48920da, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-04T16:35:48.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:48 smithi170 ceph-mon[113855]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-04T16:35:48.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:48 smithi170 ceph-mon[113855]: osdmap e53: 6 total, 5 up, 6 in 2024-09-04T16:35:48.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:48 smithi170 ceph-mon[113855]: pgmap v154: 65 pgs: 12 stale+active+clean, 53 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:48 smithi193 ceph-mon[82547]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-04T16:35:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:48 smithi193 ceph-mon[82547]: osdmap e53: 6 total, 5 up, 6 in 2024-09-04T16:35:48.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:48 smithi193 ceph-mon[82547]: pgmap v154: 65 pgs: 12 stale+active+clean, 53 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:35:49.247 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:48 smithi170 podman[128569]: 2024-09-04 16:35:48.876548156 +0000 UTC m=+0.016711330 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:35:49.247 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:48 smithi170 podman[128569]: 2024-09-04 16:35:48.977411282 +0000 UTC m=+0.117574450 container create b2dde449ba3b70abc7f99560576118191efd5f519c3c327a48539f9966c02d76 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-04T16:35:49.247 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:49 smithi170 podman[128569]: 2024-09-04 16:35:49.24737635 +0000 UTC m=+0.387539515 container init b2dde449ba3b70abc7f99560576118191efd5f519c3c327a48539f9966c02d76 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-04T16:35:49.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:49 smithi170 ceph-mon[113855]: osdmap e54: 6 total, 5 up, 6 in 2024-09-04T16:35:49.602 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:49 smithi170 podman[128569]: 2024-09-04 16:35:49.250833853 +0000 UTC m=+0.390997022 container start b2dde449ba3b70abc7f99560576118191efd5f519c3c327a48539f9966c02d76 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2) 2024-09-04T16:35:49.602 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:49 smithi170 podman[128569]: 2024-09-04 16:35:49.347200077 +0000 UTC m=+0.487363261 container attach b2dde449ba3b70abc7f99560576118191efd5f519c3c327a48539f9966c02d76 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-04T16:35:49.602 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:49 smithi170 podman[128569]: 2024-09-04 16:35:49.446668861 +0000 UTC m=+0.586832038 container died b2dde449ba3b70abc7f99560576118191efd5f519c3c327a48539f9966c02d76 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-04T16:35:49.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:49 smithi193 ceph-mon[82547]: osdmap e54: 6 total, 5 up, 6 in 2024-09-04T16:35:50.028 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:50 smithi170 podman[128591]: 2024-09-04 16:35:50.026298876 +0000 UTC m=+0.574103321 container remove b2dde449ba3b70abc7f99560576118191efd5f519c3c327a48539f9966c02d76 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-04T16:35:50.351 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:50 smithi170 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-04T16:35:50.352 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:50 smithi170 systemd[1]: Stopped Ceph osd.1 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:35:50.352 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:50 smithi170 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.1.service: Consumed 1min 904ms CPU time. 2024-09-04T16:35:50.352 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:50 smithi170 systemd[1]: Starting Ceph osd.1 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:35:50.740 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:50 smithi170 ceph-mon[113855]: pgmap v156: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-04T16:35:50.741 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:50 smithi170 podman[128691]: 2024-09-04 16:35:50.469270416 +0000 UTC m=+0.109034633 container create 2c8dea170dbc87995db7d7da29031bf251a1db1054a4d6d7f462241e9667bea3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-activate, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-04T16:35:50.741 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:50 smithi170 podman[128691]: 2024-09-04 16:35:50.376322542 +0000 UTC m=+0.016086707 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:35:50.741 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:50 smithi170 podman[128691]: 2024-09-04 16:35:50.740926621 +0000 UTC m=+0.380690779 container init 2c8dea170dbc87995db7d7da29031bf251a1db1054a4d6d7f462241e9667bea3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-activate, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True) 2024-09-04T16:35:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:50 smithi193 ceph-mon[82547]: pgmap v156: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-04T16:35:51.102 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:50 smithi170 podman[128691]: 2024-09-04 16:35:50.744674718 +0000 UTC m=+0.384438867 container start 2c8dea170dbc87995db7d7da29031bf251a1db1054a4d6d7f462241e9667bea3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-04T16:35:51.102 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:50 smithi170 podman[128691]: 2024-09-04 16:35:50.832625637 +0000 UTC m=+0.472389787 container attach 2c8dea170dbc87995db7d7da29031bf251a1db1054a4d6d7f462241e9667bea3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-04T16:35:51.102 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:50 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-activate[128705]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:35:51.102 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:50 smithi170 bash[128691]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:35:51.102 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:50 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-activate[128705]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:35:51.102 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:50 smithi170 bash[128691]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:35:51.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:51 smithi170 ceph-mon[113855]: Health check failed: Degraded data redundancy: 46/312 objects degraded (14.744%), 15 pgs degraded (PG_DEGRADED) 2024-09-04T16:35:51.852 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:51 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-activate[128705]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-04T16:35:51.852 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:51 smithi170 bash[128691]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-04T16:35:51.852 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:51 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-activate[128705]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-04T16:35:51.852 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:51 smithi170 bash[128691]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-04T16:35:51.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:51 smithi193 ceph-mon[82547]: Health check failed: Degraded data redundancy: 46/312 objects degraded (14.744%), 15 pgs degraded (PG_DEGRADED) 2024-09-04T16:35:52.228 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:51 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-activate[128705]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-04T16:35:52.228 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:51 smithi170 bash[128691]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-04T16:35:52.229 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:51 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-activate[128705]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-04T16:35:52.229 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:51 smithi170 bash[128691]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-04T16:35:52.229 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:51 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-activate[128705]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-04T16:35:52.229 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:51 smithi170 bash[128691]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-04T16:35:52.229 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:51 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-activate[128705]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-04T16:35:52.229 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:51 smithi170 bash[128691]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-04T16:35:52.229 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:51 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-activate[128705]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-04T16:35:52.229 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:51 smithi170 bash[128691]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-04T16:35:52.229 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:51 smithi170 podman[128691]: 2024-09-04 16:35:51.924603979 +0000 UTC m=+1.564368127 container died 2c8dea170dbc87995db7d7da29031bf251a1db1054a4d6d7f462241e9667bea3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-activate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.license=GPLv2) 2024-09-04T16:35:52.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.340+0000 7fca73804640 1 -- 172.21.15.170:0/405587393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca6c101930 msgr2=0x7fca6c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.340+0000 7fca73804640 1 --2- 172.21.15.170:0/405587393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca6c101930 0x7fca6c101d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca5c009880 tx=0x7fca5c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.340+0000 7fca73804640 1 -- 172.21.15.170:0/405587393 shutdown_connections 2024-09-04T16:35:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.340+0000 7fca73804640 1 --2- 172.21.15.170:0/405587393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca6c101930 0x7fca6c101d90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.340+0000 7fca73804640 1 --2- 172.21.15.170:0/405587393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca6c107930 0x7fca6c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.340+0000 7fca73804640 1 -- 172.21.15.170:0/405587393 >> 172.21.15.170:0/405587393 conn(0x7fca6c0fd630 msgr2=0x7fca6c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.340+0000 7fca73804640 1 -- 172.21.15.170:0/405587393 shutdown_connections 2024-09-04T16:35:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.340+0000 7fca73804640 1 -- 172.21.15.170:0/405587393 wait complete. 2024-09-04T16:35:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.341+0000 7fca73804640 1 Processor -- start 2024-09-04T16:35:52.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.341+0000 7fca73804640 1 -- start start 2024-09-04T16:35:52.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.341+0000 7fca73804640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca6c101930 0x7fca6c19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:52.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.341+0000 7fca73804640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca6c107930 0x7fca6c19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:52.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.341+0000 7fca73804640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c10ede0 con 0x7fca6c107930 2024-09-04T16:35:52.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.341+0000 7fca73804640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c10ec60 con 0x7fca6c101930 2024-09-04T16:35:52.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.341+0000 7fca70d9f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca6c107930 0x7fca6c19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:52.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.341+0000 7fca70d9f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca6c107930 0x7fca6c19dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53444/0 (socket says 172.21.15.170:53444) 2024-09-04T16:35:52.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.341+0000 7fca70d9f640 1 -- 172.21.15.170:0/2169824453 learned_addr learned my addr 172.21.15.170:0/2169824453 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:35:52.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.342+0000 7fca715a0640 1 --2- 172.21.15.170:0/2169824453 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca6c101930 0x7fca6c19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:52.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.342+0000 7fca70d9f640 1 -- 172.21.15.170:0/2169824453 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca6c101930 msgr2=0x7fca6c19d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:52.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.342+0000 7fca70d9f640 1 --2- 172.21.15.170:0/2169824453 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca6c101930 0x7fca6c19d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.342+0000 7fca70d9f640 1 -- 172.21.15.170:0/2169824453 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca6c197850 con 0x7fca6c107930 2024-09-04T16:35:52.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.342+0000 7fca70d9f640 1 --2- 172.21.15.170:0/2169824453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca6c107930 0x7fca6c19dc10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fca5c031460 tx=0x7fca5c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:52.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.342+0000 7fca627fc640 1 -- 172.21.15.170:0/2169824453 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca5c03f070 con 0x7fca6c107930 2024-09-04T16:35:52.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.342+0000 7fca627fc640 1 -- 172.21.15.170:0/2169824453 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca5c0035f0 con 0x7fca6c107930 2024-09-04T16:35:52.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.342+0000 7fca73804640 1 -- 172.21.15.170:0/2169824453 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca6c197ae0 con 0x7fca6c107930 2024-09-04T16:35:52.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.342+0000 7fca627fc640 1 -- 172.21.15.170:0/2169824453 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca5c035030 con 0x7fca6c107930 2024-09-04T16:35:52.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.342+0000 7fca73804640 1 -- 172.21.15.170:0/2169824453 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca6c198010 con 0x7fca6c107930 2024-09-04T16:35:52.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.343+0000 7fca73804640 1 -- 172.21.15.170:0/2169824453 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca6c103070 con 0x7fca6c107930 2024-09-04T16:35:52.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.344+0000 7fca627fc640 1 -- 172.21.15.170:0/2169824453 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fca5c042070 con 0x7fca6c107930 2024-09-04T16:35:52.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.344+0000 7fca627fc640 1 --2- 172.21.15.170:0/2169824453 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fca58079e30 0x7fca5807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:52.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.344+0000 7fca627fc640 1 -- 172.21.15.170:0/2169824453 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7fca5c0bd3b0 con 0x7fca6c107930 2024-09-04T16:35:52.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.344+0000 7fca715a0640 1 --2- 172.21.15.170:0/2169824453 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fca58079e30 0x7fca5807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:52.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.345+0000 7fca715a0640 1 --2- 172.21.15.170:0/2169824453 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fca58079e30 0x7fca5807c2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fca68005fd0 tx=0x7fca6800b590 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:52.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.349+0000 7fca627fc640 1 -- 172.21.15.170:0/2169824453 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fca5c084e70 con 0x7fca6c107930 2024-09-04T16:35:52.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.544+0000 7fca73804640 1 -- 172.21.15.170:0/2169824453 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fca6c198380 con 0x7fca58079e30 2024-09-04T16:35:52.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.546+0000 7fca627fc640 1 -- 172.21.15.170:0/2169824453 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fca6c198380 con 0x7fca58079e30 2024-09-04T16:35:52.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.548+0000 7fca73804640 1 -- 172.21.15.170:0/2169824453 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fca58079e30 msgr2=0x7fca5807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:52.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.548+0000 7fca73804640 1 --2- 172.21.15.170:0/2169824453 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fca58079e30 0x7fca5807c2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fca68005fd0 tx=0x7fca6800b590 comp rx=0 tx=0).stop 2024-09-04T16:35:52.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.548+0000 7fca73804640 1 -- 172.21.15.170:0/2169824453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca6c107930 msgr2=0x7fca6c19dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:52.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.548+0000 7fca73804640 1 --2- 172.21.15.170:0/2169824453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca6c107930 0x7fca6c19dc10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fca5c031460 tx=0x7fca5c0045e0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.548+0000 7fca73804640 1 -- 172.21.15.170:0/2169824453 shutdown_connections 2024-09-04T16:35:52.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.548+0000 7fca73804640 1 --2- 172.21.15.170:0/2169824453 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fca58079e30 0x7fca5807c2f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.548+0000 7fca73804640 1 --2- 172.21.15.170:0/2169824453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca6c107930 0x7fca6c19dc10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.548+0000 7fca73804640 1 --2- 172.21.15.170:0/2169824453 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca6c101930 0x7fca6c19d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.548+0000 7fca73804640 1 -- 172.21.15.170:0/2169824453 >> 172.21.15.170:0/2169824453 conn(0x7fca6c0fd630 msgr2=0x7fca6c0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:52.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.548+0000 7fca73804640 1 -- 172.21.15.170:0/2169824453 shutdown_connections 2024-09-04T16:35:52.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.548+0000 7fca73804640 1 -- 172.21.15.170:0/2169824453 wait complete. 2024-09-04T16:35:52.558 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:35:52.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.638+0000 7f2a85c2a640 1 -- 172.21.15.170:0/1902767090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a80102ad0 msgr2=0x7f2a80102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:52.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.638+0000 7f2a85c2a640 1 --2- 172.21.15.170:0/1902767090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a80102ad0 0x7f2a80102eb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009880 tx=0x7f2a7002a530 comp rx=0 tx=0).stop 2024-09-04T16:35:52.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.638+0000 7f2a85c2a640 1 -- 172.21.15.170:0/1902767090 shutdown_connections 2024-09-04T16:35:52.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.638+0000 7f2a85c2a640 1 --2- 172.21.15.170:0/1902767090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a801033f0 0x7f2a8010b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.638+0000 7f2a85c2a640 1 --2- 172.21.15.170:0/1902767090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a80102ad0 0x7f2a80102eb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.638+0000 7f2a85c2a640 1 -- 172.21.15.170:0/1902767090 >> 172.21.15.170:0/1902767090 conn(0x7f2a800fc510 msgr2=0x7f2a800fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:52.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.638+0000 7f2a85c2a640 1 -- 172.21.15.170:0/1902767090 shutdown_connections 2024-09-04T16:35:52.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.638+0000 7f2a85c2a640 1 -- 172.21.15.170:0/1902767090 wait complete. 2024-09-04T16:35:52.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.639+0000 7f2a85c2a640 1 Processor -- start 2024-09-04T16:35:52.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.639+0000 7f2a85c2a640 1 -- start start 2024-09-04T16:35:52.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.639+0000 7f2a85c2a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a80102ad0 0x7f2a8019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:52.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.639+0000 7f2a85c2a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a801033f0 0x7f2a8019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:52.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.639+0000 7f2a85c2a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8010ee00 con 0x7f2a80102ad0 2024-09-04T16:35:52.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.639+0000 7f2a85c2a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8010ec80 con 0x7f2a801033f0 2024-09-04T16:35:52.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.639+0000 7f2a7f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a80102ad0 0x7f2a8019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:52.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.640+0000 7f2a7f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a80102ad0 0x7f2a8019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53450/0 (socket says 172.21.15.170:53450) 2024-09-04T16:35:52.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.640+0000 7f2a7effd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a801033f0 0x7f2a8019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:52.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.640+0000 7f2a7f7fe640 1 -- 172.21.15.170:0/742922978 learned_addr learned my addr 172.21.15.170:0/742922978 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:35:52.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.640+0000 7f2a7effd640 1 -- 172.21.15.170:0/742922978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a80102ad0 msgr2=0x7f2a8019d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:52.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.640+0000 7f2a7effd640 1 --2- 172.21.15.170:0/742922978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a80102ad0 0x7f2a8019d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.640+0000 7f2a7effd640 1 -- 172.21.15.170:0/742922978 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a801977f0 con 0x7f2a801033f0 2024-09-04T16:35:52.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.640+0000 7f2a7effd640 1 --2- 172.21.15.170:0/742922978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a801033f0 0x7f2a8019dbb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400e740 tx=0x7f2a7400ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:52.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.640+0000 7f2a7cff9640 1 -- 172.21.15.170:0/742922978 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a7400ee50 con 0x7f2a801033f0 2024-09-04T16:35:52.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.640+0000 7f2a85c2a640 1 -- 172.21.15.170:0/742922978 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a80197ae0 con 0x7f2a801033f0 2024-09-04T16:35:52.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.640+0000 7f2a7cff9640 1 -- 172.21.15.170:0/742922978 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a74004030 con 0x7f2a801033f0 2024-09-04T16:35:52.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.640+0000 7f2a7cff9640 1 -- 172.21.15.170:0/742922978 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a740047a0 con 0x7f2a801033f0 2024-09-04T16:35:52.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.640+0000 7f2a85c2a640 1 -- 172.21.15.170:0/742922978 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a80198070 con 0x7f2a801033f0 2024-09-04T16:35:52.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.642+0000 7f2a85c2a640 1 -- 172.21.15.170:0/742922978 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a8006ac30 con 0x7f2a801033f0 2024-09-04T16:35:52.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.642+0000 7f2a7cff9640 1 -- 172.21.15.170:0/742922978 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f2a7400cac0 con 0x7f2a801033f0 2024-09-04T16:35:52.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.643+0000 7f2a7cff9640 1 --2- 172.21.15.170:0/742922978 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a68079e80 0x7f2a6807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:52.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.643+0000 7f2a7cff9640 1 -- 172.21.15.170:0/742922978 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7f2a7409cd90 con 0x7f2a801033f0 2024-09-04T16:35:52.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.643+0000 7f2a7f7fe640 1 --2- 172.21.15.170:0/742922978 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a68079e80 0x7f2a6807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:52.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.643+0000 7f2a7f7fe640 1 --2- 172.21.15.170:0/742922978 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a68079e80 0x7f2a6807c340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009230 tx=0x7f2a70005690 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:52.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.647+0000 7f2a7cff9640 1 -- 172.21.15.170:0/742922978 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2a74064830 con 0x7f2a801033f0 2024-09-04T16:35:52.788 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:52 smithi170 ceph-mon[113855]: pgmap v157: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-04T16:35:52.789 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:52 smithi170 podman[128841]: 2024-09-04 16:35:52.578916311 +0000 UTC m=+0.643085354 container remove 2c8dea170dbc87995db7d7da29031bf251a1db1054a4d6d7f462241e9667bea3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-04T16:35:52.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.854+0000 7f2a85c2a640 1 -- 172.21.15.170:0/742922978 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2a80198380 con 0x7f2a68079e80 2024-09-04T16:35:52.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.855+0000 7f2a7cff9640 1 -- 172.21.15.170:0/742922978 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f2a80198380 con 0x7f2a68079e80 2024-09-04T16:35:52.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.857+0000 7f2a85c2a640 1 -- 172.21.15.170:0/742922978 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a68079e80 msgr2=0x7f2a6807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:52.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.857+0000 7f2a85c2a640 1 --2- 172.21.15.170:0/742922978 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a68079e80 0x7f2a6807c340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009230 tx=0x7f2a70005690 comp rx=0 tx=0).stop 2024-09-04T16:35:52.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.857+0000 7f2a85c2a640 1 -- 172.21.15.170:0/742922978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a801033f0 msgr2=0x7f2a8019dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:52.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.857+0000 7f2a85c2a640 1 --2- 172.21.15.170:0/742922978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a801033f0 0x7f2a8019dbb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400e740 tx=0x7f2a7400ec00 comp rx=0 tx=0).stop 2024-09-04T16:35:52.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.857+0000 7f2a85c2a640 1 -- 172.21.15.170:0/742922978 shutdown_connections 2024-09-04T16:35:52.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.858+0000 7f2a85c2a640 1 --2- 172.21.15.170:0/742922978 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a68079e80 0x7f2a6807c340 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.858+0000 7f2a85c2a640 1 --2- 172.21.15.170:0/742922978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a801033f0 0x7f2a8019dbb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.858+0000 7f2a85c2a640 1 --2- 172.21.15.170:0/742922978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a80102ad0 0x7f2a8019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.858+0000 7f2a85c2a640 1 -- 172.21.15.170:0/742922978 >> 172.21.15.170:0/742922978 conn(0x7f2a800fc510 msgr2=0x7f2a801060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:52.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.858+0000 7f2a85c2a640 1 -- 172.21.15.170:0/742922978 shutdown_connections 2024-09-04T16:35:52.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.858+0000 7f2a85c2a640 1 -- 172.21.15.170:0/742922978 wait complete. 2024-09-04T16:35:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:52 smithi193 ceph-mon[82547]: pgmap v157: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-04T16:35:52.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.942+0000 7f35b6e37640 1 -- 172.21.15.170:0/1383409809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35b0107930 msgr2=0x7f35b0107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:52.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.942+0000 7f35b6e37640 1 --2- 172.21.15.170:0/1383409809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35b0107930 0x7f35b0107d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009880 tx=0x7f35a402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.942+0000 7f35b6e37640 1 -- 172.21.15.170:0/1383409809 shutdown_connections 2024-09-04T16:35:52.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.942+0000 7f35b6e37640 1 --2- 172.21.15.170:0/1383409809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35b0101930 0x7f35b0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.942+0000 7f35b6e37640 1 --2- 172.21.15.170:0/1383409809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35b0107930 0x7f35b0107d10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.942+0000 7f35b6e37640 1 -- 172.21.15.170:0/1383409809 >> 172.21.15.170:0/1383409809 conn(0x7f35b00fd630 msgr2=0x7f35b00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:52.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.942+0000 7f35b6e37640 1 -- 172.21.15.170:0/1383409809 shutdown_connections 2024-09-04T16:35:52.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.942+0000 7f35b6e37640 1 -- 172.21.15.170:0/1383409809 wait complete. 2024-09-04T16:35:52.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.943+0000 7f35b6e37640 1 Processor -- start 2024-09-04T16:35:52.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.943+0000 7f35b6e37640 1 -- start start 2024-09-04T16:35:52.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.943+0000 7f35b6e37640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35b0101930 0x7f35b019f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:52.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.943+0000 7f35b6e37640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35b0107930 0x7f35b019fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:52.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.943+0000 7f35b6e37640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f35b010ee60 con 0x7f35b0101930 2024-09-04T16:35:52.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.943+0000 7f35b6e37640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f35b010ece0 con 0x7f35b0107930 2024-09-04T16:35:52.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.943+0000 7f35b4bd3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35b0101930 0x7f35b019f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:52.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.943+0000 7f35b4bd3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35b0101930 0x7f35b019f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53478/0 (socket says 172.21.15.170:53478) 2024-09-04T16:35:52.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.943+0000 7f35b4bd3640 1 -- 172.21.15.170:0/1887079507 learned_addr learned my addr 172.21.15.170:0/1887079507 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:35:52.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.944+0000 7f35affff640 1 --2- 172.21.15.170:0/1887079507 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35b0107930 0x7f35b019fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:52.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.944+0000 7f35b4bd3640 1 -- 172.21.15.170:0/1887079507 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35b0107930 msgr2=0x7f35b019fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:52.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.944+0000 7f35b4bd3640 1 --2- 172.21.15.170:0/1887079507 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35b0107930 0x7f35b019fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:52.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.944+0000 7f35b4bd3640 1 -- 172.21.15.170:0/1887079507 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b0199ae0 con 0x7f35b0101930 2024-09-04T16:35:52.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.944+0000 7f35b4bd3640 1 --2- 172.21.15.170:0/1887079507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35b0101930 0x7f35b019f920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f35a4031460 tx=0x7f35a40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:52.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.944+0000 7f35adffb640 1 -- 172.21.15.170:0/1887079507 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35a403f070 con 0x7f35b0101930 2024-09-04T16:35:52.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.944+0000 7f35b6e37640 1 -- 172.21.15.170:0/1887079507 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b0199d70 con 0x7f35b0101930 2024-09-04T16:35:52.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.944+0000 7f35b6e37640 1 -- 172.21.15.170:0/1887079507 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b019a2a0 con 0x7f35b0101930 2024-09-04T16:35:52.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.944+0000 7f35adffb640 1 -- 172.21.15.170:0/1887079507 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f35a4004cf0 con 0x7f35b0101930 2024-09-04T16:35:52.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.944+0000 7f35adffb640 1 -- 172.21.15.170:0/1887079507 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35a4035030 con 0x7f35b0101930 2024-09-04T16:35:52.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.945+0000 7f35b6e37640 1 -- 172.21.15.170:0/1887079507 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3594005290 con 0x7f35b0101930 2024-09-04T16:35:52.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.946+0000 7f35adffb640 1 -- 172.21.15.170:0/1887079507 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f35a4042070 con 0x7f35b0101930 2024-09-04T16:35:52.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.946+0000 7f35adffb640 1 --2- 172.21.15.170:0/1887079507 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f35a0079e80 0x7f35a007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:52.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.947+0000 7f35adffb640 1 -- 172.21.15.170:0/1887079507 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7f35a40bd3a0 con 0x7f35b0101930 2024-09-04T16:35:52.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.947+0000 7f35affff640 1 --2- 172.21.15.170:0/1887079507 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f35a0079e80 0x7f35a007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:52.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.947+0000 7f35affff640 1 --2- 172.21.15.170:0/1887079507 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f35a0079e80 0x7f35a007c340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f35b0075e70 tx=0x7f359c008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:52.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:52.953+0000 7f35adffb640 1 -- 172.21.15.170:0/1887079507 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f35a4084ee0 con 0x7f35b0101930 2024-09-04T16:35:53.102 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:52 smithi170 podman[128947]: 2024-09-04 16:35:52.788270282 +0000 UTC m=+0.111167258 container create e39a15bc741ae642948aed7f21b55a9c8ad85b088a7aebc942a3be9f554cd7aa (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-04T16:35:53.102 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:52 smithi170 podman[128947]: 2024-09-04 16:35:52.693545953 +0000 UTC m=+0.016442926 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:35:53.102 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:53 smithi170 podman[128947]: 2024-09-04 16:35:53.033847445 +0000 UTC m=+0.356744427 container init e39a15bc741ae642948aed7f21b55a9c8ad85b088a7aebc942a3be9f554cd7aa (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_CLEAN=True) 2024-09-04T16:35:53.102 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:53 smithi170 podman[128947]: 2024-09-04 16:35:53.037288428 +0000 UTC m=+0.360185400 container start e39a15bc741ae642948aed7f21b55a9c8ad85b088a7aebc942a3be9f554cd7aa (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-04T16:35:53.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.145+0000 7f35b6e37640 1 -- 172.21.15.170:0/1887079507 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3594000bc0 con 0x7f35a0079e80 2024-09-04T16:35:53.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.154+0000 7f35adffb640 1 -- 172.21.15.170:0/1887079507 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f3594000bc0 con 0x7f35a0079e80 2024-09-04T16:35:53.155 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:35:53.155 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (2m) 30s ago 13m 22.0M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:35:53.155 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (6m) 30s ago 13m 8967k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:35:53.155 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (5m) 53s ago 12m 8326k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:35:53.156 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (61s) 30s ago 13m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:35:53.156 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (56s) 53s ago 12m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:35:53.156 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (2m) 30s ago 13m 77.9M - c8b91775d855 6e3778aab5e6 2024-09-04T16:35:53.156 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (8m) 30s ago 8m 27.4M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:35:53.156 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (8m) 30s ago 8m 145M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:35:53.156 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (8m) 53s ago 8m 16.9M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:35:53.156 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (8m) 53s ago 8m 16.5M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:35:53.156 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (5m) 30s ago 15m 523M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:35:53.156 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (4m) 53s ago 12m 456M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:35:53.156 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (91s) 30s ago 15m 38.3M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:35:53.156 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (74s) 53s ago 12m 25.2M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:35:53.156 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (3m) 30s ago 13m 11.2M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:35:53.156 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (3m) 53s ago 12m 12.5M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:35:53.157 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (36s) 30s ago 11m 12.2M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:35:53.157 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (11m) 30s ago 11m 228M 1216M 19.1.1-252-g48920dab b708f9119ac7 20469ba5727b 2024-09-04T16:35:53.157 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (10m) 30s ago 10m 183M 1216M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:35:53.157 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (10m) 53s ago 10m 249M 2240M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:35:53.157 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (9m) 53s ago 9m 210M 2240M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:35:53.157 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (9m) 53s ago 9m 191M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:35:53.157 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (3m) 30s ago 13m 49.4M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:35:53.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.157+0000 7f35b6e37640 1 -- 172.21.15.170:0/1887079507 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f35a0079e80 msgr2=0x7f35a007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:53.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.157+0000 7f35b6e37640 1 --2- 172.21.15.170:0/1887079507 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f35a0079e80 0x7f35a007c340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f35b0075e70 tx=0x7f359c008040 comp rx=0 tx=0).stop 2024-09-04T16:35:53.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.157+0000 7f35b6e37640 1 -- 172.21.15.170:0/1887079507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35b0101930 msgr2=0x7f35b019f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:53.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.157+0000 7f35b6e37640 1 --2- 172.21.15.170:0/1887079507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35b0101930 0x7f35b019f920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f35a4031460 tx=0x7f35a40048f0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.157+0000 7f35b6e37640 1 -- 172.21.15.170:0/1887079507 shutdown_connections 2024-09-04T16:35:53.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.157+0000 7f35b6e37640 1 --2- 172.21.15.170:0/1887079507 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f35a0079e80 0x7f35a007c340 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.157+0000 7f35b6e37640 1 --2- 172.21.15.170:0/1887079507 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35b0107930 0x7f35b019fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.157+0000 7f35b6e37640 1 --2- 172.21.15.170:0/1887079507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35b0101930 0x7f35b019f920 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.157+0000 7f35b6e37640 1 -- 172.21.15.170:0/1887079507 >> 172.21.15.170:0/1887079507 conn(0x7f35b00fd630 msgr2=0x7f35b0074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:53.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.157+0000 7f35b6e37640 1 -- 172.21.15.170:0/1887079507 shutdown_connections 2024-09-04T16:35:53.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.157+0000 7f35b6e37640 1 -- 172.21.15.170:0/1887079507 wait complete. 2024-09-04T16:35:53.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.239+0000 7f6151c31640 1 -- 172.21.15.170:0/3870385347 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f614c107930 msgr2=0x7f614c107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:53.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.239+0000 7f6151c31640 1 --2- 172.21.15.170:0/3870385347 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f614c107930 0x7f614c107d10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f613c009c20 tx=0x7f613c02a970 comp rx=0 tx=0).stop 2024-09-04T16:35:53.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.239+0000 7f6151c31640 1 -- 172.21.15.170:0/3870385347 shutdown_connections 2024-09-04T16:35:53.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.239+0000 7f6151c31640 1 --2- 172.21.15.170:0/3870385347 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f614c101930 0x7f614c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.239+0000 7f6151c31640 1 --2- 172.21.15.170:0/3870385347 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f614c107930 0x7f614c107d10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.239+0000 7f6151c31640 1 -- 172.21.15.170:0/3870385347 >> 172.21.15.170:0/3870385347 conn(0x7f614c0fd630 msgr2=0x7f614c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:53.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.239+0000 7f6151c31640 1 -- 172.21.15.170:0/3870385347 shutdown_connections 2024-09-04T16:35:53.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.239+0000 7f6151c31640 1 -- 172.21.15.170:0/3870385347 wait complete. 2024-09-04T16:35:53.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.239+0000 7f6151c31640 1 Processor -- start 2024-09-04T16:35:53.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.239+0000 7f6151c31640 1 -- start start 2024-09-04T16:35:53.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f6151c31640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f614c101930 0x7f614c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:53.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f6151c31640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f614c107930 0x7f614c19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:53.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f6151c31640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f614c10ee00 con 0x7f614c101930 2024-09-04T16:35:53.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f6151c31640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f614c10ec80 con 0x7f614c107930 2024-09-04T16:35:53.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f614b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f614c101930 0x7f614c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:53.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f614b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f614c101930 0x7f614c19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53510/0 (socket says 172.21.15.170:53510) 2024-09-04T16:35:53.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f614b7fe640 1 -- 172.21.15.170:0/1824573467 learned_addr learned my addr 172.21.15.170:0/1824573467 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:35:53.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f614affd640 1 --2- 172.21.15.170:0/1824573467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f614c107930 0x7f614c19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:53.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f614b7fe640 1 -- 172.21.15.170:0/1824573467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f614c107930 msgr2=0x7f614c19dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:53.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f614b7fe640 1 --2- 172.21.15.170:0/1824573467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f614c107930 0x7f614c19dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f614b7fe640 1 -- 172.21.15.170:0/1824573467 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614c1977f0 con 0x7f614c101930 2024-09-04T16:35:53.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f614affd640 1 --2- 172.21.15.170:0/1824573467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f614c107930 0x7f614c19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:35:53.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f614b7fe640 1 --2- 172.21.15.170:0/1824573467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f614c101930 0x7f614c19d670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f613c005cc0 tx=0x7f613c02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:53.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f6148ff9640 1 -- 172.21.15.170:0/1824573467 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f613c047070 con 0x7f614c101930 2024-09-04T16:35:53.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f6151c31640 1 -- 172.21.15.170:0/1824573467 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f614c197a80 con 0x7f614c101930 2024-09-04T16:35:53.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f6148ff9640 1 -- 172.21.15.170:0/1824573467 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f613c02f7e0 con 0x7f614c101930 2024-09-04T16:35:53.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.240+0000 7f6148ff9640 1 -- 172.21.15.170:0/1824573467 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f613c034070 con 0x7f614c101930 2024-09-04T16:35:53.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.241+0000 7f6151c31640 1 -- 172.21.15.170:0/1824573467 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f614c197fb0 con 0x7f614c101930 2024-09-04T16:35:53.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.241+0000 7f6151c31640 1 -- 172.21.15.170:0/1824573467 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614c103070 con 0x7f614c101930 2024-09-04T16:35:53.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.242+0000 7f6148ff9640 1 -- 172.21.15.170:0/1824573467 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f613c04a070 con 0x7f614c101930 2024-09-04T16:35:53.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.243+0000 7f6148ff9640 1 --2- 172.21.15.170:0/1824573467 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6138079e30 0x7f613807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:53.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.243+0000 7f6148ff9640 1 -- 172.21.15.170:0/1824573467 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7f613c0bd830 con 0x7f614c101930 2024-09-04T16:35:53.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.243+0000 7f614affd640 1 --2- 172.21.15.170:0/1824573467 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6138079e30 0x7f613807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:53.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.243+0000 7f614affd640 1 --2- 172.21.15.170:0/1824573467 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6138079e30 0x7f613807c2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6134005fd0 tx=0x7f6134005ea0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:53.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.247+0000 7f6148ff9640 1 -- 172.21.15.170:0/1824573467 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f613c03f070 con 0x7f614c101930 2024-09-04T16:35:53.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.503+0000 7f6151c31640 1 -- 172.21.15.170:0/1824573467 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f614c109ea0 con 0x7f614c101930 2024-09-04T16:35:53.505 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:53 smithi170 bash[128947]: e39a15bc741ae642948aed7f21b55a9c8ad85b088a7aebc942a3be9f554cd7aa 2024-09-04T16:35:53.505 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:53 smithi170 systemd[1]: Started Ceph osd.1 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:35:53.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.504+0000 7f6148ff9640 1 -- 172.21.15.170:0/1824573467 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f613c0852f0 con 0x7f614c101930 2024-09-04T16:35:53.505 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:35:53.505 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:35:53.506 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:35:53.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:35:53.506 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:35:53.506 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:35:53.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:35:53.506 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:35:53.506 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4, 2024-09-04T16:35:53.506 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 1 2024-09-04T16:35:53.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:35:53.506 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:35:53.506 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:35:53.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:35:53.507 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:35:53.507 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 8, 2024-09-04T16:35:53.507 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 5 2024-09-04T16:35:53.507 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:35:53.507 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:35:53.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.508+0000 7f6151c31640 1 -- 172.21.15.170:0/1824573467 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6138079e30 msgr2=0x7f613807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:53.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.508+0000 7f6151c31640 1 --2- 172.21.15.170:0/1824573467 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6138079e30 0x7f613807c2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6134005fd0 tx=0x7f6134005ea0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.508+0000 7f6151c31640 1 -- 172.21.15.170:0/1824573467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f614c101930 msgr2=0x7f614c19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:53.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.508+0000 7f6151c31640 1 --2- 172.21.15.170:0/1824573467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f614c101930 0x7f614c19d670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f613c005cc0 tx=0x7f613c02f5f0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.508+0000 7f6151c31640 1 -- 172.21.15.170:0/1824573467 shutdown_connections 2024-09-04T16:35:53.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.508+0000 7f6151c31640 1 --2- 172.21.15.170:0/1824573467 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6138079e30 0x7f613807c2f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.508+0000 7f6151c31640 1 --2- 172.21.15.170:0/1824573467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f614c107930 0x7f614c19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.508+0000 7f6151c31640 1 --2- 172.21.15.170:0/1824573467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f614c101930 0x7f614c19d670 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.508+0000 7f6151c31640 1 -- 172.21.15.170:0/1824573467 >> 172.21.15.170:0/1824573467 conn(0x7f614c0fd630 msgr2=0x7f614c0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:53.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.508+0000 7f6151c31640 1 -- 172.21.15.170:0/1824573467 shutdown_connections 2024-09-04T16:35:53.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.508+0000 7f6151c31640 1 -- 172.21.15.170:0/1824573467 wait complete. 2024-09-04T16:35:53.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.595+0000 7fea5e9b8640 1 -- 172.21.15.170:0/2693998768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea58107910 msgr2=0x7fea58107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:53.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.595+0000 7fea5e9b8640 1 --2- 172.21.15.170:0/2693998768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea58107910 0x7fea58107cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fea48009880 tx=0x7fea4802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.596+0000 7fea5e9b8640 1 -- 172.21.15.170:0/2693998768 shutdown_connections 2024-09-04T16:35:53.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.596+0000 7fea5e9b8640 1 --2- 172.21.15.170:0/2693998768 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea58101910 0x7fea58101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.596+0000 7fea5e9b8640 1 --2- 172.21.15.170:0/2693998768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea58107910 0x7fea58107cf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.596+0000 7fea5e9b8640 1 -- 172.21.15.170:0/2693998768 >> 172.21.15.170:0/2693998768 conn(0x7fea580fd5f0 msgr2=0x7fea580ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:53.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.596+0000 7fea5e9b8640 1 -- 172.21.15.170:0/2693998768 shutdown_connections 2024-09-04T16:35:53.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.596+0000 7fea5e9b8640 1 -- 172.21.15.170:0/2693998768 wait complete. 2024-09-04T16:35:53.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.596+0000 7fea5e9b8640 1 Processor -- start 2024-09-04T16:35:53.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.596+0000 7fea5e9b8640 1 -- start start 2024-09-04T16:35:53.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.597+0000 7fea5e9b8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea58101910 0x7fea5819d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:53.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.597+0000 7fea5e9b8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea58107910 0x7fea5819db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:53.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.597+0000 7fea5e9b8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fea5810edc0 con 0x7fea58107910 2024-09-04T16:35:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.597+0000 7fea5e9b8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fea5810ec40 con 0x7fea58101910 2024-09-04T16:35:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.597+0000 7fea577fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea58107910 0x7fea5819db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.597+0000 7fea577fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea58107910 0x7fea5819db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53534/0 (socket says 172.21.15.170:53534) 2024-09-04T16:35:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.597+0000 7fea577fe640 1 -- 172.21.15.170:0/1189771734 learned_addr learned my addr 172.21.15.170:0/1189771734 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:35:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.597+0000 7fea57fff640 1 --2- 172.21.15.170:0/1189771734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea58101910 0x7fea5819d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.597+0000 7fea577fe640 1 -- 172.21.15.170:0/1189771734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea58101910 msgr2=0x7fea5819d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.597+0000 7fea577fe640 1 --2- 172.21.15.170:0/1189771734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea58101910 0x7fea5819d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.597+0000 7fea577fe640 1 -- 172.21.15.170:0/1189771734 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea58197780 con 0x7fea58107910 2024-09-04T16:35:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.598+0000 7fea577fe640 1 --2- 172.21.15.170:0/1189771734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea58107910 0x7fea5819db40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00d8d0 tx=0x7fea4c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.598+0000 7fea557fa640 1 -- 172.21.15.170:0/1189771734 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea4c017030 con 0x7fea58107910 2024-09-04T16:35:53.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.598+0000 7fea5e9b8640 1 -- 172.21.15.170:0/1189771734 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea58197a10 con 0x7fea58107910 2024-09-04T16:35:53.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.598+0000 7fea557fa640 1 -- 172.21.15.170:0/1189771734 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea4c004020 con 0x7fea58107910 2024-09-04T16:35:53.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.598+0000 7fea557fa640 1 -- 172.21.15.170:0/1189771734 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea4c0047a0 con 0x7fea58107910 2024-09-04T16:35:53.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.598+0000 7fea5e9b8640 1 -- 172.21.15.170:0/1189771734 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea58197fa0 con 0x7fea58107910 2024-09-04T16:35:53.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.599+0000 7fea5e9b8640 1 -- 172.21.15.170:0/1189771734 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea58103050 con 0x7fea58107910 2024-09-04T16:35:53.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.600+0000 7fea557fa640 1 -- 172.21.15.170:0/1189771734 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fea4c009a30 con 0x7fea58107910 2024-09-04T16:35:53.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.600+0000 7fea557fa640 1 --2- 172.21.15.170:0/1189771734 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fea40079e80 0x7fea4007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:53.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.601+0000 7fea557fa640 1 -- 172.21.15.170:0/1189771734 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7fea4c018070 con 0x7fea58107910 2024-09-04T16:35:53.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.601+0000 7fea57fff640 1 --2- 172.21.15.170:0/1189771734 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fea40079e80 0x7fea4007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:53.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.601+0000 7fea57fff640 1 --2- 172.21.15.170:0/1189771734 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fea40079e80 0x7fea4007c340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fea480096c0 tx=0x7fea48031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:53.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.605+0000 7fea557fa640 1 -- 172.21.15.170:0/1189771734 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fea4c064290 con 0x7fea58107910 2024-09-04T16:35:53.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.846+0000 7fea5e9b8640 1 -- 172.21.15.170:0/1189771734 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fea58104b20 con 0x7fea58107910 2024-09-04T16:35:53.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.847+0000 7fea557fa640 1 -- 172.21.15.170:0/1189771734 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2036 (secure 0 0 0) 0x7fea4c068400 con 0x7fea58107910 2024-09-04T16:35:53.848 INFO:teuthology.orchestra.run.smithi170.stdout:e15 2024-09-04T16:35:53.848 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:27:39:151187+0000 2024-09-04T16:35:53.848 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:35:53.848 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:35:53.848 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:35:53.848 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:35:53.849 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:35:53.849 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:35:53.849 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 15 2024-09-04T16:35:53.849 INFO:teuthology.orchestra.run.smithi170.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-04T16:35:53.849 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:35:53.849 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:27:39.151182+0000 2024-09-04T16:35:53.849 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:35:53.849 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:35:53.849 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:35:53.849 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:35:53.849 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:35:53.849 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:35:53.849 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:35:53.850 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:35:53.850 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 45 2024-09-04T16:35:53.850 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:35:53.850 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:35:53.850 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:35:53.850 INFO:teuthology.orchestra.run.smithi170.stdout:up {0=14562,1=14578} 2024-09-04T16:35:53.850 INFO:teuthology.orchestra.run.smithi170.stdout:failed 2024-09-04T16:35:53.850 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:35:53.850 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:35:53.850 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:35:53.850 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:35:53.850 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:35:53.850 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:35:53.851 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:35:53.851 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:35:53.851 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 14562 members: 14562,14578 2024-09-04T16:35:53.851 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{0:14562} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:35:53.851 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{1:14578} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:35:53.851 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:35:53.851 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:35:53.851 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:35:53.851 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:35:53.851 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:24315} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.193:6826/288890560,v1:172.21.15.193:6827/288890560] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:35:53.851 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:24319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1128257367,v1:172.21.15.193:6825/1128257367] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:35:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 15 2024-09-04T16:35:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.850+0000 7fea5e9b8640 1 -- 172.21.15.170:0/1189771734 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fea40079e80 msgr2=0x7fea4007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.850+0000 7fea5e9b8640 1 --2- 172.21.15.170:0/1189771734 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fea40079e80 0x7fea4007c340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fea480096c0 tx=0x7fea48031400 comp rx=0 tx=0).stop 2024-09-04T16:35:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.850+0000 7fea5e9b8640 1 -- 172.21.15.170:0/1189771734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea58107910 msgr2=0x7fea5819db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.850+0000 7fea5e9b8640 1 --2- 172.21.15.170:0/1189771734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea58107910 0x7fea5819db40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00d8d0 tx=0x7fea4c00dd90 comp rx=0 tx=0).stop 2024-09-04T16:35:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.850+0000 7fea5e9b8640 1 -- 172.21.15.170:0/1189771734 shutdown_connections 2024-09-04T16:35:53.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.850+0000 7fea5e9b8640 1 --2- 172.21.15.170:0/1189771734 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fea40079e80 0x7fea4007c340 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.850+0000 7fea5e9b8640 1 --2- 172.21.15.170:0/1189771734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea58107910 0x7fea5819db40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.850+0000 7fea5e9b8640 1 --2- 172.21.15.170:0/1189771734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea58101910 0x7fea5819d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.850+0000 7fea5e9b8640 1 -- 172.21.15.170:0/1189771734 >> 172.21.15.170:0/1189771734 conn(0x7fea580fd5f0 msgr2=0x7fea580feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:53.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.850+0000 7fea5e9b8640 1 -- 172.21.15.170:0/1189771734 shutdown_connections 2024-09-04T16:35:53.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.850+0000 7fea5e9b8640 1 -- 172.21.15.170:0/1189771734 wait complete. 2024-09-04T16:35:53.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.935+0000 7fbbed5e7640 1 -- 172.21.15.170:0/1671931072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbe8103490 msgr2=0x7fbbe810b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:53.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.935+0000 7fbbed5e7640 1 --2- 172.21.15.170:0/1671931072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbe8103490 0x7fbbe810b980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009880 tx=0x7fbbdc02a530 comp rx=0 tx=0).stop 2024-09-04T16:35:53.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.935+0000 7fbbed5e7640 1 -- 172.21.15.170:0/1671931072 shutdown_connections 2024-09-04T16:35:53.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.935+0000 7fbbed5e7640 1 --2- 172.21.15.170:0/1671931072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbe8103490 0x7fbbe810b980 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.935+0000 7fbbed5e7640 1 --2- 172.21.15.170:0/1671931072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbe8102b70 0x7fbbe8102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.935+0000 7fbbed5e7640 1 -- 172.21.15.170:0/1671931072 >> 172.21.15.170:0/1671931072 conn(0x7fbbe80fc510 msgr2=0x7fbbe80fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:53.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.935+0000 7fbbed5e7640 1 -- 172.21.15.170:0/1671931072 shutdown_connections 2024-09-04T16:35:53.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.935+0000 7fbbed5e7640 1 -- 172.21.15.170:0/1671931072 wait complete. 2024-09-04T16:35:53.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.936+0000 7fbbed5e7640 1 Processor -- start 2024-09-04T16:35:53.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.936+0000 7fbbed5e7640 1 -- start start 2024-09-04T16:35:53.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.936+0000 7fbbed5e7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbe8102b70 0x7fbbe819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:53.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.936+0000 7fbbed5e7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbe8103490 0x7fbbe819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:53.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.936+0000 7fbbed5e7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe810ede0 con 0x7fbbe8103490 2024-09-04T16:35:53.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.936+0000 7fbbed5e7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe810ec60 con 0x7fbbe8102b70 2024-09-04T16:35:53.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.936+0000 7fbbe67fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbe8103490 0x7fbbe819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:53.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.936+0000 7fbbe67fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbe8103490 0x7fbbe819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53548/0 (socket says 172.21.15.170:53548) 2024-09-04T16:35:53.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.936+0000 7fbbe67fc640 1 -- 172.21.15.170:0/97354502 learned_addr learned my addr 172.21.15.170:0/97354502 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:35:53.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.936+0000 7fbbe6ffd640 1 --2- 172.21.15.170:0/97354502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbe8102b70 0x7fbbe819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:53.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.937+0000 7fbbe67fc640 1 -- 172.21.15.170:0/97354502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbe8102b70 msgr2=0x7fbbe819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:53.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.937+0000 7fbbe67fc640 1 --2- 172.21.15.170:0/97354502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbe8102b70 0x7fbbe819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:53.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.937+0000 7fbbe67fc640 1 -- 172.21.15.170:0/97354502 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe81977b0 con 0x7fbbe8103490 2024-09-04T16:35:53.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.937+0000 7fbbe67fc640 1 --2- 172.21.15.170:0/97354502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbe8103490 0x7fbbe819db70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc004f90 tx=0x7fbbdc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:53.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.937+0000 7fbbcffff640 1 -- 172.21.15.170:0/97354502 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbbdc03f070 con 0x7fbbe8103490 2024-09-04T16:35:53.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.937+0000 7fbbed5e7640 1 -- 172.21.15.170:0/97354502 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe8197a40 con 0x7fbbe8103490 2024-09-04T16:35:53.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.937+0000 7fbbcffff640 1 -- 172.21.15.170:0/97354502 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbbdc004c70 con 0x7fbbe8103490 2024-09-04T16:35:53.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.937+0000 7fbbed5e7640 1 -- 172.21.15.170:0/97354502 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe8197f70 con 0x7fbbe8103490 2024-09-04T16:35:53.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.937+0000 7fbbcffff640 1 -- 172.21.15.170:0/97354502 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbbdc035030 con 0x7fbbe8103490 2024-09-04T16:35:53.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.938+0000 7fbbed5e7640 1 -- 172.21.15.170:0/97354502 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe806ab90 con 0x7fbbe8103490 2024-09-04T16:35:53.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.939+0000 7fbbcffff640 1 -- 172.21.15.170:0/97354502 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fbbdc042070 con 0x7fbbe8103490 2024-09-04T16:35:53.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.939+0000 7fbbcffff640 1 --2- 172.21.15.170:0/97354502 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbbd0079e30 0x7fbbd007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:53.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.939+0000 7fbbcffff640 1 -- 172.21.15.170:0/97354502 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7fbbdc0bd3a0 con 0x7fbbe8103490 2024-09-04T16:35:53.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.939+0000 7fbbe6ffd640 1 --2- 172.21.15.170:0/97354502 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbbd0079e30 0x7fbbd007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:53.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.940+0000 7fbbe6ffd640 1 --2- 172.21.15.170:0/97354502 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbbd0079e30 0x7fbbd007c2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8005d00 tx=0x7fbbd800b410 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:53.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:53.943+0000 7fbbcffff640 1 -- 172.21.15.170:0/97354502 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbbdc088fd0 con 0x7fbbe8103490 2024-09-04T16:35:54.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.142+0000 7fbbed5e7640 1 -- 172.21.15.170:0/97354502 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbbe81982e0 con 0x7fbbd0079e30 2024-09-04T16:35:54.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.143+0000 7fbbcffff640 1 -- 172.21.15.170:0/97354502 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fbbe81982e0 con 0x7fbbd0079e30 2024-09-04T16:35:54.144 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:35:54.144 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:35:54.144 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:35:54.144 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:35:54.144 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:35:54.144 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-04T16:35:54.144 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:35:54.145 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-04T16:35:54.145 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:35:54.145 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "7/23 daemons upgraded", 2024-09-04T16:35:54.145 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-04T16:35:54.145 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:35:54.145 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:35:54.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.146+0000 7fbbed5e7640 1 -- 172.21.15.170:0/97354502 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbbd0079e30 msgr2=0x7fbbd007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:54.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.146+0000 7fbbed5e7640 1 --2- 172.21.15.170:0/97354502 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbbd0079e30 0x7fbbd007c2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8005d00 tx=0x7fbbd800b410 comp rx=0 tx=0).stop 2024-09-04T16:35:54.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.146+0000 7fbbed5e7640 1 -- 172.21.15.170:0/97354502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbe8103490 msgr2=0x7fbbe819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:54.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.146+0000 7fbbed5e7640 1 --2- 172.21.15.170:0/97354502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbe8103490 0x7fbbe819db70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc004f90 tx=0x7fbbdc0048f0 comp rx=0 tx=0).stop 2024-09-04T16:35:54.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.146+0000 7fbbed5e7640 1 -- 172.21.15.170:0/97354502 shutdown_connections 2024-09-04T16:35:54.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.146+0000 7fbbed5e7640 1 --2- 172.21.15.170:0/97354502 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbbd0079e30 0x7fbbd007c2f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:54.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.146+0000 7fbbed5e7640 1 --2- 172.21.15.170:0/97354502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbe8103490 0x7fbbe819db70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:54.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.146+0000 7fbbed5e7640 1 --2- 172.21.15.170:0/97354502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbe8102b70 0x7fbbe819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:54.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.146+0000 7fbbed5e7640 1 -- 172.21.15.170:0/97354502 >> 172.21.15.170:0/97354502 conn(0x7fbbe80fc510 msgr2=0x7fbbe8108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:54.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.146+0000 7fbbed5e7640 1 -- 172.21.15.170:0/97354502 shutdown_connections 2024-09-04T16:35:54.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.146+0000 7fbbed5e7640 1 -- 172.21.15.170:0/97354502 wait complete. 2024-09-04T16:35:54.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.232+0000 7fa32a37c640 1 -- 172.21.15.170:0/1218544669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa324106930 msgr2=0x7fa324106d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:54.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.232+0000 7fa32a37c640 1 --2- 172.21.15.170:0/1218544669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa324106930 0x7fa324106d10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa314009880 tx=0x7fa31402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:35:54.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.232+0000 7fa32a37c640 1 -- 172.21.15.170:0/1218544669 shutdown_connections 2024-09-04T16:35:54.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.232+0000 7fa32a37c640 1 --2- 172.21.15.170:0/1218544669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3240ffd50 0x7fa3241001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:54.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.232+0000 7fa32a37c640 1 --2- 172.21.15.170:0/1218544669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa324106930 0x7fa324106d10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:54.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.232+0000 7fa32a37c640 1 -- 172.21.15.170:0/1218544669 >> 172.21.15.170:0/1218544669 conn(0x7fa3240fbc40 msgr2=0x7fa3240fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:54.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.232+0000 7fa32a37c640 1 -- 172.21.15.170:0/1218544669 shutdown_connections 2024-09-04T16:35:54.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.232+0000 7fa32a37c640 1 -- 172.21.15.170:0/1218544669 wait complete. 2024-09-04T16:35:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.232+0000 7fa32a37c640 1 Processor -- start 2024-09-04T16:35:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.232+0000 7fa32a37c640 1 -- start start 2024-09-04T16:35:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.233+0000 7fa32a37c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3240ffd50 0x7fa32419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.233+0000 7fa32a37c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa324106930 0x7fa32419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.233+0000 7fa32a37c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa32410eeb0 con 0x7fa324106930 2024-09-04T16:35:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.233+0000 7fa32a37c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa32410ed30 con 0x7fa3240ffd50 2024-09-04T16:35:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.233+0000 7fa31bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa324106930 0x7fa32419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.233+0000 7fa31bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa324106930 0x7fa32419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53572/0 (socket says 172.21.15.170:53572) 2024-09-04T16:35:54.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.233+0000 7fa31bfff640 1 -- 172.21.15.170:0/4068848621 learned_addr learned my addr 172.21.15.170:0/4068848621 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:35:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.233+0000 7fa323fff640 1 --2- 172.21.15.170:0/4068848621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3240ffd50 0x7fa32419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.233+0000 7fa31bfff640 1 -- 172.21.15.170:0/4068848621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3240ffd50 msgr2=0x7fa32419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.233+0000 7fa31bfff640 1 --2- 172.21.15.170:0/4068848621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3240ffd50 0x7fa32419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.233+0000 7fa31bfff640 1 -- 172.21.15.170:0/4068848621 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa324197800 con 0x7fa324106930 2024-09-04T16:35:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.233+0000 7fa323fff640 1 --2- 172.21.15.170:0/4068848621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3240ffd50 0x7fa32419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:35:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.233+0000 7fa31bfff640 1 --2- 172.21.15.170:0/4068848621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa324106930 0x7fa32419dbc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00c8a0 tx=0x7fa30c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.233+0000 7fa321ffb640 1 -- 172.21.15.170:0/4068848621 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa30c0079b0 con 0x7fa324106930 2024-09-04T16:35:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.233+0000 7fa321ffb640 1 -- 172.21.15.170:0/4068848621 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa30c007b50 con 0x7fa324106930 2024-09-04T16:35:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.233+0000 7fa32a37c640 1 -- 172.21.15.170:0/4068848621 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa324197af0 con 0x7fa324106930 2024-09-04T16:35:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.234+0000 7fa321ffb640 1 -- 172.21.15.170:0/4068848621 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa30c018700 con 0x7fa324106930 2024-09-04T16:35:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.234+0000 7fa32a37c640 1 -- 172.21.15.170:0/4068848621 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa324198080 con 0x7fa324106930 2024-09-04T16:35:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.234+0000 7fa32a37c640 1 -- 172.21.15.170:0/4068848621 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa324103070 con 0x7fa324106930 2024-09-04T16:35:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.235+0000 7fa321ffb640 1 -- 172.21.15.170:0/4068848621 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fa30c007d00 con 0x7fa324106930 2024-09-04T16:35:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.236+0000 7fa321ffb640 1 --2- 172.21.15.170:0/4068848621 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa310079e80 0x7fa31007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:35:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.236+0000 7fa321ffb640 1 -- 172.21.15.170:0/4068848621 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7fa30c09cbe0 con 0x7fa324106930 2024-09-04T16:35:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.236+0000 7fa323fff640 1 --2- 172.21.15.170:0/4068848621 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa310079e80 0x7fa31007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:35:54.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.236+0000 7fa323fff640 1 --2- 172.21.15.170:0/4068848621 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa310079e80 0x7fa31007c340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa314000c00 tx=0x7fa314031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:35:54.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.240+0000 7fa321ffb640 1 -- 172.21.15.170:0/4068848621 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa30c014030 con 0x7fa324106930 2024-09-04T16:35:54.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.490+0000 7fa32a37c640 1 -- 172.21.15.170:0/4068848621 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fa324198d30 con 0x7fa324106930 2024-09-04T16:35:54.491 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:54 smithi170 ceph-mon[113855]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:35:54.491 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:54 smithi170 ceph-mon[113855]: from='client.44153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:35:54.491 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:54 smithi170 ceph-mon[113855]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:35:54.491 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:54 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:54.491 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:54 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:54.491 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:54 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:35:54.491 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:54 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1824573467' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:35:54.491 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:54 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1189771734' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:35:54.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.490+0000 7fa321ffb640 1 -- 172.21.15.170:0/4068848621 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1294 (secure 0 0 0) 0x7fa30c064720 con 0x7fa324106930 2024-09-04T16:35:54.492 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 46/312 objects degraded (14.744%), 15 pgs degraded 2024-09-04T16:35:54.492 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:35:54.492 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:35:54.492 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-04T16:35:54.492 INFO:teuthology.orchestra.run.smithi170.stdout: osd.1 (root=default,host=smithi170) is down 2024-09-04T16:35:54.492 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 46/312 objects degraded (14.744%), 15 pgs degraded 2024-09-04T16:35:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-04T16:35:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-04T16:35:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-04T16:35:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-04T16:35:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-04T16:35:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-04T16:35:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-04T16:35:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-04T16:35:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-04T16:35:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-04T16:35:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-04T16:35:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-09-04T16:35:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-04T16:35:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-09-04T16:35:54.494 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-04T16:35:54.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.492+0000 7fa32a37c640 1 -- 172.21.15.170:0/4068848621 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa310079e80 msgr2=0x7fa31007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:54.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.492+0000 7fa32a37c640 1 --2- 172.21.15.170:0/4068848621 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa310079e80 0x7fa31007c340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa314000c00 tx=0x7fa314031400 comp rx=0 tx=0).stop 2024-09-04T16:35:54.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.492+0000 7fa32a37c640 1 -- 172.21.15.170:0/4068848621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa324106930 msgr2=0x7fa32419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:35:54.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.492+0000 7fa32a37c640 1 --2- 172.21.15.170:0/4068848621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa324106930 0x7fa32419dbc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00c8a0 tx=0x7fa30c00cd60 comp rx=0 tx=0).stop 2024-09-04T16:35:54.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.493+0000 7fa32a37c640 1 -- 172.21.15.170:0/4068848621 shutdown_connections 2024-09-04T16:35:54.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.493+0000 7fa32a37c640 1 --2- 172.21.15.170:0/4068848621 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa310079e80 0x7fa31007c340 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:54.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.493+0000 7fa32a37c640 1 --2- 172.21.15.170:0/4068848621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa324106930 0x7fa32419dbc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:54.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.493+0000 7fa32a37c640 1 --2- 172.21.15.170:0/4068848621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3240ffd50 0x7fa32419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:35:54.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.493+0000 7fa32a37c640 1 -- 172.21.15.170:0/4068848621 >> 172.21.15.170:0/4068848621 conn(0x7fa3240fbc40 msgr2=0x7fa3240fc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:35:54.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.493+0000 7fa32a37c640 1 -- 172.21.15.170:0/4068848621 shutdown_connections 2024-09-04T16:35:54.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:35:54.493+0000 7fa32a37c640 1 -- 172.21.15.170:0/4068848621 wait complete. 2024-09-04T16:35:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:54 smithi193 ceph-mon[82547]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:35:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:54 smithi193 ceph-mon[82547]: from='client.44153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:35:54.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:54 smithi193 ceph-mon[82547]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:35:54.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:54 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:54.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:54 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:54.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:54 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:35:54.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:54 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1824573467' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:35:54.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:54 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1189771734' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:35:55.101 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:35:54 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1[128964]: 2024-09-04T16:35:54.939+0000 7f46e899e640 -1 Falling back to public interface 2024-09-04T16:35:55.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:55 smithi170 ceph-mon[113855]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:35:55.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:55 smithi170 ceph-mon[113855]: pgmap v158: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-04T16:35:55.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:55 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/4068848621' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:35:55.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:55 smithi193 ceph-mon[82547]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:35:55.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:55 smithi193 ceph-mon[82547]: pgmap v158: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-04T16:35:55.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:55 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/4068848621' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:35:56.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:56 smithi170 ceph-mon[113855]: pgmap v159: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-04T16:35:56.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:56 smithi193 ceph-mon[82547]: pgmap v159: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-04T16:35:58.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:58 smithi170 ceph-mon[113855]: pgmap v160: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-04T16:35:58.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:58 smithi193 ceph-mon[82547]: pgmap v160: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-04T16:35:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:35:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:35:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:59.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:35:59.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:35:59.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:35:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:00.540 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:36:00 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1[128964]: 2024-09-04T16:36:00.370+0000 7f46e899e640 -1 osd.1 52 log_to_monitors true 2024-09-04T16:36:00.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:00 smithi170 ceph-mon[113855]: from='osd.1 [v2:172.21.15.170:6810/1150803388,v1:172.21.15.170:6811/1150803388]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-04T16:36:00.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:00 smithi170 ceph-mon[113855]: pgmap v161: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-04T16:36:00.852 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 16:36:00 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1[128964]: 2024-09-04T16:36:00.557+0000 7f46dc740640 -1 osd.1 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-04T16:36:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:00 smithi193 ceph-mon[82547]: from='osd.1 [v2:172.21.15.170:6810/1150803388,v1:172.21.15.170:6811/1150803388]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-04T16:36:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:00 smithi193 ceph-mon[82547]: pgmap v161: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-04T16:36:01.818 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:01 smithi170 ceph-mon[113855]: from='osd.1 [v2:172.21.15.170:6810/1150803388,v1:172.21.15.170:6811/1150803388]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-04T16:36:01.819 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:01 smithi170 ceph-mon[113855]: osdmap e55: 6 total, 5 up, 6 in 2024-09-04T16:36:01.819 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:01 smithi170 ceph-mon[113855]: from='osd.1 [v2:172.21.15.170:6810/1150803388,v1:172.21.15.170:6811/1150803388]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]} : dispatch 2024-09-04T16:36:01.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:01 smithi193 ceph-mon[82547]: from='osd.1 [v2:172.21.15.170:6810/1150803388,v1:172.21.15.170:6811/1150803388]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-04T16:36:01.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:01 smithi193 ceph-mon[82547]: osdmap e55: 6 total, 5 up, 6 in 2024-09-04T16:36:01.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:01 smithi193 ceph-mon[82547]: from='osd.1 [v2:172.21.15.170:6810/1150803388,v1:172.21.15.170:6811/1150803388]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi170", "root=default"]} : dispatch 2024-09-04T16:36:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:02 smithi170 ceph-mon[113855]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-04T16:36:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:02 smithi170 ceph-mon[113855]: osd.1 [v2:172.21.15.170:6810/1150803388,v1:172.21.15.170:6811/1150803388] boot 2024-09-04T16:36:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:02 smithi170 ceph-mon[113855]: osdmap e56: 6 total, 6 up, 6 in 2024-09-04T16:36:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:02 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-04T16:36:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:02 smithi170 ceph-mon[113855]: pgmap v164: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-04T16:36:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:02 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:02 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:02 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:36:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:02 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:36:02.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:02 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:02.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:02 smithi170 ceph-mon[113855]: osdmap e57: 6 total, 6 up, 6 in 2024-09-04T16:36:02.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:02 smithi193 ceph-mon[82547]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-04T16:36:02.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:02 smithi193 ceph-mon[82547]: osd.1 [v2:172.21.15.170:6810/1150803388,v1:172.21.15.170:6811/1150803388] boot 2024-09-04T16:36:02.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:02 smithi193 ceph-mon[82547]: osdmap e56: 6 total, 6 up, 6 in 2024-09-04T16:36:02.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:02 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-04T16:36:02.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:02 smithi193 ceph-mon[82547]: pgmap v164: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-04T16:36:02.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:02 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:02.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:02 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:02.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:02 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:36:02.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:02 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:36:02.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:02 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:02.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:02 smithi193 ceph-mon[82547]: osdmap e57: 6 total, 6 up, 6 in 2024-09-04T16:36:03.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:03 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:36:03.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:03 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:36:03.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:03 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:36:03.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:03 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:36:03.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:03 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-04T16:36:03.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:03 smithi170 ceph-mon[113855]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-04T16:36:03.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:03 smithi170 ceph-mon[113855]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-04T16:36:03.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:03 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:36:03.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:03 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:36:03.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:03 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:36:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:03 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:36:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:03 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-04T16:36:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:03 smithi193 ceph-mon[82547]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-04T16:36:03.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:03 smithi193 ceph-mon[82547]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-04T16:36:04.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:04 smithi170 ceph-mon[113855]: pgmap v166: 65 pgs: 11 active+undersized, 9 active+undersized+degraded, 45 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 35/312 objects degraded (11.218%) 2024-09-04T16:36:04.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:04 smithi193 ceph-mon[82547]: pgmap v166: 65 pgs: 11 active+undersized, 9 active+undersized+degraded, 45 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 35/312 objects degraded (11.218%) 2024-09-04T16:36:05.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:05 smithi170 ceph-mon[113855]: Health check update: Degraded data redundancy: 35/312 objects degraded (11.218%), 9 pgs degraded (PG_DEGRADED) 2024-09-04T16:36:05.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:05 smithi193 ceph-mon[82547]: Health check update: Degraded data redundancy: 35/312 objects degraded (11.218%), 9 pgs degraded (PG_DEGRADED) 2024-09-04T16:36:06.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:06 smithi170 ceph-mon[113855]: pgmap v167: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:06.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:06 smithi193 ceph-mon[82547]: pgmap v167: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:07.840 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:07 smithi170 ceph-mon[113855]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/312 objects degraded (11.218%), 9 pgs degraded) 2024-09-04T16:36:07.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:07 smithi193 ceph-mon[82547]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/312 objects degraded (11.218%), 9 pgs degraded) 2024-09-04T16:36:08.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:08 smithi170 ceph-mon[113855]: pgmap v168: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:08 smithi193 ceph-mon[82547]: pgmap v168: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:10.569 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:10 smithi170 ceph-mon[113855]: pgmap v169: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:10.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:10 smithi193 ceph-mon[82547]: pgmap v169: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:12.740 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:12 smithi193 ceph-mon[82547]: pgmap v170: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:12.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:12 smithi170 ceph-mon[113855]: pgmap v170: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:15.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:15 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:15.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:15 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:36:15.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:15 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:15.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:15 smithi170 ceph-mon[113855]: pgmap v171: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:15 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:15 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:36:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:15 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:15 smithi193 ceph-mon[82547]: pgmap v171: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:16.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:16 smithi170 ceph-mon[113855]: pgmap v172: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:16.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:16 smithi193 ceph-mon[82547]: pgmap v172: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:18.055 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:17 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-04T16:36:18.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:17 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-04T16:36:19.098 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:18 smithi170 ceph-mon[113855]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-04T16:36:19.098 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:18 smithi170 ceph-mon[113855]: Upgrade: osd.2 is safe to restart 2024-09-04T16:36:19.098 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:18 smithi170 ceph-mon[113855]: pgmap v173: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:19.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:18 smithi193 ceph-mon[82547]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-04T16:36:19.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:18 smithi193 ceph-mon[82547]: Upgrade: osd.2 is safe to restart 2024-09-04T16:36:19.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:18 smithi193 ceph-mon[82547]: pgmap v173: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:20.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:20 smithi170 ceph-mon[113855]: Upgrade: Updating osd.2 2024-09-04T16:36:20.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:20 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:20.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:20 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-04T16:36:20.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:20 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:36:20.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:20 smithi170 ceph-mon[113855]: Deploying daemon osd.2 on smithi170 2024-09-04T16:36:20.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:20 smithi193 ceph-mon[82547]: Upgrade: Updating osd.2 2024-09-04T16:36:20.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:20 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:20.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:20 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-04T16:36:20.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:20 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:36:20.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:20 smithi193 ceph-mon[82547]: Deploying daemon osd.2 on smithi170 2024-09-04T16:36:21.251 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:21 smithi170 ceph-mon[113855]: pgmap v174: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:21.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:21 smithi193 ceph-mon[82547]: pgmap v174: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:22.591 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:22 smithi170 ceph-mon[113855]: pgmap v175: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:22.592 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:22 smithi170 systemd[1]: Stopping Ceph osd.2 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:36:22.852 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:22 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2[65592]: 2024-09-04T16:36:22.590+0000 7fe226ed8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T16:36:22.852 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:22 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2[65592]: 2024-09-04T16:36:22.590+0000 7fe226ed8640 -1 osd.2 57 *** Got signal Terminated *** 2024-09-04T16:36:22.852 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:22 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2[65592]: 2024-09-04T16:36:22.590+0000 7fe226ed8640 -1 osd.2 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-04T16:36:22.893 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:22 smithi193 ceph-mon[82547]: pgmap v175: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:23.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:23 smithi170 ceph-mon[113855]: osd.2 marked itself down and dead 2024-09-04T16:36:23.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:23 smithi193 ceph-mon[82547]: osd.2 marked itself down and dead 2024-09-04T16:36:24.151 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:23 smithi170 podman[134036]: 2024-09-04 16:36:23.876266633 +0000 UTC m=+1.408314374 container died 2c019c1e045332f0aa75d35a11374801b693aec683762d88ca191b5ec5b0577b (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-48920da, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-04T16:36:24.486 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:24 smithi170 podman[134036]: 2024-09-04 16:36:24.32426322 +0000 UTC m=+1.856310957 container cleanup 2c019c1e045332f0aa75d35a11374801b693aec683762d88ca191b5ec5b0577b (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-48920da, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-04T16:36:24.486 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:24 smithi170 bash[134036]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2 2024-09-04T16:36:24.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.583+0000 7f9b69716640 1 -- 172.21.15.170:0/2059959213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b64106820 msgr2=0x7f9b64106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:24.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.583+0000 7f9b69716640 1 --2- 172.21.15.170:0/2059959213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b64106820 0x7f9b64106c00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009880 tx=0x7f9b5402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:36:24.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.583+0000 7f9b69716640 1 -- 172.21.15.170:0/2059959213 shutdown_connections 2024-09-04T16:36:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.583+0000 7f9b69716640 1 --2- 172.21.15.170:0/2059959213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b64100820 0x7f9b64100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.583+0000 7f9b69716640 1 --2- 172.21.15.170:0/2059959213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b64106820 0x7f9b64106c00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.583+0000 7f9b69716640 1 -- 172.21.15.170:0/2059959213 >> 172.21.15.170:0/2059959213 conn(0x7f9b640fc520 msgr2=0x7f9b640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.583+0000 7f9b69716640 1 -- 172.21.15.170:0/2059959213 shutdown_connections 2024-09-04T16:36:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.583+0000 7f9b69716640 1 -- 172.21.15.170:0/2059959213 wait complete. 2024-09-04T16:36:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.584+0000 7f9b69716640 1 Processor -- start 2024-09-04T16:36:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.584+0000 7f9b69716640 1 -- start start 2024-09-04T16:36:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.584+0000 7f9b69716640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b64100820 0x7f9b6419c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.584+0000 7f9b69716640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b64106820 0x7f9b6419cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.584+0000 7f9b69716640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9b6410dcf0 con 0x7f9b64106820 2024-09-04T16:36:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.584+0000 7f9b69716640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9b6410db70 con 0x7f9b64100820 2024-09-04T16:36:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.584+0000 7f9b627fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b64106820 0x7f9b6419cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:24.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.584+0000 7f9b627fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b64106820 0x7f9b6419cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49128/0 (socket says 172.21.15.170:49128) 2024-09-04T16:36:24.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.584+0000 7f9b627fc640 1 -- 172.21.15.170:0/2821493189 learned_addr learned my addr 172.21.15.170:0/2821493189 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:36:24.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.584+0000 7f9b62ffd640 1 --2- 172.21.15.170:0/2821493189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b64100820 0x7f9b6419c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:24.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.585+0000 7f9b627fc640 1 -- 172.21.15.170:0/2821493189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b64100820 msgr2=0x7f9b6419c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:24.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.585+0000 7f9b627fc640 1 --2- 172.21.15.170:0/2821493189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b64100820 0x7f9b6419c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:24.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.585+0000 7f9b627fc640 1 -- 172.21.15.170:0/2821493189 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b641966e0 con 0x7f9b64106820 2024-09-04T16:36:24.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.585+0000 7f9b627fc640 1 --2- 172.21.15.170:0/2821493189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b64106820 0x7f9b6419cb50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9b5800d6f0 tx=0x7f9b5800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:24.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.585+0000 7f9b4bfff640 1 -- 172.21.15.170:0/2821493189 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b58017070 con 0x7f9b64106820 2024-09-04T16:36:24.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.585+0000 7f9b69716640 1 -- 172.21.15.170:0/2821493189 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b64196970 con 0x7f9b64106820 2024-09-04T16:36:24.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.585+0000 7f9b4bfff640 1 -- 172.21.15.170:0/2821493189 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9b5800de00 con 0x7f9b64106820 2024-09-04T16:36:24.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.585+0000 7f9b4bfff640 1 -- 172.21.15.170:0/2821493189 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b58004bb0 con 0x7f9b64106820 2024-09-04T16:36:24.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.585+0000 7f9b69716640 1 -- 172.21.15.170:0/2821493189 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b64196eb0 con 0x7f9b64106820 2024-09-04T16:36:24.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.586+0000 7f9b69716640 1 -- 172.21.15.170:0/2821493189 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b64101f60 con 0x7f9b64106820 2024-09-04T16:36:24.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.587+0000 7f9b4bfff640 1 -- 172.21.15.170:0/2821493189 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f9b58004e60 con 0x7f9b64106820 2024-09-04T16:36:24.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.587+0000 7f9b4bfff640 1 --2- 172.21.15.170:0/2821493189 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b4c079e40 0x7f9b4c07c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:24.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.588+0000 7f9b4bfff640 1 -- 172.21.15.170:0/2821493189 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7f9b5809c5d0 con 0x7f9b64106820 2024-09-04T16:36:24.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.588+0000 7f9b62ffd640 1 --2- 172.21.15.170:0/2821493189 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b4c079e40 0x7f9b4c07c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:24.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.588+0000 7f9b62ffd640 1 --2- 172.21.15.170:0/2821493189 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b4c079e40 0x7f9b4c07c300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9b540096c0 tx=0x7f9b54031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:24.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.592+0000 7f9b4bfff640 1 -- 172.21.15.170:0/2821493189 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9b58068200 con 0x7f9b64106820 2024-09-04T16:36:24.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.834+0000 7f9b69716640 1 -- 172.21.15.170:0/2821493189 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9b64197160 con 0x7f9b4c079e40 2024-09-04T16:36:24.836 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:24 smithi170 ceph-mon[113855]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-04T16:36:24.836 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:24 smithi170 ceph-mon[113855]: osdmap e58: 6 total, 5 up, 6 in 2024-09-04T16:36:24.836 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:24 smithi170 ceph-mon[113855]: pgmap v177: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:24.836 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:24 smithi170 podman[134056]: 2024-09-04 16:36:24.617992896 +0000 UTC m=+0.736649047 container remove 2c019c1e045332f0aa75d35a11374801b693aec683762d88ca191b5ec5b0577b (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2, GIT_BRANCH=HEAD, RELEASE=squid-48920da, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-04T16:36:24.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.836+0000 7f9b4bfff640 1 -- 172.21.15.170:0/2821493189 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f9b64197160 con 0x7f9b4c079e40 2024-09-04T16:36:24.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.838+0000 7f9b69716640 1 -- 172.21.15.170:0/2821493189 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b4c079e40 msgr2=0x7f9b4c07c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:24.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.838+0000 7f9b69716640 1 --2- 172.21.15.170:0/2821493189 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b4c079e40 0x7f9b4c07c300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9b540096c0 tx=0x7f9b54031400 comp rx=0 tx=0).stop 2024-09-04T16:36:24.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.838+0000 7f9b69716640 1 -- 172.21.15.170:0/2821493189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b64106820 msgr2=0x7f9b6419cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:24.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.838+0000 7f9b69716640 1 --2- 172.21.15.170:0/2821493189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b64106820 0x7f9b6419cb50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9b5800d6f0 tx=0x7f9b5800dbb0 comp rx=0 tx=0).stop 2024-09-04T16:36:24.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.839+0000 7f9b69716640 1 -- 172.21.15.170:0/2821493189 shutdown_connections 2024-09-04T16:36:24.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.839+0000 7f9b69716640 1 --2- 172.21.15.170:0/2821493189 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b4c079e40 0x7f9b4c07c300 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:24.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.839+0000 7f9b69716640 1 --2- 172.21.15.170:0/2821493189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b64106820 0x7f9b6419cb50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:24.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.839+0000 7f9b69716640 1 --2- 172.21.15.170:0/2821493189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b64100820 0x7f9b6419c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:24.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.839+0000 7f9b69716640 1 -- 172.21.15.170:0/2821493189 >> 172.21.15.170:0/2821493189 conn(0x7f9b640fc520 msgr2=0x7f9b640fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:24.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.839+0000 7f9b69716640 1 -- 172.21.15.170:0/2821493189 shutdown_connections 2024-09-04T16:36:24.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.839+0000 7f9b69716640 1 -- 172.21.15.170:0/2821493189 wait complete. 2024-09-04T16:36:24.849 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:36:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:24 smithi193 ceph-mon[82547]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-04T16:36:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:24 smithi193 ceph-mon[82547]: osdmap e58: 6 total, 5 up, 6 in 2024-09-04T16:36:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:24 smithi193 ceph-mon[82547]: pgmap v177: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:24.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.927+0000 7f5bfe819640 1 -- 172.21.15.170:0/3688109122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bf8102aa0 msgr2=0x7f5bf8102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:24.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.927+0000 7f5bfe819640 1 --2- 172.21.15.170:0/3688109122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bf8102aa0 0x7f5bf8102e80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009880 tx=0x7f5be802a530 comp rx=0 tx=0).stop 2024-09-04T16:36:24.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.927+0000 7f5bfe819640 1 -- 172.21.15.170:0/3688109122 shutdown_connections 2024-09-04T16:36:24.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.927+0000 7f5bfe819640 1 --2- 172.21.15.170:0/3688109122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bf81033c0 0x7f5bf810b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:24.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.927+0000 7f5bfe819640 1 --2- 172.21.15.170:0/3688109122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bf8102aa0 0x7f5bf8102e80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:24.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.927+0000 7f5bfe819640 1 -- 172.21.15.170:0/3688109122 >> 172.21.15.170:0/3688109122 conn(0x7f5bf80fc4c0 msgr2=0x7f5bf80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:24.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.927+0000 7f5bfe819640 1 -- 172.21.15.170:0/3688109122 shutdown_connections 2024-09-04T16:36:24.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.927+0000 7f5bfe819640 1 -- 172.21.15.170:0/3688109122 wait complete. 2024-09-04T16:36:24.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.928+0000 7f5bfe819640 1 Processor -- start 2024-09-04T16:36:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.928+0000 7f5bfe819640 1 -- start start 2024-09-04T16:36:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.928+0000 7f5bfe819640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bf8102aa0 0x7f5bf819d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.928+0000 7f5bfe819640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bf81033c0 0x7f5bf819db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.928+0000 7f5bfe819640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf810edb0 con 0x7f5bf81033c0 2024-09-04T16:36:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.928+0000 7f5bfe819640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf810ec30 con 0x7f5bf8102aa0 2024-09-04T16:36:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.928+0000 7f5bf77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bf81033c0 0x7f5bf819db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.928+0000 7f5bf77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bf81033c0 0x7f5bf819db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49154/0 (socket says 172.21.15.170:49154) 2024-09-04T16:36:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.928+0000 7f5bf77fe640 1 -- 172.21.15.170:0/2474835635 learned_addr learned my addr 172.21.15.170:0/2474835635 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:36:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.928+0000 7f5bf7fff640 1 --2- 172.21.15.170:0/2474835635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bf8102aa0 0x7f5bf819d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.928+0000 7f5bf77fe640 1 -- 172.21.15.170:0/2474835635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bf8102aa0 msgr2=0x7f5bf819d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.928+0000 7f5bf77fe640 1 --2- 172.21.15.170:0/2474835635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bf8102aa0 0x7f5bf819d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.928+0000 7f5bf77fe640 1 -- 172.21.15.170:0/2474835635 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf8197780 con 0x7f5bf81033c0 2024-09-04T16:36:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.929+0000 7f5bf77fe640 1 --2- 172.21.15.170:0/2474835635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bf81033c0 0x7f5bf819db40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00d8d0 tx=0x7f5bec00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.929+0000 7f5bf57fa640 1 -- 172.21.15.170:0/2474835635 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5bec017030 con 0x7f5bf81033c0 2024-09-04T16:36:24.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.929+0000 7f5bf57fa640 1 -- 172.21.15.170:0/2474835635 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5bec00be10 con 0x7f5bf81033c0 2024-09-04T16:36:24.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.929+0000 7f5bfe819640 1 -- 172.21.15.170:0/2474835635 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf8197a70 con 0x7f5bf81033c0 2024-09-04T16:36:24.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.929+0000 7f5bf57fa640 1 -- 172.21.15.170:0/2474835635 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5bec005580 con 0x7f5bf81033c0 2024-09-04T16:36:24.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.929+0000 7f5bfe819640 1 -- 172.21.15.170:0/2474835635 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf8198000 con 0x7f5bf81033c0 2024-09-04T16:36:24.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.930+0000 7f5bfe819640 1 -- 172.21.15.170:0/2474835635 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf806a410 con 0x7f5bf81033c0 2024-09-04T16:36:24.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.931+0000 7f5bf57fa640 1 -- 172.21.15.170:0/2474835635 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5bec004020 con 0x7f5bf81033c0 2024-09-04T16:36:24.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.931+0000 7f5bf57fa640 1 --2- 172.21.15.170:0/2474835635 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5be0079e40 0x7f5be007c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:24.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.931+0000 7f5bf57fa640 1 -- 172.21.15.170:0/2474835635 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7f5bec018070 con 0x7f5bf81033c0 2024-09-04T16:36:24.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.931+0000 7f5bf7fff640 1 --2- 172.21.15.170:0/2474835635 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5be0079e40 0x7f5be007c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:24.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.932+0000 7f5bf7fff640 1 --2- 172.21.15.170:0/2474835635 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5be0079e40 0x7f5be007c300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5be8031460 tx=0x7f5be80095c0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:24.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:24.935+0000 7f5bf57fa640 1 -- 172.21.15.170:0/2474835635 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5bec0641a0 con 0x7f5bf81033c0 2024-09-04T16:36:25.102 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:24 smithi170 podman[134169]: 2024-09-04 16:36:24.890020606 +0000 UTC m=+0.017078889 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:36:25.102 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:25 smithi170 podman[134169]: 2024-09-04 16:36:25.010856872 +0000 UTC m=+0.137915151 container create 9d7f4ec4644f4f1a7bdc248a009f4cc2a302f36b7e4246b807c7699ad7530f35 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5) 2024-09-04T16:36:25.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.132+0000 7f5bfe819640 1 -- 172.21.15.170:0/2474835635 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5bf8198310 con 0x7f5be0079e40 2024-09-04T16:36:25.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.133+0000 7f5bf57fa640 1 -- 172.21.15.170:0/2474835635 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f5bf8198310 con 0x7f5be0079e40 2024-09-04T16:36:25.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.135+0000 7f5bfe819640 1 -- 172.21.15.170:0/2474835635 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5be0079e40 msgr2=0x7f5be007c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:25.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.135+0000 7f5bfe819640 1 --2- 172.21.15.170:0/2474835635 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5be0079e40 0x7f5be007c300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5be8031460 tx=0x7f5be80095c0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.135+0000 7f5bfe819640 1 -- 172.21.15.170:0/2474835635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bf81033c0 msgr2=0x7f5bf819db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:25.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.135+0000 7f5bfe819640 1 --2- 172.21.15.170:0/2474835635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bf81033c0 0x7f5bf819db40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00d8d0 tx=0x7f5bec00dd90 comp rx=0 tx=0).stop 2024-09-04T16:36:25.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.135+0000 7f5bfe819640 1 -- 172.21.15.170:0/2474835635 shutdown_connections 2024-09-04T16:36:25.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.135+0000 7f5bfe819640 1 --2- 172.21.15.170:0/2474835635 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5be0079e40 0x7f5be007c300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.135+0000 7f5bfe819640 1 --2- 172.21.15.170:0/2474835635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bf81033c0 0x7f5bf819db40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.135+0000 7f5bfe819640 1 --2- 172.21.15.170:0/2474835635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bf8102aa0 0x7f5bf819d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.135+0000 7f5bfe819640 1 -- 172.21.15.170:0/2474835635 >> 172.21.15.170:0/2474835635 conn(0x7f5bf80fc4c0 msgr2=0x7f5bf8108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:25.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.135+0000 7f5bfe819640 1 -- 172.21.15.170:0/2474835635 shutdown_connections 2024-09-04T16:36:25.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.135+0000 7f5bfe819640 1 -- 172.21.15.170:0/2474835635 wait complete. 2024-09-04T16:36:25.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.219+0000 7f0d7e242640 1 -- 172.21.15.170:0/447640973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d78102aa0 msgr2=0x7f0d78102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:25.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.219+0000 7f0d7e242640 1 --2- 172.21.15.170:0/447640973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d78102aa0 0x7f0d78102e80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009880 tx=0x7f0d6c02a530 comp rx=0 tx=0).stop 2024-09-04T16:36:25.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.219+0000 7f0d7e242640 1 -- 172.21.15.170:0/447640973 shutdown_connections 2024-09-04T16:36:25.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.219+0000 7f0d7e242640 1 --2- 172.21.15.170:0/447640973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d781033c0 0x7f0d7810b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.219+0000 7f0d7e242640 1 --2- 172.21.15.170:0/447640973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d78102aa0 0x7f0d78102e80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.219+0000 7f0d7e242640 1 -- 172.21.15.170:0/447640973 >> 172.21.15.170:0/447640973 conn(0x7f0d780fc4c0 msgr2=0x7f0d780fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:25.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.219+0000 7f0d7e242640 1 -- 172.21.15.170:0/447640973 shutdown_connections 2024-09-04T16:36:25.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.219+0000 7f0d7e242640 1 -- 172.21.15.170:0/447640973 wait complete. 2024-09-04T16:36:25.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.219+0000 7f0d7e242640 1 Processor -- start 2024-09-04T16:36:25.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.220+0000 7f0d7e242640 1 -- start start 2024-09-04T16:36:25.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.220+0000 7f0d7e242640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d78102aa0 0x7f0d7819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:25.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.220+0000 7f0d7e242640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d781033c0 0x7f0d7819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:25.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.220+0000 7f0d7e242640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7810edd0 con 0x7f0d78102aa0 2024-09-04T16:36:25.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.220+0000 7f0d7e242640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7810ec50 con 0x7f0d781033c0 2024-09-04T16:36:25.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.220+0000 7f0d777fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d78102aa0 0x7f0d7819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:25.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.220+0000 7f0d777fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d78102aa0 0x7f0d7819f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60052/0 (socket says 172.21.15.170:60052) 2024-09-04T16:36:25.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.220+0000 7f0d777fe640 1 -- 172.21.15.170:0/2309210535 learned_addr learned my addr 172.21.15.170:0/2309210535 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:36:25.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.220+0000 7f0d777fe640 1 -- 172.21.15.170:0/2309210535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d781033c0 msgr2=0x7f0d7819fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:25.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.220+0000 7f0d777fe640 1 --2- 172.21.15.170:0/2309210535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d781033c0 0x7f0d7819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.220+0000 7f0d777fe640 1 -- 172.21.15.170:0/2309210535 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d781999d0 con 0x7f0d78102aa0 2024-09-04T16:36:25.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.220+0000 7f0d777fe640 1 --2- 172.21.15.170:0/2309210535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d78102aa0 0x7f0d7819f810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c031460 tx=0x7f0d6c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:25.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.221+0000 7f0d74ff9640 1 -- 172.21.15.170:0/2309210535 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d6c03f070 con 0x7f0d78102aa0 2024-09-04T16:36:25.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.221+0000 7f0d74ff9640 1 -- 172.21.15.170:0/2309210535 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d6c0035f0 con 0x7f0d78102aa0 2024-09-04T16:36:25.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.221+0000 7f0d7e242640 1 -- 172.21.15.170:0/2309210535 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d78199c60 con 0x7f0d78102aa0 2024-09-04T16:36:25.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.221+0000 7f0d74ff9640 1 -- 172.21.15.170:0/2309210535 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d6c035030 con 0x7f0d78102aa0 2024-09-04T16:36:25.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.221+0000 7f0d7e242640 1 -- 172.21.15.170:0/2309210535 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d7819a190 con 0x7f0d78102aa0 2024-09-04T16:36:25.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.222+0000 7f0d7e242640 1 -- 172.21.15.170:0/2309210535 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d7806a410 con 0x7f0d78102aa0 2024-09-04T16:36:25.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.222+0000 7f0d74ff9640 1 -- 172.21.15.170:0/2309210535 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f0d6c042070 con 0x7f0d78102aa0 2024-09-04T16:36:25.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.223+0000 7f0d74ff9640 1 --2- 172.21.15.170:0/2309210535 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0d60079e30 0x7f0d6007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:25.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.223+0000 7f0d74ff9640 1 -- 172.21.15.170:0/2309210535 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7f0d6c0bd3b0 con 0x7f0d78102aa0 2024-09-04T16:36:25.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.223+0000 7f0d76ffd640 1 --2- 172.21.15.170:0/2309210535 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0d60079e30 0x7f0d6007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:25.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.223+0000 7f0d76ffd640 1 --2- 172.21.15.170:0/2309210535 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0d60079e30 0x7f0d6007c2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0d68005fd0 tx=0x7f0d68005ee0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:25.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.227+0000 7f0d74ff9640 1 -- 172.21.15.170:0/2309210535 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0d6c084e70 con 0x7f0d78102aa0 2024-09-04T16:36:25.389 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:25 smithi170 podman[134169]: 2024-09-04 16:36:25.280861941 +0000 UTC m=+0.407920221 container init 9d7f4ec4644f4f1a7bdc248a009f4cc2a302f36b7e4246b807c7699ad7530f35 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-04T16:36:25.389 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:25 smithi170 podman[134169]: 2024-09-04 16:36:25.284313487 +0000 UTC m=+0.411371774 container start 9d7f4ec4644f4f1a7bdc248a009f4cc2a302f36b7e4246b807c7699ad7530f35 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-04T16:36:25.389 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:25 smithi170 podman[134169]: 2024-09-04 16:36:25.389144679 +0000 UTC m=+0.516202964 container attach 9d7f4ec4644f4f1a7bdc248a009f4cc2a302f36b7e4246b807c7699ad7530f35 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5) 2024-09-04T16:36:25.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.417+0000 7f0d7e242640 1 -- 172.21.15.170:0/2309210535 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0d7819af00 con 0x7f0d60079e30 2024-09-04T16:36:25.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.427+0000 7f0d74ff9640 1 -- 172.21.15.170:0/2309210535 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f0d7819af00 con 0x7f0d60079e30 2024-09-04T16:36:25.428 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:36:25.428 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (3m) 26s ago 14m 22.0M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:36:25.428 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (6m) 26s ago 14m 9013k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:36:25.428 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (5m) 85s ago 13m 8326k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:36:25.428 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (93s) 26s ago 14m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:36:25.428 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (89s) 85s ago 13m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:36:25.429 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (3m) 26s ago 14m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:36:25.429 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (8m) 26s ago 8m 27.1M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:36:25.429 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (9m) 26s ago 9m 145M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:36:25.429 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (8m) 85s ago 8m 16.9M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:36:25.429 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (8m) 85s ago 8m 16.5M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:36:25.429 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (5m) 26s ago 15m 524M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:36:25.429 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (4m) 85s ago 13m 456M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:36:25.429 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (2m) 26s ago 15m 41.2M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:36:25.429 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (107s) 85s ago 13m 25.2M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:36:25.429 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (4m) 26s ago 14m 9919k - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:36:25.429 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (4m) 85s ago 13m 12.5M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:36:25.429 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (68s) 26s ago 12m 83.0M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:36:25.430 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (32s) 26s ago 11m 11.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:36:25.430 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (11m) 26s ago 11m 182M 1216M 19.1.1-252-g48920dab b708f9119ac7 2c019c1e0453 2024-09-04T16:36:25.430 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (10m) 85s ago 10m 249M 2240M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:36:25.430 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (10m) 85s ago 10m 210M 2240M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:36:25.430 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (9m) 85s ago 9m 191M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:36:25.430 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (3m) 26s ago 13m 51.6M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:36:25.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.429+0000 7f0d7e242640 1 -- 172.21.15.170:0/2309210535 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0d60079e30 msgr2=0x7f0d6007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:25.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.429+0000 7f0d7e242640 1 --2- 172.21.15.170:0/2309210535 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0d60079e30 0x7f0d6007c2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0d68005fd0 tx=0x7f0d68005ee0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.429+0000 7f0d7e242640 1 -- 172.21.15.170:0/2309210535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d78102aa0 msgr2=0x7f0d7819f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:25.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.429+0000 7f0d7e242640 1 --2- 172.21.15.170:0/2309210535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d78102aa0 0x7f0d7819f810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c031460 tx=0x7f0d6c0045e0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.429+0000 7f0d7e242640 1 -- 172.21.15.170:0/2309210535 shutdown_connections 2024-09-04T16:36:25.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.429+0000 7f0d7e242640 1 --2- 172.21.15.170:0/2309210535 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0d60079e30 0x7f0d6007c2f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.429+0000 7f0d7e242640 1 --2- 172.21.15.170:0/2309210535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d781033c0 0x7f0d7819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.429+0000 7f0d7e242640 1 --2- 172.21.15.170:0/2309210535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d78102aa0 0x7f0d7819f810 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.429+0000 7f0d7e242640 1 -- 172.21.15.170:0/2309210535 >> 172.21.15.170:0/2309210535 conn(0x7f0d780fc4c0 msgr2=0x7f0d78100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:25.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.430+0000 7f0d7e242640 1 -- 172.21.15.170:0/2309210535 shutdown_connections 2024-09-04T16:36:25.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.430+0000 7f0d7e242640 1 -- 172.21.15.170:0/2309210535 wait complete. 2024-09-04T16:36:25.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.521+0000 7fef200e2640 1 -- 172.21.15.170:0/3808327130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef181067e0 msgr2=0x7fef18106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:25.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.521+0000 7fef200e2640 1 --2- 172.21.15.170:0/3808327130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef181067e0 0x7fef18106bc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fef14009880 tx=0x7fef1402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.521+0000 7fef200e2640 1 -- 172.21.15.170:0/3808327130 shutdown_connections 2024-09-04T16:36:25.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.521+0000 7fef200e2640 1 --2- 172.21.15.170:0/3808327130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef181007e0 0x7fef18100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.521+0000 7fef200e2640 1 --2- 172.21.15.170:0/3808327130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef181067e0 0x7fef18106bc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.521+0000 7fef200e2640 1 -- 172.21.15.170:0/3808327130 >> 172.21.15.170:0/3808327130 conn(0x7fef180fc4c0 msgr2=0x7fef180fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:25.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.521+0000 7fef200e2640 1 -- 172.21.15.170:0/3808327130 shutdown_connections 2024-09-04T16:36:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.521+0000 7fef200e2640 1 -- 172.21.15.170:0/3808327130 wait complete. 2024-09-04T16:36:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.522+0000 7fef200e2640 1 Processor -- start 2024-09-04T16:36:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.522+0000 7fef200e2640 1 -- start start 2024-09-04T16:36:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.522+0000 7fef200e2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef181007e0 0x7fef180fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.522+0000 7fef200e2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef181067e0 0x7fef180fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.522+0000 7fef200e2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fef1810dd10 con 0x7fef181067e0 2024-09-04T16:36:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.522+0000 7fef200e2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fef1810db90 con 0x7fef181007e0 2024-09-04T16:36:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.522+0000 7fef1d67d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef181067e0 0x7fef180fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.522+0000 7fef1d67d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef181067e0 0x7fef180fd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60066/0 (socket says 172.21.15.170:60066) 2024-09-04T16:36:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.522+0000 7fef1d67d640 1 -- 172.21.15.170:0/1666614068 learned_addr learned my addr 172.21.15.170:0/1666614068 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:36:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.522+0000 7fef1de7e640 1 --2- 172.21.15.170:0/1666614068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef181007e0 0x7fef180fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.522+0000 7fef1d67d640 1 -- 172.21.15.170:0/1666614068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef181007e0 msgr2=0x7fef180fcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.522+0000 7fef1d67d640 1 --2- 172.21.15.170:0/1666614068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef181007e0 0x7fef180fcc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.522+0000 7fef1d67d640 1 -- 172.21.15.170:0/1666614068 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef180fd710 con 0x7fef181067e0 2024-09-04T16:36:25.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.523+0000 7fef1d67d640 1 --2- 172.21.15.170:0/1666614068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef181067e0 0x7fef180fd1d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fef0800b420 tx=0x7fef0800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:25.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.523+0000 7fef0effd640 1 -- 172.21.15.170:0/1666614068 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef08011630 con 0x7fef181067e0 2024-09-04T16:36:25.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.523+0000 7fef0effd640 1 -- 172.21.15.170:0/1666614068 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fef08016070 con 0x7fef181067e0 2024-09-04T16:36:25.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.523+0000 7fef200e2640 1 -- 172.21.15.170:0/1666614068 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef180fda00 con 0x7fef181067e0 2024-09-04T16:36:25.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.523+0000 7fef0effd640 1 -- 172.21.15.170:0/1666614068 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef08010d40 con 0x7fef181067e0 2024-09-04T16:36:25.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.523+0000 7fef200e2640 1 -- 172.21.15.170:0/1666614068 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef181a3eb0 con 0x7fef181067e0 2024-09-04T16:36:25.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.524+0000 7fef200e2640 1 -- 172.21.15.170:0/1666614068 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef18101f20 con 0x7fef181067e0 2024-09-04T16:36:25.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.524+0000 7fef0effd640 1 -- 172.21.15.170:0/1666614068 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fef0801b460 con 0x7fef181067e0 2024-09-04T16:36:25.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.525+0000 7fef0effd640 1 --2- 172.21.15.170:0/1666614068 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fef04079e80 0x7fef0407c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:25.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.525+0000 7fef0effd640 1 -- 172.21.15.170:0/1666614068 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7fef0809c100 con 0x7fef181067e0 2024-09-04T16:36:25.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.525+0000 7fef1de7e640 1 --2- 172.21.15.170:0/1666614068 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fef04079e80 0x7fef0407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:25.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.525+0000 7fef1de7e640 1 --2- 172.21.15.170:0/1666614068 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fef04079e80 0x7fef0407c340 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef140096c0 tx=0x7fef14031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:25.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.529+0000 7fef0effd640 1 -- 172.21.15.170:0/1666614068 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fef08021250 con 0x7fef181067e0 2024-09-04T16:36:25.776 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:25 smithi170 podman[134169]: 2024-09-04 16:36:25.47752707 +0000 UTC m=+0.604585358 container died 9d7f4ec4644f4f1a7bdc248a009f4cc2a302f36b7e4246b807c7699ad7530f35 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-04T16:36:25.777 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:25 smithi170 ceph-mon[113855]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-04T16:36:25.777 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:25 smithi170 ceph-mon[113855]: osdmap e59: 6 total, 5 up, 6 in 2024-09-04T16:36:25.777 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:25 smithi170 ceph-mon[113855]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:36:25.777 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:25 smithi170 ceph-mon[113855]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:36:25.777 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:25 smithi170 ceph-mon[113855]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:36:25.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.778+0000 7fef200e2640 1 -- 172.21.15.170:0/1666614068 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fef18109d60 con 0x7fef181067e0 2024-09-04T16:36:25.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.779+0000 7fef0effd640 1 -- 172.21.15.170:0/1666614068 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fef08063c40 con 0x7fef181067e0 2024-09-04T16:36:25.779 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:36:25.779 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:36:25.779 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:36:25.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:36:25.780 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:36:25.780 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:36:25.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:36:25.780 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:36:25.780 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 3, 2024-09-04T16:36:25.780 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:36:25.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:36:25.780 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:36:25.780 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:36:25.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:36:25.780 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:36:25.780 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 7, 2024-09-04T16:36:25.780 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:36:25.781 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:36:25.781 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:36:25.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.781+0000 7fef200e2640 1 -- 172.21.15.170:0/1666614068 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fef04079e80 msgr2=0x7fef0407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:25.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.781+0000 7fef200e2640 1 --2- 172.21.15.170:0/1666614068 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fef04079e80 0x7fef0407c340 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef140096c0 tx=0x7fef14031400 comp rx=0 tx=0).stop 2024-09-04T16:36:25.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.781+0000 7fef200e2640 1 -- 172.21.15.170:0/1666614068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef181067e0 msgr2=0x7fef180fd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:25.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.781+0000 7fef200e2640 1 --2- 172.21.15.170:0/1666614068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef181067e0 0x7fef180fd1d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fef0800b420 tx=0x7fef0800b8e0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.781+0000 7fef200e2640 1 -- 172.21.15.170:0/1666614068 shutdown_connections 2024-09-04T16:36:25.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.781+0000 7fef200e2640 1 --2- 172.21.15.170:0/1666614068 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fef04079e80 0x7fef0407c340 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.781+0000 7fef200e2640 1 --2- 172.21.15.170:0/1666614068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef181067e0 0x7fef180fd1d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.781+0000 7fef200e2640 1 --2- 172.21.15.170:0/1666614068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef181007e0 0x7fef180fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.781+0000 7fef200e2640 1 -- 172.21.15.170:0/1666614068 >> 172.21.15.170:0/1666614068 conn(0x7fef180fc4c0 msgr2=0x7fef18069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:25.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.781+0000 7fef200e2640 1 -- 172.21.15.170:0/1666614068 shutdown_connections 2024-09-04T16:36:25.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.781+0000 7fef200e2640 1 -- 172.21.15.170:0/1666614068 wait complete. 2024-09-04T16:36:25.807 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:25 smithi193 ceph-mon[82547]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-04T16:36:25.807 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:25 smithi193 ceph-mon[82547]: osdmap e59: 6 total, 5 up, 6 in 2024-09-04T16:36:25.808 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:25 smithi193 ceph-mon[82547]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:36:25.808 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:25 smithi193 ceph-mon[82547]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:36:25.808 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:25 smithi193 ceph-mon[82547]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:36:25.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.865+0000 7f78223b6640 1 -- 172.21.15.170:0/3718232264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f781c1067e0 msgr2=0x7f781c106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:25.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.865+0000 7f78223b6640 1 --2- 172.21.15.170:0/3718232264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f781c1067e0 0x7f781c106bc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f780c009880 tx=0x7f780c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.865+0000 7f78223b6640 1 -- 172.21.15.170:0/3718232264 shutdown_connections 2024-09-04T16:36:25.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.865+0000 7f78223b6640 1 --2- 172.21.15.170:0/3718232264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f781c1007e0 0x7f781c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.865+0000 7f78223b6640 1 --2- 172.21.15.170:0/3718232264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f781c1067e0 0x7f781c106bc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.865+0000 7f78223b6640 1 -- 172.21.15.170:0/3718232264 >> 172.21.15.170:0/3718232264 conn(0x7f781c0fc4c0 msgr2=0x7f781c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:25.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.865+0000 7f78223b6640 1 -- 172.21.15.170:0/3718232264 shutdown_connections 2024-09-04T16:36:25.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.865+0000 7f78223b6640 1 -- 172.21.15.170:0/3718232264 wait complete. 2024-09-04T16:36:25.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.866+0000 7f78223b6640 1 Processor -- start 2024-09-04T16:36:25.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.866+0000 7f78223b6640 1 -- start start 2024-09-04T16:36:25.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.866+0000 7f78223b6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f781c1007e0 0x7f781c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:25.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.866+0000 7f78223b6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f781c1067e0 0x7f781c198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:25.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.866+0000 7f78223b6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f781c10dcb0 con 0x7f781c1007e0 2024-09-04T16:36:25.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.866+0000 7f78223b6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f781c10db30 con 0x7f781c1067e0 2024-09-04T16:36:25.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.866+0000 7f781bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f781c1007e0 0x7f781c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:25.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.866+0000 7f781bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f781c1007e0 0x7f781c198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60090/0 (socket says 172.21.15.170:60090) 2024-09-04T16:36:25.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.866+0000 7f781bfff640 1 -- 172.21.15.170:0/1125344363 learned_addr learned my addr 172.21.15.170:0/1125344363 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:36:25.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.866+0000 7f781b7fe640 1 --2- 172.21.15.170:0/1125344363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f781c1067e0 0x7f781c198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:25.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.866+0000 7f781bfff640 1 -- 172.21.15.170:0/1125344363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f781c1067e0 msgr2=0x7f781c198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:25.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.866+0000 7f781bfff640 1 --2- 172.21.15.170:0/1125344363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f781c1067e0 0x7f781c198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:25.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.866+0000 7f781bfff640 1 -- 172.21.15.170:0/1125344363 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781c199360 con 0x7f781c1007e0 2024-09-04T16:36:25.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.867+0000 7f781bfff640 1 --2- 172.21.15.170:0/1125344363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f781c1007e0 0x7f781c198820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f780c031460 tx=0x7f780c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:25.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.867+0000 7f78197fa640 1 -- 172.21.15.170:0/1125344363 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f780c03f070 con 0x7f781c1007e0 2024-09-04T16:36:25.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.867+0000 7f78197fa640 1 -- 172.21.15.170:0/1125344363 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f780c004cf0 con 0x7f781c1007e0 2024-09-04T16:36:25.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.867+0000 7f78223b6640 1 -- 172.21.15.170:0/1125344363 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f781c1995f0 con 0x7f781c1007e0 2024-09-04T16:36:25.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.867+0000 7f78197fa640 1 -- 172.21.15.170:0/1125344363 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f780c035030 con 0x7f781c1007e0 2024-09-04T16:36:25.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.867+0000 7f78223b6640 1 -- 172.21.15.170:0/1125344363 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f781c1a1ba0 con 0x7f781c1007e0 2024-09-04T16:36:25.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.868+0000 7f78223b6640 1 -- 172.21.15.170:0/1125344363 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f781c101f20 con 0x7f781c1007e0 2024-09-04T16:36:25.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.869+0000 7f78197fa640 1 -- 172.21.15.170:0/1125344363 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f780c042070 con 0x7f781c1007e0 2024-09-04T16:36:25.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.869+0000 7f78197fa640 1 --2- 172.21.15.170:0/1125344363 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7804079e30 0x7f780407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:25.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.870+0000 7f781b7fe640 1 --2- 172.21.15.170:0/1125344363 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7804079e30 0x7f780407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:25.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.870+0000 7f78197fa640 1 -- 172.21.15.170:0/1125344363 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7f780c0bd470 con 0x7f781c1007e0 2024-09-04T16:36:25.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.870+0000 7f781b7fe640 1 --2- 172.21.15.170:0/1125344363 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7804079e30 0x7f780407c2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7810005fd0 tx=0x7f7810005e20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:25.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:25.873+0000 7f78197fa640 1 -- 172.21.15.170:0/1125344363 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f780c084f30 con 0x7f781c1007e0 2024-09-04T16:36:26.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.093+0000 7f78223b6640 1 -- 172.21.15.170:0/1125344363 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f781c06a120 con 0x7f781c1007e0 2024-09-04T16:36:26.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.094+0000 7f78197fa640 1 -- 172.21.15.170:0/1125344363 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2036 (secure 0 0 0) 0x7f780c08d3e0 con 0x7f781c1007e0 2024-09-04T16:36:26.095 INFO:teuthology.orchestra.run.smithi170.stdout:e15 2024-09-04T16:36:26.095 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:27:39:151187+0000 2024-09-04T16:36:26.095 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:36:26.095 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:36:26.095 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:36:26.095 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:36:26.095 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:36:26.095 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:36:26.095 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 15 2024-09-04T16:36:26.095 INFO:teuthology.orchestra.run.smithi170.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-04T16:36:26.096 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:36:26.096 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:27:39.151182+0000 2024-09-04T16:36:26.096 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:36:26.096 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:36:26.096 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:36:26.096 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:36:26.096 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:36:26.096 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:36:26.096 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:36:26.096 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:36:26.096 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 45 2024-09-04T16:36:26.096 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:36:26.096 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:36:26.097 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:36:26.097 INFO:teuthology.orchestra.run.smithi170.stdout:up {0=14562,1=14578} 2024-09-04T16:36:26.097 INFO:teuthology.orchestra.run.smithi170.stdout:failed 2024-09-04T16:36:26.097 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:36:26.097 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:36:26.097 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:36:26.097 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:36:26.097 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:36:26.097 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:36:26.097 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:36:26.097 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:36:26.097 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 14562 members: 14562,14578 2024-09-04T16:36:26.098 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{0:14562} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:36:26.098 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{1:14578} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:36:26.098 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:36:26.098 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:36:26.098 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:36:26.098 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:36:26.098 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:24315} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.193:6826/288890560,v1:172.21.15.193:6827/288890560] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:36:26.098 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:24319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1128257367,v1:172.21.15.193:6825/1128257367] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:36:26.099 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 15 2024-09-04T16:36:26.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.096+0000 7f78223b6640 1 -- 172.21.15.170:0/1125344363 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7804079e30 msgr2=0x7f780407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:26.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.096+0000 7f78223b6640 1 --2- 172.21.15.170:0/1125344363 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7804079e30 0x7f780407c2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7810005fd0 tx=0x7f7810005e20 comp rx=0 tx=0).stop 2024-09-04T16:36:26.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.096+0000 7f78223b6640 1 -- 172.21.15.170:0/1125344363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f781c1007e0 msgr2=0x7f781c198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:26.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.096+0000 7f78223b6640 1 --2- 172.21.15.170:0/1125344363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f781c1007e0 0x7f781c198820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f780c031460 tx=0x7f780c0048f0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.096+0000 7f78223b6640 1 -- 172.21.15.170:0/1125344363 shutdown_connections 2024-09-04T16:36:26.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.096+0000 7f78223b6640 1 --2- 172.21.15.170:0/1125344363 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7804079e30 0x7f780407c2f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.096+0000 7f78223b6640 1 --2- 172.21.15.170:0/1125344363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f781c1067e0 0x7f781c198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.096+0000 7f78223b6640 1 --2- 172.21.15.170:0/1125344363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f781c1007e0 0x7f781c198820 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.096+0000 7f78223b6640 1 -- 172.21.15.170:0/1125344363 >> 172.21.15.170:0/1125344363 conn(0x7f781c0fc4c0 msgr2=0x7f781c0fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:26.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.096+0000 7f78223b6640 1 -- 172.21.15.170:0/1125344363 shutdown_connections 2024-09-04T16:36:26.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.096+0000 7f78223b6640 1 -- 172.21.15.170:0/1125344363 wait complete. 2024-09-04T16:36:26.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.181+0000 7f834b16e640 1 -- 172.21.15.170:0/3774792635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8344100ed0 msgr2=0x7f8344101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:26.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.181+0000 7f834b16e640 1 --2- 172.21.15.170:0/3774792635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8344100ed0 0x7f8344101330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8334009880 tx=0x7f833402a530 comp rx=0 tx=0).stop 2024-09-04T16:36:26.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.181+0000 7f834b16e640 1 -- 172.21.15.170:0/3774792635 shutdown_connections 2024-09-04T16:36:26.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.181+0000 7f834b16e640 1 --2- 172.21.15.170:0/3774792635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8344100ed0 0x7f8344101330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.181+0000 7f834b16e640 1 --2- 172.21.15.170:0/3774792635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8344106810 0x7f8344106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.181+0000 7f834b16e640 1 -- 172.21.15.170:0/3774792635 >> 172.21.15.170:0/3774792635 conn(0x7f83440fbc10 msgr2=0x7f83440fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:26.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.181+0000 7f834b16e640 1 -- 172.21.15.170:0/3774792635 shutdown_connections 2024-09-04T16:36:26.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.181+0000 7f834b16e640 1 -- 172.21.15.170:0/3774792635 wait complete. 2024-09-04T16:36:26.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.182+0000 7f834b16e640 1 Processor -- start 2024-09-04T16:36:26.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.182+0000 7f834b16e640 1 -- start start 2024-09-04T16:36:26.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.182+0000 7f834b16e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8344100ed0 0x7f834419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:26.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.182+0000 7f834b16e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8344106810 0x7f834419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:26.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.182+0000 7f834b16e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f834410dcd0 con 0x7f8344106810 2024-09-04T16:36:26.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.182+0000 7f834b16e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f834410db50 con 0x7f8344100ed0 2024-09-04T16:36:26.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.182+0000 7f833bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8344106810 0x7f834419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:26.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.183+0000 7f833bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8344106810 0x7f834419cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60114/0 (socket says 172.21.15.170:60114) 2024-09-04T16:36:26.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.183+0000 7f833bfff640 1 -- 172.21.15.170:0/4127028701 learned_addr learned my addr 172.21.15.170:0/4127028701 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:36:26.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.183+0000 7f8348f0a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8344100ed0 0x7f834419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:26.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.183+0000 7f833bfff640 1 -- 172.21.15.170:0/4127028701 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8344100ed0 msgr2=0x7f834419c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:26.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.183+0000 7f833bfff640 1 --2- 172.21.15.170:0/4127028701 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8344100ed0 0x7f834419c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.183+0000 7f833bfff640 1 -- 172.21.15.170:0/4127028701 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83441966d0 con 0x7f8344106810 2024-09-04T16:36:26.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.183+0000 7f833bfff640 1 --2- 172.21.15.170:0/4127028701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8344106810 0x7f834419cb40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8334031460 tx=0x7f83340045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:26.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.183+0000 7f8339ffb640 1 -- 172.21.15.170:0/4127028701 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8334035070 con 0x7f8344106810 2024-09-04T16:36:26.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.183+0000 7f8339ffb640 1 -- 172.21.15.170:0/4127028701 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8334004a90 con 0x7f8344106810 2024-09-04T16:36:26.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.183+0000 7f834b16e640 1 -- 172.21.15.170:0/4127028701 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8344196960 con 0x7f8344106810 2024-09-04T16:36:26.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.183+0000 7f8339ffb640 1 -- 172.21.15.170:0/4127028701 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8334031810 con 0x7f8344106810 2024-09-04T16:36:26.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.184+0000 7f834b16e640 1 -- 172.21.15.170:0/4127028701 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8344196e60 con 0x7f8344106810 2024-09-04T16:36:26.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.185+0000 7f834b16e640 1 -- 172.21.15.170:0/4127028701 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83441020f0 con 0x7f8344106810 2024-09-04T16:36:26.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.186+0000 7f8339ffb640 1 -- 172.21.15.170:0/4127028701 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f8334031b10 con 0x7f8344106810 2024-09-04T16:36:26.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.186+0000 7f8339ffb640 1 --2- 172.21.15.170:0/4127028701 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f832c079e40 0x7f832c07c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:26.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.186+0000 7f8339ffb640 1 -- 172.21.15.170:0/4127028701 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7f833403e070 con 0x7f8344106810 2024-09-04T16:36:26.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.186+0000 7f8348f0a640 1 --2- 172.21.15.170:0/4127028701 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f832c079e40 0x7f832c07c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:26.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.187+0000 7f8348f0a640 1 --2- 172.21.15.170:0/4127028701 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f832c079e40 0x7f832c07c300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8340005fd0 tx=0x7f834000b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:26.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.191+0000 7f8339ffb640 1 -- 172.21.15.170:0/4127028701 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8334086a10 con 0x7f8344106810 2024-09-04T16:36:26.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:26 smithi170 podman[134235]: 2024-09-04 16:36:26.160967064 +0000 UTC m=+0.672294114 container remove 9d7f4ec4644f4f1a7bdc248a009f4cc2a302f36b7e4246b807c7699ad7530f35 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-deactivate, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-04T16:36:26.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:26 smithi170 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-04T16:36:26.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:26 smithi170 systemd[1]: Stopped Ceph osd.2 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:36:26.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:26 smithi170 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.2.service: Consumed 47.986s CPU time. 2024-09-04T16:36:26.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.406+0000 7f834b16e640 1 -- 172.21.15.170:0/4127028701 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8344197110 con 0x7f832c079e40 2024-09-04T16:36:26.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.407+0000 7f8339ffb640 1 -- 172.21.15.170:0/4127028701 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f8344197110 con 0x7f832c079e40 2024-09-04T16:36:26.409 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:36:26.409 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:36:26.409 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:36:26.409 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:36:26.409 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:36:26.409 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-04T16:36:26.409 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:36:26.409 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-04T16:36:26.409 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:36:26.409 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "8/23 daemons upgraded", 2024-09-04T16:36:26.409 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-04T16:36:26.410 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:36:26.410 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:36:26.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.410+0000 7f834b16e640 1 -- 172.21.15.170:0/4127028701 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f832c079e40 msgr2=0x7f832c07c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:26.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.410+0000 7f834b16e640 1 --2- 172.21.15.170:0/4127028701 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f832c079e40 0x7f832c07c300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8340005fd0 tx=0x7f834000b390 comp rx=0 tx=0).stop 2024-09-04T16:36:26.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.410+0000 7f834b16e640 1 -- 172.21.15.170:0/4127028701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8344106810 msgr2=0x7f834419cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:26.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.410+0000 7f834b16e640 1 --2- 172.21.15.170:0/4127028701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8344106810 0x7f834419cb40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8334031460 tx=0x7f83340045e0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.410+0000 7f834b16e640 1 -- 172.21.15.170:0/4127028701 shutdown_connections 2024-09-04T16:36:26.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.410+0000 7f834b16e640 1 --2- 172.21.15.170:0/4127028701 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f832c079e40 0x7f832c07c300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.410+0000 7f834b16e640 1 --2- 172.21.15.170:0/4127028701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8344106810 0x7f834419cb40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.410+0000 7f834b16e640 1 --2- 172.21.15.170:0/4127028701 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8344100ed0 0x7f834419c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.410+0000 7f834b16e640 1 -- 172.21.15.170:0/4127028701 >> 172.21.15.170:0/4127028701 conn(0x7f83440fbc10 msgr2=0x7f83440fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:26.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.410+0000 7f834b16e640 1 -- 172.21.15.170:0/4127028701 shutdown_connections 2024-09-04T16:36:26.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.410+0000 7f834b16e640 1 -- 172.21.15.170:0/4127028701 wait complete. 2024-09-04T16:36:26.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.503+0000 7ff69a368640 1 -- 172.21.15.170:0/3051805790 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff694106900 msgr2=0x7ff694106ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:26.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.503+0000 7ff69a368640 1 --2- 172.21.15.170:0/3051805790 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff694106900 0x7ff694106ce0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff684009880 tx=0x7ff68402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.503+0000 7ff69a368640 1 -- 172.21.15.170:0/3051805790 shutdown_connections 2024-09-04T16:36:26.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.503+0000 7ff69a368640 1 --2- 172.21.15.170:0/3051805790 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6940ffd20 0x7ff694100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.503+0000 7ff69a368640 1 --2- 172.21.15.170:0/3051805790 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff694106900 0x7ff694106ce0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.503+0000 7ff69a368640 1 -- 172.21.15.170:0/3051805790 >> 172.21.15.170:0/3051805790 conn(0x7ff6940fbc10 msgr2=0x7ff6940fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:26.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.503+0000 7ff69a368640 1 -- 172.21.15.170:0/3051805790 shutdown_connections 2024-09-04T16:36:26.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.503+0000 7ff69a368640 1 -- 172.21.15.170:0/3051805790 wait complete. 2024-09-04T16:36:26.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.504+0000 7ff69a368640 1 Processor -- start 2024-09-04T16:36:26.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.504+0000 7ff69a368640 1 -- start start 2024-09-04T16:36:26.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.504+0000 7ff69a368640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6940ffd20 0x7ff69419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:26.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.504+0000 7ff69a368640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff694106900 0x7ff69419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:26.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.504+0000 7ff69a368640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff69410eea0 con 0x7ff6940ffd20 2024-09-04T16:36:26.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.504+0000 7ff69a368640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff69410ed20 con 0x7ff694106900 2024-09-04T16:36:26.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.504+0000 7ff693fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6940ffd20 0x7ff69419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:26.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.504+0000 7ff693fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6940ffd20 0x7ff69419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60128/0 (socket says 172.21.15.170:60128) 2024-09-04T16:36:26.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.504+0000 7ff693fff640 1 -- 172.21.15.170:0/2139587433 learned_addr learned my addr 172.21.15.170:0/2139587433 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:36:26.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.505+0000 7ff6937fe640 1 --2- 172.21.15.170:0/2139587433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff694106900 0x7ff69419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:26.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.505+0000 7ff693fff640 1 -- 172.21.15.170:0/2139587433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff694106900 msgr2=0x7ff69419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:26.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.505+0000 7ff693fff640 1 --2- 172.21.15.170:0/2139587433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff694106900 0x7ff69419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.505+0000 7ff693fff640 1 -- 172.21.15.170:0/2139587433 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff694197860 con 0x7ff6940ffd20 2024-09-04T16:36:26.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.505+0000 7ff6937fe640 1 --2- 172.21.15.170:0/2139587433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff694106900 0x7ff69419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:36:26.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.505+0000 7ff693fff640 1 --2- 172.21.15.170:0/2139587433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6940ffd20 0x7ff69419d6a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff684031460 tx=0x7ff6840045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:26.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.505+0000 7ff6917fa640 1 -- 172.21.15.170:0/2139587433 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff68403f070 con 0x7ff6940ffd20 2024-09-04T16:36:26.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.505+0000 7ff6917fa640 1 -- 172.21.15.170:0/2139587433 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6840035f0 con 0x7ff6940ffd20 2024-09-04T16:36:26.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.505+0000 7ff69a368640 1 -- 172.21.15.170:0/2139587433 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff694197af0 con 0x7ff6940ffd20 2024-09-04T16:36:26.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.505+0000 7ff6917fa640 1 -- 172.21.15.170:0/2139587433 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff684035030 con 0x7ff6940ffd20 2024-09-04T16:36:26.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.505+0000 7ff69a368640 1 -- 172.21.15.170:0/2139587433 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff694198020 con 0x7ff6940ffd20 2024-09-04T16:36:26.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.506+0000 7ff69a368640 1 -- 172.21.15.170:0/2139587433 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff694103040 con 0x7ff6940ffd20 2024-09-04T16:36:26.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.507+0000 7ff6917fa640 1 -- 172.21.15.170:0/2139587433 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ff684042070 con 0x7ff6940ffd20 2024-09-04T16:36:26.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.508+0000 7ff6917fa640 1 --2- 172.21.15.170:0/2139587433 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff680079e80 0x7ff68007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:26.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.508+0000 7ff6917fa640 1 -- 172.21.15.170:0/2139587433 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7ff6840bd3a0 con 0x7ff6940ffd20 2024-09-04T16:36:26.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.508+0000 7ff6937fe640 1 --2- 172.21.15.170:0/2139587433 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff680079e80 0x7ff68007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:26.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.508+0000 7ff6937fe640 1 --2- 172.21.15.170:0/2139587433 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff680079e80 0x7ff68007c340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0058c0 tx=0x7ff67c005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:26.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.512+0000 7ff6917fa640 1 -- 172.21.15.170:0/2139587433 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff684084ee0 con 0x7ff6940ffd20 2024-09-04T16:36:26.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:26 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1666614068' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:36:26.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:26 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1125344363' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:36:26.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:26 smithi170 ceph-mon[113855]: pgmap v179: 65 pgs: 8 active+undersized, 12 peering, 7 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25/312 objects degraded (8.013%) 2024-09-04T16:36:26.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:26 smithi170 ceph-mon[113855]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:36:26.759 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:26 smithi170 systemd[1]: Starting Ceph osd.2 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:36:26.759 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:26 smithi170 podman[134401]: 2024-09-04 16:36:26.525279731 +0000 UTC m=+0.020448564 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:36:26.759 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:26 smithi170 podman[134401]: 2024-09-04 16:36:26.646327661 +0000 UTC m=+0.141496466 container create 16a54328a33154a596262127f6eba9e54171e66e1289efd7e556aad16253d9dd (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5) 2024-09-04T16:36:26.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.786+0000 7ff69a368640 1 -- 172.21.15.170:0/2139587433 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff694198d90 con 0x7ff6940ffd20 2024-09-04T16:36:26.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.786+0000 7ff6917fa640 1 -- 172.21.15.170:0/2139587433 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1110 (secure 0 0 0) 0x7ff68408d390 con 0x7ff6940ffd20 2024-09-04T16:36:26.787 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Reduced data availability: 2 pgs peering; Degraded data redundancy: 25/312 objects degraded (8.013%), 7 pgs degraded 2024-09-04T16:36:26.787 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:36:26.787 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:36:26.788 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-04T16:36:26.788 INFO:teuthology.orchestra.run.smithi170.stdout: osd.2 (root=default,host=smithi170) is down 2024-09-04T16:36:26.788 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 2 pgs peering 2024-09-04T16:36:26.788 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.c is stuck peering for 4m, current state peering, last acting [3,0] 2024-09-04T16:36:26.788 INFO:teuthology.orchestra.run.smithi170.stdout: pg 3.1e is stuck peering for 4m, current state peering, last acting [3,1] 2024-09-04T16:36:26.788 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 25/312 objects degraded (8.013%), 7 pgs degraded 2024-09-04T16:36:26.788 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-04T16:36:26.788 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-04T16:36:26.788 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-04T16:36:26.788 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-04T16:36:26.788 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-04T16:36:26.788 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-04T16:36:26.788 INFO:teuthology.orchestra.run.smithi170.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-04T16:36:26.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.788+0000 7ff69a368640 1 -- 172.21.15.170:0/2139587433 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff680079e80 msgr2=0x7ff68007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:26.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.788+0000 7ff69a368640 1 --2- 172.21.15.170:0/2139587433 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff680079e80 0x7ff68007c340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0058c0 tx=0x7ff67c005850 comp rx=0 tx=0).stop 2024-09-04T16:36:26.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.789+0000 7ff69a368640 1 -- 172.21.15.170:0/2139587433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6940ffd20 msgr2=0x7ff69419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:26.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.789+0000 7ff69a368640 1 --2- 172.21.15.170:0/2139587433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6940ffd20 0x7ff69419d6a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff684031460 tx=0x7ff6840045e0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.789+0000 7ff69a368640 1 -- 172.21.15.170:0/2139587433 shutdown_connections 2024-09-04T16:36:26.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.789+0000 7ff69a368640 1 --2- 172.21.15.170:0/2139587433 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff680079e80 0x7ff68007c340 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.789+0000 7ff69a368640 1 --2- 172.21.15.170:0/2139587433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff694106900 0x7ff69419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.789+0000 7ff69a368640 1 --2- 172.21.15.170:0/2139587433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6940ffd20 0x7ff69419d6a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:26.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.789+0000 7ff69a368640 1 -- 172.21.15.170:0/2139587433 >> 172.21.15.170:0/2139587433 conn(0x7ff6940fbc10 msgr2=0x7ff6940fc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:26.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.789+0000 7ff69a368640 1 -- 172.21.15.170:0/2139587433 shutdown_connections 2024-09-04T16:36:26.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:26.789+0000 7ff69a368640 1 -- 172.21.15.170:0/2139587433 wait complete. 2024-09-04T16:36:26.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:26 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1666614068' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:36:26.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:26 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1125344363' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:36:26.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:26 smithi193 ceph-mon[82547]: pgmap v179: 65 pgs: 8 active+undersized, 12 peering, 7 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25/312 objects degraded (8.013%) 2024-09-04T16:36:26.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:26 smithi193 ceph-mon[82547]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:36:27.042 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:26 smithi170 podman[134401]: 2024-09-04 16:36:26.911101489 +0000 UTC m=+0.406270297 container init 16a54328a33154a596262127f6eba9e54171e66e1289efd7e556aad16253d9dd (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-04T16:36:27.042 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:26 smithi170 podman[134401]: 2024-09-04 16:36:26.914694507 +0000 UTC m=+0.409863319 container start 16a54328a33154a596262127f6eba9e54171e66e1289efd7e556aad16253d9dd (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-activate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-04T16:36:27.042 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:26 smithi170 podman[134401]: 2024-09-04 16:36:26.999239091 +0000 UTC m=+0.494407913 container attach 16a54328a33154a596262127f6eba9e54171e66e1289efd7e556aad16253d9dd (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-activate, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-04T16:36:27.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:27 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-activate[134434]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:36:27.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:27 smithi170 bash[134401]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:36:27.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:27 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-activate[134434]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:36:27.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:27 smithi170 bash[134401]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:36:27.776 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:27 smithi170 ceph-mon[113855]: Health check failed: Degraded data redundancy: 25/312 objects degraded (8.013%), 7 pgs degraded (PG_DEGRADED) 2024-09-04T16:36:27.776 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:27 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2139587433' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:36:27.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:27 smithi193 ceph-mon[82547]: Health check failed: Degraded data redundancy: 25/312 objects degraded (8.013%), 7 pgs degraded (PG_DEGRADED) 2024-09-04T16:36:27.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:27 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2139587433' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:36:28.061 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:27 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-activate[134434]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-04T16:36:28.062 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:27 smithi170 bash[134401]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-04T16:36:28.062 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:27 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-activate[134434]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-04T16:36:28.062 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:27 smithi170 bash[134401]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-04T16:36:28.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:28 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-activate[134434]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-04T16:36:28.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:28 smithi170 bash[134401]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-04T16:36:28.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:28 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-activate[134434]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-04T16:36:28.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:28 smithi170 bash[134401]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-04T16:36:28.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:28 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-activate[134434]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-04T16:36:28.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:28 smithi170 bash[134401]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-04T16:36:28.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:28 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-activate[134434]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-04T16:36:28.353 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:28 smithi170 bash[134401]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-04T16:36:28.353 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:28 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-activate[134434]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-04T16:36:28.353 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:28 smithi170 bash[134401]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-04T16:36:28.353 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:28 smithi170 podman[134401]: 2024-09-04 16:36:28.090372285 +0000 UTC m=+1.585541091 container died 16a54328a33154a596262127f6eba9e54171e66e1289efd7e556aad16253d9dd (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-activate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS) 2024-09-04T16:36:28.712 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:28 smithi170 ceph-mon[113855]: pgmap v180: 65 pgs: 8 active+undersized, 12 peering, 7 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25/312 objects degraded (8.013%) 2024-09-04T16:36:28.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:28 smithi193 ceph-mon[82547]: pgmap v180: 65 pgs: 8 active+undersized, 12 peering, 7 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25/312 objects degraded (8.013%) 2024-09-04T16:36:29.053 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:28 smithi170 podman[134583]: 2024-09-04 16:36:28.712555477 +0000 UTC m=+0.615913321 container remove 16a54328a33154a596262127f6eba9e54171e66e1289efd7e556aad16253d9dd (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-04T16:36:29.053 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:28 smithi170 podman[134643]: 2024-09-04 16:36:28.8255149 +0000 UTC m=+0.016394352 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:36:29.055 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:28 smithi170 podman[134643]: 2024-09-04 16:36:28.946955342 +0000 UTC m=+0.137834784 container create 50a84942a2f505a3128e3b939267adc38ed14c8ac8f7335849cb1198ac959e04 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-04T16:36:29.602 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:29 smithi170 podman[134643]: 2024-09-04 16:36:29.182862711 +0000 UTC m=+0.373742157 container init 50a84942a2f505a3128e3b939267adc38ed14c8ac8f7335849cb1198ac959e04 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-04T16:36:29.602 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:29 smithi170 podman[134643]: 2024-09-04 16:36:29.186127508 +0000 UTC m=+0.377006950 container start 50a84942a2f505a3128e3b939267adc38ed14c8ac8f7335849cb1198ac959e04 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-04T16:36:29.602 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:29 smithi170 ceph-osd[134662]: -- 172.21.15.170:0/1882431197 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c7f273a1e0 con 0x55c7f26ca000 2024-09-04T16:36:29.602 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:29 smithi170 bash[134643]: 50a84942a2f505a3128e3b939267adc38ed14c8ac8f7335849cb1198ac959e04 2024-09-04T16:36:29.602 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:29 smithi170 systemd[1]: Started Ceph osd.2 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:36:30.226 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:30.227 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:36:30.227 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:30.227 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:30.227 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:36:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:36:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:30.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:30.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:36:31.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:31 smithi170 ceph-mon[113855]: pgmap v181: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-04T16:36:31.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:31 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2[134658]: 2024-09-04T16:36:31.054+0000 7f671938c640 -1 Falling back to public interface 2024-09-04T16:36:31.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:31 smithi193 ceph-mon[82547]: pgmap v181: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-04T16:36:32.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:32 smithi170 ceph-mon[113855]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-04T16:36:32.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:32 smithi170 ceph-mon[113855]: Health check update: Degraded data redundancy: 41/312 objects degraded (13.141%), 13 pgs degraded (PG_DEGRADED) 2024-09-04T16:36:32.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:32 smithi193 ceph-mon[82547]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-04T16:36:32.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:32 smithi193 ceph-mon[82547]: Health check update: Degraded data redundancy: 41/312 objects degraded (13.141%), 13 pgs degraded (PG_DEGRADED) 2024-09-04T16:36:33.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:33 smithi170 ceph-mon[113855]: pgmap v182: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-04T16:36:33.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:33 smithi193 ceph-mon[82547]: pgmap v182: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-04T16:36:35.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:35 smithi170 ceph-mon[113855]: pgmap v183: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-04T16:36:35.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:35 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:35.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:35 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:35.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:35 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:35.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:35 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:35.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:35 smithi193 ceph-mon[82547]: pgmap v183: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-04T16:36:35.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:35 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:35.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:35 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:35.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:35 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:35.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:35 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:36.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:36 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2[134658]: 2024-09-04T16:36:36.059+0000 7f671938c640 -1 osd.2 57 log_to_monitors true 2024-09-04T16:36:36.778 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:36 smithi170 ceph-mon[113855]: from='osd.2 [v2:172.21.15.170:6818/1782260709,v1:172.21.15.170:6819/1782260709]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-04T16:36:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:36 smithi193 ceph-mon[82547]: from='osd.2 [v2:172.21.15.170:6818/1782260709,v1:172.21.15.170:6819/1782260709]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-04T16:36:37.352 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 16:36:37 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2[134658]: 2024-09-04T16:36:37.114+0000 7f670d12e640 -1 osd.2 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-04T16:36:37.696 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:37 smithi170 ceph-mon[113855]: pgmap v184: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-04T16:36:37.697 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:37 smithi170 ceph-mon[113855]: from='osd.2 [v2:172.21.15.170:6818/1782260709,v1:172.21.15.170:6819/1782260709]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-04T16:36:37.697 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:37 smithi170 ceph-mon[113855]: osdmap e60: 6 total, 5 up, 6 in 2024-09-04T16:36:37.697 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:37 smithi170 ceph-mon[113855]: from='osd.2 [v2:172.21.15.170:6818/1782260709,v1:172.21.15.170:6819/1782260709]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]} : dispatch 2024-09-04T16:36:37.697 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:37 smithi170 ceph-mon[113855]: from='osd.2 [v2:172.21.15.170:6818/1782260709,v1:172.21.15.170:6819/1782260709]' entity='osd.2' 2024-09-04T16:36:37.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:37 smithi193 ceph-mon[82547]: pgmap v184: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-04T16:36:37.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:37 smithi193 ceph-mon[82547]: from='osd.2 [v2:172.21.15.170:6818/1782260709,v1:172.21.15.170:6819/1782260709]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-04T16:36:37.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:37 smithi193 ceph-mon[82547]: osdmap e60: 6 total, 5 up, 6 in 2024-09-04T16:36:37.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:37 smithi193 ceph-mon[82547]: from='osd.2 [v2:172.21.15.170:6818/1782260709,v1:172.21.15.170:6819/1782260709]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi170", "root=default"]} : dispatch 2024-09-04T16:36:37.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:37 smithi193 ceph-mon[82547]: from='osd.2 [v2:172.21.15.170:6818/1782260709,v1:172.21.15.170:6819/1782260709]' entity='osd.2' 2024-09-04T16:36:38.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:38 smithi170 ceph-mon[113855]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-04T16:36:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:38 smithi170 ceph-mon[113855]: osd.2 [v2:172.21.15.170:6818/1782260709,v1:172.21.15.170:6819/1782260709] boot 2024-09-04T16:36:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:38 smithi170 ceph-mon[113855]: osdmap e61: 6 total, 6 up, 6 in 2024-09-04T16:36:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:38 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-04T16:36:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:38 smithi193 ceph-mon[82547]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-04T16:36:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:38 smithi193 ceph-mon[82547]: osd.2 [v2:172.21.15.170:6818/1782260709,v1:172.21.15.170:6819/1782260709] boot 2024-09-04T16:36:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:38 smithi193 ceph-mon[82547]: osdmap e61: 6 total, 6 up, 6 in 2024-09-04T16:36:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:38 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-04T16:36:39.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:39 smithi170 ceph-mon[113855]: pgmap v187: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-04T16:36:39.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:39 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:39.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:39 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:39.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:39 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:36:39.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:39 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:36:39.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:39 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:39.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:39 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:36:39.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:39 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:36:39.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:39 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:36:39.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:39 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:36:39.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:39 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-04T16:36:39.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:39 smithi170 ceph-mon[113855]: osdmap e62: 6 total, 6 up, 6 in 2024-09-04T16:36:39.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:39 smithi193 ceph-mon[82547]: pgmap v187: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/312 objects degraded (13.141%) 2024-09-04T16:36:39.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:39 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:39.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:39 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:39.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:39 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:36:39.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:39 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:36:39.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:39 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:39.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:39 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:36:39.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:39 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:36:39.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:39 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:36:39.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:39 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:36:39.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:39 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-04T16:36:39.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:39 smithi193 ceph-mon[82547]: osdmap e62: 6 total, 6 up, 6 in 2024-09-04T16:36:40.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:40 smithi170 ceph-mon[113855]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-04T16:36:40.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:40 smithi170 ceph-mon[113855]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-04T16:36:40.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:40 smithi193 ceph-mon[82547]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-04T16:36:40.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:40 smithi193 ceph-mon[82547]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-04T16:36:41.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:41 smithi170 ceph-mon[113855]: pgmap v189: 65 pgs: 6 active+undersized, 6 active+undersized+degraded, 53 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/312 objects degraded (7.051%) 2024-09-04T16:36:41.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:41 smithi170 ceph-mon[113855]: Health check update: Degraded data redundancy: 22/312 objects degraded (7.051%), 6 pgs degraded (PG_DEGRADED) 2024-09-04T16:36:41.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:41 smithi193 ceph-mon[82547]: pgmap v189: 65 pgs: 6 active+undersized, 6 active+undersized+degraded, 53 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/312 objects degraded (7.051%) 2024-09-04T16:36:41.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:41 smithi193 ceph-mon[82547]: Health check update: Degraded data redundancy: 22/312 objects degraded (7.051%), 6 pgs degraded (PG_DEGRADED) 2024-09-04T16:36:42.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:42 smithi170 ceph-mon[113855]: pgmap v190: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:42.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:42 smithi170 ceph-mon[113855]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/312 objects degraded (7.051%), 6 pgs degraded) 2024-09-04T16:36:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:42 smithi193 ceph-mon[82547]: pgmap v190: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:42 smithi193 ceph-mon[82547]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/312 objects degraded (7.051%), 6 pgs degraded) 2024-09-04T16:36:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:45 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:45 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:36:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:45 smithi170 ceph-mon[113855]: pgmap v191: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:45.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:45 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:45.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:45 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:36:45.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:45 smithi193 ceph-mon[82547]: pgmap v191: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:46.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:46 smithi170 ceph-mon[113855]: pgmap v192: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:46.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:46 smithi193 ceph-mon[82547]: pgmap v192: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:48.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:48 smithi193 ceph-mon[82547]: pgmap v193: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:48.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:48 smithi170 ceph-mon[113855]: pgmap v193: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:50.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:50 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:50 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:51.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:51 smithi170 ceph-mon[113855]: pgmap v194: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:51 smithi193 ceph-mon[82547]: pgmap v194: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:53.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:52 smithi170 ceph-mon[113855]: pgmap v195: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:53.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:52 smithi193 ceph-mon[82547]: pgmap v195: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:54.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:53 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-04T16:36:54.140 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:53 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-04T16:36:55.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:54 smithi170 ceph-mon[113855]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-04T16:36:55.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:54 smithi170 ceph-mon[113855]: Upgrade: osd.3 is safe to restart 2024-09-04T16:36:55.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:54 smithi170 ceph-mon[113855]: pgmap v196: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:55.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:54 smithi193 ceph-mon[82547]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-04T16:36:55.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:54 smithi193 ceph-mon[82547]: Upgrade: osd.3 is safe to restart 2024-09-04T16:36:55.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:54 smithi193 ceph-mon[82547]: pgmap v196: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:56.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:55 smithi170 ceph-mon[113855]: Upgrade: Updating osd.3 2024-09-04T16:36:56.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:55 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:56.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:55 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-04T16:36:56.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:55 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:36:56.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:55 smithi170 ceph-mon[113855]: Deploying daemon osd.3 on smithi193 2024-09-04T16:36:56.360 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:55 smithi193 ceph-mon[82547]: Upgrade: Updating osd.3 2024-09-04T16:36:56.360 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:55 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:36:56.361 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:55 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-04T16:36:56.361 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:55 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:36:56.361 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:55 smithi193 ceph-mon[82547]: Deploying daemon osd.3 on smithi193 2024-09-04T16:36:56.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.881+0000 7f5550305640 1 -- 172.21.15.170:0/2807321039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55481067e0 msgr2=0x7f5548106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:56.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.881+0000 7f5550305640 1 --2- 172.21.15.170:0/2807321039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55481067e0 0x7f5548106bc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5544009880 tx=0x7f554402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:36:56.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.882+0000 7f5550305640 1 -- 172.21.15.170:0/2807321039 shutdown_connections 2024-09-04T16:36:56.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.882+0000 7f5550305640 1 --2- 172.21.15.170:0/2807321039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55481007e0 0x7f5548100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:56.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.882+0000 7f5550305640 1 --2- 172.21.15.170:0/2807321039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55481067e0 0x7f5548106bc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:56.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.882+0000 7f5550305640 1 -- 172.21.15.170:0/2807321039 >> 172.21.15.170:0/2807321039 conn(0x7f55480fc4c0 msgr2=0x7f55480fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:56.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.882+0000 7f5550305640 1 -- 172.21.15.170:0/2807321039 shutdown_connections 2024-09-04T16:36:56.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.882+0000 7f5550305640 1 -- 172.21.15.170:0/2807321039 wait complete. 2024-09-04T16:36:56.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.882+0000 7f5550305640 1 Processor -- start 2024-09-04T16:36:56.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.882+0000 7f5550305640 1 -- start start 2024-09-04T16:36:56.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.883+0000 7f5550305640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55481007e0 0x7f554819d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:56.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.883+0000 7f5550305640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55481067e0 0x7f554819db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:56.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.883+0000 7f5550305640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f554810dc90 con 0x7f55481007e0 2024-09-04T16:36:56.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.883+0000 7f5550305640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f554810db10 con 0x7f55481067e0 2024-09-04T16:36:56.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.883+0000 7f554e0a1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55481007e0 0x7f554819d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:56.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.883+0000 7f554e0a1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55481007e0 0x7f554819d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48912/0 (socket says 172.21.15.170:48912) 2024-09-04T16:36:56.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.883+0000 7f554e0a1640 1 -- 172.21.15.170:0/1288524403 learned_addr learned my addr 172.21.15.170:0/1288524403 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:36:56.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.883+0000 7f554d8a0640 1 --2- 172.21.15.170:0/1288524403 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55481067e0 0x7f554819db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:56.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.883+0000 7f554e0a1640 1 -- 172.21.15.170:0/1288524403 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55481067e0 msgr2=0x7f554819db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:56.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.883+0000 7f554e0a1640 1 --2- 172.21.15.170:0/1288524403 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55481067e0 0x7f554819db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:56.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.883+0000 7f554e0a1640 1 -- 172.21.15.170:0/1288524403 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5548197780 con 0x7f55481007e0 2024-09-04T16:36:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.883+0000 7f554e0a1640 1 --2- 172.21.15.170:0/1288524403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55481007e0 0x7f554819d600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5544031460 tx=0x7f55440045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.884+0000 7f553f7fe640 1 -- 172.21.15.170:0/1288524403 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f554403f070 con 0x7f55481007e0 2024-09-04T16:36:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.884+0000 7f553f7fe640 1 -- 172.21.15.170:0/1288524403 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55440035f0 con 0x7f55481007e0 2024-09-04T16:36:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.884+0000 7f5550305640 1 -- 172.21.15.170:0/1288524403 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5548197a10 con 0x7f55481007e0 2024-09-04T16:36:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.884+0000 7f553f7fe640 1 -- 172.21.15.170:0/1288524403 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5544035030 con 0x7f55481007e0 2024-09-04T16:36:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.884+0000 7f5550305640 1 -- 172.21.15.170:0/1288524403 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5548197f40 con 0x7f55481007e0 2024-09-04T16:36:56.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.885+0000 7f5550305640 1 -- 172.21.15.170:0/1288524403 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5548101f20 con 0x7f55481007e0 2024-09-04T16:36:56.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.885+0000 7f553f7fe640 1 -- 172.21.15.170:0/1288524403 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5544042070 con 0x7f55481007e0 2024-09-04T16:36:56.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.886+0000 7f553f7fe640 1 --2- 172.21.15.170:0/1288524403 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5534079e80 0x7f553407c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:56.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.886+0000 7f554d8a0640 1 --2- 172.21.15.170:0/1288524403 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5534079e80 0x7f553407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:56.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.886+0000 7f553f7fe640 1 -- 172.21.15.170:0/1288524403 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7f55440bd250 con 0x7f55481007e0 2024-09-04T16:36:56.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.887+0000 7f554d8a0640 1 --2- 172.21.15.170:0/1288524403 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5534079e80 0x7f553407c340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f55480ffae0 tx=0x7f553800b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:56.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:56.891+0000 7f553f7fe640 1 -- 172.21.15.170:0/1288524403 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5544088f00 con 0x7f55481007e0 2024-09-04T16:36:57.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.085+0000 7f5550305640 1 -- 172.21.15.170:0/1288524403 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f55481982b0 con 0x7f5534079e80 2024-09-04T16:36:57.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.086+0000 7f553f7fe640 1 -- 172.21.15.170:0/1288524403 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f55481982b0 con 0x7f5534079e80 2024-09-04T16:36:57.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.088+0000 7f5550305640 1 -- 172.21.15.170:0/1288524403 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5534079e80 msgr2=0x7f553407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:57.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.088+0000 7f5550305640 1 --2- 172.21.15.170:0/1288524403 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5534079e80 0x7f553407c340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f55480ffae0 tx=0x7f553800b390 comp rx=0 tx=0).stop 2024-09-04T16:36:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.088+0000 7f5550305640 1 -- 172.21.15.170:0/1288524403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55481007e0 msgr2=0x7f554819d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.088+0000 7f5550305640 1 --2- 172.21.15.170:0/1288524403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55481007e0 0x7f554819d600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5544031460 tx=0x7f55440045e0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.089+0000 7f5550305640 1 -- 172.21.15.170:0/1288524403 shutdown_connections 2024-09-04T16:36:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.089+0000 7f5550305640 1 --2- 172.21.15.170:0/1288524403 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5534079e80 0x7f553407c340 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.089+0000 7f5550305640 1 --2- 172.21.15.170:0/1288524403 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55481067e0 0x7f554819db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.089+0000 7f5550305640 1 --2- 172.21.15.170:0/1288524403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55481007e0 0x7f554819d600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.089+0000 7f5550305640 1 -- 172.21.15.170:0/1288524403 >> 172.21.15.170:0/1288524403 conn(0x7f55480fc4c0 msgr2=0x7f5548069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.089+0000 7f5550305640 1 -- 172.21.15.170:0/1288524403 shutdown_connections 2024-09-04T16:36:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.089+0000 7f5550305640 1 -- 172.21.15.170:0/1288524403 wait complete. 2024-09-04T16:36:57.099 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:36:57.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.172+0000 7f9b6f496640 1 -- 172.21.15.170:0/1787316334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b68107930 msgr2=0x7f9b68107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:57.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.172+0000 7f9b6f496640 1 --2- 172.21.15.170:0/1787316334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b68107930 0x7f9b68107d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009880 tx=0x7f9b6402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:56 smithi170 ceph-mon[113855]: pgmap v197: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:57.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.172+0000 7f9b6f496640 1 -- 172.21.15.170:0/1787316334 shutdown_connections 2024-09-04T16:36:57.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.172+0000 7f9b6f496640 1 --2- 172.21.15.170:0/1787316334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b68101930 0x7f9b68101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.172+0000 7f9b6f496640 1 --2- 172.21.15.170:0/1787316334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b68107930 0x7f9b68107d10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.172+0000 7f9b6f496640 1 -- 172.21.15.170:0/1787316334 >> 172.21.15.170:0/1787316334 conn(0x7f9b680fd630 msgr2=0x7f9b680ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:57.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.172+0000 7f9b6f496640 1 -- 172.21.15.170:0/1787316334 shutdown_connections 2024-09-04T16:36:57.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.172+0000 7f9b6f496640 1 -- 172.21.15.170:0/1787316334 wait complete. 2024-09-04T16:36:57.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.173+0000 7f9b6f496640 1 Processor -- start 2024-09-04T16:36:57.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.173+0000 7f9b6f496640 1 -- start start 2024-09-04T16:36:57.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.173+0000 7f9b6f496640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b68101930 0x7f9b6819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:57.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.173+0000 7f9b6f496640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b68107930 0x7f9b6819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:57.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.173+0000 7f9b6f496640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9b6810ede0 con 0x7f9b68101930 2024-09-04T16:36:57.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.173+0000 7f9b6f496640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9b6810ec60 con 0x7f9b68107930 2024-09-04T16:36:57.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.173+0000 7f9b6d232640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b68101930 0x7f9b6819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:57.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.174+0000 7f9b6d232640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b68101930 0x7f9b6819d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48928/0 (socket says 172.21.15.170:48928) 2024-09-04T16:36:57.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.174+0000 7f9b6d232640 1 -- 172.21.15.170:0/2832860713 learned_addr learned my addr 172.21.15.170:0/2832860713 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:36:57.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.174+0000 7f9b6ca31640 1 --2- 172.21.15.170:0/2832860713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b68107930 0x7f9b6819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:57.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.174+0000 7f9b6d232640 1 -- 172.21.15.170:0/2832860713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b68107930 msgr2=0x7f9b6819dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:57.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.174+0000 7f9b6d232640 1 --2- 172.21.15.170:0/2832860713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b68107930 0x7f9b6819dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.174+0000 7f9b6d232640 1 -- 172.21.15.170:0/2832860713 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b68197810 con 0x7f9b68101930 2024-09-04T16:36:57.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.174+0000 7f9b6ca31640 1 --2- 172.21.15.170:0/2832860713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b68107930 0x7f9b6819dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:36:57.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.174+0000 7f9b6d232640 1 --2- 172.21.15.170:0/2832860713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b68101930 0x7f9b6819d690 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9b64031460 tx=0x7f9b640045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:57.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.174+0000 7f9b5e7fc640 1 -- 172.21.15.170:0/2832860713 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b6403f070 con 0x7f9b68101930 2024-09-04T16:36:57.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.174+0000 7f9b5e7fc640 1 -- 172.21.15.170:0/2832860713 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9b640035f0 con 0x7f9b68101930 2024-09-04T16:36:57.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.174+0000 7f9b5e7fc640 1 -- 172.21.15.170:0/2832860713 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b64035030 con 0x7f9b68101930 2024-09-04T16:36:57.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.174+0000 7f9b6f496640 1 -- 172.21.15.170:0/2832860713 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b68197aa0 con 0x7f9b68101930 2024-09-04T16:36:57.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.174+0000 7f9b6f496640 1 -- 172.21.15.170:0/2832860713 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b68197fd0 con 0x7f9b68101930 2024-09-04T16:36:57.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.175+0000 7f9b6f496640 1 -- 172.21.15.170:0/2832860713 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b68103070 con 0x7f9b68101930 2024-09-04T16:36:57.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.176+0000 7f9b5e7fc640 1 -- 172.21.15.170:0/2832860713 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f9b64042070 con 0x7f9b68101930 2024-09-04T16:36:57.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.177+0000 7f9b5e7fc640 1 --2- 172.21.15.170:0/2832860713 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b54079e30 0x7f9b5407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:57.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.177+0000 7f9b5e7fc640 1 -- 172.21.15.170:0/2832860713 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7f9b640bd300 con 0x7f9b68101930 2024-09-04T16:36:57.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.177+0000 7f9b6ca31640 1 --2- 172.21.15.170:0/2832860713 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b54079e30 0x7f9b5407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:57.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.177+0000 7f9b6ca31640 1 --2- 172.21.15.170:0/2832860713 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b54079e30 0x7f9b5407c2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9b68100d40 tx=0x7f9b5800b410 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:57.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.181+0000 7f9b5e7fc640 1 -- 172.21.15.170:0/2832860713 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9b64088f30 con 0x7f9b68101930 2024-09-04T16:36:57.257 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:56 smithi193 ceph-mon[82547]: pgmap v197: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:57.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.376+0000 7f9b6f496640 1 -- 172.21.15.170:0/2832860713 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9b68198280 con 0x7f9b54079e30 2024-09-04T16:36:57.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.377+0000 7f9b5e7fc640 1 -- 172.21.15.170:0/2832860713 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f9b68198280 con 0x7f9b54079e30 2024-09-04T16:36:57.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.379+0000 7f9b6f496640 1 -- 172.21.15.170:0/2832860713 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b54079e30 msgr2=0x7f9b5407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:57.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.379+0000 7f9b6f496640 1 --2- 172.21.15.170:0/2832860713 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b54079e30 0x7f9b5407c2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9b68100d40 tx=0x7f9b5800b410 comp rx=0 tx=0).stop 2024-09-04T16:36:57.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.379+0000 7f9b6f496640 1 -- 172.21.15.170:0/2832860713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b68101930 msgr2=0x7f9b6819d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:57.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.379+0000 7f9b6f496640 1 --2- 172.21.15.170:0/2832860713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b68101930 0x7f9b6819d690 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9b64031460 tx=0x7f9b640045e0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.379+0000 7f9b6f496640 1 -- 172.21.15.170:0/2832860713 shutdown_connections 2024-09-04T16:36:57.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.379+0000 7f9b6f496640 1 --2- 172.21.15.170:0/2832860713 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b54079e30 0x7f9b5407c2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.379+0000 7f9b6f496640 1 --2- 172.21.15.170:0/2832860713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b68107930 0x7f9b6819dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.379+0000 7f9b6f496640 1 --2- 172.21.15.170:0/2832860713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b68101930 0x7f9b6819d690 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.379+0000 7f9b6f496640 1 -- 172.21.15.170:0/2832860713 >> 172.21.15.170:0/2832860713 conn(0x7f9b680fd630 msgr2=0x7f9b680fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:57.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.379+0000 7f9b6f496640 1 -- 172.21.15.170:0/2832860713 shutdown_connections 2024-09-04T16:36:57.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.379+0000 7f9b6f496640 1 -- 172.21.15.170:0/2832860713 wait complete. 2024-09-04T16:36:57.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.461+0000 7f8d69cd3640 1 -- 172.21.15.170:0/3375087149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d64102aa0 msgr2=0x7f8d64102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:57.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.461+0000 7f8d69cd3640 1 --2- 172.21.15.170:0/3375087149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d64102aa0 0x7f8d64102e80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009880 tx=0x7f8d5402a530 comp rx=0 tx=0).stop 2024-09-04T16:36:57.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.461+0000 7f8d69cd3640 1 -- 172.21.15.170:0/3375087149 shutdown_connections 2024-09-04T16:36:57.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.461+0000 7f8d69cd3640 1 --2- 172.21.15.170:0/3375087149 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d641033c0 0x7f8d6410b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.461+0000 7f8d69cd3640 1 --2- 172.21.15.170:0/3375087149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d64102aa0 0x7f8d64102e80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.461+0000 7f8d69cd3640 1 -- 172.21.15.170:0/3375087149 >> 172.21.15.170:0/3375087149 conn(0x7f8d640fc4c0 msgr2=0x7f8d640fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:57.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.461+0000 7f8d69cd3640 1 -- 172.21.15.170:0/3375087149 shutdown_connections 2024-09-04T16:36:57.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.461+0000 7f8d69cd3640 1 -- 172.21.15.170:0/3375087149 wait complete. 2024-09-04T16:36:57.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.462+0000 7f8d69cd3640 1 Processor -- start 2024-09-04T16:36:57.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.462+0000 7f8d69cd3640 1 -- start start 2024-09-04T16:36:57.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.462+0000 7f8d69cd3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d64102aa0 0x7f8d6419d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:57.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.462+0000 7f8d69cd3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d641033c0 0x7f8d6419dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:57.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.462+0000 7f8d69cd3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6410edd0 con 0x7f8d64102aa0 2024-09-04T16:36:57.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.462+0000 7f8d69cd3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6410ec50 con 0x7f8d641033c0 2024-09-04T16:36:57.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.462+0000 7f8d637fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d64102aa0 0x7f8d6419d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:57.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.462+0000 7f8d637fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d64102aa0 0x7f8d6419d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48944/0 (socket says 172.21.15.170:48944) 2024-09-04T16:36:57.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.462+0000 7f8d637fe640 1 -- 172.21.15.170:0/1435965830 learned_addr learned my addr 172.21.15.170:0/1435965830 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:36:57.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.462+0000 7f8d62ffd640 1 --2- 172.21.15.170:0/1435965830 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d641033c0 0x7f8d6419dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:57.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.463+0000 7f8d62ffd640 1 -- 172.21.15.170:0/1435965830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d64102aa0 msgr2=0x7f8d6419d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:57.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.463+0000 7f8d62ffd640 1 --2- 172.21.15.170:0/1435965830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d64102aa0 0x7f8d6419d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.463+0000 7f8d62ffd640 1 -- 172.21.15.170:0/1435965830 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d64197900 con 0x7f8d641033c0 2024-09-04T16:36:57.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.463+0000 7f8d62ffd640 1 --2- 172.21.15.170:0/1435965830 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d641033c0 0x7f8d6419dc80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800e740 tx=0x7f8d5800ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:57.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.463+0000 7f8d60ff9640 1 -- 172.21.15.170:0/1435965830 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d5800ee50 con 0x7f8d641033c0 2024-09-04T16:36:57.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.463+0000 7f8d60ff9640 1 -- 172.21.15.170:0/1435965830 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d58004030 con 0x7f8d641033c0 2024-09-04T16:36:57.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.463+0000 7f8d60ff9640 1 -- 172.21.15.170:0/1435965830 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d580047a0 con 0x7f8d641033c0 2024-09-04T16:36:57.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.463+0000 7f8d69cd3640 1 -- 172.21.15.170:0/1435965830 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d64197bf0 con 0x7f8d641033c0 2024-09-04T16:36:57.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.463+0000 7f8d69cd3640 1 -- 172.21.15.170:0/1435965830 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d64198180 con 0x7f8d641033c0 2024-09-04T16:36:57.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.464+0000 7f8d69cd3640 1 -- 172.21.15.170:0/1435965830 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6406a410 con 0x7f8d641033c0 2024-09-04T16:36:57.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.465+0000 7f8d60ff9640 1 -- 172.21.15.170:0/1435965830 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f8d580041e0 con 0x7f8d641033c0 2024-09-04T16:36:57.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.465+0000 7f8d60ff9640 1 --2- 172.21.15.170:0/1435965830 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d4c079e80 0x7f8d4c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:57.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.465+0000 7f8d637fe640 1 --2- 172.21.15.170:0/1435965830 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d4c079e80 0x7f8d4c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:57.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.465+0000 7f8d60ff9640 1 -- 172.21.15.170:0/1435965830 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7f8d5809cd60 con 0x7f8d641033c0 2024-09-04T16:36:57.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.466+0000 7f8d637fe640 1 --2- 172.21.15.170:0/1435965830 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d4c079e80 0x7f8d4c07c340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009230 tx=0x7f8d540058d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:57.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.470+0000 7f8d60ff9640 1 -- 172.21.15.170:0/1435965830 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8d580a1070 con 0x7f8d641033c0 2024-09-04T16:36:57.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.652+0000 7f8d69cd3640 1 -- 172.21.15.170:0/1435965830 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8d64105fe0 con 0x7f8d4c079e80 2024-09-04T16:36:57.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.662+0000 7f8d60ff9640 1 -- 172.21.15.170:0/1435965830 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f8d54004340 con 0x7f8d4c079e80 2024-09-04T16:36:57.662 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:36:57.662 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (3m) 23s ago 14m 21.0M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:36:57.663 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (7m) 23s ago 14m 9126k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:36:57.663 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (6m) 118s ago 14m 8326k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:36:57.663 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (2m) 23s ago 14m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:36:57.663 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (2m) 118s ago 14m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:36:57.663 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (3m) 23s ago 14m 79.4M - c8b91775d855 6e3778aab5e6 2024-09-04T16:36:57.663 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (9m) 23s ago 9m 27.1M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:36:57.663 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (9m) 23s ago 9m 145M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:36:57.663 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (9m) 118s ago 9m 16.9M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:36:57.663 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (9m) 118s ago 9m 16.5M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:36:57.663 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (6m) 23s ago 16m 525M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:36:57.663 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (5m) 118s ago 13m 456M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:36:57.663 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (2m) 23s ago 16m 41.9M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:36:57.663 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (2m) 118s ago 13m 25.2M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:36:57.664 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (4m) 23s ago 14m 10.8M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:36:57.664 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (4m) 118s ago 13m 12.5M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:36:57.664 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (100s) 23s ago 12m 83.2M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:36:57.664 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (64s) 23s ago 12m 86.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:36:57.664 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (28s) 23s ago 11m 11.2M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:36:57.664 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (11m) 118s ago 11m 249M 2240M 19.1.1-252-g48920dab b708f9119ac7 67e8a25b6599 2024-09-04T16:36:57.664 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (10m) 118s ago 10m 210M 2240M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:36:57.664 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (10m) 118s ago 10m 191M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:36:57.664 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (4m) 23s ago 14m 53.8M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:36:57.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.664+0000 7f8d69cd3640 1 -- 172.21.15.170:0/1435965830 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d4c079e80 msgr2=0x7f8d4c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:57.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.664+0000 7f8d69cd3640 1 --2- 172.21.15.170:0/1435965830 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d4c079e80 0x7f8d4c07c340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009230 tx=0x7f8d540058d0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.664+0000 7f8d69cd3640 1 -- 172.21.15.170:0/1435965830 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d641033c0 msgr2=0x7f8d6419dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:57.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.664+0000 7f8d69cd3640 1 --2- 172.21.15.170:0/1435965830 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d641033c0 0x7f8d6419dc80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800e740 tx=0x7f8d5800ec00 comp rx=0 tx=0).stop 2024-09-04T16:36:57.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.664+0000 7f8d69cd3640 1 -- 172.21.15.170:0/1435965830 shutdown_connections 2024-09-04T16:36:57.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.664+0000 7f8d69cd3640 1 --2- 172.21.15.170:0/1435965830 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d4c079e80 0x7f8d4c07c340 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.664+0000 7f8d69cd3640 1 --2- 172.21.15.170:0/1435965830 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d641033c0 0x7f8d6419dc80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.664+0000 7f8d69cd3640 1 --2- 172.21.15.170:0/1435965830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d64102aa0 0x7f8d6419d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.664+0000 7f8d69cd3640 1 -- 172.21.15.170:0/1435965830 >> 172.21.15.170:0/1435965830 conn(0x7f8d640fc4c0 msgr2=0x7f8d64108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:57.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.664+0000 7f8d69cd3640 1 -- 172.21.15.170:0/1435965830 shutdown_connections 2024-09-04T16:36:57.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.664+0000 7f8d69cd3640 1 -- 172.21.15.170:0/1435965830 wait complete. 2024-09-04T16:36:57.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.745+0000 7fa7d85df640 1 -- 172.21.15.170:0/287905543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7d0100820 msgr2=0x7fa7d0100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:57.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.745+0000 7fa7d85df640 1 --2- 172.21.15.170:0/287905543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7d0100820 0x7fa7d0100c80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009880 tx=0x7fa7c402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.745+0000 7fa7d85df640 1 -- 172.21.15.170:0/287905543 shutdown_connections 2024-09-04T16:36:57.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.745+0000 7fa7d85df640 1 --2- 172.21.15.170:0/287905543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7d0100820 0x7fa7d0100c80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.745+0000 7fa7d85df640 1 --2- 172.21.15.170:0/287905543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7d0106820 0x7fa7d0106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.745+0000 7fa7d85df640 1 -- 172.21.15.170:0/287905543 >> 172.21.15.170:0/287905543 conn(0x7fa7d00fc520 msgr2=0x7fa7d00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:57.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.745+0000 7fa7d85df640 1 -- 172.21.15.170:0/287905543 shutdown_connections 2024-09-04T16:36:57.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.745+0000 7fa7d85df640 1 -- 172.21.15.170:0/287905543 wait complete. 2024-09-04T16:36:57.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.746+0000 7fa7d85df640 1 Processor -- start 2024-09-04T16:36:57.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.746+0000 7fa7d85df640 1 -- start start 2024-09-04T16:36:57.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.746+0000 7fa7d85df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7d0100820 0x7fa7d0198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:57.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.746+0000 7fa7d85df640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7d0106820 0x7fa7d0198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:57.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.746+0000 7fa7d85df640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d010dcf0 con 0x7fa7d0106820 2024-09-04T16:36:57.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.746+0000 7fa7d85df640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d010db70 con 0x7fa7d0100820 2024-09-04T16:36:57.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.746+0000 7fa7d5b7a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7d0106820 0x7fa7d0198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:57.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.746+0000 7fa7d637b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7d0100820 0x7fa7d0198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:57.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.746+0000 7fa7d637b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7d0100820 0x7fa7d0198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.170:32784/0 (socket says 172.21.15.170:32784) 2024-09-04T16:36:57.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.746+0000 7fa7d637b640 1 -- 172.21.15.170:0/3773948691 learned_addr learned my addr 172.21.15.170:0/3773948691 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:36:57.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.746+0000 7fa7d637b640 1 -- 172.21.15.170:0/3773948691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7d0106820 msgr2=0x7fa7d0198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:57.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.746+0000 7fa7d637b640 1 --2- 172.21.15.170:0/3773948691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7d0106820 0x7fa7d0198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:57.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.746+0000 7fa7d637b640 1 -- 172.21.15.170:0/3773948691 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d0199340 con 0x7fa7d0100820 2024-09-04T16:36:57.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.747+0000 7fa7d637b640 1 --2- 172.21.15.170:0/3773948691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7d0100820 0x7fa7d0198800 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800e970 tx=0x7fa7c800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:57.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.747+0000 7fa7cf7fe640 1 -- 172.21.15.170:0/3773948691 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7c800cac0 con 0x7fa7d0100820 2024-09-04T16:36:57.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.747+0000 7fa7cf7fe640 1 -- 172.21.15.170:0/3773948691 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa7c80054e0 con 0x7fa7d0100820 2024-09-04T16:36:57.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.747+0000 7fa7cf7fe640 1 -- 172.21.15.170:0/3773948691 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7c8010430 con 0x7fa7d0100820 2024-09-04T16:36:57.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.747+0000 7fa7d85df640 1 -- 172.21.15.170:0/3773948691 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d0199630 con 0x7fa7d0100820 2024-09-04T16:36:57.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.747+0000 7fa7d85df640 1 -- 172.21.15.170:0/3773948691 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d01a1c30 con 0x7fa7d0100820 2024-09-04T16:36:57.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.748+0000 7fa7d85df640 1 -- 172.21.15.170:0/3773948691 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d0101f60 con 0x7fa7d0100820 2024-09-04T16:36:57.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.749+0000 7fa7cf7fe640 1 -- 172.21.15.170:0/3773948691 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fa7c8004f00 con 0x7fa7d0100820 2024-09-04T16:36:57.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.750+0000 7fa7cf7fe640 1 --2- 172.21.15.170:0/3773948691 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa7b8079e80 0x7fa7b807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:57.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.750+0000 7fa7d5b7a640 1 --2- 172.21.15.170:0/3773948691 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa7b8079e80 0x7fa7b807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:57.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.750+0000 7fa7cf7fe640 1 -- 172.21.15.170:0/3773948691 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7fa7c809cf90 con 0x7fa7d0100820 2024-09-04T16:36:57.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.750+0000 7fa7d5b7a640 1 --2- 172.21.15.170:0/3773948691 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa7b8079e80 0x7fa7b807c340 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa7d006ae50 tx=0x7fa7c4031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:57.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:57.754+0000 7fa7cf7fe640 1 -- 172.21.15.170:0/3773948691 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa7d0199630 con 0x7fa7d0100820 2024-09-04T16:36:58.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.000+0000 7fa7d85df640 1 -- 172.21.15.170:0/3773948691 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa7d0108d90 con 0x7fa7d0100820 2024-09-04T16:36:58.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:57 smithi170 ceph-mon[113855]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:36:58.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:57 smithi170 ceph-mon[113855]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:36:58.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.000+0000 7fa7cf7fe640 1 -- 172.21.15.170:0/3773948691 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fa7c8064ad0 con 0x7fa7d0100820 2024-09-04T16:36:58.001 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:36:58.001 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:36:58.001 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:36:58.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:36:58.002 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:36:58.002 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:36:58.002 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:36:58.002 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:36:58.002 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 3, 2024-09-04T16:36:58.002 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 3 2024-09-04T16:36:58.002 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:36:58.002 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:36:58.002 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:36:58.002 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:36:58.002 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:36:58.002 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 7, 2024-09-04T16:36:58.002 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 7 2024-09-04T16:36:58.002 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:36:58.003 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:36:58.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.002+0000 7fa7d85df640 1 -- 172.21.15.170:0/3773948691 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa7b8079e80 msgr2=0x7fa7b807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:58.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.002+0000 7fa7d85df640 1 --2- 172.21.15.170:0/3773948691 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa7b8079e80 0x7fa7b807c340 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa7d006ae50 tx=0x7fa7c4031400 comp rx=0 tx=0).stop 2024-09-04T16:36:58.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.002+0000 7fa7d85df640 1 -- 172.21.15.170:0/3773948691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7d0100820 msgr2=0x7fa7d0198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:58.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.002+0000 7fa7d85df640 1 --2- 172.21.15.170:0/3773948691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7d0100820 0x7fa7d0198800 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800e970 tx=0x7fa7c800ed70 comp rx=0 tx=0).stop 2024-09-04T16:36:58.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.002+0000 7fa7d85df640 1 -- 172.21.15.170:0/3773948691 shutdown_connections 2024-09-04T16:36:58.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.002+0000 7fa7d85df640 1 --2- 172.21.15.170:0/3773948691 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa7b8079e80 0x7fa7b807c340 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.002+0000 7fa7d85df640 1 --2- 172.21.15.170:0/3773948691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7d0106820 0x7fa7d0198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.002+0000 7fa7d85df640 1 --2- 172.21.15.170:0/3773948691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7d0100820 0x7fa7d0198800 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.002+0000 7fa7d85df640 1 -- 172.21.15.170:0/3773948691 >> 172.21.15.170:0/3773948691 conn(0x7fa7d00fc520 msgr2=0x7fa7d00fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:58.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.003+0000 7fa7d85df640 1 -- 172.21.15.170:0/3773948691 shutdown_connections 2024-09-04T16:36:58.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.003+0000 7fa7d85df640 1 -- 172.21.15.170:0/3773948691 wait complete. 2024-09-04T16:36:58.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.083+0000 7fef98c6e640 1 -- 172.21.15.170:0/1397125333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef94074620 msgr2=0x7fef94074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:58.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.083+0000 7fef98c6e640 1 --2- 172.21.15.170:0/1397125333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef94074620 0x7fef94074a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef84009c20 tx=0x7fef8402aa00 comp rx=0 tx=0).stop 2024-09-04T16:36:58.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.084+0000 7fef98c6e640 1 -- 172.21.15.170:0/1397125333 shutdown_connections 2024-09-04T16:36:58.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.084+0000 7fef98c6e640 1 --2- 172.21.15.170:0/1397125333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef94074f40 0x7fef9410dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.084+0000 7fef98c6e640 1 --2- 172.21.15.170:0/1397125333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef94074620 0x7fef94074a00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.084+0000 7fef98c6e640 1 -- 172.21.15.170:0/1397125333 >> 172.21.15.170:0/1397125333 conn(0x7fef940fd5f0 msgr2=0x7fef940ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:58.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.084+0000 7fef98c6e640 1 -- 172.21.15.170:0/1397125333 shutdown_connections 2024-09-04T16:36:58.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.084+0000 7fef98c6e640 1 -- 172.21.15.170:0/1397125333 wait complete. 2024-09-04T16:36:58.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.084+0000 7fef98c6e640 1 Processor -- start 2024-09-04T16:36:58.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.084+0000 7fef98c6e640 1 -- start start 2024-09-04T16:36:58.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.085+0000 7fef98c6e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef94074620 0x7fef9419f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:58.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.085+0000 7fef98c6e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef94074f40 0x7fef9419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:58.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.085+0000 7fef98c6e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fef94111000 con 0x7fef94074f40 2024-09-04T16:36:58.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.085+0000 7fef98c6e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fef94110e80 con 0x7fef94074620 2024-09-04T16:36:58.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.085+0000 7fef91d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef94074f40 0x7fef9419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:58.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.085+0000 7fef91d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef94074f40 0x7fef9419fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48980/0 (socket says 172.21.15.170:48980) 2024-09-04T16:36:58.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.085+0000 7fef91d9b640 1 -- 172.21.15.170:0/1883552432 learned_addr learned my addr 172.21.15.170:0/1883552432 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:36:58.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.085+0000 7fef9259c640 1 --2- 172.21.15.170:0/1883552432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef94074620 0x7fef9419f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:58.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.085+0000 7fef91d9b640 1 -- 172.21.15.170:0/1883552432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef94074620 msgr2=0x7fef9419f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:58.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.085+0000 7fef91d9b640 1 --2- 172.21.15.170:0/1883552432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef94074620 0x7fef9419f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.085+0000 7fef91d9b640 1 -- 172.21.15.170:0/1883552432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef941999f0 con 0x7fef94074f40 2024-09-04T16:36:58.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.085+0000 7fef91d9b640 1 --2- 172.21.15.170:0/1883552432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef94074f40 0x7fef9419fd70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00e970 tx=0x7fef7c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:58.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.085+0000 7fef8b7fe640 1 -- 172.21.15.170:0/1883552432 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef7c00cac0 con 0x7fef94074f40 2024-09-04T16:36:58.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.085+0000 7fef8b7fe640 1 -- 172.21.15.170:0/1883552432 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fef7c0054e0 con 0x7fef94074f40 2024-09-04T16:36:58.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.085+0000 7fef98c6e640 1 -- 172.21.15.170:0/1883552432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef94199ce0 con 0x7fef94074f40 2024-09-04T16:36:58.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.085+0000 7fef8b7fe640 1 -- 172.21.15.170:0/1883552432 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef7c010430 con 0x7fef94074f40 2024-09-04T16:36:58.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.086+0000 7fef98c6e640 1 -- 172.21.15.170:0/1883552432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef9419a270 con 0x7fef94074f40 2024-09-04T16:36:58.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.086+0000 7fef98c6e640 1 -- 172.21.15.170:0/1883552432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef94075cd0 con 0x7fef94074f40 2024-09-04T16:36:58.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.087+0000 7fef8b7fe640 1 -- 172.21.15.170:0/1883552432 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fef7c004e80 con 0x7fef94074f40 2024-09-04T16:36:58.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.088+0000 7fef8b7fe640 1 --2- 172.21.15.170:0/1883552432 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fef80079e40 0x7fef8007c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:58.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.088+0000 7fef8b7fe640 1 -- 172.21.15.170:0/1883552432 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7fef7c09d020 con 0x7fef94074f40 2024-09-04T16:36:58.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.088+0000 7fef9259c640 1 --2- 172.21.15.170:0/1883552432 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fef80079e40 0x7fef8007c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:58.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.088+0000 7fef9259c640 1 --2- 172.21.15.170:0/1883552432 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fef80079e40 0x7fef8007c300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fef84009430 tx=0x7fef8403a040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:58.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.092+0000 7fef8b7fe640 1 -- 172.21.15.170:0/1883552432 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fef7c064ae0 con 0x7fef94074f40 2024-09-04T16:36:58.254 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:57 smithi193 ceph-mon[82547]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:36:58.254 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:57 smithi193 ceph-mon[82547]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:36:58.254 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:36:58 smithi193 systemd[1]: Stopping Ceph osd.3 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:36:58.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.304+0000 7fef98c6e640 1 -- 172.21.15.170:0/1883552432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fef9419af20 con 0x7fef94074f40 2024-09-04T16:36:58.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.305+0000 7fef8b7fe640 1 -- 172.21.15.170:0/1883552432 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2036 (secure 0 0 0) 0x7fef7c068c50 con 0x7fef94074f40 2024-09-04T16:36:58.306 INFO:teuthology.orchestra.run.smithi170.stdout:e15 2024-09-04T16:36:58.306 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:27:39:151187+0000 2024-09-04T16:36:58.306 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:36:58.306 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:36:58.306 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:36:58.306 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:36:58.306 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:36:58.306 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:36:58.306 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 15 2024-09-04T16:36:58.306 INFO:teuthology.orchestra.run.smithi170.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-04T16:36:58.307 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:36:58.307 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:27:39.151182+0000 2024-09-04T16:36:58.307 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:36:58.307 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:36:58.307 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:36:58.307 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:36:58.307 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:36:58.307 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:36:58.307 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:36:58.307 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:36:58.307 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 45 2024-09-04T16:36:58.307 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:36:58.307 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:36:58.308 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:36:58.308 INFO:teuthology.orchestra.run.smithi170.stdout:up {0=14562,1=14578} 2024-09-04T16:36:58.308 INFO:teuthology.orchestra.run.smithi170.stdout:failed 2024-09-04T16:36:58.308 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:36:58.308 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:36:58.308 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:36:58.308 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:36:58.308 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:36:58.308 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:36:58.308 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:36:58.308 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:36:58.308 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 14562 members: 14562,14578 2024-09-04T16:36:58.308 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{0:14562} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:36:58.309 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{1:14578} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:36:58.309 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:36:58.309 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:36:58.309 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:36:58.309 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:36:58.309 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:24315} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.193:6826/288890560,v1:172.21.15.193:6827/288890560] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:36:58.309 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:24319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1128257367,v1:172.21.15.193:6825/1128257367] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:36:58.310 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 15 2024-09-04T16:36:58.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.307+0000 7fef98c6e640 1 -- 172.21.15.170:0/1883552432 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fef80079e40 msgr2=0x7fef8007c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:58.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.307+0000 7fef98c6e640 1 --2- 172.21.15.170:0/1883552432 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fef80079e40 0x7fef8007c300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fef84009430 tx=0x7fef8403a040 comp rx=0 tx=0).stop 2024-09-04T16:36:58.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.307+0000 7fef98c6e640 1 -- 172.21.15.170:0/1883552432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef94074f40 msgr2=0x7fef9419fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:58.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.307+0000 7fef98c6e640 1 --2- 172.21.15.170:0/1883552432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef94074f40 0x7fef9419fd70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00e970 tx=0x7fef7c00ed70 comp rx=0 tx=0).stop 2024-09-04T16:36:58.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.307+0000 7fef98c6e640 1 -- 172.21.15.170:0/1883552432 shutdown_connections 2024-09-04T16:36:58.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.307+0000 7fef98c6e640 1 --2- 172.21.15.170:0/1883552432 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fef80079e40 0x7fef8007c300 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.307+0000 7fef98c6e640 1 --2- 172.21.15.170:0/1883552432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef94074f40 0x7fef9419fd70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.307+0000 7fef98c6e640 1 --2- 172.21.15.170:0/1883552432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef94074620 0x7fef9419f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.307+0000 7fef98c6e640 1 -- 172.21.15.170:0/1883552432 >> 172.21.15.170:0/1883552432 conn(0x7fef940fd5f0 msgr2=0x7fef9410b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:58.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.308+0000 7fef98c6e640 1 -- 172.21.15.170:0/1883552432 shutdown_connections 2024-09-04T16:36:58.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.308+0000 7fef98c6e640 1 -- 172.21.15.170:0/1883552432 wait complete. 2024-09-04T16:36:58.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.390+0000 7fd729150640 1 -- 172.21.15.170:0/210907710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd724100820 msgr2=0x7fd724100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:58.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.390+0000 7fd729150640 1 --2- 172.21.15.170:0/210907710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd724100820 0x7fd724100c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009880 tx=0x7fd70c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.390+0000 7fd729150640 1 -- 172.21.15.170:0/210907710 shutdown_connections 2024-09-04T16:36:58.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.390+0000 7fd729150640 1 --2- 172.21.15.170:0/210907710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd724100820 0x7fd724100c80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.390+0000 7fd729150640 1 --2- 172.21.15.170:0/210907710 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd724106820 0x7fd724106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.390+0000 7fd729150640 1 -- 172.21.15.170:0/210907710 >> 172.21.15.170:0/210907710 conn(0x7fd7240fc520 msgr2=0x7fd7240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:58.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.390+0000 7fd729150640 1 -- 172.21.15.170:0/210907710 shutdown_connections 2024-09-04T16:36:58.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.390+0000 7fd729150640 1 -- 172.21.15.170:0/210907710 wait complete. 2024-09-04T16:36:58.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.391+0000 7fd729150640 1 Processor -- start 2024-09-04T16:36:58.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.391+0000 7fd729150640 1 -- start start 2024-09-04T16:36:58.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd729150640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd724100820 0x7fd72419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:58.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd729150640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd724106820 0x7fd72419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:58.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd729150640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd72410dcd0 con 0x7fd724100820 2024-09-04T16:36:58.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd729150640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd72410db50 con 0x7fd724106820 2024-09-04T16:36:58.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd722d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd724100820 0x7fd72419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:58.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd722d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd724100820 0x7fd72419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48996/0 (socket says 172.21.15.170:48996) 2024-09-04T16:36:58.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd722d9d640 1 -- 172.21.15.170:0/2888574765 learned_addr learned my addr 172.21.15.170:0/2888574765 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:36:58.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd71a59c640 1 --2- 172.21.15.170:0/2888574765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd724106820 0x7fd72419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:58.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd722d9d640 1 -- 172.21.15.170:0/2888574765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd724106820 msgr2=0x7fd72419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:58.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd722d9d640 1 --2- 172.21.15.170:0/2888574765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd724106820 0x7fd72419db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd722d9d640 1 -- 172.21.15.170:0/2888574765 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7241977c0 con 0x7fd724100820 2024-09-04T16:36:58.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd71a59c640 1 --2- 172.21.15.170:0/2888574765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd724106820 0x7fd72419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:36:58.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd722d9d640 1 --2- 172.21.15.170:0/2888574765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd724100820 0x7fd72419d640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd71400d8d0 tx=0x7fd71400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:58.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd720d99640 1 -- 172.21.15.170:0/2888574765 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd714017030 con 0x7fd724100820 2024-09-04T16:36:58.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd729150640 1 -- 172.21.15.170:0/2888574765 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd724197ab0 con 0x7fd724100820 2024-09-04T16:36:58.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd720d99640 1 -- 172.21.15.170:0/2888574765 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd714004020 con 0x7fd724100820 2024-09-04T16:36:58.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.392+0000 7fd720d99640 1 -- 172.21.15.170:0/2888574765 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7140047a0 con 0x7fd724100820 2024-09-04T16:36:58.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.393+0000 7fd729150640 1 -- 172.21.15.170:0/2888574765 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd724198010 con 0x7fd724100820 2024-09-04T16:36:58.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.394+0000 7fd729150640 1 -- 172.21.15.170:0/2888574765 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd724101f60 con 0x7fd724100820 2024-09-04T16:36:58.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.394+0000 7fd720d99640 1 -- 172.21.15.170:0/2888574765 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fd7140041d0 con 0x7fd724100820 2024-09-04T16:36:58.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.395+0000 7fd720d99640 1 --2- 172.21.15.170:0/2888574765 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd710079e30 0x7fd71007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:58.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.395+0000 7fd720d99640 1 -- 172.21.15.170:0/2888574765 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7fd714018070 con 0x7fd724100820 2024-09-04T16:36:58.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.395+0000 7fd71a59c640 1 --2- 172.21.15.170:0/2888574765 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd710079e30 0x7fd71007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:58.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.395+0000 7fd71a59c640 1 --2- 172.21.15.170:0/2888574765 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd710079e30 0x7fd71007c2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd724198b10 tx=0x7fd70c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:58.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.399+0000 7fd720d99640 1 -- 172.21.15.170:0/2888574765 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd7140642f0 con 0x7fd724100820 2024-09-04T16:36:58.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.592+0000 7fd729150640 1 -- 172.21.15.170:0/2888574765 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd724198380 con 0x7fd710079e30 2024-09-04T16:36:58.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.593+0000 7fd720d99640 1 -- 172.21.15.170:0/2888574765 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fd724198380 con 0x7fd710079e30 2024-09-04T16:36:58.594 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:36:58.594 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:36:58.594 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:36:58.594 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:36:58.594 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:36:58.594 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-04T16:36:58.594 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:36:58.594 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-04T16:36:58.594 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:36:58.594 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "9/23 daemons upgraded", 2024-09-04T16:36:58.594 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-04T16:36:58.595 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:36:58.595 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:36:58.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.595+0000 7fd729150640 1 -- 172.21.15.170:0/2888574765 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd710079e30 msgr2=0x7fd71007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:58.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.595+0000 7fd729150640 1 --2- 172.21.15.170:0/2888574765 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd710079e30 0x7fd71007c2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd724198b10 tx=0x7fd70c031400 comp rx=0 tx=0).stop 2024-09-04T16:36:58.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.595+0000 7fd729150640 1 -- 172.21.15.170:0/2888574765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd724100820 msgr2=0x7fd72419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:58.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.595+0000 7fd729150640 1 --2- 172.21.15.170:0/2888574765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd724100820 0x7fd72419d640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd71400d8d0 tx=0x7fd71400dd90 comp rx=0 tx=0).stop 2024-09-04T16:36:58.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.595+0000 7fd729150640 1 -- 172.21.15.170:0/2888574765 shutdown_connections 2024-09-04T16:36:58.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.595+0000 7fd729150640 1 --2- 172.21.15.170:0/2888574765 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd710079e30 0x7fd71007c2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.595+0000 7fd729150640 1 --2- 172.21.15.170:0/2888574765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd724106820 0x7fd72419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.595+0000 7fd729150640 1 --2- 172.21.15.170:0/2888574765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd724100820 0x7fd72419d640 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.595+0000 7fd729150640 1 -- 172.21.15.170:0/2888574765 >> 172.21.15.170:0/2888574765 conn(0x7fd7240fc520 msgr2=0x7fd724104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:58.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.595+0000 7fd729150640 1 -- 172.21.15.170:0/2888574765 shutdown_connections 2024-09-04T16:36:58.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.596+0000 7fd729150640 1 -- 172.21.15.170:0/2888574765 wait complete. 2024-09-04T16:36:58.656 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:36:58 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3[42182]: 2024-09-04T16:36:58.252+0000 7f7bd1312640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T16:36:58.656 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:36:58 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3[42182]: 2024-09-04T16:36:58.252+0000 7f7bd1312640 -1 osd.3 62 *** Got signal Terminated *** 2024-09-04T16:36:58.657 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:36:58 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3[42182]: 2024-09-04T16:36:58.252+0000 7f7bd1312640 -1 osd.3 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-04T16:36:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.677+0000 7f22301b4640 1 -- 172.21.15.170:0/3024786163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228101930 msgr2=0x7f2228101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.677+0000 7f22301b4640 1 --2- 172.21.15.170:0/3024786163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228101930 0x7f2228101d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2218009880 tx=0x7f221802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.677+0000 7f22301b4640 1 -- 172.21.15.170:0/3024786163 shutdown_connections 2024-09-04T16:36:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.677+0000 7f22301b4640 1 --2- 172.21.15.170:0/3024786163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228101930 0x7f2228101d90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.677+0000 7f22301b4640 1 --2- 172.21.15.170:0/3024786163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2228107930 0x7f2228107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.677+0000 7f22301b4640 1 -- 172.21.15.170:0/3024786163 >> 172.21.15.170:0/3024786163 conn(0x7f22280fd630 msgr2=0x7f22280ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:58.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.677+0000 7f22301b4640 1 -- 172.21.15.170:0/3024786163 shutdown_connections 2024-09-04T16:36:58.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.677+0000 7f22301b4640 1 -- 172.21.15.170:0/3024786163 wait complete. 2024-09-04T16:36:58.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.678+0000 7f22301b4640 1 Processor -- start 2024-09-04T16:36:58.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.678+0000 7f22301b4640 1 -- start start 2024-09-04T16:36:58.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.678+0000 7f22301b4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2228101930 0x7f222819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.678+0000 7f22301b4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228107930 0x7f222819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.678+0000 7f22301b4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f222810ee00 con 0x7f2228107930 2024-09-04T16:36:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.678+0000 7f22301b4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f222810ec80 con 0x7f2228101930 2024-09-04T16:36:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.678+0000 7f222d74f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228107930 0x7f222819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.678+0000 7f222d74f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228107930 0x7f222819dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49026/0 (socket says 172.21.15.170:49026) 2024-09-04T16:36:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.678+0000 7f222d74f640 1 -- 172.21.15.170:0/423976466 learned_addr learned my addr 172.21.15.170:0/423976466 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:36:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.678+0000 7f222df50640 1 --2- 172.21.15.170:0/423976466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2228101930 0x7f222819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.678+0000 7f222d74f640 1 -- 172.21.15.170:0/423976466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2228101930 msgr2=0x7f222819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.678+0000 7f222d74f640 1 --2- 172.21.15.170:0/423976466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2228101930 0x7f222819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.678+0000 7f222d74f640 1 -- 172.21.15.170:0/423976466 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2228197810 con 0x7f2228107930 2024-09-04T16:36:58.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.679+0000 7f222d74f640 1 --2- 172.21.15.170:0/423976466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228107930 0x7f222819dbd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2218031460 tx=0x7f22180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:58.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.679+0000 7f221effd640 1 -- 172.21.15.170:0/423976466 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f221803f070 con 0x7f2228107930 2024-09-04T16:36:58.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.679+0000 7f221effd640 1 -- 172.21.15.170:0/423976466 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2218004cf0 con 0x7f2228107930 2024-09-04T16:36:58.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.679+0000 7f22301b4640 1 -- 172.21.15.170:0/423976466 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2228197aa0 con 0x7f2228107930 2024-09-04T16:36:58.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.679+0000 7f221effd640 1 -- 172.21.15.170:0/423976466 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2218035030 con 0x7f2228107930 2024-09-04T16:36:58.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.679+0000 7f22301b4640 1 -- 172.21.15.170:0/423976466 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2228197fd0 con 0x7f2228107930 2024-09-04T16:36:58.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.680+0000 7f22301b4640 1 -- 172.21.15.170:0/423976466 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2228103070 con 0x7f2228107930 2024-09-04T16:36:58.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.680+0000 7f221effd640 1 -- 172.21.15.170:0/423976466 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f2218042070 con 0x7f2228107930 2024-09-04T16:36:58.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.681+0000 7f221effd640 1 --2- 172.21.15.170:0/423976466 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2214079e80 0x7f221407c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:36:58.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.681+0000 7f221effd640 1 -- 172.21.15.170:0/423976466 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7f22180bd400 con 0x7f2228107930 2024-09-04T16:36:58.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.681+0000 7f222df50640 1 --2- 172.21.15.170:0/423976466 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2214079e80 0x7f221407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:36:58.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.681+0000 7f222df50640 1 --2- 172.21.15.170:0/423976466 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2214079e80 0x7f221407c340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2224005fd0 tx=0x7f2224005e20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:36:58.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.685+0000 7f221effd640 1 -- 172.21.15.170:0/423976466 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2218084f40 con 0x7f2228107930 2024-09-04T16:36:58.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.929+0000 7f22301b4640 1 -- 172.21.15.170:0/423976466 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f2228198d40 con 0x7f2228107930 2024-09-04T16:36:58.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.929+0000 7f221effd640 1 -- 172.21.15.170:0/423976466 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f221808d3f0 con 0x7f2228107930 2024-09-04T16:36:58.930 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-04T16:36:58.930 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:36:58.931 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:36:58.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.932+0000 7f22301b4640 1 -- 172.21.15.170:0/423976466 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2214079e80 msgr2=0x7f221407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:58.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.932+0000 7f22301b4640 1 --2- 172.21.15.170:0/423976466 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2214079e80 0x7f221407c340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2224005fd0 tx=0x7f2224005e20 comp rx=0 tx=0).stop 2024-09-04T16:36:58.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.932+0000 7f22301b4640 1 -- 172.21.15.170:0/423976466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228107930 msgr2=0x7f222819dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:36:58.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.932+0000 7f22301b4640 1 --2- 172.21.15.170:0/423976466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228107930 0x7f222819dbd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2218031460 tx=0x7f22180048f0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.932+0000 7f22301b4640 1 -- 172.21.15.170:0/423976466 shutdown_connections 2024-09-04T16:36:58.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.932+0000 7f22301b4640 1 --2- 172.21.15.170:0/423976466 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2214079e80 0x7f221407c340 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.932+0000 7f22301b4640 1 --2- 172.21.15.170:0/423976466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228107930 0x7f222819dbd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.932+0000 7f22301b4640 1 --2- 172.21.15.170:0/423976466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2228101930 0x7f222819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:36:58.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.932+0000 7f22301b4640 1 -- 172.21.15.170:0/423976466 >> 172.21.15.170:0/423976466 conn(0x7f22280fd630 msgr2=0x7f22280fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:36:58.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.932+0000 7f22301b4640 1 -- 172.21.15.170:0/423976466 shutdown_connections 2024-09-04T16:36:58.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:36:58.932+0000 7f22301b4640 1 -- 172.21.15.170:0/423976466 wait complete. 2024-09-04T16:36:59.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:58 smithi170 ceph-mon[113855]: from='client.44207 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:36:59.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:58 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3773948691' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:36:59.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:58 smithi170 ceph-mon[113855]: osd.3 marked itself down and dead 2024-09-04T16:36:59.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:58 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1883552432' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:36:59.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:58 smithi170 ceph-mon[113855]: pgmap v198: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:59.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:58 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/423976466' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:36:59.376 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:58 smithi193 ceph-mon[82547]: from='client.44207 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:36:59.376 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:58 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3773948691' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:36:59.376 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:58 smithi193 ceph-mon[82547]: osd.3 marked itself down and dead 2024-09-04T16:36:59.377 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:58 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1883552432' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:36:59.377 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:58 smithi193 ceph-mon[82547]: pgmap v198: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:36:59.377 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:58 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/423976466' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:36:59.656 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:36:59 smithi193 podman[90214]: 2024-09-04 16:36:59.376983349 +0000 UTC m=+1.232074614 container died 67e8a25b659985a89aa2cdc045c28ab1c875ca8e0d8833b46e26a01691770b88 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-48920da) 2024-09-04T16:36:59.979 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:36:59 smithi193 podman[90214]: 2024-09-04 16:36:59.761571467 +0000 UTC m=+1.616662724 container cleanup 67e8a25b659985a89aa2cdc045c28ab1c875ca8e0d8833b46e26a01691770b88 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-48920da) 2024-09-04T16:36:59.979 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:36:59 smithi193 bash[90214]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3 2024-09-04T16:37:00.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:59 smithi170 ceph-mon[113855]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:37:00.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:59 smithi170 ceph-mon[113855]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-04T16:37:00.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:59 smithi170 ceph-mon[113855]: osdmap e63: 6 total, 5 up, 6 in 2024-09-04T16:37:00.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:00.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:36:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:37:00.314 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:36:59 smithi193 podman[90230]: 2024-09-04 16:36:59.979396622 +0000 UTC m=+0.604782671 container remove 67e8a25b659985a89aa2cdc045c28ab1c875ca8e0d8833b46e26a01691770b88 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-48920da, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-04T16:37:00.315 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:59 smithi193 ceph-mon[82547]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:37:00.315 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:59 smithi193 ceph-mon[82547]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-04T16:37:00.315 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:59 smithi193 ceph-mon[82547]: osdmap e63: 6 total, 5 up, 6 in 2024-09-04T16:37:00.315 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:00.315 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:36:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:37:00.567 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:00 smithi193 podman[90317]: 2024-09-04 16:37:00.21758905 +0000 UTC m=+0.015736254 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:37:00.567 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:00 smithi193 podman[90317]: 2024-09-04 16:37:00.335737088 +0000 UTC m=+0.133884331 container create 2772077a535d1720fde7924935208b258507f7cce1f17640c3ff8fb23777a4eb (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-04T16:37:00.567 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:00 smithi193 podman[90317]: 2024-09-04 16:37:00.566960282 +0000 UTC m=+0.365107491 container init 2772077a535d1720fde7924935208b258507f7cce1f17640c3ff8fb23777a4eb (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-04T16:37:00.906 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:00 smithi193 podman[90317]: 2024-09-04 16:37:00.570593876 +0000 UTC m=+0.368741078 container start 2772077a535d1720fde7924935208b258507f7cce1f17640c3ff8fb23777a4eb (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2) 2024-09-04T16:37:00.907 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:00 smithi193 podman[90317]: 2024-09-04 16:37:00.641422899 +0000 UTC m=+0.439570111 container attach 2772077a535d1720fde7924935208b258507f7cce1f17640c3ff8fb23777a4eb (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-deactivate, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-04T16:37:00.907 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:00 smithi193 podman[90317]: 2024-09-04 16:37:00.755484426 +0000 UTC m=+0.553631632 container died 2772077a535d1720fde7924935208b258507f7cce1f17640c3ff8fb23777a4eb (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-04T16:37:01.294 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:00 smithi193 ceph-mon[82547]: osdmap e64: 6 total, 5 up, 6 in 2024-09-04T16:37:01.295 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:00 smithi193 ceph-mon[82547]: pgmap v201: 65 pgs: 25 peering, 3 stale+active+clean, 37 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:01.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:00 smithi170 ceph-mon[113855]: osdmap e64: 6 total, 5 up, 6 in 2024-09-04T16:37:01.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:00 smithi170 ceph-mon[113855]: pgmap v201: 65 pgs: 25 peering, 3 stale+active+clean, 37 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:01.656 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:01 smithi193 podman[90340]: 2024-09-04 16:37:01.295014393 +0000 UTC m=+0.533239121 container remove 2772077a535d1720fde7924935208b258507f7cce1f17640c3ff8fb23777a4eb (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5) 2024-09-04T16:37:01.656 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:01 smithi193 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-04T16:37:01.656 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:01 smithi193 systemd[1]: Stopped Ceph osd.3 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:37:01.657 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:01 smithi193 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.3.service: Consumed 1min 4.004s CPU time. 2024-09-04T16:37:01.657 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:01 smithi193 systemd[1]: Starting Ceph osd.3 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:37:02.006 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:01 smithi193 ceph-mon[82547]: Health check failed: Reduced data availability: 13 pgs peering (PG_AVAILABILITY) 2024-09-04T16:37:02.007 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:01 smithi193 podman[90440]: 2024-09-04 16:37:01.647543586 +0000 UTC m=+0.016308029 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:37:02.007 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:01 smithi193 podman[90440]: 2024-09-04 16:37:01.771083491 +0000 UTC m=+0.139847978 container create c4ebc27f38debb508dd605f97e48aeb5d7816e99328f684105cb6ca3604e92aa (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-activate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-04T16:37:02.007 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:02 smithi193 podman[90440]: 2024-09-04 16:37:02.007110332 +0000 UTC m=+0.375874780 container init c4ebc27f38debb508dd605f97e48aeb5d7816e99328f684105cb6ca3604e92aa (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-04T16:37:02.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:01 smithi170 ceph-mon[113855]: Health check failed: Reduced data availability: 13 pgs peering (PG_AVAILABILITY) 2024-09-04T16:37:02.406 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:02 smithi193 podman[90440]: 2024-09-04 16:37:02.010684854 +0000 UTC m=+0.379449305 container start c4ebc27f38debb508dd605f97e48aeb5d7816e99328f684105cb6ca3604e92aa (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-04T16:37:02.406 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:02 smithi193 podman[90440]: 2024-09-04 16:37:02.082057545 +0000 UTC m=+0.450822001 container attach c4ebc27f38debb508dd605f97e48aeb5d7816e99328f684105cb6ca3604e92aa (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-activate, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-04T16:37:02.406 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:02 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-activate[90455]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:37:02.407 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:02 smithi193 bash[90440]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:37:02.407 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:02 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-activate[90455]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:37:02.407 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:02 smithi193 bash[90440]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:37:03.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:02 smithi193 ceph-mon[82547]: pgmap v202: 65 pgs: 5 active+undersized, 25 peering, 8 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/312 objects degraded (7.051%) 2024-09-04T16:37:03.156 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:02 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-activate[90455]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-04T16:37:03.156 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:02 smithi193 bash[90440]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-04T16:37:03.157 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:02 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-activate[90455]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-04T16:37:03.157 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:02 smithi193 bash[90440]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-04T16:37:03.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:02 smithi170 ceph-mon[113855]: pgmap v202: 65 pgs: 5 active+undersized, 25 peering, 8 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/312 objects degraded (7.051%) 2024-09-04T16:37:03.485 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:03 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-activate[90455]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-04T16:37:03.485 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:03 smithi193 bash[90440]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-04T16:37:03.485 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:03 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-activate[90455]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-04T16:37:03.485 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:03 smithi193 bash[90440]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-04T16:37:03.485 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:03 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-activate[90455]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-04T16:37:03.485 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:03 smithi193 bash[90440]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-04T16:37:03.485 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:03 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-activate[90455]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-04T16:37:03.485 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:03 smithi193 bash[90440]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-04T16:37:03.485 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:03 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-activate[90455]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-04T16:37:03.485 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:03 smithi193 bash[90440]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-04T16:37:03.486 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:03 smithi193 podman[90440]: 2024-09-04 16:37:03.186465035 +0000 UTC m=+1.555229480 container died c4ebc27f38debb508dd605f97e48aeb5d7816e99328f684105cb6ca3604e92aa (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-activate, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-04T16:37:04.106 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:03 smithi193 ceph-mon[82547]: Health check failed: Degraded data redundancy: 22/312 objects degraded (7.051%), 8 pgs degraded (PG_DEGRADED) 2024-09-04T16:37:04.107 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:03 smithi193 podman[90596]: 2024-09-04 16:37:03.778034322 +0000 UTC m=+0.585461108 container remove c4ebc27f38debb508dd605f97e48aeb5d7816e99328f684105cb6ca3604e92aa (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-activate, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-09-04T16:37:04.107 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:03 smithi193 podman[90655]: 2024-09-04 16:37:03.885653818 +0000 UTC m=+0.015923398 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:37:04.107 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:04 smithi193 podman[90655]: 2024-09-04 16:37:04.003758479 +0000 UTC m=+0.134028052 container create c571a091a612220beca002d0001a33443140568c92953e49b82c46d75439279e (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-04T16:37:04.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:03 smithi170 ceph-mon[113855]: Health check failed: Degraded data redundancy: 22/312 objects degraded (7.051%), 8 pgs degraded (PG_DEGRADED) 2024-09-04T16:37:04.406 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:04 smithi193 podman[90655]: 2024-09-04 16:37:04.206233584 +0000 UTC m=+0.336503154 container init c571a091a612220beca002d0001a33443140568c92953e49b82c46d75439279e (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-04T16:37:04.406 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:04 smithi193 podman[90655]: 2024-09-04 16:37:04.209541843 +0000 UTC m=+0.339811426 container start c571a091a612220beca002d0001a33443140568c92953e49b82c46d75439279e (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-04T16:37:04.406 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:04 smithi193 ceph-osd[90674]: -- 172.21.15.193:0/3644494206 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c5166381e0 con 0x55c5165c8000 2024-09-04T16:37:04.406 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:04 smithi193 bash[90655]: c571a091a612220beca002d0001a33443140568c92953e49b82c46d75439279e 2024-09-04T16:37:04.406 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:04 smithi193 systemd[1]: Started Ceph osd.3 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:37:05.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:05 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:05.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:05 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:05.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:05 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:37:05.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:05 smithi170 ceph-mon[113855]: pgmap v203: 65 pgs: 15 active+undersized, 7 peering, 16 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 56/312 objects degraded (17.949%) 2024-09-04T16:37:05.637 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:05 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:05.638 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:05 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:05.638 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:05 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:37:05.638 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:05 smithi193 ceph-mon[82547]: pgmap v203: 65 pgs: 15 active+undersized, 7 peering, 16 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 56/312 objects degraded (17.949%) 2024-09-04T16:37:06.332 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:06 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3[90670]: 2024-09-04T16:37:06.075+0000 7fb163ed4640 -1 Falling back to public interface 2024-09-04T16:37:06.607 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:06 smithi193 ceph-mon[82547]: pgmap v204: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-04T16:37:06.607 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:06 smithi193 ceph-mon[82547]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-04T16:37:06.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:06 smithi170 ceph-mon[113855]: pgmap v204: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-04T16:37:06.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:06 smithi170 ceph-mon[113855]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-04T16:37:08.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:08 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:08.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:08 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:08.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:08 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:08.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:08 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:08.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:08 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:08.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:08 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:08.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:08 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:08.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:08 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:09.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:09 smithi193 ceph-mon[82547]: pgmap v205: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-04T16:37:09.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:09 smithi170 ceph-mon[113855]: pgmap v205: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-04T16:37:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:10 smithi170 ceph-mon[113855]: pgmap v206: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-04T16:37:10.756 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:10 smithi193 ceph-mon[82547]: pgmap v206: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-04T16:37:12.406 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3[90670]: 2024-09-04T16:37:12.068+0000 7fb163ed4640 -1 osd.3 62 log_to_monitors true 2024-09-04T16:37:12.406 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3[90670]: 2024-09-04T16:37:12.197+0000 7fb15bc7e640 -1 osd.3 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-04T16:37:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:37:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:37:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:37:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:37:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:37:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:37:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-04T16:37:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-mon[82547]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-04T16:37:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-mon[82547]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-04T16:37:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-mon[82547]: Health check update: Degraded data redundancy: 66/312 objects degraded (21.154%), 19 pgs degraded (PG_DEGRADED) 2024-09-04T16:37:12.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-mon[82547]: from='osd.3 [v2:172.21.15.193:6800/1541290296,v1:172.21.15.193:6801/1541290296]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-04T16:37:12.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:12 smithi193 ceph-mon[82547]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-04T16:37:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:37:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:37:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:37:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:37:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:37:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:37:12.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-04T16:37:12.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:12 smithi170 ceph-mon[113855]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-04T16:37:12.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:12 smithi170 ceph-mon[113855]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-04T16:37:12.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:12 smithi170 ceph-mon[113855]: Health check update: Degraded data redundancy: 66/312 objects degraded (21.154%), 19 pgs degraded (PG_DEGRADED) 2024-09-04T16:37:12.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:12 smithi170 ceph-mon[113855]: from='osd.3 [v2:172.21.15.193:6800/1541290296,v1:172.21.15.193:6801/1541290296]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-04T16:37:12.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:12 smithi170 ceph-mon[113855]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-04T16:37:13.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:13 smithi170 ceph-mon[113855]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-04T16:37:13.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:13 smithi170 ceph-mon[113855]: osdmap e65: 6 total, 5 up, 6 in 2024-09-04T16:37:13.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:13 smithi170 ceph-mon[113855]: from='osd.3 [v2:172.21.15.193:6800/1541290296,v1:172.21.15.193:6801/1541290296]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-04T16:37:13.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:13 smithi170 ceph-mon[113855]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-04T16:37:13.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:13 smithi170 ceph-mon[113855]: pgmap v208: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-04T16:37:13.630 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:13 smithi193 ceph-mon[82547]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-04T16:37:13.630 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:13 smithi193 ceph-mon[82547]: osdmap e65: 6 total, 5 up, 6 in 2024-09-04T16:37:13.630 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:13 smithi193 ceph-mon[82547]: from='osd.3 [v2:172.21.15.193:6800/1541290296,v1:172.21.15.193:6801/1541290296]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-04T16:37:13.630 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:13 smithi193 ceph-mon[82547]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-04T16:37:13.630 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:13 smithi193 ceph-mon[82547]: pgmap v208: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-04T16:37:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:14 smithi170 ceph-mon[113855]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-04T16:37:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:14 smithi170 ceph-mon[113855]: osd.3 [v2:172.21.15.193:6800/1541290296,v1:172.21.15.193:6801/1541290296] boot 2024-09-04T16:37:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:14 smithi170 ceph-mon[113855]: osdmap e66: 6 total, 6 up, 6 in 2024-09-04T16:37:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-04T16:37:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:37:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:14 smithi170 ceph-mon[113855]: osdmap e67: 6 total, 6 up, 6 in 2024-09-04T16:37:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:14 smithi193 ceph-mon[82547]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-04T16:37:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:14 smithi193 ceph-mon[82547]: osd.3 [v2:172.21.15.193:6800/1541290296,v1:172.21.15.193:6801/1541290296] boot 2024-09-04T16:37:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:14 smithi193 ceph-mon[82547]: osdmap e66: 6 total, 6 up, 6 in 2024-09-04T16:37:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-04T16:37:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:37:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:14 smithi193 ceph-mon[82547]: osdmap e67: 6 total, 6 up, 6 in 2024-09-04T16:37:15.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:15 smithi170 ceph-mon[113855]: pgmap v211: 65 pgs: 13 active+undersized, 17 active+undersized+degraded, 35 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 57/312 objects degraded (18.269%) 2024-09-04T16:37:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:15 smithi193 ceph-mon[82547]: pgmap v211: 65 pgs: 13 active+undersized, 17 active+undersized+degraded, 35 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 57/312 objects degraded (18.269%) 2024-09-04T16:37:16.818 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:16 smithi170 ceph-mon[113855]: pgmap v212: 65 pgs: 7 active+undersized, 12 active+undersized+degraded, 46 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 38/312 objects degraded (12.179%) 2024-09-04T16:37:16.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:16 smithi193 ceph-mon[82547]: pgmap v212: 65 pgs: 7 active+undersized, 12 active+undersized+degraded, 46 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 38/312 objects degraded (12.179%) 2024-09-04T16:37:17.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:17 smithi170 ceph-mon[113855]: Health check update: Degraded data redundancy: 38/312 objects degraded (12.179%), 12 pgs degraded (PG_DEGRADED) 2024-09-04T16:37:17.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:17 smithi193 ceph-mon[82547]: Health check update: Degraded data redundancy: 38/312 objects degraded (12.179%), 12 pgs degraded (PG_DEGRADED) 2024-09-04T16:37:18.791 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:18 smithi170 ceph-mon[113855]: pgmap v213: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:18.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:18 smithi193 ceph-mon[82547]: pgmap v213: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:19.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:19 smithi170 ceph-mon[113855]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 38/312 objects degraded (12.179%), 12 pgs degraded) 2024-09-04T16:37:19.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:19 smithi193 ceph-mon[82547]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 38/312 objects degraded (12.179%), 12 pgs degraded) 2024-09-04T16:37:20.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:20 smithi170 ceph-mon[113855]: pgmap v214: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:20.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:20 smithi193 ceph-mon[82547]: pgmap v214: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:22.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:22 smithi170 ceph-mon[113855]: pgmap v215: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:22 smithi193 ceph-mon[82547]: pgmap v215: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:25.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:25 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:25.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:25 smithi170 ceph-mon[113855]: pgmap v216: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:25.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:25 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:25.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:25 smithi193 ceph-mon[82547]: pgmap v216: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:26 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-04T16:37:26.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:26 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-04T16:37:27.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:27 smithi193 ceph-mon[82547]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-04T16:37:27.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:27 smithi193 ceph-mon[82547]: Upgrade: osd.4 is safe to restart 2024-09-04T16:37:27.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:27 smithi193 ceph-mon[82547]: pgmap v217: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:27.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:27 smithi170 ceph-mon[113855]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-04T16:37:27.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:27 smithi170 ceph-mon[113855]: Upgrade: osd.4 is safe to restart 2024-09-04T16:37:27.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:27 smithi170 ceph-mon[113855]: pgmap v217: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:29.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.026+0000 7fcf507d1640 1 -- 172.21.15.170:0/1869978804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf48100a80 msgr2=0x7fcf481065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:29.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.026+0000 7fcf507d1640 1 --2- 172.21.15.170:0/1869978804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf48100a80 0x7fcf481065c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009880 tx=0x7fcf3802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.026+0000 7fcf507d1640 1 -- 172.21.15.170:0/1869978804 shutdown_connections 2024-09-04T16:37:29.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.026+0000 7fcf507d1640 1 --2- 172.21.15.170:0/1869978804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf48100a80 0x7fcf481065c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.026+0000 7fcf507d1640 1 --2- 172.21.15.170:0/1869978804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf481000d0 0x7fcf481004b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.026+0000 7fcf507d1640 1 -- 172.21.15.170:0/1869978804 >> 172.21.15.170:0/1869978804 conn(0x7fcf480fbc60 msgr2=0x7fcf480fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:37:29.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.026+0000 7fcf507d1640 1 -- 172.21.15.170:0/1869978804 shutdown_connections 2024-09-04T16:37:29.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.027+0000 7fcf507d1640 1 -- 172.21.15.170:0/1869978804 wait complete. 2024-09-04T16:37:29.029 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:28 smithi170 ceph-mon[113855]: Upgrade: Updating osd.4 2024-09-04T16:37:29.029 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:28 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:29.029 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:28 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-04T16:37:29.029 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:28 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:37:29.029 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:28 smithi170 ceph-mon[113855]: Deploying daemon osd.4 on smithi193 2024-09-04T16:37:29.029 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:28 smithi170 ceph-mon[113855]: pgmap v218: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:29.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.027+0000 7fcf507d1640 1 Processor -- start 2024-09-04T16:37:29.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.027+0000 7fcf507d1640 1 -- start start 2024-09-04T16:37:29.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.027+0000 7fcf507d1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf481000d0 0x7fcf48101050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:29.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.027+0000 7fcf507d1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf48100a80 0x7fcf48101590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:29.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.027+0000 7fcf507d1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4810ee10 con 0x7fcf48100a80 2024-09-04T16:37:29.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.027+0000 7fcf507d1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4810ec90 con 0x7fcf481000d0 2024-09-04T16:37:29.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.028+0000 7fcf4dd6c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf48100a80 0x7fcf48101590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:29.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.028+0000 7fcf4dd6c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf48100a80 0x7fcf48101590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49028/0 (socket says 172.21.15.170:49028) 2024-09-04T16:37:29.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.028+0000 7fcf4dd6c640 1 -- 172.21.15.170:0/345038264 learned_addr learned my addr 172.21.15.170:0/345038264 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:37:29.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.028+0000 7fcf4e56d640 1 --2- 172.21.15.170:0/345038264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf481000d0 0x7fcf48101050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:29.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.028+0000 7fcf4dd6c640 1 -- 172.21.15.170:0/345038264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf481000d0 msgr2=0x7fcf48101050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:29.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.028+0000 7fcf4dd6c640 1 --2- 172.21.15.170:0/345038264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf481000d0 0x7fcf48101050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.028+0000 7fcf4dd6c640 1 -- 172.21.15.170:0/345038264 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf48101ad0 con 0x7fcf48100a80 2024-09-04T16:37:29.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.028+0000 7fcf4dd6c640 1 --2- 172.21.15.170:0/345038264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf48100a80 0x7fcf48101590 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcf38031460 tx=0x7fcf380045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:37:29.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.028+0000 7fcf3f7fe640 1 -- 172.21.15.170:0/345038264 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf3803f070 con 0x7fcf48100a80 2024-09-04T16:37:29.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.028+0000 7fcf3f7fe640 1 -- 172.21.15.170:0/345038264 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcf380035f0 con 0x7fcf48100a80 2024-09-04T16:37:29.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.028+0000 7fcf507d1640 1 -- 172.21.15.170:0/345038264 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf48101d60 con 0x7fcf48100a80 2024-09-04T16:37:29.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.028+0000 7fcf3f7fe640 1 -- 172.21.15.170:0/345038264 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf38035030 con 0x7fcf48100a80 2024-09-04T16:37:29.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.029+0000 7fcf507d1640 1 -- 172.21.15.170:0/345038264 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf481a3de0 con 0x7fcf48100a80 2024-09-04T16:37:29.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.029+0000 7fcf507d1640 1 -- 172.21.15.170:0/345038264 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf48103190 con 0x7fcf48100a80 2024-09-04T16:37:29.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.030+0000 7fcf3f7fe640 1 -- 172.21.15.170:0/345038264 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fcf38042070 con 0x7fcf48100a80 2024-09-04T16:37:29.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.031+0000 7fcf3f7fe640 1 --2- 172.21.15.170:0/345038264 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcf34079e80 0x7fcf3407c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:29.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.031+0000 7fcf4e56d640 1 --2- 172.21.15.170:0/345038264 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcf34079e80 0x7fcf3407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:29.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.031+0000 7fcf3f7fe640 1 -- 172.21.15.170:0/345038264 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7fcf380bd1c0 con 0x7fcf48100a80 2024-09-04T16:37:29.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.031+0000 7fcf4e56d640 1 --2- 172.21.15.170:0/345038264 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcf34079e80 0x7fcf3407c340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcf44005fd0 tx=0x7fcf44009680 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:37:29.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.035+0000 7fcf3f7fe640 1 -- 172.21.15.170:0/345038264 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcf38088e70 con 0x7fcf48100a80 2024-09-04T16:37:29.044 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:28 smithi193 ceph-mon[82547]: Upgrade: Updating osd.4 2024-09-04T16:37:29.044 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:28 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:29.044 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:28 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-04T16:37:29.044 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:28 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:37:29.044 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:28 smithi193 ceph-mon[82547]: Deploying daemon osd.4 on smithi193 2024-09-04T16:37:29.044 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:28 smithi193 ceph-mon[82547]: pgmap v218: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:29.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.228+0000 7fcf507d1640 1 -- 172.21.15.170:0/345038264 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcf48109f10 con 0x7fcf34079e80 2024-09-04T16:37:29.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.229+0000 7fcf3f7fe640 1 -- 172.21.15.170:0/345038264 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fcf48109f10 con 0x7fcf34079e80 2024-09-04T16:37:29.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.231+0000 7fcf507d1640 1 -- 172.21.15.170:0/345038264 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcf34079e80 msgr2=0x7fcf3407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:29.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.231+0000 7fcf507d1640 1 --2- 172.21.15.170:0/345038264 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcf34079e80 0x7fcf3407c340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcf44005fd0 tx=0x7fcf44009680 comp rx=0 tx=0).stop 2024-09-04T16:37:29.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.231+0000 7fcf507d1640 1 -- 172.21.15.170:0/345038264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf48100a80 msgr2=0x7fcf48101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:29.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.231+0000 7fcf507d1640 1 --2- 172.21.15.170:0/345038264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf48100a80 0x7fcf48101590 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcf38031460 tx=0x7fcf380045e0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.231+0000 7fcf507d1640 1 -- 172.21.15.170:0/345038264 shutdown_connections 2024-09-04T16:37:29.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.231+0000 7fcf507d1640 1 --2- 172.21.15.170:0/345038264 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcf34079e80 0x7fcf3407c340 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.231+0000 7fcf507d1640 1 --2- 172.21.15.170:0/345038264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf48100a80 0x7fcf48101590 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.231+0000 7fcf507d1640 1 --2- 172.21.15.170:0/345038264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf481000d0 0x7fcf48101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.231+0000 7fcf507d1640 1 -- 172.21.15.170:0/345038264 >> 172.21.15.170:0/345038264 conn(0x7fcf480fbc60 msgr2=0x7fcf480fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:37:29.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.231+0000 7fcf507d1640 1 -- 172.21.15.170:0/345038264 shutdown_connections 2024-09-04T16:37:29.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.231+0000 7fcf507d1640 1 -- 172.21.15.170:0/345038264 wait complete. 2024-09-04T16:37:29.241 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:37:29.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.314+0000 7f0dffae3640 1 -- 172.21.15.170:0/372115627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0df8106820 msgr2=0x7f0df8106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:29.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.314+0000 7f0dffae3640 1 --2- 172.21.15.170:0/372115627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0df8106820 0x7f0df8106c00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0de8009880 tx=0x7f0de802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.314+0000 7f0dffae3640 1 -- 172.21.15.170:0/372115627 shutdown_connections 2024-09-04T16:37:29.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.314+0000 7f0dffae3640 1 --2- 172.21.15.170:0/372115627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0df8100820 0x7f0df8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.314+0000 7f0dffae3640 1 --2- 172.21.15.170:0/372115627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0df8106820 0x7f0df8106c00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.314+0000 7f0dffae3640 1 -- 172.21.15.170:0/372115627 >> 172.21.15.170:0/372115627 conn(0x7f0df80fc520 msgr2=0x7f0df80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:37:29.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.314+0000 7f0dffae3640 1 -- 172.21.15.170:0/372115627 shutdown_connections 2024-09-04T16:37:29.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.314+0000 7f0dffae3640 1 -- 172.21.15.170:0/372115627 wait complete. 2024-09-04T16:37:29.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.315+0000 7f0dffae3640 1 Processor -- start 2024-09-04T16:37:29.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.315+0000 7f0dffae3640 1 -- start start 2024-09-04T16:37:29.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.315+0000 7f0dffae3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0df8100820 0x7f0df819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:29.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.315+0000 7f0dffae3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0df8106820 0x7f0df819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:29.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.315+0000 7f0dffae3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0df810dcf0 con 0x7f0df8106820 2024-09-04T16:37:29.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.315+0000 7f0dffae3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0df810db70 con 0x7f0df8100820 2024-09-04T16:37:29.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.315+0000 7f0dfd07e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0df8106820 0x7f0df819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:29.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.315+0000 7f0dfd07e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0df8106820 0x7f0df819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49042/0 (socket says 172.21.15.170:49042) 2024-09-04T16:37:29.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.315+0000 7f0dfd07e640 1 -- 172.21.15.170:0/3076686737 learned_addr learned my addr 172.21.15.170:0/3076686737 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:37:29.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.315+0000 7f0dfd87f640 1 --2- 172.21.15.170:0/3076686737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0df8100820 0x7f0df819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:29.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.315+0000 7f0dfd87f640 1 -- 172.21.15.170:0/3076686737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0df8106820 msgr2=0x7f0df819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:29.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.315+0000 7f0dfd87f640 1 --2- 172.21.15.170:0/3076686737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0df8106820 0x7f0df819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.315+0000 7f0dfd87f640 1 -- 172.21.15.170:0/3076686737 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df81977e0 con 0x7f0df8100820 2024-09-04T16:37:29.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.316+0000 7f0dfd87f640 1 --2- 172.21.15.170:0/3076686737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0df8100820 0x7f0df819d660 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0de802a9c0 tx=0x7f0de80045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:37:29.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.316+0000 7f0deeffd640 1 -- 172.21.15.170:0/3076686737 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0de803f070 con 0x7f0df8100820 2024-09-04T16:37:29.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.316+0000 7f0deeffd640 1 -- 172.21.15.170:0/3076686737 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0de80035f0 con 0x7f0df8100820 2024-09-04T16:37:29.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.316+0000 7f0dffae3640 1 -- 172.21.15.170:0/3076686737 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df8197a70 con 0x7f0df8100820 2024-09-04T16:37:29.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.316+0000 7f0deeffd640 1 -- 172.21.15.170:0/3076686737 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0de8035030 con 0x7f0df8100820 2024-09-04T16:37:29.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.316+0000 7f0dffae3640 1 -- 172.21.15.170:0/3076686737 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df8197fa0 con 0x7f0df8100820 2024-09-04T16:37:29.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.317+0000 7f0dffae3640 1 -- 172.21.15.170:0/3076686737 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df8101f60 con 0x7f0df8100820 2024-09-04T16:37:29.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.318+0000 7f0deeffd640 1 -- 172.21.15.170:0/3076686737 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f0de8042070 con 0x7f0df8100820 2024-09-04T16:37:29.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.318+0000 7f0deeffd640 1 --2- 172.21.15.170:0/3076686737 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0de4079e40 0x7f0de407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:29.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.318+0000 7f0deeffd640 1 -- 172.21.15.170:0/3076686737 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7f0de80bd2f0 con 0x7f0df8100820 2024-09-04T16:37:29.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.318+0000 7f0dfd07e640 1 --2- 172.21.15.170:0/3076686737 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0de4079e40 0x7f0de407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:29.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.319+0000 7f0dfd07e640 1 --2- 172.21.15.170:0/3076686737 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0de4079e40 0x7f0de407c300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0df8104fa0 tx=0x7f0df4005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:37:29.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.323+0000 7f0deeffd640 1 -- 172.21.15.170:0/3076686737 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0de8084db0 con 0x7f0df8100820 2024-09-04T16:37:29.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.515+0000 7f0dffae3640 1 -- 172.21.15.170:0/3076686737 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0df8198310 con 0x7f0de4079e40 2024-09-04T16:37:29.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.516+0000 7f0deeffd640 1 -- 172.21.15.170:0/3076686737 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f0df8198310 con 0x7f0de4079e40 2024-09-04T16:37:29.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.518+0000 7f0dffae3640 1 -- 172.21.15.170:0/3076686737 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0de4079e40 msgr2=0x7f0de407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:29.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.518+0000 7f0dffae3640 1 --2- 172.21.15.170:0/3076686737 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0de4079e40 0x7f0de407c300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0df8104fa0 tx=0x7f0df4005f90 comp rx=0 tx=0).stop 2024-09-04T16:37:29.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.518+0000 7f0dffae3640 1 -- 172.21.15.170:0/3076686737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0df8100820 msgr2=0x7f0df819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:29.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.518+0000 7f0dffae3640 1 --2- 172.21.15.170:0/3076686737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0df8100820 0x7f0df819d660 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0de802a9c0 tx=0x7f0de80045e0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.518+0000 7f0dffae3640 1 -- 172.21.15.170:0/3076686737 shutdown_connections 2024-09-04T16:37:29.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.518+0000 7f0dffae3640 1 --2- 172.21.15.170:0/3076686737 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0de4079e40 0x7f0de407c300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.518+0000 7f0dffae3640 1 --2- 172.21.15.170:0/3076686737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0df8106820 0x7f0df819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.518+0000 7f0dffae3640 1 --2- 172.21.15.170:0/3076686737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0df8100820 0x7f0df819d660 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.518+0000 7f0dffae3640 1 -- 172.21.15.170:0/3076686737 >> 172.21.15.170:0/3076686737 conn(0x7f0df80fc520 msgr2=0x7f0df806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:37:29.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.518+0000 7f0dffae3640 1 -- 172.21.15.170:0/3076686737 shutdown_connections 2024-09-04T16:37:29.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.518+0000 7f0dffae3640 1 -- 172.21.15.170:0/3076686737 wait complete. 2024-09-04T16:37:29.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.600+0000 7f2a51e3f640 1 -- 172.21.15.170:0/3473558171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a4c100820 msgr2=0x7f2a4c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:29.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.600+0000 7f2a51e3f640 1 --2- 172.21.15.170:0/3473558171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a4c100820 0x7f2a4c100c80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a34009880 tx=0x7f2a3402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.600+0000 7f2a51e3f640 1 -- 172.21.15.170:0/3473558171 shutdown_connections 2024-09-04T16:37:29.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.600+0000 7f2a51e3f640 1 --2- 172.21.15.170:0/3473558171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a4c100820 0x7f2a4c100c80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.600+0000 7f2a51e3f640 1 --2- 172.21.15.170:0/3473558171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a4c106820 0x7f2a4c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.600+0000 7f2a51e3f640 1 -- 172.21.15.170:0/3473558171 >> 172.21.15.170:0/3473558171 conn(0x7f2a4c0fc520 msgr2=0x7f2a4c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:37:29.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.600+0000 7f2a51e3f640 1 -- 172.21.15.170:0/3473558171 shutdown_connections 2024-09-04T16:37:29.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.600+0000 7f2a51e3f640 1 -- 172.21.15.170:0/3473558171 wait complete. 2024-09-04T16:37:29.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.600+0000 7f2a51e3f640 1 Processor -- start 2024-09-04T16:37:29.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.600+0000 7f2a51e3f640 1 -- start start 2024-09-04T16:37:29.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.601+0000 7f2a51e3f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a4c100820 0x7f2a4c198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:29.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.601+0000 7f2a51e3f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a4c106820 0x7f2a4c198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:29.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.601+0000 7f2a51e3f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c10dcf0 con 0x7f2a4c106820 2024-09-04T16:37:29.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.601+0000 7f2a51e3f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c10db70 con 0x7f2a4c100820 2024-09-04T16:37:29.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.601+0000 7f2a43fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a4c106820 0x7f2a4c198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:29.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.601+0000 7f2a43fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a4c106820 0x7f2a4c198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49066/0 (socket says 172.21.15.170:49066) 2024-09-04T16:37:29.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.601+0000 7f2a43fff640 1 -- 172.21.15.170:0/4020003858 learned_addr learned my addr 172.21.15.170:0/4020003858 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:37:29.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.601+0000 7f2a4b7fe640 1 --2- 172.21.15.170:0/4020003858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a4c100820 0x7f2a4c198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:29.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.601+0000 7f2a43fff640 1 -- 172.21.15.170:0/4020003858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a4c100820 msgr2=0x7f2a4c198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:29.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.601+0000 7f2a43fff640 1 --2- 172.21.15.170:0/4020003858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a4c100820 0x7f2a4c198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.601+0000 7f2a43fff640 1 -- 172.21.15.170:0/4020003858 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4c199340 con 0x7f2a4c106820 2024-09-04T16:37:29.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.601+0000 7f2a4b7fe640 1 --2- 172.21.15.170:0/4020003858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a4c100820 0x7f2a4c198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:37:29.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.601+0000 7f2a43fff640 1 --2- 172.21.15.170:0/4020003858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a4c106820 0x7f2a4c198d40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2a34031460 tx=0x7f2a34004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:37:29.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.601+0000 7f2a497fa640 1 -- 172.21.15.170:0/4020003858 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a3403f070 con 0x7f2a4c106820 2024-09-04T16:37:29.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.602+0000 7f2a51e3f640 1 -- 172.21.15.170:0/4020003858 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4c1995d0 con 0x7f2a4c106820 2024-09-04T16:37:29.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.602+0000 7f2a497fa640 1 -- 172.21.15.170:0/4020003858 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a340035f0 con 0x7f2a4c106820 2024-09-04T16:37:29.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.602+0000 7f2a51e3f640 1 -- 172.21.15.170:0/4020003858 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a4c1a1b80 con 0x7f2a4c106820 2024-09-04T16:37:29.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.602+0000 7f2a497fa640 1 -- 172.21.15.170:0/4020003858 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a34035030 con 0x7f2a4c106820 2024-09-04T16:37:29.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.603+0000 7f2a51e3f640 1 -- 172.21.15.170:0/4020003858 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a4c101f60 con 0x7f2a4c106820 2024-09-04T16:37:29.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.603+0000 7f2a497fa640 1 -- 172.21.15.170:0/4020003858 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f2a34042070 con 0x7f2a4c106820 2024-09-04T16:37:29.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.604+0000 7f2a497fa640 1 --2- 172.21.15.170:0/4020003858 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a38079e30 0x7f2a3807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:29.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.604+0000 7f2a4b7fe640 1 --2- 172.21.15.170:0/4020003858 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a38079e30 0x7f2a3807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:29.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.604+0000 7f2a497fa640 1 -- 172.21.15.170:0/4020003858 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7f2a340bd2d0 con 0x7f2a4c106820 2024-09-04T16:37:29.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.604+0000 7f2a4b7fe640 1 --2- 172.21.15.170:0/4020003858 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a38079e30 0x7f2a3807c2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c009fc0 tx=0x7f2a3c005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:37:29.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.608+0000 7f2a497fa640 1 -- 172.21.15.170:0/4020003858 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2a34088f00 con 0x7f2a4c106820 2024-09-04T16:37:29.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.791+0000 7f2a51e3f640 1 -- 172.21.15.170:0/4020003858 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2a4c062630 con 0x7f2a38079e30 2024-09-04T16:37:29.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.801+0000 7f2a497fa640 1 -- 172.21.15.170:0/4020003858 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f2a4c062630 con 0x7f2a38079e30 2024-09-04T16:37:29.801 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:37:29.801 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (4m) 55s ago 15m 21.0M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:37:29.802 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (7m) 55s ago 15m 9126k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:37:29.802 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (7m) 22s ago 14m 8506k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:37:29.802 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (2m) 55s ago 15m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:37:29.802 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (2m) 22s ago 14m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:37:29.802 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (4m) 55s ago 15m 79.4M - c8b91775d855 6e3778aab5e6 2024-09-04T16:37:29.802 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (9m) 55s ago 9m 27.1M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:37:29.802 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (10m) 55s ago 10m 145M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:37:29.802 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (9m) 22s ago 9m 17.7M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:37:29.802 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (10m) 22s ago 10m 17.3M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:37:29.802 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (6m) 55s ago 16m 525M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:37:29.802 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (5m) 22s ago 14m 457M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:37:29.802 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (3m) 55s ago 16m 41.9M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:37:29.802 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (2m) 22s ago 14m 35.7M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:37:29.802 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (5m) 55s ago 15m 10.8M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:37:29.803 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (5m) 22s ago 14m 13.0M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:37:29.803 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (2m) 55s ago 13m 83.2M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:37:29.803 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (97s) 55s ago 12m 86.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:37:29.803 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (60s) 55s ago 12m 11.2M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:37:29.803 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (25s) 22s ago 11m 14.4M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:37:29.803 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (11m) 22s ago 11m 213M 2240M 19.1.1-252-g48920dab b708f9119ac7 96094d3f68d0 2024-09-04T16:37:29.803 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (11m) 22s ago 11m 191M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:37:29.803 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (4m) 55s ago 14m 53.8M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:37:29.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.803+0000 7f2a51e3f640 1 -- 172.21.15.170:0/4020003858 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a38079e30 msgr2=0x7f2a3807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:29.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.803+0000 7f2a51e3f640 1 --2- 172.21.15.170:0/4020003858 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a38079e30 0x7f2a3807c2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c009fc0 tx=0x7f2a3c005f90 comp rx=0 tx=0).stop 2024-09-04T16:37:29.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.803+0000 7f2a51e3f640 1 -- 172.21.15.170:0/4020003858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a4c106820 msgr2=0x7f2a4c198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:29.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.803+0000 7f2a51e3f640 1 --2- 172.21.15.170:0/4020003858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a4c106820 0x7f2a4c198d40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2a34031460 tx=0x7f2a34004530 comp rx=0 tx=0).stop 2024-09-04T16:37:29.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.803+0000 7f2a51e3f640 1 -- 172.21.15.170:0/4020003858 shutdown_connections 2024-09-04T16:37:29.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.803+0000 7f2a51e3f640 1 --2- 172.21.15.170:0/4020003858 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2a38079e30 0x7f2a3807c2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.803+0000 7f2a51e3f640 1 --2- 172.21.15.170:0/4020003858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a4c106820 0x7f2a4c198d40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.803+0000 7f2a51e3f640 1 --2- 172.21.15.170:0/4020003858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2a4c100820 0x7f2a4c198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.803+0000 7f2a51e3f640 1 -- 172.21.15.170:0/4020003858 >> 172.21.15.170:0/4020003858 conn(0x7f2a4c0fc520 msgr2=0x7f2a4c0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:37:29.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.803+0000 7f2a51e3f640 1 -- 172.21.15.170:0/4020003858 shutdown_connections 2024-09-04T16:37:29.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.803+0000 7f2a51e3f640 1 -- 172.21.15.170:0/4020003858 wait complete. 2024-09-04T16:37:29.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.884+0000 7f7d95c21640 1 -- 172.21.15.170:0/3812010467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d901007e0 msgr2=0x7f7d90100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.884+0000 7f7d95c21640 1 --2- 172.21.15.170:0/3812010467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d901007e0 0x7f7d90100c40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009880 tx=0x7f7d8402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.885+0000 7f7d95c21640 1 -- 172.21.15.170:0/3812010467 shutdown_connections 2024-09-04T16:37:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.885+0000 7f7d95c21640 1 --2- 172.21.15.170:0/3812010467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d901007e0 0x7f7d90100c40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.885+0000 7f7d95c21640 1 --2- 172.21.15.170:0/3812010467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d901067e0 0x7f7d90106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.885+0000 7f7d95c21640 1 -- 172.21.15.170:0/3812010467 >> 172.21.15.170:0/3812010467 conn(0x7f7d900fc4c0 msgr2=0x7f7d900fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:37:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.885+0000 7f7d95c21640 1 -- 172.21.15.170:0/3812010467 shutdown_connections 2024-09-04T16:37:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.885+0000 7f7d95c21640 1 -- 172.21.15.170:0/3812010467 wait complete. 2024-09-04T16:37:29.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.885+0000 7f7d95c21640 1 Processor -- start 2024-09-04T16:37:29.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.885+0000 7f7d95c21640 1 -- start start 2024-09-04T16:37:29.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.886+0000 7f7d95c21640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d901007e0 0x7f7d9019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:29.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.886+0000 7f7d95c21640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d901067e0 0x7f7d9019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:29.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.886+0000 7f7d95c21640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9010dd10 con 0x7f7d901007e0 2024-09-04T16:37:29.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.886+0000 7f7d95c21640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9010db90 con 0x7f7d901067e0 2024-09-04T16:37:29.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.886+0000 7f7d8f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d901007e0 0x7f7d9019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:29.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.886+0000 7f7d8f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d901007e0 0x7f7d9019c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49078/0 (socket says 172.21.15.170:49078) 2024-09-04T16:37:29.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.886+0000 7f7d8f7fe640 1 -- 172.21.15.170:0/2375015531 learned_addr learned my addr 172.21.15.170:0/2375015531 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:37:29.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.886+0000 7f7d8effd640 1 --2- 172.21.15.170:0/2375015531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d901067e0 0x7f7d9019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:29.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.886+0000 7f7d8f7fe640 1 -- 172.21.15.170:0/2375015531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d901067e0 msgr2=0x7f7d9019cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:29.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.886+0000 7f7d8f7fe640 1 --2- 172.21.15.170:0/2375015531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d901067e0 0x7f7d9019cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:29.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.886+0000 7f7d8f7fe640 1 -- 172.21.15.170:0/2375015531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d90196700 con 0x7f7d901007e0 2024-09-04T16:37:29.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.886+0000 7f7d8f7fe640 1 --2- 172.21.15.170:0/2375015531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d901007e0 0x7f7d9019c630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000b420 tx=0x7f7d8000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:37:29.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.886+0000 7f7d8cff9640 1 -- 172.21.15.170:0/2375015531 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d80011630 con 0x7f7d901007e0 2024-09-04T16:37:29.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.886+0000 7f7d95c21640 1 -- 172.21.15.170:0/2375015531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d901969f0 con 0x7f7d901007e0 2024-09-04T16:37:29.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.886+0000 7f7d8cff9640 1 -- 172.21.15.170:0/2375015531 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d80016070 con 0x7f7d901007e0 2024-09-04T16:37:29.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.886+0000 7f7d8cff9640 1 -- 172.21.15.170:0/2375015531 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d80010d40 con 0x7f7d901007e0 2024-09-04T16:37:29.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.887+0000 7f7d95c21640 1 -- 172.21.15.170:0/2375015531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d90196f50 con 0x7f7d901007e0 2024-09-04T16:37:29.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.887+0000 7f7d95c21640 1 -- 172.21.15.170:0/2375015531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d90101f20 con 0x7f7d901007e0 2024-09-04T16:37:29.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.888+0000 7f7d8cff9640 1 -- 172.21.15.170:0/2375015531 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f7d8001b460 con 0x7f7d901007e0 2024-09-04T16:37:29.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.889+0000 7f7d8cff9640 1 --2- 172.21.15.170:0/2375015531 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7d78079e30 0x7f7d7807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:29.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.889+0000 7f7d8cff9640 1 -- 172.21.15.170:0/2375015531 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7f7d8009c110 con 0x7f7d901007e0 2024-09-04T16:37:29.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.889+0000 7f7d8effd640 1 --2- 172.21.15.170:0/2375015531 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7d78079e30 0x7f7d7807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:29.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.889+0000 7f7d8effd640 1 --2- 172.21.15.170:0/2375015531 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7d78079e30 0x7f7d7807c2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7d90197f50 tx=0x7f7d84031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:37:29.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:29.893+0000 7f7d8cff9640 1 -- 172.21.15.170:0/2375015531 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7d80063bd0 con 0x7f7d901007e0 2024-09-04T16:37:30.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.136+0000 7f7d95c21640 1 -- 172.21.15.170:0/2375015531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7d90108d70 con 0x7f7d901007e0 2024-09-04T16:37:30.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.136+0000 7f7d8cff9640 1 -- 172.21.15.170:0/2375015531 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f7d8006c080 con 0x7f7d901007e0 2024-09-04T16:37:30.137 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:37:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:37:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:37:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:37:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:37:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:37:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:37:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:37:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 2, 2024-09-04T16:37:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:37:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:37:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:37:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:37:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:37:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:37:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 6, 2024-09-04T16:37:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 8 2024-09-04T16:37:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:37:30.138 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:37:30.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.138+0000 7f7d95c21640 1 -- 172.21.15.170:0/2375015531 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7d78079e30 msgr2=0x7f7d7807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:30.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.138+0000 7f7d95c21640 1 --2- 172.21.15.170:0/2375015531 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7d78079e30 0x7f7d7807c2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7d90197f50 tx=0x7f7d84031400 comp rx=0 tx=0).stop 2024-09-04T16:37:30.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.138+0000 7f7d95c21640 1 -- 172.21.15.170:0/2375015531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d901007e0 msgr2=0x7f7d9019c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:30.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.138+0000 7f7d95c21640 1 --2- 172.21.15.170:0/2375015531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d901007e0 0x7f7d9019c630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000b420 tx=0x7f7d8000b8e0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.138+0000 7f7d95c21640 1 -- 172.21.15.170:0/2375015531 shutdown_connections 2024-09-04T16:37:30.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.138+0000 7f7d95c21640 1 --2- 172.21.15.170:0/2375015531 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7d78079e30 0x7f7d7807c2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.138+0000 7f7d95c21640 1 --2- 172.21.15.170:0/2375015531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d901067e0 0x7f7d9019cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.139+0000 7f7d95c21640 1 --2- 172.21.15.170:0/2375015531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d901007e0 0x7f7d9019c630 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.139+0000 7f7d95c21640 1 -- 172.21.15.170:0/2375015531 >> 172.21.15.170:0/2375015531 conn(0x7f7d900fc4c0 msgr2=0x7f7d900fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:37:30.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.139+0000 7f7d95c21640 1 -- 172.21.15.170:0/2375015531 shutdown_connections 2024-09-04T16:37:30.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.139+0000 7f7d95c21640 1 -- 172.21.15.170:0/2375015531 wait complete. 2024-09-04T16:37:30.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.226+0000 7fac182c4640 1 -- 172.21.15.170:0/1442082462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac101033f0 msgr2=0x7fac1010b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.226+0000 7fac182c4640 1 --2- 172.21.15.170:0/1442082462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac101033f0 0x7fac1010b8e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009880 tx=0x7fac0c02a530 comp rx=0 tx=0).stop 2024-09-04T16:37:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.226+0000 7fac182c4640 1 -- 172.21.15.170:0/1442082462 shutdown_connections 2024-09-04T16:37:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.226+0000 7fac182c4640 1 --2- 172.21.15.170:0/1442082462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac101033f0 0x7fac1010b8e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.226+0000 7fac182c4640 1 --2- 172.21.15.170:0/1442082462 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac10102ad0 0x7fac10102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.226+0000 7fac182c4640 1 -- 172.21.15.170:0/1442082462 >> 172.21.15.170:0/1442082462 conn(0x7fac100fc510 msgr2=0x7fac100fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:37:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.226+0000 7fac182c4640 1 -- 172.21.15.170:0/1442082462 shutdown_connections 2024-09-04T16:37:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.226+0000 7fac182c4640 1 -- 172.21.15.170:0/1442082462 wait complete. 2024-09-04T16:37:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.226+0000 7fac182c4640 1 Processor -- start 2024-09-04T16:37:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.227+0000 7fac182c4640 1 -- start start 2024-09-04T16:37:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.227+0000 7fac182c4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac10102ad0 0x7fac10100730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.227+0000 7fac182c4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac101033f0 0x7fac10100c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.227+0000 7fac182c4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fac1010ee60 con 0x7fac10102ad0 2024-09-04T16:37:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.227+0000 7fac182c4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fac1010ece0 con 0x7fac101033f0 2024-09-04T16:37:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.227+0000 7fac16060640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac10102ad0 0x7fac10100730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.227+0000 7fac16060640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac10102ad0 0x7fac10100730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49090/0 (socket says 172.21.15.170:49090) 2024-09-04T16:37:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.227+0000 7fac16060640 1 -- 172.21.15.170:0/1616716423 learned_addr learned my addr 172.21.15.170:0/1616716423 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:37:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.227+0000 7fac1585f640 1 --2- 172.21.15.170:0/1616716423 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac101033f0 0x7fac10100c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.227+0000 7fac16060640 1 -- 172.21.15.170:0/1616716423 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac101033f0 msgr2=0x7fac10100c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.227+0000 7fac16060640 1 --2- 172.21.15.170:0/1616716423 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac101033f0 0x7fac10100c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.227+0000 7fac16060640 1 -- 172.21.15.170:0/1616716423 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac101011b0 con 0x7fac10102ad0 2024-09-04T16:37:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.227+0000 7fac16060640 1 --2- 172.21.15.170:0/1616716423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac10102ad0 0x7fac10100730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac0000b420 tx=0x7fac0000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:37:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.227+0000 7fac077fe640 1 -- 172.21.15.170:0/1616716423 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac00011630 con 0x7fac10102ad0 2024-09-04T16:37:30.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.228+0000 7fac182c4640 1 -- 172.21.15.170:0/1616716423 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac101014a0 con 0x7fac10102ad0 2024-09-04T16:37:30.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.228+0000 7fac077fe640 1 -- 172.21.15.170:0/1616716423 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac00016070 con 0x7fac10102ad0 2024-09-04T16:37:30.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.228+0000 7fac077fe640 1 -- 172.21.15.170:0/1616716423 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac00010d40 con 0x7fac10102ad0 2024-09-04T16:37:30.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.228+0000 7fac182c4640 1 -- 172.21.15.170:0/1616716423 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac101a3ed0 con 0x7fac10102ad0 2024-09-04T16:37:30.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.229+0000 7fac182c4640 1 -- 172.21.15.170:0/1616716423 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac1006ac30 con 0x7fac10102ad0 2024-09-04T16:37:30.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.229+0000 7fac077fe640 1 -- 172.21.15.170:0/1616716423 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fac0001b480 con 0x7fac10102ad0 2024-09-04T16:37:30.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.230+0000 7fac077fe640 1 --2- 172.21.15.170:0/1616716423 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fabfc079e30 0x7fabfc07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:30.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.230+0000 7fac1585f640 1 --2- 172.21.15.170:0/1616716423 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fabfc079e30 0x7fabfc07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:30.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.230+0000 7fac077fe640 1 -- 172.21.15.170:0/1616716423 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7fac0009c1d0 con 0x7fac10102ad0 2024-09-04T16:37:30.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.231+0000 7fac1585f640 1 --2- 172.21.15.170:0/1616716423 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fabfc079e30 0x7fabfc07c2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fac101021c0 tx=0x7fac0c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:37:30.234 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:30.234 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:37:30.234 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:30 smithi193 ceph-mon[82547]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:37:30.234 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:30 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2375015531' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:37:30.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.234+0000 7fac077fe640 1 -- 172.21.15.170:0/1616716423 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fac00063c90 con 0x7fac10102ad0 2024-09-04T16:37:30.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.448+0000 7fac182c4640 1 -- 172.21.15.170:0/1616716423 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fac10108eb0 con 0x7fac10102ad0 2024-09-04T16:37:30.449 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:30.449 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:37:30.450 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:30 smithi170 ceph-mon[113855]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:37:30.450 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:30 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2375015531' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:37:30.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.449+0000 7fac077fe640 1 -- 172.21.15.170:0/1616716423 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2036 (secure 0 0 0) 0x7fac00067e00 con 0x7fac10102ad0 2024-09-04T16:37:30.450 INFO:teuthology.orchestra.run.smithi170.stdout:e15 2024-09-04T16:37:30.450 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:27:39:151187+0000 2024-09-04T16:37:30.450 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 15 2024-09-04T16:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-04T16:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:27:39.151182+0000 2024-09-04T16:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:37:30.451 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:37:30.452 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:37:30.452 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:37:30.452 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:37:30.452 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 45 2024-09-04T16:37:30.452 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:37:30.452 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:37:30.452 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:37:30.452 INFO:teuthology.orchestra.run.smithi170.stdout:up {0=14562,1=14578} 2024-09-04T16:37:30.452 INFO:teuthology.orchestra.run.smithi170.stdout:failed 2024-09-04T16:37:30.452 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:37:30.452 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:37:30.452 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:37:30.452 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:37:30.453 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:37:30.453 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:37:30.453 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:37:30.453 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:37:30.453 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 14562 members: 14562,14578 2024-09-04T16:37:30.453 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{0:14562} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:37:30.453 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{1:14578} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:37:30.453 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:37:30.453 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:37:30.453 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:37:30.453 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:37:30.453 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:24315} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.193:6826/288890560,v1:172.21.15.193:6827/288890560] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:37:30.453 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:24319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1128257367,v1:172.21.15.193:6825/1128257367] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:37:30.454 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 15 2024-09-04T16:37:30.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.452+0000 7fac182c4640 1 -- 172.21.15.170:0/1616716423 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fabfc079e30 msgr2=0x7fabfc07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:30.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.452+0000 7fac182c4640 1 --2- 172.21.15.170:0/1616716423 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fabfc079e30 0x7fabfc07c2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fac101021c0 tx=0x7fac0c031400 comp rx=0 tx=0).stop 2024-09-04T16:37:30.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.452+0000 7fac182c4640 1 -- 172.21.15.170:0/1616716423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac10102ad0 msgr2=0x7fac10100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:30.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.452+0000 7fac182c4640 1 --2- 172.21.15.170:0/1616716423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac10102ad0 0x7fac10100730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac0000b420 tx=0x7fac0000b8e0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.452+0000 7fac182c4640 1 -- 172.21.15.170:0/1616716423 shutdown_connections 2024-09-04T16:37:30.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.452+0000 7fac182c4640 1 --2- 172.21.15.170:0/1616716423 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fabfc079e30 0x7fabfc07c2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.452+0000 7fac182c4640 1 --2- 172.21.15.170:0/1616716423 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac101033f0 0x7fac10100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.452+0000 7fac182c4640 1 --2- 172.21.15.170:0/1616716423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac10102ad0 0x7fac10100730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.452+0000 7fac182c4640 1 -- 172.21.15.170:0/1616716423 >> 172.21.15.170:0/1616716423 conn(0x7fac100fc510 msgr2=0x7fac10106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:37:30.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.452+0000 7fac182c4640 1 -- 172.21.15.170:0/1616716423 shutdown_connections 2024-09-04T16:37:30.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.452+0000 7fac182c4640 1 -- 172.21.15.170:0/1616716423 wait complete. 2024-09-04T16:37:30.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.535+0000 7f0704585640 1 -- 172.21.15.170:0/4233945884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06fc1007e0 msgr2=0x7f06fc100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:30.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.535+0000 7f0704585640 1 --2- 172.21.15.170:0/4233945884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06fc1007e0 0x7f06fc100c40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009880 tx=0x7f06ec02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.536+0000 7f0704585640 1 -- 172.21.15.170:0/4233945884 shutdown_connections 2024-09-04T16:37:30.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.536+0000 7f0704585640 1 --2- 172.21.15.170:0/4233945884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06fc1007e0 0x7f06fc100c40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.536+0000 7f0704585640 1 --2- 172.21.15.170:0/4233945884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06fc1067e0 0x7f06fc106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.536+0000 7f0704585640 1 -- 172.21.15.170:0/4233945884 >> 172.21.15.170:0/4233945884 conn(0x7f06fc0fc4c0 msgr2=0x7f06fc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:37:30.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.536+0000 7f0704585640 1 -- 172.21.15.170:0/4233945884 shutdown_connections 2024-09-04T16:37:30.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.536+0000 7f0704585640 1 -- 172.21.15.170:0/4233945884 wait complete. 2024-09-04T16:37:30.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.536+0000 7f0704585640 1 Processor -- start 2024-09-04T16:37:30.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.536+0000 7f0704585640 1 -- start start 2024-09-04T16:37:30.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.536+0000 7f0704585640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06fc1007e0 0x7f06fc0fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:30.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.536+0000 7f0704585640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06fc1067e0 0x7f06fc0fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:30.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.536+0000 7f0704585640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc10dcb0 con 0x7f06fc1067e0 2024-09-04T16:37:30.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.536+0000 7f0704585640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc10db30 con 0x7f06fc1007e0 2024-09-04T16:37:30.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.537+0000 7f0701b20640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06fc1067e0 0x7f06fc0fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:30.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.537+0000 7f0701b20640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06fc1067e0 0x7f06fc0fd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49108/0 (socket says 172.21.15.170:49108) 2024-09-04T16:37:30.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.537+0000 7f0701b20640 1 -- 172.21.15.170:0/1603031321 learned_addr learned my addr 172.21.15.170:0/1603031321 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:37:30.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.537+0000 7f0702321640 1 --2- 172.21.15.170:0/1603031321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06fc1007e0 0x7f06fc0fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:30.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.537+0000 7f0701b20640 1 -- 172.21.15.170:0/1603031321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06fc1007e0 msgr2=0x7f06fc0fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:30.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.537+0000 7f0701b20640 1 --2- 172.21.15.170:0/1603031321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06fc1007e0 0x7f06fc0fcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.537+0000 7f0701b20640 1 -- 172.21.15.170:0/1603031321 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06fc0fd690 con 0x7f06fc1067e0 2024-09-04T16:37:30.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.537+0000 7f0701b20640 1 --2- 172.21.15.170:0/1603031321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06fc1067e0 0x7f06fc0fd150 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f06ec031460 tx=0x7f06ec004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:37:30.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.537+0000 7f06f37fe640 1 -- 172.21.15.170:0/1603031321 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06ec03f070 con 0x7f06fc1067e0 2024-09-04T16:37:30.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.537+0000 7f0704585640 1 -- 172.21.15.170:0/1603031321 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06fc0fd920 con 0x7f06fc1067e0 2024-09-04T16:37:30.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.537+0000 7f06f37fe640 1 -- 172.21.15.170:0/1603031321 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06ec0035f0 con 0x7f06fc1067e0 2024-09-04T16:37:30.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.537+0000 7f06f37fe640 1 -- 172.21.15.170:0/1603031321 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06ec035030 con 0x7f06fc1067e0 2024-09-04T16:37:30.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.537+0000 7f0704585640 1 -- 172.21.15.170:0/1603031321 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06fc1a3df0 con 0x7f06fc1067e0 2024-09-04T16:37:30.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.538+0000 7f0704585640 1 -- 172.21.15.170:0/1603031321 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06fc101f20 con 0x7f06fc1067e0 2024-09-04T16:37:30.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.539+0000 7f06f37fe640 1 -- 172.21.15.170:0/1603031321 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f06ec042070 con 0x7f06fc1067e0 2024-09-04T16:37:30.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.539+0000 7f06f37fe640 1 --2- 172.21.15.170:0/1603031321 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f06e8079e30 0x7f06e807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:30.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.539+0000 7f06f37fe640 1 -- 172.21.15.170:0/1603031321 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7f06ec0bd2d0 con 0x7f06fc1067e0 2024-09-04T16:37:30.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.539+0000 7f0702321640 1 --2- 172.21.15.170:0/1603031321 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f06e8079e30 0x7f06e807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:30.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.540+0000 7f0702321640 1 --2- 172.21.15.170:0/1603031321 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f06e8079e30 0x7f06e807c2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009bd0 tx=0x7f06f8005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:37:30.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.544+0000 7f06f37fe640 1 -- 172.21.15.170:0/1603031321 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f06ec088f00 con 0x7f06fc1067e0 2024-09-04T16:37:30.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.734+0000 7f0704585640 1 -- 172.21.15.170:0/1603031321 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f06fc062630 con 0x7f06e8079e30 2024-09-04T16:37:30.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.735+0000 7f06f37fe640 1 -- 172.21.15.170:0/1603031321 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f06fc062630 con 0x7f06e8079e30 2024-09-04T16:37:30.736 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:37:30.736 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:37:30.736 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:37:30.736 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:37:30.736 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:37:30.736 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-04T16:37:30.736 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:37:30.736 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-04T16:37:30.736 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:37:30.736 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "10/23 daemons upgraded", 2024-09-04T16:37:30.737 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-04T16:37:30.737 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:37:30.737 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:37:30.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.737+0000 7f0704585640 1 -- 172.21.15.170:0/1603031321 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f06e8079e30 msgr2=0x7f06e807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:30.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.737+0000 7f0704585640 1 --2- 172.21.15.170:0/1603031321 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f06e8079e30 0x7f06e807c2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009bd0 tx=0x7f06f8005f90 comp rx=0 tx=0).stop 2024-09-04T16:37:30.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.737+0000 7f0704585640 1 -- 172.21.15.170:0/1603031321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06fc1067e0 msgr2=0x7f06fc0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:30.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.737+0000 7f0704585640 1 --2- 172.21.15.170:0/1603031321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06fc1067e0 0x7f06fc0fd150 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f06ec031460 tx=0x7f06ec004530 comp rx=0 tx=0).stop 2024-09-04T16:37:30.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.737+0000 7f0704585640 1 -- 172.21.15.170:0/1603031321 shutdown_connections 2024-09-04T16:37:30.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.737+0000 7f0704585640 1 --2- 172.21.15.170:0/1603031321 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f06e8079e30 0x7f06e807c2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.738+0000 7f0704585640 1 --2- 172.21.15.170:0/1603031321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06fc1067e0 0x7f06fc0fd150 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.738+0000 7f0704585640 1 --2- 172.21.15.170:0/1603031321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06fc1007e0 0x7f06fc0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.738+0000 7f0704585640 1 -- 172.21.15.170:0/1603031321 >> 172.21.15.170:0/1603031321 conn(0x7f06fc0fc4c0 msgr2=0x7f06fc069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:37:30.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.738+0000 7f0704585640 1 -- 172.21.15.170:0/1603031321 shutdown_connections 2024-09-04T16:37:30.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.738+0000 7f0704585640 1 -- 172.21.15.170:0/1603031321 wait complete. 2024-09-04T16:37:30.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.819+0000 7f898b848640 1 -- 172.21.15.170:0/1519196546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8984106820 msgr2=0x7f8984106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:30.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.819+0000 7f898b848640 1 --2- 172.21.15.170:0/1519196546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8984106820 0x7f8984106c00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8980009880 tx=0x7f898002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.819+0000 7f898b848640 1 -- 172.21.15.170:0/1519196546 shutdown_connections 2024-09-04T16:37:30.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.819+0000 7f898b848640 1 --2- 172.21.15.170:0/1519196546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8984100820 0x7f8984100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.819+0000 7f898b848640 1 --2- 172.21.15.170:0/1519196546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8984106820 0x7f8984106c00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.819+0000 7f898b848640 1 -- 172.21.15.170:0/1519196546 >> 172.21.15.170:0/1519196546 conn(0x7f89840fc520 msgr2=0x7f89840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:37:30.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.819+0000 7f898b848640 1 -- 172.21.15.170:0/1519196546 shutdown_connections 2024-09-04T16:37:30.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.819+0000 7f898b848640 1 -- 172.21.15.170:0/1519196546 wait complete. 2024-09-04T16:37:30.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.820+0000 7f898b848640 1 Processor -- start 2024-09-04T16:37:30.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.820+0000 7f898b848640 1 -- start start 2024-09-04T16:37:30.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.820+0000 7f898b848640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8984100820 0x7f898419f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:30.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.820+0000 7f898b848640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8984106820 0x7f898419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:30.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.820+0000 7f898b848640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8984110fd0 con 0x7f8984106820 2024-09-04T16:37:30.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.820+0000 7f898b848640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8984110e50 con 0x7f8984100820 2024-09-04T16:37:30.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.820+0000 7f8988de3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8984106820 0x7f898419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:30.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.820+0000 7f8988de3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8984106820 0x7f898419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49120/0 (socket says 172.21.15.170:49120) 2024-09-04T16:37:30.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.820+0000 7f8988de3640 1 -- 172.21.15.170:0/229138605 learned_addr learned my addr 172.21.15.170:0/229138605 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:37:30.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.820+0000 7f89895e4640 1 --2- 172.21.15.170:0/229138605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8984100820 0x7f898419f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:30.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.821+0000 7f8988de3640 1 -- 172.21.15.170:0/229138605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8984100820 msgr2=0x7f898419f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:30.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.821+0000 7f8988de3640 1 --2- 172.21.15.170:0/229138605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8984100820 0x7f898419f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:30.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.821+0000 7f8988de3640 1 -- 172.21.15.170:0/229138605 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89841999a0 con 0x7f8984106820 2024-09-04T16:37:30.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.821+0000 7f8988de3640 1 --2- 172.21.15.170:0/229138605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8984106820 0x7f898419fd20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f897400d8d0 tx=0x7f897400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:37:30.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.821+0000 7f897a7fc640 1 -- 172.21.15.170:0/229138605 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8974017070 con 0x7f8984106820 2024-09-04T16:37:30.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.821+0000 7f898b848640 1 -- 172.21.15.170:0/229138605 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8984199c90 con 0x7f8984106820 2024-09-04T16:37:30.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.821+0000 7f897a7fc640 1 -- 172.21.15.170:0/229138605 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8974010460 con 0x7f8984106820 2024-09-04T16:37:30.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.821+0000 7f897a7fc640 1 -- 172.21.15.170:0/229138605 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f897400f5f0 con 0x7f8984106820 2024-09-04T16:37:30.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.821+0000 7f898b848640 1 -- 172.21.15.170:0/229138605 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f898419a220 con 0x7f8984106820 2024-09-04T16:37:30.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.822+0000 7f898b848640 1 -- 172.21.15.170:0/229138605 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8984101f60 con 0x7f8984106820 2024-09-04T16:37:30.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.823+0000 7f897a7fc640 1 -- 172.21.15.170:0/229138605 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f8974009a30 con 0x7f8984106820 2024-09-04T16:37:30.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.823+0000 7f897a7fc640 1 --2- 172.21.15.170:0/229138605 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8970079e30 0x7f897007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:37:30.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.823+0000 7f897a7fc640 1 -- 172.21.15.170:0/229138605 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7f897409c860 con 0x7f8984106820 2024-09-04T16:37:30.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.823+0000 7f89895e4640 1 --2- 172.21.15.170:0/229138605 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8970079e30 0x7f897007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:37:30.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.824+0000 7f89895e4640 1 --2- 172.21.15.170:0/229138605 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8970079e30 0x7f897007c2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8980000c00 tx=0x7f8980031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:37:30.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:30.827+0000 7f897a7fc640 1 -- 172.21.15.170:0/229138605 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8974068490 con 0x7f8984106820 2024-09-04T16:37:30.848 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:30 smithi193 systemd[1]: Stopping Ceph osd.4 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:37:31.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:31.070+0000 7f898b848640 1 -- 172.21.15.170:0/229138605 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f898419aed0 con 0x7f8984106820 2024-09-04T16:37:31.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:31.071+0000 7f897a7fc640 1 -- 172.21.15.170:0/229138605 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f897406ceb0 con 0x7f8984106820 2024-09-04T16:37:31.073 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-04T16:37:31.073 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:37:31.073 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:37:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:31.073+0000 7f898b848640 1 -- 172.21.15.170:0/229138605 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8970079e30 msgr2=0x7f897007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:31.073+0000 7f898b848640 1 --2- 172.21.15.170:0/229138605 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8970079e30 0x7f897007c2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8980000c00 tx=0x7f8980031400 comp rx=0 tx=0).stop 2024-09-04T16:37:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:31.073+0000 7f898b848640 1 -- 172.21.15.170:0/229138605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8984106820 msgr2=0x7f898419fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:37:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:31.073+0000 7f898b848640 1 --2- 172.21.15.170:0/229138605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8984106820 0x7f898419fd20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f897400d8d0 tx=0x7f897400dd90 comp rx=0 tx=0).stop 2024-09-04T16:37:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:31.073+0000 7f898b848640 1 -- 172.21.15.170:0/229138605 shutdown_connections 2024-09-04T16:37:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:31.073+0000 7f898b848640 1 --2- 172.21.15.170:0/229138605 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8970079e30 0x7f897007c2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:31.073+0000 7f898b848640 1 --2- 172.21.15.170:0/229138605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8984106820 0x7f898419fd20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:31.073+0000 7f898b848640 1 --2- 172.21.15.170:0/229138605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8984100820 0x7f898419f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:37:31.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:31.073+0000 7f898b848640 1 -- 172.21.15.170:0/229138605 >> 172.21.15.170:0/229138605 conn(0x7f89840fc520 msgr2=0x7f89840fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:37:31.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:31.073+0000 7f898b848640 1 -- 172.21.15.170:0/229138605 shutdown_connections 2024-09-04T16:37:31.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:37:31.073+0000 7f898b848640 1 -- 172.21.15.170:0/229138605 wait complete. 2024-09-04T16:37:31.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:30 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[48612]: 2024-09-04T16:37:30.847+0000 7fe5a442b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T16:37:31.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:30 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[48612]: 2024-09-04T16:37:30.847+0000 7fe5a442b640 -1 osd.4 67 *** Got signal Terminated *** 2024-09-04T16:37:31.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:30 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[48612]: 2024-09-04T16:37:30.847+0000 7fe5a442b640 -1 osd.4 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-04T16:37:31.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:31 smithi170 ceph-mon[113855]: from='client.44233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:37:31.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:31 smithi170 ceph-mon[113855]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:37:31.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:31 smithi170 ceph-mon[113855]: pgmap v219: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:31.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:31 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1616716423' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:37:31.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:31 smithi170 ceph-mon[113855]: osd.4 marked itself down and dead 2024-09-04T16:37:31.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:31 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/229138605' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:37:31.573 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:31 smithi193 ceph-mon[82547]: from='client.44233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:37:31.573 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:31 smithi193 ceph-mon[82547]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:37:31.573 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:31 smithi193 ceph-mon[82547]: pgmap v219: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:31.573 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:31 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1616716423' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:37:31.573 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:31 smithi193 ceph-mon[82547]: osd.4 marked itself down and dead 2024-09-04T16:37:31.573 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:31 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/229138605' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:37:31.848 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:31 smithi193 podman[95097]: 2024-09-04 16:37:31.573145239 +0000 UTC m=+0.828250765 container died 96094d3f68d03c4f121c7ae7af7a69d6691d3c412dc18c68efe4a3323625fae5 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-48920da, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-04T16:37:32.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:31 smithi193 podman[95097]: 2024-09-04 16:37:31.941357112 +0000 UTC m=+1.196462622 container cleanup 96094d3f68d03c4f121c7ae7af7a69d6691d3c412dc18c68efe4a3323625fae5 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4, RELEASE=squid-48920da, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-04T16:37:32.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:31 smithi193 bash[95097]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4 2024-09-04T16:37:32.599 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:32 smithi193 podman[95111]: 2024-09-04 16:37:32.248643181 +0000 UTC m=+0.669180277 container remove 96094d3f68d03c4f121c7ae7af7a69d6691d3c412dc18c68efe4a3323625fae5 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-48920da, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-04T16:37:32.599 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:32 smithi193 ceph-mon[82547]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:37:32.599 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:32 smithi193 ceph-mon[82547]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-04T16:37:32.600 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:32 smithi193 ceph-mon[82547]: osdmap e68: 6 total, 5 up, 6 in 2024-09-04T16:37:32.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:32 smithi170 ceph-mon[113855]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:37:32.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:32 smithi170 ceph-mon[113855]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-04T16:37:32.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:32 smithi170 ceph-mon[113855]: osdmap e68: 6 total, 5 up, 6 in 2024-09-04T16:37:32.852 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:32 smithi193 podman[95200]: 2024-09-04 16:37:32.502122538 +0000 UTC m=+0.015908510 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:37:32.852 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:32 smithi193 podman[95200]: 2024-09-04 16:37:32.608104924 +0000 UTC m=+0.121890933 container create adb426b5103649ff471ff6d8f47996130b17df929e52e474f4a73e5f235bbbda (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True) 2024-09-04T16:37:32.852 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:32 smithi193 podman[95200]: 2024-09-04 16:37:32.852124004 +0000 UTC m=+0.365909973 container init adb426b5103649ff471ff6d8f47996130b17df929e52e474f4a73e5f235bbbda (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-04T16:37:33.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:32 smithi193 podman[95200]: 2024-09-04 16:37:32.855446889 +0000 UTC m=+0.369232862 container start adb426b5103649ff471ff6d8f47996130b17df929e52e474f4a73e5f235bbbda (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-04T16:37:33.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:32 smithi193 podman[95200]: 2024-09-04 16:37:32.935376585 +0000 UTC m=+0.449162557 container attach adb426b5103649ff471ff6d8f47996130b17df929e52e474f4a73e5f235bbbda (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-04T16:37:33.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:33 smithi193 podman[95200]: 2024-09-04 16:37:33.048334176 +0000 UTC m=+0.562120140 container died adb426b5103649ff471ff6d8f47996130b17df929e52e474f4a73e5f235bbbda (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD) 2024-09-04T16:37:33.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:33 smithi170 ceph-mon[113855]: osdmap e69: 6 total, 5 up, 6 in 2024-09-04T16:37:33.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:33 smithi170 ceph-mon[113855]: pgmap v222: 65 pgs: 1 activating+undersized, 5 active+undersized, 2 peering, 4 stale+active+clean, 5 active+undersized+degraded, 48 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26/312 objects degraded (8.333%) 2024-09-04T16:37:33.655 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:33 smithi193 ceph-mon[82547]: osdmap e69: 6 total, 5 up, 6 in 2024-09-04T16:37:33.655 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:33 smithi193 ceph-mon[82547]: pgmap v222: 65 pgs: 1 activating+undersized, 5 active+undersized, 2 peering, 4 stale+active+clean, 5 active+undersized+degraded, 48 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26/312 objects degraded (8.333%) 2024-09-04T16:37:33.906 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:33 smithi193 podman[95224]: 2024-09-04 16:37:33.655412809 +0000 UTC m=+0.601366345 container remove adb426b5103649ff471ff6d8f47996130b17df929e52e474f4a73e5f235bbbda (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-04T16:37:33.906 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:33 smithi193 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-04T16:37:33.906 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:33 smithi193 systemd[1]: Stopped Ceph osd.4 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:37:33.906 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:33 smithi193 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.4.service: Consumed 52.583s CPU time. 2024-09-04T16:37:33.906 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:33 smithi193 systemd[1]: Starting Ceph osd.4 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:37:34.189 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:34 smithi193 podman[95323]: 2024-09-04 16:37:34.000353522 +0000 UTC m=+0.016640480 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:37:34.189 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:34 smithi193 podman[95323]: 2024-09-04 16:37:34.123060976 +0000 UTC m=+0.139347934 container create ca1684d8d9599c9188c7e5f68ad93ccf8b83643ba70fe292cf0b13524106a381 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-activate, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5) 2024-09-04T16:37:34.459 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:34 smithi193 ceph-mon[82547]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-04T16:37:34.459 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:34 smithi193 ceph-mon[82547]: Health check failed: Degraded data redundancy: 26/312 objects degraded (8.333%), 5 pgs degraded (PG_DEGRADED) 2024-09-04T16:37:34.460 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:34 smithi193 podman[95323]: 2024-09-04 16:37:34.384471044 +0000 UTC m=+0.400758002 container init ca1684d8d9599c9188c7e5f68ad93ccf8b83643ba70fe292cf0b13524106a381 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-04T16:37:34.460 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:34 smithi193 podman[95323]: 2024-09-04 16:37:34.387883709 +0000 UTC m=+0.404170673 container start ca1684d8d9599c9188c7e5f68ad93ccf8b83643ba70fe292cf0b13524106a381 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-activate, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-04T16:37:34.460 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:34 smithi193 podman[95323]: 2024-09-04 16:37:34.459168723 +0000 UTC m=+0.475455689 container attach ca1684d8d9599c9188c7e5f68ad93ccf8b83643ba70fe292cf0b13524106a381 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-04T16:37:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:34 smithi170 ceph-mon[113855]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-04T16:37:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:34 smithi170 ceph-mon[113855]: Health check failed: Degraded data redundancy: 26/312 objects degraded (8.333%), 5 pgs degraded (PG_DEGRADED) 2024-09-04T16:37:34.906 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:34 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-activate[95338]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:37:34.906 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:34 smithi193 bash[95323]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:37:34.906 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:34 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-activate[95338]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:37:34.906 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:34 smithi193 bash[95323]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:37:35.541 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:35 smithi193 ceph-mon[82547]: pgmap v223: 65 pgs: 1 activating+undersized, 8 active+undersized, 2 peering, 3 stale+active+clean, 7 active+undersized+degraded, 44 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 32/312 objects degraded (10.256%) 2024-09-04T16:37:35.541 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:35 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-activate[95338]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-04T16:37:35.541 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:35 smithi193 bash[95323]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-04T16:37:35.542 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:35 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-activate[95338]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-04T16:37:35.542 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:35 smithi193 bash[95323]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-04T16:37:35.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:35 smithi170 ceph-mon[113855]: pgmap v223: 65 pgs: 1 activating+undersized, 8 active+undersized, 2 peering, 3 stale+active+clean, 7 active+undersized+degraded, 44 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 32/312 objects degraded (10.256%) 2024-09-04T16:37:35.862 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:35 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-activate[95338]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-04T16:37:35.862 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:35 smithi193 bash[95323]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-04T16:37:35.862 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:35 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-activate[95338]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-04T16:37:35.863 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:35 smithi193 bash[95323]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-04T16:37:35.863 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:35 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-activate[95338]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-04T16:37:35.863 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:35 smithi193 bash[95323]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-04T16:37:35.863 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:35 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-activate[95338]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-04T16:37:35.863 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:35 smithi193 bash[95323]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-04T16:37:35.863 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:35 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-activate[95338]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-04T16:37:35.863 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:35 smithi193 bash[95323]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-04T16:37:35.863 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:35 smithi193 podman[95323]: 2024-09-04 16:37:35.570704427 +0000 UTC m=+1.586991395 container died ca1684d8d9599c9188c7e5f68ad93ccf8b83643ba70fe292cf0b13524106a381 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-activate, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-04T16:37:36.406 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:36 smithi193 podman[95475]: 2024-09-04 16:37:36.137530003 +0000 UTC m=+0.559990252 container remove ca1684d8d9599c9188c7e5f68ad93ccf8b83643ba70fe292cf0b13524106a381 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-04T16:37:36.407 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:36 smithi193 podman[95533]: 2024-09-04 16:37:36.247787888 +0000 UTC m=+0.016118697 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:37:36.407 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:36 smithi193 podman[95533]: 2024-09-04 16:37:36.371785579 +0000 UTC m=+0.140116423 container create b402c5732f0b11111a3e1ae021a90e78d8cbd9333735c281bee1cae7e31bf551 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-04T16:37:36.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:36 smithi170 ceph-mon[113855]: pgmap v224: 65 pgs: 1 activating+undersized, 16 active+undersized, 2 peering, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-04T16:37:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:36 smithi193 ceph-mon[82547]: pgmap v224: 65 pgs: 1 activating+undersized, 16 active+undersized, 2 peering, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-04T16:37:36.906 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:36 smithi193 podman[95533]: 2024-09-04 16:37:36.598935488 +0000 UTC m=+0.367266291 container init b402c5732f0b11111a3e1ae021a90e78d8cbd9333735c281bee1cae7e31bf551 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-04T16:37:36.906 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:36 smithi193 podman[95533]: 2024-09-04 16:37:36.6021999 +0000 UTC m=+0.370530712 container start b402c5732f0b11111a3e1ae021a90e78d8cbd9333735c281bee1cae7e31bf551 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True) 2024-09-04T16:37:36.906 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:36 smithi193 ceph-osd[95552]: -- 172.21.15.193:0/3964112 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55927f5061e0 con 0x55927e713c00 2024-09-04T16:37:36.907 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:36 smithi193 bash[95533]: b402c5732f0b11111a3e1ae021a90e78d8cbd9333735c281bee1cae7e31bf551 2024-09-04T16:37:36.907 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:36 smithi193 systemd[1]: Started Ceph osd.4 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:37:38.055 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:37 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:38.055 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:37 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:38.055 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:37 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:37:38.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:37 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:38.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:37 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:38.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:37 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:37:38.406 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:38 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T16:37:38.264+0000 7f1f2e2d7640 -1 Falling back to public interface 2024-09-04T16:37:39.050 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:38 smithi193 ceph-mon[82547]: pgmap v225: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-04T16:37:39.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:38 smithi170 ceph-mon[113855]: pgmap v225: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-04T16:37:40.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:39 smithi170 ceph-mon[113855]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-04T16:37:40.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:39 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:40.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:39 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:40.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:39 smithi193 ceph-mon[82547]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-04T16:37:40.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:39 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:40.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:39 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:41.549 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:41 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:41.549 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:41 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:41.549 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:41 smithi193 ceph-mon[82547]: pgmap v226: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-04T16:37:41.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:41 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:41.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:41 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:41.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:41 smithi170 ceph-mon[113855]: pgmap v226: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-04T16:37:42.596 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:42 smithi193 ceph-mon[82547]: Health check update: Degraded data redundancy: 52/312 objects degraded (16.667%), 15 pgs degraded (PG_DEGRADED) 2024-09-04T16:37:42.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:42 smithi170 ceph-mon[113855]: Health check update: Degraded data redundancy: 52/312 objects degraded (16.667%), 15 pgs degraded (PG_DEGRADED) 2024-09-04T16:37:43.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:43 smithi193 ceph-mon[82547]: pgmap v227: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-04T16:37:43.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:43 smithi170 ceph-mon[113855]: pgmap v227: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-04T16:37:44.406 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:43 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T16:37:43.956+0000 7f1f2e2d7640 -1 osd.4 67 log_to_monitors true 2024-09-04T16:37:44.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:44.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:44.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:37:44.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:37:44.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:44.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:37:44.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:37:44.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:37:44.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:37:44.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-04T16:37:44.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:44 smithi193 ceph-mon[82547]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-04T16:37:44.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:44 smithi193 ceph-mon[82547]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-04T16:37:44.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:44 smithi193 ceph-mon[82547]: from='osd.4 [v2:172.21.15.193:6808/2844405015,v1:172.21.15.193:6809/2844405015]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-04T16:37:44.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:44 smithi193 ceph-mon[82547]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-04T16:37:44.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:44.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:37:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:37:44.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:37:44.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:44.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:37:44.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:37:44.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:37:44.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:37:44.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-04T16:37:44.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:44 smithi170 ceph-mon[113855]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-04T16:37:44.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:44 smithi170 ceph-mon[113855]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-04T16:37:44.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:44 smithi170 ceph-mon[113855]: from='osd.4 [v2:172.21.15.193:6808/2844405015,v1:172.21.15.193:6809/2844405015]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-04T16:37:44.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:44 smithi170 ceph-mon[113855]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-04T16:37:44.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:44.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:37:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:45 smithi170 ceph-mon[113855]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-04T16:37:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:45 smithi170 ceph-mon[113855]: osdmap e70: 6 total, 5 up, 6 in 2024-09-04T16:37:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:45 smithi170 ceph-mon[113855]: from='osd.4 [v2:172.21.15.193:6808/2844405015,v1:172.21.15.193:6809/2844405015]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-04T16:37:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:45 smithi170 ceph-mon[113855]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-04T16:37:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:45 smithi170 ceph-mon[113855]: pgmap v229: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-04T16:37:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:45 smithi170 ceph-mon[113855]: from='osd.4 ' entity='osd.4' 2024-09-04T16:37:45.656 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 16:37:45 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T16:37:45.184+0000 7f1f22079640 -1 osd.4 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-04T16:37:45.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:45 smithi193 ceph-mon[82547]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-04T16:37:45.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:45 smithi193 ceph-mon[82547]: osdmap e70: 6 total, 5 up, 6 in 2024-09-04T16:37:45.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:45 smithi193 ceph-mon[82547]: from='osd.4 [v2:172.21.15.193:6808/2844405015,v1:172.21.15.193:6809/2844405015]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-04T16:37:45.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:45 smithi193 ceph-mon[82547]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-04T16:37:45.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:45 smithi193 ceph-mon[82547]: pgmap v229: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-04T16:37:45.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:45 smithi193 ceph-mon[82547]: from='osd.4 ' entity='osd.4' 2024-09-04T16:37:46.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:46 smithi170 ceph-mon[113855]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-04T16:37:46.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:46 smithi170 ceph-mon[113855]: osd.4 [v2:172.21.15.193:6808/2844405015,v1:172.21.15.193:6809/2844405015] boot 2024-09-04T16:37:46.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:46 smithi170 ceph-mon[113855]: osdmap e71: 6 total, 6 up, 6 in 2024-09-04T16:37:46.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:46 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-04T16:37:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:46 smithi193 ceph-mon[82547]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-04T16:37:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:46 smithi193 ceph-mon[82547]: osd.4 [v2:172.21.15.193:6808/2844405015,v1:172.21.15.193:6809/2844405015] boot 2024-09-04T16:37:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:46 smithi193 ceph-mon[82547]: osdmap e71: 6 total, 6 up, 6 in 2024-09-04T16:37:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:46 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-04T16:37:47.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:47 smithi170 ceph-mon[113855]: pgmap v231: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-04T16:37:47.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:47 smithi170 ceph-mon[113855]: osdmap e72: 6 total, 6 up, 6 in 2024-09-04T16:37:47.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:47 smithi193 ceph-mon[82547]: pgmap v231: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 52/312 objects degraded (16.667%) 2024-09-04T16:37:47.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:47 smithi193 ceph-mon[82547]: osdmap e72: 6 total, 6 up, 6 in 2024-09-04T16:37:48.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:48 smithi170 ceph-mon[113855]: pgmap v233: 65 pgs: 1 activating, 1 peering, 13 active+undersized, 10 active+undersized+degraded, 40 active+clean; 245 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 26/312 objects degraded (8.333%) 2024-09-04T16:37:48.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:48 smithi170 ceph-mon[113855]: Health check update: Degraded data redundancy: 26/312 objects degraded (8.333%), 10 pgs degraded (PG_DEGRADED) 2024-09-04T16:37:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:48 smithi193 ceph-mon[82547]: pgmap v233: 65 pgs: 1 activating, 1 peering, 13 active+undersized, 10 active+undersized+degraded, 40 active+clean; 245 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 26/312 objects degraded (8.333%) 2024-09-04T16:37:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:48 smithi193 ceph-mon[82547]: Health check update: Degraded data redundancy: 26/312 objects degraded (8.333%), 10 pgs degraded (PG_DEGRADED) 2024-09-04T16:37:50.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:50 smithi170 ceph-mon[113855]: pgmap v234: 65 pgs: 1 activating, 1 peering, 3 active+undersized, 4 active+undersized+degraded, 56 active+clean; 245 MiB data, 1011 MiB used, 535 GiB / 536 GiB avail; 10/312 objects degraded (3.205%) 2024-09-04T16:37:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:50 smithi193 ceph-mon[82547]: pgmap v234: 65 pgs: 1 activating, 1 peering, 3 active+undersized, 4 active+undersized+degraded, 56 active+clean; 245 MiB data, 1011 MiB used, 535 GiB / 536 GiB avail; 10/312 objects degraded (3.205%) 2024-09-04T16:37:52.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:52 smithi170 ceph-mon[113855]: pgmap v235: 65 pgs: 65 active+clean; 245 MiB data, 1011 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:52.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:52 smithi170 ceph-mon[113855]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/312 objects degraded (3.205%), 4 pgs degraded) 2024-09-04T16:37:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:52 smithi193 ceph-mon[82547]: pgmap v235: 65 pgs: 65 active+clean; 245 MiB data, 1011 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:52 smithi193 ceph-mon[82547]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/312 objects degraded (3.205%), 4 pgs degraded) 2024-09-04T16:37:54.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:54 smithi170 ceph-mon[113855]: pgmap v236: 65 pgs: 65 active+clean; 245 MiB data, 1011 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:54 smithi193 ceph-mon[82547]: pgmap v236: 65 pgs: 65 active+clean; 245 MiB data, 1011 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:56.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:56 smithi170 ceph-mon[113855]: pgmap v237: 65 pgs: 65 active+clean; 245 MiB data, 1011 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:56.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:56 smithi193 ceph-mon[82547]: pgmap v237: 65 pgs: 65 active+clean; 245 MiB data, 1011 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:58.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:58 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-04T16:37:58.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:58 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-04T16:37:59.595 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:59 smithi193 ceph-mon[82547]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-04T16:37:59.595 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:59 smithi193 ceph-mon[82547]: Upgrade: osd.5 is safe to restart 2024-09-04T16:37:59.595 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:59 smithi193 ceph-mon[82547]: pgmap v238: 65 pgs: 65 active+clean; 245 MiB data, 1011 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:59.595 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:59.596 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:37:59.596 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:37:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:59 smithi170 ceph-mon[113855]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-04T16:37:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:59 smithi170 ceph-mon[113855]: Upgrade: osd.5 is safe to restart 2024-09-04T16:37:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:59 smithi170 ceph-mon[113855]: pgmap v238: 65 pgs: 65 active+clean; 245 MiB data, 1011 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:37:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:37:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:37:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:37:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:00 smithi193 ceph-mon[82547]: Upgrade: Updating osd.5 2024-09-04T16:38:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:00 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:00 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-04T16:38:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:00 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:38:00.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:00 smithi193 ceph-mon[82547]: Deploying daemon osd.5 on smithi193 2024-09-04T16:38:00.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:00 smithi193 ceph-mon[82547]: pgmap v239: 65 pgs: 65 active+clean; 245 MiB data, 1011 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:01.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:00 smithi170 ceph-mon[113855]: Upgrade: Updating osd.5 2024-09-04T16:38:01.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:00 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:01.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:00 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-04T16:38:01.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:00 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:38:01.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:00 smithi170 ceph-mon[113855]: Deploying daemon osd.5 on smithi193 2024-09-04T16:38:01.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:00 smithi170 ceph-mon[113855]: pgmap v239: 65 pgs: 65 active+clean; 245 MiB data, 1011 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:01.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.169+0000 7f5e1435c640 1 -- 172.21.15.170:0/2848216294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e0c1033c0 msgr2=0x7f5e0c10b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:01.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.169+0000 7f5e1435c640 1 --2- 172.21.15.170:0/2848216294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e0c1033c0 0x7f5e0c10b8b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009880 tx=0x7f5e0002a530 comp rx=0 tx=0).stop 2024-09-04T16:38:01.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.169+0000 7f5e1435c640 1 -- 172.21.15.170:0/2848216294 shutdown_connections 2024-09-04T16:38:01.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.169+0000 7f5e1435c640 1 --2- 172.21.15.170:0/2848216294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e0c1033c0 0x7f5e0c10b8b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.169+0000 7f5e1435c640 1 --2- 172.21.15.170:0/2848216294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e0c102aa0 0x7f5e0c102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.169+0000 7f5e1435c640 1 -- 172.21.15.170:0/2848216294 >> 172.21.15.170:0/2848216294 conn(0x7f5e0c0fc4c0 msgr2=0x7f5e0c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:01.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.169+0000 7f5e1435c640 1 -- 172.21.15.170:0/2848216294 shutdown_connections 2024-09-04T16:38:01.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.169+0000 7f5e1435c640 1 -- 172.21.15.170:0/2848216294 wait complete. 2024-09-04T16:38:01.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.170+0000 7f5e1435c640 1 Processor -- start 2024-09-04T16:38:01.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.170+0000 7f5e1435c640 1 -- start start 2024-09-04T16:38:01.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.170+0000 7f5e1435c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e0c102aa0 0x7f5e0c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:01.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.170+0000 7f5e1435c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e0c1033c0 0x7f5e0c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:01.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.170+0000 7f5e1435c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c10edd0 con 0x7f5e0c102aa0 2024-09-04T16:38:01.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.170+0000 7f5e1435c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c10ec50 con 0x7f5e0c1033c0 2024-09-04T16:38:01.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.170+0000 7f5e120f8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e0c102aa0 0x7f5e0c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:01.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.170+0000 7f5e120f8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e0c102aa0 0x7f5e0c19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58958/0 (socket says 172.21.15.170:58958) 2024-09-04T16:38:01.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.170+0000 7f5e120f8640 1 -- 172.21.15.170:0/2523150809 learned_addr learned my addr 172.21.15.170:0/2523150809 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:38:01.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.170+0000 7f5e118f7640 1 --2- 172.21.15.170:0/2523150809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e0c1033c0 0x7f5e0c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:01.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.170+0000 7f5e120f8640 1 -- 172.21.15.170:0/2523150809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e0c1033c0 msgr2=0x7f5e0c19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:01.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.170+0000 7f5e120f8640 1 --2- 172.21.15.170:0/2523150809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e0c1033c0 0x7f5e0c19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.170+0000 7f5e120f8640 1 -- 172.21.15.170:0/2523150809 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0c197860 con 0x7f5e0c102aa0 2024-09-04T16:38:01.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.171+0000 7f5e120f8640 1 --2- 172.21.15.170:0/2523150809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e0c102aa0 0x7f5e0c19d6a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400d6f0 tx=0x7f5e0400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:01.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.171+0000 7f5e0b7fe640 1 -- 172.21.15.170:0/2523150809 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e04017070 con 0x7f5e0c102aa0 2024-09-04T16:38:01.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.171+0000 7f5e1435c640 1 -- 172.21.15.170:0/2523150809 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e0c197b50 con 0x7f5e0c102aa0 2024-09-04T16:38:01.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.171+0000 7f5e0b7fe640 1 -- 172.21.15.170:0/2523150809 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5e0400de00 con 0x7f5e0c102aa0 2024-09-04T16:38:01.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.171+0000 7f5e0b7fe640 1 -- 172.21.15.170:0/2523150809 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e04004bb0 con 0x7f5e0c102aa0 2024-09-04T16:38:01.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.171+0000 7f5e1435c640 1 -- 172.21.15.170:0/2523150809 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e0c1980b0 con 0x7f5e0c102aa0 2024-09-04T16:38:01.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.172+0000 7f5e1435c640 1 -- 172.21.15.170:0/2523150809 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e0c06a410 con 0x7f5e0c102aa0 2024-09-04T16:38:01.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.173+0000 7f5e0b7fe640 1 -- 172.21.15.170:0/2523150809 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5e04004e60 con 0x7f5e0c102aa0 2024-09-04T16:38:01.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.173+0000 7f5e0b7fe640 1 --2- 172.21.15.170:0/2523150809 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5df4079e30 0x7f5df407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:01.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.173+0000 7f5e0b7fe640 1 -- 172.21.15.170:0/2523150809 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f5e0409c5d0 con 0x7f5e0c102aa0 2024-09-04T16:38:01.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.173+0000 7f5e118f7640 1 --2- 172.21.15.170:0/2523150809 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5df4079e30 0x7f5df407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:01.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.174+0000 7f5e118f7640 1 --2- 172.21.15.170:0/2523150809 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5df4079e30 0x7f5df407c2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c199050 tx=0x7f5e00031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:01.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.178+0000 7f5e0b7fe640 1 -- 172.21.15.170:0/2523150809 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5e04068200 con 0x7f5e0c102aa0 2024-09-04T16:38:01.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.372+0000 7f5e1435c640 1 -- 172.21.15.170:0/2523150809 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5e0c198d90 con 0x7f5df4079e30 2024-09-04T16:38:01.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.374+0000 7f5e0b7fe640 1 -- 172.21.15.170:0/2523150809 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f5e0c198d90 con 0x7f5df4079e30 2024-09-04T16:38:01.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.376+0000 7f5e1435c640 1 -- 172.21.15.170:0/2523150809 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5df4079e30 msgr2=0x7f5df407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:01.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.376+0000 7f5e1435c640 1 --2- 172.21.15.170:0/2523150809 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5df4079e30 0x7f5df407c2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c199050 tx=0x7f5e00031400 comp rx=0 tx=0).stop 2024-09-04T16:38:01.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.376+0000 7f5e1435c640 1 -- 172.21.15.170:0/2523150809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e0c102aa0 msgr2=0x7f5e0c19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:01.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.376+0000 7f5e1435c640 1 --2- 172.21.15.170:0/2523150809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e0c102aa0 0x7f5e0c19d6a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400d6f0 tx=0x7f5e0400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.376+0000 7f5e1435c640 1 -- 172.21.15.170:0/2523150809 shutdown_connections 2024-09-04T16:38:01.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.376+0000 7f5e1435c640 1 --2- 172.21.15.170:0/2523150809 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5df4079e30 0x7f5df407c2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.376+0000 7f5e1435c640 1 --2- 172.21.15.170:0/2523150809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e0c1033c0 0x7f5e0c19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.376+0000 7f5e1435c640 1 --2- 172.21.15.170:0/2523150809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e0c102aa0 0x7f5e0c19d6a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.376+0000 7f5e1435c640 1 -- 172.21.15.170:0/2523150809 >> 172.21.15.170:0/2523150809 conn(0x7f5e0c0fc4c0 msgr2=0x7f5e0c107d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:01.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.376+0000 7f5e1435c640 1 -- 172.21.15.170:0/2523150809 shutdown_connections 2024-09-04T16:38:01.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.376+0000 7f5e1435c640 1 -- 172.21.15.170:0/2523150809 wait complete. 2024-09-04T16:38:01.386 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:38:01.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.460+0000 7f87980da640 1 -- 172.21.15.170:0/2133725116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8790106930 msgr2=0x7f8790106d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:01.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.460+0000 7f87980da640 1 --2- 172.21.15.170:0/2133725116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8790106930 0x7f8790106d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8780009c20 tx=0x7f878002a970 comp rx=0 tx=0).stop 2024-09-04T16:38:01.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.460+0000 7f87980da640 1 -- 172.21.15.170:0/2133725116 shutdown_connections 2024-09-04T16:38:01.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.460+0000 7f87980da640 1 --2- 172.21.15.170:0/2133725116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87900ffd50 0x7f87901001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.460+0000 7f87980da640 1 --2- 172.21.15.170:0/2133725116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8790106930 0x7f8790106d10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.460+0000 7f87980da640 1 -- 172.21.15.170:0/2133725116 >> 172.21.15.170:0/2133725116 conn(0x7f87900fbc40 msgr2=0x7f87900fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:01.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.460+0000 7f87980da640 1 -- 172.21.15.170:0/2133725116 shutdown_connections 2024-09-04T16:38:01.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.460+0000 7f87980da640 1 -- 172.21.15.170:0/2133725116 wait complete. 2024-09-04T16:38:01.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.461+0000 7f87980da640 1 Processor -- start 2024-09-04T16:38:01.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.461+0000 7f87980da640 1 -- start start 2024-09-04T16:38:01.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.461+0000 7f87980da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87900ffd50 0x7f879019d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:01.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.461+0000 7f87980da640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8790106930 0x7f879019dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:01.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.461+0000 7f87980da640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f879010ef30 con 0x7f87900ffd50 2024-09-04T16:38:01.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.461+0000 7f87980da640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f879010edb0 con 0x7f8790106930 2024-09-04T16:38:01.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.461+0000 7f8795e76640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87900ffd50 0x7f879019d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:01.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.461+0000 7f8795e76640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87900ffd50 0x7f879019d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58990/0 (socket says 172.21.15.170:58990) 2024-09-04T16:38:01.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.461+0000 7f8795e76640 1 -- 172.21.15.170:0/514545687 learned_addr learned my addr 172.21.15.170:0/514545687 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:38:01.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.461+0000 7f8795675640 1 --2- 172.21.15.170:0/514545687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8790106930 0x7f879019dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:01.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.462+0000 7f8795e76640 1 -- 172.21.15.170:0/514545687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8790106930 msgr2=0x7f879019dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:01.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.462+0000 7f8795e76640 1 --2- 172.21.15.170:0/514545687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8790106930 0x7f879019dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.462+0000 7f8795e76640 1 -- 172.21.15.170:0/514545687 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87901978c0 con 0x7f87900ffd50 2024-09-04T16:38:01.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.462+0000 7f8795e76640 1 --2- 172.21.15.170:0/514545687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87900ffd50 0x7f879019d700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8780006010 tx=0x7f878002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:01.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.462+0000 7f878effd640 1 -- 172.21.15.170:0/514545687 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8780047070 con 0x7f87900ffd50 2024-09-04T16:38:01.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.462+0000 7f878effd640 1 -- 172.21.15.170:0/514545687 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f878002f7e0 con 0x7f87900ffd50 2024-09-04T16:38:01.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.462+0000 7f87980da640 1 -- 172.21.15.170:0/514545687 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8790197b50 con 0x7f87900ffd50 2024-09-04T16:38:01.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.462+0000 7f878effd640 1 -- 172.21.15.170:0/514545687 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8780034070 con 0x7f87900ffd50 2024-09-04T16:38:01.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.462+0000 7f87980da640 1 -- 172.21.15.170:0/514545687 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8790198080 con 0x7f87900ffd50 2024-09-04T16:38:01.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.463+0000 7f87980da640 1 -- 172.21.15.170:0/514545687 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8790103070 con 0x7f87900ffd50 2024-09-04T16:38:01.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.464+0000 7f878effd640 1 -- 172.21.15.170:0/514545687 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f878004a070 con 0x7f87900ffd50 2024-09-04T16:38:01.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.465+0000 7f878effd640 1 --2- 172.21.15.170:0/514545687 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8778079e40 0x7f877807c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:01.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.465+0000 7f878effd640 1 -- 172.21.15.170:0/514545687 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f87800bd710 con 0x7f87900ffd50 2024-09-04T16:38:01.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.465+0000 7f8795675640 1 --2- 172.21.15.170:0/514545687 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8778079e40 0x7f877807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:01.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.465+0000 7f8795675640 1 --2- 172.21.15.170:0/514545687 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8778079e40 0x7f877807c300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f87900fe1f0 tx=0x7f8784009110 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:01.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.469+0000 7f878effd640 1 -- 172.21.15.170:0/514545687 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f878003f070 con 0x7f87900ffd50 2024-09-04T16:38:01.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.662+0000 7f87980da640 1 -- 172.21.15.170:0/514545687 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8790198f00 con 0x7f8778079e40 2024-09-04T16:38:01.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.664+0000 7f878effd640 1 -- 172.21.15.170:0/514545687 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f8790198f00 con 0x7f8778079e40 2024-09-04T16:38:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.666+0000 7f87980da640 1 -- 172.21.15.170:0/514545687 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8778079e40 msgr2=0x7f877807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.666+0000 7f87980da640 1 --2- 172.21.15.170:0/514545687 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8778079e40 0x7f877807c300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f87900fe1f0 tx=0x7f8784009110 comp rx=0 tx=0).stop 2024-09-04T16:38:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.666+0000 7f87980da640 1 -- 172.21.15.170:0/514545687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87900ffd50 msgr2=0x7f879019d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.666+0000 7f87980da640 1 --2- 172.21.15.170:0/514545687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87900ffd50 0x7f879019d700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8780006010 tx=0x7f878002f5f0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.666+0000 7f87980da640 1 -- 172.21.15.170:0/514545687 shutdown_connections 2024-09-04T16:38:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.666+0000 7f87980da640 1 --2- 172.21.15.170:0/514545687 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8778079e40 0x7f877807c300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.666+0000 7f87980da640 1 --2- 172.21.15.170:0/514545687 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8790106930 0x7f879019dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.666+0000 7f87980da640 1 --2- 172.21.15.170:0/514545687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87900ffd50 0x7f879019d700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.666+0000 7f87980da640 1 -- 172.21.15.170:0/514545687 >> 172.21.15.170:0/514545687 conn(0x7f87900fbc40 msgr2=0x7f87900fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.666+0000 7f87980da640 1 -- 172.21.15.170:0/514545687 shutdown_connections 2024-09-04T16:38:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.666+0000 7f87980da640 1 -- 172.21.15.170:0/514545687 wait complete. 2024-09-04T16:38:01.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.747+0000 7ff813503640 1 -- 172.21.15.170:0/3910268681 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff80c107910 msgr2=0x7ff80c107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:01.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.747+0000 7ff813503640 1 --2- 172.21.15.170:0/3910268681 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff80c107910 0x7ff80c107cf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc009880 tx=0x7ff7fc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.749 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:01 smithi170 ceph-mon[113855]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:38:01.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.748+0000 7ff813503640 1 -- 172.21.15.170:0/3910268681 shutdown_connections 2024-09-04T16:38:01.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.748+0000 7ff813503640 1 --2- 172.21.15.170:0/3910268681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff80c101910 0x7ff80c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.748+0000 7ff813503640 1 --2- 172.21.15.170:0/3910268681 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff80c107910 0x7ff80c107cf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.748+0000 7ff813503640 1 -- 172.21.15.170:0/3910268681 >> 172.21.15.170:0/3910268681 conn(0x7ff80c0fd5f0 msgr2=0x7ff80c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.748+0000 7ff813503640 1 -- 172.21.15.170:0/3910268681 shutdown_connections 2024-09-04T16:38:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.748+0000 7ff813503640 1 -- 172.21.15.170:0/3910268681 wait complete. 2024-09-04T16:38:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.748+0000 7ff813503640 1 Processor -- start 2024-09-04T16:38:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.748+0000 7ff813503640 1 -- start start 2024-09-04T16:38:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.749+0000 7ff813503640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff80c101910 0x7ff80c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.749+0000 7ff813503640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff80c107910 0x7ff80c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.749+0000 7ff813503640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c10ee40 con 0x7ff80c101910 2024-09-04T16:38:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.749+0000 7ff813503640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c10ecc0 con 0x7ff80c107910 2024-09-04T16:38:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.749+0000 7ff81129f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff80c101910 0x7ff80c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.749+0000 7ff81129f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff80c101910 0x7ff80c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58994/0 (socket says 172.21.15.170:58994) 2024-09-04T16:38:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.749+0000 7ff81129f640 1 -- 172.21.15.170:0/2558557102 learned_addr learned my addr 172.21.15.170:0/2558557102 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:38:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.749+0000 7ff810a9e640 1 --2- 172.21.15.170:0/2558557102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff80c107910 0x7ff80c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.749+0000 7ff81129f640 1 -- 172.21.15.170:0/2558557102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff80c107910 msgr2=0x7ff80c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.749+0000 7ff81129f640 1 --2- 172.21.15.170:0/2558557102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff80c107910 0x7ff80c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.749+0000 7ff81129f640 1 -- 172.21.15.170:0/2558557102 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80c074f70 con 0x7ff80c101910 2024-09-04T16:38:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.749+0000 7ff81129f640 1 --2- 172.21.15.170:0/2558557102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff80c101910 0x7ff80c0744f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc031460 tx=0x7ff7fc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.750+0000 7ff8027fc640 1 -- 172.21.15.170:0/2558557102 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7fc03f070 con 0x7ff80c101910 2024-09-04T16:38:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.750+0000 7ff813503640 1 -- 172.21.15.170:0/2558557102 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff80c075200 con 0x7ff80c101910 2024-09-04T16:38:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.750+0000 7ff8027fc640 1 -- 172.21.15.170:0/2558557102 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7fc004cf0 con 0x7ff80c101910 2024-09-04T16:38:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.750+0000 7ff8027fc640 1 -- 172.21.15.170:0/2558557102 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7fc035030 con 0x7ff80c101910 2024-09-04T16:38:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.750+0000 7ff813503640 1 -- 172.21.15.170:0/2558557102 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff80c1a3e30 con 0x7ff80c101910 2024-09-04T16:38:01.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.751+0000 7ff813503640 1 -- 172.21.15.170:0/2558557102 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff80c103050 con 0x7ff80c101910 2024-09-04T16:38:01.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.751+0000 7ff8027fc640 1 -- 172.21.15.170:0/2558557102 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ff7fc042070 con 0x7ff80c101910 2024-09-04T16:38:01.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.752+0000 7ff8027fc640 1 --2- 172.21.15.170:0/2558557102 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7f8079e80 0x7ff7f807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:01.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.752+0000 7ff8027fc640 1 -- 172.21.15.170:0/2558557102 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7ff7fc0bd400 con 0x7ff80c101910 2024-09-04T16:38:01.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.752+0000 7ff810a9e640 1 --2- 172.21.15.170:0/2558557102 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7f8079e80 0x7ff7f807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:01.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.752+0000 7ff810a9e640 1 --2- 172.21.15.170:0/2558557102 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7f8079e80 0x7ff7f807c340 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff80c075f80 tx=0x7ff808009110 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:01.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.756+0000 7ff8027fc640 1 -- 172.21.15.170:0/2558557102 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff7fc084ee0 con 0x7ff80c101910 2024-09-04T16:38:01.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:01 smithi193 ceph-mon[82547]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:38:01.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.936+0000 7ff813503640 1 -- 172.21.15.170:0/2558557102 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff80c062630 con 0x7ff7f8079e80 2024-09-04T16:38:01.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.945+0000 7ff8027fc640 1 -- 172.21.15.170:0/2558557102 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ff80c062630 con 0x7ff7f8079e80 2024-09-04T16:38:01.946 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:38:01.946 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (5m) 87s ago 15m 21.0M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:38:01.947 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (8m) 87s ago 16m 9126k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:38:01.947 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (7m) 22s ago 15m 8548k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:38:01.947 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (3m) 87s ago 16m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:38:01.947 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (3m) 22s ago 15m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:38:01.947 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (4m) 87s ago 15m 79.4M - c8b91775d855 6e3778aab5e6 2024-09-04T16:38:01.947 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (10m) 87s ago 10m 27.1M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:38:01.947 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (10m) 87s ago 10m 145M - 19.1.1-252-g48920dab b708f9119ac7 f45e16980711 2024-09-04T16:38:01.947 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (10m) 22s ago 10m 17.9M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:38:01.947 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (10m) 22s ago 10m 17.5M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:38:01.947 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (7m) 87s ago 17m 525M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:38:01.947 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (6m) 22s ago 14m 457M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:38:01.947 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (3m) 87s ago 17m 41.9M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:38:01.947 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (3m) 22s ago 14m 36.5M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:38:01.947 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (5m) 87s ago 15m 10.8M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:38:01.948 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (5m) 22s ago 15m 12.3M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:38:01.948 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (2m) 87s ago 13m 83.2M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:38:01.948 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (2m) 87s ago 13m 86.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:38:01.948 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (93s) 87s ago 12m 11.2M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:38:01.948 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (58s) 22s ago 12m 95.8M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:38:01.948 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (25s) 22s ago 12m 12.1M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:38:01.948 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (11m) 22s ago 11m 191M 2240M 19.1.1-252-g48920dab b708f9119ac7 8dba9fbb37ab 2024-09-04T16:38:01.948 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (5m) 87s ago 15m 53.8M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:38:01.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.948+0000 7ff813503640 1 -- 172.21.15.170:0/2558557102 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7f8079e80 msgr2=0x7ff7f807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:01.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.948+0000 7ff813503640 1 --2- 172.21.15.170:0/2558557102 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7f8079e80 0x7ff7f807c340 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff80c075f80 tx=0x7ff808009110 comp rx=0 tx=0).stop 2024-09-04T16:38:01.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.948+0000 7ff813503640 1 -- 172.21.15.170:0/2558557102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff80c101910 msgr2=0x7ff80c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:01.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.948+0000 7ff813503640 1 --2- 172.21.15.170:0/2558557102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff80c101910 0x7ff80c0744f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc031460 tx=0x7ff7fc0048f0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.948+0000 7ff813503640 1 -- 172.21.15.170:0/2558557102 shutdown_connections 2024-09-04T16:38:01.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.948+0000 7ff813503640 1 --2- 172.21.15.170:0/2558557102 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7f8079e80 0x7ff7f807c340 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.948+0000 7ff813503640 1 --2- 172.21.15.170:0/2558557102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff80c107910 0x7ff80c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.948+0000 7ff813503640 1 --2- 172.21.15.170:0/2558557102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff80c101910 0x7ff80c0744f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:01.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.948+0000 7ff813503640 1 -- 172.21.15.170:0/2558557102 >> 172.21.15.170:0/2558557102 conn(0x7ff80c0fd5f0 msgr2=0x7ff80c0fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:01.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.948+0000 7ff813503640 1 -- 172.21.15.170:0/2558557102 shutdown_connections 2024-09-04T16:38:01.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:01.948+0000 7ff813503640 1 -- 172.21.15.170:0/2558557102 wait complete. 2024-09-04T16:38:02.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.029+0000 7f6b7a9c6640 1 -- 172.21.15.170:0/3195829036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b741001e0 msgr2=0x7f6b741005c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:02.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.029+0000 7f6b7a9c6640 1 --2- 172.21.15.170:0/3195829036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b741001e0 0x7f6b741005c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400a990 tx=0x7f6b6402b7d0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.029+0000 7f6b7a9c6640 1 -- 172.21.15.170:0/3195829036 shutdown_connections 2024-09-04T16:38:02.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.029+0000 7f6b7a9c6640 1 --2- 172.21.15.170:0/3195829036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b74100b90 0x7f6b74104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.029+0000 7f6b7a9c6640 1 --2- 172.21.15.170:0/3195829036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b741001e0 0x7f6b741005c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.029+0000 7f6b7a9c6640 1 -- 172.21.15.170:0/3195829036 >> 172.21.15.170:0/3195829036 conn(0x7f6b740fbc40 msgr2=0x7f6b740fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:02.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.029+0000 7f6b7a9c6640 1 -- 172.21.15.170:0/3195829036 shutdown_connections 2024-09-04T16:38:02.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.030+0000 7f6b7a9c6640 1 -- 172.21.15.170:0/3195829036 wait complete. 2024-09-04T16:38:02.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.030+0000 7f6b7a9c6640 1 Processor -- start 2024-09-04T16:38:02.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.030+0000 7f6b7a9c6640 1 -- start start 2024-09-04T16:38:02.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.031+0000 7f6b7a9c6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b741001e0 0x7f6b7419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:02.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.031+0000 7f6b7a9c6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b74100b90 0x7f6b7419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:02.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.031+0000 7f6b7a9c6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7410cb40 con 0x7f6b74100b90 2024-09-04T16:38:02.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.031+0000 7f6b7a9c6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7410c9c0 con 0x7f6b741001e0 2024-09-04T16:38:02.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.031+0000 7f6b737fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b74100b90 0x7f6b7419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:02.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.031+0000 7f6b737fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b74100b90 0x7f6b7419db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59010/0 (socket says 172.21.15.170:59010) 2024-09-04T16:38:02.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.031+0000 7f6b737fe640 1 -- 172.21.15.170:0/295891437 learned_addr learned my addr 172.21.15.170:0/295891437 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:38:02.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.031+0000 7f6b73fff640 1 --2- 172.21.15.170:0/295891437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b741001e0 0x7f6b7419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:02.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.031+0000 7f6b737fe640 1 -- 172.21.15.170:0/295891437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b741001e0 msgr2=0x7f6b7419d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:02.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.031+0000 7f6b737fe640 1 --2- 172.21.15.170:0/295891437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b741001e0 0x7f6b7419d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.031+0000 7f6b737fe640 1 -- 172.21.15.170:0/295891437 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b741976e0 con 0x7f6b74100b90 2024-09-04T16:38:02.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.031+0000 7f6b737fe640 1 --2- 172.21.15.170:0/295891437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b74100b90 0x7f6b7419db50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800d8d0 tx=0x7f6b6800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:02.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.032+0000 7f6b717fa640 1 -- 172.21.15.170:0/295891437 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b68017070 con 0x7f6b74100b90 2024-09-04T16:38:02.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.032+0000 7f6b7a9c6640 1 -- 172.21.15.170:0/295891437 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b741979d0 con 0x7f6b74100b90 2024-09-04T16:38:02.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.032+0000 7f6b717fa640 1 -- 172.21.15.170:0/295891437 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b68010460 con 0x7f6b74100b90 2024-09-04T16:38:02.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.032+0000 7f6b717fa640 1 -- 172.21.15.170:0/295891437 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b6800f5f0 con 0x7f6b74100b90 2024-09-04T16:38:02.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.032+0000 7f6b7a9c6640 1 -- 172.21.15.170:0/295891437 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b74197f30 con 0x7f6b74100b90 2024-09-04T16:38:02.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.033+0000 7f6b7a9c6640 1 -- 172.21.15.170:0/295891437 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b741016c0 con 0x7f6b74100b90 2024-09-04T16:38:02.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.034+0000 7f6b717fa640 1 -- 172.21.15.170:0/295891437 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f6b68009a30 con 0x7f6b74100b90 2024-09-04T16:38:02.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.034+0000 7f6b717fa640 1 --2- 172.21.15.170:0/295891437 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6b5c079e30 0x7f6b5c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:02.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.034+0000 7f6b717fa640 1 -- 172.21.15.170:0/295891437 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f6b6809c840 con 0x7f6b74100b90 2024-09-04T16:38:02.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.034+0000 7f6b73fff640 1 --2- 172.21.15.170:0/295891437 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6b5c079e30 0x7f6b5c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:02.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.035+0000 7f6b73fff640 1 --2- 172.21.15.170:0/295891437 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6b5c079e30 0x7f6b5c07c2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400a340 tx=0x7f6b64005fd0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:02.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.039+0000 7f6b717fa640 1 -- 172.21.15.170:0/295891437 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6b68068470 con 0x7f6b74100b90 2024-09-04T16:38:02.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.287+0000 7f6b7a9c6640 1 -- 172.21.15.170:0/295891437 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6b74198250 con 0x7f6b74100b90 2024-09-04T16:38:02.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.288+0000 7f6b717fa640 1 -- 172.21.15.170:0/295891437 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f6b6806ce90 con 0x7f6b74100b90 2024-09-04T16:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 1, 2024-09-04T16:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 5 2024-09-04T16:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 4 2024-09-04T16:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 5, 2024-09-04T16:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 9 2024-09-04T16:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:38:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.290+0000 7f6b7a9c6640 1 -- 172.21.15.170:0/295891437 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6b5c079e30 msgr2=0x7f6b5c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.290+0000 7f6b7a9c6640 1 --2- 172.21.15.170:0/295891437 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6b5c079e30 0x7f6b5c07c2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400a340 tx=0x7f6b64005fd0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.290+0000 7f6b7a9c6640 1 -- 172.21.15.170:0/295891437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b74100b90 msgr2=0x7f6b7419db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.290+0000 7f6b7a9c6640 1 --2- 172.21.15.170:0/295891437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b74100b90 0x7f6b7419db50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800d8d0 tx=0x7f6b6800dd90 comp rx=0 tx=0).stop 2024-09-04T16:38:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.290+0000 7f6b7a9c6640 1 -- 172.21.15.170:0/295891437 shutdown_connections 2024-09-04T16:38:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.290+0000 7f6b7a9c6640 1 --2- 172.21.15.170:0/295891437 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6b5c079e30 0x7f6b5c07c2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.290+0000 7f6b7a9c6640 1 --2- 172.21.15.170:0/295891437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b74100b90 0x7f6b7419db50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.290+0000 7f6b7a9c6640 1 --2- 172.21.15.170:0/295891437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b741001e0 0x7f6b7419d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.291+0000 7f6b7a9c6640 1 -- 172.21.15.170:0/295891437 >> 172.21.15.170:0/295891437 conn(0x7f6b740fbc40 msgr2=0x7f6b740fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.291+0000 7f6b7a9c6640 1 -- 172.21.15.170:0/295891437 shutdown_connections 2024-09-04T16:38:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.291+0000 7f6b7a9c6640 1 -- 172.21.15.170:0/295891437 wait complete. 2024-09-04T16:38:02.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.373+0000 7f798293d640 1 -- 172.21.15.170:0/3195619657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f797c106900 msgr2=0x7f797c106ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:02.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.373+0000 7f798293d640 1 --2- 172.21.15.170:0/3195619657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f797c106900 0x7f797c106ce0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f796c009880 tx=0x7f796c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.373+0000 7f798293d640 1 -- 172.21.15.170:0/3195619657 shutdown_connections 2024-09-04T16:38:02.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.373+0000 7f798293d640 1 --2- 172.21.15.170:0/3195619657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f797c0ffd20 0x7f797c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.373+0000 7f798293d640 1 --2- 172.21.15.170:0/3195619657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f797c106900 0x7f797c106ce0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.373+0000 7f798293d640 1 -- 172.21.15.170:0/3195619657 >> 172.21.15.170:0/3195619657 conn(0x7f797c0fbc10 msgr2=0x7f797c0fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:02.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.373+0000 7f798293d640 1 -- 172.21.15.170:0/3195619657 shutdown_connections 2024-09-04T16:38:02.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.373+0000 7f798293d640 1 -- 172.21.15.170:0/3195619657 wait complete. 2024-09-04T16:38:02.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.373+0000 7f798293d640 1 Processor -- start 2024-09-04T16:38:02.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.373+0000 7f798293d640 1 -- start start 2024-09-04T16:38:02.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f798293d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f797c0ffd20 0x7f797c19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:02.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f798293d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f797c106900 0x7f797c19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:02.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f798293d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f797c10eea0 con 0x7f797c0ffd20 2024-09-04T16:38:02.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f798293d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f797c10ed20 con 0x7f797c106900 2024-09-04T16:38:02.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f797bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f797c0ffd20 0x7f797c19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:02.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f797bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f797c0ffd20 0x7f797c19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59022/0 (socket says 172.21.15.170:59022) 2024-09-04T16:38:02.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f797bfff640 1 -- 172.21.15.170:0/2615153779 learned_addr learned my addr 172.21.15.170:0/2615153779 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:38:02.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f7973fff640 1 --2- 172.21.15.170:0/2615153779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f797c106900 0x7f797c19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:02.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f797bfff640 1 -- 172.21.15.170:0/2615153779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f797c106900 msgr2=0x7f797c19dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:02.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f797bfff640 1 --2- 172.21.15.170:0/2615153779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f797c106900 0x7f797c19dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f797bfff640 1 -- 172.21.15.170:0/2615153779 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797c197850 con 0x7f797c0ffd20 2024-09-04T16:38:02.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f797bfff640 1 --2- 172.21.15.170:0/2615153779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f797c0ffd20 0x7f797c19d6d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f796c031460 tx=0x7f796c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:02.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f7979ffb640 1 -- 172.21.15.170:0/2615153779 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f796c03f070 con 0x7f797c0ffd20 2024-09-04T16:38:02.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f7979ffb640 1 -- 172.21.15.170:0/2615153779 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f796c0035f0 con 0x7f797c0ffd20 2024-09-04T16:38:02.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f798293d640 1 -- 172.21.15.170:0/2615153779 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797c197ae0 con 0x7f797c0ffd20 2024-09-04T16:38:02.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f7979ffb640 1 -- 172.21.15.170:0/2615153779 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f796c035030 con 0x7f797c0ffd20 2024-09-04T16:38:02.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.374+0000 7f798293d640 1 -- 172.21.15.170:0/2615153779 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797c198010 con 0x7f797c0ffd20 2024-09-04T16:38:02.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.375+0000 7f798293d640 1 -- 172.21.15.170:0/2615153779 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f797c103040 con 0x7f797c0ffd20 2024-09-04T16:38:02.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.376+0000 7f7979ffb640 1 -- 172.21.15.170:0/2615153779 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f796c042070 con 0x7f797c0ffd20 2024-09-04T16:38:02.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.376+0000 7f7979ffb640 1 --2- 172.21.15.170:0/2615153779 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7968079e30 0x7f796807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:02.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.377+0000 7f7979ffb640 1 -- 172.21.15.170:0/2615153779 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f796c0bd3f0 con 0x7f797c0ffd20 2024-09-04T16:38:02.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.377+0000 7f7973fff640 1 --2- 172.21.15.170:0/2615153779 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7968079e30 0x7f796807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:02.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.377+0000 7f7973fff640 1 --2- 172.21.15.170:0/2615153779 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7968079e30 0x7f796807c2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f797c0fe180 tx=0x7f7964005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:02.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.381+0000 7f7979ffb640 1 -- 172.21.15.170:0/2615153779 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f796c088f80 con 0x7f797c0ffd20 2024-09-04T16:38:02.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.593+0000 7f798293d640 1 -- 172.21.15.170:0/2615153779 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f797c198d80 con 0x7f797c0ffd20 2024-09-04T16:38:02.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.593+0000 7f7979ffb640 1 -- 172.21.15.170:0/2615153779 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2036 (secure 0 0 0) 0x7f796c08d2c0 con 0x7f797c0ffd20 2024-09-04T16:38:02.594 INFO:teuthology.orchestra.run.smithi170.stdout:e15 2024-09-04T16:38:02.594 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:27:39:151187+0000 2024-09-04T16:38:02.594 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:38:02.595 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:38:02.595 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:38:02.595 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:38:02.595 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:38:02.595 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:38:02.595 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 15 2024-09-04T16:38:02.595 INFO:teuthology.orchestra.run.smithi170.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-04T16:38:02.595 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:38:02.595 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:27:39.151182+0000 2024-09-04T16:38:02.595 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:38:02.595 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:38:02.595 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:38:02.596 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:38:02.596 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:38:02.596 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:38:02.596 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:38:02.596 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:38:02.596 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 45 2024-09-04T16:38:02.596 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:38:02.596 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:38:02.596 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:38:02.596 INFO:teuthology.orchestra.run.smithi170.stdout:up {0=14562,1=14578} 2024-09-04T16:38:02.596 INFO:teuthology.orchestra.run.smithi170.stdout:failed 2024-09-04T16:38:02.596 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:38:02.596 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:38:02.597 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:38:02.597 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:38:02.597 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:38:02.597 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:38:02.597 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:38:02.597 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:38:02.597 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 14562 members: 14562,14578 2024-09-04T16:38:02.598 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{0:14562} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6826/3443400311,v1:172.21.15.170:6827/3443400311] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:38:02.598 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{1:14578} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.170:6828/3937288624,v1:172.21.15.170:6829/3937288624] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:38:02.598 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:38:02.598 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:38:02.598 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:38:02.598 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:38:02.599 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:24315} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.193:6826/288890560,v1:172.21.15.193:6827/288890560] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:38:02.599 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:24319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1128257367,v1:172.21.15.193:6825/1128257367] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:38:02.599 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 15 2024-09-04T16:38:02.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.595+0000 7f798293d640 1 -- 172.21.15.170:0/2615153779 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7968079e30 msgr2=0x7f796807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:02.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.595+0000 7f798293d640 1 --2- 172.21.15.170:0/2615153779 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7968079e30 0x7f796807c2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f797c0fe180 tx=0x7f7964005f90 comp rx=0 tx=0).stop 2024-09-04T16:38:02.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.595+0000 7f798293d640 1 -- 172.21.15.170:0/2615153779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f797c0ffd20 msgr2=0x7f797c19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:02.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.595+0000 7f798293d640 1 --2- 172.21.15.170:0/2615153779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f797c0ffd20 0x7f797c19d6d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f796c031460 tx=0x7f796c004530 comp rx=0 tx=0).stop 2024-09-04T16:38:02.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.595+0000 7f798293d640 1 -- 172.21.15.170:0/2615153779 shutdown_connections 2024-09-04T16:38:02.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.595+0000 7f798293d640 1 --2- 172.21.15.170:0/2615153779 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7968079e30 0x7f796807c2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.595+0000 7f798293d640 1 --2- 172.21.15.170:0/2615153779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f797c106900 0x7f797c19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.595+0000 7f798293d640 1 --2- 172.21.15.170:0/2615153779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f797c0ffd20 0x7f797c19d6d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.595+0000 7f798293d640 1 -- 172.21.15.170:0/2615153779 >> 172.21.15.170:0/2615153779 conn(0x7f797c0fbc10 msgr2=0x7f797c0fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:02.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.595+0000 7f798293d640 1 -- 172.21.15.170:0/2615153779 shutdown_connections 2024-09-04T16:38:02.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.595+0000 7f798293d640 1 -- 172.21.15.170:0/2615153779 wait complete. 2024-09-04T16:38:02.656 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:02 smithi193 systemd[1]: Stopping Ceph osd.5 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:38:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:02 smithi193 ceph-mon[82547]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:38:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:02 smithi193 ceph-mon[82547]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:38:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:02 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/295891437' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:02 smithi193 ceph-mon[82547]: pgmap v240: 65 pgs: 65 active+clean; 245 MiB data, 1011 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:02.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:02 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2615153779' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:38:02.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.680+0000 7f5a95fe2640 1 -- 172.21.15.170:0/4121307368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a901033c0 msgr2=0x7f5a9010b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:02.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.680+0000 7f5a95fe2640 1 --2- 172.21.15.170:0/4121307368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a901033c0 0x7f5a9010b8b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009880 tx=0x7f5a7802a530 comp rx=0 tx=0).stop 2024-09-04T16:38:02.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.680+0000 7f5a95fe2640 1 -- 172.21.15.170:0/4121307368 shutdown_connections 2024-09-04T16:38:02.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.680+0000 7f5a95fe2640 1 --2- 172.21.15.170:0/4121307368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a901033c0 0x7f5a9010b8b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.680+0000 7f5a95fe2640 1 --2- 172.21.15.170:0/4121307368 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a90102aa0 0x7f5a90102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.680+0000 7f5a95fe2640 1 -- 172.21.15.170:0/4121307368 >> 172.21.15.170:0/4121307368 conn(0x7f5a900fc4c0 msgr2=0x7f5a900fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:02.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.680+0000 7f5a95fe2640 1 -- 172.21.15.170:0/4121307368 shutdown_connections 2024-09-04T16:38:02.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.680+0000 7f5a95fe2640 1 -- 172.21.15.170:0/4121307368 wait complete. 2024-09-04T16:38:02.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.680+0000 7f5a95fe2640 1 Processor -- start 2024-09-04T16:38:02.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.680+0000 7f5a95fe2640 1 -- start start 2024-09-04T16:38:02.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a95fe2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a90102aa0 0x7f5a90100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:02.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a95fe2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a901033c0 0x7f5a90100c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:02.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a95fe2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9010edd0 con 0x7f5a90102aa0 2024-09-04T16:38:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a95fe2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9010ec50 con 0x7f5a901033c0 2024-09-04T16:38:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a8f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a90102aa0 0x7f5a90100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a8f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a90102aa0 0x7f5a90100700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59040/0 (socket says 172.21.15.170:59040) 2024-09-04T16:38:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a8f7fe640 1 -- 172.21.15.170:0/247687866 learned_addr learned my addr 172.21.15.170:0/247687866 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:38:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a8f7fe640 1 -- 172.21.15.170:0/247687866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a901033c0 msgr2=0x7f5a90100c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a87fff640 1 --2- 172.21.15.170:0/247687866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a901033c0 0x7f5a90100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a8f7fe640 1 --2- 172.21.15.170:0/247687866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a901033c0 0x7f5a90100c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a8f7fe640 1 -- 172.21.15.170:0/247687866 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a90101180 con 0x7f5a90102aa0 2024-09-04T16:38:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a8f7fe640 1 --2- 172.21.15.170:0/247687866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a90102aa0 0x7f5a90100700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000e970 tx=0x7f5a8000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a8d7fa640 1 -- 172.21.15.170:0/247687866 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a8000cac0 con 0x7f5a90102aa0 2024-09-04T16:38:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a8d7fa640 1 -- 172.21.15.170:0/247687866 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5a800054e0 con 0x7f5a90102aa0 2024-09-04T16:38:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a95fe2640 1 -- 172.21.15.170:0/247687866 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a90101470 con 0x7f5a90102aa0 2024-09-04T16:38:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a8d7fa640 1 -- 172.21.15.170:0/247687866 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a80010430 con 0x7f5a90102aa0 2024-09-04T16:38:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.681+0000 7f5a95fe2640 1 -- 172.21.15.170:0/247687866 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a901a3ee0 con 0x7f5a90102aa0 2024-09-04T16:38:02.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.682+0000 7f5a95fe2640 1 -- 172.21.15.170:0/247687866 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a9006a410 con 0x7f5a90102aa0 2024-09-04T16:38:02.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.683+0000 7f5a8d7fa640 1 -- 172.21.15.170:0/247687866 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5a80004f00 con 0x7f5a90102aa0 2024-09-04T16:38:02.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.683+0000 7f5a8d7fa640 1 --2- 172.21.15.170:0/247687866 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5a7c079e80 0x7f5a7c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:02.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.683+0000 7f5a8d7fa640 1 -- 172.21.15.170:0/247687866 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f5a8009d050 con 0x7f5a90102aa0 2024-09-04T16:38:02.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.683+0000 7f5a87fff640 1 --2- 172.21.15.170:0/247687866 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5a7c079e80 0x7f5a7c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:02.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.684+0000 7f5a87fff640 1 --2- 172.21.15.170:0/247687866 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5a7c079e80 0x7f5a7c07c340 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5a78031460 tx=0x7f5a78009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:02.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.688+0000 7f5a8d7fa640 1 -- 172.21.15.170:0/247687866 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5a80064b90 con 0x7f5a90102aa0 2024-09-04T16:38:02.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:02 smithi170 ceph-mon[113855]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:38:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:02 smithi170 ceph-mon[113855]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:38:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:02 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/295891437' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:02 smithi170 ceph-mon[113855]: pgmap v240: 65 pgs: 65 active+clean; 245 MiB data, 1011 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:02 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2615153779' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:38:02.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.889+0000 7f5a95fe2640 1 -- 172.21.15.170:0/247687866 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5a90062630 con 0x7f5a7c079e80 2024-09-04T16:38:02.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.890+0000 7f5a8d7fa640 1 -- 172.21.15.170:0/247687866 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f5a90062630 con 0x7f5a7c079e80 2024-09-04T16:38:02.891 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:38:02.891 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:38:02.891 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:38:02.891 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:38:02.891 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:38:02.891 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-04T16:38:02.891 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:38:02.891 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-04T16:38:02.891 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:38:02.891 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "11/23 daemons upgraded", 2024-09-04T16:38:02.891 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading osd daemons", 2024-09-04T16:38:02.891 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:38:02.892 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:38:02.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.892+0000 7f5a95fe2640 1 -- 172.21.15.170:0/247687866 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5a7c079e80 msgr2=0x7f5a7c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:02.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.892+0000 7f5a95fe2640 1 --2- 172.21.15.170:0/247687866 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5a7c079e80 0x7f5a7c07c340 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5a78031460 tx=0x7f5a78009560 comp rx=0 tx=0).stop 2024-09-04T16:38:02.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.892+0000 7f5a95fe2640 1 -- 172.21.15.170:0/247687866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a90102aa0 msgr2=0x7f5a90100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:02.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.892+0000 7f5a95fe2640 1 --2- 172.21.15.170:0/247687866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a90102aa0 0x7f5a90100700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000e970 tx=0x7f5a8000ed70 comp rx=0 tx=0).stop 2024-09-04T16:38:02.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.892+0000 7f5a95fe2640 1 -- 172.21.15.170:0/247687866 shutdown_connections 2024-09-04T16:38:02.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.892+0000 7f5a95fe2640 1 --2- 172.21.15.170:0/247687866 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5a7c079e80 0x7f5a7c07c340 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.892+0000 7f5a95fe2640 1 --2- 172.21.15.170:0/247687866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a901033c0 0x7f5a90100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.892+0000 7f5a95fe2640 1 --2- 172.21.15.170:0/247687866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a90102aa0 0x7f5a90100700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.892+0000 7f5a95fe2640 1 -- 172.21.15.170:0/247687866 >> 172.21.15.170:0/247687866 conn(0x7f5a900fc4c0 msgr2=0x7f5a90107d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:02.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.893+0000 7f5a95fe2640 1 -- 172.21.15.170:0/247687866 shutdown_connections 2024-09-04T16:38:02.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.893+0000 7f5a95fe2640 1 -- 172.21.15.170:0/247687866 wait complete. 2024-09-04T16:38:02.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.974+0000 7fe059439640 1 -- 172.21.15.170:0/2672202150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe054100800 msgr2=0x7fe054100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:02.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.974+0000 7fe059439640 1 --2- 172.21.15.170:0/2672202150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe054100800 0x7fe054100c60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009880 tx=0x7fe03c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.974+0000 7fe059439640 1 -- 172.21.15.170:0/2672202150 shutdown_connections 2024-09-04T16:38:02.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.974+0000 7fe059439640 1 --2- 172.21.15.170:0/2672202150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe054100800 0x7fe054100c60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.974+0000 7fe059439640 1 --2- 172.21.15.170:0/2672202150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe054106800 0x7fe054106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.974+0000 7fe059439640 1 -- 172.21.15.170:0/2672202150 >> 172.21.15.170:0/2672202150 conn(0x7fe0540fc4e0 msgr2=0x7fe0540fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:02.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.974+0000 7fe059439640 1 -- 172.21.15.170:0/2672202150 shutdown_connections 2024-09-04T16:38:02.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.974+0000 7fe059439640 1 -- 172.21.15.170:0/2672202150 wait complete. 2024-09-04T16:38:02.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.974+0000 7fe059439640 1 Processor -- start 2024-09-04T16:38:02.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.975+0000 7fe059439640 1 -- start start 2024-09-04T16:38:02.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.975+0000 7fe059439640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe054100800 0x7fe05419c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:02.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.975+0000 7fe059439640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe054106800 0x7fe05419cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:02.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.975+0000 7fe059439640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe05410dcb0 con 0x7fe054106800 2024-09-04T16:38:02.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.975+0000 7fe059439640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe05410db30 con 0x7fe054100800 2024-09-04T16:38:02.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.975+0000 7fe0527fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe054106800 0x7fe05419cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:02.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.975+0000 7fe0527fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe054106800 0x7fe05419cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59054/0 (socket says 172.21.15.170:59054) 2024-09-04T16:38:02.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.975+0000 7fe0527fc640 1 -- 172.21.15.170:0/2072230005 learned_addr learned my addr 172.21.15.170:0/2072230005 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:38:02.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.975+0000 7fe052ffd640 1 --2- 172.21.15.170:0/2072230005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe054100800 0x7fe05419c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:02.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.975+0000 7fe0527fc640 1 -- 172.21.15.170:0/2072230005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe054100800 msgr2=0x7fe05419c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:02.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.975+0000 7fe0527fc640 1 --2- 172.21.15.170:0/2072230005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe054100800 0x7fe05419c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:02.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.975+0000 7fe0527fc640 1 -- 172.21.15.170:0/2072230005 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe054196690 con 0x7fe054106800 2024-09-04T16:38:02.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.975+0000 7fe052ffd640 1 --2- 172.21.15.170:0/2072230005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe054100800 0x7fe05419c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:38:02.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.976+0000 7fe0527fc640 1 --2- 172.21.15.170:0/2072230005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe054106800 0x7fe05419cb00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe03c031460 tx=0x7fe03c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:02.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.976+0000 7fe04bfff640 1 -- 172.21.15.170:0/2072230005 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe03c03f070 con 0x7fe054106800 2024-09-04T16:38:02.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.976+0000 7fe059439640 1 -- 172.21.15.170:0/2072230005 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe054196920 con 0x7fe054106800 2024-09-04T16:38:02.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.976+0000 7fe04bfff640 1 -- 172.21.15.170:0/2072230005 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe03c0044d0 con 0x7fe054106800 2024-09-04T16:38:02.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.976+0000 7fe04bfff640 1 -- 172.21.15.170:0/2072230005 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe03c035030 con 0x7fe054106800 2024-09-04T16:38:02.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.976+0000 7fe059439640 1 -- 172.21.15.170:0/2072230005 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe054196e20 con 0x7fe054106800 2024-09-04T16:38:02.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.977+0000 7fe059439640 1 -- 172.21.15.170:0/2072230005 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe054101f40 con 0x7fe054106800 2024-09-04T16:38:02.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.977+0000 7fe04bfff640 1 -- 172.21.15.170:0/2072230005 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fe03c042070 con 0x7fe054106800 2024-09-04T16:38:02.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.978+0000 7fe04bfff640 1 --2- 172.21.15.170:0/2072230005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe040079e40 0x7fe04007c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:02.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.978+0000 7fe052ffd640 1 --2- 172.21.15.170:0/2072230005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe040079e40 0x7fe04007c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:02.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.978+0000 7fe04bfff640 1 -- 172.21.15.170:0/2072230005 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7fe03c0bd570 con 0x7fe054106800 2024-09-04T16:38:02.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.978+0000 7fe052ffd640 1 --2- 172.21.15.170:0/2072230005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe040079e40 0x7fe04007c300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe0440058c0 tx=0x7fe044005ec0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:02.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:02.982+0000 7fe04bfff640 1 -- 172.21.15.170:0/2072230005 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe03c085030 con 0x7fe054106800 2024-09-04T16:38:03.156 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:02 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[55171]: 2024-09-04T16:38:02.687+0000 7f7909bfc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T16:38:03.156 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:02 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[55171]: 2024-09-04T16:38:02.687+0000 7f7909bfc640 -1 osd.5 72 *** Got signal Terminated *** 2024-09-04T16:38:03.156 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:02 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[55171]: 2024-09-04T16:38:02.687+0000 7f7909bfc640 -1 osd.5 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-04T16:38:03.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:03.230+0000 7fe059439640 1 -- 172.21.15.170:0/2072230005 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe054197bc0 con 0x7fe054106800 2024-09-04T16:38:03.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:03.231+0000 7fe04bfff640 1 -- 172.21.15.170:0/2072230005 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fe03c004cf0 con 0x7fe054106800 2024-09-04T16:38:03.232 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-04T16:38:03.232 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:38:03.232 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:38:03.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:03.233+0000 7fe059439640 1 -- 172.21.15.170:0/2072230005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe040079e40 msgr2=0x7fe04007c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:03.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:03.233+0000 7fe059439640 1 --2- 172.21.15.170:0/2072230005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe040079e40 0x7fe04007c300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe0440058c0 tx=0x7fe044005ec0 comp rx=0 tx=0).stop 2024-09-04T16:38:03.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:03.233+0000 7fe059439640 1 -- 172.21.15.170:0/2072230005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe054106800 msgr2=0x7fe05419cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:03.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:03.233+0000 7fe059439640 1 --2- 172.21.15.170:0/2072230005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe054106800 0x7fe05419cb00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe03c031460 tx=0x7fe03c0048f0 comp rx=0 tx=0).stop 2024-09-04T16:38:03.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:03.233+0000 7fe059439640 1 -- 172.21.15.170:0/2072230005 shutdown_connections 2024-09-04T16:38:03.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:03.233+0000 7fe059439640 1 --2- 172.21.15.170:0/2072230005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe040079e40 0x7fe04007c300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:03.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:03.233+0000 7fe059439640 1 --2- 172.21.15.170:0/2072230005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe054106800 0x7fe05419cb00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:03.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:03.233+0000 7fe059439640 1 --2- 172.21.15.170:0/2072230005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe054100800 0x7fe05419c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:03.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:03.233+0000 7fe059439640 1 -- 172.21.15.170:0/2072230005 >> 172.21.15.170:0/2072230005 conn(0x7fe0540fc4e0 msgr2=0x7fe0540fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:03.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:03.233+0000 7fe059439640 1 -- 172.21.15.170:0/2072230005 shutdown_connections 2024-09-04T16:38:03.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:03.233+0000 7fe059439640 1 -- 172.21.15.170:0/2072230005 wait complete. 2024-09-04T16:38:03.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:03 smithi193 ceph-mon[82547]: osd.5 marked itself down and dead 2024-09-04T16:38:03.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:03 smithi193 ceph-mon[82547]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:38:03.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:03 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2072230005' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:38:04.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:03 smithi170 ceph-mon[113855]: osd.5 marked itself down and dead 2024-09-04T16:38:04.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:03 smithi170 ceph-mon[113855]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:38:04.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:03 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2072230005' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:38:04.406 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:04 smithi193 podman[99996]: 2024-09-04 16:38:04.121367478 +0000 UTC m=+1.557983797 container died 8dba9fbb37abd0a70bf9a391854b35b2560265eee45c40634f4acadcc568a874 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5, RELEASE=squid-48920da, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-04T16:38:04.781 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:04 smithi193 ceph-mon[82547]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-04T16:38:04.781 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:04 smithi193 ceph-mon[82547]: osdmap e73: 6 total, 5 up, 6 in 2024-09-04T16:38:04.782 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:04 smithi193 ceph-mon[82547]: pgmap v242: 65 pgs: 7 peering, 9 stale+active+clean, 49 active+clean; 245 MiB data, 1011 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:04.782 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:04 smithi193 podman[99996]: 2024-09-04 16:38:04.537080486 +0000 UTC m=+1.973696794 container cleanup 8dba9fbb37abd0a70bf9a391854b35b2560265eee45c40634f4acadcc568a874 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-48920da, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-04T16:38:04.782 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:04 smithi193 bash[99996]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5 2024-09-04T16:38:05.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:04 smithi170 ceph-mon[113855]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-04T16:38:05.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:04 smithi170 ceph-mon[113855]: osdmap e73: 6 total, 5 up, 6 in 2024-09-04T16:38:05.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:04 smithi170 ceph-mon[113855]: pgmap v242: 65 pgs: 7 peering, 9 stale+active+clean, 49 active+clean; 245 MiB data, 1011 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:05.156 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:04 smithi193 podman[100013]: 2024-09-04 16:38:04.780405161 +0000 UTC m=+0.660468315 container remove 8dba9fbb37abd0a70bf9a391854b35b2560265eee45c40634f4acadcc568a874 (image=quay.ceph.io/ceph-ci/ceph@sha256:2a3da6a7f1629b3648e8b7d3210a4b078c761ae55b28ce1148d46a6504eb3666, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-48920da, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-04T16:38:05.491 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:05 smithi193 podman[100101]: 2024-09-04 16:38:05.10266341 +0000 UTC m=+0.015979679 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:38:05.492 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:05 smithi193 podman[100101]: 2024-09-04 16:38:05.206316344 +0000 UTC m=+0.119632607 container create be5cfadd4c4f72550f9de6a95070ddf2daa9f8e18bf019e7ae1e70a877f81bb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-04T16:38:05.492 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:05 smithi193 podman[100101]: 2024-09-04 16:38:05.41692085 +0000 UTC m=+0.330237113 container init be5cfadd4c4f72550f9de6a95070ddf2daa9f8e18bf019e7ae1e70a877f81bb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.build-date=20240731) 2024-09-04T16:38:05.492 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:05 smithi193 podman[100101]: 2024-09-04 16:38:05.4201517 +0000 UTC m=+0.333467961 container start be5cfadd4c4f72550f9de6a95070ddf2daa9f8e18bf019e7ae1e70a877f81bb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-04T16:38:05.492 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:05 smithi193 podman[100101]: 2024-09-04 16:38:05.491809755 +0000 UTC m=+0.405126016 container attach be5cfadd4c4f72550f9de6a95070ddf2daa9f8e18bf019e7ae1e70a877f81bb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-04T16:38:05.902 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:05 smithi193 ceph-mon[82547]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-04T16:38:05.903 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:05 smithi193 ceph-mon[82547]: osdmap e74: 6 total, 5 up, 6 in 2024-09-04T16:38:05.903 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:05 smithi193 podman[100101]: 2024-09-04 16:38:05.606939671 +0000 UTC m=+0.520255941 container died be5cfadd4c4f72550f9de6a95070ddf2daa9f8e18bf019e7ae1e70a877f81bb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-04T16:38:06.003 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:05 smithi170 ceph-mon[113855]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-04T16:38:06.003 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:05 smithi170 ceph-mon[113855]: osdmap e74: 6 total, 5 up, 6 in 2024-09-04T16:38:06.156 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:06 smithi193 podman[100124]: 2024-09-04 16:38:06.145071855 +0000 UTC m=+0.532477379 container remove be5cfadd4c4f72550f9de6a95070ddf2daa9f8e18bf019e7ae1e70a877f81bb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-04T16:38:06.583 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:06 smithi193 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-04T16:38:06.583 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:06 smithi193 systemd[1]: Stopped Ceph osd.5 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:38:06.583 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:06 smithi193 systemd[1]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.5.service: Consumed 52.606s CPU time. 2024-09-04T16:38:06.583 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:06 smithi193 systemd[1]: Starting Ceph osd.5 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T16:38:06.841 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:06 smithi193 podman[100222]: 2024-09-04 16:38:06.486115323 +0000 UTC m=+0.016003291 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:38:06.841 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:06 smithi193 podman[100222]: 2024-09-04 16:38:06.596318762 +0000 UTC m=+0.126206717 container create 80fc39974adbdb38612ff93b3bdda50a0d4909425fdea116dfb7bfdbe1c56a84 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-04T16:38:06.841 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:06 smithi193 ceph-mon[82547]: pgmap v244: 65 pgs: 4 active+undersized, 7 peering, 6 stale+active+clean, 2 active+undersized+degraded, 46 active+clean; 245 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 5/312 objects degraded (1.603%) 2024-09-04T16:38:07.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:06 smithi170 ceph-mon[113855]: pgmap v244: 65 pgs: 4 active+undersized, 7 peering, 6 stale+active+clean, 2 active+undersized+degraded, 46 active+clean; 245 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 5/312 objects degraded (1.603%) 2024-09-04T16:38:07.156 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:06 smithi193 podman[100222]: 2024-09-04 16:38:06.841115 +0000 UTC m=+0.371002960 container init 80fc39974adbdb38612ff93b3bdda50a0d4909425fdea116dfb7bfdbe1c56a84 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-09-04T16:38:07.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:06 smithi193 podman[100222]: 2024-09-04 16:38:06.845253372 +0000 UTC m=+0.375141334 container start 80fc39974adbdb38612ff93b3bdda50a0d4909425fdea116dfb7bfdbe1c56a84 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-activate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-04T16:38:07.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:06 smithi193 podman[100222]: 2024-09-04 16:38:06.915685598 +0000 UTC m=+0.445573569 container attach 80fc39974adbdb38612ff93b3bdda50a0d4909425fdea116dfb7bfdbe1c56a84 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-activate, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-09-04T16:38:07.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:06 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-activate[100236]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:38:07.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:06 smithi193 bash[100222]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:38:07.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:06 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-activate[100236]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:38:07.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:06 smithi193 bash[100222]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-04T16:38:07.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:07 smithi193 ceph-mon[82547]: Health check failed: Degraded data redundancy: 5/312 objects degraded (1.603%), 2 pgs degraded (PG_DEGRADED) 2024-09-04T16:38:07.906 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:07 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-activate[100236]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-04T16:38:07.907 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:07 smithi193 bash[100222]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-04T16:38:07.907 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:07 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-activate[100236]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-04T16:38:07.907 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:07 smithi193 bash[100222]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-04T16:38:08.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:07 smithi170 ceph-mon[113855]: Health check failed: Degraded data redundancy: 5/312 objects degraded (1.603%), 2 pgs degraded (PG_DEGRADED) 2024-09-04T16:38:08.319 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:08 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-activate[100236]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-04T16:38:08.320 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:08 smithi193 bash[100222]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-04T16:38:08.320 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:08 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-activate[100236]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-04T16:38:08.320 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:08 smithi193 bash[100222]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-04T16:38:08.320 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:08 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-activate[100236]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-04T16:38:08.320 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:08 smithi193 bash[100222]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-04T16:38:08.320 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:08 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-activate[100236]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-04T16:38:08.320 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:08 smithi193 bash[100222]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-04T16:38:08.320 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:08 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-activate[100236]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-04T16:38:08.321 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:08 smithi193 bash[100222]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-04T16:38:08.321 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:08 smithi193 podman[100222]: 2024-09-04 16:38:08.032918492 +0000 UTC m=+1.562806456 container died 80fc39974adbdb38612ff93b3bdda50a0d4909425fdea116dfb7bfdbe1c56a84 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-04T16:38:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:08 smithi193 ceph-mon[82547]: pgmap v245: 65 pgs: 10 active+undersized, 7 peering, 11 active+undersized+degraded, 37 active+clean; 245 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 40/312 objects degraded (12.821%) 2024-09-04T16:38:08.906 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:08 smithi193 podman[100367]: 2024-09-04 16:38:08.585894742 +0000 UTC m=+0.544736811 container remove 80fc39974adbdb38612ff93b3bdda50a0d4909425fdea116dfb7bfdbe1c56a84 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-04T16:38:08.906 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:08 smithi193 podman[100428]: 2024-09-04 16:38:08.695889626 +0000 UTC m=+0.016000141 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T16:38:08.906 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:08 smithi193 podman[100428]: 2024-09-04 16:38:08.795032496 +0000 UTC m=+0.115143054 container create 877ff342899c6729e23bbc40fa06af747083d1d5463e728723e8acef74b64b43 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-04T16:38:09.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:08 smithi170 ceph-mon[113855]: pgmap v245: 65 pgs: 10 active+undersized, 7 peering, 11 active+undersized+degraded, 37 active+clean; 245 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 40/312 objects degraded (12.821%) 2024-09-04T16:38:09.406 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:09 smithi193 podman[100428]: 2024-09-04 16:38:09.031139753 +0000 UTC m=+0.351250265 container init 877ff342899c6729e23bbc40fa06af747083d1d5463e728723e8acef74b64b43 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-04T16:38:09.406 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:09 smithi193 podman[100428]: 2024-09-04 16:38:09.034540283 +0000 UTC m=+0.354650795 container start 877ff342899c6729e23bbc40fa06af747083d1d5463e728723e8acef74b64b43 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-04T16:38:09.406 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:09 smithi193 ceph-osd[100448]: -- 172.21.15.193:0/33441387 <== mon.1 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e05234a1e0 con 0x55e0514ebc00 2024-09-04T16:38:09.406 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:09 smithi193 bash[100428]: 877ff342899c6729e23bbc40fa06af747083d1d5463e728723e8acef74b64b43 2024-09-04T16:38:09.406 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:09 smithi193 systemd[1]: Started Ceph osd.5 for 89be7670-6ad9-11ef-bcd6-c7b262605968. 2024-09-04T16:38:10.548 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:10 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:10.549 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:10 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:10.549 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:10 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:38:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:10 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:10 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:10 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:38:11.264 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:11 smithi193 ceph-mon[82547]: pgmap v246: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-04T16:38:11.265 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:10 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T16:38:10.938+0000 7f056fd76640 -1 Falling back to public interface 2024-09-04T16:38:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:11 smithi170 ceph-mon[113855]: pgmap v246: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-04T16:38:12.436 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:12 smithi193 ceph-mon[82547]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-04T16:38:12.436 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:12 smithi193 ceph-mon[82547]: Health check update: Degraded data redundancy: 49/312 objects degraded (15.705%), 14 pgs degraded (PG_DEGRADED) 2024-09-04T16:38:12.437 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:12.437 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:12 smithi170 ceph-mon[113855]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-04T16:38:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:12 smithi170 ceph-mon[113855]: Health check update: Degraded data redundancy: 49/312 objects degraded (15.705%), 14 pgs degraded (PG_DEGRADED) 2024-09-04T16:38:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:13.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:13 smithi170 ceph-mon[113855]: pgmap v247: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-04T16:38:13.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:13 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:13.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:13 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:13 smithi193 ceph-mon[82547]: pgmap v247: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-04T16:38:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:13 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:13 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:15.278 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:15 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:15.278 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:15 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:38:15.278 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:15 smithi193 ceph-mon[82547]: pgmap v248: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-04T16:38:15.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:15 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:15.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:15 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:38:15.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:15 smithi170 ceph-mon[113855]: pgmap v248: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-04T16:38:16.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:15 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170[113851]: 2024-09-04T16:38:15.783+0000 7f1580eb9640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-04T16:38:16.406 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:15 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T16:38:15.993+0000 7f056fd76640 -1 osd.5 72 log_to_monitors true 2024-09-04T16:38:16.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:16.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:16.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:38:16.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:38:16.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:16.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:38:16.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:16.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:16.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:16.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:16.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: Upgrade: Setting container_image for all osd 2024-09-04T16:38:16.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:16.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-04T16:38:16.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-04T16:38:16.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-04T16:38:16.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-04T16:38:16.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-04T16:38:16.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-04T16:38:16.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-04T16:38:16.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-04T16:38:16.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-04T16:38:16.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-04T16:38:16.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-04T16:38:16.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-04T16:38:16.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-04T16:38:16.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-04T16:38:16.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-04T16:38:16.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-04T16:38:16.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-04T16:38:16.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: osdmap e75: 6 total, 5 up, 6 in 2024-09-04T16:38:16.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-04T16:38:16.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='osd.5 [v2:172.21.15.193:6816/2573406747,v1:172.21.15.193:6817/2573406747]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-04T16:38:16.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-04T16:38:16.855 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:16 smithi170 ceph-mon[113855]: pgmap v250: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-04T16:38:16.906 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T16:38:16.807+0000 7f0563b18640 -1 osd.5 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-04T16:38:16.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:16.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:16.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:38:16.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:38:16.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:16.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:38:16.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:16.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:16.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:16.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:16.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: Upgrade: Setting container_image for all osd 2024-09-04T16:38:16.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:16.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-04T16:38:16.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-04T16:38:16.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-04T16:38:16.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-04T16:38:16.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-04T16:38:16.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-04T16:38:16.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-04T16:38:16.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-04T16:38:16.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-04T16:38:16.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-04T16:38:16.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-04T16:38:16.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-04T16:38:16.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-04T16:38:16.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-04T16:38:16.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-04T16:38:16.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-04T16:38:16.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-04T16:38:16.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: osdmap e75: 6 total, 5 up, 6 in 2024-09-04T16:38:16.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-04T16:38:16.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='osd.5 [v2:172.21.15.193:6816/2573406747,v1:172.21.15.193:6817/2573406747]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-04T16:38:16.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-04T16:38:16.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:16 smithi193 ceph-mon[82547]: pgmap v250: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-04T16:38:17.952 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:17 smithi170 ceph-mon[113855]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-04T16:38:17.953 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:17 smithi170 ceph-mon[113855]: osdmap e76: 6 total, 5 up, 6 in 2024-09-04T16:38:17.953 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:17 smithi170 ceph-mon[113855]: mds.? [v2:172.21.15.170:6826/2819765606,v1:172.21.15.170:6827/2819765606] up:boot 2024-09-04T16:38:17.953 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:17 smithi170 ceph-mon[113855]: mds.? [v2:172.21.15.170:6828/3038480657,v1:172.21.15.170:6829/3038480657] up:boot 2024-09-04T16:38:17.953 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:17 smithi170 ceph-mon[113855]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-04T16:38:17.953 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:17 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "mds metadata", "who": "cephfs.smithi170.rzbrux"} : dispatch 2024-09-04T16:38:17.953 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:17 smithi170 ceph-mon[113855]: from='osd.5 [v2:172.21.15.193:6816/2573406747,v1:172.21.15.193:6817/2573406747]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-04T16:38:17.954 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:17 smithi170 ceph-mon[113855]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-04T16:38:17.954 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:17 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "mds metadata", "who": "cephfs.smithi170.zkhdil"} : dispatch 2024-09-04T16:38:17.954 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:17 smithi170 ceph-mon[113855]: Upgrade: Updating mds.cephfs.smithi170.zkhdil 2024-09-04T16:38:17.954 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:17 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:17.954 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:17 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.zkhdil", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-04T16:38:17.954 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:17 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:38:17.954 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:17 smithi170 ceph-mon[113855]: Deploying daemon mds.cephfs.smithi170.zkhdil on smithi170 2024-09-04T16:38:18.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:17 smithi193 ceph-mon[82547]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-04T16:38:18.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:17 smithi193 ceph-mon[82547]: osdmap e76: 6 total, 5 up, 6 in 2024-09-04T16:38:18.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:17 smithi193 ceph-mon[82547]: mds.? [v2:172.21.15.170:6826/2819765606,v1:172.21.15.170:6827/2819765606] up:boot 2024-09-04T16:38:18.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:17 smithi193 ceph-mon[82547]: mds.? [v2:172.21.15.170:6828/3038480657,v1:172.21.15.170:6829/3038480657] up:boot 2024-09-04T16:38:18.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:17 smithi193 ceph-mon[82547]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-04T16:38:18.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:17 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "mds metadata", "who": "cephfs.smithi170.rzbrux"} : dispatch 2024-09-04T16:38:18.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:17 smithi193 ceph-mon[82547]: from='osd.5 [v2:172.21.15.193:6816/2573406747,v1:172.21.15.193:6817/2573406747]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-04T16:38:18.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:17 smithi193 ceph-mon[82547]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi193", "root=default"]} : dispatch 2024-09-04T16:38:18.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:17 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "mds metadata", "who": "cephfs.smithi170.zkhdil"} : dispatch 2024-09-04T16:38:18.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:17 smithi193 ceph-mon[82547]: Upgrade: Updating mds.cephfs.smithi170.zkhdil 2024-09-04T16:38:18.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:17 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:18.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:17 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.zkhdil", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-04T16:38:18.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:17 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:38:18.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:17 smithi193 ceph-mon[82547]: Deploying daemon mds.cephfs.smithi170.zkhdil on smithi170 2024-09-04T16:38:18.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:18 smithi170 ceph-mon[113855]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-04T16:38:18.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:18 smithi170 ceph-mon[113855]: osd.5 [v2:172.21.15.193:6816/2573406747,v1:172.21.15.193:6817/2573406747] boot 2024-09-04T16:38:18.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:18 smithi170 ceph-mon[113855]: osdmap e77: 6 total, 6 up, 6 in 2024-09-04T16:38:18.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:18 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-04T16:38:18.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:18 smithi170 ceph-mon[113855]: pgmap v253: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 965 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-04T16:38:18.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:18 smithi170 ceph-mon[113855]: osdmap e78: 6 total, 6 up, 6 in 2024-09-04T16:38:19.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:18 smithi193 ceph-mon[82547]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-04T16:38:19.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:18 smithi193 ceph-mon[82547]: osd.5 [v2:172.21.15.193:6816/2573406747,v1:172.21.15.193:6817/2573406747] boot 2024-09-04T16:38:19.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:18 smithi193 ceph-mon[82547]: osdmap e77: 6 total, 6 up, 6 in 2024-09-04T16:38:19.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:18 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-04T16:38:19.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:18 smithi193 ceph-mon[82547]: pgmap v253: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 965 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-04T16:38:19.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:18 smithi193 ceph-mon[82547]: osdmap e78: 6 total, 6 up, 6 in 2024-09-04T16:38:21.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:20 smithi170 ceph-mon[113855]: osdmap e79: 6 total, 6 up, 6 in 2024-09-04T16:38:21.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:20 smithi170 ceph-mon[113855]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-04T16:38:21.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:20 smithi170 ceph-mon[113855]: pgmap v256: 65 pgs: 12 active+undersized, 12 active+undersized+degraded, 41 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 44/312 objects degraded (14.103%) 2024-09-04T16:38:21.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:20 smithi193 ceph-mon[82547]: osdmap e79: 6 total, 6 up, 6 in 2024-09-04T16:38:21.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:20 smithi193 ceph-mon[82547]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-04T16:38:21.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:20 smithi193 ceph-mon[82547]: pgmap v256: 65 pgs: 12 active+undersized, 12 active+undersized+degraded, 41 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 44/312 objects degraded (14.103%) 2024-09-04T16:38:22.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:21 smithi170 ceph-mon[113855]: Health check update: Degraded data redundancy: 44/312 objects degraded (14.103%), 12 pgs degraded (PG_DEGRADED) 2024-09-04T16:38:22.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:21 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "mds metadata", "who": "cephfs.smithi170.zkhdil"} : dispatch 2024-09-04T16:38:22.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:21 smithi193 ceph-mon[82547]: Health check update: Degraded data redundancy: 44/312 objects degraded (14.103%), 12 pgs degraded (PG_DEGRADED) 2024-09-04T16:38:22.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:21 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "mds metadata", "who": "cephfs.smithi170.zkhdil"} : dispatch 2024-09-04T16:38:23.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:22 smithi170 ceph-mon[113855]: pgmap v257: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:23.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:22 smithi193 ceph-mon[82547]: pgmap v257: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:24.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:23 smithi170 ceph-mon[113855]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/312 objects degraded (14.103%), 12 pgs degraded) 2024-09-04T16:38:24.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:23 smithi193 ceph-mon[82547]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/312 objects degraded (14.103%), 12 pgs degraded) 2024-09-04T16:38:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:24 smithi193 ceph-mon[82547]: pgmap v258: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:25.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:24 smithi170 ceph-mon[113855]: pgmap v258: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:26.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:25 smithi170 ceph-mon[113855]: mds.? [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] up:boot 2024-09-04T16:38:26.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:25 smithi170 ceph-mon[113855]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-04T16:38:26.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:25 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "mds metadata", "who": "cephfs.smithi170.zkhdil"} : dispatch 2024-09-04T16:38:26.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:25 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:26.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:25 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:26.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:25 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:38:26.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:25 smithi193 ceph-mon[82547]: mds.? [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] up:boot 2024-09-04T16:38:26.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:25 smithi193 ceph-mon[82547]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-04T16:38:26.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:25 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "mds metadata", "who": "cephfs.smithi170.zkhdil"} : dispatch 2024-09-04T16:38:26.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:25 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:26.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:25 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:26.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:25 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:38:27.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:26 smithi170 ceph-mon[113855]: pgmap v259: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:27.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:26 smithi193 ceph-mon[82547]: pgmap v259: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:28.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:28 smithi170 ceph-mon[113855]: pgmap v260: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:28.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:28 smithi193 ceph-mon[82547]: pgmap v260: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:30.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:30.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:38:30.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:30.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:30.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:38:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:31.845 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:31 smithi170 ceph-mon[113855]: pgmap v261: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:31.845 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:31 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:31.845 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:31 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:31.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:31 smithi193 ceph-mon[82547]: pgmap v261: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:31.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:31 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:31.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:31 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.323+0000 7f4a720d5640 1 -- 172.21.15.170:0/4236899296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c107930 msgr2=0x7f4a6c107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.323+0000 7f4a720d5640 1 --2- 172.21.15.170:0/4236899296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c107930 0x7f4a6c107d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c009880 tx=0x7f4a5c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.323+0000 7f4a720d5640 1 -- 172.21.15.170:0/4236899296 shutdown_connections 2024-09-04T16:38:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.323+0000 7f4a720d5640 1 --2- 172.21.15.170:0/4236899296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a6c101930 0x7f4a6c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.323+0000 7f4a720d5640 1 --2- 172.21.15.170:0/4236899296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c107930 0x7f4a6c107d10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.323+0000 7f4a720d5640 1 -- 172.21.15.170:0/4236899296 >> 172.21.15.170:0/4236899296 conn(0x7f4a6c0fd630 msgr2=0x7f4a6c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.323+0000 7f4a720d5640 1 -- 172.21.15.170:0/4236899296 shutdown_connections 2024-09-04T16:38:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.324+0000 7f4a720d5640 1 -- 172.21.15.170:0/4236899296 wait complete. 2024-09-04T16:38:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.324+0000 7f4a720d5640 1 Processor -- start 2024-09-04T16:38:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.324+0000 7f4a720d5640 1 -- start start 2024-09-04T16:38:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.324+0000 7f4a720d5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a6c101930 0x7f4a6c19d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.324+0000 7f4a720d5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c107930 0x7f4a6c19dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.324+0000 7f4a720d5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c10ede0 con 0x7f4a6c107930 2024-09-04T16:38:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.324+0000 7f4a720d5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c10ec60 con 0x7f4a6c101930 2024-09-04T16:38:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.325+0000 7f4a6affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c107930 0x7f4a6c19dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.325+0000 7f4a6affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c107930 0x7f4a6c19dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37778/0 (socket says 172.21.15.170:37778) 2024-09-04T16:38:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.325+0000 7f4a6affd640 1 -- 172.21.15.170:0/3376497774 learned_addr learned my addr 172.21.15.170:0/3376497774 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:38:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.325+0000 7f4a6b7fe640 1 --2- 172.21.15.170:0/3376497774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a6c101930 0x7f4a6c19d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.325+0000 7f4a6affd640 1 -- 172.21.15.170:0/3376497774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a6c101930 msgr2=0x7f4a6c19d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.325+0000 7f4a6affd640 1 --2- 172.21.15.170:0/3376497774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a6c101930 0x7f4a6c19d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.325+0000 7f4a6affd640 1 -- 172.21.15.170:0/3376497774 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6c1978b0 con 0x7f4a6c107930 2024-09-04T16:38:33.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.325+0000 7f4a6affd640 1 --2- 172.21.15.170:0/3376497774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c107930 0x7f4a6c19dc30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000c810 tx=0x7f4a6000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:33.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.325+0000 7f4a68ff9640 1 -- 172.21.15.170:0/3376497774 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a60004020 con 0x7f4a6c107930 2024-09-04T16:38:33.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.325+0000 7f4a68ff9640 1 -- 172.21.15.170:0/3376497774 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4a600041c0 con 0x7f4a6c107930 2024-09-04T16:38:33.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.325+0000 7f4a68ff9640 1 -- 172.21.15.170:0/3376497774 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a600047a0 con 0x7f4a6c107930 2024-09-04T16:38:33.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.325+0000 7f4a720d5640 1 -- 172.21.15.170:0/3376497774 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a6c197ba0 con 0x7f4a6c107930 2024-09-04T16:38:33.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.325+0000 7f4a720d5640 1 -- 172.21.15.170:0/3376497774 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a6c198130 con 0x7f4a6c107930 2024-09-04T16:38:33.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.326+0000 7f4a720d5640 1 -- 172.21.15.170:0/3376497774 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a6c103070 con 0x7f4a6c107930 2024-09-04T16:38:33.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.327+0000 7f4a68ff9640 1 -- 172.21.15.170:0/3376497774 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f4a600079b0 con 0x7f4a6c107930 2024-09-04T16:38:33.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.328+0000 7f4a68ff9640 1 --2- 172.21.15.170:0/3376497774 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4a54079e80 0x7f4a5407c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:33.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.328+0000 7f4a68ff9640 1 -- 172.21.15.170:0/3376497774 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7f4a6009c840 con 0x7f4a6c107930 2024-09-04T16:38:33.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.328+0000 7f4a6b7fe640 1 --2- 172.21.15.170:0/3376497774 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4a54079e80 0x7f4a5407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:33.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.328+0000 7f4a6b7fe640 1 --2- 172.21.15.170:0/3376497774 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4a54079e80 0x7f4a5407c340 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c000c00 tx=0x7f4a5c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:33.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.332+0000 7f4a68ff9640 1 -- 172.21.15.170:0/3376497774 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4a60014030 con 0x7f4a6c107930 2024-09-04T16:38:33.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.531+0000 7f4a720d5640 1 -- 172.21.15.170:0/3376497774 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4a6c104bb0 con 0x7f4a54079e80 2024-09-04T16:38:33.532 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:33 smithi170 ceph-mon[113855]: pgmap v262: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:33.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.532+0000 7f4a68ff9640 1 -- 172.21.15.170:0/3376497774 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f4a5c004340 con 0x7f4a54079e80 2024-09-04T16:38:33.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.534+0000 7f4a720d5640 1 -- 172.21.15.170:0/3376497774 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4a54079e80 msgr2=0x7f4a5407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:33.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.534+0000 7f4a720d5640 1 --2- 172.21.15.170:0/3376497774 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4a54079e80 0x7f4a5407c340 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c000c00 tx=0x7f4a5c031400 comp rx=0 tx=0).stop 2024-09-04T16:38:33.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.534+0000 7f4a720d5640 1 -- 172.21.15.170:0/3376497774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c107930 msgr2=0x7f4a6c19dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:33.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.534+0000 7f4a720d5640 1 --2- 172.21.15.170:0/3376497774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c107930 0x7f4a6c19dc30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000c810 tx=0x7f4a6000ccd0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.534+0000 7f4a720d5640 1 -- 172.21.15.170:0/3376497774 shutdown_connections 2024-09-04T16:38:33.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.534+0000 7f4a720d5640 1 --2- 172.21.15.170:0/3376497774 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4a54079e80 0x7f4a5407c340 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.534+0000 7f4a720d5640 1 --2- 172.21.15.170:0/3376497774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a6c107930 0x7f4a6c19dc30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.534+0000 7f4a720d5640 1 --2- 172.21.15.170:0/3376497774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a6c101930 0x7f4a6c19d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.534+0000 7f4a720d5640 1 -- 172.21.15.170:0/3376497774 >> 172.21.15.170:0/3376497774 conn(0x7f4a6c0fd630 msgr2=0x7f4a6c0fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:33.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.535+0000 7f4a720d5640 1 -- 172.21.15.170:0/3376497774 shutdown_connections 2024-09-04T16:38:33.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.535+0000 7f4a720d5640 1 -- 172.21.15.170:0/3376497774 wait complete. 2024-09-04T16:38:33.544 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:38:33.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.618+0000 7f7977930640 1 -- 172.21.15.170:0/2399112522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79701067e0 msgr2=0x7f7970106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.618+0000 7f7977930640 1 --2- 172.21.15.170:0/2399112522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79701067e0 0x7f7970106bc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f796c009880 tx=0x7f796c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.618+0000 7f7977930640 1 -- 172.21.15.170:0/2399112522 shutdown_connections 2024-09-04T16:38:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.618+0000 7f7977930640 1 --2- 172.21.15.170:0/2399112522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79701007e0 0x7f7970100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.618+0000 7f7977930640 1 --2- 172.21.15.170:0/2399112522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79701067e0 0x7f7970106bc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.618+0000 7f7977930640 1 -- 172.21.15.170:0/2399112522 >> 172.21.15.170:0/2399112522 conn(0x7f79700fc4c0 msgr2=0x7f79700fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.618+0000 7f7977930640 1 -- 172.21.15.170:0/2399112522 shutdown_connections 2024-09-04T16:38:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.618+0000 7f7977930640 1 -- 172.21.15.170:0/2399112522 wait complete. 2024-09-04T16:38:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.619+0000 7f7977930640 1 Processor -- start 2024-09-04T16:38:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.619+0000 7f7977930640 1 -- start start 2024-09-04T16:38:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.619+0000 7f7977930640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79701007e0 0x7f797019d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.619+0000 7f7977930640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79701067e0 0x7f797019db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.619+0000 7f7977930640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f797010dcb0 con 0x7f79701067e0 2024-09-04T16:38:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.619+0000 7f7977930640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f797010db30 con 0x7f79701007e0 2024-09-04T16:38:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.619+0000 7f7974ecb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79701067e0 0x7f797019db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.619+0000 7f7974ecb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79701067e0 0x7f797019db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37790/0 (socket says 172.21.15.170:37790) 2024-09-04T16:38:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.619+0000 7f7974ecb640 1 -- 172.21.15.170:0/2968706622 learned_addr learned my addr 172.21.15.170:0/2968706622 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:38:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.619+0000 7f79756cc640 1 --2- 172.21.15.170:0/2968706622 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79701007e0 0x7f797019d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.619+0000 7f7974ecb640 1 -- 172.21.15.170:0/2968706622 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79701007e0 msgr2=0x7f797019d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.619+0000 7f7974ecb640 1 --2- 172.21.15.170:0/2968706622 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79701007e0 0x7f797019d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.619+0000 7f7974ecb640 1 -- 172.21.15.170:0/2968706622 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7970197790 con 0x7f79701067e0 2024-09-04T16:38:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.620+0000 7f7974ecb640 1 --2- 172.21.15.170:0/2968706622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79701067e0 0x7f797019db50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f796000d6f0 tx=0x7f796000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.620+0000 7f79667fc640 1 -- 172.21.15.170:0/2968706622 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7960017070 con 0x7f79701067e0 2024-09-04T16:38:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.620+0000 7f79667fc640 1 -- 172.21.15.170:0/2968706622 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f796000de00 con 0x7f79701067e0 2024-09-04T16:38:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.620+0000 7f7977930640 1 -- 172.21.15.170:0/2968706622 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7970197a80 con 0x7f79701067e0 2024-09-04T16:38:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.620+0000 7f79667fc640 1 -- 172.21.15.170:0/2968706622 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7960004bb0 con 0x7f79701067e0 2024-09-04T16:38:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.620+0000 7f7977930640 1 -- 172.21.15.170:0/2968706622 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7970198010 con 0x7f79701067e0 2024-09-04T16:38:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.621+0000 7f7977930640 1 -- 172.21.15.170:0/2968706622 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7970101f20 con 0x7f79701067e0 2024-09-04T16:38:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.621+0000 7f79667fc640 1 -- 172.21.15.170:0/2968706622 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f7960004e60 con 0x7f79701067e0 2024-09-04T16:38:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.622+0000 7f79667fc640 1 --2- 172.21.15.170:0/2968706622 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f795c079e40 0x7f795c07c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.622+0000 7f79756cc640 1 --2- 172.21.15.170:0/2968706622 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f795c079e40 0x7f795c07c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:33.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.622+0000 7f79667fc640 1 -- 172.21.15.170:0/2968706622 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7f796009c730 con 0x7f79701067e0 2024-09-04T16:38:33.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.622+0000 7f79756cc640 1 --2- 172.21.15.170:0/2968706622 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f795c079e40 0x7f795c07c300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f796c031460 tx=0x7f796c0095c0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:33.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.626+0000 7f79667fc640 1 -- 172.21.15.170:0/2968706622 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7960064140 con 0x7f79701067e0 2024-09-04T16:38:33.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.857+0000 7f7977930640 1 -- 172.21.15.170:0/2968706622 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f79701982c0 con 0x7f795c079e40 2024-09-04T16:38:33.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.858+0000 7f79667fc640 1 -- 172.21.15.170:0/2968706622 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f79701982c0 con 0x7f795c079e40 2024-09-04T16:38:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.861+0000 7f7977930640 1 -- 172.21.15.170:0/2968706622 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f795c079e40 msgr2=0x7f795c07c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.861+0000 7f7977930640 1 --2- 172.21.15.170:0/2968706622 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f795c079e40 0x7f795c07c300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f796c031460 tx=0x7f796c0095c0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.861+0000 7f7977930640 1 -- 172.21.15.170:0/2968706622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79701067e0 msgr2=0x7f797019db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.861+0000 7f7977930640 1 --2- 172.21.15.170:0/2968706622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79701067e0 0x7f797019db50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f796000d6f0 tx=0x7f796000dbb0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.861+0000 7f7977930640 1 -- 172.21.15.170:0/2968706622 shutdown_connections 2024-09-04T16:38:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.861+0000 7f7977930640 1 --2- 172.21.15.170:0/2968706622 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f795c079e40 0x7f795c07c300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.861+0000 7f7977930640 1 --2- 172.21.15.170:0/2968706622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79701067e0 0x7f797019db50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.861+0000 7f7977930640 1 --2- 172.21.15.170:0/2968706622 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79701007e0 0x7f797019d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.861+0000 7f7977930640 1 -- 172.21.15.170:0/2968706622 >> 172.21.15.170:0/2968706622 conn(0x7f79700fc4c0 msgr2=0x7f7970069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:33.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.861+0000 7f7977930640 1 -- 172.21.15.170:0/2968706622 shutdown_connections 2024-09-04T16:38:33.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.861+0000 7f7977930640 1 -- 172.21.15.170:0/2968706622 wait complete. 2024-09-04T16:38:33.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:33 smithi193 ceph-mon[82547]: pgmap v262: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:33.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.946+0000 7ff2d29c0640 1 -- 172.21.15.170:0/1038918358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2cc1007e0 msgr2=0x7ff2cc100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:33.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.946+0000 7ff2d29c0640 1 --2- 172.21.15.170:0/1038918358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2cc1007e0 0x7ff2cc100c40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009880 tx=0x7ff2c002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.947+0000 7ff2d29c0640 1 -- 172.21.15.170:0/1038918358 shutdown_connections 2024-09-04T16:38:33.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.947+0000 7ff2d29c0640 1 --2- 172.21.15.170:0/1038918358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2cc1007e0 0x7ff2cc100c40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.947+0000 7ff2d29c0640 1 --2- 172.21.15.170:0/1038918358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2cc1067e0 0x7ff2cc106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.947+0000 7ff2d29c0640 1 -- 172.21.15.170:0/1038918358 >> 172.21.15.170:0/1038918358 conn(0x7ff2cc0fc4c0 msgr2=0x7ff2cc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:33.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.947+0000 7ff2d29c0640 1 -- 172.21.15.170:0/1038918358 shutdown_connections 2024-09-04T16:38:33.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.947+0000 7ff2d29c0640 1 -- 172.21.15.170:0/1038918358 wait complete. 2024-09-04T16:38:33.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.947+0000 7ff2d29c0640 1 Processor -- start 2024-09-04T16:38:33.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.947+0000 7ff2d29c0640 1 -- start start 2024-09-04T16:38:33.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.948+0000 7ff2d29c0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2cc1007e0 0x7ff2cc19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:33.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.948+0000 7ff2d29c0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2cc1067e0 0x7ff2cc19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:33.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.948+0000 7ff2d29c0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc10dcb0 con 0x7ff2cc1067e0 2024-09-04T16:38:33.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.948+0000 7ff2d29c0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc10db30 con 0x7ff2cc1007e0 2024-09-04T16:38:33.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.948+0000 7ff2cb7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2cc1067e0 0x7ff2cc19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:33.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.948+0000 7ff2cb7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2cc1067e0 0x7ff2cc19dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37810/0 (socket says 172.21.15.170:37810) 2024-09-04T16:38:33.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.948+0000 7ff2cb7fe640 1 -- 172.21.15.170:0/1758175135 learned_addr learned my addr 172.21.15.170:0/1758175135 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:38:33.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.948+0000 7ff2cbfff640 1 --2- 172.21.15.170:0/1758175135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2cc1007e0 0x7ff2cc19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:33.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.948+0000 7ff2cb7fe640 1 -- 172.21.15.170:0/1758175135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2cc1007e0 msgr2=0x7ff2cc19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:33.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.948+0000 7ff2cb7fe640 1 --2- 172.21.15.170:0/1758175135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2cc1007e0 0x7ff2cc19d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:33.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.948+0000 7ff2cb7fe640 1 -- 172.21.15.170:0/1758175135 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2cc197830 con 0x7ff2cc1067e0 2024-09-04T16:38:33.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.948+0000 7ff2cb7fe640 1 --2- 172.21.15.170:0/1758175135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2cc1067e0 0x7ff2cc19dbf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0031460 tx=0x7ff2c00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:33.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.949+0000 7ff2c97fa640 1 -- 172.21.15.170:0/1758175135 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2c003f070 con 0x7ff2cc1067e0 2024-09-04T16:38:33.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.949+0000 7ff2c97fa640 1 -- 172.21.15.170:0/1758175135 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff2c0004b10 con 0x7ff2cc1067e0 2024-09-04T16:38:33.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.949+0000 7ff2d29c0640 1 -- 172.21.15.170:0/1758175135 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2cc197ac0 con 0x7ff2cc1067e0 2024-09-04T16:38:33.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.949+0000 7ff2c97fa640 1 -- 172.21.15.170:0/1758175135 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2c0035030 con 0x7ff2cc1067e0 2024-09-04T16:38:33.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.949+0000 7ff2d29c0640 1 -- 172.21.15.170:0/1758175135 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2cc197ff0 con 0x7ff2cc1067e0 2024-09-04T16:38:33.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.950+0000 7ff2d29c0640 1 -- 172.21.15.170:0/1758175135 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2cc101f20 con 0x7ff2cc1067e0 2024-09-04T16:38:33.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.950+0000 7ff2c97fa640 1 -- 172.21.15.170:0/1758175135 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ff2c0042070 con 0x7ff2cc1067e0 2024-09-04T16:38:33.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.951+0000 7ff2c97fa640 1 --2- 172.21.15.170:0/1758175135 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff2b4079e40 0x7ff2b407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:33.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.951+0000 7ff2c97fa640 1 -- 172.21.15.170:0/1758175135 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7ff2c00bd500 con 0x7ff2cc1067e0 2024-09-04T16:38:33.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.951+0000 7ff2cbfff640 1 --2- 172.21.15.170:0/1758175135 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff2b4079e40 0x7ff2b407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:33.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.951+0000 7ff2cbfff640 1 --2- 172.21.15.170:0/1758175135 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff2b4079e40 0x7ff2b407c300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc005fd0 tx=0x7ff2bc00b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:33.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:33.955+0000 7ff2c97fa640 1 -- 172.21.15.170:0/1758175135 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff2c0089080 con 0x7ff2cc1067e0 2024-09-04T16:38:34.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.145+0000 7ff2d29c0640 1 -- 172.21.15.170:0/1758175135 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff2cc198360 con 0x7ff2b4079e40 2024-09-04T16:38:34.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.157+0000 7ff2c97fa640 1 -- 172.21.15.170:0/1758175135 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ff2cc198360 con 0x7ff2b4079e40 2024-09-04T16:38:34.158 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:38:34.159 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (5m) 4s ago 16m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:38:34.159 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (8m) 4s ago 16m 9281k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:38:34.159 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (8m) 22s ago 15m 8644k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:38:34.159 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (3m) 4s ago 16m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:38:34.159 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (3m) 22s ago 15m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:38:34.159 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (5m) 4s ago 16m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:38:34.159 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (11m) 4s ago 11m 12.1M - 19.1.1-252-g48920dab b708f9119ac7 58630b40e596 2024-09-04T16:38:34.159 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (9s) 4s ago 11m 14.6M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:38:34.159 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (11m) 22s ago 11m 18.2M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:38:34.159 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (11m) 22s ago 11m 17.7M - 19.1.1-252-g48920dab b708f9119ac7 b15afd5c9c72 2024-09-04T16:38:34.159 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (7m) 4s ago 17m 528M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:38:34.159 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (6m) 22s ago 15m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:38:34.159 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (4m) 4s ago 17m 48.3M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:38:34.160 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (3m) 22s ago 15m 36.9M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:38:34.160 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (6m) 4s ago 16m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:38:34.160 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (6m) 22s ago 15m 11.8M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:38:34.160 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (3m) 4s ago 14m 87.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:38:34.160 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (2m) 4s ago 13m 89.0M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:38:34.160 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (2m) 4s ago 13m 83.7M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:38:34.160 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (90s) 22s ago 13m 98.5M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:38:34.160 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (57s) 22s ago 12m 95.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:38:34.160 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (25s) 22s ago 12m 11.1M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:38:34.160 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (5m) 4s ago 15m 56.0M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:38:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.160+0000 7ff2d29c0640 1 -- 172.21.15.170:0/1758175135 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff2b4079e40 msgr2=0x7ff2b407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.160+0000 7ff2d29c0640 1 --2- 172.21.15.170:0/1758175135 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff2b4079e40 0x7ff2b407c300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc005fd0 tx=0x7ff2bc00b390 comp rx=0 tx=0).stop 2024-09-04T16:38:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.160+0000 7ff2d29c0640 1 -- 172.21.15.170:0/1758175135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2cc1067e0 msgr2=0x7ff2cc19dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.160+0000 7ff2d29c0640 1 --2- 172.21.15.170:0/1758175135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2cc1067e0 0x7ff2cc19dbf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0031460 tx=0x7ff2c00045e0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.160+0000 7ff2d29c0640 1 -- 172.21.15.170:0/1758175135 shutdown_connections 2024-09-04T16:38:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.160+0000 7ff2d29c0640 1 --2- 172.21.15.170:0/1758175135 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff2b4079e40 0x7ff2b407c300 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.160+0000 7ff2d29c0640 1 --2- 172.21.15.170:0/1758175135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2cc1067e0 0x7ff2cc19dbf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.160+0000 7ff2d29c0640 1 --2- 172.21.15.170:0/1758175135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff2cc1007e0 0x7ff2cc19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.160+0000 7ff2d29c0640 1 -- 172.21.15.170:0/1758175135 >> 172.21.15.170:0/1758175135 conn(0x7ff2cc0fc4c0 msgr2=0x7ff2cc069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:34.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.160+0000 7ff2d29c0640 1 -- 172.21.15.170:0/1758175135 shutdown_connections 2024-09-04T16:38:34.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.160+0000 7ff2d29c0640 1 -- 172.21.15.170:0/1758175135 wait complete. 2024-09-04T16:38:34.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.248+0000 7f85687c0640 1 -- 172.21.15.170:0/680154839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85601067e0 msgr2=0x7f8560106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:34.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.248+0000 7f85687c0640 1 --2- 172.21.15.170:0/680154839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85601067e0 0x7f8560106bc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8558009880 tx=0x7f855802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.248+0000 7f85687c0640 1 -- 172.21.15.170:0/680154839 shutdown_connections 2024-09-04T16:38:34.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.248+0000 7f85687c0640 1 --2- 172.21.15.170:0/680154839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85601007e0 0x7f8560100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.248+0000 7f85687c0640 1 --2- 172.21.15.170:0/680154839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85601067e0 0x7f8560106bc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.248+0000 7f85687c0640 1 -- 172.21.15.170:0/680154839 >> 172.21.15.170:0/680154839 conn(0x7f85600fc4c0 msgr2=0x7f85600fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:34.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.249+0000 7f85687c0640 1 -- 172.21.15.170:0/680154839 shutdown_connections 2024-09-04T16:38:34.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.249+0000 7f85687c0640 1 -- 172.21.15.170:0/680154839 wait complete. 2024-09-04T16:38:34.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.249+0000 7f85687c0640 1 Processor -- start 2024-09-04T16:38:34.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.249+0000 7f85687c0640 1 -- start start 2024-09-04T16:38:34.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.249+0000 7f85687c0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85601007e0 0x7f856019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:34.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.249+0000 7f85687c0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85601067e0 0x7f856019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:34.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.249+0000 7f85687c0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f856010dcb0 con 0x7f85601067e0 2024-09-04T16:38:34.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.249+0000 7f85687c0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f856010db30 con 0x7f85601007e0 2024-09-04T16:38:34.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.249+0000 7f8565d5b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85601067e0 0x7f856019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:34.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.250+0000 7f8565d5b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85601067e0 0x7f856019fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37834/0 (socket says 172.21.15.170:37834) 2024-09-04T16:38:34.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.250+0000 7f8565d5b640 1 -- 172.21.15.170:0/1999363371 learned_addr learned my addr 172.21.15.170:0/1999363371 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:38:34.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.250+0000 7f856655c640 1 --2- 172.21.15.170:0/1999363371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85601007e0 0x7f856019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:34.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.250+0000 7f8565d5b640 1 -- 172.21.15.170:0/1999363371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85601007e0 msgr2=0x7f856019f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:34.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.250+0000 7f8565d5b640 1 --2- 172.21.15.170:0/1999363371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85601007e0 0x7f856019f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.250+0000 7f8565d5b640 1 -- 172.21.15.170:0/1999363371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8560199a20 con 0x7f85601067e0 2024-09-04T16:38:34.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.250+0000 7f8565d5b640 1 --2- 172.21.15.170:0/1999363371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85601067e0 0x7f856019fda0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f855400d6f0 tx=0x7f855400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:34.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.250+0000 7f855f7fe640 1 -- 172.21.15.170:0/1999363371 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8554017070 con 0x7f85601067e0 2024-09-04T16:38:34.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.250+0000 7f855f7fe640 1 -- 172.21.15.170:0/1999363371 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f855400de00 con 0x7f85601067e0 2024-09-04T16:38:34.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.250+0000 7f85687c0640 1 -- 172.21.15.170:0/1999363371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8560199d10 con 0x7f85601067e0 2024-09-04T16:38:34.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.250+0000 7f855f7fe640 1 -- 172.21.15.170:0/1999363371 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8554004bb0 con 0x7f85601067e0 2024-09-04T16:38:34.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.250+0000 7f85687c0640 1 -- 172.21.15.170:0/1999363371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f856019a2a0 con 0x7f85601067e0 2024-09-04T16:38:34.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.251+0000 7f85687c0640 1 -- 172.21.15.170:0/1999363371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8560101f20 con 0x7f85601067e0 2024-09-04T16:38:34.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.252+0000 7f855f7fe640 1 -- 172.21.15.170:0/1999363371 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f8554009a30 con 0x7f85601067e0 2024-09-04T16:38:34.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.252+0000 7f855f7fe640 1 --2- 172.21.15.170:0/1999363371 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8548079e80 0x7f854807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:34.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.252+0000 7f856655c640 1 --2- 172.21.15.170:0/1999363371 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8548079e80 0x7f854807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:34.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.252+0000 7f855f7fe640 1 -- 172.21.15.170:0/1999363371 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7f855409c560 con 0x7f85601067e0 2024-09-04T16:38:34.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.253+0000 7f856655c640 1 --2- 172.21.15.170:0/1999363371 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8548079e80 0x7f854807c340 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8558000c00 tx=0x7f8558031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:34.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.257+0000 7f855f7fe640 1 -- 172.21.15.170:0/1999363371 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8554068160 con 0x7f85601067e0 2024-09-04T16:38:34.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.503+0000 7f85687c0640 1 -- 172.21.15.170:0/1999363371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8560100c40 con 0x7f85601067e0 2024-09-04T16:38:34.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.504+0000 7f855f7fe640 1 -- 172.21.15.170:0/1999363371 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f855406cb80 con 0x7f85601067e0 2024-09-04T16:38:34.505 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:38:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:38:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:38:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:38:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:38:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:38:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:38:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:38:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:38:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:38:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:38:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 3, 2024-09-04T16:38:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 1 2024-09-04T16:38:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:38:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:38:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 3, 2024-09-04T16:38:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 11 2024-09-04T16:38:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:38:34.506 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:38:34.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.506+0000 7f85687c0640 1 -- 172.21.15.170:0/1999363371 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8548079e80 msgr2=0x7f854807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:34.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.506+0000 7f85687c0640 1 --2- 172.21.15.170:0/1999363371 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8548079e80 0x7f854807c340 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8558000c00 tx=0x7f8558031400 comp rx=0 tx=0).stop 2024-09-04T16:38:34.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.506+0000 7f85687c0640 1 -- 172.21.15.170:0/1999363371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85601067e0 msgr2=0x7f856019fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:34.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.506+0000 7f85687c0640 1 --2- 172.21.15.170:0/1999363371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85601067e0 0x7f856019fda0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f855400d6f0 tx=0x7f855400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.507+0000 7f85687c0640 1 -- 172.21.15.170:0/1999363371 shutdown_connections 2024-09-04T16:38:34.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.507+0000 7f85687c0640 1 --2- 172.21.15.170:0/1999363371 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8548079e80 0x7f854807c340 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.507+0000 7f85687c0640 1 --2- 172.21.15.170:0/1999363371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85601067e0 0x7f856019fda0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.507+0000 7f85687c0640 1 --2- 172.21.15.170:0/1999363371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85601007e0 0x7f856019f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.507+0000 7f85687c0640 1 -- 172.21.15.170:0/1999363371 >> 172.21.15.170:0/1999363371 conn(0x7f85600fc4c0 msgr2=0x7f85600fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:34.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.507+0000 7f85687c0640 1 -- 172.21.15.170:0/1999363371 shutdown_connections 2024-09-04T16:38:34.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.507+0000 7f85687c0640 1 -- 172.21.15.170:0/1999363371 wait complete. 2024-09-04T16:38:34.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.589+0000 7fd40a8e2640 1 -- 172.21.15.170:0/4160324221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4041033c0 msgr2=0x7fd40410b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:34.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.589+0000 7fd40a8e2640 1 --2- 172.21.15.170:0/4160324221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4041033c0 0x7fd40410b8b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8009880 tx=0x7fd3f802a530 comp rx=0 tx=0).stop 2024-09-04T16:38:34.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.589+0000 7fd40a8e2640 1 -- 172.21.15.170:0/4160324221 shutdown_connections 2024-09-04T16:38:34.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.589+0000 7fd40a8e2640 1 --2- 172.21.15.170:0/4160324221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4041033c0 0x7fd40410b8b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.589+0000 7fd40a8e2640 1 --2- 172.21.15.170:0/4160324221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd404102aa0 0x7fd404102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.589+0000 7fd40a8e2640 1 -- 172.21.15.170:0/4160324221 >> 172.21.15.170:0/4160324221 conn(0x7fd4040fc4c0 msgr2=0x7fd4040fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:34.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.590+0000 7fd40a8e2640 1 -- 172.21.15.170:0/4160324221 shutdown_connections 2024-09-04T16:38:34.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.590+0000 7fd40a8e2640 1 -- 172.21.15.170:0/4160324221 wait complete. 2024-09-04T16:38:34.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.590+0000 7fd40a8e2640 1 Processor -- start 2024-09-04T16:38:34.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.590+0000 7fd40a8e2640 1 -- start start 2024-09-04T16:38:34.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.591+0000 7fd40a8e2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd404102aa0 0x7fd40419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:34.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.591+0000 7fd40a8e2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4041033c0 0x7fd40419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:34.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.591+0000 7fd40a8e2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd40410edb0 con 0x7fd404102aa0 2024-09-04T16:38:34.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.591+0000 7fd40a8e2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd40410ec30 con 0x7fd4041033c0 2024-09-04T16:38:34.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.591+0000 7fd403fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd404102aa0 0x7fd40419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:34.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.591+0000 7fd403fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd404102aa0 0x7fd40419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37850/0 (socket says 172.21.15.170:37850) 2024-09-04T16:38:34.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.591+0000 7fd403fff640 1 -- 172.21.15.170:0/497645648 learned_addr learned my addr 172.21.15.170:0/497645648 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:38:34.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.591+0000 7fd4037fe640 1 --2- 172.21.15.170:0/497645648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4041033c0 0x7fd40419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:34.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.591+0000 7fd403fff640 1 -- 172.21.15.170:0/497645648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4041033c0 msgr2=0x7fd40419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.591+0000 7fd403fff640 1 --2- 172.21.15.170:0/497645648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4041033c0 0x7fd40419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.591+0000 7fd403fff640 1 -- 172.21.15.170:0/497645648 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4041977c0 con 0x7fd404102aa0 2024-09-04T16:38:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.591+0000 7fd403fff640 1 --2- 172.21.15.170:0/497645648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd404102aa0 0x7fd40419d640 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400d8d0 tx=0x7fd3f400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.592+0000 7fd4017fa640 1 -- 172.21.15.170:0/497645648 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3f4017070 con 0x7fd404102aa0 2024-09-04T16:38:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.592+0000 7fd40a8e2640 1 -- 172.21.15.170:0/497645648 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd404197ab0 con 0x7fd404102aa0 2024-09-04T16:38:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.592+0000 7fd4017fa640 1 -- 172.21.15.170:0/497645648 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd3f4010460 con 0x7fd404102aa0 2024-09-04T16:38:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.592+0000 7fd4017fa640 1 -- 172.21.15.170:0/497645648 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3f400f5f0 con 0x7fd404102aa0 2024-09-04T16:38:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.592+0000 7fd40a8e2640 1 -- 172.21.15.170:0/497645648 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd404198040 con 0x7fd404102aa0 2024-09-04T16:38:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.593+0000 7fd40a8e2640 1 -- 172.21.15.170:0/497645648 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd40406a410 con 0x7fd404102aa0 2024-09-04T16:38:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.593+0000 7fd4017fa640 1 -- 172.21.15.170:0/497645648 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fd3f4009a30 con 0x7fd404102aa0 2024-09-04T16:38:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.594+0000 7fd4017fa640 1 --2- 172.21.15.170:0/497645648 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd3ec079e30 0x7fd3ec07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.594+0000 7fd4037fe640 1 --2- 172.21.15.170:0/497645648 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd3ec079e30 0x7fd3ec07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.594+0000 7fd4017fa640 1 -- 172.21.15.170:0/497645648 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7fd3f409c9f0 con 0x7fd404102aa0 2024-09-04T16:38:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.594+0000 7fd4037fe640 1 --2- 172.21.15.170:0/497645648 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd3ec079e30 0x7fd3ec07c2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8031460 tx=0x7fd3f8009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:34.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.598+0000 7fd4017fa640 1 -- 172.21.15.170:0/497645648 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd3f409ee20 con 0x7fd404102aa0 2024-09-04T16:38:34.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.820+0000 7fd40a8e2640 1 -- 172.21.15.170:0/497645648 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd404105fb0 con 0x7fd404102aa0 2024-09-04T16:38:34.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.820+0000 7fd4017fa640 1 -- 172.21.15.170:0/497645648 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) ==== 76+0+2004 (secure 0 0 0) 0x7fd3f40643a0 con 0x7fd404102aa0 2024-09-04T16:38:34.821 INFO:teuthology.orchestra.run.smithi170.stdout:e19 2024-09-04T16:38:34.821 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:38:24:820923+0000 2024-09-04T16:38:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:38:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:38:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:38:34.822 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:38:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:38:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:38:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:38:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:38:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:38:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:38:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:38:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:38:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:38:34.823 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:38:34.823 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:38:34.823 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:38:34.823 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:38:34.823 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:38:34.823 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:38:34.823 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:38:34.823 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:38:34.823 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:38:34.823 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:38:34.823 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:38:34.823 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:38:34.823 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:38:34.823 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:38:34.824 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:38:34.824 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:38:34.824 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:38:34.824 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:38:34.824 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:38:34.824 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:38:34.824 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:38:34.824 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:38:34.824 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:38:34.824 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:38:34.824 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:24315} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.193:6826/288890560,v1:172.21.15.193:6827/288890560] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:38:34.824 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:24319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1128257367,v1:172.21.15.193:6825/1128257367] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:38:34.824 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34314} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/2819765606,v1:172.21.15.170:6827/2819765606] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:38:34.824 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:38:34.825 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 19 2024-09-04T16:38:34.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.823+0000 7fd40a8e2640 1 -- 172.21.15.170:0/497645648 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd3ec079e30 msgr2=0x7fd3ec07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:34.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.823+0000 7fd40a8e2640 1 --2- 172.21.15.170:0/497645648 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd3ec079e30 0x7fd3ec07c2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8031460 tx=0x7fd3f8009560 comp rx=0 tx=0).stop 2024-09-04T16:38:34.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.823+0000 7fd40a8e2640 1 -- 172.21.15.170:0/497645648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd404102aa0 msgr2=0x7fd40419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:34.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.823+0000 7fd40a8e2640 1 --2- 172.21.15.170:0/497645648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd404102aa0 0x7fd40419d640 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400d8d0 tx=0x7fd3f400dd90 comp rx=0 tx=0).stop 2024-09-04T16:38:34.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.823+0000 7fd40a8e2640 1 -- 172.21.15.170:0/497645648 shutdown_connections 2024-09-04T16:38:34.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.823+0000 7fd40a8e2640 1 --2- 172.21.15.170:0/497645648 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd3ec079e30 0x7fd3ec07c2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.823+0000 7fd40a8e2640 1 --2- 172.21.15.170:0/497645648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4041033c0 0x7fd40419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.823+0000 7fd40a8e2640 1 --2- 172.21.15.170:0/497645648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd404102aa0 0x7fd40419d640 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.823+0000 7fd40a8e2640 1 -- 172.21.15.170:0/497645648 >> 172.21.15.170:0/497645648 conn(0x7fd4040fc4c0 msgr2=0x7fd404103d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:34.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.823+0000 7fd40a8e2640 1 -- 172.21.15.170:0/497645648 shutdown_connections 2024-09-04T16:38:34.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.823+0000 7fd40a8e2640 1 -- 172.21.15.170:0/497645648 wait complete. 2024-09-04T16:38:34.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.911+0000 7f67035e6640 1 -- 172.21.15.170:0/3747619440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66fc102aa0 msgr2=0x7f66fc102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:34.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.911+0000 7f67035e6640 1 --2- 172.21.15.170:0/3747619440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66fc102aa0 0x7f66fc102e80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009c20 tx=0x7f66ec02aa00 comp rx=0 tx=0).stop 2024-09-04T16:38:34.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.912+0000 7f67035e6640 1 -- 172.21.15.170:0/3747619440 shutdown_connections 2024-09-04T16:38:34.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.912+0000 7f67035e6640 1 --2- 172.21.15.170:0/3747619440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66fc1033c0 0x7f66fc10b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.912+0000 7f67035e6640 1 --2- 172.21.15.170:0/3747619440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66fc102aa0 0x7f66fc102e80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.912+0000 7f67035e6640 1 -- 172.21.15.170:0/3747619440 >> 172.21.15.170:0/3747619440 conn(0x7f66fc0fc4c0 msgr2=0x7f66fc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:34.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.912+0000 7f67035e6640 1 -- 172.21.15.170:0/3747619440 shutdown_connections 2024-09-04T16:38:34.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.912+0000 7f67035e6640 1 -- 172.21.15.170:0/3747619440 wait complete. 2024-09-04T16:38:34.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.912+0000 7f67035e6640 1 Processor -- start 2024-09-04T16:38:34.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.912+0000 7f67035e6640 1 -- start start 2024-09-04T16:38:34.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f67035e6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66fc102aa0 0x7f66fc19d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:34.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f67035e6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66fc1033c0 0x7f66fc19db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:34.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f67035e6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc10edb0 con 0x7f66fc102aa0 2024-09-04T16:38:34.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f67035e6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc10ec30 con 0x7f66fc1033c0 2024-09-04T16:38:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f6701382640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66fc102aa0 0x7f66fc19d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f6701382640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66fc102aa0 0x7f66fc19d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37868/0 (socket says 172.21.15.170:37868) 2024-09-04T16:38:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f6701382640 1 -- 172.21.15.170:0/3013238901 learned_addr learned my addr 172.21.15.170:0/3013238901 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:38:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f6700b81640 1 --2- 172.21.15.170:0/3013238901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66fc1033c0 0x7f66fc19db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f6701382640 1 -- 172.21.15.170:0/3013238901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66fc1033c0 msgr2=0x7f66fc19db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f6701382640 1 --2- 172.21.15.170:0/3013238901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66fc1033c0 0x7f66fc19db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f6701382640 1 -- 172.21.15.170:0/3013238901 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66fc197780 con 0x7f66fc102aa0 2024-09-04T16:38:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f6700b81640 1 --2- 172.21.15.170:0/3013238901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66fc1033c0 0x7f66fc19db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:38:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f6701382640 1 --2- 172.21.15.170:0/3013238901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66fc102aa0 0x7f66fc19d600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f66ec005cc0 tx=0x7f66ec02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f66fa7fc640 1 -- 172.21.15.170:0/3013238901 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66ec047070 con 0x7f66fc102aa0 2024-09-04T16:38:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f66fa7fc640 1 -- 172.21.15.170:0/3013238901 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f66ec003e30 con 0x7f66fc102aa0 2024-09-04T16:38:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f67035e6640 1 -- 172.21.15.170:0/3013238901 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66fc197a10 con 0x7f66fc102aa0 2024-09-04T16:38:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f66fa7fc640 1 -- 172.21.15.170:0/3013238901 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66ec033050 con 0x7f66fc102aa0 2024-09-04T16:38:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.913+0000 7f67035e6640 1 -- 172.21.15.170:0/3013238901 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66fc197f40 con 0x7f66fc102aa0 2024-09-04T16:38:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.914+0000 7f67035e6640 1 -- 172.21.15.170:0/3013238901 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66fc06a410 con 0x7f66fc102aa0 2024-09-04T16:38:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.915+0000 7f66fa7fc640 1 -- 172.21.15.170:0/3013238901 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f66ec04a070 con 0x7f66fc102aa0 2024-09-04T16:38:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.915+0000 7f66fa7fc640 1 --2- 172.21.15.170:0/3013238901 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f66e4079e40 0x7f66e407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.916+0000 7f66fa7fc640 1 -- 172.21.15.170:0/3013238901 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7f66ec03e030 con 0x7f66fc102aa0 2024-09-04T16:38:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.916+0000 7f6700b81640 1 --2- 172.21.15.170:0/3013238901 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f66e4079e40 0x7f66e407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:34.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.916+0000 7f6700b81640 1 --2- 172.21.15.170:0/3013238901 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f66e4079e40 0x7f66e407c300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f66fc1088e0 tx=0x7f66f0005e30 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:34.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:34.920+0000 7f66fa7fc640 1 -- 172.21.15.170:0/3013238901 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f66ec0856f0 con 0x7f66fc102aa0 2024-09-04T16:38:35.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:34 smithi170 ceph-mon[113855]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:38:35.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:35.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:35.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:38:35.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:38:35.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:35.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:34 smithi170 ceph-mon[113855]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:38:35.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:38:35.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:35.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:35.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:35.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:35.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:34 smithi170 ceph-mon[113855]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:38:35.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:34 smithi170 ceph-mon[113855]: pgmap v263: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:35.103 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:34 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1999363371' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:35.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.113+0000 7f67035e6640 1 -- 172.21.15.170:0/3013238901 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f66fc198cb0 con 0x7f66e4079e40 2024-09-04T16:38:35.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.114+0000 7f66fa7fc640 1 -- 172.21.15.170:0/3013238901 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f66fc198cb0 con 0x7f66e4079e40 2024-09-04T16:38:35.115 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:38:35.115 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:38:35.115 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:38:35.115 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:38:35.115 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:38:35.115 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-04T16:38:35.115 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:38:35.115 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:38:35.116 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-04T16:38:35.116 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:38:35.116 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "13/23 daemons upgraded", 2024-09-04T16:38:35.116 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:38:35.116 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:38:35.116 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:38:35.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.117+0000 7f67035e6640 1 -- 172.21.15.170:0/3013238901 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f66e4079e40 msgr2=0x7f66e407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:35.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.117+0000 7f67035e6640 1 --2- 172.21.15.170:0/3013238901 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f66e4079e40 0x7f66e407c300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f66fc1088e0 tx=0x7f66f0005e30 comp rx=0 tx=0).stop 2024-09-04T16:38:35.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.117+0000 7f67035e6640 1 -- 172.21.15.170:0/3013238901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66fc102aa0 msgr2=0x7f66fc19d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:35.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.117+0000 7f67035e6640 1 --2- 172.21.15.170:0/3013238901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66fc102aa0 0x7f66fc19d600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f66ec005cc0 tx=0x7f66ec02ee60 comp rx=0 tx=0).stop 2024-09-04T16:38:35.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.117+0000 7f67035e6640 1 -- 172.21.15.170:0/3013238901 shutdown_connections 2024-09-04T16:38:35.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.117+0000 7f67035e6640 1 --2- 172.21.15.170:0/3013238901 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f66e4079e40 0x7f66e407c300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:35.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.117+0000 7f67035e6640 1 --2- 172.21.15.170:0/3013238901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66fc1033c0 0x7f66fc19db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:35.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.117+0000 7f67035e6640 1 --2- 172.21.15.170:0/3013238901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66fc102aa0 0x7f66fc19d600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:35.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.117+0000 7f67035e6640 1 -- 172.21.15.170:0/3013238901 >> 172.21.15.170:0/3013238901 conn(0x7f66fc0fc4c0 msgr2=0x7f66fc108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:35.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.117+0000 7f67035e6640 1 -- 172.21.15.170:0/3013238901 shutdown_connections 2024-09-04T16:38:35.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.117+0000 7f67035e6640 1 -- 172.21.15.170:0/3013238901 wait complete. 2024-09-04T16:38:35.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:34 smithi193 ceph-mon[82547]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:38:35.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:35.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:35.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:38:35.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:38:35.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:35.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:34 smithi193 ceph-mon[82547]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:38:35.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:38:35.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:35.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:35.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:35.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:35.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:34 smithi193 ceph-mon[82547]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:38:35.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:34 smithi193 ceph-mon[82547]: pgmap v263: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:35.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:34 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1999363371' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.200+0000 7fcda6fd3640 1 -- 172.21.15.170:0/1436706113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda01067e0 msgr2=0x7fcda0106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.200+0000 7fcda6fd3640 1 --2- 172.21.15.170:0/1436706113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda01067e0 0x7fcda0106bc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009880 tx=0x7fcd9402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:38:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.200+0000 7fcda6fd3640 1 -- 172.21.15.170:0/1436706113 shutdown_connections 2024-09-04T16:38:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.200+0000 7fcda6fd3640 1 --2- 172.21.15.170:0/1436706113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcda01007e0 0x7fcda0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.200+0000 7fcda6fd3640 1 --2- 172.21.15.170:0/1436706113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda01067e0 0x7fcda0106bc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.200+0000 7fcda6fd3640 1 -- 172.21.15.170:0/1436706113 >> 172.21.15.170:0/1436706113 conn(0x7fcda00fc4c0 msgr2=0x7fcda00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.201+0000 7fcda6fd3640 1 -- 172.21.15.170:0/1436706113 shutdown_connections 2024-09-04T16:38:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.201+0000 7fcda6fd3640 1 -- 172.21.15.170:0/1436706113 wait complete. 2024-09-04T16:38:35.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.201+0000 7fcda6fd3640 1 Processor -- start 2024-09-04T16:38:35.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.201+0000 7fcda6fd3640 1 -- start start 2024-09-04T16:38:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.201+0000 7fcda6fd3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcda01007e0 0x7fcda019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.201+0000 7fcda6fd3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda01067e0 0x7fcda019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.201+0000 7fcda6fd3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcda010dcb0 con 0x7fcda01067e0 2024-09-04T16:38:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.201+0000 7fcda6fd3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcda010db30 con 0x7fcda01007e0 2024-09-04T16:38:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.202+0000 7fcd9ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda01067e0 0x7fcda019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.202+0000 7fcd9ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda01067e0 0x7fcda019db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44988/0 (socket says 172.21.15.170:44988) 2024-09-04T16:38:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.202+0000 7fcd9ffff640 1 -- 172.21.15.170:0/1791998452 learned_addr learned my addr 172.21.15.170:0/1791998452 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:38:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.202+0000 7fcda4d6f640 1 --2- 172.21.15.170:0/1791998452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcda01007e0 0x7fcda019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.202+0000 7fcd9ffff640 1 -- 172.21.15.170:0/1791998452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcda01007e0 msgr2=0x7fcda019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.202+0000 7fcd9ffff640 1 --2- 172.21.15.170:0/1791998452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcda01007e0 0x7fcda019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.202+0000 7fcd9ffff640 1 -- 172.21.15.170:0/1791998452 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda01977d0 con 0x7fcda01067e0 2024-09-04T16:38:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.202+0000 7fcd9ffff640 1 --2- 172.21.15.170:0/1791998452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda01067e0 0x7fcda019db90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00e970 tx=0x7fcd8c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:35.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.202+0000 7fcd9dffb640 1 -- 172.21.15.170:0/1791998452 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd8c00cac0 con 0x7fcda01067e0 2024-09-04T16:38:35.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.202+0000 7fcd9dffb640 1 -- 172.21.15.170:0/1791998452 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd8c0054e0 con 0x7fcda01067e0 2024-09-04T16:38:35.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.202+0000 7fcda6fd3640 1 -- 172.21.15.170:0/1791998452 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda0197ac0 con 0x7fcda01067e0 2024-09-04T16:38:35.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.202+0000 7fcd9dffb640 1 -- 172.21.15.170:0/1791998452 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd8c010430 con 0x7fcda01067e0 2024-09-04T16:38:35.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.203+0000 7fcda6fd3640 1 -- 172.21.15.170:0/1791998452 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda0198050 con 0x7fcda01067e0 2024-09-04T16:38:35.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.204+0000 7fcda6fd3640 1 -- 172.21.15.170:0/1791998452 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcda0101f20 con 0x7fcda01067e0 2024-09-04T16:38:35.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.204+0000 7fcd9dffb640 1 -- 172.21.15.170:0/1791998452 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fcd8c004f00 con 0x7fcda01067e0 2024-09-04T16:38:35.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.204+0000 7fcd9dffb640 1 --2- 172.21.15.170:0/1791998452 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd90079e80 0x7fcd9007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:38:35.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.204+0000 7fcd9dffb640 1 -- 172.21.15.170:0/1791998452 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7fcd8c09d130 con 0x7fcda01067e0 2024-09-04T16:38:35.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.205+0000 7fcda4d6f640 1 --2- 172.21.15.170:0/1791998452 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd90079e80 0x7fcd9007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:38:35.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.205+0000 7fcda4d6f640 1 --2- 172.21.15.170:0/1791998452 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd90079e80 0x7fcd9007c340 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcd940096c0 tx=0x7fcd94031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:38:35.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.209+0000 7fcd9dffb640 1 -- 172.21.15.170:0/1791998452 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcd8c064bc0 con 0x7fcda01067e0 2024-09-04T16:38:35.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.461+0000 7fcda6fd3640 1 -- 172.21.15.170:0/1791998452 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fcda0109d60 con 0x7fcda01067e0 2024-09-04T16:38:35.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.461+0000 7fcd9dffb640 1 -- 172.21.15.170:0/1791998452 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fcd8c068d30 con 0x7fcda01067e0 2024-09-04T16:38:35.462 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:38:35.462 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:38:35.462 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:38:35.462 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:38:35.462 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:38:35.462 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:38:35.462 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:38:35.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.464+0000 7fcda6fd3640 1 -- 172.21.15.170:0/1791998452 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd90079e80 msgr2=0x7fcd9007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:35.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.464+0000 7fcda6fd3640 1 --2- 172.21.15.170:0/1791998452 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd90079e80 0x7fcd9007c340 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcd940096c0 tx=0x7fcd94031400 comp rx=0 tx=0).stop 2024-09-04T16:38:35.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.464+0000 7fcda6fd3640 1 -- 172.21.15.170:0/1791998452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda01067e0 msgr2=0x7fcda019db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:38:35.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.464+0000 7fcda6fd3640 1 --2- 172.21.15.170:0/1791998452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda01067e0 0x7fcda019db90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00e970 tx=0x7fcd8c00ed70 comp rx=0 tx=0).stop 2024-09-04T16:38:35.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.464+0000 7fcda6fd3640 1 -- 172.21.15.170:0/1791998452 shutdown_connections 2024-09-04T16:38:35.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.464+0000 7fcda6fd3640 1 --2- 172.21.15.170:0/1791998452 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd90079e80 0x7fcd9007c340 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:35.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.464+0000 7fcda6fd3640 1 --2- 172.21.15.170:0/1791998452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcda01067e0 0x7fcda019db90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:35.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.464+0000 7fcda6fd3640 1 --2- 172.21.15.170:0/1791998452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcda01007e0 0x7fcda019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:38:35.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.464+0000 7fcda6fd3640 1 -- 172.21.15.170:0/1791998452 >> 172.21.15.170:0/1791998452 conn(0x7fcda00fc4c0 msgr2=0x7fcda0069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:38:35.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.464+0000 7fcda6fd3640 1 -- 172.21.15.170:0/1791998452 shutdown_connections 2024-09-04T16:38:35.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:38:35.464+0000 7fcda6fd3640 1 -- 172.21.15.170:0/1791998452 wait complete. 2024-09-04T16:38:36.049 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:35 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/497645648' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:38:36.049 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:35 smithi170 ceph-mon[113855]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:38:36.049 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:35 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1791998452' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:38:36.049 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:35 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:36.049 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:35 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.rzbrux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-04T16:38:36.049 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:35 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:38:36.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:35 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/497645648' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:38:36.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:35 smithi193 ceph-mon[82547]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:38:36.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:35 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1791998452' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:38:36.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:35 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:36.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:35 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.rzbrux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-04T16:38:36.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:35 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:38:37.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:36 smithi170 ceph-mon[113855]: Upgrade: Updating mds.cephfs.smithi170.rzbrux 2024-09-04T16:38:37.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:36 smithi170 ceph-mon[113855]: Deploying daemon mds.cephfs.smithi170.rzbrux on smithi170 2024-09-04T16:38:37.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:36 smithi170 ceph-mon[113855]: pgmap v264: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:37.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:36 smithi193 ceph-mon[82547]: Upgrade: Updating mds.cephfs.smithi170.rzbrux 2024-09-04T16:38:37.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:36 smithi193 ceph-mon[82547]: Deploying daemon mds.cephfs.smithi170.rzbrux on smithi170 2024-09-04T16:38:37.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:36 smithi193 ceph-mon[82547]: pgmap v264: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:39.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:38 smithi193 ceph-mon[82547]: osdmap e80: 6 total, 6 up, 6 in 2024-09-04T16:38:39.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:38 smithi193 ceph-mon[82547]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-04T16:38:39.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:38 smithi193 ceph-mon[82547]: pgmap v266: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:39.222 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:38 smithi170 ceph-mon[113855]: osdmap e80: 6 total, 6 up, 6 in 2024-09-04T16:38:39.222 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:38 smithi170 ceph-mon[113855]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-04T16:38:39.223 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:38 smithi170 ceph-mon[113855]: pgmap v266: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:40.841 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:40 smithi170 ceph-mon[113855]: pgmap v267: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:40.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:40 smithi193 ceph-mon[82547]: pgmap v267: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:42.775 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:42 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:42.775 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:42 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:42.775 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:42 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:38:42.775 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:42 smithi170 ceph-mon[113855]: mds.? [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] up:boot 2024-09-04T16:38:42.775 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:42 smithi170 ceph-mon[113855]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-04T16:38:42.775 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:42 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "mds metadata", "who": "cephfs.smithi170.rzbrux"} : dispatch 2024-09-04T16:38:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:42 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:42 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:42 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:38:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:42 smithi193 ceph-mon[82547]: mds.? [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] up:boot 2024-09-04T16:38:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:42 smithi193 ceph-mon[82547]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-04T16:38:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:42 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "mds metadata", "who": "cephfs.smithi170.rzbrux"} : dispatch 2024-09-04T16:38:43.723 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:43 smithi170 ceph-mon[113855]: pgmap v268: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:43.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:43 smithi193 ceph-mon[82547]: pgmap v268: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:38:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:38:45.846 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:45 smithi170 ceph-mon[113855]: pgmap v269: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:45.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:45 smithi193 ceph-mon[82547]: pgmap v269: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:47.714 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:47 smithi170 ceph-mon[113855]: pgmap v270: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:47.714 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:47.714 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:47.714 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:47.714 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:47 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:47.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:47 smithi193 ceph-mon[82547]: pgmap v270: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:47.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:47.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:47.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:47.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:47 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:49.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:49 smithi170 ceph-mon[113855]: pgmap v271: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:49.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:49 smithi193 ceph-mon[82547]: pgmap v271: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:50 smithi170 ceph-mon[113855]: pgmap v272: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:50 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:50 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:50 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:38:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:50 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:38:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:50 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:50 smithi193 ceph-mon[82547]: pgmap v272: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:50 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:50 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:50 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:38:50.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:50 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:38:50.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:50 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:51 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:38:51.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:51 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:51.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:51 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:51.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:51 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:51.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:51 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:51.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:51 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:38:51.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:51 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:51.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:51 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:51.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:51 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:51.853 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:51 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:38:53.248 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:52 smithi193 ceph-mon[82547]: Upgrade: Updating mds.cephfs.smithi193.xostco 2024-09-04T16:38:53.248 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:52 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:53.248 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:52 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi193.xostco", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-04T16:38:53.249 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:52 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:38:53.249 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:52 smithi193 ceph-mon[82547]: Deploying daemon mds.cephfs.smithi193.xostco on smithi193 2024-09-04T16:38:53.249 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:52 smithi193 ceph-mon[82547]: pgmap v273: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:53.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:52 smithi170 ceph-mon[113855]: Upgrade: Updating mds.cephfs.smithi193.xostco 2024-09-04T16:38:53.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:52 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:53.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:52 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi193.xostco", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-04T16:38:53.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:52 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:38:53.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:52 smithi170 ceph-mon[113855]: Deploying daemon mds.cephfs.smithi193.xostco on smithi193 2024-09-04T16:38:53.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:52 smithi170 ceph-mon[113855]: pgmap v273: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:55.230 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:54 smithi193 ceph-mon[82547]: osdmap e81: 6 total, 6 up, 6 in 2024-09-04T16:38:55.230 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:54 smithi193 ceph-mon[82547]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-04T16:38:55.230 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:54 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "mds metadata", "who": "cephfs.smithi193.xostco"} : dispatch 2024-09-04T16:38:55.230 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:54 smithi193 ceph-mon[82547]: pgmap v275: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:55.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:54 smithi170 ceph-mon[113855]: osdmap e81: 6 total, 6 up, 6 in 2024-09-04T16:38:55.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:54 smithi170 ceph-mon[113855]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-04T16:38:55.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:54 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "mds metadata", "who": "cephfs.smithi193.xostco"} : dispatch 2024-09-04T16:38:55.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:54 smithi170 ceph-mon[113855]: pgmap v275: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:56.715 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:56 smithi193 ceph-mon[82547]: pgmap v276: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:56.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:56 smithi170 ceph-mon[113855]: pgmap v276: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:58.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:57 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:58.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:57 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:58.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:57 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:38:58.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:57 smithi170 ceph-mon[113855]: mds.? [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] up:boot 2024-09-04T16:38:58.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:57 smithi170 ceph-mon[113855]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-04T16:38:58.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:57 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "mds metadata", "who": "cephfs.smithi193.xostco"} : dispatch 2024-09-04T16:38:58.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:57 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:58.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:57 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:38:58.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:57 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:38:58.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:57 smithi193 ceph-mon[82547]: mds.? [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] up:boot 2024-09-04T16:38:58.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:57 smithi193 ceph-mon[82547]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-04T16:38:58.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:57 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "mds metadata", "who": "cephfs.smithi193.xostco"} : dispatch 2024-09-04T16:38:59.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:58 smithi170 ceph-mon[113855]: pgmap v277: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:38:59.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:58 smithi193 ceph-mon[82547]: pgmap v277: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:00.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:39:00.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:00.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:38:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:00.219 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:39:00.219 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:00.219 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:38:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:01.540 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:01 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:01.540 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:01 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:01.540 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:01 smithi193 ceph-mon[82547]: pgmap v278: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:01.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:01 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:01.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:01 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:01.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:01 smithi170 ceph-mon[113855]: pgmap v278: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:02 smithi170 ceph-mon[113855]: pgmap v279: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:02.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:02 smithi193 ceph-mon[82547]: pgmap v279: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:04.403 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:04 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:04.403 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:04 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:04.403 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:04 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:39:04.403 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:04 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:39:04.403 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:04 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:04.404 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:04 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:39:04.404 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:04 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:39:04.404 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:04 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:39:04.404 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:04 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:39:04.404 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:04 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:39:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:04 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:04 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:04 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:39:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:04 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:39:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:04 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:04 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:39:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:04 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:39:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:04 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:39:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:04 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:39:04.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:04 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:39:05.376 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:05 smithi193 ceph-mon[82547]: pgmap v280: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:05.376 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:05 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:05.376 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:05 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi193.kabapr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-04T16:39:05.377 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:05 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:39:05.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:05 smithi170 ceph-mon[113855]: pgmap v280: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:05.560 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:05 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:05.560 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:05 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi193.kabapr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-04T16:39:05.560 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:05 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:39:05.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.559+0000 7fac4d2c2640 1 -- 172.21.15.170:0/1275369552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac48106820 msgr2=0x7fac48106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:05.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.559+0000 7fac4d2c2640 1 --2- 172.21.15.170:0/1275369552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac48106820 0x7fac48106c00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac38009c20 tx=0x7fac3802a970 comp rx=0 tx=0).stop 2024-09-04T16:39:05.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.559+0000 7fac4d2c2640 1 -- 172.21.15.170:0/1275369552 shutdown_connections 2024-09-04T16:39:05.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.559+0000 7fac4d2c2640 1 --2- 172.21.15.170:0/1275369552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac48100820 0x7fac48100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:05.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.559+0000 7fac4d2c2640 1 --2- 172.21.15.170:0/1275369552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac48106820 0x7fac48106c00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:05.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.559+0000 7fac4d2c2640 1 -- 172.21.15.170:0/1275369552 >> 172.21.15.170:0/1275369552 conn(0x7fac480fc520 msgr2=0x7fac480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:05.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.559+0000 7fac4d2c2640 1 -- 172.21.15.170:0/1275369552 shutdown_connections 2024-09-04T16:39:05.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.559+0000 7fac4d2c2640 1 -- 172.21.15.170:0/1275369552 wait complete. 2024-09-04T16:39:05.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.559+0000 7fac4d2c2640 1 Processor -- start 2024-09-04T16:39:05.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.560+0000 7fac4d2c2640 1 -- start start 2024-09-04T16:39:05.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.560+0000 7fac4d2c2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac48100820 0x7fac48107750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:05.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.560+0000 7fac4d2c2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac48106820 0x7fac48107c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:05.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.560+0000 7fac4d2c2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fac4810dcd0 con 0x7fac48100820 2024-09-04T16:39:05.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.560+0000 7fac4d2c2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fac4810db50 con 0x7fac48106820 2024-09-04T16:39:05.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.560+0000 7fac46ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac48100820 0x7fac48107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:05.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.560+0000 7fac46ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac48100820 0x7fac48107750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59238/0 (socket says 172.21.15.170:59238) 2024-09-04T16:39:05.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.560+0000 7fac46ffd640 1 -- 172.21.15.170:0/1552766520 learned_addr learned my addr 172.21.15.170:0/1552766520 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:39:05.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.560+0000 7fac3e7fc640 1 --2- 172.21.15.170:0/1552766520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac48106820 0x7fac48107c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:05.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.560+0000 7fac46ffd640 1 -- 172.21.15.170:0/1552766520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac48106820 msgr2=0x7fac48107c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:05.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.560+0000 7fac46ffd640 1 --2- 172.21.15.170:0/1552766520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac48106820 0x7fac48107c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:05.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.560+0000 7fac46ffd640 1 -- 172.21.15.170:0/1552766520 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac481081d0 con 0x7fac48100820 2024-09-04T16:39:05.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.560+0000 7fac3e7fc640 1 --2- 172.21.15.170:0/1552766520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac48106820 0x7fac48107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:39:05.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.561+0000 7fac46ffd640 1 --2- 172.21.15.170:0/1552766520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac48100820 0x7fac48107750 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac38005cc0 tx=0x7fac3802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:05.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.561+0000 7fac44ff9640 1 -- 172.21.15.170:0/1552766520 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac38047070 con 0x7fac48100820 2024-09-04T16:39:05.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.561+0000 7fac44ff9640 1 -- 172.21.15.170:0/1552766520 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac3802f7e0 con 0x7fac48100820 2024-09-04T16:39:05.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.561+0000 7fac4d2c2640 1 -- 172.21.15.170:0/1552766520 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac48108460 con 0x7fac48100820 2024-09-04T16:39:05.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.561+0000 7fac44ff9640 1 -- 172.21.15.170:0/1552766520 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac38034070 con 0x7fac48100820 2024-09-04T16:39:05.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.561+0000 7fac4d2c2640 1 -- 172.21.15.170:0/1552766520 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac481a3d90 con 0x7fac48100820 2024-09-04T16:39:05.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.562+0000 7fac4d2c2640 1 -- 172.21.15.170:0/1552766520 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac48101f60 con 0x7fac48100820 2024-09-04T16:39:05.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.563+0000 7fac44ff9640 1 -- 172.21.15.170:0/1552766520 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fac3804a070 con 0x7fac48100820 2024-09-04T16:39:05.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.563+0000 7fac44ff9640 1 --2- 172.21.15.170:0/1552766520 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fac34079e30 0x7fac3407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:05.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.563+0000 7fac44ff9640 1 -- 172.21.15.170:0/1552766520 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fac380bd900 con 0x7fac48100820 2024-09-04T16:39:05.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.563+0000 7fac3e7fc640 1 --2- 172.21.15.170:0/1552766520 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fac34079e30 0x7fac3407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:05.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.564+0000 7fac3e7fc640 1 --2- 172.21.15.170:0/1552766520 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fac34079e30 0x7fac3407c2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fac481091e0 tx=0x7fac3000a5c0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:05.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.568+0000 7fac44ff9640 1 -- 172.21.15.170:0/1552766520 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fac3803f070 con 0x7fac48100820 2024-09-04T16:39:05.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.760+0000 7fac4d2c2640 1 -- 172.21.15.170:0/1552766520 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fac4806aad0 con 0x7fac34079e30 2024-09-04T16:39:05.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.762+0000 7fac44ff9640 1 -- 172.21.15.170:0/1552766520 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fac4806aad0 con 0x7fac34079e30 2024-09-04T16:39:05.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.764+0000 7fac4d2c2640 1 -- 172.21.15.170:0/1552766520 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fac34079e30 msgr2=0x7fac3407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:05.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.764+0000 7fac4d2c2640 1 --2- 172.21.15.170:0/1552766520 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fac34079e30 0x7fac3407c2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fac481091e0 tx=0x7fac3000a5c0 comp rx=0 tx=0).stop 2024-09-04T16:39:05.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.764+0000 7fac4d2c2640 1 -- 172.21.15.170:0/1552766520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac48100820 msgr2=0x7fac48107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:05.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.764+0000 7fac4d2c2640 1 --2- 172.21.15.170:0/1552766520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac48100820 0x7fac48107750 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac38005cc0 tx=0x7fac3802f5f0 comp rx=0 tx=0).stop 2024-09-04T16:39:05.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.764+0000 7fac4d2c2640 1 -- 172.21.15.170:0/1552766520 shutdown_connections 2024-09-04T16:39:05.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.764+0000 7fac4d2c2640 1 --2- 172.21.15.170:0/1552766520 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fac34079e30 0x7fac3407c2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:05.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.764+0000 7fac4d2c2640 1 --2- 172.21.15.170:0/1552766520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac48106820 0x7fac48107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:05.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.764+0000 7fac4d2c2640 1 --2- 172.21.15.170:0/1552766520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac48100820 0x7fac48107750 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:05.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.764+0000 7fac4d2c2640 1 -- 172.21.15.170:0/1552766520 >> 172.21.15.170:0/1552766520 conn(0x7fac480fc520 msgr2=0x7fac4806a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:05.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.764+0000 7fac4d2c2640 1 -- 172.21.15.170:0/1552766520 shutdown_connections 2024-09-04T16:39:05.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.764+0000 7fac4d2c2640 1 -- 172.21.15.170:0/1552766520 wait complete. 2024-09-04T16:39:05.774 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:39:05.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.847+0000 7f9ab603b640 1 -- 172.21.15.170:0/3367384042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab0101930 msgr2=0x7f9ab0101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:05.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.847+0000 7f9ab603b640 1 --2- 172.21.15.170:0/3367384042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab0101930 0x7f9ab0101d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4009880 tx=0x7f9aa402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:39:05.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.847+0000 7f9ab603b640 1 -- 172.21.15.170:0/3367384042 shutdown_connections 2024-09-04T16:39:05.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.847+0000 7f9ab603b640 1 --2- 172.21.15.170:0/3367384042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab0101930 0x7f9ab0101d90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:05.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.847+0000 7f9ab603b640 1 --2- 172.21.15.170:0/3367384042 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ab0107930 0x7f9ab0107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:05.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.847+0000 7f9ab603b640 1 -- 172.21.15.170:0/3367384042 >> 172.21.15.170:0/3367384042 conn(0x7f9ab00fd630 msgr2=0x7f9ab00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:05.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.847+0000 7f9ab603b640 1 -- 172.21.15.170:0/3367384042 shutdown_connections 2024-09-04T16:39:05.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.847+0000 7f9ab603b640 1 -- 172.21.15.170:0/3367384042 wait complete. 2024-09-04T16:39:05.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.848+0000 7f9ab603b640 1 Processor -- start 2024-09-04T16:39:05.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.848+0000 7f9ab603b640 1 -- start start 2024-09-04T16:39:05.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.848+0000 7f9ab603b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ab0101930 0x7f9ab019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:05.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.848+0000 7f9ab603b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab0107930 0x7f9ab019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:05.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.848+0000 7f9ab603b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab010ee60 con 0x7f9ab0107930 2024-09-04T16:39:05.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.848+0000 7f9ab603b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab010ece0 con 0x7f9ab0101930 2024-09-04T16:39:05.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.848+0000 7f9aaeffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab0107930 0x7f9ab019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:05.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.848+0000 7f9aaeffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab0107930 0x7f9ab019dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59256/0 (socket says 172.21.15.170:59256) 2024-09-04T16:39:05.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.848+0000 7f9aaeffd640 1 -- 172.21.15.170:0/1499297413 learned_addr learned my addr 172.21.15.170:0/1499297413 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:39:05.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.848+0000 7f9aaf7fe640 1 --2- 172.21.15.170:0/1499297413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ab0101930 0x7f9ab019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:05.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.849+0000 7f9aaeffd640 1 -- 172.21.15.170:0/1499297413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ab0101930 msgr2=0x7f9ab019d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:05.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.849+0000 7f9aaeffd640 1 --2- 172.21.15.170:0/1499297413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ab0101930 0x7f9ab019d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:05.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.849+0000 7f9aaeffd640 1 -- 172.21.15.170:0/1499297413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab0197870 con 0x7f9ab0107930 2024-09-04T16:39:05.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.849+0000 7f9aaeffd640 1 --2- 172.21.15.170:0/1499297413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab0107930 0x7f9ab019dbf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4031460 tx=0x7f9aa40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:05.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.849+0000 7f9aacff9640 1 -- 172.21.15.170:0/1499297413 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9aa403f070 con 0x7f9ab0107930 2024-09-04T16:39:05.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.849+0000 7f9ab603b640 1 -- 172.21.15.170:0/1499297413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab0197b00 con 0x7f9ab0107930 2024-09-04T16:39:05.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.849+0000 7f9aacff9640 1 -- 172.21.15.170:0/1499297413 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9aa4004cf0 con 0x7f9ab0107930 2024-09-04T16:39:05.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.849+0000 7f9aacff9640 1 -- 172.21.15.170:0/1499297413 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9aa4035030 con 0x7f9ab0107930 2024-09-04T16:39:05.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.849+0000 7f9ab603b640 1 -- 172.21.15.170:0/1499297413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab0198030 con 0x7f9ab0107930 2024-09-04T16:39:05.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.850+0000 7f9ab603b640 1 -- 172.21.15.170:0/1499297413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab0103070 con 0x7f9ab0107930 2024-09-04T16:39:05.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.851+0000 7f9aacff9640 1 -- 172.21.15.170:0/1499297413 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f9aa4042070 con 0x7f9ab0107930 2024-09-04T16:39:05.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.851+0000 7f9aacff9640 1 --2- 172.21.15.170:0/1499297413 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9a98079e30 0x7f9a9807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:05.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.852+0000 7f9aacff9640 1 -- 172.21.15.170:0/1499297413 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f9aa40bd520 con 0x7f9ab0107930 2024-09-04T16:39:05.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.852+0000 7f9aaf7fe640 1 --2- 172.21.15.170:0/1499297413 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9a98079e30 0x7f9a9807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:05.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.852+0000 7f9aaf7fe640 1 --2- 172.21.15.170:0/1499297413 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9a98079e30 0x7f9a9807c2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9ab01989b0 tx=0x7f9aa0009110 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:05.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:05.856+0000 7f9aacff9640 1 -- 172.21.15.170:0/1499297413 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9aa4084f30 con 0x7f9ab0107930 2024-09-04T16:39:06.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.048+0000 7f9ab603b640 1 -- 172.21.15.170:0/1499297413 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9ab0198da0 con 0x7f9a98079e30 2024-09-04T16:39:06.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.049+0000 7f9aacff9640 1 -- 172.21.15.170:0/1499297413 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f9ab0198da0 con 0x7f9a98079e30 2024-09-04T16:39:06.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.051+0000 7f9ab603b640 1 -- 172.21.15.170:0/1499297413 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9a98079e30 msgr2=0x7f9a9807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:06.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.051+0000 7f9ab603b640 1 --2- 172.21.15.170:0/1499297413 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9a98079e30 0x7f9a9807c2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9ab01989b0 tx=0x7f9aa0009110 comp rx=0 tx=0).stop 2024-09-04T16:39:06.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.051+0000 7f9ab603b640 1 -- 172.21.15.170:0/1499297413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab0107930 msgr2=0x7f9ab019dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:06.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.051+0000 7f9ab603b640 1 --2- 172.21.15.170:0/1499297413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab0107930 0x7f9ab019dbf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4031460 tx=0x7f9aa40048f0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.051+0000 7f9ab603b640 1 -- 172.21.15.170:0/1499297413 shutdown_connections 2024-09-04T16:39:06.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.051+0000 7f9ab603b640 1 --2- 172.21.15.170:0/1499297413 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9a98079e30 0x7f9a9807c2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.051+0000 7f9ab603b640 1 --2- 172.21.15.170:0/1499297413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab0107930 0x7f9ab019dbf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.051+0000 7f9ab603b640 1 --2- 172.21.15.170:0/1499297413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ab0101930 0x7f9ab019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.051+0000 7f9ab603b640 1 -- 172.21.15.170:0/1499297413 >> 172.21.15.170:0/1499297413 conn(0x7f9ab00fd630 msgr2=0x7f9ab00fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:06.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.052+0000 7f9ab603b640 1 -- 172.21.15.170:0/1499297413 shutdown_connections 2024-09-04T16:39:06.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.052+0000 7f9ab603b640 1 -- 172.21.15.170:0/1499297413 wait complete. 2024-09-04T16:39:06.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.135+0000 7fb5795fc640 1 -- 172.21.15.170:0/1730648722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5741033c0 msgr2=0x7fb57410b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:06.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.135+0000 7fb5795fc640 1 --2- 172.21.15.170:0/1730648722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5741033c0 0x7fb57410b8b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009880 tx=0x7fb55c02a530 comp rx=0 tx=0).stop 2024-09-04T16:39:06.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.135+0000 7fb5795fc640 1 -- 172.21.15.170:0/1730648722 shutdown_connections 2024-09-04T16:39:06.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.135+0000 7fb5795fc640 1 --2- 172.21.15.170:0/1730648722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5741033c0 0x7fb57410b8b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.135+0000 7fb5795fc640 1 --2- 172.21.15.170:0/1730648722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb574102aa0 0x7fb574102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.135+0000 7fb5795fc640 1 -- 172.21.15.170:0/1730648722 >> 172.21.15.170:0/1730648722 conn(0x7fb5740fc4c0 msgr2=0x7fb5740fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:06.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.136+0000 7fb5795fc640 1 -- 172.21.15.170:0/1730648722 shutdown_connections 2024-09-04T16:39:06.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.136+0000 7fb5795fc640 1 -- 172.21.15.170:0/1730648722 wait complete. 2024-09-04T16:39:06.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.136+0000 7fb5795fc640 1 Processor -- start 2024-09-04T16:39:06.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.136+0000 7fb5795fc640 1 -- start start 2024-09-04T16:39:06.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.136+0000 7fb5795fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb574102aa0 0x7fb57419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:06.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.136+0000 7fb5795fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5741033c0 0x7fb57419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:06.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.136+0000 7fb5795fc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb57410edb0 con 0x7fb574102aa0 2024-09-04T16:39:06.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.136+0000 7fb5795fc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb57410ec30 con 0x7fb5741033c0 2024-09-04T16:39:06.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.136+0000 7fb572ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb574102aa0 0x7fb57419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:06.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.137+0000 7fb572ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb574102aa0 0x7fb57419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59276/0 (socket says 172.21.15.170:59276) 2024-09-04T16:39:06.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.137+0000 7fb572ffd640 1 -- 172.21.15.170:0/3612114413 learned_addr learned my addr 172.21.15.170:0/3612114413 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:39:06.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.137+0000 7fb56bfff640 1 --2- 172.21.15.170:0/3612114413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5741033c0 0x7fb57419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:06.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.137+0000 7fb572ffd640 1 -- 172.21.15.170:0/3612114413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5741033c0 msgr2=0x7fb57419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:06.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.137+0000 7fb572ffd640 1 --2- 172.21.15.170:0/3612114413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5741033c0 0x7fb57419db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.137+0000 7fb572ffd640 1 -- 172.21.15.170:0/3612114413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5741977c0 con 0x7fb574102aa0 2024-09-04T16:39:06.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.137+0000 7fb572ffd640 1 --2- 172.21.15.170:0/3612114413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb574102aa0 0x7fb57419d640 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb56400d8d0 tx=0x7fb56400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:06.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.137+0000 7fb570ff9640 1 -- 172.21.15.170:0/3612114413 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb564017070 con 0x7fb574102aa0 2024-09-04T16:39:06.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.137+0000 7fb570ff9640 1 -- 172.21.15.170:0/3612114413 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb564010460 con 0x7fb574102aa0 2024-09-04T16:39:06.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.137+0000 7fb5795fc640 1 -- 172.21.15.170:0/3612114413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb574197ab0 con 0x7fb574102aa0 2024-09-04T16:39:06.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.137+0000 7fb570ff9640 1 -- 172.21.15.170:0/3612114413 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb56400f5f0 con 0x7fb574102aa0 2024-09-04T16:39:06.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.137+0000 7fb5795fc640 1 -- 172.21.15.170:0/3612114413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb574198010 con 0x7fb574102aa0 2024-09-04T16:39:06.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.138+0000 7fb5795fc640 1 -- 172.21.15.170:0/3612114413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb57406a410 con 0x7fb574102aa0 2024-09-04T16:39:06.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.140+0000 7fb570ff9640 1 -- 172.21.15.170:0/3612114413 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fb564009a30 con 0x7fb574102aa0 2024-09-04T16:39:06.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.140+0000 7fb570ff9640 1 --2- 172.21.15.170:0/3612114413 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb560079e80 0x7fb56007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:06.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.140+0000 7fb570ff9640 1 -- 172.21.15.170:0/3612114413 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fb56409c150 con 0x7fb574102aa0 2024-09-04T16:39:06.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.140+0000 7fb56bfff640 1 --2- 172.21.15.170:0/3612114413 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb560079e80 0x7fb56007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:06.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.141+0000 7fb56bfff640 1 --2- 172.21.15.170:0/3612114413 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb560079e80 0x7fb56007c340 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb574198b10 tx=0x7fb55c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:06.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.145+0000 7fb570ff9640 1 -- 172.21.15.170:0/3612114413 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb564067df0 con 0x7fb574102aa0 2024-09-04T16:39:06.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.346+0000 7fb5795fc640 1 -- 172.21.15.170:0/3612114413 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb574198380 con 0x7fb560079e80 2024-09-04T16:39:06.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.356+0000 7fb570ff9640 1 -- 172.21.15.170:0/3612114413 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb574198380 con 0x7fb560079e80 2024-09-04T16:39:06.357 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:39:06.357 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (6m) 19s ago 16m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:39:06.357 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (9m) 19s ago 17m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:39:06.357 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (8m) 6s ago 16m 8774k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:39:06.357 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (4m) 19s ago 17m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:39:06.357 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (4m) 6s ago 16m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:39:06.357 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (5m) 19s ago 16m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:39:06.357 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (25s) 19s ago 11m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:39:06.357 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (41s) 19s ago 11m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:39:06.358 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (11m) 6s ago 11m 18.5M - 19.1.1-252-g48920dab b708f9119ac7 2094fece3c98 2024-09-04T16:39:06.358 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (9s) 6s ago 11m 11.9M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:39:06.358 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (8m) 19s ago 18m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:39:06.358 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (7m) 6s ago 16m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:39:06.358 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (4m) 19s ago 18m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:39:06.358 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (4m) 6s ago 15m 39.0M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:39:06.358 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (6m) 19s ago 17m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:39:06.358 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (6m) 6s ago 16m 13.0M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:39:06.358 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (3m) 19s ago 14m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:39:06.358 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (3m) 19s ago 14m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:39:06.358 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (2m) 19s ago 13m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:39:06.358 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (2m) 6s ago 13m 98.7M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:39:06.358 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (90s) 6s ago 13m 96.1M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:39:06.358 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (57s) 6s ago 12m 77.0M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:39:06.358 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (6m) 19s ago 16m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:39:06.359 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:06 smithi170 ceph-mon[113855]: Upgrade: Updating mds.cephfs.smithi193.kabapr 2024-09-04T16:39:06.359 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:06 smithi170 ceph-mon[113855]: Deploying daemon mds.cephfs.smithi193.kabapr on smithi193 2024-09-04T16:39:06.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.359+0000 7fb5795fc640 1 -- 172.21.15.170:0/3612114413 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb560079e80 msgr2=0x7fb56007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:06.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.359+0000 7fb5795fc640 1 --2- 172.21.15.170:0/3612114413 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb560079e80 0x7fb56007c340 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb574198b10 tx=0x7fb55c031400 comp rx=0 tx=0).stop 2024-09-04T16:39:06.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.359+0000 7fb5795fc640 1 -- 172.21.15.170:0/3612114413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb574102aa0 msgr2=0x7fb57419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:06.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.359+0000 7fb5795fc640 1 --2- 172.21.15.170:0/3612114413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb574102aa0 0x7fb57419d640 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb56400d8d0 tx=0x7fb56400dd90 comp rx=0 tx=0).stop 2024-09-04T16:39:06.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.359+0000 7fb5795fc640 1 -- 172.21.15.170:0/3612114413 shutdown_connections 2024-09-04T16:39:06.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.359+0000 7fb5795fc640 1 --2- 172.21.15.170:0/3612114413 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb560079e80 0x7fb56007c340 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.359+0000 7fb5795fc640 1 --2- 172.21.15.170:0/3612114413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5741033c0 0x7fb57419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.359+0000 7fb5795fc640 1 --2- 172.21.15.170:0/3612114413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb574102aa0 0x7fb57419d640 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.359+0000 7fb5795fc640 1 -- 172.21.15.170:0/3612114413 >> 172.21.15.170:0/3612114413 conn(0x7fb5740fc4c0 msgr2=0x7fb574103d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:06.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.359+0000 7fb5795fc640 1 -- 172.21.15.170:0/3612114413 shutdown_connections 2024-09-04T16:39:06.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.359+0000 7fb5795fc640 1 -- 172.21.15.170:0/3612114413 wait complete. 2024-09-04T16:39:06.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.442+0000 7f4aa26fb640 1 -- 172.21.15.170:0/1920536848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a9c1067e0 msgr2=0x7f4a9c106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:06.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.442+0000 7f4aa26fb640 1 --2- 172.21.15.170:0/1920536848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a9c1067e0 0x7f4a9c106bc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c009880 tx=0x7f4a8c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.442+0000 7f4aa26fb640 1 -- 172.21.15.170:0/1920536848 shutdown_connections 2024-09-04T16:39:06.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.442+0000 7f4aa26fb640 1 --2- 172.21.15.170:0/1920536848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a9c1007e0 0x7f4a9c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.442+0000 7f4aa26fb640 1 --2- 172.21.15.170:0/1920536848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a9c1067e0 0x7f4a9c106bc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.442+0000 7f4aa26fb640 1 -- 172.21.15.170:0/1920536848 >> 172.21.15.170:0/1920536848 conn(0x7f4a9c0fc4c0 msgr2=0x7f4a9c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:06.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.442+0000 7f4aa26fb640 1 -- 172.21.15.170:0/1920536848 shutdown_connections 2024-09-04T16:39:06.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.442+0000 7f4aa26fb640 1 -- 172.21.15.170:0/1920536848 wait complete. 2024-09-04T16:39:06.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.443+0000 7f4aa26fb640 1 Processor -- start 2024-09-04T16:39:06.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.443+0000 7f4aa26fb640 1 -- start start 2024-09-04T16:39:06.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.443+0000 7f4aa26fb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a9c1007e0 0x7f4a9c107710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:06.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.443+0000 7f4aa26fb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a9c1067e0 0x7f4a9c107c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:06.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.443+0000 7f4aa26fb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c10dc90 con 0x7f4a9c1007e0 2024-09-04T16:39:06.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.443+0000 7f4aa26fb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c10db10 con 0x7f4a9c1067e0 2024-09-04T16:39:06.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.443+0000 7f4a9bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a9c1007e0 0x7f4a9c107710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:06.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.443+0000 7f4a9bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a9c1007e0 0x7f4a9c107710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59298/0 (socket says 172.21.15.170:59298) 2024-09-04T16:39:06.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.443+0000 7f4a9bfff640 1 -- 172.21.15.170:0/519689005 learned_addr learned my addr 172.21.15.170:0/519689005 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:39:06.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.443+0000 7f4a9b7fe640 1 --2- 172.21.15.170:0/519689005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a9c1067e0 0x7f4a9c107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:06.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.444+0000 7f4a9bfff640 1 -- 172.21.15.170:0/519689005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a9c1067e0 msgr2=0x7f4a9c107c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:06.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.444+0000 7f4a9bfff640 1 --2- 172.21.15.170:0/519689005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a9c1067e0 0x7f4a9c107c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.444+0000 7f4a9bfff640 1 -- 172.21.15.170:0/519689005 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c108190 con 0x7f4a9c1007e0 2024-09-04T16:39:06.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.444+0000 7f4a9bfff640 1 --2- 172.21.15.170:0/519689005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a9c1007e0 0x7f4a9c107710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c031460 tx=0x7f4a8c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:06.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.444+0000 7f4a997fa640 1 -- 172.21.15.170:0/519689005 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a8c03f070 con 0x7f4a9c1007e0 2024-09-04T16:39:06.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.444+0000 7f4aa26fb640 1 -- 172.21.15.170:0/519689005 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9c108420 con 0x7f4a9c1007e0 2024-09-04T16:39:06.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.444+0000 7f4a997fa640 1 -- 172.21.15.170:0/519689005 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4a8c0035f0 con 0x7f4a9c1007e0 2024-09-04T16:39:06.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.445+0000 7f4a997fa640 1 -- 172.21.15.170:0/519689005 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a8c035030 con 0x7f4a9c1007e0 2024-09-04T16:39:06.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.445+0000 7f4aa26fb640 1 -- 172.21.15.170:0/519689005 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a9c1a3d10 con 0x7f4a9c1007e0 2024-09-04T16:39:06.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.446+0000 7f4a997fa640 1 -- 172.21.15.170:0/519689005 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f4a8c042070 con 0x7f4a9c1007e0 2024-09-04T16:39:06.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.446+0000 7f4aa26fb640 1 -- 172.21.15.170:0/519689005 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a9c101f20 con 0x7f4a9c1007e0 2024-09-04T16:39:06.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.447+0000 7f4a997fa640 1 --2- 172.21.15.170:0/519689005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4a84079e80 0x7f4a8407c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:06.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.447+0000 7f4a997fa640 1 -- 172.21.15.170:0/519689005 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f4a8c0c1060 con 0x7f4a9c1007e0 2024-09-04T16:39:06.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.447+0000 7f4a9b7fe640 1 --2- 172.21.15.170:0/519689005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4a84079e80 0x7f4a8407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:06.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.447+0000 7f4a9b7fe640 1 --2- 172.21.15.170:0/519689005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4a84079e80 0x7f4a8407c340 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c1091a0 tx=0x7f4a9000b410 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:06.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.451+0000 7f4a997fa640 1 -- 172.21.15.170:0/519689005 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4a8c0883b0 con 0x7f4a9c1007e0 2024-09-04T16:39:06.609 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:06 smithi193 ceph-mon[82547]: Upgrade: Updating mds.cephfs.smithi193.kabapr 2024-09-04T16:39:06.609 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:06 smithi193 ceph-mon[82547]: Deploying daemon mds.cephfs.smithi193.kabapr on smithi193 2024-09-04T16:39:06.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.707+0000 7f4aa26fb640 1 -- 172.21.15.170:0/519689005 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4a9c1a4010 con 0x7f4a9c1007e0 2024-09-04T16:39:06.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.708+0000 7f4a997fa640 1 -- 172.21.15.170:0/519689005 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f4a8c08cdd0 con 0x7f4a9c1007e0 2024-09-04T16:39:06.709 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:39:06.709 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:39:06.709 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:39:06.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:39:06.709 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:39:06.709 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:39:06.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:39:06.709 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:39:06.710 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:39:06.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:39:06.710 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:39:06.710 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 1, 2024-09-04T16:39:06.710 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 3 2024-09-04T16:39:06.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:39:06.710 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:39:06.710 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.1.1-252-g48920dab (48920dabc954a29bdb7dd91079363a020369bbff) squid (stable)": 1, 2024-09-04T16:39:06.710 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 13 2024-09-04T16:39:06.710 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:39:06.710 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:39:06.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.712+0000 7f4aa26fb640 1 -- 172.21.15.170:0/519689005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4a84079e80 msgr2=0x7f4a8407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:06.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.712+0000 7f4aa26fb640 1 --2- 172.21.15.170:0/519689005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4a84079e80 0x7f4a8407c340 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c1091a0 tx=0x7f4a9000b410 comp rx=0 tx=0).stop 2024-09-04T16:39:06.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.712+0000 7f4aa26fb640 1 -- 172.21.15.170:0/519689005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a9c1007e0 msgr2=0x7f4a9c107710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:06.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.712+0000 7f4aa26fb640 1 --2- 172.21.15.170:0/519689005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a9c1007e0 0x7f4a9c107710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c031460 tx=0x7f4a8c0045e0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.712+0000 7f4aa26fb640 1 -- 172.21.15.170:0/519689005 shutdown_connections 2024-09-04T16:39:06.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.712+0000 7f4aa26fb640 1 --2- 172.21.15.170:0/519689005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4a84079e80 0x7f4a8407c340 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.712+0000 7f4aa26fb640 1 --2- 172.21.15.170:0/519689005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a9c1067e0 0x7f4a9c107c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.712+0000 7f4aa26fb640 1 --2- 172.21.15.170:0/519689005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a9c1007e0 0x7f4a9c107710 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.712+0000 7f4aa26fb640 1 -- 172.21.15.170:0/519689005 >> 172.21.15.170:0/519689005 conn(0x7f4a9c0fc4c0 msgr2=0x7f4a9c069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:06.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.712+0000 7f4aa26fb640 1 -- 172.21.15.170:0/519689005 shutdown_connections 2024-09-04T16:39:06.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.712+0000 7f4aa26fb640 1 -- 172.21.15.170:0/519689005 wait complete. 2024-09-04T16:39:06.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.795+0000 7fdce32a9640 1 -- 172.21.15.170:0/1474800532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcdc106810 msgr2=0x7fdcdc106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:06.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.795+0000 7fdce32a9640 1 --2- 172.21.15.170:0/1474800532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcdc106810 0x7fdcdc106bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009880 tx=0x7fdccc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.795+0000 7fdce32a9640 1 -- 172.21.15.170:0/1474800532 shutdown_connections 2024-09-04T16:39:06.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.795+0000 7fdce32a9640 1 --2- 172.21.15.170:0/1474800532 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcdc100810 0x7fdcdc100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.795+0000 7fdce32a9640 1 --2- 172.21.15.170:0/1474800532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcdc106810 0x7fdcdc106bf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.795+0000 7fdce32a9640 1 -- 172.21.15.170:0/1474800532 >> 172.21.15.170:0/1474800532 conn(0x7fdcdc0fc4f0 msgr2=0x7fdcdc0fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:06.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.795+0000 7fdce32a9640 1 -- 172.21.15.170:0/1474800532 shutdown_connections 2024-09-04T16:39:06.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.795+0000 7fdce32a9640 1 -- 172.21.15.170:0/1474800532 wait complete. 2024-09-04T16:39:06.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.795+0000 7fdce32a9640 1 Processor -- start 2024-09-04T16:39:06.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.795+0000 7fdce32a9640 1 -- start start 2024-09-04T16:39:06.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.796+0000 7fdce32a9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcdc100810 0x7fdcdc1965e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:06.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.796+0000 7fdce32a9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcdc106810 0x7fdcdc196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:06.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.796+0000 7fdce32a9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdcdc10dce0 con 0x7fdcdc106810 2024-09-04T16:39:06.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.796+0000 7fdce32a9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdcdc10db60 con 0x7fdcdc100810 2024-09-04T16:39:06.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.796+0000 7fdce0844640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcdc106810 0x7fdcdc196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:06.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.796+0000 7fdce0844640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcdc106810 0x7fdcdc196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59306/0 (socket says 172.21.15.170:59306) 2024-09-04T16:39:06.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.796+0000 7fdce0844640 1 -- 172.21.15.170:0/1811634109 learned_addr learned my addr 172.21.15.170:0/1811634109 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:39:06.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.796+0000 7fdce1045640 1 --2- 172.21.15.170:0/1811634109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcdc100810 0x7fdcdc1965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:06.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.796+0000 7fdce0844640 1 -- 172.21.15.170:0/1811634109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcdc100810 msgr2=0x7fdcdc1965e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:06.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.796+0000 7fdce0844640 1 --2- 172.21.15.170:0/1811634109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcdc100810 0x7fdcdc1965e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:06.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.796+0000 7fdce0844640 1 -- 172.21.15.170:0/1811634109 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcdc197060 con 0x7fdcdc106810 2024-09-04T16:39:06.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.796+0000 7fdce0844640 1 --2- 172.21.15.170:0/1811634109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcdc106810 0x7fdcdc196b20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800e970 tx=0x7fdcd800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:06.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.797+0000 7fdcd27fc640 1 -- 172.21.15.170:0/1811634109 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdcd800cac0 con 0x7fdcdc106810 2024-09-04T16:39:06.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.797+0000 7fdce32a9640 1 -- 172.21.15.170:0/1811634109 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcdc197350 con 0x7fdcdc106810 2024-09-04T16:39:06.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.797+0000 7fdce32a9640 1 -- 172.21.15.170:0/1811634109 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcdc1a3e20 con 0x7fdcdc106810 2024-09-04T16:39:06.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.797+0000 7fdcd27fc640 1 -- 172.21.15.170:0/1811634109 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdcd80054e0 con 0x7fdcdc106810 2024-09-04T16:39:06.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.797+0000 7fdcd27fc640 1 -- 172.21.15.170:0/1811634109 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdcd8010430 con 0x7fdcdc106810 2024-09-04T16:39:06.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.798+0000 7fdce32a9640 1 -- 172.21.15.170:0/1811634109 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcdc101f50 con 0x7fdcdc106810 2024-09-04T16:39:06.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.798+0000 7fdcd27fc640 1 -- 172.21.15.170:0/1811634109 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fdcd8004f00 con 0x7fdcdc106810 2024-09-04T16:39:06.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.799+0000 7fdcd27fc640 1 --2- 172.21.15.170:0/1811634109 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdcc8079e80 0x7fdcc807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:06.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.799+0000 7fdcd27fc640 1 -- 172.21.15.170:0/1811634109 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fdcd809d010 con 0x7fdcdc106810 2024-09-04T16:39:06.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.799+0000 7fdce1045640 1 --2- 172.21.15.170:0/1811634109 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdcc8079e80 0x7fdcc807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:06.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.799+0000 7fdce1045640 1 --2- 172.21.15.170:0/1811634109 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdcc8079e80 0x7fdcc807c340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0096c0 tx=0x7fdccc031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:06.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:06.803+0000 7fdcd27fc640 1 -- 172.21.15.170:0/1811634109 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdcd8064aa0 con 0x7fdcdc106810 2024-09-04T16:39:07.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.026+0000 7fdce32a9640 1 -- 172.21.15.170:0/1811634109 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fdcdc02d7c0 con 0x7fdcdc106810 2024-09-04T16:39:07.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.026+0000 7fdcd27fc640 1 -- 172.21.15.170:0/1811634109 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) ==== 76+0+2002 (secure 0 0 0) 0x7fdcd8068c10 con 0x7fdcdc106810 2024-09-04T16:39:07.027 INFO:teuthology.orchestra.run.smithi170.stdout:e23 2024-09-04T16:39:07.027 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:38:57:507295+0000 2024-09-04T16:39:07.027 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:39:07.028 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:39:07.028 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:39:07.028 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:39:07.028 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:39:07.028 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:39:07.028 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:39:07.028 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:39:07.028 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:39:07.028 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:39:07.028 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:39:07.028 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:39:07.028 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:39:07.028 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:39:07.029 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:39:07.029 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:39:07.029 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:39:07.029 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:39:07.029 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:39:07.029 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:39:07.029 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:39:07.029 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:39:07.029 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:39:07.029 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:39:07.029 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:39:07.029 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:39:07.030 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:39:07.030 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:39:07.030 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:39:07.030 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:39:07.030 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:39:07.030 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:39:07.030 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:39:07.030 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:39:07.030 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:39:07.030 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:39:07.030 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:39:07.030 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:24315} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.193:6826/288890560,v1:172.21.15.193:6827/288890560] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:39:07.030 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:39:07.031 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:39:07.031 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:39:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 23 2024-09-04T16:39:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.029+0000 7fdce32a9640 1 -- 172.21.15.170:0/1811634109 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdcc8079e80 msgr2=0x7fdcc807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.029+0000 7fdce32a9640 1 --2- 172.21.15.170:0/1811634109 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdcc8079e80 0x7fdcc807c340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0096c0 tx=0x7fdccc031400 comp rx=0 tx=0).stop 2024-09-04T16:39:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.029+0000 7fdce32a9640 1 -- 172.21.15.170:0/1811634109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcdc106810 msgr2=0x7fdcdc196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.029+0000 7fdce32a9640 1 --2- 172.21.15.170:0/1811634109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcdc106810 0x7fdcdc196b20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800e970 tx=0x7fdcd800ed70 comp rx=0 tx=0).stop 2024-09-04T16:39:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.029+0000 7fdce32a9640 1 -- 172.21.15.170:0/1811634109 shutdown_connections 2024-09-04T16:39:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.029+0000 7fdce32a9640 1 --2- 172.21.15.170:0/1811634109 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdcc8079e80 0x7fdcc807c340 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.029+0000 7fdce32a9640 1 --2- 172.21.15.170:0/1811634109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcdc106810 0x7fdcdc196b20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.029+0000 7fdce32a9640 1 --2- 172.21.15.170:0/1811634109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcdc100810 0x7fdcdc1965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.029+0000 7fdce32a9640 1 -- 172.21.15.170:0/1811634109 >> 172.21.15.170:0/1811634109 conn(0x7fdcdc0fc4f0 msgr2=0x7fdcdc0fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.029+0000 7fdce32a9640 1 -- 172.21.15.170:0/1811634109 shutdown_connections 2024-09-04T16:39:07.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.029+0000 7fdce32a9640 1 -- 172.21.15.170:0/1811634109 wait complete. 2024-09-04T16:39:07.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.113+0000 7f9086d41640 1 -- 172.21.15.170:0/1954729776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90801067e0 msgr2=0x7f9080106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:07.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.113+0000 7f9086d41640 1 --2- 172.21.15.170:0/1954729776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90801067e0 0x7f9080106bc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9074009880 tx=0x7f907402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.113+0000 7f9086d41640 1 -- 172.21.15.170:0/1954729776 shutdown_connections 2024-09-04T16:39:07.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.113+0000 7f9086d41640 1 --2- 172.21.15.170:0/1954729776 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90801007e0 0x7f9080100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.113+0000 7f9086d41640 1 --2- 172.21.15.170:0/1954729776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90801067e0 0x7f9080106bc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.113+0000 7f9086d41640 1 -- 172.21.15.170:0/1954729776 >> 172.21.15.170:0/1954729776 conn(0x7f90800fc4c0 msgr2=0x7f90800fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:07.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.113+0000 7f9086d41640 1 -- 172.21.15.170:0/1954729776 shutdown_connections 2024-09-04T16:39:07.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.113+0000 7f9086d41640 1 -- 172.21.15.170:0/1954729776 wait complete. 2024-09-04T16:39:07.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.113+0000 7f9086d41640 1 Processor -- start 2024-09-04T16:39:07.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.114+0000 7f9086d41640 1 -- start start 2024-09-04T16:39:07.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.114+0000 7f9086d41640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90801007e0 0x7f908019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:07.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.114+0000 7f9086d41640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90801067e0 0x7f908019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:07.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.114+0000 7f9086d41640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f908010dd10 con 0x7f90801007e0 2024-09-04T16:39:07.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.114+0000 7f9086d41640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f908010db90 con 0x7f90801067e0 2024-09-04T16:39:07.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.114+0000 7f9084add640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90801007e0 0x7f908019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:07.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.114+0000 7f9084add640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90801007e0 0x7f908019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59320/0 (socket says 172.21.15.170:59320) 2024-09-04T16:39:07.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.114+0000 7f9084add640 1 -- 172.21.15.170:0/1953067395 learned_addr learned my addr 172.21.15.170:0/1953067395 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:39:07.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.114+0000 7f907ffff640 1 --2- 172.21.15.170:0/1953067395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90801067e0 0x7f908019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:07.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.114+0000 7f9084add640 1 -- 172.21.15.170:0/1953067395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90801067e0 msgr2=0x7f908019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:07.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.114+0000 7f9084add640 1 --2- 172.21.15.170:0/1953067395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90801067e0 0x7f908019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.114+0000 7f9084add640 1 -- 172.21.15.170:0/1953067395 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9080197800 con 0x7f90801007e0 2024-09-04T16:39:07.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.114+0000 7f9084add640 1 --2- 172.21.15.170:0/1953067395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90801007e0 0x7f908019d680 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9074031460 tx=0x7f90740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:07.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.115+0000 7f907dffb640 1 -- 172.21.15.170:0/1953067395 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f907403f070 con 0x7f90801007e0 2024-09-04T16:39:07.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.115+0000 7f907dffb640 1 -- 172.21.15.170:0/1953067395 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9074004cf0 con 0x7f90801007e0 2024-09-04T16:39:07.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.115+0000 7f9086d41640 1 -- 172.21.15.170:0/1953067395 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9080197a90 con 0x7f90801007e0 2024-09-04T16:39:07.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.115+0000 7f907dffb640 1 -- 172.21.15.170:0/1953067395 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9074035030 con 0x7f90801007e0 2024-09-04T16:39:07.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.115+0000 7f9086d41640 1 -- 172.21.15.170:0/1953067395 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9080197fc0 con 0x7f90801007e0 2024-09-04T16:39:07.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.116+0000 7f9086d41640 1 -- 172.21.15.170:0/1953067395 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9080101f20 con 0x7f90801007e0 2024-09-04T16:39:07.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.117+0000 7f907dffb640 1 -- 172.21.15.170:0/1953067395 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f9074042070 con 0x7f90801007e0 2024-09-04T16:39:07.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.117+0000 7f907dffb640 1 --2- 172.21.15.170:0/1953067395 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9070079e80 0x7f907007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:07.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.117+0000 7f907dffb640 1 -- 172.21.15.170:0/1953067395 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f90740bd420 con 0x7f90801007e0 2024-09-04T16:39:07.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.117+0000 7f907ffff640 1 --2- 172.21.15.170:0/1953067395 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9070079e80 0x7f907007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:07.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.118+0000 7f907ffff640 1 --2- 172.21.15.170:0/1953067395 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9070079e80 0x7f907007c340 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9080105f00 tx=0x7f906c009110 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:07.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.122+0000 7f907dffb640 1 -- 172.21.15.170:0/1953067395 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9074084eb0 con 0x7f90801007e0 2024-09-04T16:39:07.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.323+0000 7f9086d41640 1 -- 172.21.15.170:0/1953067395 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9080198270 con 0x7f9070079e80 2024-09-04T16:39:07.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.324+0000 7f907dffb640 1 -- 172.21.15.170:0/1953067395 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f9080198270 con 0x7f9070079e80 2024-09-04T16:39:07.325 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:39:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:39:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:39:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:39:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:39:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "mon", 2024-09-04T16:39:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:39:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:39:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr" 2024-09-04T16:39:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:39:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "15/23 daemons upgraded", 2024-09-04T16:39:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:39:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:39:07.327 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:39:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.327+0000 7f9086d41640 1 -- 172.21.15.170:0/1953067395 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9070079e80 msgr2=0x7f907007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.327+0000 7f9086d41640 1 --2- 172.21.15.170:0/1953067395 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9070079e80 0x7f907007c340 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9080105f00 tx=0x7f906c009110 comp rx=0 tx=0).stop 2024-09-04T16:39:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.327+0000 7f9086d41640 1 -- 172.21.15.170:0/1953067395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90801007e0 msgr2=0x7f908019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.327+0000 7f9086d41640 1 --2- 172.21.15.170:0/1953067395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90801007e0 0x7f908019d680 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9074031460 tx=0x7f90740048f0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.327+0000 7f9086d41640 1 -- 172.21.15.170:0/1953067395 shutdown_connections 2024-09-04T16:39:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.327+0000 7f9086d41640 1 --2- 172.21.15.170:0/1953067395 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9070079e80 0x7f907007c340 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.327+0000 7f9086d41640 1 --2- 172.21.15.170:0/1953067395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90801067e0 0x7f908019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.327+0000 7f9086d41640 1 --2- 172.21.15.170:0/1953067395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90801007e0 0x7f908019d680 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.327+0000 7f9086d41640 1 -- 172.21.15.170:0/1953067395 >> 172.21.15.170:0/1953067395 conn(0x7f90800fc4c0 msgr2=0x7f9080069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:07.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.327+0000 7f9086d41640 1 -- 172.21.15.170:0/1953067395 shutdown_connections 2024-09-04T16:39:07.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.327+0000 7f9086d41640 1 -- 172.21.15.170:0/1953067395 wait complete. 2024-09-04T16:39:07.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.412+0000 7f5682da1640 1 -- 172.21.15.170:0/1370830987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f567c103220 msgr2=0x7f567c107760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:07.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.412+0000 7f5682da1640 1 --2- 172.21.15.170:0/1370830987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f567c103220 0x7f567c107760 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f566c009880 tx=0x7f566c02a530 comp rx=0 tx=0).stop 2024-09-04T16:39:07.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.412+0000 7f5682da1640 1 -- 172.21.15.170:0/1370830987 shutdown_connections 2024-09-04T16:39:07.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.412+0000 7f5682da1640 1 --2- 172.21.15.170:0/1370830987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f567c103220 0x7f567c107760 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.412+0000 7f5682da1640 1 --2- 172.21.15.170:0/1370830987 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f567c102900 0x7f567c102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.412+0000 7f5682da1640 1 -- 172.21.15.170:0/1370830987 >> 172.21.15.170:0/1370830987 conn(0x7f567c0fc340 msgr2=0x7f567c0fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:07.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.412+0000 7f5682da1640 1 -- 172.21.15.170:0/1370830987 shutdown_connections 2024-09-04T16:39:07.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.412+0000 7f5682da1640 1 -- 172.21.15.170:0/1370830987 wait complete. 2024-09-04T16:39:07.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.412+0000 7f5682da1640 1 Processor -- start 2024-09-04T16:39:07.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.412+0000 7f5682da1640 1 -- start start 2024-09-04T16:39:07.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f5682da1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f567c102900 0x7f567c19d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:07.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f5682da1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f567c103220 0x7f567c19dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:07.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f5682da1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f567c10edb0 con 0x7f567c103220 2024-09-04T16:39:07.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f5682da1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f567c10ec30 con 0x7f567c102900 2024-09-04T16:39:07.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f568159e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f567c103220 0x7f567c19dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:07.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f568159e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f567c103220 0x7f567c19dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59336/0 (socket says 172.21.15.170:59336) 2024-09-04T16:39:07.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f568159e640 1 -- 172.21.15.170:0/61409217 learned_addr learned my addr 172.21.15.170:0/61409217 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:39:07.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f5681d9f640 1 --2- 172.21.15.170:0/61409217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f567c102900 0x7f567c19d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:07.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f568159e640 1 -- 172.21.15.170:0/61409217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f567c102900 msgr2=0x7f567c19d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:07.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f568159e640 1 --2- 172.21.15.170:0/61409217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f567c102900 0x7f567c19d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f568159e640 1 -- 172.21.15.170:0/61409217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567c1979c0 con 0x7f567c103220 2024-09-04T16:39:07.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f5681d9f640 1 --2- 172.21.15.170:0/61409217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f567c102900 0x7f567c19d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:39:07.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f568159e640 1 --2- 172.21.15.170:0/61409217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f567c103220 0x7f567c19dd40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f566c031460 tx=0x7f566c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:07.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f5672ffd640 1 -- 172.21.15.170:0/61409217 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f566c03f070 con 0x7f567c103220 2024-09-04T16:39:07.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f5672ffd640 1 -- 172.21.15.170:0/61409217 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f566c0035f0 con 0x7f567c103220 2024-09-04T16:39:07.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f5682da1640 1 -- 172.21.15.170:0/61409217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f567c197c50 con 0x7f567c103220 2024-09-04T16:39:07.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f5672ffd640 1 -- 172.21.15.170:0/61409217 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f566c035030 con 0x7f567c103220 2024-09-04T16:39:07.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.413+0000 7f5682da1640 1 -- 172.21.15.170:0/61409217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f567c198180 con 0x7f567c103220 2024-09-04T16:39:07.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.414+0000 7f5682da1640 1 -- 172.21.15.170:0/61409217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f567c06abe0 con 0x7f567c103220 2024-09-04T16:39:07.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.415+0000 7f5672ffd640 1 -- 172.21.15.170:0/61409217 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f566c042070 con 0x7f567c103220 2024-09-04T16:39:07.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.415+0000 7f5672ffd640 1 --2- 172.21.15.170:0/61409217 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5668079e30 0x7f566807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:07.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.416+0000 7f5672ffd640 1 -- 172.21.15.170:0/61409217 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f566c0bd460 con 0x7f567c103220 2024-09-04T16:39:07.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.416+0000 7f5681d9f640 1 --2- 172.21.15.170:0/61409217 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5668079e30 0x7f566807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:07.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.416+0000 7f5681d9f640 1 --2- 172.21.15.170:0/61409217 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5668079e30 0x7f566807c2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5678005fd0 tx=0x7f5678005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:07.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.420+0000 7f5672ffd640 1 -- 172.21.15.170:0/61409217 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f566c084e70 con 0x7f567c103220 2024-09-04T16:39:07.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:07 smithi170 ceph-mon[113855]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:39:07.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:07 smithi170 ceph-mon[113855]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:39:07.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:07 smithi170 ceph-mon[113855]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:39:07.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:07 smithi170 ceph-mon[113855]: pgmap v281: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:07.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:07 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/519689005' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:39:07.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:07 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1811634109' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:39:07.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:07 smithi193 ceph-mon[82547]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:39:07.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:07 smithi193 ceph-mon[82547]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:39:07.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:07 smithi193 ceph-mon[82547]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:39:07.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:07 smithi193 ceph-mon[82547]: pgmap v281: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:07.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:07 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/519689005' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:39:07.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:07 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1811634109' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:39:07.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.662+0000 7f5682da1640 1 -- 172.21.15.170:0/61409217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f567c102ce0 con 0x7f567c103220 2024-09-04T16:39:07.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.662+0000 7f5672ffd640 1 -- 172.21.15.170:0/61409217 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f566c088fe0 con 0x7f567c103220 2024-09-04T16:39:07.663 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:39:07.663 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:39:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:39:07.664 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:39:07.664 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:39:07.664 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:39:07.665 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:39:07.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.664+0000 7f5682da1640 1 -- 172.21.15.170:0/61409217 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5668079e30 msgr2=0x7f566807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:07.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.664+0000 7f5682da1640 1 --2- 172.21.15.170:0/61409217 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5668079e30 0x7f566807c2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5678005fd0 tx=0x7f5678005850 comp rx=0 tx=0).stop 2024-09-04T16:39:07.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.664+0000 7f5682da1640 1 -- 172.21.15.170:0/61409217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f567c103220 msgr2=0x7f567c19dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:07.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.664+0000 7f5682da1640 1 --2- 172.21.15.170:0/61409217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f567c103220 0x7f567c19dd40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f566c031460 tx=0x7f566c0045e0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.664+0000 7f5682da1640 1 -- 172.21.15.170:0/61409217 shutdown_connections 2024-09-04T16:39:07.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.664+0000 7f5682da1640 1 --2- 172.21.15.170:0/61409217 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5668079e30 0x7f566807c2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.664+0000 7f5682da1640 1 --2- 172.21.15.170:0/61409217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f567c103220 0x7f567c19dd40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.664+0000 7f5682da1640 1 --2- 172.21.15.170:0/61409217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f567c102900 0x7f567c19d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:07.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.664+0000 7f5682da1640 1 -- 172.21.15.170:0/61409217 >> 172.21.15.170:0/61409217 conn(0x7f567c0fc340 msgr2=0x7f567c10bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:07.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.664+0000 7f5682da1640 1 -- 172.21.15.170:0/61409217 shutdown_connections 2024-09-04T16:39:07.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:07.664+0000 7f5682da1640 1 -- 172.21.15.170:0/61409217 wait complete. 2024-09-04T16:39:08.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:08 smithi170 ceph-mon[113855]: osdmap e82: 6 total, 6 up, 6 in 2024-09-04T16:39:08.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:08 smithi170 ceph-mon[113855]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-04T16:39:08.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:08 smithi170 ceph-mon[113855]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:39:08.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:08 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/61409217' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:39:08.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:08 smithi193 ceph-mon[82547]: osdmap e82: 6 total, 6 up, 6 in 2024-09-04T16:39:08.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:08 smithi193 ceph-mon[82547]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-04T16:39:08.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:08 smithi193 ceph-mon[82547]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:39:08.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:08 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/61409217' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:39:09.580 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:09 smithi193 ceph-mon[82547]: pgmap v283: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:09.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:09 smithi170 ceph-mon[113855]: pgmap v283: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:10 smithi170 ceph-mon[113855]: pgmap v284: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:10.624 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:10 smithi193 ceph-mon[82547]: pgmap v284: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:12.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:12.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:12.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:39:12.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:11 smithi193 ceph-mon[82547]: mds.? [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] up:boot 2024-09-04T16:39:12.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:11 smithi193 ceph-mon[82547]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-04T16:39:12.157 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "mds metadata", "who": "cephfs.smithi193.kabapr"} : dispatch 2024-09-04T16:39:12.228 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:12.228 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:12.228 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:39:12.228 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:11 smithi170 ceph-mon[113855]: mds.? [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] up:boot 2024-09-04T16:39:12.228 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:11 smithi170 ceph-mon[113855]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-04T16:39:12.228 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "mds metadata", "who": "cephfs.smithi193.kabapr"} : dispatch 2024-09-04T16:39:13.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:12 smithi193 ceph-mon[82547]: pgmap v285: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:13.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:12 smithi170 ceph-mon[113855]: pgmap v285: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:14.837 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:14.837 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:14.837 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:39:14.838 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:14.838 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:14.838 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:14 smithi193 ceph-mon[82547]: pgmap v286: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:14.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:39:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:39:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:14 smithi170 ceph-mon[113855]: pgmap v286: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:16.810 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:16 smithi193 ceph-mon[82547]: pgmap v287: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:16.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:16 smithi170 ceph-mon[113855]: pgmap v287: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:18.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:18 smithi170 ceph-mon[113855]: pgmap v288: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:18.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:18 smithi193 ceph-mon[82547]: pgmap v288: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:20.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:20 smithi170 ceph-mon[113855]: pgmap v289: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:20.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:20 smithi193 ceph-mon[82547]: pgmap v289: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:23.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:22 smithi193 ceph-mon[82547]: pgmap v290: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:23.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:22 smithi170 ceph-mon[113855]: pgmap v290: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:24.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:24 smithi170 ceph-mon[113855]: pgmap v291: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:24 smithi193 ceph-mon[82547]: pgmap v291: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:26.807 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:26 smithi193 ceph-mon[82547]: pgmap v292: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:26.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:26 smithi170 ceph-mon[113855]: pgmap v292: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:28.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:28 smithi170 ceph-mon[113855]: pgmap v293: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:28.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:28 smithi193 ceph-mon[82547]: pgmap v293: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:29.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:39:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:39:30.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:30 smithi170 ceph-mon[113855]: pgmap v294: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:30.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:30 smithi193 ceph-mon[82547]: pgmap v294: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:32.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:32 smithi170 ceph-mon[113855]: pgmap v295: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:32.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:32 smithi193 ceph-mon[82547]: pgmap v295: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:34.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:34 smithi170 ceph-mon[113855]: pgmap v296: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:34.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:34 smithi193 ceph-mon[82547]: pgmap v296: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:36.776 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:36 smithi170 ceph-mon[113855]: pgmap v297: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:36 smithi193 ceph-mon[82547]: pgmap v297: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.751+0000 7fc2bf1b9640 1 -- 172.21.15.170:0/3324704233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2b81007e0 msgr2=0x7fc2b8100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.751+0000 7fc2bf1b9640 1 --2- 172.21.15.170:0/3324704233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2b81007e0 0x7fc2b8100c40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009880 tx=0x7fc2a402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:39:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.751+0000 7fc2bf1b9640 1 -- 172.21.15.170:0/3324704233 shutdown_connections 2024-09-04T16:39:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.751+0000 7fc2bf1b9640 1 --2- 172.21.15.170:0/3324704233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2b81007e0 0x7fc2b8100c40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.751+0000 7fc2bf1b9640 1 --2- 172.21.15.170:0/3324704233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2b81067e0 0x7fc2b8106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.751+0000 7fc2bf1b9640 1 -- 172.21.15.170:0/3324704233 >> 172.21.15.170:0/3324704233 conn(0x7fc2b80fc4c0 msgr2=0x7fc2b80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.751+0000 7fc2bf1b9640 1 -- 172.21.15.170:0/3324704233 shutdown_connections 2024-09-04T16:39:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.751+0000 7fc2bf1b9640 1 -- 172.21.15.170:0/3324704233 wait complete. 2024-09-04T16:39:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.751+0000 7fc2bf1b9640 1 Processor -- start 2024-09-04T16:39:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.751+0000 7fc2bf1b9640 1 -- start start 2024-09-04T16:39:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.751+0000 7fc2bf1b9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2b81007e0 0x7fc2b819f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.751+0000 7fc2bf1b9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2b81067e0 0x7fc2b819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.751+0000 7fc2bf1b9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b810dcb0 con 0x7fc2b81007e0 2024-09-04T16:39:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.751+0000 7fc2bf1b9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b810db30 con 0x7fc2b81067e0 2024-09-04T16:39:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.752+0000 7fc2bcf55640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2b81007e0 0x7fc2b819f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.752+0000 7fc2bcf55640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2b81007e0 0x7fc2b819f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41308/0 (socket says 172.21.15.170:41308) 2024-09-04T16:39:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.752+0000 7fc2bcf55640 1 -- 172.21.15.170:0/4106718574 learned_addr learned my addr 172.21.15.170:0/4106718574 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:39:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.752+0000 7fc2b7fff640 1 --2- 172.21.15.170:0/4106718574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2b81067e0 0x7fc2b819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.752+0000 7fc2bcf55640 1 -- 172.21.15.170:0/4106718574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2b81067e0 msgr2=0x7fc2b819fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.752+0000 7fc2bcf55640 1 --2- 172.21.15.170:0/4106718574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2b81067e0 0x7fc2b819fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.752+0000 7fc2bcf55640 1 -- 172.21.15.170:0/4106718574 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b81999e0 con 0x7fc2b81007e0 2024-09-04T16:39:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.752+0000 7fc2b7fff640 1 --2- 172.21.15.170:0/4106718574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2b81067e0 0x7fc2b819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:39:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.752+0000 7fc2bcf55640 1 --2- 172.21.15.170:0/4106718574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2b81007e0 0x7fc2b819f820 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00d6f0 tx=0x7fc2ac00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.752+0000 7fc2b5ffb640 1 -- 172.21.15.170:0/4106718574 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc2ac017070 con 0x7fc2b81007e0 2024-09-04T16:39:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.752+0000 7fc2b5ffb640 1 -- 172.21.15.170:0/4106718574 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc2ac00de00 con 0x7fc2b81007e0 2024-09-04T16:39:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.752+0000 7fc2bf1b9640 1 -- 172.21.15.170:0/4106718574 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b8199cd0 con 0x7fc2b81007e0 2024-09-04T16:39:37.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.752+0000 7fc2b5ffb640 1 -- 172.21.15.170:0/4106718574 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc2ac004bb0 con 0x7fc2b81007e0 2024-09-04T16:39:37.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.753+0000 7fc2bf1b9640 1 -- 172.21.15.170:0/4106718574 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b819a230 con 0x7fc2b81007e0 2024-09-04T16:39:37.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.753+0000 7fc2bf1b9640 1 -- 172.21.15.170:0/4106718574 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2b8101f20 con 0x7fc2b81007e0 2024-09-04T16:39:37.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.754+0000 7fc2b5ffb640 1 -- 172.21.15.170:0/4106718574 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fc2ac004e60 con 0x7fc2b81007e0 2024-09-04T16:39:37.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.754+0000 7fc2b5ffb640 1 --2- 172.21.15.170:0/4106718574 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc2a8079e30 0x7fc2a807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:37.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.755+0000 7fc2b5ffb640 1 -- 172.21.15.170:0/4106718574 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc2ac09c790 con 0x7fc2b81007e0 2024-09-04T16:39:37.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.755+0000 7fc2b7fff640 1 --2- 172.21.15.170:0/4106718574 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc2a8079e30 0x7fc2a807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:37.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.755+0000 7fc2b7fff640 1 --2- 172.21.15.170:0/4106718574 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc2a8079e30 0x7fc2a807c2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc2b819b1d0 tx=0x7fc2a4031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:37.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.759+0000 7fc2b5ffb640 1 -- 172.21.15.170:0/4106718574 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc2ac064140 con 0x7fc2b81007e0 2024-09-04T16:39:37.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.964+0000 7fc2bf1b9640 1 -- 172.21.15.170:0/4106718574 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc2b819a4e0 con 0x7fc2a8079e30 2024-09-04T16:39:37.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.966+0000 7fc2b5ffb640 1 -- 172.21.15.170:0/4106718574 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc2b819a4e0 con 0x7fc2a8079e30 2024-09-04T16:39:37.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.968+0000 7fc2bf1b9640 1 -- 172.21.15.170:0/4106718574 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc2a8079e30 msgr2=0x7fc2a807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:37.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.968+0000 7fc2bf1b9640 1 --2- 172.21.15.170:0/4106718574 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc2a8079e30 0x7fc2a807c2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc2b819b1d0 tx=0x7fc2a4031400 comp rx=0 tx=0).stop 2024-09-04T16:39:37.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.968+0000 7fc2bf1b9640 1 -- 172.21.15.170:0/4106718574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2b81007e0 msgr2=0x7fc2b819f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:37.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.968+0000 7fc2bf1b9640 1 --2- 172.21.15.170:0/4106718574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2b81007e0 0x7fc2b819f820 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00d6f0 tx=0x7fc2ac00dbb0 comp rx=0 tx=0).stop 2024-09-04T16:39:37.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.968+0000 7fc2bf1b9640 1 -- 172.21.15.170:0/4106718574 shutdown_connections 2024-09-04T16:39:37.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.968+0000 7fc2bf1b9640 1 --2- 172.21.15.170:0/4106718574 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc2a8079e30 0x7fc2a807c2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:37.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.968+0000 7fc2bf1b9640 1 --2- 172.21.15.170:0/4106718574 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2b81067e0 0x7fc2b819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:37.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.968+0000 7fc2bf1b9640 1 --2- 172.21.15.170:0/4106718574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2b81007e0 0x7fc2b819f820 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:37.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.968+0000 7fc2bf1b9640 1 -- 172.21.15.170:0/4106718574 >> 172.21.15.170:0/4106718574 conn(0x7fc2b80fc4c0 msgr2=0x7fc2b80fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:37.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.968+0000 7fc2bf1b9640 1 -- 172.21.15.170:0/4106718574 shutdown_connections 2024-09-04T16:39:37.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:37.968+0000 7fc2bf1b9640 1 -- 172.21.15.170:0/4106718574 wait complete. 2024-09-04T16:39:37.978 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:39:38.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.051+0000 7f366ba4e640 1 -- 172.21.15.170:0/3341304350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36640ffd50 msgr2=0x7f36641001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:38.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.051+0000 7f366ba4e640 1 --2- 172.21.15.170:0/3341304350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36640ffd50 0x7f36641001b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3654009880 tx=0x7f365402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.051+0000 7f366ba4e640 1 -- 172.21.15.170:0/3341304350 shutdown_connections 2024-09-04T16:39:38.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.051+0000 7f366ba4e640 1 --2- 172.21.15.170:0/3341304350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36640ffd50 0x7f36641001b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.051+0000 7f366ba4e640 1 --2- 172.21.15.170:0/3341304350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3664106930 0x7f3664106d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.051+0000 7f366ba4e640 1 -- 172.21.15.170:0/3341304350 >> 172.21.15.170:0/3341304350 conn(0x7f36640fbc40 msgr2=0x7f36640fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:38.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.052+0000 7f366ba4e640 1 -- 172.21.15.170:0/3341304350 shutdown_connections 2024-09-04T16:39:38.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.052+0000 7f366ba4e640 1 -- 172.21.15.170:0/3341304350 wait complete. 2024-09-04T16:39:38.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.052+0000 7f366ba4e640 1 Processor -- start 2024-09-04T16:39:38.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.052+0000 7f366ba4e640 1 -- start start 2024-09-04T16:39:38.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.052+0000 7f366ba4e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36640ffd50 0x7f366419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:38.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.052+0000 7f366ba4e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3664106930 0x7f366419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:38.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.052+0000 7f366ba4e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f366410eed0 con 0x7f3664106930 2024-09-04T16:39:38.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.052+0000 7f366ba4e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f366410ed50 con 0x7f36640ffd50 2024-09-04T16:39:38.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.052+0000 7f3668fe9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3664106930 0x7f366419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:38.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.052+0000 7f3668fe9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3664106930 0x7f366419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41328/0 (socket says 172.21.15.170:41328) 2024-09-04T16:39:38.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.052+0000 7f3668fe9640 1 -- 172.21.15.170:0/1383363477 learned_addr learned my addr 172.21.15.170:0/1383363477 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:39:38.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.053+0000 7f36697ea640 1 --2- 172.21.15.170:0/1383363477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36640ffd50 0x7f366419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:38.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.053+0000 7f3668fe9640 1 -- 172.21.15.170:0/1383363477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36640ffd50 msgr2=0x7f366419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:38.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.053+0000 7f3668fe9640 1 --2- 172.21.15.170:0/1383363477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36640ffd50 0x7f366419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.053+0000 7f3668fe9640 1 -- 172.21.15.170:0/1383363477 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3664197880 con 0x7f3664106930 2024-09-04T16:39:38.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.053+0000 7f36697ea640 1 --2- 172.21.15.170:0/1383363477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36640ffd50 0x7f366419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:39:38.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.053+0000 7f3668fe9640 1 --2- 172.21.15.170:0/1383363477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3664106930 0x7f366419dc00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3654031460 tx=0x7f36540045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:38.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.053+0000 7f365a7fc640 1 -- 172.21.15.170:0/1383363477 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f365403f070 con 0x7f3664106930 2024-09-04T16:39:38.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.053+0000 7f365a7fc640 1 -- 172.21.15.170:0/1383363477 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f36540035f0 con 0x7f3664106930 2024-09-04T16:39:38.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.053+0000 7f365a7fc640 1 -- 172.21.15.170:0/1383363477 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3654035030 con 0x7f3664106930 2024-09-04T16:39:38.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.053+0000 7f366ba4e640 1 -- 172.21.15.170:0/1383363477 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3664197b10 con 0x7f3664106930 2024-09-04T16:39:38.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.053+0000 7f366ba4e640 1 -- 172.21.15.170:0/1383363477 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3664198040 con 0x7f3664106930 2024-09-04T16:39:38.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.054+0000 7f366ba4e640 1 -- 172.21.15.170:0/1383363477 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3664103070 con 0x7f3664106930 2024-09-04T16:39:38.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.055+0000 7f365a7fc640 1 -- 172.21.15.170:0/1383363477 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f3654042070 con 0x7f3664106930 2024-09-04T16:39:38.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.055+0000 7f365a7fc640 1 --2- 172.21.15.170:0/1383363477 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3650079e80 0x7f365007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:38.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.055+0000 7f36697ea640 1 --2- 172.21.15.170:0/1383363477 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3650079e80 0x7f365007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:38.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.055+0000 7f365a7fc640 1 -- 172.21.15.170:0/1383363477 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f36540bd450 con 0x7f3664106930 2024-09-04T16:39:38.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.056+0000 7f36697ea640 1 --2- 172.21.15.170:0/1383363477 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3650079e80 0x7f365007c340 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3660005fd0 tx=0x7f3660005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:38.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.059+0000 7f365a7fc640 1 -- 172.21.15.170:0/1383363477 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3654084ee0 con 0x7f3664106930 2024-09-04T16:39:38.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.253+0000 7f366ba4e640 1 -- 172.21.15.170:0/1383363477 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3664109ee0 con 0x7f3650079e80 2024-09-04T16:39:38.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.255+0000 7f365a7fc640 1 -- 172.21.15.170:0/1383363477 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3664109ee0 con 0x7f3650079e80 2024-09-04T16:39:38.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.257+0000 7f366ba4e640 1 -- 172.21.15.170:0/1383363477 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3650079e80 msgr2=0x7f365007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:38.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.257+0000 7f366ba4e640 1 --2- 172.21.15.170:0/1383363477 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3650079e80 0x7f365007c340 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3660005fd0 tx=0x7f3660005850 comp rx=0 tx=0).stop 2024-09-04T16:39:38.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.257+0000 7f366ba4e640 1 -- 172.21.15.170:0/1383363477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3664106930 msgr2=0x7f366419dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:38.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.257+0000 7f366ba4e640 1 --2- 172.21.15.170:0/1383363477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3664106930 0x7f366419dc00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3654031460 tx=0x7f36540045e0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.257+0000 7f366ba4e640 1 -- 172.21.15.170:0/1383363477 shutdown_connections 2024-09-04T16:39:38.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.257+0000 7f366ba4e640 1 --2- 172.21.15.170:0/1383363477 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3650079e80 0x7f365007c340 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.257+0000 7f366ba4e640 1 --2- 172.21.15.170:0/1383363477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3664106930 0x7f366419dc00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.257+0000 7f366ba4e640 1 --2- 172.21.15.170:0/1383363477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f36640ffd50 0x7f366419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.257+0000 7f366ba4e640 1 -- 172.21.15.170:0/1383363477 >> 172.21.15.170:0/1383363477 conn(0x7f36640fbc40 msgr2=0x7f36640fc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:38.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.257+0000 7f366ba4e640 1 -- 172.21.15.170:0/1383363477 shutdown_connections 2024-09-04T16:39:38.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.257+0000 7f366ba4e640 1 -- 172.21.15.170:0/1383363477 wait complete. 2024-09-04T16:39:38.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.339+0000 7fd19c084640 1 -- 172.21.15.170:0/4129413318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd194100820 msgr2=0x7fd194100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:38.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.339+0000 7fd19c084640 1 --2- 172.21.15.170:0/4129413318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd194100820 0x7fd194100c80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd190009880 tx=0x7fd19002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.339+0000 7fd19c084640 1 -- 172.21.15.170:0/4129413318 shutdown_connections 2024-09-04T16:39:38.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.339+0000 7fd19c084640 1 --2- 172.21.15.170:0/4129413318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd194100820 0x7fd194100c80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.339+0000 7fd19c084640 1 --2- 172.21.15.170:0/4129413318 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd194106820 0x7fd194106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.339+0000 7fd19c084640 1 -- 172.21.15.170:0/4129413318 >> 172.21.15.170:0/4129413318 conn(0x7fd1940fc520 msgr2=0x7fd1940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:38.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.339+0000 7fd19c084640 1 -- 172.21.15.170:0/4129413318 shutdown_connections 2024-09-04T16:39:38.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.339+0000 7fd19c084640 1 -- 172.21.15.170:0/4129413318 wait complete. 2024-09-04T16:39:38.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.340+0000 7fd19c084640 1 Processor -- start 2024-09-04T16:39:38.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.340+0000 7fd19c084640 1 -- start start 2024-09-04T16:39:38.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.340+0000 7fd19c084640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd194100820 0x7fd19419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:38.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.340+0000 7fd19c084640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd194106820 0x7fd19419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:38.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.340+0000 7fd19c084640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd19410dcd0 con 0x7fd194100820 2024-09-04T16:39:38.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.340+0000 7fd19c084640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd19410db50 con 0x7fd194106820 2024-09-04T16:39:38.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.340+0000 7fd199e20640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd194100820 0x7fd19419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:38.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.340+0000 7fd199e20640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd194100820 0x7fd19419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41348/0 (socket says 172.21.15.170:41348) 2024-09-04T16:39:38.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.340+0000 7fd199e20640 1 -- 172.21.15.170:0/3376640746 learned_addr learned my addr 172.21.15.170:0/3376640746 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:39:38.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.340+0000 7fd199e20640 1 -- 172.21.15.170:0/3376640746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd194106820 msgr2=0x7fd19419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:38.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.340+0000 7fd19961f640 1 --2- 172.21.15.170:0/3376640746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd194106820 0x7fd19419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:38.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.340+0000 7fd199e20640 1 --2- 172.21.15.170:0/3376640746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd194106820 0x7fd19419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.340+0000 7fd199e20640 1 -- 172.21.15.170:0/3376640746 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1941977c0 con 0x7fd194100820 2024-09-04T16:39:38.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.341+0000 7fd199e20640 1 --2- 172.21.15.170:0/3376640746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd194100820 0x7fd19419d640 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd18400d8d0 tx=0x7fd18400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:38.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.341+0000 7fd18affd640 1 -- 172.21.15.170:0/3376640746 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd184017030 con 0x7fd194100820 2024-09-04T16:39:38.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.341+0000 7fd18affd640 1 -- 172.21.15.170:0/3376640746 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd184004020 con 0x7fd194100820 2024-09-04T16:39:38.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.341+0000 7fd18affd640 1 -- 172.21.15.170:0/3376640746 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd1840047a0 con 0x7fd194100820 2024-09-04T16:39:38.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.341+0000 7fd19c084640 1 -- 172.21.15.170:0/3376640746 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd194197ab0 con 0x7fd194100820 2024-09-04T16:39:38.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.341+0000 7fd19c084640 1 -- 172.21.15.170:0/3376640746 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd194198040 con 0x7fd194100820 2024-09-04T16:39:38.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.342+0000 7fd19c084640 1 -- 172.21.15.170:0/3376640746 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd194101f60 con 0x7fd194100820 2024-09-04T16:39:38.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.342+0000 7fd18affd640 1 -- 172.21.15.170:0/3376640746 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fd1840041d0 con 0x7fd194100820 2024-09-04T16:39:38.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.343+0000 7fd18affd640 1 --2- 172.21.15.170:0/3376640746 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd180079e80 0x7fd18007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:38.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.343+0000 7fd19961f640 1 --2- 172.21.15.170:0/3376640746 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd180079e80 0x7fd18007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:38.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.343+0000 7fd18affd640 1 -- 172.21.15.170:0/3376640746 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd184018070 con 0x7fd194100820 2024-09-04T16:39:38.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.343+0000 7fd19961f640 1 --2- 172.21.15.170:0/3376640746 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd180079e80 0x7fd18007c340 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd190031460 tx=0x7fd190009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:38.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.347+0000 7fd18affd640 1 -- 172.21.15.170:0/3376640746 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd1840642a0 con 0x7fd194100820 2024-09-04T16:39:38.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.529+0000 7fd19c084640 1 -- 172.21.15.170:0/3376640746 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd194198350 con 0x7fd180079e80 2024-09-04T16:39:38.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.539+0000 7fd18affd640 1 -- 172.21.15.170:0/3376640746 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fd194198350 con 0x7fd180079e80 2024-09-04T16:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (6m) 51s ago 17m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (9m) 51s ago 17m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (9m) 24s ago 16m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (4m) 51s ago 17m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (4m) 24s ago 16m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (6m) 51s ago 17m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (57s) 51s ago 12m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (74s) 51s ago 12m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (28s) 24s ago 12m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (42s) 24s ago 12m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (8m) 51s ago 18m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (7m) 24s ago 16m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (5m) 51s ago 18m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (5m) 24s ago 16m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (7m) 51s ago 17m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (7m) 24s ago 16m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (4m) 51s ago 15m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (3m) 51s ago 14m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (3m) 51s ago 14m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (2m) 24s ago 14m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (2m) 24s ago 13m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (89s) 24s ago 13m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (6m) 51s ago 17m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:39:38.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.541+0000 7fd19c084640 1 -- 172.21.15.170:0/3376640746 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd180079e80 msgr2=0x7fd18007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:38.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.541+0000 7fd19c084640 1 --2- 172.21.15.170:0/3376640746 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd180079e80 0x7fd18007c340 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd190031460 tx=0x7fd190009560 comp rx=0 tx=0).stop 2024-09-04T16:39:38.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.541+0000 7fd19c084640 1 -- 172.21.15.170:0/3376640746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd194100820 msgr2=0x7fd19419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:38.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.541+0000 7fd19c084640 1 --2- 172.21.15.170:0/3376640746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd194100820 0x7fd19419d640 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd18400d8d0 tx=0x7fd18400dd90 comp rx=0 tx=0).stop 2024-09-04T16:39:38.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.541+0000 7fd19c084640 1 -- 172.21.15.170:0/3376640746 shutdown_connections 2024-09-04T16:39:38.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.541+0000 7fd19c084640 1 --2- 172.21.15.170:0/3376640746 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd180079e80 0x7fd18007c340 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.541+0000 7fd19c084640 1 --2- 172.21.15.170:0/3376640746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd194106820 0x7fd19419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.541+0000 7fd19c084640 1 --2- 172.21.15.170:0/3376640746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd194100820 0x7fd19419d640 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.541+0000 7fd19c084640 1 -- 172.21.15.170:0/3376640746 >> 172.21.15.170:0/3376640746 conn(0x7fd1940fc520 msgr2=0x7fd19406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:38.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.541+0000 7fd19c084640 1 -- 172.21.15.170:0/3376640746 shutdown_connections 2024-09-04T16:39:38.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.541+0000 7fd19c084640 1 -- 172.21.15.170:0/3376640746 wait complete. 2024-09-04T16:39:38.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.622+0000 7fa303aef640 1 -- 172.21.15.170:0/3679294407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2fc106820 msgr2=0x7fa2fc106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:38.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.622+0000 7fa303aef640 1 --2- 172.21.15.170:0/3679294407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2fc106820 0x7fa2fc106c00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009880 tx=0x7fa2ec02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.622+0000 7fa303aef640 1 -- 172.21.15.170:0/3679294407 shutdown_connections 2024-09-04T16:39:38.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.622+0000 7fa303aef640 1 --2- 172.21.15.170:0/3679294407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2fc100820 0x7fa2fc100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.622+0000 7fa303aef640 1 --2- 172.21.15.170:0/3679294407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2fc106820 0x7fa2fc106c00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.622+0000 7fa303aef640 1 -- 172.21.15.170:0/3679294407 >> 172.21.15.170:0/3679294407 conn(0x7fa2fc0fc520 msgr2=0x7fa2fc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:38.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.622+0000 7fa303aef640 1 -- 172.21.15.170:0/3679294407 shutdown_connections 2024-09-04T16:39:38.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.622+0000 7fa303aef640 1 -- 172.21.15.170:0/3679294407 wait complete. 2024-09-04T16:39:38.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.623+0000 7fa303aef640 1 Processor -- start 2024-09-04T16:39:38.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.623+0000 7fa303aef640 1 -- start start 2024-09-04T16:39:38.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.623+0000 7fa303aef640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2fc100820 0x7fa2fc198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:38.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.623+0000 7fa303aef640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2fc106820 0x7fa2fc198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:38.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.623+0000 7fa303aef640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc10dcf0 con 0x7fa2fc106820 2024-09-04T16:39:38.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.623+0000 7fa303aef640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc10db70 con 0x7fa2fc100820 2024-09-04T16:39:38.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.623+0000 7fa30108a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2fc106820 0x7fa2fc198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:38.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.623+0000 7fa30108a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2fc106820 0x7fa2fc198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41368/0 (socket says 172.21.15.170:41368) 2024-09-04T16:39:38.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.623+0000 7fa30108a640 1 -- 172.21.15.170:0/1207705004 learned_addr learned my addr 172.21.15.170:0/1207705004 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:39:38.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.623+0000 7fa30188b640 1 --2- 172.21.15.170:0/1207705004 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2fc100820 0x7fa2fc198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:38.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.623+0000 7fa30108a640 1 -- 172.21.15.170:0/1207705004 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2fc100820 msgr2=0x7fa2fc198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:38.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.623+0000 7fa30108a640 1 --2- 172.21.15.170:0/1207705004 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2fc100820 0x7fa2fc198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.623+0000 7fa30108a640 1 -- 172.21.15.170:0/1207705004 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2fc199380 con 0x7fa2fc106820 2024-09-04T16:39:38.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.624+0000 7fa30108a640 1 --2- 172.21.15.170:0/1207705004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2fc106820 0x7fa2fc198d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800d6f0 tx=0x7fa2f800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:38.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.624+0000 7fa2f2ffd640 1 -- 172.21.15.170:0/1207705004 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2f8017070 con 0x7fa2fc106820 2024-09-04T16:39:38.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.624+0000 7fa2f2ffd640 1 -- 172.21.15.170:0/1207705004 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa2f800de00 con 0x7fa2fc106820 2024-09-04T16:39:38.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.624+0000 7fa303aef640 1 -- 172.21.15.170:0/1207705004 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2fc199670 con 0x7fa2fc106820 2024-09-04T16:39:38.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.624+0000 7fa2f2ffd640 1 -- 172.21.15.170:0/1207705004 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2f8004bb0 con 0x7fa2fc106820 2024-09-04T16:39:38.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.624+0000 7fa303aef640 1 -- 172.21.15.170:0/1207705004 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2fc1a1c70 con 0x7fa2fc106820 2024-09-04T16:39:38.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.625+0000 7fa303aef640 1 -- 172.21.15.170:0/1207705004 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2fc101f60 con 0x7fa2fc106820 2024-09-04T16:39:38.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.625+0000 7fa2f2ffd640 1 -- 172.21.15.170:0/1207705004 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fa2f8009a30 con 0x7fa2fc106820 2024-09-04T16:39:38.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.626+0000 7fa2f2ffd640 1 --2- 172.21.15.170:0/1207705004 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2e8079e80 0x7fa2e807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:38.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.626+0000 7fa2f2ffd640 1 -- 172.21.15.170:0/1207705004 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa2f809c560 con 0x7fa2fc106820 2024-09-04T16:39:38.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.626+0000 7fa30188b640 1 --2- 172.21.15.170:0/1207705004 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2e8079e80 0x7fa2e807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:38.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.626+0000 7fa30188b640 1 --2- 172.21.15.170:0/1207705004 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2e8079e80 0x7fa2e807c340 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0096c0 tx=0x7fa2ec031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:38.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.630+0000 7fa2f2ffd640 1 -- 172.21.15.170:0/1207705004 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa2fc199670 con 0x7fa2fc106820 2024-09-04T16:39:38.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:38 smithi170 ceph-mon[113855]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:39:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:38 smithi170 ceph-mon[113855]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:39:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:38 smithi170 ceph-mon[113855]: pgmap v298: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:38.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.877+0000 7fa303aef640 1 -- 172.21.15.170:0/1207705004 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa2fc06a8f0 con 0x7fa2fc106820 2024-09-04T16:39:38.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.877+0000 7fa2f2ffd640 1 -- 172.21.15.170:0/1207705004 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fa2f8068160 con 0x7fa2fc106820 2024-09-04T16:39:38.878 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:39:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:39:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:39:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:39:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:39:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:39:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:39:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:39:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:39:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:39:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:39:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:39:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:39:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:39:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:39:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:39:38.879 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:39:38.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.880+0000 7fa303aef640 1 -- 172.21.15.170:0/1207705004 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2e8079e80 msgr2=0x7fa2e807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:38.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.880+0000 7fa303aef640 1 --2- 172.21.15.170:0/1207705004 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2e8079e80 0x7fa2e807c340 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0096c0 tx=0x7fa2ec031400 comp rx=0 tx=0).stop 2024-09-04T16:39:38.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.880+0000 7fa303aef640 1 -- 172.21.15.170:0/1207705004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2fc106820 msgr2=0x7fa2fc198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:38.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.880+0000 7fa303aef640 1 --2- 172.21.15.170:0/1207705004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2fc106820 0x7fa2fc198d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800d6f0 tx=0x7fa2f800dbb0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.880+0000 7fa303aef640 1 -- 172.21.15.170:0/1207705004 shutdown_connections 2024-09-04T16:39:38.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.880+0000 7fa303aef640 1 --2- 172.21.15.170:0/1207705004 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2e8079e80 0x7fa2e807c340 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.880+0000 7fa303aef640 1 --2- 172.21.15.170:0/1207705004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2fc106820 0x7fa2fc198d80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.880+0000 7fa303aef640 1 --2- 172.21.15.170:0/1207705004 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2fc100820 0x7fa2fc198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.880+0000 7fa303aef640 1 -- 172.21.15.170:0/1207705004 >> 172.21.15.170:0/1207705004 conn(0x7fa2fc0fc520 msgr2=0x7fa2fc0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:38.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.880+0000 7fa303aef640 1 -- 172.21.15.170:0/1207705004 shutdown_connections 2024-09-04T16:39:38.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.880+0000 7fa303aef640 1 -- 172.21.15.170:0/1207705004 wait complete. 2024-09-04T16:39:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:38 smithi193 ceph-mon[82547]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:39:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:38 smithi193 ceph-mon[82547]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:39:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:38 smithi193 ceph-mon[82547]: pgmap v298: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:38.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.962+0000 7f27ee4f9640 1 -- 172.21.15.170:0/3141763969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27e8100820 msgr2=0x7f27e8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:38.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.962+0000 7f27ee4f9640 1 --2- 172.21.15.170:0/3141763969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27e8100820 0x7f27e8100c80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009880 tx=0x7f27dc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.962+0000 7f27ee4f9640 1 -- 172.21.15.170:0/3141763969 shutdown_connections 2024-09-04T16:39:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.962+0000 7f27ee4f9640 1 --2- 172.21.15.170:0/3141763969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27e8100820 0x7f27e8100c80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.962+0000 7f27ee4f9640 1 --2- 172.21.15.170:0/3141763969 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27e8106820 0x7f27e8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.962+0000 7f27ee4f9640 1 -- 172.21.15.170:0/3141763969 >> 172.21.15.170:0/3141763969 conn(0x7f27e80fc520 msgr2=0x7f27e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.962+0000 7f27ee4f9640 1 -- 172.21.15.170:0/3141763969 shutdown_connections 2024-09-04T16:39:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.962+0000 7f27ee4f9640 1 -- 172.21.15.170:0/3141763969 wait complete. 2024-09-04T16:39:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.963+0000 7f27ee4f9640 1 Processor -- start 2024-09-04T16:39:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.963+0000 7f27ee4f9640 1 -- start start 2024-09-04T16:39:38.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.963+0000 7f27ee4f9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27e8100820 0x7f27e8198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:38.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.963+0000 7f27ee4f9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27e8106820 0x7f27e8198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:38.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.963+0000 7f27ee4f9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f27e810dcf0 con 0x7f27e8106820 2024-09-04T16:39:38.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.963+0000 7f27ee4f9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f27e810db70 con 0x7f27e8100820 2024-09-04T16:39:38.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.963+0000 7f27e77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27e8106820 0x7f27e8198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:38.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.963+0000 7f27e77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27e8106820 0x7f27e8198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41378/0 (socket says 172.21.15.170:41378) 2024-09-04T16:39:38.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.963+0000 7f27e77fe640 1 -- 172.21.15.170:0/1123905872 learned_addr learned my addr 172.21.15.170:0/1123905872 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:39:38.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.963+0000 7f27e7fff640 1 --2- 172.21.15.170:0/1123905872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27e8100820 0x7f27e8198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:38.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.964+0000 7f27e77fe640 1 -- 172.21.15.170:0/1123905872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27e8100820 msgr2=0x7f27e8198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:38.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.964+0000 7f27e77fe640 1 --2- 172.21.15.170:0/1123905872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27e8100820 0x7f27e8198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:38.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.964+0000 7f27e77fe640 1 -- 172.21.15.170:0/1123905872 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e8199340 con 0x7f27e8106820 2024-09-04T16:39:38.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.964+0000 7f27e77fe640 1 --2- 172.21.15.170:0/1123905872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27e8106820 0x7f27e8198d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f27dc031460 tx=0x7f27dc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:38.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.964+0000 7f27e57fa640 1 -- 172.21.15.170:0/1123905872 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f27dc03f070 con 0x7f27e8106820 2024-09-04T16:39:38.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.964+0000 7f27e57fa640 1 -- 172.21.15.170:0/1123905872 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f27dc0035f0 con 0x7f27e8106820 2024-09-04T16:39:38.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.964+0000 7f27e57fa640 1 -- 172.21.15.170:0/1123905872 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f27dc035030 con 0x7f27e8106820 2024-09-04T16:39:38.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.964+0000 7f27ee4f9640 1 -- 172.21.15.170:0/1123905872 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e81995d0 con 0x7f27e8106820 2024-09-04T16:39:38.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.964+0000 7f27ee4f9640 1 -- 172.21.15.170:0/1123905872 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e81a1b80 con 0x7f27e8106820 2024-09-04T16:39:38.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.965+0000 7f27ee4f9640 1 -- 172.21.15.170:0/1123905872 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e8101f60 con 0x7f27e8106820 2024-09-04T16:39:38.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.966+0000 7f27e57fa640 1 -- 172.21.15.170:0/1123905872 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f27dc042070 con 0x7f27e8106820 2024-09-04T16:39:38.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.966+0000 7f27e57fa640 1 --2- 172.21.15.170:0/1123905872 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f27d0079e80 0x7f27d007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:38.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.966+0000 7f27e57fa640 1 -- 172.21.15.170:0/1123905872 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f27dc0bd300 con 0x7f27e8106820 2024-09-04T16:39:38.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.966+0000 7f27e7fff640 1 --2- 172.21.15.170:0/1123905872 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f27d0079e80 0x7f27d007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:38.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.967+0000 7f27e7fff640 1 --2- 172.21.15.170:0/1123905872 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f27d0079e80 0x7f27d007c340 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f27d8005fd0 tx=0x7f27d800b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:38.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:38.970+0000 7f27e57fa640 1 -- 172.21.15.170:0/1123905872 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f27dc088f00 con 0x7f27e8106820 2024-09-04T16:39:39.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.177+0000 7f27ee4f9640 1 -- 172.21.15.170:0/1123905872 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f27e8108d90 con 0x7f27e8106820 2024-09-04T16:39:39.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.178+0000 7f27e57fa640 1 -- 172.21.15.170:0/1123905872 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7f27dc08d920 con 0x7f27e8106820 2024-09-04T16:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:39:39.184 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:39:39.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.180+0000 7f27ee4f9640 1 -- 172.21.15.170:0/1123905872 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f27d0079e80 msgr2=0x7f27d007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:39.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.180+0000 7f27ee4f9640 1 --2- 172.21.15.170:0/1123905872 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f27d0079e80 0x7f27d007c340 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f27d8005fd0 tx=0x7f27d800b390 comp rx=0 tx=0).stop 2024-09-04T16:39:39.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.180+0000 7f27ee4f9640 1 -- 172.21.15.170:0/1123905872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27e8106820 msgr2=0x7f27e8198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:39.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.180+0000 7f27ee4f9640 1 --2- 172.21.15.170:0/1123905872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27e8106820 0x7f27e8198d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f27dc031460 tx=0x7f27dc0045e0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.180+0000 7f27ee4f9640 1 -- 172.21.15.170:0/1123905872 shutdown_connections 2024-09-04T16:39:39.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.180+0000 7f27ee4f9640 1 --2- 172.21.15.170:0/1123905872 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f27d0079e80 0x7f27d007c340 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.180+0000 7f27ee4f9640 1 --2- 172.21.15.170:0/1123905872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27e8106820 0x7f27e8198d40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.180+0000 7f27ee4f9640 1 --2- 172.21.15.170:0/1123905872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27e8100820 0x7f27e8198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.180+0000 7f27ee4f9640 1 -- 172.21.15.170:0/1123905872 >> 172.21.15.170:0/1123905872 conn(0x7f27e80fc520 msgr2=0x7f27e80fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:39.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.180+0000 7f27ee4f9640 1 -- 172.21.15.170:0/1123905872 shutdown_connections 2024-09-04T16:39:39.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.180+0000 7f27ee4f9640 1 -- 172.21.15.170:0/1123905872 wait complete. 2024-09-04T16:39:39.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.265+0000 7fc732c7f640 1 -- 172.21.15.170:0/1997794774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc72c100820 msgr2=0x7fc72c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:39.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.265+0000 7fc732c7f640 1 --2- 172.21.15.170:0/1997794774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc72c100820 0x7fc72c100c80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc718009880 tx=0x7fc71802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.265+0000 7fc732c7f640 1 -- 172.21.15.170:0/1997794774 shutdown_connections 2024-09-04T16:39:39.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.265+0000 7fc732c7f640 1 --2- 172.21.15.170:0/1997794774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc72c100820 0x7fc72c100c80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.265+0000 7fc732c7f640 1 --2- 172.21.15.170:0/1997794774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc72c106820 0x7fc72c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.265+0000 7fc732c7f640 1 -- 172.21.15.170:0/1997794774 >> 172.21.15.170:0/1997794774 conn(0x7fc72c0fc520 msgr2=0x7fc72c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:39.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.265+0000 7fc732c7f640 1 -- 172.21.15.170:0/1997794774 shutdown_connections 2024-09-04T16:39:39.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.265+0000 7fc732c7f640 1 -- 172.21.15.170:0/1997794774 wait complete. 2024-09-04T16:39:39.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.266+0000 7fc732c7f640 1 Processor -- start 2024-09-04T16:39:39.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.266+0000 7fc732c7f640 1 -- start start 2024-09-04T16:39:39.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.266+0000 7fc732c7f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc72c100820 0x7fc72c198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:39.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.266+0000 7fc732c7f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc72c106820 0x7fc72c198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:39.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.266+0000 7fc732c7f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc72c10dcd0 con 0x7fc72c106820 2024-09-04T16:39:39.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.266+0000 7fc732c7f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc72c10db50 con 0x7fc72c100820 2024-09-04T16:39:39.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.266+0000 7fc72bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc72c106820 0x7fc72c198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:39.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.266+0000 7fc72bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc72c106820 0x7fc72c198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41394/0 (socket says 172.21.15.170:41394) 2024-09-04T16:39:39.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.266+0000 7fc72bfff640 1 -- 172.21.15.170:0/3481087374 learned_addr learned my addr 172.21.15.170:0/3481087374 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:39:39.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.266+0000 7fc730a1b640 1 --2- 172.21.15.170:0/3481087374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc72c100820 0x7fc72c198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:39.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.266+0000 7fc72bfff640 1 -- 172.21.15.170:0/3481087374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc72c100820 msgr2=0x7fc72c198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:39.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.266+0000 7fc72bfff640 1 --2- 172.21.15.170:0/3481087374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc72c100820 0x7fc72c198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.266+0000 7fc72bfff640 1 -- 172.21.15.170:0/3481087374 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72c199340 con 0x7fc72c106820 2024-09-04T16:39:39.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.266+0000 7fc730a1b640 1 --2- 172.21.15.170:0/3481087374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc72c100820 0x7fc72c198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:39:39.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.266+0000 7fc72bfff640 1 --2- 172.21.15.170:0/3481087374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc72c106820 0x7fc72c198d40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc718031460 tx=0x7fc7180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:39.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.267+0000 7fc729ffb640 1 -- 172.21.15.170:0/3481087374 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc71803f070 con 0x7fc72c106820 2024-09-04T16:39:39.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.267+0000 7fc729ffb640 1 -- 172.21.15.170:0/3481087374 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc718004cf0 con 0x7fc72c106820 2024-09-04T16:39:39.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.267+0000 7fc732c7f640 1 -- 172.21.15.170:0/3481087374 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72c1995d0 con 0x7fc72c106820 2024-09-04T16:39:39.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.267+0000 7fc729ffb640 1 -- 172.21.15.170:0/3481087374 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc718035030 con 0x7fc72c106820 2024-09-04T16:39:39.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.267+0000 7fc732c7f640 1 -- 172.21.15.170:0/3481087374 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc72c1a1b80 con 0x7fc72c106820 2024-09-04T16:39:39.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.268+0000 7fc732c7f640 1 -- 172.21.15.170:0/3481087374 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc72c101f60 con 0x7fc72c106820 2024-09-04T16:39:39.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.268+0000 7fc729ffb640 1 -- 172.21.15.170:0/3481087374 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fc718042070 con 0x7fc72c106820 2024-09-04T16:39:39.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.269+0000 7fc729ffb640 1 --2- 172.21.15.170:0/3481087374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc71c079e30 0x7fc71c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:39.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.269+0000 7fc729ffb640 1 -- 172.21.15.170:0/3481087374 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc7180bd600 con 0x7fc72c106820 2024-09-04T16:39:39.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.269+0000 7fc730a1b640 1 --2- 172.21.15.170:0/3481087374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc71c079e30 0x7fc71c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:39.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.269+0000 7fc730a1b640 1 --2- 172.21.15.170:0/3481087374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc71c079e30 0x7fc71c07c2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc7200058c0 tx=0x7fc720005ec0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:39.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.273+0000 7fc729ffb640 1 -- 172.21.15.170:0/3481087374 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc718084fb0 con 0x7fc72c106820 2024-09-04T16:39:39.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.479+0000 7fc732c7f640 1 -- 172.21.15.170:0/3481087374 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc72c062630 con 0x7fc71c079e30 2024-09-04T16:39:39.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.480+0000 7fc729ffb640 1 -- 172.21.15.170:0/3481087374 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc72c062630 con 0x7fc71c079e30 2024-09-04T16:39:39.481 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:39:39.481 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:39:39.481 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:39:39.481 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:39:39.482 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:39:39.482 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:39:39.482 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:39:39.482 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:39:39.482 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:39:39.482 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:39:39.482 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:39:39.482 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:39:39.482 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:39:39.482 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:39:39.482 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:39:39.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.483+0000 7fc732c7f640 1 -- 172.21.15.170:0/3481087374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc71c079e30 msgr2=0x7fc71c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:39.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.483+0000 7fc732c7f640 1 --2- 172.21.15.170:0/3481087374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc71c079e30 0x7fc71c07c2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc7200058c0 tx=0x7fc720005ec0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.483+0000 7fc732c7f640 1 -- 172.21.15.170:0/3481087374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc72c106820 msgr2=0x7fc72c198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:39.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.483+0000 7fc732c7f640 1 --2- 172.21.15.170:0/3481087374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc72c106820 0x7fc72c198d40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc718031460 tx=0x7fc7180048f0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.483+0000 7fc732c7f640 1 -- 172.21.15.170:0/3481087374 shutdown_connections 2024-09-04T16:39:39.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.483+0000 7fc732c7f640 1 --2- 172.21.15.170:0/3481087374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc71c079e30 0x7fc71c07c2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.483+0000 7fc732c7f640 1 --2- 172.21.15.170:0/3481087374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc72c106820 0x7fc72c198d40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.483+0000 7fc732c7f640 1 --2- 172.21.15.170:0/3481087374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc72c100820 0x7fc72c198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.483+0000 7fc732c7f640 1 -- 172.21.15.170:0/3481087374 >> 172.21.15.170:0/3481087374 conn(0x7fc72c0fc520 msgr2=0x7fc72c0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:39.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.483+0000 7fc732c7f640 1 -- 172.21.15.170:0/3481087374 shutdown_connections 2024-09-04T16:39:39.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.483+0000 7fc732c7f640 1 -- 172.21.15.170:0/3481087374 wait complete. 2024-09-04T16:39:39.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.565+0000 7ff5630ce640 1 -- 172.21.15.170:0/167988691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c106820 msgr2=0x7ff55c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:39.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.565+0000 7ff5630ce640 1 --2- 172.21.15.170:0/167988691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c106820 0x7ff55c106c00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff54c009880 tx=0x7ff54c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.565+0000 7ff5630ce640 1 -- 172.21.15.170:0/167988691 shutdown_connections 2024-09-04T16:39:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.565+0000 7ff5630ce640 1 --2- 172.21.15.170:0/167988691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff55c100820 0x7ff55c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.565+0000 7ff5630ce640 1 --2- 172.21.15.170:0/167988691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c106820 0x7ff55c106c00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.565+0000 7ff5630ce640 1 -- 172.21.15.170:0/167988691 >> 172.21.15.170:0/167988691 conn(0x7ff55c0fc520 msgr2=0x7ff55c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.565+0000 7ff5630ce640 1 -- 172.21.15.170:0/167988691 shutdown_connections 2024-09-04T16:39:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.565+0000 7ff5630ce640 1 -- 172.21.15.170:0/167988691 wait complete. 2024-09-04T16:39:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.565+0000 7ff5630ce640 1 Processor -- start 2024-09-04T16:39:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.565+0000 7ff5630ce640 1 -- start start 2024-09-04T16:39:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.566+0000 7ff5630ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c100820 0x7ff55c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.566+0000 7ff5630ce640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff55c106820 0x7ff55c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.566+0000 7ff5630ce640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff55c10dcf0 con 0x7ff55c100820 2024-09-04T16:39:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.566+0000 7ff5630ce640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff55c10db70 con 0x7ff55c106820 2024-09-04T16:39:39.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.566+0000 7ff560e6a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c100820 0x7ff55c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:39.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.566+0000 7ff560e6a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c100820 0x7ff55c19d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41420/0 (socket says 172.21.15.170:41420) 2024-09-04T16:39:39.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.566+0000 7ff560e6a640 1 -- 172.21.15.170:0/451294265 learned_addr learned my addr 172.21.15.170:0/451294265 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:39:39.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.566+0000 7ff55bfff640 1 --2- 172.21.15.170:0/451294265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff55c106820 0x7ff55c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:39.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.566+0000 7ff560e6a640 1 -- 172.21.15.170:0/451294265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff55c106820 msgr2=0x7ff55c19dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:39.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.566+0000 7ff560e6a640 1 --2- 172.21.15.170:0/451294265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff55c106820 0x7ff55c19dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.566+0000 7ff560e6a640 1 -- 172.21.15.170:0/451294265 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55c197810 con 0x7ff55c100820 2024-09-04T16:39:39.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.566+0000 7ff55bfff640 1 --2- 172.21.15.170:0/451294265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff55c106820 0x7ff55c19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:39:39.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.566+0000 7ff560e6a640 1 --2- 172.21.15.170:0/451294265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c100820 0x7ff55c19d690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff54c031460 tx=0x7ff54c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:39.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.566+0000 7ff559ffb640 1 -- 172.21.15.170:0/451294265 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff54c03f070 con 0x7ff55c100820 2024-09-04T16:39:39.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.566+0000 7ff559ffb640 1 -- 172.21.15.170:0/451294265 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff54c004cf0 con 0x7ff55c100820 2024-09-04T16:39:39.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.567+0000 7ff5630ce640 1 -- 172.21.15.170:0/451294265 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff55c197aa0 con 0x7ff55c100820 2024-09-04T16:39:39.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.567+0000 7ff559ffb640 1 -- 172.21.15.170:0/451294265 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff54c035030 con 0x7ff55c100820 2024-09-04T16:39:39.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.567+0000 7ff5630ce640 1 -- 172.21.15.170:0/451294265 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff55c197fd0 con 0x7ff55c100820 2024-09-04T16:39:39.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.568+0000 7ff5630ce640 1 -- 172.21.15.170:0/451294265 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff55c101f60 con 0x7ff55c100820 2024-09-04T16:39:39.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.568+0000 7ff559ffb640 1 -- 172.21.15.170:0/451294265 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ff54c042070 con 0x7ff55c100820 2024-09-04T16:39:39.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.569+0000 7ff559ffb640 1 --2- 172.21.15.170:0/451294265 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff548079e30 0x7ff54807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:39:39.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.569+0000 7ff559ffb640 1 -- 172.21.15.170:0/451294265 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff54c0bd520 con 0x7ff55c100820 2024-09-04T16:39:39.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.569+0000 7ff55bfff640 1 --2- 172.21.15.170:0/451294265 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff548079e30 0x7ff54807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:39:39.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.569+0000 7ff55bfff640 1 --2- 172.21.15.170:0/451294265 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff548079e30 0x7ff54807c2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff55c105f90 tx=0x7ff544005d30 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:39:39.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.573+0000 7ff559ffb640 1 -- 172.21.15.170:0/451294265 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff54c084f30 con 0x7ff55c100820 2024-09-04T16:39:39.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.814+0000 7ff5630ce640 1 -- 172.21.15.170:0/451294265 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff55c109da0 con 0x7ff55c100820 2024-09-04T16:39:39.815 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:39 smithi170 ceph-mon[113855]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:39:39.815 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:39 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1207705004' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:39:39.815 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:39 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1123905872' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:39:39.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.814+0000 7ff559ffb640 1 -- 172.21.15.170:0/451294265 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7ff54c08d3e0 con 0x7ff55c100820 2024-09-04T16:39:39.815 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:39:39.815 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:39:39.816 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:39:39.816 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:39:39.816 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:39:39.816 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:39:39.816 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:39:39.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.816+0000 7ff5630ce640 1 -- 172.21.15.170:0/451294265 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff548079e30 msgr2=0x7ff54807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:39.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.816+0000 7ff5630ce640 1 --2- 172.21.15.170:0/451294265 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff548079e30 0x7ff54807c2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff55c105f90 tx=0x7ff544005d30 comp rx=0 tx=0).stop 2024-09-04T16:39:39.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.817+0000 7ff5630ce640 1 -- 172.21.15.170:0/451294265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c100820 msgr2=0x7ff55c19d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:39:39.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.817+0000 7ff5630ce640 1 --2- 172.21.15.170:0/451294265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c100820 0x7ff55c19d690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff54c031460 tx=0x7ff54c0048f0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.817+0000 7ff5630ce640 1 -- 172.21.15.170:0/451294265 shutdown_connections 2024-09-04T16:39:39.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.817+0000 7ff5630ce640 1 --2- 172.21.15.170:0/451294265 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff548079e30 0x7ff54807c2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.817+0000 7ff5630ce640 1 --2- 172.21.15.170:0/451294265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff55c106820 0x7ff55c19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.817+0000 7ff5630ce640 1 --2- 172.21.15.170:0/451294265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c100820 0x7ff55c19d690 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:39:39.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.817+0000 7ff5630ce640 1 -- 172.21.15.170:0/451294265 >> 172.21.15.170:0/451294265 conn(0x7ff55c0fc520 msgr2=0x7ff55c06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:39:39.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.817+0000 7ff5630ce640 1 -- 172.21.15.170:0/451294265 shutdown_connections 2024-09-04T16:39:39.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:39:39.817+0000 7ff5630ce640 1 -- 172.21.15.170:0/451294265 wait complete. 2024-09-04T16:39:39.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:39 smithi193 ceph-mon[82547]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:39:39.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:39 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1207705004' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:39:39.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:39 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1123905872' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:39:40.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:40 smithi170 ceph-mon[113855]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:39:40.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:40 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/451294265' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:39:40.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:40 smithi170 ceph-mon[113855]: pgmap v299: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:40.788 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:40 smithi193 ceph-mon[82547]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:39:40.788 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:40 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/451294265' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:39:40.789 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:40 smithi193 ceph-mon[82547]: pgmap v299: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:42.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:42 smithi170 ceph-mon[113855]: pgmap v300: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:42 smithi193 ceph-mon[82547]: pgmap v300: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:39:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:39:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:45 smithi170 ceph-mon[113855]: pgmap v301: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:45.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:45 smithi193 ceph-mon[82547]: pgmap v301: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:46.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:46 smithi170 ceph-mon[113855]: pgmap v302: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:46.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:46 smithi193 ceph-mon[82547]: pgmap v302: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:48.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:48 smithi170 ceph-mon[113855]: pgmap v303: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:48.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:48 smithi193 ceph-mon[82547]: pgmap v303: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:50.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:50 smithi170 ceph-mon[113855]: pgmap v304: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:50 smithi193 ceph-mon[82547]: pgmap v304: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:52.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:52 smithi170 ceph-mon[113855]: pgmap v305: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:52 smithi193 ceph-mon[82547]: pgmap v305: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:54.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:54 smithi170 ceph-mon[113855]: pgmap v306: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:54 smithi193 ceph-mon[82547]: pgmap v306: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:56.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:56 smithi170 ceph-mon[113855]: pgmap v307: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:56.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:56 smithi193 ceph-mon[82547]: pgmap v307: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:58.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:58 smithi170 ceph-mon[113855]: pgmap v308: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:58.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:58 smithi193 ceph-mon[82547]: pgmap v308: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:39:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:39:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:39:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:39:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:40:00.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:00 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170[113851]: 2024-09-04T16:39:59.999+0000 7f15836be640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:40:00.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:00 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170[113851]: 2024-09-04T16:39:59.999+0000 7f15836be640 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:40:00.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:00 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170[113851]: 2024-09-04T16:39:59.999+0000 7f15836be640 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2024-09-04T16:40:00.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:00 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170[113851]: 2024-09-04T16:39:59.999+0000 7f15836be640 -1 log_channel(cluster) log [ERR] : [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:40:00.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:00 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170[113851]: 2024-09-04T16:39:59.999+0000 7f15836be640 -1 log_channel(cluster) log [ERR] : fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:40:00.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:00 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170[113851]: 2024-09-04T16:39:59.999+0000 7f15836be640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:40:00.278 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:00 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170[113851]: 2024-09-04T16:39:59.999+0000 7f15836be640 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2024-09-04T16:40:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:00 smithi170 ceph-mon[113855]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:40:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:00 smithi170 ceph-mon[113855]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:40:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:00 smithi170 ceph-mon[113855]: fs cephfs is degraded 2024-09-04T16:40:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:00 smithi170 ceph-mon[113855]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:40:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:00 smithi170 ceph-mon[113855]: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:40:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:00 smithi170 ceph-mon[113855]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:40:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:00 smithi170 ceph-mon[113855]: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:40:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:00 smithi170 ceph-mon[113855]: pgmap v309: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:00 smithi193 ceph-mon[82547]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:40:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:00 smithi193 ceph-mon[82547]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:40:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:00 smithi193 ceph-mon[82547]: fs cephfs is degraded 2024-09-04T16:40:00.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:00 smithi193 ceph-mon[82547]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:40:00.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:00 smithi193 ceph-mon[82547]: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:40:00.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:00 smithi193 ceph-mon[82547]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:40:00.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:00 smithi193 ceph-mon[82547]: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:40:00.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:00 smithi193 ceph-mon[82547]: pgmap v309: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:02 smithi170 ceph-mon[113855]: pgmap v310: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:02.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:02 smithi193 ceph-mon[82547]: pgmap v310: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:04.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:04 smithi170 ceph-mon[113855]: pgmap v311: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:04.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:04 smithi193 ceph-mon[82547]: pgmap v311: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:06.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:06 smithi170 ceph-mon[113855]: pgmap v312: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:06.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:06 smithi193 ceph-mon[82547]: pgmap v312: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:08.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:08 smithi170 ceph-mon[113855]: pgmap v313: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:08 smithi193 ceph-mon[82547]: pgmap v313: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:09.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.905+0000 7f1c63581640 1 -- 172.21.15.170:0/3024458463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c5c106950 msgr2=0x7f1c5c106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:09.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.905+0000 7f1c63581640 1 --2- 172.21.15.170:0/3024458463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c5c106950 0x7f1c5c106d30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009880 tx=0x7f1c5802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:40:09.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.905+0000 7f1c63581640 1 -- 172.21.15.170:0/3024458463 shutdown_connections 2024-09-04T16:40:09.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.905+0000 7f1c63581640 1 --2- 172.21.15.170:0/3024458463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1c5c0ffd70 0x7f1c5c1001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:09.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.905+0000 7f1c63581640 1 --2- 172.21.15.170:0/3024458463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c5c106950 0x7f1c5c106d30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:09.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.905+0000 7f1c63581640 1 -- 172.21.15.170:0/3024458463 >> 172.21.15.170:0/3024458463 conn(0x7f1c5c0fbc60 msgr2=0x7f1c5c0fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:09.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.905+0000 7f1c63581640 1 -- 172.21.15.170:0/3024458463 shutdown_connections 2024-09-04T16:40:09.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.905+0000 7f1c63581640 1 -- 172.21.15.170:0/3024458463 wait complete. 2024-09-04T16:40:09.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.906+0000 7f1c63581640 1 Processor -- start 2024-09-04T16:40:09.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.906+0000 7f1c63581640 1 -- start start 2024-09-04T16:40:09.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.906+0000 7f1c63581640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c5c0ffd70 0x7f1c5c100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:09.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.906+0000 7f1c63581640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1c5c106950 0x7f1c5c101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:09.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.906+0000 7f1c63581640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c10eef0 con 0x7f1c5c0ffd70 2024-09-04T16:40:09.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.906+0000 7f1c63581640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c10ed70 con 0x7f1c5c106950 2024-09-04T16:40:09.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.906+0000 7f1c6131d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c5c0ffd70 0x7f1c5c100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:09.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.906+0000 7f1c6131d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c5c0ffd70 0x7f1c5c100f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48316/0 (socket says 172.21.15.170:48316) 2024-09-04T16:40:09.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.906+0000 7f1c6131d640 1 -- 172.21.15.170:0/1303863102 learned_addr learned my addr 172.21.15.170:0/1303863102 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:40:09.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.907+0000 7f1c60b1c640 1 --2- 172.21.15.170:0/1303863102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1c5c106950 0x7f1c5c101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:09.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.907+0000 7f1c6131d640 1 -- 172.21.15.170:0/1303863102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1c5c106950 msgr2=0x7f1c5c101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:09.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.907+0000 7f1c6131d640 1 --2- 172.21.15.170:0/1303863102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1c5c106950 0x7f1c5c101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:09.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.907+0000 7f1c6131d640 1 -- 172.21.15.170:0/1303863102 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5c1019d0 con 0x7f1c5c0ffd70 2024-09-04T16:40:09.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.907+0000 7f1c60b1c640 1 --2- 172.21.15.170:0/1303863102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1c5c106950 0x7f1c5c101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:40:09.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.907+0000 7f1c6131d640 1 --2- 172.21.15.170:0/1303863102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c5c0ffd70 0x7f1c5c100f50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1c58031460 tx=0x7f1c580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:09.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.907+0000 7f1c527fc640 1 -- 172.21.15.170:0/1303863102 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c5803f070 con 0x7f1c5c0ffd70 2024-09-04T16:40:09.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.907+0000 7f1c527fc640 1 -- 172.21.15.170:0/1303863102 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c58004cf0 con 0x7f1c5c0ffd70 2024-09-04T16:40:09.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.907+0000 7f1c63581640 1 -- 172.21.15.170:0/1303863102 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c5c101c60 con 0x7f1c5c0ffd70 2024-09-04T16:40:09.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.907+0000 7f1c527fc640 1 -- 172.21.15.170:0/1303863102 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c58035030 con 0x7f1c5c0ffd70 2024-09-04T16:40:09.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.907+0000 7f1c63581640 1 -- 172.21.15.170:0/1303863102 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c5c1a3e00 con 0x7f1c5c0ffd70 2024-09-04T16:40:09.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.908+0000 7f1c63581640 1 -- 172.21.15.170:0/1303863102 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c5c103090 con 0x7f1c5c0ffd70 2024-09-04T16:40:09.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.909+0000 7f1c527fc640 1 -- 172.21.15.170:0/1303863102 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f1c58042070 con 0x7f1c5c0ffd70 2024-09-04T16:40:09.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.909+0000 7f1c527fc640 1 --2- 172.21.15.170:0/1303863102 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1c48079e30 0x7f1c4807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:09.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.909+0000 7f1c527fc640 1 -- 172.21.15.170:0/1303863102 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f1c580bd520 con 0x7f1c5c0ffd70 2024-09-04T16:40:09.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.909+0000 7f1c60b1c640 1 --2- 172.21.15.170:0/1303863102 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1c48079e30 0x7f1c4807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:09.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.910+0000 7f1c60b1c640 1 --2- 172.21.15.170:0/1303863102 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1c48079e30 0x7f1c4807c2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c1029e0 tx=0x7f1c4c005d30 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:09.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:09.914+0000 7f1c527fc640 1 -- 172.21.15.170:0/1303863102 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1c58084f30 con 0x7f1c5c0ffd70 2024-09-04T16:40:10.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.103+0000 7f1c63581640 1 -- 172.21.15.170:0/1303863102 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1c5c0fcc40 con 0x7f1c48079e30 2024-09-04T16:40:10.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.104+0000 7f1c527fc640 1 -- 172.21.15.170:0/1303863102 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f1c5c0fcc40 con 0x7f1c48079e30 2024-09-04T16:40:10.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.107+0000 7f1c63581640 1 -- 172.21.15.170:0/1303863102 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1c48079e30 msgr2=0x7f1c4807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:10.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.107+0000 7f1c63581640 1 --2- 172.21.15.170:0/1303863102 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1c48079e30 0x7f1c4807c2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c1029e0 tx=0x7f1c4c005d30 comp rx=0 tx=0).stop 2024-09-04T16:40:10.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.107+0000 7f1c63581640 1 -- 172.21.15.170:0/1303863102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c5c0ffd70 msgr2=0x7f1c5c100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:10.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.107+0000 7f1c63581640 1 --2- 172.21.15.170:0/1303863102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c5c0ffd70 0x7f1c5c100f50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1c58031460 tx=0x7f1c580048f0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.107+0000 7f1c63581640 1 -- 172.21.15.170:0/1303863102 shutdown_connections 2024-09-04T16:40:10.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.107+0000 7f1c63581640 1 --2- 172.21.15.170:0/1303863102 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1c48079e30 0x7f1c4807c2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.107+0000 7f1c63581640 1 --2- 172.21.15.170:0/1303863102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1c5c106950 0x7f1c5c101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.107+0000 7f1c63581640 1 --2- 172.21.15.170:0/1303863102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c5c0ffd70 0x7f1c5c100f50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.107+0000 7f1c63581640 1 -- 172.21.15.170:0/1303863102 >> 172.21.15.170:0/1303863102 conn(0x7f1c5c0fbc60 msgr2=0x7f1c5c0fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:10.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.107+0000 7f1c63581640 1 -- 172.21.15.170:0/1303863102 shutdown_connections 2024-09-04T16:40:10.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.107+0000 7f1c63581640 1 -- 172.21.15.170:0/1303863102 wait complete. 2024-09-04T16:40:10.116 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:40:10.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.189+0000 7fa54f240640 1 -- 172.21.15.170:0/1233552512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa548103400 msgr2=0x7fa54810b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:10.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.189+0000 7fa54f240640 1 --2- 172.21.15.170:0/1233552512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa548103400 0x7fa54810b8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa534009880 tx=0x7fa53402a530 comp rx=0 tx=0).stop 2024-09-04T16:40:10.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.190+0000 7fa54f240640 1 -- 172.21.15.170:0/1233552512 shutdown_connections 2024-09-04T16:40:10.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.190+0000 7fa54f240640 1 --2- 172.21.15.170:0/1233552512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa548103400 0x7fa54810b8f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.190+0000 7fa54f240640 1 --2- 172.21.15.170:0/1233552512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa548102ae0 0x7fa548102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.190+0000 7fa54f240640 1 -- 172.21.15.170:0/1233552512 >> 172.21.15.170:0/1233552512 conn(0x7fa5480fc520 msgr2=0x7fa5480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:10.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.190+0000 7fa54f240640 1 -- 172.21.15.170:0/1233552512 shutdown_connections 2024-09-04T16:40:10.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.190+0000 7fa54f240640 1 -- 172.21.15.170:0/1233552512 wait complete. 2024-09-04T16:40:10.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.190+0000 7fa54f240640 1 Processor -- start 2024-09-04T16:40:10.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.190+0000 7fa54f240640 1 -- start start 2024-09-04T16:40:10.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.190+0000 7fa54f240640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa548102ae0 0x7fa548100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:10.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.190+0000 7fa54f240640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa548103400 0x7fa548100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:10.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.190+0000 7fa54f240640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa54810ee10 con 0x7fa548103400 2024-09-04T16:40:10.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.190+0000 7fa54f240640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa54810ec90 con 0x7fa548102ae0 2024-09-04T16:40:10.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.191+0000 7fa547fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa548103400 0x7fa548100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:10.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.191+0000 7fa547fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa548103400 0x7fa548100c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48344/0 (socket says 172.21.15.170:48344) 2024-09-04T16:40:10.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.191+0000 7fa547fff640 1 -- 172.21.15.170:0/1590470761 learned_addr learned my addr 172.21.15.170:0/1590470761 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:40:10.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.191+0000 7fa54cfdc640 1 --2- 172.21.15.170:0/1590470761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa548102ae0 0x7fa548100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:10.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.191+0000 7fa547fff640 1 -- 172.21.15.170:0/1590470761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa548102ae0 msgr2=0x7fa548100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:10.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.191+0000 7fa547fff640 1 --2- 172.21.15.170:0/1590470761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa548102ae0 0x7fa548100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.191+0000 7fa547fff640 1 -- 172.21.15.170:0/1590470761 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5481011c0 con 0x7fa548103400 2024-09-04T16:40:10.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.191+0000 7fa547fff640 1 --2- 172.21.15.170:0/1590470761 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa548103400 0x7fa548100c80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa534031460 tx=0x7fa5340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:10.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.191+0000 7fa545ffb640 1 -- 172.21.15.170:0/1590470761 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa53403f070 con 0x7fa548103400 2024-09-04T16:40:10.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.191+0000 7fa545ffb640 1 -- 172.21.15.170:0/1590470761 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa534004ac0 con 0x7fa548103400 2024-09-04T16:40:10.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.191+0000 7fa545ffb640 1 -- 172.21.15.170:0/1590470761 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa534035030 con 0x7fa548103400 2024-09-04T16:40:10.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.191+0000 7fa54f240640 1 -- 172.21.15.170:0/1590470761 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa548101450 con 0x7fa548103400 2024-09-04T16:40:10.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.192+0000 7fa54f240640 1 -- 172.21.15.170:0/1590470761 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5481a3de0 con 0x7fa548103400 2024-09-04T16:40:10.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.193+0000 7fa54f240640 1 -- 172.21.15.170:0/1590470761 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa54806abe0 con 0x7fa548103400 2024-09-04T16:40:10.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.193+0000 7fa545ffb640 1 -- 172.21.15.170:0/1590470761 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fa534042070 con 0x7fa548103400 2024-09-04T16:40:10.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.194+0000 7fa545ffb640 1 --2- 172.21.15.170:0/1590470761 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa538079e30 0x7fa53807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:10.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.194+0000 7fa545ffb640 1 -- 172.21.15.170:0/1590470761 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa5340bd4b0 con 0x7fa548103400 2024-09-04T16:40:10.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.194+0000 7fa54cfdc640 1 --2- 172.21.15.170:0/1590470761 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa538079e30 0x7fa53807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:10.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.194+0000 7fa54cfdc640 1 --2- 172.21.15.170:0/1590470761 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa538079e30 0x7fa53807c2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa53c005fd0 tx=0x7fa53c005e20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:10.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.198+0000 7fa545ffb640 1 -- 172.21.15.170:0/1590470761 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa534084ec0 con 0x7fa548103400 2024-09-04T16:40:10.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.392+0000 7fa54f240640 1 -- 172.21.15.170:0/1590470761 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa548062630 con 0x7fa538079e30 2024-09-04T16:40:10.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.394+0000 7fa545ffb640 1 -- 172.21.15.170:0/1590470761 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa548062630 con 0x7fa538079e30 2024-09-04T16:40:10.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.396+0000 7fa54f240640 1 -- 172.21.15.170:0/1590470761 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa538079e30 msgr2=0x7fa53807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:10.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.396+0000 7fa54f240640 1 --2- 172.21.15.170:0/1590470761 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa538079e30 0x7fa53807c2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa53c005fd0 tx=0x7fa53c005e20 comp rx=0 tx=0).stop 2024-09-04T16:40:10.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.396+0000 7fa54f240640 1 -- 172.21.15.170:0/1590470761 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa548103400 msgr2=0x7fa548100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:10.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.396+0000 7fa54f240640 1 --2- 172.21.15.170:0/1590470761 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa548103400 0x7fa548100c80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa534031460 tx=0x7fa5340046c0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.396+0000 7fa54f240640 1 -- 172.21.15.170:0/1590470761 shutdown_connections 2024-09-04T16:40:10.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.396+0000 7fa54f240640 1 --2- 172.21.15.170:0/1590470761 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa538079e30 0x7fa53807c2f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.396+0000 7fa54f240640 1 --2- 172.21.15.170:0/1590470761 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa548103400 0x7fa548100c80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.396+0000 7fa54f240640 1 --2- 172.21.15.170:0/1590470761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa548102ae0 0x7fa548100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.396+0000 7fa54f240640 1 -- 172.21.15.170:0/1590470761 >> 172.21.15.170:0/1590470761 conn(0x7fa5480fc520 msgr2=0x7fa548108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:10.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.396+0000 7fa54f240640 1 -- 172.21.15.170:0/1590470761 shutdown_connections 2024-09-04T16:40:10.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.396+0000 7fa54f240640 1 -- 172.21.15.170:0/1590470761 wait complete. 2024-09-04T16:40:10.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.478+0000 7f98fb08c640 1 -- 172.21.15.170:0/671924849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f4107930 msgr2=0x7f98f4107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:10.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.478+0000 7f98fb08c640 1 --2- 172.21.15.170:0/671924849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f4107930 0x7f98f4107d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009880 tx=0x7f98e802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.478+0000 7f98fb08c640 1 -- 172.21.15.170:0/671924849 shutdown_connections 2024-09-04T16:40:10.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.478+0000 7f98fb08c640 1 --2- 172.21.15.170:0/671924849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f98f4101930 0x7f98f4101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.478+0000 7f98fb08c640 1 --2- 172.21.15.170:0/671924849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f4107930 0x7f98f4107d10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.478+0000 7f98fb08c640 1 -- 172.21.15.170:0/671924849 >> 172.21.15.170:0/671924849 conn(0x7f98f40fd630 msgr2=0x7f98f40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:10.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.478+0000 7f98fb08c640 1 -- 172.21.15.170:0/671924849 shutdown_connections 2024-09-04T16:40:10.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.478+0000 7f98fb08c640 1 -- 172.21.15.170:0/671924849 wait complete. 2024-09-04T16:40:10.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.478+0000 7f98fb08c640 1 Processor -- start 2024-09-04T16:40:10.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.478+0000 7f98fb08c640 1 -- start start 2024-09-04T16:40:10.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.479+0000 7f98fb08c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f4101930 0x7f98f419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:10.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.479+0000 7f98fb08c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f98f4107930 0x7f98f419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:10.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.479+0000 7f98fb08c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f98f410ee00 con 0x7f98f4101930 2024-09-04T16:40:10.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.479+0000 7f98fb08c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f98f410ec80 con 0x7f98f4107930 2024-09-04T16:40:10.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.479+0000 7f98f8e28640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f4101930 0x7f98f419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:10.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.479+0000 7f98f8e28640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f4101930 0x7f98f419d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48362/0 (socket says 172.21.15.170:48362) 2024-09-04T16:40:10.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.479+0000 7f98f8e28640 1 -- 172.21.15.170:0/1043380965 learned_addr learned my addr 172.21.15.170:0/1043380965 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:40:10.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.479+0000 7f98f3fff640 1 --2- 172.21.15.170:0/1043380965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f98f4107930 0x7f98f419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:10.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.479+0000 7f98f8e28640 1 -- 172.21.15.170:0/1043380965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f98f4107930 msgr2=0x7f98f419dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:10.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.479+0000 7f98f8e28640 1 --2- 172.21.15.170:0/1043380965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f98f4107930 0x7f98f419dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.479+0000 7f98f8e28640 1 -- 172.21.15.170:0/1043380965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f41977f0 con 0x7f98f4101930 2024-09-04T16:40:10.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.479+0000 7f98f8e28640 1 --2- 172.21.15.170:0/1043380965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f4101930 0x7f98f419d670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f98e8031460 tx=0x7f98e80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:10.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.479+0000 7f98f1ffb640 1 -- 172.21.15.170:0/1043380965 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f98e803f070 con 0x7f98f4101930 2024-09-04T16:40:10.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.479+0000 7f98f1ffb640 1 -- 172.21.15.170:0/1043380965 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f98e80035f0 con 0x7f98f4101930 2024-09-04T16:40:10.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.479+0000 7f98fb08c640 1 -- 172.21.15.170:0/1043380965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f4197a80 con 0x7f98f4101930 2024-09-04T16:40:10.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.480+0000 7f98f1ffb640 1 -- 172.21.15.170:0/1043380965 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f98e8035030 con 0x7f98f4101930 2024-09-04T16:40:10.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.480+0000 7f98fb08c640 1 -- 172.21.15.170:0/1043380965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f4197fb0 con 0x7f98f4101930 2024-09-04T16:40:10.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.481+0000 7f98fb08c640 1 -- 172.21.15.170:0/1043380965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f4103070 con 0x7f98f4101930 2024-09-04T16:40:10.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.481+0000 7f98f1ffb640 1 -- 172.21.15.170:0/1043380965 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f98e8042070 con 0x7f98f4101930 2024-09-04T16:40:10.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.482+0000 7f98f1ffb640 1 --2- 172.21.15.170:0/1043380965 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f98e4079e30 0x7f98e407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:10.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.482+0000 7f98f1ffb640 1 -- 172.21.15.170:0/1043380965 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f98e80bd460 con 0x7f98f4101930 2024-09-04T16:40:10.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.482+0000 7f98f3fff640 1 --2- 172.21.15.170:0/1043380965 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f98e4079e30 0x7f98e407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:10.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.482+0000 7f98f3fff640 1 --2- 172.21.15.170:0/1043380965 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f98e4079e30 0x7f98e407c2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f98e0005fd0 tx=0x7f98e0005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:10.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.486+0000 7f98f1ffb640 1 -- 172.21.15.170:0/1043380965 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f98e8084e70 con 0x7f98f4101930 2024-09-04T16:40:10.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.675+0000 7f98fb08c640 1 -- 172.21.15.170:0/1043380965 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f98f4198260 con 0x7f98e4079e30 2024-09-04T16:40:10.676 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:10 smithi170 ceph-mon[113855]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:40:10.676 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:10 smithi170 ceph-mon[113855]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:40:10.676 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:10 smithi170 ceph-mon[113855]: pgmap v314: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:10.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.686+0000 7f98f1ffb640 1 -- 172.21.15.170:0/1043380965 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f98f4198260 con 0x7f98e4079e30 2024-09-04T16:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (7m) 84s ago 17m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (10m) 84s ago 18m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (9m) 57s ago 17m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (5m) 84s ago 18m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (5m) 57s ago 17m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (6m) 84s ago 17m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (89s) 84s ago 12m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (106s) 84s ago 12m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (60s) 57s ago 12m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (74s) 57s ago 12m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (9m) 84s ago 19m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (8m) 57s ago 17m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (5m) 84s ago 19m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (5m) 57s ago 17m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (8m) 84s ago 18m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (7m) 57s ago 17m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (4m) 84s ago 15m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (4m) 84s ago 15m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (3m) 84s ago 15m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (3m) 57s ago 14m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (2m) 57s ago 14m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:40:10.689 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (2m) 57s ago 13m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:40:10.689 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (7m) 84s ago 17m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:40:10.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.689+0000 7f98fb08c640 1 -- 172.21.15.170:0/1043380965 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f98e4079e30 msgr2=0x7f98e407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:10.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.689+0000 7f98fb08c640 1 --2- 172.21.15.170:0/1043380965 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f98e4079e30 0x7f98e407c2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f98e0005fd0 tx=0x7f98e0005850 comp rx=0 tx=0).stop 2024-09-04T16:40:10.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.689+0000 7f98fb08c640 1 -- 172.21.15.170:0/1043380965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f4101930 msgr2=0x7f98f419d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:10.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.689+0000 7f98fb08c640 1 --2- 172.21.15.170:0/1043380965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f4101930 0x7f98f419d670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f98e8031460 tx=0x7f98e80045e0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.689+0000 7f98fb08c640 1 -- 172.21.15.170:0/1043380965 shutdown_connections 2024-09-04T16:40:10.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.689+0000 7f98fb08c640 1 --2- 172.21.15.170:0/1043380965 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f98e4079e30 0x7f98e407c2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.689+0000 7f98fb08c640 1 --2- 172.21.15.170:0/1043380965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f98f4107930 0x7f98f419dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.689+0000 7f98fb08c640 1 --2- 172.21.15.170:0/1043380965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98f4101930 0x7f98f419d670 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.689+0000 7f98fb08c640 1 -- 172.21.15.170:0/1043380965 >> 172.21.15.170:0/1043380965 conn(0x7f98f40fd630 msgr2=0x7f98f40fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:10.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.689+0000 7f98fb08c640 1 -- 172.21.15.170:0/1043380965 shutdown_connections 2024-09-04T16:40:10.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.689+0000 7f98fb08c640 1 -- 172.21.15.170:0/1043380965 wait complete. 2024-09-04T16:40:10.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.768+0000 7f9154a92640 1 -- 172.21.15.170:0/2782473394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9150102aa0 msgr2=0x7f9150102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:10.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.768+0000 7f9154a92640 1 --2- 172.21.15.170:0/2782473394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9150102aa0 0x7f9150102e80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9148009c20 tx=0x7f914802aa00 comp rx=0 tx=0).stop 2024-09-04T16:40:10.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.769+0000 7f9154a92640 1 -- 172.21.15.170:0/2782473394 shutdown_connections 2024-09-04T16:40:10.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.769+0000 7f9154a92640 1 --2- 172.21.15.170:0/2782473394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91501033c0 0x7f915010b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.769+0000 7f9154a92640 1 --2- 172.21.15.170:0/2782473394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9150102aa0 0x7f9150102e80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.769+0000 7f9154a92640 1 -- 172.21.15.170:0/2782473394 >> 172.21.15.170:0/2782473394 conn(0x7f91500fc4c0 msgr2=0x7f91500fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:10.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.769+0000 7f9154a92640 1 -- 172.21.15.170:0/2782473394 shutdown_connections 2024-09-04T16:40:10.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.769+0000 7f9154a92640 1 -- 172.21.15.170:0/2782473394 wait complete. 2024-09-04T16:40:10.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.769+0000 7f9154a92640 1 Processor -- start 2024-09-04T16:40:10.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.769+0000 7f9154a92640 1 -- start start 2024-09-04T16:40:10.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.770+0000 7f9154a92640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9150102aa0 0x7f915019d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:10.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.770+0000 7f9154a92640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91501033c0 0x7f915019dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:10.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.770+0000 7f9154a92640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f915010ee30 con 0x7f91501033c0 2024-09-04T16:40:10.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.770+0000 7f9154a92640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f915010ecb0 con 0x7f9150102aa0 2024-09-04T16:40:10.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.770+0000 7f914dd9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91501033c0 0x7f915019dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:10.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.770+0000 7f914dd9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91501033c0 0x7f915019dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48376/0 (socket says 172.21.15.170:48376) 2024-09-04T16:40:10.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.770+0000 7f914dd9b640 1 -- 172.21.15.170:0/2802925223 learned_addr learned my addr 172.21.15.170:0/2802925223 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:40:10.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.770+0000 7f914e59c640 1 --2- 172.21.15.170:0/2802925223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9150102aa0 0x7f915019d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:10.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.770+0000 7f914dd9b640 1 -- 172.21.15.170:0/2802925223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9150102aa0 msgr2=0x7f915019d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:10.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.770+0000 7f914dd9b640 1 --2- 172.21.15.170:0/2802925223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9150102aa0 0x7f915019d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:10.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.770+0000 7f914dd9b640 1 -- 172.21.15.170:0/2802925223 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91501978c0 con 0x7f91501033c0 2024-09-04T16:40:10.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.770+0000 7f914dd9b640 1 --2- 172.21.15.170:0/2802925223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91501033c0 0x7f915019dc40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f913800b370 tx=0x7f913800b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:10.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.770+0000 7f91477fe640 1 -- 172.21.15.170:0/2802925223 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9138015020 con 0x7f91501033c0 2024-09-04T16:40:10.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.770+0000 7f91477fe640 1 -- 172.21.15.170:0/2802925223 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9138011af0 con 0x7f91501033c0 2024-09-04T16:40:10.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.770+0000 7f9154a92640 1 -- 172.21.15.170:0/2802925223 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9150197bb0 con 0x7f91501033c0 2024-09-04T16:40:10.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.770+0000 7f91477fe640 1 -- 172.21.15.170:0/2802925223 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9138010d60 con 0x7f91501033c0 2024-09-04T16:40:10.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.771+0000 7f9154a92640 1 -- 172.21.15.170:0/2802925223 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9150198140 con 0x7f91501033c0 2024-09-04T16:40:10.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.771+0000 7f9154a92640 1 -- 172.21.15.170:0/2802925223 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f915006a410 con 0x7f91501033c0 2024-09-04T16:40:10.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.772+0000 7f91477fe640 1 -- 172.21.15.170:0/2802925223 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f9138018020 con 0x7f91501033c0 2024-09-04T16:40:10.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.773+0000 7f91477fe640 1 --2- 172.21.15.170:0/2802925223 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f913c079e40 0x7f913c07c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:10.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.773+0000 7f914e59c640 1 --2- 172.21.15.170:0/2802925223 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f913c079e40 0x7f913c07c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:10.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.773+0000 7f91477fe640 1 -- 172.21.15.170:0/2802925223 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f913809c360 con 0x7f91501033c0 2024-09-04T16:40:10.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.773+0000 7f914e59c640 1 --2- 172.21.15.170:0/2802925223 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f913c079e40 0x7f913c07c300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9148009430 tx=0x7f914803a040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:10.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:10.777+0000 7f91477fe640 1 -- 172.21.15.170:0/2802925223 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f913801f020 con 0x7f91501033c0 2024-09-04T16:40:10.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:10 smithi193 ceph-mon[82547]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:40:10.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:10 smithi193 ceph-mon[82547]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:40:10.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:10 smithi193 ceph-mon[82547]: pgmap v314: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:11.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.024+0000 7f9154a92640 1 -- 172.21.15.170:0/2802925223 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9150198df0 con 0x7f91501033c0 2024-09-04T16:40:11.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.025+0000 7f91477fe640 1 -- 172.21.15.170:0/2802925223 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f9138063d70 con 0x7f91501033c0 2024-09-04T16:40:11.026 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:40:11.026 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:40:11.026 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:40:11.026 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:40:11.026 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:40:11.026 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:40:11.026 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:40:11.027 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:40:11.027 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:40:11.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:40:11.027 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:40:11.027 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:40:11.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:40:11.027 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:40:11.027 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:40:11.027 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:40:11.027 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:40:11.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.028+0000 7f9154a92640 1 -- 172.21.15.170:0/2802925223 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f913c079e40 msgr2=0x7f913c07c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:11.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.028+0000 7f9154a92640 1 --2- 172.21.15.170:0/2802925223 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f913c079e40 0x7f913c07c300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9148009430 tx=0x7f914803a040 comp rx=0 tx=0).stop 2024-09-04T16:40:11.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.028+0000 7f9154a92640 1 -- 172.21.15.170:0/2802925223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91501033c0 msgr2=0x7f915019dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:11.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.028+0000 7f9154a92640 1 --2- 172.21.15.170:0/2802925223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91501033c0 0x7f915019dc40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f913800b370 tx=0x7f913800b830 comp rx=0 tx=0).stop 2024-09-04T16:40:11.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.028+0000 7f9154a92640 1 -- 172.21.15.170:0/2802925223 shutdown_connections 2024-09-04T16:40:11.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.028+0000 7f9154a92640 1 --2- 172.21.15.170:0/2802925223 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f913c079e40 0x7f913c07c300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.028+0000 7f9154a92640 1 --2- 172.21.15.170:0/2802925223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91501033c0 0x7f915019dc40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.028+0000 7f9154a92640 1 --2- 172.21.15.170:0/2802925223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9150102aa0 0x7f915019d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.028+0000 7f9154a92640 1 -- 172.21.15.170:0/2802925223 >> 172.21.15.170:0/2802925223 conn(0x7f91500fc4c0 msgr2=0x7f9150108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:11.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.028+0000 7f9154a92640 1 -- 172.21.15.170:0/2802925223 shutdown_connections 2024-09-04T16:40:11.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.028+0000 7f9154a92640 1 -- 172.21.15.170:0/2802925223 wait complete. 2024-09-04T16:40:11.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.111+0000 7fe307d04640 1 -- 172.21.15.170:0/2099837063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3001008d0 msgr2=0x7fe300100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:11.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.111+0000 7fe307d04640 1 --2- 172.21.15.170:0/2099837063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3001008d0 0x7fe300100cb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009880 tx=0x7fe2f802a530 comp rx=0 tx=0).stop 2024-09-04T16:40:11.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.111+0000 7fe307d04640 1 -- 172.21.15.170:0/2099837063 shutdown_connections 2024-09-04T16:40:11.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.111+0000 7fe307d04640 1 --2- 172.21.15.170:0/2099837063 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3001011f0 0x7fe3001056c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.111+0000 7fe307d04640 1 --2- 172.21.15.170:0/2099837063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3001008d0 0x7fe300100cb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.111+0000 7fe307d04640 1 -- 172.21.15.170:0/2099837063 >> 172.21.15.170:0/2099837063 conn(0x7fe3000fc520 msgr2=0x7fe3000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:11.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.111+0000 7fe307d04640 1 -- 172.21.15.170:0/2099837063 shutdown_connections 2024-09-04T16:40:11.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.111+0000 7fe307d04640 1 -- 172.21.15.170:0/2099837063 wait complete. 2024-09-04T16:40:11.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.112+0000 7fe307d04640 1 Processor -- start 2024-09-04T16:40:11.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.112+0000 7fe307d04640 1 -- start start 2024-09-04T16:40:11.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.112+0000 7fe307d04640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3001008d0 0x7fe30019e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:11.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.112+0000 7fe307d04640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3001011f0 0x7fe30019e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:11.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.112+0000 7fe307d04640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe300115410 con 0x7fe3001008d0 2024-09-04T16:40:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.112+0000 7fe307d04640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe300115290 con 0x7fe3001011f0 2024-09-04T16:40:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.112+0000 7fe305aa0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3001008d0 0x7fe30019e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.112+0000 7fe305aa0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3001008d0 0x7fe30019e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48398/0 (socket says 172.21.15.170:48398) 2024-09-04T16:40:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.112+0000 7fe305aa0640 1 -- 172.21.15.170:0/4271632883 learned_addr learned my addr 172.21.15.170:0/4271632883 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:40:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.112+0000 7fe30529f640 1 --2- 172.21.15.170:0/4271632883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3001011f0 0x7fe30019e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.112+0000 7fe305aa0640 1 -- 172.21.15.170:0/4271632883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3001011f0 msgr2=0x7fe30019e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.112+0000 7fe305aa0640 1 --2- 172.21.15.170:0/4271632883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3001011f0 0x7fe30019e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.112+0000 7fe305aa0640 1 -- 172.21.15.170:0/4271632883 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3001a29c0 con 0x7fe3001008d0 2024-09-04T16:40:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.113+0000 7fe305aa0640 1 --2- 172.21.15.170:0/4271632883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3001008d0 0x7fe30019e0f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8031460 tx=0x7fe2f80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.113+0000 7fe2feffd640 1 -- 172.21.15.170:0/4271632883 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2f803f070 con 0x7fe3001008d0 2024-09-04T16:40:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.113+0000 7fe2feffd640 1 -- 172.21.15.170:0/4271632883 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe2f8004cf0 con 0x7fe3001008d0 2024-09-04T16:40:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.113+0000 7fe307d04640 1 -- 172.21.15.170:0/4271632883 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3001a2c50 con 0x7fe3001008d0 2024-09-04T16:40:11.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.113+0000 7fe2feffd640 1 -- 172.21.15.170:0/4271632883 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2f8035030 con 0x7fe3001008d0 2024-09-04T16:40:11.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.113+0000 7fe307d04640 1 -- 172.21.15.170:0/4271632883 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3001a3180 con 0x7fe3001008d0 2024-09-04T16:40:11.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.114+0000 7fe307d04640 1 -- 172.21.15.170:0/4271632883 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30006abe0 con 0x7fe3001008d0 2024-09-04T16:40:11.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.115+0000 7fe2feffd640 1 -- 172.21.15.170:0/4271632883 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fe2f8042070 con 0x7fe3001008d0 2024-09-04T16:40:11.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.115+0000 7fe2feffd640 1 --2- 172.21.15.170:0/4271632883 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe2e8079e80 0x7fe2e807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:11.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.115+0000 7fe30529f640 1 --2- 172.21.15.170:0/4271632883 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe2e8079e80 0x7fe2e807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:11.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.115+0000 7fe2feffd640 1 -- 172.21.15.170:0/4271632883 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe2f80bd4b0 con 0x7fe3001008d0 2024-09-04T16:40:11.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.116+0000 7fe30529f640 1 --2- 172.21.15.170:0/4271632883 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe2e8079e80 0x7fe2e807c340 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe3000feec0 tx=0x7fe2f4005ec0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:11.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.120+0000 7fe2feffd640 1 -- 172.21.15.170:0/4271632883 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe2f8084f40 con 0x7fe3001008d0 2024-09-04T16:40:11.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.331+0000 7fe307d04640 1 -- 172.21.15.170:0/4271632883 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe30019f450 con 0x7fe3001008d0 2024-09-04T16:40:11.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.332+0000 7fe2feffd640 1 -- 172.21.15.170:0/4271632883 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7fe2f808d3f0 con 0x7fe3001008d0 2024-09-04T16:40:11.333 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:40:11.333 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:40:11.333 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:40:11.334 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:40:11.334 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:40:11.334 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:40:11.334 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:40:11.334 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:40:11.334 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:40:11.334 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:40:11.334 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:40:11.334 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:40:11.334 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:40:11.334 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:40:11.334 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:40:11.334 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:40:11.335 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:40:11.335 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:40:11.335 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:40:11.335 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:40:11.335 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:40:11.335 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:40:11.335 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:40:11.335 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:40:11.335 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:40:11.335 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:40:11.335 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:40:11.335 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:40:11.335 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:40:11.335 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:40:11.336 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:40:11.336 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:40:11.336 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:40:11.336 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:40:11.336 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:40:11.336 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:40:11.336 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:40:11.336 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:40:11.336 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:40:11.336 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:40:11.336 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:40:11.336 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:40:11.336 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:40:11.337 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:40:11.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.334+0000 7fe307d04640 1 -- 172.21.15.170:0/4271632883 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe2e8079e80 msgr2=0x7fe2e807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:11.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.334+0000 7fe307d04640 1 --2- 172.21.15.170:0/4271632883 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe2e8079e80 0x7fe2e807c340 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe3000feec0 tx=0x7fe2f4005ec0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.334+0000 7fe307d04640 1 -- 172.21.15.170:0/4271632883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3001008d0 msgr2=0x7fe30019e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:11.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.334+0000 7fe307d04640 1 --2- 172.21.15.170:0/4271632883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3001008d0 0x7fe30019e0f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8031460 tx=0x7fe2f80048f0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.334+0000 7fe307d04640 1 -- 172.21.15.170:0/4271632883 shutdown_connections 2024-09-04T16:40:11.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.334+0000 7fe307d04640 1 --2- 172.21.15.170:0/4271632883 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe2e8079e80 0x7fe2e807c340 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.334+0000 7fe307d04640 1 --2- 172.21.15.170:0/4271632883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3001011f0 0x7fe30019e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.334+0000 7fe307d04640 1 --2- 172.21.15.170:0/4271632883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3001008d0 0x7fe30019e0f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.334+0000 7fe307d04640 1 -- 172.21.15.170:0/4271632883 >> 172.21.15.170:0/4271632883 conn(0x7fe3000fc520 msgr2=0x7fe300112bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:11.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.334+0000 7fe307d04640 1 -- 172.21.15.170:0/4271632883 shutdown_connections 2024-09-04T16:40:11.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.334+0000 7fe307d04640 1 -- 172.21.15.170:0/4271632883 wait complete. 2024-09-04T16:40:11.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.416+0000 7fc42b36e640 1 -- 172.21.15.170:0/3677412493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc424102ae0 msgr2=0x7fc424102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:11.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.416+0000 7fc42b36e640 1 --2- 172.21.15.170:0/3677412493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc424102ae0 0x7fc424102ec0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc414009880 tx=0x7fc41402a530 comp rx=0 tx=0).stop 2024-09-04T16:40:11.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.416+0000 7fc42b36e640 1 -- 172.21.15.170:0/3677412493 shutdown_connections 2024-09-04T16:40:11.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.416+0000 7fc42b36e640 1 --2- 172.21.15.170:0/3677412493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc424103400 0x7fc42410b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.416+0000 7fc42b36e640 1 --2- 172.21.15.170:0/3677412493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc424102ae0 0x7fc424102ec0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.416+0000 7fc42b36e640 1 -- 172.21.15.170:0/3677412493 >> 172.21.15.170:0/3677412493 conn(0x7fc4240fc520 msgr2=0x7fc4240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:11.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.416+0000 7fc42b36e640 1 -- 172.21.15.170:0/3677412493 shutdown_connections 2024-09-04T16:40:11.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.416+0000 7fc42b36e640 1 -- 172.21.15.170:0/3677412493 wait complete. 2024-09-04T16:40:11.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.417+0000 7fc42b36e640 1 Processor -- start 2024-09-04T16:40:11.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.417+0000 7fc42b36e640 1 -- start start 2024-09-04T16:40:11.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.417+0000 7fc42b36e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc424102ae0 0x7fc42419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:11.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.417+0000 7fc42b36e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc424103400 0x7fc42419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:11.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.417+0000 7fc42b36e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc42410edf0 con 0x7fc424103400 2024-09-04T16:40:11.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.417+0000 7fc42b36e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc42410ec70 con 0x7fc424102ae0 2024-09-04T16:40:11.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.417+0000 7fc428909640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc424103400 0x7fc42419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:11.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.417+0000 7fc428909640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc424103400 0x7fc42419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48408/0 (socket says 172.21.15.170:48408) 2024-09-04T16:40:11.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.417+0000 7fc428909640 1 -- 172.21.15.170:0/1229354504 learned_addr learned my addr 172.21.15.170:0/1229354504 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:40:11.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.418+0000 7fc42910a640 1 --2- 172.21.15.170:0/1229354504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc424102ae0 0x7fc42419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:11.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.418+0000 7fc428909640 1 -- 172.21.15.170:0/1229354504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc424102ae0 msgr2=0x7fc42419d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:11.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.418+0000 7fc428909640 1 --2- 172.21.15.170:0/1229354504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc424102ae0 0x7fc42419d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.418+0000 7fc428909640 1 -- 172.21.15.170:0/1229354504 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4241977e0 con 0x7fc424103400 2024-09-04T16:40:11.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.418+0000 7fc428909640 1 --2- 172.21.15.170:0/1229354504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc424103400 0x7fc42419dba0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc42000d6c0 tx=0x7fc42000db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:11.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.418+0000 7fc41a7fc640 1 -- 172.21.15.170:0/1229354504 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc420017070 con 0x7fc424103400 2024-09-04T16:40:11.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.418+0000 7fc41a7fc640 1 -- 172.21.15.170:0/1229354504 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc420009ce0 con 0x7fc424103400 2024-09-04T16:40:11.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.418+0000 7fc42b36e640 1 -- 172.21.15.170:0/1229354504 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc424197ad0 con 0x7fc424103400 2024-09-04T16:40:11.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.418+0000 7fc41a7fc640 1 -- 172.21.15.170:0/1229354504 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc42000f3c0 con 0x7fc424103400 2024-09-04T16:40:11.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.418+0000 7fc42b36e640 1 -- 172.21.15.170:0/1229354504 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc424198060 con 0x7fc424103400 2024-09-04T16:40:11.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.419+0000 7fc42b36e640 1 -- 172.21.15.170:0/1229354504 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc42406abe0 con 0x7fc424103400 2024-09-04T16:40:11.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.419+0000 7fc41a7fc640 1 -- 172.21.15.170:0/1229354504 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fc420010460 con 0x7fc424103400 2024-09-04T16:40:11.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.420+0000 7fc41a7fc640 1 --2- 172.21.15.170:0/1229354504 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc410079e80 0x7fc41007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:11.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.420+0000 7fc41a7fc640 1 -- 172.21.15.170:0/1229354504 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc42009c7b0 con 0x7fc424103400 2024-09-04T16:40:11.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.420+0000 7fc42910a640 1 --2- 172.21.15.170:0/1229354504 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc410079e80 0x7fc41007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:11.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.421+0000 7fc42910a640 1 --2- 172.21.15.170:0/1229354504 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc410079e80 0x7fc41007c340 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc4140096c0 tx=0x7fc414031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:11.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.424+0000 7fc41a7fc640 1 -- 172.21.15.170:0/1229354504 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc420064240 con 0x7fc424103400 2024-09-04T16:40:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:11 smithi170 ceph-mon[113855]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:40:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:11 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2802925223' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:40:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:11 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/4271632883' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:40:11.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.616+0000 7fc42b36e640 1 -- 172.21.15.170:0/1229354504 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc424198310 con 0x7fc410079e80 2024-09-04T16:40:11.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.617+0000 7fc41a7fc640 1 -- 172.21.15.170:0/1229354504 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc424198310 con 0x7fc410079e80 2024-09-04T16:40:11.618 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:40:11.618 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:40:11.618 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:40:11.618 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:40:11.618 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:40:11.619 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:40:11.619 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:40:11.619 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:40:11.619 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:40:11.619 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:40:11.619 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:40:11.619 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:40:11.619 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:40:11.619 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:40:11.619 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:40:11.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.619+0000 7fc42b36e640 1 -- 172.21.15.170:0/1229354504 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc410079e80 msgr2=0x7fc41007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:11.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.619+0000 7fc42b36e640 1 --2- 172.21.15.170:0/1229354504 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc410079e80 0x7fc41007c340 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc4140096c0 tx=0x7fc414031400 comp rx=0 tx=0).stop 2024-09-04T16:40:11.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.619+0000 7fc42b36e640 1 -- 172.21.15.170:0/1229354504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc424103400 msgr2=0x7fc42419dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:11.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.619+0000 7fc42b36e640 1 --2- 172.21.15.170:0/1229354504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc424103400 0x7fc42419dba0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc42000d6c0 tx=0x7fc42000db80 comp rx=0 tx=0).stop 2024-09-04T16:40:11.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.619+0000 7fc42b36e640 1 -- 172.21.15.170:0/1229354504 shutdown_connections 2024-09-04T16:40:11.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.619+0000 7fc42b36e640 1 --2- 172.21.15.170:0/1229354504 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc410079e80 0x7fc41007c340 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.619+0000 7fc42b36e640 1 --2- 172.21.15.170:0/1229354504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc424103400 0x7fc42419dba0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.619+0000 7fc42b36e640 1 --2- 172.21.15.170:0/1229354504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc424102ae0 0x7fc42419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.619+0000 7fc42b36e640 1 -- 172.21.15.170:0/1229354504 >> 172.21.15.170:0/1229354504 conn(0x7fc4240fc520 msgr2=0x7fc424108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:11.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.620+0000 7fc42b36e640 1 -- 172.21.15.170:0/1229354504 shutdown_connections 2024-09-04T16:40:11.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.620+0000 7fc42b36e640 1 -- 172.21.15.170:0/1229354504 wait complete. 2024-09-04T16:40:11.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.700+0000 7ffaa81b2640 1 -- 172.21.15.170:0/532618333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffaa0107910 msgr2=0x7ffaa0107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:11.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.700+0000 7ffaa81b2640 1 --2- 172.21.15.170:0/532618333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffaa0107910 0x7ffaa0107cf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009880 tx=0x7ffa9c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.701+0000 7ffaa81b2640 1 -- 172.21.15.170:0/532618333 shutdown_connections 2024-09-04T16:40:11.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.701+0000 7ffaa81b2640 1 --2- 172.21.15.170:0/532618333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa0101910 0x7ffaa0101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.701+0000 7ffaa81b2640 1 --2- 172.21.15.170:0/532618333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffaa0107910 0x7ffaa0107cf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.701+0000 7ffaa81b2640 1 -- 172.21.15.170:0/532618333 >> 172.21.15.170:0/532618333 conn(0x7ffaa00fd5f0 msgr2=0x7ffaa00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:11.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.701+0000 7ffaa81b2640 1 -- 172.21.15.170:0/532618333 shutdown_connections 2024-09-04T16:40:11.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.701+0000 7ffaa81b2640 1 -- 172.21.15.170:0/532618333 wait complete. 2024-09-04T16:40:11.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.701+0000 7ffaa81b2640 1 Processor -- start 2024-09-04T16:40:11.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.701+0000 7ffaa81b2640 1 -- start start 2024-09-04T16:40:11.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.701+0000 7ffaa81b2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa0101910 0x7ffaa019f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:11.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.701+0000 7ffaa81b2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffaa0107910 0x7ffaa019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:11.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.702+0000 7ffaa81b2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa010edc0 con 0x7ffaa0107910 2024-09-04T16:40:11.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.702+0000 7ffaa81b2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa010ec40 con 0x7ffaa0101910 2024-09-04T16:40:11.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.702+0000 7ffaa574d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffaa0107910 0x7ffaa019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:11.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.702+0000 7ffaa574d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffaa0107910 0x7ffaa019fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48434/0 (socket says 172.21.15.170:48434) 2024-09-04T16:40:11.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.702+0000 7ffaa574d640 1 -- 172.21.15.170:0/3392625946 learned_addr learned my addr 172.21.15.170:0/3392625946 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:40:11.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.702+0000 7ffaa5f4e640 1 --2- 172.21.15.170:0/3392625946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa0101910 0x7ffaa019f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:11.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.702+0000 7ffaa574d640 1 -- 172.21.15.170:0/3392625946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa0101910 msgr2=0x7ffaa019f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:11.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.702+0000 7ffaa574d640 1 --2- 172.21.15.170:0/3392625946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa0101910 0x7ffaa019f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.702+0000 7ffaa574d640 1 -- 172.21.15.170:0/3392625946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa0199a00 con 0x7ffaa0107910 2024-09-04T16:40:11.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.702+0000 7ffaa574d640 1 --2- 172.21.15.170:0/3392625946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffaa0107910 0x7ffaa019fd80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000d8d0 tx=0x7ffa9000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:11.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.702+0000 7ffa96ffd640 1 -- 172.21.15.170:0/3392625946 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa90017070 con 0x7ffaa0107910 2024-09-04T16:40:11.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.702+0000 7ffa96ffd640 1 -- 172.21.15.170:0/3392625946 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa90010460 con 0x7ffaa0107910 2024-09-04T16:40:11.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.702+0000 7ffaa81b2640 1 -- 172.21.15.170:0/3392625946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa0199cf0 con 0x7ffaa0107910 2024-09-04T16:40:11.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.702+0000 7ffa96ffd640 1 -- 172.21.15.170:0/3392625946 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa9000f5f0 con 0x7ffaa0107910 2024-09-04T16:40:11.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.702+0000 7ffaa81b2640 1 -- 172.21.15.170:0/3392625946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa019a280 con 0x7ffaa0107910 2024-09-04T16:40:11.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.703+0000 7ffaa81b2640 1 -- 172.21.15.170:0/3392625946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa0103050 con 0x7ffaa0107910 2024-09-04T16:40:11.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.704+0000 7ffa96ffd640 1 -- 172.21.15.170:0/3392625946 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ffa90009a30 con 0x7ffaa0107910 2024-09-04T16:40:11.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.704+0000 7ffa96ffd640 1 --2- 172.21.15.170:0/3392625946 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffa8c079e30 0x7ffa8c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:11.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.705+0000 7ffaa5f4e640 1 --2- 172.21.15.170:0/3392625946 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffa8c079e30 0x7ffa8c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:11.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.705+0000 7ffa96ffd640 1 -- 172.21.15.170:0/3392625946 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ffa9009c8e0 con 0x7ffaa0107910 2024-09-04T16:40:11.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.705+0000 7ffaa5f4e640 1 --2- 172.21.15.170:0/3392625946 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffa8c079e30 0x7ffa8c07c2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c000c00 tx=0x7ffa9c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:11.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.709+0000 7ffa96ffd640 1 -- 172.21.15.170:0/3392625946 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ffa90068460 con 0x7ffaa0107910 2024-09-04T16:40:11.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:11 smithi193 ceph-mon[82547]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:40:11.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:11 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2802925223' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:40:11.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:11 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/4271632883' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:40:11.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.951+0000 7ffaa81b2640 1 -- 172.21.15.170:0/3392625946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ffaa019af90 con 0x7ffaa0107910 2024-09-04T16:40:11.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.951+0000 7ffa96ffd640 1 -- 172.21.15.170:0/3392625946 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7ffa9006ce80 con 0x7ffaa0107910 2024-09-04T16:40:11.952 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:40:11.952 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:40:11.952 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:40:11.952 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:40:11.952 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:40:11.953 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:40:11.953 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:40:11.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.953+0000 7ffaa81b2640 1 -- 172.21.15.170:0/3392625946 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffa8c079e30 msgr2=0x7ffa8c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:11.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.953+0000 7ffaa81b2640 1 --2- 172.21.15.170:0/3392625946 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffa8c079e30 0x7ffa8c07c2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c000c00 tx=0x7ffa9c031400 comp rx=0 tx=0).stop 2024-09-04T16:40:11.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.953+0000 7ffaa81b2640 1 -- 172.21.15.170:0/3392625946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffaa0107910 msgr2=0x7ffaa019fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:11.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.953+0000 7ffaa81b2640 1 --2- 172.21.15.170:0/3392625946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffaa0107910 0x7ffaa019fd80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000d8d0 tx=0x7ffa9000dd90 comp rx=0 tx=0).stop 2024-09-04T16:40:11.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.954+0000 7ffaa81b2640 1 -- 172.21.15.170:0/3392625946 shutdown_connections 2024-09-04T16:40:11.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.954+0000 7ffaa81b2640 1 --2- 172.21.15.170:0/3392625946 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ffa8c079e30 0x7ffa8c07c2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.954+0000 7ffaa81b2640 1 --2- 172.21.15.170:0/3392625946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffaa0107910 0x7ffaa019fd80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.954+0000 7ffaa81b2640 1 --2- 172.21.15.170:0/3392625946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa0101910 0x7ffaa019f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:11.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.954+0000 7ffaa81b2640 1 -- 172.21.15.170:0/3392625946 >> 172.21.15.170:0/3392625946 conn(0x7ffaa00fd5f0 msgr2=0x7ffaa0074870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:11.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.954+0000 7ffaa81b2640 1 -- 172.21.15.170:0/3392625946 shutdown_connections 2024-09-04T16:40:11.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:11.954+0000 7ffaa81b2640 1 -- 172.21.15.170:0/3392625946 wait complete. 2024-09-04T16:40:12.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:12 smithi170 ceph-mon[113855]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:40:12.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:12 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3392625946' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:40:12.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:12 smithi170 ceph-mon[113855]: pgmap v315: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:12.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:12 smithi193 ceph-mon[82547]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:40:12.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:12 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3392625946' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:40:12.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:12 smithi193 ceph-mon[82547]: pgmap v315: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:40:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:40:15.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:15 smithi170 ceph-mon[113855]: pgmap v316: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:15 smithi193 ceph-mon[82547]: pgmap v316: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:16 smithi193 ceph-mon[82547]: pgmap v317: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:16.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:16 smithi170 ceph-mon[113855]: pgmap v317: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:18.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:18 smithi170 ceph-mon[113855]: pgmap v318: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:18.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:18 smithi193 ceph-mon[82547]: pgmap v318: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:20.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:20 smithi170 ceph-mon[113855]: pgmap v319: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:20.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:20 smithi193 ceph-mon[82547]: pgmap v319: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:22.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:22 smithi170 ceph-mon[113855]: pgmap v320: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:22 smithi193 ceph-mon[82547]: pgmap v320: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:24.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:24 smithi170 ceph-mon[113855]: pgmap v321: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:24 smithi193 ceph-mon[82547]: pgmap v321: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:26.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:26 smithi170 ceph-mon[113855]: pgmap v322: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:26.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:26 smithi193 ceph-mon[82547]: pgmap v322: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:28.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:28 smithi170 ceph-mon[113855]: pgmap v323: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:28.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:28 smithi193 ceph-mon[82547]: pgmap v323: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:29.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:40:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:40:30.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:30 smithi170 ceph-mon[113855]: pgmap v324: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:30.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:30 smithi193 ceph-mon[82547]: pgmap v324: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:32.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:32 smithi170 ceph-mon[113855]: pgmap v325: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:32.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:32 smithi193 ceph-mon[82547]: pgmap v325: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:34.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:34 smithi170 ceph-mon[113855]: pgmap v326: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:34.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:34 smithi193 ceph-mon[82547]: pgmap v326: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:36.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:36 smithi170 ceph-mon[113855]: pgmap v327: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:36 smithi193 ceph-mon[82547]: pgmap v327: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:38.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:38 smithi170 ceph-mon[113855]: pgmap v328: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:38 smithi193 ceph-mon[82547]: pgmap v328: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:40.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:40 smithi170 ceph-mon[113855]: pgmap v329: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:40.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:40 smithi193 ceph-mon[82547]: pgmap v329: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:42.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.048+0000 7f8e978a3640 1 -- 172.21.15.170:0/281958455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e90102ae0 msgr2=0x7f8e90102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:42.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.048+0000 7f8e978a3640 1 --2- 172.21.15.170:0/281958455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e90102ae0 0x7f8e90102ec0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009880 tx=0x7f8e8402a530 comp rx=0 tx=0).stop 2024-09-04T16:40:42.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.048+0000 7f8e978a3640 1 -- 172.21.15.170:0/281958455 shutdown_connections 2024-09-04T16:40:42.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.048+0000 7f8e978a3640 1 --2- 172.21.15.170:0/281958455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e90103400 0x7f8e9010b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.048+0000 7f8e978a3640 1 --2- 172.21.15.170:0/281958455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e90102ae0 0x7f8e90102ec0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.048+0000 7f8e978a3640 1 -- 172.21.15.170:0/281958455 >> 172.21.15.170:0/281958455 conn(0x7f8e900fc520 msgr2=0x7f8e900fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:42.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.048+0000 7f8e978a3640 1 -- 172.21.15.170:0/281958455 shutdown_connections 2024-09-04T16:40:42.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.048+0000 7f8e978a3640 1 -- 172.21.15.170:0/281958455 wait complete. 2024-09-04T16:40:42.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.049+0000 7f8e978a3640 1 Processor -- start 2024-09-04T16:40:42.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.049+0000 7f8e978a3640 1 -- start start 2024-09-04T16:40:42.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.049+0000 7f8e978a3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e90102ae0 0x7f8e9019f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:42.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.049+0000 7f8e978a3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e90103400 0x7f8e9019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:42.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.049+0000 7f8e978a3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9010ee10 con 0x7f8e90103400 2024-09-04T16:40:42.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.049+0000 7f8e978a3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9010ec90 con 0x7f8e90102ae0 2024-09-04T16:40:42.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.049+0000 7f8e94e3e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e90103400 0x7f8e9019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:42.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.050+0000 7f8e94e3e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e90103400 0x7f8e9019fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51420/0 (socket says 172.21.15.170:51420) 2024-09-04T16:40:42.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.050+0000 7f8e94e3e640 1 -- 172.21.15.170:0/3607419388 learned_addr learned my addr 172.21.15.170:0/3607419388 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:40:42.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.050+0000 7f8e9563f640 1 --2- 172.21.15.170:0/3607419388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e90102ae0 0x7f8e9019f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:42.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.050+0000 7f8e94e3e640 1 -- 172.21.15.170:0/3607419388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e90102ae0 msgr2=0x7f8e9019f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:42.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.050+0000 7f8e94e3e640 1 --2- 172.21.15.170:0/3607419388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e90102ae0 0x7f8e9019f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.050+0000 7f8e94e3e640 1 -- 172.21.15.170:0/3607419388 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e90199a30 con 0x7f8e90103400 2024-09-04T16:40:42.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.050+0000 7f8e94e3e640 1 --2- 172.21.15.170:0/3607419388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e90103400 0x7f8e9019fd60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c00d6d0 tx=0x7f8e8c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:42.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.050+0000 7f8e827fc640 1 -- 172.21.15.170:0/3607419388 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e8c017070 con 0x7f8e90103400 2024-09-04T16:40:42.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.050+0000 7f8e827fc640 1 -- 172.21.15.170:0/3607419388 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e8c0054e0 con 0x7f8e90103400 2024-09-04T16:40:42.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.050+0000 7f8e978a3640 1 -- 172.21.15.170:0/3607419388 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e90199d20 con 0x7f8e90103400 2024-09-04T16:40:42.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.050+0000 7f8e827fc640 1 -- 172.21.15.170:0/3607419388 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e8c004ae0 con 0x7f8e90103400 2024-09-04T16:40:42.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.050+0000 7f8e978a3640 1 -- 172.21.15.170:0/3607419388 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e9019a2b0 con 0x7f8e90103400 2024-09-04T16:40:42.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.051+0000 7f8e978a3640 1 -- 172.21.15.170:0/3607419388 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e9006abe0 con 0x7f8e90103400 2024-09-04T16:40:42.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.052+0000 7f8e827fc640 1 -- 172.21.15.170:0/3607419388 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f8e8c004d90 con 0x7f8e90103400 2024-09-04T16:40:42.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.052+0000 7f8e827fc640 1 --2- 172.21.15.170:0/3607419388 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8e7c079e80 0x7f8e7c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:42.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.053+0000 7f8e827fc640 1 -- 172.21.15.170:0/3607419388 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8e8c09c260 con 0x7f8e90103400 2024-09-04T16:40:42.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.053+0000 7f8e9563f640 1 --2- 172.21.15.170:0/3607419388 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8e7c079e80 0x7f8e7c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:42.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.053+0000 7f8e9563f640 1 --2- 172.21.15.170:0/3607419388 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8e7c079e80 0x7f8e7c07c340 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8e84000c00 tx=0x7f8e84031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:42.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.057+0000 7f8e827fc640 1 -- 172.21.15.170:0/3607419388 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8e8c063d90 con 0x7f8e90103400 2024-09-04T16:40:42.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.250+0000 7f8e978a3640 1 -- 172.21.15.170:0/3607419388 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8e9019af10 con 0x7f8e7c079e80 2024-09-04T16:40:42.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.251+0000 7f8e827fc640 1 -- 172.21.15.170:0/3607419388 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8e9019af10 con 0x7f8e7c079e80 2024-09-04T16:40:42.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.254+0000 7f8e978a3640 1 -- 172.21.15.170:0/3607419388 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8e7c079e80 msgr2=0x7f8e7c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:42.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.254+0000 7f8e978a3640 1 --2- 172.21.15.170:0/3607419388 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8e7c079e80 0x7f8e7c07c340 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8e84000c00 tx=0x7f8e84031400 comp rx=0 tx=0).stop 2024-09-04T16:40:42.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.254+0000 7f8e978a3640 1 -- 172.21.15.170:0/3607419388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e90103400 msgr2=0x7f8e9019fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:42.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.254+0000 7f8e978a3640 1 --2- 172.21.15.170:0/3607419388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e90103400 0x7f8e9019fd60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c00d6d0 tx=0x7f8e8c00db90 comp rx=0 tx=0).stop 2024-09-04T16:40:42.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.254+0000 7f8e978a3640 1 -- 172.21.15.170:0/3607419388 shutdown_connections 2024-09-04T16:40:42.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.254+0000 7f8e978a3640 1 --2- 172.21.15.170:0/3607419388 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8e7c079e80 0x7f8e7c07c340 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.254+0000 7f8e978a3640 1 --2- 172.21.15.170:0/3607419388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e90103400 0x7f8e9019fd60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.254+0000 7f8e978a3640 1 --2- 172.21.15.170:0/3607419388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e90102ae0 0x7f8e9019f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.254+0000 7f8e978a3640 1 -- 172.21.15.170:0/3607419388 >> 172.21.15.170:0/3607419388 conn(0x7f8e900fc520 msgr2=0x7f8e90100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:42.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.254+0000 7f8e978a3640 1 -- 172.21.15.170:0/3607419388 shutdown_connections 2024-09-04T16:40:42.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.254+0000 7f8e978a3640 1 -- 172.21.15.170:0/3607419388 wait complete. 2024-09-04T16:40:42.264 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:40:42.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.337+0000 7f31b9289640 1 -- 172.21.15.170:0/1203527006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b4106810 msgr2=0x7f31b4106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:42.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.337+0000 7f31b9289640 1 --2- 172.21.15.170:0/1203527006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b4106810 0x7f31b4106bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f31a4009880 tx=0x7f31a402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.337+0000 7f31b9289640 1 -- 172.21.15.170:0/1203527006 shutdown_connections 2024-09-04T16:40:42.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.337+0000 7f31b9289640 1 --2- 172.21.15.170:0/1203527006 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31b4100810 0x7f31b4100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.337+0000 7f31b9289640 1 --2- 172.21.15.170:0/1203527006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b4106810 0x7f31b4106bf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.337+0000 7f31b9289640 1 -- 172.21.15.170:0/1203527006 >> 172.21.15.170:0/1203527006 conn(0x7f31b40fc510 msgr2=0x7f31b40fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:42.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.338+0000 7f31b9289640 1 -- 172.21.15.170:0/1203527006 shutdown_connections 2024-09-04T16:40:42.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.338+0000 7f31b9289640 1 -- 172.21.15.170:0/1203527006 wait complete. 2024-09-04T16:40:42.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.338+0000 7f31b9289640 1 Processor -- start 2024-09-04T16:40:42.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.338+0000 7f31b9289640 1 -- start start 2024-09-04T16:40:42.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.338+0000 7f31b9289640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31b4100810 0x7f31b419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:42.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31b9289640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b4106810 0x7f31b419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:42.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31b9289640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f31b410dce0 con 0x7f31b4106810 2024-09-04T16:40:42.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31b9289640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f31b410db60 con 0x7f31b4100810 2024-09-04T16:40:42.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31b27fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b4106810 0x7f31b419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:42.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31b27fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b4106810 0x7f31b419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51430/0 (socket says 172.21.15.170:51430) 2024-09-04T16:40:42.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31b27fc640 1 -- 172.21.15.170:0/1300133331 learned_addr learned my addr 172.21.15.170:0/1300133331 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:40:42.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31b2ffd640 1 --2- 172.21.15.170:0/1300133331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31b4100810 0x7f31b419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:42.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31b27fc640 1 -- 172.21.15.170:0/1300133331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31b4100810 msgr2=0x7f31b419d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:42.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31b27fc640 1 --2- 172.21.15.170:0/1300133331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31b4100810 0x7f31b419d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31b27fc640 1 -- 172.21.15.170:0/1300133331 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b41977e0 con 0x7f31b4106810 2024-09-04T16:40:42.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31b2ffd640 1 --2- 172.21.15.170:0/1300133331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31b4100810 0x7f31b419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:40:42.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31b27fc640 1 --2- 172.21.15.170:0/1300133331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b4106810 0x7f31b419dba0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f319c00d6f0 tx=0x7f319c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:42.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31abfff640 1 -- 172.21.15.170:0/1300133331 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f319c017070 con 0x7f31b4106810 2024-09-04T16:40:42.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31b9289640 1 -- 172.21.15.170:0/1300133331 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b4197ad0 con 0x7f31b4106810 2024-09-04T16:40:42.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31abfff640 1 -- 172.21.15.170:0/1300133331 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f319c00de00 con 0x7f31b4106810 2024-09-04T16:40:42.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31abfff640 1 -- 172.21.15.170:0/1300133331 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f319c004bb0 con 0x7f31b4106810 2024-09-04T16:40:42.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.339+0000 7f31b9289640 1 -- 172.21.15.170:0/1300133331 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b4198060 con 0x7f31b4106810 2024-09-04T16:40:42.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.341+0000 7f31b9289640 1 -- 172.21.15.170:0/1300133331 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b4101f50 con 0x7f31b4106810 2024-09-04T16:40:42.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.341+0000 7f31abfff640 1 -- 172.21.15.170:0/1300133331 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f319c004e60 con 0x7f31b4106810 2024-09-04T16:40:42.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.342+0000 7f31abfff640 1 --2- 172.21.15.170:0/1300133331 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f31a0079e30 0x7f31a007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:42.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.342+0000 7f31abfff640 1 -- 172.21.15.170:0/1300133331 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f319c09c730 con 0x7f31b4106810 2024-09-04T16:40:42.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.342+0000 7f31b2ffd640 1 --2- 172.21.15.170:0/1300133331 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f31a0079e30 0x7f31a007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:42.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.342+0000 7f31b2ffd640 1 --2- 172.21.15.170:0/1300133331 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f31a0079e30 0x7f31a007c2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f31a4000c00 tx=0x7f31a4031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:42.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.346+0000 7f31abfff640 1 -- 172.21.15.170:0/1300133331 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f319c064140 con 0x7f31b4106810 2024-09-04T16:40:42.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.539+0000 7f31b9289640 1 -- 172.21.15.170:0/1300133331 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f31b4198310 con 0x7f31a0079e30 2024-09-04T16:40:42.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.540+0000 7f31abfff640 1 -- 172.21.15.170:0/1300133331 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f31b4198310 con 0x7f31a0079e30 2024-09-04T16:40:42.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.542+0000 7f31b9289640 1 -- 172.21.15.170:0/1300133331 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f31a0079e30 msgr2=0x7f31a007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:42.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.542+0000 7f31b9289640 1 --2- 172.21.15.170:0/1300133331 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f31a0079e30 0x7f31a007c2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f31a4000c00 tx=0x7f31a4031400 comp rx=0 tx=0).stop 2024-09-04T16:40:42.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.542+0000 7f31b9289640 1 -- 172.21.15.170:0/1300133331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b4106810 msgr2=0x7f31b419dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:42.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.542+0000 7f31b9289640 1 --2- 172.21.15.170:0/1300133331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b4106810 0x7f31b419dba0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f319c00d6f0 tx=0x7f319c00dbb0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.542+0000 7f31b9289640 1 -- 172.21.15.170:0/1300133331 shutdown_connections 2024-09-04T16:40:42.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.542+0000 7f31b9289640 1 --2- 172.21.15.170:0/1300133331 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f31a0079e30 0x7f31a007c2f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.542+0000 7f31b9289640 1 --2- 172.21.15.170:0/1300133331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b4106810 0x7f31b419dba0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.542+0000 7f31b9289640 1 --2- 172.21.15.170:0/1300133331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31b4100810 0x7f31b419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.542+0000 7f31b9289640 1 -- 172.21.15.170:0/1300133331 >> 172.21.15.170:0/1300133331 conn(0x7f31b40fc510 msgr2=0x7f31b4104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:42.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.543+0000 7f31b9289640 1 -- 172.21.15.170:0/1300133331 shutdown_connections 2024-09-04T16:40:42.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.543+0000 7f31b9289640 1 -- 172.21.15.170:0/1300133331 wait complete. 2024-09-04T16:40:42.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:42 smithi170 ceph-mon[113855]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:40:42.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:42 smithi170 ceph-mon[113855]: pgmap v330: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:42.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.625+0000 7f42db8d9640 1 -- 172.21.15.170:0/1161445524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d41011f0 msgr2=0x7f42d41056c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:42.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.625+0000 7f42db8d9640 1 --2- 172.21.15.170:0/1161445524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d41011f0 0x7f42d41056c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f42c4009880 tx=0x7f42c402a530 comp rx=0 tx=0).stop 2024-09-04T16:40:42.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.625+0000 7f42db8d9640 1 -- 172.21.15.170:0/1161445524 shutdown_connections 2024-09-04T16:40:42.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.625+0000 7f42db8d9640 1 --2- 172.21.15.170:0/1161445524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d41011f0 0x7f42d41056c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.625+0000 7f42db8d9640 1 --2- 172.21.15.170:0/1161445524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d41008d0 0x7f42d4100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.625+0000 7f42db8d9640 1 -- 172.21.15.170:0/1161445524 >> 172.21.15.170:0/1161445524 conn(0x7f42d40fc520 msgr2=0x7f42d40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:42.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.625+0000 7f42db8d9640 1 -- 172.21.15.170:0/1161445524 shutdown_connections 2024-09-04T16:40:42.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.625+0000 7f42db8d9640 1 -- 172.21.15.170:0/1161445524 wait complete. 2024-09-04T16:40:42.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.626+0000 7f42db8d9640 1 Processor -- start 2024-09-04T16:40:42.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.626+0000 7f42db8d9640 1 -- start start 2024-09-04T16:40:42.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.626+0000 7f42db8d9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d41008d0 0x7f42d419e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:42.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.626+0000 7f42db8d9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d41011f0 0x7f42d419e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:42.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.626+0000 7f42db8d9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f42d4115410 con 0x7f42d41008d0 2024-09-04T16:40:42.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.626+0000 7f42db8d9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42d4115290 con 0x7f42d41011f0 2024-09-04T16:40:42.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.626+0000 7f42d9675640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d41008d0 0x7f42d419e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:42.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.626+0000 7f42d9675640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d41008d0 0x7f42d419e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51454/0 (socket says 172.21.15.170:51454) 2024-09-04T16:40:42.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.626+0000 7f42d9675640 1 -- 172.21.15.170:0/1852824321 learned_addr learned my addr 172.21.15.170:0/1852824321 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:40:42.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.626+0000 7f42d8e74640 1 --2- 172.21.15.170:0/1852824321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d41011f0 0x7f42d419e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:42.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.626+0000 7f42d9675640 1 -- 172.21.15.170:0/1852824321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d41011f0 msgr2=0x7f42d419e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:42.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.626+0000 7f42d9675640 1 --2- 172.21.15.170:0/1852824321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d41011f0 0x7f42d419e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.626+0000 7f42d9675640 1 -- 172.21.15.170:0/1852824321 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d41a28e0 con 0x7f42d41008d0 2024-09-04T16:40:42.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.626+0000 7f42d9675640 1 --2- 172.21.15.170:0/1852824321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d41008d0 0x7f42d419e010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f42d000c8f0 tx=0x7f42d000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:42.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.627+0000 7f42ca7fc640 1 -- 172.21.15.170:0/1852824321 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42d00079b0 con 0x7f42d41008d0 2024-09-04T16:40:42.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.627+0000 7f42ca7fc640 1 -- 172.21.15.170:0/1852824321 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42d00054e0 con 0x7f42d41008d0 2024-09-04T16:40:42.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.627+0000 7f42ca7fc640 1 -- 172.21.15.170:0/1852824321 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42d0004dd0 con 0x7f42d41008d0 2024-09-04T16:40:42.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.627+0000 7f42db8d9640 1 -- 172.21.15.170:0/1852824321 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d41a2bd0 con 0x7f42d41008d0 2024-09-04T16:40:42.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.627+0000 7f42db8d9640 1 -- 172.21.15.170:0/1852824321 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d41a3160 con 0x7f42d41008d0 2024-09-04T16:40:42.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.628+0000 7f42db8d9640 1 -- 172.21.15.170:0/1852824321 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d406abe0 con 0x7f42d41008d0 2024-09-04T16:40:42.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.628+0000 7f42ca7fc640 1 -- 172.21.15.170:0/1852824321 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f42d0005020 con 0x7f42d41008d0 2024-09-04T16:40:42.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.629+0000 7f42ca7fc640 1 --2- 172.21.15.170:0/1852824321 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42c0079dd0 0x7f42c007c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:42.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.629+0000 7f42ca7fc640 1 -- 172.21.15.170:0/1852824321 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f42d009cad0 con 0x7f42d41008d0 2024-09-04T16:40:42.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.629+0000 7f42d8e74640 1 --2- 172.21.15.170:0/1852824321 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42c0079dd0 0x7f42c007c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:42.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.629+0000 7f42d8e74640 1 --2- 172.21.15.170:0/1852824321 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42c0079dd0 0x7f42c007c290 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f42c4031460 tx=0x7f42c4009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:42.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.633+0000 7f42ca7fc640 1 -- 172.21.15.170:0/1852824321 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f42d0014030 con 0x7f42d41008d0 2024-09-04T16:40:42.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.815+0000 7f42db8d9640 1 -- 172.21.15.170:0/1852824321 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f42d41a3470 con 0x7f42c0079dd0 2024-09-04T16:40:42.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.825+0000 7f42ca7fc640 1 -- 172.21.15.170:0/1852824321 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f42d41a3470 con 0x7f42c0079dd0 2024-09-04T16:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (7m) 116s ago 18m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (10m) 116s ago 18m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (10m) 89s ago 17m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (5m) 116s ago 18m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (5m) 89s ago 17m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (7m) 116s ago 18m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (2m) 116s ago 13m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (2m) 116s ago 13m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (92s) 89s ago 13m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (106s) 89s ago 13m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (9m) 116s ago 19m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (8m) 89s ago 17m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (6m) 116s ago 19m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (6m) 89s ago 17m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (8m) 116s ago 18m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (8m) 89s ago 17m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (5m) 116s ago 16m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (4m) 116s ago 16m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (4m) 116s ago 15m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (3m) 89s ago 15m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (3m) 89s ago 14m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (2m) 89s ago 14m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (8m) 116s ago 18m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:40:42.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.827+0000 7f42db8d9640 1 -- 172.21.15.170:0/1852824321 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42c0079dd0 msgr2=0x7f42c007c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:42.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.827+0000 7f42db8d9640 1 --2- 172.21.15.170:0/1852824321 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42c0079dd0 0x7f42c007c290 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f42c4031460 tx=0x7f42c4009560 comp rx=0 tx=0).stop 2024-09-04T16:40:42.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.827+0000 7f42db8d9640 1 -- 172.21.15.170:0/1852824321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d41008d0 msgr2=0x7f42d419e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:42.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.827+0000 7f42db8d9640 1 --2- 172.21.15.170:0/1852824321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d41008d0 0x7f42d419e010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f42d000c8f0 tx=0x7f42d000cdb0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.827+0000 7f42db8d9640 1 -- 172.21.15.170:0/1852824321 shutdown_connections 2024-09-04T16:40:42.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.827+0000 7f42db8d9640 1 --2- 172.21.15.170:0/1852824321 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42c0079dd0 0x7f42c007c290 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.827+0000 7f42db8d9640 1 --2- 172.21.15.170:0/1852824321 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d41011f0 0x7f42d419e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.827+0000 7f42db8d9640 1 --2- 172.21.15.170:0/1852824321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d41008d0 0x7f42d419e010 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.827+0000 7f42db8d9640 1 -- 172.21.15.170:0/1852824321 >> 172.21.15.170:0/1852824321 conn(0x7f42d40fc520 msgr2=0x7f42d4112c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:42.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.827+0000 7f42db8d9640 1 -- 172.21.15.170:0/1852824321 shutdown_connections 2024-09-04T16:40:42.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.827+0000 7f42db8d9640 1 -- 172.21.15.170:0/1852824321 wait complete. 2024-09-04T16:40:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:42 smithi193 ceph-mon[82547]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:40:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:42 smithi193 ceph-mon[82547]: pgmap v330: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:42.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.908+0000 7fb3be8e9640 1 -- 172.21.15.170:0/524060683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b81034a0 msgr2=0x7fb3b810b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:42.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.908+0000 7fb3be8e9640 1 --2- 172.21.15.170:0/524060683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b81034a0 0x7fb3b810b990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009880 tx=0x7fb3ac02a530 comp rx=0 tx=0).stop 2024-09-04T16:40:42.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.908+0000 7fb3be8e9640 1 -- 172.21.15.170:0/524060683 shutdown_connections 2024-09-04T16:40:42.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.908+0000 7fb3be8e9640 1 --2- 172.21.15.170:0/524060683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b81034a0 0x7fb3b810b990 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.908+0000 7fb3be8e9640 1 --2- 172.21.15.170:0/524060683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3b8102b80 0x7fb3b8102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.908+0000 7fb3be8e9640 1 -- 172.21.15.170:0/524060683 >> 172.21.15.170:0/524060683 conn(0x7fb3b80fc520 msgr2=0x7fb3b80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:42.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.908+0000 7fb3be8e9640 1 -- 172.21.15.170:0/524060683 shutdown_connections 2024-09-04T16:40:42.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.908+0000 7fb3be8e9640 1 -- 172.21.15.170:0/524060683 wait complete. 2024-09-04T16:40:42.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.909+0000 7fb3be8e9640 1 Processor -- start 2024-09-04T16:40:42.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.909+0000 7fb3be8e9640 1 -- start start 2024-09-04T16:40:42.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.909+0000 7fb3be8e9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3b8102b80 0x7fb3b819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:42.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.909+0000 7fb3be8e9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b81034a0 0x7fb3b819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:42.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.909+0000 7fb3be8e9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b810edf0 con 0x7fb3b81034a0 2024-09-04T16:40:42.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.909+0000 7fb3be8e9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b810ec70 con 0x7fb3b8102b80 2024-09-04T16:40:42.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.910+0000 7fb3b77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b81034a0 0x7fb3b819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:42.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.910+0000 7fb3b77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b81034a0 0x7fb3b819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51478/0 (socket says 172.21.15.170:51478) 2024-09-04T16:40:42.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.910+0000 7fb3b77fe640 1 -- 172.21.15.170:0/4067085664 learned_addr learned my addr 172.21.15.170:0/4067085664 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:40:42.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.910+0000 7fb3b7fff640 1 --2- 172.21.15.170:0/4067085664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3b8102b80 0x7fb3b819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:42.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.910+0000 7fb3b77fe640 1 -- 172.21.15.170:0/4067085664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3b8102b80 msgr2=0x7fb3b819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:42.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.910+0000 7fb3b77fe640 1 --2- 172.21.15.170:0/4067085664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3b8102b80 0x7fb3b819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:42.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.910+0000 7fb3b77fe640 1 -- 172.21.15.170:0/4067085664 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b81977e0 con 0x7fb3b81034a0 2024-09-04T16:40:42.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.910+0000 7fb3b77fe640 1 --2- 172.21.15.170:0/4067085664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b81034a0 0x7fb3b819dba0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac004f90 tx=0x7fb3ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:42.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.910+0000 7fb3b57fa640 1 -- 172.21.15.170:0/4067085664 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb3ac03f070 con 0x7fb3b81034a0 2024-09-04T16:40:42.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.910+0000 7fb3b57fa640 1 -- 172.21.15.170:0/4067085664 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb3ac004ac0 con 0x7fb3b81034a0 2024-09-04T16:40:42.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.910+0000 7fb3be8e9640 1 -- 172.21.15.170:0/4067085664 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b8197a70 con 0x7fb3b81034a0 2024-09-04T16:40:42.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.910+0000 7fb3b57fa640 1 -- 172.21.15.170:0/4067085664 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb3ac035030 con 0x7fb3b81034a0 2024-09-04T16:40:42.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.911+0000 7fb3be8e9640 1 -- 172.21.15.170:0/4067085664 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b8197fa0 con 0x7fb3b81034a0 2024-09-04T16:40:42.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.912+0000 7fb3be8e9640 1 -- 172.21.15.170:0/4067085664 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b806ab40 con 0x7fb3b81034a0 2024-09-04T16:40:42.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.912+0000 7fb3b57fa640 1 -- 172.21.15.170:0/4067085664 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fb3ac042070 con 0x7fb3b81034a0 2024-09-04T16:40:42.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.913+0000 7fb3b57fa640 1 --2- 172.21.15.170:0/4067085664 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb3a0079e30 0x7fb3a007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:42.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.913+0000 7fb3b7fff640 1 --2- 172.21.15.170:0/4067085664 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb3a0079e30 0x7fb3a007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:42.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.913+0000 7fb3b57fa640 1 -- 172.21.15.170:0/4067085664 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb3ac0bd400 con 0x7fb3b81034a0 2024-09-04T16:40:42.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.913+0000 7fb3b7fff640 1 --2- 172.21.15.170:0/4067085664 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb3a0079e30 0x7fb3a007c2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009b60 tx=0x7fb3a8005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:42.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:42.917+0000 7fb3b57fa640 1 -- 172.21.15.170:0/4067085664 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb3ac084e10 con 0x7fb3b81034a0 2024-09-04T16:40:43.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.160+0000 7fb3be8e9640 1 -- 172.21.15.170:0/4067085664 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb3b8105fa0 con 0x7fb3b81034a0 2024-09-04T16:40:43.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.161+0000 7fb3b57fa640 1 -- 172.21.15.170:0/4067085664 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fb3ac08d2c0 con 0x7fb3b81034a0 2024-09-04T16:40:43.161 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:40:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:40:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:40:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:40:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:40:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:40:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:40:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:40:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:40:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:40:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:40:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:40:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:40:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:40:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:40:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:40:43.163 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:40:43.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.163+0000 7fb3be8e9640 1 -- 172.21.15.170:0/4067085664 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb3a0079e30 msgr2=0x7fb3a007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:43.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.163+0000 7fb3be8e9640 1 --2- 172.21.15.170:0/4067085664 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb3a0079e30 0x7fb3a007c2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009b60 tx=0x7fb3a8005f90 comp rx=0 tx=0).stop 2024-09-04T16:40:43.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.163+0000 7fb3be8e9640 1 -- 172.21.15.170:0/4067085664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b81034a0 msgr2=0x7fb3b819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:43.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.163+0000 7fb3be8e9640 1 --2- 172.21.15.170:0/4067085664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b81034a0 0x7fb3b819dba0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac004f90 tx=0x7fb3ac0046c0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.163+0000 7fb3be8e9640 1 -- 172.21.15.170:0/4067085664 shutdown_connections 2024-09-04T16:40:43.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.163+0000 7fb3be8e9640 1 --2- 172.21.15.170:0/4067085664 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb3a0079e30 0x7fb3a007c2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.163+0000 7fb3be8e9640 1 --2- 172.21.15.170:0/4067085664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b81034a0 0x7fb3b819dba0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.163+0000 7fb3be8e9640 1 --2- 172.21.15.170:0/4067085664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3b8102b80 0x7fb3b819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.163+0000 7fb3be8e9640 1 -- 172.21.15.170:0/4067085664 >> 172.21.15.170:0/4067085664 conn(0x7fb3b80fc520 msgr2=0x7fb3b8108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:43.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.163+0000 7fb3be8e9640 1 -- 172.21.15.170:0/4067085664 shutdown_connections 2024-09-04T16:40:43.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.163+0000 7fb3be8e9640 1 -- 172.21.15.170:0/4067085664 wait complete. 2024-09-04T16:40:43.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.246+0000 7ff6de3e4640 1 -- 172.21.15.170:0/1591073469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d8102ba0 msgr2=0x7ff6d8102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:43.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.246+0000 7ff6de3e4640 1 --2- 172.21.15.170:0/1591073469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d8102ba0 0x7ff6d8102f80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009880 tx=0x7ff6c802a530 comp rx=0 tx=0).stop 2024-09-04T16:40:43.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.246+0000 7ff6de3e4640 1 -- 172.21.15.170:0/1591073469 shutdown_connections 2024-09-04T16:40:43.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.246+0000 7ff6de3e4640 1 --2- 172.21.15.170:0/1591073469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6d81034c0 0x7ff6d810b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.246+0000 7ff6de3e4640 1 --2- 172.21.15.170:0/1591073469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d8102ba0 0x7ff6d8102f80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.246+0000 7ff6de3e4640 1 -- 172.21.15.170:0/1591073469 >> 172.21.15.170:0/1591073469 conn(0x7ff6d80fc520 msgr2=0x7ff6d80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:43.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.246+0000 7ff6de3e4640 1 -- 172.21.15.170:0/1591073469 shutdown_connections 2024-09-04T16:40:43.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.246+0000 7ff6de3e4640 1 -- 172.21.15.170:0/1591073469 wait complete. 2024-09-04T16:40:43.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.247+0000 7ff6de3e4640 1 Processor -- start 2024-09-04T16:40:43.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.247+0000 7ff6de3e4640 1 -- start start 2024-09-04T16:40:43.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.247+0000 7ff6de3e4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d8102ba0 0x7ff6d819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:43.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.247+0000 7ff6de3e4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6d81034c0 0x7ff6d819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:43.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.247+0000 7ff6de3e4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d810ee10 con 0x7ff6d8102ba0 2024-09-04T16:40:43.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.247+0000 7ff6de3e4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d810ec90 con 0x7ff6d81034c0 2024-09-04T16:40:43.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.247+0000 7ff6d7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d8102ba0 0x7ff6d819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:43.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.248+0000 7ff6d7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d8102ba0 0x7ff6d819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51484/0 (socket says 172.21.15.170:51484) 2024-09-04T16:40:43.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.248+0000 7ff6d7fff640 1 -- 172.21.15.170:0/142076294 learned_addr learned my addr 172.21.15.170:0/142076294 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:40:43.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.248+0000 7ff6d77fe640 1 --2- 172.21.15.170:0/142076294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6d81034c0 0x7ff6d819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:43.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.248+0000 7ff6d7fff640 1 -- 172.21.15.170:0/142076294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6d81034c0 msgr2=0x7ff6d819dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:43.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.248+0000 7ff6d7fff640 1 --2- 172.21.15.170:0/142076294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6d81034c0 0x7ff6d819dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.248+0000 7ff6d7fff640 1 -- 172.21.15.170:0/142076294 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d8197860 con 0x7ff6d8102ba0 2024-09-04T16:40:43.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.248+0000 7ff6d7fff640 1 --2- 172.21.15.170:0/142076294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d8102ba0 0x7ff6d819d6a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8004f90 tx=0x7ff6c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:43.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.248+0000 7ff6d57fa640 1 -- 172.21.15.170:0/142076294 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff6c803f070 con 0x7ff6d8102ba0 2024-09-04T16:40:43.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.248+0000 7ff6de3e4640 1 -- 172.21.15.170:0/142076294 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d8197af0 con 0x7ff6d8102ba0 2024-09-04T16:40:43.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.248+0000 7ff6d57fa640 1 -- 172.21.15.170:0/142076294 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6c8004ac0 con 0x7ff6d8102ba0 2024-09-04T16:40:43.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.248+0000 7ff6d57fa640 1 -- 172.21.15.170:0/142076294 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff6c8035030 con 0x7ff6d8102ba0 2024-09-04T16:40:43.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.248+0000 7ff6de3e4640 1 -- 172.21.15.170:0/142076294 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d8198020 con 0x7ff6d8102ba0 2024-09-04T16:40:43.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.249+0000 7ff6de3e4640 1 -- 172.21.15.170:0/142076294 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6d806ab20 con 0x7ff6d8102ba0 2024-09-04T16:40:43.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.250+0000 7ff6d57fa640 1 -- 172.21.15.170:0/142076294 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ff6c8042070 con 0x7ff6d8102ba0 2024-09-04T16:40:43.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.250+0000 7ff6d57fa640 1 --2- 172.21.15.170:0/142076294 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff6c0079e30 0x7ff6c007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:43.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.250+0000 7ff6d57fa640 1 -- 172.21.15.170:0/142076294 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff6c80bd430 con 0x7ff6d8102ba0 2024-09-04T16:40:43.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.250+0000 7ff6d77fe640 1 --2- 172.21.15.170:0/142076294 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff6c0079e30 0x7ff6c007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:43.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.251+0000 7ff6d77fe640 1 --2- 172.21.15.170:0/142076294 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff6c0079e30 0x7ff6c007c2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8108970 tx=0x7ff6cc005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:43.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.255+0000 7ff6d57fa640 1 -- 172.21.15.170:0/142076294 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff6c8084e40 con 0x7ff6d8102ba0 2024-09-04T16:40:43.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.462+0000 7ff6de3e4640 1 -- 172.21.15.170:0/142076294 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff6d8106000 con 0x7ff6d8102ba0 2024-09-04T16:40:43.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.462+0000 7ff6d57fa640 1 -- 172.21.15.170:0/142076294 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7ff6c80a5e20 con 0x7ff6d8102ba0 2024-09-04T16:40:43.463 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:40:43.463 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:40:43.463 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:40:43.464 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:40:43.464 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:40:43.464 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:40:43.464 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:40:43.464 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:40:43.464 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:40:43.464 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:40:43.464 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:40:43.464 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:40:43.464 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:40:43.464 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:40:43.464 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:40:43.464 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:40:43.465 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:40:43.465 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:40:43.465 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:40:43.465 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:40:43.465 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:40:43.465 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:40:43.465 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:40:43.465 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:40:43.465 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:40:43.465 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:40:43.465 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:40:43.465 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:40:43.465 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:40:43.465 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:40:43.466 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:40:43.466 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:40:43.466 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:40:43.466 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:40:43.466 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:40:43.466 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:40:43.466 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:40:43.466 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:40:43.466 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:40:43.466 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:40:43.466 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:40:43.466 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:40:43.466 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:40:43.467 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:40:43.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.464+0000 7ff6de3e4640 1 -- 172.21.15.170:0/142076294 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff6c0079e30 msgr2=0x7ff6c007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:43.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.464+0000 7ff6de3e4640 1 --2- 172.21.15.170:0/142076294 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff6c0079e30 0x7ff6c007c2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8108970 tx=0x7ff6cc005f90 comp rx=0 tx=0).stop 2024-09-04T16:40:43.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.465+0000 7ff6de3e4640 1 -- 172.21.15.170:0/142076294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d8102ba0 msgr2=0x7ff6d819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:43.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.465+0000 7ff6de3e4640 1 --2- 172.21.15.170:0/142076294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d8102ba0 0x7ff6d819d6a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8004f90 tx=0x7ff6c80046c0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.465+0000 7ff6de3e4640 1 -- 172.21.15.170:0/142076294 shutdown_connections 2024-09-04T16:40:43.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.465+0000 7ff6de3e4640 1 --2- 172.21.15.170:0/142076294 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff6c0079e30 0x7ff6c007c2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.465+0000 7ff6de3e4640 1 --2- 172.21.15.170:0/142076294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff6d81034c0 0x7ff6d819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.465+0000 7ff6de3e4640 1 --2- 172.21.15.170:0/142076294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d8102ba0 0x7ff6d819d6a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.465+0000 7ff6de3e4640 1 -- 172.21.15.170:0/142076294 >> 172.21.15.170:0/142076294 conn(0x7ff6d80fc520 msgr2=0x7ff6d8108fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:43.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.465+0000 7ff6de3e4640 1 -- 172.21.15.170:0/142076294 shutdown_connections 2024-09-04T16:40:43.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.465+0000 7ff6de3e4640 1 -- 172.21.15.170:0/142076294 wait complete. 2024-09-04T16:40:43.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.548+0000 7f9b17026640 1 -- 172.21.15.170:0/3733306540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b10107930 msgr2=0x7f9b10107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:43.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.548+0000 7f9b17026640 1 --2- 172.21.15.170:0/3733306540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b10107930 0x7f9b10107d10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009880 tx=0x7f9b0002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.548+0000 7f9b17026640 1 -- 172.21.15.170:0/3733306540 shutdown_connections 2024-09-04T16:40:43.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.548+0000 7f9b17026640 1 --2- 172.21.15.170:0/3733306540 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b10101930 0x7f9b10101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.548+0000 7f9b17026640 1 --2- 172.21.15.170:0/3733306540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b10107930 0x7f9b10107d10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.548+0000 7f9b17026640 1 -- 172.21.15.170:0/3733306540 >> 172.21.15.170:0/3733306540 conn(0x7f9b100fd630 msgr2=0x7f9b100ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:43.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.549+0000 7f9b17026640 1 -- 172.21.15.170:0/3733306540 shutdown_connections 2024-09-04T16:40:43.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.549+0000 7f9b17026640 1 -- 172.21.15.170:0/3733306540 wait complete. 2024-09-04T16:40:43.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.549+0000 7f9b17026640 1 Processor -- start 2024-09-04T16:40:43.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.549+0000 7f9b17026640 1 -- start start 2024-09-04T16:40:43.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.549+0000 7f9b17026640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b10101930 0x7f9b100744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:43.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.549+0000 7f9b17026640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b10107930 0x7f9b10074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:43.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.549+0000 7f9b17026640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1010ee00 con 0x7f9b10101930 2024-09-04T16:40:43.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.549+0000 7f9b17026640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1010ec80 con 0x7f9b10107930 2024-09-04T16:40:43.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.549+0000 7f9b14dc2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b10101930 0x7f9b100744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:43.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.549+0000 7f9b14dc2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b10101930 0x7f9b100744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51500/0 (socket says 172.21.15.170:51500) 2024-09-04T16:40:43.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.549+0000 7f9b14dc2640 1 -- 172.21.15.170:0/4219122751 learned_addr learned my addr 172.21.15.170:0/4219122751 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:40:43.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.550+0000 7f9b0ffff640 1 --2- 172.21.15.170:0/4219122751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b10107930 0x7f9b10074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:43.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.550+0000 7f9b14dc2640 1 -- 172.21.15.170:0/4219122751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b10107930 msgr2=0x7f9b10074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:43.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.550+0000 7f9b14dc2640 1 --2- 172.21.15.170:0/4219122751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b10107930 0x7f9b10074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.550+0000 7f9b14dc2640 1 -- 172.21.15.170:0/4219122751 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b10074f70 con 0x7f9b10101930 2024-09-04T16:40:43.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.550+0000 7f9b14dc2640 1 --2- 172.21.15.170:0/4219122751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b10101930 0x7f9b100744f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9b00031460 tx=0x7f9b00004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:43.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.550+0000 7f9b0dffb640 1 -- 172.21.15.170:0/4219122751 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b0003f070 con 0x7f9b10101930 2024-09-04T16:40:43.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.550+0000 7f9b17026640 1 -- 172.21.15.170:0/4219122751 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b10075200 con 0x7f9b10101930 2024-09-04T16:40:43.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.550+0000 7f9b0dffb640 1 -- 172.21.15.170:0/4219122751 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9b000035f0 con 0x7f9b10101930 2024-09-04T16:40:43.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.550+0000 7f9b0dffb640 1 -- 172.21.15.170:0/4219122751 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b00035030 con 0x7f9b10101930 2024-09-04T16:40:43.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.550+0000 7f9b17026640 1 -- 172.21.15.170:0/4219122751 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b101a3db0 con 0x7f9b10101930 2024-09-04T16:40:43.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.551+0000 7f9b17026640 1 -- 172.21.15.170:0/4219122751 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b10103070 con 0x7f9b10101930 2024-09-04T16:40:43.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.552+0000 7f9b0dffb640 1 -- 172.21.15.170:0/4219122751 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f9b00042070 con 0x7f9b10101930 2024-09-04T16:40:43.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.552+0000 7f9b0dffb640 1 --2- 172.21.15.170:0/4219122751 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9af8079e30 0x7f9af807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:43.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.552+0000 7f9b0dffb640 1 -- 172.21.15.170:0/4219122751 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9b000bd430 con 0x7f9b10101930 2024-09-04T16:40:43.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.552+0000 7f9b0ffff640 1 --2- 172.21.15.170:0/4219122751 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9af8079e30 0x7f9af807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:43.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.553+0000 7f9b0ffff640 1 --2- 172.21.15.170:0/4219122751 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9af8079e30 0x7f9af807c2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9b10075f80 tx=0x7f9b04005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:43.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.557+0000 7f9b0dffb640 1 -- 172.21.15.170:0/4219122751 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9b00084e40 con 0x7f9b10101930 2024-09-04T16:40:43.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.746+0000 7f9b17026640 1 -- 172.21.15.170:0/4219122751 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9b10062630 con 0x7f9af8079e30 2024-09-04T16:40:43.748 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:43 smithi170 ceph-mon[113855]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:40:43.748 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:43 smithi170 ceph-mon[113855]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:40:43.748 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:43 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/4067085664' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:40:43.748 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:43 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/142076294' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:40:43.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.748+0000 7f9b0dffb640 1 -- 172.21.15.170:0/4219122751 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9b10062630 con 0x7f9af8079e30 2024-09-04T16:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:40:43.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.750+0000 7f9b17026640 1 -- 172.21.15.170:0/4219122751 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9af8079e30 msgr2=0x7f9af807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:43.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.750+0000 7f9b17026640 1 --2- 172.21.15.170:0/4219122751 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9af8079e30 0x7f9af807c2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9b10075f80 tx=0x7f9b04005f90 comp rx=0 tx=0).stop 2024-09-04T16:40:43.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.750+0000 7f9b17026640 1 -- 172.21.15.170:0/4219122751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b10101930 msgr2=0x7f9b100744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:43.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.750+0000 7f9b17026640 1 --2- 172.21.15.170:0/4219122751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b10101930 0x7f9b100744f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9b00031460 tx=0x7f9b00004530 comp rx=0 tx=0).stop 2024-09-04T16:40:43.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.750+0000 7f9b17026640 1 -- 172.21.15.170:0/4219122751 shutdown_connections 2024-09-04T16:40:43.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.750+0000 7f9b17026640 1 --2- 172.21.15.170:0/4219122751 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9af8079e30 0x7f9af807c2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.750+0000 7f9b17026640 1 --2- 172.21.15.170:0/4219122751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b10107930 0x7f9b10074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.751+0000 7f9b17026640 1 --2- 172.21.15.170:0/4219122751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b10101930 0x7f9b100744f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.751+0000 7f9b17026640 1 -- 172.21.15.170:0/4219122751 >> 172.21.15.170:0/4219122751 conn(0x7f9b100fd630 msgr2=0x7f9b100fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:43.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.751+0000 7f9b17026640 1 -- 172.21.15.170:0/4219122751 shutdown_connections 2024-09-04T16:40:43.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.751+0000 7f9b17026640 1 -- 172.21.15.170:0/4219122751 wait complete. 2024-09-04T16:40:43.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.833+0000 7f156df97640 1 -- 172.21.15.170:0/4001479048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15681007e0 msgr2=0x7f1568100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:43.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.833+0000 7f156df97640 1 --2- 172.21.15.170:0/4001479048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15681007e0 0x7f1568100c40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1550009880 tx=0x7f155002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.833+0000 7f156df97640 1 -- 172.21.15.170:0/4001479048 shutdown_connections 2024-09-04T16:40:43.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.833+0000 7f156df97640 1 --2- 172.21.15.170:0/4001479048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15681007e0 0x7f1568100c40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.833+0000 7f156df97640 1 --2- 172.21.15.170:0/4001479048 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15681067e0 0x7f1568106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.833+0000 7f156df97640 1 -- 172.21.15.170:0/4001479048 >> 172.21.15.170:0/4001479048 conn(0x7f15680fc4c0 msgr2=0x7f15680fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:43.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.833+0000 7f156df97640 1 -- 172.21.15.170:0/4001479048 shutdown_connections 2024-09-04T16:40:43.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.833+0000 7f156df97640 1 -- 172.21.15.170:0/4001479048 wait complete. 2024-09-04T16:40:43.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.834+0000 7f156df97640 1 Processor -- start 2024-09-04T16:40:43.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.834+0000 7f156df97640 1 -- start start 2024-09-04T16:40:43.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.834+0000 7f156df97640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15681007e0 0x7f15680fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:43.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.834+0000 7f156df97640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15681067e0 0x7f15680fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:43.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.834+0000 7f156df97640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f156810dcb0 con 0x7f15681067e0 2024-09-04T16:40:43.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.834+0000 7f156df97640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f156810db30 con 0x7f15681007e0 2024-09-04T16:40:43.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.834+0000 7f155ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15681067e0 0x7f15680fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:43.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.834+0000 7f155ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15681067e0 0x7f15680fd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51524/0 (socket says 172.21.15.170:51524) 2024-09-04T16:40:43.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.834+0000 7f155ffff640 1 -- 172.21.15.170:0/2091924642 learned_addr learned my addr 172.21.15.170:0/2091924642 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:40:43.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.834+0000 7f15677fe640 1 --2- 172.21.15.170:0/2091924642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15681007e0 0x7f15680fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:43.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.834+0000 7f155ffff640 1 -- 172.21.15.170:0/2091924642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15681007e0 msgr2=0x7f15680fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:43.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.834+0000 7f155ffff640 1 --2- 172.21.15.170:0/2091924642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15681007e0 0x7f15680fcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:43.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.834+0000 7f155ffff640 1 -- 172.21.15.170:0/2091924642 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15680fd690 con 0x7f15681067e0 2024-09-04T16:40:43.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.834+0000 7f155ffff640 1 --2- 172.21.15.170:0/2091924642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15681067e0 0x7f15680fd150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1550031460 tx=0x7f15500045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:43.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.834+0000 7f15657fa640 1 -- 172.21.15.170:0/2091924642 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f155003f070 con 0x7f15681067e0 2024-09-04T16:40:43.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.835+0000 7f156df97640 1 -- 172.21.15.170:0/2091924642 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15680fd920 con 0x7f15681067e0 2024-09-04T16:40:43.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.835+0000 7f15657fa640 1 -- 172.21.15.170:0/2091924642 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f15500035f0 con 0x7f15681067e0 2024-09-04T16:40:43.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.835+0000 7f15657fa640 1 -- 172.21.15.170:0/2091924642 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1550035030 con 0x7f15681067e0 2024-09-04T16:40:43.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.835+0000 7f156df97640 1 -- 172.21.15.170:0/2091924642 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15681a3df0 con 0x7f15681067e0 2024-09-04T16:40:43.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.836+0000 7f156df97640 1 -- 172.21.15.170:0/2091924642 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1568101f20 con 0x7f15681067e0 2024-09-04T16:40:43.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.836+0000 7f15657fa640 1 -- 172.21.15.170:0/2091924642 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f1550042070 con 0x7f15681067e0 2024-09-04T16:40:43.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.837+0000 7f15657fa640 1 --2- 172.21.15.170:0/2091924642 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1554079e30 0x7f155407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:40:43.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.837+0000 7f15657fa640 1 -- 172.21.15.170:0/2091924642 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f15500bd460 con 0x7f15681067e0 2024-09-04T16:40:43.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.837+0000 7f15677fe640 1 --2- 172.21.15.170:0/2091924642 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1554079e30 0x7f155407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:40:43.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.837+0000 7f15677fe640 1 --2- 172.21.15.170:0/2091924642 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1554079e30 0x7f155407c2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1558005fd0 tx=0x7f1558005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:40:43.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:43.841+0000 7f15657fa640 1 -- 172.21.15.170:0/2091924642 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1550084e70 con 0x7f15681067e0 2024-09-04T16:40:43.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:43 smithi193 ceph-mon[82547]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:40:43.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:43 smithi193 ceph-mon[82547]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:40:43.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:43 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/4067085664' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:40:43.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:43 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/142076294' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:40:44.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:44.088+0000 7f156df97640 1 -- 172.21.15.170:0/2091924642 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f1568109d60 con 0x7f15681067e0 2024-09-04T16:40:44.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:44.088+0000 7f15657fa640 1 -- 172.21.15.170:0/2091924642 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f1550088fe0 con 0x7f15681067e0 2024-09-04T16:40:44.089 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:40:44.089 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:40:44.089 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:40:44.089 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:40:44.089 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:40:44.090 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:40:44.090 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:40:44.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:44.090+0000 7f156df97640 1 -- 172.21.15.170:0/2091924642 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1554079e30 msgr2=0x7f155407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:44.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:44.090+0000 7f156df97640 1 --2- 172.21.15.170:0/2091924642 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1554079e30 0x7f155407c2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1558005fd0 tx=0x7f1558005850 comp rx=0 tx=0).stop 2024-09-04T16:40:44.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:44.090+0000 7f156df97640 1 -- 172.21.15.170:0/2091924642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15681067e0 msgr2=0x7f15680fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:40:44.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:44.090+0000 7f156df97640 1 --2- 172.21.15.170:0/2091924642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15681067e0 0x7f15680fd150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1550031460 tx=0x7f15500045e0 comp rx=0 tx=0).stop 2024-09-04T16:40:44.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:44.091+0000 7f156df97640 1 -- 172.21.15.170:0/2091924642 shutdown_connections 2024-09-04T16:40:44.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:44.091+0000 7f156df97640 1 --2- 172.21.15.170:0/2091924642 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1554079e30 0x7f155407c2f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:44.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:44.091+0000 7f156df97640 1 --2- 172.21.15.170:0/2091924642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15681067e0 0x7f15680fd150 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:44.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:44.091+0000 7f156df97640 1 --2- 172.21.15.170:0/2091924642 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15681007e0 0x7f15680fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:40:44.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:44.091+0000 7f156df97640 1 -- 172.21.15.170:0/2091924642 >> 172.21.15.170:0/2091924642 conn(0x7f15680fc4c0 msgr2=0x7f1568069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:40:44.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:44.091+0000 7f156df97640 1 -- 172.21.15.170:0/2091924642 shutdown_connections 2024-09-04T16:40:44.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:40:44.091+0000 7f156df97640 1 -- 172.21.15.170:0/2091924642 wait complete. 2024-09-04T16:40:44.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:44 smithi170 ceph-mon[113855]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:40:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:44 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2091924642' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:40:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:40:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:44 smithi170 ceph-mon[113855]: pgmap v331: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:44 smithi193 ceph-mon[82547]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:40:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:44 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2091924642' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:40:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:40:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:44 smithi193 ceph-mon[82547]: pgmap v331: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:46.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:46 smithi170 ceph-mon[113855]: pgmap v332: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:46.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:46 smithi193 ceph-mon[82547]: pgmap v332: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:48.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:48 smithi170 ceph-mon[113855]: pgmap v333: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:48 smithi193 ceph-mon[82547]: pgmap v333: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:50.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:50 smithi170 ceph-mon[113855]: pgmap v334: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:50 smithi193 ceph-mon[82547]: pgmap v334: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:53.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:52 smithi193 ceph-mon[82547]: pgmap v335: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:53.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:52 smithi170 ceph-mon[113855]: pgmap v335: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:54.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:54 smithi170 ceph-mon[113855]: pgmap v336: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:54 smithi193 ceph-mon[82547]: pgmap v336: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:56.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:56 smithi170 ceph-mon[113855]: pgmap v337: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:56.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:56 smithi193 ceph-mon[82547]: pgmap v337: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:58.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:58 smithi170 ceph-mon[113855]: pgmap v338: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:58.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:58 smithi193 ceph-mon[82547]: pgmap v338: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:40:59.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:40:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:40:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:40:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:41:00.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:00 smithi170 ceph-mon[113855]: pgmap v339: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:00 smithi193 ceph-mon[82547]: pgmap v339: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:02 smithi170 ceph-mon[113855]: pgmap v340: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:02.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:02 smithi193 ceph-mon[82547]: pgmap v340: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:04.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:04 smithi170 ceph-mon[113855]: pgmap v341: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:04.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:04 smithi193 ceph-mon[82547]: pgmap v341: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:06.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:06 smithi170 ceph-mon[113855]: pgmap v342: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:06.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:06 smithi193 ceph-mon[82547]: pgmap v342: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:08.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:08 smithi170 ceph-mon[113855]: pgmap v343: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:08 smithi193 ceph-mon[82547]: pgmap v343: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:10.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:10 smithi170 ceph-mon[113855]: pgmap v344: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:10.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:10 smithi193 ceph-mon[82547]: pgmap v344: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:12.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:12 smithi170 ceph-mon[113855]: pgmap v345: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:12.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:12 smithi193 ceph-mon[82547]: pgmap v345: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:14.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.186+0000 7f29770be640 1 -- 172.21.15.170:0/2502371529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2970103460 msgr2=0x7f297010b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:14.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.186+0000 7f29770be640 1 --2- 172.21.15.170:0/2502371529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2970103460 0x7f297010b950 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f295c009880 tx=0x7f295c02a530 comp rx=0 tx=0).stop 2024-09-04T16:41:14.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.187+0000 7f29770be640 1 -- 172.21.15.170:0/2502371529 shutdown_connections 2024-09-04T16:41:14.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.187+0000 7f29770be640 1 --2- 172.21.15.170:0/2502371529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2970103460 0x7f297010b950 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.187+0000 7f29770be640 1 --2- 172.21.15.170:0/2502371529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2970102b40 0x7f2970102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.187+0000 7f29770be640 1 -- 172.21.15.170:0/2502371529 >> 172.21.15.170:0/2502371529 conn(0x7f29700fc4c0 msgr2=0x7f29700fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:14.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.187+0000 7f29770be640 1 -- 172.21.15.170:0/2502371529 shutdown_connections 2024-09-04T16:41:14.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.187+0000 7f29770be640 1 -- 172.21.15.170:0/2502371529 wait complete. 2024-09-04T16:41:14.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.187+0000 7f29770be640 1 Processor -- start 2024-09-04T16:41:14.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.187+0000 7f29770be640 1 -- start start 2024-09-04T16:41:14.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f29770be640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2970102b40 0x7f297019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:14.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f29770be640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2970103460 0x7f297019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:14.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f29770be640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f297010edd0 con 0x7f2970102b40 2024-09-04T16:41:14.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f29770be640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f297010ec50 con 0x7f2970103460 2024-09-04T16:41:14.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f2974e5a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2970102b40 0x7f297019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:14.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f2974e5a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2970102b40 0x7f297019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43054/0 (socket says 172.21.15.170:43054) 2024-09-04T16:41:14.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f2974e5a640 1 -- 172.21.15.170:0/809344409 learned_addr learned my addr 172.21.15.170:0/809344409 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:41:14.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f296ffff640 1 --2- 172.21.15.170:0/809344409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2970103460 0x7f297019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:14.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f2974e5a640 1 -- 172.21.15.170:0/809344409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2970103460 msgr2=0x7f297019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:14.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f2974e5a640 1 --2- 172.21.15.170:0/809344409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2970103460 0x7f297019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f2974e5a640 1 -- 172.21.15.170:0/809344409 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29701977c0 con 0x7f2970102b40 2024-09-04T16:41:14.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f296ffff640 1 --2- 172.21.15.170:0/809344409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2970103460 0x7f297019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:41:14.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f2974e5a640 1 --2- 172.21.15.170:0/809344409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2970102b40 0x7f297019d640 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f296400e970 tx=0x7f296400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:14.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f296dffb640 1 -- 172.21.15.170:0/809344409 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f296400cac0 con 0x7f2970102b40 2024-09-04T16:41:14.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f296dffb640 1 -- 172.21.15.170:0/809344409 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f29640054e0 con 0x7f2970102b40 2024-09-04T16:41:14.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f29770be640 1 -- 172.21.15.170:0/809344409 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2970197ab0 con 0x7f2970102b40 2024-09-04T16:41:14.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.188+0000 7f296dffb640 1 -- 172.21.15.170:0/809344409 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2964010430 con 0x7f2970102b40 2024-09-04T16:41:14.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.189+0000 7f29770be640 1 -- 172.21.15.170:0/809344409 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2970198010 con 0x7f2970102b40 2024-09-04T16:41:14.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.190+0000 7f29770be640 1 -- 172.21.15.170:0/809344409 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f297006a370 con 0x7f2970102b40 2024-09-04T16:41:14.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.190+0000 7f296dffb640 1 -- 172.21.15.170:0/809344409 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f2964004e80 con 0x7f2970102b40 2024-09-04T16:41:14.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.191+0000 7f296dffb640 1 --2- 172.21.15.170:0/809344409 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2960079e30 0x7f296007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:14.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.191+0000 7f296dffb640 1 -- 172.21.15.170:0/809344409 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f296409d180 con 0x7f2970102b40 2024-09-04T16:41:14.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.191+0000 7f296ffff640 1 --2- 172.21.15.170:0/809344409 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2960079e30 0x7f296007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:14.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.192+0000 7f296ffff640 1 --2- 172.21.15.170:0/809344409 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2960079e30 0x7f296007c2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2970198b10 tx=0x7f295c004f30 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:14.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.195+0000 7f296dffb640 1 -- 172.21.15.170:0/809344409 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2964064b90 con 0x7f2970102b40 2024-09-04T16:41:14.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.389+0000 7f29770be640 1 -- 172.21.15.170:0/809344409 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2970198320 con 0x7f2960079e30 2024-09-04T16:41:14.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.391+0000 7f296dffb640 1 -- 172.21.15.170:0/809344409 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2970198320 con 0x7f2960079e30 2024-09-04T16:41:14.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.393+0000 7f29770be640 1 -- 172.21.15.170:0/809344409 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2960079e30 msgr2=0x7f296007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:14.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.393+0000 7f29770be640 1 --2- 172.21.15.170:0/809344409 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2960079e30 0x7f296007c2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2970198b10 tx=0x7f295c004f30 comp rx=0 tx=0).stop 2024-09-04T16:41:14.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.393+0000 7f29770be640 1 -- 172.21.15.170:0/809344409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2970102b40 msgr2=0x7f297019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:14.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.393+0000 7f29770be640 1 --2- 172.21.15.170:0/809344409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2970102b40 0x7f297019d640 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f296400e970 tx=0x7f296400ed70 comp rx=0 tx=0).stop 2024-09-04T16:41:14.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.393+0000 7f29770be640 1 -- 172.21.15.170:0/809344409 shutdown_connections 2024-09-04T16:41:14.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.393+0000 7f29770be640 1 --2- 172.21.15.170:0/809344409 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2960079e30 0x7f296007c2f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.393+0000 7f29770be640 1 --2- 172.21.15.170:0/809344409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2970103460 0x7f297019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.393+0000 7f29770be640 1 --2- 172.21.15.170:0/809344409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2970102b40 0x7f297019d640 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.393+0000 7f29770be640 1 -- 172.21.15.170:0/809344409 >> 172.21.15.170:0/809344409 conn(0x7f29700fc4c0 msgr2=0x7f2970103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:14.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.393+0000 7f29770be640 1 -- 172.21.15.170:0/809344409 shutdown_connections 2024-09-04T16:41:14.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.393+0000 7f29770be640 1 -- 172.21.15.170:0/809344409 wait complete. 2024-09-04T16:41:14.402 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:41:14.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.476+0000 7f99b0d91640 1 -- 172.21.15.170:0/3802246993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99ac107930 msgr2=0x7f99ac107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:14.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.476+0000 7f99b0d91640 1 --2- 172.21.15.170:0/3802246993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99ac107930 0x7f99ac107d10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f999c009880 tx=0x7f999c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.477 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:41:14.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.476+0000 7f99b0d91640 1 -- 172.21.15.170:0/3802246993 shutdown_connections 2024-09-04T16:41:14.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.476+0000 7f99b0d91640 1 --2- 172.21.15.170:0/3802246993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99ac101930 0x7f99ac101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.476+0000 7f99b0d91640 1 --2- 172.21.15.170:0/3802246993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99ac107930 0x7f99ac107d10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.476+0000 7f99b0d91640 1 -- 172.21.15.170:0/3802246993 >> 172.21.15.170:0/3802246993 conn(0x7f99ac0fd630 msgr2=0x7f99ac0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:14.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.476+0000 7f99b0d91640 1 -- 172.21.15.170:0/3802246993 shutdown_connections 2024-09-04T16:41:14.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.476+0000 7f99b0d91640 1 -- 172.21.15.170:0/3802246993 wait complete. 2024-09-04T16:41:14.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.477+0000 7f99b0d91640 1 Processor -- start 2024-09-04T16:41:14.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.477+0000 7f99b0d91640 1 -- start start 2024-09-04T16:41:14.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.477+0000 7f99b0d91640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99ac101930 0x7f99ac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:14.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.477+0000 7f99b0d91640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99ac107930 0x7f99ac074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:14.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.477+0000 7f99b0d91640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac10ede0 con 0x7f99ac107930 2024-09-04T16:41:14.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.477+0000 7f99b0d91640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac10ec60 con 0x7f99ac101930 2024-09-04T16:41:14.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.477+0000 7f99a9d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99ac107930 0x7f99ac074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:14.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.477+0000 7f99a9d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99ac107930 0x7f99ac074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43074/0 (socket says 172.21.15.170:43074) 2024-09-04T16:41:14.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.477+0000 7f99a9d9b640 1 -- 172.21.15.170:0/3553673184 learned_addr learned my addr 172.21.15.170:0/3553673184 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:41:14.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.477+0000 7f99aa59c640 1 --2- 172.21.15.170:0/3553673184 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99ac101930 0x7f99ac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:14.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.477+0000 7f99a9d9b640 1 -- 172.21.15.170:0/3553673184 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99ac101930 msgr2=0x7f99ac0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:14.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.477+0000 7f99a9d9b640 1 --2- 172.21.15.170:0/3553673184 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99ac101930 0x7f99ac0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.477+0000 7f99a9d9b640 1 -- 172.21.15.170:0/3553673184 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ac074f70 con 0x7f99ac107930 2024-09-04T16:41:14.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.478+0000 7f99a9d9b640 1 --2- 172.21.15.170:0/3553673184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99ac107930 0x7f99ac074a30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f999400c810 tx=0x7f999400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:14.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.478+0000 7f99a37fe640 1 -- 172.21.15.170:0/3553673184 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9994004020 con 0x7f99ac107930 2024-09-04T16:41:14.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.478+0000 7f99b0d91640 1 -- 172.21.15.170:0/3553673184 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99ac075260 con 0x7f99ac107930 2024-09-04T16:41:14.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.478+0000 7f99a37fe640 1 -- 172.21.15.170:0/3553673184 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f99940041c0 con 0x7f99ac107930 2024-09-04T16:41:14.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.478+0000 7f99a37fe640 1 -- 172.21.15.170:0/3553673184 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f99940047a0 con 0x7f99ac107930 2024-09-04T16:41:14.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.478+0000 7f99b0d91640 1 -- 172.21.15.170:0/3553673184 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99ac1a3e90 con 0x7f99ac107930 2024-09-04T16:41:14.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.479+0000 7f99b0d91640 1 -- 172.21.15.170:0/3553673184 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99ac103070 con 0x7f99ac107930 2024-09-04T16:41:14.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.480+0000 7f99a37fe640 1 -- 172.21.15.170:0/3553673184 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f99940079b0 con 0x7f99ac107930 2024-09-04T16:41:14.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.480+0000 7f99a37fe640 1 --2- 172.21.15.170:0/3553673184 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9998079e30 0x7f999807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:14.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.480+0000 7f99a37fe640 1 -- 172.21.15.170:0/3553673184 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f999409c980 con 0x7f99ac107930 2024-09-04T16:41:14.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.480+0000 7f99aa59c640 1 --2- 172.21.15.170:0/3553673184 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9998079e30 0x7f999807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:14.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.481+0000 7f99aa59c640 1 --2- 172.21.15.170:0/3553673184 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9998079e30 0x7f999807c2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f999c000c00 tx=0x7f999c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:14.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.485+0000 7f99a37fe640 1 -- 172.21.15.170:0/3553673184 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9994014030 con 0x7f99ac107930 2024-09-04T16:41:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:41:14.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.674+0000 7f99b0d91640 1 -- 172.21.15.170:0/3553673184 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f99ac062630 con 0x7f9998079e30 2024-09-04T16:41:14.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.676+0000 7f99a37fe640 1 -- 172.21.15.170:0/3553673184 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f99ac062630 con 0x7f9998079e30 2024-09-04T16:41:14.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.678+0000 7f99b0d91640 1 -- 172.21.15.170:0/3553673184 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9998079e30 msgr2=0x7f999807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:14.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.678+0000 7f99b0d91640 1 --2- 172.21.15.170:0/3553673184 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9998079e30 0x7f999807c2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f999c000c00 tx=0x7f999c031400 comp rx=0 tx=0).stop 2024-09-04T16:41:14.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.678+0000 7f99b0d91640 1 -- 172.21.15.170:0/3553673184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99ac107930 msgr2=0x7f99ac074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:14.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.678+0000 7f99b0d91640 1 --2- 172.21.15.170:0/3553673184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99ac107930 0x7f99ac074a30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f999400c810 tx=0x7f999400ccd0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.678+0000 7f99b0d91640 1 -- 172.21.15.170:0/3553673184 shutdown_connections 2024-09-04T16:41:14.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.678+0000 7f99b0d91640 1 --2- 172.21.15.170:0/3553673184 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9998079e30 0x7f999807c2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.678+0000 7f99b0d91640 1 --2- 172.21.15.170:0/3553673184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99ac107930 0x7f99ac074a30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.678+0000 7f99b0d91640 1 --2- 172.21.15.170:0/3553673184 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99ac101930 0x7f99ac0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.678+0000 7f99b0d91640 1 -- 172.21.15.170:0/3553673184 >> 172.21.15.170:0/3553673184 conn(0x7f99ac0fd630 msgr2=0x7f99ac0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:14.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.678+0000 7f99b0d91640 1 -- 172.21.15.170:0/3553673184 shutdown_connections 2024-09-04T16:41:14.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.678+0000 7f99b0d91640 1 -- 172.21.15.170:0/3553673184 wait complete. 2024-09-04T16:41:14.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.760+0000 7fc3a5a80640 1 -- 172.21.15.170:0/684975908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3a0107930 msgr2=0x7fc3a0107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:14.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.760+0000 7fc3a5a80640 1 --2- 172.21.15.170:0/684975908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3a0107930 0x7fc3a0107d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc390009880 tx=0x7fc39002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.760+0000 7fc3a5a80640 1 -- 172.21.15.170:0/684975908 shutdown_connections 2024-09-04T16:41:14.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.760+0000 7fc3a5a80640 1 --2- 172.21.15.170:0/684975908 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3a0101930 0x7fc3a0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.760+0000 7fc3a5a80640 1 --2- 172.21.15.170:0/684975908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3a0107930 0x7fc3a0107d10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.760+0000 7fc3a5a80640 1 -- 172.21.15.170:0/684975908 >> 172.21.15.170:0/684975908 conn(0x7fc3a00fd630 msgr2=0x7fc3a00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:14.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.760+0000 7fc3a5a80640 1 -- 172.21.15.170:0/684975908 shutdown_connections 2024-09-04T16:41:14.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.760+0000 7fc3a5a80640 1 -- 172.21.15.170:0/684975908 wait complete. 2024-09-04T16:41:14.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.761+0000 7fc3a5a80640 1 Processor -- start 2024-09-04T16:41:14.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.761+0000 7fc3a5a80640 1 -- start start 2024-09-04T16:41:14.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.761+0000 7fc3a5a80640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3a0101930 0x7fc3a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:14.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.761+0000 7fc3a5a80640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3a0107930 0x7fc3a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:14.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.761+0000 7fc3a5a80640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a010ede0 con 0x7fc3a0107930 2024-09-04T16:41:14.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.761+0000 7fc3a5a80640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a010ec60 con 0x7fc3a0101930 2024-09-04T16:41:14.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.761+0000 7fc39effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3a0107930 0x7fc3a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:14.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.761+0000 7fc39effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3a0107930 0x7fc3a0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43086/0 (socket says 172.21.15.170:43086) 2024-09-04T16:41:14.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.761+0000 7fc39effd640 1 -- 172.21.15.170:0/4018757546 learned_addr learned my addr 172.21.15.170:0/4018757546 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:41:14.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.762+0000 7fc39f7fe640 1 --2- 172.21.15.170:0/4018757546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3a0101930 0x7fc3a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:14.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.762+0000 7fc39effd640 1 -- 172.21.15.170:0/4018757546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3a0101930 msgr2=0x7fc3a00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:14.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.762+0000 7fc39effd640 1 --2- 172.21.15.170:0/4018757546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3a0101930 0x7fc3a00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.762+0000 7fc39effd640 1 -- 172.21.15.170:0/4018757546 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a0074f70 con 0x7fc3a0107930 2024-09-04T16:41:14.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.762+0000 7fc39f7fe640 1 --2- 172.21.15.170:0/4018757546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3a0101930 0x7fc3a00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:41:14.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.762+0000 7fc39effd640 1 --2- 172.21.15.170:0/4018757546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3a0107930 0x7fc3a0074a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc39400d8d0 tx=0x7fc39400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:14.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.762+0000 7fc39cff9640 1 -- 172.21.15.170:0/4018757546 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc394017070 con 0x7fc3a0107930 2024-09-04T16:41:14.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.762+0000 7fc3a5a80640 1 -- 172.21.15.170:0/4018757546 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a0075260 con 0x7fc3a0107930 2024-09-04T16:41:14.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.762+0000 7fc39cff9640 1 -- 172.21.15.170:0/4018757546 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc394010460 con 0x7fc3a0107930 2024-09-04T16:41:14.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.763+0000 7fc39cff9640 1 -- 172.21.15.170:0/4018757546 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc39400f5f0 con 0x7fc3a0107930 2024-09-04T16:41:14.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.763+0000 7fc3a5a80640 1 -- 172.21.15.170:0/4018757546 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a01a3e50 con 0x7fc3a0107930 2024-09-04T16:41:14.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.764+0000 7fc3a5a80640 1 -- 172.21.15.170:0/4018757546 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3a0103070 con 0x7fc3a0107930 2024-09-04T16:41:14.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.764+0000 7fc39cff9640 1 -- 172.21.15.170:0/4018757546 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fc394009a30 con 0x7fc3a0107930 2024-09-04T16:41:14.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.764+0000 7fc39cff9640 1 --2- 172.21.15.170:0/4018757546 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc388079e30 0x7fc38807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:14.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.765+0000 7fc39cff9640 1 -- 172.21.15.170:0/4018757546 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc39409c920 con 0x7fc3a0107930 2024-09-04T16:41:14.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.765+0000 7fc39f7fe640 1 --2- 172.21.15.170:0/4018757546 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc388079e30 0x7fc38807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:14.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.765+0000 7fc39f7fe640 1 --2- 172.21.15.170:0/4018757546 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc388079e30 0x7fc38807c2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc3900096c0 tx=0x7fc390031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:14.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.769+0000 7fc39cff9640 1 -- 172.21.15.170:0/4018757546 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc3940684a0 con 0x7fc3a0107930 2024-09-04T16:41:14.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.953+0000 7fc3a5a80640 1 -- 172.21.15.170:0/4018757546 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc3a0062630 con 0x7fc388079e30 2024-09-04T16:41:14.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.963+0000 7fc39cff9640 1 -- 172.21.15.170:0/4018757546 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc3a0062630 con 0x7fc388079e30 2024-09-04T16:41:14.964 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:41:14.964 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (8m) 2m ago 19m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:41:14.964 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (11m) 2m ago 19m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:41:14.964 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (10m) 2m ago 18m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:41:14.964 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (6m) 2m ago 19m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:41:14.964 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (6m) 2m ago 18m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:41:14.964 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (7m) 2m ago 18m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:41:14.964 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (2m) 2m ago 13m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:41:14.964 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (2m) 2m ago 13m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:41:14.964 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (2m) 2m ago 13m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:41:14.964 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (2m) 2m ago 13m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:41:14.964 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (10m) 2m ago 20m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:41:14.964 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (9m) 2m ago 18m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:41:14.964 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (6m) 2m ago 20m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:41:14.965 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (6m) 2m ago 18m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:41:14.965 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (9m) 2m ago 19m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:41:14.965 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (8m) 2m ago 18m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:41:14.965 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (5m) 2m ago 17m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:41:14.965 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (5m) 2m ago 16m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:41:14.965 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (4m) 2m ago 16m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:41:14.965 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (4m) 2m ago 15m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:41:14.965 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (3m) 2m ago 15m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:41:14.965 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (3m) 2m ago 14m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:41:14.965 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (8m) 2m ago 18m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:41:14.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.966+0000 7fc3a5a80640 1 -- 172.21.15.170:0/4018757546 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc388079e30 msgr2=0x7fc38807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:14.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.966+0000 7fc3a5a80640 1 --2- 172.21.15.170:0/4018757546 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc388079e30 0x7fc38807c2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc3900096c0 tx=0x7fc390031400 comp rx=0 tx=0).stop 2024-09-04T16:41:14.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.966+0000 7fc3a5a80640 1 -- 172.21.15.170:0/4018757546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3a0107930 msgr2=0x7fc3a0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:14.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.966+0000 7fc3a5a80640 1 --2- 172.21.15.170:0/4018757546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3a0107930 0x7fc3a0074a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc39400d8d0 tx=0x7fc39400dd90 comp rx=0 tx=0).stop 2024-09-04T16:41:14.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.966+0000 7fc3a5a80640 1 -- 172.21.15.170:0/4018757546 shutdown_connections 2024-09-04T16:41:14.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.966+0000 7fc3a5a80640 1 --2- 172.21.15.170:0/4018757546 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc388079e30 0x7fc38807c2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.966+0000 7fc3a5a80640 1 --2- 172.21.15.170:0/4018757546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3a0107930 0x7fc3a0074a30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.966+0000 7fc3a5a80640 1 --2- 172.21.15.170:0/4018757546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3a0101930 0x7fc3a00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:14.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.966+0000 7fc3a5a80640 1 -- 172.21.15.170:0/4018757546 >> 172.21.15.170:0/4018757546 conn(0x7fc3a00fd630 msgr2=0x7fc3a00fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:14.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.966+0000 7fc3a5a80640 1 -- 172.21.15.170:0/4018757546 shutdown_connections 2024-09-04T16:41:14.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:14.966+0000 7fc3a5a80640 1 -- 172.21.15.170:0/4018757546 wait complete. 2024-09-04T16:41:15.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.046+0000 7f4b990be640 1 -- 172.21.15.170:0/4284023524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b94107930 msgr2=0x7f4b94107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:15.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.046+0000 7f4b990be640 1 --2- 172.21.15.170:0/4284023524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b94107930 0x7f4b94107d10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4b84009880 tx=0x7f4b8402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.046+0000 7f4b990be640 1 -- 172.21.15.170:0/4284023524 shutdown_connections 2024-09-04T16:41:15.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.046+0000 7f4b990be640 1 --2- 172.21.15.170:0/4284023524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b94101930 0x7f4b94101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.046+0000 7f4b990be640 1 --2- 172.21.15.170:0/4284023524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b94107930 0x7f4b94107d10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.046+0000 7f4b990be640 1 -- 172.21.15.170:0/4284023524 >> 172.21.15.170:0/4284023524 conn(0x7f4b940fd630 msgr2=0x7f4b940ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:15.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.046+0000 7f4b990be640 1 -- 172.21.15.170:0/4284023524 shutdown_connections 2024-09-04T16:41:15.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.046+0000 7f4b990be640 1 -- 172.21.15.170:0/4284023524 wait complete. 2024-09-04T16:41:15.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.047+0000 7f4b990be640 1 Processor -- start 2024-09-04T16:41:15.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.047+0000 7f4b990be640 1 -- start start 2024-09-04T16:41:15.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.047+0000 7f4b990be640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b94101930 0x7f4b9419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:15.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.048+0000 7f4b990be640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b94107930 0x7f4b9419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:15.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.048+0000 7f4b990be640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9410ede0 con 0x7f4b94107930 2024-09-04T16:41:15.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.048+0000 7f4b990be640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9410ec60 con 0x7f4b94101930 2024-09-04T16:41:15.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.048+0000 7f4b8bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b94107930 0x7f4b9419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:15.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.048+0000 7f4b8bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b94107930 0x7f4b9419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55112/0 (socket says 172.21.15.170:55112) 2024-09-04T16:41:15.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.048+0000 7f4b8bfff640 1 -- 172.21.15.170:0/259202085 learned_addr learned my addr 172.21.15.170:0/259202085 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:41:15.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.048+0000 7f4b92d9d640 1 --2- 172.21.15.170:0/259202085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b94101930 0x7f4b9419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:15.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.048+0000 7f4b8bfff640 1 -- 172.21.15.170:0/259202085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b94101930 msgr2=0x7f4b9419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:15.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.048+0000 7f4b8bfff640 1 --2- 172.21.15.170:0/259202085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b94101930 0x7f4b9419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.048+0000 7f4b8bfff640 1 -- 172.21.15.170:0/259202085 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b941977d0 con 0x7f4b94107930 2024-09-04T16:41:15.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.048+0000 7f4b8bfff640 1 --2- 172.21.15.170:0/259202085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b94107930 0x7f4b9419db90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00d8d0 tx=0x7f4b7c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:15.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.048+0000 7f4b90d99640 1 -- 172.21.15.170:0/259202085 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b7c017070 con 0x7f4b94107930 2024-09-04T16:41:15.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.048+0000 7f4b90d99640 1 -- 172.21.15.170:0/259202085 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b7c010460 con 0x7f4b94107930 2024-09-04T16:41:15.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.048+0000 7f4b990be640 1 -- 172.21.15.170:0/259202085 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b94197ac0 con 0x7f4b94107930 2024-09-04T16:41:15.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.048+0000 7f4b90d99640 1 -- 172.21.15.170:0/259202085 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b7c00f5f0 con 0x7f4b94107930 2024-09-04T16:41:15.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.048+0000 7f4b990be640 1 -- 172.21.15.170:0/259202085 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b94198050 con 0x7f4b94107930 2024-09-04T16:41:15.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.049+0000 7f4b990be640 1 -- 172.21.15.170:0/259202085 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b94103070 con 0x7f4b94107930 2024-09-04T16:41:15.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.050+0000 7f4b90d99640 1 -- 172.21.15.170:0/259202085 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f4b7c009a30 con 0x7f4b94107930 2024-09-04T16:41:15.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.051+0000 7f4b90d99640 1 --2- 172.21.15.170:0/259202085 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4b80079e30 0x7f4b8007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:15.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.051+0000 7f4b90d99640 1 -- 172.21.15.170:0/259202085 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4b7c09c990 con 0x7f4b94107930 2024-09-04T16:41:15.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.051+0000 7f4b92d9d640 1 --2- 172.21.15.170:0/259202085 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4b80079e30 0x7f4b8007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:15.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.051+0000 7f4b92d9d640 1 --2- 172.21.15.170:0/259202085 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4b80079e30 0x7f4b8007c2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4b840096c0 tx=0x7f4b84031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:15.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.056+0000 7f4b90d99640 1 -- 172.21.15.170:0/259202085 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4b7c0643a0 con 0x7f4b94107930 2024-09-04T16:41:15.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.302+0000 7f4b990be640 1 -- 172.21.15.170:0/259202085 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4b94104b40 con 0x7f4b94107930 2024-09-04T16:41:15.303 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:15 smithi170 ceph-mon[113855]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:41:15.303 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:15 smithi170 ceph-mon[113855]: pgmap v346: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:15.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.302+0000 7f4b90d99640 1 -- 172.21.15.170:0/259202085 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f4b7c068510 con 0x7f4b94107930 2024-09-04T16:41:15.303 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:41:15.303 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:41:15.304 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:41:15.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:41:15.304 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:41:15.304 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:41:15.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:41:15.304 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:41:15.304 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:41:15.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:41:15.304 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:41:15.304 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:41:15.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:41:15.304 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:41:15.305 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:41:15.305 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:41:15.305 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:41:15.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.304+0000 7f4b990be640 1 -- 172.21.15.170:0/259202085 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4b80079e30 msgr2=0x7f4b8007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:15.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.304+0000 7f4b990be640 1 --2- 172.21.15.170:0/259202085 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4b80079e30 0x7f4b8007c2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4b840096c0 tx=0x7f4b84031400 comp rx=0 tx=0).stop 2024-09-04T16:41:15.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.304+0000 7f4b990be640 1 -- 172.21.15.170:0/259202085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b94107930 msgr2=0x7f4b9419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:15.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.304+0000 7f4b990be640 1 --2- 172.21.15.170:0/259202085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b94107930 0x7f4b9419db90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00d8d0 tx=0x7f4b7c00dd90 comp rx=0 tx=0).stop 2024-09-04T16:41:15.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.304+0000 7f4b990be640 1 -- 172.21.15.170:0/259202085 shutdown_connections 2024-09-04T16:41:15.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.304+0000 7f4b990be640 1 --2- 172.21.15.170:0/259202085 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4b80079e30 0x7f4b8007c2f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.304+0000 7f4b990be640 1 --2- 172.21.15.170:0/259202085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b94107930 0x7f4b9419db90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.304+0000 7f4b990be640 1 --2- 172.21.15.170:0/259202085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b94101930 0x7f4b9419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.304+0000 7f4b990be640 1 -- 172.21.15.170:0/259202085 >> 172.21.15.170:0/259202085 conn(0x7f4b940fd630 msgr2=0x7f4b940fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:15.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.304+0000 7f4b990be640 1 -- 172.21.15.170:0/259202085 shutdown_connections 2024-09-04T16:41:15.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.304+0000 7f4b990be640 1 -- 172.21.15.170:0/259202085 wait complete. 2024-09-04T16:41:15.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.386+0000 7f601b169640 1 -- 172.21.15.170:0/4127239371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60141007e0 msgr2=0x7f6014100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:15.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.386+0000 7f601b169640 1 --2- 172.21.15.170:0/4127239371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60141007e0 0x7f6014100c40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6000009880 tx=0x7f600002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.386+0000 7f601b169640 1 -- 172.21.15.170:0/4127239371 shutdown_connections 2024-09-04T16:41:15.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.386+0000 7f601b169640 1 --2- 172.21.15.170:0/4127239371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60141007e0 0x7f6014100c40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.386+0000 7f601b169640 1 --2- 172.21.15.170:0/4127239371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f60141067e0 0x7f6014106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.386+0000 7f601b169640 1 -- 172.21.15.170:0/4127239371 >> 172.21.15.170:0/4127239371 conn(0x7f60140fc4c0 msgr2=0x7f60140fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:15.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.386+0000 7f601b169640 1 -- 172.21.15.170:0/4127239371 shutdown_connections 2024-09-04T16:41:15.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.386+0000 7f601b169640 1 -- 172.21.15.170:0/4127239371 wait complete. 2024-09-04T16:41:15.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.386+0000 7f601b169640 1 Processor -- start 2024-09-04T16:41:15.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.386+0000 7f601b169640 1 -- start start 2024-09-04T16:41:15.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.387+0000 7f601b169640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60141007e0 0x7f601419f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:15.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.387+0000 7f601b169640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f60141067e0 0x7f601419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:15.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.387+0000 7f601b169640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f601410dc90 con 0x7f60141007e0 2024-09-04T16:41:15.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.387+0000 7f601b169640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f601410db10 con 0x7f60141067e0 2024-09-04T16:41:15.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.387+0000 7f6018f05640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60141007e0 0x7f601419f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:15.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.387+0000 7f6018f05640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60141007e0 0x7f601419f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55128/0 (socket says 172.21.15.170:55128) 2024-09-04T16:41:15.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.387+0000 7f6018f05640 1 -- 172.21.15.170:0/3686201525 learned_addr learned my addr 172.21.15.170:0/3686201525 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:41:15.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.387+0000 7f6013fff640 1 --2- 172.21.15.170:0/3686201525 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f60141067e0 0x7f601419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:15.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.387+0000 7f6018f05640 1 -- 172.21.15.170:0/3686201525 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f60141067e0 msgr2=0x7f601419fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:15.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.387+0000 7f6018f05640 1 --2- 172.21.15.170:0/3686201525 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f60141067e0 0x7f601419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.387+0000 7f6018f05640 1 -- 172.21.15.170:0/3686201525 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60141999a0 con 0x7f60141007e0 2024-09-04T16:41:15.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.387+0000 7f6018f05640 1 --2- 172.21.15.170:0/3686201525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60141007e0 0x7f601419f7e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f600800d8d0 tx=0x7f600800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:15.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.387+0000 7f6011ffb640 1 -- 172.21.15.170:0/3686201525 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6008017070 con 0x7f60141007e0 2024-09-04T16:41:15.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.387+0000 7f6011ffb640 1 -- 172.21.15.170:0/3686201525 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6008010460 con 0x7f60141007e0 2024-09-04T16:41:15.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.387+0000 7f6011ffb640 1 -- 172.21.15.170:0/3686201525 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f600800f5f0 con 0x7f60141007e0 2024-09-04T16:41:15.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.387+0000 7f601b169640 1 -- 172.21.15.170:0/3686201525 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6014199c90 con 0x7f60141007e0 2024-09-04T16:41:15.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.388+0000 7f601b169640 1 -- 172.21.15.170:0/3686201525 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f601419a220 con 0x7f60141007e0 2024-09-04T16:41:15.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.389+0000 7f601b169640 1 -- 172.21.15.170:0/3686201525 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6014101f20 con 0x7f60141007e0 2024-09-04T16:41:15.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.389+0000 7f6011ffb640 1 -- 172.21.15.170:0/3686201525 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f6008009a30 con 0x7f60141007e0 2024-09-04T16:41:15.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.390+0000 7f6011ffb640 1 --2- 172.21.15.170:0/3686201525 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6004079e30 0x7f600407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:15.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.390+0000 7f6011ffb640 1 -- 172.21.15.170:0/3686201525 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f600809c990 con 0x7f60141007e0 2024-09-04T16:41:15.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.390+0000 7f6013fff640 1 --2- 172.21.15.170:0/3686201525 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6004079e30 0x7f600407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:15.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.390+0000 7f6013fff640 1 --2- 172.21.15.170:0/3686201525 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6004079e30 0x7f600407c2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6000031460 tx=0x7f6000009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:15.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.394+0000 7f6011ffb640 1 -- 172.21.15.170:0/3686201525 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f60080643a0 con 0x7f60141007e0 2024-09-04T16:41:15.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.605+0000 7f601b169640 1 -- 172.21.15.170:0/3686201525 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f601419a4d0 con 0x7f60141007e0 2024-09-04T16:41:15.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.606+0000 7f6011ffb640 1 -- 172.21.15.170:0/3686201525 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7f6008068510 con 0x7f60141007e0 2024-09-04T16:41:15.607 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:41:15.607 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:41:15.607 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:41:15.608 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:41:15.608 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:41:15.608 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:41:15.608 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:41:15.608 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:41:15.608 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:41:15.608 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:41:15.608 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:41:15.609 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:41:15.609 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:41:15.609 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:41:15.609 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:41:15.609 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:41:15.609 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:41:15.609 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:41:15.609 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:41:15.610 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:41:15.610 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:41:15.610 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:41:15.610 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:41:15.610 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:41:15.610 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:41:15.610 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:41:15.610 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:41:15.611 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:41:15.611 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:41:15.611 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:41:15.611 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:41:15.611 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:41:15.611 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:41:15.611 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:41:15.611 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:41:15.612 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:41:15.612 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:41:15.612 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:41:15.612 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:41:15.612 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:41:15.612 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:41:15.612 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:41:15.612 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:41:15.614 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:41:15.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.608+0000 7f601b169640 1 -- 172.21.15.170:0/3686201525 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6004079e30 msgr2=0x7f600407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:15.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.608+0000 7f601b169640 1 --2- 172.21.15.170:0/3686201525 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6004079e30 0x7f600407c2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6000031460 tx=0x7f6000009560 comp rx=0 tx=0).stop 2024-09-04T16:41:15.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.608+0000 7f601b169640 1 -- 172.21.15.170:0/3686201525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60141007e0 msgr2=0x7f601419f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:15.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.608+0000 7f601b169640 1 --2- 172.21.15.170:0/3686201525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60141007e0 0x7f601419f7e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f600800d8d0 tx=0x7f600800dd90 comp rx=0 tx=0).stop 2024-09-04T16:41:15.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.608+0000 7f601b169640 1 -- 172.21.15.170:0/3686201525 shutdown_connections 2024-09-04T16:41:15.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.608+0000 7f601b169640 1 --2- 172.21.15.170:0/3686201525 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6004079e30 0x7f600407c2f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.608+0000 7f601b169640 1 --2- 172.21.15.170:0/3686201525 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f60141067e0 0x7f601419fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.608+0000 7f601b169640 1 --2- 172.21.15.170:0/3686201525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60141007e0 0x7f601419f7e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.608+0000 7f601b169640 1 -- 172.21.15.170:0/3686201525 >> 172.21.15.170:0/3686201525 conn(0x7f60140fc4c0 msgr2=0x7f60140fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:15.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.608+0000 7f601b169640 1 -- 172.21.15.170:0/3686201525 shutdown_connections 2024-09-04T16:41:15.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.608+0000 7f601b169640 1 -- 172.21.15.170:0/3686201525 wait complete. 2024-09-04T16:41:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:15 smithi193 ceph-mon[82547]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:41:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:15 smithi193 ceph-mon[82547]: pgmap v346: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:15.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.690+0000 7f01542d8640 1 -- 172.21.15.170:0/3335245559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f014c100820 msgr2=0x7f014c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.690+0000 7f01542d8640 1 --2- 172.21.15.170:0/3335245559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f014c100820 0x7f014c100c80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f013c009880 tx=0x7f013c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.690+0000 7f01542d8640 1 -- 172.21.15.170:0/3335245559 shutdown_connections 2024-09-04T16:41:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.690+0000 7f01542d8640 1 --2- 172.21.15.170:0/3335245559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f014c100820 0x7f014c100c80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.690+0000 7f01542d8640 1 --2- 172.21.15.170:0/3335245559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f014c106820 0x7f014c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.690+0000 7f01542d8640 1 -- 172.21.15.170:0/3335245559 >> 172.21.15.170:0/3335245559 conn(0x7f014c0fc520 msgr2=0x7f014c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.690+0000 7f01542d8640 1 -- 172.21.15.170:0/3335245559 shutdown_connections 2024-09-04T16:41:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.690+0000 7f01542d8640 1 -- 172.21.15.170:0/3335245559 wait complete. 2024-09-04T16:41:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.691+0000 7f01542d8640 1 Processor -- start 2024-09-04T16:41:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.691+0000 7f01542d8640 1 -- start start 2024-09-04T16:41:15.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.691+0000 7f01542d8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f014c100820 0x7f014c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.691+0000 7f01542d8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f014c106820 0x7f014c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.691+0000 7f01542d8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f014c10dcd0 con 0x7f014c106820 2024-09-04T16:41:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.691+0000 7f01542d8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f014c10db50 con 0x7f014c100820 2024-09-04T16:41:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.691+0000 7f0151873640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f014c106820 0x7f014c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.691+0000 7f0151873640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f014c106820 0x7f014c19db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55134/0 (socket says 172.21.15.170:55134) 2024-09-04T16:41:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.691+0000 7f0151873640 1 -- 172.21.15.170:0/4071822620 learned_addr learned my addr 172.21.15.170:0/4071822620 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:41:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.691+0000 7f0152074640 1 --2- 172.21.15.170:0/4071822620 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f014c100820 0x7f014c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.691+0000 7f0151873640 1 -- 172.21.15.170:0/4071822620 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f014c100820 msgr2=0x7f014c19d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.691+0000 7f0151873640 1 --2- 172.21.15.170:0/4071822620 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f014c100820 0x7f014c19d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.691+0000 7f0151873640 1 -- 172.21.15.170:0/4071822620 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f014c1977c0 con 0x7f014c106820 2024-09-04T16:41:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.691+0000 7f0152074640 1 --2- 172.21.15.170:0/4071822620 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f014c100820 0x7f014c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:41:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.692+0000 7f0151873640 1 --2- 172.21.15.170:0/4071822620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f014c106820 0x7f014c19db80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f013c031460 tx=0x7f013c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:15.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.692+0000 7f01437fe640 1 -- 172.21.15.170:0/4071822620 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f013c03f070 con 0x7f014c106820 2024-09-04T16:41:15.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.692+0000 7f01542d8640 1 -- 172.21.15.170:0/4071822620 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f014c197a50 con 0x7f014c106820 2024-09-04T16:41:15.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.692+0000 7f01437fe640 1 -- 172.21.15.170:0/4071822620 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f013c0035f0 con 0x7f014c106820 2024-09-04T16:41:15.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.692+0000 7f01437fe640 1 -- 172.21.15.170:0/4071822620 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f013c035030 con 0x7f014c106820 2024-09-04T16:41:15.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.692+0000 7f01542d8640 1 -- 172.21.15.170:0/4071822620 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f014c197f80 con 0x7f014c106820 2024-09-04T16:41:15.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.693+0000 7f01542d8640 1 -- 172.21.15.170:0/4071822620 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f014c101f60 con 0x7f014c106820 2024-09-04T16:41:15.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.694+0000 7f01437fe640 1 -- 172.21.15.170:0/4071822620 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f013c042070 con 0x7f014c106820 2024-09-04T16:41:15.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.694+0000 7f01437fe640 1 --2- 172.21.15.170:0/4071822620 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0138079e30 0x7f013807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:15.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.694+0000 7f01437fe640 1 -- 172.21.15.170:0/4071822620 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f013c0bd460 con 0x7f014c106820 2024-09-04T16:41:15.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.694+0000 7f0152074640 1 --2- 172.21.15.170:0/4071822620 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0138079e30 0x7f013807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:15.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.695+0000 7f0152074640 1 --2- 172.21.15.170:0/4071822620 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0138079e30 0x7f013807c2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f01480058c0 tx=0x7f0148005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:15.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.699+0000 7f01437fe640 1 -- 172.21.15.170:0/4071822620 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f013c084e70 con 0x7f014c106820 2024-09-04T16:41:15.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.897+0000 7f01542d8640 1 -- 172.21.15.170:0/4071822620 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f014c1982f0 con 0x7f0138079e30 2024-09-04T16:41:15.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.899+0000 7f01437fe640 1 -- 172.21.15.170:0/4071822620 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f014c1982f0 con 0x7f0138079e30 2024-09-04T16:41:15.899 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:41:15.899 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:41:15.899 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:41:15.899 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:41:15.899 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:41:15.899 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:41:15.899 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:41:15.899 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:41:15.900 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:41:15.900 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:41:15.900 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:41:15.900 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:41:15.900 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:41:15.900 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:41:15.901 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:41:15.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.902+0000 7f01542d8640 1 -- 172.21.15.170:0/4071822620 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0138079e30 msgr2=0x7f013807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:15.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.902+0000 7f01542d8640 1 --2- 172.21.15.170:0/4071822620 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0138079e30 0x7f013807c2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f01480058c0 tx=0x7f0148005850 comp rx=0 tx=0).stop 2024-09-04T16:41:15.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.902+0000 7f01542d8640 1 -- 172.21.15.170:0/4071822620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f014c106820 msgr2=0x7f014c19db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:15.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.902+0000 7f01542d8640 1 --2- 172.21.15.170:0/4071822620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f014c106820 0x7f014c19db80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f013c031460 tx=0x7f013c0045e0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.902+0000 7f01542d8640 1 -- 172.21.15.170:0/4071822620 shutdown_connections 2024-09-04T16:41:15.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.902+0000 7f01542d8640 1 --2- 172.21.15.170:0/4071822620 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0138079e30 0x7f013807c2f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.902+0000 7f01542d8640 1 --2- 172.21.15.170:0/4071822620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f014c106820 0x7f014c19db80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.902+0000 7f01542d8640 1 --2- 172.21.15.170:0/4071822620 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f014c100820 0x7f014c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.902+0000 7f01542d8640 1 -- 172.21.15.170:0/4071822620 >> 172.21.15.170:0/4071822620 conn(0x7f014c0fc520 msgr2=0x7f014c104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:15.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.902+0000 7f01542d8640 1 -- 172.21.15.170:0/4071822620 shutdown_connections 2024-09-04T16:41:15.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.902+0000 7f01542d8640 1 -- 172.21.15.170:0/4071822620 wait complete. 2024-09-04T16:41:15.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.983+0000 7fa8b67b1640 1 -- 172.21.15.170:0/34070963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b0107930 msgr2=0x7fa8b0107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:15.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.983+0000 7fa8b67b1640 1 --2- 172.21.15.170:0/34070963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b0107930 0x7fa8b0107d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009880 tx=0x7fa8a002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.983+0000 7fa8b67b1640 1 -- 172.21.15.170:0/34070963 shutdown_connections 2024-09-04T16:41:15.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.983+0000 7fa8b67b1640 1 --2- 172.21.15.170:0/34070963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8b0101930 0x7fa8b0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.983+0000 7fa8b67b1640 1 --2- 172.21.15.170:0/34070963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b0107930 0x7fa8b0107d10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.983+0000 7fa8b67b1640 1 -- 172.21.15.170:0/34070963 >> 172.21.15.170:0/34070963 conn(0x7fa8b00fd630 msgr2=0x7fa8b00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:15.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.983+0000 7fa8b67b1640 1 -- 172.21.15.170:0/34070963 shutdown_connections 2024-09-04T16:41:15.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.983+0000 7fa8b67b1640 1 -- 172.21.15.170:0/34070963 wait complete. 2024-09-04T16:41:15.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.984+0000 7fa8b67b1640 1 Processor -- start 2024-09-04T16:41:15.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.984+0000 7fa8b67b1640 1 -- start start 2024-09-04T16:41:15.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.984+0000 7fa8b67b1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b0101930 0x7fa8b00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:15.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.984+0000 7fa8b67b1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8b0107930 0x7fa8b0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:15.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.984+0000 7fa8b67b1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b010ede0 con 0x7fa8b0101930 2024-09-04T16:41:15.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.984+0000 7fa8b67b1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b010ec60 con 0x7fa8b0107930 2024-09-04T16:41:15.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.984+0000 7fa8affff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b0101930 0x7fa8b00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:15.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.984+0000 7fa8affff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b0101930 0x7fa8b00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55152/0 (socket says 172.21.15.170:55152) 2024-09-04T16:41:15.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.984+0000 7fa8affff640 1 -- 172.21.15.170:0/3143700062 learned_addr learned my addr 172.21.15.170:0/3143700062 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:41:15.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.984+0000 7fa8af7fe640 1 --2- 172.21.15.170:0/3143700062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8b0107930 0x7fa8b0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:15.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.984+0000 7fa8affff640 1 -- 172.21.15.170:0/3143700062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8b0107930 msgr2=0x7fa8b0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:15.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.984+0000 7fa8affff640 1 --2- 172.21.15.170:0/3143700062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8b0107930 0x7fa8b0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:15.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.984+0000 7fa8affff640 1 -- 172.21.15.170:0/3143700062 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b0074f70 con 0x7fa8b0101930 2024-09-04T16:41:15.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.985+0000 7fa8affff640 1 --2- 172.21.15.170:0/3143700062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b0101930 0x7fa8b00744f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0031460 tx=0x7fa8a00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:15.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.985+0000 7fa8ad7fa640 1 -- 172.21.15.170:0/3143700062 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa8a003f070 con 0x7fa8b0101930 2024-09-04T16:41:15.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.985+0000 7fa8ad7fa640 1 -- 172.21.15.170:0/3143700062 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa8a00035f0 con 0x7fa8b0101930 2024-09-04T16:41:15.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.985+0000 7fa8b67b1640 1 -- 172.21.15.170:0/3143700062 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b0075200 con 0x7fa8b0101930 2024-09-04T16:41:15.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.985+0000 7fa8ad7fa640 1 -- 172.21.15.170:0/3143700062 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa8a0035030 con 0x7fa8b0101930 2024-09-04T16:41:15.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.985+0000 7fa8b67b1640 1 -- 172.21.15.170:0/3143700062 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b01a3d90 con 0x7fa8b0101930 2024-09-04T16:41:15.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.986+0000 7fa8b67b1640 1 -- 172.21.15.170:0/3143700062 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b0103070 con 0x7fa8b0101930 2024-09-04T16:41:15.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.987+0000 7fa8ad7fa640 1 -- 172.21.15.170:0/3143700062 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fa8a0042070 con 0x7fa8b0101930 2024-09-04T16:41:15.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.987+0000 7fa8ad7fa640 1 --2- 172.21.15.170:0/3143700062 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa89c079e30 0x7fa89c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:15.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.987+0000 7fa8ad7fa640 1 -- 172.21.15.170:0/3143700062 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa8a00bd460 con 0x7fa8b0101930 2024-09-04T16:41:15.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.987+0000 7fa8af7fe640 1 --2- 172.21.15.170:0/3143700062 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa89c079e30 0x7fa89c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:15.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.988+0000 7fa8af7fe640 1 --2- 172.21.15.170:0/3143700062 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa89c079e30 0x7fa89c07c2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0075f80 tx=0x7fa89800b590 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:15.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:15.991+0000 7fa8ad7fa640 1 -- 172.21.15.170:0/3143700062 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa8a0084e70 con 0x7fa8b0101930 2024-09-04T16:41:16.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:16.235+0000 7fa8b67b1640 1 -- 172.21.15.170:0/3143700062 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fa8b0101d90 con 0x7fa8b0101930 2024-09-04T16:41:16.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:16.236+0000 7fa8ad7fa640 1 -- 172.21.15.170:0/3143700062 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fa8a0088fe0 con 0x7fa8b0101930 2024-09-04T16:41:16.235 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:41:16.236 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:41:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:41:16.236 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:41:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:41:16.236 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:41:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:41:16.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:16.238+0000 7fa8b67b1640 1 -- 172.21.15.170:0/3143700062 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa89c079e30 msgr2=0x7fa89c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:16.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:16.238+0000 7fa8b67b1640 1 --2- 172.21.15.170:0/3143700062 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa89c079e30 0x7fa89c07c2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0075f80 tx=0x7fa89800b590 comp rx=0 tx=0).stop 2024-09-04T16:41:16.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:16.238+0000 7fa8b67b1640 1 -- 172.21.15.170:0/3143700062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b0101930 msgr2=0x7fa8b00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:16.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:16.238+0000 7fa8b67b1640 1 --2- 172.21.15.170:0/3143700062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b0101930 0x7fa8b00744f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0031460 tx=0x7fa8a00045e0 comp rx=0 tx=0).stop 2024-09-04T16:41:16.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:16.238+0000 7fa8b67b1640 1 -- 172.21.15.170:0/3143700062 shutdown_connections 2024-09-04T16:41:16.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:16.238+0000 7fa8b67b1640 1 --2- 172.21.15.170:0/3143700062 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa89c079e30 0x7fa89c07c2f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:16.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:16.238+0000 7fa8b67b1640 1 --2- 172.21.15.170:0/3143700062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8b0107930 0x7fa8b0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:16.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:16.238+0000 7fa8b67b1640 1 --2- 172.21.15.170:0/3143700062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b0101930 0x7fa8b00744f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:16.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:16.238+0000 7fa8b67b1640 1 -- 172.21.15.170:0/3143700062 >> 172.21.15.170:0/3143700062 conn(0x7fa8b00fd630 msgr2=0x7fa8b00fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:16.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:16.238+0000 7fa8b67b1640 1 -- 172.21.15.170:0/3143700062 shutdown_connections 2024-09-04T16:41:16.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:16.238+0000 7fa8b67b1640 1 -- 172.21.15.170:0/3143700062 wait complete. 2024-09-04T16:41:16.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:16 smithi170 ceph-mon[113855]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:41:16.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:16 smithi170 ceph-mon[113855]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:41:16.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:16 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/259202085' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:41:16.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:16 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3686201525' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:41:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:16 smithi193 ceph-mon[82547]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:41:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:16 smithi193 ceph-mon[82547]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:41:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:16 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/259202085' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:41:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:16 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3686201525' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:41:17.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:17 smithi170 ceph-mon[113855]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:41:17.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:17 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3143700062' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:41:17.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:17 smithi170 ceph-mon[113855]: pgmap v347: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:17.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:17 smithi193 ceph-mon[82547]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:41:17.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:17 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3143700062' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:41:17.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:17 smithi193 ceph-mon[82547]: pgmap v347: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:18.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:18 smithi170 ceph-mon[113855]: pgmap v348: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:18.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:18 smithi193 ceph-mon[82547]: pgmap v348: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:20.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:20 smithi170 ceph-mon[113855]: pgmap v349: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:20.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:20 smithi193 ceph-mon[82547]: pgmap v349: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:22 smithi193 ceph-mon[82547]: pgmap v350: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:22.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:22 smithi170 ceph-mon[113855]: pgmap v350: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:24.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:24 smithi170 ceph-mon[113855]: pgmap v351: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:24 smithi193 ceph-mon[82547]: pgmap v351: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:26.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:26 smithi170 ceph-mon[113855]: pgmap v352: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:26.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:26 smithi193 ceph-mon[82547]: pgmap v352: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:28.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:28 smithi170 ceph-mon[113855]: pgmap v353: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:28.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:28 smithi193 ceph-mon[82547]: pgmap v353: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:29.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:41:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:41:30.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:30 smithi170 ceph-mon[113855]: pgmap v354: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:30.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:30 smithi193 ceph-mon[82547]: pgmap v354: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:32.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:32 smithi170 ceph-mon[113855]: pgmap v355: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:32.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:32 smithi193 ceph-mon[82547]: pgmap v355: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:34.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:34 smithi170 ceph-mon[113855]: pgmap v356: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:34.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:34 smithi193 ceph-mon[82547]: pgmap v356: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:36.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:36 smithi170 ceph-mon[113855]: pgmap v357: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:36 smithi193 ceph-mon[82547]: pgmap v357: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:38.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:38 smithi170 ceph-mon[113855]: pgmap v358: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:38 smithi193 ceph-mon[82547]: pgmap v358: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:40.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:40 smithi170 ceph-mon[113855]: pgmap v359: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:40.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:40 smithi193 ceph-mon[82547]: pgmap v359: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:42.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:42 smithi170 ceph-mon[113855]: pgmap v360: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:42 smithi193 ceph-mon[82547]: pgmap v360: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:44.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:41:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:41:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:45 smithi170 ceph-mon[113855]: pgmap v361: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:45.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:45 smithi193 ceph-mon[82547]: pgmap v361: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:46.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.335+0000 7feba7eb7640 1 -- 172.21.15.170:0/2581853817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feba0101930 msgr2=0x7feba0101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:46.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.335+0000 7feba7eb7640 1 --2- 172.21.15.170:0/2581853817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feba0101930 0x7feba0101d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feb94009880 tx=0x7feb9402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.335+0000 7feba7eb7640 1 -- 172.21.15.170:0/2581853817 shutdown_connections 2024-09-04T16:41:46.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.335+0000 7feba7eb7640 1 --2- 172.21.15.170:0/2581853817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feba0101930 0x7feba0101d90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.335+0000 7feba7eb7640 1 --2- 172.21.15.170:0/2581853817 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feba0107930 0x7feba0107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.335+0000 7feba7eb7640 1 -- 172.21.15.170:0/2581853817 >> 172.21.15.170:0/2581853817 conn(0x7feba00fd630 msgr2=0x7feba00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:46.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.335+0000 7feba7eb7640 1 -- 172.21.15.170:0/2581853817 shutdown_connections 2024-09-04T16:41:46.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.335+0000 7feba7eb7640 1 -- 172.21.15.170:0/2581853817 wait complete. 2024-09-04T16:41:46.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.336+0000 7feba7eb7640 1 Processor -- start 2024-09-04T16:41:46.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.336+0000 7feba7eb7640 1 -- start start 2024-09-04T16:41:46.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.336+0000 7feba7eb7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feba0101930 0x7feba019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:46.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.336+0000 7feba7eb7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feba0107930 0x7feba019dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:46.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.336+0000 7feba7eb7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7feba010ede0 con 0x7feba0101930 2024-09-04T16:41:46.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.336+0000 7feba7eb7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feba010ec60 con 0x7feba0107930 2024-09-04T16:41:46.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.336+0000 7feba5c53640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feba0101930 0x7feba019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:46.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.336+0000 7feba5c53640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feba0101930 0x7feba019d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43560/0 (socket says 172.21.15.170:43560) 2024-09-04T16:41:46.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.336+0000 7feba5c53640 1 -- 172.21.15.170:0/2073447223 learned_addr learned my addr 172.21.15.170:0/2073447223 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:41:46.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.336+0000 7feba5452640 1 --2- 172.21.15.170:0/2073447223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feba0107930 0x7feba019dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:46.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.337+0000 7feba5c53640 1 -- 172.21.15.170:0/2073447223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feba0107930 msgr2=0x7feba019dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:46.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.337+0000 7feba5c53640 1 --2- 172.21.15.170:0/2073447223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feba0107930 0x7feba019dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.337+0000 7feba5c53640 1 -- 172.21.15.170:0/2073447223 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba0197850 con 0x7feba0101930 2024-09-04T16:41:46.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.337+0000 7feba5c53640 1 --2- 172.21.15.170:0/2073447223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feba0101930 0x7feba019d6d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feb9800c8a0 tx=0x7feb9800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:46.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.337+0000 7feb9effd640 1 -- 172.21.15.170:0/2073447223 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb980079b0 con 0x7feba0101930 2024-09-04T16:41:46.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.337+0000 7feb9effd640 1 -- 172.21.15.170:0/2073447223 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feb98007b50 con 0x7feba0101930 2024-09-04T16:41:46.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.337+0000 7feba7eb7640 1 -- 172.21.15.170:0/2073447223 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba0197b40 con 0x7feba0101930 2024-09-04T16:41:46.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.337+0000 7feb9effd640 1 -- 172.21.15.170:0/2073447223 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb98018700 con 0x7feba0101930 2024-09-04T16:41:46.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.337+0000 7feba7eb7640 1 -- 172.21.15.170:0/2073447223 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba01980a0 con 0x7feba0101930 2024-09-04T16:41:46.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.338+0000 7feba7eb7640 1 -- 172.21.15.170:0/2073447223 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba0103070 con 0x7feba0101930 2024-09-04T16:41:46.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.339+0000 7feb9effd640 1 -- 172.21.15.170:0/2073447223 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7feb98007d00 con 0x7feba0101930 2024-09-04T16:41:46.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.339+0000 7feb9effd640 1 --2- 172.21.15.170:0/2073447223 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7feb88079e30 0x7feb8807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:46.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.340+0000 7feb9effd640 1 -- 172.21.15.170:0/2073447223 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7feb9809cce0 con 0x7feba0101930 2024-09-04T16:41:46.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.340+0000 7feba5452640 1 --2- 172.21.15.170:0/2073447223 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7feb88079e30 0x7feb8807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:46.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.340+0000 7feba5452640 1 --2- 172.21.15.170:0/2073447223 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7feb88079e30 0x7feb8807c2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feba0198ba0 tx=0x7feb94031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:46.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.344+0000 7feb9effd640 1 -- 172.21.15.170:0/2073447223 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7feb98014030 con 0x7feba0101930 2024-09-04T16:41:46.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.537+0000 7feba7eb7640 1 -- 172.21.15.170:0/2073447223 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7feba01983b0 con 0x7feb88079e30 2024-09-04T16:41:46.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.538+0000 7feb9effd640 1 -- 172.21.15.170:0/2073447223 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7feba01983b0 con 0x7feb88079e30 2024-09-04T16:41:46.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.540+0000 7feba7eb7640 1 -- 172.21.15.170:0/2073447223 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7feb88079e30 msgr2=0x7feb8807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:46.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.540+0000 7feba7eb7640 1 --2- 172.21.15.170:0/2073447223 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7feb88079e30 0x7feb8807c2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feba0198ba0 tx=0x7feb94031400 comp rx=0 tx=0).stop 2024-09-04T16:41:46.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.540+0000 7feba7eb7640 1 -- 172.21.15.170:0/2073447223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feba0101930 msgr2=0x7feba019d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:46.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.540+0000 7feba7eb7640 1 --2- 172.21.15.170:0/2073447223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feba0101930 0x7feba019d6d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feb9800c8a0 tx=0x7feb9800cd60 comp rx=0 tx=0).stop 2024-09-04T16:41:46.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.540+0000 7feba7eb7640 1 -- 172.21.15.170:0/2073447223 shutdown_connections 2024-09-04T16:41:46.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.540+0000 7feba7eb7640 1 --2- 172.21.15.170:0/2073447223 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7feb88079e30 0x7feb8807c2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.540+0000 7feba7eb7640 1 --2- 172.21.15.170:0/2073447223 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feba0107930 0x7feba019dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.540+0000 7feba7eb7640 1 --2- 172.21.15.170:0/2073447223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feba0101930 0x7feba019d6d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.540+0000 7feba7eb7640 1 -- 172.21.15.170:0/2073447223 >> 172.21.15.170:0/2073447223 conn(0x7feba00fd630 msgr2=0x7feba00fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:46.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.540+0000 7feba7eb7640 1 -- 172.21.15.170:0/2073447223 shutdown_connections 2024-09-04T16:41:46.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.540+0000 7feba7eb7640 1 -- 172.21.15.170:0/2073447223 wait complete. 2024-09-04T16:41:46.550 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:41:46.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.623+0000 7fbed62c4640 1 -- 172.21.15.170:0/1514017647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbed0101930 msgr2=0x7fbed0101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:46.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.623+0000 7fbed62c4640 1 --2- 172.21.15.170:0/1514017647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbed0101930 0x7fbed0101d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8009880 tx=0x7fbeb802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.623+0000 7fbed62c4640 1 -- 172.21.15.170:0/1514017647 shutdown_connections 2024-09-04T16:41:46.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.623+0000 7fbed62c4640 1 --2- 172.21.15.170:0/1514017647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbed0101930 0x7fbed0101d90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.623+0000 7fbed62c4640 1 --2- 172.21.15.170:0/1514017647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbed0107930 0x7fbed0107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.623+0000 7fbed62c4640 1 -- 172.21.15.170:0/1514017647 >> 172.21.15.170:0/1514017647 conn(0x7fbed00fd630 msgr2=0x7fbed00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:46.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.623+0000 7fbed62c4640 1 -- 172.21.15.170:0/1514017647 shutdown_connections 2024-09-04T16:41:46.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.623+0000 7fbed62c4640 1 -- 172.21.15.170:0/1514017647 wait complete. 2024-09-04T16:41:46.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.624+0000 7fbed62c4640 1 Processor -- start 2024-09-04T16:41:46.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.624+0000 7fbed62c4640 1 -- start start 2024-09-04T16:41:46.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.624+0000 7fbed62c4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbed0101930 0x7fbed00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:46.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.624+0000 7fbed62c4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbed0107930 0x7fbed0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:46.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.624+0000 7fbed62c4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbed010ee00 con 0x7fbed0107930 2024-09-04T16:41:46.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.624+0000 7fbed62c4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbed010ec80 con 0x7fbed0101930 2024-09-04T16:41:46.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.624+0000 7fbecf7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbed0107930 0x7fbed0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:46.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.624+0000 7fbecf7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbed0107930 0x7fbed0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43582/0 (socket says 172.21.15.170:43582) 2024-09-04T16:41:46.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.624+0000 7fbecf7fe640 1 -- 172.21.15.170:0/1510937531 learned_addr learned my addr 172.21.15.170:0/1510937531 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:41:46.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.624+0000 7fbecffff640 1 --2- 172.21.15.170:0/1510937531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbed0101930 0x7fbed00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:46.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.624+0000 7fbecf7fe640 1 -- 172.21.15.170:0/1510937531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbed0101930 msgr2=0x7fbed00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:46.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.624+0000 7fbecf7fe640 1 --2- 172.21.15.170:0/1510937531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbed0101930 0x7fbed00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.624+0000 7fbecf7fe640 1 -- 172.21.15.170:0/1510937531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed0074f70 con 0x7fbed0107930 2024-09-04T16:41:46.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.624+0000 7fbecffff640 1 --2- 172.21.15.170:0/1510937531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbed0101930 0x7fbed00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:41:46.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.625+0000 7fbecf7fe640 1 --2- 172.21.15.170:0/1510937531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbed0107930 0x7fbed0074a30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8031460 tx=0x7fbeb80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:46.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.625+0000 7fbecd7fa640 1 -- 172.21.15.170:0/1510937531 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbeb803f070 con 0x7fbed0107930 2024-09-04T16:41:46.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.625+0000 7fbed62c4640 1 -- 172.21.15.170:0/1510937531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed0075200 con 0x7fbed0107930 2024-09-04T16:41:46.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.625+0000 7fbecd7fa640 1 -- 172.21.15.170:0/1510937531 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbeb80035f0 con 0x7fbed0107930 2024-09-04T16:41:46.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.625+0000 7fbecd7fa640 1 -- 172.21.15.170:0/1510937531 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbeb8035030 con 0x7fbed0107930 2024-09-04T16:41:46.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.625+0000 7fbed62c4640 1 -- 172.21.15.170:0/1510937531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed01a3dd0 con 0x7fbed0107930 2024-09-04T16:41:46.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.626+0000 7fbed62c4640 1 -- 172.21.15.170:0/1510937531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed0103070 con 0x7fbed0107930 2024-09-04T16:41:46.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.626+0000 7fbecd7fa640 1 -- 172.21.15.170:0/1510937531 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fbeb8042070 con 0x7fbed0107930 2024-09-04T16:41:46.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.627+0000 7fbecd7fa640 1 --2- 172.21.15.170:0/1510937531 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbebc079e30 0x7fbebc07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:46.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.627+0000 7fbecd7fa640 1 -- 172.21.15.170:0/1510937531 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fbeb80bd460 con 0x7fbed0107930 2024-09-04T16:41:46.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.627+0000 7fbecffff640 1 --2- 172.21.15.170:0/1510937531 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbebc079e30 0x7fbebc07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:46.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.627+0000 7fbecffff640 1 --2- 172.21.15.170:0/1510937531 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbebc079e30 0x7fbebc07c2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbec0009b40 tx=0x7fbec0005e50 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:46.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.631+0000 7fbecd7fa640 1 -- 172.21.15.170:0/1510937531 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbeb8084e70 con 0x7fbed0107930 2024-09-04T16:41:46.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.824+0000 7fbed62c4640 1 -- 172.21.15.170:0/1510937531 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbed0062630 con 0x7fbebc079e30 2024-09-04T16:41:46.825 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:46 smithi170 ceph-mon[113855]: pgmap v362: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:46.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.825+0000 7fbecd7fa640 1 -- 172.21.15.170:0/1510937531 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fbed0062630 con 0x7fbebc079e30 2024-09-04T16:41:46.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.828+0000 7fbed62c4640 1 -- 172.21.15.170:0/1510937531 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbebc079e30 msgr2=0x7fbebc07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:46.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.828+0000 7fbed62c4640 1 --2- 172.21.15.170:0/1510937531 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbebc079e30 0x7fbebc07c2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbec0009b40 tx=0x7fbec0005e50 comp rx=0 tx=0).stop 2024-09-04T16:41:46.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.828+0000 7fbed62c4640 1 -- 172.21.15.170:0/1510937531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbed0107930 msgr2=0x7fbed0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:46.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.828+0000 7fbed62c4640 1 --2- 172.21.15.170:0/1510937531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbed0107930 0x7fbed0074a30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8031460 tx=0x7fbeb80045e0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.828+0000 7fbed62c4640 1 -- 172.21.15.170:0/1510937531 shutdown_connections 2024-09-04T16:41:46.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.828+0000 7fbed62c4640 1 --2- 172.21.15.170:0/1510937531 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbebc079e30 0x7fbebc07c2f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.828+0000 7fbed62c4640 1 --2- 172.21.15.170:0/1510937531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbed0107930 0x7fbed0074a30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.828+0000 7fbed62c4640 1 --2- 172.21.15.170:0/1510937531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbed0101930 0x7fbed00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.828+0000 7fbed62c4640 1 -- 172.21.15.170:0/1510937531 >> 172.21.15.170:0/1510937531 conn(0x7fbed00fd630 msgr2=0x7fbed00fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:46.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.828+0000 7fbed62c4640 1 -- 172.21.15.170:0/1510937531 shutdown_connections 2024-09-04T16:41:46.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.828+0000 7fbed62c4640 1 -- 172.21.15.170:0/1510937531 wait complete. 2024-09-04T16:41:46.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:46 smithi193 ceph-mon[82547]: pgmap v362: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:46.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.910+0000 7faed570b640 1 -- 172.21.15.170:0/980389546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed0102aa0 msgr2=0x7faed0102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:46.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.910+0000 7faed570b640 1 --2- 172.21.15.170:0/980389546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed0102aa0 0x7faed0102e80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faec0009c20 tx=0x7faec002aa00 comp rx=0 tx=0).stop 2024-09-04T16:41:46.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.910+0000 7faed570b640 1 -- 172.21.15.170:0/980389546 shutdown_connections 2024-09-04T16:41:46.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.910+0000 7faed570b640 1 --2- 172.21.15.170:0/980389546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faed01033c0 0x7faed010b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.910+0000 7faed570b640 1 --2- 172.21.15.170:0/980389546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed0102aa0 0x7faed0102e80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.910+0000 7faed570b640 1 -- 172.21.15.170:0/980389546 >> 172.21.15.170:0/980389546 conn(0x7faed00fc4c0 msgr2=0x7faed00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:46.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.911+0000 7faed570b640 1 -- 172.21.15.170:0/980389546 shutdown_connections 2024-09-04T16:41:46.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.911+0000 7faed570b640 1 -- 172.21.15.170:0/980389546 wait complete. 2024-09-04T16:41:46.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.911+0000 7faed570b640 1 Processor -- start 2024-09-04T16:41:46.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.911+0000 7faed570b640 1 -- start start 2024-09-04T16:41:46.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.911+0000 7faed570b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed0102aa0 0x7faed0100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:46.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.911+0000 7faed570b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faed01033c0 0x7faed0100c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:46.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.911+0000 7faed570b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faed010edb0 con 0x7faed0102aa0 2024-09-04T16:41:46.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.911+0000 7faed570b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faed010ec30 con 0x7faed01033c0 2024-09-04T16:41:46.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.912+0000 7faeceffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed0102aa0 0x7faed0100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:46.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.912+0000 7faeceffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed0102aa0 0x7faed0100700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43602/0 (socket says 172.21.15.170:43602) 2024-09-04T16:41:46.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.912+0000 7faeceffd640 1 -- 172.21.15.170:0/1009991214 learned_addr learned my addr 172.21.15.170:0/1009991214 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:41:46.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.912+0000 7faece7fc640 1 --2- 172.21.15.170:0/1009991214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faed01033c0 0x7faed0100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:46.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.912+0000 7faeceffd640 1 -- 172.21.15.170:0/1009991214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faed01033c0 msgr2=0x7faed0100c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:46.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.912+0000 7faeceffd640 1 --2- 172.21.15.170:0/1009991214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faed01033c0 0x7faed0100c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:46.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.912+0000 7faeceffd640 1 -- 172.21.15.170:0/1009991214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed0101180 con 0x7faed0102aa0 2024-09-04T16:41:46.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.912+0000 7faeceffd640 1 --2- 172.21.15.170:0/1009991214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed0102aa0 0x7faed0100700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faec002af20 tx=0x7faec002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:46.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.912+0000 7faec7fff640 1 -- 172.21.15.170:0/1009991214 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faec0047070 con 0x7faed0102aa0 2024-09-04T16:41:46.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.912+0000 7faec7fff640 1 -- 172.21.15.170:0/1009991214 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faec0003e30 con 0x7faed0102aa0 2024-09-04T16:41:46.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.912+0000 7faec7fff640 1 -- 172.21.15.170:0/1009991214 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faec0033050 con 0x7faed0102aa0 2024-09-04T16:41:46.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.912+0000 7faed570b640 1 -- 172.21.15.170:0/1009991214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed0101410 con 0x7faed0102aa0 2024-09-04T16:41:46.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.912+0000 7faed570b640 1 -- 172.21.15.170:0/1009991214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed01a3d60 con 0x7faed0102aa0 2024-09-04T16:41:46.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.913+0000 7faed570b640 1 -- 172.21.15.170:0/1009991214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faed006a410 con 0x7faed0102aa0 2024-09-04T16:41:46.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.914+0000 7faec7fff640 1 -- 172.21.15.170:0/1009991214 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7faec004a070 con 0x7faed0102aa0 2024-09-04T16:41:46.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.914+0000 7faec7fff640 1 --2- 172.21.15.170:0/1009991214 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faebc079e40 0x7faebc07c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:46.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.915+0000 7faec7fff640 1 -- 172.21.15.170:0/1009991214 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7faec003e030 con 0x7faed0102aa0 2024-09-04T16:41:46.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.915+0000 7faece7fc640 1 --2- 172.21.15.170:0/1009991214 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faebc079e40 0x7faebc07c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:46.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.915+0000 7faece7fc640 1 --2- 172.21.15.170:0/1009991214 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faebc079e40 0x7faebc07c300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faeb8004630 tx=0x7faeb8005c50 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:46.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:46.919+0000 7faec7fff640 1 -- 172.21.15.170:0/1009991214 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faec0085620 con 0x7faed0102aa0 2024-09-04T16:41:47.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.104+0000 7faed570b640 1 -- 172.21.15.170:0/1009991214 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7faed0062630 con 0x7faebc079e40 2024-09-04T16:41:47.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.114+0000 7faec7fff640 1 -- 172.21.15.170:0/1009991214 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7faed0062630 con 0x7faebc079e40 2024-09-04T16:41:47.115 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:41:47.115 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (8m) 3m ago 19m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:41:47.115 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (11m) 3m ago 19m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:41:47.115 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (11m) 2m ago 18m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:41:47.115 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (6m) 3m ago 19m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:41:47.115 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (6m) 2m ago 18m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:41:47.115 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (8m) 3m ago 19m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:41:47.115 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (3m) 3m ago 14m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:41:47.116 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (3m) 3m ago 14m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:41:47.116 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (2m) 2m ago 14m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:41:47.116 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (2m) 2m ago 14m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:41:47.116 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (11m) 3m ago 20m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:41:47.116 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (9m) 2m ago 18m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:41:47.116 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (7m) 3m ago 21m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:41:47.116 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (7m) 2m ago 18m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:41:47.116 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (9m) 3m ago 19m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:41:47.116 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (9m) 2m ago 18m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:41:47.116 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (6m) 3m ago 17m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:41:47.116 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (5m) 3m ago 17m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:41:47.116 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (5m) 3m ago 16m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:41:47.117 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (4m) 2m ago 16m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:41:47.117 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (4m) 2m ago 15m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:41:47.117 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (3m) 2m ago 15m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:41:47.117 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (9m) 3m ago 19m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:41:47.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.116+0000 7faed570b640 1 -- 172.21.15.170:0/1009991214 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faebc079e40 msgr2=0x7faebc07c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:47.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.116+0000 7faed570b640 1 --2- 172.21.15.170:0/1009991214 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faebc079e40 0x7faebc07c300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faeb8004630 tx=0x7faeb8005c50 comp rx=0 tx=0).stop 2024-09-04T16:41:47.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.116+0000 7faed570b640 1 -- 172.21.15.170:0/1009991214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed0102aa0 msgr2=0x7faed0100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:47.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.116+0000 7faed570b640 1 --2- 172.21.15.170:0/1009991214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed0102aa0 0x7faed0100700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faec002af20 tx=0x7faec002ee60 comp rx=0 tx=0).stop 2024-09-04T16:41:47.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.116+0000 7faed570b640 1 -- 172.21.15.170:0/1009991214 shutdown_connections 2024-09-04T16:41:47.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.116+0000 7faed570b640 1 --2- 172.21.15.170:0/1009991214 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faebc079e40 0x7faebc07c300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.116+0000 7faed570b640 1 --2- 172.21.15.170:0/1009991214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faed01033c0 0x7faed0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.116+0000 7faed570b640 1 --2- 172.21.15.170:0/1009991214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed0102aa0 0x7faed0100700 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.116+0000 7faed570b640 1 -- 172.21.15.170:0/1009991214 >> 172.21.15.170:0/1009991214 conn(0x7faed00fc4c0 msgr2=0x7faed0108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:47.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.117+0000 7faed570b640 1 -- 172.21.15.170:0/1009991214 shutdown_connections 2024-09-04T16:41:47.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.117+0000 7faed570b640 1 -- 172.21.15.170:0/1009991214 wait complete. 2024-09-04T16:41:47.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.197+0000 7ff2a2799640 1 -- 172.21.15.170:0/3513621198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff29c101930 msgr2=0x7ff29c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:47.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.197+0000 7ff2a2799640 1 --2- 172.21.15.170:0/3513621198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff29c101930 0x7ff29c101d90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff290009880 tx=0x7ff29002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.197+0000 7ff2a2799640 1 -- 172.21.15.170:0/3513621198 shutdown_connections 2024-09-04T16:41:47.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.197+0000 7ff2a2799640 1 --2- 172.21.15.170:0/3513621198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff29c101930 0x7ff29c101d90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.197+0000 7ff2a2799640 1 --2- 172.21.15.170:0/3513621198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff29c107930 0x7ff29c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.197+0000 7ff2a2799640 1 -- 172.21.15.170:0/3513621198 >> 172.21.15.170:0/3513621198 conn(0x7ff29c0fd630 msgr2=0x7ff29c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:47.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.197+0000 7ff2a2799640 1 -- 172.21.15.170:0/3513621198 shutdown_connections 2024-09-04T16:41:47.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.197+0000 7ff2a2799640 1 -- 172.21.15.170:0/3513621198 wait complete. 2024-09-04T16:41:47.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.198+0000 7ff2a2799640 1 Processor -- start 2024-09-04T16:41:47.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.198+0000 7ff2a2799640 1 -- start start 2024-09-04T16:41:47.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.198+0000 7ff2a2799640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff29c101930 0x7ff29c19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:47.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.198+0000 7ff2a2799640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff29c107930 0x7ff29c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:47.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.198+0000 7ff2a2799640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff29c10ee00 con 0x7ff29c101930 2024-09-04T16:41:47.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.198+0000 7ff2a2799640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff29c10ec80 con 0x7ff29c107930 2024-09-04T16:41:47.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.198+0000 7ff29bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff29c101930 0x7ff29c19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:47.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.198+0000 7ff29bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff29c101930 0x7ff29c19f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43622/0 (socket says 172.21.15.170:43622) 2024-09-04T16:41:47.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.198+0000 7ff29bfff640 1 -- 172.21.15.170:0/2355470416 learned_addr learned my addr 172.21.15.170:0/2355470416 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:41:47.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.198+0000 7ff29b7fe640 1 --2- 172.21.15.170:0/2355470416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff29c107930 0x7ff29c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:47.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.199+0000 7ff29bfff640 1 -- 172.21.15.170:0/2355470416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff29c107930 msgr2=0x7ff29c19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:47.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.199+0000 7ff29bfff640 1 --2- 172.21.15.170:0/2355470416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff29c107930 0x7ff29c19fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.199+0000 7ff29bfff640 1 -- 172.21.15.170:0/2355470416 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29c1999e0 con 0x7ff29c101930 2024-09-04T16:41:47.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.199+0000 7ff29bfff640 1 --2- 172.21.15.170:0/2355470416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff29c101930 0x7ff29c19f820 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00d6f0 tx=0x7ff28c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:47.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.199+0000 7ff2997fa640 1 -- 172.21.15.170:0/2355470416 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff28c017070 con 0x7ff29c101930 2024-09-04T16:41:47.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.199+0000 7ff2997fa640 1 -- 172.21.15.170:0/2355470416 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff28c00de00 con 0x7ff29c101930 2024-09-04T16:41:47.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.199+0000 7ff2997fa640 1 -- 172.21.15.170:0/2355470416 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff28c004bb0 con 0x7ff29c101930 2024-09-04T16:41:47.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.199+0000 7ff2a2799640 1 -- 172.21.15.170:0/2355470416 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff29c199cd0 con 0x7ff29c101930 2024-09-04T16:41:47.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.199+0000 7ff2a2799640 1 -- 172.21.15.170:0/2355470416 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff29c19a260 con 0x7ff29c101930 2024-09-04T16:41:47.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.200+0000 7ff2a2799640 1 -- 172.21.15.170:0/2355470416 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff29c103070 con 0x7ff29c101930 2024-09-04T16:41:47.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.201+0000 7ff2997fa640 1 -- 172.21.15.170:0/2355470416 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ff28c009a30 con 0x7ff29c101930 2024-09-04T16:41:47.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.202+0000 7ff2997fa640 1 --2- 172.21.15.170:0/2355470416 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff284079e80 0x7ff28407c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:47.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.202+0000 7ff2997fa640 1 -- 172.21.15.170:0/2355470416 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff28c09c610 con 0x7ff29c101930 2024-09-04T16:41:47.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.202+0000 7ff29b7fe640 1 --2- 172.21.15.170:0/2355470416 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff284079e80 0x7ff28407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:47.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.202+0000 7ff29b7fe640 1 --2- 172.21.15.170:0/2355470416 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff284079e80 0x7ff28407c340 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff290031460 tx=0x7ff290009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:47.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.206+0000 7ff2997fa640 1 -- 172.21.15.170:0/2355470416 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff28c0640a0 con 0x7ff29c101930 2024-09-04T16:41:47.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.453+0000 7ff2a2799640 1 -- 172.21.15.170:0/2355470416 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff29c19a510 con 0x7ff29c101930 2024-09-04T16:41:47.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.454+0000 7ff2997fa640 1 -- 172.21.15.170:0/2355470416 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7ff28c068210 con 0x7ff29c101930 2024-09-04T16:41:47.455 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:41:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:41:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:41:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:41:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:41:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:41:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:41:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:41:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:41:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:41:47.456 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:41:47.456 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:41:47.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:41:47.456 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:41:47.456 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:41:47.456 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:41:47.456 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:41:47.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.457+0000 7ff2a2799640 1 -- 172.21.15.170:0/2355470416 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff284079e80 msgr2=0x7ff28407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:47.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.457+0000 7ff2a2799640 1 --2- 172.21.15.170:0/2355470416 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff284079e80 0x7ff28407c340 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff290031460 tx=0x7ff290009560 comp rx=0 tx=0).stop 2024-09-04T16:41:47.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.457+0000 7ff2a2799640 1 -- 172.21.15.170:0/2355470416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff29c101930 msgr2=0x7ff29c19f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:47.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.457+0000 7ff2a2799640 1 --2- 172.21.15.170:0/2355470416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff29c101930 0x7ff29c19f820 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00d6f0 tx=0x7ff28c00dbb0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.457+0000 7ff2a2799640 1 -- 172.21.15.170:0/2355470416 shutdown_connections 2024-09-04T16:41:47.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.457+0000 7ff2a2799640 1 --2- 172.21.15.170:0/2355470416 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff284079e80 0x7ff28407c340 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.457+0000 7ff2a2799640 1 --2- 172.21.15.170:0/2355470416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff29c107930 0x7ff29c19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.457+0000 7ff2a2799640 1 --2- 172.21.15.170:0/2355470416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff29c101930 0x7ff29c19f820 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.457+0000 7ff2a2799640 1 -- 172.21.15.170:0/2355470416 >> 172.21.15.170:0/2355470416 conn(0x7ff29c0fd630 msgr2=0x7ff29c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:47.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.457+0000 7ff2a2799640 1 -- 172.21.15.170:0/2355470416 shutdown_connections 2024-09-04T16:41:47.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.457+0000 7ff2a2799640 1 -- 172.21.15.170:0/2355470416 wait complete. 2024-09-04T16:41:47.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.540+0000 7f0482c0a640 1 -- 172.21.15.170:0/4180143279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f047c1067e0 msgr2=0x7f047c106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:47.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.540+0000 7f0482c0a640 1 --2- 172.21.15.170:0/4180143279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f047c1067e0 0x7f047c106bc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f046c009880 tx=0x7f046c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.540+0000 7f0482c0a640 1 -- 172.21.15.170:0/4180143279 shutdown_connections 2024-09-04T16:41:47.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.540+0000 7f0482c0a640 1 --2- 172.21.15.170:0/4180143279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f047c1007e0 0x7f047c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.540+0000 7f0482c0a640 1 --2- 172.21.15.170:0/4180143279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f047c1067e0 0x7f047c106bc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.540+0000 7f0482c0a640 1 -- 172.21.15.170:0/4180143279 >> 172.21.15.170:0/4180143279 conn(0x7f047c0fc4c0 msgr2=0x7f047c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:47.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.540+0000 7f0482c0a640 1 -- 172.21.15.170:0/4180143279 shutdown_connections 2024-09-04T16:41:47.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.540+0000 7f0482c0a640 1 -- 172.21.15.170:0/4180143279 wait complete. 2024-09-04T16:41:47.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.541+0000 7f0482c0a640 1 Processor -- start 2024-09-04T16:41:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.541+0000 7f0482c0a640 1 -- start start 2024-09-04T16:41:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.541+0000 7f0482c0a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f047c1007e0 0x7f047c19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.541+0000 7f0482c0a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f047c1067e0 0x7f047c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.541+0000 7f0482c0a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f047c10dcb0 con 0x7f047c1007e0 2024-09-04T16:41:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.541+0000 7f0482c0a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f047c10db30 con 0x7f047c1067e0 2024-09-04T16:41:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.541+0000 7f04809a6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f047c1007e0 0x7f047c19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.541+0000 7f04809a6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f047c1007e0 0x7f047c19d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43654/0 (socket says 172.21.15.170:43654) 2024-09-04T16:41:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.541+0000 7f04809a6640 1 -- 172.21.15.170:0/3173419534 learned_addr learned my addr 172.21.15.170:0/3173419534 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:41:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.542+0000 7f047bfff640 1 --2- 172.21.15.170:0/3173419534 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f047c1067e0 0x7f047c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.542+0000 7f04809a6640 1 -- 172.21.15.170:0/3173419534 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f047c1067e0 msgr2=0x7f047c19db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.542+0000 7f04809a6640 1 --2- 172.21.15.170:0/3173419534 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f047c1067e0 0x7f047c19db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.542+0000 7f04809a6640 1 -- 172.21.15.170:0/3173419534 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047c1977a0 con 0x7f047c1007e0 2024-09-04T16:41:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.542+0000 7f04809a6640 1 --2- 172.21.15.170:0/3173419534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f047c1007e0 0x7f047c19d620 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f046c031460 tx=0x7f046c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.542+0000 7f0479ffb640 1 -- 172.21.15.170:0/3173419534 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f046c03f070 con 0x7f047c1007e0 2024-09-04T16:41:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.542+0000 7f0479ffb640 1 -- 172.21.15.170:0/3173419534 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f046c0035f0 con 0x7f047c1007e0 2024-09-04T16:41:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.542+0000 7f0482c0a640 1 -- 172.21.15.170:0/3173419534 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f047c197a30 con 0x7f047c1007e0 2024-09-04T16:41:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.542+0000 7f0479ffb640 1 -- 172.21.15.170:0/3173419534 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f046c035030 con 0x7f047c1007e0 2024-09-04T16:41:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.542+0000 7f0482c0a640 1 -- 172.21.15.170:0/3173419534 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f047c197f60 con 0x7f047c1007e0 2024-09-04T16:41:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.543+0000 7f0482c0a640 1 -- 172.21.15.170:0/3173419534 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f047c101f20 con 0x7f047c1007e0 2024-09-04T16:41:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.544+0000 7f0479ffb640 1 -- 172.21.15.170:0/3173419534 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f046c042070 con 0x7f047c1007e0 2024-09-04T16:41:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.544+0000 7f0479ffb640 1 --2- 172.21.15.170:0/3173419534 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0468079e30 0x7f046807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.544+0000 7f0479ffb640 1 -- 172.21.15.170:0/3173419534 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f046c0bd430 con 0x7f047c1007e0 2024-09-04T16:41:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.544+0000 7f047bfff640 1 --2- 172.21.15.170:0/3173419534 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0468079e30 0x7f046807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.545+0000 7f047bfff640 1 --2- 172.21.15.170:0/3173419534 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0468079e30 0x7f046807c2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f047c105f00 tx=0x7f0464005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:47.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.549+0000 7f0479ffb640 1 -- 172.21.15.170:0/3173419534 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f046c084e40 con 0x7f047c1007e0 2024-09-04T16:41:47.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.757+0000 7f0482c0a640 1 -- 172.21.15.170:0/3173419534 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f047c109d60 con 0x7f047c1007e0 2024-09-04T16:41:47.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:47 smithi170 ceph-mon[113855]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:41:47.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:47 smithi170 ceph-mon[113855]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:41:47.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:47 smithi170 ceph-mon[113855]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:41:47.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:47 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2355470416' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:41:47.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.758+0000 7f0479ffb640 1 -- 172.21.15.170:0/3173419534 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7f046c0a5e20 con 0x7f047c1007e0 2024-09-04T16:41:47.760 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:41:47.760 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:41:47.760 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:41:47.760 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:41:47.760 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:41:47.760 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:41:47.760 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:41:47.760 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:41:47.760 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:41:47.760 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:41:47.761 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:41:47.761 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:41:47.761 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:41:47.761 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:41:47.761 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:41:47.761 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:41:47.761 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:41:47.761 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:41:47.761 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:41:47.761 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:41:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:41:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:41:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:41:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:41:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:41:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:41:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:41:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:41:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:41:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:41:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:41:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:41:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:41:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:41:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:41:47.763 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:41:47.763 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:41:47.763 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:41:47.763 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:41:47.763 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:41:47.763 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:41:47.763 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:41:47.763 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:41:47.764 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:41:47.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.761+0000 7f0482c0a640 1 -- 172.21.15.170:0/3173419534 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0468079e30 msgr2=0x7f046807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:47.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.761+0000 7f0482c0a640 1 --2- 172.21.15.170:0/3173419534 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0468079e30 0x7f046807c2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f047c105f00 tx=0x7f0464005f90 comp rx=0 tx=0).stop 2024-09-04T16:41:47.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.761+0000 7f0482c0a640 1 -- 172.21.15.170:0/3173419534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f047c1007e0 msgr2=0x7f047c19d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:47.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.761+0000 7f0482c0a640 1 --2- 172.21.15.170:0/3173419534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f047c1007e0 0x7f047c19d620 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f046c031460 tx=0x7f046c004530 comp rx=0 tx=0).stop 2024-09-04T16:41:47.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.761+0000 7f0482c0a640 1 -- 172.21.15.170:0/3173419534 shutdown_connections 2024-09-04T16:41:47.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.761+0000 7f0482c0a640 1 --2- 172.21.15.170:0/3173419534 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0468079e30 0x7f046807c2f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.761+0000 7f0482c0a640 1 --2- 172.21.15.170:0/3173419534 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f047c1067e0 0x7f047c19db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.761+0000 7f0482c0a640 1 --2- 172.21.15.170:0/3173419534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f047c1007e0 0x7f047c19d620 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.761+0000 7f0482c0a640 1 -- 172.21.15.170:0/3173419534 >> 172.21.15.170:0/3173419534 conn(0x7f047c0fc4c0 msgr2=0x7f047c069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:47.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.761+0000 7f0482c0a640 1 -- 172.21.15.170:0/3173419534 shutdown_connections 2024-09-04T16:41:47.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.761+0000 7f0482c0a640 1 -- 172.21.15.170:0/3173419534 wait complete. 2024-09-04T16:41:47.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.845+0000 7f75f23e4640 1 -- 172.21.15.170:0/211596206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75ec103400 msgr2=0x7f75ec10b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:47.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.845+0000 7f75f23e4640 1 --2- 172.21.15.170:0/211596206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75ec103400 0x7f75ec10b8f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009880 tx=0x7f75e002a530 comp rx=0 tx=0).stop 2024-09-04T16:41:47.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.845+0000 7f75f23e4640 1 -- 172.21.15.170:0/211596206 shutdown_connections 2024-09-04T16:41:47.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.845+0000 7f75f23e4640 1 --2- 172.21.15.170:0/211596206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75ec103400 0x7f75ec10b8f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.845+0000 7f75f23e4640 1 --2- 172.21.15.170:0/211596206 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75ec102ae0 0x7f75ec102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.845+0000 7f75f23e4640 1 -- 172.21.15.170:0/211596206 >> 172.21.15.170:0/211596206 conn(0x7f75ec0fc520 msgr2=0x7f75ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:47.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.845+0000 7f75f23e4640 1 -- 172.21.15.170:0/211596206 shutdown_connections 2024-09-04T16:41:47.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.845+0000 7f75f23e4640 1 -- 172.21.15.170:0/211596206 wait complete. 2024-09-04T16:41:47.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.845+0000 7f75f23e4640 1 Processor -- start 2024-09-04T16:41:47.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.846+0000 7f75f23e4640 1 -- start start 2024-09-04T16:41:47.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.846+0000 7f75f23e4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75ec102ae0 0x7f75ec100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:47.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.846+0000 7f75f23e4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75ec103400 0x7f75ec100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:47.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.846+0000 7f75f23e4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec10edf0 con 0x7f75ec102ae0 2024-09-04T16:41:47.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.846+0000 7f75f23e4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec10ec70 con 0x7f75ec103400 2024-09-04T16:41:47.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.846+0000 7f75ebfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75ec102ae0 0x7f75ec100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:47.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.846+0000 7f75ebfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75ec102ae0 0x7f75ec100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43672/0 (socket says 172.21.15.170:43672) 2024-09-04T16:41:47.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.846+0000 7f75ebfff640 1 -- 172.21.15.170:0/1405036925 learned_addr learned my addr 172.21.15.170:0/1405036925 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:41:47.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.846+0000 7f75eb7fe640 1 --2- 172.21.15.170:0/1405036925 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75ec103400 0x7f75ec100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:47.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.846+0000 7f75ebfff640 1 -- 172.21.15.170:0/1405036925 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75ec103400 msgr2=0x7f75ec100c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:47.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.846+0000 7f75ebfff640 1 --2- 172.21.15.170:0/1405036925 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75ec103400 0x7f75ec100c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:47.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.846+0000 7f75ebfff640 1 -- 172.21.15.170:0/1405036925 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec1011c0 con 0x7f75ec102ae0 2024-09-04T16:41:47.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.847+0000 7f75ebfff640 1 --2- 172.21.15.170:0/1405036925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75ec102ae0 0x7f75ec100740 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00d8d0 tx=0x7f75dc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:47.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.847+0000 7f75e97fa640 1 -- 172.21.15.170:0/1405036925 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f75dc017070 con 0x7f75ec102ae0 2024-09-04T16:41:47.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.847+0000 7f75e97fa640 1 -- 172.21.15.170:0/1405036925 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f75dc010460 con 0x7f75ec102ae0 2024-09-04T16:41:47.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.847+0000 7f75f23e4640 1 -- 172.21.15.170:0/1405036925 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ec1014b0 con 0x7f75ec102ae0 2024-09-04T16:41:47.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.847+0000 7f75f23e4640 1 -- 172.21.15.170:0/1405036925 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ec1a3e80 con 0x7f75ec102ae0 2024-09-04T16:41:47.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.847+0000 7f75e97fa640 1 -- 172.21.15.170:0/1405036925 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f75dc00f5f0 con 0x7f75ec102ae0 2024-09-04T16:41:47.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.848+0000 7f75f23e4640 1 -- 172.21.15.170:0/1405036925 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ec06abe0 con 0x7f75ec102ae0 2024-09-04T16:41:47.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.848+0000 7f75e97fa640 1 -- 172.21.15.170:0/1405036925 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f75dc009a30 con 0x7f75ec102ae0 2024-09-04T16:41:47.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.849+0000 7f75e97fa640 1 --2- 172.21.15.170:0/1405036925 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f75d4079e30 0x7f75d407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:47.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.849+0000 7f75e97fa640 1 -- 172.21.15.170:0/1405036925 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f75dc09c8f0 con 0x7f75ec102ae0 2024-09-04T16:41:47.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.849+0000 7f75eb7fe640 1 --2- 172.21.15.170:0/1405036925 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f75d4079e30 0x7f75d407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:47.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.850+0000 7f75eb7fe640 1 --2- 172.21.15.170:0/1405036925 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f75d4079e30 0x7f75d407c2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f75ec1021d0 tx=0x7f75e0031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:47.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:47.853+0000 7f75e97fa640 1 -- 172.21.15.170:0/1405036925 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f75dc068470 con 0x7f75ec102ae0 2024-09-04T16:41:47.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:47 smithi193 ceph-mon[82547]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:41:47.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:47 smithi193 ceph-mon[82547]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:41:47.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:47 smithi193 ceph-mon[82547]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:41:47.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:47 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2355470416' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:41:48.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.049+0000 7f75f23e4640 1 -- 172.21.15.170:0/1405036925 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f75ec062630 con 0x7f75d4079e30 2024-09-04T16:41:48.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.051+0000 7f75e97fa640 1 -- 172.21.15.170:0/1405036925 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f75ec062630 con 0x7f75d4079e30 2024-09-04T16:41:48.052 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:41:48.052 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:41:48.052 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:41:48.052 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:41:48.052 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:41:48.052 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:41:48.052 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:41:48.052 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:41:48.052 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:41:48.052 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:41:48.052 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:41:48.052 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:41:48.053 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:41:48.053 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:41:48.053 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:41:48.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.053+0000 7f75f23e4640 1 -- 172.21.15.170:0/1405036925 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f75d4079e30 msgr2=0x7f75d407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:48.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.053+0000 7f75f23e4640 1 --2- 172.21.15.170:0/1405036925 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f75d4079e30 0x7f75d407c2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f75ec1021d0 tx=0x7f75e0031400 comp rx=0 tx=0).stop 2024-09-04T16:41:48.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.053+0000 7f75f23e4640 1 -- 172.21.15.170:0/1405036925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75ec102ae0 msgr2=0x7f75ec100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:48.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.053+0000 7f75f23e4640 1 --2- 172.21.15.170:0/1405036925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75ec102ae0 0x7f75ec100740 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00d8d0 tx=0x7f75dc00dd90 comp rx=0 tx=0).stop 2024-09-04T16:41:48.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.054+0000 7f75f23e4640 1 -- 172.21.15.170:0/1405036925 shutdown_connections 2024-09-04T16:41:48.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.054+0000 7f75f23e4640 1 --2- 172.21.15.170:0/1405036925 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f75d4079e30 0x7f75d407c2f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:48.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.054+0000 7f75f23e4640 1 --2- 172.21.15.170:0/1405036925 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75ec103400 0x7f75ec100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:48.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.054+0000 7f75f23e4640 1 --2- 172.21.15.170:0/1405036925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75ec102ae0 0x7f75ec100740 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:48.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.054+0000 7f75f23e4640 1 -- 172.21.15.170:0/1405036925 >> 172.21.15.170:0/1405036925 conn(0x7f75ec0fc520 msgr2=0x7f75ec108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:48.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.054+0000 7f75f23e4640 1 -- 172.21.15.170:0/1405036925 shutdown_connections 2024-09-04T16:41:48.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.054+0000 7f75f23e4640 1 -- 172.21.15.170:0/1405036925 wait complete. 2024-09-04T16:41:48.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.135+0000 7f7f7c51a640 1 -- 172.21.15.170:0/198372068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f74106950 msgr2=0x7f7f74106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:48.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.135+0000 7f7f7c51a640 1 --2- 172.21.15.170:0/198372068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f74106950 0x7f7f74106d30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009880 tx=0x7f7f6802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:41:48.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.135+0000 7f7f7c51a640 1 -- 172.21.15.170:0/198372068 shutdown_connections 2024-09-04T16:41:48.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.135+0000 7f7f7c51a640 1 --2- 172.21.15.170:0/198372068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7f740ffd70 0x7f7f741001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:48.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.135+0000 7f7f7c51a640 1 --2- 172.21.15.170:0/198372068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f74106950 0x7f7f74106d30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:48.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.135+0000 7f7f7c51a640 1 -- 172.21.15.170:0/198372068 >> 172.21.15.170:0/198372068 conn(0x7f7f740fbc60 msgr2=0x7f7f740fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:48.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.135+0000 7f7f7c51a640 1 -- 172.21.15.170:0/198372068 shutdown_connections 2024-09-04T16:41:48.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.135+0000 7f7f7c51a640 1 -- 172.21.15.170:0/198372068 wait complete. 2024-09-04T16:41:48.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.136+0000 7f7f7c51a640 1 Processor -- start 2024-09-04T16:41:48.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.136+0000 7f7f7c51a640 1 -- start start 2024-09-04T16:41:48.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.136+0000 7f7f7c51a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f740ffd70 0x7f7f74100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:48.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.136+0000 7f7f7c51a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7f74106950 0x7f7f74101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:48.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.136+0000 7f7f7c51a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7410eed0 con 0x7f7f740ffd70 2024-09-04T16:41:48.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.136+0000 7f7f7c51a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7410ed50 con 0x7f7f74106950 2024-09-04T16:41:48.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.136+0000 7f7f7a2b6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f740ffd70 0x7f7f74100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:48.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.136+0000 7f7f7a2b6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f740ffd70 0x7f7f74100f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43696/0 (socket says 172.21.15.170:43696) 2024-09-04T16:41:48.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.136+0000 7f7f7a2b6640 1 -- 172.21.15.170:0/3291589617 learned_addr learned my addr 172.21.15.170:0/3291589617 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:41:48.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.136+0000 7f7f7a2b6640 1 -- 172.21.15.170:0/3291589617 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7f74106950 msgr2=0x7f7f74101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:48.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.136+0000 7f7f7a2b6640 1 --2- 172.21.15.170:0/3291589617 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7f74106950 0x7f7f74101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:48.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.136+0000 7f7f7a2b6640 1 -- 172.21.15.170:0/3291589617 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f741019d0 con 0x7f7f740ffd70 2024-09-04T16:41:48.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.137+0000 7f7f7a2b6640 1 --2- 172.21.15.170:0/3291589617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f740ffd70 0x7f7f74100f50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7f68031460 tx=0x7f7f680048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:48.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.137+0000 7f7f677fe640 1 -- 172.21.15.170:0/3291589617 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f6803f070 con 0x7f7f740ffd70 2024-09-04T16:41:48.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.137+0000 7f7f677fe640 1 -- 172.21.15.170:0/3291589617 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7f68004cf0 con 0x7f7f740ffd70 2024-09-04T16:41:48.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.137+0000 7f7f677fe640 1 -- 172.21.15.170:0/3291589617 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f68035030 con 0x7f7f740ffd70 2024-09-04T16:41:48.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.137+0000 7f7f7c51a640 1 -- 172.21.15.170:0/3291589617 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f74101c60 con 0x7f7f740ffd70 2024-09-04T16:41:48.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.137+0000 7f7f7c51a640 1 -- 172.21.15.170:0/3291589617 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f741a3d90 con 0x7f7f740ffd70 2024-09-04T16:41:48.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.138+0000 7f7f7c51a640 1 -- 172.21.15.170:0/3291589617 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f741001d0 con 0x7f7f740ffd70 2024-09-04T16:41:48.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.138+0000 7f7f677fe640 1 -- 172.21.15.170:0/3291589617 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f7f68042070 con 0x7f7f740ffd70 2024-09-04T16:41:48.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.139+0000 7f7f677fe640 1 --2- 172.21.15.170:0/3291589617 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7f60079e30 0x7f7f6007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:41:48.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.139+0000 7f7f79ab5640 1 --2- 172.21.15.170:0/3291589617 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7f60079e30 0x7f7f6007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:41:48.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.139+0000 7f7f677fe640 1 -- 172.21.15.170:0/3291589617 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f7f680bd520 con 0x7f7f740ffd70 2024-09-04T16:41:48.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.140+0000 7f7f79ab5640 1 --2- 172.21.15.170:0/3291589617 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7f60079e30 0x7f7f6007c2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7f741029e0 tx=0x7f7f70005c70 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:41:48.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.143+0000 7f7f677fe640 1 -- 172.21.15.170:0/3291589617 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7f68084f30 con 0x7f7f740ffd70 2024-09-04T16:41:48.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.388+0000 7f7f7c51a640 1 -- 172.21.15.170:0/3291589617 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f7f741a3ff0 con 0x7f7f740ffd70 2024-09-04T16:41:48.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.389+0000 7f7f677fe640 1 -- 172.21.15.170:0/3291589617 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f7f6808d3e0 con 0x7f7f740ffd70 2024-09-04T16:41:48.390 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:41:48.390 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:41:48.390 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:41:48.390 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:41:48.390 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:41:48.390 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:41:48.390 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:41:48.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.391+0000 7f7f7c51a640 1 -- 172.21.15.170:0/3291589617 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7f60079e30 msgr2=0x7f7f6007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:48.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.391+0000 7f7f7c51a640 1 --2- 172.21.15.170:0/3291589617 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7f60079e30 0x7f7f6007c2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7f741029e0 tx=0x7f7f70005c70 comp rx=0 tx=0).stop 2024-09-04T16:41:48.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.391+0000 7f7f7c51a640 1 -- 172.21.15.170:0/3291589617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f740ffd70 msgr2=0x7f7f74100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:41:48.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.391+0000 7f7f7c51a640 1 --2- 172.21.15.170:0/3291589617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f740ffd70 0x7f7f74100f50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7f68031460 tx=0x7f7f680048f0 comp rx=0 tx=0).stop 2024-09-04T16:41:48.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.391+0000 7f7f7c51a640 1 -- 172.21.15.170:0/3291589617 shutdown_connections 2024-09-04T16:41:48.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.391+0000 7f7f7c51a640 1 --2- 172.21.15.170:0/3291589617 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7f60079e30 0x7f7f6007c2f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:48.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.391+0000 7f7f7c51a640 1 --2- 172.21.15.170:0/3291589617 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7f74106950 0x7f7f74101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:48.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.391+0000 7f7f7c51a640 1 --2- 172.21.15.170:0/3291589617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f740ffd70 0x7f7f74100f50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:41:48.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.391+0000 7f7f7c51a640 1 -- 172.21.15.170:0/3291589617 >> 172.21.15.170:0/3291589617 conn(0x7f7f740fbc60 msgr2=0x7f7f740fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:41:48.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.391+0000 7f7f7c51a640 1 -- 172.21.15.170:0/3291589617 shutdown_connections 2024-09-04T16:41:48.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:41:48.391+0000 7f7f7c51a640 1 -- 172.21.15.170:0/3291589617 wait complete. 2024-09-04T16:41:48.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:48 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3173419534' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:41:48.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:48 smithi170 ceph-mon[113855]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:41:48.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:48 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3291589617' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:41:48.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:48 smithi170 ceph-mon[113855]: pgmap v363: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:48 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3173419534' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:41:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:48 smithi193 ceph-mon[82547]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:41:48.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:48 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3291589617' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:41:48.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:48 smithi193 ceph-mon[82547]: pgmap v363: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:50.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:50 smithi170 ceph-mon[113855]: pgmap v364: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:50 smithi193 ceph-mon[82547]: pgmap v364: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:52.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:52 smithi170 ceph-mon[113855]: pgmap v365: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:52 smithi193 ceph-mon[82547]: pgmap v365: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:54.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:54 smithi170 ceph-mon[113855]: pgmap v366: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:54 smithi193 ceph-mon[82547]: pgmap v366: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:56.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:56 smithi170 ceph-mon[113855]: pgmap v367: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:56.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:56 smithi193 ceph-mon[82547]: pgmap v367: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:58.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:58 smithi170 ceph-mon[113855]: pgmap v368: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:58.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:58 smithi193 ceph-mon[82547]: pgmap v368: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:41:59.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:41:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:41:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:41:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:42:00.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:00 smithi170 ceph-mon[113855]: pgmap v369: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:00 smithi193 ceph-mon[82547]: pgmap v369: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:02.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:02 smithi170 ceph-mon[113855]: pgmap v370: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:02.904 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:02 smithi193 ceph-mon[82547]: pgmap v370: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:04.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:04 smithi170 ceph-mon[113855]: pgmap v371: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:04.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:04 smithi193 ceph-mon[82547]: pgmap v371: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:06.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:06 smithi170 ceph-mon[113855]: pgmap v372: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:06.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:06 smithi193 ceph-mon[82547]: pgmap v372: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:08.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:08 smithi170 ceph-mon[113855]: pgmap v373: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:08 smithi193 ceph-mon[82547]: pgmap v373: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:10.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:10 smithi170 ceph-mon[113855]: pgmap v374: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:10.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:10 smithi193 ceph-mon[82547]: pgmap v374: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:12.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:12 smithi170 ceph-mon[113855]: pgmap v375: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:12.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:12 smithi193 ceph-mon[82547]: pgmap v375: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:42:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:42:15.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:15 smithi170 ceph-mon[113855]: pgmap v376: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:15 smithi193 ceph-mon[82547]: pgmap v376: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:16.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:16 smithi170 ceph-mon[113855]: pgmap v377: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:16.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:16 smithi193 ceph-mon[82547]: pgmap v377: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:18.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.486+0000 7fce5a3aa640 1 -- 172.21.15.170:0/2058966540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce541067e0 msgr2=0x7fce54106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:18.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.486+0000 7fce5a3aa640 1 --2- 172.21.15.170:0/2058966540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce541067e0 0x7fce54106bc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fce44009880 tx=0x7fce4402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:42:18.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.486+0000 7fce5a3aa640 1 -- 172.21.15.170:0/2058966540 shutdown_connections 2024-09-04T16:42:18.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.486+0000 7fce5a3aa640 1 --2- 172.21.15.170:0/2058966540 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce541007e0 0x7fce54100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:18.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.486+0000 7fce5a3aa640 1 --2- 172.21.15.170:0/2058966540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce541067e0 0x7fce54106bc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:18.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.486+0000 7fce5a3aa640 1 -- 172.21.15.170:0/2058966540 >> 172.21.15.170:0/2058966540 conn(0x7fce540fc4c0 msgr2=0x7fce540fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:18.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.486+0000 7fce5a3aa640 1 -- 172.21.15.170:0/2058966540 shutdown_connections 2024-09-04T16:42:18.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.486+0000 7fce5a3aa640 1 -- 172.21.15.170:0/2058966540 wait complete. 2024-09-04T16:42:18.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.487+0000 7fce5a3aa640 1 Processor -- start 2024-09-04T16:42:18.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.487+0000 7fce5a3aa640 1 -- start start 2024-09-04T16:42:18.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.487+0000 7fce5a3aa640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce541007e0 0x7fce5419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:18.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.487+0000 7fce5a3aa640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce541067e0 0x7fce5419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:18.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.487+0000 7fce5a3aa640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fce5410dc90 con 0x7fce541007e0 2024-09-04T16:42:18.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.487+0000 7fce5a3aa640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fce5410db10 con 0x7fce541067e0 2024-09-04T16:42:18.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.487+0000 7fce53fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce541007e0 0x7fce5419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:18.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.487+0000 7fce53fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce541007e0 0x7fce5419d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37718/0 (socket says 172.21.15.170:37718) 2024-09-04T16:42:18.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.487+0000 7fce53fff640 1 -- 172.21.15.170:0/1146400274 learned_addr learned my addr 172.21.15.170:0/1146400274 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:42:18.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.487+0000 7fce537fe640 1 --2- 172.21.15.170:0/1146400274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce541067e0 0x7fce5419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:18.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.488+0000 7fce53fff640 1 -- 172.21.15.170:0/1146400274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce541067e0 msgr2=0x7fce5419dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:18.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.488+0000 7fce53fff640 1 --2- 172.21.15.170:0/1146400274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce541067e0 0x7fce5419dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:18.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.488+0000 7fce53fff640 1 -- 172.21.15.170:0/1146400274 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce54197760 con 0x7fce541007e0 2024-09-04T16:42:18.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.488+0000 7fce53fff640 1 --2- 172.21.15.170:0/1146400274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce541007e0 0x7fce5419d690 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fce44031460 tx=0x7fce440045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:18.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.488+0000 7fce517fa640 1 -- 172.21.15.170:0/1146400274 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce4403f070 con 0x7fce541007e0 2024-09-04T16:42:18.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.488+0000 7fce517fa640 1 -- 172.21.15.170:0/1146400274 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce44004b10 con 0x7fce541007e0 2024-09-04T16:42:18.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.488+0000 7fce5a3aa640 1 -- 172.21.15.170:0/1146400274 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce541979f0 con 0x7fce541007e0 2024-09-04T16:42:18.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.488+0000 7fce517fa640 1 -- 172.21.15.170:0/1146400274 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce44035030 con 0x7fce541007e0 2024-09-04T16:42:18.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.488+0000 7fce5a3aa640 1 -- 172.21.15.170:0/1146400274 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce54197ef0 con 0x7fce541007e0 2024-09-04T16:42:18.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.489+0000 7fce5a3aa640 1 -- 172.21.15.170:0/1146400274 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce54101f20 con 0x7fce541007e0 2024-09-04T16:42:18.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.490+0000 7fce517fa640 1 -- 172.21.15.170:0/1146400274 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fce44042070 con 0x7fce541007e0 2024-09-04T16:42:18.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.490+0000 7fce517fa640 1 --2- 172.21.15.170:0/1146400274 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fce3c079e90 0x7fce3c07c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:18.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.491+0000 7fce517fa640 1 -- 172.21.15.170:0/1146400274 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fce440bd470 con 0x7fce541007e0 2024-09-04T16:42:18.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.491+0000 7fce537fe640 1 --2- 172.21.15.170:0/1146400274 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fce3c079e90 0x7fce3c07c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:18.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.491+0000 7fce537fe640 1 --2- 172.21.15.170:0/1146400274 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fce3c079e90 0x7fce3c07c350 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fce54198fb0 tx=0x7fce4800b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:18.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.495+0000 7fce517fa640 1 -- 172.21.15.170:0/1146400274 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fce44089070 con 0x7fce541007e0 2024-09-04T16:42:18.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.686+0000 7fce5a3aa640 1 -- 172.21.15.170:0/1146400274 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fce54198260 con 0x7fce3c079e90 2024-09-04T16:42:18.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.687+0000 7fce517fa640 1 -- 172.21.15.170:0/1146400274 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fce54198260 con 0x7fce3c079e90 2024-09-04T16:42:18.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.689+0000 7fce5a3aa640 1 -- 172.21.15.170:0/1146400274 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fce3c079e90 msgr2=0x7fce3c07c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:18.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.689+0000 7fce5a3aa640 1 --2- 172.21.15.170:0/1146400274 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fce3c079e90 0x7fce3c07c350 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fce54198fb0 tx=0x7fce4800b390 comp rx=0 tx=0).stop 2024-09-04T16:42:18.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.689+0000 7fce5a3aa640 1 -- 172.21.15.170:0/1146400274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce541007e0 msgr2=0x7fce5419d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:18.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.689+0000 7fce5a3aa640 1 --2- 172.21.15.170:0/1146400274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce541007e0 0x7fce5419d690 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fce44031460 tx=0x7fce440045e0 comp rx=0 tx=0).stop 2024-09-04T16:42:18.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.690+0000 7fce5a3aa640 1 -- 172.21.15.170:0/1146400274 shutdown_connections 2024-09-04T16:42:18.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.690+0000 7fce5a3aa640 1 --2- 172.21.15.170:0/1146400274 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fce3c079e90 0x7fce3c07c350 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:18.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.690+0000 7fce5a3aa640 1 --2- 172.21.15.170:0/1146400274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce541067e0 0x7fce5419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:18.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.690+0000 7fce5a3aa640 1 --2- 172.21.15.170:0/1146400274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce541007e0 0x7fce5419d690 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:18.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.690+0000 7fce5a3aa640 1 -- 172.21.15.170:0/1146400274 >> 172.21.15.170:0/1146400274 conn(0x7fce540fc4c0 msgr2=0x7fce54069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:18.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.690+0000 7fce5a3aa640 1 -- 172.21.15.170:0/1146400274 shutdown_connections 2024-09-04T16:42:18.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.690+0000 7fce5a3aa640 1 -- 172.21.15.170:0/1146400274 wait complete. 2024-09-04T16:42:18.700 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:42:18.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.773+0000 7fa177b45640 1 -- 172.21.15.170:0/128884845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1701067f0 msgr2=0x7fa170106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:18.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.773+0000 7fa177b45640 1 --2- 172.21.15.170:0/128884845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1701067f0 0x7fa170106bd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa160009880 tx=0x7fa16002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:42:18.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.773+0000 7fa177b45640 1 -- 172.21.15.170:0/128884845 shutdown_connections 2024-09-04T16:42:18.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.773+0000 7fa177b45640 1 --2- 172.21.15.170:0/128884845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1701007f0 0x7fa170100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:18.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.773+0000 7fa177b45640 1 --2- 172.21.15.170:0/128884845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1701067f0 0x7fa170106bd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:18.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.773+0000 7fa177b45640 1 -- 172.21.15.170:0/128884845 >> 172.21.15.170:0/128884845 conn(0x7fa1700fc4f0 msgr2=0x7fa1700fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:18.774 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:18 smithi170 ceph-mon[113855]: pgmap v378: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:18.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.773+0000 7fa177b45640 1 -- 172.21.15.170:0/128884845 shutdown_connections 2024-09-04T16:42:18.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.773+0000 7fa177b45640 1 -- 172.21.15.170:0/128884845 wait complete. 2024-09-04T16:42:18.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.773+0000 7fa177b45640 1 Processor -- start 2024-09-04T16:42:18.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.774+0000 7fa177b45640 1 -- start start 2024-09-04T16:42:18.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.774+0000 7fa177b45640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1701007f0 0x7fa1701987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:18.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.774+0000 7fa177b45640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1701067f0 0x7fa170198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:18.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.774+0000 7fa177b45640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa17010dcc0 con 0x7fa1701067f0 2024-09-04T16:42:18.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.774+0000 7fa177b45640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa17010db40 con 0x7fa1701007f0 2024-09-04T16:42:18.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.774+0000 7fa1750e0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1701067f0 0x7fa170198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:18.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.774+0000 7fa1750e0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1701067f0 0x7fa170198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37744/0 (socket says 172.21.15.170:37744) 2024-09-04T16:42:18.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.774+0000 7fa1750e0640 1 -- 172.21.15.170:0/641345967 learned_addr learned my addr 172.21.15.170:0/641345967 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:42:18.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.774+0000 7fa1758e1640 1 --2- 172.21.15.170:0/641345967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1701007f0 0x7fa1701987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:18.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.774+0000 7fa1750e0640 1 -- 172.21.15.170:0/641345967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1701007f0 msgr2=0x7fa1701987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:18.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.774+0000 7fa1750e0640 1 --2- 172.21.15.170:0/641345967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1701007f0 0x7fa1701987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:18.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.774+0000 7fa1750e0640 1 -- 172.21.15.170:0/641345967 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa170199330 con 0x7fa1701067f0 2024-09-04T16:42:18.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.774+0000 7fa1750e0640 1 --2- 172.21.15.170:0/641345967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1701067f0 0x7fa170198d30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00d6f0 tx=0x7fa16c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:18.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.775+0000 7fa166ffd640 1 -- 172.21.15.170:0/641345967 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa16c017070 con 0x7fa1701067f0 2024-09-04T16:42:18.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.775+0000 7fa177b45640 1 -- 172.21.15.170:0/641345967 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa170199620 con 0x7fa1701067f0 2024-09-04T16:42:18.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.775+0000 7fa166ffd640 1 -- 172.21.15.170:0/641345967 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa16c00de00 con 0x7fa1701067f0 2024-09-04T16:42:18.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.775+0000 7fa166ffd640 1 -- 172.21.15.170:0/641345967 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa16c004bb0 con 0x7fa1701067f0 2024-09-04T16:42:18.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.775+0000 7fa177b45640 1 -- 172.21.15.170:0/641345967 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1701a1c20 con 0x7fa1701067f0 2024-09-04T16:42:18.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.776+0000 7fa177b45640 1 -- 172.21.15.170:0/641345967 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa170101f30 con 0x7fa1701067f0 2024-09-04T16:42:18.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.776+0000 7fa166ffd640 1 -- 172.21.15.170:0/641345967 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fa16c009a30 con 0x7fa1701067f0 2024-09-04T16:42:18.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.777+0000 7fa166ffd640 1 --2- 172.21.15.170:0/641345967 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa15c079e80 0x7fa15c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:18.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.777+0000 7fa1758e1640 1 --2- 172.21.15.170:0/641345967 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa15c079e80 0x7fa15c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:18.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.777+0000 7fa166ffd640 1 -- 172.21.15.170:0/641345967 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa16c09c610 con 0x7fa1701067f0 2024-09-04T16:42:18.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.778+0000 7fa1758e1640 1 --2- 172.21.15.170:0/641345967 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa15c079e80 0x7fa15c07c340 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa1600096c0 tx=0x7fa160031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:18.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.782+0000 7fa166ffd640 1 -- 172.21.15.170:0/641345967 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa170199620 con 0x7fa1701067f0 2024-09-04T16:42:18.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:18 smithi193 ceph-mon[82547]: pgmap v378: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:18.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.975+0000 7fa177b45640 1 -- 172.21.15.170:0/641345967 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa170062630 con 0x7fa15c079e80 2024-09-04T16:42:18.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.976+0000 7fa166ffd640 1 -- 172.21.15.170:0/641345967 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa170062630 con 0x7fa15c079e80 2024-09-04T16:42:18.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.978+0000 7fa177b45640 1 -- 172.21.15.170:0/641345967 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa15c079e80 msgr2=0x7fa15c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:18.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.978+0000 7fa177b45640 1 --2- 172.21.15.170:0/641345967 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa15c079e80 0x7fa15c07c340 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa1600096c0 tx=0x7fa160031400 comp rx=0 tx=0).stop 2024-09-04T16:42:18.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.978+0000 7fa177b45640 1 -- 172.21.15.170:0/641345967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1701067f0 msgr2=0x7fa170198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:18.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.978+0000 7fa177b45640 1 --2- 172.21.15.170:0/641345967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1701067f0 0x7fa170198d30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00d6f0 tx=0x7fa16c00dbb0 comp rx=0 tx=0).stop 2024-09-04T16:42:18.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.978+0000 7fa177b45640 1 -- 172.21.15.170:0/641345967 shutdown_connections 2024-09-04T16:42:18.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.978+0000 7fa177b45640 1 --2- 172.21.15.170:0/641345967 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa15c079e80 0x7fa15c07c340 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:18.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.978+0000 7fa177b45640 1 --2- 172.21.15.170:0/641345967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1701067f0 0x7fa170198d30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:18.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.978+0000 7fa177b45640 1 --2- 172.21.15.170:0/641345967 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1701007f0 0x7fa1701987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:18.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.978+0000 7fa177b45640 1 -- 172.21.15.170:0/641345967 >> 172.21.15.170:0/641345967 conn(0x7fa1700fc4f0 msgr2=0x7fa1700fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:18.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.978+0000 7fa177b45640 1 -- 172.21.15.170:0/641345967 shutdown_connections 2024-09-04T16:42:18.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:18.978+0000 7fa177b45640 1 -- 172.21.15.170:0/641345967 wait complete. 2024-09-04T16:42:19.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.060+0000 7f5f7f819640 1 -- 172.21.15.170:0/2519420189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f781007e0 msgr2=0x7f5f78100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:19.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.060+0000 7f5f7f819640 1 --2- 172.21.15.170:0/2519420189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f781007e0 0x7f5f78100c40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009880 tx=0x7f5f7402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.060+0000 7f5f7f819640 1 -- 172.21.15.170:0/2519420189 shutdown_connections 2024-09-04T16:42:19.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.060+0000 7f5f7f819640 1 --2- 172.21.15.170:0/2519420189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f781007e0 0x7f5f78100c40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.060+0000 7f5f7f819640 1 --2- 172.21.15.170:0/2519420189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f781067e0 0x7f5f78106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.060+0000 7f5f7f819640 1 -- 172.21.15.170:0/2519420189 >> 172.21.15.170:0/2519420189 conn(0x7f5f780fc4c0 msgr2=0x7f5f780fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:19.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.060+0000 7f5f7f819640 1 -- 172.21.15.170:0/2519420189 shutdown_connections 2024-09-04T16:42:19.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.060+0000 7f5f7f819640 1 -- 172.21.15.170:0/2519420189 wait complete. 2024-09-04T16:42:19.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.061+0000 7f5f7f819640 1 Processor -- start 2024-09-04T16:42:19.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.061+0000 7f5f7f819640 1 -- start start 2024-09-04T16:42:19.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.061+0000 7f5f7f819640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f781007e0 0x7f5f7819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:19.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.061+0000 7f5f7f819640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f781067e0 0x7f5f7819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:19.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.061+0000 7f5f7f819640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7810dc90 con 0x7f5f781007e0 2024-09-04T16:42:19.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.061+0000 7f5f7f819640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7810db10 con 0x7f5f781067e0 2024-09-04T16:42:19.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.061+0000 7f5f7d5b5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f781007e0 0x7f5f7819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:19.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.061+0000 7f5f7d5b5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f781007e0 0x7f5f7819d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37774/0 (socket says 172.21.15.170:37774) 2024-09-04T16:42:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.061+0000 7f5f7d5b5640 1 -- 172.21.15.170:0/2357858213 learned_addr learned my addr 172.21.15.170:0/2357858213 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:42:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.061+0000 7f5f7cdb4640 1 --2- 172.21.15.170:0/2357858213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f781067e0 0x7f5f7819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.061+0000 7f5f7d5b5640 1 -- 172.21.15.170:0/2357858213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f781067e0 msgr2=0x7f5f7819db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.061+0000 7f5f7d5b5640 1 --2- 172.21.15.170:0/2357858213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f781067e0 0x7f5f7819db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.061+0000 7f5f7d5b5640 1 -- 172.21.15.170:0/2357858213 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f781977a0 con 0x7f5f781007e0 2024-09-04T16:42:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.061+0000 7f5f7cdb4640 1 --2- 172.21.15.170:0/2357858213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f781067e0 0x7f5f7819db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:42:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.061+0000 7f5f7d5b5640 1 --2- 172.21.15.170:0/2357858213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f781007e0 0x7f5f7819d620 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5f6800d8d0 tx=0x7f5f6800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.062+0000 7f5f6e7fc640 1 -- 172.21.15.170:0/2357858213 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f68017030 con 0x7f5f781007e0 2024-09-04T16:42:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.062+0000 7f5f7f819640 1 -- 172.21.15.170:0/2357858213 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f78197a90 con 0x7f5f781007e0 2024-09-04T16:42:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.062+0000 7f5f6e7fc640 1 -- 172.21.15.170:0/2357858213 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f68004020 con 0x7f5f781007e0 2024-09-04T16:42:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.062+0000 7f5f6e7fc640 1 -- 172.21.15.170:0/2357858213 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f680047a0 con 0x7f5f781007e0 2024-09-04T16:42:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.062+0000 7f5f7f819640 1 -- 172.21.15.170:0/2357858213 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f78198020 con 0x7f5f781007e0 2024-09-04T16:42:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.063+0000 7f5f7f819640 1 -- 172.21.15.170:0/2357858213 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f78101f20 con 0x7f5f781007e0 2024-09-04T16:42:19.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.063+0000 7f5f6e7fc640 1 -- 172.21.15.170:0/2357858213 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5f680041d0 con 0x7f5f781007e0 2024-09-04T16:42:19.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.064+0000 7f5f6e7fc640 1 --2- 172.21.15.170:0/2357858213 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f64079e90 0x7f5f6407c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:19.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.064+0000 7f5f6e7fc640 1 -- 172.21.15.170:0/2357858213 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5f68018070 con 0x7f5f781007e0 2024-09-04T16:42:19.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.064+0000 7f5f7cdb4640 1 --2- 172.21.15.170:0/2357858213 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f64079e90 0x7f5f6407c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:19.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.064+0000 7f5f7cdb4640 1 --2- 172.21.15.170:0/2357858213 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f64079e90 0x7f5f6407c350 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5f74031460 tx=0x7f5f740041a0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:19.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.068+0000 7f5f6e7fc640 1 -- 172.21.15.170:0/2357858213 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5f680642a0 con 0x7f5f781007e0 2024-09-04T16:42:19.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.253+0000 7f5f7f819640 1 -- 172.21.15.170:0/2357858213 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5f78198330 con 0x7f5f64079e90 2024-09-04T16:42:19.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.263+0000 7f5f6e7fc640 1 -- 172.21.15.170:0/2357858213 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5f78198330 con 0x7f5f64079e90 2024-09-04T16:42:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:42:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (9m) 3m ago 20m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:42:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (12m) 3m ago 20m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:42:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (11m) 3m ago 19m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:42:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (7m) 3m ago 20m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:42:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (7m) 3m ago 19m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:42:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (8m) 3m ago 19m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:42:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (3m) 3m ago 14m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:42:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (3m) 3m ago 14m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:42:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (3m) 3m ago 14m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:42:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (3m) 3m ago 14m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:42:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (11m) 3m ago 21m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:42:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (10m) 3m ago 19m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:42:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (7m) 3m ago 21m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:42:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (7m) 3m ago 19m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:42:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (10m) 3m ago 20m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:42:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (10m) 3m ago 19m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:42:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (7m) 3m ago 18m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:42:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (6m) 3m ago 17m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:42:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (5m) 3m ago 17m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:42:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (5m) 3m ago 16m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:42:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (4m) 3m ago 16m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:42:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (4m) 3m ago 15m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:42:19.265 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (9m) 3m ago 19m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:42:19.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.265+0000 7f5f7f819640 1 -- 172.21.15.170:0/2357858213 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f64079e90 msgr2=0x7f5f6407c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:19.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.265+0000 7f5f7f819640 1 --2- 172.21.15.170:0/2357858213 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f64079e90 0x7f5f6407c350 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5f74031460 tx=0x7f5f740041a0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.265+0000 7f5f7f819640 1 -- 172.21.15.170:0/2357858213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f781007e0 msgr2=0x7f5f7819d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:19.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.265+0000 7f5f7f819640 1 --2- 172.21.15.170:0/2357858213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f781007e0 0x7f5f7819d620 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5f6800d8d0 tx=0x7f5f6800dd90 comp rx=0 tx=0).stop 2024-09-04T16:42:19.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.265+0000 7f5f7f819640 1 -- 172.21.15.170:0/2357858213 shutdown_connections 2024-09-04T16:42:19.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.265+0000 7f5f7f819640 1 --2- 172.21.15.170:0/2357858213 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f64079e90 0x7f5f6407c350 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.265+0000 7f5f7f819640 1 --2- 172.21.15.170:0/2357858213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f781067e0 0x7f5f7819db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.265+0000 7f5f7f819640 1 --2- 172.21.15.170:0/2357858213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f781007e0 0x7f5f7819d620 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.265+0000 7f5f7f819640 1 -- 172.21.15.170:0/2357858213 >> 172.21.15.170:0/2357858213 conn(0x7f5f780fc4c0 msgr2=0x7f5f78069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:19.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.265+0000 7f5f7f819640 1 -- 172.21.15.170:0/2357858213 shutdown_connections 2024-09-04T16:42:19.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.265+0000 7f5f7f819640 1 -- 172.21.15.170:0/2357858213 wait complete. 2024-09-04T16:42:19.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.345+0000 7fccee579640 1 -- 172.21.15.170:0/3924054628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcce8100820 msgr2=0x7fcce8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:19.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.345+0000 7fccee579640 1 --2- 172.21.15.170:0/3924054628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcce8100820 0x7fcce8100c80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009880 tx=0x7fccdc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.345+0000 7fccee579640 1 -- 172.21.15.170:0/3924054628 shutdown_connections 2024-09-04T16:42:19.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.345+0000 7fccee579640 1 --2- 172.21.15.170:0/3924054628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcce8100820 0x7fcce8100c80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.345+0000 7fccee579640 1 --2- 172.21.15.170:0/3924054628 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcce8106820 0x7fcce8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.345+0000 7fccee579640 1 -- 172.21.15.170:0/3924054628 >> 172.21.15.170:0/3924054628 conn(0x7fcce80fc520 msgr2=0x7fcce80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:19.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.345+0000 7fccee579640 1 -- 172.21.15.170:0/3924054628 shutdown_connections 2024-09-04T16:42:19.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.345+0000 7fccee579640 1 -- 172.21.15.170:0/3924054628 wait complete. 2024-09-04T16:42:19.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.346+0000 7fccee579640 1 Processor -- start 2024-09-04T16:42:19.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.346+0000 7fccee579640 1 -- start start 2024-09-04T16:42:19.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.346+0000 7fccee579640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcce8100820 0x7fcce819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:19.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.346+0000 7fccee579640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcce8106820 0x7fcce819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:19.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.346+0000 7fccee579640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcce810dcd0 con 0x7fcce8106820 2024-09-04T16:42:19.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.346+0000 7fccee579640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcce810db50 con 0x7fcce8100820 2024-09-04T16:42:19.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.347+0000 7fcce77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcce8106820 0x7fcce819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:19.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.347+0000 7fcce77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcce8106820 0x7fcce819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37796/0 (socket says 172.21.15.170:37796) 2024-09-04T16:42:19.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.347+0000 7fcce77fe640 1 -- 172.21.15.170:0/406288263 learned_addr learned my addr 172.21.15.170:0/406288263 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:42:19.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.347+0000 7fcce7fff640 1 --2- 172.21.15.170:0/406288263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcce8100820 0x7fcce819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:19.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.347+0000 7fcce77fe640 1 -- 172.21.15.170:0/406288263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcce8100820 msgr2=0x7fcce819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:19.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.347+0000 7fcce77fe640 1 --2- 172.21.15.170:0/406288263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcce8100820 0x7fcce819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.347+0000 7fcce77fe640 1 -- 172.21.15.170:0/406288263 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce81977b0 con 0x7fcce8106820 2024-09-04T16:42:19.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.347+0000 7fcce77fe640 1 --2- 172.21.15.170:0/406288263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcce8106820 0x7fcce819db70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fccdc031460 tx=0x7fccdc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:19.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.347+0000 7fcce57fa640 1 -- 172.21.15.170:0/406288263 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fccdc03f070 con 0x7fcce8106820 2024-09-04T16:42:19.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.347+0000 7fccee579640 1 -- 172.21.15.170:0/406288263 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce8197a40 con 0x7fcce8106820 2024-09-04T16:42:19.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.347+0000 7fccee579640 1 -- 172.21.15.170:0/406288263 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce8197f70 con 0x7fcce8106820 2024-09-04T16:42:19.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.347+0000 7fcce57fa640 1 -- 172.21.15.170:0/406288263 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fccdc004cf0 con 0x7fcce8106820 2024-09-04T16:42:19.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.347+0000 7fcce57fa640 1 -- 172.21.15.170:0/406288263 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fccdc035030 con 0x7fcce8106820 2024-09-04T16:42:19.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.348+0000 7fccee579640 1 -- 172.21.15.170:0/406288263 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce8101f60 con 0x7fcce8106820 2024-09-04T16:42:19.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.349+0000 7fcce57fa640 1 -- 172.21.15.170:0/406288263 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fccdc042070 con 0x7fcce8106820 2024-09-04T16:42:19.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.350+0000 7fcce57fa640 1 --2- 172.21.15.170:0/406288263 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fccd0079e80 0x7fccd007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:19.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.350+0000 7fcce57fa640 1 -- 172.21.15.170:0/406288263 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fccdc0bda40 con 0x7fcce8106820 2024-09-04T16:42:19.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.350+0000 7fcce7fff640 1 --2- 172.21.15.170:0/406288263 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fccd0079e80 0x7fccd007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:19.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.350+0000 7fcce7fff640 1 --2- 172.21.15.170:0/406288263 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fccd0079e80 0x7fccd007c340 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fccd800abe0 tx=0x7fccd800a2d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:19.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.355+0000 7fcce57fa640 1 -- 172.21.15.170:0/406288263 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fccdc0854f0 con 0x7fcce8106820 2024-09-04T16:42:19.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.598+0000 7fccee579640 1 -- 172.21.15.170:0/406288263 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fcce8198220 con 0x7fcce8106820 2024-09-04T16:42:19.599 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:19 smithi170 ceph-mon[113855]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:42:19.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:19 smithi170 ceph-mon[113855]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:42:19.600 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:19 smithi170 ceph-mon[113855]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:42:19.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.599+0000 7fcce57fa640 1 -- 172.21.15.170:0/406288263 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fccdc089660 con 0x7fcce8106820 2024-09-04T16:42:19.600 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:42:19.600 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:42:19.600 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:42:19.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:42:19.600 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:42:19.601 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:42:19.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:42:19.601 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:42:19.601 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:42:19.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:42:19.601 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:42:19.601 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:42:19.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:42:19.601 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:42:19.601 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:42:19.601 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:42:19.601 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:42:19.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.601+0000 7fccee579640 1 -- 172.21.15.170:0/406288263 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fccd0079e80 msgr2=0x7fccd007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:19.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.601+0000 7fccee579640 1 --2- 172.21.15.170:0/406288263 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fccd0079e80 0x7fccd007c340 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fccd800abe0 tx=0x7fccd800a2d0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.601+0000 7fccee579640 1 -- 172.21.15.170:0/406288263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcce8106820 msgr2=0x7fcce819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:19.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.601+0000 7fccee579640 1 --2- 172.21.15.170:0/406288263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcce8106820 0x7fcce819db70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fccdc031460 tx=0x7fccdc0048f0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.601+0000 7fccee579640 1 -- 172.21.15.170:0/406288263 shutdown_connections 2024-09-04T16:42:19.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.601+0000 7fccee579640 1 --2- 172.21.15.170:0/406288263 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fccd0079e80 0x7fccd007c340 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.601+0000 7fccee579640 1 --2- 172.21.15.170:0/406288263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcce8106820 0x7fcce819db70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.601+0000 7fccee579640 1 --2- 172.21.15.170:0/406288263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcce8100820 0x7fcce819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.601+0000 7fccee579640 1 -- 172.21.15.170:0/406288263 >> 172.21.15.170:0/406288263 conn(0x7fcce80fc520 msgr2=0x7fcce81045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:19.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.601+0000 7fccee579640 1 -- 172.21.15.170:0/406288263 shutdown_connections 2024-09-04T16:42:19.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.601+0000 7fccee579640 1 -- 172.21.15.170:0/406288263 wait complete. 2024-09-04T16:42:19.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.683+0000 7fe7ad7ab640 1 -- 172.21.15.170:0/2998859933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7a8106950 msgr2=0x7fe7a8106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:19.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.683+0000 7fe7ad7ab640 1 --2- 172.21.15.170:0/2998859933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7a8106950 0x7fe7a8106d30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe798009880 tx=0x7fe79802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.683+0000 7fe7ad7ab640 1 -- 172.21.15.170:0/2998859933 shutdown_connections 2024-09-04T16:42:19.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.683+0000 7fe7ad7ab640 1 --2- 172.21.15.170:0/2998859933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7a80ffd70 0x7fe7a81001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.683+0000 7fe7ad7ab640 1 --2- 172.21.15.170:0/2998859933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7a8106950 0x7fe7a8106d30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.683+0000 7fe7ad7ab640 1 -- 172.21.15.170:0/2998859933 >> 172.21.15.170:0/2998859933 conn(0x7fe7a80fbc60 msgr2=0x7fe7a80fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:19.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.683+0000 7fe7ad7ab640 1 -- 172.21.15.170:0/2998859933 shutdown_connections 2024-09-04T16:42:19.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.683+0000 7fe7ad7ab640 1 -- 172.21.15.170:0/2998859933 wait complete. 2024-09-04T16:42:19.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.683+0000 7fe7ad7ab640 1 Processor -- start 2024-09-04T16:42:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.684+0000 7fe7ad7ab640 1 -- start start 2024-09-04T16:42:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.684+0000 7fe7ad7ab640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7a80ffd70 0x7fe7a8100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.684+0000 7fe7ad7ab640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7a8106950 0x7fe7a8101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.684+0000 7fe7ad7ab640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a810ef50 con 0x7fe7a80ffd70 2024-09-04T16:42:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.684+0000 7fe7ad7ab640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a810edd0 con 0x7fe7a8106950 2024-09-04T16:42:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.684+0000 7fe7a6ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7a80ffd70 0x7fe7a8100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.684+0000 7fe7a6ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7a80ffd70 0x7fe7a8100f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37810/0 (socket says 172.21.15.170:37810) 2024-09-04T16:42:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.684+0000 7fe7a6ffd640 1 -- 172.21.15.170:0/721957235 learned_addr learned my addr 172.21.15.170:0/721957235 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:42:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.684+0000 7fe7a67fc640 1 --2- 172.21.15.170:0/721957235 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7a8106950 0x7fe7a8101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:19.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.684+0000 7fe7a6ffd640 1 -- 172.21.15.170:0/721957235 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7a8106950 msgr2=0x7fe7a8101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:19.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.684+0000 7fe7a6ffd640 1 --2- 172.21.15.170:0/721957235 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7a8106950 0x7fe7a8101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.684+0000 7fe7a6ffd640 1 -- 172.21.15.170:0/721957235 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a81019d0 con 0x7fe7a80ffd70 2024-09-04T16:42:19.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.684+0000 7fe7a67fc640 1 --2- 172.21.15.170:0/721957235 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7a8106950 0x7fe7a8101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:42:19.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.684+0000 7fe7a6ffd640 1 --2- 172.21.15.170:0/721957235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7a80ffd70 0x7fe7a8100f50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe798031460 tx=0x7fe7980048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:19.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.685+0000 7fe79ffff640 1 -- 172.21.15.170:0/721957235 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe79803f070 con 0x7fe7a80ffd70 2024-09-04T16:42:19.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.685+0000 7fe7ad7ab640 1 -- 172.21.15.170:0/721957235 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a8101c60 con 0x7fe7a80ffd70 2024-09-04T16:42:19.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.685+0000 7fe79ffff640 1 -- 172.21.15.170:0/721957235 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe798004cf0 con 0x7fe7a80ffd70 2024-09-04T16:42:19.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.685+0000 7fe79ffff640 1 -- 172.21.15.170:0/721957235 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe798035030 con 0x7fe7a80ffd70 2024-09-04T16:42:19.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.685+0000 7fe7ad7ab640 1 -- 172.21.15.170:0/721957235 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a81a3e60 con 0x7fe7a80ffd70 2024-09-04T16:42:19.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.686+0000 7fe7ad7ab640 1 -- 172.21.15.170:0/721957235 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7a8103090 con 0x7fe7a80ffd70 2024-09-04T16:42:19.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.686+0000 7fe79ffff640 1 -- 172.21.15.170:0/721957235 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fe798042070 con 0x7fe7a80ffd70 2024-09-04T16:42:19.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.687+0000 7fe79ffff640 1 --2- 172.21.15.170:0/721957235 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe794079e30 0x7fe79407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:19.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.687+0000 7fe79ffff640 1 -- 172.21.15.170:0/721957235 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe7980bd5d0 con 0x7fe7a80ffd70 2024-09-04T16:42:19.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.687+0000 7fe7a67fc640 1 --2- 172.21.15.170:0/721957235 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe794079e30 0x7fe79407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:19.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.687+0000 7fe7a67fc640 1 --2- 172.21.15.170:0/721957235 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe794079e30 0x7fe79407c2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe790006fd0 tx=0x7fe790008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:19.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.691+0000 7fe79ffff640 1 -- 172.21.15.170:0/721957235 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe798084fe0 con 0x7fe7a80ffd70 2024-09-04T16:42:19.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.900+0000 7fe7ad7ab640 1 -- 172.21.15.170:0/721957235 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe7a8102480 con 0x7fe7a80ffd70 2024-09-04T16:42:19.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.900+0000 7fe79ffff640 1 -- 172.21.15.170:0/721957235 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7fe798089150 con 0x7fe7a80ffd70 2024-09-04T16:42:19.901 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:42:19.902 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:42:19.902 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:42:19.902 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:42:19.902 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:42:19.902 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:42:19.902 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:42:19.902 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:42:19.902 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:42:19.902 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:42:19.902 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:42:19.902 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:42:19.902 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:42:19.902 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:42:19.903 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:42:19.903 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:42:19.903 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:42:19.903 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:42:19.903 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:42:19.903 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:42:19.903 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:42:19.903 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:42:19.903 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:42:19.903 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:42:19.903 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:42:19.903 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:42:19.903 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:42:19.904 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:42:19.904 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:42:19.904 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:42:19.904 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:42:19.904 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:42:19.904 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:42:19.904 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:42:19.904 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:42:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:42:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:42:19.904 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:42:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:42:19.904 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:42:19.904 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:42:19.904 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:42:19.905 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:42:19.906 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:42:19.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.903+0000 7fe7ad7ab640 1 -- 172.21.15.170:0/721957235 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe794079e30 msgr2=0x7fe79407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:19.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.903+0000 7fe7ad7ab640 1 --2- 172.21.15.170:0/721957235 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe794079e30 0x7fe79407c2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe790006fd0 tx=0x7fe790008040 comp rx=0 tx=0).stop 2024-09-04T16:42:19.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.903+0000 7fe7ad7ab640 1 -- 172.21.15.170:0/721957235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7a80ffd70 msgr2=0x7fe7a8100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:19.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.903+0000 7fe7ad7ab640 1 --2- 172.21.15.170:0/721957235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7a80ffd70 0x7fe7a8100f50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe798031460 tx=0x7fe7980048f0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.903+0000 7fe7ad7ab640 1 -- 172.21.15.170:0/721957235 shutdown_connections 2024-09-04T16:42:19.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.903+0000 7fe7ad7ab640 1 --2- 172.21.15.170:0/721957235 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe794079e30 0x7fe79407c2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.903+0000 7fe7ad7ab640 1 --2- 172.21.15.170:0/721957235 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7a8106950 0x7fe7a8101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.903+0000 7fe7ad7ab640 1 --2- 172.21.15.170:0/721957235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7a80ffd70 0x7fe7a8100f50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.903+0000 7fe7ad7ab640 1 -- 172.21.15.170:0/721957235 >> 172.21.15.170:0/721957235 conn(0x7fe7a80fbc60 msgr2=0x7fe7a80fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:19.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.903+0000 7fe7ad7ab640 1 -- 172.21.15.170:0/721957235 shutdown_connections 2024-09-04T16:42:19.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.903+0000 7fe7ad7ab640 1 -- 172.21.15.170:0/721957235 wait complete. 2024-09-04T16:42:19.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:19 smithi193 ceph-mon[82547]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:42:19.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:19 smithi193 ceph-mon[82547]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:42:19.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:19 smithi193 ceph-mon[82547]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:42:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.985+0000 7f76cee3e640 1 -- 172.21.15.170:0/2377330442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c8100820 msgr2=0x7f76c8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.985+0000 7f76cee3e640 1 --2- 172.21.15.170:0/2377330442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c8100820 0x7f76c8100c80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009880 tx=0x7f76b402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.985+0000 7f76cee3e640 1 -- 172.21.15.170:0/2377330442 shutdown_connections 2024-09-04T16:42:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.985+0000 7f76cee3e640 1 --2- 172.21.15.170:0/2377330442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c8100820 0x7f76c8100c80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.985+0000 7f76cee3e640 1 --2- 172.21.15.170:0/2377330442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76c8106820 0x7f76c8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.985+0000 7f76cee3e640 1 -- 172.21.15.170:0/2377330442 >> 172.21.15.170:0/2377330442 conn(0x7f76c80fc520 msgr2=0x7f76c80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.985+0000 7f76cee3e640 1 -- 172.21.15.170:0/2377330442 shutdown_connections 2024-09-04T16:42:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.985+0000 7f76cee3e640 1 -- 172.21.15.170:0/2377330442 wait complete. 2024-09-04T16:42:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.986+0000 7f76cee3e640 1 Processor -- start 2024-09-04T16:42:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.986+0000 7f76cee3e640 1 -- start start 2024-09-04T16:42:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.986+0000 7f76cee3e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c8100820 0x7f76c8198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.986+0000 7f76cee3e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76c8106820 0x7f76c8198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.986+0000 7f76cee3e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f76c810dcd0 con 0x7f76c8100820 2024-09-04T16:42:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.986+0000 7f76cee3e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f76c810db50 con 0x7f76c8106820 2024-09-04T16:42:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.986+0000 7f76ccbda640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c8100820 0x7f76c8198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.986+0000 7f76ccbda640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c8100820 0x7f76c8198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37826/0 (socket says 172.21.15.170:37826) 2024-09-04T16:42:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.986+0000 7f76ccbda640 1 -- 172.21.15.170:0/697190848 learned_addr learned my addr 172.21.15.170:0/697190848 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:42:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.986+0000 7f76c7fff640 1 --2- 172.21.15.170:0/697190848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76c8106820 0x7f76c8198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.987+0000 7f76ccbda640 1 -- 172.21.15.170:0/697190848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76c8106820 msgr2=0x7f76c8198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.987+0000 7f76ccbda640 1 --2- 172.21.15.170:0/697190848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76c8106820 0x7f76c8198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.987+0000 7f76ccbda640 1 -- 172.21.15.170:0/697190848 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c81992b0 con 0x7f76c8100820 2024-09-04T16:42:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.987+0000 7f76ccbda640 1 --2- 172.21.15.170:0/697190848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c8100820 0x7f76c8198800 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00c8a0 tx=0x7f76bc00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.987+0000 7f76c5ffb640 1 -- 172.21.15.170:0/697190848 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76bc0079b0 con 0x7f76c8100820 2024-09-04T16:42:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.987+0000 7f76c5ffb640 1 -- 172.21.15.170:0/697190848 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76bc007b50 con 0x7f76c8100820 2024-09-04T16:42:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.987+0000 7f76cee3e640 1 -- 172.21.15.170:0/697190848 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c81995a0 con 0x7f76c8100820 2024-09-04T16:42:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.987+0000 7f76c5ffb640 1 -- 172.21.15.170:0/697190848 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76bc018700 con 0x7f76c8100820 2024-09-04T16:42:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.987+0000 7f76cee3e640 1 -- 172.21.15.170:0/697190848 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c81a1ba0 con 0x7f76c8100820 2024-09-04T16:42:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.988+0000 7f76cee3e640 1 -- 172.21.15.170:0/697190848 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c8101f60 con 0x7f76c8100820 2024-09-04T16:42:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.989+0000 7f76c5ffb640 1 -- 172.21.15.170:0/697190848 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f76bc007d00 con 0x7f76c8100820 2024-09-04T16:42:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.989+0000 7f76c5ffb640 1 --2- 172.21.15.170:0/697190848 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76b8079e90 0x7f76b807c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.989+0000 7f76c5ffb640 1 -- 172.21.15.170:0/697190848 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f76bc09ccb0 con 0x7f76c8100820 2024-09-04T16:42:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.989+0000 7f76c7fff640 1 --2- 172.21.15.170:0/697190848 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76b8079e90 0x7f76b807c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.990+0000 7f76c7fff640 1 --2- 172.21.15.170:0/697190848 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76b8079e90 0x7f76b807c350 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f76c806ae50 tx=0x7f76b4009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:19.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:19.993+0000 7f76c5ffb640 1 -- 172.21.15.170:0/697190848 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f76bc014030 con 0x7f76c8100820 2024-09-04T16:42:20.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.183+0000 7f76cee3e640 1 -- 172.21.15.170:0/697190848 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f76c8108e00 con 0x7f76b8079e90 2024-09-04T16:42:20.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.185+0000 7f76c5ffb640 1 -- 172.21.15.170:0/697190848 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f76c8108e00 con 0x7f76b8079e90 2024-09-04T16:42:20.185 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:42:20.186 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:42:20.186 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:42:20.186 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:42:20.186 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:42:20.186 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:42:20.186 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:42:20.186 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:42:20.186 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:42:20.186 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:42:20.186 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:42:20.186 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:42:20.186 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:42:20.186 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:42:20.186 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:42:20.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.187+0000 7f76cee3e640 1 -- 172.21.15.170:0/697190848 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76b8079e90 msgr2=0x7f76b807c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:20.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.187+0000 7f76cee3e640 1 --2- 172.21.15.170:0/697190848 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76b8079e90 0x7f76b807c350 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f76c806ae50 tx=0x7f76b4009560 comp rx=0 tx=0).stop 2024-09-04T16:42:20.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.187+0000 7f76cee3e640 1 -- 172.21.15.170:0/697190848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c8100820 msgr2=0x7f76c8198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:20.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.187+0000 7f76cee3e640 1 --2- 172.21.15.170:0/697190848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c8100820 0x7f76c8198800 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00c8a0 tx=0x7f76bc00cd60 comp rx=0 tx=0).stop 2024-09-04T16:42:20.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.187+0000 7f76cee3e640 1 -- 172.21.15.170:0/697190848 shutdown_connections 2024-09-04T16:42:20.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.187+0000 7f76cee3e640 1 --2- 172.21.15.170:0/697190848 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76b8079e90 0x7f76b807c350 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:20.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.187+0000 7f76cee3e640 1 --2- 172.21.15.170:0/697190848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76c8106820 0x7f76c8198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:20.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.187+0000 7f76cee3e640 1 --2- 172.21.15.170:0/697190848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c8100820 0x7f76c8198800 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:20.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.187+0000 7f76cee3e640 1 -- 172.21.15.170:0/697190848 >> 172.21.15.170:0/697190848 conn(0x7f76c80fc520 msgr2=0x7f76c80fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:20.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.187+0000 7f76cee3e640 1 -- 172.21.15.170:0/697190848 shutdown_connections 2024-09-04T16:42:20.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.187+0000 7f76cee3e640 1 -- 172.21.15.170:0/697190848 wait complete. 2024-09-04T16:42:20.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.269+0000 7fce68508640 1 -- 172.21.15.170:0/2846409443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce60101930 msgr2=0x7fce60101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:20.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.269+0000 7fce68508640 1 --2- 172.21.15.170:0/2846409443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce60101930 0x7fce60101d90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fce5c009880 tx=0x7fce5c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:42:20.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.269+0000 7fce68508640 1 -- 172.21.15.170:0/2846409443 shutdown_connections 2024-09-04T16:42:20.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.269+0000 7fce68508640 1 --2- 172.21.15.170:0/2846409443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce60101930 0x7fce60101d90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:20.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.269+0000 7fce68508640 1 --2- 172.21.15.170:0/2846409443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce60107930 0x7fce60107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:20.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.269+0000 7fce68508640 1 -- 172.21.15.170:0/2846409443 >> 172.21.15.170:0/2846409443 conn(0x7fce600fd630 msgr2=0x7fce600ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:20.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.269+0000 7fce68508640 1 -- 172.21.15.170:0/2846409443 shutdown_connections 2024-09-04T16:42:20.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.269+0000 7fce68508640 1 -- 172.21.15.170:0/2846409443 wait complete. 2024-09-04T16:42:20.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.270+0000 7fce68508640 1 Processor -- start 2024-09-04T16:42:20.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.270+0000 7fce68508640 1 -- start start 2024-09-04T16:42:20.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.270+0000 7fce68508640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce60101930 0x7fce6019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:20.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.270+0000 7fce68508640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce60107930 0x7fce6019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:20.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.270+0000 7fce68508640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fce6010ee00 con 0x7fce60101930 2024-09-04T16:42:20.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.270+0000 7fce68508640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fce6010ec80 con 0x7fce60107930 2024-09-04T16:42:20.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.270+0000 7fce662a4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce60101930 0x7fce6019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:20.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.270+0000 7fce662a4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce60101930 0x7fce6019d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:37840/0 (socket says 172.21.15.170:37840) 2024-09-04T16:42:20.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.270+0000 7fce662a4640 1 -- 172.21.15.170:0/2779741336 learned_addr learned my addr 172.21.15.170:0/2779741336 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:42:20.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.270+0000 7fce65aa3640 1 --2- 172.21.15.170:0/2779741336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce60107930 0x7fce6019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:20.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.270+0000 7fce662a4640 1 -- 172.21.15.170:0/2779741336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce60107930 msgr2=0x7fce6019dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:20.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.270+0000 7fce662a4640 1 --2- 172.21.15.170:0/2779741336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce60107930 0x7fce6019dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:20.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.270+0000 7fce662a4640 1 -- 172.21.15.170:0/2779741336 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce60197810 con 0x7fce60101930 2024-09-04T16:42:20.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.270+0000 7fce65aa3640 1 --2- 172.21.15.170:0/2779741336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce60107930 0x7fce6019dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:42:20.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.270+0000 7fce662a4640 1 --2- 172.21.15.170:0/2779741336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce60101930 0x7fce6019d690 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fce5400d6f0 tx=0x7fce5400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:20.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.271+0000 7fce537fe640 1 -- 172.21.15.170:0/2779741336 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce54017070 con 0x7fce60101930 2024-09-04T16:42:20.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.271+0000 7fce68508640 1 -- 172.21.15.170:0/2779741336 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce60197b00 con 0x7fce60101930 2024-09-04T16:42:20.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.271+0000 7fce537fe640 1 -- 172.21.15.170:0/2779741336 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce5400de00 con 0x7fce60101930 2024-09-04T16:42:20.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.271+0000 7fce537fe640 1 -- 172.21.15.170:0/2779741336 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce54004bb0 con 0x7fce60101930 2024-09-04T16:42:20.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.271+0000 7fce68508640 1 -- 172.21.15.170:0/2779741336 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce60198060 con 0x7fce60101930 2024-09-04T16:42:20.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.272+0000 7fce68508640 1 -- 172.21.15.170:0/2779741336 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce60103070 con 0x7fce60101930 2024-09-04T16:42:20.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.272+0000 7fce537fe640 1 -- 172.21.15.170:0/2779741336 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fce54004e60 con 0x7fce60101930 2024-09-04T16:42:20.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.273+0000 7fce537fe640 1 --2- 172.21.15.170:0/2779741336 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fce4c079e30 0x7fce4c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:20.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.273+0000 7fce537fe640 1 -- 172.21.15.170:0/2779741336 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fce5409c730 con 0x7fce60101930 2024-09-04T16:42:20.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.273+0000 7fce65aa3640 1 --2- 172.21.15.170:0/2779741336 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fce4c079e30 0x7fce4c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:20.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.273+0000 7fce65aa3640 1 --2- 172.21.15.170:0/2779741336 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fce4c079e30 0x7fce4c07c2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fce60198b60 tx=0x7fce5c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:20.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.277+0000 7fce537fe640 1 -- 172.21.15.170:0/2779741336 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fce54064140 con 0x7fce60101930 2024-09-04T16:42:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.520+0000 7fce68508640 1 -- 172.21.15.170:0/2779741336 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fce60109ea0 con 0x7fce60101930 2024-09-04T16:42:20.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.520+0000 7fce537fe640 1 -- 172.21.15.170:0/2779741336 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fce540682b0 con 0x7fce60101930 2024-09-04T16:42:20.525 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:42:20.525 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:42:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:42:20.525 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:42:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:42:20.525 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:42:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:42:20.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.523+0000 7fce68508640 1 -- 172.21.15.170:0/2779741336 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fce4c079e30 msgr2=0x7fce4c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:20.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.523+0000 7fce68508640 1 --2- 172.21.15.170:0/2779741336 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fce4c079e30 0x7fce4c07c2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fce60198b60 tx=0x7fce5c031400 comp rx=0 tx=0).stop 2024-09-04T16:42:20.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.523+0000 7fce68508640 1 -- 172.21.15.170:0/2779741336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce60101930 msgr2=0x7fce6019d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:20.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.523+0000 7fce68508640 1 --2- 172.21.15.170:0/2779741336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce60101930 0x7fce6019d690 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fce5400d6f0 tx=0x7fce5400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:42:20.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.523+0000 7fce68508640 1 -- 172.21.15.170:0/2779741336 shutdown_connections 2024-09-04T16:42:20.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.523+0000 7fce68508640 1 --2- 172.21.15.170:0/2779741336 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fce4c079e30 0x7fce4c07c2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.523+0000 7fce68508640 1 --2- 172.21.15.170:0/2779741336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce60107930 0x7fce6019dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.523+0000 7fce68508640 1 --2- 172.21.15.170:0/2779741336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce60101930 0x7fce6019d690 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.523+0000 7fce68508640 1 -- 172.21.15.170:0/2779741336 >> 172.21.15.170:0/2779741336 conn(0x7fce600fd630 msgr2=0x7fce600fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.523+0000 7fce68508640 1 -- 172.21.15.170:0/2779741336 shutdown_connections 2024-09-04T16:42:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:20.523+0000 7fce68508640 1 -- 172.21.15.170:0/2779741336 wait complete. 2024-09-04T16:42:20.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:20 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/406288263' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:42:20.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:20 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/721957235' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:42:20.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:20 smithi170 ceph-mon[113855]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:42:20.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:20 smithi170 ceph-mon[113855]: pgmap v379: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:20.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:20 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2779741336' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:42:20.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:20 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/406288263' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:42:20.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:20 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/721957235' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:42:20.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:20 smithi193 ceph-mon[82547]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:42:20.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:20 smithi193 ceph-mon[82547]: pgmap v379: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:20.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:20 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2779741336' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:42:22.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:22 smithi170 ceph-mon[113855]: pgmap v380: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:22 smithi193 ceph-mon[82547]: pgmap v380: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:24.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:24 smithi170 ceph-mon[113855]: pgmap v381: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:24 smithi193 ceph-mon[82547]: pgmap v381: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:26.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:26 smithi170 ceph-mon[113855]: pgmap v382: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:26.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:26 smithi193 ceph-mon[82547]: pgmap v382: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:28.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:28 smithi170 ceph-mon[113855]: pgmap v383: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:28.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:28 smithi193 ceph-mon[82547]: pgmap v383: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:29.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:42:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:42:30.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:30 smithi170 ceph-mon[113855]: pgmap v384: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:30.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:30 smithi193 ceph-mon[82547]: pgmap v384: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:32.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:32 smithi170 ceph-mon[113855]: pgmap v385: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:32.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:32 smithi193 ceph-mon[82547]: pgmap v385: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:34.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:34 smithi170 ceph-mon[113855]: pgmap v386: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:34.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:34 smithi193 ceph-mon[82547]: pgmap v386: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:36.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:36 smithi170 ceph-mon[113855]: pgmap v387: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:36 smithi193 ceph-mon[82547]: pgmap v387: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:38 smithi170 ceph-mon[113855]: pgmap v388: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:38 smithi193 ceph-mon[82547]: pgmap v388: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:40.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:40 smithi170 ceph-mon[113855]: pgmap v389: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:40.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:40 smithi193 ceph-mon[82547]: pgmap v389: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:42.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:42 smithi170 ceph-mon[113855]: pgmap v390: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:42 smithi193 ceph-mon[82547]: pgmap v390: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:44.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:42:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:42:45.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:45 smithi170 ceph-mon[113855]: pgmap v391: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:45.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:45 smithi193 ceph-mon[82547]: pgmap v391: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:46.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:46 smithi170 ceph-mon[113855]: pgmap v392: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:46.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:46 smithi193 ceph-mon[82547]: pgmap v392: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:48.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:48 smithi170 ceph-mon[113855]: pgmap v393: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:48 smithi193 ceph-mon[82547]: pgmap v393: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:50.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.618+0000 7f399e8c5640 1 -- 172.21.15.170:0/1703725968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3998100f80 msgr2=0x7f39981013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:50.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.618+0000 7f399e8c5640 1 --2- 172.21.15.170:0/1703725968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3998100f80 0x7f39981013e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f398c009880 tx=0x7f398c02a530 comp rx=0 tx=0).stop 2024-09-04T16:42:50.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.618+0000 7f399e8c5640 1 -- 172.21.15.170:0/1703725968 shutdown_connections 2024-09-04T16:42:50.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.618+0000 7f399e8c5640 1 --2- 172.21.15.170:0/1703725968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3998100f80 0x7f39981013e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:50.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.618+0000 7f399e8c5640 1 --2- 172.21.15.170:0/1703725968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3998106860 0x7f3998106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:50.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.619+0000 7f399e8c5640 1 -- 172.21.15.170:0/1703725968 >> 172.21.15.170:0/1703725968 conn(0x7f39980fbc60 msgr2=0x7f39980fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:50.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.619+0000 7f399e8c5640 1 -- 172.21.15.170:0/1703725968 shutdown_connections 2024-09-04T16:42:50.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.619+0000 7f399e8c5640 1 -- 172.21.15.170:0/1703725968 wait complete. 2024-09-04T16:42:50.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.619+0000 7f399e8c5640 1 Processor -- start 2024-09-04T16:42:50.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.619+0000 7f399e8c5640 1 -- start start 2024-09-04T16:42:50.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.620+0000 7f399e8c5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3998100f80 0x7f399819f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:50.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.620+0000 7f399e8c5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3998106860 0x7f399819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:50.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.620+0000 7f399e8c5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f399810dd00 con 0x7f3998100f80 2024-09-04T16:42:50.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.620+0000 7f399e8c5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f399810db80 con 0x7f3998106860 2024-09-04T16:42:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.620+0000 7f3997fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3998100f80 0x7f399819f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.620+0000 7f3997fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3998100f80 0x7f399819f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59856/0 (socket says 172.21.15.170:59856) 2024-09-04T16:42:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.620+0000 7f3997fff640 1 -- 172.21.15.170:0/964333853 learned_addr learned my addr 172.21.15.170:0/964333853 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:42:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.620+0000 7f39977fe640 1 --2- 172.21.15.170:0/964333853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3998106860 0x7f399819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.620+0000 7f3997fff640 1 -- 172.21.15.170:0/964333853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3998106860 msgr2=0x7f399819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.620+0000 7f3997fff640 1 --2- 172.21.15.170:0/964333853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3998106860 0x7f399819fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.620+0000 7f3997fff640 1 -- 172.21.15.170:0/964333853 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3998199990 con 0x7f3998100f80 2024-09-04T16:42:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.620+0000 7f39977fe640 1 --2- 172.21.15.170:0/964333853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3998106860 0x7f399819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:42:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.620+0000 7f3997fff640 1 --2- 172.21.15.170:0/964333853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3998100f80 0x7f399819f7d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f398800d8d0 tx=0x7f398800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.621+0000 7f39957fa640 1 -- 172.21.15.170:0/964333853 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3988017030 con 0x7f3998100f80 2024-09-04T16:42:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.621+0000 7f39957fa640 1 -- 172.21.15.170:0/964333853 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3988004020 con 0x7f3998100f80 2024-09-04T16:42:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.621+0000 7f39957fa640 1 -- 172.21.15.170:0/964333853 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39880047a0 con 0x7f3998100f80 2024-09-04T16:42:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.621+0000 7f399e8c5640 1 -- 172.21.15.170:0/964333853 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3998199c80 con 0x7f3998100f80 2024-09-04T16:42:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.621+0000 7f399e8c5640 1 -- 172.21.15.170:0/964333853 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f399819a1e0 con 0x7f3998100f80 2024-09-04T16:42:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.622+0000 7f399e8c5640 1 -- 172.21.15.170:0/964333853 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39981013e0 con 0x7f3998100f80 2024-09-04T16:42:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.623+0000 7f39957fa640 1 -- 172.21.15.170:0/964333853 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f39880041d0 con 0x7f3998100f80 2024-09-04T16:42:50.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.623+0000 7f39957fa640 1 --2- 172.21.15.170:0/964333853 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3980079e80 0x7f398007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:50.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.623+0000 7f39957fa640 1 -- 172.21.15.170:0/964333853 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3988018070 con 0x7f3998100f80 2024-09-04T16:42:50.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.623+0000 7f39977fe640 1 --2- 172.21.15.170:0/964333853 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3980079e80 0x7f398007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:50.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.624+0000 7f39977fe640 1 --2- 172.21.15.170:0/964333853 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3980079e80 0x7f398007c340 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f399819b180 tx=0x7f398c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:50.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.628+0000 7f39957fa640 1 -- 172.21.15.170:0/964333853 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f39880642a0 con 0x7f3998100f80 2024-09-04T16:42:50.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.819+0000 7f399e8c5640 1 -- 172.21.15.170:0/964333853 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f399819a4f0 con 0x7f3980079e80 2024-09-04T16:42:50.820 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:50 smithi170 ceph-mon[113855]: pgmap v394: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:50.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.821+0000 7f39957fa640 1 -- 172.21.15.170:0/964333853 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f399819a4f0 con 0x7f3980079e80 2024-09-04T16:42:50.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.823+0000 7f399e8c5640 1 -- 172.21.15.170:0/964333853 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3980079e80 msgr2=0x7f398007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:50.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.823+0000 7f399e8c5640 1 --2- 172.21.15.170:0/964333853 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3980079e80 0x7f398007c340 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f399819b180 tx=0x7f398c031400 comp rx=0 tx=0).stop 2024-09-04T16:42:50.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.823+0000 7f399e8c5640 1 -- 172.21.15.170:0/964333853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3998100f80 msgr2=0x7f399819f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:50.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.823+0000 7f399e8c5640 1 --2- 172.21.15.170:0/964333853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3998100f80 0x7f399819f7d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f398800d8d0 tx=0x7f398800dd90 comp rx=0 tx=0).stop 2024-09-04T16:42:50.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.823+0000 7f399e8c5640 1 -- 172.21.15.170:0/964333853 shutdown_connections 2024-09-04T16:42:50.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.823+0000 7f399e8c5640 1 --2- 172.21.15.170:0/964333853 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3980079e80 0x7f398007c340 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:50.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.823+0000 7f399e8c5640 1 --2- 172.21.15.170:0/964333853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3998106860 0x7f399819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:50.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.823+0000 7f399e8c5640 1 --2- 172.21.15.170:0/964333853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3998100f80 0x7f399819f7d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:50.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.823+0000 7f399e8c5640 1 -- 172.21.15.170:0/964333853 >> 172.21.15.170:0/964333853 conn(0x7f39980fbc60 msgr2=0x7f39980fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:50.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.823+0000 7f399e8c5640 1 -- 172.21.15.170:0/964333853 shutdown_connections 2024-09-04T16:42:50.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.823+0000 7f399e8c5640 1 -- 172.21.15.170:0/964333853 wait complete. 2024-09-04T16:42:50.833 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:42:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:50 smithi193 ceph-mon[82547]: pgmap v394: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:50.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.907+0000 7fba92aad640 1 -- 172.21.15.170:0/2309090434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba8c100820 msgr2=0x7fba8c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:50.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.907+0000 7fba92aad640 1 --2- 172.21.15.170:0/2309090434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba8c100820 0x7fba8c100c80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fba74009880 tx=0x7fba7402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:42:50.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.907+0000 7fba92aad640 1 -- 172.21.15.170:0/2309090434 shutdown_connections 2024-09-04T16:42:50.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.907+0000 7fba92aad640 1 --2- 172.21.15.170:0/2309090434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba8c100820 0x7fba8c100c80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:50.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.907+0000 7fba92aad640 1 --2- 172.21.15.170:0/2309090434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba8c106820 0x7fba8c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:50.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.907+0000 7fba92aad640 1 -- 172.21.15.170:0/2309090434 >> 172.21.15.170:0/2309090434 conn(0x7fba8c0fc520 msgr2=0x7fba8c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:50.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.907+0000 7fba92aad640 1 -- 172.21.15.170:0/2309090434 shutdown_connections 2024-09-04T16:42:50.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.907+0000 7fba92aad640 1 -- 172.21.15.170:0/2309090434 wait complete. 2024-09-04T16:42:50.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.908+0000 7fba92aad640 1 Processor -- start 2024-09-04T16:42:50.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.908+0000 7fba92aad640 1 -- start start 2024-09-04T16:42:50.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.908+0000 7fba92aad640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba8c100820 0x7fba8c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:50.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.908+0000 7fba92aad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba8c106820 0x7fba8c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:50.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.908+0000 7fba92aad640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c10dcf0 con 0x7fba8c100820 2024-09-04T16:42:50.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.908+0000 7fba92aad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c10db70 con 0x7fba8c106820 2024-09-04T16:42:50.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.908+0000 7fba90849640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba8c100820 0x7fba8c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:50.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.908+0000 7fba90849640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba8c100820 0x7fba8c19d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59868/0 (socket says 172.21.15.170:59868) 2024-09-04T16:42:50.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.908+0000 7fba90849640 1 -- 172.21.15.170:0/152045821 learned_addr learned my addr 172.21.15.170:0/152045821 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:42:50.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.908+0000 7fba8bfff640 1 --2- 172.21.15.170:0/152045821 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba8c106820 0x7fba8c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:50.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.909+0000 7fba90849640 1 -- 172.21.15.170:0/152045821 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba8c106820 msgr2=0x7fba8c19dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:50.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.909+0000 7fba90849640 1 --2- 172.21.15.170:0/152045821 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba8c106820 0x7fba8c19dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:50.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.909+0000 7fba90849640 1 -- 172.21.15.170:0/152045821 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8c197810 con 0x7fba8c100820 2024-09-04T16:42:50.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.909+0000 7fba8bfff640 1 --2- 172.21.15.170:0/152045821 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba8c106820 0x7fba8c19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:42:50.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.909+0000 7fba90849640 1 --2- 172.21.15.170:0/152045821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba8c100820 0x7fba8c19d690 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00d6f0 tx=0x7fba7c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:50.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.909+0000 7fba89ffb640 1 -- 172.21.15.170:0/152045821 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba7c017070 con 0x7fba8c100820 2024-09-04T16:42:50.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.909+0000 7fba89ffb640 1 -- 172.21.15.170:0/152045821 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba7c00de00 con 0x7fba8c100820 2024-09-04T16:42:50.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.909+0000 7fba92aad640 1 -- 172.21.15.170:0/152045821 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8c197b00 con 0x7fba8c100820 2024-09-04T16:42:50.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.909+0000 7fba89ffb640 1 -- 172.21.15.170:0/152045821 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba7c004bb0 con 0x7fba8c100820 2024-09-04T16:42:50.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.909+0000 7fba92aad640 1 -- 172.21.15.170:0/152045821 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba8c198090 con 0x7fba8c100820 2024-09-04T16:42:50.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.910+0000 7fba92aad640 1 -- 172.21.15.170:0/152045821 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba8c101f60 con 0x7fba8c100820 2024-09-04T16:42:50.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.911+0000 7fba89ffb640 1 -- 172.21.15.170:0/152045821 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fba7c004e60 con 0x7fba8c100820 2024-09-04T16:42:50.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.911+0000 7fba89ffb640 1 --2- 172.21.15.170:0/152045821 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fba78079e30 0x7fba7807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:50.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.911+0000 7fba89ffb640 1 -- 172.21.15.170:0/152045821 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fba7c09c730 con 0x7fba8c100820 2024-09-04T16:42:50.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.911+0000 7fba8bfff640 1 --2- 172.21.15.170:0/152045821 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fba78079e30 0x7fba7807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:50.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.912+0000 7fba8bfff640 1 --2- 172.21.15.170:0/152045821 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fba78079e30 0x7fba7807c2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fba74031460 tx=0x7fba740095f0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:50.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:50.915+0000 7fba89ffb640 1 -- 172.21.15.170:0/152045821 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fba7c064140 con 0x7fba8c100820 2024-09-04T16:42:51.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.108+0000 7fba92aad640 1 -- 172.21.15.170:0/152045821 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fba8c198340 con 0x7fba78079e30 2024-09-04T16:42:51.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.109+0000 7fba89ffb640 1 -- 172.21.15.170:0/152045821 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fba8c198340 con 0x7fba78079e30 2024-09-04T16:42:51.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.111+0000 7fba92aad640 1 -- 172.21.15.170:0/152045821 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fba78079e30 msgr2=0x7fba7807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:51.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.111+0000 7fba92aad640 1 --2- 172.21.15.170:0/152045821 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fba78079e30 0x7fba7807c2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fba74031460 tx=0x7fba740095f0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.111+0000 7fba92aad640 1 -- 172.21.15.170:0/152045821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba8c100820 msgr2=0x7fba8c19d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:51.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.111+0000 7fba92aad640 1 --2- 172.21.15.170:0/152045821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba8c100820 0x7fba8c19d690 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00d6f0 tx=0x7fba7c00dbb0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.111+0000 7fba92aad640 1 -- 172.21.15.170:0/152045821 shutdown_connections 2024-09-04T16:42:51.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.111+0000 7fba92aad640 1 --2- 172.21.15.170:0/152045821 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fba78079e30 0x7fba7807c2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.111+0000 7fba92aad640 1 --2- 172.21.15.170:0/152045821 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba8c106820 0x7fba8c19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.111+0000 7fba92aad640 1 --2- 172.21.15.170:0/152045821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba8c100820 0x7fba8c19d690 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.111+0000 7fba92aad640 1 -- 172.21.15.170:0/152045821 >> 172.21.15.170:0/152045821 conn(0x7fba8c0fc520 msgr2=0x7fba8c06a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:51.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.111+0000 7fba92aad640 1 -- 172.21.15.170:0/152045821 shutdown_connections 2024-09-04T16:42:51.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.111+0000 7fba92aad640 1 -- 172.21.15.170:0/152045821 wait complete. 2024-09-04T16:42:51.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.193+0000 7f8862d57640 1 -- 172.21.15.170:0/2431157144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f885c106820 msgr2=0x7f885c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:51.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.193+0000 7f8862d57640 1 --2- 172.21.15.170:0/2431157144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f885c106820 0x7f885c106c00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f884c009880 tx=0x7f884c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.193+0000 7f8862d57640 1 -- 172.21.15.170:0/2431157144 shutdown_connections 2024-09-04T16:42:51.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.193+0000 7f8862d57640 1 --2- 172.21.15.170:0/2431157144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f885c100820 0x7f885c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.193+0000 7f8862d57640 1 --2- 172.21.15.170:0/2431157144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f885c106820 0x7f885c106c00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.193+0000 7f8862d57640 1 -- 172.21.15.170:0/2431157144 >> 172.21.15.170:0/2431157144 conn(0x7f885c0fc520 msgr2=0x7f885c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:51.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.193+0000 7f8862d57640 1 -- 172.21.15.170:0/2431157144 shutdown_connections 2024-09-04T16:42:51.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.193+0000 7f8862d57640 1 -- 172.21.15.170:0/2431157144 wait complete. 2024-09-04T16:42:51.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.194+0000 7f8862d57640 1 Processor -- start 2024-09-04T16:42:51.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.194+0000 7f8862d57640 1 -- start start 2024-09-04T16:42:51.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.194+0000 7f8862d57640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f885c100820 0x7f885c19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:51.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.194+0000 7f8862d57640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f885c106820 0x7f885c19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:51.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.194+0000 7f8862d57640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f885c10dd50 con 0x7f885c100820 2024-09-04T16:42:51.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.194+0000 7f8862d57640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f885c10dbd0 con 0x7f885c106820 2024-09-04T16:42:51.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.194+0000 7f8860af3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f885c100820 0x7f885c19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:51.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.194+0000 7f8860af3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f885c100820 0x7f885c19c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59882/0 (socket says 172.21.15.170:59882) 2024-09-04T16:42:51.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.194+0000 7f8860af3640 1 -- 172.21.15.170:0/2701974231 learned_addr learned my addr 172.21.15.170:0/2701974231 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:42:51.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.195+0000 7f885bfff640 1 --2- 172.21.15.170:0/2701974231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f885c106820 0x7f885c19cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:51.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.195+0000 7f8860af3640 1 -- 172.21.15.170:0/2701974231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f885c106820 msgr2=0x7f885c19cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:51.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.195+0000 7f8860af3640 1 --2- 172.21.15.170:0/2701974231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f885c106820 0x7f885c19cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.195+0000 7f8860af3640 1 -- 172.21.15.170:0/2701974231 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c196720 con 0x7f885c100820 2024-09-04T16:42:51.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.195+0000 7f8860af3640 1 --2- 172.21.15.170:0/2701974231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f885c100820 0x7f885c19c650 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f884c031460 tx=0x7f884c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:51.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.195+0000 7f8859ffb640 1 -- 172.21.15.170:0/2701974231 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f884c03f070 con 0x7f885c100820 2024-09-04T16:42:51.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.195+0000 7f8859ffb640 1 -- 172.21.15.170:0/2701974231 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f884c004cf0 con 0x7f885c100820 2024-09-04T16:42:51.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.195+0000 7f8862d57640 1 -- 172.21.15.170:0/2701974231 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885c1969b0 con 0x7f885c100820 2024-09-04T16:42:51.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.195+0000 7f8859ffb640 1 -- 172.21.15.170:0/2701974231 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f884c035030 con 0x7f885c100820 2024-09-04T16:42:51.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.195+0000 7f8862d57640 1 -- 172.21.15.170:0/2701974231 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885c196eb0 con 0x7f885c100820 2024-09-04T16:42:51.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.196+0000 7f8862d57640 1 -- 172.21.15.170:0/2701974231 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f885c101f60 con 0x7f885c100820 2024-09-04T16:42:51.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.197+0000 7f8859ffb640 1 -- 172.21.15.170:0/2701974231 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f884c042070 con 0x7f885c100820 2024-09-04T16:42:51.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.197+0000 7f8859ffb640 1 --2- 172.21.15.170:0/2701974231 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8844079e30 0x7f884407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:51.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.197+0000 7f8859ffb640 1 -- 172.21.15.170:0/2701974231 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f884c0bd600 con 0x7f885c100820 2024-09-04T16:42:51.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.197+0000 7f885bfff640 1 --2- 172.21.15.170:0/2701974231 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8844079e30 0x7f884407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:51.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.198+0000 7f885bfff640 1 --2- 172.21.15.170:0/2701974231 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8844079e30 0x7f884407c2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f885c197f70 tx=0x7f8850008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:51.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.202+0000 7f8859ffb640 1 -- 172.21.15.170:0/2701974231 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f884c085010 con 0x7f885c100820 2024-09-04T16:42:51.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.398+0000 7f8862d57640 1 -- 172.21.15.170:0/2701974231 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f885c197160 con 0x7f8844079e30 2024-09-04T16:42:51.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.407+0000 7f8859ffb640 1 -- 172.21.15.170:0/2701974231 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f885c197160 con 0x7f8844079e30 2024-09-04T16:42:51.408 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:42:51.408 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (9m) 4m ago 20m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:42:51.408 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (13m) 4m ago 20m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:42:51.408 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (12m) 3m ago 19m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:42:51.408 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (7m) 4m ago 20m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:42:51.408 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (7m) 3m ago 19m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:42:51.408 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (9m) 4m ago 20m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:42:51.409 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (4m) 4m ago 15m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:42:51.409 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (4m) 4m ago 15m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:42:51.409 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (3m) 3m ago 15m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:42:51.409 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (3m) 3m ago 15m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:42:51.409 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (12m) 4m ago 21m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:42:51.409 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (11m) 3m ago 19m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:42:51.409 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (8m) 4m ago 22m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:42:51.409 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (8m) 3m ago 19m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:42:51.409 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (10m) 4m ago 20m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:42:51.409 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (10m) 3m ago 19m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:42:51.409 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (7m) 4m ago 18m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:42:51.409 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (6m) 4m ago 18m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:42:51.410 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (6m) 4m ago 17m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:42:51.410 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (5m) 3m ago 17m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:42:51.410 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (5m) 3m ago 16m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:42:51.410 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (4m) 3m ago 16m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:42:51.410 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (10m) 4m ago 20m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:42:51.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.410+0000 7f8862d57640 1 -- 172.21.15.170:0/2701974231 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8844079e30 msgr2=0x7f884407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:51.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.410+0000 7f8862d57640 1 --2- 172.21.15.170:0/2701974231 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8844079e30 0x7f884407c2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f885c197f70 tx=0x7f8850008040 comp rx=0 tx=0).stop 2024-09-04T16:42:51.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.410+0000 7f8862d57640 1 -- 172.21.15.170:0/2701974231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f885c100820 msgr2=0x7f885c19c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:51.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.410+0000 7f8862d57640 1 --2- 172.21.15.170:0/2701974231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f885c100820 0x7f885c19c650 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f884c031460 tx=0x7f884c0048f0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.410+0000 7f8862d57640 1 -- 172.21.15.170:0/2701974231 shutdown_connections 2024-09-04T16:42:51.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.410+0000 7f8862d57640 1 --2- 172.21.15.170:0/2701974231 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8844079e30 0x7f884407c2f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.410+0000 7f8862d57640 1 --2- 172.21.15.170:0/2701974231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f885c106820 0x7f885c19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.410+0000 7f8862d57640 1 --2- 172.21.15.170:0/2701974231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f885c100820 0x7f885c19c650 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.410+0000 7f8862d57640 1 -- 172.21.15.170:0/2701974231 >> 172.21.15.170:0/2701974231 conn(0x7f885c0fc520 msgr2=0x7f885c0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:51.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.410+0000 7f8862d57640 1 -- 172.21.15.170:0/2701974231 shutdown_connections 2024-09-04T16:42:51.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.410+0000 7f8862d57640 1 -- 172.21.15.170:0/2701974231 wait complete. 2024-09-04T16:42:51.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.491+0000 7f54dab7e640 1 -- 172.21.15.170:0/1063262811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54d4107930 msgr2=0x7f54d4107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:51.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.491+0000 7f54dab7e640 1 --2- 172.21.15.170:0/1063262811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54d4107930 0x7f54d4107d10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f54c8009880 tx=0x7f54c802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.491+0000 7f54dab7e640 1 -- 172.21.15.170:0/1063262811 shutdown_connections 2024-09-04T16:42:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.491+0000 7f54dab7e640 1 --2- 172.21.15.170:0/1063262811 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54d4101930 0x7f54d4101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.491+0000 7f54dab7e640 1 --2- 172.21.15.170:0/1063262811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54d4107930 0x7f54d4107d10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.491+0000 7f54dab7e640 1 -- 172.21.15.170:0/1063262811 >> 172.21.15.170:0/1063262811 conn(0x7f54d40fd630 msgr2=0x7f54d40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.491+0000 7f54dab7e640 1 -- 172.21.15.170:0/1063262811 shutdown_connections 2024-09-04T16:42:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.491+0000 7f54dab7e640 1 -- 172.21.15.170:0/1063262811 wait complete. 2024-09-04T16:42:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.491+0000 7f54dab7e640 1 Processor -- start 2024-09-04T16:42:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.491+0000 7f54dab7e640 1 -- start start 2024-09-04T16:42:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54dab7e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54d4101930 0x7f54d419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54dab7e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54d4107930 0x7f54d419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:51.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54dab7e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f54d410ee00 con 0x7f54d4101930 2024-09-04T16:42:51.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54dab7e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f54d410ec80 con 0x7f54d4107930 2024-09-04T16:42:51.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54d891a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54d4101930 0x7f54d419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:51.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54d891a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54d4101930 0x7f54d419d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59898/0 (socket says 172.21.15.170:59898) 2024-09-04T16:42:51.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54d891a640 1 -- 172.21.15.170:0/2326162496 learned_addr learned my addr 172.21.15.170:0/2326162496 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:42:51.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54d3fff640 1 --2- 172.21.15.170:0/2326162496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54d4107930 0x7f54d419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:51.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54d891a640 1 -- 172.21.15.170:0/2326162496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54d4107930 msgr2=0x7f54d419dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:51.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54d891a640 1 --2- 172.21.15.170:0/2326162496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54d4107930 0x7f54d419dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54d891a640 1 -- 172.21.15.170:0/2326162496 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d41977f0 con 0x7f54d4101930 2024-09-04T16:42:51.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54d3fff640 1 --2- 172.21.15.170:0/2326162496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54d4107930 0x7f54d419dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:42:51.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54d891a640 1 --2- 172.21.15.170:0/2326162496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54d4101930 0x7f54d419d670 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f54c8031460 tx=0x7f54c80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:51.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54d1ffb640 1 -- 172.21.15.170:0/2326162496 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f54c803f070 con 0x7f54d4101930 2024-09-04T16:42:51.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54d1ffb640 1 -- 172.21.15.170:0/2326162496 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f54c8004cf0 con 0x7f54d4101930 2024-09-04T16:42:51.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54dab7e640 1 -- 172.21.15.170:0/2326162496 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d4197a80 con 0x7f54d4101930 2024-09-04T16:42:51.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.492+0000 7f54d1ffb640 1 -- 172.21.15.170:0/2326162496 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f54c8035030 con 0x7f54d4101930 2024-09-04T16:42:51.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.493+0000 7f54dab7e640 1 -- 172.21.15.170:0/2326162496 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d4197fb0 con 0x7f54d4101930 2024-09-04T16:42:51.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.494+0000 7f54dab7e640 1 -- 172.21.15.170:0/2326162496 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d4103070 con 0x7f54d4101930 2024-09-04T16:42:51.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.494+0000 7f54d1ffb640 1 -- 172.21.15.170:0/2326162496 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f54c8042070 con 0x7f54d4101930 2024-09-04T16:42:51.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.495+0000 7f54d1ffb640 1 --2- 172.21.15.170:0/2326162496 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f54c4079e30 0x7f54c407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:51.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.495+0000 7f54d1ffb640 1 -- 172.21.15.170:0/2326162496 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f54c80bd520 con 0x7f54d4101930 2024-09-04T16:42:51.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.495+0000 7f54d3fff640 1 --2- 172.21.15.170:0/2326162496 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f54c4079e30 0x7f54c407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:51.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.495+0000 7f54d3fff640 1 --2- 172.21.15.170:0/2326162496 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f54c4079e30 0x7f54c407c2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f54d40ffc20 tx=0x7f54c0005d30 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:51.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.499+0000 7f54d1ffb640 1 -- 172.21.15.170:0/2326162496 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f54c8084f30 con 0x7f54d4101930 2024-09-04T16:42:51.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.744+0000 7f54dab7e640 1 -- 172.21.15.170:0/2326162496 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f54d4109ea0 con 0x7f54d4101930 2024-09-04T16:42:51.745 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:51 smithi170 ceph-mon[113855]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:42:51.745 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:51 smithi170 ceph-mon[113855]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:42:51.745 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:51 smithi170 ceph-mon[113855]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:42:51.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.744+0000 7f54d1ffb640 1 -- 172.21.15.170:0/2326162496 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f54c80890a0 con 0x7f54d4101930 2024-09-04T16:42:51.746 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:42:51.746 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:42:51.746 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:42:51.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:42:51.746 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:42:51.746 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:42:51.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:42:51.746 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:42:51.746 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:42:51.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:42:51.747 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:42:51.747 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:42:51.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:42:51.747 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:42:51.747 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:42:51.747 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:42:51.747 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:42:51.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.747+0000 7f54dab7e640 1 -- 172.21.15.170:0/2326162496 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f54c4079e30 msgr2=0x7f54c407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:51.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.747+0000 7f54dab7e640 1 --2- 172.21.15.170:0/2326162496 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f54c4079e30 0x7f54c407c2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f54d40ffc20 tx=0x7f54c0005d30 comp rx=0 tx=0).stop 2024-09-04T16:42:51.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.747+0000 7f54dab7e640 1 -- 172.21.15.170:0/2326162496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54d4101930 msgr2=0x7f54d419d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:51.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.747+0000 7f54dab7e640 1 --2- 172.21.15.170:0/2326162496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54d4101930 0x7f54d419d670 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f54c8031460 tx=0x7f54c80048f0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.747+0000 7f54dab7e640 1 -- 172.21.15.170:0/2326162496 shutdown_connections 2024-09-04T16:42:51.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.747+0000 7f54dab7e640 1 --2- 172.21.15.170:0/2326162496 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f54c4079e30 0x7f54c407c2f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.747+0000 7f54dab7e640 1 --2- 172.21.15.170:0/2326162496 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54d4107930 0x7f54d419dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.747+0000 7f54dab7e640 1 --2- 172.21.15.170:0/2326162496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54d4101930 0x7f54d419d670 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.747+0000 7f54dab7e640 1 -- 172.21.15.170:0/2326162496 >> 172.21.15.170:0/2326162496 conn(0x7f54d40fd630 msgr2=0x7f54d40fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:51.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.747+0000 7f54dab7e640 1 -- 172.21.15.170:0/2326162496 shutdown_connections 2024-09-04T16:42:51.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.747+0000 7f54dab7e640 1 -- 172.21.15.170:0/2326162496 wait complete. 2024-09-04T16:42:51.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.828+0000 7f83235c3640 1 -- 172.21.15.170:0/1180544245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f831c100820 msgr2=0x7f831c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:51.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.828+0000 7f83235c3640 1 --2- 172.21.15.170:0/1180544245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f831c100820 0x7f831c100c80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8310009880 tx=0x7f831002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.828+0000 7f83235c3640 1 -- 172.21.15.170:0/1180544245 shutdown_connections 2024-09-04T16:42:51.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.828+0000 7f83235c3640 1 --2- 172.21.15.170:0/1180544245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f831c100820 0x7f831c100c80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.828+0000 7f83235c3640 1 --2- 172.21.15.170:0/1180544245 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f831c106820 0x7f831c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.828+0000 7f83235c3640 1 -- 172.21.15.170:0/1180544245 >> 172.21.15.170:0/1180544245 conn(0x7f831c0fc520 msgr2=0x7f831c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:51.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.828+0000 7f83235c3640 1 -- 172.21.15.170:0/1180544245 shutdown_connections 2024-09-04T16:42:51.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.828+0000 7f83235c3640 1 -- 172.21.15.170:0/1180544245 wait complete. 2024-09-04T16:42:51.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.829+0000 7f83235c3640 1 Processor -- start 2024-09-04T16:42:51.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.829+0000 7f83235c3640 1 -- start start 2024-09-04T16:42:51.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.829+0000 7f83235c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f831c100820 0x7f831c19c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:51.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.829+0000 7f83235c3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f831c106820 0x7f831c19cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:51.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.829+0000 7f83235c3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f831c10dcd0 con 0x7f831c106820 2024-09-04T16:42:51.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.829+0000 7f83235c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f831c10db50 con 0x7f831c100820 2024-09-04T16:42:51.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.829+0000 7f8320b5e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f831c106820 0x7f831c19cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:51.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.829+0000 7f8320b5e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f831c106820 0x7f831c19cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59920/0 (socket says 172.21.15.170:59920) 2024-09-04T16:42:51.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.829+0000 7f8320b5e640 1 -- 172.21.15.170:0/3835079498 learned_addr learned my addr 172.21.15.170:0/3835079498 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:42:51.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.829+0000 7f832135f640 1 --2- 172.21.15.170:0/3835079498 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f831c100820 0x7f831c19c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:51.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.830+0000 7f8320b5e640 1 -- 172.21.15.170:0/3835079498 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f831c100820 msgr2=0x7f831c19c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:51.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.830+0000 7f8320b5e640 1 --2- 172.21.15.170:0/3835079498 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f831c100820 0x7f831c19c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:51.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.830+0000 7f8320b5e640 1 -- 172.21.15.170:0/3835079498 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831c1966b0 con 0x7f831c106820 2024-09-04T16:42:51.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.830+0000 7f8320b5e640 1 --2- 172.21.15.170:0/3835079498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f831c106820 0x7f831c19cb20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8310031460 tx=0x7f83100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:51.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.830+0000 7f831a7fc640 1 -- 172.21.15.170:0/3835079498 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f831003f070 con 0x7f831c106820 2024-09-04T16:42:51.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.830+0000 7f83235c3640 1 -- 172.21.15.170:0/3835079498 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f831c196940 con 0x7f831c106820 2024-09-04T16:42:51.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.830+0000 7f831a7fc640 1 -- 172.21.15.170:0/3835079498 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8310004cf0 con 0x7f831c106820 2024-09-04T16:42:51.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.830+0000 7f831a7fc640 1 -- 172.21.15.170:0/3835079498 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8310035030 con 0x7f831c106820 2024-09-04T16:42:51.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.830+0000 7f83235c3640 1 -- 172.21.15.170:0/3835079498 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f831c196e40 con 0x7f831c106820 2024-09-04T16:42:51.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.831+0000 7f83235c3640 1 -- 172.21.15.170:0/3835079498 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f831c101f60 con 0x7f831c106820 2024-09-04T16:42:51.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.832+0000 7f831a7fc640 1 -- 172.21.15.170:0/3835079498 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f8310042070 con 0x7f831c106820 2024-09-04T16:42:51.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.832+0000 7f831a7fc640 1 --2- 172.21.15.170:0/3835079498 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8304079e30 0x7f830407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:51.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.832+0000 7f831a7fc640 1 -- 172.21.15.170:0/3835079498 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f83100bd470 con 0x7f831c106820 2024-09-04T16:42:51.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.832+0000 7f832135f640 1 --2- 172.21.15.170:0/3835079498 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8304079e30 0x7f830407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:51.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.832+0000 7f832135f640 1 --2- 172.21.15.170:0/3835079498 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8304079e30 0x7f830407c2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f830c005c40 tx=0x7f830c00a590 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:51.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:51.836+0000 7f831a7fc640 1 -- 172.21.15.170:0/3835079498 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8310088ff0 con 0x7f831c106820 2024-09-04T16:42:51.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:51 smithi193 ceph-mon[82547]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:42:51.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:51 smithi193 ceph-mon[82547]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:42:51.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:51 smithi193 ceph-mon[82547]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:42:52.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.045+0000 7f83235c3640 1 -- 172.21.15.170:0/3835079498 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f831c197be0 con 0x7f831c106820 2024-09-04T16:42:52.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.046+0000 7f831a7fc640 1 -- 172.21.15.170:0/3835079498 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7f831008d330 con 0x7f831c106820 2024-09-04T16:42:52.047 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:42:52.047 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:42:52.047 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:42:52.047 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:42:52.047 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:42:52.047 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:42:52.047 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:42:52.047 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:42:52.047 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:42:52.047 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:42:52.047 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:42:52.047 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:42:52.048 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:42:52.048 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:42:52.048 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:42:52.048 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:42:52.048 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:42:52.048 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:42:52.048 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:42:52.048 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:42:52.048 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:42:52.048 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:42:52.048 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:42:52.048 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:42:52.048 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:42:52.049 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:42:52.049 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:42:52.049 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:42:52.049 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:42:52.049 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:42:52.049 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:42:52.049 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:42:52.049 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:42:52.049 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:42:52.049 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:42:52.049 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:42:52.049 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:42:52.049 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:42:52.049 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:42:52.050 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:42:52.050 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:42:52.050 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:42:52.050 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:42:52.050 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:42:52.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.049+0000 7f83235c3640 1 -- 172.21.15.170:0/3835079498 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8304079e30 msgr2=0x7f830407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:52.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.049+0000 7f83235c3640 1 --2- 172.21.15.170:0/3835079498 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8304079e30 0x7f830407c2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f830c005c40 tx=0x7f830c00a590 comp rx=0 tx=0).stop 2024-09-04T16:42:52.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.049+0000 7f83235c3640 1 -- 172.21.15.170:0/3835079498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f831c106820 msgr2=0x7f831c19cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:52.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.049+0000 7f83235c3640 1 --2- 172.21.15.170:0/3835079498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f831c106820 0x7f831c19cb20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8310031460 tx=0x7f83100048f0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.049+0000 7f83235c3640 1 -- 172.21.15.170:0/3835079498 shutdown_connections 2024-09-04T16:42:52.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.049+0000 7f83235c3640 1 --2- 172.21.15.170:0/3835079498 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8304079e30 0x7f830407c2f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.049+0000 7f83235c3640 1 --2- 172.21.15.170:0/3835079498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f831c106820 0x7f831c19cb20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.049+0000 7f83235c3640 1 --2- 172.21.15.170:0/3835079498 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f831c100820 0x7f831c19c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.049+0000 7f83235c3640 1 -- 172.21.15.170:0/3835079498 >> 172.21.15.170:0/3835079498 conn(0x7f831c0fc520 msgr2=0x7f831c0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:52.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.049+0000 7f83235c3640 1 -- 172.21.15.170:0/3835079498 shutdown_connections 2024-09-04T16:42:52.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.049+0000 7f83235c3640 1 -- 172.21.15.170:0/3835079498 wait complete. 2024-09-04T16:42:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.132+0000 7f1e88fae640 1 -- 172.21.15.170:0/2306260631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e84106820 msgr2=0x7f1e84106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.132+0000 7f1e88fae640 1 --2- 172.21.15.170:0/2306260631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e84106820 0x7f1e84106c00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009880 tx=0x7f1e7402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.132+0000 7f1e88fae640 1 -- 172.21.15.170:0/2306260631 shutdown_connections 2024-09-04T16:42:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.132+0000 7f1e88fae640 1 --2- 172.21.15.170:0/2306260631 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e84100820 0x7f1e84100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.132+0000 7f1e88fae640 1 --2- 172.21.15.170:0/2306260631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e84106820 0x7f1e84106c00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.132+0000 7f1e88fae640 1 -- 172.21.15.170:0/2306260631 >> 172.21.15.170:0/2306260631 conn(0x7f1e840fc520 msgr2=0x7f1e840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.132+0000 7f1e88fae640 1 -- 172.21.15.170:0/2306260631 shutdown_connections 2024-09-04T16:42:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.132+0000 7f1e88fae640 1 -- 172.21.15.170:0/2306260631 wait complete. 2024-09-04T16:42:52.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.133+0000 7f1e88fae640 1 Processor -- start 2024-09-04T16:42:52.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.133+0000 7f1e88fae640 1 -- start start 2024-09-04T16:42:52.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.133+0000 7f1e88fae640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e84100820 0x7f1e84196620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:52.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.133+0000 7f1e88fae640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e84106820 0x7f1e84196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:52.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.133+0000 7f1e88fae640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1e8410dcd0 con 0x7f1e84100820 2024-09-04T16:42:52.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.133+0000 7f1e88fae640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1e8410db50 con 0x7f1e84106820 2024-09-04T16:42:52.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.133+0000 7f1e8259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e84100820 0x7f1e84196620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:52.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.133+0000 7f1e8259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e84100820 0x7f1e84196620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59928/0 (socket says 172.21.15.170:59928) 2024-09-04T16:42:52.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.133+0000 7f1e8259c640 1 -- 172.21.15.170:0/1723664492 learned_addr learned my addr 172.21.15.170:0/1723664492 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:42:52.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.133+0000 7f1e7bfff640 1 --2- 172.21.15.170:0/1723664492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e84106820 0x7f1e84196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:52.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.133+0000 7f1e8259c640 1 -- 172.21.15.170:0/1723664492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e84106820 msgr2=0x7f1e84196b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:52.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.133+0000 7f1e8259c640 1 --2- 172.21.15.170:0/1723664492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e84106820 0x7f1e84196b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.133+0000 7f1e8259c640 1 -- 172.21.15.170:0/1723664492 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e841970a0 con 0x7f1e84100820 2024-09-04T16:42:52.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.133+0000 7f1e7bfff640 1 --2- 172.21.15.170:0/1723664492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e84106820 0x7f1e84196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:42:52.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.134+0000 7f1e8259c640 1 --2- 172.21.15.170:0/1723664492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e84100820 0x7f1e84196620 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1e74031460 tx=0x7f1e740045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:52.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.134+0000 7f1e7b7fe640 1 -- 172.21.15.170:0/1723664492 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e7403f070 con 0x7f1e84100820 2024-09-04T16:42:52.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.134+0000 7f1e7b7fe640 1 -- 172.21.15.170:0/1723664492 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e740035f0 con 0x7f1e84100820 2024-09-04T16:42:52.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.134+0000 7f1e88fae640 1 -- 172.21.15.170:0/1723664492 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e84197330 con 0x7f1e84100820 2024-09-04T16:42:52.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.134+0000 7f1e7b7fe640 1 -- 172.21.15.170:0/1723664492 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e74035030 con 0x7f1e84100820 2024-09-04T16:42:52.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.134+0000 7f1e88fae640 1 -- 172.21.15.170:0/1723664492 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e841a3e60 con 0x7f1e84100820 2024-09-04T16:42:52.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.135+0000 7f1e88fae640 1 -- 172.21.15.170:0/1723664492 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e84101f60 con 0x7f1e84100820 2024-09-04T16:42:52.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.136+0000 7f1e7b7fe640 1 -- 172.21.15.170:0/1723664492 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f1e74042070 con 0x7f1e84100820 2024-09-04T16:42:52.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.136+0000 7f1e7b7fe640 1 --2- 172.21.15.170:0/1723664492 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1e70079e30 0x7f1e7007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:52.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.136+0000 7f1e7b7fe640 1 -- 172.21.15.170:0/1723664492 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f1e740bd460 con 0x7f1e84100820 2024-09-04T16:42:52.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.136+0000 7f1e7bfff640 1 --2- 172.21.15.170:0/1723664492 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1e70079e30 0x7f1e7007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:52.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.136+0000 7f1e7bfff640 1 --2- 172.21.15.170:0/1723664492 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1e70079e30 0x7f1e7007c2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1e84198780 tx=0x7f1e6c005e50 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:52.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.141+0000 7f1e7b7fe640 1 -- 172.21.15.170:0/1723664492 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1e74084e70 con 0x7f1e84100820 2024-09-04T16:42:52.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.339+0000 7f1e88fae640 1 -- 172.21.15.170:0/1723664492 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1e84103aa0 con 0x7f1e70079e30 2024-09-04T16:42:52.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.340+0000 7f1e7b7fe640 1 -- 172.21.15.170:0/1723664492 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f1e6c00ea60 con 0x7f1e70079e30 2024-09-04T16:42:52.341 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:42:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:42:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:42:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:42:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:42:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:42:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:42:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:42:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:42:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:42:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:42:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:42:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:42:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:42:52.342 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:42:52.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.343+0000 7f1e88fae640 1 -- 172.21.15.170:0/1723664492 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1e70079e30 msgr2=0x7f1e7007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.343+0000 7f1e88fae640 1 --2- 172.21.15.170:0/1723664492 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1e70079e30 0x7f1e7007c2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1e84198780 tx=0x7f1e6c005e50 comp rx=0 tx=0).stop 2024-09-04T16:42:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.343+0000 7f1e88fae640 1 -- 172.21.15.170:0/1723664492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e84100820 msgr2=0x7f1e84196620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.343+0000 7f1e88fae640 1 --2- 172.21.15.170:0/1723664492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e84100820 0x7f1e84196620 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1e74031460 tx=0x7f1e740045e0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.343+0000 7f1e88fae640 1 -- 172.21.15.170:0/1723664492 shutdown_connections 2024-09-04T16:42:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.343+0000 7f1e88fae640 1 --2- 172.21.15.170:0/1723664492 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1e70079e30 0x7f1e7007c2f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.343+0000 7f1e88fae640 1 --2- 172.21.15.170:0/1723664492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e84106820 0x7f1e84196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.343+0000 7f1e88fae640 1 --2- 172.21.15.170:0/1723664492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e84100820 0x7f1e84196620 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.343+0000 7f1e88fae640 1 -- 172.21.15.170:0/1723664492 >> 172.21.15.170:0/1723664492 conn(0x7f1e840fc520 msgr2=0x7f1e840fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.343+0000 7f1e88fae640 1 -- 172.21.15.170:0/1723664492 shutdown_connections 2024-09-04T16:42:52.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.343+0000 7f1e88fae640 1 -- 172.21.15.170:0/1723664492 wait complete. 2024-09-04T16:42:52.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.426+0000 7f3af5bdf640 1 -- 172.21.15.170:0/1925111519 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3af01067e0 msgr2=0x7f3af0106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:52.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.426+0000 7f3af5bdf640 1 --2- 172.21.15.170:0/1925111519 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3af01067e0 0x7f3af0106bc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0009c20 tx=0x7f3ae002a970 comp rx=0 tx=0).stop 2024-09-04T16:42:52.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.426+0000 7f3af5bdf640 1 -- 172.21.15.170:0/1925111519 shutdown_connections 2024-09-04T16:42:52.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.426+0000 7f3af5bdf640 1 --2- 172.21.15.170:0/1925111519 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3af01007e0 0x7f3af0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.426+0000 7f3af5bdf640 1 --2- 172.21.15.170:0/1925111519 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3af01067e0 0x7f3af0106bc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.426+0000 7f3af5bdf640 1 -- 172.21.15.170:0/1925111519 >> 172.21.15.170:0/1925111519 conn(0x7f3af00fc4c0 msgr2=0x7f3af00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:52.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.426+0000 7f3af5bdf640 1 -- 172.21.15.170:0/1925111519 shutdown_connections 2024-09-04T16:42:52.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.426+0000 7f3af5bdf640 1 -- 172.21.15.170:0/1925111519 wait complete. 2024-09-04T16:42:52.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.426+0000 7f3af5bdf640 1 Processor -- start 2024-09-04T16:42:52.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.427+0000 7f3af5bdf640 1 -- start start 2024-09-04T16:42:52.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.427+0000 7f3af5bdf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3af01007e0 0x7f3af019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:52.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.427+0000 7f3af5bdf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3af01067e0 0x7f3af019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:52.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.427+0000 7f3af5bdf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3af010dc90 con 0x7f3af01007e0 2024-09-04T16:42:52.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.427+0000 7f3af5bdf640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3af010db10 con 0x7f3af01067e0 2024-09-04T16:42:52.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.427+0000 7f3aef7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3af01007e0 0x7f3af019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:52.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.427+0000 7f3aef7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3af01007e0 0x7f3af019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59936/0 (socket says 172.21.15.170:59936) 2024-09-04T16:42:52.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.427+0000 7f3aef7fe640 1 -- 172.21.15.170:0/2237104367 learned_addr learned my addr 172.21.15.170:0/2237104367 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:42:52.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.427+0000 7f3aeeffd640 1 --2- 172.21.15.170:0/2237104367 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3af01067e0 0x7f3af019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:52.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.427+0000 7f3aef7fe640 1 -- 172.21.15.170:0/2237104367 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3af01067e0 msgr2=0x7f3af019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:52.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.427+0000 7f3aef7fe640 1 --2- 172.21.15.170:0/2237104367 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3af01067e0 0x7f3af019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.427+0000 7f3aef7fe640 1 -- 172.21.15.170:0/2237104367 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af0197750 con 0x7f3af01007e0 2024-09-04T16:42:52.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.427+0000 7f3aef7fe640 1 --2- 172.21.15.170:0/2237104367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3af01007e0 0x7f3af019d680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3ae002ae90 tx=0x7f3ae002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:52.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.428+0000 7f3aecff9640 1 -- 172.21.15.170:0/2237104367 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ae0047070 con 0x7f3af01007e0 2024-09-04T16:42:52.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.428+0000 7f3af5bdf640 1 -- 172.21.15.170:0/2237104367 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af01979e0 con 0x7f3af01007e0 2024-09-04T16:42:52.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.428+0000 7f3aecff9640 1 -- 172.21.15.170:0/2237104367 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3ae002f7e0 con 0x7f3af01007e0 2024-09-04T16:42:52.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.428+0000 7f3af5bdf640 1 -- 172.21.15.170:0/2237104367 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af0197ee0 con 0x7f3af01007e0 2024-09-04T16:42:52.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.428+0000 7f3aecff9640 1 -- 172.21.15.170:0/2237104367 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ae0034070 con 0x7f3af01007e0 2024-09-04T16:42:52.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.429+0000 7f3af5bdf640 1 -- 172.21.15.170:0/2237104367 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3af0101f20 con 0x7f3af01007e0 2024-09-04T16:42:52.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.429+0000 7f3aecff9640 1 -- 172.21.15.170:0/2237104367 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f3ae004a070 con 0x7f3af01007e0 2024-09-04T16:42:52.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.430+0000 7f3aecff9640 1 --2- 172.21.15.170:0/2237104367 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3adc079e30 0x7f3adc07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:42:52.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.430+0000 7f3aeeffd640 1 --2- 172.21.15.170:0/2237104367 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3adc079e30 0x7f3adc07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:42:52.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.430+0000 7f3aecff9640 1 -- 172.21.15.170:0/2237104367 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3ae00bd740 con 0x7f3af01007e0 2024-09-04T16:42:52.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.431+0000 7f3aeeffd640 1 --2- 172.21.15.170:0/2237104367 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3adc079e30 0x7f3adc07c2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3af0198fa0 tx=0x7f3ad800b590 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:42:52.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.434+0000 7f3aecff9640 1 -- 172.21.15.170:0/2237104367 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3ae003f070 con 0x7f3af01007e0 2024-09-04T16:42:52.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:52 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2326162496' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:42:52.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:52 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3835079498' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:42:52.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:52 smithi170 ceph-mon[113855]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:42:52.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:52 smithi170 ceph-mon[113855]: pgmap v395: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:52.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.677+0000 7f3af5bdf640 1 -- 172.21.15.170:0/2237104367 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f3af0198250 con 0x7f3af01007e0 2024-09-04T16:42:52.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.677+0000 7f3aecff9640 1 -- 172.21.15.170:0/2237104367 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f3ae0085150 con 0x7f3af01007e0 2024-09-04T16:42:52.678 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:42:52.678 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:42:52.678 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:42:52.678 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:42:52.679 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:42:52.679 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:42:52.679 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:42:52.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.679+0000 7f3af5bdf640 1 -- 172.21.15.170:0/2237104367 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3adc079e30 msgr2=0x7f3adc07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:52.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.679+0000 7f3af5bdf640 1 --2- 172.21.15.170:0/2237104367 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3adc079e30 0x7f3adc07c2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3af0198fa0 tx=0x7f3ad800b590 comp rx=0 tx=0).stop 2024-09-04T16:42:52.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.679+0000 7f3af5bdf640 1 -- 172.21.15.170:0/2237104367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3af01007e0 msgr2=0x7f3af019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:42:52.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.679+0000 7f3af5bdf640 1 --2- 172.21.15.170:0/2237104367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3af01007e0 0x7f3af019d680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3ae002ae90 tx=0x7f3ae002f5f0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.679+0000 7f3af5bdf640 1 -- 172.21.15.170:0/2237104367 shutdown_connections 2024-09-04T16:42:52.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.679+0000 7f3af5bdf640 1 --2- 172.21.15.170:0/2237104367 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3adc079e30 0x7f3adc07c2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.679+0000 7f3af5bdf640 1 --2- 172.21.15.170:0/2237104367 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3af01067e0 0x7f3af019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.680+0000 7f3af5bdf640 1 --2- 172.21.15.170:0/2237104367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3af01007e0 0x7f3af019d680 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:42:52.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.680+0000 7f3af5bdf640 1 -- 172.21.15.170:0/2237104367 >> 172.21.15.170:0/2237104367 conn(0x7f3af00fc4c0 msgr2=0x7f3af0069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:42:52.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.680+0000 7f3af5bdf640 1 -- 172.21.15.170:0/2237104367 shutdown_connections 2024-09-04T16:42:52.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:42:52.680+0000 7f3af5bdf640 1 -- 172.21.15.170:0/2237104367 wait complete. 2024-09-04T16:42:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:52 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2326162496' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:42:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:52 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3835079498' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:42:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:52 smithi193 ceph-mon[82547]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:42:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:52 smithi193 ceph-mon[82547]: pgmap v395: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:53.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:53 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2237104367' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:42:53.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:53 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2237104367' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:42:54.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:54 smithi170 ceph-mon[113855]: pgmap v396: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:54 smithi193 ceph-mon[82547]: pgmap v396: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:56.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:56 smithi170 ceph-mon[113855]: pgmap v397: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:56.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:56 smithi193 ceph-mon[82547]: pgmap v397: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:58.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:58 smithi170 ceph-mon[113855]: pgmap v398: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:58.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:58 smithi193 ceph-mon[82547]: pgmap v398: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:42:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:42:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:42:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:42:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:43:00.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:00 smithi170 ceph-mon[113855]: pgmap v399: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:00 smithi193 ceph-mon[82547]: pgmap v399: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:02 smithi170 ceph-mon[113855]: pgmap v400: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:02.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:02 smithi193 ceph-mon[82547]: pgmap v400: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:04.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:04 smithi170 ceph-mon[113855]: pgmap v401: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:04.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:04 smithi193 ceph-mon[82547]: pgmap v401: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:06.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:06 smithi170 ceph-mon[113855]: pgmap v402: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:06.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:06 smithi193 ceph-mon[82547]: pgmap v402: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:08.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:08 smithi170 ceph-mon[113855]: pgmap v403: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:08.882 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:08 smithi193 ceph-mon[82547]: pgmap v403: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:10.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:10 smithi170 ceph-mon[113855]: pgmap v404: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:10.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:10 smithi193 ceph-mon[82547]: pgmap v404: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:12.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:12 smithi170 ceph-mon[113855]: pgmap v405: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:12.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:12 smithi193 ceph-mon[82547]: pgmap v405: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:43:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:43:15.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:15 smithi170 ceph-mon[113855]: pgmap v406: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:15 smithi193 ceph-mon[82547]: pgmap v406: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:16.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:16 smithi170 ceph-mon[113855]: pgmap v407: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:16.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:16 smithi193 ceph-mon[82547]: pgmap v407: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:18.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:18 smithi170 ceph-mon[113855]: pgmap v408: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:18.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:18 smithi193 ceph-mon[82547]: pgmap v408: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:20.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:20 smithi170 ceph-mon[113855]: pgmap v409: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:20.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:20 smithi193 ceph-mon[82547]: pgmap v409: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:22.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.775+0000 7f14446f7640 1 -- 172.21.15.170:0/1932447505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f143c102ae0 msgr2=0x7f143c102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:22.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.775+0000 7f14446f7640 1 --2- 172.21.15.170:0/1932447505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f143c102ae0 0x7f143c102ec0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1438009880 tx=0x7f143802a530 comp rx=0 tx=0).stop 2024-09-04T16:43:22.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.776+0000 7f14446f7640 1 -- 172.21.15.170:0/1932447505 shutdown_connections 2024-09-04T16:43:22.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.776+0000 7f14446f7640 1 --2- 172.21.15.170:0/1932447505 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f143c103400 0x7f143c10b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:22.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.776+0000 7f14446f7640 1 --2- 172.21.15.170:0/1932447505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f143c102ae0 0x7f143c102ec0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:22.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.776+0000 7f14446f7640 1 -- 172.21.15.170:0/1932447505 >> 172.21.15.170:0/1932447505 conn(0x7f143c0fc520 msgr2=0x7f143c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:22.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.776+0000 7f14446f7640 1 -- 172.21.15.170:0/1932447505 shutdown_connections 2024-09-04T16:43:22.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.776+0000 7f14446f7640 1 -- 172.21.15.170:0/1932447505 wait complete. 2024-09-04T16:43:22.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.776+0000 7f14446f7640 1 Processor -- start 2024-09-04T16:43:22.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.776+0000 7f14446f7640 1 -- start start 2024-09-04T16:43:22.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.777+0000 7f14446f7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f143c102ae0 0x7f143c100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:22.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.777+0000 7f14446f7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f143c103400 0x7f143c100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:22.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.777+0000 7f14446f7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f143c10ee10 con 0x7f143c102ae0 2024-09-04T16:43:22.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.777+0000 7f14446f7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f143c10ec90 con 0x7f143c103400 2024-09-04T16:43:22.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.777+0000 7f1442493640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f143c102ae0 0x7f143c100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:22.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.777+0000 7f1442493640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f143c102ae0 0x7f143c100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58340/0 (socket says 172.21.15.170:58340) 2024-09-04T16:43:22.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.777+0000 7f1442493640 1 -- 172.21.15.170:0/2910305697 learned_addr learned my addr 172.21.15.170:0/2910305697 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:43:22.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.777+0000 7f1441c92640 1 --2- 172.21.15.170:0/2910305697 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f143c103400 0x7f143c100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:22.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.777+0000 7f1442493640 1 -- 172.21.15.170:0/2910305697 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f143c103400 msgr2=0x7f143c100c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:22.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.777+0000 7f1442493640 1 --2- 172.21.15.170:0/2910305697 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f143c103400 0x7f143c100c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:22.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.777+0000 7f1442493640 1 -- 172.21.15.170:0/2910305697 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143c1011c0 con 0x7f143c102ae0 2024-09-04T16:43:22.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.777+0000 7f1441c92640 1 --2- 172.21.15.170:0/2910305697 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f143c103400 0x7f143c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:43:22.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.777+0000 7f1442493640 1 --2- 172.21.15.170:0/2910305697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f143c102ae0 0x7f143c100740 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1438031460 tx=0x7f14380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:22.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.777+0000 7f14337fe640 1 -- 172.21.15.170:0/2910305697 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f143803f070 con 0x7f143c102ae0 2024-09-04T16:43:22.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.778+0000 7f14446f7640 1 -- 172.21.15.170:0/2910305697 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143c101450 con 0x7f143c102ae0 2024-09-04T16:43:22.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.778+0000 7f14446f7640 1 -- 172.21.15.170:0/2910305697 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f143c1a3dc0 con 0x7f143c102ae0 2024-09-04T16:43:22.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.778+0000 7f14337fe640 1 -- 172.21.15.170:0/2910305697 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1438004cf0 con 0x7f143c102ae0 2024-09-04T16:43:22.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.779+0000 7f14337fe640 1 -- 172.21.15.170:0/2910305697 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1438035030 con 0x7f143c102ae0 2024-09-04T16:43:22.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.779+0000 7f14446f7640 1 -- 172.21.15.170:0/2910305697 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f143c06abe0 con 0x7f143c102ae0 2024-09-04T16:43:22.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.779+0000 7f14337fe640 1 -- 172.21.15.170:0/2910305697 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f1438042070 con 0x7f143c102ae0 2024-09-04T16:43:22.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.780+0000 7f14337fe640 1 --2- 172.21.15.170:0/2910305697 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1428079e80 0x7f142807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:22.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.780+0000 7f1441c92640 1 --2- 172.21.15.170:0/2910305697 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1428079e80 0x7f142807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:22.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.780+0000 7f14337fe640 1 -- 172.21.15.170:0/2910305697 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f14380bd4b0 con 0x7f143c102ae0 2024-09-04T16:43:22.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.781+0000 7f1441c92640 1 --2- 172.21.15.170:0/2910305697 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1428079e80 0x7f142807c340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f142c005fd0 tx=0x7f142c005f40 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:22.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.785+0000 7f14337fe640 1 -- 172.21.15.170:0/2910305697 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1438084f40 con 0x7f143c102ae0 2024-09-04T16:43:22.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:22 smithi170 ceph-mon[113855]: pgmap v410: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:22.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:22 smithi193 ceph-mon[82547]: pgmap v410: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:22.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.986+0000 7f14446f7640 1 -- 172.21.15.170:0/2910305697 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f143c062630 con 0x7f1428079e80 2024-09-04T16:43:22.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.988+0000 7f14337fe640 1 -- 172.21.15.170:0/2910305697 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f143c062630 con 0x7f1428079e80 2024-09-04T16:43:22.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.990+0000 7f14446f7640 1 -- 172.21.15.170:0/2910305697 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1428079e80 msgr2=0x7f142807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:22.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.990+0000 7f14446f7640 1 --2- 172.21.15.170:0/2910305697 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1428079e80 0x7f142807c340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f142c005fd0 tx=0x7f142c005f40 comp rx=0 tx=0).stop 2024-09-04T16:43:22.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.990+0000 7f14446f7640 1 -- 172.21.15.170:0/2910305697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f143c102ae0 msgr2=0x7f143c100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:22.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.990+0000 7f14446f7640 1 --2- 172.21.15.170:0/2910305697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f143c102ae0 0x7f143c100740 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1438031460 tx=0x7f14380048f0 comp rx=0 tx=0).stop 2024-09-04T16:43:22.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.990+0000 7f14446f7640 1 -- 172.21.15.170:0/2910305697 shutdown_connections 2024-09-04T16:43:22.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.990+0000 7f14446f7640 1 --2- 172.21.15.170:0/2910305697 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1428079e80 0x7f142807c340 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:22.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.990+0000 7f14446f7640 1 --2- 172.21.15.170:0/2910305697 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f143c103400 0x7f143c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:22.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.990+0000 7f14446f7640 1 --2- 172.21.15.170:0/2910305697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f143c102ae0 0x7f143c100740 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:22.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.990+0000 7f14446f7640 1 -- 172.21.15.170:0/2910305697 >> 172.21.15.170:0/2910305697 conn(0x7f143c0fc520 msgr2=0x7f143c108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:22.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.990+0000 7f14446f7640 1 -- 172.21.15.170:0/2910305697 shutdown_connections 2024-09-04T16:43:22.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:22.990+0000 7f14446f7640 1 -- 172.21.15.170:0/2910305697 wait complete. 2024-09-04T16:43:23.000 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:43:23.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.073+0000 7f83b87fb640 1 -- 172.21.15.170:0/3444222744 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83b01067e0 msgr2=0x7f83b0106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:23.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.073+0000 7f83b87fb640 1 --2- 172.21.15.170:0/3444222744 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83b01067e0 0x7f83b0106bc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009880 tx=0x7f83ac02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.073+0000 7f83b87fb640 1 -- 172.21.15.170:0/3444222744 shutdown_connections 2024-09-04T16:43:23.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.073+0000 7f83b87fb640 1 --2- 172.21.15.170:0/3444222744 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83b01007e0 0x7f83b0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.073+0000 7f83b87fb640 1 --2- 172.21.15.170:0/3444222744 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83b01067e0 0x7f83b0106bc0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.073+0000 7f83b87fb640 1 -- 172.21.15.170:0/3444222744 >> 172.21.15.170:0/3444222744 conn(0x7f83b00fc4c0 msgr2=0x7f83b00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:23.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.073+0000 7f83b87fb640 1 -- 172.21.15.170:0/3444222744 shutdown_connections 2024-09-04T16:43:23.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.073+0000 7f83b87fb640 1 -- 172.21.15.170:0/3444222744 wait complete. 2024-09-04T16:43:23.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.073+0000 7f83b87fb640 1 Processor -- start 2024-09-04T16:43:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.073+0000 7f83b87fb640 1 -- start start 2024-09-04T16:43:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83b87fb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83b01007e0 0x7f83b0107710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83b87fb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83b01067e0 0x7f83b0107c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83b87fb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f83b010dc90 con 0x7f83b01067e0 2024-09-04T16:43:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83b87fb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f83b010db10 con 0x7f83b01007e0 2024-09-04T16:43:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83b5d96640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83b01067e0 0x7f83b0107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83b5d96640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83b01067e0 0x7f83b0107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58360/0 (socket says 172.21.15.170:58360) 2024-09-04T16:43:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83b5d96640 1 -- 172.21.15.170:0/1937769397 learned_addr learned my addr 172.21.15.170:0/1937769397 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:43:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83b6597640 1 --2- 172.21.15.170:0/1937769397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83b01007e0 0x7f83b0107710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83b5d96640 1 -- 172.21.15.170:0/1937769397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83b01007e0 msgr2=0x7f83b0107710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83b5d96640 1 --2- 172.21.15.170:0/1937769397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83b01007e0 0x7f83b0107710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83b5d96640 1 -- 172.21.15.170:0/1937769397 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b0108190 con 0x7f83b01067e0 2024-09-04T16:43:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83b5d96640 1 --2- 172.21.15.170:0/1937769397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83b01067e0 0x7f83b0107c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f83a000d8d0 tx=0x7f83a000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:23.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83a77fe640 1 -- 172.21.15.170:0/1937769397 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83a0017070 con 0x7f83b01067e0 2024-09-04T16:43:23.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83a77fe640 1 -- 172.21.15.170:0/1937769397 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83a0010460 con 0x7f83b01067e0 2024-09-04T16:43:23.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83b87fb640 1 -- 172.21.15.170:0/1937769397 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b0108480 con 0x7f83b01067e0 2024-09-04T16:43:23.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83a77fe640 1 -- 172.21.15.170:0/1937769397 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83a000f5f0 con 0x7f83b01067e0 2024-09-04T16:43:23.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.074+0000 7f83b87fb640 1 -- 172.21.15.170:0/1937769397 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b01a3de0 con 0x7f83b01067e0 2024-09-04T16:43:23.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.075+0000 7f83b87fb640 1 -- 172.21.15.170:0/1937769397 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83b0101f20 con 0x7f83b01067e0 2024-09-04T16:43:23.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.076+0000 7f83a77fe640 1 -- 172.21.15.170:0/1937769397 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f83a0009a30 con 0x7f83b01067e0 2024-09-04T16:43:23.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.077+0000 7f83a77fe640 1 --2- 172.21.15.170:0/1937769397 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f839c079e30 0x7f839c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:23.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.077+0000 7f83a77fe640 1 -- 172.21.15.170:0/1937769397 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f83a009c8f0 con 0x7f83b01067e0 2024-09-04T16:43:23.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.077+0000 7f83b6597640 1 --2- 172.21.15.170:0/1937769397 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f839c079e30 0x7f839c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:23.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.077+0000 7f83b6597640 1 --2- 172.21.15.170:0/1937769397 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f839c079e30 0x7f839c07c2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0096c0 tx=0x7f83ac031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:23.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.081+0000 7f83a77fe640 1 -- 172.21.15.170:0/1937769397 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f83a0068470 con 0x7f83b01067e0 2024-09-04T16:43:23.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.274+0000 7f83b87fb640 1 -- 172.21.15.170:0/1937769397 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f83b006a300 con 0x7f839c079e30 2024-09-04T16:43:23.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.275+0000 7f83a77fe640 1 -- 172.21.15.170:0/1937769397 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f83b006a300 con 0x7f839c079e30 2024-09-04T16:43:23.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.277+0000 7f83b87fb640 1 -- 172.21.15.170:0/1937769397 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f839c079e30 msgr2=0x7f839c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:23.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.277+0000 7f83b87fb640 1 --2- 172.21.15.170:0/1937769397 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f839c079e30 0x7f839c07c2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0096c0 tx=0x7f83ac031400 comp rx=0 tx=0).stop 2024-09-04T16:43:23.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.277+0000 7f83b87fb640 1 -- 172.21.15.170:0/1937769397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83b01067e0 msgr2=0x7f83b0107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:23.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.277+0000 7f83b87fb640 1 --2- 172.21.15.170:0/1937769397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83b01067e0 0x7f83b0107c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f83a000d8d0 tx=0x7f83a000dd90 comp rx=0 tx=0).stop 2024-09-04T16:43:23.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.277+0000 7f83b87fb640 1 -- 172.21.15.170:0/1937769397 shutdown_connections 2024-09-04T16:43:23.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.277+0000 7f83b87fb640 1 --2- 172.21.15.170:0/1937769397 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f839c079e30 0x7f839c07c2f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.277+0000 7f83b87fb640 1 --2- 172.21.15.170:0/1937769397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83b01067e0 0x7f83b0107c50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.277+0000 7f83b87fb640 1 --2- 172.21.15.170:0/1937769397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83b01007e0 0x7f83b0107710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.277+0000 7f83b87fb640 1 -- 172.21.15.170:0/1937769397 >> 172.21.15.170:0/1937769397 conn(0x7f83b00fc4c0 msgr2=0x7f83b0069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:23.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.277+0000 7f83b87fb640 1 -- 172.21.15.170:0/1937769397 shutdown_connections 2024-09-04T16:43:23.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.277+0000 7f83b87fb640 1 -- 172.21.15.170:0/1937769397 wait complete. 2024-09-04T16:43:23.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.359+0000 7f2f35903640 1 -- 172.21.15.170:0/1841193067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30103460 msgr2=0x7f2f3010b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:23.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.359+0000 7f2f35903640 1 --2- 172.21.15.170:0/1841193067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30103460 0x7f2f3010b950 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009880 tx=0x7f2f2402a530 comp rx=0 tx=0).stop 2024-09-04T16:43:23.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.359+0000 7f2f35903640 1 -- 172.21.15.170:0/1841193067 shutdown_connections 2024-09-04T16:43:23.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.359+0000 7f2f35903640 1 --2- 172.21.15.170:0/1841193067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30103460 0x7f2f3010b950 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.359+0000 7f2f35903640 1 --2- 172.21.15.170:0/1841193067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f30102b40 0x7f2f30102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.359+0000 7f2f35903640 1 -- 172.21.15.170:0/1841193067 >> 172.21.15.170:0/1841193067 conn(0x7f2f300fc4c0 msgr2=0x7f2f300fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:23.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.359+0000 7f2f35903640 1 -- 172.21.15.170:0/1841193067 shutdown_connections 2024-09-04T16:43:23.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.359+0000 7f2f35903640 1 -- 172.21.15.170:0/1841193067 wait complete. 2024-09-04T16:43:23.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.359+0000 7f2f35903640 1 Processor -- start 2024-09-04T16:43:23.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.359+0000 7f2f35903640 1 -- start start 2024-09-04T16:43:23.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.360+0000 7f2f35903640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30102b40 0x7f2f3019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:23.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.360+0000 7f2f35903640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f30103460 0x7f2f3019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:23.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.360+0000 7f2f35903640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2f3010edd0 con 0x7f2f30102b40 2024-09-04T16:43:23.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.360+0000 7f2f35903640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2f3010ec50 con 0x7f2f30103460 2024-09-04T16:43:23.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.360+0000 7f2f2effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30102b40 0x7f2f3019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:23.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.360+0000 7f2f2effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30102b40 0x7f2f3019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58380/0 (socket says 172.21.15.170:58380) 2024-09-04T16:43:23.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.360+0000 7f2f2effd640 1 -- 172.21.15.170:0/3546409405 learned_addr learned my addr 172.21.15.170:0/3546409405 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:43:23.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.360+0000 7f2f2e7fc640 1 --2- 172.21.15.170:0/3546409405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f30103460 0x7f2f3019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:23.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.360+0000 7f2f2effd640 1 -- 172.21.15.170:0/3546409405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f30103460 msgr2=0x7f2f3019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:23.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.360+0000 7f2f2effd640 1 --2- 172.21.15.170:0/3546409405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f30103460 0x7f2f3019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.360+0000 7f2f2effd640 1 -- 172.21.15.170:0/3546409405 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f301977c0 con 0x7f2f30102b40 2024-09-04T16:43:23.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.360+0000 7f2f2effd640 1 --2- 172.21.15.170:0/3546409405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30102b40 0x7f2f3019d640 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000d6f0 tx=0x7f2f2000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:23.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.360+0000 7f2f34901640 1 -- 172.21.15.170:0/3546409405 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f20017070 con 0x7f2f30102b40 2024-09-04T16:43:23.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.360+0000 7f2f34901640 1 -- 172.21.15.170:0/3546409405 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f2000de00 con 0x7f2f30102b40 2024-09-04T16:43:23.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.360+0000 7f2f35903640 1 -- 172.21.15.170:0/3546409405 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f30197ab0 con 0x7f2f30102b40 2024-09-04T16:43:23.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.360+0000 7f2f34901640 1 -- 172.21.15.170:0/3546409405 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f20004bb0 con 0x7f2f30102b40 2024-09-04T16:43:23.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.361+0000 7f2f35903640 1 -- 172.21.15.170:0/3546409405 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f30198010 con 0x7f2f30102b40 2024-09-04T16:43:23.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.362+0000 7f2f35903640 1 -- 172.21.15.170:0/3546409405 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f3006a370 con 0x7f2f30102b40 2024-09-04T16:43:23.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.362+0000 7f2f34901640 1 -- 172.21.15.170:0/3546409405 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f2f20009a30 con 0x7f2f30102b40 2024-09-04T16:43:23.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.363+0000 7f2f34901640 1 --2- 172.21.15.170:0/3546409405 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f18079e80 0x7f2f1807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:23.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.363+0000 7f2f34901640 1 -- 172.21.15.170:0/3546409405 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2f2009c610 con 0x7f2f30102b40 2024-09-04T16:43:23.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.363+0000 7f2f2e7fc640 1 --2- 172.21.15.170:0/3546409405 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f18079e80 0x7f2f1807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:23.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.363+0000 7f2f2e7fc640 1 --2- 172.21.15.170:0/3546409405 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f18079e80 0x7f2f1807c340 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2f30198b10 tx=0x7f2f24004f30 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:23.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.367+0000 7f2f34901640 1 -- 172.21.15.170:0/3546409405 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2f200640a0 con 0x7f2f30102b40 2024-09-04T16:43:23.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.551+0000 7f2f35903640 1 -- 172.21.15.170:0/3546409405 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2f301982c0 con 0x7f2f18079e80 2024-09-04T16:43:23.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.561+0000 7f2f34901640 1 -- 172.21.15.170:0/3546409405 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f2f301982c0 con 0x7f2f18079e80 2024-09-04T16:43:23.561 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:43:23.562 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (10m) 4m ago 21m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:43:23.562 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (13m) 4m ago 21m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:43:23.562 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (12m) 4m ago 20m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:43:23.562 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (8m) 4m ago 21m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:43:23.562 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (8m) 4m ago 20m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:43:23.562 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (10m) 4m ago 21m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:43:23.562 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (4m) 4m ago 15m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:43:23.562 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (4m) 4m ago 15m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:43:23.562 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (4m) 4m ago 15m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:43:23.562 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (4m) 4m ago 15m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:43:23.562 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (12m) 4m ago 22m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:43:23.562 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (11m) 4m ago 20m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:43:23.563 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (9m) 4m ago 22m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:43:23.563 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (8m) 4m ago 20m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:43:23.563 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (11m) 4m ago 21m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:43:23.563 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (11m) 4m ago 20m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:43:23.563 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (8m) 4m ago 19m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:43:23.563 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (7m) 4m ago 18m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:43:23.563 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (6m) 4m ago 18m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:43:23.563 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (6m) 4m ago 17m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:43:23.563 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (5m) 4m ago 17m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:43:23.563 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (5m) 4m ago 16m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:43:23.563 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (10m) 4m ago 20m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:43:23.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.563+0000 7f2f35903640 1 -- 172.21.15.170:0/3546409405 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f18079e80 msgr2=0x7f2f1807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:23.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.563+0000 7f2f35903640 1 --2- 172.21.15.170:0/3546409405 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f18079e80 0x7f2f1807c340 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2f30198b10 tx=0x7f2f24004f30 comp rx=0 tx=0).stop 2024-09-04T16:43:23.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.563+0000 7f2f35903640 1 -- 172.21.15.170:0/3546409405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30102b40 msgr2=0x7f2f3019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:23.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.563+0000 7f2f35903640 1 --2- 172.21.15.170:0/3546409405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30102b40 0x7f2f3019d640 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000d6f0 tx=0x7f2f2000dbb0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.563+0000 7f2f35903640 1 -- 172.21.15.170:0/3546409405 shutdown_connections 2024-09-04T16:43:23.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.563+0000 7f2f35903640 1 --2- 172.21.15.170:0/3546409405 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f18079e80 0x7f2f1807c340 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.563+0000 7f2f35903640 1 --2- 172.21.15.170:0/3546409405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f30103460 0x7f2f3019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.563+0000 7f2f35903640 1 --2- 172.21.15.170:0/3546409405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f30102b40 0x7f2f3019d640 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.563+0000 7f2f35903640 1 -- 172.21.15.170:0/3546409405 >> 172.21.15.170:0/3546409405 conn(0x7f2f300fc4c0 msgr2=0x7f2f30103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:23.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.563+0000 7f2f35903640 1 -- 172.21.15.170:0/3546409405 shutdown_connections 2024-09-04T16:43:23.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.563+0000 7f2f35903640 1 -- 172.21.15.170:0/3546409405 wait complete. 2024-09-04T16:43:23.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.643+0000 7f74e64b2640 1 -- 172.21.15.170:0/1624101959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74e01001c0 msgr2=0x7f74e01005a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:23.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.643+0000 7f74e64b2640 1 --2- 172.21.15.170:0/1624101959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74e01001c0 0x7f74e01005a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009880 tx=0x7f74d002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.643+0000 7f74e64b2640 1 -- 172.21.15.170:0/1624101959 shutdown_connections 2024-09-04T16:43:23.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.643+0000 7f74e64b2640 1 --2- 172.21.15.170:0/1624101959 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74e0100b70 0x7f74e0104bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.643+0000 7f74e64b2640 1 --2- 172.21.15.170:0/1624101959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74e01001c0 0x7f74e01005a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.643+0000 7f74e64b2640 1 -- 172.21.15.170:0/1624101959 >> 172.21.15.170:0/1624101959 conn(0x7f74e00fbc40 msgr2=0x7f74e00fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:23.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.643+0000 7f74e64b2640 1 -- 172.21.15.170:0/1624101959 shutdown_connections 2024-09-04T16:43:23.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.643+0000 7f74e64b2640 1 -- 172.21.15.170:0/1624101959 wait complete. 2024-09-04T16:43:23.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.644+0000 7f74e64b2640 1 Processor -- start 2024-09-04T16:43:23.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.644+0000 7f74e64b2640 1 -- start start 2024-09-04T16:43:23.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.644+0000 7f74e64b2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74e01001c0 0x7f74e019d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:23.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.644+0000 7f74e64b2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74e0100b70 0x7f74e019db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:23.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.644+0000 7f74e64b2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f74e010d440 con 0x7f74e0100b70 2024-09-04T16:43:23.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.644+0000 7f74e64b2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f74e010d2c0 con 0x7f74e01001c0 2024-09-04T16:43:23.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.644+0000 7f74df7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74e0100b70 0x7f74e019db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:23.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.645+0000 7f74df7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74e0100b70 0x7f74e019db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58398/0 (socket says 172.21.15.170:58398) 2024-09-04T16:43:23.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.645+0000 7f74df7fe640 1 -- 172.21.15.170:0/3738691031 learned_addr learned my addr 172.21.15.170:0/3738691031 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:43:23.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.645+0000 7f74dffff640 1 --2- 172.21.15.170:0/3738691031 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74e01001c0 0x7f74e019d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:23.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.645+0000 7f74df7fe640 1 -- 172.21.15.170:0/3738691031 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74e01001c0 msgr2=0x7f74e019d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:23.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.645+0000 7f74df7fe640 1 --2- 172.21.15.170:0/3738691031 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74e01001c0 0x7f74e019d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.645+0000 7f74df7fe640 1 -- 172.21.15.170:0/3738691031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e0197790 con 0x7f74e0100b70 2024-09-04T16:43:23.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.645+0000 7f74df7fe640 1 --2- 172.21.15.170:0/3738691031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74e0100b70 0x7f74e019db50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f74d400d6f0 tx=0x7f74d400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:23.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.645+0000 7f74dd7fa640 1 -- 172.21.15.170:0/3738691031 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f74d4017070 con 0x7f74e0100b70 2024-09-04T16:43:23.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.645+0000 7f74dd7fa640 1 -- 172.21.15.170:0/3738691031 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f74d400de00 con 0x7f74e0100b70 2024-09-04T16:43:23.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.645+0000 7f74e64b2640 1 -- 172.21.15.170:0/3738691031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e0197a80 con 0x7f74e0100b70 2024-09-04T16:43:23.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.645+0000 7f74dd7fa640 1 -- 172.21.15.170:0/3738691031 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f74d4004bb0 con 0x7f74e0100b70 2024-09-04T16:43:23.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.645+0000 7f74e64b2640 1 -- 172.21.15.170:0/3738691031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e0198010 con 0x7f74e0100b70 2024-09-04T16:43:23.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.646+0000 7f74e64b2640 1 -- 172.21.15.170:0/3738691031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e01016a0 con 0x7f74e0100b70 2024-09-04T16:43:23.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.647+0000 7f74dd7fa640 1 -- 172.21.15.170:0/3738691031 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f74d4009a30 con 0x7f74e0100b70 2024-09-04T16:43:23.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.647+0000 7f74dd7fa640 1 --2- 172.21.15.170:0/3738691031 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f74c8079e80 0x7f74c807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:23.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.647+0000 7f74dd7fa640 1 -- 172.21.15.170:0/3738691031 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f74d409c610 con 0x7f74e0100b70 2024-09-04T16:43:23.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.647+0000 7f74dffff640 1 --2- 172.21.15.170:0/3738691031 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f74c8079e80 0x7f74c807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:23.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.648+0000 7f74dffff640 1 --2- 172.21.15.170:0/3738691031 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f74c8079e80 0x7f74c807c340 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f74d0031460 tx=0x7f74d0009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:23.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.651+0000 7f74dd7fa640 1 -- 172.21.15.170:0/3738691031 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f74d40640a0 con 0x7f74e0100b70 2024-09-04T16:43:23.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:23 smithi170 ceph-mon[113855]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:43:23.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:23 smithi170 ceph-mon[113855]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:43:23.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.894+0000 7f74e64b2640 1 -- 172.21.15.170:0/3738691031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f74e01982c0 con 0x7f74e0100b70 2024-09-04T16:43:23.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.895+0000 7f74dd7fa640 1 -- 172.21.15.170:0/3738691031 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f74d4068210 con 0x7f74e0100b70 2024-09-04T16:43:23.896 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:43:23.896 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:43:23.896 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:43:23.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:43:23.896 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:43:23.896 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:43:23.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:43:23.896 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:43:23.896 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:43:23.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:43:23.897 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:43:23.897 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:43:23.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:43:23.897 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:43:23.897 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:43:23.897 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:43:23.897 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:43:23.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.898+0000 7f74e64b2640 1 -- 172.21.15.170:0/3738691031 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f74c8079e80 msgr2=0x7f74c807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:23.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.898+0000 7f74e64b2640 1 --2- 172.21.15.170:0/3738691031 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f74c8079e80 0x7f74c807c340 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f74d0031460 tx=0x7f74d0009560 comp rx=0 tx=0).stop 2024-09-04T16:43:23.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.898+0000 7f74e64b2640 1 -- 172.21.15.170:0/3738691031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74e0100b70 msgr2=0x7f74e019db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:23.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.898+0000 7f74e64b2640 1 --2- 172.21.15.170:0/3738691031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74e0100b70 0x7f74e019db50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f74d400d6f0 tx=0x7f74d400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.898+0000 7f74e64b2640 1 -- 172.21.15.170:0/3738691031 shutdown_connections 2024-09-04T16:43:23.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.898+0000 7f74e64b2640 1 --2- 172.21.15.170:0/3738691031 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f74c8079e80 0x7f74c807c340 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.898+0000 7f74e64b2640 1 --2- 172.21.15.170:0/3738691031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74e0100b70 0x7f74e019db50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.898+0000 7f74e64b2640 1 --2- 172.21.15.170:0/3738691031 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74e01001c0 0x7f74e019d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.898+0000 7f74e64b2640 1 -- 172.21.15.170:0/3738691031 >> 172.21.15.170:0/3738691031 conn(0x7f74e00fbc40 msgr2=0x7f74e00fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:23.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.898+0000 7f74e64b2640 1 -- 172.21.15.170:0/3738691031 shutdown_connections 2024-09-04T16:43:23.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.898+0000 7f74e64b2640 1 -- 172.21.15.170:0/3738691031 wait complete. 2024-09-04T16:43:23.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:23 smithi193 ceph-mon[82547]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:43:23.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:23 smithi193 ceph-mon[82547]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:43:23.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.979+0000 7f637bdc5640 1 -- 172.21.15.170:0/3606625857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6374100820 msgr2=0x7f6374100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:23.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.979+0000 7f637bdc5640 1 --2- 172.21.15.170:0/3606625857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6374100820 0x7f6374100c80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6364009880 tx=0x7f636402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.979+0000 7f637bdc5640 1 -- 172.21.15.170:0/3606625857 shutdown_connections 2024-09-04T16:43:23.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.979+0000 7f637bdc5640 1 --2- 172.21.15.170:0/3606625857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6374100820 0x7f6374100c80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.979+0000 7f637bdc5640 1 --2- 172.21.15.170:0/3606625857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6374106820 0x7f6374106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.979+0000 7f637bdc5640 1 -- 172.21.15.170:0/3606625857 >> 172.21.15.170:0/3606625857 conn(0x7f63740fc520 msgr2=0x7f63740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:23.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.979+0000 7f637bdc5640 1 -- 172.21.15.170:0/3606625857 shutdown_connections 2024-09-04T16:43:23.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.979+0000 7f637bdc5640 1 -- 172.21.15.170:0/3606625857 wait complete. 2024-09-04T16:43:23.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.980+0000 7f637bdc5640 1 Processor -- start 2024-09-04T16:43:23.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.980+0000 7f637bdc5640 1 -- start start 2024-09-04T16:43:23.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.980+0000 7f637bdc5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6374100820 0x7f6374198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:23.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.980+0000 7f637bdc5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6374106820 0x7f6374198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:23.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.980+0000 7f637bdc5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f637410dd50 con 0x7f6374100820 2024-09-04T16:43:23.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.980+0000 7f637bdc5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f637410dbd0 con 0x7f6374106820 2024-09-04T16:43:23.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.980+0000 7f6379b61640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6374100820 0x7f6374198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:23.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.980+0000 7f6379b61640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6374100820 0x7f6374198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58412/0 (socket says 172.21.15.170:58412) 2024-09-04T16:43:23.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.980+0000 7f6379b61640 1 -- 172.21.15.170:0/176347773 learned_addr learned my addr 172.21.15.170:0/176347773 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:43:23.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.980+0000 7f6379360640 1 --2- 172.21.15.170:0/176347773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6374106820 0x7f6374198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:23.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.981+0000 7f6379b61640 1 -- 172.21.15.170:0/176347773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6374106820 msgr2=0x7f6374198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:23.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.981+0000 7f6379b61640 1 --2- 172.21.15.170:0/176347773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6374106820 0x7f6374198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:23.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.981+0000 7f6379b61640 1 -- 172.21.15.170:0/176347773 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63741993b0 con 0x7f6374100820 2024-09-04T16:43:23.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.981+0000 7f6379360640 1 --2- 172.21.15.170:0/176347773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6374106820 0x7f6374198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:43:23.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.981+0000 7f6379b61640 1 --2- 172.21.15.170:0/176347773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6374100820 0x7f6374198870 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f637000b420 tx=0x7f637000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:23.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.981+0000 7f636affd640 1 -- 172.21.15.170:0/176347773 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6370011630 con 0x7f6374100820 2024-09-04T16:43:23.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.981+0000 7f636affd640 1 -- 172.21.15.170:0/176347773 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6370016070 con 0x7f6374100820 2024-09-04T16:43:23.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.981+0000 7f637bdc5640 1 -- 172.21.15.170:0/176347773 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63741996a0 con 0x7f6374100820 2024-09-04T16:43:23.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.981+0000 7f636affd640 1 -- 172.21.15.170:0/176347773 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6370010d40 con 0x7f6374100820 2024-09-04T16:43:23.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.981+0000 7f637bdc5640 1 -- 172.21.15.170:0/176347773 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63741a1ca0 con 0x7f6374100820 2024-09-04T16:43:23.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.982+0000 7f637bdc5640 1 -- 172.21.15.170:0/176347773 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6374101f60 con 0x7f6374100820 2024-09-04T16:43:23.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.983+0000 7f636affd640 1 -- 172.21.15.170:0/176347773 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f637001b460 con 0x7f6374100820 2024-09-04T16:43:23.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.983+0000 7f636affd640 1 --2- 172.21.15.170:0/176347773 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6360079e30 0x7f636007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:23.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.983+0000 7f636affd640 1 -- 172.21.15.170:0/176347773 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f637009be30 con 0x7f6374100820 2024-09-04T16:43:23.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.983+0000 7f6379360640 1 --2- 172.21.15.170:0/176347773 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6360079e30 0x7f636007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:23.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.984+0000 7f6379360640 1 --2- 172.21.15.170:0/176347773 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6360079e30 0x7f636007c2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6364006010 tx=0x7f63640095f0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:23.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:23.987+0000 7f636affd640 1 -- 172.21.15.170:0/176347773 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6370020060 con 0x7f6374100820 2024-09-04T16:43:24.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.202+0000 7f637bdc5640 1 -- 172.21.15.170:0/176347773 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6374108db0 con 0x7f6374100820 2024-09-04T16:43:24.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.203+0000 7f636affd640 1 -- 172.21.15.170:0/176347773 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7f63741996a0 con 0x7f6374100820 2024-09-04T16:43:24.204 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:43:24.204 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:43:24.204 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:43:24.204 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:43:24.204 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:43:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:43:24.204 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:43:24.204 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:43:24.204 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:43:24.204 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:43:24.204 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:43:24.204 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:43:24.205 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:43:24.205 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:43:24.205 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:43:24.205 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:43:24.205 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:43:24.205 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:43:24.205 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:43:24.205 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:43:24.205 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:43:24.205 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:43:24.205 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:43:24.205 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:43:24.205 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:43:24.206 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:43:24.206 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:43:24.206 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:43:24.206 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:43:24.206 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:43:24.206 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:43:24.206 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:43:24.206 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:43:24.206 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:43:24.206 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:43:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:43:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:43:24.206 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:43:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:43:24.206 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:43:24.207 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:43:24.207 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:43:24.207 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:43:24.207 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:43:24.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.206+0000 7f637bdc5640 1 -- 172.21.15.170:0/176347773 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6360079e30 msgr2=0x7f636007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:24.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.206+0000 7f637bdc5640 1 --2- 172.21.15.170:0/176347773 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6360079e30 0x7f636007c2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6364006010 tx=0x7f63640095f0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.206+0000 7f637bdc5640 1 -- 172.21.15.170:0/176347773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6374100820 msgr2=0x7f6374198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:24.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.206+0000 7f637bdc5640 1 --2- 172.21.15.170:0/176347773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6374100820 0x7f6374198870 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f637000b420 tx=0x7f637000b8e0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.206+0000 7f637bdc5640 1 -- 172.21.15.170:0/176347773 shutdown_connections 2024-09-04T16:43:24.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.206+0000 7f637bdc5640 1 --2- 172.21.15.170:0/176347773 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6360079e30 0x7f636007c2f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.206+0000 7f637bdc5640 1 --2- 172.21.15.170:0/176347773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6374106820 0x7f6374198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.206+0000 7f637bdc5640 1 --2- 172.21.15.170:0/176347773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6374100820 0x7f6374198870 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.206+0000 7f637bdc5640 1 -- 172.21.15.170:0/176347773 >> 172.21.15.170:0/176347773 conn(0x7f63740fc520 msgr2=0x7f63740fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:24.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.206+0000 7f637bdc5640 1 -- 172.21.15.170:0/176347773 shutdown_connections 2024-09-04T16:43:24.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.206+0000 7f637bdc5640 1 -- 172.21.15.170:0/176347773 wait complete. 2024-09-04T16:43:24.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.293+0000 7f93bff95640 1 -- 172.21.15.170:0/693043865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93b8106820 msgr2=0x7f93b8106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:24.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.293+0000 7f93bff95640 1 --2- 172.21.15.170:0/693043865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93b8106820 0x7f93b8106c00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009880 tx=0x7f93b402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.293+0000 7f93bff95640 1 -- 172.21.15.170:0/693043865 shutdown_connections 2024-09-04T16:43:24.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.293+0000 7f93bff95640 1 --2- 172.21.15.170:0/693043865 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93b8100820 0x7f93b8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.293+0000 7f93bff95640 1 --2- 172.21.15.170:0/693043865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93b8106820 0x7f93b8106c00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.293+0000 7f93bff95640 1 -- 172.21.15.170:0/693043865 >> 172.21.15.170:0/693043865 conn(0x7f93b80fc520 msgr2=0x7f93b80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:24.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.293+0000 7f93bff95640 1 -- 172.21.15.170:0/693043865 shutdown_connections 2024-09-04T16:43:24.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.293+0000 7f93bff95640 1 -- 172.21.15.170:0/693043865 wait complete. 2024-09-04T16:43:24.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.294+0000 7f93bff95640 1 Processor -- start 2024-09-04T16:43:24.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.294+0000 7f93bff95640 1 -- start start 2024-09-04T16:43:24.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.294+0000 7f93bff95640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93b8100820 0x7f93b80fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:24.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.294+0000 7f93bff95640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93b8106820 0x7f93b80fd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:24.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.294+0000 7f93bff95640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f93b810dd50 con 0x7f93b8106820 2024-09-04T16:43:24.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.294+0000 7f93bff95640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f93b810dbd0 con 0x7f93b8100820 2024-09-04T16:43:24.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.294+0000 7f93bd530640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93b8106820 0x7f93b80fd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:24.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.294+0000 7f93bd530640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93b8106820 0x7f93b80fd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58438/0 (socket says 172.21.15.170:58438) 2024-09-04T16:43:24.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.294+0000 7f93bd530640 1 -- 172.21.15.170:0/3645710345 learned_addr learned my addr 172.21.15.170:0/3645710345 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:43:24.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.294+0000 7f93bdd31640 1 --2- 172.21.15.170:0/3645710345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93b8100820 0x7f93b80fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:24.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.294+0000 7f93bd530640 1 -- 172.21.15.170:0/3645710345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93b8100820 msgr2=0x7f93b80fcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:24.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.294+0000 7f93bd530640 1 --2- 172.21.15.170:0/3645710345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93b8100820 0x7f93b80fcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.294+0000 7f93bd530640 1 -- 172.21.15.170:0/3645710345 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b80fd6a0 con 0x7f93b8106820 2024-09-04T16:43:24.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.294+0000 7f93bdd31640 1 --2- 172.21.15.170:0/3645710345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93b8100820 0x7f93b80fcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:43:24.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.294+0000 7f93bd530640 1 --2- 172.21.15.170:0/3645710345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93b8106820 0x7f93b80fd160 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f93a800b420 tx=0x7f93a800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:24.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.295+0000 7f93aeffd640 1 -- 172.21.15.170:0/3645710345 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93a8011630 con 0x7f93b8106820 2024-09-04T16:43:24.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.295+0000 7f93aeffd640 1 -- 172.21.15.170:0/3645710345 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f93a8016070 con 0x7f93b8106820 2024-09-04T16:43:24.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.295+0000 7f93bff95640 1 -- 172.21.15.170:0/3645710345 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b80fd990 con 0x7f93b8106820 2024-09-04T16:43:24.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.295+0000 7f93aeffd640 1 -- 172.21.15.170:0/3645710345 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93a8010d40 con 0x7f93b8106820 2024-09-04T16:43:24.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.295+0000 7f93bff95640 1 -- 172.21.15.170:0/3645710345 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b81a3eb0 con 0x7f93b8106820 2024-09-04T16:43:24.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.296+0000 7f93bff95640 1 -- 172.21.15.170:0/3645710345 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b8101f60 con 0x7f93b8106820 2024-09-04T16:43:24.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.297+0000 7f93aeffd640 1 -- 172.21.15.170:0/3645710345 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f93a801b460 con 0x7f93b8106820 2024-09-04T16:43:24.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.297+0000 7f93aeffd640 1 --2- 172.21.15.170:0/3645710345 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f93a4079e80 0x7f93a407c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:24.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.298+0000 7f93bdd31640 1 --2- 172.21.15.170:0/3645710345 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f93a4079e80 0x7f93a407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:24.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.298+0000 7f93aeffd640 1 -- 172.21.15.170:0/3645710345 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f93a809bd60 con 0x7f93b8106820 2024-09-04T16:43:24.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.298+0000 7f93bdd31640 1 --2- 172.21.15.170:0/3645710345 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f93a4079e80 0x7f93a407c340 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f93b4006010 tx=0x7f93b40095f0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:24.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.302+0000 7f93aeffd640 1 -- 172.21.15.170:0/3645710345 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f93a8020060 con 0x7f93b8106820 2024-09-04T16:43:24.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.493+0000 7f93bff95640 1 -- 172.21.15.170:0/3645710345 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f93b8062630 con 0x7f93a4079e80 2024-09-04T16:43:24.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.495+0000 7f93aeffd640 1 -- 172.21.15.170:0/3645710345 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f93b8062630 con 0x7f93a4079e80 2024-09-04T16:43:24.495 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:43:24.496 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:43:24.496 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:43:24.496 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:43:24.496 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:43:24.496 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:43:24.496 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:43:24.496 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:43:24.496 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:43:24.496 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:43:24.496 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:43:24.496 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:43:24.496 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:43:24.496 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:43:24.496 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:43:24.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.497+0000 7f93bff95640 1 -- 172.21.15.170:0/3645710345 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f93a4079e80 msgr2=0x7f93a407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:24.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.497+0000 7f93bff95640 1 --2- 172.21.15.170:0/3645710345 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f93a4079e80 0x7f93a407c340 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f93b4006010 tx=0x7f93b40095f0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.497+0000 7f93bff95640 1 -- 172.21.15.170:0/3645710345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93b8106820 msgr2=0x7f93b80fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:24.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.497+0000 7f93bff95640 1 --2- 172.21.15.170:0/3645710345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93b8106820 0x7f93b80fd160 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f93a800b420 tx=0x7f93a800b8e0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.497+0000 7f93bff95640 1 -- 172.21.15.170:0/3645710345 shutdown_connections 2024-09-04T16:43:24.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.497+0000 7f93bff95640 1 --2- 172.21.15.170:0/3645710345 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f93a4079e80 0x7f93a407c340 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.497+0000 7f93bff95640 1 --2- 172.21.15.170:0/3645710345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93b8106820 0x7f93b80fd160 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.497+0000 7f93bff95640 1 --2- 172.21.15.170:0/3645710345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93b8100820 0x7f93b80fcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.497+0000 7f93bff95640 1 -- 172.21.15.170:0/3645710345 >> 172.21.15.170:0/3645710345 conn(0x7f93b80fc520 msgr2=0x7f93b806a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:24.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.497+0000 7f93bff95640 1 -- 172.21.15.170:0/3645710345 shutdown_connections 2024-09-04T16:43:24.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.497+0000 7f93bff95640 1 -- 172.21.15.170:0/3645710345 wait complete. 2024-09-04T16:43:24.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.581+0000 7fad1aa9a640 1 -- 172.21.15.170:0/396279559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad14100820 msgr2=0x7fad14100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:24.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.581+0000 7fad1aa9a640 1 --2- 172.21.15.170:0/396279559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad14100820 0x7fad14100c80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fad08009880 tx=0x7fad0802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.581+0000 7fad1aa9a640 1 -- 172.21.15.170:0/396279559 shutdown_connections 2024-09-04T16:43:24.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.581+0000 7fad1aa9a640 1 --2- 172.21.15.170:0/396279559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad14100820 0x7fad14100c80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.581+0000 7fad1aa9a640 1 --2- 172.21.15.170:0/396279559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad14106820 0x7fad14106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.581+0000 7fad1aa9a640 1 -- 172.21.15.170:0/396279559 >> 172.21.15.170:0/396279559 conn(0x7fad140fc520 msgr2=0x7fad140fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:24.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.581+0000 7fad1aa9a640 1 -- 172.21.15.170:0/396279559 shutdown_connections 2024-09-04T16:43:24.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.582+0000 7fad1aa9a640 1 -- 172.21.15.170:0/396279559 wait complete. 2024-09-04T16:43:24.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.582+0000 7fad1aa9a640 1 Processor -- start 2024-09-04T16:43:24.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.582+0000 7fad1aa9a640 1 -- start start 2024-09-04T16:43:24.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.582+0000 7fad1aa9a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad14100820 0x7fad1419c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:24.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.582+0000 7fad1aa9a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad14106820 0x7fad1419cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:24.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.582+0000 7fad1aa9a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fad1410dcf0 con 0x7fad14106820 2024-09-04T16:43:24.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.582+0000 7fad1aa9a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fad1410db70 con 0x7fad14100820 2024-09-04T16:43:24.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.582+0000 7fad13fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad14106820 0x7fad1419cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:24.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.582+0000 7fad13fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad14106820 0x7fad1419cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58456/0 (socket says 172.21.15.170:58456) 2024-09-04T16:43:24.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.582+0000 7fad13fff640 1 -- 172.21.15.170:0/2794837147 learned_addr learned my addr 172.21.15.170:0/2794837147 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:43:24.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.582+0000 7fad18836640 1 --2- 172.21.15.170:0/2794837147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad14100820 0x7fad1419c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:24.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.583+0000 7fad13fff640 1 -- 172.21.15.170:0/2794837147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad14100820 msgr2=0x7fad1419c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:24.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.583+0000 7fad13fff640 1 --2- 172.21.15.170:0/2794837147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad14100820 0x7fad1419c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.583+0000 7fad13fff640 1 -- 172.21.15.170:0/2794837147 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad141966c0 con 0x7fad14106820 2024-09-04T16:43:24.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.583+0000 7fad13fff640 1 --2- 172.21.15.170:0/2794837147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad14106820 0x7fad1419cb30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fad08031460 tx=0x7fad080045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:24.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.583+0000 7fad11ffb640 1 -- 172.21.15.170:0/2794837147 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad0803f070 con 0x7fad14106820 2024-09-04T16:43:24.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.583+0000 7fad11ffb640 1 -- 172.21.15.170:0/2794837147 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad080035f0 con 0x7fad14106820 2024-09-04T16:43:24.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.583+0000 7fad1aa9a640 1 -- 172.21.15.170:0/2794837147 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad14196950 con 0x7fad14106820 2024-09-04T16:43:24.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.583+0000 7fad11ffb640 1 -- 172.21.15.170:0/2794837147 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad08035030 con 0x7fad14106820 2024-09-04T16:43:24.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.583+0000 7fad1aa9a640 1 -- 172.21.15.170:0/2794837147 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad14196e50 con 0x7fad14106820 2024-09-04T16:43:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.584+0000 7fad1aa9a640 1 -- 172.21.15.170:0/2794837147 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad14101f60 con 0x7fad14106820 2024-09-04T16:43:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.585+0000 7fad11ffb640 1 -- 172.21.15.170:0/2794837147 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fad08042070 con 0x7fad14106820 2024-09-04T16:43:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.585+0000 7fad11ffb640 1 --2- 172.21.15.170:0/2794837147 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7facfc079e80 0x7facfc07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.585+0000 7fad11ffb640 1 -- 172.21.15.170:0/2794837147 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fad080bd300 con 0x7fad14106820 2024-09-04T16:43:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.585+0000 7fad18836640 1 --2- 172.21.15.170:0/2794837147 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7facfc079e80 0x7facfc07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:24.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.586+0000 7fad18836640 1 --2- 172.21.15.170:0/2794837147 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7facfc079e80 0x7facfc07c340 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fad04005fd0 tx=0x7fad0400b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:24.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.590+0000 7fad11ffb640 1 -- 172.21.15.170:0/2794837147 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fad08088f00 con 0x7fad14106820 2024-09-04T16:43:24.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.836+0000 7fad1aa9a640 1 -- 172.21.15.170:0/2794837147 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fad14197bf0 con 0x7fad14106820 2024-09-04T16:43:24.837 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:24 smithi170 ceph-mon[113855]: from='client.34594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:43:24.837 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:24 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3738691031' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:43:24.837 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:24 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/176347773' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:43:24.837 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:24 smithi170 ceph-mon[113855]: from='client.34606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:43:24.837 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:24 smithi170 ceph-mon[113855]: pgmap v411: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:24.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.836+0000 7fad11ffb640 1 -- 172.21.15.170:0/2794837147 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fad0808d920 con 0x7fad14106820 2024-09-04T16:43:24.838 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:43:24.838 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:43:24.838 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:43:24.838 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:43:24.838 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:43:24.838 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:43:24.838 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:43:24.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.839+0000 7fad1aa9a640 1 -- 172.21.15.170:0/2794837147 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7facfc079e80 msgr2=0x7facfc07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:24.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.839+0000 7fad1aa9a640 1 --2- 172.21.15.170:0/2794837147 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7facfc079e80 0x7facfc07c340 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fad04005fd0 tx=0x7fad0400b390 comp rx=0 tx=0).stop 2024-09-04T16:43:24.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.839+0000 7fad1aa9a640 1 -- 172.21.15.170:0/2794837147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad14106820 msgr2=0x7fad1419cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:24.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.839+0000 7fad1aa9a640 1 --2- 172.21.15.170:0/2794837147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad14106820 0x7fad1419cb30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fad08031460 tx=0x7fad080045e0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.839+0000 7fad1aa9a640 1 -- 172.21.15.170:0/2794837147 shutdown_connections 2024-09-04T16:43:24.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.839+0000 7fad1aa9a640 1 --2- 172.21.15.170:0/2794837147 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7facfc079e80 0x7facfc07c340 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.839+0000 7fad1aa9a640 1 --2- 172.21.15.170:0/2794837147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad14106820 0x7fad1419cb30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.839+0000 7fad1aa9a640 1 --2- 172.21.15.170:0/2794837147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad14100820 0x7fad1419c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:24.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.839+0000 7fad1aa9a640 1 -- 172.21.15.170:0/2794837147 >> 172.21.15.170:0/2794837147 conn(0x7fad140fc520 msgr2=0x7fad140fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:24.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.840+0000 7fad1aa9a640 1 -- 172.21.15.170:0/2794837147 shutdown_connections 2024-09-04T16:43:24.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:24.840+0000 7fad1aa9a640 1 -- 172.21.15.170:0/2794837147 wait complete. 2024-09-04T16:43:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:24 smithi193 ceph-mon[82547]: from='client.34594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:43:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:24 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3738691031' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:43:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:24 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/176347773' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:43:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:24 smithi193 ceph-mon[82547]: from='client.34606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:43:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:24 smithi193 ceph-mon[82547]: pgmap v411: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:25.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:25 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2794837147' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:43:25.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:25 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2794837147' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:43:26.807 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:26 smithi193 ceph-mon[82547]: pgmap v412: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:26.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:26 smithi170 ceph-mon[113855]: pgmap v412: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:28.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:28 smithi170 ceph-mon[113855]: pgmap v413: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:28.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:28 smithi193 ceph-mon[82547]: pgmap v413: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:29.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:43:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:43:30.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:30 smithi170 ceph-mon[113855]: pgmap v414: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:30.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:30 smithi193 ceph-mon[82547]: pgmap v414: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:33.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:33 smithi170 ceph-mon[113855]: pgmap v415: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:33.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:33 smithi193 ceph-mon[82547]: pgmap v415: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:35.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:35 smithi170 ceph-mon[113855]: pgmap v416: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:35.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:35 smithi193 ceph-mon[82547]: pgmap v416: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:37.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:37 smithi170 ceph-mon[113855]: pgmap v417: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:37.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:37 smithi193 ceph-mon[82547]: pgmap v417: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:39.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:39 smithi193 ceph-mon[82547]: pgmap v418: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:39.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:39 smithi170 ceph-mon[113855]: pgmap v418: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:41.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:41 smithi170 ceph-mon[113855]: pgmap v419: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:41.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:41 smithi193 ceph-mon[82547]: pgmap v419: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:43.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:43 smithi170 ceph-mon[113855]: pgmap v420: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:43.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:43 smithi193 ceph-mon[82547]: pgmap v420: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:44.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:43:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:43:45.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:45 smithi170 ceph-mon[113855]: pgmap v421: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:45.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:45 smithi193 ceph-mon[82547]: pgmap v421: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:47.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:47 smithi170 ceph-mon[113855]: pgmap v422: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:47.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:47 smithi193 ceph-mon[82547]: pgmap v422: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:49.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:49 smithi170 ceph-mon[113855]: pgmap v423: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:49.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:49 smithi193 ceph-mon[82547]: pgmap v423: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:51.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:51 smithi170 ceph-mon[113855]: pgmap v424: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:51.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:51 smithi193 ceph-mon[82547]: pgmap v424: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:53.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:53 smithi170 ceph-mon[113855]: pgmap v425: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:53.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:53 smithi193 ceph-mon[82547]: pgmap v425: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:54.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.933+0000 7fede0393640 1 -- 172.21.15.170:0/2568585508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd8107930 msgr2=0x7fedd8107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:54.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.933+0000 7fede0393640 1 --2- 172.21.15.170:0/2568585508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd8107930 0x7fedd8107d10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009880 tx=0x7fedc802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:43:54.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.933+0000 7fede0393640 1 -- 172.21.15.170:0/2568585508 shutdown_connections 2024-09-04T16:43:54.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.933+0000 7fede0393640 1 --2- 172.21.15.170:0/2568585508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fedd8101930 0x7fedd8101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:54.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.933+0000 7fede0393640 1 --2- 172.21.15.170:0/2568585508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd8107930 0x7fedd8107d10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:54.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.933+0000 7fede0393640 1 -- 172.21.15.170:0/2568585508 >> 172.21.15.170:0/2568585508 conn(0x7fedd80fd630 msgr2=0x7fedd80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:54.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.933+0000 7fede0393640 1 -- 172.21.15.170:0/2568585508 shutdown_connections 2024-09-04T16:43:54.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.933+0000 7fede0393640 1 -- 172.21.15.170:0/2568585508 wait complete. 2024-09-04T16:43:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.934+0000 7fede0393640 1 Processor -- start 2024-09-04T16:43:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.934+0000 7fede0393640 1 -- start start 2024-09-04T16:43:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7fede0393640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fedd8101930 0x7fedd819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7fede0393640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd8107930 0x7fedd819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7fede0393640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fedd810ede0 con 0x7fedd8107930 2024-09-04T16:43:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7fede0393640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fedd810ec60 con 0x7fedd8101930 2024-09-04T16:43:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7feddd92e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd8107930 0x7fedd819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7feddd92e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd8107930 0x7fedd819dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57920/0 (socket says 172.21.15.170:57920) 2024-09-04T16:43:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7feddd92e640 1 -- 172.21.15.170:0/2496631685 learned_addr learned my addr 172.21.15.170:0/2496631685 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:43:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7fedde12f640 1 --2- 172.21.15.170:0/2496631685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fedd8101930 0x7fedd819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:54.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7feddd92e640 1 -- 172.21.15.170:0/2496631685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fedd8101930 msgr2=0x7fedd819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:54.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7feddd92e640 1 --2- 172.21.15.170:0/2496631685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fedd8101930 0x7fedd819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:54.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7feddd92e640 1 -- 172.21.15.170:0/2496631685 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd8197810 con 0x7fedd8107930 2024-09-04T16:43:54.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7feddd92e640 1 --2- 172.21.15.170:0/2496631685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd8107930 0x7fedd819dbd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00ea30 tx=0x7fedcc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:54.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7fedd77fe640 1 -- 172.21.15.170:0/2496631685 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedcc00cbe0 con 0x7fedd8107930 2024-09-04T16:43:54.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7fede0393640 1 -- 172.21.15.170:0/2496631685 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd8197b00 con 0x7fedd8107930 2024-09-04T16:43:54.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7fedd77fe640 1 -- 172.21.15.170:0/2496631685 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fedcc00cd80 con 0x7fedd8107930 2024-09-04T16:43:54.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7fedd77fe640 1 -- 172.21.15.170:0/2496631685 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedcc01a920 con 0x7fedd8107930 2024-09-04T16:43:54.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.935+0000 7fede0393640 1 -- 172.21.15.170:0/2496631685 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd8198090 con 0x7fedd8107930 2024-09-04T16:43:54.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.937+0000 7fede0393640 1 -- 172.21.15.170:0/2496631685 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd8103070 con 0x7fedd8107930 2024-09-04T16:43:54.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.937+0000 7fedd77fe640 1 -- 172.21.15.170:0/2496631685 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fedcc01abd0 con 0x7fedd8107930 2024-09-04T16:43:54.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.938+0000 7fedd77fe640 1 --2- 172.21.15.170:0/2496631685 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fedc0079e30 0x7fedc007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:54.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.938+0000 7fedd77fe640 1 -- 172.21.15.170:0/2496631685 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fedcc09d0f0 con 0x7fedd8107930 2024-09-04T16:43:54.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.938+0000 7fedde12f640 1 --2- 172.21.15.170:0/2496631685 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fedc0079e30 0x7fedc007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:54.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.938+0000 7fedde12f640 1 --2- 172.21.15.170:0/2496631685 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fedc0079e30 0x7fedc007c2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fedc80096c0 tx=0x7fedc8031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:54.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:54.942+0000 7fedd77fe640 1 -- 172.21.15.170:0/2496631685 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fedcc016030 con 0x7fedd8107930 2024-09-04T16:43:55.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.134+0000 7fede0393640 1 -- 172.21.15.170:0/2496631685 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fedd8198400 con 0x7fedc0079e30 2024-09-04T16:43:55.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.135+0000 7fedd77fe640 1 -- 172.21.15.170:0/2496631685 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fedd8198400 con 0x7fedc0079e30 2024-09-04T16:43:55.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.137+0000 7fede0393640 1 -- 172.21.15.170:0/2496631685 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fedc0079e30 msgr2=0x7fedc007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:55.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.137+0000 7fede0393640 1 --2- 172.21.15.170:0/2496631685 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fedc0079e30 0x7fedc007c2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fedc80096c0 tx=0x7fedc8031400 comp rx=0 tx=0).stop 2024-09-04T16:43:55.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.137+0000 7fede0393640 1 -- 172.21.15.170:0/2496631685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd8107930 msgr2=0x7fedd819dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:55.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.137+0000 7fede0393640 1 --2- 172.21.15.170:0/2496631685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd8107930 0x7fedd819dbd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00ea30 tx=0x7fedcc00eef0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.137+0000 7fede0393640 1 -- 172.21.15.170:0/2496631685 shutdown_connections 2024-09-04T16:43:55.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.137+0000 7fede0393640 1 --2- 172.21.15.170:0/2496631685 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fedc0079e30 0x7fedc007c2f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.137+0000 7fede0393640 1 --2- 172.21.15.170:0/2496631685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd8107930 0x7fedd819dbd0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.137+0000 7fede0393640 1 --2- 172.21.15.170:0/2496631685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fedd8101930 0x7fedd819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.137+0000 7fede0393640 1 -- 172.21.15.170:0/2496631685 >> 172.21.15.170:0/2496631685 conn(0x7fedd80fd630 msgr2=0x7fedd80fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:55.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.137+0000 7fede0393640 1 -- 172.21.15.170:0/2496631685 shutdown_connections 2024-09-04T16:43:55.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.138+0000 7fede0393640 1 -- 172.21.15.170:0/2496631685 wait complete. 2024-09-04T16:43:55.147 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:43:55.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.222+0000 7fdacd90b640 1 -- 172.21.15.170:0/3815380289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdac8102ae0 msgr2=0x7fdac8102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:55.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.222+0000 7fdacd90b640 1 --2- 172.21.15.170:0/3815380289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdac8102ae0 0x7fdac8102ec0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdab8009880 tx=0x7fdab802a530 comp rx=0 tx=0).stop 2024-09-04T16:43:55.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.222+0000 7fdacd90b640 1 -- 172.21.15.170:0/3815380289 shutdown_connections 2024-09-04T16:43:55.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.222+0000 7fdacd90b640 1 --2- 172.21.15.170:0/3815380289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdac8103400 0x7fdac810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.222+0000 7fdacd90b640 1 --2- 172.21.15.170:0/3815380289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdac8102ae0 0x7fdac8102ec0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.222+0000 7fdacd90b640 1 -- 172.21.15.170:0/3815380289 >> 172.21.15.170:0/3815380289 conn(0x7fdac80fc520 msgr2=0x7fdac80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:55.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.222+0000 7fdacd90b640 1 -- 172.21.15.170:0/3815380289 shutdown_connections 2024-09-04T16:43:55.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.222+0000 7fdacd90b640 1 -- 172.21.15.170:0/3815380289 wait complete. 2024-09-04T16:43:55.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.223+0000 7fdacd90b640 1 Processor -- start 2024-09-04T16:43:55.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.223+0000 7fdacd90b640 1 -- start start 2024-09-04T16:43:55.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.223+0000 7fdacd90b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdac8102ae0 0x7fdac8100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:55.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.223+0000 7fdacd90b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdac8103400 0x7fdac8100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:55.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.223+0000 7fdacd90b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdac810ee10 con 0x7fdac8103400 2024-09-04T16:43:55.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.223+0000 7fdacd90b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdac810ec90 con 0x7fdac8102ae0 2024-09-04T16:43:55.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.223+0000 7fdac67fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdac8103400 0x7fdac8100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:55.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.223+0000 7fdac67fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdac8103400 0x7fdac8100c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42608/0 (socket says 172.21.15.170:42608) 2024-09-04T16:43:55.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.223+0000 7fdac67fc640 1 -- 172.21.15.170:0/1407903814 learned_addr learned my addr 172.21.15.170:0/1407903814 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:43:55.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.223+0000 7fdac6ffd640 1 --2- 172.21.15.170:0/1407903814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdac8102ae0 0x7fdac8100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:55.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.224+0000 7fdac67fc640 1 -- 172.21.15.170:0/1407903814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdac8102ae0 msgr2=0x7fdac8100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:55.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.224+0000 7fdac67fc640 1 --2- 172.21.15.170:0/1407903814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdac8102ae0 0x7fdac8100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.224+0000 7fdac67fc640 1 -- 172.21.15.170:0/1407903814 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac81011c0 con 0x7fdac8103400 2024-09-04T16:43:55.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.224+0000 7fdac67fc640 1 --2- 172.21.15.170:0/1407903814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdac8103400 0x7fdac8100c80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00d6d0 tx=0x7fdabc00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:55.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.224+0000 7fdacc909640 1 -- 172.21.15.170:0/1407903814 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdabc017070 con 0x7fdac8103400 2024-09-04T16:43:55.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.224+0000 7fdacd90b640 1 -- 172.21.15.170:0/1407903814 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac81014b0 con 0x7fdac8103400 2024-09-04T16:43:55.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.224+0000 7fdacc909640 1 -- 172.21.15.170:0/1407903814 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdabc0054e0 con 0x7fdac8103400 2024-09-04T16:43:55.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.224+0000 7fdacc909640 1 -- 172.21.15.170:0/1407903814 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdabc004ae0 con 0x7fdac8103400 2024-09-04T16:43:55.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.224+0000 7fdacd90b640 1 -- 172.21.15.170:0/1407903814 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac81a3e80 con 0x7fdac8103400 2024-09-04T16:43:55.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.226+0000 7fdacd90b640 1 -- 172.21.15.170:0/1407903814 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdac806abe0 con 0x7fdac8103400 2024-09-04T16:43:55.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.226+0000 7fdacc909640 1 -- 172.21.15.170:0/1407903814 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fdabc004de0 con 0x7fdac8103400 2024-09-04T16:43:55.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.227+0000 7fdacc909640 1 --2- 172.21.15.170:0/1407903814 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdab0079e30 0x7fdab007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:55.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.227+0000 7fdac6ffd640 1 --2- 172.21.15.170:0/1407903814 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdab0079e30 0x7fdab007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:55.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.227+0000 7fdacc909640 1 -- 172.21.15.170:0/1407903814 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fdabc09c660 con 0x7fdac8103400 2024-09-04T16:43:55.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.228+0000 7fdac6ffd640 1 --2- 172.21.15.170:0/1407903814 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdab0079e30 0x7fdab007c2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdab80096c0 tx=0x7fdab8031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:55.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.232+0000 7fdacc909640 1 -- 172.21.15.170:0/1407903814 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdabc0681e0 con 0x7fdac8103400 2024-09-04T16:43:55.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.424+0000 7fdacd90b640 1 -- 172.21.15.170:0/1407903814 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fdac8062630 con 0x7fdab0079e30 2024-09-04T16:43:55.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.425+0000 7fdacc909640 1 -- 172.21.15.170:0/1407903814 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fdac8062630 con 0x7fdab0079e30 2024-09-04T16:43:55.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.427+0000 7fdacd90b640 1 -- 172.21.15.170:0/1407903814 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdab0079e30 msgr2=0x7fdab007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:55.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.427+0000 7fdacd90b640 1 --2- 172.21.15.170:0/1407903814 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdab0079e30 0x7fdab007c2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdab80096c0 tx=0x7fdab8031400 comp rx=0 tx=0).stop 2024-09-04T16:43:55.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.427+0000 7fdacd90b640 1 -- 172.21.15.170:0/1407903814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdac8103400 msgr2=0x7fdac8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:55.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.427+0000 7fdacd90b640 1 --2- 172.21.15.170:0/1407903814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdac8103400 0x7fdac8100c80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00d6d0 tx=0x7fdabc00db90 comp rx=0 tx=0).stop 2024-09-04T16:43:55.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.427+0000 7fdacd90b640 1 -- 172.21.15.170:0/1407903814 shutdown_connections 2024-09-04T16:43:55.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.427+0000 7fdacd90b640 1 --2- 172.21.15.170:0/1407903814 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdab0079e30 0x7fdab007c2f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.427+0000 7fdacd90b640 1 --2- 172.21.15.170:0/1407903814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdac8103400 0x7fdac8100c80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.427+0000 7fdacd90b640 1 --2- 172.21.15.170:0/1407903814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdac8102ae0 0x7fdac8100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.427+0000 7fdacd90b640 1 -- 172.21.15.170:0/1407903814 >> 172.21.15.170:0/1407903814 conn(0x7fdac80fc520 msgr2=0x7fdac8108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:55.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.427+0000 7fdacd90b640 1 -- 172.21.15.170:0/1407903814 shutdown_connections 2024-09-04T16:43:55.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.427+0000 7fdacd90b640 1 -- 172.21.15.170:0/1407903814 wait complete. 2024-09-04T16:43:55.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.508+0000 7f777553c640 1 -- 172.21.15.170:0/991858784 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77701007e0 msgr2=0x7f7770100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:55.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.508+0000 7f777553c640 1 --2- 172.21.15.170:0/991858784 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77701007e0 0x7f7770100c40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7764009880 tx=0x7f776402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.508+0000 7f777553c640 1 -- 172.21.15.170:0/991858784 shutdown_connections 2024-09-04T16:43:55.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.508+0000 7f777553c640 1 --2- 172.21.15.170:0/991858784 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77701007e0 0x7f7770100c40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.508+0000 7f777553c640 1 --2- 172.21.15.170:0/991858784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77701067e0 0x7f7770106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.508+0000 7f777553c640 1 -- 172.21.15.170:0/991858784 >> 172.21.15.170:0/991858784 conn(0x7f77700fc4c0 msgr2=0x7f77700fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:55.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.508+0000 7f777553c640 1 -- 172.21.15.170:0/991858784 shutdown_connections 2024-09-04T16:43:55.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.508+0000 7f777553c640 1 -- 172.21.15.170:0/991858784 wait complete. 2024-09-04T16:43:55.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.509+0000 7f777553c640 1 Processor -- start 2024-09-04T16:43:55.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.509+0000 7f777553c640 1 -- start start 2024-09-04T16:43:55.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.509+0000 7f777553c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77701007e0 0x7f77700fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:55.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.509+0000 7f777553c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77701067e0 0x7f77700fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:55.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.509+0000 7f777553c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f777010dd10 con 0x7f77701007e0 2024-09-04T16:43:55.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.509+0000 7f777553c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f777010db90 con 0x7f77701067e0 2024-09-04T16:43:55.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.510+0000 7f776effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77701007e0 0x7f77700fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:55.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.510+0000 7f776effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77701007e0 0x7f77700fcc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42630/0 (socket says 172.21.15.170:42630) 2024-09-04T16:43:55.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.510+0000 7f776effd640 1 -- 172.21.15.170:0/645723741 learned_addr learned my addr 172.21.15.170:0/645723741 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:43:55.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.510+0000 7f776e7fc640 1 --2- 172.21.15.170:0/645723741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77701067e0 0x7f77700fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:55.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.510+0000 7f776effd640 1 -- 172.21.15.170:0/645723741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77701067e0 msgr2=0x7f77700fd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:55.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.510+0000 7f776effd640 1 --2- 172.21.15.170:0/645723741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77701067e0 0x7f77700fd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.510+0000 7f776effd640 1 -- 172.21.15.170:0/645723741 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77700fd6c0 con 0x7f77701007e0 2024-09-04T16:43:55.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.510+0000 7f776e7fc640 1 --2- 172.21.15.170:0/645723741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77701067e0 0x7f77700fd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:43:55.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.510+0000 7f776effd640 1 --2- 172.21.15.170:0/645723741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77701007e0 0x7f77700fcc40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f776000ba50 tx=0x7f776000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:55.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.510+0000 7f7757fff640 1 -- 172.21.15.170:0/645723741 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7760019070 con 0x7f77701007e0 2024-09-04T16:43:55.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.510+0000 7f777553c640 1 -- 172.21.15.170:0/645723741 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77700fd9b0 con 0x7f77701007e0 2024-09-04T16:43:55.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.510+0000 7f7757fff640 1 -- 172.21.15.170:0/645723741 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f776000ce20 con 0x7f77701007e0 2024-09-04T16:43:55.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.510+0000 7f7757fff640 1 -- 172.21.15.170:0/645723741 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77600075a0 con 0x7f77701007e0 2024-09-04T16:43:55.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.510+0000 7f777553c640 1 -- 172.21.15.170:0/645723741 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77701a3ea0 con 0x7f77701007e0 2024-09-04T16:43:55.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.511+0000 7f777553c640 1 -- 172.21.15.170:0/645723741 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7770101f20 con 0x7f77701007e0 2024-09-04T16:43:55.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.512+0000 7f7757fff640 1 -- 172.21.15.170:0/645723741 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f776001c070 con 0x7f77701007e0 2024-09-04T16:43:55.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.513+0000 7f7757fff640 1 --2- 172.21.15.170:0/645723741 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7758079e30 0x7f775807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:55.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.513+0000 7f7757fff640 1 -- 172.21.15.170:0/645723741 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f776009c360 con 0x7f77701007e0 2024-09-04T16:43:55.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.513+0000 7f776e7fc640 1 --2- 172.21.15.170:0/645723741 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7758079e30 0x7f775807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:55.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.513+0000 7f776e7fc640 1 --2- 172.21.15.170:0/645723741 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7758079e30 0x7f775807c2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f77700fe6d0 tx=0x7f7764031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:55.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.517+0000 7f7757fff640 1 -- 172.21.15.170:0/645723741 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7760063d70 con 0x7f77701007e0 2024-09-04T16:43:55.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.700+0000 7f777553c640 1 -- 172.21.15.170:0/645723741 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7770062630 con 0x7f7758079e30 2024-09-04T16:43:55.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.709+0000 7f7757fff640 1 -- 172.21.15.170:0/645723741 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f7770062630 con 0x7f7758079e30 2024-09-04T16:43:55.710 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:43:55.710 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (10m) 5m ago 21m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:43:55.710 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (14m) 5m ago 21m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:43:55.710 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (13m) 4m ago 21m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:43:55.711 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (9m) 5m ago 21m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:43:55.711 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (8m) 4m ago 20m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:43:55.711 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (10m) 5m ago 21m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:43:55.711 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (5m) 5m ago 16m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:43:55.711 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (5m) 5m ago 16m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:43:55.711 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (4m) 4m ago 16m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:43:55.711 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (4m) 4m ago 16m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:43:55.711 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (13m) 5m ago 23m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:43:55.711 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (12m) 4m ago 20m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:43:55.711 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (9m) 5m ago 23m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:43:55.711 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (9m) 4m ago 20m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:43:55.711 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (11m) 5m ago 21m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:43:55.711 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (11m) 4m ago 20m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:43:55.712 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (8m) 5m ago 19m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:43:55.712 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (8m) 5m ago 19m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:43:55.712 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (7m) 5m ago 18m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:43:55.712 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (6m) 4m ago 18m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:43:55.712 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (6m) 4m ago 17m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:43:55.712 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (5m) 4m ago 17m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:43:55.712 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (11m) 5m ago 21m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:43:55.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.712+0000 7f777553c640 1 -- 172.21.15.170:0/645723741 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7758079e30 msgr2=0x7f775807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:55.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.712+0000 7f777553c640 1 --2- 172.21.15.170:0/645723741 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7758079e30 0x7f775807c2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f77700fe6d0 tx=0x7f7764031400 comp rx=0 tx=0).stop 2024-09-04T16:43:55.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.712+0000 7f777553c640 1 -- 172.21.15.170:0/645723741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77701007e0 msgr2=0x7f77700fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:55.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.712+0000 7f777553c640 1 --2- 172.21.15.170:0/645723741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77701007e0 0x7f77700fcc40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f776000ba50 tx=0x7f776000bf10 comp rx=0 tx=0).stop 2024-09-04T16:43:55.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.712+0000 7f777553c640 1 -- 172.21.15.170:0/645723741 shutdown_connections 2024-09-04T16:43:55.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.712+0000 7f777553c640 1 --2- 172.21.15.170:0/645723741 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7758079e30 0x7f775807c2f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.712+0000 7f777553c640 1 --2- 172.21.15.170:0/645723741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77701067e0 0x7f77700fd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.712+0000 7f777553c640 1 --2- 172.21.15.170:0/645723741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77701007e0 0x7f77700fcc40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.712+0000 7f777553c640 1 -- 172.21.15.170:0/645723741 >> 172.21.15.170:0/645723741 conn(0x7f77700fc4c0 msgr2=0x7f7770069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:55.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.712+0000 7f777553c640 1 -- 172.21.15.170:0/645723741 shutdown_connections 2024-09-04T16:43:55.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.712+0000 7f777553c640 1 -- 172.21.15.170:0/645723741 wait complete. 2024-09-04T16:43:55.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.792+0000 7f4518528640 1 -- 172.21.15.170:0/2537314068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510107930 msgr2=0x7f4510107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:55.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.792+0000 7f4518528640 1 --2- 172.21.15.170:0/2537314068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510107930 0x7f4510107d10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4500009880 tx=0x7f450002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.793+0000 7f4518528640 1 -- 172.21.15.170:0/2537314068 shutdown_connections 2024-09-04T16:43:55.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.793+0000 7f4518528640 1 --2- 172.21.15.170:0/2537314068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4510101930 0x7f4510101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.793+0000 7f4518528640 1 --2- 172.21.15.170:0/2537314068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510107930 0x7f4510107d10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.793+0000 7f4518528640 1 -- 172.21.15.170:0/2537314068 >> 172.21.15.170:0/2537314068 conn(0x7f45100fd630 msgr2=0x7f45100ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:55.794 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:55 smithi170 ceph-mon[113855]: pgmap v426: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:55.794 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:55 smithi170 ceph-mon[113855]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:43:55.795 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:55 smithi170 ceph-mon[113855]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:43:55.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.793+0000 7f4518528640 1 -- 172.21.15.170:0/2537314068 shutdown_connections 2024-09-04T16:43:55.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.793+0000 7f4518528640 1 -- 172.21.15.170:0/2537314068 wait complete. 2024-09-04T16:43:55.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.794+0000 7f4518528640 1 Processor -- start 2024-09-04T16:43:55.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.794+0000 7f4518528640 1 -- start start 2024-09-04T16:43:55.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.794+0000 7f4518528640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4510101930 0x7f451019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:55.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.794+0000 7f4518528640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510107930 0x7f451019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:55.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.794+0000 7f4518528640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f451010ee60 con 0x7f4510107930 2024-09-04T16:43:55.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.794+0000 7f4518528640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f451010ece0 con 0x7f4510101930 2024-09-04T16:43:55.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.794+0000 7f4515ac3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510107930 0x7f451019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:55.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.794+0000 7f4515ac3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510107930 0x7f451019dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42658/0 (socket says 172.21.15.170:42658) 2024-09-04T16:43:55.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.794+0000 7f4515ac3640 1 -- 172.21.15.170:0/1277652411 learned_addr learned my addr 172.21.15.170:0/1277652411 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:43:55.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.794+0000 7f45162c4640 1 --2- 172.21.15.170:0/1277652411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4510101930 0x7f451019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:55.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.794+0000 7f4515ac3640 1 -- 172.21.15.170:0/1277652411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4510101930 msgr2=0x7f451019d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:55.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.794+0000 7f4515ac3640 1 --2- 172.21.15.170:0/1277652411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4510101930 0x7f451019d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:55.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.794+0000 7f4515ac3640 1 -- 172.21.15.170:0/1277652411 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4510197870 con 0x7f4510107930 2024-09-04T16:43:55.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.795+0000 7f4515ac3640 1 --2- 172.21.15.170:0/1277652411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510107930 0x7f451019dbf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f450400ba50 tx=0x7f450400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:55.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.795+0000 7f450f7fe640 1 -- 172.21.15.170:0/1277652411 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4504019070 con 0x7f4510107930 2024-09-04T16:43:55.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.795+0000 7f4518528640 1 -- 172.21.15.170:0/1277652411 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4510197b60 con 0x7f4510107930 2024-09-04T16:43:55.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.795+0000 7f450f7fe640 1 -- 172.21.15.170:0/1277652411 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f450400ce20 con 0x7f4510107930 2024-09-04T16:43:55.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.795+0000 7f450f7fe640 1 -- 172.21.15.170:0/1277652411 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f45040075a0 con 0x7f4510107930 2024-09-04T16:43:55.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.795+0000 7f4518528640 1 -- 172.21.15.170:0/1277652411 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45101980f0 con 0x7f4510107930 2024-09-04T16:43:55.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.796+0000 7f4518528640 1 -- 172.21.15.170:0/1277652411 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4510103070 con 0x7f4510107930 2024-09-04T16:43:55.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.796+0000 7f450f7fe640 1 -- 172.21.15.170:0/1277652411 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f450401c070 con 0x7f4510107930 2024-09-04T16:43:55.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.797+0000 7f450f7fe640 1 --2- 172.21.15.170:0/1277652411 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f44f8079e30 0x7f44f807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:55.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.797+0000 7f450f7fe640 1 -- 172.21.15.170:0/1277652411 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f450409c3a0 con 0x7f4510107930 2024-09-04T16:43:55.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.797+0000 7f45162c4640 1 --2- 172.21.15.170:0/1277652411 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f44f8079e30 0x7f44f807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:55.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.798+0000 7f45162c4640 1 --2- 172.21.15.170:0/1277652411 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f44f8079e30 0x7f44f807c2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4500000c00 tx=0x7f4500031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:55.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:55.801+0000 7f450f7fe640 1 -- 172.21.15.170:0/1277652411 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4504063db0 con 0x7f4510107930 2024-09-04T16:43:55.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:55 smithi193 ceph-mon[82547]: pgmap v426: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:55.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:55 smithi193 ceph-mon[82547]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:43:55.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:55 smithi193 ceph-mon[82547]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:43:56.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.042+0000 7f4518528640 1 -- 172.21.15.170:0/1277652411 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4510109ea0 con 0x7f4510107930 2024-09-04T16:43:56.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.043+0000 7f450f7fe640 1 -- 172.21.15.170:0/1277652411 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f450406c260 con 0x7f4510107930 2024-09-04T16:43:56.043 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:43:56.044 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:43:56.044 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:43:56.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:43:56.044 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:43:56.044 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:43:56.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:43:56.044 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:43:56.044 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:43:56.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:43:56.044 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:43:56.044 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:43:56.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:43:56.044 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:43:56.045 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:43:56.045 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:43:56.045 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:43:56.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.045+0000 7f4518528640 1 -- 172.21.15.170:0/1277652411 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f44f8079e30 msgr2=0x7f44f807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:56.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.045+0000 7f4518528640 1 --2- 172.21.15.170:0/1277652411 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f44f8079e30 0x7f44f807c2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4500000c00 tx=0x7f4500031400 comp rx=0 tx=0).stop 2024-09-04T16:43:56.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.045+0000 7f4518528640 1 -- 172.21.15.170:0/1277652411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510107930 msgr2=0x7f451019dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:56.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.045+0000 7f4518528640 1 --2- 172.21.15.170:0/1277652411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510107930 0x7f451019dbf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f450400ba50 tx=0x7f450400bf10 comp rx=0 tx=0).stop 2024-09-04T16:43:56.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.045+0000 7f4518528640 1 -- 172.21.15.170:0/1277652411 shutdown_connections 2024-09-04T16:43:56.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.045+0000 7f4518528640 1 --2- 172.21.15.170:0/1277652411 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f44f8079e30 0x7f44f807c2f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.045+0000 7f4518528640 1 --2- 172.21.15.170:0/1277652411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4510107930 0x7f451019dbf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.045+0000 7f4518528640 1 --2- 172.21.15.170:0/1277652411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4510101930 0x7f451019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.045+0000 7f4518528640 1 -- 172.21.15.170:0/1277652411 >> 172.21.15.170:0/1277652411 conn(0x7f45100fd630 msgr2=0x7f45100fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:56.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.045+0000 7f4518528640 1 -- 172.21.15.170:0/1277652411 shutdown_connections 2024-09-04T16:43:56.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.045+0000 7f4518528640 1 -- 172.21.15.170:0/1277652411 wait complete. 2024-09-04T16:43:56.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.127+0000 7f39979e7640 1 -- 172.21.15.170:0/2145384104 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3990106820 msgr2=0x7f3990106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:56.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.127+0000 7f39979e7640 1 --2- 172.21.15.170:0/2145384104 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3990106820 0x7f3990106c00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3980009880 tx=0x7f398002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.127+0000 7f39979e7640 1 -- 172.21.15.170:0/2145384104 shutdown_connections 2024-09-04T16:43:56.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.127+0000 7f39979e7640 1 --2- 172.21.15.170:0/2145384104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3990100820 0x7f3990100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.127+0000 7f39979e7640 1 --2- 172.21.15.170:0/2145384104 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3990106820 0x7f3990106c00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.127+0000 7f39979e7640 1 -- 172.21.15.170:0/2145384104 >> 172.21.15.170:0/2145384104 conn(0x7f39900fc520 msgr2=0x7f39900fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:56.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.127+0000 7f39979e7640 1 -- 172.21.15.170:0/2145384104 shutdown_connections 2024-09-04T16:43:56.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.127+0000 7f39979e7640 1 -- 172.21.15.170:0/2145384104 wait complete. 2024-09-04T16:43:56.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.128+0000 7f39979e7640 1 Processor -- start 2024-09-04T16:43:56.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.128+0000 7f39979e7640 1 -- start start 2024-09-04T16:43:56.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.128+0000 7f39979e7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3990100820 0x7f39901987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:56.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.128+0000 7f39979e7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3990106820 0x7f3990198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:56.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.128+0000 7f39979e7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f399010dcd0 con 0x7f3990100820 2024-09-04T16:43:56.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.128+0000 7f39979e7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f399010db50 con 0x7f3990106820 2024-09-04T16:43:56.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.128+0000 7f3995783640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3990100820 0x7f39901987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:56.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.128+0000 7f3995783640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3990100820 0x7f39901987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42674/0 (socket says 172.21.15.170:42674) 2024-09-04T16:43:56.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.128+0000 7f3995783640 1 -- 172.21.15.170:0/1720011666 learned_addr learned my addr 172.21.15.170:0/1720011666 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:43:56.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.128+0000 7f3994f82640 1 --2- 172.21.15.170:0/1720011666 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3990106820 0x7f3990198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:56.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.128+0000 7f3995783640 1 -- 172.21.15.170:0/1720011666 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3990106820 msgr2=0x7f3990198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:56.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.128+0000 7f3995783640 1 --2- 172.21.15.170:0/1720011666 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3990106820 0x7f3990198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.128+0000 7f3995783640 1 -- 172.21.15.170:0/1720011666 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3990199320 con 0x7f3990100820 2024-09-04T16:43:56.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.129+0000 7f3995783640 1 --2- 172.21.15.170:0/1720011666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3990100820 0x7f39901987e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3980031460 tx=0x7f39800045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:56.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.129+0000 7f39867fc640 1 -- 172.21.15.170:0/1720011666 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f398003f070 con 0x7f3990100820 2024-09-04T16:43:56.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.129+0000 7f39979e7640 1 -- 172.21.15.170:0/1720011666 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39901995b0 con 0x7f3990100820 2024-09-04T16:43:56.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.129+0000 7f39867fc640 1 -- 172.21.15.170:0/1720011666 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39800035f0 con 0x7f3990100820 2024-09-04T16:43:56.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.129+0000 7f39867fc640 1 -- 172.21.15.170:0/1720011666 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3980035030 con 0x7f3990100820 2024-09-04T16:43:56.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.129+0000 7f39979e7640 1 -- 172.21.15.170:0/1720011666 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39901a1b60 con 0x7f3990100820 2024-09-04T16:43:56.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.130+0000 7f39979e7640 1 -- 172.21.15.170:0/1720011666 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3990101f60 con 0x7f3990100820 2024-09-04T16:43:56.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.130+0000 7f39867fc640 1 -- 172.21.15.170:0/1720011666 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f3980042070 con 0x7f3990100820 2024-09-04T16:43:56.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.131+0000 7f39867fc640 1 --2- 172.21.15.170:0/1720011666 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f397c079e30 0x7f397c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:56.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.131+0000 7f3994f82640 1 --2- 172.21.15.170:0/1720011666 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f397c079e30 0x7f397c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:56.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.131+0000 7f39867fc640 1 -- 172.21.15.170:0/1720011666 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f39800bd460 con 0x7f3990100820 2024-09-04T16:43:56.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.132+0000 7f3994f82640 1 --2- 172.21.15.170:0/1720011666 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f397c079e30 0x7f397c07c2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f398c005fd0 tx=0x7f398c009470 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:56.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.135+0000 7f39867fc640 1 -- 172.21.15.170:0/1720011666 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3980084e70 con 0x7f3990100820 2024-09-04T16:43:56.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.345+0000 7f39979e7640 1 -- 172.21.15.170:0/1720011666 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3990103a30 con 0x7f3990100820 2024-09-04T16:43:56.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.346+0000 7f39867fc640 1 -- 172.21.15.170:0/1720011666 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7f3980088fe0 con 0x7f3990100820 2024-09-04T16:43:56.347 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:43:56.347 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:43:56.347 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:43:56.347 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:43:56.347 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:43:56.347 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:43:56.347 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:43:56.347 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:43:56.347 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:43:56.347 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:43:56.347 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:43:56.347 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:43:56.348 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:43:56.348 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:43:56.348 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:43:56.348 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:43:56.348 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:43:56.348 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:43:56.348 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:43:56.348 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:43:56.348 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:43:56.348 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:43:56.348 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:43:56.348 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:43:56.348 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:43:56.348 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:43:56.349 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:43:56.349 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:43:56.349 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:43:56.349 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:43:56.349 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:43:56.349 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:43:56.349 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:43:56.349 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:43:56.349 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:43:56.349 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:43:56.349 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:43:56.349 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:43:56.349 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:43:56.350 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:43:56.350 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:43:56.350 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:43:56.350 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:43:56.350 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:43:56.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.349+0000 7f39979e7640 1 -- 172.21.15.170:0/1720011666 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f397c079e30 msgr2=0x7f397c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:56.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.349+0000 7f39979e7640 1 --2- 172.21.15.170:0/1720011666 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f397c079e30 0x7f397c07c2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f398c005fd0 tx=0x7f398c009470 comp rx=0 tx=0).stop 2024-09-04T16:43:56.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.349+0000 7f39979e7640 1 -- 172.21.15.170:0/1720011666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3990100820 msgr2=0x7f39901987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:56.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.349+0000 7f39979e7640 1 --2- 172.21.15.170:0/1720011666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3990100820 0x7f39901987e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3980031460 tx=0x7f39800045e0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.349+0000 7f39979e7640 1 -- 172.21.15.170:0/1720011666 shutdown_connections 2024-09-04T16:43:56.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.349+0000 7f39979e7640 1 --2- 172.21.15.170:0/1720011666 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f397c079e30 0x7f397c07c2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.349+0000 7f39979e7640 1 --2- 172.21.15.170:0/1720011666 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3990106820 0x7f3990198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.349+0000 7f39979e7640 1 --2- 172.21.15.170:0/1720011666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3990100820 0x7f39901987e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.349+0000 7f39979e7640 1 -- 172.21.15.170:0/1720011666 >> 172.21.15.170:0/1720011666 conn(0x7f39900fc520 msgr2=0x7f39900fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:56.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.349+0000 7f39979e7640 1 -- 172.21.15.170:0/1720011666 shutdown_connections 2024-09-04T16:43:56.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.349+0000 7f39979e7640 1 -- 172.21.15.170:0/1720011666 wait complete. 2024-09-04T16:43:56.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.431+0000 7f47e7085640 1 -- 172.21.15.170:0/3623876409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47e01033f0 msgr2=0x7f47e010b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:56.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.431+0000 7f47e7085640 1 --2- 172.21.15.170:0/3623876409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47e01033f0 0x7f47e010b8e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009880 tx=0x7f47d002a530 comp rx=0 tx=0).stop 2024-09-04T16:43:56.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.432+0000 7f47e7085640 1 -- 172.21.15.170:0/3623876409 shutdown_connections 2024-09-04T16:43:56.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.432+0000 7f47e7085640 1 --2- 172.21.15.170:0/3623876409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47e01033f0 0x7f47e010b8e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.432+0000 7f47e7085640 1 --2- 172.21.15.170:0/3623876409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47e0102ad0 0x7f47e0102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.432+0000 7f47e7085640 1 -- 172.21.15.170:0/3623876409 >> 172.21.15.170:0/3623876409 conn(0x7f47e00fc510 msgr2=0x7f47e00fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:56.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.432+0000 7f47e7085640 1 -- 172.21.15.170:0/3623876409 shutdown_connections 2024-09-04T16:43:56.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.432+0000 7f47e7085640 1 -- 172.21.15.170:0/3623876409 wait complete. 2024-09-04T16:43:56.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.432+0000 7f47e7085640 1 Processor -- start 2024-09-04T16:43:56.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.432+0000 7f47e7085640 1 -- start start 2024-09-04T16:43:56.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.432+0000 7f47e7085640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47e0102ad0 0x7f47e019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:56.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.432+0000 7f47e7085640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47e01033f0 0x7f47e019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:56.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.432+0000 7f47e7085640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f47e010ee00 con 0x7f47e01033f0 2024-09-04T16:43:56.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.432+0000 7f47e7085640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f47e010ec80 con 0x7f47e0102ad0 2024-09-04T16:43:56.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.433+0000 7f47d7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47e01033f0 0x7f47e019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:56.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.433+0000 7f47d7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47e01033f0 0x7f47e019db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42706/0 (socket says 172.21.15.170:42706) 2024-09-04T16:43:56.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.433+0000 7f47d7fff640 1 -- 172.21.15.170:0/331901524 learned_addr learned my addr 172.21.15.170:0/331901524 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:43:56.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.433+0000 7f47e4e21640 1 --2- 172.21.15.170:0/331901524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47e0102ad0 0x7f47e019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:56.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.433+0000 7f47d7fff640 1 -- 172.21.15.170:0/331901524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47e0102ad0 msgr2=0x7f47e019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:56.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.433+0000 7f47d7fff640 1 --2- 172.21.15.170:0/331901524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47e0102ad0 0x7f47e019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.433+0000 7f47d7fff640 1 -- 172.21.15.170:0/331901524 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e01977d0 con 0x7f47e01033f0 2024-09-04T16:43:56.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.433+0000 7f47d7fff640 1 --2- 172.21.15.170:0/331901524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47e01033f0 0x7f47e019db90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f47d0031460 tx=0x7f47d00045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:56.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.433+0000 7f47d5ffb640 1 -- 172.21.15.170:0/331901524 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47d003f070 con 0x7f47e01033f0 2024-09-04T16:43:56.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.433+0000 7f47d5ffb640 1 -- 172.21.15.170:0/331901524 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f47d00035f0 con 0x7f47e01033f0 2024-09-04T16:43:56.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.433+0000 7f47e7085640 1 -- 172.21.15.170:0/331901524 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e0197a60 con 0x7f47e01033f0 2024-09-04T16:43:56.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.433+0000 7f47d5ffb640 1 -- 172.21.15.170:0/331901524 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47d0035030 con 0x7f47e01033f0 2024-09-04T16:43:56.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.434+0000 7f47e7085640 1 -- 172.21.15.170:0/331901524 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e0197f90 con 0x7f47e01033f0 2024-09-04T16:43:56.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.434+0000 7f47e7085640 1 -- 172.21.15.170:0/331901524 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47e006abe0 con 0x7f47e01033f0 2024-09-04T16:43:56.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.435+0000 7f47d5ffb640 1 -- 172.21.15.170:0/331901524 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f47d0042070 con 0x7f47e01033f0 2024-09-04T16:43:56.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.436+0000 7f47d5ffb640 1 --2- 172.21.15.170:0/331901524 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f47c8079e30 0x7f47c807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:56.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.436+0000 7f47d5ffb640 1 -- 172.21.15.170:0/331901524 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f47d00bd2e0 con 0x7f47e01033f0 2024-09-04T16:43:56.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.436+0000 7f47e4e21640 1 --2- 172.21.15.170:0/331901524 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f47c8079e30 0x7f47c807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:56.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.436+0000 7f47e4e21640 1 --2- 172.21.15.170:0/331901524 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f47c8079e30 0x7f47c807c2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009bd0 tx=0x7f47dc005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:56.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.440+0000 7f47d5ffb640 1 -- 172.21.15.170:0/331901524 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f47d0088e60 con 0x7f47e01033f0 2024-09-04T16:43:56.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:56 smithi170 ceph-mon[113855]: from='client.34622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:43:56.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:56 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1277652411' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:43:56.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:56 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1720011666' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:43:56.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.633+0000 7f47e7085640 1 -- 172.21.15.170:0/331901524 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f47e0198300 con 0x7f47c8079e30 2024-09-04T16:43:56.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.634+0000 7f47d5ffb640 1 -- 172.21.15.170:0/331901524 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f47e0198300 con 0x7f47c8079e30 2024-09-04T16:43:56.635 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:43:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:43:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:43:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:43:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:43:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:43:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:43:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:43:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:43:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:43:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:43:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:43:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:43:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:43:56.636 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:43:56.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.636+0000 7f47e7085640 1 -- 172.21.15.170:0/331901524 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f47c8079e30 msgr2=0x7f47c807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:56.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.636+0000 7f47e7085640 1 --2- 172.21.15.170:0/331901524 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f47c8079e30 0x7f47c807c2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009bd0 tx=0x7f47dc005f90 comp rx=0 tx=0).stop 2024-09-04T16:43:56.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.636+0000 7f47e7085640 1 -- 172.21.15.170:0/331901524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47e01033f0 msgr2=0x7f47e019db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:56.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.636+0000 7f47e7085640 1 --2- 172.21.15.170:0/331901524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47e01033f0 0x7f47e019db90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f47d0031460 tx=0x7f47d00045c0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.636+0000 7f47e7085640 1 -- 172.21.15.170:0/331901524 shutdown_connections 2024-09-04T16:43:56.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.636+0000 7f47e7085640 1 --2- 172.21.15.170:0/331901524 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f47c8079e30 0x7f47c807c2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.636+0000 7f47e7085640 1 --2- 172.21.15.170:0/331901524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47e01033f0 0x7f47e019db90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.636+0000 7f47e7085640 1 --2- 172.21.15.170:0/331901524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47e0102ad0 0x7f47e019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.636+0000 7f47e7085640 1 -- 172.21.15.170:0/331901524 >> 172.21.15.170:0/331901524 conn(0x7f47e00fc510 msgr2=0x7f47e0106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:56.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.636+0000 7f47e7085640 1 -- 172.21.15.170:0/331901524 shutdown_connections 2024-09-04T16:43:56.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.636+0000 7f47e7085640 1 -- 172.21.15.170:0/331901524 wait complete. 2024-09-04T16:43:56.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.717+0000 7f5f30535640 1 -- 172.21.15.170:0/2824310720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f28101930 msgr2=0x7f5f28101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:56.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.717+0000 7f5f30535640 1 --2- 172.21.15.170:0/2824310720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f28101930 0x7f5f28101d90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5f18009880 tx=0x7f5f1802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.717+0000 7f5f30535640 1 -- 172.21.15.170:0/2824310720 shutdown_connections 2024-09-04T16:43:56.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.717+0000 7f5f30535640 1 --2- 172.21.15.170:0/2824310720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f28101930 0x7f5f28101d90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.717+0000 7f5f30535640 1 --2- 172.21.15.170:0/2824310720 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f28107930 0x7f5f28107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.717+0000 7f5f30535640 1 -- 172.21.15.170:0/2824310720 >> 172.21.15.170:0/2824310720 conn(0x7f5f280fd630 msgr2=0x7f5f280ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:56.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.717+0000 7f5f30535640 1 -- 172.21.15.170:0/2824310720 shutdown_connections 2024-09-04T16:43:56.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.717+0000 7f5f30535640 1 -- 172.21.15.170:0/2824310720 wait complete. 2024-09-04T16:43:56.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.718+0000 7f5f30535640 1 Processor -- start 2024-09-04T16:43:56.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.718+0000 7f5f30535640 1 -- start start 2024-09-04T16:43:56.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.718+0000 7f5f30535640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f28101930 0x7f5f2819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:56.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.718+0000 7f5f30535640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f28107930 0x7f5f2819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:56.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.718+0000 7f5f30535640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2810ede0 con 0x7f5f28107930 2024-09-04T16:43:56.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.718+0000 7f5f30535640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2810ec60 con 0x7f5f28101930 2024-09-04T16:43:56.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.718+0000 7f5f2dad0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f28107930 0x7f5f2819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:56.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.718+0000 7f5f2dad0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f28107930 0x7f5f2819dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42722/0 (socket says 172.21.15.170:42722) 2024-09-04T16:43:56.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.718+0000 7f5f2dad0640 1 -- 172.21.15.170:0/2261892205 learned_addr learned my addr 172.21.15.170:0/2261892205 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:43:56.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.719+0000 7f5f2e2d1640 1 --2- 172.21.15.170:0/2261892205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f28101930 0x7f5f2819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:56.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.719+0000 7f5f2dad0640 1 -- 172.21.15.170:0/2261892205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f28101930 msgr2=0x7f5f2819d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:56.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.719+0000 7f5f2dad0640 1 --2- 172.21.15.170:0/2261892205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f28101930 0x7f5f2819d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.719+0000 7f5f2dad0640 1 -- 172.21.15.170:0/2261892205 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f28197850 con 0x7f5f28107930 2024-09-04T16:43:56.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.719+0000 7f5f2dad0640 1 --2- 172.21.15.170:0/2261892205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f28107930 0x7f5f2819dc10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5f18031460 tx=0x7f5f180045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:56.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.719+0000 7f5f1f7fe640 1 -- 172.21.15.170:0/2261892205 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f1803f070 con 0x7f5f28107930 2024-09-04T16:43:56.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.719+0000 7f5f1f7fe640 1 -- 172.21.15.170:0/2261892205 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f180035f0 con 0x7f5f28107930 2024-09-04T16:43:56.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.719+0000 7f5f30535640 1 -- 172.21.15.170:0/2261892205 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f28197ae0 con 0x7f5f28107930 2024-09-04T16:43:56.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.719+0000 7f5f1f7fe640 1 -- 172.21.15.170:0/2261892205 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f18035030 con 0x7f5f28107930 2024-09-04T16:43:56.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.719+0000 7f5f30535640 1 -- 172.21.15.170:0/2261892205 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f28198010 con 0x7f5f28107930 2024-09-04T16:43:56.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.720+0000 7f5f30535640 1 -- 172.21.15.170:0/2261892205 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f28103070 con 0x7f5f28107930 2024-09-04T16:43:56.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.721+0000 7f5f1f7fe640 1 -- 172.21.15.170:0/2261892205 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5f18042070 con 0x7f5f28107930 2024-09-04T16:43:56.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.722+0000 7f5f1f7fe640 1 --2- 172.21.15.170:0/2261892205 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f14079e30 0x7f5f1407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:43:56.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.722+0000 7f5f1f7fe640 1 -- 172.21.15.170:0/2261892205 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5f180bd3b0 con 0x7f5f28107930 2024-09-04T16:43:56.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.722+0000 7f5f2e2d1640 1 --2- 172.21.15.170:0/2261892205 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f14079e30 0x7f5f1407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:43:56.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.722+0000 7f5f2e2d1640 1 --2- 172.21.15.170:0/2261892205 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f14079e30 0x7f5f1407c2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5f24005d00 tx=0x7f5f2400b410 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:43:56.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.726+0000 7f5f1f7fe640 1 -- 172.21.15.170:0/2261892205 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5f18088f30 con 0x7f5f28107930 2024-09-04T16:43:56.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:56 smithi193 ceph-mon[82547]: from='client.34622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:43:56.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:56 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1277652411' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:43:56.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:56 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1720011666' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:43:56.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.971+0000 7f5f30535640 1 -- 172.21.15.170:0/2261892205 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f5f28198d80 con 0x7f5f28107930 2024-09-04T16:43:56.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.971+0000 7f5f1f7fe640 1 -- 172.21.15.170:0/2261892205 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f5f1808d950 con 0x7f5f28107930 2024-09-04T16:43:56.972 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:43:56.972 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:43:56.972 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:43:56.972 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:43:56.972 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:43:56.972 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:43:56.972 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:43:56.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.973+0000 7f5f30535640 1 -- 172.21.15.170:0/2261892205 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f14079e30 msgr2=0x7f5f1407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.974+0000 7f5f30535640 1 --2- 172.21.15.170:0/2261892205 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f14079e30 0x7f5f1407c2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5f24005d00 tx=0x7f5f2400b410 comp rx=0 tx=0).stop 2024-09-04T16:43:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.974+0000 7f5f30535640 1 -- 172.21.15.170:0/2261892205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f28107930 msgr2=0x7f5f2819dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:43:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.974+0000 7f5f30535640 1 --2- 172.21.15.170:0/2261892205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f28107930 0x7f5f2819dc10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5f18031460 tx=0x7f5f180045e0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.974+0000 7f5f30535640 1 -- 172.21.15.170:0/2261892205 shutdown_connections 2024-09-04T16:43:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.974+0000 7f5f30535640 1 --2- 172.21.15.170:0/2261892205 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5f14079e30 0x7f5f1407c2f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.974+0000 7f5f30535640 1 --2- 172.21.15.170:0/2261892205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f28107930 0x7f5f2819dc10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.974+0000 7f5f30535640 1 --2- 172.21.15.170:0/2261892205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f28101930 0x7f5f2819d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:43:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.974+0000 7f5f30535640 1 -- 172.21.15.170:0/2261892205 >> 172.21.15.170:0/2261892205 conn(0x7f5f280fd630 msgr2=0x7f5f280fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:43:56.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.974+0000 7f5f30535640 1 -- 172.21.15.170:0/2261892205 shutdown_connections 2024-09-04T16:43:56.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:43:56.974+0000 7f5f30535640 1 -- 172.21.15.170:0/2261892205 wait complete. 2024-09-04T16:43:57.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:57 smithi170 ceph-mon[113855]: pgmap v427: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:57.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:57 smithi170 ceph-mon[113855]: from='client.34634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:43:57.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:57 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2261892205' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:43:57.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:57 smithi193 ceph-mon[82547]: pgmap v427: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:57.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:57 smithi193 ceph-mon[82547]: from='client.34634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:43:57.909 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:57 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2261892205' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:43:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:59 smithi170 ceph-mon[113855]: pgmap v428: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:43:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:43:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:59 smithi193 ceph-mon[82547]: pgmap v428: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:43:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:43:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:44:01.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:01 smithi170 ceph-mon[113855]: pgmap v429: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:01.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:01 smithi193 ceph-mon[82547]: pgmap v429: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:03.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:03 smithi170 ceph-mon[113855]: pgmap v430: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:03.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:03 smithi193 ceph-mon[82547]: pgmap v430: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:05.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:05 smithi193 ceph-mon[82547]: pgmap v431: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:06.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:05 smithi170 ceph-mon[113855]: pgmap v431: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:07.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:07 smithi193 ceph-mon[82547]: pgmap v432: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:08.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:07 smithi170 ceph-mon[113855]: pgmap v432: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:09.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:09 smithi193 ceph-mon[82547]: pgmap v433: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:10.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:09 smithi170 ceph-mon[113855]: pgmap v433: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:11.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:11 smithi193 ceph-mon[82547]: pgmap v434: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:12.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:11 smithi170 ceph-mon[113855]: pgmap v434: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:13.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:13 smithi170 ceph-mon[113855]: pgmap v435: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:13.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:13 smithi193 ceph-mon[82547]: pgmap v435: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:14.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:44:15.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:44:15.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:15 smithi193 ceph-mon[82547]: pgmap v436: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:16.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:15 smithi170 ceph-mon[113855]: pgmap v436: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:17.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:17 smithi193 ceph-mon[82547]: pgmap v437: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:18.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:17 smithi170 ceph-mon[113855]: pgmap v437: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:19.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:19 smithi193 ceph-mon[82547]: pgmap v438: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:20.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:19 smithi170 ceph-mon[113855]: pgmap v438: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:21.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:21 smithi193 ceph-mon[82547]: pgmap v439: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:22.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:21 smithi170 ceph-mon[113855]: pgmap v439: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:23.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:23 smithi193 ceph-mon[82547]: pgmap v440: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:24.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:23 smithi170 ceph-mon[113855]: pgmap v440: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:25.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:25 smithi193 ceph-mon[82547]: pgmap v441: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:26.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:25 smithi170 ceph-mon[113855]: pgmap v441: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:27.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.068+0000 7fe72db0f640 1 -- 172.21.15.170:0/4236012023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe728103400 msgr2=0x7fe72810b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:27.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.068+0000 7fe72db0f640 1 --2- 172.21.15.170:0/4236012023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe728103400 0x7fe72810b8f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009880 tx=0x7fe71c02a530 comp rx=0 tx=0).stop 2024-09-04T16:44:27.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.068+0000 7fe72db0f640 1 -- 172.21.15.170:0/4236012023 shutdown_connections 2024-09-04T16:44:27.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.068+0000 7fe72db0f640 1 --2- 172.21.15.170:0/4236012023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe728103400 0x7fe72810b8f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.068+0000 7fe72db0f640 1 --2- 172.21.15.170:0/4236012023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe728102ae0 0x7fe728102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.068+0000 7fe72db0f640 1 -- 172.21.15.170:0/4236012023 >> 172.21.15.170:0/4236012023 conn(0x7fe7280fc520 msgr2=0x7fe7280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:27.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.068+0000 7fe72db0f640 1 -- 172.21.15.170:0/4236012023 shutdown_connections 2024-09-04T16:44:27.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.068+0000 7fe72db0f640 1 -- 172.21.15.170:0/4236012023 wait complete. 2024-09-04T16:44:27.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.069+0000 7fe72db0f640 1 Processor -- start 2024-09-04T16:44:27.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.069+0000 7fe72db0f640 1 -- start start 2024-09-04T16:44:27.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.070+0000 7fe72db0f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe728102ae0 0x7fe72819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:27.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.070+0000 7fe72db0f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe728103400 0x7fe72819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:27.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.070+0000 7fe72db0f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe72810edf0 con 0x7fe728103400 2024-09-04T16:44:27.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.070+0000 7fe72db0f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe72810ec70 con 0x7fe728102ae0 2024-09-04T16:44:27.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.070+0000 7fe726ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe728103400 0x7fe72819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:27.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.070+0000 7fe726ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe728103400 0x7fe72819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44010/0 (socket says 172.21.15.170:44010) 2024-09-04T16:44:27.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.070+0000 7fe726ffd640 1 -- 172.21.15.170:0/893582820 learned_addr learned my addr 172.21.15.170:0/893582820 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:44:27.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.070+0000 7fe7277fe640 1 --2- 172.21.15.170:0/893582820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe728102ae0 0x7fe72819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:27.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.070+0000 7fe726ffd640 1 -- 172.21.15.170:0/893582820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe728102ae0 msgr2=0x7fe72819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:27.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.070+0000 7fe726ffd640 1 --2- 172.21.15.170:0/893582820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe728102ae0 0x7fe72819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.070+0000 7fe726ffd640 1 -- 172.21.15.170:0/893582820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe728197800 con 0x7fe728103400 2024-09-04T16:44:27.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.070+0000 7fe7277fe640 1 --2- 172.21.15.170:0/893582820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe728102ae0 0x7fe72819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:44:27.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.070+0000 7fe726ffd640 1 --2- 172.21.15.170:0/893582820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe728103400 0x7fe72819dbc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe71c031460 tx=0x7fe71c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:27.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.071+0000 7fe724ff9640 1 -- 172.21.15.170:0/893582820 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe71c03f070 con 0x7fe728103400 2024-09-04T16:44:27.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.071+0000 7fe724ff9640 1 -- 172.21.15.170:0/893582820 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe71c004ac0 con 0x7fe728103400 2024-09-04T16:44:27.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.071+0000 7fe72db0f640 1 -- 172.21.15.170:0/893582820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe728197a90 con 0x7fe728103400 2024-09-04T16:44:27.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.071+0000 7fe724ff9640 1 -- 172.21.15.170:0/893582820 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe71c035030 con 0x7fe728103400 2024-09-04T16:44:27.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.071+0000 7fe72db0f640 1 -- 172.21.15.170:0/893582820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe728197fc0 con 0x7fe728103400 2024-09-04T16:44:27.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.072+0000 7fe72db0f640 1 -- 172.21.15.170:0/893582820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe72806abe0 con 0x7fe728103400 2024-09-04T16:44:27.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.072+0000 7fe724ff9640 1 -- 172.21.15.170:0/893582820 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fe71c042070 con 0x7fe728103400 2024-09-04T16:44:27.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.073+0000 7fe724ff9640 1 --2- 172.21.15.170:0/893582820 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe710079e30 0x7fe71007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:27.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.073+0000 7fe7277fe640 1 --2- 172.21.15.170:0/893582820 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe710079e30 0x7fe71007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:27.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.073+0000 7fe724ff9640 1 -- 172.21.15.170:0/893582820 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe71c0bd4b0 con 0x7fe728103400 2024-09-04T16:44:27.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.074+0000 7fe7277fe640 1 --2- 172.21.15.170:0/893582820 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe710079e30 0x7fe71007c2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe71800abe0 tx=0x7fe71800a5c0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:27.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.077+0000 7fe724ff9640 1 -- 172.21.15.170:0/893582820 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe71c084ec0 con 0x7fe728103400 2024-09-04T16:44:27.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.274+0000 7fe72db0f640 1 -- 172.21.15.170:0/893582820 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe728198330 con 0x7fe710079e30 2024-09-04T16:44:27.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.276+0000 7fe724ff9640 1 -- 172.21.15.170:0/893582820 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe728198330 con 0x7fe710079e30 2024-09-04T16:44:27.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.278+0000 7fe72db0f640 1 -- 172.21.15.170:0/893582820 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe710079e30 msgr2=0x7fe71007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:27.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.278+0000 7fe72db0f640 1 --2- 172.21.15.170:0/893582820 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe710079e30 0x7fe71007c2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe71800abe0 tx=0x7fe71800a5c0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.278+0000 7fe72db0f640 1 -- 172.21.15.170:0/893582820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe728103400 msgr2=0x7fe72819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:27.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.278+0000 7fe72db0f640 1 --2- 172.21.15.170:0/893582820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe728103400 0x7fe72819dbc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe71c031460 tx=0x7fe71c0046c0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.278+0000 7fe72db0f640 1 -- 172.21.15.170:0/893582820 shutdown_connections 2024-09-04T16:44:27.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.278+0000 7fe72db0f640 1 --2- 172.21.15.170:0/893582820 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe710079e30 0x7fe71007c2f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.278+0000 7fe72db0f640 1 --2- 172.21.15.170:0/893582820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe728103400 0x7fe72819dbc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.278+0000 7fe72db0f640 1 --2- 172.21.15.170:0/893582820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe728102ae0 0x7fe72819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.278+0000 7fe72db0f640 1 -- 172.21.15.170:0/893582820 >> 172.21.15.170:0/893582820 conn(0x7fe7280fc520 msgr2=0x7fe728108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:27.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.278+0000 7fe72db0f640 1 -- 172.21.15.170:0/893582820 shutdown_connections 2024-09-04T16:44:27.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.278+0000 7fe72db0f640 1 -- 172.21.15.170:0/893582820 wait complete. 2024-09-04T16:44:27.288 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:44:27.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.361+0000 7f5ce8fc6640 1 -- 172.21.15.170:0/155534074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce4101930 msgr2=0x7f5ce4101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:27.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.361+0000 7f5ce8fc6640 1 --2- 172.21.15.170:0/155534074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce4101930 0x7f5ce4101d90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009880 tx=0x7f5ccc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.361+0000 7f5ce8fc6640 1 -- 172.21.15.170:0/155534074 shutdown_connections 2024-09-04T16:44:27.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.361+0000 7f5ce8fc6640 1 --2- 172.21.15.170:0/155534074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce4101930 0x7f5ce4101d90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.361+0000 7f5ce8fc6640 1 --2- 172.21.15.170:0/155534074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ce4107930 0x7f5ce4107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.361+0000 7f5ce8fc6640 1 -- 172.21.15.170:0/155534074 >> 172.21.15.170:0/155534074 conn(0x7f5ce40fd630 msgr2=0x7f5ce40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:27.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.361+0000 7f5ce8fc6640 1 -- 172.21.15.170:0/155534074 shutdown_connections 2024-09-04T16:44:27.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.361+0000 7f5ce8fc6640 1 -- 172.21.15.170:0/155534074 wait complete. 2024-09-04T16:44:27.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.362+0000 7f5ce8fc6640 1 Processor -- start 2024-09-04T16:44:27.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.362+0000 7f5ce8fc6640 1 -- start start 2024-09-04T16:44:27.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.362+0000 7f5ce8fc6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce4101930 0x7f5ce40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:27.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.362+0000 7f5ce8fc6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ce4107930 0x7f5ce4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:27.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.362+0000 7f5ce8fc6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce410ee00 con 0x7f5ce4101930 2024-09-04T16:44:27.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.362+0000 7f5ce8fc6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce410ec80 con 0x7f5ce4107930 2024-09-04T16:44:27.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.362+0000 7f5ce259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce4101930 0x7f5ce40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:27.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.362+0000 7f5ce259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce4101930 0x7f5ce40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44034/0 (socket says 172.21.15.170:44034) 2024-09-04T16:44:27.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.362+0000 7f5ce259c640 1 -- 172.21.15.170:0/2832637309 learned_addr learned my addr 172.21.15.170:0/2832637309 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:44:27.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.363+0000 7f5cd9d9b640 1 --2- 172.21.15.170:0/2832637309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ce4107930 0x7f5ce4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:27.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.363+0000 7f5ce259c640 1 -- 172.21.15.170:0/2832637309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ce4107930 msgr2=0x7f5ce4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:27.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.363+0000 7f5ce259c640 1 --2- 172.21.15.170:0/2832637309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ce4107930 0x7f5ce4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.363+0000 7f5ce259c640 1 -- 172.21.15.170:0/2832637309 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce4074f70 con 0x7f5ce4101930 2024-09-04T16:44:27.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.363+0000 7f5ce259c640 1 --2- 172.21.15.170:0/2832637309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce4101930 0x7f5ce40744f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400d6f0 tx=0x7f5cd400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:27.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.363+0000 7f5cdbfff640 1 -- 172.21.15.170:0/2832637309 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5cd4017070 con 0x7f5ce4101930 2024-09-04T16:44:27.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.363+0000 7f5ce8fc6640 1 -- 172.21.15.170:0/2832637309 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce4075260 con 0x7f5ce4101930 2024-09-04T16:44:27.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.363+0000 7f5cdbfff640 1 -- 172.21.15.170:0/2832637309 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5cd400de00 con 0x7f5ce4101930 2024-09-04T16:44:27.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.363+0000 7f5cdbfff640 1 -- 172.21.15.170:0/2832637309 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5cd4004bb0 con 0x7f5ce4101930 2024-09-04T16:44:27.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.363+0000 7f5ce8fc6640 1 -- 172.21.15.170:0/2832637309 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce41a3e90 con 0x7f5ce4101930 2024-09-04T16:44:27.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.364+0000 7f5ce8fc6640 1 -- 172.21.15.170:0/2832637309 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce4103070 con 0x7f5ce4101930 2024-09-04T16:44:27.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.365+0000 7f5cdbfff640 1 -- 172.21.15.170:0/2832637309 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5cd4004e60 con 0x7f5ce4101930 2024-09-04T16:44:27.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.365+0000 7f5cdbfff640 1 --2- 172.21.15.170:0/2832637309 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5cd0079e30 0x7f5cd007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:27.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.365+0000 7f5cdbfff640 1 -- 172.21.15.170:0/2832637309 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5cd409c710 con 0x7f5ce4101930 2024-09-04T16:44:27.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.365+0000 7f5cd9d9b640 1 --2- 172.21.15.170:0/2832637309 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5cd0079e30 0x7f5cd007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:27.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.366+0000 7f5cd9d9b640 1 --2- 172.21.15.170:0/2832637309 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5cd0079e30 0x7f5cd007c2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4075f80 tx=0x7f5ccc031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:27.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.370+0000 7f5cdbfff640 1 -- 172.21.15.170:0/2832637309 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5cd4064120 con 0x7f5ce4101930 2024-09-04T16:44:27.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.560+0000 7f5ce8fc6640 1 -- 172.21.15.170:0/2832637309 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5ce4062630 con 0x7f5cd0079e30 2024-09-04T16:44:27.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.561+0000 7f5cdbfff640 1 -- 172.21.15.170:0/2832637309 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5ce4062630 con 0x7f5cd0079e30 2024-09-04T16:44:27.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.563+0000 7f5ce8fc6640 1 -- 172.21.15.170:0/2832637309 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5cd0079e30 msgr2=0x7f5cd007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:27.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.563+0000 7f5ce8fc6640 1 --2- 172.21.15.170:0/2832637309 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5cd0079e30 0x7f5cd007c2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4075f80 tx=0x7f5ccc031400 comp rx=0 tx=0).stop 2024-09-04T16:44:27.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.563+0000 7f5ce8fc6640 1 -- 172.21.15.170:0/2832637309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce4101930 msgr2=0x7f5ce40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:27.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.563+0000 7f5ce8fc6640 1 --2- 172.21.15.170:0/2832637309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce4101930 0x7f5ce40744f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400d6f0 tx=0x7f5cd400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.564+0000 7f5ce8fc6640 1 -- 172.21.15.170:0/2832637309 shutdown_connections 2024-09-04T16:44:27.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.564+0000 7f5ce8fc6640 1 --2- 172.21.15.170:0/2832637309 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5cd0079e30 0x7f5cd007c2f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.564+0000 7f5ce8fc6640 1 --2- 172.21.15.170:0/2832637309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ce4107930 0x7f5ce4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.564+0000 7f5ce8fc6640 1 --2- 172.21.15.170:0/2832637309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce4101930 0x7f5ce40744f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.564+0000 7f5ce8fc6640 1 -- 172.21.15.170:0/2832637309 >> 172.21.15.170:0/2832637309 conn(0x7f5ce40fd630 msgr2=0x7f5ce40fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:27.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.564+0000 7f5ce8fc6640 1 -- 172.21.15.170:0/2832637309 shutdown_connections 2024-09-04T16:44:27.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.564+0000 7f5ce8fc6640 1 -- 172.21.15.170:0/2832637309 wait complete. 2024-09-04T16:44:27.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.647+0000 7fe98c173640 1 -- 172.21.15.170:0/3332426273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9841007e0 msgr2=0x7fe984100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:27.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.647+0000 7fe98c173640 1 --2- 172.21.15.170:0/3332426273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9841007e0 0x7fe984100c40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe974009880 tx=0x7fe97402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.647+0000 7fe98c173640 1 -- 172.21.15.170:0/3332426273 shutdown_connections 2024-09-04T16:44:27.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.647+0000 7fe98c173640 1 --2- 172.21.15.170:0/3332426273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9841007e0 0x7fe984100c40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.647+0000 7fe98c173640 1 --2- 172.21.15.170:0/3332426273 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9841067e0 0x7fe984106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.647+0000 7fe98c173640 1 -- 172.21.15.170:0/3332426273 >> 172.21.15.170:0/3332426273 conn(0x7fe9840fc4c0 msgr2=0x7fe9840fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:27.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.647+0000 7fe98c173640 1 -- 172.21.15.170:0/3332426273 shutdown_connections 2024-09-04T16:44:27.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.647+0000 7fe98c173640 1 -- 172.21.15.170:0/3332426273 wait complete. 2024-09-04T16:44:27.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.648+0000 7fe98c173640 1 Processor -- start 2024-09-04T16:44:27.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.648+0000 7fe98c173640 1 -- start start 2024-09-04T16:44:27.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.648+0000 7fe98c173640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9841007e0 0x7fe9840fcc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:27.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.648+0000 7fe98c173640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9841067e0 0x7fe9840fd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:27.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.648+0000 7fe98c173640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe98410dc90 con 0x7fe9841067e0 2024-09-04T16:44:27.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.648+0000 7fe98c173640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe98410db10 con 0x7fe9841007e0 2024-09-04T16:44:27.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.648+0000 7fe98970e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9841067e0 0x7fe9840fd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:27.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.648+0000 7fe98970e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9841067e0 0x7fe9840fd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44048/0 (socket says 172.21.15.170:44048) 2024-09-04T16:44:27.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.648+0000 7fe98970e640 1 -- 172.21.15.170:0/3461042711 learned_addr learned my addr 172.21.15.170:0/3461042711 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:44:27.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.648+0000 7fe989f0f640 1 --2- 172.21.15.170:0/3461042711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9841007e0 0x7fe9840fcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:27.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.648+0000 7fe98970e640 1 -- 172.21.15.170:0/3461042711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9841007e0 msgr2=0x7fe9840fcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:27.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.648+0000 7fe98970e640 1 --2- 172.21.15.170:0/3461042711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9841007e0 0x7fe9840fcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.648+0000 7fe98970e640 1 -- 172.21.15.170:0/3461042711 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9840fd6b0 con 0x7fe9841067e0 2024-09-04T16:44:27.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.649+0000 7fe98970e640 1 --2- 172.21.15.170:0/3461042711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9841067e0 0x7fe9840fd170 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe974031460 tx=0x7fe9740045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:27.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.649+0000 7fe97affd640 1 -- 172.21.15.170:0/3461042711 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe97403f070 con 0x7fe9841067e0 2024-09-04T16:44:27.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.649+0000 7fe97affd640 1 -- 172.21.15.170:0/3461042711 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe9740035f0 con 0x7fe9841067e0 2024-09-04T16:44:27.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.649+0000 7fe98c173640 1 -- 172.21.15.170:0/3461042711 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9840fd940 con 0x7fe9841067e0 2024-09-04T16:44:27.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.649+0000 7fe97affd640 1 -- 172.21.15.170:0/3461042711 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe974035030 con 0x7fe9841067e0 2024-09-04T16:44:27.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.649+0000 7fe98c173640 1 -- 172.21.15.170:0/3461042711 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9841a3d60 con 0x7fe9841067e0 2024-09-04T16:44:27.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.650+0000 7fe98c173640 1 -- 172.21.15.170:0/3461042711 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe984101f20 con 0x7fe9841067e0 2024-09-04T16:44:27.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.651+0000 7fe97affd640 1 -- 172.21.15.170:0/3461042711 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fe974042070 con 0x7fe9841067e0 2024-09-04T16:44:27.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.651+0000 7fe97affd640 1 --2- 172.21.15.170:0/3461042711 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe970079e30 0x7fe97007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:27.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.651+0000 7fe97affd640 1 -- 172.21.15.170:0/3461042711 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe9740bd3b0 con 0x7fe9841067e0 2024-09-04T16:44:27.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.651+0000 7fe989f0f640 1 --2- 172.21.15.170:0/3461042711 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe970079e30 0x7fe97007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:27.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.652+0000 7fe989f0f640 1 --2- 172.21.15.170:0/3461042711 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe970079e30 0x7fe97007c2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe98000bbe0 tx=0x7fe98000b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:27.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.655+0000 7fe97affd640 1 -- 172.21.15.170:0/3461042711 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe974088f30 con 0x7fe9841067e0 2024-09-04T16:44:27.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.838+0000 7fe98c173640 1 -- 172.21.15.170:0/3461042711 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe984109df0 con 0x7fe970079e30 2024-09-04T16:44:27.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.847+0000 7fe97affd640 1 -- 172.21.15.170:0/3461042711 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fe980010c30 con 0x7fe970079e30 2024-09-04T16:44:27.848 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:44:27.848 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (11m) 5m ago 22m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:44:27.849 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (14m) 5m ago 22m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:44:27.849 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (14m) 5m ago 21m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:44:27.849 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (9m) 5m ago 22m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:44:27.849 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (9m) 5m ago 21m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:44:27.849 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (11m) 5m ago 22m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:44:27.849 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (5m) 5m ago 16m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:44:27.849 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (6m) 5m ago 17m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:44:27.849 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (5m) 5m ago 16m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:44:27.849 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (5m) 5m ago 16m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:44:27.849 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (13m) 5m ago 23m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:44:27.849 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (12m) 5m ago 21m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:44:27.849 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (10m) 5m ago 23m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:44:27.849 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (9m) 5m ago 21m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:44:27.849 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (12m) 5m ago 22m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:44:27.850 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (12m) 5m ago 21m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:44:27.850 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (9m) 5m ago 20m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:44:27.850 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (8m) 5m ago 19m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:44:27.850 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (7m) 5m ago 19m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:44:27.850 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (7m) 5m ago 18m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:44:27.850 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (6m) 5m ago 18m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:44:27.850 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (6m) 5m ago 18m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:44:27.850 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (11m) 5m ago 21m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:44:27.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.849+0000 7fe98c173640 1 -- 172.21.15.170:0/3461042711 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe970079e30 msgr2=0x7fe97007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:27.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.849+0000 7fe98c173640 1 --2- 172.21.15.170:0/3461042711 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe970079e30 0x7fe97007c2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe98000bbe0 tx=0x7fe98000b390 comp rx=0 tx=0).stop 2024-09-04T16:44:27.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.849+0000 7fe98c173640 1 -- 172.21.15.170:0/3461042711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9841067e0 msgr2=0x7fe9840fd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:27.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.849+0000 7fe98c173640 1 --2- 172.21.15.170:0/3461042711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9841067e0 0x7fe9840fd170 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe974031460 tx=0x7fe9740045e0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.849+0000 7fe98c173640 1 -- 172.21.15.170:0/3461042711 shutdown_connections 2024-09-04T16:44:27.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.849+0000 7fe98c173640 1 --2- 172.21.15.170:0/3461042711 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe970079e30 0x7fe97007c2f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.849+0000 7fe98c173640 1 --2- 172.21.15.170:0/3461042711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9841067e0 0x7fe9840fd170 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.849+0000 7fe98c173640 1 --2- 172.21.15.170:0/3461042711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9841007e0 0x7fe9840fcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.849+0000 7fe98c173640 1 -- 172.21.15.170:0/3461042711 >> 172.21.15.170:0/3461042711 conn(0x7fe9840fc4c0 msgr2=0x7fe984069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:27.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.849+0000 7fe98c173640 1 -- 172.21.15.170:0/3461042711 shutdown_connections 2024-09-04T16:44:27.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.850+0000 7fe98c173640 1 -- 172.21.15.170:0/3461042711 wait complete. 2024-09-04T16:44:27.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:27 smithi193 ceph-mon[82547]: pgmap v442: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:27.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:27 smithi193 ceph-mon[82547]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:44:27.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.930+0000 7ff488c0e640 1 -- 172.21.15.170:0/1263226095 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff484107930 msgr2=0x7ff484107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:27.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.930+0000 7ff488c0e640 1 --2- 172.21.15.170:0/1263226095 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff484107930 0x7ff484107d10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff478009c20 tx=0x7ff47802a970 comp rx=0 tx=0).stop 2024-09-04T16:44:27.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.930+0000 7ff488c0e640 1 -- 172.21.15.170:0/1263226095 shutdown_connections 2024-09-04T16:44:27.932 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:27 smithi170 ceph-mon[113855]: pgmap v442: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:27.932 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:27 smithi170 ceph-mon[113855]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:44:27.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.930+0000 7ff488c0e640 1 --2- 172.21.15.170:0/1263226095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff484101930 0x7ff484101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.930+0000 7ff488c0e640 1 --2- 172.21.15.170:0/1263226095 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff484107930 0x7ff484107d10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.930+0000 7ff488c0e640 1 -- 172.21.15.170:0/1263226095 >> 172.21.15.170:0/1263226095 conn(0x7ff4840fd630 msgr2=0x7ff4840ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:27.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.930+0000 7ff488c0e640 1 -- 172.21.15.170:0/1263226095 shutdown_connections 2024-09-04T16:44:27.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.930+0000 7ff488c0e640 1 -- 172.21.15.170:0/1263226095 wait complete. 2024-09-04T16:44:27.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.931+0000 7ff488c0e640 1 Processor -- start 2024-09-04T16:44:27.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.931+0000 7ff488c0e640 1 -- start start 2024-09-04T16:44:27.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.931+0000 7ff488c0e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff484101930 0x7ff48419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:27.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.931+0000 7ff488c0e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff484107930 0x7ff48419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:27.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.931+0000 7ff488c0e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff48410ede0 con 0x7ff484107930 2024-09-04T16:44:27.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.931+0000 7ff488c0e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff48410ec60 con 0x7ff484101930 2024-09-04T16:44:27.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.931+0000 7ff481d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff484107930 0x7ff48419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:27.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.932+0000 7ff481d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff484107930 0x7ff48419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44058/0 (socket says 172.21.15.170:44058) 2024-09-04T16:44:27.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.932+0000 7ff481d9b640 1 -- 172.21.15.170:0/2113159826 learned_addr learned my addr 172.21.15.170:0/2113159826 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:44:27.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.932+0000 7ff48259c640 1 --2- 172.21.15.170:0/2113159826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff484101930 0x7ff48419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:27.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.932+0000 7ff481d9b640 1 -- 172.21.15.170:0/2113159826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff484101930 msgr2=0x7ff48419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:27.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.932+0000 7ff481d9b640 1 --2- 172.21.15.170:0/2113159826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff484101930 0x7ff48419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:27.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.932+0000 7ff481d9b640 1 -- 172.21.15.170:0/2113159826 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4841977d0 con 0x7ff484107930 2024-09-04T16:44:27.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.932+0000 7ff481d9b640 1 --2- 172.21.15.170:0/2113159826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff484107930 0x7ff48419db90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff47400c8a0 tx=0x7ff47400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:27.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.932+0000 7ff4737fe640 1 -- 172.21.15.170:0/2113159826 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4740079b0 con 0x7ff484107930 2024-09-04T16:44:27.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.932+0000 7ff488c0e640 1 -- 172.21.15.170:0/2113159826 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff484197ac0 con 0x7ff484107930 2024-09-04T16:44:27.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.932+0000 7ff4737fe640 1 -- 172.21.15.170:0/2113159826 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff474007b50 con 0x7ff484107930 2024-09-04T16:44:27.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.932+0000 7ff4737fe640 1 -- 172.21.15.170:0/2113159826 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff474018700 con 0x7ff484107930 2024-09-04T16:44:27.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.932+0000 7ff488c0e640 1 -- 172.21.15.170:0/2113159826 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff484198050 con 0x7ff484107930 2024-09-04T16:44:27.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.934+0000 7ff488c0e640 1 -- 172.21.15.170:0/2113159826 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff484103070 con 0x7ff484107930 2024-09-04T16:44:27.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.934+0000 7ff4737fe640 1 -- 172.21.15.170:0/2113159826 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ff47400f450 con 0x7ff484107930 2024-09-04T16:44:27.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.934+0000 7ff4737fe640 1 --2- 172.21.15.170:0/2113159826 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff46c079e30 0x7ff46c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:27.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.935+0000 7ff4737fe640 1 -- 172.21.15.170:0/2113159826 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff47409ccf0 con 0x7ff484107930 2024-09-04T16:44:27.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.935+0000 7ff48259c640 1 --2- 172.21.15.170:0/2113159826 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff46c079e30 0x7ff46c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:27.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.935+0000 7ff48259c640 1 --2- 172.21.15.170:0/2113159826 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff46c079e30 0x7ff46c07c2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff478009430 tx=0x7ff47803c040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:27.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:27.939+0000 7ff4737fe640 1 -- 172.21.15.170:0/2113159826 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff474014030 con 0x7ff484107930 2024-09-04T16:44:28.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.183+0000 7ff488c0e640 1 -- 172.21.15.170:0/2113159826 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff484198d30 con 0x7ff484107930 2024-09-04T16:44:28.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.183+0000 7ff4737fe640 1 -- 172.21.15.170:0/2113159826 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7ff484198d30 con 0x7ff484107930 2024-09-04T16:44:28.186 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:44:28.186 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:44:28.186 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:44:28.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:44:28.186 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:44:28.186 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:44:28.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:44:28.186 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:44:28.186 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:44:28.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:44:28.186 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:44:28.186 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:44:28.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:44:28.187 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:44:28.187 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:44:28.187 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:44:28.187 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:44:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.186+0000 7ff488c0e640 1 -- 172.21.15.170:0/2113159826 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff46c079e30 msgr2=0x7ff46c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.186+0000 7ff488c0e640 1 --2- 172.21.15.170:0/2113159826 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff46c079e30 0x7ff46c07c2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff478009430 tx=0x7ff47803c040 comp rx=0 tx=0).stop 2024-09-04T16:44:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.186+0000 7ff488c0e640 1 -- 172.21.15.170:0/2113159826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff484107930 msgr2=0x7ff48419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.186+0000 7ff488c0e640 1 --2- 172.21.15.170:0/2113159826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff484107930 0x7ff48419db90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff47400c8a0 tx=0x7ff47400cd60 comp rx=0 tx=0).stop 2024-09-04T16:44:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.186+0000 7ff488c0e640 1 -- 172.21.15.170:0/2113159826 shutdown_connections 2024-09-04T16:44:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.186+0000 7ff488c0e640 1 --2- 172.21.15.170:0/2113159826 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff46c079e30 0x7ff46c07c2f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.186+0000 7ff488c0e640 1 --2- 172.21.15.170:0/2113159826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff484107930 0x7ff48419db90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.186+0000 7ff488c0e640 1 --2- 172.21.15.170:0/2113159826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff484101930 0x7ff48419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.186+0000 7ff488c0e640 1 -- 172.21.15.170:0/2113159826 >> 172.21.15.170:0/2113159826 conn(0x7ff4840fd630 msgr2=0x7ff4840fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.186+0000 7ff488c0e640 1 -- 172.21.15.170:0/2113159826 shutdown_connections 2024-09-04T16:44:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.186+0000 7ff488c0e640 1 -- 172.21.15.170:0/2113159826 wait complete. 2024-09-04T16:44:28.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.267+0000 7f92d577e640 1 -- 172.21.15.170:0/2399362313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92d0101930 msgr2=0x7f92d0101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:28.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.267+0000 7f92d577e640 1 --2- 172.21.15.170:0/2399362313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92d0101930 0x7f92d0101d90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f92c4009880 tx=0x7f92c402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.267+0000 7f92d577e640 1 -- 172.21.15.170:0/2399362313 shutdown_connections 2024-09-04T16:44:28.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.267+0000 7f92d577e640 1 --2- 172.21.15.170:0/2399362313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92d0101930 0x7f92d0101d90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.267+0000 7f92d577e640 1 --2- 172.21.15.170:0/2399362313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92d0107930 0x7f92d0107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.267+0000 7f92d577e640 1 -- 172.21.15.170:0/2399362313 >> 172.21.15.170:0/2399362313 conn(0x7f92d00fd630 msgr2=0x7f92d00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:28.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.267+0000 7f92d577e640 1 -- 172.21.15.170:0/2399362313 shutdown_connections 2024-09-04T16:44:28.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.267+0000 7f92d577e640 1 -- 172.21.15.170:0/2399362313 wait complete. 2024-09-04T16:44:28.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.268+0000 7f92d577e640 1 Processor -- start 2024-09-04T16:44:28.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.268+0000 7f92d577e640 1 -- start start 2024-09-04T16:44:28.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.268+0000 7f92d577e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92d0101930 0x7f92d00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:28.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.268+0000 7f92d577e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92d0107930 0x7f92d0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:28.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.268+0000 7f92d577e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f92d010ede0 con 0x7f92d0107930 2024-09-04T16:44:28.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.268+0000 7f92d577e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f92d010ec60 con 0x7f92d0101930 2024-09-04T16:44:28.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.268+0000 7f92ce7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92d0107930 0x7f92d0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:28.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.268+0000 7f92ce7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92d0107930 0x7f92d0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44072/0 (socket says 172.21.15.170:44072) 2024-09-04T16:44:28.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.268+0000 7f92ce7fc640 1 -- 172.21.15.170:0/617933937 learned_addr learned my addr 172.21.15.170:0/617933937 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:44:28.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.268+0000 7f92ceffd640 1 --2- 172.21.15.170:0/617933937 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92d0101930 0x7f92d00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:28.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.268+0000 7f92ce7fc640 1 -- 172.21.15.170:0/617933937 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92d0101930 msgr2=0x7f92d00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:28.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.268+0000 7f92ce7fc640 1 --2- 172.21.15.170:0/617933937 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92d0101930 0x7f92d00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.268+0000 7f92ce7fc640 1 -- 172.21.15.170:0/617933937 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d0074f70 con 0x7f92d0107930 2024-09-04T16:44:28.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.268+0000 7f92ceffd640 1 --2- 172.21.15.170:0/617933937 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92d0101930 0x7f92d00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:44:28.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.269+0000 7f92ce7fc640 1 --2- 172.21.15.170:0/617933937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92d0107930 0x7f92d0074a30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f92c4031460 tx=0x7f92c40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:28.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.269+0000 7f92b7fff640 1 -- 172.21.15.170:0/617933937 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f92c403f070 con 0x7f92d0107930 2024-09-04T16:44:28.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.269+0000 7f92d577e640 1 -- 172.21.15.170:0/617933937 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d0075200 con 0x7f92d0107930 2024-09-04T16:44:28.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.269+0000 7f92b7fff640 1 -- 172.21.15.170:0/617933937 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f92c40044d0 con 0x7f92d0107930 2024-09-04T16:44:28.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.269+0000 7f92b7fff640 1 -- 172.21.15.170:0/617933937 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f92c4035030 con 0x7f92d0107930 2024-09-04T16:44:28.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.269+0000 7f92d577e640 1 -- 172.21.15.170:0/617933937 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d01a3dc0 con 0x7f92d0107930 2024-09-04T16:44:28.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.270+0000 7f92d577e640 1 -- 172.21.15.170:0/617933937 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d0103070 con 0x7f92d0107930 2024-09-04T16:44:28.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.271+0000 7f92b7fff640 1 -- 172.21.15.170:0/617933937 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f92c4042070 con 0x7f92d0107930 2024-09-04T16:44:28.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.271+0000 7f92b7fff640 1 --2- 172.21.15.170:0/617933937 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f92b8079e40 0x7f92b807c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:28.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.271+0000 7f92b7fff640 1 -- 172.21.15.170:0/617933937 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f92c40bd5d0 con 0x7f92d0107930 2024-09-04T16:44:28.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.271+0000 7f92ceffd640 1 --2- 172.21.15.170:0/617933937 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f92b8079e40 0x7f92b807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:28.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.272+0000 7f92ceffd640 1 --2- 172.21.15.170:0/617933937 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f92b8079e40 0x7f92b807c300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f92c000baa0 tx=0x7f92c0005d90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:28.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.276+0000 7f92b7fff640 1 -- 172.21.15.170:0/617933937 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f92c4004cf0 con 0x7f92d0107930 2024-09-04T16:44:28.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.487+0000 7f92d577e640 1 -- 172.21.15.170:0/617933937 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f92d0109ec0 con 0x7f92d0107930 2024-09-04T16:44:28.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.487+0000 7f92b7fff640 1 -- 172.21.15.170:0/617933937 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7f92c4084fe0 con 0x7f92d0107930 2024-09-04T16:44:28.488 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:44:28.489 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:44:28.489 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:44:28.489 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:44:28.489 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:44:28.489 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:44:28.489 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:44:28.489 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:44:28.489 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:44:28.489 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:44:28.489 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:44:28.489 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:44:28.489 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:44:28.489 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:44:28.490 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:44:28.490 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:44:28.490 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:44:28.490 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:44:28.490 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:44:28.490 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:44:28.490 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:44:28.490 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:44:28.490 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:44:28.490 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:44:28.490 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:44:28.490 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:44:28.490 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:44:28.490 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:44:28.491 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:44:28.491 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:44:28.491 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:44:28.491 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:44:28.491 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:44:28.491 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:44:28.491 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:44:28.491 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:44:28.491 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:44:28.491 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:44:28.491 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:44:28.491 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:44:28.491 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:44:28.491 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:44:28.492 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:44:28.492 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:44:28.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.490+0000 7f92d577e640 1 -- 172.21.15.170:0/617933937 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f92b8079e40 msgr2=0x7f92b807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:28.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.490+0000 7f92d577e640 1 --2- 172.21.15.170:0/617933937 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f92b8079e40 0x7f92b807c300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f92c000baa0 tx=0x7f92c0005d90 comp rx=0 tx=0).stop 2024-09-04T16:44:28.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.490+0000 7f92d577e640 1 -- 172.21.15.170:0/617933937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92d0107930 msgr2=0x7f92d0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:28.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.490+0000 7f92d577e640 1 --2- 172.21.15.170:0/617933937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92d0107930 0x7f92d0074a30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f92c4031460 tx=0x7f92c40048f0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.490+0000 7f92d577e640 1 -- 172.21.15.170:0/617933937 shutdown_connections 2024-09-04T16:44:28.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.490+0000 7f92d577e640 1 --2- 172.21.15.170:0/617933937 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f92b8079e40 0x7f92b807c300 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.490+0000 7f92d577e640 1 --2- 172.21.15.170:0/617933937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92d0107930 0x7f92d0074a30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.490+0000 7f92d577e640 1 --2- 172.21.15.170:0/617933937 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92d0101930 0x7f92d00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.490+0000 7f92d577e640 1 -- 172.21.15.170:0/617933937 >> 172.21.15.170:0/617933937 conn(0x7f92d00fd630 msgr2=0x7f92d00fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:28.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.490+0000 7f92d577e640 1 -- 172.21.15.170:0/617933937 shutdown_connections 2024-09-04T16:44:28.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.490+0000 7f92d577e640 1 -- 172.21.15.170:0/617933937 wait complete. 2024-09-04T16:44:28.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.573+0000 7fcbfb70d640 1 -- 172.21.15.170:0/2587198598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbf41067e0 msgr2=0x7fcbf4106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:28.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.573+0000 7fcbfb70d640 1 --2- 172.21.15.170:0/2587198598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbf41067e0 0x7fcbf4106bc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009880 tx=0x7fcbf002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.573+0000 7fcbfb70d640 1 -- 172.21.15.170:0/2587198598 shutdown_connections 2024-09-04T16:44:28.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.573+0000 7fcbfb70d640 1 --2- 172.21.15.170:0/2587198598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcbf41007e0 0x7fcbf4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.573+0000 7fcbfb70d640 1 --2- 172.21.15.170:0/2587198598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbf41067e0 0x7fcbf4106bc0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.573+0000 7fcbfb70d640 1 -- 172.21.15.170:0/2587198598 >> 172.21.15.170:0/2587198598 conn(0x7fcbf40fc4c0 msgr2=0x7fcbf40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:28.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.573+0000 7fcbfb70d640 1 -- 172.21.15.170:0/2587198598 shutdown_connections 2024-09-04T16:44:28.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.573+0000 7fcbfb70d640 1 -- 172.21.15.170:0/2587198598 wait complete. 2024-09-04T16:44:28.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.573+0000 7fcbfb70d640 1 Processor -- start 2024-09-04T16:44:28.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.573+0000 7fcbfb70d640 1 -- start start 2024-09-04T16:44:28.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.574+0000 7fcbfb70d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcbf41007e0 0x7fcbf419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:28.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.574+0000 7fcbfb70d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbf41067e0 0x7fcbf419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:28.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.574+0000 7fcbfb70d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf410dcb0 con 0x7fcbf41067e0 2024-09-04T16:44:28.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.574+0000 7fcbfb70d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf410db30 con 0x7fcbf41007e0 2024-09-04T16:44:28.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.574+0000 7fcbf8ca8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbf41067e0 0x7fcbf419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:28.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.574+0000 7fcbf8ca8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbf41067e0 0x7fcbf419db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44084/0 (socket says 172.21.15.170:44084) 2024-09-04T16:44:28.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.574+0000 7fcbf8ca8640 1 -- 172.21.15.170:0/3678892046 learned_addr learned my addr 172.21.15.170:0/3678892046 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:44:28.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.574+0000 7fcbf94a9640 1 --2- 172.21.15.170:0/3678892046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcbf41007e0 0x7fcbf419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:28.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.574+0000 7fcbf8ca8640 1 -- 172.21.15.170:0/3678892046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcbf41007e0 msgr2=0x7fcbf419d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:28.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.574+0000 7fcbf8ca8640 1 --2- 172.21.15.170:0/3678892046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcbf41007e0 0x7fcbf419d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.574+0000 7fcbf8ca8640 1 -- 172.21.15.170:0/3678892046 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf4197790 con 0x7fcbf41067e0 2024-09-04T16:44:28.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.574+0000 7fcbf8ca8640 1 --2- 172.21.15.170:0/3678892046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbf41067e0 0x7fcbf419db50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400d6f0 tx=0x7fcbe400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:28.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.574+0000 7fcbea7fc640 1 -- 172.21.15.170:0/3678892046 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcbe4017070 con 0x7fcbf41067e0 2024-09-04T16:44:28.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.574+0000 7fcbea7fc640 1 -- 172.21.15.170:0/3678892046 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcbe400de00 con 0x7fcbf41067e0 2024-09-04T16:44:28.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.574+0000 7fcbfb70d640 1 -- 172.21.15.170:0/3678892046 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf4197a80 con 0x7fcbf41067e0 2024-09-04T16:44:28.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.575+0000 7fcbea7fc640 1 -- 172.21.15.170:0/3678892046 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcbe4004bb0 con 0x7fcbf41067e0 2024-09-04T16:44:28.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.575+0000 7fcbfb70d640 1 -- 172.21.15.170:0/3678892046 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf4198010 con 0x7fcbf41067e0 2024-09-04T16:44:28.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.575+0000 7fcbfb70d640 1 -- 172.21.15.170:0/3678892046 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf4101f20 con 0x7fcbf41067e0 2024-09-04T16:44:28.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.576+0000 7fcbea7fc640 1 -- 172.21.15.170:0/3678892046 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fcbe4004e60 con 0x7fcbf41067e0 2024-09-04T16:44:28.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.577+0000 7fcbea7fc640 1 --2- 172.21.15.170:0/3678892046 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcbe0079e30 0x7fcbe007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:28.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.577+0000 7fcbea7fc640 1 -- 172.21.15.170:0/3678892046 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fcbe409c610 con 0x7fcbf41067e0 2024-09-04T16:44:28.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.577+0000 7fcbf94a9640 1 --2- 172.21.15.170:0/3678892046 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcbe0079e30 0x7fcbe007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:28.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.577+0000 7fcbf94a9640 1 --2- 172.21.15.170:0/3678892046 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcbe0079e30 0x7fcbe007c2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00096c0 tx=0x7fcbf0031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:28.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.581+0000 7fcbea7fc640 1 -- 172.21.15.170:0/3678892046 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcbe4068190 con 0x7fcbf41067e0 2024-09-04T16:44:28.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.777+0000 7fcbfb70d640 1 -- 172.21.15.170:0/3678892046 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcbf41982c0 con 0x7fcbe0079e30 2024-09-04T16:44:28.778 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:28 smithi170 ceph-mon[113855]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:44:28.778 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:28 smithi170 ceph-mon[113855]: from='client.34650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:44:28.778 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:28 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2113159826' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:44:28.778 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:28 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/617933937' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:44:28.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.778+0000 7fcbea7fc640 1 -- 172.21.15.170:0/3678892046 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fcbf41982c0 con 0x7fcbe0079e30 2024-09-04T16:44:28.779 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:44:28.779 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:44:28.779 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:44:28.779 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:44:28.779 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:44:28.779 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:44:28.780 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:44:28.780 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:44:28.780 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:44:28.780 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:44:28.780 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:44:28.780 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:44:28.780 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:44:28.780 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:44:28.780 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:44:28.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.780+0000 7fcbfb70d640 1 -- 172.21.15.170:0/3678892046 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcbe0079e30 msgr2=0x7fcbe007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:28.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.780+0000 7fcbfb70d640 1 --2- 172.21.15.170:0/3678892046 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcbe0079e30 0x7fcbe007c2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00096c0 tx=0x7fcbf0031400 comp rx=0 tx=0).stop 2024-09-04T16:44:28.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.780+0000 7fcbfb70d640 1 -- 172.21.15.170:0/3678892046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbf41067e0 msgr2=0x7fcbf419db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:28.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.780+0000 7fcbfb70d640 1 --2- 172.21.15.170:0/3678892046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbf41067e0 0x7fcbf419db50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400d6f0 tx=0x7fcbe400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.781+0000 7fcbfb70d640 1 -- 172.21.15.170:0/3678892046 shutdown_connections 2024-09-04T16:44:28.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.781+0000 7fcbfb70d640 1 --2- 172.21.15.170:0/3678892046 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcbe0079e30 0x7fcbe007c2f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.781+0000 7fcbfb70d640 1 --2- 172.21.15.170:0/3678892046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbf41067e0 0x7fcbf419db50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.781+0000 7fcbfb70d640 1 --2- 172.21.15.170:0/3678892046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcbf41007e0 0x7fcbf419d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.781+0000 7fcbfb70d640 1 -- 172.21.15.170:0/3678892046 >> 172.21.15.170:0/3678892046 conn(0x7fcbf40fc4c0 msgr2=0x7fcbf4069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:28.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.781+0000 7fcbfb70d640 1 -- 172.21.15.170:0/3678892046 shutdown_connections 2024-09-04T16:44:28.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.781+0000 7fcbfb70d640 1 -- 172.21.15.170:0/3678892046 wait complete. 2024-09-04T16:44:28.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.864+0000 7f0425550640 1 -- 172.21.15.170:0/2471868510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0420100810 msgr2=0x7f0420100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:28.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.864+0000 7f0425550640 1 --2- 172.21.15.170:0/2471868510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0420100810 0x7f0420100c70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0410009880 tx=0x7f041002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.865+0000 7f0425550640 1 -- 172.21.15.170:0/2471868510 shutdown_connections 2024-09-04T16:44:28.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.865+0000 7f0425550640 1 --2- 172.21.15.170:0/2471868510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0420100810 0x7f0420100c70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.865+0000 7f0425550640 1 --2- 172.21.15.170:0/2471868510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0420106810 0x7f0420106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.865+0000 7f0425550640 1 -- 172.21.15.170:0/2471868510 >> 172.21.15.170:0/2471868510 conn(0x7f04200fc510 msgr2=0x7f04200fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:28.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.865+0000 7f0425550640 1 -- 172.21.15.170:0/2471868510 shutdown_connections 2024-09-04T16:44:28.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.865+0000 7f0425550640 1 -- 172.21.15.170:0/2471868510 wait complete. 2024-09-04T16:44:28.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.865+0000 7f0425550640 1 Processor -- start 2024-09-04T16:44:28.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.865+0000 7f0425550640 1 -- start start 2024-09-04T16:44:28.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f0425550640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0420100810 0x7f04200fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:28.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f0425550640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0420106810 0x7f04200fd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:28.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f0425550640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f042010dce0 con 0x7f0420100810 2024-09-04T16:44:28.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f0425550640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f042010db60 con 0x7f0420106810 2024-09-04T16:44:28.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f041effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0420100810 0x7f04200fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:28.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f041effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0420100810 0x7f04200fcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44104/0 (socket says 172.21.15.170:44104) 2024-09-04T16:44:28.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f041effd640 1 -- 172.21.15.170:0/738374036 learned_addr learned my addr 172.21.15.170:0/738374036 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:44:28.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f041e7fc640 1 --2- 172.21.15.170:0/738374036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0420106810 0x7f04200fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:28.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f041effd640 1 -- 172.21.15.170:0/738374036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0420106810 msgr2=0x7f04200fd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:28.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f041effd640 1 --2- 172.21.15.170:0/738374036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0420106810 0x7f04200fd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:28.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f041effd640 1 -- 172.21.15.170:0/738374036 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04200fd6d0 con 0x7f0420100810 2024-09-04T16:44:28.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f041effd640 1 --2- 172.21.15.170:0/738374036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0420100810 0x7f04200fcc50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f041400d6f0 tx=0x7f041400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:28.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f0407fff640 1 -- 172.21.15.170:0/738374036 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0414017070 con 0x7f0420100810 2024-09-04T16:44:28.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f0425550640 1 -- 172.21.15.170:0/738374036 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04200fd9c0 con 0x7f0420100810 2024-09-04T16:44:28.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f0407fff640 1 -- 172.21.15.170:0/738374036 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f041400de00 con 0x7f0420100810 2024-09-04T16:44:28.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f0407fff640 1 -- 172.21.15.170:0/738374036 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0414004bb0 con 0x7f0420100810 2024-09-04T16:44:28.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.866+0000 7f0425550640 1 -- 172.21.15.170:0/738374036 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04201a3e50 con 0x7f0420100810 2024-09-04T16:44:28.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.867+0000 7f0425550640 1 -- 172.21.15.170:0/738374036 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0420101f50 con 0x7f0420100810 2024-09-04T16:44:28.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.868+0000 7f0407fff640 1 -- 172.21.15.170:0/738374036 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f0414004e60 con 0x7f0420100810 2024-09-04T16:44:28.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.869+0000 7f0407fff640 1 --2- 172.21.15.170:0/738374036 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0408079e30 0x7f040807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:28.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.869+0000 7f0407fff640 1 -- 172.21.15.170:0/738374036 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f041409c680 con 0x7f0420100810 2024-09-04T16:44:28.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.869+0000 7f041e7fc640 1 --2- 172.21.15.170:0/738374036 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0408079e30 0x7f040807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:28.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.869+0000 7f041e7fc640 1 --2- 172.21.15.170:0/738374036 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0408079e30 0x7f040807c2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f04200fe6e0 tx=0x7f0410031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:28.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:28.873+0000 7f0407fff640 1 -- 172.21.15.170:0/738374036 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0414068200 con 0x7f0420100810 2024-09-04T16:44:28.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:28 smithi193 ceph-mon[82547]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:44:28.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:28 smithi193 ceph-mon[82547]: from='client.34650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:44:28.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:28 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2113159826' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:44:28.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:28 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/617933937' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:44:29.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:29.116+0000 7f0425550640 1 -- 172.21.15.170:0/738374036 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0420109d90 con 0x7f0420100810 2024-09-04T16:44:29.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:29.116+0000 7f0407fff640 1 -- 172.21.15.170:0/738374036 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f041406cc20 con 0x7f0420100810 2024-09-04T16:44:29.117 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:44:29.117 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:44:29.117 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:44:29.117 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:44:29.117 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:44:29.117 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:44:29.117 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:44:29.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:29.118+0000 7f0425550640 1 -- 172.21.15.170:0/738374036 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0408079e30 msgr2=0x7f040807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:29.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:29.118+0000 7f0425550640 1 --2- 172.21.15.170:0/738374036 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0408079e30 0x7f040807c2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f04200fe6e0 tx=0x7f0410031400 comp rx=0 tx=0).stop 2024-09-04T16:44:29.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:29.118+0000 7f0425550640 1 -- 172.21.15.170:0/738374036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0420100810 msgr2=0x7f04200fcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:29.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:29.118+0000 7f0425550640 1 --2- 172.21.15.170:0/738374036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0420100810 0x7f04200fcc50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f041400d6f0 tx=0x7f041400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:44:29.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:29.118+0000 7f0425550640 1 -- 172.21.15.170:0/738374036 shutdown_connections 2024-09-04T16:44:29.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:29.118+0000 7f0425550640 1 --2- 172.21.15.170:0/738374036 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0408079e30 0x7f040807c2f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:29.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:29.118+0000 7f0425550640 1 --2- 172.21.15.170:0/738374036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0420106810 0x7f04200fd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:29.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:29.118+0000 7f0425550640 1 --2- 172.21.15.170:0/738374036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0420100810 0x7f04200fcc50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:29.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:29.118+0000 7f0425550640 1 -- 172.21.15.170:0/738374036 >> 172.21.15.170:0/738374036 conn(0x7f04200fc510 msgr2=0x7f042006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:29.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:29.118+0000 7f0425550640 1 -- 172.21.15.170:0/738374036 shutdown_connections 2024-09-04T16:44:29.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:29.118+0000 7f0425550640 1 -- 172.21.15.170:0/738374036 wait complete. 2024-09-04T16:44:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:29 smithi193 ceph-mon[82547]: pgmap v443: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:29 smithi193 ceph-mon[82547]: from='client.34662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:44:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:29 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/738374036' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:44:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:44:30.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:29 smithi170 ceph-mon[113855]: pgmap v443: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:30.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:29 smithi170 ceph-mon[113855]: from='client.34662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:44:30.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:29 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/738374036' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:44:30.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:44:31.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:31 smithi193 ceph-mon[82547]: pgmap v444: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:32.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:31 smithi170 ceph-mon[113855]: pgmap v444: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:33.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:33 smithi193 ceph-mon[82547]: pgmap v445: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:34.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:33 smithi170 ceph-mon[113855]: pgmap v445: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:35.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:35 smithi193 ceph-mon[82547]: pgmap v446: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:36.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:35 smithi170 ceph-mon[113855]: pgmap v446: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:38.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:37 smithi170 ceph-mon[113855]: pgmap v447: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:38.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:37 smithi193 ceph-mon[82547]: pgmap v447: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:40.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:39 smithi170 ceph-mon[113855]: pgmap v448: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:40.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:39 smithi193 ceph-mon[82547]: pgmap v448: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:42.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:41 smithi170 ceph-mon[113855]: pgmap v449: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:42.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:41 smithi193 ceph-mon[82547]: pgmap v449: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:44.020 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:43 smithi170 ceph-mon[113855]: pgmap v450: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:44.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:43 smithi193 ceph-mon[82547]: pgmap v450: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:45.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:44:45.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:44:46.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:45 smithi170 ceph-mon[113855]: pgmap v451: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:46.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:45 smithi193 ceph-mon[82547]: pgmap v451: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:48.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:47 smithi170 ceph-mon[113855]: pgmap v452: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:48.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:47 smithi193 ceph-mon[82547]: pgmap v452: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:50.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:49 smithi170 ceph-mon[113855]: pgmap v453: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:50.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:49 smithi193 ceph-mon[82547]: pgmap v453: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:52.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:51 smithi170 ceph-mon[113855]: pgmap v454: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:52.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:51 smithi193 ceph-mon[82547]: pgmap v454: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:54.178 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:53 smithi170 ceph-mon[113855]: pgmap v455: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:54.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:53 smithi193 ceph-mon[82547]: pgmap v455: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:56.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:55 smithi170 ceph-mon[113855]: pgmap v456: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:56.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:55 smithi193 ceph-mon[82547]: pgmap v456: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:58.208 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:57 smithi193 ceph-mon[82547]: pgmap v457: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:58.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:57 smithi170 ceph-mon[113855]: pgmap v457: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:44:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.216+0000 7fcd196b5640 1 -- 172.21.15.170:0/424402206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd14106820 msgr2=0x7fcd14106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.216+0000 7fcd196b5640 1 --2- 172.21.15.170:0/424402206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd14106820 0x7fcd14106c00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009880 tx=0x7fcd0402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.216+0000 7fcd196b5640 1 -- 172.21.15.170:0/424402206 shutdown_connections 2024-09-04T16:44:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.216+0000 7fcd196b5640 1 --2- 172.21.15.170:0/424402206 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd14100820 0x7fcd14100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.216+0000 7fcd196b5640 1 --2- 172.21.15.170:0/424402206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd14106820 0x7fcd14106c00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.216+0000 7fcd196b5640 1 -- 172.21.15.170:0/424402206 >> 172.21.15.170:0/424402206 conn(0x7fcd140fc520 msgr2=0x7fcd140fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.216+0000 7fcd196b5640 1 -- 172.21.15.170:0/424402206 shutdown_connections 2024-09-04T16:44:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.216+0000 7fcd196b5640 1 -- 172.21.15.170:0/424402206 wait complete. 2024-09-04T16:44:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.217+0000 7fcd196b5640 1 Processor -- start 2024-09-04T16:44:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.217+0000 7fcd196b5640 1 -- start start 2024-09-04T16:44:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.217+0000 7fcd196b5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd14100820 0x7fcd140fcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.217+0000 7fcd196b5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd14106820 0x7fcd140fd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.217+0000 7fcd196b5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1410dcf0 con 0x7fcd14106820 2024-09-04T16:44:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.217+0000 7fcd196b5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1410db70 con 0x7fcd14100820 2024-09-04T16:44:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.218+0000 7fcd0a7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd14106820 0x7fcd140fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.218+0000 7fcd0a7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd14106820 0x7fcd140fd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53836/0 (socket says 172.21.15.170:53836) 2024-09-04T16:44:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.218+0000 7fcd0a7fc640 1 -- 172.21.15.170:0/823579373 learned_addr learned my addr 172.21.15.170:0/823579373 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:44:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.218+0000 7fcd12ffd640 1 --2- 172.21.15.170:0/823579373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd14100820 0x7fcd140fcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.218+0000 7fcd0a7fc640 1 -- 172.21.15.170:0/823579373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd14100820 msgr2=0x7fcd140fcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.218+0000 7fcd0a7fc640 1 --2- 172.21.15.170:0/823579373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd14100820 0x7fcd140fcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.218+0000 7fcd0a7fc640 1 -- 172.21.15.170:0/823579373 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd140fd680 con 0x7fcd14106820 2024-09-04T16:44:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.218+0000 7fcd0a7fc640 1 --2- 172.21.15.170:0/823579373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd14106820 0x7fcd140fd140 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00e970 tx=0x7fccfc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.218+0000 7fcd10ff9640 1 -- 172.21.15.170:0/823579373 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fccfc00cac0 con 0x7fcd14106820 2024-09-04T16:44:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.218+0000 7fcd196b5640 1 -- 172.21.15.170:0/823579373 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd140fd970 con 0x7fcd14106820 2024-09-04T16:44:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.218+0000 7fcd10ff9640 1 -- 172.21.15.170:0/823579373 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fccfc0054e0 con 0x7fcd14106820 2024-09-04T16:44:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.218+0000 7fcd10ff9640 1 -- 172.21.15.170:0/823579373 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fccfc010430 con 0x7fcd14106820 2024-09-04T16:44:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.219+0000 7fcd196b5640 1 -- 172.21.15.170:0/823579373 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd141a3e60 con 0x7fcd14106820 2024-09-04T16:44:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.220+0000 7fcd196b5640 1 -- 172.21.15.170:0/823579373 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd14101f60 con 0x7fcd14106820 2024-09-04T16:44:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.221+0000 7fcd10ff9640 1 -- 172.21.15.170:0/823579373 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fccfc004ee0 con 0x7fcd14106820 2024-09-04T16:44:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.221+0000 7fcd10ff9640 1 --2- 172.21.15.170:0/823579373 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd00079e30 0x7fcd0007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.221+0000 7fcd10ff9640 1 -- 172.21.15.170:0/823579373 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fccfc09d120 con 0x7fcd14106820 2024-09-04T16:44:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.221+0000 7fcd12ffd640 1 --2- 172.21.15.170:0/823579373 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd00079e30 0x7fcd0007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.222+0000 7fcd12ffd640 1 --2- 172.21.15.170:0/823579373 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd00079e30 0x7fcd0007c2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcd040096c0 tx=0x7fcd04031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:59.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.226+0000 7fcd10ff9640 1 -- 172.21.15.170:0/823579373 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fccfc064b30 con 0x7fcd14106820 2024-09-04T16:44:59.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.427+0000 7fcd196b5640 1 -- 172.21.15.170:0/823579373 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcd14062630 con 0x7fcd00079e30 2024-09-04T16:44:59.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.429+0000 7fcd10ff9640 1 -- 172.21.15.170:0/823579373 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fcd14062630 con 0x7fcd00079e30 2024-09-04T16:44:59.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.431+0000 7fcd196b5640 1 -- 172.21.15.170:0/823579373 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd00079e30 msgr2=0x7fcd0007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:59.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.431+0000 7fcd196b5640 1 --2- 172.21.15.170:0/823579373 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd00079e30 0x7fcd0007c2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcd040096c0 tx=0x7fcd04031400 comp rx=0 tx=0).stop 2024-09-04T16:44:59.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.431+0000 7fcd196b5640 1 -- 172.21.15.170:0/823579373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd14106820 msgr2=0x7fcd140fd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:59.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.431+0000 7fcd196b5640 1 --2- 172.21.15.170:0/823579373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd14106820 0x7fcd140fd140 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00e970 tx=0x7fccfc00ed70 comp rx=0 tx=0).stop 2024-09-04T16:44:59.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.431+0000 7fcd196b5640 1 -- 172.21.15.170:0/823579373 shutdown_connections 2024-09-04T16:44:59.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.431+0000 7fcd196b5640 1 --2- 172.21.15.170:0/823579373 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd00079e30 0x7fcd0007c2f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.431+0000 7fcd196b5640 1 --2- 172.21.15.170:0/823579373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd14106820 0x7fcd140fd140 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.431+0000 7fcd196b5640 1 --2- 172.21.15.170:0/823579373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd14100820 0x7fcd140fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.431+0000 7fcd196b5640 1 -- 172.21.15.170:0/823579373 >> 172.21.15.170:0/823579373 conn(0x7fcd140fc520 msgr2=0x7fcd1406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:59.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.431+0000 7fcd196b5640 1 -- 172.21.15.170:0/823579373 shutdown_connections 2024-09-04T16:44:59.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.431+0000 7fcd196b5640 1 -- 172.21.15.170:0/823579373 wait complete. 2024-09-04T16:44:59.441 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:44:59.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.513+0000 7f700ca9a640 1 -- 172.21.15.170:0/2100245457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 msgr2=0x7f7008101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.513+0000 7f700ca9a640 1 --2- 172.21.15.170:0/2100245457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 0x7f7008101d90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009880 tx=0x7f6ff002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.514+0000 7f700ca9a640 1 -- 172.21.15.170:0/2100245457 shutdown_connections 2024-09-04T16:44:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.514+0000 7f700ca9a640 1 --2- 172.21.15.170:0/2100245457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 0x7f7008101d90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.514+0000 7f700ca9a640 1 --2- 172.21.15.170:0/2100245457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7008107930 0x7f7008107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.514+0000 7f700ca9a640 1 -- 172.21.15.170:0/2100245457 >> 172.21.15.170:0/2100245457 conn(0x7f70080fd630 msgr2=0x7f70080ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.514+0000 7f700ca9a640 1 -- 172.21.15.170:0/2100245457 shutdown_connections 2024-09-04T16:44:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.514+0000 7f700ca9a640 1 -- 172.21.15.170:0/2100245457 wait complete. 2024-09-04T16:44:59.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.514+0000 7f700ca9a640 1 Processor -- start 2024-09-04T16:44:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.514+0000 7f700ca9a640 1 -- start start 2024-09-04T16:44:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.515+0000 7f700ca9a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 0x7f700819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.515+0000 7f700ca9a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7008107930 0x7f700819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.515+0000 7f700ca9a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f700810ee60 con 0x7f7008101930 2024-09-04T16:44:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.515+0000 7f700ca9a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f700810ece0 con 0x7f7008107930 2024-09-04T16:44:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.515+0000 7f700659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 0x7f700819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.515+0000 7f700659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 0x7f700819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53844/0 (socket says 172.21.15.170:53844) 2024-09-04T16:44:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.515+0000 7f700659c640 1 -- 172.21.15.170:0/4061020377 learned_addr learned my addr 172.21.15.170:0/4061020377 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:44:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.515+0000 7f7005d9b640 1 --2- 172.21.15.170:0/4061020377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7008107930 0x7f700819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.515+0000 7f700659c640 1 -- 172.21.15.170:0/4061020377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7008107930 msgr2=0x7f700819dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.515+0000 7f700659c640 1 --2- 172.21.15.170:0/4061020377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7008107930 0x7f700819dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.515+0000 7f700659c640 1 -- 172.21.15.170:0/4061020377 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7008197880 con 0x7f7008101930 2024-09-04T16:44:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.515+0000 7f7005d9b640 1 --2- 172.21.15.170:0/4061020377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7008107930 0x7f700819dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:44:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.515+0000 7f700659c640 1 --2- 172.21.15.170:0/4061020377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 0x7f700819d6c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800ba50 tx=0x7f6ff800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.515+0000 7f6fff7fe640 1 -- 172.21.15.170:0/4061020377 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ff8019070 con 0x7f7008101930 2024-09-04T16:44:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.516+0000 7f700ca9a640 1 -- 172.21.15.170:0/4061020377 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7008197b70 con 0x7f7008101930 2024-09-04T16:44:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.516+0000 7f6fff7fe640 1 -- 172.21.15.170:0/4061020377 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ff800ce20 con 0x7f7008101930 2024-09-04T16:44:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.516+0000 7f6fff7fe640 1 -- 172.21.15.170:0/4061020377 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ff80075a0 con 0x7f7008101930 2024-09-04T16:44:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.516+0000 7f700ca9a640 1 -- 172.21.15.170:0/4061020377 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7008198100 con 0x7f7008101930 2024-09-04T16:44:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.517+0000 7f700ca9a640 1 -- 172.21.15.170:0/4061020377 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7008103070 con 0x7f7008101930 2024-09-04T16:44:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.517+0000 7f6fff7fe640 1 -- 172.21.15.170:0/4061020377 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f6ff801c070 con 0x7f7008101930 2024-09-04T16:44:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.518+0000 7f6fff7fe640 1 --2- 172.21.15.170:0/4061020377 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6ff4079e90 0x7f6ff407c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.518+0000 7f6fff7fe640 1 -- 172.21.15.170:0/4061020377 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6ff809c2b0 con 0x7f7008101930 2024-09-04T16:44:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.518+0000 7f7005d9b640 1 --2- 172.21.15.170:0/4061020377 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6ff4079e90 0x7f6ff407c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.518+0000 7f7005d9b640 1 --2- 172.21.15.170:0/4061020377 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6ff4079e90 0x7f6ff407c350 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0031460 tx=0x7f6ff0004280 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:59.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.522+0000 7f6fff7fe640 1 -- 172.21.15.170:0/4061020377 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6ff8063d40 con 0x7f7008101930 2024-09-04T16:44:59.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.714+0000 7f700ca9a640 1 -- 172.21.15.170:0/4061020377 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7008198db0 con 0x7f6ff4079e90 2024-09-04T16:44:59.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.715+0000 7f6fff7fe640 1 -- 172.21.15.170:0/4061020377 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7008198db0 con 0x7f6ff4079e90 2024-09-04T16:44:59.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.717+0000 7f700ca9a640 1 -- 172.21.15.170:0/4061020377 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6ff4079e90 msgr2=0x7f6ff407c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:59.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.717+0000 7f700ca9a640 1 --2- 172.21.15.170:0/4061020377 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6ff4079e90 0x7f6ff407c350 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0031460 tx=0x7f6ff0004280 comp rx=0 tx=0).stop 2024-09-04T16:44:59.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.717+0000 7f700ca9a640 1 -- 172.21.15.170:0/4061020377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 msgr2=0x7f700819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:59.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.717+0000 7f700ca9a640 1 --2- 172.21.15.170:0/4061020377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 0x7f700819d6c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800ba50 tx=0x7f6ff800bf10 comp rx=0 tx=0).stop 2024-09-04T16:44:59.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.717+0000 7f700ca9a640 1 -- 172.21.15.170:0/4061020377 shutdown_connections 2024-09-04T16:44:59.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.717+0000 7f700ca9a640 1 --2- 172.21.15.170:0/4061020377 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6ff4079e90 0x7f6ff407c350 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.717+0000 7f700ca9a640 1 --2- 172.21.15.170:0/4061020377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7008107930 0x7f700819dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.717+0000 7f700ca9a640 1 --2- 172.21.15.170:0/4061020377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 0x7f700819d6c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.718+0000 7f700ca9a640 1 -- 172.21.15.170:0/4061020377 >> 172.21.15.170:0/4061020377 conn(0x7f70080fd630 msgr2=0x7f70080fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:59.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.718+0000 7f700ca9a640 1 -- 172.21.15.170:0/4061020377 shutdown_connections 2024-09-04T16:44:59.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.718+0000 7f700ca9a640 1 -- 172.21.15.170:0/4061020377 wait complete. 2024-09-04T16:44:59.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.800+0000 7ff4d42a1640 1 -- 172.21.15.170:0/3290785693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4cc1067e0 msgr2=0x7ff4cc106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:59.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.800+0000 7ff4d42a1640 1 --2- 172.21.15.170:0/3290785693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4cc1067e0 0x7ff4cc106bc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009880 tx=0x7ff4c802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.800+0000 7ff4d42a1640 1 -- 172.21.15.170:0/3290785693 shutdown_connections 2024-09-04T16:44:59.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.800+0000 7ff4d42a1640 1 --2- 172.21.15.170:0/3290785693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4cc1007e0 0x7ff4cc100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.800+0000 7ff4d42a1640 1 --2- 172.21.15.170:0/3290785693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4cc1067e0 0x7ff4cc106bc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.800+0000 7ff4d42a1640 1 -- 172.21.15.170:0/3290785693 >> 172.21.15.170:0/3290785693 conn(0x7ff4cc0fc4c0 msgr2=0x7ff4cc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:44:59.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.800+0000 7ff4d42a1640 1 -- 172.21.15.170:0/3290785693 shutdown_connections 2024-09-04T16:44:59.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.800+0000 7ff4d42a1640 1 -- 172.21.15.170:0/3290785693 wait complete. 2024-09-04T16:44:59.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.800+0000 7ff4d42a1640 1 Processor -- start 2024-09-04T16:44:59.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.801+0000 7ff4d42a1640 1 -- start start 2024-09-04T16:44:59.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.801+0000 7ff4d42a1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4cc1007e0 0x7ff4cc198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:59.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.801+0000 7ff4d42a1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4cc1067e0 0x7ff4cc198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:59.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.801+0000 7ff4d42a1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc10dc90 con 0x7ff4cc1067e0 2024-09-04T16:44:59.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.801+0000 7ff4d42a1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc10db10 con 0x7ff4cc1007e0 2024-09-04T16:44:59.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.801+0000 7ff4d183c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4cc1067e0 0x7ff4cc198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:59.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.801+0000 7ff4d183c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4cc1067e0 0x7ff4cc198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53862/0 (socket says 172.21.15.170:53862) 2024-09-04T16:44:59.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.801+0000 7ff4d183c640 1 -- 172.21.15.170:0/645187351 learned_addr learned my addr 172.21.15.170:0/645187351 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:44:59.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.801+0000 7ff4d203d640 1 --2- 172.21.15.170:0/645187351 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4cc1007e0 0x7ff4cc198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:59.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.801+0000 7ff4d183c640 1 -- 172.21.15.170:0/645187351 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4cc1007e0 msgr2=0x7ff4cc198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:44:59.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.801+0000 7ff4d183c640 1 --2- 172.21.15.170:0/645187351 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4cc1007e0 0x7ff4cc198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:44:59.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.801+0000 7ff4d183c640 1 -- 172.21.15.170:0/645187351 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4cc199310 con 0x7ff4cc1067e0 2024-09-04T16:44:59.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.801+0000 7ff4d183c640 1 --2- 172.21.15.170:0/645187351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4cc1067e0 0x7ff4cc198cc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00d8d0 tx=0x7ff4bc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:59.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.802+0000 7ff4c37fe640 1 -- 172.21.15.170:0/645187351 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4bc017030 con 0x7ff4cc1067e0 2024-09-04T16:44:59.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.802+0000 7ff4d42a1640 1 -- 172.21.15.170:0/645187351 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4cc1a17f0 con 0x7ff4cc1067e0 2024-09-04T16:44:59.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.802+0000 7ff4c37fe640 1 -- 172.21.15.170:0/645187351 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4bc004020 con 0x7ff4cc1067e0 2024-09-04T16:44:59.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.802+0000 7ff4c37fe640 1 -- 172.21.15.170:0/645187351 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4bc0047a0 con 0x7ff4cc1067e0 2024-09-04T16:44:59.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.802+0000 7ff4d42a1640 1 -- 172.21.15.170:0/645187351 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4cc1a1bf0 con 0x7ff4cc1067e0 2024-09-04T16:44:59.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.803+0000 7ff4d42a1640 1 -- 172.21.15.170:0/645187351 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4cc101f20 con 0x7ff4cc1067e0 2024-09-04T16:44:59.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.804+0000 7ff4c37fe640 1 -- 172.21.15.170:0/645187351 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ff4bc0041d0 con 0x7ff4cc1067e0 2024-09-04T16:44:59.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.804+0000 7ff4c37fe640 1 --2- 172.21.15.170:0/645187351 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff4b8079e40 0x7ff4b807c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:44:59.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.804+0000 7ff4c37fe640 1 -- 172.21.15.170:0/645187351 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff4bc018070 con 0x7ff4cc1067e0 2024-09-04T16:44:59.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.804+0000 7ff4d203d640 1 --2- 172.21.15.170:0/645187351 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff4b8079e40 0x7ff4b807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:44:59.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.805+0000 7ff4d203d640 1 --2- 172.21.15.170:0/645187351 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff4b8079e40 0x7ff4b807c300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80096c0 tx=0x7ff4c8031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:44:59.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.808+0000 7ff4c37fe640 1 -- 172.21.15.170:0/645187351 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff4bc064230 con 0x7ff4cc1067e0 2024-09-04T16:44:59.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:44:59.992+0000 7ff4d42a1640 1 -- 172.21.15.170:0/645187351 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff4cc062630 con 0x7ff4b8079e40 2024-09-04T16:45:00.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.001+0000 7ff4c37fe640 1 -- 172.21.15.170:0/645187351 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ff4cc062630 con 0x7ff4b8079e40 2024-09-04T16:45:00.002 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:45:00.002 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (11m) 6m ago 22m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:45:00.002 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (15m) 6m ago 23m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:45:00.002 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (14m) 5m ago 22m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:45:00.003 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (10m) 6m ago 22m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:45:00.003 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (10m) 5m ago 22m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:45:00.003 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (11m) 6m ago 22m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:45:00.003 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (6m) 6m ago 17m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:45:00.003 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (6m) 6m ago 17m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:45:00.003 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (5m) 5m ago 17m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:45:00.003 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (6m) 5m ago 17m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:45:00.003 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (14m) 6m ago 24m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:45:00.003 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (13m) 5m ago 21m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:45:00.003 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (10m) 6m ago 24m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:45:00.003 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (10m) 5m ago 21m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:45:00.003 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (12m) 6m ago 22m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:45:00.003 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (12m) 5m ago 21m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:45:00.003 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (9m) 6m ago 20m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:45:00.003 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (9m) 6m ago 20m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:45:00.004 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (8m) 6m ago 19m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:45:00.004 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (7m) 5m ago 19m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:45:00.004 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (7m) 5m ago 18m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:45:00.004 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (6m) 5m ago 18m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:45:00.004 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (12m) 6m ago 22m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:45:00.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.003+0000 7ff4d42a1640 1 -- 172.21.15.170:0/645187351 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff4b8079e40 msgr2=0x7ff4b807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:00.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.003+0000 7ff4d42a1640 1 --2- 172.21.15.170:0/645187351 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff4b8079e40 0x7ff4b807c300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80096c0 tx=0x7ff4c8031400 comp rx=0 tx=0).stop 2024-09-04T16:45:00.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.003+0000 7ff4d42a1640 1 -- 172.21.15.170:0/645187351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4cc1067e0 msgr2=0x7ff4cc198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:00.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.003+0000 7ff4d42a1640 1 --2- 172.21.15.170:0/645187351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4cc1067e0 0x7ff4cc198cc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00d8d0 tx=0x7ff4bc00dd90 comp rx=0 tx=0).stop 2024-09-04T16:45:00.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.004+0000 7ff4d42a1640 1 -- 172.21.15.170:0/645187351 shutdown_connections 2024-09-04T16:45:00.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.004+0000 7ff4d42a1640 1 --2- 172.21.15.170:0/645187351 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff4b8079e40 0x7ff4b807c300 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.004+0000 7ff4d42a1640 1 --2- 172.21.15.170:0/645187351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4cc1067e0 0x7ff4cc198cc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.004+0000 7ff4d42a1640 1 --2- 172.21.15.170:0/645187351 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4cc1007e0 0x7ff4cc198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.004+0000 7ff4d42a1640 1 -- 172.21.15.170:0/645187351 >> 172.21.15.170:0/645187351 conn(0x7ff4cc0fc4c0 msgr2=0x7ff4cc0fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:00.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.004+0000 7ff4d42a1640 1 -- 172.21.15.170:0/645187351 shutdown_connections 2024-09-04T16:45:00.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.004+0000 7ff4d42a1640 1 -- 172.21.15.170:0/645187351 wait complete. 2024-09-04T16:45:00.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.084+0000 7fd9281f6640 1 -- 172.21.15.170:0/2844505082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd920101930 msgr2=0x7fd920101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:00.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.084+0000 7fd9281f6640 1 --2- 172.21.15.170:0/2844505082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd920101930 0x7fd920101d90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd910009880 tx=0x7fd91002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.084+0000 7fd9281f6640 1 -- 172.21.15.170:0/2844505082 shutdown_connections 2024-09-04T16:45:00.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.084+0000 7fd9281f6640 1 --2- 172.21.15.170:0/2844505082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd920101930 0x7fd920101d90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.084+0000 7fd9281f6640 1 --2- 172.21.15.170:0/2844505082 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd920107930 0x7fd920107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.084+0000 7fd9281f6640 1 -- 172.21.15.170:0/2844505082 >> 172.21.15.170:0/2844505082 conn(0x7fd9200fd630 msgr2=0x7fd9200ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:00.086 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:59 smithi170 ceph-mon[113855]: pgmap v458: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:00.086 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:45:00.086 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:44:59 smithi170 ceph-mon[113855]: from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:45:00.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.085+0000 7fd9281f6640 1 -- 172.21.15.170:0/2844505082 shutdown_connections 2024-09-04T16:45:00.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.085+0000 7fd9281f6640 1 -- 172.21.15.170:0/2844505082 wait complete. 2024-09-04T16:45:00.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.085+0000 7fd9281f6640 1 Processor -- start 2024-09-04T16:45:00.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.085+0000 7fd9281f6640 1 -- start start 2024-09-04T16:45:00.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.085+0000 7fd9281f6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd920101930 0x7fd92019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:00.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.085+0000 7fd9281f6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd920107930 0x7fd92019dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:00.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.085+0000 7fd9281f6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd92010ede0 con 0x7fd920101930 2024-09-04T16:45:00.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.085+0000 7fd9281f6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd92010ec60 con 0x7fd920107930 2024-09-04T16:45:00.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.086+0000 7fd925f92640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd920101930 0x7fd92019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:00.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.086+0000 7fd925f92640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd920101930 0x7fd92019d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53872/0 (socket says 172.21.15.170:53872) 2024-09-04T16:45:00.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.086+0000 7fd925f92640 1 -- 172.21.15.170:0/3084618619 learned_addr learned my addr 172.21.15.170:0/3084618619 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:45:00.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.086+0000 7fd925791640 1 --2- 172.21.15.170:0/3084618619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd920107930 0x7fd92019dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:00.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.086+0000 7fd925f92640 1 -- 172.21.15.170:0/3084618619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd920107930 msgr2=0x7fd92019dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:00.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.086+0000 7fd925f92640 1 --2- 172.21.15.170:0/3084618619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd920107930 0x7fd92019dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.086+0000 7fd925f92640 1 -- 172.21.15.170:0/3084618619 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd920197850 con 0x7fd920101930 2024-09-04T16:45:00.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.086+0000 7fd925791640 1 --2- 172.21.15.170:0/3084618619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd920107930 0x7fd92019dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:45:00.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.086+0000 7fd925f92640 1 --2- 172.21.15.170:0/3084618619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd920101930 0x7fd92019d6d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00c810 tx=0x7fd91c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:00.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.086+0000 7fd916ffd640 1 -- 172.21.15.170:0/3084618619 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd91c004020 con 0x7fd920101930 2024-09-04T16:45:00.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.086+0000 7fd916ffd640 1 -- 172.21.15.170:0/3084618619 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd91c0041c0 con 0x7fd920101930 2024-09-04T16:45:00.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.086+0000 7fd9281f6640 1 -- 172.21.15.170:0/3084618619 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd920197b40 con 0x7fd920101930 2024-09-04T16:45:00.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.086+0000 7fd916ffd640 1 -- 172.21.15.170:0/3084618619 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd91c0047a0 con 0x7fd920101930 2024-09-04T16:45:00.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.086+0000 7fd9281f6640 1 -- 172.21.15.170:0/3084618619 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9201980a0 con 0x7fd920101930 2024-09-04T16:45:00.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.087+0000 7fd9281f6640 1 -- 172.21.15.170:0/3084618619 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd920103070 con 0x7fd920101930 2024-09-04T16:45:00.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.089+0000 7fd916ffd640 1 -- 172.21.15.170:0/3084618619 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fd91c0079b0 con 0x7fd920101930 2024-09-04T16:45:00.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.089+0000 7fd916ffd640 1 --2- 172.21.15.170:0/3084618619 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd90c079e80 0x7fd90c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:00.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.089+0000 7fd916ffd640 1 -- 172.21.15.170:0/3084618619 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd91c09cd20 con 0x7fd920101930 2024-09-04T16:45:00.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.089+0000 7fd925791640 1 --2- 172.21.15.170:0/3084618619 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd90c079e80 0x7fd90c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:00.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.090+0000 7fd925791640 1 --2- 172.21.15.170:0/3084618619 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd90c079e80 0x7fd90c07c340 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd920198ba0 tx=0x7fd910009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:00.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.093+0000 7fd916ffd640 1 -- 172.21.15.170:0/3084618619 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd91c014030 con 0x7fd920101930 2024-09-04T16:45:00.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.338+0000 7fd9281f6640 1 -- 172.21.15.170:0/3084618619 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd920109ec0 con 0x7fd920101930 2024-09-04T16:45:00.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.339+0000 7fd916ffd640 1 -- 172.21.15.170:0/3084618619 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fd91c064850 con 0x7fd920101930 2024-09-04T16:45:00.340 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:45:00.340 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:45:00.340 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:45:00.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:45:00.340 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:45:00.340 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:45:00.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:45:00.340 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:45:00.340 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:45:00.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:45:00.341 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:45:00.341 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:45:00.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:45:00.341 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:45:00.341 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:45:00.341 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:45:00.341 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:45:00.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.341+0000 7fd9281f6640 1 -- 172.21.15.170:0/3084618619 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd90c079e80 msgr2=0x7fd90c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:00.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.341+0000 7fd9281f6640 1 --2- 172.21.15.170:0/3084618619 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd90c079e80 0x7fd90c07c340 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd920198ba0 tx=0x7fd910009560 comp rx=0 tx=0).stop 2024-09-04T16:45:00.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.341+0000 7fd9281f6640 1 -- 172.21.15.170:0/3084618619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd920101930 msgr2=0x7fd92019d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:00.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.341+0000 7fd9281f6640 1 --2- 172.21.15.170:0/3084618619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd920101930 0x7fd92019d6d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00c810 tx=0x7fd91c00ccd0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.341+0000 7fd9281f6640 1 -- 172.21.15.170:0/3084618619 shutdown_connections 2024-09-04T16:45:00.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.341+0000 7fd9281f6640 1 --2- 172.21.15.170:0/3084618619 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd90c079e80 0x7fd90c07c340 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.341+0000 7fd9281f6640 1 --2- 172.21.15.170:0/3084618619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd920107930 0x7fd92019dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.341+0000 7fd9281f6640 1 --2- 172.21.15.170:0/3084618619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd920101930 0x7fd92019d6d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.341+0000 7fd9281f6640 1 -- 172.21.15.170:0/3084618619 >> 172.21.15.170:0/3084618619 conn(0x7fd9200fd630 msgr2=0x7fd9200fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:00.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.341+0000 7fd9281f6640 1 -- 172.21.15.170:0/3084618619 shutdown_connections 2024-09-04T16:45:00.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.341+0000 7fd9281f6640 1 -- 172.21.15.170:0/3084618619 wait complete. 2024-09-04T16:45:00.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:59 smithi193 ceph-mon[82547]: pgmap v458: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:00.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:45:00.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:44:59 smithi193 ceph-mon[82547]: from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:45:00.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.423+0000 7fde434f9640 1 -- 172.21.15.170:0/1820461919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde3c100820 msgr2=0x7fde3c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:00.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.423+0000 7fde434f9640 1 --2- 172.21.15.170:0/1820461919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde3c100820 0x7fde3c100c80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fde30009880 tx=0x7fde3002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.423+0000 7fde434f9640 1 -- 172.21.15.170:0/1820461919 shutdown_connections 2024-09-04T16:45:00.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.423+0000 7fde434f9640 1 --2- 172.21.15.170:0/1820461919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde3c100820 0x7fde3c100c80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.423+0000 7fde434f9640 1 --2- 172.21.15.170:0/1820461919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde3c106820 0x7fde3c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.423+0000 7fde434f9640 1 -- 172.21.15.170:0/1820461919 >> 172.21.15.170:0/1820461919 conn(0x7fde3c0fc520 msgr2=0x7fde3c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:00.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.423+0000 7fde434f9640 1 -- 172.21.15.170:0/1820461919 shutdown_connections 2024-09-04T16:45:00.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.423+0000 7fde434f9640 1 -- 172.21.15.170:0/1820461919 wait complete. 2024-09-04T16:45:00.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.423+0000 7fde434f9640 1 Processor -- start 2024-09-04T16:45:00.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.423+0000 7fde434f9640 1 -- start start 2024-09-04T16:45:00.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde434f9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde3c100820 0x7fde3c198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:00.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde434f9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde3c106820 0x7fde3c198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:00.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde434f9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c10dcf0 con 0x7fde3c100820 2024-09-04T16:45:00.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde434f9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c10db70 con 0x7fde3c106820 2024-09-04T16:45:00.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde41295640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde3c100820 0x7fde3c198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:00.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde41295640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde3c100820 0x7fde3c198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53896/0 (socket says 172.21.15.170:53896) 2024-09-04T16:45:00.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde41295640 1 -- 172.21.15.170:0/2302132117 learned_addr learned my addr 172.21.15.170:0/2302132117 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:45:00.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde41295640 1 -- 172.21.15.170:0/2302132117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde3c106820 msgr2=0x7fde3c198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:00.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde40a94640 1 --2- 172.21.15.170:0/2302132117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde3c106820 0x7fde3c198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:00.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde41295640 1 --2- 172.21.15.170:0/2302132117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde3c106820 0x7fde3c198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde41295640 1 -- 172.21.15.170:0/2302132117 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde3c199340 con 0x7fde3c100820 2024-09-04T16:45:00.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde41295640 1 --2- 172.21.15.170:0/2302132117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde3c100820 0x7fde3c198800 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fde3800c8f0 tx=0x7fde3800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:00.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde2e7fc640 1 -- 172.21.15.170:0/2302132117 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde380079b0 con 0x7fde3c100820 2024-09-04T16:45:00.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde434f9640 1 -- 172.21.15.170:0/2302132117 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde3c199630 con 0x7fde3c100820 2024-09-04T16:45:00.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde2e7fc640 1 -- 172.21.15.170:0/2302132117 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fde380054e0 con 0x7fde3c100820 2024-09-04T16:45:00.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde2e7fc640 1 -- 172.21.15.170:0/2302132117 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde38004dd0 con 0x7fde3c100820 2024-09-04T16:45:00.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.424+0000 7fde434f9640 1 -- 172.21.15.170:0/2302132117 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde3c1a1c30 con 0x7fde3c100820 2024-09-04T16:45:00.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.426+0000 7fde434f9640 1 -- 172.21.15.170:0/2302132117 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde3c101f60 con 0x7fde3c100820 2024-09-04T16:45:00.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.426+0000 7fde2e7fc640 1 -- 172.21.15.170:0/2302132117 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fde38005020 con 0x7fde3c100820 2024-09-04T16:45:00.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.427+0000 7fde2e7fc640 1 --2- 172.21.15.170:0/2302132117 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fde28079dd0 0x7fde2807c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:00.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.427+0000 7fde2e7fc640 1 -- 172.21.15.170:0/2302132117 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fde3809cad0 con 0x7fde3c100820 2024-09-04T16:45:00.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.427+0000 7fde40a94640 1 --2- 172.21.15.170:0/2302132117 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fde28079dd0 0x7fde2807c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:00.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.427+0000 7fde40a94640 1 --2- 172.21.15.170:0/2302132117 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fde28079dd0 0x7fde2807c290 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fde30031460 tx=0x7fde30009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:00.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.431+0000 7fde2e7fc640 1 -- 172.21.15.170:0/2302132117 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fde3c199630 con 0x7fde3c100820 2024-09-04T16:45:00.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.641+0000 7fde434f9640 1 -- 172.21.15.170:0/2302132117 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fde3c108d90 con 0x7fde3c100820 2024-09-04T16:45:00.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.642+0000 7fde2e7fc640 1 -- 172.21.15.170:0/2302132117 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7fde3809c070 con 0x7fde3c100820 2024-09-04T16:45:00.643 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:45:00.643 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:45:00.643 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:45:00.643 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:45:00.643 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:45:00.643 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:45:00.643 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:45:00.643 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:45:00.643 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:45:00.644 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:45:00.644 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:45:00.644 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:45:00.644 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:45:00.644 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:45:00.644 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:45:00.644 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:45:00.644 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:45:00.644 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:45:00.644 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:45:00.644 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:45:00.644 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:45:00.644 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:45:00.645 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:45:00.645 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:45:00.645 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:45:00.645 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:45:00.645 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:45:00.645 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:45:00.645 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:45:00.645 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:45:00.645 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:45:00.645 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:45:00.645 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:45:00.645 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:45:00.645 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:45:00.645 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:45:00.646 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:45:00.646 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:45:00.646 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:45:00.646 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:45:00.646 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:45:00.646 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:45:00.646 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:45:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:45:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.644+0000 7fde434f9640 1 -- 172.21.15.170:0/2302132117 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fde28079dd0 msgr2=0x7fde2807c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.644+0000 7fde434f9640 1 --2- 172.21.15.170:0/2302132117 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fde28079dd0 0x7fde2807c290 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fde30031460 tx=0x7fde30009560 comp rx=0 tx=0).stop 2024-09-04T16:45:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.644+0000 7fde434f9640 1 -- 172.21.15.170:0/2302132117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde3c100820 msgr2=0x7fde3c198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.644+0000 7fde434f9640 1 --2- 172.21.15.170:0/2302132117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde3c100820 0x7fde3c198800 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fde3800c8f0 tx=0x7fde3800cdb0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.644+0000 7fde434f9640 1 -- 172.21.15.170:0/2302132117 shutdown_connections 2024-09-04T16:45:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.644+0000 7fde434f9640 1 --2- 172.21.15.170:0/2302132117 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fde28079dd0 0x7fde2807c290 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.644+0000 7fde434f9640 1 --2- 172.21.15.170:0/2302132117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde3c106820 0x7fde3c198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.644+0000 7fde434f9640 1 --2- 172.21.15.170:0/2302132117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde3c100820 0x7fde3c198800 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.644+0000 7fde434f9640 1 -- 172.21.15.170:0/2302132117 >> 172.21.15.170:0/2302132117 conn(0x7fde3c0fc520 msgr2=0x7fde3c0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.644+0000 7fde434f9640 1 -- 172.21.15.170:0/2302132117 shutdown_connections 2024-09-04T16:45:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.644+0000 7fde434f9640 1 -- 172.21.15.170:0/2302132117 wait complete. 2024-09-04T16:45:00.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.726+0000 7f552f53f640 1 -- 172.21.15.170:0/1310189768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55281067e0 msgr2=0x7f5528106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:00.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.726+0000 7f552f53f640 1 --2- 172.21.15.170:0/1310189768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55281067e0 0x7f5528106bc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5524009880 tx=0x7f552402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.726+0000 7f552f53f640 1 -- 172.21.15.170:0/1310189768 shutdown_connections 2024-09-04T16:45:00.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.726+0000 7f552f53f640 1 --2- 172.21.15.170:0/1310189768 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55281007e0 0x7f5528100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.726+0000 7f552f53f640 1 --2- 172.21.15.170:0/1310189768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55281067e0 0x7f5528106bc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.726+0000 7f552f53f640 1 -- 172.21.15.170:0/1310189768 >> 172.21.15.170:0/1310189768 conn(0x7f55280fc4c0 msgr2=0x7f55280fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:00.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.727+0000 7f552f53f640 1 -- 172.21.15.170:0/1310189768 shutdown_connections 2024-09-04T16:45:00.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.727+0000 7f552f53f640 1 -- 172.21.15.170:0/1310189768 wait complete. 2024-09-04T16:45:00.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.727+0000 7f552f53f640 1 Processor -- start 2024-09-04T16:45:00.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.727+0000 7f552f53f640 1 -- start start 2024-09-04T16:45:00.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.727+0000 7f552f53f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55281007e0 0x7f5528198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:00.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.727+0000 7f552f53f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55281067e0 0x7f5528198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:00.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.727+0000 7f552f53f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f552810dcb0 con 0x7f55281067e0 2024-09-04T16:45:00.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.727+0000 7f552f53f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f552810db30 con 0x7f55281007e0 2024-09-04T16:45:00.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.728+0000 7f552cada640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55281067e0 0x7f5528198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:00.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.728+0000 7f552cada640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55281067e0 0x7f5528198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53912/0 (socket says 172.21.15.170:53912) 2024-09-04T16:45:00.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.728+0000 7f552cada640 1 -- 172.21.15.170:0/590698007 learned_addr learned my addr 172.21.15.170:0/590698007 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:45:00.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.728+0000 7f552d2db640 1 --2- 172.21.15.170:0/590698007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55281007e0 0x7f5528198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:00.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.728+0000 7f552cada640 1 -- 172.21.15.170:0/590698007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55281007e0 msgr2=0x7f5528198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:00.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.728+0000 7f552cada640 1 --2- 172.21.15.170:0/590698007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55281007e0 0x7f5528198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.728+0000 7f552cada640 1 -- 172.21.15.170:0/590698007 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5528199360 con 0x7f55281067e0 2024-09-04T16:45:00.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.728+0000 7f552cada640 1 --2- 172.21.15.170:0/590698007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55281067e0 0x7f5528198d60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f551800d6f0 tx=0x7f551800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:00.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.728+0000 7f551e7fc640 1 -- 172.21.15.170:0/590698007 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5518017070 con 0x7f55281067e0 2024-09-04T16:45:00.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.728+0000 7f552f53f640 1 -- 172.21.15.170:0/590698007 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5528199650 con 0x7f55281067e0 2024-09-04T16:45:00.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.728+0000 7f551e7fc640 1 -- 172.21.15.170:0/590698007 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f551800de00 con 0x7f55281067e0 2024-09-04T16:45:00.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.728+0000 7f551e7fc640 1 -- 172.21.15.170:0/590698007 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5518004bb0 con 0x7f55281067e0 2024-09-04T16:45:00.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.728+0000 7f552f53f640 1 -- 172.21.15.170:0/590698007 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55281a1c50 con 0x7f55281067e0 2024-09-04T16:45:00.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.729+0000 7f552f53f640 1 -- 172.21.15.170:0/590698007 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5528101f20 con 0x7f55281067e0 2024-09-04T16:45:00.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.730+0000 7f551e7fc640 1 -- 172.21.15.170:0/590698007 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5518004e60 con 0x7f55281067e0 2024-09-04T16:45:00.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.731+0000 7f551e7fc640 1 --2- 172.21.15.170:0/590698007 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5514079e30 0x7f551407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:00.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.731+0000 7f551e7fc640 1 -- 172.21.15.170:0/590698007 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f551809c680 con 0x7f55281067e0 2024-09-04T16:45:00.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.731+0000 7f552d2db640 1 --2- 172.21.15.170:0/590698007 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5514079e30 0x7f551407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:00.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.731+0000 7f552d2db640 1 --2- 172.21.15.170:0/590698007 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5514079e30 0x7f551407c2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f55240096c0 tx=0x7f5524031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:00.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.735+0000 7f551e7fc640 1 -- 172.21.15.170:0/590698007 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5528199650 con 0x7f55281067e0 2024-09-04T16:45:00.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.929+0000 7f552f53f640 1 -- 172.21.15.170:0/590698007 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5528062630 con 0x7f5514079e30 2024-09-04T16:45:00.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.930+0000 7f551e7fc640 1 -- 172.21.15.170:0/590698007 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5528062630 con 0x7f5514079e30 2024-09-04T16:45:00.931 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:45:00.931 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:45:00.931 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:45:00.931 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:45:00.931 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:45:00.931 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:45:00.931 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:45:00.931 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:45:00.931 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:45:00.931 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:45:00.931 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:45:00.932 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:45:00.932 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:45:00.932 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:45:00.932 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:45:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.932+0000 7f552f53f640 1 -- 172.21.15.170:0/590698007 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5514079e30 msgr2=0x7f551407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.932+0000 7f552f53f640 1 --2- 172.21.15.170:0/590698007 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5514079e30 0x7f551407c2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f55240096c0 tx=0x7f5524031400 comp rx=0 tx=0).stop 2024-09-04T16:45:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.932+0000 7f552f53f640 1 -- 172.21.15.170:0/590698007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55281067e0 msgr2=0x7f5528198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.932+0000 7f552f53f640 1 --2- 172.21.15.170:0/590698007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55281067e0 0x7f5528198d60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f551800d6f0 tx=0x7f551800dbb0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.933+0000 7f552f53f640 1 -- 172.21.15.170:0/590698007 shutdown_connections 2024-09-04T16:45:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.933+0000 7f552f53f640 1 --2- 172.21.15.170:0/590698007 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5514079e30 0x7f551407c2f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.933+0000 7f552f53f640 1 --2- 172.21.15.170:0/590698007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55281067e0 0x7f5528198d60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.933+0000 7f552f53f640 1 --2- 172.21.15.170:0/590698007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55281007e0 0x7f5528198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.933+0000 7f552f53f640 1 -- 172.21.15.170:0/590698007 >> 172.21.15.170:0/590698007 conn(0x7f55280fc4c0 msgr2=0x7f55280fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.933+0000 7f552f53f640 1 -- 172.21.15.170:0/590698007 shutdown_connections 2024-09-04T16:45:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:00.933+0000 7f552f53f640 1 -- 172.21.15.170:0/590698007 wait complete. 2024-09-04T16:45:01.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.015+0000 7f700fb62640 1 -- 172.21.15.170:0/824809516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 msgr2=0x7f7008101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:01.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.015+0000 7f700fb62640 1 --2- 172.21.15.170:0/824809516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 0x7f7008101d90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009880 tx=0x7f6ffc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:45:01.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.015+0000 7f700fb62640 1 -- 172.21.15.170:0/824809516 shutdown_connections 2024-09-04T16:45:01.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.015+0000 7f700fb62640 1 --2- 172.21.15.170:0/824809516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 0x7f7008101d90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:01.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.015+0000 7f700fb62640 1 --2- 172.21.15.170:0/824809516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7008107930 0x7f7008107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:01.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.015+0000 7f700fb62640 1 -- 172.21.15.170:0/824809516 >> 172.21.15.170:0/824809516 conn(0x7f70080fd630 msgr2=0x7f70080ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:01.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.015+0000 7f700fb62640 1 -- 172.21.15.170:0/824809516 shutdown_connections 2024-09-04T16:45:01.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.015+0000 7f700fb62640 1 -- 172.21.15.170:0/824809516 wait complete. 2024-09-04T16:45:01.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.015+0000 7f700fb62640 1 Processor -- start 2024-09-04T16:45:01.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.016+0000 7f700fb62640 1 -- start start 2024-09-04T16:45:01.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.016+0000 7f700fb62640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 0x7f70080744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:01.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.016+0000 7f700fb62640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7008107930 0x7f7008074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:01.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.016+0000 7f700fb62640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f700810ee00 con 0x7f7008101930 2024-09-04T16:45:01.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.016+0000 7f700fb62640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f700810ec80 con 0x7f7008107930 2024-09-04T16:45:01.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.016+0000 7f700d8fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 0x7f70080744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:01.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.016+0000 7f700d8fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 0x7f70080744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53936/0 (socket says 172.21.15.170:53936) 2024-09-04T16:45:01.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.016+0000 7f700d8fe640 1 -- 172.21.15.170:0/3238909793 learned_addr learned my addr 172.21.15.170:0/3238909793 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:45:01.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.016+0000 7f700d0fd640 1 --2- 172.21.15.170:0/3238909793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7008107930 0x7f7008074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:01.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.016+0000 7f700d8fe640 1 -- 172.21.15.170:0/3238909793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7008107930 msgr2=0x7f7008074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:01.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.016+0000 7f700d8fe640 1 --2- 172.21.15.170:0/3238909793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7008107930 0x7f7008074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:01.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.016+0000 7f700d8fe640 1 -- 172.21.15.170:0/3238909793 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7008074f70 con 0x7f7008101930 2024-09-04T16:45:01.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.016+0000 7f700d8fe640 1 --2- 172.21.15.170:0/3238909793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 0x7f70080744f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f700000d6f0 tx=0x7f700000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:01.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.017+0000 7f7006ffd640 1 -- 172.21.15.170:0/3238909793 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7000017070 con 0x7f7008101930 2024-09-04T16:45:01.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.017+0000 7f700fb62640 1 -- 172.21.15.170:0/3238909793 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7008075260 con 0x7f7008101930 2024-09-04T16:45:01.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.017+0000 7f7006ffd640 1 -- 172.21.15.170:0/3238909793 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f700000de00 con 0x7f7008101930 2024-09-04T16:45:01.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.017+0000 7f7006ffd640 1 -- 172.21.15.170:0/3238909793 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7000004bb0 con 0x7f7008101930 2024-09-04T16:45:01.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.017+0000 7f700fb62640 1 -- 172.21.15.170:0/3238909793 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70081a3e90 con 0x7f7008101930 2024-09-04T16:45:01.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.018+0000 7f700fb62640 1 -- 172.21.15.170:0/3238909793 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7008103070 con 0x7f7008101930 2024-09-04T16:45:01.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.018+0000 7f7006ffd640 1 -- 172.21.15.170:0/3238909793 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f7000004e60 con 0x7f7008101930 2024-09-04T16:45:01.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.019+0000 7f7006ffd640 1 --2- 172.21.15.170:0/3238909793 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6ff0079e30 0x7f6ff007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:01.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.019+0000 7f7006ffd640 1 -- 172.21.15.170:0/3238909793 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f700009c660 con 0x7f7008101930 2024-09-04T16:45:01.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.019+0000 7f700d0fd640 1 --2- 172.21.15.170:0/3238909793 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6ff0079e30 0x7f6ff007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:01.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.019+0000 7f700d0fd640 1 --2- 172.21.15.170:0/3238909793 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6ff0079e30 0x7f6ff007c2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7008075f80 tx=0x7f6ffc031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:01.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.023+0000 7f7006ffd640 1 -- 172.21.15.170:0/3238909793 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f70000681e0 con 0x7f7008101930 2024-09-04T16:45:01.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.267+0000 7f700fb62640 1 -- 172.21.15.170:0/3238909793 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f7008101d90 con 0x7f7008101930 2024-09-04T16:45:01.269 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:00 smithi170 ceph-mon[113855]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:45:01.269 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:00 smithi170 ceph-mon[113855]: from='client.34678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:45:01.269 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:00 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3084618619' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:45:01.269 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:00 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2302132117' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:45:01.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.268+0000 7f7006ffd640 1 -- 172.21.15.170:0/3238909793 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f700006cc00 con 0x7f7008101930 2024-09-04T16:45:01.269 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:45:01.270 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:45:01.270 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:45:01.270 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:45:01.270 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:45:01.270 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:45:01.270 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:45:01.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.270+0000 7f700fb62640 1 -- 172.21.15.170:0/3238909793 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6ff0079e30 msgr2=0x7f6ff007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:01.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.270+0000 7f700fb62640 1 --2- 172.21.15.170:0/3238909793 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6ff0079e30 0x7f6ff007c2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7008075f80 tx=0x7f6ffc031400 comp rx=0 tx=0).stop 2024-09-04T16:45:01.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.270+0000 7f700fb62640 1 -- 172.21.15.170:0/3238909793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 msgr2=0x7f70080744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:01.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.270+0000 7f700fb62640 1 --2- 172.21.15.170:0/3238909793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 0x7f70080744f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f700000d6f0 tx=0x7f700000dbb0 comp rx=0 tx=0).stop 2024-09-04T16:45:01.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.270+0000 7f700fb62640 1 -- 172.21.15.170:0/3238909793 shutdown_connections 2024-09-04T16:45:01.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.270+0000 7f700fb62640 1 --2- 172.21.15.170:0/3238909793 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6ff0079e30 0x7f6ff007c2f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:01.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.270+0000 7f700fb62640 1 --2- 172.21.15.170:0/3238909793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7008107930 0x7f7008074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:01.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.270+0000 7f700fb62640 1 --2- 172.21.15.170:0/3238909793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7008101930 0x7f70080744f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:01.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.270+0000 7f700fb62640 1 -- 172.21.15.170:0/3238909793 >> 172.21.15.170:0/3238909793 conn(0x7f70080fd630 msgr2=0x7f70080fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:01.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.270+0000 7f700fb62640 1 -- 172.21.15.170:0/3238909793 shutdown_connections 2024-09-04T16:45:01.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:01.270+0000 7f700fb62640 1 -- 172.21.15.170:0/3238909793 wait complete. 2024-09-04T16:45:01.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:00 smithi193 ceph-mon[82547]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:45:01.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:00 smithi193 ceph-mon[82547]: from='client.34678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:45:01.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:00 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3084618619' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:45:01.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:00 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2302132117' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:45:02.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:01 smithi170 ceph-mon[113855]: pgmap v459: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:02.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:01 smithi170 ceph-mon[113855]: from='client.34690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:45:02.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:01 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3238909793' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:45:02.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:01 smithi193 ceph-mon[82547]: pgmap v459: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:02.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:01 smithi193 ceph-mon[82547]: from='client.34690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:45:02.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:01 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3238909793' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:45:04.337 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:03 smithi170 ceph-mon[113855]: pgmap v460: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:04.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:03 smithi193 ceph-mon[82547]: pgmap v460: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:06.224 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:05 smithi170 ceph-mon[113855]: pgmap v461: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:06.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:05 smithi193 ceph-mon[82547]: pgmap v461: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:08.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:07 smithi170 ceph-mon[113855]: pgmap v462: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:08.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:07 smithi193 ceph-mon[82547]: pgmap v462: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:10.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:09 smithi170 ceph-mon[113855]: pgmap v463: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:10.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:09 smithi193 ceph-mon[82547]: pgmap v463: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:12.231 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:11 smithi170 ceph-mon[113855]: pgmap v464: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:12.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:11 smithi193 ceph-mon[82547]: pgmap v464: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:14.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:13 smithi170 ceph-mon[113855]: pgmap v465: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:14.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:13 smithi193 ceph-mon[82547]: pgmap v465: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:15.228 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:45:15.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:45:16.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:15 smithi193 ceph-mon[82547]: pgmap v466: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:16.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:15 smithi170 ceph-mon[113855]: pgmap v466: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:18.219 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:17 smithi170 ceph-mon[113855]: pgmap v467: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:18.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:17 smithi193 ceph-mon[82547]: pgmap v467: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:20.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:19 smithi170 ceph-mon[113855]: pgmap v468: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:20.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:19 smithi193 ceph-mon[82547]: pgmap v468: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:22.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:21 smithi170 ceph-mon[113855]: pgmap v469: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:22.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:21 smithi193 ceph-mon[82547]: pgmap v469: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:24.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:23 smithi170 ceph-mon[113855]: pgmap v470: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:24.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:23 smithi193 ceph-mon[82547]: pgmap v470: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:26.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:25 smithi170 ceph-mon[113855]: pgmap v471: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:26.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:25 smithi193 ceph-mon[82547]: pgmap v471: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:28.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:27 smithi170 ceph-mon[113855]: pgmap v472: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:28.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:27 smithi193 ceph-mon[82547]: pgmap v472: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:30.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:29 smithi170 ceph-mon[113855]: pgmap v473: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:30.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:45:30.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:29 smithi193 ceph-mon[82547]: pgmap v473: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:30.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:45:31.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.365+0000 7ff7ca30a640 1 -- 172.21.15.170:0/3665756277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c41067e0 msgr2=0x7ff7c4106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:31.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.365+0000 7ff7ca30a640 1 --2- 172.21.15.170:0/3665756277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c41067e0 0x7ff7c4106bc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009880 tx=0x7ff7b402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.365+0000 7ff7ca30a640 1 -- 172.21.15.170:0/3665756277 shutdown_connections 2024-09-04T16:45:31.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.365+0000 7ff7ca30a640 1 --2- 172.21.15.170:0/3665756277 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c41007e0 0x7ff7c4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.365+0000 7ff7ca30a640 1 --2- 172.21.15.170:0/3665756277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c41067e0 0x7ff7c4106bc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.365+0000 7ff7ca30a640 1 -- 172.21.15.170:0/3665756277 >> 172.21.15.170:0/3665756277 conn(0x7ff7c40fc4c0 msgr2=0x7ff7c40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:31.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.365+0000 7ff7ca30a640 1 -- 172.21.15.170:0/3665756277 shutdown_connections 2024-09-04T16:45:31.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.365+0000 7ff7ca30a640 1 -- 172.21.15.170:0/3665756277 wait complete. 2024-09-04T16:45:31.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.366+0000 7ff7ca30a640 1 Processor -- start 2024-09-04T16:45:31.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.366+0000 7ff7ca30a640 1 -- start start 2024-09-04T16:45:31.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.366+0000 7ff7ca30a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c41007e0 0x7ff7c419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:31.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.366+0000 7ff7ca30a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c41067e0 0x7ff7c419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:31.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.366+0000 7ff7ca30a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c410dcb0 con 0x7ff7c41067e0 2024-09-04T16:45:31.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.366+0000 7ff7ca30a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c410db30 con 0x7ff7c41007e0 2024-09-04T16:45:31.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.366+0000 7ff7c37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c41067e0 0x7ff7c419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:31.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.366+0000 7ff7c37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c41067e0 0x7ff7c419db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42064/0 (socket says 172.21.15.170:42064) 2024-09-04T16:45:31.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.366+0000 7ff7c37fe640 1 -- 172.21.15.170:0/3610704526 learned_addr learned my addr 172.21.15.170:0/3610704526 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:45:31.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.366+0000 7ff7c3fff640 1 --2- 172.21.15.170:0/3610704526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c41007e0 0x7ff7c419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:31.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.367+0000 7ff7c37fe640 1 -- 172.21.15.170:0/3610704526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c41007e0 msgr2=0x7ff7c419d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:31.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.367+0000 7ff7c37fe640 1 --2- 172.21.15.170:0/3610704526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c41007e0 0x7ff7c419d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.367+0000 7ff7c37fe640 1 -- 172.21.15.170:0/3610704526 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c41977a0 con 0x7ff7c41067e0 2024-09-04T16:45:31.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.367+0000 7ff7c37fe640 1 --2- 172.21.15.170:0/3610704526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c41067e0 0x7ff7c419db60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800d6f0 tx=0x7ff7b800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:31.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.367+0000 7ff7c17fa640 1 -- 172.21.15.170:0/3610704526 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7b8017070 con 0x7ff7c41067e0 2024-09-04T16:45:31.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.367+0000 7ff7c17fa640 1 -- 172.21.15.170:0/3610704526 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7b800de00 con 0x7ff7c41067e0 2024-09-04T16:45:31.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.367+0000 7ff7ca30a640 1 -- 172.21.15.170:0/3610704526 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c4197a90 con 0x7ff7c41067e0 2024-09-04T16:45:31.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.367+0000 7ff7c17fa640 1 -- 172.21.15.170:0/3610704526 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7b8004bb0 con 0x7ff7c41067e0 2024-09-04T16:45:31.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.367+0000 7ff7ca30a640 1 -- 172.21.15.170:0/3610704526 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c4198020 con 0x7ff7c41067e0 2024-09-04T16:45:31.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.368+0000 7ff7ca30a640 1 -- 172.21.15.170:0/3610704526 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c4101f20 con 0x7ff7c41067e0 2024-09-04T16:45:31.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.369+0000 7ff7c17fa640 1 -- 172.21.15.170:0/3610704526 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ff7b8004e60 con 0x7ff7c41067e0 2024-09-04T16:45:31.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.369+0000 7ff7c17fa640 1 --2- 172.21.15.170:0/3610704526 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7ac079e30 0x7ff7ac07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:31.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.370+0000 7ff7c3fff640 1 --2- 172.21.15.170:0/3610704526 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7ac079e30 0x7ff7ac07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:31.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.370+0000 7ff7c17fa640 1 -- 172.21.15.170:0/3610704526 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff7b809c730 con 0x7ff7c41067e0 2024-09-04T16:45:31.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.370+0000 7ff7c3fff640 1 --2- 172.21.15.170:0/3610704526 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7ac079e30 0x7ff7ac07c2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40096c0 tx=0x7ff7b4031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:31.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.374+0000 7ff7c17fa640 1 -- 172.21.15.170:0/3610704526 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff7b8064140 con 0x7ff7c41067e0 2024-09-04T16:45:31.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.566+0000 7ff7ca30a640 1 -- 172.21.15.170:0/3610704526 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff7c4198390 con 0x7ff7ac079e30 2024-09-04T16:45:31.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.568+0000 7ff7c17fa640 1 -- 172.21.15.170:0/3610704526 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff7c4198390 con 0x7ff7ac079e30 2024-09-04T16:45:31.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.570+0000 7ff7ca30a640 1 -- 172.21.15.170:0/3610704526 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7ac079e30 msgr2=0x7ff7ac07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:31.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.570+0000 7ff7ca30a640 1 --2- 172.21.15.170:0/3610704526 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7ac079e30 0x7ff7ac07c2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40096c0 tx=0x7ff7b4031400 comp rx=0 tx=0).stop 2024-09-04T16:45:31.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.570+0000 7ff7ca30a640 1 -- 172.21.15.170:0/3610704526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c41067e0 msgr2=0x7ff7c419db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:31.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.570+0000 7ff7ca30a640 1 --2- 172.21.15.170:0/3610704526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c41067e0 0x7ff7c419db60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800d6f0 tx=0x7ff7b800dbb0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.570+0000 7ff7ca30a640 1 -- 172.21.15.170:0/3610704526 shutdown_connections 2024-09-04T16:45:31.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.570+0000 7ff7ca30a640 1 --2- 172.21.15.170:0/3610704526 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff7ac079e30 0x7ff7ac07c2f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.570+0000 7ff7ca30a640 1 --2- 172.21.15.170:0/3610704526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c41067e0 0x7ff7c419db60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.570+0000 7ff7ca30a640 1 --2- 172.21.15.170:0/3610704526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7c41007e0 0x7ff7c419d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.570+0000 7ff7ca30a640 1 -- 172.21.15.170:0/3610704526 >> 172.21.15.170:0/3610704526 conn(0x7ff7c40fc4c0 msgr2=0x7ff7c4069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:31.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.570+0000 7ff7ca30a640 1 -- 172.21.15.170:0/3610704526 shutdown_connections 2024-09-04T16:45:31.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.570+0000 7ff7ca30a640 1 -- 172.21.15.170:0/3610704526 wait complete. 2024-09-04T16:45:31.581 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:45:31.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.653+0000 7fb514952640 1 -- 172.21.15.170:0/2047277997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb510100820 msgr2=0x7fb510100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:31.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.653+0000 7fb514952640 1 --2- 172.21.15.170:0/2047277997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb510100820 0x7fb510100c80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb504009880 tx=0x7fb50402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.653+0000 7fb514952640 1 -- 172.21.15.170:0/2047277997 shutdown_connections 2024-09-04T16:45:31.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.653+0000 7fb514952640 1 --2- 172.21.15.170:0/2047277997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb510100820 0x7fb510100c80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.653+0000 7fb514952640 1 --2- 172.21.15.170:0/2047277997 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb510106820 0x7fb510106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.653+0000 7fb514952640 1 -- 172.21.15.170:0/2047277997 >> 172.21.15.170:0/2047277997 conn(0x7fb5100fc520 msgr2=0x7fb5100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:31.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.653+0000 7fb514952640 1 -- 172.21.15.170:0/2047277997 shutdown_connections 2024-09-04T16:45:31.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.653+0000 7fb514952640 1 -- 172.21.15.170:0/2047277997 wait complete. 2024-09-04T16:45:31.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.654+0000 7fb514952640 1 Processor -- start 2024-09-04T16:45:31.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.654+0000 7fb514952640 1 -- start start 2024-09-04T16:45:31.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.654+0000 7fb514952640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb510100820 0x7fb51019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:31.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.654+0000 7fb514952640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb510106820 0x7fb51019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:31.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.654+0000 7fb514952640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb51010dcf0 con 0x7fb510106820 2024-09-04T16:45:31.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.654+0000 7fb514952640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb51010db70 con 0x7fb510100820 2024-09-04T16:45:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.655+0000 7fb50dd9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb510106820 0x7fb51019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.655+0000 7fb50dd9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb510106820 0x7fb51019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42090/0 (socket says 172.21.15.170:42090) 2024-09-04T16:45:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.655+0000 7fb50dd9b640 1 -- 172.21.15.170:0/4273350840 learned_addr learned my addr 172.21.15.170:0/4273350840 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:45:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.655+0000 7fb50e59c640 1 --2- 172.21.15.170:0/4273350840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb510100820 0x7fb51019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.655+0000 7fb50dd9b640 1 -- 172.21.15.170:0/4273350840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb510100820 msgr2=0x7fb51019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.655+0000 7fb50dd9b640 1 --2- 172.21.15.170:0/4273350840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb510100820 0x7fb51019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.655+0000 7fb50dd9b640 1 -- 172.21.15.170:0/4273350840 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb510197810 con 0x7fb510106820 2024-09-04T16:45:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.655+0000 7fb50e59c640 1 --2- 172.21.15.170:0/4273350840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb510100820 0x7fb51019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:45:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.655+0000 7fb50dd9b640 1 --2- 172.21.15.170:0/4273350840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb510106820 0x7fb51019dbd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb504031460 tx=0x7fb5040045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.655+0000 7fb4ff7fe640 1 -- 172.21.15.170:0/4273350840 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb50403f070 con 0x7fb510106820 2024-09-04T16:45:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.655+0000 7fb4ff7fe640 1 -- 172.21.15.170:0/4273350840 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb504004b10 con 0x7fb510106820 2024-09-04T16:45:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.655+0000 7fb4ff7fe640 1 -- 172.21.15.170:0/4273350840 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb504035030 con 0x7fb510106820 2024-09-04T16:45:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.655+0000 7fb514952640 1 -- 172.21.15.170:0/4273350840 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb510197aa0 con 0x7fb510106820 2024-09-04T16:45:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.655+0000 7fb514952640 1 -- 172.21.15.170:0/4273350840 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb510197fd0 con 0x7fb510106820 2024-09-04T16:45:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.656+0000 7fb514952640 1 -- 172.21.15.170:0/4273350840 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb510101f60 con 0x7fb510106820 2024-09-04T16:45:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.657+0000 7fb4ff7fe640 1 -- 172.21.15.170:0/4273350840 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fb504042070 con 0x7fb510106820 2024-09-04T16:45:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.658+0000 7fb4ff7fe640 1 --2- 172.21.15.170:0/4273350840 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb4f8079ee0 0x7fb4f807c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.658+0000 7fb4ff7fe640 1 -- 172.21.15.170:0/4273350840 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb5040bd430 con 0x7fb510106820 2024-09-04T16:45:31.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.658+0000 7fb50e59c640 1 --2- 172.21.15.170:0/4273350840 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb4f8079ee0 0x7fb4f807c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:31.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.658+0000 7fb50e59c640 1 --2- 172.21.15.170:0/4273350840 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb4f8079ee0 0x7fb4f807c3a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb5000058c0 tx=0x7fb500005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:31.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.662+0000 7fb4ff7fe640 1 -- 172.21.15.170:0/4273350840 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb504084f60 con 0x7fb510106820 2024-09-04T16:45:31.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.854+0000 7fb514952640 1 -- 172.21.15.170:0/4273350840 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb510198280 con 0x7fb4f8079ee0 2024-09-04T16:45:31.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.856+0000 7fb4ff7fe640 1 -- 172.21.15.170:0/4273350840 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fb510198280 con 0x7fb4f8079ee0 2024-09-04T16:45:31.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.858+0000 7fb514952640 1 -- 172.21.15.170:0/4273350840 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb4f8079ee0 msgr2=0x7fb4f807c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:31.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.858+0000 7fb514952640 1 --2- 172.21.15.170:0/4273350840 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb4f8079ee0 0x7fb4f807c3a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb5000058c0 tx=0x7fb500005850 comp rx=0 tx=0).stop 2024-09-04T16:45:31.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.858+0000 7fb514952640 1 -- 172.21.15.170:0/4273350840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb510106820 msgr2=0x7fb51019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:31.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.858+0000 7fb514952640 1 --2- 172.21.15.170:0/4273350840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb510106820 0x7fb51019dbd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb504031460 tx=0x7fb5040045e0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.858+0000 7fb514952640 1 -- 172.21.15.170:0/4273350840 shutdown_connections 2024-09-04T16:45:31.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.858+0000 7fb514952640 1 --2- 172.21.15.170:0/4273350840 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb4f8079ee0 0x7fb4f807c3a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.858+0000 7fb514952640 1 --2- 172.21.15.170:0/4273350840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb510106820 0x7fb51019dbd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.858+0000 7fb514952640 1 --2- 172.21.15.170:0/4273350840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb510100820 0x7fb51019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.858+0000 7fb514952640 1 -- 172.21.15.170:0/4273350840 >> 172.21.15.170:0/4273350840 conn(0x7fb5100fc520 msgr2=0x7fb51006a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:31.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.858+0000 7fb514952640 1 -- 172.21.15.170:0/4273350840 shutdown_connections 2024-09-04T16:45:31.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.858+0000 7fb514952640 1 -- 172.21.15.170:0/4273350840 wait complete. 2024-09-04T16:45:31.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.941+0000 7f76a5f8c640 1 -- 172.21.15.170:0/2135308563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76a0102b40 msgr2=0x7f76a0102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:31.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.941+0000 7f76a5f8c640 1 --2- 172.21.15.170:0/2135308563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76a0102b40 0x7f76a0102f20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7690009880 tx=0x7f769002a530 comp rx=0 tx=0).stop 2024-09-04T16:45:31.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.941+0000 7f76a5f8c640 1 -- 172.21.15.170:0/2135308563 shutdown_connections 2024-09-04T16:45:31.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.941+0000 7f76a5f8c640 1 --2- 172.21.15.170:0/2135308563 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76a0103460 0x7f76a010b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.941+0000 7f76a5f8c640 1 --2- 172.21.15.170:0/2135308563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76a0102b40 0x7f76a0102f20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.941+0000 7f76a5f8c640 1 -- 172.21.15.170:0/2135308563 >> 172.21.15.170:0/2135308563 conn(0x7f76a00fc4c0 msgr2=0x7f76a00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:31.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.941+0000 7f76a5f8c640 1 -- 172.21.15.170:0/2135308563 shutdown_connections 2024-09-04T16:45:31.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.941+0000 7f76a5f8c640 1 -- 172.21.15.170:0/2135308563 wait complete. 2024-09-04T16:45:31.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.942+0000 7f76a5f8c640 1 Processor -- start 2024-09-04T16:45:31.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.942+0000 7f76a5f8c640 1 -- start start 2024-09-04T16:45:31.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.942+0000 7f76a5f8c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76a0102b40 0x7f76a019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:31.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.942+0000 7f76a5f8c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76a0103460 0x7f76a019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:31.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.942+0000 7f76a5f8c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f76a010edd0 con 0x7f76a0102b40 2024-09-04T16:45:31.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.942+0000 7f76a5f8c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f76a010ec50 con 0x7f76a0103460 2024-09-04T16:45:31.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.942+0000 7f769f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76a0102b40 0x7f76a019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:31.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.942+0000 7f769f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76a0102b40 0x7f76a019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42104/0 (socket says 172.21.15.170:42104) 2024-09-04T16:45:31.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.942+0000 7f769f7fe640 1 -- 172.21.15.170:0/2449313205 learned_addr learned my addr 172.21.15.170:0/2449313205 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:45:31.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.942+0000 7f7697fff640 1 --2- 172.21.15.170:0/2449313205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76a0103460 0x7f76a019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:31.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.943+0000 7f769f7fe640 1 -- 172.21.15.170:0/2449313205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76a0103460 msgr2=0x7f76a019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:31.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.943+0000 7f769f7fe640 1 --2- 172.21.15.170:0/2449313205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76a0103460 0x7f76a019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:31.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.943+0000 7f769f7fe640 1 -- 172.21.15.170:0/2449313205 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a01977c0 con 0x7f76a0102b40 2024-09-04T16:45:31.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.943+0000 7f769f7fe640 1 --2- 172.21.15.170:0/2449313205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76a0102b40 0x7f76a019d640 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7690004f90 tx=0x7f76900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:31.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.943+0000 7f769d7fa640 1 -- 172.21.15.170:0/2449313205 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f769003f070 con 0x7f76a0102b40 2024-09-04T16:45:31.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.943+0000 7f76a5f8c640 1 -- 172.21.15.170:0/2449313205 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a0197a50 con 0x7f76a0102b40 2024-09-04T16:45:31.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.943+0000 7f769d7fa640 1 -- 172.21.15.170:0/2449313205 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7690004cf0 con 0x7f76a0102b40 2024-09-04T16:45:31.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.943+0000 7f769d7fa640 1 -- 172.21.15.170:0/2449313205 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7690035030 con 0x7f76a0102b40 2024-09-04T16:45:31.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.943+0000 7f76a5f8c640 1 -- 172.21.15.170:0/2449313205 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a0197f80 con 0x7f76a0102b40 2024-09-04T16:45:31.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.944+0000 7f76a5f8c640 1 -- 172.21.15.170:0/2449313205 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76a006a370 con 0x7f76a0102b40 2024-09-04T16:45:31.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.945+0000 7f769d7fa640 1 -- 172.21.15.170:0/2449313205 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f7690042070 con 0x7f76a0102b40 2024-09-04T16:45:31.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.945+0000 7f769d7fa640 1 --2- 172.21.15.170:0/2449313205 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f768c079e80 0x7f768c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:31.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.945+0000 7f769d7fa640 1 -- 172.21.15.170:0/2449313205 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f76900bd4e0 con 0x7f76a0102b40 2024-09-04T16:45:31.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.945+0000 7f7697fff640 1 --2- 172.21.15.170:0/2449313205 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f768c079e80 0x7f768c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:31.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.946+0000 7f7697fff640 1 --2- 172.21.15.170:0/2449313205 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f768c079e80 0x7f768c07c340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7688005fd0 tx=0x7f7688005e20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:31.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:31.950+0000 7f769d7fa640 1 -- 172.21.15.170:0/2449313205 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7690084f70 con 0x7f76a0102b40 2024-09-04T16:45:32.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.132+0000 7f76a5f8c640 1 -- 172.21.15.170:0/2449313205 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f76a01982f0 con 0x7f768c079e80 2024-09-04T16:45:32.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.142+0000 7f769d7fa640 1 -- 172.21.15.170:0/2449313205 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f76a01982f0 con 0x7f768c079e80 2024-09-04T16:45:32.142 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:45:32.142 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (12m) 6m ago 23m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:45:32.142 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (15m) 6m ago 23m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:45:32.143 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (15m) 6m ago 22m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:45:32.143 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (10m) 6m ago 23m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:45:32.143 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (10m) 6m ago 22m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:45:32.143 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (12m) 6m ago 23m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:45:32.143 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (6m) 6m ago 18m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:45:32.143 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (7m) 6m ago 18m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:45:32.143 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (6m) 6m ago 17m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:45:32.143 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (6m) 6m ago 18m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:45:32.143 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (14m) 6m ago 24m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:45:32.143 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (13m) 6m ago 22m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:45:32.143 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (11m) 6m ago 24m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:45:32.143 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (10m) 6m ago 22m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:45:32.143 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (13m) 6m ago 23m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:45:32.144 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (13m) 6m ago 22m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:45:32.144 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (10m) 6m ago 21m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:45:32.144 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (9m) 6m ago 20m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:45:32.144 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (9m) 6m ago 20m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:45:32.144 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (8m) 6m ago 19m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:45:32.144 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (7m) 6m ago 19m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:45:32.144 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (7m) 6m ago 19m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:45:32.144 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (12m) 6m ago 22m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:45:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.144+0000 7f76a5f8c640 1 -- 172.21.15.170:0/2449313205 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f768c079e80 msgr2=0x7f768c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.144+0000 7f76a5f8c640 1 --2- 172.21.15.170:0/2449313205 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f768c079e80 0x7f768c07c340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7688005fd0 tx=0x7f7688005e20 comp rx=0 tx=0).stop 2024-09-04T16:45:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.144+0000 7f76a5f8c640 1 -- 172.21.15.170:0/2449313205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76a0102b40 msgr2=0x7f76a019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.144+0000 7f76a5f8c640 1 --2- 172.21.15.170:0/2449313205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76a0102b40 0x7f76a019d640 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7690004f90 tx=0x7f76900048f0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.144+0000 7f76a5f8c640 1 -- 172.21.15.170:0/2449313205 shutdown_connections 2024-09-04T16:45:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.144+0000 7f76a5f8c640 1 --2- 172.21.15.170:0/2449313205 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f768c079e80 0x7f768c07c340 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.144+0000 7f76a5f8c640 1 --2- 172.21.15.170:0/2449313205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76a0103460 0x7f76a019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.144+0000 7f76a5f8c640 1 --2- 172.21.15.170:0/2449313205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76a0102b40 0x7f76a019d640 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.144+0000 7f76a5f8c640 1 -- 172.21.15.170:0/2449313205 >> 172.21.15.170:0/2449313205 conn(0x7f76a00fc4c0 msgr2=0x7f76a0103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:32.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.145+0000 7f76a5f8c640 1 -- 172.21.15.170:0/2449313205 shutdown_connections 2024-09-04T16:45:32.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.145+0000 7f76a5f8c640 1 -- 172.21.15.170:0/2449313205 wait complete. 2024-09-04T16:45:32.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.226+0000 7f319e399640 1 -- 172.21.15.170:0/2294636406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31981067e0 msgr2=0x7f3198106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:32.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.226+0000 7f319e399640 1 --2- 172.21.15.170:0/2294636406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31981067e0 0x7f3198106bc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3188009880 tx=0x7f318802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.226+0000 7f319e399640 1 -- 172.21.15.170:0/2294636406 shutdown_connections 2024-09-04T16:45:32.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.226+0000 7f319e399640 1 --2- 172.21.15.170:0/2294636406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31981007e0 0x7f3198100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.226+0000 7f319e399640 1 --2- 172.21.15.170:0/2294636406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31981067e0 0x7f3198106bc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.226+0000 7f319e399640 1 -- 172.21.15.170:0/2294636406 >> 172.21.15.170:0/2294636406 conn(0x7f31980fc4c0 msgr2=0x7f31980fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:32.227 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:31 smithi170 ceph-mon[113855]: pgmap v474: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:32.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.226+0000 7f319e399640 1 -- 172.21.15.170:0/2294636406 shutdown_connections 2024-09-04T16:45:32.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.226+0000 7f319e399640 1 -- 172.21.15.170:0/2294636406 wait complete. 2024-09-04T16:45:32.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.227+0000 7f319e399640 1 Processor -- start 2024-09-04T16:45:32.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.227+0000 7f319e399640 1 -- start start 2024-09-04T16:45:32.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.227+0000 7f319e399640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31981007e0 0x7f31980fccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:32.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.227+0000 7f319e399640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31981067e0 0x7f31980fd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:32.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.227+0000 7f319e399640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f319810dcb0 con 0x7f31981007e0 2024-09-04T16:45:32.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.227+0000 7f319e399640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f319810db30 con 0x7f31981067e0 2024-09-04T16:45:32.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.227+0000 7f3197fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31981007e0 0x7f31980fccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:32.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.227+0000 7f3197fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31981007e0 0x7f31980fccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42126/0 (socket says 172.21.15.170:42126) 2024-09-04T16:45:32.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.227+0000 7f3197fff640 1 -- 172.21.15.170:0/3073623332 learned_addr learned my addr 172.21.15.170:0/3073623332 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:45:32.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.228+0000 7f31977fe640 1 --2- 172.21.15.170:0/3073623332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31981067e0 0x7f31980fd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:32.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.228+0000 7f3197fff640 1 -- 172.21.15.170:0/3073623332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31981067e0 msgr2=0x7f31980fd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:32.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.228+0000 7f3197fff640 1 --2- 172.21.15.170:0/3073623332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31981067e0 0x7f31980fd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.228+0000 7f3197fff640 1 -- 172.21.15.170:0/3073623332 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31980fd730 con 0x7f31981007e0 2024-09-04T16:45:32.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.228+0000 7f31977fe640 1 --2- 172.21.15.170:0/3073623332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31981067e0 0x7f31980fd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:45:32.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.228+0000 7f3197fff640 1 --2- 172.21.15.170:0/3073623332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31981007e0 0x7f31980fccb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3188031460 tx=0x7f31880045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:32.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.228+0000 7f31957fa640 1 -- 172.21.15.170:0/3073623332 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f318803f070 con 0x7f31981007e0 2024-09-04T16:45:32.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.228+0000 7f31957fa640 1 -- 172.21.15.170:0/3073623332 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31880035f0 con 0x7f31981007e0 2024-09-04T16:45:32.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.228+0000 7f319e399640 1 -- 172.21.15.170:0/3073623332 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31980fd9c0 con 0x7f31981007e0 2024-09-04T16:45:32.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.228+0000 7f31957fa640 1 -- 172.21.15.170:0/3073623332 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3188035030 con 0x7f31981007e0 2024-09-04T16:45:32.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.228+0000 7f319e399640 1 -- 172.21.15.170:0/3073623332 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31981a3d60 con 0x7f31981007e0 2024-09-04T16:45:32.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.229+0000 7f319e399640 1 -- 172.21.15.170:0/3073623332 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3198101f20 con 0x7f31981007e0 2024-09-04T16:45:32.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.230+0000 7f31957fa640 1 -- 172.21.15.170:0/3073623332 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f3188042070 con 0x7f31981007e0 2024-09-04T16:45:32.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.230+0000 7f31957fa640 1 --2- 172.21.15.170:0/3073623332 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3184079e80 0x7f318407c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:32.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.231+0000 7f31957fa640 1 -- 172.21.15.170:0/3073623332 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f31880bd3b0 con 0x7f31981007e0 2024-09-04T16:45:32.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.231+0000 7f31977fe640 1 --2- 172.21.15.170:0/3073623332 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3184079e80 0x7f318407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:32.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.231+0000 7f31977fe640 1 --2- 172.21.15.170:0/3073623332 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3184079e80 0x7f318407c340 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f31800058c0 tx=0x7f3180005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:32.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.235+0000 7f31957fa640 1 -- 172.21.15.170:0/3073623332 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3188084e40 con 0x7f31981007e0 2024-09-04T16:45:32.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:31 smithi193 ceph-mon[82547]: pgmap v474: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:32.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.480+0000 7f319e399640 1 -- 172.21.15.170:0/3073623332 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f319802d7c0 con 0x7f31981007e0 2024-09-04T16:45:32.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.480+0000 7f31957fa640 1 -- 172.21.15.170:0/3073623332 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f318808d2f0 con 0x7f31981007e0 2024-09-04T16:45:32.481 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:45:32.481 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:45:32.481 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:45:32.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:45:32.481 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:45:32.481 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:45:32.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:45:32.482 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:45:32.482 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:45:32.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:45:32.482 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:45:32.482 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:45:32.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:45:32.482 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:45:32.482 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:45:32.482 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:45:32.482 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:45:32.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.482+0000 7f319e399640 1 -- 172.21.15.170:0/3073623332 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3184079e80 msgr2=0x7f318407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:32.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.482+0000 7f319e399640 1 --2- 172.21.15.170:0/3073623332 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3184079e80 0x7f318407c340 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f31800058c0 tx=0x7f3180005850 comp rx=0 tx=0).stop 2024-09-04T16:45:32.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.482+0000 7f319e399640 1 -- 172.21.15.170:0/3073623332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31981007e0 msgr2=0x7f31980fccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:32.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.483+0000 7f319e399640 1 --2- 172.21.15.170:0/3073623332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31981007e0 0x7f31980fccb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3188031460 tx=0x7f31880045e0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.483+0000 7f319e399640 1 -- 172.21.15.170:0/3073623332 shutdown_connections 2024-09-04T16:45:32.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.483+0000 7f319e399640 1 --2- 172.21.15.170:0/3073623332 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3184079e80 0x7f318407c340 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.483+0000 7f319e399640 1 --2- 172.21.15.170:0/3073623332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31981067e0 0x7f31980fd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.483+0000 7f319e399640 1 --2- 172.21.15.170:0/3073623332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31981007e0 0x7f31980fccb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.483+0000 7f319e399640 1 -- 172.21.15.170:0/3073623332 >> 172.21.15.170:0/3073623332 conn(0x7f31980fc4c0 msgr2=0x7f3198069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:32.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.483+0000 7f319e399640 1 -- 172.21.15.170:0/3073623332 shutdown_connections 2024-09-04T16:45:32.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.483+0000 7f319e399640 1 -- 172.21.15.170:0/3073623332 wait complete. 2024-09-04T16:45:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.564+0000 7f64b67ec640 1 -- 172.21.15.170:0/585095826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64b0100820 msgr2=0x7f64b0100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.564+0000 7f64b67ec640 1 --2- 172.21.15.170:0/585095826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64b0100820 0x7f64b0100c80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6498009880 tx=0x7f649802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.564+0000 7f64b67ec640 1 -- 172.21.15.170:0/585095826 shutdown_connections 2024-09-04T16:45:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.564+0000 7f64b67ec640 1 --2- 172.21.15.170:0/585095826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64b0100820 0x7f64b0100c80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.564+0000 7f64b67ec640 1 --2- 172.21.15.170:0/585095826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64b0106820 0x7f64b0106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.564+0000 7f64b67ec640 1 -- 172.21.15.170:0/585095826 >> 172.21.15.170:0/585095826 conn(0x7f64b00fc520 msgr2=0x7f64b00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.564+0000 7f64b67ec640 1 -- 172.21.15.170:0/585095826 shutdown_connections 2024-09-04T16:45:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.564+0000 7f64b67ec640 1 -- 172.21.15.170:0/585095826 wait complete. 2024-09-04T16:45:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.564+0000 7f64b67ec640 1 Processor -- start 2024-09-04T16:45:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.565+0000 7f64b67ec640 1 -- start start 2024-09-04T16:45:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.565+0000 7f64b67ec640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64b0100820 0x7f64b019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.565+0000 7f64b67ec640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64b0106820 0x7f64b019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.565+0000 7f64b67ec640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f64b010dcf0 con 0x7f64b0106820 2024-09-04T16:45:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.565+0000 7f64b67ec640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f64b010db70 con 0x7f64b0100820 2024-09-04T16:45:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.565+0000 7f64af7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64b0106820 0x7f64b019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.565+0000 7f64af7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64b0106820 0x7f64b019dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42142/0 (socket says 172.21.15.170:42142) 2024-09-04T16:45:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.565+0000 7f64af7fe640 1 -- 172.21.15.170:0/3309754607 learned_addr learned my addr 172.21.15.170:0/3309754607 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:45:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.565+0000 7f64affff640 1 --2- 172.21.15.170:0/3309754607 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64b0100820 0x7f64b019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.565+0000 7f64af7fe640 1 -- 172.21.15.170:0/3309754607 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64b0100820 msgr2=0x7f64b019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.565+0000 7f64af7fe640 1 --2- 172.21.15.170:0/3309754607 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64b0100820 0x7f64b019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.565+0000 7f64af7fe640 1 -- 172.21.15.170:0/3309754607 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b01977e0 con 0x7f64b0106820 2024-09-04T16:45:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.566+0000 7f64af7fe640 1 --2- 172.21.15.170:0/3309754607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64b0106820 0x7f64b019dba0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6498031460 tx=0x7f6498004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.566+0000 7f64ad7fa640 1 -- 172.21.15.170:0/3309754607 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f649803f070 con 0x7f64b0106820 2024-09-04T16:45:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.566+0000 7f64ad7fa640 1 -- 172.21.15.170:0/3309754607 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64980035f0 con 0x7f64b0106820 2024-09-04T16:45:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.566+0000 7f64b67ec640 1 -- 172.21.15.170:0/3309754607 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b0197a70 con 0x7f64b0106820 2024-09-04T16:45:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.566+0000 7f64ad7fa640 1 -- 172.21.15.170:0/3309754607 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6498035030 con 0x7f64b0106820 2024-09-04T16:45:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.566+0000 7f64b67ec640 1 -- 172.21.15.170:0/3309754607 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b0197fa0 con 0x7f64b0106820 2024-09-04T16:45:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.567+0000 7f64b67ec640 1 -- 172.21.15.170:0/3309754607 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b0101f60 con 0x7f64b0106820 2024-09-04T16:45:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.568+0000 7f64ad7fa640 1 -- 172.21.15.170:0/3309754607 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f6498042070 con 0x7f64b0106820 2024-09-04T16:45:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.568+0000 7f64ad7fa640 1 --2- 172.21.15.170:0/3309754607 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f649c079e80 0x7f649c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.568+0000 7f64ad7fa640 1 -- 172.21.15.170:0/3309754607 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f64980bd380 con 0x7f64b0106820 2024-09-04T16:45:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.568+0000 7f64affff640 1 --2- 172.21.15.170:0/3309754607 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f649c079e80 0x7f649c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.569+0000 7f64affff640 1 --2- 172.21.15.170:0/3309754607 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f649c079e80 0x7f649c07c340 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009b60 tx=0x7f64a0005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:32.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.572+0000 7f64ad7fa640 1 -- 172.21.15.170:0/3309754607 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6498084e10 con 0x7f64b0106820 2024-09-04T16:45:32.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.781+0000 7f64b67ec640 1 -- 172.21.15.170:0/3309754607 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f64b0109da0 con 0x7f64b0106820 2024-09-04T16:45:32.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.781+0000 7f64ad7fa640 1 -- 172.21.15.170:0/3309754607 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7f6498088f80 con 0x7f64b0106820 2024-09-04T16:45:32.782 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:45:32.782 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:45:32.782 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:45:32.782 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:45:32.782 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:45:32.783 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:45:32.783 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:45:32.783 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:45:32.783 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:45:32.783 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:45:32.783 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:45:32.783 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:45:32.783 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:45:32.783 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:45:32.783 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:45:32.784 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:45:32.784 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:45:32.784 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:45:32.784 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:45:32.784 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:45:32.784 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:45:32.784 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:45:32.784 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:45:32.784 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:45:32.784 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:45:32.784 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:45:32.785 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:45:32.785 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:45:32.785 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:45:32.785 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:45:32.785 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:45:32.785 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:45:32.785 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:45:32.785 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:45:32.785 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:45:32.785 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:45:32.785 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:45:32.785 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:45:32.785 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:45:32.786 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:45:32.786 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:45:32.786 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:45:32.786 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:45:32.786 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:45:32.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.783+0000 7f64b67ec640 1 -- 172.21.15.170:0/3309754607 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f649c079e80 msgr2=0x7f649c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:32.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.783+0000 7f64b67ec640 1 --2- 172.21.15.170:0/3309754607 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f649c079e80 0x7f649c07c340 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009b60 tx=0x7f64a0005f90 comp rx=0 tx=0).stop 2024-09-04T16:45:32.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.783+0000 7f64b67ec640 1 -- 172.21.15.170:0/3309754607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64b0106820 msgr2=0x7f64b019dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:32.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.783+0000 7f64b67ec640 1 --2- 172.21.15.170:0/3309754607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64b0106820 0x7f64b019dba0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6498031460 tx=0x7f6498004530 comp rx=0 tx=0).stop 2024-09-04T16:45:32.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.783+0000 7f64b67ec640 1 -- 172.21.15.170:0/3309754607 shutdown_connections 2024-09-04T16:45:32.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.783+0000 7f64b67ec640 1 --2- 172.21.15.170:0/3309754607 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f649c079e80 0x7f649c07c340 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.783+0000 7f64b67ec640 1 --2- 172.21.15.170:0/3309754607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64b0106820 0x7f64b019dba0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.783+0000 7f64b67ec640 1 --2- 172.21.15.170:0/3309754607 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64b0100820 0x7f64b019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.783+0000 7f64b67ec640 1 -- 172.21.15.170:0/3309754607 >> 172.21.15.170:0/3309754607 conn(0x7f64b00fc520 msgr2=0x7f64b006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:32.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.784+0000 7f64b67ec640 1 -- 172.21.15.170:0/3309754607 shutdown_connections 2024-09-04T16:45:32.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.784+0000 7f64b67ec640 1 -- 172.21.15.170:0/3309754607 wait complete. 2024-09-04T16:45:32.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.867+0000 7f4aee26b640 1 -- 172.21.15.170:0/3677487194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ae8101930 msgr2=0x7f4ae8101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:32.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.867+0000 7f4aee26b640 1 --2- 172.21.15.170:0/3677487194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ae8101930 0x7f4ae8101d90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009880 tx=0x7f4adc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.867+0000 7f4aee26b640 1 -- 172.21.15.170:0/3677487194 shutdown_connections 2024-09-04T16:45:32.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.867+0000 7f4aee26b640 1 --2- 172.21.15.170:0/3677487194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ae8101930 0x7f4ae8101d90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.867+0000 7f4aee26b640 1 --2- 172.21.15.170:0/3677487194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ae8107930 0x7f4ae8107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.867+0000 7f4aee26b640 1 -- 172.21.15.170:0/3677487194 >> 172.21.15.170:0/3677487194 conn(0x7f4ae80fd630 msgr2=0x7f4ae80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:32.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.867+0000 7f4aee26b640 1 -- 172.21.15.170:0/3677487194 shutdown_connections 2024-09-04T16:45:32.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.867+0000 7f4aee26b640 1 -- 172.21.15.170:0/3677487194 wait complete. 2024-09-04T16:45:32.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.868+0000 7f4aee26b640 1 Processor -- start 2024-09-04T16:45:32.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.868+0000 7f4aee26b640 1 -- start start 2024-09-04T16:45:32.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.868+0000 7f4aee26b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ae8101930 0x7f4ae80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:32.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.868+0000 7f4aee26b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ae8107930 0x7f4ae8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:32.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.868+0000 7f4aee26b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae810ee00 con 0x7f4ae8101930 2024-09-04T16:45:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.868+0000 7f4aee26b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae810ec80 con 0x7f4ae8107930 2024-09-04T16:45:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.868+0000 7f4ae7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ae8101930 0x7f4ae80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.868+0000 7f4ae7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ae8101930 0x7f4ae80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42162/0 (socket says 172.21.15.170:42162) 2024-09-04T16:45:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.868+0000 7f4ae7fff640 1 -- 172.21.15.170:0/4230002147 learned_addr learned my addr 172.21.15.170:0/4230002147 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:45:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.868+0000 7f4ae77fe640 1 --2- 172.21.15.170:0/4230002147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ae8107930 0x7f4ae8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.868+0000 7f4ae7fff640 1 -- 172.21.15.170:0/4230002147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ae8107930 msgr2=0x7f4ae8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.869+0000 7f4ae7fff640 1 --2- 172.21.15.170:0/4230002147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ae8107930 0x7f4ae8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.869+0000 7f4ae7fff640 1 -- 172.21.15.170:0/4230002147 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae8074f70 con 0x7f4ae8101930 2024-09-04T16:45:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.869+0000 7f4ae7fff640 1 --2- 172.21.15.170:0/4230002147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ae8101930 0x7f4ae80744f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800c8f0 tx=0x7f4ad800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.869+0000 7f4ae57fa640 1 -- 172.21.15.170:0/4230002147 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ad80079b0 con 0x7f4ae8101930 2024-09-04T16:45:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.869+0000 7f4ae57fa640 1 -- 172.21.15.170:0/4230002147 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ad80054e0 con 0x7f4ae8101930 2024-09-04T16:45:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.869+0000 7f4aee26b640 1 -- 172.21.15.170:0/4230002147 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae8075260 con 0x7f4ae8101930 2024-09-04T16:45:32.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.869+0000 7f4ae57fa640 1 -- 172.21.15.170:0/4230002147 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ad8004dd0 con 0x7f4ae8101930 2024-09-04T16:45:32.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.869+0000 7f4aee26b640 1 -- 172.21.15.170:0/4230002147 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae81a3e90 con 0x7f4ae8101930 2024-09-04T16:45:32.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.870+0000 7f4aee26b640 1 -- 172.21.15.170:0/4230002147 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae8103070 con 0x7f4ae8101930 2024-09-04T16:45:32.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.871+0000 7f4ae57fa640 1 -- 172.21.15.170:0/4230002147 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f4ad8005020 con 0x7f4ae8101930 2024-09-04T16:45:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.871+0000 7f4ae57fa640 1 --2- 172.21.15.170:0/4230002147 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4ad0079e30 0x7f4ad007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.871+0000 7f4ae57fa640 1 -- 172.21.15.170:0/4230002147 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4ad809c9d0 con 0x7f4ae8101930 2024-09-04T16:45:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.871+0000 7f4ae77fe640 1 --2- 172.21.15.170:0/4230002147 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4ad0079e30 0x7f4ad007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.872+0000 7f4ae77fe640 1 --2- 172.21.15.170:0/4230002147 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4ad0079e30 0x7f4ad007c2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8075f80 tx=0x7f4adc031420 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:32.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:32.875+0000 7f4ae57fa640 1 -- 172.21.15.170:0/4230002147 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4ad8014030 con 0x7f4ae8101930 2024-09-04T16:45:33.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.074+0000 7f4aee26b640 1 -- 172.21.15.170:0/4230002147 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4ae8062630 con 0x7f4ad0079e30 2024-09-04T16:45:33.075 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:32 smithi170 ceph-mon[113855]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:45:33.075 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:32 smithi170 ceph-mon[113855]: from='client.34702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:45:33.075 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:32 smithi170 ceph-mon[113855]: from='client.34706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:45:33.076 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:32 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3073623332' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:45:33.076 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:32 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3309754607' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:45:33.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.075+0000 7f4ae57fa640 1 -- 172.21.15.170:0/4230002147 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f4ae8062630 con 0x7f4ad0079e30 2024-09-04T16:45:33.076 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:45:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:45:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:45:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:45:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:45:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:45:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:45:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:45:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:45:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:45:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:45:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:45:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:45:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:45:33.077 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:45:33.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.078+0000 7f4aee26b640 1 -- 172.21.15.170:0/4230002147 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4ad0079e30 msgr2=0x7f4ad007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:33.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.078+0000 7f4aee26b640 1 --2- 172.21.15.170:0/4230002147 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4ad0079e30 0x7f4ad007c2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8075f80 tx=0x7f4adc031420 comp rx=0 tx=0).stop 2024-09-04T16:45:33.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.078+0000 7f4aee26b640 1 -- 172.21.15.170:0/4230002147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ae8101930 msgr2=0x7f4ae80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:33.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.078+0000 7f4aee26b640 1 --2- 172.21.15.170:0/4230002147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ae8101930 0x7f4ae80744f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800c8f0 tx=0x7f4ad800cdb0 comp rx=0 tx=0).stop 2024-09-04T16:45:33.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.078+0000 7f4aee26b640 1 -- 172.21.15.170:0/4230002147 shutdown_connections 2024-09-04T16:45:33.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.078+0000 7f4aee26b640 1 --2- 172.21.15.170:0/4230002147 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4ad0079e30 0x7f4ad007c2f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:33.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.078+0000 7f4aee26b640 1 --2- 172.21.15.170:0/4230002147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ae8107930 0x7f4ae8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:33.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.078+0000 7f4aee26b640 1 --2- 172.21.15.170:0/4230002147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ae8101930 0x7f4ae80744f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:33.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.078+0000 7f4aee26b640 1 -- 172.21.15.170:0/4230002147 >> 172.21.15.170:0/4230002147 conn(0x7f4ae80fd630 msgr2=0x7f4ae80fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:33.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.078+0000 7f4aee26b640 1 -- 172.21.15.170:0/4230002147 shutdown_connections 2024-09-04T16:45:33.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.078+0000 7f4aee26b640 1 -- 172.21.15.170:0/4230002147 wait complete. 2024-09-04T16:45:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.159+0000 7f2900094640 1 -- 172.21.15.170:0/210313486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f81011e0 msgr2=0x7f28f81056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.159+0000 7f2900094640 1 --2- 172.21.15.170:0/210313486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f81011e0 0x7f28f81056b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009880 tx=0x7f28e802a530 comp rx=0 tx=0).stop 2024-09-04T16:45:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.159+0000 7f2900094640 1 -- 172.21.15.170:0/210313486 shutdown_connections 2024-09-04T16:45:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.159+0000 7f2900094640 1 --2- 172.21.15.170:0/210313486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f81011e0 0x7f28f81056b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.159+0000 7f2900094640 1 --2- 172.21.15.170:0/210313486 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28f81008c0 0x7f28f8100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.159+0000 7f2900094640 1 -- 172.21.15.170:0/210313486 >> 172.21.15.170:0/210313486 conn(0x7f28f80fc510 msgr2=0x7f28f80fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.159+0000 7f2900094640 1 -- 172.21.15.170:0/210313486 shutdown_connections 2024-09-04T16:45:33.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.159+0000 7f2900094640 1 -- 172.21.15.170:0/210313486 wait complete. 2024-09-04T16:45:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.160+0000 7f2900094640 1 Processor -- start 2024-09-04T16:45:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.160+0000 7f2900094640 1 -- start start 2024-09-04T16:45:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.160+0000 7f2900094640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28f81008c0 0x7f28f819dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.160+0000 7f2900094640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f81011e0 0x7f28f819e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.160+0000 7f2900094640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f28f8115400 con 0x7f28f81011e0 2024-09-04T16:45:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.160+0000 7f2900094640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f28f8115280 con 0x7f28f81008c0 2024-09-04T16:45:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.160+0000 7f28fd62f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f81011e0 0x7f28f819e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.160+0000 7f28fd62f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f81011e0 0x7f28f819e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42188/0 (socket says 172.21.15.170:42188) 2024-09-04T16:45:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.160+0000 7f28fd62f640 1 -- 172.21.15.170:0/1707115044 learned_addr learned my addr 172.21.15.170:0/1707115044 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:45:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.160+0000 7f28fde30640 1 --2- 172.21.15.170:0/1707115044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28f81008c0 0x7f28f819dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.161+0000 7f28fd62f640 1 -- 172.21.15.170:0/1707115044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28f81008c0 msgr2=0x7f28f819dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.161+0000 7f28fd62f640 1 --2- 172.21.15.170:0/1707115044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28f81008c0 0x7f28f819dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.161+0000 7f28fd62f640 1 -- 172.21.15.170:0/1707115044 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f81a2890 con 0x7f28f81011e0 2024-09-04T16:45:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.161+0000 7f28fd62f640 1 --2- 172.21.15.170:0/1707115044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f81011e0 0x7f28f819e500 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f28e8031460 tx=0x7f28e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.161+0000 7f28eeffd640 1 -- 172.21.15.170:0/1707115044 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f28e803f070 con 0x7f28f81011e0 2024-09-04T16:45:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.161+0000 7f28eeffd640 1 -- 172.21.15.170:0/1707115044 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f28e8004ac0 con 0x7f28f81011e0 2024-09-04T16:45:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.161+0000 7f2900094640 1 -- 172.21.15.170:0/1707115044 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f81a2b20 con 0x7f28f81011e0 2024-09-04T16:45:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.161+0000 7f28eeffd640 1 -- 172.21.15.170:0/1707115044 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f28e8035030 con 0x7f28f81011e0 2024-09-04T16:45:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.161+0000 7f2900094640 1 -- 172.21.15.170:0/1707115044 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f81a3050 con 0x7f28f81011e0 2024-09-04T16:45:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.162+0000 7f2900094640 1 -- 172.21.15.170:0/1707115044 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f806abe0 con 0x7f28f81011e0 2024-09-04T16:45:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.163+0000 7f28eeffd640 1 -- 172.21.15.170:0/1707115044 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f28e8042070 con 0x7f28f81011e0 2024-09-04T16:45:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.163+0000 7f28eeffd640 1 --2- 172.21.15.170:0/1707115044 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f28e4079e40 0x7f28e407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:45:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.163+0000 7f28fde30640 1 --2- 172.21.15.170:0/1707115044 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f28e4079e40 0x7f28e407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:45:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.163+0000 7f28eeffd640 1 -- 172.21.15.170:0/1707115044 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f28e80bd470 con 0x7f28f81011e0 2024-09-04T16:45:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.164+0000 7f28fde30640 1 --2- 172.21.15.170:0/1707115044 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f28e4079e40 0x7f28e407c300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f28f40058c0 tx=0x7f28f400a250 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:45:33.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.167+0000 7f28eeffd640 1 -- 172.21.15.170:0/1707115044 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f28e8088ff0 con 0x7f28f81011e0 2024-09-04T16:45:33.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:32 smithi193 ceph-mon[82547]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:45:33.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:32 smithi193 ceph-mon[82547]: from='client.34702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:45:33.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:32 smithi193 ceph-mon[82547]: from='client.34706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:45:33.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:32 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3073623332' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:45:33.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:32 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3309754607' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:45:33.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.416+0000 7f2900094640 1 -- 172.21.15.170:0/1707115044 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f28f819f320 con 0x7f28f81011e0 2024-09-04T16:45:33.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.416+0000 7f28eeffd640 1 -- 172.21.15.170:0/1707115044 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f28e808d330 con 0x7f28f81011e0 2024-09-04T16:45:33.417 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:45:33.418 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:45:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:45:33.418 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:45:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:45:33.418 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:45:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:45:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.419+0000 7f2900094640 1 -- 172.21.15.170:0/1707115044 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f28e4079e40 msgr2=0x7f28e407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.419+0000 7f2900094640 1 --2- 172.21.15.170:0/1707115044 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f28e4079e40 0x7f28e407c300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f28f40058c0 tx=0x7f28f400a250 comp rx=0 tx=0).stop 2024-09-04T16:45:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.419+0000 7f2900094640 1 -- 172.21.15.170:0/1707115044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f81011e0 msgr2=0x7f28f819e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:45:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.419+0000 7f2900094640 1 --2- 172.21.15.170:0/1707115044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f81011e0 0x7f28f819e500 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f28e8031460 tx=0x7f28e80046c0 comp rx=0 tx=0).stop 2024-09-04T16:45:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.419+0000 7f2900094640 1 -- 172.21.15.170:0/1707115044 shutdown_connections 2024-09-04T16:45:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.419+0000 7f2900094640 1 --2- 172.21.15.170:0/1707115044 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f28e4079e40 0x7f28e407c300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.419+0000 7f2900094640 1 --2- 172.21.15.170:0/1707115044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f81011e0 0x7f28f819e500 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.419+0000 7f2900094640 1 --2- 172.21.15.170:0/1707115044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28f81008c0 0x7f28f819dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:45:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.419+0000 7f2900094640 1 -- 172.21.15.170:0/1707115044 >> 172.21.15.170:0/1707115044 conn(0x7f28f80fc510 msgr2=0x7f28f8112bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:45:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.419+0000 7f2900094640 1 -- 172.21.15.170:0/1707115044 shutdown_connections 2024-09-04T16:45:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:45:33.419+0000 7f2900094640 1 -- 172.21.15.170:0/1707115044 wait complete. 2024-09-04T16:45:34.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:33 smithi170 ceph-mon[113855]: pgmap v475: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:34.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:33 smithi170 ceph-mon[113855]: from='client.34718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:45:34.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:33 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1707115044' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:45:34.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:33 smithi193 ceph-mon[82547]: pgmap v475: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:34.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:33 smithi193 ceph-mon[82547]: from='client.34718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:45:34.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:33 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1707115044' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:45:36.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:35 smithi170 ceph-mon[113855]: pgmap v476: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:36.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:35 smithi193 ceph-mon[82547]: pgmap v476: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:38.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:37 smithi170 ceph-mon[113855]: pgmap v477: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:38.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:37 smithi193 ceph-mon[82547]: pgmap v477: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:40.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:39 smithi170 ceph-mon[113855]: pgmap v478: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:40.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:39 smithi193 ceph-mon[82547]: pgmap v478: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:42.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:42 smithi170 ceph-mon[113855]: pgmap v479: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:42.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:42 smithi193 ceph-mon[82547]: pgmap v479: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:44.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:44 smithi170 ceph-mon[113855]: pgmap v480: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:44.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:44 smithi193 ceph-mon[82547]: pgmap v480: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:45.228 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:45 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:45:45.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:45 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:45:46.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:46 smithi170 ceph-mon[113855]: pgmap v481: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:46.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:46 smithi193 ceph-mon[82547]: pgmap v481: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:48.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:48 smithi170 ceph-mon[113855]: pgmap v482: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:48.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:48 smithi193 ceph-mon[82547]: pgmap v482: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:50.276 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:50 smithi170 ceph-mon[113855]: pgmap v483: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:50.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:50 smithi193 ceph-mon[82547]: pgmap v483: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:52.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:52 smithi170 ceph-mon[113855]: pgmap v484: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:52.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:52 smithi193 ceph-mon[82547]: pgmap v484: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:54.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:54 smithi170 ceph-mon[113855]: pgmap v485: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:54.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:54 smithi193 ceph-mon[82547]: pgmap v485: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:56.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:56 smithi170 ceph-mon[113855]: pgmap v486: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:56.374 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:56 smithi193 ceph-mon[82547]: pgmap v486: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:58.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:45:58 smithi170 ceph-mon[113855]: pgmap v487: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:45:58.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:45:58 smithi193 ceph-mon[82547]: pgmap v487: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:00.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:00 smithi170 ceph-mon[113855]: pgmap v488: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:00.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:00 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:46:00.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:00 smithi193 ceph-mon[82547]: pgmap v488: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:00.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:00 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:46:02.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:02 smithi170 ceph-mon[113855]: pgmap v489: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:02.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:02 smithi193 ceph-mon[82547]: pgmap v489: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:03.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.512+0000 7ff7b632c640 1 -- 172.21.15.170:0/172440022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b0106820 msgr2=0x7ff7b0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:03.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.512+0000 7ff7b632c640 1 --2- 172.21.15.170:0/172440022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b0106820 0x7ff7b0106c00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009900 tx=0x7ff7a002c6e0 comp rx=0 tx=0).stop 2024-09-04T16:46:03.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.512+0000 7ff7b632c640 1 -- 172.21.15.170:0/172440022 shutdown_connections 2024-09-04T16:46:03.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.512+0000 7ff7b632c640 1 --2- 172.21.15.170:0/172440022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7b0100820 0x7ff7b0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:03.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.512+0000 7ff7b632c640 1 --2- 172.21.15.170:0/172440022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b0106820 0x7ff7b0106c00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:03.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.512+0000 7ff7b632c640 1 -- 172.21.15.170:0/172440022 >> 172.21.15.170:0/172440022 conn(0x7ff7b00fc520 msgr2=0x7ff7b00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:03.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.512+0000 7ff7b632c640 1 -- 172.21.15.170:0/172440022 shutdown_connections 2024-09-04T16:46:03.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.512+0000 7ff7b632c640 1 -- 172.21.15.170:0/172440022 wait complete. 2024-09-04T16:46:03.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.512+0000 7ff7b632c640 1 Processor -- start 2024-09-04T16:46:03.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.512+0000 7ff7b632c640 1 -- start start 2024-09-04T16:46:03.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.513+0000 7ff7b632c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b0100820 0x7ff7b019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:03.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.513+0000 7ff7b632c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7b0106820 0x7ff7b019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:03.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.513+0000 7ff7b632c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b010cc00 con 0x7ff7b0100820 2024-09-04T16:46:03.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.513+0000 7ff7b632c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b010ca80 con 0x7ff7b0106820 2024-09-04T16:46:03.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.513+0000 7ff7affff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b0100820 0x7ff7b019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:03.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.513+0000 7ff7affff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b0100820 0x7ff7b019b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47700/0 (socket says 172.21.15.170:47700) 2024-09-04T16:46:03.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.513+0000 7ff7affff640 1 -- 172.21.15.170:0/3970690155 learned_addr learned my addr 172.21.15.170:0/3970690155 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:46:03.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.513+0000 7ff7affff640 1 -- 172.21.15.170:0/3970690155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7b0106820 msgr2=0x7ff7b019b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:03.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.513+0000 7ff7affff640 1 --2- 172.21.15.170:0/3970690155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7b0106820 0x7ff7b019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:03.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.513+0000 7ff7affff640 1 -- 172.21.15.170:0/3970690155 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b01955f0 con 0x7ff7b0100820 2024-09-04T16:46:03.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.515+0000 7ff7affff640 1 --2- 172.21.15.170:0/3970690155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b0100820 0x7ff7b019b430 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0033460 tx=0x7ff7a00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:03.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.515+0000 7ff7ad7fa640 1 -- 172.21.15.170:0/3970690155 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7a0041070 con 0x7ff7b0100820 2024-09-04T16:46:03.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.515+0000 7ff7ad7fa640 1 -- 172.21.15.170:0/3970690155 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7a00035f0 con 0x7ff7b0100820 2024-09-04T16:46:03.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.515+0000 7ff7b632c640 1 -- 172.21.15.170:0/3970690155 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b0195880 con 0x7ff7b0100820 2024-09-04T16:46:03.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.515+0000 7ff7ad7fa640 1 -- 172.21.15.170:0/3970690155 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7a0037030 con 0x7ff7b0100820 2024-09-04T16:46:03.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.515+0000 7ff7b632c640 1 -- 172.21.15.170:0/3970690155 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b0195db0 con 0x7ff7b0100820 2024-09-04T16:46:03.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.516+0000 7ff7b632c640 1 -- 172.21.15.170:0/3970690155 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b0101f60 con 0x7ff7b0100820 2024-09-04T16:46:03.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.516+0000 7ff7ad7fa640 1 -- 172.21.15.170:0/3970690155 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ff7a0044070 con 0x7ff7b0100820 2024-09-04T16:46:03.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.517+0000 7ff7ad7fa640 1 --2- 172.21.15.170:0/3970690155 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff798079e30 0x7ff79807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:03.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.517+0000 7ff7ad7fa640 1 -- 172.21.15.170:0/3970690155 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff7a00bf420 con 0x7ff7b0100820 2024-09-04T16:46:03.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.517+0000 7ff7af7fe640 1 --2- 172.21.15.170:0/3970690155 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff798079e30 0x7ff79807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:03.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.518+0000 7ff7af7fe640 1 --2- 172.21.15.170:0/3970690155 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff798079e30 0x7ff79807c2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4005fd0 tx=0x7ff7a4005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:03.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.520+0000 7ff7ad7fa640 1 -- 172.21.15.170:0/3970690155 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff7a0086e30 con 0x7ff7b0100820 2024-09-04T16:46:03.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.716+0000 7ff7b632c640 1 -- 172.21.15.170:0/3970690155 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff7b0196b20 con 0x7ff798079e30 2024-09-04T16:46:03.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.717+0000 7ff7ad7fa640 1 -- 172.21.15.170:0/3970690155 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff7b0196b20 con 0x7ff798079e30 2024-09-04T16:46:03.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.719+0000 7ff7b632c640 1 -- 172.21.15.170:0/3970690155 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff798079e30 msgr2=0x7ff79807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:03.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.719+0000 7ff7b632c640 1 --2- 172.21.15.170:0/3970690155 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff798079e30 0x7ff79807c2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4005fd0 tx=0x7ff7a4005850 comp rx=0 tx=0).stop 2024-09-04T16:46:03.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.719+0000 7ff7b632c640 1 -- 172.21.15.170:0/3970690155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b0100820 msgr2=0x7ff7b019b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:03.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.719+0000 7ff7b632c640 1 --2- 172.21.15.170:0/3970690155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b0100820 0x7ff7b019b430 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0033460 tx=0x7ff7a00045e0 comp rx=0 tx=0).stop 2024-09-04T16:46:03.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.719+0000 7ff7b632c640 1 -- 172.21.15.170:0/3970690155 shutdown_connections 2024-09-04T16:46:03.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.719+0000 7ff7b632c640 1 --2- 172.21.15.170:0/3970690155 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff798079e30 0x7ff79807c2f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:03.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.719+0000 7ff7b632c640 1 --2- 172.21.15.170:0/3970690155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7b0106820 0x7ff7b019b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:03.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.719+0000 7ff7b632c640 1 --2- 172.21.15.170:0/3970690155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b0100820 0x7ff7b019b430 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:03.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.719+0000 7ff7b632c640 1 -- 172.21.15.170:0/3970690155 >> 172.21.15.170:0/3970690155 conn(0x7ff7b00fc520 msgr2=0x7ff7b00fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:03.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.720+0000 7ff7b632c640 1 -- 172.21.15.170:0/3970690155 shutdown_connections 2024-09-04T16:46:03.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.720+0000 7ff7b632c640 1 -- 172.21.15.170:0/3970690155 wait complete. 2024-09-04T16:46:03.728 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:46:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.802+0000 7f491535a640 1 -- 172.21.15.170:0/2789228680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49101067e0 msgr2=0x7f4910106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.802+0000 7f491535a640 1 --2- 172.21.15.170:0/2789228680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49101067e0 0x7f4910106bc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4908009c20 tx=0x7f490802a970 comp rx=0 tx=0).stop 2024-09-04T16:46:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.802+0000 7f491535a640 1 -- 172.21.15.170:0/2789228680 shutdown_connections 2024-09-04T16:46:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.802+0000 7f491535a640 1 --2- 172.21.15.170:0/2789228680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49101007e0 0x7f4910100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.802+0000 7f491535a640 1 --2- 172.21.15.170:0/2789228680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49101067e0 0x7f4910106bc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.802+0000 7f491535a640 1 -- 172.21.15.170:0/2789228680 >> 172.21.15.170:0/2789228680 conn(0x7f49100fc4c0 msgr2=0x7f49100fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.802+0000 7f491535a640 1 -- 172.21.15.170:0/2789228680 shutdown_connections 2024-09-04T16:46:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.802+0000 7f491535a640 1 -- 172.21.15.170:0/2789228680 wait complete. 2024-09-04T16:46:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.803+0000 7f491535a640 1 Processor -- start 2024-09-04T16:46:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.803+0000 7f491535a640 1 -- start start 2024-09-04T16:46:03.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.803+0000 7f491535a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49101007e0 0x7f491019f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:03.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.803+0000 7f491535a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49101067e0 0x7f491019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:03.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.803+0000 7f491535a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f491010dcb0 con 0x7f49101007e0 2024-09-04T16:46:03.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.803+0000 7f491535a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f491010db30 con 0x7f49101067e0 2024-09-04T16:46:03.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.803+0000 7f490effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49101007e0 0x7f491019f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:03.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.803+0000 7f490effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49101007e0 0x7f491019f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47718/0 (socket says 172.21.15.170:47718) 2024-09-04T16:46:03.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.803+0000 7f490effd640 1 -- 172.21.15.170:0/3930143271 learned_addr learned my addr 172.21.15.170:0/3930143271 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:46:03.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.803+0000 7f490e7fc640 1 --2- 172.21.15.170:0/3930143271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49101067e0 0x7f491019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:03.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.804+0000 7f490effd640 1 -- 172.21.15.170:0/3930143271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49101067e0 msgr2=0x7f491019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:03.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.804+0000 7f490effd640 1 --2- 172.21.15.170:0/3930143271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49101067e0 0x7f491019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:03.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.804+0000 7f490effd640 1 -- 172.21.15.170:0/3930143271 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49101999a0 con 0x7f49101007e0 2024-09-04T16:46:03.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.804+0000 7f490e7fc640 1 --2- 172.21.15.170:0/3930143271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49101067e0 0x7f491019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:46:03.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.804+0000 7f490effd640 1 --2- 172.21.15.170:0/3930143271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49101007e0 0x7f491019f7e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4908005cc0 tx=0x7f490802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:03.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.804+0000 7f4907fff640 1 -- 172.21.15.170:0/3930143271 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4908047070 con 0x7f49101007e0 2024-09-04T16:46:03.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.804+0000 7f4907fff640 1 -- 172.21.15.170:0/3930143271 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f490802f7e0 con 0x7f49101007e0 2024-09-04T16:46:03.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.804+0000 7f491535a640 1 -- 172.21.15.170:0/3930143271 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4910199c30 con 0x7f49101007e0 2024-09-04T16:46:03.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.804+0000 7f4907fff640 1 -- 172.21.15.170:0/3930143271 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4908034070 con 0x7f49101007e0 2024-09-04T16:46:03.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.804+0000 7f491535a640 1 -- 172.21.15.170:0/3930143271 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f491019a160 con 0x7f49101007e0 2024-09-04T16:46:03.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.805+0000 7f491535a640 1 -- 172.21.15.170:0/3930143271 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4910101f20 con 0x7f49101007e0 2024-09-04T16:46:03.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.806+0000 7f4907fff640 1 -- 172.21.15.170:0/3930143271 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f490804a070 con 0x7f49101007e0 2024-09-04T16:46:03.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.807+0000 7f4907fff640 1 --2- 172.21.15.170:0/3930143271 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f48fc079e30 0x7f48fc07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:03.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.807+0000 7f4907fff640 1 -- 172.21.15.170:0/3930143271 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f49080bd8e0 con 0x7f49101007e0 2024-09-04T16:46:03.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.807+0000 7f490e7fc640 1 --2- 172.21.15.170:0/3930143271 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f48fc079e30 0x7f48fc07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:03.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.807+0000 7f490e7fc640 1 --2- 172.21.15.170:0/3930143271 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f48fc079e30 0x7f48fc07c2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f49100fe3d0 tx=0x7f48f8005d30 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:03.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:03.812+0000 7f4907fff640 1 -- 172.21.15.170:0/3930143271 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f490803f070 con 0x7f49101007e0 2024-09-04T16:46:04.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.004+0000 7f491535a640 1 -- 172.21.15.170:0/3930143271 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f491019a4d0 con 0x7f48fc079e30 2024-09-04T16:46:04.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.005+0000 7f4907fff640 1 -- 172.21.15.170:0/3930143271 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f491019a4d0 con 0x7f48fc079e30 2024-09-04T16:46:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.008+0000 7f491535a640 1 -- 172.21.15.170:0/3930143271 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f48fc079e30 msgr2=0x7f48fc07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.008+0000 7f491535a640 1 --2- 172.21.15.170:0/3930143271 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f48fc079e30 0x7f48fc07c2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f49100fe3d0 tx=0x7f48f8005d30 comp rx=0 tx=0).stop 2024-09-04T16:46:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.008+0000 7f491535a640 1 -- 172.21.15.170:0/3930143271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49101007e0 msgr2=0x7f491019f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.008+0000 7f491535a640 1 --2- 172.21.15.170:0/3930143271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49101007e0 0x7f491019f7e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4908005cc0 tx=0x7f490802f5f0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.008+0000 7f491535a640 1 -- 172.21.15.170:0/3930143271 shutdown_connections 2024-09-04T16:46:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.008+0000 7f491535a640 1 --2- 172.21.15.170:0/3930143271 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f48fc079e30 0x7f48fc07c2f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.008+0000 7f491535a640 1 --2- 172.21.15.170:0/3930143271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49101067e0 0x7f491019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.008+0000 7f491535a640 1 --2- 172.21.15.170:0/3930143271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49101007e0 0x7f491019f7e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.008+0000 7f491535a640 1 -- 172.21.15.170:0/3930143271 >> 172.21.15.170:0/3930143271 conn(0x7f49100fc4c0 msgr2=0x7f49100fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.008+0000 7f491535a640 1 -- 172.21.15.170:0/3930143271 shutdown_connections 2024-09-04T16:46:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.008+0000 7f491535a640 1 -- 172.21.15.170:0/3930143271 wait complete. 2024-09-04T16:46:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.090+0000 7f522dcc2640 1 -- 172.21.15.170:0/1942852632 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5228102aa0 msgr2=0x7f5228102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.090+0000 7f522dcc2640 1 --2- 172.21.15.170:0/1942852632 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5228102aa0 0x7f5228102e80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5218009880 tx=0x7f521802a530 comp rx=0 tx=0).stop 2024-09-04T16:46:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.090+0000 7f522dcc2640 1 -- 172.21.15.170:0/1942852632 shutdown_connections 2024-09-04T16:46:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.090+0000 7f522dcc2640 1 --2- 172.21.15.170:0/1942852632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52281033c0 0x7f522810b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.090+0000 7f522dcc2640 1 --2- 172.21.15.170:0/1942852632 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5228102aa0 0x7f5228102e80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.090+0000 7f522dcc2640 1 -- 172.21.15.170:0/1942852632 >> 172.21.15.170:0/1942852632 conn(0x7f52280fc4c0 msgr2=0x7f52280fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:04.091 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:04 smithi170 ceph-mon[113855]: pgmap v490: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:04.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.090+0000 7f522dcc2640 1 -- 172.21.15.170:0/1942852632 shutdown_connections 2024-09-04T16:46:04.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.090+0000 7f522dcc2640 1 -- 172.21.15.170:0/1942852632 wait complete. 2024-09-04T16:46:04.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.090+0000 7f522dcc2640 1 Processor -- start 2024-09-04T16:46:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.091+0000 7f522dcc2640 1 -- start start 2024-09-04T16:46:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.091+0000 7f522dcc2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5228102aa0 0x7f5228100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.091+0000 7f522dcc2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52281033c0 0x7f5228100c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.091+0000 7f522dcc2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f522810edb0 con 0x7f5228102aa0 2024-09-04T16:46:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.091+0000 7f522dcc2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f522810ec30 con 0x7f52281033c0 2024-09-04T16:46:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.091+0000 7f52277fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5228102aa0 0x7f5228100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.091+0000 7f52277fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5228102aa0 0x7f5228100700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47736/0 (socket says 172.21.15.170:47736) 2024-09-04T16:46:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.091+0000 7f52277fe640 1 -- 172.21.15.170:0/3630516686 learned_addr learned my addr 172.21.15.170:0/3630516686 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:46:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.091+0000 7f521ffff640 1 --2- 172.21.15.170:0/3630516686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52281033c0 0x7f5228100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.091+0000 7f52277fe640 1 -- 172.21.15.170:0/3630516686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52281033c0 msgr2=0x7f5228100c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.091+0000 7f52277fe640 1 --2- 172.21.15.170:0/3630516686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52281033c0 0x7f5228100c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.091+0000 7f52277fe640 1 -- 172.21.15.170:0/3630516686 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5228101180 con 0x7f5228102aa0 2024-09-04T16:46:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.091+0000 7f52277fe640 1 --2- 172.21.15.170:0/3630516686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5228102aa0 0x7f5228100700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5218031460 tx=0x7f52180045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.092+0000 7f52257fa640 1 -- 172.21.15.170:0/3630516686 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f521803f070 con 0x7f5228102aa0 2024-09-04T16:46:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.092+0000 7f522dcc2640 1 -- 172.21.15.170:0/3630516686 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5228101410 con 0x7f5228102aa0 2024-09-04T16:46:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.092+0000 7f52257fa640 1 -- 172.21.15.170:0/3630516686 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f52180035f0 con 0x7f5228102aa0 2024-09-04T16:46:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.092+0000 7f52257fa640 1 -- 172.21.15.170:0/3630516686 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5218035030 con 0x7f5228102aa0 2024-09-04T16:46:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.092+0000 7f522dcc2640 1 -- 172.21.15.170:0/3630516686 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52281a3d60 con 0x7f5228102aa0 2024-09-04T16:46:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.093+0000 7f522dcc2640 1 -- 172.21.15.170:0/3630516686 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f522806a410 con 0x7f5228102aa0 2024-09-04T16:46:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.093+0000 7f52257fa640 1 -- 172.21.15.170:0/3630516686 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5218042070 con 0x7f5228102aa0 2024-09-04T16:46:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.094+0000 7f52257fa640 1 --2- 172.21.15.170:0/3630516686 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5214079e30 0x7f521407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.094+0000 7f52257fa640 1 -- 172.21.15.170:0/3630516686 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f52180bd3b0 con 0x7f5228102aa0 2024-09-04T16:46:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.094+0000 7f521ffff640 1 --2- 172.21.15.170:0/3630516686 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5214079e30 0x7f521407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.094+0000 7f521ffff640 1 --2- 172.21.15.170:0/3630516686 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5214079e30 0x7f521407c2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5228102190 tx=0x7f521000b2e0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:04.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.098+0000 7f52257fa640 1 -- 172.21.15.170:0/3630516686 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5218088f30 con 0x7f5228102aa0 2024-09-04T16:46:04.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.283+0000 7f522dcc2640 1 -- 172.21.15.170:0/3630516686 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5228062630 con 0x7f5214079e30 2024-09-04T16:46:04.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.293+0000 7f52257fa640 1 -- 172.21.15.170:0/3630516686 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5228062630 con 0x7f5214079e30 2024-09-04T16:46:04.292 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:46:04.292 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (13m) 7m ago 23m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:46:04.293 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (16m) 7m ago 24m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:46:04.293 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (15m) 6m ago 23m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:46:04.293 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (11m) 7m ago 24m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:46:04.293 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (11m) 6m ago 23m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:46:04.293 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (12m) 7m ago 23m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:46:04.293 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (7m) 7m ago 18m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:46:04.293 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (7m) 7m ago 18m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:46:04.293 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (6m) 6m ago 18m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:46:04.293 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (7m) 6m ago 18m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:46:04.293 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (15m) 7m ago 25m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:46:04.293 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (14m) 6m ago 23m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:46:04.293 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (11m) 7m ago 25m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:46:04.294 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (11m) 6m ago 22m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:46:04.294 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (13m) 7m ago 23m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:46:04.294 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (13m) 6m ago 23m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:46:04.294 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (10m) 7m ago 21m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:46:04.294 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (10m) 7m ago 21m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:46:04.294 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (9m) 7m ago 20m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:46:04.294 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (9m) 6m ago 20m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:46:04.294 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (8m) 6m ago 20m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:46:04.294 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (7m) 6m ago 19m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:46:04.294 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (13m) 7m ago 23m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:46:04.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.295+0000 7f522dcc2640 1 -- 172.21.15.170:0/3630516686 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5214079e30 msgr2=0x7f521407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:04.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.295+0000 7f522dcc2640 1 --2- 172.21.15.170:0/3630516686 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5214079e30 0x7f521407c2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5228102190 tx=0x7f521000b2e0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.295+0000 7f522dcc2640 1 -- 172.21.15.170:0/3630516686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5228102aa0 msgr2=0x7f5228100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:04.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.295+0000 7f522dcc2640 1 --2- 172.21.15.170:0/3630516686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5228102aa0 0x7f5228100700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5218031460 tx=0x7f52180045e0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.295+0000 7f522dcc2640 1 -- 172.21.15.170:0/3630516686 shutdown_connections 2024-09-04T16:46:04.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.295+0000 7f522dcc2640 1 --2- 172.21.15.170:0/3630516686 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5214079e30 0x7f521407c2f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.295+0000 7f522dcc2640 1 --2- 172.21.15.170:0/3630516686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52281033c0 0x7f5228100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.295+0000 7f522dcc2640 1 --2- 172.21.15.170:0/3630516686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5228102aa0 0x7f5228100700 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.295+0000 7f522dcc2640 1 -- 172.21.15.170:0/3630516686 >> 172.21.15.170:0/3630516686 conn(0x7f52280fc4c0 msgr2=0x7f5228108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:04.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.295+0000 7f522dcc2640 1 -- 172.21.15.170:0/3630516686 shutdown_connections 2024-09-04T16:46:04.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.295+0000 7f522dcc2640 1 -- 172.21.15.170:0/3630516686 wait complete. 2024-09-04T16:46:04.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.377+0000 7fa2bb5bb640 1 -- 172.21.15.170:0/3090510873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2b4100820 msgr2=0x7fa2b4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:04.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.377+0000 7fa2bb5bb640 1 --2- 172.21.15.170:0/3090510873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2b4100820 0x7fa2b4100c80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009880 tx=0x7fa2a402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.377+0000 7fa2bb5bb640 1 -- 172.21.15.170:0/3090510873 shutdown_connections 2024-09-04T16:46:04.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.377+0000 7fa2bb5bb640 1 --2- 172.21.15.170:0/3090510873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2b4100820 0x7fa2b4100c80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.377+0000 7fa2bb5bb640 1 --2- 172.21.15.170:0/3090510873 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2b4106820 0x7fa2b4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.377+0000 7fa2bb5bb640 1 -- 172.21.15.170:0/3090510873 >> 172.21.15.170:0/3090510873 conn(0x7fa2b40fc520 msgr2=0x7fa2b40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:04.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.377+0000 7fa2bb5bb640 1 -- 172.21.15.170:0/3090510873 shutdown_connections 2024-09-04T16:46:04.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.377+0000 7fa2bb5bb640 1 -- 172.21.15.170:0/3090510873 wait complete. 2024-09-04T16:46:04.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.378+0000 7fa2bb5bb640 1 Processor -- start 2024-09-04T16:46:04.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.378+0000 7fa2bb5bb640 1 -- start start 2024-09-04T16:46:04.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.378+0000 7fa2bb5bb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2b4100820 0x7fa2b419b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:04.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.378+0000 7fa2bb5bb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2b4106820 0x7fa2b419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:04.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.378+0000 7fa2bb5bb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b410cc00 con 0x7fa2b4106820 2024-09-04T16:46:04.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.378+0000 7fa2bb5bb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b410ca80 con 0x7fa2b4100820 2024-09-04T16:46:04.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.378+0000 7fa2b8b56640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2b4106820 0x7fa2b419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:04.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.378+0000 7fa2b8b56640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2b4106820 0x7fa2b419b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47750/0 (socket says 172.21.15.170:47750) 2024-09-04T16:46:04.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.378+0000 7fa2b8b56640 1 -- 172.21.15.170:0/1350251552 learned_addr learned my addr 172.21.15.170:0/1350251552 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:46:04.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.379+0000 7fa2b9357640 1 --2- 172.21.15.170:0/1350251552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2b4100820 0x7fa2b419b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:04.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.379+0000 7fa2b8b56640 1 -- 172.21.15.170:0/1350251552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2b4100820 msgr2=0x7fa2b419b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:04.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.379+0000 7fa2b8b56640 1 --2- 172.21.15.170:0/1350251552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2b4100820 0x7fa2b419b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.379+0000 7fa2b8b56640 1 -- 172.21.15.170:0/1350251552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b41955d0 con 0x7fa2b4106820 2024-09-04T16:46:04.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.379+0000 7fa2b8b56640 1 --2- 172.21.15.170:0/1350251552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2b4106820 0x7fa2b419b950 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4031460 tx=0x7fa2a40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:04.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.379+0000 7fa2aa7fc640 1 -- 172.21.15.170:0/1350251552 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2a403f070 con 0x7fa2b4106820 2024-09-04T16:46:04.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.379+0000 7fa2aa7fc640 1 -- 172.21.15.170:0/1350251552 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa2a40035f0 con 0x7fa2b4106820 2024-09-04T16:46:04.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.379+0000 7fa2bb5bb640 1 -- 172.21.15.170:0/1350251552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b4195860 con 0x7fa2b4106820 2024-09-04T16:46:04.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.379+0000 7fa2aa7fc640 1 -- 172.21.15.170:0/1350251552 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2a4035030 con 0x7fa2b4106820 2024-09-04T16:46:04.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.379+0000 7fa2bb5bb640 1 -- 172.21.15.170:0/1350251552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b4195d90 con 0x7fa2b4106820 2024-09-04T16:46:04.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.380+0000 7fa2bb5bb640 1 -- 172.21.15.170:0/1350251552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2b4101f60 con 0x7fa2b4106820 2024-09-04T16:46:04.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.381+0000 7fa2aa7fc640 1 -- 172.21.15.170:0/1350251552 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fa2a4042070 con 0x7fa2b4106820 2024-09-04T16:46:04.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.381+0000 7fa2aa7fc640 1 --2- 172.21.15.170:0/1350251552 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2a007c0a0 0x7fa2a007e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:04.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.381+0000 7fa2aa7fc640 1 -- 172.21.15.170:0/1350251552 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa2a40bd300 con 0x7fa2b4106820 2024-09-04T16:46:04.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.381+0000 7fa2b9357640 1 --2- 172.21.15.170:0/1350251552 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2a007c0a0 0x7fa2a007e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:04.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.382+0000 7fa2b9357640 1 --2- 172.21.15.170:0/1350251552 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2a007c0a0 0x7fa2a007e560 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0005fd0 tx=0x7fa2b000b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:04.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.386+0000 7fa2aa7fc640 1 -- 172.21.15.170:0/1350251552 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa2a4088f00 con 0x7fa2b4106820 2024-09-04T16:46:04.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:04 smithi193 ceph-mon[82547]: pgmap v490: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:04.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.628+0000 7fa2bb5bb640 1 -- 172.21.15.170:0/1350251552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa2b4196b00 con 0x7fa2b4106820 2024-09-04T16:46:04.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.629+0000 7fa2aa7fc640 1 -- 172.21.15.170:0/1350251552 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fa2a408d240 con 0x7fa2b4106820 2024-09-04T16:46:04.630 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:46:04.630 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:46:04.630 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:46:04.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:46:04.630 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:46:04.631 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:46:04.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:46:04.631 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:46:04.631 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:46:04.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:46:04.632 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:46:04.632 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:46:04.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:46:04.632 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:46:04.633 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:46:04.633 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:46:04.633 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:46:04.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.632+0000 7fa2bb5bb640 1 -- 172.21.15.170:0/1350251552 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2a007c0a0 msgr2=0x7fa2a007e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:04.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.632+0000 7fa2bb5bb640 1 --2- 172.21.15.170:0/1350251552 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2a007c0a0 0x7fa2a007e560 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0005fd0 tx=0x7fa2b000b390 comp rx=0 tx=0).stop 2024-09-04T16:46:04.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.632+0000 7fa2bb5bb640 1 -- 172.21.15.170:0/1350251552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2b4106820 msgr2=0x7fa2b419b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:04.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.632+0000 7fa2bb5bb640 1 --2- 172.21.15.170:0/1350251552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2b4106820 0x7fa2b419b950 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4031460 tx=0x7fa2a40045e0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.632+0000 7fa2bb5bb640 1 -- 172.21.15.170:0/1350251552 shutdown_connections 2024-09-04T16:46:04.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.632+0000 7fa2bb5bb640 1 --2- 172.21.15.170:0/1350251552 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2a007c0a0 0x7fa2a007e560 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.632+0000 7fa2bb5bb640 1 --2- 172.21.15.170:0/1350251552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2b4106820 0x7fa2b419b950 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.632+0000 7fa2bb5bb640 1 --2- 172.21.15.170:0/1350251552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2b4100820 0x7fa2b419b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.632+0000 7fa2bb5bb640 1 -- 172.21.15.170:0/1350251552 >> 172.21.15.170:0/1350251552 conn(0x7fa2b40fc520 msgr2=0x7fa2b40fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:04.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.632+0000 7fa2bb5bb640 1 -- 172.21.15.170:0/1350251552 shutdown_connections 2024-09-04T16:46:04.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.632+0000 7fa2bb5bb640 1 -- 172.21.15.170:0/1350251552 wait complete. 2024-09-04T16:46:04.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.713+0000 7f37f32f2640 1 -- 172.21.15.170:0/4087506012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37ec1067e0 msgr2=0x7f37ec106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:04.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.713+0000 7f37f32f2640 1 --2- 172.21.15.170:0/4087506012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37ec1067e0 0x7f37ec106bc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f37e0009880 tx=0x7f37e002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.714+0000 7f37f32f2640 1 -- 172.21.15.170:0/4087506012 shutdown_connections 2024-09-04T16:46:04.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.714+0000 7f37f32f2640 1 --2- 172.21.15.170:0/4087506012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37ec1007e0 0x7f37ec100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.714+0000 7f37f32f2640 1 --2- 172.21.15.170:0/4087506012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37ec1067e0 0x7f37ec106bc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.714+0000 7f37f32f2640 1 -- 172.21.15.170:0/4087506012 >> 172.21.15.170:0/4087506012 conn(0x7f37ec0fc4c0 msgr2=0x7f37ec0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:04.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.714+0000 7f37f32f2640 1 -- 172.21.15.170:0/4087506012 shutdown_connections 2024-09-04T16:46:04.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.714+0000 7f37f32f2640 1 -- 172.21.15.170:0/4087506012 wait complete. 2024-09-04T16:46:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.714+0000 7f37f32f2640 1 Processor -- start 2024-09-04T16:46:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.714+0000 7f37f32f2640 1 -- start start 2024-09-04T16:46:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37f32f2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37ec1007e0 0x7f37ec19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37f32f2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37ec1067e0 0x7f37ec19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37f32f2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec10dcb0 con 0x7f37ec1067e0 2024-09-04T16:46:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37f32f2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec10db30 con 0x7f37ec1007e0 2024-09-04T16:46:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37f088d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37ec1067e0 0x7f37ec19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:04.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37f088d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37ec1067e0 0x7f37ec19db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47772/0 (socket says 172.21.15.170:47772) 2024-09-04T16:46:04.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37f088d640 1 -- 172.21.15.170:0/1798121387 learned_addr learned my addr 172.21.15.170:0/1798121387 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:46:04.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37f108e640 1 --2- 172.21.15.170:0/1798121387 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37ec1007e0 0x7f37ec19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37f088d640 1 -- 172.21.15.170:0/1798121387 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37ec1007e0 msgr2=0x7f37ec19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37f088d640 1 --2- 172.21.15.170:0/1798121387 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37ec1007e0 0x7f37ec19d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37f088d640 1 -- 172.21.15.170:0/1798121387 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ec1977d0 con 0x7f37ec1067e0 2024-09-04T16:46:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37f088d640 1 --2- 172.21.15.170:0/1798121387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37ec1067e0 0x7f37ec19db90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f37e800d6f0 tx=0x7f37e800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37de7fc640 1 -- 172.21.15.170:0/1798121387 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f37e8017070 con 0x7f37ec1067e0 2024-09-04T16:46:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37de7fc640 1 -- 172.21.15.170:0/1798121387 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f37e800de00 con 0x7f37ec1067e0 2024-09-04T16:46:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37de7fc640 1 -- 172.21.15.170:0/1798121387 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f37e8004bb0 con 0x7f37ec1067e0 2024-09-04T16:46:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37f32f2640 1 -- 172.21.15.170:0/1798121387 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37ec197ac0 con 0x7f37ec1067e0 2024-09-04T16:46:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.715+0000 7f37f32f2640 1 -- 172.21.15.170:0/1798121387 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37ec198050 con 0x7f37ec1067e0 2024-09-04T16:46:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.716+0000 7f37f32f2640 1 -- 172.21.15.170:0/1798121387 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37ec101f20 con 0x7f37ec1067e0 2024-09-04T16:46:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.717+0000 7f37de7fc640 1 -- 172.21.15.170:0/1798121387 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f37e8004e60 con 0x7f37ec1067e0 2024-09-04T16:46:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.717+0000 7f37de7fc640 1 --2- 172.21.15.170:0/1798121387 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f37d8079e30 0x7f37d807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.718+0000 7f37f108e640 1 --2- 172.21.15.170:0/1798121387 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f37d8079e30 0x7f37d807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.718+0000 7f37de7fc640 1 -- 172.21.15.170:0/1798121387 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f37e809c730 con 0x7f37ec1067e0 2024-09-04T16:46:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.718+0000 7f37f108e640 1 --2- 172.21.15.170:0/1798121387 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f37d8079e30 0x7f37d807c2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f37e0031460 tx=0x7f37e0009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:04.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.722+0000 7f37de7fc640 1 -- 172.21.15.170:0/1798121387 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f37e8064140 con 0x7f37ec1067e0 2024-09-04T16:46:04.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.931+0000 7f37f32f2640 1 -- 172.21.15.170:0/1798121387 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f37ec109d60 con 0x7f37ec1067e0 2024-09-04T16:46:04.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.932+0000 7f37de7fc640 1 -- 172.21.15.170:0/1798121387 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7f37e80682b0 con 0x7f37ec1067e0 2024-09-04T16:46:04.931 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:46:04.932 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:46:04.932 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:46:04.932 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:46:04.932 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:46:04.932 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:46:04.932 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:46:04.932 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:46:04.932 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:46:04.932 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:46:04.932 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:46:04.932 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:46:04.932 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:46:04.932 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:46:04.933 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:46:04.933 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:46:04.933 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:46:04.933 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:46:04.933 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:46:04.933 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:46:04.933 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:46:04.933 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:46:04.933 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:46:04.933 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:46:04.933 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:46:04.933 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:46:04.933 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:46:04.933 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:46:04.934 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:46:04.934 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:46:04.934 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:46:04.934 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:46:04.934 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:46:04.934 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:46:04.934 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:46:04.934 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:46:04.934 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:46:04.934 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:46:04.934 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:46:04.934 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:46:04.934 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:46:04.934 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:46:04.935 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:46:04.935 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:46:04.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.934+0000 7f37f32f2640 1 -- 172.21.15.170:0/1798121387 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f37d8079e30 msgr2=0x7f37d807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:04.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.934+0000 7f37f32f2640 1 --2- 172.21.15.170:0/1798121387 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f37d8079e30 0x7f37d807c2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f37e0031460 tx=0x7f37e0009560 comp rx=0 tx=0).stop 2024-09-04T16:46:04.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.934+0000 7f37f32f2640 1 -- 172.21.15.170:0/1798121387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37ec1067e0 msgr2=0x7f37ec19db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:04.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.934+0000 7f37f32f2640 1 --2- 172.21.15.170:0/1798121387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37ec1067e0 0x7f37ec19db90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f37e800d6f0 tx=0x7f37e800dbb0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.934+0000 7f37f32f2640 1 -- 172.21.15.170:0/1798121387 shutdown_connections 2024-09-04T16:46:04.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.934+0000 7f37f32f2640 1 --2- 172.21.15.170:0/1798121387 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f37d8079e30 0x7f37d807c2f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.934+0000 7f37f32f2640 1 --2- 172.21.15.170:0/1798121387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37ec1067e0 0x7f37ec19db90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.934+0000 7f37f32f2640 1 --2- 172.21.15.170:0/1798121387 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37ec1007e0 0x7f37ec19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:04.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.934+0000 7f37f32f2640 1 -- 172.21.15.170:0/1798121387 >> 172.21.15.170:0/1798121387 conn(0x7f37ec0fc4c0 msgr2=0x7f37ec069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:04.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.934+0000 7f37f32f2640 1 -- 172.21.15.170:0/1798121387 shutdown_connections 2024-09-04T16:46:04.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:04.934+0000 7f37f32f2640 1 -- 172.21.15.170:0/1798121387 wait complete. 2024-09-04T16:46:05.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.017+0000 7fb3a7973640 1 -- 172.21.15.170:0/3998023842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3a0106820 msgr2=0x7fb3a0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:05.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.017+0000 7fb3a7973640 1 --2- 172.21.15.170:0/3998023842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3a0106820 0x7fb3a0106c00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009880 tx=0x7fb39c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:46:05.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.017+0000 7fb3a7973640 1 -- 172.21.15.170:0/3998023842 shutdown_connections 2024-09-04T16:46:05.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.017+0000 7fb3a7973640 1 --2- 172.21.15.170:0/3998023842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3a0100820 0x7fb3a0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:05.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.017+0000 7fb3a7973640 1 --2- 172.21.15.170:0/3998023842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3a0106820 0x7fb3a0106c00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:05.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.017+0000 7fb3a7973640 1 -- 172.21.15.170:0/3998023842 >> 172.21.15.170:0/3998023842 conn(0x7fb3a00fc520 msgr2=0x7fb3a00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:05.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.017+0000 7fb3a7973640 1 -- 172.21.15.170:0/3998023842 shutdown_connections 2024-09-04T16:46:05.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.017+0000 7fb3a7973640 1 -- 172.21.15.170:0/3998023842 wait complete. 2024-09-04T16:46:05.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.018+0000 7fb3a7973640 1 Processor -- start 2024-09-04T16:46:05.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.018+0000 7fb3a7973640 1 -- start start 2024-09-04T16:46:05.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.018+0000 7fb3a7973640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3a0100820 0x7fb3a0198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:05.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.018+0000 7fb3a7973640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3a0106820 0x7fb3a0198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:05.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.018+0000 7fb3a7973640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a010dcf0 con 0x7fb3a0106820 2024-09-04T16:46:05.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.018+0000 7fb3a7973640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a010db70 con 0x7fb3a0100820 2024-09-04T16:46:05.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.018+0000 7fb3a4f0e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3a0106820 0x7fb3a0198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.018+0000 7fb3a570f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3a0100820 0x7fb3a0198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.018+0000 7fb3a4f0e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3a0106820 0x7fb3a0198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58110/0 (socket says 172.21.15.170:58110) 2024-09-04T16:46:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.018+0000 7fb3a4f0e640 1 -- 172.21.15.170:0/1902780314 learned_addr learned my addr 172.21.15.170:0/1902780314 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:46:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.018+0000 7fb3a4f0e640 1 -- 172.21.15.170:0/1902780314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3a0100820 msgr2=0x7fb3a0198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.018+0000 7fb3a4f0e640 1 --2- 172.21.15.170:0/1902780314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3a0100820 0x7fb3a0198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.018+0000 7fb3a4f0e640 1 -- 172.21.15.170:0/1902780314 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a0199360 con 0x7fb3a0106820 2024-09-04T16:46:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.019+0000 7fb3a4f0e640 1 --2- 172.21.15.170:0/1902780314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3a0106820 0x7fb3a0198d60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb39000d6f0 tx=0x7fb39000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.019+0000 7fb3967fc640 1 -- 172.21.15.170:0/1902780314 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb390017070 con 0x7fb3a0106820 2024-09-04T16:46:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.019+0000 7fb3967fc640 1 -- 172.21.15.170:0/1902780314 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb39000de00 con 0x7fb3a0106820 2024-09-04T16:46:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.019+0000 7fb3a7973640 1 -- 172.21.15.170:0/1902780314 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a0199650 con 0x7fb3a0106820 2024-09-04T16:46:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.019+0000 7fb3967fc640 1 -- 172.21.15.170:0/1902780314 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb390004bb0 con 0x7fb3a0106820 2024-09-04T16:46:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.019+0000 7fb3a7973640 1 -- 172.21.15.170:0/1902780314 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a01a1c50 con 0x7fb3a0106820 2024-09-04T16:46:05.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.020+0000 7fb3a7973640 1 -- 172.21.15.170:0/1902780314 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a0101f60 con 0x7fb3a0106820 2024-09-04T16:46:05.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.021+0000 7fb3967fc640 1 -- 172.21.15.170:0/1902780314 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fb390004e60 con 0x7fb3a0106820 2024-09-04T16:46:05.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.021+0000 7fb3967fc640 1 --2- 172.21.15.170:0/1902780314 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb38c079e30 0x7fb38c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:05.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.021+0000 7fb3967fc640 1 -- 172.21.15.170:0/1902780314 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb39009c680 con 0x7fb3a0106820 2024-09-04T16:46:05.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.021+0000 7fb3a570f640 1 --2- 172.21.15.170:0/1902780314 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb38c079e30 0x7fb38c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:05.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.022+0000 7fb3a570f640 1 --2- 172.21.15.170:0/1902780314 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb38c079e30 0x7fb38c07c2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0096c0 tx=0x7fb39c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:05.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.025+0000 7fb3967fc640 1 -- 172.21.15.170:0/1902780314 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb3a0199650 con 0x7fb3a0106820 2024-09-04T16:46:05.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.218+0000 7fb3a7973640 1 -- 172.21.15.170:0/1902780314 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb3a0062630 con 0x7fb38c079e30 2024-09-04T16:46:05.218 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:05 smithi170 ceph-mon[113855]: from='client.34726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:46:05.218 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:05 smithi170 ceph-mon[113855]: from='client.34730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:46:05.218 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:05 smithi170 ceph-mon[113855]: from='client.34734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:46:05.218 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:05 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1350251552' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:46:05.218 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:05 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1798121387' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:46:05.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.219+0000 7fb3967fc640 1 -- 172.21.15.170:0/1902780314 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fb3a0062630 con 0x7fb38c079e30 2024-09-04T16:46:05.219 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:46:05.219 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:46:05.219 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:46:05.219 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:46:05.219 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:46:05.219 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:46:05.220 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:46:05.220 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:46:05.220 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:46:05.220 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:46:05.220 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:46:05.220 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:46:05.220 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:46:05.220 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:46:05.220 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:46:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.222+0000 7fb3a7973640 1 -- 172.21.15.170:0/1902780314 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb38c079e30 msgr2=0x7fb38c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.222+0000 7fb3a7973640 1 --2- 172.21.15.170:0/1902780314 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb38c079e30 0x7fb38c07c2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0096c0 tx=0x7fb39c031400 comp rx=0 tx=0).stop 2024-09-04T16:46:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.222+0000 7fb3a7973640 1 -- 172.21.15.170:0/1902780314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3a0106820 msgr2=0x7fb3a0198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.222+0000 7fb3a7973640 1 --2- 172.21.15.170:0/1902780314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3a0106820 0x7fb3a0198d60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb39000d6f0 tx=0x7fb39000dbb0 comp rx=0 tx=0).stop 2024-09-04T16:46:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.222+0000 7fb3a7973640 1 -- 172.21.15.170:0/1902780314 shutdown_connections 2024-09-04T16:46:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.222+0000 7fb3a7973640 1 --2- 172.21.15.170:0/1902780314 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb38c079e30 0x7fb38c07c2f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.222+0000 7fb3a7973640 1 --2- 172.21.15.170:0/1902780314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3a0106820 0x7fb3a0198d60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:05.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.222+0000 7fb3a7973640 1 --2- 172.21.15.170:0/1902780314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb3a0100820 0x7fb3a0198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:05.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.222+0000 7fb3a7973640 1 -- 172.21.15.170:0/1902780314 >> 172.21.15.170:0/1902780314 conn(0x7fb3a00fc520 msgr2=0x7fb3a00fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:05.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.222+0000 7fb3a7973640 1 -- 172.21.15.170:0/1902780314 shutdown_connections 2024-09-04T16:46:05.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.222+0000 7fb3a7973640 1 -- 172.21.15.170:0/1902780314 wait complete. 2024-09-04T16:46:05.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.305+0000 7f45dbd81640 1 -- 172.21.15.170:0/177364733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45d41007e0 msgr2=0x7f45d4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:05.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.305+0000 7f45dbd81640 1 --2- 172.21.15.170:0/177364733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45d41007e0 0x7f45d4100c40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009880 tx=0x7f45d002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:46:05.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.305+0000 7f45dbd81640 1 -- 172.21.15.170:0/177364733 shutdown_connections 2024-09-04T16:46:05.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.305+0000 7f45dbd81640 1 --2- 172.21.15.170:0/177364733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45d41007e0 0x7f45d4100c40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:05.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.305+0000 7f45dbd81640 1 --2- 172.21.15.170:0/177364733 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45d41067e0 0x7f45d4106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:05.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.305+0000 7f45dbd81640 1 -- 172.21.15.170:0/177364733 >> 172.21.15.170:0/177364733 conn(0x7f45d40fc4c0 msgr2=0x7f45d40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:05.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.305+0000 7f45dbd81640 1 -- 172.21.15.170:0/177364733 shutdown_connections 2024-09-04T16:46:05.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.305+0000 7f45dbd81640 1 -- 172.21.15.170:0/177364733 wait complete. 2024-09-04T16:46:05.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.305+0000 7f45dbd81640 1 Processor -- start 2024-09-04T16:46:05.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.305+0000 7f45dbd81640 1 -- start start 2024-09-04T16:46:05.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.306+0000 7f45dbd81640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45d41007e0 0x7f45d4198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:05.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.306+0000 7f45dbd81640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45d41067e0 0x7f45d4198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:05.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.306+0000 7f45dbd81640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f45d410dc90 con 0x7f45d41067e0 2024-09-04T16:46:05.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.306+0000 7f45dbd81640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f45d410db10 con 0x7f45d41007e0 2024-09-04T16:46:05.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.306+0000 7f45d931c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45d41067e0 0x7f45d4198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:05.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.306+0000 7f45d931c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45d41067e0 0x7f45d4198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58126/0 (socket says 172.21.15.170:58126) 2024-09-04T16:46:05.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.306+0000 7f45d931c640 1 -- 172.21.15.170:0/958796549 learned_addr learned my addr 172.21.15.170:0/958796549 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:46:05.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.306+0000 7f45d9b1d640 1 --2- 172.21.15.170:0/958796549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45d41007e0 0x7f45d4198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:05.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.306+0000 7f45d931c640 1 -- 172.21.15.170:0/958796549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45d41007e0 msgr2=0x7f45d4198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:05.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.306+0000 7f45d931c640 1 --2- 172.21.15.170:0/958796549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45d41007e0 0x7f45d4198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:05.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.306+0000 7f45d931c640 1 -- 172.21.15.170:0/958796549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d4199310 con 0x7f45d41067e0 2024-09-04T16:46:05.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.306+0000 7f45d931c640 1 --2- 172.21.15.170:0/958796549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45d41067e0 0x7f45d4198cc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f45d0031460 tx=0x7f45d00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:05.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.306+0000 7f45caffd640 1 -- 172.21.15.170:0/958796549 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f45d003f070 con 0x7f45d41067e0 2024-09-04T16:46:05.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.307+0000 7f45caffd640 1 -- 172.21.15.170:0/958796549 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f45d0004b10 con 0x7f45d41067e0 2024-09-04T16:46:05.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.307+0000 7f45dbd81640 1 -- 172.21.15.170:0/958796549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d41995a0 con 0x7f45d41067e0 2024-09-04T16:46:05.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.307+0000 7f45caffd640 1 -- 172.21.15.170:0/958796549 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f45d0035030 con 0x7f45d41067e0 2024-09-04T16:46:05.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.307+0000 7f45dbd81640 1 -- 172.21.15.170:0/958796549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d41a1b50 con 0x7f45d41067e0 2024-09-04T16:46:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.308+0000 7f45dbd81640 1 -- 172.21.15.170:0/958796549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d4101f20 con 0x7f45d41067e0 2024-09-04T16:46:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.308+0000 7f45caffd640 1 -- 172.21.15.170:0/958796549 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f45d0042070 con 0x7f45d41067e0 2024-09-04T16:46:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.309+0000 7f45caffd640 1 --2- 172.21.15.170:0/958796549 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f45c0079e90 0x7f45c007c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.309+0000 7f45d9b1d640 1 --2- 172.21.15.170:0/958796549 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f45c0079e90 0x7f45c007c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.309+0000 7f45caffd640 1 -- 172.21.15.170:0/958796549 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f45d00bd560 con 0x7f45d41067e0 2024-09-04T16:46:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.309+0000 7f45d9b1d640 1 --2- 172.21.15.170:0/958796549 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f45c0079e90 0x7f45c007c350 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f45c4005d00 tx=0x7f45c400b410 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.313+0000 7f45caffd640 1 -- 172.21.15.170:0/958796549 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f45d00890c0 con 0x7f45d41067e0 2024-09-04T16:46:05.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:05 smithi193 ceph-mon[82547]: from='client.34726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:46:05.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:05 smithi193 ceph-mon[82547]: from='client.34730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:46:05.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:05 smithi193 ceph-mon[82547]: from='client.34734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:46:05.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:05 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1350251552' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:46:05.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:05 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1798121387' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:46:05.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.557+0000 7f45dbd81640 1 -- 172.21.15.170:0/958796549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f45d4108d70 con 0x7f45d41067e0 2024-09-04T16:46:05.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.557+0000 7f45caffd640 1 -- 172.21.15.170:0/958796549 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f45d008d400 con 0x7f45d41067e0 2024-09-04T16:46:05.558 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:46:05.558 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:46:05.558 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:46:05.559 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:46:05.559 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:46:05.559 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:46:05.559 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:46:05.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.560+0000 7f45dbd81640 1 -- 172.21.15.170:0/958796549 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f45c0079e90 msgr2=0x7f45c007c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:05.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.560+0000 7f45dbd81640 1 --2- 172.21.15.170:0/958796549 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f45c0079e90 0x7f45c007c350 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f45c4005d00 tx=0x7f45c400b410 comp rx=0 tx=0).stop 2024-09-04T16:46:05.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.560+0000 7f45dbd81640 1 -- 172.21.15.170:0/958796549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45d41067e0 msgr2=0x7f45d4198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:05.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.560+0000 7f45dbd81640 1 --2- 172.21.15.170:0/958796549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45d41067e0 0x7f45d4198cc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f45d0031460 tx=0x7f45d00045e0 comp rx=0 tx=0).stop 2024-09-04T16:46:05.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.560+0000 7f45dbd81640 1 -- 172.21.15.170:0/958796549 shutdown_connections 2024-09-04T16:46:05.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.560+0000 7f45dbd81640 1 --2- 172.21.15.170:0/958796549 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f45c0079e90 0x7f45c007c350 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:05.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.560+0000 7f45dbd81640 1 --2- 172.21.15.170:0/958796549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45d41067e0 0x7f45d4198cc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:05.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.560+0000 7f45dbd81640 1 --2- 172.21.15.170:0/958796549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45d41007e0 0x7f45d4198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:05.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.560+0000 7f45dbd81640 1 -- 172.21.15.170:0/958796549 >> 172.21.15.170:0/958796549 conn(0x7f45d40fc4c0 msgr2=0x7f45d40fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:05.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.560+0000 7f45dbd81640 1 -- 172.21.15.170:0/958796549 shutdown_connections 2024-09-04T16:46:05.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:05.560+0000 7f45dbd81640 1 -- 172.21.15.170:0/958796549 wait complete. 2024-09-04T16:46:06.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:06 smithi170 ceph-mon[113855]: pgmap v491: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:06.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:06 smithi170 ceph-mon[113855]: from='client.34746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:46:06.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:06 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/958796549' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:46:06.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:06 smithi193 ceph-mon[82547]: pgmap v491: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:06.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:06 smithi193 ceph-mon[82547]: from='client.34746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:46:06.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:06 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/958796549' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:46:08.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:08 smithi170 ceph-mon[113855]: pgmap v492: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:08.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:08 smithi193 ceph-mon[82547]: pgmap v492: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:10.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:10 smithi170 ceph-mon[113855]: pgmap v493: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:10.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:10 smithi193 ceph-mon[82547]: pgmap v493: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:12.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:12 smithi170 ceph-mon[113855]: pgmap v494: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:12.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:12 smithi193 ceph-mon[82547]: pgmap v494: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:14.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:14 smithi170 ceph-mon[113855]: pgmap v495: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:14.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:14 smithi193 ceph-mon[82547]: pgmap v495: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:15.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:15 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:46:15.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:15 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:46:16.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:16 smithi170 ceph-mon[113855]: pgmap v496: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:16.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:16 smithi193 ceph-mon[82547]: pgmap v496: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:18.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:18 smithi170 ceph-mon[113855]: pgmap v497: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:18.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:18 smithi193 ceph-mon[82547]: pgmap v497: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:20.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:20 smithi170 ceph-mon[113855]: pgmap v498: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:20.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:20 smithi193 ceph-mon[82547]: pgmap v498: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:22.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:22 smithi170 ceph-mon[113855]: pgmap v499: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:22.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:22 smithi193 ceph-mon[82547]: pgmap v499: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:24.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:24 smithi170 ceph-mon[113855]: pgmap v500: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:24.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:24 smithi193 ceph-mon[82547]: pgmap v500: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:26.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:26 smithi170 ceph-mon[113855]: pgmap v501: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:26.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:26 smithi193 ceph-mon[82547]: pgmap v501: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:28.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:28 smithi170 ceph-mon[113855]: pgmap v502: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:28.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:28 smithi193 ceph-mon[82547]: pgmap v502: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:30.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:30 smithi170 ceph-mon[113855]: pgmap v503: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:30.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:46:30.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:30 smithi193 ceph-mon[82547]: pgmap v503: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:30.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:46:32.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:32 smithi193 ceph-mon[82547]: pgmap v504: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:32.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:32 smithi170 ceph-mon[113855]: pgmap v504: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:34.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:34 smithi170 ceph-mon[113855]: pgmap v505: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:34.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:34 smithi193 ceph-mon[82547]: pgmap v505: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.654+0000 7faa4b3a5640 1 -- 172.21.15.170:0/104363147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa44102ae0 msgr2=0x7faa44102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.654+0000 7faa4b3a5640 1 --2- 172.21.15.170:0/104363147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa44102ae0 0x7faa44102ec0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faa40009880 tx=0x7faa4002a530 comp rx=0 tx=0).stop 2024-09-04T16:46:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.654+0000 7faa4b3a5640 1 -- 172.21.15.170:0/104363147 shutdown_connections 2024-09-04T16:46:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.654+0000 7faa4b3a5640 1 --2- 172.21.15.170:0/104363147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa44103400 0x7faa4410b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.654+0000 7faa4b3a5640 1 --2- 172.21.15.170:0/104363147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa44102ae0 0x7faa44102ec0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.654+0000 7faa4b3a5640 1 -- 172.21.15.170:0/104363147 >> 172.21.15.170:0/104363147 conn(0x7faa440fc520 msgr2=0x7faa440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.655+0000 7faa4b3a5640 1 -- 172.21.15.170:0/104363147 shutdown_connections 2024-09-04T16:46:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.655+0000 7faa4b3a5640 1 -- 172.21.15.170:0/104363147 wait complete. 2024-09-04T16:46:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.655+0000 7faa4b3a5640 1 Processor -- start 2024-09-04T16:46:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.655+0000 7faa4b3a5640 1 -- start start 2024-09-04T16:46:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.655+0000 7faa4b3a5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa44102ae0 0x7faa4419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.655+0000 7faa4b3a5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa44103400 0x7faa4419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.655+0000 7faa4b3a5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faa4410ee10 con 0x7faa44102ae0 2024-09-04T16:46:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.655+0000 7faa4b3a5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faa4410ec90 con 0x7faa44103400 2024-09-04T16:46:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.656+0000 7faa49141640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa44102ae0 0x7faa4419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.656+0000 7faa49141640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa44102ae0 0x7faa4419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:39084/0 (socket says 172.21.15.170:39084) 2024-09-04T16:46:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.656+0000 7faa49141640 1 -- 172.21.15.170:0/3823789384 learned_addr learned my addr 172.21.15.170:0/3823789384 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:46:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.656+0000 7faa48940640 1 --2- 172.21.15.170:0/3823789384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa44103400 0x7faa4419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.656+0000 7faa49141640 1 -- 172.21.15.170:0/3823789384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa44103400 msgr2=0x7faa4419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.656+0000 7faa49141640 1 --2- 172.21.15.170:0/3823789384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa44103400 0x7faa4419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.656+0000 7faa49141640 1 -- 172.21.15.170:0/3823789384 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa44197800 con 0x7faa44102ae0 2024-09-04T16:46:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.656+0000 7faa49141640 1 --2- 172.21.15.170:0/3823789384 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa44102ae0 0x7faa4419d680 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faa40031460 tx=0x7faa400045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.656+0000 7faa3a7fc640 1 -- 172.21.15.170:0/3823789384 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa4003f070 con 0x7faa44102ae0 2024-09-04T16:46:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.656+0000 7faa3a7fc640 1 -- 172.21.15.170:0/3823789384 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa400035f0 con 0x7faa44102ae0 2024-09-04T16:46:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.656+0000 7faa4b3a5640 1 -- 172.21.15.170:0/3823789384 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa44197a90 con 0x7faa44102ae0 2024-09-04T16:46:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.656+0000 7faa3a7fc640 1 -- 172.21.15.170:0/3823789384 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa40035030 con 0x7faa44102ae0 2024-09-04T16:46:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.657+0000 7faa4b3a5640 1 -- 172.21.15.170:0/3823789384 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa44197fc0 con 0x7faa44102ae0 2024-09-04T16:46:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.658+0000 7faa4b3a5640 1 -- 172.21.15.170:0/3823789384 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa4406abe0 con 0x7faa44102ae0 2024-09-04T16:46:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.658+0000 7faa3a7fc640 1 -- 172.21.15.170:0/3823789384 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7faa40042070 con 0x7faa44102ae0 2024-09-04T16:46:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.659+0000 7faa3a7fc640 1 --2- 172.21.15.170:0/3823789384 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faa30079e80 0x7faa3007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.659+0000 7faa3a7fc640 1 -- 172.21.15.170:0/3823789384 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7faa400bd360 con 0x7faa44102ae0 2024-09-04T16:46:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.659+0000 7faa48940640 1 --2- 172.21.15.170:0/3823789384 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faa30079e80 0x7faa3007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.659+0000 7faa48940640 1 --2- 172.21.15.170:0/3823789384 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faa30079e80 0x7faa3007c340 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faa440fe4d0 tx=0x7faa3400b2e0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:35.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.663+0000 7faa3a7fc640 1 -- 172.21.15.170:0/3823789384 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faa40088f00 con 0x7faa44102ae0 2024-09-04T16:46:35.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.860+0000 7faa4b3a5640 1 -- 172.21.15.170:0/3823789384 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faa44198270 con 0x7faa30079e80 2024-09-04T16:46:35.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.862+0000 7faa3a7fc640 1 -- 172.21.15.170:0/3823789384 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7faa44198270 con 0x7faa30079e80 2024-09-04T16:46:35.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.864+0000 7faa4b3a5640 1 -- 172.21.15.170:0/3823789384 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faa30079e80 msgr2=0x7faa3007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:35.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.864+0000 7faa4b3a5640 1 --2- 172.21.15.170:0/3823789384 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faa30079e80 0x7faa3007c340 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faa440fe4d0 tx=0x7faa3400b2e0 comp rx=0 tx=0).stop 2024-09-04T16:46:35.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.864+0000 7faa4b3a5640 1 -- 172.21.15.170:0/3823789384 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa44102ae0 msgr2=0x7faa4419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:35.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.864+0000 7faa4b3a5640 1 --2- 172.21.15.170:0/3823789384 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa44102ae0 0x7faa4419d680 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faa40031460 tx=0x7faa400045e0 comp rx=0 tx=0).stop 2024-09-04T16:46:35.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.864+0000 7faa4b3a5640 1 -- 172.21.15.170:0/3823789384 shutdown_connections 2024-09-04T16:46:35.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.864+0000 7faa4b3a5640 1 --2- 172.21.15.170:0/3823789384 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faa30079e80 0x7faa3007c340 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:35.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.864+0000 7faa4b3a5640 1 --2- 172.21.15.170:0/3823789384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa44103400 0x7faa4419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:35.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.864+0000 7faa4b3a5640 1 --2- 172.21.15.170:0/3823789384 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa44102ae0 0x7faa4419d680 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:35.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.864+0000 7faa4b3a5640 1 -- 172.21.15.170:0/3823789384 >> 172.21.15.170:0/3823789384 conn(0x7faa440fc520 msgr2=0x7faa44108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:35.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.864+0000 7faa4b3a5640 1 -- 172.21.15.170:0/3823789384 shutdown_connections 2024-09-04T16:46:35.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.864+0000 7faa4b3a5640 1 -- 172.21.15.170:0/3823789384 wait complete. 2024-09-04T16:46:35.873 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:46:35.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.947+0000 7fa315f02640 1 -- 172.21.15.170:0/368313166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa310107930 msgr2=0x7fa310107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:35.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.947+0000 7fa315f02640 1 --2- 172.21.15.170:0/368313166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa310107930 0x7fa310107d10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa300009880 tx=0x7fa30002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:46:35.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.947+0000 7fa315f02640 1 -- 172.21.15.170:0/368313166 shutdown_connections 2024-09-04T16:46:35.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.947+0000 7fa315f02640 1 --2- 172.21.15.170:0/368313166 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa310101930 0x7fa310101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:35.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.947+0000 7fa315f02640 1 --2- 172.21.15.170:0/368313166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa310107930 0x7fa310107d10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:35.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.947+0000 7fa315f02640 1 -- 172.21.15.170:0/368313166 >> 172.21.15.170:0/368313166 conn(0x7fa3100fd630 msgr2=0x7fa3100ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:35.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.947+0000 7fa315f02640 1 -- 172.21.15.170:0/368313166 shutdown_connections 2024-09-04T16:46:35.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.947+0000 7fa315f02640 1 -- 172.21.15.170:0/368313166 wait complete. 2024-09-04T16:46:35.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.948+0000 7fa315f02640 1 Processor -- start 2024-09-04T16:46:35.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.948+0000 7fa315f02640 1 -- start start 2024-09-04T16:46:35.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.948+0000 7fa315f02640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa310101930 0x7fa31019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:35.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.948+0000 7fa315f02640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa310107930 0x7fa31019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:35.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.948+0000 7fa315f02640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa31010ee00 con 0x7fa310107930 2024-09-04T16:46:35.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.948+0000 7fa315f02640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa31010ec80 con 0x7fa310101930 2024-09-04T16:46:35.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.948+0000 7fa30effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa310107930 0x7fa31019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:35.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.948+0000 7fa30effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa310107930 0x7fa31019dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:39110/0 (socket says 172.21.15.170:39110) 2024-09-04T16:46:35.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.948+0000 7fa30effd640 1 -- 172.21.15.170:0/1901872180 learned_addr learned my addr 172.21.15.170:0/1901872180 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:46:35.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.948+0000 7fa30f7fe640 1 --2- 172.21.15.170:0/1901872180 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa310101930 0x7fa31019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:35.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.949+0000 7fa30effd640 1 -- 172.21.15.170:0/1901872180 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa310101930 msgr2=0x7fa31019d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:35.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.949+0000 7fa30effd640 1 --2- 172.21.15.170:0/1901872180 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa310101930 0x7fa31019d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:35.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.949+0000 7fa30effd640 1 -- 172.21.15.170:0/1901872180 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3101977f0 con 0x7fa310107930 2024-09-04T16:46:35.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.949+0000 7fa30effd640 1 --2- 172.21.15.170:0/1901872180 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa310107930 0x7fa31019dbb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa30400d6f0 tx=0x7fa30400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:35.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.949+0000 7fa30cff9640 1 -- 172.21.15.170:0/1901872180 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa304017070 con 0x7fa310107930 2024-09-04T16:46:35.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.949+0000 7fa30cff9640 1 -- 172.21.15.170:0/1901872180 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa30400de00 con 0x7fa310107930 2024-09-04T16:46:35.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.949+0000 7fa315f02640 1 -- 172.21.15.170:0/1901872180 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa310197ae0 con 0x7fa310107930 2024-09-04T16:46:35.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.949+0000 7fa30cff9640 1 -- 172.21.15.170:0/1901872180 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa304004bb0 con 0x7fa310107930 2024-09-04T16:46:35.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.949+0000 7fa315f02640 1 -- 172.21.15.170:0/1901872180 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa310198070 con 0x7fa310107930 2024-09-04T16:46:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.950+0000 7fa315f02640 1 -- 172.21.15.170:0/1901872180 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa310103070 con 0x7fa310107930 2024-09-04T16:46:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.951+0000 7fa30cff9640 1 -- 172.21.15.170:0/1901872180 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fa304010460 con 0x7fa310107930 2024-09-04T16:46:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.951+0000 7fa30cff9640 1 --2- 172.21.15.170:0/1901872180 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2f8079e30 0x7fa2f807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.951+0000 7fa30cff9640 1 -- 172.21.15.170:0/1901872180 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa30409c5f0 con 0x7fa310107930 2024-09-04T16:46:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.951+0000 7fa30f7fe640 1 --2- 172.21.15.170:0/1901872180 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2f8079e30 0x7fa2f807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.952+0000 7fa30f7fe640 1 --2- 172.21.15.170:0/1901872180 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2f8079e30 0x7fa2f807c2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa3000096c0 tx=0x7fa300031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:35.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:35.956+0000 7fa30cff9640 1 -- 172.21.15.170:0/1901872180 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa304068170 con 0x7fa310107930 2024-09-04T16:46:36.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.146+0000 7fa315f02640 1 -- 172.21.15.170:0/1901872180 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa3101983e0 con 0x7fa2f8079e30 2024-09-04T16:46:36.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.147+0000 7fa30cff9640 1 -- 172.21.15.170:0/1901872180 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa3101983e0 con 0x7fa2f8079e30 2024-09-04T16:46:36.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.149+0000 7fa315f02640 1 -- 172.21.15.170:0/1901872180 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2f8079e30 msgr2=0x7fa2f807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:36.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.149+0000 7fa315f02640 1 --2- 172.21.15.170:0/1901872180 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2f8079e30 0x7fa2f807c2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa3000096c0 tx=0x7fa300031400 comp rx=0 tx=0).stop 2024-09-04T16:46:36.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.149+0000 7fa315f02640 1 -- 172.21.15.170:0/1901872180 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa310107930 msgr2=0x7fa31019dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:36.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.149+0000 7fa315f02640 1 --2- 172.21.15.170:0/1901872180 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa310107930 0x7fa31019dbb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa30400d6f0 tx=0x7fa30400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.149+0000 7fa315f02640 1 -- 172.21.15.170:0/1901872180 shutdown_connections 2024-09-04T16:46:36.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.149+0000 7fa315f02640 1 --2- 172.21.15.170:0/1901872180 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa2f8079e30 0x7fa2f807c2f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.149+0000 7fa315f02640 1 --2- 172.21.15.170:0/1901872180 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa310107930 0x7fa31019dbb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.149+0000 7fa315f02640 1 --2- 172.21.15.170:0/1901872180 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa310101930 0x7fa31019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.149+0000 7fa315f02640 1 -- 172.21.15.170:0/1901872180 >> 172.21.15.170:0/1901872180 conn(0x7fa3100fd630 msgr2=0x7fa3100fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:36.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.150+0000 7fa315f02640 1 -- 172.21.15.170:0/1901872180 shutdown_connections 2024-09-04T16:46:36.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.150+0000 7fa315f02640 1 -- 172.21.15.170:0/1901872180 wait complete. 2024-09-04T16:46:36.217 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:36 smithi170 ceph-mon[113855]: pgmap v506: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:36.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.234+0000 7f7062b1b640 1 -- 172.21.15.170:0/436277470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f705c103400 msgr2=0x7f705c10b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:36.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.234+0000 7f7062b1b640 1 --2- 172.21.15.170:0/436277470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f705c103400 0x7f705c10b8f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f704c009880 tx=0x7f704c02a530 comp rx=0 tx=0).stop 2024-09-04T16:46:36.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.234+0000 7f7062b1b640 1 -- 172.21.15.170:0/436277470 shutdown_connections 2024-09-04T16:46:36.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.234+0000 7f7062b1b640 1 --2- 172.21.15.170:0/436277470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f705c103400 0x7f705c10b8f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.234+0000 7f7062b1b640 1 --2- 172.21.15.170:0/436277470 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f705c102ae0 0x7f705c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.234+0000 7f7062b1b640 1 -- 172.21.15.170:0/436277470 >> 172.21.15.170:0/436277470 conn(0x7f705c0fc520 msgr2=0x7f705c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:36.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.234+0000 7f7062b1b640 1 -- 172.21.15.170:0/436277470 shutdown_connections 2024-09-04T16:46:36.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.234+0000 7f7062b1b640 1 -- 172.21.15.170:0/436277470 wait complete. 2024-09-04T16:46:36.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.234+0000 7f7062b1b640 1 Processor -- start 2024-09-04T16:46:36.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.234+0000 7f7062b1b640 1 -- start start 2024-09-04T16:46:36.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.234+0000 7f7062b1b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f705c102ae0 0x7f705c100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:36.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.234+0000 7f7062b1b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f705c103400 0x7f705c100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:36.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.234+0000 7f7062b1b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f705c10ee10 con 0x7f705c102ae0 2024-09-04T16:46:36.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.234+0000 7f7062b1b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f705c10ec90 con 0x7f705c103400 2024-09-04T16:46:36.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.235+0000 7f70608b7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f705c102ae0 0x7f705c100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:36.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.235+0000 7f70608b7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f705c102ae0 0x7f705c100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:39128/0 (socket says 172.21.15.170:39128) 2024-09-04T16:46:36.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.235+0000 7f70608b7640 1 -- 172.21.15.170:0/1090400573 learned_addr learned my addr 172.21.15.170:0/1090400573 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:46:36.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.235+0000 7f7053fff640 1 --2- 172.21.15.170:0/1090400573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f705c103400 0x7f705c100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:36.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.235+0000 7f70608b7640 1 -- 172.21.15.170:0/1090400573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f705c103400 msgr2=0x7f705c100c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:36.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.235+0000 7f70608b7640 1 --2- 172.21.15.170:0/1090400573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f705c103400 0x7f705c100c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.235+0000 7f70608b7640 1 -- 172.21.15.170:0/1090400573 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f705c1011c0 con 0x7f705c102ae0 2024-09-04T16:46:36.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.235+0000 7f70608b7640 1 --2- 172.21.15.170:0/1090400573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f705c102ae0 0x7f705c100740 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f705800d6f0 tx=0x7f705800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:36.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.235+0000 7f7051ffb640 1 -- 172.21.15.170:0/1090400573 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7058017070 con 0x7f705c102ae0 2024-09-04T16:46:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.235+0000 7f7051ffb640 1 -- 172.21.15.170:0/1090400573 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f705800de00 con 0x7f705c102ae0 2024-09-04T16:46:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.235+0000 7f7062b1b640 1 -- 172.21.15.170:0/1090400573 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f705c1014b0 con 0x7f705c102ae0 2024-09-04T16:46:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.235+0000 7f7051ffb640 1 -- 172.21.15.170:0/1090400573 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7058004bb0 con 0x7f705c102ae0 2024-09-04T16:46:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.236+0000 7f7062b1b640 1 -- 172.21.15.170:0/1090400573 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f705c1a3ea0 con 0x7f705c102ae0 2024-09-04T16:46:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.237+0000 7f7062b1b640 1 -- 172.21.15.170:0/1090400573 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f705c06abe0 con 0x7f705c102ae0 2024-09-04T16:46:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.237+0000 7f7051ffb640 1 -- 172.21.15.170:0/1090400573 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f7058004e60 con 0x7f705c102ae0 2024-09-04T16:46:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.237+0000 7f7051ffb640 1 --2- 172.21.15.170:0/1090400573 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7044079e30 0x7f704407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.238+0000 7f7051ffb640 1 -- 172.21.15.170:0/1090400573 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f705809c660 con 0x7f705c102ae0 2024-09-04T16:46:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.238+0000 7f7053fff640 1 --2- 172.21.15.170:0/1090400573 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7044079e30 0x7f704407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.238+0000 7f7053fff640 1 --2- 172.21.15.170:0/1090400573 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7044079e30 0x7f704407c2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f705c1021d0 tx=0x7f704c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:36.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.242+0000 7f7051ffb640 1 -- 172.21.15.170:0/1090400573 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f70580681e0 con 0x7f705c102ae0 2024-09-04T16:46:36.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:36 smithi193 ceph-mon[82547]: pgmap v506: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:36.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.428+0000 7f7062b1b640 1 -- 172.21.15.170:0/1090400573 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f705c062630 con 0x7f7044079e30 2024-09-04T16:46:36.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.438+0000 7f7051ffb640 1 -- 172.21.15.170:0/1090400573 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f705c062630 con 0x7f7044079e30 2024-09-04T16:46:36.439 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:46:36.439 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (13m) 7m ago 24m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:46:36.439 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (16m) 7m ago 24m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:46:36.439 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (16m) 7m ago 23m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:46:36.439 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (11m) 7m ago 24m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:46:36.439 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (11m) 7m ago 23m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:46:36.439 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (13m) 7m ago 24m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:46:36.439 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (7m) 7m ago 19m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:46:36.439 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (8m) 7m ago 19m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:46:36.440 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (7m) 7m ago 19m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:46:36.440 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (7m) 7m ago 19m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:46:36.440 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (15m) 7m ago 25m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:46:36.440 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (14m) 7m ago 23m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:46:36.440 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (12m) 7m ago 25m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:46:36.440 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (11m) 7m ago 23m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:46:36.440 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (14m) 7m ago 24m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:46:36.440 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (14m) 7m ago 23m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:46:36.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (11m) 7m ago 22m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:46:36.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (10m) 7m ago 21m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:46:36.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (10m) 7m ago 21m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:46:36.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (9m) 7m ago 21m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:46:36.440 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (9m) 7m ago 20m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:46:36.441 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (8m) 7m ago 20m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:46:36.441 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (13m) 7m ago 23m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:46:36.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.440+0000 7f7062b1b640 1 -- 172.21.15.170:0/1090400573 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7044079e30 msgr2=0x7f704407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:36.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.440+0000 7f7062b1b640 1 --2- 172.21.15.170:0/1090400573 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7044079e30 0x7f704407c2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f705c1021d0 tx=0x7f704c031400 comp rx=0 tx=0).stop 2024-09-04T16:46:36.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.440+0000 7f7062b1b640 1 -- 172.21.15.170:0/1090400573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f705c102ae0 msgr2=0x7f705c100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:36.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.440+0000 7f7062b1b640 1 --2- 172.21.15.170:0/1090400573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f705c102ae0 0x7f705c100740 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f705800d6f0 tx=0x7f705800dbb0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.440+0000 7f7062b1b640 1 -- 172.21.15.170:0/1090400573 shutdown_connections 2024-09-04T16:46:36.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.440+0000 7f7062b1b640 1 --2- 172.21.15.170:0/1090400573 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7044079e30 0x7f704407c2f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.440+0000 7f7062b1b640 1 --2- 172.21.15.170:0/1090400573 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f705c103400 0x7f705c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.440+0000 7f7062b1b640 1 --2- 172.21.15.170:0/1090400573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f705c102ae0 0x7f705c100740 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.440+0000 7f7062b1b640 1 -- 172.21.15.170:0/1090400573 >> 172.21.15.170:0/1090400573 conn(0x7f705c0fc520 msgr2=0x7f705c108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:36.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.441+0000 7f7062b1b640 1 -- 172.21.15.170:0/1090400573 shutdown_connections 2024-09-04T16:46:36.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.441+0000 7f7062b1b640 1 -- 172.21.15.170:0/1090400573 wait complete. 2024-09-04T16:46:36.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.521+0000 7f3c22cde640 1 -- 172.21.15.170:0/225835969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c1c100820 msgr2=0x7f3c1c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:36.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.521+0000 7f3c22cde640 1 --2- 172.21.15.170:0/225835969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c1c100820 0x7f3c1c100c80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c009880 tx=0x7f3c0c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.521+0000 7f3c22cde640 1 -- 172.21.15.170:0/225835969 shutdown_connections 2024-09-04T16:46:36.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.521+0000 7f3c22cde640 1 --2- 172.21.15.170:0/225835969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c1c100820 0x7f3c1c100c80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.521+0000 7f3c22cde640 1 --2- 172.21.15.170:0/225835969 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3c1c106820 0x7f3c1c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.521+0000 7f3c22cde640 1 -- 172.21.15.170:0/225835969 >> 172.21.15.170:0/225835969 conn(0x7f3c1c0fc520 msgr2=0x7f3c1c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:36.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.521+0000 7f3c22cde640 1 -- 172.21.15.170:0/225835969 shutdown_connections 2024-09-04T16:46:36.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.521+0000 7f3c22cde640 1 -- 172.21.15.170:0/225835969 wait complete. 2024-09-04T16:46:36.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.521+0000 7f3c22cde640 1 Processor -- start 2024-09-04T16:46:36.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.522+0000 7f3c22cde640 1 -- start start 2024-09-04T16:46:36.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.522+0000 7f3c22cde640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3c1c100820 0x7f3c1c19f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:36.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.522+0000 7f3c22cde640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c1c106820 0x7f3c1c19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:36.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.522+0000 7f3c22cde640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c10cbe0 con 0x7f3c1c106820 2024-09-04T16:46:36.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.522+0000 7f3c22cde640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c10ca60 con 0x7f3c1c100820 2024-09-04T16:46:36.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.522+0000 7f3c1bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c1c106820 0x7f3c1c19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:36.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.522+0000 7f3c1bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c1c106820 0x7f3c1c19fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:39140/0 (socket says 172.21.15.170:39140) 2024-09-04T16:46:36.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.522+0000 7f3c1bfff640 1 -- 172.21.15.170:0/2832583847 learned_addr learned my addr 172.21.15.170:0/2832583847 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:46:36.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.522+0000 7f3c20a7a640 1 --2- 172.21.15.170:0/2832583847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3c1c100820 0x7f3c1c19f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:36.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.522+0000 7f3c1bfff640 1 -- 172.21.15.170:0/2832583847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3c1c100820 msgr2=0x7f3c1c19f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:36.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.522+0000 7f3c1bfff640 1 --2- 172.21.15.170:0/2832583847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3c1c100820 0x7f3c1c19f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.522+0000 7f3c1bfff640 1 -- 172.21.15.170:0/2832583847 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1c1a0400 con 0x7f3c1c106820 2024-09-04T16:46:36.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.522+0000 7f3c1bfff640 1 --2- 172.21.15.170:0/2832583847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c1c106820 0x7f3c1c19fd50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c031460 tx=0x7f3c0c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:36.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.523+0000 7f3c19ffb640 1 -- 172.21.15.170:0/2832583847 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c0c03f070 con 0x7f3c1c106820 2024-09-04T16:46:36.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.523+0000 7f3c19ffb640 1 -- 172.21.15.170:0/2832583847 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c0c004cf0 con 0x7f3c1c106820 2024-09-04T16:46:36.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.523+0000 7f3c22cde640 1 -- 172.21.15.170:0/2832583847 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c1c199a90 con 0x7f3c1c106820 2024-09-04T16:46:36.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.523+0000 7f3c19ffb640 1 -- 172.21.15.170:0/2832583847 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c0c035030 con 0x7f3c1c106820 2024-09-04T16:46:36.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.523+0000 7f3c22cde640 1 -- 172.21.15.170:0/2832583847 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c1c199f90 con 0x7f3c1c106820 2024-09-04T16:46:36.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.524+0000 7f3c22cde640 1 -- 172.21.15.170:0/2832583847 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c1c101f60 con 0x7f3c1c106820 2024-09-04T16:46:36.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.525+0000 7f3c19ffb640 1 -- 172.21.15.170:0/2832583847 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f3c0c042070 con 0x7f3c1c106820 2024-09-04T16:46:36.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.525+0000 7f3c19ffb640 1 --2- 172.21.15.170:0/2832583847 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3c08079e80 0x7f3c0807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:36.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.525+0000 7f3c19ffb640 1 -- 172.21.15.170:0/2832583847 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3c0c0bd400 con 0x7f3c1c106820 2024-09-04T16:46:36.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.525+0000 7f3c20a7a640 1 --2- 172.21.15.170:0/2832583847 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3c08079e80 0x7f3c0807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:36.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.526+0000 7f3c20a7a640 1 --2- 172.21.15.170:0/2832583847 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3c08079e80 0x7f3c0807c340 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c19ab10 tx=0x7f3c140075b0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:36.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.530+0000 7f3c19ffb640 1 -- 172.21.15.170:0/2832583847 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3c0c089000 con 0x7f3c1c106820 2024-09-04T16:46:36.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.775+0000 7f3c22cde640 1 -- 172.21.15.170:0/2832583847 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3c1c19af00 con 0x7f3c1c106820 2024-09-04T16:46:36.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.775+0000 7f3c19ffb640 1 -- 172.21.15.170:0/2832583847 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f3c0c08da20 con 0x7f3c1c106820 2024-09-04T16:46:36.776 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:46:36.776 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:46:36.776 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:46:36.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:46:36.777 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:46:36.777 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:46:36.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:46:36.777 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:46:36.777 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:46:36.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:46:36.777 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:46:36.777 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:46:36.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:46:36.777 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:46:36.777 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:46:36.777 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:46:36.777 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:46:36.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.778+0000 7f3c22cde640 1 -- 172.21.15.170:0/2832583847 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3c08079e80 msgr2=0x7f3c0807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:36.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.778+0000 7f3c22cde640 1 --2- 172.21.15.170:0/2832583847 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3c08079e80 0x7f3c0807c340 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c19ab10 tx=0x7f3c140075b0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.778+0000 7f3c22cde640 1 -- 172.21.15.170:0/2832583847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c1c106820 msgr2=0x7f3c1c19fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:36.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.778+0000 7f3c22cde640 1 --2- 172.21.15.170:0/2832583847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c1c106820 0x7f3c1c19fd50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c031460 tx=0x7f3c0c0048f0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.778+0000 7f3c22cde640 1 -- 172.21.15.170:0/2832583847 shutdown_connections 2024-09-04T16:46:36.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.778+0000 7f3c22cde640 1 --2- 172.21.15.170:0/2832583847 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3c08079e80 0x7f3c0807c340 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.778+0000 7f3c22cde640 1 --2- 172.21.15.170:0/2832583847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c1c106820 0x7f3c1c19fd50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.778+0000 7f3c22cde640 1 --2- 172.21.15.170:0/2832583847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3c1c100820 0x7f3c1c19f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.778+0000 7f3c22cde640 1 -- 172.21.15.170:0/2832583847 >> 172.21.15.170:0/2832583847 conn(0x7f3c1c0fc520 msgr2=0x7f3c1c0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:36.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.778+0000 7f3c22cde640 1 -- 172.21.15.170:0/2832583847 shutdown_connections 2024-09-04T16:46:36.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.778+0000 7f3c22cde640 1 -- 172.21.15.170:0/2832583847 wait complete. 2024-09-04T16:46:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.860+0000 7fb137adb640 1 -- 172.21.15.170:0/1147552526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb130106820 msgr2=0x7fb130106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.860+0000 7fb137adb640 1 --2- 172.21.15.170:0/1147552526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb130106820 0x7fb130106c00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb124009880 tx=0x7fb12402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.860+0000 7fb137adb640 1 -- 172.21.15.170:0/1147552526 shutdown_connections 2024-09-04T16:46:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.860+0000 7fb137adb640 1 --2- 172.21.15.170:0/1147552526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb130100820 0x7fb130100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.860+0000 7fb137adb640 1 --2- 172.21.15.170:0/1147552526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb130106820 0x7fb130106c00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.860+0000 7fb137adb640 1 -- 172.21.15.170:0/1147552526 >> 172.21.15.170:0/1147552526 conn(0x7fb1300fc520 msgr2=0x7fb1300fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.860+0000 7fb137adb640 1 -- 172.21.15.170:0/1147552526 shutdown_connections 2024-09-04T16:46:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.860+0000 7fb137adb640 1 -- 172.21.15.170:0/1147552526 wait complete. 2024-09-04T16:46:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.860+0000 7fb137adb640 1 Processor -- start 2024-09-04T16:46:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.861+0000 7fb137adb640 1 -- start start 2024-09-04T16:46:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.861+0000 7fb137adb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb130100820 0x7fb1300fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.861+0000 7fb137adb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb130106820 0x7fb1300fd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.861+0000 7fb137adb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb13010dcf0 con 0x7fb130100820 2024-09-04T16:46:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.861+0000 7fb137adb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb13010db70 con 0x7fb130106820 2024-09-04T16:46:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.861+0000 7fb135877640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb130100820 0x7fb1300fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.861+0000 7fb135877640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb130100820 0x7fb1300fcc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:39166/0 (socket says 172.21.15.170:39166) 2024-09-04T16:46:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.861+0000 7fb135877640 1 -- 172.21.15.170:0/3506290185 learned_addr learned my addr 172.21.15.170:0/3506290185 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:46:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.861+0000 7fb135076640 1 --2- 172.21.15.170:0/3506290185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb130106820 0x7fb1300fd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.861+0000 7fb135877640 1 -- 172.21.15.170:0/3506290185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb130106820 msgr2=0x7fb1300fd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.861+0000 7fb135877640 1 --2- 172.21.15.170:0/3506290185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb130106820 0x7fb1300fd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.861+0000 7fb135877640 1 -- 172.21.15.170:0/3506290185 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1300fd6a0 con 0x7fb130100820 2024-09-04T16:46:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.861+0000 7fb135877640 1 --2- 172.21.15.170:0/3506290185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb130100820 0x7fb1300fcc20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb124031460 tx=0x7fb1240045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.862+0000 7fb122ffd640 1 -- 172.21.15.170:0/3506290185 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb12403f070 con 0x7fb130100820 2024-09-04T16:46:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.862+0000 7fb122ffd640 1 -- 172.21.15.170:0/3506290185 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb1240035f0 con 0x7fb130100820 2024-09-04T16:46:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.862+0000 7fb137adb640 1 -- 172.21.15.170:0/3506290185 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1300fd930 con 0x7fb130100820 2024-09-04T16:46:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.862+0000 7fb122ffd640 1 -- 172.21.15.170:0/3506290185 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb124035030 con 0x7fb130100820 2024-09-04T16:46:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.862+0000 7fb137adb640 1 -- 172.21.15.170:0/3506290185 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1301a3dd0 con 0x7fb130100820 2024-09-04T16:46:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.863+0000 7fb137adb640 1 -- 172.21.15.170:0/3506290185 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb130101f60 con 0x7fb130100820 2024-09-04T16:46:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.863+0000 7fb122ffd640 1 -- 172.21.15.170:0/3506290185 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fb124042070 con 0x7fb130100820 2024-09-04T16:46:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.864+0000 7fb122ffd640 1 --2- 172.21.15.170:0/3506290185 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb11c079e30 0x7fb11c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.864+0000 7fb122ffd640 1 -- 172.21.15.170:0/3506290185 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb1240bd3d0 con 0x7fb130100820 2024-09-04T16:46:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.864+0000 7fb135076640 1 --2- 172.21.15.170:0/3506290185 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb11c079e30 0x7fb11c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.864+0000 7fb135076640 1 --2- 172.21.15.170:0/3506290185 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb11c079e30 0x7fb11c07c2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb1300fe6b0 tx=0x7fb12c00b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:36.868+0000 7fb122ffd640 1 -- 172.21.15.170:0/3506290185 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb124088f50 con 0x7fb130100820 2024-09-04T16:46:37.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.077+0000 7fb137adb640 1 -- 172.21.15.170:0/3506290185 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb130109da0 con 0x7fb130100820 2024-09-04T16:46:37.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.077+0000 7fb122ffd640 1 -- 172.21.15.170:0/3506290185 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7fb12408d970 con 0x7fb130100820 2024-09-04T16:46:37.078 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:46:37.078 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:46:37.078 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:46:37.078 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:46:37.078 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:46:37.078 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:46:37.079 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:46:37.079 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:46:37.079 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:46:37.079 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:46:37.079 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:46:37.079 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:46:37.079 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:46:37.079 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:46:37.079 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:46:37.079 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:46:37.079 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:46:37.079 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:46:37.079 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:46:37.079 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:46:37.080 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:46:37.080 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:46:37.080 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:46:37.080 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:46:37.080 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:46:37.080 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:46:37.080 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:46:37.080 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:46:37.080 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:46:37.080 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:46:37.080 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:46:37.080 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:46:37.080 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:46:37.080 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:46:37.081 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:46:37.081 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:46:37.081 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:46:37.081 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:46:37.081 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:46:37.081 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:46:37.081 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:46:37.081 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:46:37.081 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:46:37.082 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:46:37.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.080+0000 7fb137adb640 1 -- 172.21.15.170:0/3506290185 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb11c079e30 msgr2=0x7fb11c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:37.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.080+0000 7fb137adb640 1 --2- 172.21.15.170:0/3506290185 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb11c079e30 0x7fb11c07c2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb1300fe6b0 tx=0x7fb12c00b390 comp rx=0 tx=0).stop 2024-09-04T16:46:37.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.080+0000 7fb137adb640 1 -- 172.21.15.170:0/3506290185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb130100820 msgr2=0x7fb1300fcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:37.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.080+0000 7fb137adb640 1 --2- 172.21.15.170:0/3506290185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb130100820 0x7fb1300fcc20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb124031460 tx=0x7fb1240045e0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.080+0000 7fb137adb640 1 -- 172.21.15.170:0/3506290185 shutdown_connections 2024-09-04T16:46:37.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.080+0000 7fb137adb640 1 --2- 172.21.15.170:0/3506290185 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb11c079e30 0x7fb11c07c2f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.080+0000 7fb137adb640 1 --2- 172.21.15.170:0/3506290185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb130106820 0x7fb1300fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.080+0000 7fb137adb640 1 --2- 172.21.15.170:0/3506290185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb130100820 0x7fb1300fcc20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.080+0000 7fb137adb640 1 -- 172.21.15.170:0/3506290185 >> 172.21.15.170:0/3506290185 conn(0x7fb1300fc520 msgr2=0x7fb13006a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:37.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.080+0000 7fb137adb640 1 -- 172.21.15.170:0/3506290185 shutdown_connections 2024-09-04T16:46:37.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.080+0000 7fb137adb640 1 -- 172.21.15.170:0/3506290185 wait complete. 2024-09-04T16:46:37.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.163+0000 7f0e4b736640 1 -- 172.21.15.170:0/3539380893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e441008d0 msgr2=0x7f0e44100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:37.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.163+0000 7f0e4b736640 1 --2- 172.21.15.170:0/3539380893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e441008d0 0x7f0e44100cb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009880 tx=0x7f0e4002a530 comp rx=0 tx=0).stop 2024-09-04T16:46:37.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.163+0000 7f0e4b736640 1 -- 172.21.15.170:0/3539380893 shutdown_connections 2024-09-04T16:46:37.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.163+0000 7f0e4b736640 1 --2- 172.21.15.170:0/3539380893 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e441011f0 0x7f0e441056c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.163+0000 7f0e4b736640 1 --2- 172.21.15.170:0/3539380893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e441008d0 0x7f0e44100cb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.163+0000 7f0e4b736640 1 -- 172.21.15.170:0/3539380893 >> 172.21.15.170:0/3539380893 conn(0x7f0e440fc520 msgr2=0x7f0e440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:37.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.163+0000 7f0e4b736640 1 -- 172.21.15.170:0/3539380893 shutdown_connections 2024-09-04T16:46:37.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.163+0000 7f0e4b736640 1 -- 172.21.15.170:0/3539380893 wait complete. 2024-09-04T16:46:37.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.164+0000 7f0e4b736640 1 Processor -- start 2024-09-04T16:46:37.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.164+0000 7f0e4b736640 1 -- start start 2024-09-04T16:46:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.164+0000 7f0e4b736640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e441008d0 0x7f0e4419dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.164+0000 7f0e4b736640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e441011f0 0x7f0e4419e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.164+0000 7f0e4b736640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0e441153f0 con 0x7f0e441008d0 2024-09-04T16:46:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.164+0000 7f0e4b736640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0e44115270 con 0x7f0e441011f0 2024-09-04T16:46:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.164+0000 7f0e494d2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e441008d0 0x7f0e4419dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.164+0000 7f0e494d2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e441008d0 0x7f0e4419dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:39186/0 (socket says 172.21.15.170:39186) 2024-09-04T16:46:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.164+0000 7f0e494d2640 1 -- 172.21.15.170:0/8134960 learned_addr learned my addr 172.21.15.170:0/8134960 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:46:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.164+0000 7f0e48cd1640 1 --2- 172.21.15.170:0/8134960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e441011f0 0x7f0e4419e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.165+0000 7f0e494d2640 1 -- 172.21.15.170:0/8134960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e441011f0 msgr2=0x7f0e4419e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.165+0000 7f0e494d2640 1 --2- 172.21.15.170:0/8134960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e441011f0 0x7f0e4419e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.165+0000 7f0e494d2640 1 -- 172.21.15.170:0/8134960 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e441a28a0 con 0x7f0e441008d0 2024-09-04T16:46:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.165+0000 7f0e494d2640 1 --2- 172.21.15.170:0/8134960 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e441008d0 0x7f0e4419dfd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0e40031460 tx=0x7f0e400045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:37.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.165+0000 7f0e3a7fc640 1 -- 172.21.15.170:0/8134960 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e4003f070 con 0x7f0e441008d0 2024-09-04T16:46:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.165+0000 7f0e3a7fc640 1 -- 172.21.15.170:0/8134960 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0e400035f0 con 0x7f0e441008d0 2024-09-04T16:46:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.165+0000 7f0e4b736640 1 -- 172.21.15.170:0/8134960 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e441a2b30 con 0x7f0e441008d0 2024-09-04T16:46:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.165+0000 7f0e3a7fc640 1 -- 172.21.15.170:0/8134960 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e40035030 con 0x7f0e441008d0 2024-09-04T16:46:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.165+0000 7f0e4b736640 1 -- 172.21.15.170:0/8134960 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e441a3060 con 0x7f0e441008d0 2024-09-04T16:46:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.166+0000 7f0e4b736640 1 -- 172.21.15.170:0/8134960 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e4406abe0 con 0x7f0e441008d0 2024-09-04T16:46:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.167+0000 7f0e3a7fc640 1 -- 172.21.15.170:0/8134960 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f0e40042070 con 0x7f0e441008d0 2024-09-04T16:46:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.167+0000 7f0e3a7fc640 1 --2- 172.21.15.170:0/8134960 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0e30079e80 0x7f0e3007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.167+0000 7f0e3a7fc640 1 -- 172.21.15.170:0/8134960 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f0e400bd3a0 con 0x7f0e441008d0 2024-09-04T16:46:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.167+0000 7f0e48cd1640 1 --2- 172.21.15.170:0/8134960 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0e30079e80 0x7f0e3007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.168+0000 7f0e48cd1640 1 --2- 172.21.15.170:0/8134960 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0e30079e80 0x7f0e3007c340 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0e44112510 tx=0x7f0e3400b360 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:37.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.172+0000 7f0e3a7fc640 1 -- 172.21.15.170:0/8134960 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0e40088f00 con 0x7f0e441008d0 2024-09-04T16:46:37.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:37 smithi170 ceph-mon[113855]: from='client.34754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:46:37.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:37 smithi170 ceph-mon[113855]: from='client.34758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:46:37.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:37 smithi170 ceph-mon[113855]: from='client.34762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:46:37.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:37 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2832583847' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:46:37.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:37 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3506290185' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:46:37.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.363+0000 7f0e4b736640 1 -- 172.21.15.170:0/8134960 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0e441a33d0 con 0x7f0e30079e80 2024-09-04T16:46:37.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.365+0000 7f0e3a7fc640 1 -- 172.21.15.170:0/8134960 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f0e441a33d0 con 0x7f0e30079e80 2024-09-04T16:46:37.365 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:46:37.365 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:46:37.365 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:46:37.365 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:46:37.365 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:46:37.366 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:46:37.366 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:46:37.366 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:46:37.366 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:46:37.366 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:46:37.366 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:46:37.366 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:46:37.366 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:46:37.366 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:46:37.366 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:46:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.367+0000 7f0e4b736640 1 -- 172.21.15.170:0/8134960 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0e30079e80 msgr2=0x7f0e3007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.367+0000 7f0e4b736640 1 --2- 172.21.15.170:0/8134960 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0e30079e80 0x7f0e3007c340 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0e44112510 tx=0x7f0e3400b360 comp rx=0 tx=0).stop 2024-09-04T16:46:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.367+0000 7f0e4b736640 1 -- 172.21.15.170:0/8134960 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e441008d0 msgr2=0x7f0e4419dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.367+0000 7f0e4b736640 1 --2- 172.21.15.170:0/8134960 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e441008d0 0x7f0e4419dfd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0e40031460 tx=0x7f0e400045e0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.367+0000 7f0e4b736640 1 -- 172.21.15.170:0/8134960 shutdown_connections 2024-09-04T16:46:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.367+0000 7f0e4b736640 1 --2- 172.21.15.170:0/8134960 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0e30079e80 0x7f0e3007c340 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.367+0000 7f0e4b736640 1 --2- 172.21.15.170:0/8134960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e441011f0 0x7f0e4419e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.367+0000 7f0e4b736640 1 --2- 172.21.15.170:0/8134960 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e441008d0 0x7f0e4419dfd0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.367+0000 7f0e4b736640 1 -- 172.21.15.170:0/8134960 >> 172.21.15.170:0/8134960 conn(0x7f0e440fc520 msgr2=0x7f0e44112bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.367+0000 7f0e4b736640 1 -- 172.21.15.170:0/8134960 shutdown_connections 2024-09-04T16:46:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.367+0000 7f0e4b736640 1 -- 172.21.15.170:0/8134960 wait complete. 2024-09-04T16:46:37.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:37 smithi193 ceph-mon[82547]: from='client.34754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:46:37.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:37 smithi193 ceph-mon[82547]: from='client.34758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:46:37.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:37 smithi193 ceph-mon[82547]: from='client.34762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:46:37.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:37 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2832583847' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:46:37.409 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:37 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3506290185' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:46:37.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.447+0000 7fe681768640 1 -- 172.21.15.170:0/2224972695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe67c102b40 msgr2=0x7fe67c102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:37.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.447+0000 7fe681768640 1 --2- 172.21.15.170:0/2224972695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe67c102b40 0x7fe67c102f20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009c20 tx=0x7fe66c02aa00 comp rx=0 tx=0).stop 2024-09-04T16:46:37.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.447+0000 7fe681768640 1 -- 172.21.15.170:0/2224972695 shutdown_connections 2024-09-04T16:46:37.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.447+0000 7fe681768640 1 --2- 172.21.15.170:0/2224972695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe67c103460 0x7fe67c10b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.447+0000 7fe681768640 1 --2- 172.21.15.170:0/2224972695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe67c102b40 0x7fe67c102f20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.447+0000 7fe681768640 1 -- 172.21.15.170:0/2224972695 >> 172.21.15.170:0/2224972695 conn(0x7fe67c0fc4c0 msgr2=0x7fe67c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:37.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.448+0000 7fe681768640 1 -- 172.21.15.170:0/2224972695 shutdown_connections 2024-09-04T16:46:37.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.448+0000 7fe681768640 1 -- 172.21.15.170:0/2224972695 wait complete. 2024-09-04T16:46:37.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.448+0000 7fe681768640 1 Processor -- start 2024-09-04T16:46:37.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.448+0000 7fe681768640 1 -- start start 2024-09-04T16:46:37.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.448+0000 7fe681768640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe67c102b40 0x7fe67c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:37.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.448+0000 7fe681768640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe67c103460 0x7fe67c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:37.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.449+0000 7fe681768640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c10edd0 con 0x7fe67c102b40 2024-09-04T16:46:37.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.449+0000 7fe681768640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c10ec50 con 0x7fe67c103460 2024-09-04T16:46:37.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.449+0000 7fe67affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe67c102b40 0x7fe67c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:37.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.449+0000 7fe67affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe67c102b40 0x7fe67c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:39204/0 (socket says 172.21.15.170:39204) 2024-09-04T16:46:37.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.449+0000 7fe67affd640 1 -- 172.21.15.170:0/3225846609 learned_addr learned my addr 172.21.15.170:0/3225846609 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:46:37.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.449+0000 7fe67a7fc640 1 --2- 172.21.15.170:0/3225846609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe67c103460 0x7fe67c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:37.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.449+0000 7fe67affd640 1 -- 172.21.15.170:0/3225846609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe67c103460 msgr2=0x7fe67c19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:37.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.449+0000 7fe67affd640 1 --2- 172.21.15.170:0/3225846609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe67c103460 0x7fe67c19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.449+0000 7fe67affd640 1 -- 172.21.15.170:0/3225846609 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67c1977c0 con 0x7fe67c102b40 2024-09-04T16:46:37.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.449+0000 7fe67a7fc640 1 --2- 172.21.15.170:0/3225846609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe67c103460 0x7fe67c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:46:37.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.449+0000 7fe67affd640 1 --2- 172.21.15.170:0/3225846609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe67c102b40 0x7fe67c19d640 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe66c02af20 tx=0x7fe66c02ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:37.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.449+0000 7fe673fff640 1 -- 172.21.15.170:0/3225846609 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe66c047070 con 0x7fe67c102b40 2024-09-04T16:46:37.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.449+0000 7fe673fff640 1 -- 172.21.15.170:0/3225846609 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe66c003e30 con 0x7fe67c102b40 2024-09-04T16:46:37.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.449+0000 7fe673fff640 1 -- 172.21.15.170:0/3225846609 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe66c033050 con 0x7fe67c102b40 2024-09-04T16:46:37.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.449+0000 7fe681768640 1 -- 172.21.15.170:0/3225846609 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67c197a50 con 0x7fe67c102b40 2024-09-04T16:46:37.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.449+0000 7fe681768640 1 -- 172.21.15.170:0/3225846609 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67c197f80 con 0x7fe67c102b40 2024-09-04T16:46:37.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.450+0000 7fe681768640 1 -- 172.21.15.170:0/3225846609 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe67c06a370 con 0x7fe67c102b40 2024-09-04T16:46:37.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.451+0000 7fe673fff640 1 -- 172.21.15.170:0/3225846609 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fe66c04a070 con 0x7fe67c102b40 2024-09-04T16:46:37.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.452+0000 7fe673fff640 1 --2- 172.21.15.170:0/3225846609 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe668079e30 0x7fe66807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:46:37.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.452+0000 7fe673fff640 1 -- 172.21.15.170:0/3225846609 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe66c03e030 con 0x7fe67c102b40 2024-09-04T16:46:37.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.452+0000 7fe67a7fc640 1 --2- 172.21.15.170:0/3225846609 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe668079e30 0x7fe66807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:46:37.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.452+0000 7fe67a7fc640 1 --2- 172.21.15.170:0/3225846609 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe668079e30 0x7fe66807c2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe6640058c0 tx=0x7fe664005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:46:37.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.456+0000 7fe673fff640 1 -- 172.21.15.170:0/3225846609 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe66c085620 con 0x7fe67c102b40 2024-09-04T16:46:37.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.697+0000 7fe681768640 1 -- 172.21.15.170:0/3225846609 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe67c106010 con 0x7fe67c102b40 2024-09-04T16:46:37.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.698+0000 7fe673fff640 1 -- 172.21.15.170:0/3225846609 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fe66c089790 con 0x7fe67c102b40 2024-09-04T16:46:37.699 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:46:37.699 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:46:37.699 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:46:37.699 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:46:37.699 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:46:37.699 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:46:37.699 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:46:37.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.700+0000 7fe681768640 1 -- 172.21.15.170:0/3225846609 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe668079e30 msgr2=0x7fe66807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:37.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.700+0000 7fe681768640 1 --2- 172.21.15.170:0/3225846609 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe668079e30 0x7fe66807c2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe6640058c0 tx=0x7fe664005850 comp rx=0 tx=0).stop 2024-09-04T16:46:37.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.700+0000 7fe681768640 1 -- 172.21.15.170:0/3225846609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe67c102b40 msgr2=0x7fe67c19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:46:37.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.700+0000 7fe681768640 1 --2- 172.21.15.170:0/3225846609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe67c102b40 0x7fe67c19d640 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe66c02af20 tx=0x7fe66c02ee50 comp rx=0 tx=0).stop 2024-09-04T16:46:37.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.700+0000 7fe681768640 1 -- 172.21.15.170:0/3225846609 shutdown_connections 2024-09-04T16:46:37.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.700+0000 7fe681768640 1 --2- 172.21.15.170:0/3225846609 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe668079e30 0x7fe66807c2f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.700+0000 7fe681768640 1 --2- 172.21.15.170:0/3225846609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe67c103460 0x7fe67c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.700+0000 7fe681768640 1 --2- 172.21.15.170:0/3225846609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe67c102b40 0x7fe67c19d640 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:46:37.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.700+0000 7fe681768640 1 -- 172.21.15.170:0/3225846609 >> 172.21.15.170:0/3225846609 conn(0x7fe67c0fc4c0 msgr2=0x7fe67c103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:46:37.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.700+0000 7fe681768640 1 -- 172.21.15.170:0/3225846609 shutdown_connections 2024-09-04T16:46:37.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:46:37.700+0000 7fe681768640 1 -- 172.21.15.170:0/3225846609 wait complete. 2024-09-04T16:46:38.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:38 smithi193 ceph-mon[82547]: pgmap v507: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:38.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:38 smithi193 ceph-mon[82547]: from='client.34774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:46:38.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:38 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3225846609' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:46:38.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:38 smithi170 ceph-mon[113855]: pgmap v507: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:38.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:38 smithi170 ceph-mon[113855]: from='client.34774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:46:38.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:38 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3225846609' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:46:40.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:40 smithi193 ceph-mon[82547]: pgmap v508: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:40.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:40 smithi170 ceph-mon[113855]: pgmap v508: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:42.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:42 smithi193 ceph-mon[82547]: pgmap v509: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:42.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:42 smithi170 ceph-mon[113855]: pgmap v509: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:44.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:44 smithi193 ceph-mon[82547]: pgmap v510: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:44.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:44 smithi170 ceph-mon[113855]: pgmap v510: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:45.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:45 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:46:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:45 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:46:46.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:46 smithi170 ceph-mon[113855]: pgmap v511: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:46.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:46 smithi193 ceph-mon[82547]: pgmap v511: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:48.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:48 smithi193 ceph-mon[82547]: pgmap v512: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:48.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:48 smithi170 ceph-mon[113855]: pgmap v512: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:50.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:50 smithi193 ceph-mon[82547]: pgmap v513: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:50.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:50 smithi170 ceph-mon[113855]: pgmap v513: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:52.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:52 smithi193 ceph-mon[82547]: pgmap v514: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:52.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:52 smithi170 ceph-mon[113855]: pgmap v514: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:54.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:54 smithi193 ceph-mon[82547]: pgmap v515: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:54.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:54 smithi170 ceph-mon[113855]: pgmap v515: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:56.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:56 smithi170 ceph-mon[113855]: pgmap v516: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:56.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:56 smithi193 ceph-mon[82547]: pgmap v516: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:58.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:46:58 smithi193 ceph-mon[82547]: pgmap v517: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:46:58.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:46:58 smithi170 ceph-mon[113855]: pgmap v517: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:00.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:00 smithi193 ceph-mon[82547]: pgmap v518: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:00.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:00 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:47:00.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:00 smithi170 ceph-mon[113855]: pgmap v518: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:00 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:47:02.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:02 smithi193 ceph-mon[82547]: pgmap v519: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:02.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:02 smithi170 ceph-mon[113855]: pgmap v519: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:04.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:04 smithi193 ceph-mon[82547]: pgmap v520: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:04.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:04 smithi170 ceph-mon[113855]: pgmap v520: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:06.404 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:06 smithi170 ceph-mon[113855]: pgmap v521: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:06.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:06 smithi193 ceph-mon[82547]: pgmap v521: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:07.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.793+0000 7f76d9315640 1 -- 172.21.15.170:0/1050974185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d4103400 msgr2=0x7f76d410b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:07.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.793+0000 7f76d9315640 1 --2- 172.21.15.170:0/1050974185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d4103400 0x7f76d410b8f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009880 tx=0x7f76c802a530 comp rx=0 tx=0).stop 2024-09-04T16:47:07.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.793+0000 7f76d9315640 1 -- 172.21.15.170:0/1050974185 shutdown_connections 2024-09-04T16:47:07.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.793+0000 7f76d9315640 1 --2- 172.21.15.170:0/1050974185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d4103400 0x7f76d410b8f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:07.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.793+0000 7f76d9315640 1 --2- 172.21.15.170:0/1050974185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76d4102ae0 0x7f76d4102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:07.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.794+0000 7f76d9315640 1 -- 172.21.15.170:0/1050974185 >> 172.21.15.170:0/1050974185 conn(0x7f76d40fc520 msgr2=0x7f76d40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:07.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.794+0000 7f76d9315640 1 -- 172.21.15.170:0/1050974185 shutdown_connections 2024-09-04T16:47:07.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.794+0000 7f76d9315640 1 -- 172.21.15.170:0/1050974185 wait complete. 2024-09-04T16:47:07.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.794+0000 7f76d9315640 1 Processor -- start 2024-09-04T16:47:07.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.794+0000 7f76d9315640 1 -- start start 2024-09-04T16:47:07.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.795+0000 7f76d9315640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d4102ae0 0x7f76d419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:07.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.795+0000 7f76d9315640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76d4103400 0x7f76d419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:07.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.795+0000 7f76d9315640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f76d410edf0 con 0x7f76d4102ae0 2024-09-04T16:47:07.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.795+0000 7f76d9315640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f76d410ec70 con 0x7f76d4103400 2024-09-04T16:47:07.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.795+0000 7f76d2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d4102ae0 0x7f76d419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:07.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.795+0000 7f76d2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d4102ae0 0x7f76d419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41284/0 (socket says 172.21.15.170:41284) 2024-09-04T16:47:07.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.795+0000 7f76d2ffd640 1 -- 172.21.15.170:0/3025313748 learned_addr learned my addr 172.21.15.170:0/3025313748 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:47:07.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.795+0000 7f76d27fc640 1 --2- 172.21.15.170:0/3025313748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76d4103400 0x7f76d419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:07.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.795+0000 7f76d2ffd640 1 -- 172.21.15.170:0/3025313748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76d4103400 msgr2=0x7f76d419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:07.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.795+0000 7f76d2ffd640 1 --2- 172.21.15.170:0/3025313748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76d4103400 0x7f76d419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:07.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.795+0000 7f76d2ffd640 1 -- 172.21.15.170:0/3025313748 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d4197800 con 0x7f76d4102ae0 2024-09-04T16:47:07.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.795+0000 7f76d27fc640 1 --2- 172.21.15.170:0/3025313748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76d4103400 0x7f76d419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:47:07.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.795+0000 7f76d2ffd640 1 --2- 172.21.15.170:0/3025313748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d4102ae0 0x7f76d419d680 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f76c400c8a0 tx=0x7f76c400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:07.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.796+0000 7f76bbfff640 1 -- 172.21.15.170:0/3025313748 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76c40079b0 con 0x7f76d4102ae0 2024-09-04T16:47:07.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.796+0000 7f76d9315640 1 -- 172.21.15.170:0/3025313748 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d4197af0 con 0x7f76d4102ae0 2024-09-04T16:47:07.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.796+0000 7f76bbfff640 1 -- 172.21.15.170:0/3025313748 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76c4007b50 con 0x7f76d4102ae0 2024-09-04T16:47:07.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.796+0000 7f76bbfff640 1 -- 172.21.15.170:0/3025313748 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76c4018700 con 0x7f76d4102ae0 2024-09-04T16:47:07.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.796+0000 7f76d9315640 1 -- 172.21.15.170:0/3025313748 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d4198080 con 0x7f76d4102ae0 2024-09-04T16:47:07.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.797+0000 7f76d9315640 1 -- 172.21.15.170:0/3025313748 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d406abe0 con 0x7f76d4102ae0 2024-09-04T16:47:07.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.797+0000 7f76bbfff640 1 -- 172.21.15.170:0/3025313748 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f76c4007d00 con 0x7f76d4102ae0 2024-09-04T16:47:07.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.798+0000 7f76bbfff640 1 --2- 172.21.15.170:0/3025313748 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76bc079e30 0x7f76bc07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:07.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.798+0000 7f76bbfff640 1 -- 172.21.15.170:0/3025313748 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f76c409cd70 con 0x7f76d4102ae0 2024-09-04T16:47:07.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.798+0000 7f76d27fc640 1 --2- 172.21.15.170:0/3025313748 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76bc079e30 0x7f76bc07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:07.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.799+0000 7f76d27fc640 1 --2- 172.21.15.170:0/3025313748 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76bc079e30 0x7f76bc07c2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f76c8031460 tx=0x7f76c80095f0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:07.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.802+0000 7f76bbfff640 1 -- 172.21.15.170:0/3025313748 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f76c4014030 con 0x7f76d4102ae0 2024-09-04T16:47:07.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.994+0000 7f76d9315640 1 -- 172.21.15.170:0/3025313748 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f76d4198390 con 0x7f76bc079e30 2024-09-04T16:47:07.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.996+0000 7f76bbfff640 1 -- 172.21.15.170:0/3025313748 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f76d4198390 con 0x7f76bc079e30 2024-09-04T16:47:07.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.998+0000 7f76d9315640 1 -- 172.21.15.170:0/3025313748 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76bc079e30 msgr2=0x7f76bc07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:07.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.998+0000 7f76d9315640 1 --2- 172.21.15.170:0/3025313748 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76bc079e30 0x7f76bc07c2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f76c8031460 tx=0x7f76c80095f0 comp rx=0 tx=0).stop 2024-09-04T16:47:07.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.998+0000 7f76d9315640 1 -- 172.21.15.170:0/3025313748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d4102ae0 msgr2=0x7f76d419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:07.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.998+0000 7f76d9315640 1 --2- 172.21.15.170:0/3025313748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d4102ae0 0x7f76d419d680 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f76c400c8a0 tx=0x7f76c400cd60 comp rx=0 tx=0).stop 2024-09-04T16:47:07.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.998+0000 7f76d9315640 1 -- 172.21.15.170:0/3025313748 shutdown_connections 2024-09-04T16:47:08.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.998+0000 7f76d9315640 1 --2- 172.21.15.170:0/3025313748 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76bc079e30 0x7f76bc07c2f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.998+0000 7f76d9315640 1 --2- 172.21.15.170:0/3025313748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76d4103400 0x7f76d419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.998+0000 7f76d9315640 1 --2- 172.21.15.170:0/3025313748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d4102ae0 0x7f76d419d680 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.998+0000 7f76d9315640 1 -- 172.21.15.170:0/3025313748 >> 172.21.15.170:0/3025313748 conn(0x7f76d40fc520 msgr2=0x7f76d4108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:08.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.998+0000 7f76d9315640 1 -- 172.21.15.170:0/3025313748 shutdown_connections 2024-09-04T16:47:08.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:07.998+0000 7f76d9315640 1 -- 172.21.15.170:0/3025313748 wait complete. 2024-09-04T16:47:08.008 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:47:08.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.082+0000 7fd64f3b7640 1 -- 172.21.15.170:0/2981464271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd648107930 msgr2=0x7fd648107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:08.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.082+0000 7fd64f3b7640 1 --2- 172.21.15.170:0/2981464271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd648107930 0x7fd648107d10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd63c009880 tx=0x7fd63c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.082+0000 7fd64f3b7640 1 -- 172.21.15.170:0/2981464271 shutdown_connections 2024-09-04T16:47:08.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.082+0000 7fd64f3b7640 1 --2- 172.21.15.170:0/2981464271 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd648101930 0x7fd648101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.082+0000 7fd64f3b7640 1 --2- 172.21.15.170:0/2981464271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd648107930 0x7fd648107d10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.082+0000 7fd64f3b7640 1 -- 172.21.15.170:0/2981464271 >> 172.21.15.170:0/2981464271 conn(0x7fd6480fd630 msgr2=0x7fd6480ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:08.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.082+0000 7fd64f3b7640 1 -- 172.21.15.170:0/2981464271 shutdown_connections 2024-09-04T16:47:08.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.082+0000 7fd64f3b7640 1 -- 172.21.15.170:0/2981464271 wait complete. 2024-09-04T16:47:08.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.083+0000 7fd64f3b7640 1 Processor -- start 2024-09-04T16:47:08.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.083+0000 7fd64f3b7640 1 -- start start 2024-09-04T16:47:08.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.083+0000 7fd64f3b7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd648101930 0x7fd64819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:08.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.083+0000 7fd64f3b7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd648107930 0x7fd64819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:08.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.083+0000 7fd64f3b7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd64810ee60 con 0x7fd648101930 2024-09-04T16:47:08.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.083+0000 7fd64f3b7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd64810ece0 con 0x7fd648107930 2024-09-04T16:47:08.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.083+0000 7fd64d153640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd648101930 0x7fd64819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:08.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.083+0000 7fd64d153640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd648101930 0x7fd64819d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41306/0 (socket says 172.21.15.170:41306) 2024-09-04T16:47:08.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.083+0000 7fd64d153640 1 -- 172.21.15.170:0/3844589121 learned_addr learned my addr 172.21.15.170:0/3844589121 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:47:08.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.083+0000 7fd64c952640 1 --2- 172.21.15.170:0/3844589121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd648107930 0x7fd64819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:08.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.083+0000 7fd64d153640 1 -- 172.21.15.170:0/3844589121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd648107930 msgr2=0x7fd64819dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:08.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.083+0000 7fd64d153640 1 --2- 172.21.15.170:0/3844589121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd648107930 0x7fd64819dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.083+0000 7fd64d153640 1 -- 172.21.15.170:0/3844589121 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd648197890 con 0x7fd648101930 2024-09-04T16:47:08.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.084+0000 7fd64d153640 1 --2- 172.21.15.170:0/3844589121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd648101930 0x7fd64819d6d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd63c031460 tx=0x7fd63c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:08.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.084+0000 7fd63a7fc640 1 -- 172.21.15.170:0/3844589121 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd63c03f070 con 0x7fd648101930 2024-09-04T16:47:08.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.084+0000 7fd64f3b7640 1 -- 172.21.15.170:0/3844589121 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd648197b20 con 0x7fd648101930 2024-09-04T16:47:08.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.084+0000 7fd63a7fc640 1 -- 172.21.15.170:0/3844589121 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd63c004cf0 con 0x7fd648101930 2024-09-04T16:47:08.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.084+0000 7fd63a7fc640 1 -- 172.21.15.170:0/3844589121 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd63c035030 con 0x7fd648101930 2024-09-04T16:47:08.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.084+0000 7fd64f3b7640 1 -- 172.21.15.170:0/3844589121 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd648198050 con 0x7fd648101930 2024-09-04T16:47:08.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.085+0000 7fd64f3b7640 1 -- 172.21.15.170:0/3844589121 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd648103070 con 0x7fd648101930 2024-09-04T16:47:08.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.085+0000 7fd63a7fc640 1 -- 172.21.15.170:0/3844589121 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fd63c042070 con 0x7fd648101930 2024-09-04T16:47:08.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.086+0000 7fd63a7fc640 1 --2- 172.21.15.170:0/3844589121 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd634079e30 0x7fd63407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:08.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.086+0000 7fd63a7fc640 1 -- 172.21.15.170:0/3844589121 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd63c0bd5d0 con 0x7fd648101930 2024-09-04T16:47:08.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.086+0000 7fd64c952640 1 --2- 172.21.15.170:0/3844589121 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd634079e30 0x7fd63407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:08.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.087+0000 7fd64c952640 1 --2- 172.21.15.170:0/3844589121 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd634079e30 0x7fd63407c2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd6480ffc10 tx=0x7fd644008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:08.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.091+0000 7fd63a7fc640 1 -- 172.21.15.170:0/3844589121 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd63c084fe0 con 0x7fd648101930 2024-09-04T16:47:08.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.283+0000 7fd64f3b7640 1 -- 172.21.15.170:0/3844589121 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd648198dc0 con 0x7fd634079e30 2024-09-04T16:47:08.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.284+0000 7fd63a7fc640 1 -- 172.21.15.170:0/3844589121 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fd648198dc0 con 0x7fd634079e30 2024-09-04T16:47:08.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.286+0000 7fd64f3b7640 1 -- 172.21.15.170:0/3844589121 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd634079e30 msgr2=0x7fd63407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:08.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.286+0000 7fd64f3b7640 1 --2- 172.21.15.170:0/3844589121 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd634079e30 0x7fd63407c2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd6480ffc10 tx=0x7fd644008040 comp rx=0 tx=0).stop 2024-09-04T16:47:08.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.286+0000 7fd64f3b7640 1 -- 172.21.15.170:0/3844589121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd648101930 msgr2=0x7fd64819d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:08.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.286+0000 7fd64f3b7640 1 --2- 172.21.15.170:0/3844589121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd648101930 0x7fd64819d6d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd63c031460 tx=0x7fd63c0048f0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.286+0000 7fd64f3b7640 1 -- 172.21.15.170:0/3844589121 shutdown_connections 2024-09-04T16:47:08.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.286+0000 7fd64f3b7640 1 --2- 172.21.15.170:0/3844589121 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd634079e30 0x7fd63407c2f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.286+0000 7fd64f3b7640 1 --2- 172.21.15.170:0/3844589121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd648107930 0x7fd64819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.286+0000 7fd64f3b7640 1 --2- 172.21.15.170:0/3844589121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd648101930 0x7fd64819d6d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.286+0000 7fd64f3b7640 1 -- 172.21.15.170:0/3844589121 >> 172.21.15.170:0/3844589121 conn(0x7fd6480fd630 msgr2=0x7fd6480fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:08.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.287+0000 7fd64f3b7640 1 -- 172.21.15.170:0/3844589121 shutdown_connections 2024-09-04T16:47:08.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.287+0000 7fd64f3b7640 1 -- 172.21.15.170:0/3844589121 wait complete. 2024-09-04T16:47:08.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:08 smithi170 ceph-mon[113855]: pgmap v522: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:08.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.368+0000 7f0d605ae640 1 -- 172.21.15.170:0/3012755024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d58100820 msgr2=0x7f0d58100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:08.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.368+0000 7f0d605ae640 1 --2- 172.21.15.170:0/3012755024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d58100820 0x7f0d58100c80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009880 tx=0x7f0d5402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.368+0000 7f0d605ae640 1 -- 172.21.15.170:0/3012755024 shutdown_connections 2024-09-04T16:47:08.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.368+0000 7f0d605ae640 1 --2- 172.21.15.170:0/3012755024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d58100820 0x7f0d58100c80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.368+0000 7f0d605ae640 1 --2- 172.21.15.170:0/3012755024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d58106820 0x7f0d58106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.368+0000 7f0d605ae640 1 -- 172.21.15.170:0/3012755024 >> 172.21.15.170:0/3012755024 conn(0x7f0d580fc520 msgr2=0x7f0d580fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:08.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.368+0000 7f0d605ae640 1 -- 172.21.15.170:0/3012755024 shutdown_connections 2024-09-04T16:47:08.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.368+0000 7f0d605ae640 1 -- 172.21.15.170:0/3012755024 wait complete. 2024-09-04T16:47:08.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.369+0000 7f0d605ae640 1 Processor -- start 2024-09-04T16:47:08.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.369+0000 7f0d605ae640 1 -- start start 2024-09-04T16:47:08.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.369+0000 7f0d605ae640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d58100820 0x7f0d5819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:08.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.369+0000 7f0d605ae640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d58106820 0x7f0d5819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:08.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.369+0000 7f0d605ae640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5810dcd0 con 0x7f0d58100820 2024-09-04T16:47:08.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.369+0000 7f0d605ae640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5810db50 con 0x7f0d58106820 2024-09-04T16:47:08.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.369+0000 7f0d5e34a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d58100820 0x7f0d5819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:08.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.369+0000 7f0d5e34a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d58100820 0x7f0d5819d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41322/0 (socket says 172.21.15.170:41322) 2024-09-04T16:47:08.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.369+0000 7f0d5e34a640 1 -- 172.21.15.170:0/3270687657 learned_addr learned my addr 172.21.15.170:0/3270687657 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:47:08.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.369+0000 7f0d5db49640 1 --2- 172.21.15.170:0/3270687657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d58106820 0x7f0d5819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:08.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.369+0000 7f0d5e34a640 1 -- 172.21.15.170:0/3270687657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d58106820 msgr2=0x7f0d5819db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:08.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.369+0000 7f0d5e34a640 1 --2- 172.21.15.170:0/3270687657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d58106820 0x7f0d5819db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.369+0000 7f0d5e34a640 1 -- 172.21.15.170:0/3270687657 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d581977c0 con 0x7f0d58100820 2024-09-04T16:47:08.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.369+0000 7f0d5db49640 1 --2- 172.21.15.170:0/3270687657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d58106820 0x7f0d5819db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:47:08.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.370+0000 7f0d5e34a640 1 --2- 172.21.15.170:0/3270687657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d58100820 0x7f0d5819d640 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00c8a0 tx=0x7f0d4c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:08.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.370+0000 7f0d4b7fe640 1 -- 172.21.15.170:0/3270687657 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d4c0079b0 con 0x7f0d58100820 2024-09-04T16:47:08.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.370+0000 7f0d4b7fe640 1 -- 172.21.15.170:0/3270687657 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d4c007b50 con 0x7f0d58100820 2024-09-04T16:47:08.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.370+0000 7f0d605ae640 1 -- 172.21.15.170:0/3270687657 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d58197ab0 con 0x7f0d58100820 2024-09-04T16:47:08.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.370+0000 7f0d4b7fe640 1 -- 172.21.15.170:0/3270687657 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d4c018700 con 0x7f0d58100820 2024-09-04T16:47:08.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.370+0000 7f0d605ae640 1 -- 172.21.15.170:0/3270687657 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d58198010 con 0x7f0d58100820 2024-09-04T16:47:08.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.371+0000 7f0d605ae640 1 -- 172.21.15.170:0/3270687657 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d58101f60 con 0x7f0d58100820 2024-09-04T16:47:08.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.371+0000 7f0d4b7fe640 1 -- 172.21.15.170:0/3270687657 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f0d4c007d00 con 0x7f0d58100820 2024-09-04T16:47:08.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.372+0000 7f0d4b7fe640 1 --2- 172.21.15.170:0/3270687657 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0d44079e80 0x7f0d4407c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:08.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.372+0000 7f0d4b7fe640 1 -- 172.21.15.170:0/3270687657 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f0d4c09cc90 con 0x7f0d58100820 2024-09-04T16:47:08.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.372+0000 7f0d5db49640 1 --2- 172.21.15.170:0/3270687657 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0d44079e80 0x7f0d4407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:08.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.372+0000 7f0d5db49640 1 --2- 172.21.15.170:0/3270687657 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0d44079e80 0x7f0d4407c340 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0d58198b10 tx=0x7f0d54009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:08.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.376+0000 7f0d4b7fe640 1 -- 172.21.15.170:0/3270687657 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0d4c014030 con 0x7f0d58100820 2024-09-04T16:47:08.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:08 smithi193 ceph-mon[82547]: pgmap v522: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:08.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.556+0000 7f0d605ae640 1 -- 172.21.15.170:0/3270687657 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0d58198320 con 0x7f0d44079e80 2024-09-04T16:47:08.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.566+0000 7f0d4b7fe640 1 -- 172.21.15.170:0/3270687657 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f0d58198320 con 0x7f0d44079e80 2024-09-04T16:47:08.567 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:47:08.567 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (14m) 8m ago 24m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:47:08.567 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (17m) 8m ago 25m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:47:08.567 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (16m) 7m ago 24m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:47:08.567 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (12m) 8m ago 25m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:47:08.567 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (12m) 7m ago 24m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:47:08.567 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (13m) 8m ago 24m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:47:08.567 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (8m) 8m ago 19m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:47:08.568 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (8m) 8m ago 19m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:47:08.568 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (7m) 7m ago 19m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:47:08.568 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (8m) 7m ago 19m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:47:08.568 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (16m) 8m ago 26m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:47:08.568 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (15m) 7m ago 24m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:47:08.569 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (12m) 8m ago 26m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:47:08.569 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (12m) 7m ago 23m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:47:08.569 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (14m) 8m ago 25m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:47:08.569 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (14m) 7m ago 24m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:47:08.569 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (11m) 8m ago 22m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:47:08.569 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (11m) 8m ago 22m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:47:08.569 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (10m) 8m ago 21m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:47:08.569 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (10m) 7m ago 21m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:47:08.569 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (9m) 7m ago 21m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:47:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (8m) 7m ago 20m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:47:08.570 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (14m) 8m ago 24m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:47:08.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.568+0000 7f0d605ae640 1 -- 172.21.15.170:0/3270687657 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0d44079e80 msgr2=0x7f0d4407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:08.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.568+0000 7f0d605ae640 1 --2- 172.21.15.170:0/3270687657 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0d44079e80 0x7f0d4407c340 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0d58198b10 tx=0x7f0d54009560 comp rx=0 tx=0).stop 2024-09-04T16:47:08.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.568+0000 7f0d605ae640 1 -- 172.21.15.170:0/3270687657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d58100820 msgr2=0x7f0d5819d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:08.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.568+0000 7f0d605ae640 1 --2- 172.21.15.170:0/3270687657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d58100820 0x7f0d5819d640 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00c8a0 tx=0x7f0d4c00cd60 comp rx=0 tx=0).stop 2024-09-04T16:47:08.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.568+0000 7f0d605ae640 1 -- 172.21.15.170:0/3270687657 shutdown_connections 2024-09-04T16:47:08.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.568+0000 7f0d605ae640 1 --2- 172.21.15.170:0/3270687657 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0d44079e80 0x7f0d4407c340 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.568+0000 7f0d605ae640 1 --2- 172.21.15.170:0/3270687657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d58106820 0x7f0d5819db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.568+0000 7f0d605ae640 1 --2- 172.21.15.170:0/3270687657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d58100820 0x7f0d5819d640 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.568+0000 7f0d605ae640 1 -- 172.21.15.170:0/3270687657 >> 172.21.15.170:0/3270687657 conn(0x7f0d580fc520 msgr2=0x7f0d5806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:08.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.568+0000 7f0d605ae640 1 -- 172.21.15.170:0/3270687657 shutdown_connections 2024-09-04T16:47:08.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.568+0000 7f0d605ae640 1 -- 172.21.15.170:0/3270687657 wait complete. 2024-09-04T16:47:08.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.648+0000 7f8e16c17640 1 -- 172.21.15.170:0/1567452692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e10103400 msgr2=0x7f8e1010b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:08.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.648+0000 7f8e16c17640 1 --2- 172.21.15.170:0/1567452692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e10103400 0x7f8e1010b8f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009c20 tx=0x7f8e0002aa00 comp rx=0 tx=0).stop 2024-09-04T16:47:08.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.648+0000 7f8e16c17640 1 -- 172.21.15.170:0/1567452692 shutdown_connections 2024-09-04T16:47:08.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.648+0000 7f8e16c17640 1 --2- 172.21.15.170:0/1567452692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e10103400 0x7f8e1010b8f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.648+0000 7f8e16c17640 1 --2- 172.21.15.170:0/1567452692 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e10102ae0 0x7f8e10102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.648+0000 7f8e16c17640 1 -- 172.21.15.170:0/1567452692 >> 172.21.15.170:0/1567452692 conn(0x7f8e100fc520 msgr2=0x7f8e100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:08.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.648+0000 7f8e16c17640 1 -- 172.21.15.170:0/1567452692 shutdown_connections 2024-09-04T16:47:08.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.648+0000 7f8e16c17640 1 -- 172.21.15.170:0/1567452692 wait complete. 2024-09-04T16:47:08.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.649+0000 7f8e16c17640 1 Processor -- start 2024-09-04T16:47:08.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.649+0000 7f8e16c17640 1 -- start start 2024-09-04T16:47:08.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.649+0000 7f8e16c17640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e10102ae0 0x7f8e1019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:08.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.649+0000 7f8e16c17640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e10103400 0x7f8e1019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:08.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.649+0000 7f8e16c17640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1010edf0 con 0x7f8e10103400 2024-09-04T16:47:08.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.649+0000 7f8e16c17640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1010ec70 con 0x7f8e10102ae0 2024-09-04T16:47:08.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.649+0000 7f8e0ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e10103400 0x7f8e1019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:08.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.649+0000 7f8e0ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e10103400 0x7f8e1019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41344/0 (socket says 172.21.15.170:41344) 2024-09-04T16:47:08.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.649+0000 7f8e0ffff640 1 -- 172.21.15.170:0/112686287 learned_addr learned my addr 172.21.15.170:0/112686287 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:47:08.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.649+0000 7f8e149b3640 1 --2- 172.21.15.170:0/112686287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e10102ae0 0x7f8e1019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:08.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.649+0000 7f8e0ffff640 1 -- 172.21.15.170:0/112686287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e10102ae0 msgr2=0x7f8e1019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:08.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.649+0000 7f8e0ffff640 1 --2- 172.21.15.170:0/112686287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e10102ae0 0x7f8e1019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.649+0000 7f8e0ffff640 1 -- 172.21.15.170:0/112686287 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e10197800 con 0x7f8e10103400 2024-09-04T16:47:08.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.649+0000 7f8e149b3640 1 --2- 172.21.15.170:0/112686287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e10102ae0 0x7f8e1019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:47:08.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.650+0000 7f8e0ffff640 1 --2- 172.21.15.170:0/112686287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e10103400 0x7f8e1019dbc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8e0002af20 tx=0x7f8e0002ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:08.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.650+0000 7f8e0dffb640 1 -- 172.21.15.170:0/112686287 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e00047070 con 0x7f8e10103400 2024-09-04T16:47:08.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.650+0000 7f8e16c17640 1 -- 172.21.15.170:0/112686287 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e10197a90 con 0x7f8e10103400 2024-09-04T16:47:08.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.650+0000 7f8e0dffb640 1 -- 172.21.15.170:0/112686287 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e0002eeb0 con 0x7f8e10103400 2024-09-04T16:47:08.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.650+0000 7f8e0dffb640 1 -- 172.21.15.170:0/112686287 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e00033050 con 0x7f8e10103400 2024-09-04T16:47:08.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.650+0000 7f8e16c17640 1 -- 172.21.15.170:0/112686287 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e10197fc0 con 0x7f8e10103400 2024-09-04T16:47:08.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.651+0000 7f8e16c17640 1 -- 172.21.15.170:0/112686287 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e1006abe0 con 0x7f8e10103400 2024-09-04T16:47:08.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.652+0000 7f8e0dffb640 1 -- 172.21.15.170:0/112686287 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f8e0004a070 con 0x7f8e10103400 2024-09-04T16:47:08.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.652+0000 7f8e0dffb640 1 --2- 172.21.15.170:0/112686287 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8dfc079e40 0x7f8dfc07c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:08.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.652+0000 7f8e0dffb640 1 -- 172.21.15.170:0/112686287 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8e0003e030 con 0x7f8e10103400 2024-09-04T16:47:08.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.653+0000 7f8e149b3640 1 --2- 172.21.15.170:0/112686287 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8dfc079e40 0x7f8dfc07c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:08.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.653+0000 7f8e149b3640 1 --2- 172.21.15.170:0/112686287 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8dfc079e40 0x7f8dfc07c300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009b40 tx=0x7f8df8005e50 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:08.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.657+0000 7f8e0dffb640 1 -- 172.21.15.170:0/112686287 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8e00085670 con 0x7f8e10103400 2024-09-04T16:47:08.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.900+0000 7f8e16c17640 1 -- 172.21.15.170:0/112686287 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8e10198d30 con 0x7f8e10103400 2024-09-04T16:47:08.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.900+0000 7f8e0dffb640 1 -- 172.21.15.170:0/112686287 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f8e000897e0 con 0x7f8e10103400 2024-09-04T16:47:08.901 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:47:08.901 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:47:08.901 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:47:08.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:47:08.901 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:47:08.901 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:47:08.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:47:08.902 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:47:08.902 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:47:08.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:47:08.902 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:47:08.902 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:47:08.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:47:08.902 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:47:08.902 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:47:08.902 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:47:08.902 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:47:08.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.903+0000 7f8e16c17640 1 -- 172.21.15.170:0/112686287 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8dfc079e40 msgr2=0x7f8dfc07c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:08.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.903+0000 7f8e16c17640 1 --2- 172.21.15.170:0/112686287 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8dfc079e40 0x7f8dfc07c300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009b40 tx=0x7f8df8005e50 comp rx=0 tx=0).stop 2024-09-04T16:47:08.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.903+0000 7f8e16c17640 1 -- 172.21.15.170:0/112686287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e10103400 msgr2=0x7f8e1019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:08.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.903+0000 7f8e16c17640 1 --2- 172.21.15.170:0/112686287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e10103400 0x7f8e1019dbc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8e0002af20 tx=0x7f8e0002ed40 comp rx=0 tx=0).stop 2024-09-04T16:47:08.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.903+0000 7f8e16c17640 1 -- 172.21.15.170:0/112686287 shutdown_connections 2024-09-04T16:47:08.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.903+0000 7f8e16c17640 1 --2- 172.21.15.170:0/112686287 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8dfc079e40 0x7f8dfc07c300 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.903+0000 7f8e16c17640 1 --2- 172.21.15.170:0/112686287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e10103400 0x7f8e1019dbc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.903+0000 7f8e16c17640 1 --2- 172.21.15.170:0/112686287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8e10102ae0 0x7f8e1019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.903+0000 7f8e16c17640 1 -- 172.21.15.170:0/112686287 >> 172.21.15.170:0/112686287 conn(0x7f8e100fc520 msgr2=0x7f8e10108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:08.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.903+0000 7f8e16c17640 1 -- 172.21.15.170:0/112686287 shutdown_connections 2024-09-04T16:47:08.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.903+0000 7f8e16c17640 1 -- 172.21.15.170:0/112686287 wait complete. 2024-09-04T16:47:08.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.985+0000 7fbaaa379640 1 -- 172.21.15.170:0/122280975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa4101910 msgr2=0x7fbaa4101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:08.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.985+0000 7fbaaa379640 1 --2- 172.21.15.170:0/122280975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa4101910 0x7fbaa4101d70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fba98009880 tx=0x7fba9802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.985+0000 7fbaaa379640 1 -- 172.21.15.170:0/122280975 shutdown_connections 2024-09-04T16:47:08.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.985+0000 7fbaaa379640 1 --2- 172.21.15.170:0/122280975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa4101910 0x7fbaa4101d70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.985+0000 7fbaaa379640 1 --2- 172.21.15.170:0/122280975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaa4107910 0x7fbaa4107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.985+0000 7fbaaa379640 1 -- 172.21.15.170:0/122280975 >> 172.21.15.170:0/122280975 conn(0x7fbaa40fd5f0 msgr2=0x7fbaa40ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:08.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.985+0000 7fbaaa379640 1 -- 172.21.15.170:0/122280975 shutdown_connections 2024-09-04T16:47:08.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.985+0000 7fbaaa379640 1 -- 172.21.15.170:0/122280975 wait complete. 2024-09-04T16:47:08.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.985+0000 7fbaaa379640 1 Processor -- start 2024-09-04T16:47:08.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.985+0000 7fbaaa379640 1 -- start start 2024-09-04T16:47:08.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaaa379640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaa4101910 0x7fbaa419f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:08.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaaa379640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa4107910 0x7fbaa419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:08.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaaa379640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa410edc0 con 0x7fbaa4107910 2024-09-04T16:47:08.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaaa379640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa410ec40 con 0x7fbaa4101910 2024-09-04T16:47:08.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaa37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa4107910 0x7fbaa419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:08.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaa37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa4107910 0x7fbaa419fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41372/0 (socket says 172.21.15.170:41372) 2024-09-04T16:47:08.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaa37fe640 1 -- 172.21.15.170:0/4154786643 learned_addr learned my addr 172.21.15.170:0/4154786643 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:47:08.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaa3fff640 1 --2- 172.21.15.170:0/4154786643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaa4101910 0x7fbaa419f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:08.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaa37fe640 1 -- 172.21.15.170:0/4154786643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaa4101910 msgr2=0x7fbaa419f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:08.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaa37fe640 1 --2- 172.21.15.170:0/4154786643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaa4101910 0x7fbaa419f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:08.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaa37fe640 1 -- 172.21.15.170:0/4154786643 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa41999c0 con 0x7fbaa4107910 2024-09-04T16:47:08.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaa3fff640 1 --2- 172.21.15.170:0/4154786643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaa4101910 0x7fbaa419f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:47:08.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaa37fe640 1 --2- 172.21.15.170:0/4154786643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa4107910 0x7fbaa419fd40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fba98031460 tx=0x7fba980048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:08.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaa17fa640 1 -- 172.21.15.170:0/4154786643 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba9803f070 con 0x7fbaa4107910 2024-09-04T16:47:08.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaa17fa640 1 -- 172.21.15.170:0/4154786643 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba98004cf0 con 0x7fbaa4107910 2024-09-04T16:47:08.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaaa379640 1 -- 172.21.15.170:0/4154786643 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa4199c50 con 0x7fbaa4107910 2024-09-04T16:47:08.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.986+0000 7fbaa17fa640 1 -- 172.21.15.170:0/4154786643 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba98035030 con 0x7fbaa4107910 2024-09-04T16:47:08.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.987+0000 7fbaaa379640 1 -- 172.21.15.170:0/4154786643 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa419a180 con 0x7fbaa4107910 2024-09-04T16:47:08.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.988+0000 7fbaaa379640 1 -- 172.21.15.170:0/4154786643 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa4103050 con 0x7fbaa4107910 2024-09-04T16:47:08.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.988+0000 7fbaa17fa640 1 -- 172.21.15.170:0/4154786643 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fba98042070 con 0x7fbaa4107910 2024-09-04T16:47:08.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.989+0000 7fbaa17fa640 1 --2- 172.21.15.170:0/4154786643 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fba8c079e80 0x7fba8c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:08.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.989+0000 7fbaa17fa640 1 -- 172.21.15.170:0/4154786643 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fba980bd4b0 con 0x7fbaa4107910 2024-09-04T16:47:08.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.989+0000 7fbaa3fff640 1 --2- 172.21.15.170:0/4154786643 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fba8c079e80 0x7fba8c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:08.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.989+0000 7fbaa3fff640 1 --2- 172.21.15.170:0/4154786643 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fba8c079e80 0x7fba8c07c340 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fba94005fd0 tx=0x7fba94005ec0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:08.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:08.993+0000 7fbaa17fa640 1 -- 172.21.15.170:0/4154786643 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fba98084f40 con 0x7fbaa4107910 2024-09-04T16:47:09.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.207+0000 7fbaaa379640 1 -- 172.21.15.170:0/4154786643 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbaa419afc0 con 0x7fbaa4107910 2024-09-04T16:47:09.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.207+0000 7fbaa17fa640 1 -- 172.21.15.170:0/4154786643 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7fba9808d3f0 con 0x7fbaa4107910 2024-09-04T16:47:09.208 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:47:09.208 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:47:09.208 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:47:09.208 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:47:09.209 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:47:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:47:09.209 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:47:09.209 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:47:09.209 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:47:09.209 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:47:09.209 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:47:09.209 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:47:09.209 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:47:09.209 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:47:09.209 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:47:09.210 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:47:09.210 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:47:09.210 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:47:09.210 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:47:09.210 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:47:09.210 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:47:09.210 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:47:09.210 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:47:09.210 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:47:09.210 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:47:09.210 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:47:09.210 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:47:09.210 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:47:09.210 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:47:09.211 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:47:09.211 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:47:09.211 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:47:09.211 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:47:09.211 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:47:09.211 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:47:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:47:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:47:09.211 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:47:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:47:09.211 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:47:09.211 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:47:09.211 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:47:09.211 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:47:09.212 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:47:09.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.209+0000 7fbaaa379640 1 -- 172.21.15.170:0/4154786643 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fba8c079e80 msgr2=0x7fba8c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:09.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.209+0000 7fbaaa379640 1 --2- 172.21.15.170:0/4154786643 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fba8c079e80 0x7fba8c07c340 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fba94005fd0 tx=0x7fba94005ec0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.210+0000 7fbaaa379640 1 -- 172.21.15.170:0/4154786643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa4107910 msgr2=0x7fbaa419fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:09.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.210+0000 7fbaaa379640 1 --2- 172.21.15.170:0/4154786643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa4107910 0x7fbaa419fd40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fba98031460 tx=0x7fba980048f0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.210+0000 7fbaaa379640 1 -- 172.21.15.170:0/4154786643 shutdown_connections 2024-09-04T16:47:09.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.210+0000 7fbaaa379640 1 --2- 172.21.15.170:0/4154786643 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fba8c079e80 0x7fba8c07c340 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.210+0000 7fbaaa379640 1 --2- 172.21.15.170:0/4154786643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa4107910 0x7fbaa419fd40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.210+0000 7fbaaa379640 1 --2- 172.21.15.170:0/4154786643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaa4101910 0x7fbaa419f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.210+0000 7fbaaa379640 1 -- 172.21.15.170:0/4154786643 >> 172.21.15.170:0/4154786643 conn(0x7fbaa40fd5f0 msgr2=0x7fbaa4074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:09.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.210+0000 7fbaaa379640 1 -- 172.21.15.170:0/4154786643 shutdown_connections 2024-09-04T16:47:09.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.210+0000 7fbaaa379640 1 -- 172.21.15.170:0/4154786643 wait complete. 2024-09-04T16:47:09.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.294+0000 7f744cf6f640 1 -- 172.21.15.170:0/3065409017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7448107930 msgr2=0x7f7448107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:09.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.294+0000 7f744cf6f640 1 --2- 172.21.15.170:0/3065409017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7448107930 0x7f7448107d10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7438009880 tx=0x7f743802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.294+0000 7f744cf6f640 1 -- 172.21.15.170:0/3065409017 shutdown_connections 2024-09-04T16:47:09.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.294+0000 7f744cf6f640 1 --2- 172.21.15.170:0/3065409017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7448101930 0x7f7448101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.294+0000 7f744cf6f640 1 --2- 172.21.15.170:0/3065409017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7448107930 0x7f7448107d10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.294+0000 7f744cf6f640 1 -- 172.21.15.170:0/3065409017 >> 172.21.15.170:0/3065409017 conn(0x7f74480fd630 msgr2=0x7f74480ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:09.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.294+0000 7f744cf6f640 1 -- 172.21.15.170:0/3065409017 shutdown_connections 2024-09-04T16:47:09.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.294+0000 7f744cf6f640 1 -- 172.21.15.170:0/3065409017 wait complete. 2024-09-04T16:47:09.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.295+0000 7f744cf6f640 1 Processor -- start 2024-09-04T16:47:09.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.295+0000 7f744cf6f640 1 -- start start 2024-09-04T16:47:09.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.295+0000 7f744cf6f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7448101930 0x7f744819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:09.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.295+0000 7f744cf6f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7448107930 0x7f744819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:09.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.295+0000 7f744cf6f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f744810ee00 con 0x7f7448107930 2024-09-04T16:47:09.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.295+0000 7f744cf6f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f744810ec80 con 0x7f7448101930 2024-09-04T16:47:09.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.295+0000 7f7445d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7448107930 0x7f744819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:09.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.295+0000 7f7445d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7448107930 0x7f744819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41390/0 (socket says 172.21.15.170:41390) 2024-09-04T16:47:09.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.295+0000 7f7445d9b640 1 -- 172.21.15.170:0/2232354212 learned_addr learned my addr 172.21.15.170:0/2232354212 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:47:09.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.295+0000 7f744659c640 1 --2- 172.21.15.170:0/2232354212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7448101930 0x7f744819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:09.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.296+0000 7f7445d9b640 1 -- 172.21.15.170:0/2232354212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7448101930 msgr2=0x7f744819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:09.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.296+0000 7f7445d9b640 1 --2- 172.21.15.170:0/2232354212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7448101930 0x7f744819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.296+0000 7f7445d9b640 1 -- 172.21.15.170:0/2232354212 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74481977f0 con 0x7f7448107930 2024-09-04T16:47:09.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.296+0000 7f7445d9b640 1 --2- 172.21.15.170:0/2232354212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7448107930 0x7f744819dbb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f743c00e970 tx=0x7f743c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:09.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.296+0000 7f74377fe640 1 -- 172.21.15.170:0/2232354212 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f743c00cac0 con 0x7f7448107930 2024-09-04T16:47:09.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.296+0000 7f74377fe640 1 -- 172.21.15.170:0/2232354212 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f743c0054e0 con 0x7f7448107930 2024-09-04T16:47:09.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.296+0000 7f744cf6f640 1 -- 172.21.15.170:0/2232354212 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7448197ae0 con 0x7f7448107930 2024-09-04T16:47:09.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.296+0000 7f74377fe640 1 -- 172.21.15.170:0/2232354212 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f743c010430 con 0x7f7448107930 2024-09-04T16:47:09.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.296+0000 7f744cf6f640 1 -- 172.21.15.170:0/2232354212 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7448198070 con 0x7f7448107930 2024-09-04T16:47:09.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.297+0000 7f744cf6f640 1 -- 172.21.15.170:0/2232354212 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7448103070 con 0x7f7448107930 2024-09-04T16:47:09.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.298+0000 7f74377fe640 1 -- 172.21.15.170:0/2232354212 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f743c004e80 con 0x7f7448107930 2024-09-04T16:47:09.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.298+0000 7f74377fe640 1 --2- 172.21.15.170:0/2232354212 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7430079e40 0x7f743007c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:09.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.298+0000 7f74377fe640 1 -- 172.21.15.170:0/2232354212 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f743c09d180 con 0x7f7448107930 2024-09-04T16:47:09.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.298+0000 7f744659c640 1 --2- 172.21.15.170:0/2232354212 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7430079e40 0x7f743007c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:09.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.299+0000 7f744659c640 1 --2- 172.21.15.170:0/2232354212 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7430079e40 0x7f743007c300 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7438031460 tx=0x7f74380095c0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:09.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.303+0000 7f74377fe640 1 -- 172.21.15.170:0/2232354212 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f743c064b90 con 0x7f7448107930 2024-09-04T16:47:09.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:09 smithi193 ceph-mon[82547]: from='client.34782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:47:09.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:09 smithi193 ceph-mon[82547]: from='client.34786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:47:09.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:09 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/112686287' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:47:09.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.494+0000 7f744cf6f640 1 -- 172.21.15.170:0/2232354212 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7448198380 con 0x7f7430079e40 2024-09-04T16:47:09.495 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:09 smithi170 ceph-mon[113855]: from='client.34782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:47:09.495 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:09 smithi170 ceph-mon[113855]: from='client.34786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:47:09.495 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:09 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/112686287' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:47:09.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.496+0000 7f74377fe640 1 -- 172.21.15.170:0/2232354212 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7448198380 con 0x7f7430079e40 2024-09-04T16:47:09.496 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:47:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:47:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:47:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:47:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:47:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:47:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:47:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:47:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:47:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:47:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:47:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:47:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:47:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:47:09.497 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:47:09.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.498+0000 7f744cf6f640 1 -- 172.21.15.170:0/2232354212 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7430079e40 msgr2=0x7f743007c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:09.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.498+0000 7f744cf6f640 1 --2- 172.21.15.170:0/2232354212 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7430079e40 0x7f743007c300 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7438031460 tx=0x7f74380095c0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.498+0000 7f744cf6f640 1 -- 172.21.15.170:0/2232354212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7448107930 msgr2=0x7f744819dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:09.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.498+0000 7f744cf6f640 1 --2- 172.21.15.170:0/2232354212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7448107930 0x7f744819dbb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f743c00e970 tx=0x7f743c00ed70 comp rx=0 tx=0).stop 2024-09-04T16:47:09.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.498+0000 7f744cf6f640 1 -- 172.21.15.170:0/2232354212 shutdown_connections 2024-09-04T16:47:09.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.498+0000 7f744cf6f640 1 --2- 172.21.15.170:0/2232354212 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7430079e40 0x7f743007c300 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.498+0000 7f744cf6f640 1 --2- 172.21.15.170:0/2232354212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7448107930 0x7f744819dbb0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.498+0000 7f744cf6f640 1 --2- 172.21.15.170:0/2232354212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7448101930 0x7f744819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.498+0000 7f744cf6f640 1 -- 172.21.15.170:0/2232354212 >> 172.21.15.170:0/2232354212 conn(0x7f74480fd630 msgr2=0x7f74480fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:09.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.499+0000 7f744cf6f640 1 -- 172.21.15.170:0/2232354212 shutdown_connections 2024-09-04T16:47:09.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.499+0000 7f744cf6f640 1 -- 172.21.15.170:0/2232354212 wait complete. 2024-09-04T16:47:09.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.581+0000 7f3200760640 1 -- 172.21.15.170:0/2521741785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31f81067e0 msgr2=0x7f31f8106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:09.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.581+0000 7f3200760640 1 --2- 172.21.15.170:0/2521741785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31f81067e0 0x7f31f8106bc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f31e8009880 tx=0x7f31e802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.581+0000 7f3200760640 1 -- 172.21.15.170:0/2521741785 shutdown_connections 2024-09-04T16:47:09.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.581+0000 7f3200760640 1 --2- 172.21.15.170:0/2521741785 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31f81007e0 0x7f31f8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.581+0000 7f3200760640 1 --2- 172.21.15.170:0/2521741785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31f81067e0 0x7f31f8106bc0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.581+0000 7f3200760640 1 -- 172.21.15.170:0/2521741785 >> 172.21.15.170:0/2521741785 conn(0x7f31f80fc4c0 msgr2=0x7f31f80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:09.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.581+0000 7f3200760640 1 -- 172.21.15.170:0/2521741785 shutdown_connections 2024-09-04T16:47:09.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.581+0000 7f3200760640 1 -- 172.21.15.170:0/2521741785 wait complete. 2024-09-04T16:47:09.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.581+0000 7f3200760640 1 Processor -- start 2024-09-04T16:47:09.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.581+0000 7f3200760640 1 -- start start 2024-09-04T16:47:09.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f3200760640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31f81007e0 0x7f31f8196670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:09.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f3200760640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31f81067e0 0x7f31f8196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:09.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f3200760640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f31f810dd10 con 0x7f31f81007e0 2024-09-04T16:47:09.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f3200760640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f31f810db90 con 0x7f31f81067e0 2024-09-04T16:47:09.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f31fe4fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31f81007e0 0x7f31f8196670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:09.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f31fe4fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31f81007e0 0x7f31f8196670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41406/0 (socket says 172.21.15.170:41406) 2024-09-04T16:47:09.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f31fe4fc640 1 -- 172.21.15.170:0/2988330855 learned_addr learned my addr 172.21.15.170:0/2988330855 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:47:09.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f31fdcfb640 1 --2- 172.21.15.170:0/2988330855 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31f81067e0 0x7f31f8196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:09.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f31fe4fc640 1 -- 172.21.15.170:0/2988330855 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31f81067e0 msgr2=0x7f31f8196bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:09.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f31fe4fc640 1 --2- 172.21.15.170:0/2988330855 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31f81067e0 0x7f31f8196bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f31fe4fc640 1 -- 172.21.15.170:0/2988330855 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f81970f0 con 0x7f31f81007e0 2024-09-04T16:47:09.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f31fe4fc640 1 --2- 172.21.15.170:0/2988330855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31f81007e0 0x7f31f8196670 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f31e8031460 tx=0x7f31e80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:09.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f31ef7fe640 1 -- 172.21.15.170:0/2988330855 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f31e803f070 con 0x7f31f81007e0 2024-09-04T16:47:09.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f31ef7fe640 1 -- 172.21.15.170:0/2988330855 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31e8004cf0 con 0x7f31f81007e0 2024-09-04T16:47:09.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f3200760640 1 -- 172.21.15.170:0/2988330855 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f8197380 con 0x7f31f81007e0 2024-09-04T16:47:09.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f31ef7fe640 1 -- 172.21.15.170:0/2988330855 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f31e8035030 con 0x7f31f81007e0 2024-09-04T16:47:09.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.582+0000 7f3200760640 1 -- 172.21.15.170:0/2988330855 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f81a3eb0 con 0x7f31f81007e0 2024-09-04T16:47:09.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.583+0000 7f3200760640 1 -- 172.21.15.170:0/2988330855 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f8101f20 con 0x7f31f81007e0 2024-09-04T16:47:09.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.584+0000 7f31ef7fe640 1 -- 172.21.15.170:0/2988330855 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f31e8042070 con 0x7f31f81007e0 2024-09-04T16:47:09.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.585+0000 7f31ef7fe640 1 --2- 172.21.15.170:0/2988330855 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f31e4079e30 0x7f31e407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:09.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.585+0000 7f31fdcfb640 1 --2- 172.21.15.170:0/2988330855 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f31e4079e30 0x7f31e407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:09.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.585+0000 7f31ef7fe640 1 -- 172.21.15.170:0/2988330855 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f31e80bd520 con 0x7f31f81007e0 2024-09-04T16:47:09.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.585+0000 7f31fdcfb640 1 --2- 172.21.15.170:0/2988330855 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f31e4079e30 0x7f31e407c2f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f31f81987d0 tx=0x7f31f4009110 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:09.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.589+0000 7f31ef7fe640 1 -- 172.21.15.170:0/2988330855 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f31e8084f30 con 0x7f31f81007e0 2024-09-04T16:47:09.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.831+0000 7f3200760640 1 -- 172.21.15.170:0/2988330855 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f31f8108d50 con 0x7f31f81007e0 2024-09-04T16:47:09.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.831+0000 7f31ef7fe640 1 -- 172.21.15.170:0/2988330855 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f31e808d3e0 con 0x7f31f81007e0 2024-09-04T16:47:09.832 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:47:09.832 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:47:09.832 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:47:09.832 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:47:09.832 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:47:09.832 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:47:09.832 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:47:09.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.833+0000 7f3200760640 1 -- 172.21.15.170:0/2988330855 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f31e4079e30 msgr2=0x7f31e407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:09.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.833+0000 7f3200760640 1 --2- 172.21.15.170:0/2988330855 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f31e4079e30 0x7f31e407c2f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f31f81987d0 tx=0x7f31f4009110 comp rx=0 tx=0).stop 2024-09-04T16:47:09.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.833+0000 7f3200760640 1 -- 172.21.15.170:0/2988330855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31f81007e0 msgr2=0x7f31f8196670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:09.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.833+0000 7f3200760640 1 --2- 172.21.15.170:0/2988330855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31f81007e0 0x7f31f8196670 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f31e8031460 tx=0x7f31e80048f0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.834+0000 7f3200760640 1 -- 172.21.15.170:0/2988330855 shutdown_connections 2024-09-04T16:47:09.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.834+0000 7f3200760640 1 --2- 172.21.15.170:0/2988330855 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f31e4079e30 0x7f31e407c2f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.834+0000 7f3200760640 1 --2- 172.21.15.170:0/2988330855 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31f81067e0 0x7f31f8196bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.834+0000 7f3200760640 1 --2- 172.21.15.170:0/2988330855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31f81007e0 0x7f31f8196670 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:09.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.834+0000 7f3200760640 1 -- 172.21.15.170:0/2988330855 >> 172.21.15.170:0/2988330855 conn(0x7f31f80fc4c0 msgr2=0x7f31f80fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:09.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.834+0000 7f3200760640 1 -- 172.21.15.170:0/2988330855 shutdown_connections 2024-09-04T16:47:09.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:09.834+0000 7f3200760640 1 -- 172.21.15.170:0/2988330855 wait complete. 2024-09-04T16:47:10.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:10 smithi170 ceph-mon[113855]: pgmap v523: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:10 smithi170 ceph-mon[113855]: from='client.34790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:47:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:10 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/4154786643' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:47:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:10 smithi170 ceph-mon[113855]: from='client.34802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:47:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:10 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2988330855' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:47:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:10 smithi193 ceph-mon[82547]: pgmap v523: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:10 smithi193 ceph-mon[82547]: from='client.34790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:47:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:10 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/4154786643' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:47:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:10 smithi193 ceph-mon[82547]: from='client.34802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:47:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:10 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2988330855' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:47:12.509 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:12 smithi193 ceph-mon[82547]: pgmap v524: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:12.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:12 smithi170 ceph-mon[113855]: pgmap v524: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:14.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:14 smithi170 ceph-mon[113855]: pgmap v525: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:14 smithi193 ceph-mon[82547]: pgmap v525: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:15.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:15 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:47:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:15 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:47:16.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:16 smithi170 ceph-mon[113855]: pgmap v526: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:16 smithi193 ceph-mon[82547]: pgmap v526: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:18.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:18 smithi170 ceph-mon[113855]: pgmap v527: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:18 smithi193 ceph-mon[82547]: pgmap v527: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:20.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:20 smithi170 ceph-mon[113855]: pgmap v528: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:20.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:20 smithi193 ceph-mon[82547]: pgmap v528: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:22.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:22 smithi170 ceph-mon[113855]: pgmap v529: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:22 smithi193 ceph-mon[82547]: pgmap v529: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:24.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:24 smithi170 ceph-mon[113855]: pgmap v530: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:24.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:24 smithi193 ceph-mon[82547]: pgmap v530: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:26.551 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:26 smithi170 ceph-mon[113855]: pgmap v531: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:26 smithi193 ceph-mon[82547]: pgmap v531: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:28.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:28 smithi170 ceph-mon[113855]: pgmap v532: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:28 smithi193 ceph-mon[82547]: pgmap v532: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:47:29.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:47:30.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:30 smithi170 ceph-mon[113855]: pgmap v533: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:30 smithi193 ceph-mon[82547]: pgmap v533: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:32.457 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:32 smithi193 ceph-mon[82547]: pgmap v534: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:32.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:32 smithi170 ceph-mon[113855]: pgmap v534: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:34.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:34 smithi170 ceph-mon[113855]: pgmap v535: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:34 smithi193 ceph-mon[82547]: pgmap v535: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:36.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:36 smithi170 ceph-mon[113855]: pgmap v536: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:36.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:36 smithi193 ceph-mon[82547]: pgmap v536: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:38.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:38 smithi170 ceph-mon[113855]: pgmap v537: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:38.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:38 smithi193 ceph-mon[82547]: pgmap v537: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:39.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.930+0000 7f2fe690e640 1 -- 172.21.15.170:0/3858663102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fe0101930 msgr2=0x7f2fe0101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:39.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.930+0000 7f2fe690e640 1 --2- 172.21.15.170:0/3858663102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fe0101930 0x7f2fe0101d90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8009880 tx=0x7f2fc802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:47:39.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.930+0000 7f2fe690e640 1 -- 172.21.15.170:0/3858663102 shutdown_connections 2024-09-04T16:47:39.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.930+0000 7f2fe690e640 1 --2- 172.21.15.170:0/3858663102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fe0101930 0x7f2fe0101d90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:39.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.930+0000 7f2fe690e640 1 --2- 172.21.15.170:0/3858663102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fe0107930 0x7f2fe0107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:39.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.930+0000 7f2fe690e640 1 -- 172.21.15.170:0/3858663102 >> 172.21.15.170:0/3858663102 conn(0x7f2fe00fd630 msgr2=0x7f2fe00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:39.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.930+0000 7f2fe690e640 1 -- 172.21.15.170:0/3858663102 shutdown_connections 2024-09-04T16:47:39.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.930+0000 7f2fe690e640 1 -- 172.21.15.170:0/3858663102 wait complete. 2024-09-04T16:47:39.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.930+0000 7f2fe690e640 1 Processor -- start 2024-09-04T16:47:39.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.931+0000 7f2fe690e640 1 -- start start 2024-09-04T16:47:39.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.931+0000 7f2fe690e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fe0101930 0x7f2fe00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:39.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.931+0000 7f2fe690e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fe0107930 0x7f2fe0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:39.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.931+0000 7f2fe690e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe010ede0 con 0x7f2fe0101930 2024-09-04T16:47:39.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.931+0000 7f2fe690e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe010ec60 con 0x7f2fe0107930 2024-09-04T16:47:39.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.931+0000 7f2fdffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fe0101930 0x7f2fe00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:39.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.931+0000 7f2fdffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fe0101930 0x7f2fe00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43218/0 (socket says 172.21.15.170:43218) 2024-09-04T16:47:39.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.931+0000 7f2fdffff640 1 -- 172.21.15.170:0/203402201 learned_addr learned my addr 172.21.15.170:0/203402201 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:47:39.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.931+0000 7f2fd7fff640 1 --2- 172.21.15.170:0/203402201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fe0107930 0x7f2fe0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:39.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.931+0000 7f2fdffff640 1 -- 172.21.15.170:0/203402201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fe0107930 msgr2=0x7f2fe0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:39.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.931+0000 7f2fdffff640 1 --2- 172.21.15.170:0/203402201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fe0107930 0x7f2fe0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:39.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.931+0000 7f2fdffff640 1 -- 172.21.15.170:0/203402201 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe0074f70 con 0x7f2fe0101930 2024-09-04T16:47:39.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.931+0000 7f2fd7fff640 1 --2- 172.21.15.170:0/203402201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fe0107930 0x7f2fe0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:47:39.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.931+0000 7f2fdffff640 1 --2- 172.21.15.170:0/203402201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fe0101930 0x7f2fe00744f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000c8a0 tx=0x7f2fd000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:39.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.932+0000 7f2fddffb640 1 -- 172.21.15.170:0/203402201 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fd00079b0 con 0x7f2fe0101930 2024-09-04T16:47:39.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.932+0000 7f2fe690e640 1 -- 172.21.15.170:0/203402201 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe0075260 con 0x7f2fe0101930 2024-09-04T16:47:39.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.932+0000 7f2fddffb640 1 -- 172.21.15.170:0/203402201 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2fd0007b50 con 0x7f2fe0101930 2024-09-04T16:47:39.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.932+0000 7f2fddffb640 1 -- 172.21.15.170:0/203402201 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fd0018700 con 0x7f2fe0101930 2024-09-04T16:47:39.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.932+0000 7f2fe690e640 1 -- 172.21.15.170:0/203402201 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe01a3e70 con 0x7f2fe0101930 2024-09-04T16:47:39.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.933+0000 7f2fe690e640 1 -- 172.21.15.170:0/203402201 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe0103070 con 0x7f2fe0101930 2024-09-04T16:47:39.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.933+0000 7f2fddffb640 1 -- 172.21.15.170:0/203402201 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f2fd0007d00 con 0x7f2fe0101930 2024-09-04T16:47:39.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.934+0000 7f2fddffb640 1 --2- 172.21.15.170:0/203402201 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2fcc079e30 0x7f2fcc07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:39.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.934+0000 7f2fddffb640 1 -- 172.21.15.170:0/203402201 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2fd009cd80 con 0x7f2fe0101930 2024-09-04T16:47:39.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.934+0000 7f2fd7fff640 1 --2- 172.21.15.170:0/203402201 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2fcc079e30 0x7f2fcc07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:39.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.935+0000 7f2fd7fff640 1 --2- 172.21.15.170:0/203402201 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2fcc079e30 0x7f2fcc07c2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0075f80 tx=0x7f2fc8009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:39.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:39.938+0000 7f2fddffb640 1 -- 172.21.15.170:0/203402201 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2fd0014030 con 0x7f2fe0101930 2024-09-04T16:47:40.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.129+0000 7f2fe690e640 1 -- 172.21.15.170:0/203402201 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2fe0109f30 con 0x7f2fcc079e30 2024-09-04T16:47:40.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.130+0000 7f2fddffb640 1 -- 172.21.15.170:0/203402201 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2fc8004380 con 0x7f2fcc079e30 2024-09-04T16:47:40.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.132+0000 7f2fe690e640 1 -- 172.21.15.170:0/203402201 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2fcc079e30 msgr2=0x7f2fcc07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:40.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.132+0000 7f2fe690e640 1 --2- 172.21.15.170:0/203402201 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2fcc079e30 0x7f2fcc07c2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0075f80 tx=0x7f2fc8009560 comp rx=0 tx=0).stop 2024-09-04T16:47:40.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.132+0000 7f2fe690e640 1 -- 172.21.15.170:0/203402201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fe0101930 msgr2=0x7f2fe00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:40.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.132+0000 7f2fe690e640 1 --2- 172.21.15.170:0/203402201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fe0101930 0x7f2fe00744f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000c8a0 tx=0x7f2fd000cd60 comp rx=0 tx=0).stop 2024-09-04T16:47:40.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.132+0000 7f2fe690e640 1 -- 172.21.15.170:0/203402201 shutdown_connections 2024-09-04T16:47:40.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.132+0000 7f2fe690e640 1 --2- 172.21.15.170:0/203402201 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2fcc079e30 0x7f2fcc07c2f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.132+0000 7f2fe690e640 1 --2- 172.21.15.170:0/203402201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fe0107930 0x7f2fe0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.132+0000 7f2fe690e640 1 --2- 172.21.15.170:0/203402201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fe0101930 0x7f2fe00744f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.132+0000 7f2fe690e640 1 -- 172.21.15.170:0/203402201 >> 172.21.15.170:0/203402201 conn(0x7f2fe00fd630 msgr2=0x7f2fe00fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:40.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.132+0000 7f2fe690e640 1 -- 172.21.15.170:0/203402201 shutdown_connections 2024-09-04T16:47:40.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.132+0000 7f2fe690e640 1 -- 172.21.15.170:0/203402201 wait complete. 2024-09-04T16:47:40.142 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:47:40.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.218+0000 7f5bb5468640 1 -- 172.21.15.170:0/3985887176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bb01067e0 msgr2=0x7f5bb0106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:40.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.218+0000 7f5bb5468640 1 --2- 172.21.15.170:0/3985887176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bb01067e0 0x7f5bb0106bc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009880 tx=0x7f5ba002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.218+0000 7f5bb5468640 1 -- 172.21.15.170:0/3985887176 shutdown_connections 2024-09-04T16:47:40.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.218+0000 7f5bb5468640 1 --2- 172.21.15.170:0/3985887176 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bb01007e0 0x7f5bb0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.218+0000 7f5bb5468640 1 --2- 172.21.15.170:0/3985887176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bb01067e0 0x7f5bb0106bc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.218+0000 7f5bb5468640 1 -- 172.21.15.170:0/3985887176 >> 172.21.15.170:0/3985887176 conn(0x7f5bb00fc4c0 msgr2=0x7f5bb00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:40.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.218+0000 7f5bb5468640 1 -- 172.21.15.170:0/3985887176 shutdown_connections 2024-09-04T16:47:40.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.218+0000 7f5bb5468640 1 -- 172.21.15.170:0/3985887176 wait complete. 2024-09-04T16:47:40.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.218+0000 7f5bb5468640 1 Processor -- start 2024-09-04T16:47:40.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.219+0000 7f5bb5468640 1 -- start start 2024-09-04T16:47:40.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.219+0000 7f5bb5468640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bb01007e0 0x7f5bb00fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:40.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.219+0000 7f5bb5468640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bb01067e0 0x7f5bb00fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:40.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.219+0000 7f5bb5468640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb010dcb0 con 0x7f5bb01007e0 2024-09-04T16:47:40.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.219+0000 7f5bb5468640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb010db30 con 0x7f5bb01067e0 2024-09-04T16:47:40.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.219+0000 7f5baeffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bb01007e0 0x7f5bb00fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:40.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.219+0000 7f5baeffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bb01007e0 0x7f5bb00fcc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43248/0 (socket says 172.21.15.170:43248) 2024-09-04T16:47:40.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.219+0000 7f5baeffd640 1 -- 172.21.15.170:0/3361442965 learned_addr learned my addr 172.21.15.170:0/3361442965 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:47:40.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.219+0000 7f5baeffd640 1 -- 172.21.15.170:0/3361442965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bb01067e0 msgr2=0x7f5bb00fd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:40.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.219+0000 7f5bae7fc640 1 --2- 172.21.15.170:0/3361442965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bb01067e0 0x7f5bb00fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:40.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.219+0000 7f5baeffd640 1 --2- 172.21.15.170:0/3361442965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bb01067e0 0x7f5bb00fd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.219+0000 7f5baeffd640 1 -- 172.21.15.170:0/3361442965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb00fd690 con 0x7f5bb01007e0 2024-09-04T16:47:40.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.219+0000 7f5baeffd640 1 --2- 172.21.15.170:0/3361442965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bb01007e0 0x7f5bb00fcc10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0031460 tx=0x7f5ba00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:40.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.220+0000 7f5ba7fff640 1 -- 172.21.15.170:0/3361442965 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ba003f070 con 0x7f5bb01007e0 2024-09-04T16:47:40.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.220+0000 7f5ba7fff640 1 -- 172.21.15.170:0/3361442965 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5ba00035f0 con 0x7f5bb01007e0 2024-09-04T16:47:40.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.220+0000 7f5bb5468640 1 -- 172.21.15.170:0/3361442965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb00fd920 con 0x7f5bb01007e0 2024-09-04T16:47:40.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.220+0000 7f5ba7fff640 1 -- 172.21.15.170:0/3361442965 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ba0035030 con 0x7f5bb01007e0 2024-09-04T16:47:40.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.220+0000 7f5bb5468640 1 -- 172.21.15.170:0/3361442965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb01a3d50 con 0x7f5bb01007e0 2024-09-04T16:47:40.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.221+0000 7f5bb5468640 1 -- 172.21.15.170:0/3361442965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb0101f20 con 0x7f5bb01007e0 2024-09-04T16:47:40.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.221+0000 7f5ba7fff640 1 -- 172.21.15.170:0/3361442965 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5ba0042070 con 0x7f5bb01007e0 2024-09-04T16:47:40.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.222+0000 7f5ba7fff640 1 --2- 172.21.15.170:0/3361442965 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5b9c079e80 0x7f5b9c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:40.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.222+0000 7f5ba7fff640 1 -- 172.21.15.170:0/3361442965 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5ba00bd440 con 0x7f5bb01007e0 2024-09-04T16:47:40.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.222+0000 7f5bae7fc640 1 --2- 172.21.15.170:0/3361442965 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5b9c079e80 0x7f5b9c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:40.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.222+0000 7f5bae7fc640 1 --2- 172.21.15.170:0/3361442965 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5b9c079e80 0x7f5b9c07c340 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5b98005fd0 tx=0x7f5b98005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:40.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.226+0000 7f5ba7fff640 1 -- 172.21.15.170:0/3361442965 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5ba0084e30 con 0x7f5bb01007e0 2024-09-04T16:47:40.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.416+0000 7f5bb5468640 1 -- 172.21.15.170:0/3361442965 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5bb0062630 con 0x7f5b9c079e80 2024-09-04T16:47:40.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.417+0000 7f5ba7fff640 1 -- 172.21.15.170:0/3361442965 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5bb0062630 con 0x7f5b9c079e80 2024-09-04T16:47:40.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.419+0000 7f5bb5468640 1 -- 172.21.15.170:0/3361442965 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5b9c079e80 msgr2=0x7f5b9c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:40.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.419+0000 7f5bb5468640 1 --2- 172.21.15.170:0/3361442965 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5b9c079e80 0x7f5b9c07c340 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5b98005fd0 tx=0x7f5b98005850 comp rx=0 tx=0).stop 2024-09-04T16:47:40.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.419+0000 7f5bb5468640 1 -- 172.21.15.170:0/3361442965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bb01007e0 msgr2=0x7f5bb00fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:40.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.419+0000 7f5bb5468640 1 --2- 172.21.15.170:0/3361442965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bb01007e0 0x7f5bb00fcc10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0031460 tx=0x7f5ba00045e0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.419+0000 7f5bb5468640 1 -- 172.21.15.170:0/3361442965 shutdown_connections 2024-09-04T16:47:40.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.419+0000 7f5bb5468640 1 --2- 172.21.15.170:0/3361442965 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5b9c079e80 0x7f5b9c07c340 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.419+0000 7f5bb5468640 1 --2- 172.21.15.170:0/3361442965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bb01067e0 0x7f5bb00fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.419+0000 7f5bb5468640 1 --2- 172.21.15.170:0/3361442965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bb01007e0 0x7f5bb00fcc10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.419+0000 7f5bb5468640 1 -- 172.21.15.170:0/3361442965 >> 172.21.15.170:0/3361442965 conn(0x7f5bb00fc4c0 msgr2=0x7f5bb0069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:40.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.419+0000 7f5bb5468640 1 -- 172.21.15.170:0/3361442965 shutdown_connections 2024-09-04T16:47:40.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.420+0000 7f5bb5468640 1 -- 172.21.15.170:0/3361442965 wait complete. 2024-09-04T16:47:40.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.501+0000 7f72bd470640 1 -- 172.21.15.170:0/3761786577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72b8100820 msgr2=0x7f72b8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:40.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.501+0000 7f72bd470640 1 --2- 172.21.15.170:0/3761786577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72b8100820 0x7f72b8100c80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009880 tx=0x7f72a802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.501+0000 7f72bd470640 1 -- 172.21.15.170:0/3761786577 shutdown_connections 2024-09-04T16:47:40.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.501+0000 7f72bd470640 1 --2- 172.21.15.170:0/3761786577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72b8100820 0x7f72b8100c80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.501+0000 7f72bd470640 1 --2- 172.21.15.170:0/3761786577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f72b8106820 0x7f72b8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.501+0000 7f72bd470640 1 -- 172.21.15.170:0/3761786577 >> 172.21.15.170:0/3761786577 conn(0x7f72b80fc520 msgr2=0x7f72b80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:40.505 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:40 smithi170 ceph-mon[113855]: pgmap v538: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:40.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.501+0000 7f72bd470640 1 -- 172.21.15.170:0/3761786577 shutdown_connections 2024-09-04T16:47:40.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.501+0000 7f72bd470640 1 -- 172.21.15.170:0/3761786577 wait complete. 2024-09-04T16:47:40.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.501+0000 7f72bd470640 1 Processor -- start 2024-09-04T16:47:40.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.502+0000 7f72bd470640 1 -- start start 2024-09-04T16:47:40.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.502+0000 7f72bd470640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72b8100820 0x7f72b8198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:40.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.502+0000 7f72bd470640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f72b8106820 0x7f72b8198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:40.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.502+0000 7f72bd470640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f72b810dcf0 con 0x7f72b8100820 2024-09-04T16:47:40.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.502+0000 7f72bd470640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f72b810db70 con 0x7f72b8106820 2024-09-04T16:47:40.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.502+0000 7f72b6ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72b8100820 0x7f72b8198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:40.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.502+0000 7f72b6ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72b8100820 0x7f72b8198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43268/0 (socket says 172.21.15.170:43268) 2024-09-04T16:47:40.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.502+0000 7f72b6ffd640 1 -- 172.21.15.170:0/593178380 learned_addr learned my addr 172.21.15.170:0/593178380 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:47:40.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.502+0000 7f72b67fc640 1 --2- 172.21.15.170:0/593178380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f72b8106820 0x7f72b8198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:40.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.503+0000 7f72b6ffd640 1 -- 172.21.15.170:0/593178380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f72b8106820 msgr2=0x7f72b8198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:40.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.503+0000 7f72b6ffd640 1 --2- 172.21.15.170:0/593178380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f72b8106820 0x7f72b8198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.503+0000 7f72b6ffd640 1 -- 172.21.15.170:0/593178380 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b8199340 con 0x7f72b8100820 2024-09-04T16:47:40.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.503+0000 7f72b67fc640 1 --2- 172.21.15.170:0/593178380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f72b8106820 0x7f72b8198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:47:40.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.503+0000 7f72b6ffd640 1 --2- 172.21.15.170:0/593178380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72b8100820 0x7f72b8198800 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00c8f0 tx=0x7f72ac00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:40.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.503+0000 7f729ffff640 1 -- 172.21.15.170:0/593178380 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f72ac0079b0 con 0x7f72b8100820 2024-09-04T16:47:40.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.503+0000 7f729ffff640 1 -- 172.21.15.170:0/593178380 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72ac0054e0 con 0x7f72b8100820 2024-09-04T16:47:40.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.503+0000 7f72bd470640 1 -- 172.21.15.170:0/593178380 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b8199630 con 0x7f72b8100820 2024-09-04T16:47:40.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.503+0000 7f729ffff640 1 -- 172.21.15.170:0/593178380 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f72ac004dd0 con 0x7f72b8100820 2024-09-04T16:47:40.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.503+0000 7f72bd470640 1 -- 172.21.15.170:0/593178380 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b81a1c30 con 0x7f72b8100820 2024-09-04T16:47:40.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.504+0000 7f72bd470640 1 -- 172.21.15.170:0/593178380 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b8101f60 con 0x7f72b8100820 2024-09-04T16:47:40.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.505+0000 7f729ffff640 1 -- 172.21.15.170:0/593178380 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f72ac005020 con 0x7f72b8100820 2024-09-04T16:47:40.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.505+0000 7f729ffff640 1 --2- 172.21.15.170:0/593178380 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f72a0079dd0 0x7f72a007c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:40.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.505+0000 7f729ffff640 1 -- 172.21.15.170:0/593178380 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f72ac09caa0 con 0x7f72b8100820 2024-09-04T16:47:40.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.505+0000 7f72b67fc640 1 --2- 172.21.15.170:0/593178380 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f72a0079dd0 0x7f72a007c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:40.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.506+0000 7f72b67fc640 1 --2- 172.21.15.170:0/593178380 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f72a0079dd0 0x7f72a007c290 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f72b806ae50 tx=0x7f72a8009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:40.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.511+0000 7f729ffff640 1 -- 172.21.15.170:0/593178380 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f72b8199630 con 0x7f72b8100820 2024-09-04T16:47:40.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:40 smithi193 ceph-mon[82547]: pgmap v538: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:40.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.696+0000 7f72bd470640 1 -- 172.21.15.170:0/593178380 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f72b8062630 con 0x7f72a0079dd0 2024-09-04T16:47:40.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.706+0000 7f729ffff640 1 -- 172.21.15.170:0/593178380 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f72b8062630 con 0x7f72a0079dd0 2024-09-04T16:47:40.709 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:47:40.709 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (14m) 8m ago 25m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:47:40.709 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (17m) 8m ago 25m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:47:40.709 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (17m) 8m ago 24m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:47:40.709 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (12m) 8m ago 25m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:47:40.709 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (12m) 8m ago 24m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:47:40.709 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (14m) 8m ago 25m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:47:40.709 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (8m) 8m ago 20m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:47:40.709 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (9m) 8m ago 20m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:47:40.709 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (8m) 8m ago 20m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:47:40.709 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (8m) 8m ago 20m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:47:40.709 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (16m) 8m ago 26m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:47:40.709 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (15m) 8m ago 24m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:47:40.710 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (13m) 8m ago 26m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:47:40.710 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (13m) 8m ago 24m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:47:40.710 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (15m) 8m ago 25m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:47:40.710 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (15m) 8m ago 24m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:47:40.710 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (12m) 8m ago 23m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:47:40.710 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (11m) 8m ago 22m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:47:40.710 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (11m) 8m ago 22m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:47:40.710 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (10m) 8m ago 22m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:47:40.710 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (10m) 8m ago 21m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:47:40.710 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (9m) 8m ago 21m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:47:40.710 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (15m) 8m ago 25m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:47:40.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.708+0000 7f72bd470640 1 -- 172.21.15.170:0/593178380 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f72a0079dd0 msgr2=0x7f72a007c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:40.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.708+0000 7f72bd470640 1 --2- 172.21.15.170:0/593178380 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f72a0079dd0 0x7f72a007c290 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f72b806ae50 tx=0x7f72a8009560 comp rx=0 tx=0).stop 2024-09-04T16:47:40.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.708+0000 7f72bd470640 1 -- 172.21.15.170:0/593178380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72b8100820 msgr2=0x7f72b8198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:40.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.708+0000 7f72bd470640 1 --2- 172.21.15.170:0/593178380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72b8100820 0x7f72b8198800 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00c8f0 tx=0x7f72ac00cdb0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.708+0000 7f72bd470640 1 -- 172.21.15.170:0/593178380 shutdown_connections 2024-09-04T16:47:40.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.708+0000 7f72bd470640 1 --2- 172.21.15.170:0/593178380 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f72a0079dd0 0x7f72a007c290 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.708+0000 7f72bd470640 1 --2- 172.21.15.170:0/593178380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f72b8106820 0x7f72b8198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.708+0000 7f72bd470640 1 --2- 172.21.15.170:0/593178380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72b8100820 0x7f72b8198800 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.708+0000 7f72bd470640 1 -- 172.21.15.170:0/593178380 >> 172.21.15.170:0/593178380 conn(0x7f72b80fc520 msgr2=0x7f72b80fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:40.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.708+0000 7f72bd470640 1 -- 172.21.15.170:0/593178380 shutdown_connections 2024-09-04T16:47:40.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.708+0000 7f72bd470640 1 -- 172.21.15.170:0/593178380 wait complete. 2024-09-04T16:47:40.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.789+0000 7faed434b640 1 -- 172.21.15.170:0/887915305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faecc106820 msgr2=0x7faecc106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:40.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.789+0000 7faed434b640 1 --2- 172.21.15.170:0/887915305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faecc106820 0x7faecc106c00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7faec8009880 tx=0x7faec802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.789+0000 7faed434b640 1 -- 172.21.15.170:0/887915305 shutdown_connections 2024-09-04T16:47:40.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.789+0000 7faed434b640 1 --2- 172.21.15.170:0/887915305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faecc100820 0x7faecc100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.789+0000 7faed434b640 1 --2- 172.21.15.170:0/887915305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faecc106820 0x7faecc106c00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.789+0000 7faed434b640 1 -- 172.21.15.170:0/887915305 >> 172.21.15.170:0/887915305 conn(0x7faecc0fc520 msgr2=0x7faecc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:40.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.789+0000 7faed434b640 1 -- 172.21.15.170:0/887915305 shutdown_connections 2024-09-04T16:47:40.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.789+0000 7faed434b640 1 -- 172.21.15.170:0/887915305 wait complete. 2024-09-04T16:47:40.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.790+0000 7faed434b640 1 Processor -- start 2024-09-04T16:47:40.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.790+0000 7faed434b640 1 -- start start 2024-09-04T16:47:40.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.790+0000 7faed434b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faecc100820 0x7faecc19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:40.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.790+0000 7faed434b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faecc106820 0x7faecc19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:40.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.790+0000 7faed434b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faecc10ee10 con 0x7faecc100820 2024-09-04T16:47:40.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.790+0000 7faed434b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faecc10ec90 con 0x7faecc106820 2024-09-04T16:47:40.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.791+0000 7faed20e7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faecc100820 0x7faecc19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:40.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.791+0000 7faed20e7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faecc100820 0x7faecc19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43298/0 (socket says 172.21.15.170:43298) 2024-09-04T16:47:40.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.791+0000 7faed20e7640 1 -- 172.21.15.170:0/4089303260 learned_addr learned my addr 172.21.15.170:0/4089303260 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:47:40.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.791+0000 7faed18e6640 1 --2- 172.21.15.170:0/4089303260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faecc106820 0x7faecc19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:40.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.791+0000 7faed20e7640 1 -- 172.21.15.170:0/4089303260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faecc106820 msgr2=0x7faecc19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:40.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.791+0000 7faed20e7640 1 --2- 172.21.15.170:0/4089303260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faecc106820 0x7faecc19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:40.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.791+0000 7faed20e7640 1 -- 172.21.15.170:0/4089303260 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc197820 con 0x7faecc100820 2024-09-04T16:47:40.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.791+0000 7faed20e7640 1 --2- 172.21.15.170:0/4089303260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faecc100820 0x7faecc19d6a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7faec8031460 tx=0x7faec80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:40.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.791+0000 7faec37fe640 1 -- 172.21.15.170:0/4089303260 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faec803f070 con 0x7faecc100820 2024-09-04T16:47:40.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.791+0000 7faed434b640 1 -- 172.21.15.170:0/4089303260 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faecc197ab0 con 0x7faecc100820 2024-09-04T16:47:40.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.791+0000 7faec37fe640 1 -- 172.21.15.170:0/4089303260 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faec80035f0 con 0x7faecc100820 2024-09-04T16:47:40.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.791+0000 7faec37fe640 1 -- 172.21.15.170:0/4089303260 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faec8035030 con 0x7faecc100820 2024-09-04T16:47:40.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.792+0000 7faed434b640 1 -- 172.21.15.170:0/4089303260 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faecc197fe0 con 0x7faecc100820 2024-09-04T16:47:40.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.793+0000 7faed434b640 1 -- 172.21.15.170:0/4089303260 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faecc101f60 con 0x7faecc100820 2024-09-04T16:47:40.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.793+0000 7faec37fe640 1 -- 172.21.15.170:0/4089303260 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7faec8042070 con 0x7faecc100820 2024-09-04T16:47:40.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.794+0000 7faec37fe640 1 --2- 172.21.15.170:0/4089303260 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faeb8079e30 0x7faeb807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:40.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.794+0000 7faed18e6640 1 --2- 172.21.15.170:0/4089303260 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faeb8079e30 0x7faeb807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:40.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.794+0000 7faec37fe640 1 -- 172.21.15.170:0/4089303260 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7faec80bd3b0 con 0x7faecc100820 2024-09-04T16:47:40.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.795+0000 7faed18e6640 1 --2- 172.21.15.170:0/4089303260 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faeb8079e30 0x7faeb807c2f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faecc0feb80 tx=0x7faebc00b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:40.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:40.798+0000 7faec37fe640 1 -- 172.21.15.170:0/4089303260 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faec8088f30 con 0x7faecc100820 2024-09-04T16:47:41.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.040+0000 7faed434b640 1 -- 172.21.15.170:0/4089303260 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7faecc108d90 con 0x7faecc100820 2024-09-04T16:47:41.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.040+0000 7faec37fe640 1 -- 172.21.15.170:0/4089303260 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7faec808d270 con 0x7faecc100820 2024-09-04T16:47:41.041 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:47:41.041 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:47:41.041 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:47:41.041 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:47:41.041 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:47:41.041 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:47:41.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:47:41.042 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:47:41.042 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:47:41.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:47:41.042 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:47:41.042 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:47:41.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:47:41.042 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:47:41.042 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:47:41.042 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:47:41.042 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:47:41.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.042+0000 7faed434b640 1 -- 172.21.15.170:0/4089303260 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faeb8079e30 msgr2=0x7faeb807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:41.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.042+0000 7faed434b640 1 --2- 172.21.15.170:0/4089303260 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faeb8079e30 0x7faeb807c2f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faecc0feb80 tx=0x7faebc00b390 comp rx=0 tx=0).stop 2024-09-04T16:47:41.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.042+0000 7faed434b640 1 -- 172.21.15.170:0/4089303260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faecc100820 msgr2=0x7faecc19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:41.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.042+0000 7faed434b640 1 --2- 172.21.15.170:0/4089303260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faecc100820 0x7faecc19d6a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7faec8031460 tx=0x7faec80045e0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.042+0000 7faed434b640 1 -- 172.21.15.170:0/4089303260 shutdown_connections 2024-09-04T16:47:41.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.042+0000 7faed434b640 1 --2- 172.21.15.170:0/4089303260 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faeb8079e30 0x7faeb807c2f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.042+0000 7faed434b640 1 --2- 172.21.15.170:0/4089303260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faecc106820 0x7faecc19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.042+0000 7faed434b640 1 --2- 172.21.15.170:0/4089303260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faecc100820 0x7faecc19d6a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.042+0000 7faed434b640 1 -- 172.21.15.170:0/4089303260 >> 172.21.15.170:0/4089303260 conn(0x7faecc0fc520 msgr2=0x7faecc0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:41.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.043+0000 7faed434b640 1 -- 172.21.15.170:0/4089303260 shutdown_connections 2024-09-04T16:47:41.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.043+0000 7faed434b640 1 -- 172.21.15.170:0/4089303260 wait complete. 2024-09-04T16:47:41.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.125+0000 7faafe069640 1 -- 172.21.15.170:0/3327248938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaf81067e0 msgr2=0x7faaf8106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:41.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.125+0000 7faafe069640 1 --2- 172.21.15.170:0/3327248938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaf81067e0 0x7faaf8106bc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7faae8009880 tx=0x7faae802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.125+0000 7faafe069640 1 -- 172.21.15.170:0/3327248938 shutdown_connections 2024-09-04T16:47:41.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.125+0000 7faafe069640 1 --2- 172.21.15.170:0/3327248938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faaf81007e0 0x7faaf8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.125+0000 7faafe069640 1 --2- 172.21.15.170:0/3327248938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaf81067e0 0x7faaf8106bc0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.125+0000 7faafe069640 1 -- 172.21.15.170:0/3327248938 >> 172.21.15.170:0/3327248938 conn(0x7faaf80fc4c0 msgr2=0x7faaf80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:41.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.125+0000 7faafe069640 1 -- 172.21.15.170:0/3327248938 shutdown_connections 2024-09-04T16:47:41.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.125+0000 7faafe069640 1 -- 172.21.15.170:0/3327248938 wait complete. 2024-09-04T16:47:41.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.125+0000 7faafe069640 1 Processor -- start 2024-09-04T16:47:41.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.125+0000 7faafe069640 1 -- start start 2024-09-04T16:47:41.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.125+0000 7faafe069640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaf81007e0 0x7faaf80fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:41.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faafe069640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faaf81067e0 0x7faaf80fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:41.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faafe069640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faaf810dd10 con 0x7faaf81007e0 2024-09-04T16:47:41.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faafe069640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faaf810db90 con 0x7faaf81067e0 2024-09-04T16:47:41.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faaf77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaf81007e0 0x7faaf80fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:41.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faaf77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaf81007e0 0x7faaf80fcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43314/0 (socket says 172.21.15.170:43314) 2024-09-04T16:47:41.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faaf77fe640 1 -- 172.21.15.170:0/1866583446 learned_addr learned my addr 172.21.15.170:0/1866583446 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:47:41.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faaeffff640 1 --2- 172.21.15.170:0/1866583446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faaf81067e0 0x7faaf80fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faaf77fe640 1 -- 172.21.15.170:0/1866583446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faaf81067e0 msgr2=0x7faaf80fd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faaf77fe640 1 --2- 172.21.15.170:0/1866583446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faaf81067e0 0x7faaf80fd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faaf77fe640 1 -- 172.21.15.170:0/1866583446 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf80fd710 con 0x7faaf81007e0 2024-09-04T16:47:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faaeffff640 1 --2- 172.21.15.170:0/1866583446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faaf81067e0 0x7faaf80fd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:47:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faaf77fe640 1 --2- 172.21.15.170:0/1866583446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaf81007e0 0x7faaf80fcc90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faae8031460 tx=0x7faae80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faaf57fa640 1 -- 172.21.15.170:0/1866583446 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faae803f070 con 0x7faaf81007e0 2024-09-04T16:47:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faafe069640 1 -- 172.21.15.170:0/1866583446 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf80fd9a0 con 0x7faaf81007e0 2024-09-04T16:47:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faaf57fa640 1 -- 172.21.15.170:0/1866583446 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faae8004cf0 con 0x7faaf81007e0 2024-09-04T16:47:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faaf57fa640 1 -- 172.21.15.170:0/1866583446 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faae8035030 con 0x7faaf81007e0 2024-09-04T16:47:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.126+0000 7faafe069640 1 -- 172.21.15.170:0/1866583446 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf81a3df0 con 0x7faaf81007e0 2024-09-04T16:47:41.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.127+0000 7faafe069640 1 -- 172.21.15.170:0/1866583446 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf8101f20 con 0x7faaf81007e0 2024-09-04T16:47:41.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.128+0000 7faaf57fa640 1 -- 172.21.15.170:0/1866583446 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7faae8042070 con 0x7faaf81007e0 2024-09-04T16:47:41.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.129+0000 7faaf57fa640 1 --2- 172.21.15.170:0/1866583446 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faae4079e30 0x7faae407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:41.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.129+0000 7faaf57fa640 1 -- 172.21.15.170:0/1866583446 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7faae80bd5d0 con 0x7faaf81007e0 2024-09-04T16:47:41.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.129+0000 7faaeffff640 1 --2- 172.21.15.170:0/1866583446 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faae4079e30 0x7faae407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:41.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.129+0000 7faaeffff640 1 --2- 172.21.15.170:0/1866583446 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faae4079e30 0x7faae407c2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faaf80fe720 tx=0x7faae0008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:41.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.133+0000 7faaf57fa640 1 -- 172.21.15.170:0/1866583446 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faae8084fe0 con 0x7faaf81007e0 2024-09-04T16:47:41.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.347+0000 7faafe069640 1 -- 172.21.15.170:0/1866583446 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7faaf81097d0 con 0x7faaf81007e0 2024-09-04T16:47:41.348 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:41 smithi170 ceph-mon[113855]: from='client.34810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:47:41.348 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:41 smithi170 ceph-mon[113855]: from='client.34814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:47:41.348 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:41 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/4089303260' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:47:41.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.347+0000 7faaf57fa640 1 -- 172.21.15.170:0/1866583446 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7faae8089150 con 0x7faaf81007e0 2024-09-04T16:47:41.349 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:47:41.349 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:47:41.349 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:47:41.349 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:47:41.349 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:47:41.349 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:47:41.349 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:47:41.349 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:47:41.349 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:47:41.349 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:47:41.350 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:47:41.350 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:47:41.350 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:47:41.350 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:47:41.350 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:47:41.350 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:47:41.350 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:47:41.350 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:47:41.350 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:47:41.350 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:47:41.350 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:47:41.350 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:47:41.350 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:47:41.350 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:47:41.351 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:47:41.351 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:47:41.351 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:47:41.351 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:47:41.351 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:47:41.351 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:47:41.351 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:47:41.351 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:47:41.351 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:47:41.351 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:47:41.351 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:47:41.351 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:47:41.351 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:47:41.351 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:47:41.352 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:47:41.352 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:47:41.352 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:47:41.352 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:47:41.352 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:47:41.352 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:47:41.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.349+0000 7faafe069640 1 -- 172.21.15.170:0/1866583446 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faae4079e30 msgr2=0x7faae407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:41.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.349+0000 7faafe069640 1 --2- 172.21.15.170:0/1866583446 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faae4079e30 0x7faae407c2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faaf80fe720 tx=0x7faae0008040 comp rx=0 tx=0).stop 2024-09-04T16:47:41.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.350+0000 7faafe069640 1 -- 172.21.15.170:0/1866583446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaf81007e0 msgr2=0x7faaf80fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:41.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.350+0000 7faafe069640 1 --2- 172.21.15.170:0/1866583446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaf81007e0 0x7faaf80fcc90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faae8031460 tx=0x7faae80048f0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.350+0000 7faafe069640 1 -- 172.21.15.170:0/1866583446 shutdown_connections 2024-09-04T16:47:41.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.350+0000 7faafe069640 1 --2- 172.21.15.170:0/1866583446 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faae4079e30 0x7faae407c2f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.350+0000 7faafe069640 1 --2- 172.21.15.170:0/1866583446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faaf81067e0 0x7faaf80fd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.350+0000 7faafe069640 1 --2- 172.21.15.170:0/1866583446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaf81007e0 0x7faaf80fcc90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.350+0000 7faafe069640 1 -- 172.21.15.170:0/1866583446 >> 172.21.15.170:0/1866583446 conn(0x7faaf80fc4c0 msgr2=0x7faaf8069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:41.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.350+0000 7faafe069640 1 -- 172.21.15.170:0/1866583446 shutdown_connections 2024-09-04T16:47:41.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.350+0000 7faafe069640 1 -- 172.21.15.170:0/1866583446 wait complete. 2024-09-04T16:47:41.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.432+0000 7f57e8f0f640 1 -- 172.21.15.170:0/4044389227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57e41067e0 msgr2=0x7f57e4106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:41.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.432+0000 7f57e8f0f640 1 --2- 172.21.15.170:0/4044389227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57e41067e0 0x7f57e4106bc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f57d4009880 tx=0x7f57d402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.433+0000 7f57e8f0f640 1 -- 172.21.15.170:0/4044389227 shutdown_connections 2024-09-04T16:47:41.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.433+0000 7f57e8f0f640 1 --2- 172.21.15.170:0/4044389227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57e41007e0 0x7f57e4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.433+0000 7f57e8f0f640 1 --2- 172.21.15.170:0/4044389227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57e41067e0 0x7f57e4106bc0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.433+0000 7f57e8f0f640 1 -- 172.21.15.170:0/4044389227 >> 172.21.15.170:0/4044389227 conn(0x7f57e40fc4c0 msgr2=0x7f57e40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:41.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.433+0000 7f57e8f0f640 1 -- 172.21.15.170:0/4044389227 shutdown_connections 2024-09-04T16:47:41.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.433+0000 7f57e8f0f640 1 -- 172.21.15.170:0/4044389227 wait complete. 2024-09-04T16:47:41.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.433+0000 7f57e8f0f640 1 Processor -- start 2024-09-04T16:47:41.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.434+0000 7f57e8f0f640 1 -- start start 2024-09-04T16:47:41.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.434+0000 7f57e8f0f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57e41007e0 0x7f57e41987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:41.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.434+0000 7f57e8f0f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57e41067e0 0x7f57e4198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:41.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.434+0000 7f57e8f0f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f57e410dcb0 con 0x7f57e41067e0 2024-09-04T16:47:41.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.434+0000 7f57e8f0f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57e410db30 con 0x7f57e41007e0 2024-09-04T16:47:41.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.434+0000 7f57d9d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57e41067e0 0x7f57e4198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:41.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.434+0000 7f57d9d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57e41067e0 0x7f57e4198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43330/0 (socket says 172.21.15.170:43330) 2024-09-04T16:47:41.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.434+0000 7f57d9d9b640 1 -- 172.21.15.170:0/1369660419 learned_addr learned my addr 172.21.15.170:0/1369660419 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:47:41.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.434+0000 7f57e259c640 1 --2- 172.21.15.170:0/1369660419 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57e41007e0 0x7f57e41987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:41.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.434+0000 7f57d9d9b640 1 -- 172.21.15.170:0/1369660419 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57e41007e0 msgr2=0x7f57e41987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:41.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.434+0000 7f57d9d9b640 1 --2- 172.21.15.170:0/1369660419 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57e41007e0 0x7f57e41987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.434+0000 7f57d9d9b640 1 -- 172.21.15.170:0/1369660419 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e4199370 con 0x7f57e41067e0 2024-09-04T16:47:41.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.434+0000 7f57e259c640 1 --2- 172.21.15.170:0/1369660419 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57e41007e0 0x7f57e41987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:47:41.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.434+0000 7f57d9d9b640 1 --2- 172.21.15.170:0/1369660419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57e41067e0 0x7f57e4198d20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00c8f0 tx=0x7f57cc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:41.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.434+0000 7f57dbfff640 1 -- 172.21.15.170:0/1369660419 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57cc0079b0 con 0x7f57e41067e0 2024-09-04T16:47:41.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.435+0000 7f57e8f0f640 1 -- 172.21.15.170:0/1369660419 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e41a1850 con 0x7f57e41067e0 2024-09-04T16:47:41.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.435+0000 7f57dbfff640 1 -- 172.21.15.170:0/1369660419 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f57cc0054e0 con 0x7f57e41067e0 2024-09-04T16:47:41.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.435+0000 7f57dbfff640 1 -- 172.21.15.170:0/1369660419 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57cc004dd0 con 0x7f57e41067e0 2024-09-04T16:47:41.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.435+0000 7f57e8f0f640 1 -- 172.21.15.170:0/1369660419 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e41a1c50 con 0x7f57e41067e0 2024-09-04T16:47:41.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.436+0000 7f57e8f0f640 1 -- 172.21.15.170:0/1369660419 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e4101f20 con 0x7f57e41067e0 2024-09-04T16:47:41.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.436+0000 7f57dbfff640 1 -- 172.21.15.170:0/1369660419 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f57cc005020 con 0x7f57e41067e0 2024-09-04T16:47:41.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.437+0000 7f57dbfff640 1 --2- 172.21.15.170:0/1369660419 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f57d0079dd0 0x7f57d007c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:41.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.437+0000 7f57dbfff640 1 -- 172.21.15.170:0/1369660419 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f57cc09cad0 con 0x7f57e41067e0 2024-09-04T16:47:41.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.437+0000 7f57e259c640 1 --2- 172.21.15.170:0/1369660419 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f57d0079dd0 0x7f57d007c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:41.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.437+0000 7f57e259c640 1 --2- 172.21.15.170:0/1369660419 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f57d0079dd0 0x7f57d007c290 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f57d4006010 tx=0x7f57d40095f0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:41.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.441+0000 7f57dbfff640 1 -- 172.21.15.170:0/1369660419 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f57cc014030 con 0x7f57e41067e0 2024-09-04T16:47:41.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.632+0000 7f57e8f0f640 1 -- 172.21.15.170:0/1369660419 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f57e4062630 con 0x7f57d0079dd0 2024-09-04T16:47:41.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.633+0000 7f57dbfff640 1 -- 172.21.15.170:0/1369660419 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f57e4062630 con 0x7f57d0079dd0 2024-09-04T16:47:41.634 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:47:41.634 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:47:41.634 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:47:41.634 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:47:41.635 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:47:41.635 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:47:41.635 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:47:41.635 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:47:41.635 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:47:41.635 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:47:41.635 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:47:41.635 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:47:41.635 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:47:41.635 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:47:41.635 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:47:41.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.636+0000 7f57e8f0f640 1 -- 172.21.15.170:0/1369660419 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f57d0079dd0 msgr2=0x7f57d007c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:41.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.636+0000 7f57e8f0f640 1 --2- 172.21.15.170:0/1369660419 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f57d0079dd0 0x7f57d007c290 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f57d4006010 tx=0x7f57d40095f0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.636+0000 7f57e8f0f640 1 -- 172.21.15.170:0/1369660419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57e41067e0 msgr2=0x7f57e4198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:41.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.636+0000 7f57e8f0f640 1 --2- 172.21.15.170:0/1369660419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57e41067e0 0x7f57e4198d20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00c8f0 tx=0x7f57cc00cdb0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.636+0000 7f57e8f0f640 1 -- 172.21.15.170:0/1369660419 shutdown_connections 2024-09-04T16:47:41.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.636+0000 7f57e8f0f640 1 --2- 172.21.15.170:0/1369660419 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f57d0079dd0 0x7f57d007c290 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.636+0000 7f57e8f0f640 1 --2- 172.21.15.170:0/1369660419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57e41067e0 0x7f57e4198d20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.636+0000 7f57e8f0f640 1 --2- 172.21.15.170:0/1369660419 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57e41007e0 0x7f57e41987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.636+0000 7f57e8f0f640 1 -- 172.21.15.170:0/1369660419 >> 172.21.15.170:0/1369660419 conn(0x7f57e40fc4c0 msgr2=0x7f57e40fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:41.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.636+0000 7f57e8f0f640 1 -- 172.21.15.170:0/1369660419 shutdown_connections 2024-09-04T16:47:41.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.636+0000 7f57e8f0f640 1 -- 172.21.15.170:0/1369660419 wait complete. 2024-09-04T16:47:41.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:41 smithi193 ceph-mon[82547]: from='client.34810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:47:41.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:41 smithi193 ceph-mon[82547]: from='client.34814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:47:41.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:41 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/4089303260' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:47:41.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.718+0000 7efdfeb7c640 1 -- 172.21.15.170:0/3741616756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdf8100820 msgr2=0x7efdf8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:41.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.718+0000 7efdfeb7c640 1 --2- 172.21.15.170:0/3741616756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdf8100820 0x7efdf8100c80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efde4009880 tx=0x7efde402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.718+0000 7efdfeb7c640 1 -- 172.21.15.170:0/3741616756 shutdown_connections 2024-09-04T16:47:41.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.718+0000 7efdfeb7c640 1 --2- 172.21.15.170:0/3741616756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdf8100820 0x7efdf8100c80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.718+0000 7efdfeb7c640 1 --2- 172.21.15.170:0/3741616756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdf8106820 0x7efdf8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.718+0000 7efdfeb7c640 1 -- 172.21.15.170:0/3741616756 >> 172.21.15.170:0/3741616756 conn(0x7efdf80fc520 msgr2=0x7efdf80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:41.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.718+0000 7efdfeb7c640 1 -- 172.21.15.170:0/3741616756 shutdown_connections 2024-09-04T16:47:41.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.718+0000 7efdfeb7c640 1 -- 172.21.15.170:0/3741616756 wait complete. 2024-09-04T16:47:41.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.718+0000 7efdfeb7c640 1 Processor -- start 2024-09-04T16:47:41.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.718+0000 7efdfeb7c640 1 -- start start 2024-09-04T16:47:41.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.719+0000 7efdfeb7c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdf8100820 0x7efdf819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:41.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.719+0000 7efdfeb7c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdf8106820 0x7efdf819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:41.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.719+0000 7efdfeb7c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efdf810dcf0 con 0x7efdf8100820 2024-09-04T16:47:41.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.719+0000 7efdfeb7c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efdf810db70 con 0x7efdf8106820 2024-09-04T16:47:41.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.719+0000 7efdfc918640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdf8100820 0x7efdf819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:41.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.719+0000 7efdfc918640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdf8100820 0x7efdf819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43346/0 (socket says 172.21.15.170:43346) 2024-09-04T16:47:41.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.719+0000 7efdfc918640 1 -- 172.21.15.170:0/865162002 learned_addr learned my addr 172.21.15.170:0/865162002 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:47:41.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.719+0000 7efdf7fff640 1 --2- 172.21.15.170:0/865162002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdf8106820 0x7efdf819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:41.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.719+0000 7efdfc918640 1 -- 172.21.15.170:0/865162002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdf8106820 msgr2=0x7efdf819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:41.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.719+0000 7efdfc918640 1 --2- 172.21.15.170:0/865162002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdf8106820 0x7efdf819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.719+0000 7efdfc918640 1 -- 172.21.15.170:0/865162002 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf81977e0 con 0x7efdf8100820 2024-09-04T16:47:41.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.719+0000 7efdfc918640 1 --2- 172.21.15.170:0/865162002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdf8100820 0x7efdf819d660 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efdec00c8f0 tx=0x7efdec00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:41.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.719+0000 7efdf5ffb640 1 -- 172.21.15.170:0/865162002 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efdec0079b0 con 0x7efdf8100820 2024-09-04T16:47:41.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.719+0000 7efdfeb7c640 1 -- 172.21.15.170:0/865162002 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf8197ad0 con 0x7efdf8100820 2024-09-04T16:47:41.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.719+0000 7efdf5ffb640 1 -- 172.21.15.170:0/865162002 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efdec0054e0 con 0x7efdf8100820 2024-09-04T16:47:41.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.719+0000 7efdf5ffb640 1 -- 172.21.15.170:0/865162002 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efdec004dd0 con 0x7efdf8100820 2024-09-04T16:47:41.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.720+0000 7efdfeb7c640 1 -- 172.21.15.170:0/865162002 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf8198060 con 0x7efdf8100820 2024-09-04T16:47:41.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.721+0000 7efdfeb7c640 1 -- 172.21.15.170:0/865162002 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf8101f60 con 0x7efdf8100820 2024-09-04T16:47:41.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.721+0000 7efdf5ffb640 1 -- 172.21.15.170:0/865162002 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7efdec005020 con 0x7efdf8100820 2024-09-04T16:47:41.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.722+0000 7efdf5ffb640 1 --2- 172.21.15.170:0/865162002 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efde8079dd0 0x7efde807c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:47:41.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.722+0000 7efdf5ffb640 1 -- 172.21.15.170:0/865162002 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7efdec09cb00 con 0x7efdf8100820 2024-09-04T16:47:41.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.722+0000 7efdf7fff640 1 --2- 172.21.15.170:0/865162002 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efde8079dd0 0x7efde807c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:47:41.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.722+0000 7efdf7fff640 1 --2- 172.21.15.170:0/865162002 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efde8079dd0 0x7efde807c290 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efde4031460 tx=0x7efde4009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:47:41.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.726+0000 7efdf5ffb640 1 -- 172.21.15.170:0/865162002 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efdec014030 con 0x7efdf8100820 2024-09-04T16:47:41.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.976+0000 7efdfeb7c640 1 -- 172.21.15.170:0/865162002 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7efdf8109da0 con 0x7efdf8100820 2024-09-04T16:47:41.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.976+0000 7efdf5ffb640 1 -- 172.21.15.170:0/865162002 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7efdec0644b0 con 0x7efdf8100820 2024-09-04T16:47:41.977 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:47:41.977 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:47:41.977 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:47:41.977 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:47:41.977 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:47:41.977 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:47:41.978 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:47:41.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.979+0000 7efdfeb7c640 1 -- 172.21.15.170:0/865162002 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efde8079dd0 msgr2=0x7efde807c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:41.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.979+0000 7efdfeb7c640 1 --2- 172.21.15.170:0/865162002 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efde8079dd0 0x7efde807c290 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efde4031460 tx=0x7efde4009560 comp rx=0 tx=0).stop 2024-09-04T16:47:41.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.979+0000 7efdfeb7c640 1 -- 172.21.15.170:0/865162002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdf8100820 msgr2=0x7efdf819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:47:41.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.979+0000 7efdfeb7c640 1 --2- 172.21.15.170:0/865162002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdf8100820 0x7efdf819d660 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efdec00c8f0 tx=0x7efdec00cdb0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.979+0000 7efdfeb7c640 1 -- 172.21.15.170:0/865162002 shutdown_connections 2024-09-04T16:47:41.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.979+0000 7efdfeb7c640 1 --2- 172.21.15.170:0/865162002 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efde8079dd0 0x7efde807c290 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.979+0000 7efdfeb7c640 1 --2- 172.21.15.170:0/865162002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdf8106820 0x7efdf819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.979+0000 7efdfeb7c640 1 --2- 172.21.15.170:0/865162002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdf8100820 0x7efdf819d660 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:47:41.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.979+0000 7efdfeb7c640 1 -- 172.21.15.170:0/865162002 >> 172.21.15.170:0/865162002 conn(0x7efdf80fc520 msgr2=0x7efdf806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:47:41.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.979+0000 7efdfeb7c640 1 -- 172.21.15.170:0/865162002 shutdown_connections 2024-09-04T16:47:41.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:47:41.979+0000 7efdfeb7c640 1 -- 172.21.15.170:0/865162002 wait complete. 2024-09-04T16:47:42.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:42 smithi170 ceph-mon[113855]: pgmap v539: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:42.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:42 smithi170 ceph-mon[113855]: from='client.34818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:47:42.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:42 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1866583446' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:47:42.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:42 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/865162002' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:47:42.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:42 smithi193 ceph-mon[82547]: pgmap v539: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:42.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:42 smithi193 ceph-mon[82547]: from='client.34818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:47:42.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:42 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1866583446' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:47:42.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:42 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/865162002' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:47:43.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:43 smithi170 ceph-mon[113855]: from='client.34830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:47:43.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:43 smithi193 ceph-mon[82547]: from='client.34830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:47:44.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:44 smithi170 ceph-mon[113855]: pgmap v540: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:47:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:44 smithi193 ceph-mon[82547]: pgmap v540: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:47:46.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:46 smithi170 ceph-mon[113855]: pgmap v541: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:46 smithi193 ceph-mon[82547]: pgmap v541: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:48.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:48 smithi193 ceph-mon[82547]: pgmap v542: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:48.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:48 smithi170 ceph-mon[113855]: pgmap v542: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:50.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:50 smithi170 ceph-mon[113855]: pgmap v543: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:50 smithi193 ceph-mon[82547]: pgmap v543: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:52.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:52 smithi170 ceph-mon[113855]: pgmap v544: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:52.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:52 smithi193 ceph-mon[82547]: pgmap v544: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:54.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:54 smithi170 ceph-mon[113855]: pgmap v545: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:54 smithi193 ceph-mon[82547]: pgmap v545: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:56.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:56 smithi170 ceph-mon[113855]: pgmap v546: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:56.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:56 smithi193 ceph-mon[82547]: pgmap v546: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:58.458 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:58 smithi193 ceph-mon[82547]: pgmap v547: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:58.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:58 smithi170 ceph-mon[113855]: pgmap v547: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:47:59.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:47:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:47:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:47:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:48:00.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:00 smithi170 ceph-mon[113855]: pgmap v548: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:00.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:00 smithi193 ceph-mon[82547]: pgmap v548: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:02.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:02 smithi170 ceph-mon[113855]: pgmap v549: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:02 smithi193 ceph-mon[82547]: pgmap v549: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:04.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:04 smithi170 ceph-mon[113855]: pgmap v550: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:04 smithi193 ceph-mon[82547]: pgmap v550: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:06.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:06 smithi170 ceph-mon[113855]: pgmap v551: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:06.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:06 smithi193 ceph-mon[82547]: pgmap v551: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:08.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:08 smithi170 ceph-mon[113855]: pgmap v552: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:08.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:08 smithi193 ceph-mon[82547]: pgmap v552: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:10.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:10 smithi170 ceph-mon[113855]: pgmap v553: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:10 smithi193 ceph-mon[82547]: pgmap v553: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:12.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.074+0000 7f85adb6c640 1 -- 172.21.15.170:0/3839066329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85a8107930 msgr2=0x7f85a8107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:12.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.074+0000 7f85adb6c640 1 --2- 172.21.15.170:0/3839066329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85a8107930 0x7f85a8107d10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8598009880 tx=0x7f859802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.074+0000 7f85adb6c640 1 -- 172.21.15.170:0/3839066329 shutdown_connections 2024-09-04T16:48:12.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.074+0000 7f85adb6c640 1 --2- 172.21.15.170:0/3839066329 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85a8101930 0x7f85a8101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.074+0000 7f85adb6c640 1 --2- 172.21.15.170:0/3839066329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85a8107930 0x7f85a8107d10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.074+0000 7f85adb6c640 1 -- 172.21.15.170:0/3839066329 >> 172.21.15.170:0/3839066329 conn(0x7f85a80fd630 msgr2=0x7f85a80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:12.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.074+0000 7f85adb6c640 1 -- 172.21.15.170:0/3839066329 shutdown_connections 2024-09-04T16:48:12.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.074+0000 7f85adb6c640 1 -- 172.21.15.170:0/3839066329 wait complete. 2024-09-04T16:48:12.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.074+0000 7f85adb6c640 1 Processor -- start 2024-09-04T16:48:12.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.075+0000 7f85adb6c640 1 -- start start 2024-09-04T16:48:12.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.075+0000 7f85adb6c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85a8101930 0x7f85a80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:12.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.075+0000 7f85adb6c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85a8107930 0x7f85a8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:12.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.075+0000 7f85adb6c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f85a810ee00 con 0x7f85a8107930 2024-09-04T16:48:12.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.075+0000 7f85adb6c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f85a810ec80 con 0x7f85a8101930 2024-09-04T16:48:12.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.075+0000 7f85a6ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85a8107930 0x7f85a8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:12.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.075+0000 7f85a6ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85a8107930 0x7f85a8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53704/0 (socket says 172.21.15.170:53704) 2024-09-04T16:48:12.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.075+0000 7f85a77fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85a8101930 0x7f85a80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:12.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.075+0000 7f85a6ffd640 1 -- 172.21.15.170:0/1924349823 learned_addr learned my addr 172.21.15.170:0/1924349823 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:48:12.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.075+0000 7f85a6ffd640 1 -- 172.21.15.170:0/1924349823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85a8101930 msgr2=0x7f85a80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:12.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.075+0000 7f85a6ffd640 1 --2- 172.21.15.170:0/1924349823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85a8101930 0x7f85a80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.075+0000 7f85a6ffd640 1 -- 172.21.15.170:0/1924349823 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a8074f70 con 0x7f85a8107930 2024-09-04T16:48:12.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.076+0000 7f85a6ffd640 1 --2- 172.21.15.170:0/1924349823 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85a8107930 0x7f85a8074a30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f859c00d6f0 tx=0x7f859c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:12.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.076+0000 7f85a4ff9640 1 -- 172.21.15.170:0/1924349823 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f859c017070 con 0x7f85a8107930 2024-09-04T16:48:12.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.076+0000 7f85adb6c640 1 -- 172.21.15.170:0/1924349823 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a8075260 con 0x7f85a8107930 2024-09-04T16:48:12.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.076+0000 7f85a4ff9640 1 -- 172.21.15.170:0/1924349823 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f859c00de00 con 0x7f85a8107930 2024-09-04T16:48:12.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.076+0000 7f85a4ff9640 1 -- 172.21.15.170:0/1924349823 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f859c004bb0 con 0x7f85a8107930 2024-09-04T16:48:12.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.076+0000 7f85adb6c640 1 -- 172.21.15.170:0/1924349823 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a81a3e70 con 0x7f85a8107930 2024-09-04T16:48:12.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.077+0000 7f85adb6c640 1 -- 172.21.15.170:0/1924349823 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85a8103070 con 0x7f85a8107930 2024-09-04T16:48:12.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.078+0000 7f85a4ff9640 1 -- 172.21.15.170:0/1924349823 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f859c004e60 con 0x7f85a8107930 2024-09-04T16:48:12.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.078+0000 7f85a4ff9640 1 --2- 172.21.15.170:0/1924349823 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8590079e30 0x7f859007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:12.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.078+0000 7f85a4ff9640 1 -- 172.21.15.170:0/1924349823 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f859c09c660 con 0x7f85a8107930 2024-09-04T16:48:12.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.078+0000 7f85a77fe640 1 --2- 172.21.15.170:0/1924349823 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8590079e30 0x7f859007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:12.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.079+0000 7f85a77fe640 1 --2- 172.21.15.170:0/1924349823 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8590079e30 0x7f859007c2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f85980096c0 tx=0x7f8598031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:12.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.083+0000 7f85a4ff9640 1 -- 172.21.15.170:0/1924349823 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f859c0681e0 con 0x7f85a8107930 2024-09-04T16:48:12.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.283+0000 7f85adb6c640 1 -- 172.21.15.170:0/1924349823 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f85a8062630 con 0x7f8590079e30 2024-09-04T16:48:12.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.284+0000 7f85a4ff9640 1 -- 172.21.15.170:0/1924349823 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f85a8062630 con 0x7f8590079e30 2024-09-04T16:48:12.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.286+0000 7f85adb6c640 1 -- 172.21.15.170:0/1924349823 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8590079e30 msgr2=0x7f859007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:12.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.286+0000 7f85adb6c640 1 --2- 172.21.15.170:0/1924349823 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8590079e30 0x7f859007c2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f85980096c0 tx=0x7f8598031400 comp rx=0 tx=0).stop 2024-09-04T16:48:12.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.286+0000 7f85adb6c640 1 -- 172.21.15.170:0/1924349823 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85a8107930 msgr2=0x7f85a8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:12.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.286+0000 7f85adb6c640 1 --2- 172.21.15.170:0/1924349823 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85a8107930 0x7f85a8074a30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f859c00d6f0 tx=0x7f859c00dbb0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.286+0000 7f85adb6c640 1 -- 172.21.15.170:0/1924349823 shutdown_connections 2024-09-04T16:48:12.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.286+0000 7f85adb6c640 1 --2- 172.21.15.170:0/1924349823 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8590079e30 0x7f859007c2f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.286+0000 7f85adb6c640 1 --2- 172.21.15.170:0/1924349823 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85a8107930 0x7f85a8074a30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.286+0000 7f85adb6c640 1 --2- 172.21.15.170:0/1924349823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85a8101930 0x7f85a80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.286+0000 7f85adb6c640 1 -- 172.21.15.170:0/1924349823 >> 172.21.15.170:0/1924349823 conn(0x7f85a80fd630 msgr2=0x7f85a80fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:12.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.286+0000 7f85adb6c640 1 -- 172.21.15.170:0/1924349823 shutdown_connections 2024-09-04T16:48:12.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.286+0000 7f85adb6c640 1 -- 172.21.15.170:0/1924349823 wait complete. 2024-09-04T16:48:12.296 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:48:12.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:12 smithi170 ceph-mon[113855]: pgmap v554: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:12.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.371+0000 7f002ce50640 1 -- 172.21.15.170:0/2287813193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0028100820 msgr2=0x7f0028100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:12.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.371+0000 7f002ce50640 1 --2- 172.21.15.170:0/2287813193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0028100820 0x7f0028100c80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f001c009880 tx=0x7f001c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.371+0000 7f002ce50640 1 -- 172.21.15.170:0/2287813193 shutdown_connections 2024-09-04T16:48:12.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.371+0000 7f002ce50640 1 --2- 172.21.15.170:0/2287813193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0028100820 0x7f0028100c80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.371+0000 7f002ce50640 1 --2- 172.21.15.170:0/2287813193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0028106820 0x7f0028106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.371+0000 7f002ce50640 1 -- 172.21.15.170:0/2287813193 >> 172.21.15.170:0/2287813193 conn(0x7f00280fc520 msgr2=0x7f00280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:12.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.371+0000 7f002ce50640 1 -- 172.21.15.170:0/2287813193 shutdown_connections 2024-09-04T16:48:12.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.371+0000 7f002ce50640 1 -- 172.21.15.170:0/2287813193 wait complete. 2024-09-04T16:48:12.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.372+0000 7f002ce50640 1 Processor -- start 2024-09-04T16:48:12.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.372+0000 7f002ce50640 1 -- start start 2024-09-04T16:48:12.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.372+0000 7f002ce50640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0028100820 0x7f002819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:12.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.372+0000 7f002ce50640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0028106820 0x7f002819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:12.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.372+0000 7f002ce50640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f002810dcf0 con 0x7f0028100820 2024-09-04T16:48:12.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.372+0000 7f002ce50640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f002810db70 con 0x7f0028106820 2024-09-04T16:48:12.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.372+0000 7f002659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0028100820 0x7f002819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:12.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.372+0000 7f002659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0028100820 0x7f002819d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53710/0 (socket says 172.21.15.170:53710) 2024-09-04T16:48:12.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.372+0000 7f002659c640 1 -- 172.21.15.170:0/1185404050 learned_addr learned my addr 172.21.15.170:0/1185404050 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:48:12.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.373+0000 7f0025d9b640 1 --2- 172.21.15.170:0/1185404050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0028106820 0x7f002819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:12.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.373+0000 7f002659c640 1 -- 172.21.15.170:0/1185404050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0028106820 msgr2=0x7f002819dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:12.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.373+0000 7f002659c640 1 --2- 172.21.15.170:0/1185404050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0028106820 0x7f002819dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.373+0000 7f002659c640 1 -- 172.21.15.170:0/1185404050 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00281977f0 con 0x7f0028100820 2024-09-04T16:48:12.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.373+0000 7f002659c640 1 --2- 172.21.15.170:0/1185404050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0028100820 0x7f002819d670 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f001800d6f0 tx=0x7f001800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:12.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.373+0000 7f00177fe640 1 -- 172.21.15.170:0/1185404050 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0018017070 con 0x7f0028100820 2024-09-04T16:48:12.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.373+0000 7f002ce50640 1 -- 172.21.15.170:0/1185404050 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0028197ae0 con 0x7f0028100820 2024-09-04T16:48:12.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.373+0000 7f00177fe640 1 -- 172.21.15.170:0/1185404050 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f001800de00 con 0x7f0028100820 2024-09-04T16:48:12.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.373+0000 7f00177fe640 1 -- 172.21.15.170:0/1185404050 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0018004bb0 con 0x7f0028100820 2024-09-04T16:48:12.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.373+0000 7f002ce50640 1 -- 172.21.15.170:0/1185404050 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0028198040 con 0x7f0028100820 2024-09-04T16:48:12.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.374+0000 7f002ce50640 1 -- 172.21.15.170:0/1185404050 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0028101f60 con 0x7f0028100820 2024-09-04T16:48:12.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.375+0000 7f00177fe640 1 -- 172.21.15.170:0/1185404050 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f0018004e60 con 0x7f0028100820 2024-09-04T16:48:12.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.375+0000 7f00177fe640 1 --2- 172.21.15.170:0/1185404050 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0010079e30 0x7f001007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:12.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.375+0000 7f00177fe640 1 -- 172.21.15.170:0/1185404050 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f001809c6c0 con 0x7f0028100820 2024-09-04T16:48:12.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.375+0000 7f0025d9b640 1 --2- 172.21.15.170:0/1185404050 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0010079e30 0x7f001007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:12.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.376+0000 7f0025d9b640 1 --2- 172.21.15.170:0/1185404050 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0010079e30 0x7f001007c2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0028198b40 tx=0x7f001c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:12.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.379+0000 7f00177fe640 1 -- 172.21.15.170:0/1185404050 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f00180640d0 con 0x7f0028100820 2024-09-04T16:48:12.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.571+0000 7f002ce50640 1 -- 172.21.15.170:0/1185404050 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f00281982f0 con 0x7f0010079e30 2024-09-04T16:48:12.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.573+0000 7f00177fe640 1 -- 172.21.15.170:0/1185404050 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f00281982f0 con 0x7f0010079e30 2024-09-04T16:48:12.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.575+0000 7f002ce50640 1 -- 172.21.15.170:0/1185404050 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0010079e30 msgr2=0x7f001007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:12.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.575+0000 7f002ce50640 1 --2- 172.21.15.170:0/1185404050 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0010079e30 0x7f001007c2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0028198b40 tx=0x7f001c031400 comp rx=0 tx=0).stop 2024-09-04T16:48:12.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.575+0000 7f002ce50640 1 -- 172.21.15.170:0/1185404050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0028100820 msgr2=0x7f002819d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:12.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.575+0000 7f002ce50640 1 --2- 172.21.15.170:0/1185404050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0028100820 0x7f002819d670 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f001800d6f0 tx=0x7f001800dbb0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.575+0000 7f002ce50640 1 -- 172.21.15.170:0/1185404050 shutdown_connections 2024-09-04T16:48:12.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.575+0000 7f002ce50640 1 --2- 172.21.15.170:0/1185404050 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0010079e30 0x7f001007c2f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.575+0000 7f002ce50640 1 --2- 172.21.15.170:0/1185404050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0028106820 0x7f002819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.575+0000 7f002ce50640 1 --2- 172.21.15.170:0/1185404050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0028100820 0x7f002819d670 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.575+0000 7f002ce50640 1 -- 172.21.15.170:0/1185404050 >> 172.21.15.170:0/1185404050 conn(0x7f00280fc520 msgr2=0x7f0028104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:12.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.575+0000 7f002ce50640 1 -- 172.21.15.170:0/1185404050 shutdown_connections 2024-09-04T16:48:12.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.575+0000 7f002ce50640 1 -- 172.21.15.170:0/1185404050 wait complete. 2024-09-04T16:48:12.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:12 smithi193 ceph-mon[82547]: pgmap v554: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:12.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.657+0000 7f155867b640 1 -- 172.21.15.170:0/3550430805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15501007e0 msgr2=0x7f1550100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:12.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.657+0000 7f155867b640 1 --2- 172.21.15.170:0/3550430805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15501007e0 0x7f1550100c40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f154c009880 tx=0x7f154c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.657+0000 7f155867b640 1 -- 172.21.15.170:0/3550430805 shutdown_connections 2024-09-04T16:48:12.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.657+0000 7f155867b640 1 --2- 172.21.15.170:0/3550430805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15501007e0 0x7f1550100c40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.657+0000 7f155867b640 1 --2- 172.21.15.170:0/3550430805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15501067e0 0x7f1550106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.657+0000 7f155867b640 1 -- 172.21.15.170:0/3550430805 >> 172.21.15.170:0/3550430805 conn(0x7f15500fc4c0 msgr2=0x7f15500fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:12.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.657+0000 7f155867b640 1 -- 172.21.15.170:0/3550430805 shutdown_connections 2024-09-04T16:48:12.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.657+0000 7f155867b640 1 -- 172.21.15.170:0/3550430805 wait complete. 2024-09-04T16:48:12.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.657+0000 7f155867b640 1 Processor -- start 2024-09-04T16:48:12.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.657+0000 7f155867b640 1 -- start start 2024-09-04T16:48:12.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.658+0000 7f155867b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15501007e0 0x7f15500fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:12.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.658+0000 7f155867b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15501067e0 0x7f15500fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:12.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.658+0000 7f155867b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f155010dcb0 con 0x7f15501007e0 2024-09-04T16:48:12.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.658+0000 7f155867b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f155010db30 con 0x7f15501067e0 2024-09-04T16:48:12.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.658+0000 7f1556417640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15501007e0 0x7f15500fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:12.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.658+0000 7f1556417640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15501007e0 0x7f15500fcc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53718/0 (socket says 172.21.15.170:53718) 2024-09-04T16:48:12.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.658+0000 7f1556417640 1 -- 172.21.15.170:0/19577224 learned_addr learned my addr 172.21.15.170:0/19577224 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:48:12.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.658+0000 7f1555c16640 1 --2- 172.21.15.170:0/19577224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15501067e0 0x7f15500fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:12.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.658+0000 7f1556417640 1 -- 172.21.15.170:0/19577224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15501067e0 msgr2=0x7f15500fd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:12.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.658+0000 7f1556417640 1 --2- 172.21.15.170:0/19577224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15501067e0 0x7f15500fd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.658+0000 7f1556417640 1 -- 172.21.15.170:0/19577224 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15500fd690 con 0x7f15501007e0 2024-09-04T16:48:12.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.658+0000 7f1556417640 1 --2- 172.21.15.170:0/19577224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15501007e0 0x7f15500fcc10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f154000d6f0 tx=0x7f154000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:12.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.658+0000 7f15477fe640 1 -- 172.21.15.170:0/19577224 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1540017070 con 0x7f15501007e0 2024-09-04T16:48:12.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.658+0000 7f155867b640 1 -- 172.21.15.170:0/19577224 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15500fd980 con 0x7f15501007e0 2024-09-04T16:48:12.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.658+0000 7f15477fe640 1 -- 172.21.15.170:0/19577224 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f154000de00 con 0x7f15501007e0 2024-09-04T16:48:12.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.659+0000 7f155867b640 1 -- 172.21.15.170:0/19577224 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15501a3eb0 con 0x7f15501007e0 2024-09-04T16:48:12.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.659+0000 7f15477fe640 1 -- 172.21.15.170:0/19577224 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1540004bb0 con 0x7f15501007e0 2024-09-04T16:48:12.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.659+0000 7f155867b640 1 -- 172.21.15.170:0/19577224 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1534005290 con 0x7f15501007e0 2024-09-04T16:48:12.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.660+0000 7f15477fe640 1 -- 172.21.15.170:0/19577224 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f1540009a30 con 0x7f15501007e0 2024-09-04T16:48:12.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.661+0000 7f15477fe640 1 --2- 172.21.15.170:0/19577224 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f153c079e30 0x7f153c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:12.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.661+0000 7f15477fe640 1 -- 172.21.15.170:0/19577224 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f154009c540 con 0x7f15501007e0 2024-09-04T16:48:12.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.661+0000 7f1555c16640 1 --2- 172.21.15.170:0/19577224 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f153c079e30 0x7f153c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:12.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.661+0000 7f1555c16640 1 --2- 172.21.15.170:0/19577224 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f153c079e30 0x7f153c07c2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f15500fe6a0 tx=0x7f154c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:12.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.665+0000 7f15477fe640 1 -- 172.21.15.170:0/19577224 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f15400680c0 con 0x7f15501007e0 2024-09-04T16:48:12.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.845+0000 7f155867b640 1 -- 172.21.15.170:0/19577224 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1534000bc0 con 0x7f153c079e30 2024-09-04T16:48:12.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.855+0000 7f15477fe640 1 -- 172.21.15.170:0/19577224 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f1534000bc0 con 0x7f153c079e30 2024-09-04T16:48:12.855 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:48:12.855 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (15m) 9m ago 25m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:48:12.855 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (18m) 9m ago 26m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:48:12.856 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (17m) 8m ago 25m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:48:12.856 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (13m) 9m ago 26m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:48:12.856 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (13m) 8m ago 25m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:48:12.856 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (14m) 9m ago 25m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:48:12.856 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (9m) 9m ago 20m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:48:12.856 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (9m) 9m ago 20m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:48:12.856 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (9m) 8m ago 20m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:48:12.856 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (9m) 8m ago 20m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:48:12.856 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (17m) 9m ago 27m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:48:12.856 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (16m) 8m ago 25m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:48:12.856 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (13m) 9m ago 27m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:48:12.856 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (13m) 8m ago 25m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:48:12.857 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (16m) 9m ago 26m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:48:12.857 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (15m) 8m ago 25m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:48:12.857 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (12m) 9m ago 23m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:48:12.857 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (12m) 9m ago 23m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:48:12.857 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (11m) 9m ago 23m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:48:12.857 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (11m) 8m ago 22m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:48:12.857 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (10m) 8m ago 22m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:48:12.857 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (10m) 8m ago 21m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:48:12.857 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (15m) 9m ago 25m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:48:12.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.857+0000 7f155867b640 1 -- 172.21.15.170:0/19577224 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f153c079e30 msgr2=0x7f153c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:12.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.857+0000 7f155867b640 1 --2- 172.21.15.170:0/19577224 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f153c079e30 0x7f153c07c2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f15500fe6a0 tx=0x7f154c031400 comp rx=0 tx=0).stop 2024-09-04T16:48:12.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.857+0000 7f155867b640 1 -- 172.21.15.170:0/19577224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15501007e0 msgr2=0x7f15500fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:12.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.857+0000 7f155867b640 1 --2- 172.21.15.170:0/19577224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15501007e0 0x7f15500fcc10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f154000d6f0 tx=0x7f154000dbb0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.857+0000 7f155867b640 1 -- 172.21.15.170:0/19577224 shutdown_connections 2024-09-04T16:48:12.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.857+0000 7f155867b640 1 --2- 172.21.15.170:0/19577224 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f153c079e30 0x7f153c07c2f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.857+0000 7f155867b640 1 --2- 172.21.15.170:0/19577224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15501067e0 0x7f15500fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.857+0000 7f155867b640 1 --2- 172.21.15.170:0/19577224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15501007e0 0x7f15500fcc10 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.857+0000 7f155867b640 1 -- 172.21.15.170:0/19577224 >> 172.21.15.170:0/19577224 conn(0x7f15500fc4c0 msgr2=0x7f1550069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:12.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.857+0000 7f155867b640 1 -- 172.21.15.170:0/19577224 shutdown_connections 2024-09-04T16:48:12.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.857+0000 7f155867b640 1 -- 172.21.15.170:0/19577224 wait complete. 2024-09-04T16:48:12.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.938+0000 7f0b55341640 1 -- 172.21.15.170:0/3849397137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b500ffd50 msgr2=0x7f0b501001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:12.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.938+0000 7f0b55341640 1 --2- 172.21.15.170:0/3849397137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b500ffd50 0x7f0b501001b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009880 tx=0x7f0b4002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.938+0000 7f0b55341640 1 -- 172.21.15.170:0/3849397137 shutdown_connections 2024-09-04T16:48:12.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.938+0000 7f0b55341640 1 --2- 172.21.15.170:0/3849397137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b500ffd50 0x7f0b501001b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.938+0000 7f0b55341640 1 --2- 172.21.15.170:0/3849397137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b50106930 0x7f0b50106d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.938+0000 7f0b55341640 1 -- 172.21.15.170:0/3849397137 >> 172.21.15.170:0/3849397137 conn(0x7f0b500fbc40 msgr2=0x7f0b500fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:12.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.938+0000 7f0b55341640 1 -- 172.21.15.170:0/3849397137 shutdown_connections 2024-09-04T16:48:12.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.938+0000 7f0b55341640 1 -- 172.21.15.170:0/3849397137 wait complete. 2024-09-04T16:48:12.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.938+0000 7f0b55341640 1 Processor -- start 2024-09-04T16:48:12.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.939+0000 7f0b55341640 1 -- start start 2024-09-04T16:48:12.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.939+0000 7f0b55341640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b500ffd50 0x7f0b50100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:12.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.939+0000 7f0b55341640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b50106930 0x7f0b50101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:12.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.939+0000 7f0b55341640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5010eed0 con 0x7f0b50106930 2024-09-04T16:48:12.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.939+0000 7f0b55341640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5010ed50 con 0x7f0b500ffd50 2024-09-04T16:48:12.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.939+0000 7f0b4e7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b50106930 0x7f0b50101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:12.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.939+0000 7f0b4e7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b50106930 0x7f0b50101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53734/0 (socket says 172.21.15.170:53734) 2024-09-04T16:48:12.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.939+0000 7f0b4e7fc640 1 -- 172.21.15.170:0/2012411595 learned_addr learned my addr 172.21.15.170:0/2012411595 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:48:12.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.939+0000 7f0b4effd640 1 --2- 172.21.15.170:0/2012411595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b500ffd50 0x7f0b50100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:12.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.939+0000 7f0b4e7fc640 1 -- 172.21.15.170:0/2012411595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b500ffd50 msgr2=0x7f0b50100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:12.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.939+0000 7f0b4e7fc640 1 --2- 172.21.15.170:0/2012411595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b500ffd50 0x7f0b50100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:12.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.939+0000 7f0b4e7fc640 1 -- 172.21.15.170:0/2012411595 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b501019b0 con 0x7f0b50106930 2024-09-04T16:48:12.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.940+0000 7f0b4e7fc640 1 --2- 172.21.15.170:0/2012411595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b50106930 0x7f0b50101470 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0b40031460 tx=0x7f0b40004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:12.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.940+0000 7f0b37fff640 1 -- 172.21.15.170:0/2012411595 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b4003f070 con 0x7f0b50106930 2024-09-04T16:48:12.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.940+0000 7f0b55341640 1 -- 172.21.15.170:0/2012411595 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b50101c40 con 0x7f0b50106930 2024-09-04T16:48:12.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.940+0000 7f0b37fff640 1 -- 172.21.15.170:0/2012411595 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b400035f0 con 0x7f0b50106930 2024-09-04T16:48:12.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.940+0000 7f0b37fff640 1 -- 172.21.15.170:0/2012411595 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b40035030 con 0x7f0b50106930 2024-09-04T16:48:12.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.940+0000 7f0b55341640 1 -- 172.21.15.170:0/2012411595 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b501a3e20 con 0x7f0b50106930 2024-09-04T16:48:12.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.941+0000 7f0b55341640 1 -- 172.21.15.170:0/2012411595 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b50103070 con 0x7f0b50106930 2024-09-04T16:48:12.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.942+0000 7f0b37fff640 1 -- 172.21.15.170:0/2012411595 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f0b40042070 con 0x7f0b50106930 2024-09-04T16:48:12.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.942+0000 7f0b37fff640 1 --2- 172.21.15.170:0/2012411595 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0b38079e30 0x7f0b3807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:12.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.943+0000 7f0b4effd640 1 --2- 172.21.15.170:0/2012411595 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0b38079e30 0x7f0b3807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:12.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.943+0000 7f0b37fff640 1 -- 172.21.15.170:0/2012411595 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f0b400bd380 con 0x7f0b50106930 2024-09-04T16:48:12.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.943+0000 7f0b4effd640 1 --2- 172.21.15.170:0/2012411595 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0b38079e30 0x7f0b3807c2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009bd0 tx=0x7f0b44005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:12.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:12.946+0000 7f0b37fff640 1 -- 172.21.15.170:0/2012411595 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0b40088f00 con 0x7f0b50106930 2024-09-04T16:48:13.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.194+0000 7f0b55341640 1 -- 172.21.15.170:0/2012411595 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0b50102460 con 0x7f0b50106930 2024-09-04T16:48:13.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.194+0000 7f0b37fff640 1 -- 172.21.15.170:0/2012411595 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f0b4008d240 con 0x7f0b50106930 2024-09-04T16:48:13.195 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:48:13.195 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:48:13.195 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:48:13.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:48:13.195 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:48:13.196 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:48:13.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:48:13.196 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:48:13.196 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:48:13.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:48:13.196 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:48:13.196 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:48:13.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:48:13.196 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:48:13.196 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:48:13.196 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:48:13.196 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:48:13.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.197+0000 7f0b55341640 1 -- 172.21.15.170:0/2012411595 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0b38079e30 msgr2=0x7f0b3807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:13.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.197+0000 7f0b55341640 1 --2- 172.21.15.170:0/2012411595 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0b38079e30 0x7f0b3807c2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009bd0 tx=0x7f0b44005f90 comp rx=0 tx=0).stop 2024-09-04T16:48:13.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.197+0000 7f0b55341640 1 -- 172.21.15.170:0/2012411595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b50106930 msgr2=0x7f0b50101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:13.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.197+0000 7f0b55341640 1 --2- 172.21.15.170:0/2012411595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b50106930 0x7f0b50101470 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0b40031460 tx=0x7f0b40004530 comp rx=0 tx=0).stop 2024-09-04T16:48:13.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.197+0000 7f0b55341640 1 -- 172.21.15.170:0/2012411595 shutdown_connections 2024-09-04T16:48:13.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.197+0000 7f0b55341640 1 --2- 172.21.15.170:0/2012411595 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0b38079e30 0x7f0b3807c2f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.197+0000 7f0b55341640 1 --2- 172.21.15.170:0/2012411595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b50106930 0x7f0b50101470 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.197+0000 7f0b55341640 1 --2- 172.21.15.170:0/2012411595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b500ffd50 0x7f0b50100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.197+0000 7f0b55341640 1 -- 172.21.15.170:0/2012411595 >> 172.21.15.170:0/2012411595 conn(0x7f0b500fbc40 msgr2=0x7f0b500fc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:13.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.197+0000 7f0b55341640 1 -- 172.21.15.170:0/2012411595 shutdown_connections 2024-09-04T16:48:13.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.197+0000 7f0b55341640 1 -- 172.21.15.170:0/2012411595 wait complete. 2024-09-04T16:48:13.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.279+0000 7f7714964640 1 -- 172.21.15.170:0/3310898014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77101067e0 msgr2=0x7f7710106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:13.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.279+0000 7f7714964640 1 --2- 172.21.15.170:0/3310898014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77101067e0 0x7f7710106bc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7708009c20 tx=0x7f770802a970 comp rx=0 tx=0).stop 2024-09-04T16:48:13.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.279+0000 7f7714964640 1 -- 172.21.15.170:0/3310898014 shutdown_connections 2024-09-04T16:48:13.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.279+0000 7f7714964640 1 --2- 172.21.15.170:0/3310898014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77101007e0 0x7f7710100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.279+0000 7f7714964640 1 --2- 172.21.15.170:0/3310898014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77101067e0 0x7f7710106bc0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.279+0000 7f7714964640 1 -- 172.21.15.170:0/3310898014 >> 172.21.15.170:0/3310898014 conn(0x7f77100fc4c0 msgr2=0x7f77100fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:13.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.279+0000 7f7714964640 1 -- 172.21.15.170:0/3310898014 shutdown_connections 2024-09-04T16:48:13.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.279+0000 7f7714964640 1 -- 172.21.15.170:0/3310898014 wait complete. 2024-09-04T16:48:13.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.280+0000 7f7714964640 1 Processor -- start 2024-09-04T16:48:13.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.280+0000 7f7714964640 1 -- start start 2024-09-04T16:48:13.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.280+0000 7f7714964640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77101007e0 0x7f771019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:13.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.280+0000 7f7714964640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77101067e0 0x7f771019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:13.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.280+0000 7f7714964640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f771010dcb0 con 0x7f77101007e0 2024-09-04T16:48:13.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.280+0000 7f7714964640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f771010db30 con 0x7f77101067e0 2024-09-04T16:48:13.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.280+0000 7f770e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77101007e0 0x7f771019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:13.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.280+0000 7f770e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77101007e0 0x7f771019d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53754/0 (socket says 172.21.15.170:53754) 2024-09-04T16:48:13.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.280+0000 7f770e59c640 1 -- 172.21.15.170:0/4035144816 learned_addr learned my addr 172.21.15.170:0/4035144816 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:48:13.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.280+0000 7f770dd9b640 1 --2- 172.21.15.170:0/4035144816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77101067e0 0x7f771019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:13.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.280+0000 7f770e59c640 1 -- 172.21.15.170:0/4035144816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77101067e0 msgr2=0x7f771019db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:13.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.280+0000 7f770e59c640 1 --2- 172.21.15.170:0/4035144816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77101067e0 0x7f771019db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.280+0000 7f770e59c640 1 -- 172.21.15.170:0/4035144816 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77101977d0 con 0x7f77101007e0 2024-09-04T16:48:13.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.280+0000 7f770e59c640 1 --2- 172.21.15.170:0/4035144816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77101007e0 0x7f771019d650 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f770802ae90 tx=0x7f770802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:13.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.281+0000 7f77077fe640 1 -- 172.21.15.170:0/4035144816 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7708047070 con 0x7f77101007e0 2024-09-04T16:48:13.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.281+0000 7f77077fe640 1 -- 172.21.15.170:0/4035144816 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f770802f7e0 con 0x7f77101007e0 2024-09-04T16:48:13.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.281+0000 7f77077fe640 1 -- 172.21.15.170:0/4035144816 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7708034070 con 0x7f77101007e0 2024-09-04T16:48:13.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.281+0000 7f7714964640 1 -- 172.21.15.170:0/4035144816 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7710197a60 con 0x7f77101007e0 2024-09-04T16:48:13.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.281+0000 7f7714964640 1 -- 172.21.15.170:0/4035144816 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7710197f90 con 0x7f77101007e0 2024-09-04T16:48:13.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.282+0000 7f7714964640 1 -- 172.21.15.170:0/4035144816 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7710101f20 con 0x7f77101007e0 2024-09-04T16:48:13.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.282+0000 7f77077fe640 1 -- 172.21.15.170:0/4035144816 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f770804a070 con 0x7f77101007e0 2024-09-04T16:48:13.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.283+0000 7f77077fe640 1 --2- 172.21.15.170:0/4035144816 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76fc079e30 0x7f76fc07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:13.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.283+0000 7f77077fe640 1 -- 172.21.15.170:0/4035144816 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f77080bd840 con 0x7f77101007e0 2024-09-04T16:48:13.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.283+0000 7f770dd9b640 1 --2- 172.21.15.170:0/4035144816 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76fc079e30 0x7f76fc07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:13.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.284+0000 7f770dd9b640 1 --2- 172.21.15.170:0/4035144816 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76fc079e30 0x7f76fc07c2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f76f8005fd0 tx=0x7f76f8005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:13.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.287+0000 7f77077fe640 1 -- 172.21.15.170:0/4035144816 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f770803f070 con 0x7f77101007e0 2024-09-04T16:48:13.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.495+0000 7f7714964640 1 -- 172.21.15.170:0/4035144816 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7710109d60 con 0x7f77101007e0 2024-09-04T16:48:13.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:13 smithi170 ceph-mon[113855]: from='client.34838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:48:13.496 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:13 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2012411595' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:48:13.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.496+0000 7f77077fe640 1 -- 172.21.15.170:0/4035144816 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7f7708085250 con 0x7f77101007e0 2024-09-04T16:48:13.497 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:48:13.497 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:48:13.497 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:48:13.497 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:48:13.497 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:48:13.497 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:48:13.498 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:48:13.498 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:48:13.498 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:48:13.498 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:48:13.498 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:48:13.498 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:48:13.498 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:48:13.498 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:48:13.498 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:48:13.498 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:48:13.498 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:48:13.498 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:48:13.498 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:48:13.498 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:48:13.499 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:48:13.499 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:48:13.499 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:48:13.499 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:48:13.499 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:48:13.499 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:48:13.499 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:48:13.499 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:48:13.499 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:48:13.499 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:48:13.499 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:48:13.499 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:48:13.499 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:48:13.499 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:48:13.500 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:48:13.500 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:48:13.500 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:48:13.500 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:48:13.500 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:48:13.500 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:48:13.500 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:48:13.500 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:48:13.500 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:48:13.501 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:48:13.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.498+0000 7f7714964640 1 -- 172.21.15.170:0/4035144816 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76fc079e30 msgr2=0x7f76fc07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:13.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.498+0000 7f7714964640 1 --2- 172.21.15.170:0/4035144816 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76fc079e30 0x7f76fc07c2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f76f8005fd0 tx=0x7f76f8005850 comp rx=0 tx=0).stop 2024-09-04T16:48:13.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.498+0000 7f7714964640 1 -- 172.21.15.170:0/4035144816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77101007e0 msgr2=0x7f771019d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:13.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.498+0000 7f7714964640 1 --2- 172.21.15.170:0/4035144816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77101007e0 0x7f771019d650 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f770802ae90 tx=0x7f770802f5f0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.498+0000 7f7714964640 1 -- 172.21.15.170:0/4035144816 shutdown_connections 2024-09-04T16:48:13.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.498+0000 7f7714964640 1 --2- 172.21.15.170:0/4035144816 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f76fc079e30 0x7f76fc07c2f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.498+0000 7f7714964640 1 --2- 172.21.15.170:0/4035144816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77101067e0 0x7f771019db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.498+0000 7f7714964640 1 --2- 172.21.15.170:0/4035144816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77101007e0 0x7f771019d650 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.498+0000 7f7714964640 1 -- 172.21.15.170:0/4035144816 >> 172.21.15.170:0/4035144816 conn(0x7f77100fc4c0 msgr2=0x7f7710069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:13.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.498+0000 7f7714964640 1 -- 172.21.15.170:0/4035144816 shutdown_connections 2024-09-04T16:48:13.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.499+0000 7f7714964640 1 -- 172.21.15.170:0/4035144816 wait complete. 2024-09-04T16:48:13.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.580+0000 7f5e39fa3640 1 -- 172.21.15.170:0/2216744358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e34103400 msgr2=0x7f5e3410b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:13.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.580+0000 7f5e39fa3640 1 --2- 172.21.15.170:0/2216744358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e34103400 0x7f5e3410b8f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009880 tx=0x7f5e2802a530 comp rx=0 tx=0).stop 2024-09-04T16:48:13.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.580+0000 7f5e39fa3640 1 -- 172.21.15.170:0/2216744358 shutdown_connections 2024-09-04T16:48:13.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.580+0000 7f5e39fa3640 1 --2- 172.21.15.170:0/2216744358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e34103400 0x7f5e3410b8f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.580+0000 7f5e39fa3640 1 --2- 172.21.15.170:0/2216744358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e34102ae0 0x7f5e34102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.580+0000 7f5e39fa3640 1 -- 172.21.15.170:0/2216744358 >> 172.21.15.170:0/2216744358 conn(0x7f5e340fc520 msgr2=0x7f5e340fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:13.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.580+0000 7f5e39fa3640 1 -- 172.21.15.170:0/2216744358 shutdown_connections 2024-09-04T16:48:13.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.580+0000 7f5e39fa3640 1 -- 172.21.15.170:0/2216744358 wait complete. 2024-09-04T16:48:13.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.581+0000 7f5e39fa3640 1 Processor -- start 2024-09-04T16:48:13.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.581+0000 7f5e39fa3640 1 -- start start 2024-09-04T16:48:13.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.581+0000 7f5e39fa3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e34102ae0 0x7f5e3419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:13.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.581+0000 7f5e39fa3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e34103400 0x7f5e3419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:13.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.581+0000 7f5e39fa3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3410ee10 con 0x7f5e34102ae0 2024-09-04T16:48:13.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.581+0000 7f5e39fa3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3410ec90 con 0x7f5e34103400 2024-09-04T16:48:13.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.582+0000 7f5e337fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e34102ae0 0x7f5e3419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:13.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.582+0000 7f5e337fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e34102ae0 0x7f5e3419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53768/0 (socket says 172.21.15.170:53768) 2024-09-04T16:48:13.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.582+0000 7f5e337fe640 1 -- 172.21.15.170:0/1253692613 learned_addr learned my addr 172.21.15.170:0/1253692613 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:48:13.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.582+0000 7f5e32ffd640 1 --2- 172.21.15.170:0/1253692613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e34103400 0x7f5e3419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:13.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.582+0000 7f5e337fe640 1 -- 172.21.15.170:0/1253692613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e34103400 msgr2=0x7f5e3419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:13.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.582+0000 7f5e337fe640 1 --2- 172.21.15.170:0/1253692613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e34103400 0x7f5e3419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.582+0000 7f5e337fe640 1 -- 172.21.15.170:0/1253692613 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e34197820 con 0x7f5e34102ae0 2024-09-04T16:48:13.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.582+0000 7f5e337fe640 1 --2- 172.21.15.170:0/1253692613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e34102ae0 0x7f5e3419d6a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400d6f0 tx=0x7f5e2400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:13.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.582+0000 7f5e30ff9640 1 -- 172.21.15.170:0/1253692613 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e24017070 con 0x7f5e34102ae0 2024-09-04T16:48:13.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.582+0000 7f5e30ff9640 1 -- 172.21.15.170:0/1253692613 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5e2400de00 con 0x7f5e34102ae0 2024-09-04T16:48:13.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.582+0000 7f5e30ff9640 1 -- 172.21.15.170:0/1253692613 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e24004bb0 con 0x7f5e34102ae0 2024-09-04T16:48:13.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.582+0000 7f5e39fa3640 1 -- 172.21.15.170:0/1253692613 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e34197b10 con 0x7f5e34102ae0 2024-09-04T16:48:13.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.582+0000 7f5e39fa3640 1 -- 172.21.15.170:0/1253692613 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e34198070 con 0x7f5e34102ae0 2024-09-04T16:48:13.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.583+0000 7f5e39fa3640 1 -- 172.21.15.170:0/1253692613 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e3406abe0 con 0x7f5e34102ae0 2024-09-04T16:48:13.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.584+0000 7f5e30ff9640 1 -- 172.21.15.170:0/1253692613 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5e24004e60 con 0x7f5e34102ae0 2024-09-04T16:48:13.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.584+0000 7f5e30ff9640 1 --2- 172.21.15.170:0/1253692613 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5e1c079e30 0x7f5e1c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:13.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.585+0000 7f5e32ffd640 1 --2- 172.21.15.170:0/1253692613 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5e1c079e30 0x7f5e1c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:13.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.585+0000 7f5e30ff9640 1 -- 172.21.15.170:0/1253692613 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5e2409c680 con 0x7f5e34102ae0 2024-09-04T16:48:13.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.585+0000 7f5e32ffd640 1 --2- 172.21.15.170:0/1253692613 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5e1c079e30 0x7f5e1c07c2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5e34198b70 tx=0x7f5e28031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:13.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.589+0000 7f5e30ff9640 1 -- 172.21.15.170:0/1253692613 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5e24068200 con 0x7f5e34102ae0 2024-09-04T16:48:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:13 smithi193 ceph-mon[82547]: from='client.34838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:48:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:13 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2012411595' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:48:13.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.781+0000 7f5e39fa3640 1 -- 172.21.15.170:0/1253692613 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5e34198320 con 0x7f5e1c079e30 2024-09-04T16:48:13.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.782+0000 7f5e30ff9640 1 -- 172.21.15.170:0/1253692613 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5e34198320 con 0x7f5e1c079e30 2024-09-04T16:48:13.783 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:48:13.783 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:48:13.783 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:48:13.783 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:48:13.783 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:48:13.783 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:48:13.783 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:48:13.783 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:48:13.783 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:48:13.784 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:48:13.784 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:48:13.784 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:48:13.784 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:48:13.784 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:48:13.784 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:48:13.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.785+0000 7f5e39fa3640 1 -- 172.21.15.170:0/1253692613 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5e1c079e30 msgr2=0x7f5e1c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:13.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.785+0000 7f5e39fa3640 1 --2- 172.21.15.170:0/1253692613 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5e1c079e30 0x7f5e1c07c2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5e34198b70 tx=0x7f5e28031400 comp rx=0 tx=0).stop 2024-09-04T16:48:13.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.785+0000 7f5e39fa3640 1 -- 172.21.15.170:0/1253692613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e34102ae0 msgr2=0x7f5e3419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:13.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.785+0000 7f5e39fa3640 1 --2- 172.21.15.170:0/1253692613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e34102ae0 0x7f5e3419d6a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400d6f0 tx=0x7f5e2400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.785+0000 7f5e39fa3640 1 -- 172.21.15.170:0/1253692613 shutdown_connections 2024-09-04T16:48:13.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.785+0000 7f5e39fa3640 1 --2- 172.21.15.170:0/1253692613 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5e1c079e30 0x7f5e1c07c2f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.785+0000 7f5e39fa3640 1 --2- 172.21.15.170:0/1253692613 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e34103400 0x7f5e3419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.785+0000 7f5e39fa3640 1 --2- 172.21.15.170:0/1253692613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e34102ae0 0x7f5e3419d6a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.785+0000 7f5e39fa3640 1 -- 172.21.15.170:0/1253692613 >> 172.21.15.170:0/1253692613 conn(0x7f5e340fc520 msgr2=0x7f5e34108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:13.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.785+0000 7f5e39fa3640 1 -- 172.21.15.170:0/1253692613 shutdown_connections 2024-09-04T16:48:13.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.785+0000 7f5e39fa3640 1 -- 172.21.15.170:0/1253692613 wait complete. 2024-09-04T16:48:13.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.865+0000 7fda57050640 1 -- 172.21.15.170:0/4146688119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda50100820 msgr2=0x7fda50100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:13.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.865+0000 7fda57050640 1 --2- 172.21.15.170:0/4146688119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda50100820 0x7fda50100c80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fda44009880 tx=0x7fda4402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.866+0000 7fda57050640 1 -- 172.21.15.170:0/4146688119 shutdown_connections 2024-09-04T16:48:13.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.866+0000 7fda57050640 1 --2- 172.21.15.170:0/4146688119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda50100820 0x7fda50100c80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.866+0000 7fda57050640 1 --2- 172.21.15.170:0/4146688119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda50106820 0x7fda50106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.866+0000 7fda57050640 1 -- 172.21.15.170:0/4146688119 >> 172.21.15.170:0/4146688119 conn(0x7fda500fc520 msgr2=0x7fda500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:13.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.866+0000 7fda57050640 1 -- 172.21.15.170:0/4146688119 shutdown_connections 2024-09-04T16:48:13.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.866+0000 7fda57050640 1 -- 172.21.15.170:0/4146688119 wait complete. 2024-09-04T16:48:13.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.866+0000 7fda57050640 1 Processor -- start 2024-09-04T16:48:13.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.866+0000 7fda57050640 1 -- start start 2024-09-04T16:48:13.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.866+0000 7fda57050640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda50100820 0x7fda5019f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:13.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.866+0000 7fda57050640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda50106820 0x7fda5019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:13.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.866+0000 7fda57050640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fda5010dcf0 con 0x7fda50100820 2024-09-04T16:48:13.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.866+0000 7fda57050640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fda5010db70 con 0x7fda50106820 2024-09-04T16:48:13.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.866+0000 7fda54dec640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda50100820 0x7fda5019f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:13.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.867+0000 7fda54dec640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda50100820 0x7fda5019f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53786/0 (socket says 172.21.15.170:53786) 2024-09-04T16:48:13.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.867+0000 7fda54dec640 1 -- 172.21.15.170:0/2085620446 learned_addr learned my addr 172.21.15.170:0/2085620446 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:48:13.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.867+0000 7fda4ffff640 1 --2- 172.21.15.170:0/2085620446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda50106820 0x7fda5019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:13.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.867+0000 7fda54dec640 1 -- 172.21.15.170:0/2085620446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda50106820 msgr2=0x7fda5019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:13.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.867+0000 7fda54dec640 1 --2- 172.21.15.170:0/2085620446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda50106820 0x7fda5019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:13.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.867+0000 7fda54dec640 1 -- 172.21.15.170:0/2085620446 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda501999c0 con 0x7fda50100820 2024-09-04T16:48:13.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.867+0000 7fda4ffff640 1 --2- 172.21.15.170:0/2085620446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda50106820 0x7fda5019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:48:13.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.867+0000 7fda54dec640 1 --2- 172.21.15.170:0/2085620446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda50100820 0x7fda5019f800 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fda4000d6f0 tx=0x7fda4000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:13.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.867+0000 7fda4dffb640 1 -- 172.21.15.170:0/2085620446 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda40017070 con 0x7fda50100820 2024-09-04T16:48:13.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.867+0000 7fda4dffb640 1 -- 172.21.15.170:0/2085620446 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda4000de00 con 0x7fda50100820 2024-09-04T16:48:13.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.867+0000 7fda57050640 1 -- 172.21.15.170:0/2085620446 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda50199cb0 con 0x7fda50100820 2024-09-04T16:48:13.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.867+0000 7fda4dffb640 1 -- 172.21.15.170:0/2085620446 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda40004bb0 con 0x7fda50100820 2024-09-04T16:48:13.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.867+0000 7fda57050640 1 -- 172.21.15.170:0/2085620446 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda5019a210 con 0x7fda50100820 2024-09-04T16:48:13.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.868+0000 7fda57050640 1 -- 172.21.15.170:0/2085620446 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda50101f60 con 0x7fda50100820 2024-09-04T16:48:13.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.869+0000 7fda4dffb640 1 -- 172.21.15.170:0/2085620446 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fda40004e60 con 0x7fda50100820 2024-09-04T16:48:13.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.869+0000 7fda4dffb640 1 --2- 172.21.15.170:0/2085620446 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fda38079e30 0x7fda3807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:13.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.869+0000 7fda4dffb640 1 -- 172.21.15.170:0/2085620446 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fda4009c730 con 0x7fda50100820 2024-09-04T16:48:13.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.870+0000 7fda4ffff640 1 --2- 172.21.15.170:0/2085620446 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fda38079e30 0x7fda3807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:13.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.870+0000 7fda4ffff640 1 --2- 172.21.15.170:0/2085620446 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fda38079e30 0x7fda3807c2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fda5019b1b0 tx=0x7fda44031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:13.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:13.874+0000 7fda4dffb640 1 -- 172.21.15.170:0/2085620446 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fda40064140 con 0x7fda50100820 2024-09-04T16:48:14.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:14.114+0000 7fda57050640 1 -- 172.21.15.170:0/2085620446 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fda5019a4c0 con 0x7fda50100820 2024-09-04T16:48:14.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:14.115+0000 7fda4dffb640 1 -- 172.21.15.170:0/2085620446 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fda400682b0 con 0x7fda50100820 2024-09-04T16:48:14.116 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:48:14.116 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:48:14.116 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:48:14.116 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:48:14.116 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:48:14.116 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:48:14.116 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:48:14.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:14.117+0000 7fda57050640 1 -- 172.21.15.170:0/2085620446 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fda38079e30 msgr2=0x7fda3807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:14.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:14.117+0000 7fda57050640 1 --2- 172.21.15.170:0/2085620446 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fda38079e30 0x7fda3807c2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fda5019b1b0 tx=0x7fda44031400 comp rx=0 tx=0).stop 2024-09-04T16:48:14.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:14.117+0000 7fda57050640 1 -- 172.21.15.170:0/2085620446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda50100820 msgr2=0x7fda5019f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:14.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:14.117+0000 7fda57050640 1 --2- 172.21.15.170:0/2085620446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda50100820 0x7fda5019f800 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fda4000d6f0 tx=0x7fda4000dbb0 comp rx=0 tx=0).stop 2024-09-04T16:48:14.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:14.117+0000 7fda57050640 1 -- 172.21.15.170:0/2085620446 shutdown_connections 2024-09-04T16:48:14.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:14.117+0000 7fda57050640 1 --2- 172.21.15.170:0/2085620446 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fda38079e30 0x7fda3807c2f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:14.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:14.117+0000 7fda57050640 1 --2- 172.21.15.170:0/2085620446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda50106820 0x7fda5019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:14.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:14.117+0000 7fda57050640 1 --2- 172.21.15.170:0/2085620446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda50100820 0x7fda5019f800 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:14.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:14.117+0000 7fda57050640 1 -- 172.21.15.170:0/2085620446 >> 172.21.15.170:0/2085620446 conn(0x7fda500fc520 msgr2=0x7fda500fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:14.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:14.118+0000 7fda57050640 1 -- 172.21.15.170:0/2085620446 shutdown_connections 2024-09-04T16:48:14.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:14.118+0000 7fda57050640 1 -- 172.21.15.170:0/2085620446 wait complete. 2024-09-04T16:48:14.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:14 smithi170 ceph-mon[113855]: pgmap v555: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:14 smithi170 ceph-mon[113855]: from='client.34842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:48:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:14 smithi170 ceph-mon[113855]: from='client.34846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:48:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:14 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/4035144816' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:48:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:14 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2085620446' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:48:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:48:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:14 smithi193 ceph-mon[82547]: pgmap v555: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:14 smithi193 ceph-mon[82547]: from='client.34842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:48:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:14 smithi193 ceph-mon[82547]: from='client.34846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:48:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:14 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/4035144816' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:48:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:14 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2085620446' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:48:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:48:15.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:15 smithi170 ceph-mon[113855]: from='client.34858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:48:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:15 smithi193 ceph-mon[82547]: from='client.34858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:48:16.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:16 smithi170 ceph-mon[113855]: pgmap v556: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:16 smithi193 ceph-mon[82547]: pgmap v556: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:18.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:18 smithi170 ceph-mon[113855]: pgmap v557: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:18 smithi193 ceph-mon[82547]: pgmap v557: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:20.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:20 smithi170 ceph-mon[113855]: pgmap v558: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:20.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:20 smithi193 ceph-mon[82547]: pgmap v558: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:22.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:22 smithi170 ceph-mon[113855]: pgmap v559: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:22 smithi193 ceph-mon[82547]: pgmap v559: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:24.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:24 smithi170 ceph-mon[113855]: pgmap v560: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:24.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:24 smithi193 ceph-mon[82547]: pgmap v560: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:26.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:26 smithi170 ceph-mon[113855]: pgmap v561: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:26 smithi193 ceph-mon[82547]: pgmap v561: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:28.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:28 smithi170 ceph-mon[113855]: pgmap v562: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:28.644 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:28 smithi193 ceph-mon[82547]: pgmap v562: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:29.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:48:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:48:30.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:30 smithi170 ceph-mon[113855]: pgmap v563: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:30 smithi193 ceph-mon[82547]: pgmap v563: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:32.571 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:32 smithi170 ceph-mon[113855]: pgmap v564: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:32.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:32 smithi193 ceph-mon[82547]: pgmap v564: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:34.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:34 smithi170 ceph-mon[113855]: pgmap v565: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:34 smithi193 ceph-mon[82547]: pgmap v565: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:36.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:36 smithi170 ceph-mon[113855]: pgmap v566: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:36.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:36 smithi193 ceph-mon[82547]: pgmap v566: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:38.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:38 smithi170 ceph-mon[113855]: pgmap v567: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:38.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:38 smithi193 ceph-mon[82547]: pgmap v567: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:40.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:40 smithi170 ceph-mon[113855]: pgmap v568: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:40.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:40 smithi193 ceph-mon[82547]: pgmap v568: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:42.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:42 smithi170 ceph-mon[113855]: pgmap v569: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:42.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:42 smithi193 ceph-mon[82547]: pgmap v569: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:44.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.213+0000 7fea7166b640 1 -- 172.21.15.170:0/3660426623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea6c102ae0 msgr2=0x7fea6c102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:44.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.213+0000 7fea7166b640 1 --2- 172.21.15.170:0/3660426623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea6c102ae0 0x7fea6c102ec0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009880 tx=0x7fea5c02a530 comp rx=0 tx=0).stop 2024-09-04T16:48:44.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.213+0000 7fea7166b640 1 -- 172.21.15.170:0/3660426623 shutdown_connections 2024-09-04T16:48:44.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.213+0000 7fea7166b640 1 --2- 172.21.15.170:0/3660426623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea6c103400 0x7fea6c10b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.214+0000 7fea7166b640 1 --2- 172.21.15.170:0/3660426623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea6c102ae0 0x7fea6c102ec0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.214+0000 7fea7166b640 1 -- 172.21.15.170:0/3660426623 >> 172.21.15.170:0/3660426623 conn(0x7fea6c0fc520 msgr2=0x7fea6c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:44.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.214+0000 7fea7166b640 1 -- 172.21.15.170:0/3660426623 shutdown_connections 2024-09-04T16:48:44.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.214+0000 7fea7166b640 1 -- 172.21.15.170:0/3660426623 wait complete. 2024-09-04T16:48:44.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.214+0000 7fea7166b640 1 Processor -- start 2024-09-04T16:48:44.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.214+0000 7fea7166b640 1 -- start start 2024-09-04T16:48:44.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.215+0000 7fea7166b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea6c102ae0 0x7fea6c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:44.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.215+0000 7fea7166b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea6c103400 0x7fea6c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:44.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.215+0000 7fea7166b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c10edf0 con 0x7fea6c103400 2024-09-04T16:48:44.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.215+0000 7fea7166b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c10ec70 con 0x7fea6c102ae0 2024-09-04T16:48:44.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.215+0000 7fea6a7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea6c103400 0x7fea6c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:44.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.215+0000 7fea6a7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea6c103400 0x7fea6c19dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33232/0 (socket says 172.21.15.170:33232) 2024-09-04T16:48:44.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.215+0000 7fea6a7fc640 1 -- 172.21.15.170:0/3288943975 learned_addr learned my addr 172.21.15.170:0/3288943975 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:48:44.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.215+0000 7fea6affd640 1 --2- 172.21.15.170:0/3288943975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea6c102ae0 0x7fea6c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:44.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.215+0000 7fea6a7fc640 1 -- 172.21.15.170:0/3288943975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea6c102ae0 msgr2=0x7fea6c19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:44.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.215+0000 7fea6a7fc640 1 --2- 172.21.15.170:0/3288943975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea6c102ae0 0x7fea6c19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.215+0000 7fea6a7fc640 1 -- 172.21.15.170:0/3288943975 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6c1977e0 con 0x7fea6c103400 2024-09-04T16:48:44.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.215+0000 7fea6affd640 1 --2- 172.21.15.170:0/3288943975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea6c102ae0 0x7fea6c19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:48:44.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.215+0000 7fea6a7fc640 1 --2- 172.21.15.170:0/3288943975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea6c103400 0x7fea6c19dba0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fea6000d6c0 tx=0x7fea6000db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:44.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.216+0000 7fea53fff640 1 -- 172.21.15.170:0/3288943975 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea60017070 con 0x7fea6c103400 2024-09-04T16:48:44.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.216+0000 7fea7166b640 1 -- 172.21.15.170:0/3288943975 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea6c197ad0 con 0x7fea6c103400 2024-09-04T16:48:44.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.216+0000 7fea53fff640 1 -- 172.21.15.170:0/3288943975 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea60009ce0 con 0x7fea6c103400 2024-09-04T16:48:44.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.216+0000 7fea53fff640 1 -- 172.21.15.170:0/3288943975 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea6000f3c0 con 0x7fea6c103400 2024-09-04T16:48:44.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.216+0000 7fea7166b640 1 -- 172.21.15.170:0/3288943975 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea6c198060 con 0x7fea6c103400 2024-09-04T16:48:44.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.217+0000 7fea7166b640 1 -- 172.21.15.170:0/3288943975 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea6c06abe0 con 0x7fea6c103400 2024-09-04T16:48:44.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.217+0000 7fea53fff640 1 -- 172.21.15.170:0/3288943975 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fea60010460 con 0x7fea6c103400 2024-09-04T16:48:44.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.218+0000 7fea53fff640 1 --2- 172.21.15.170:0/3288943975 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fea54079e30 0x7fea5407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:44.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.218+0000 7fea6affd640 1 --2- 172.21.15.170:0/3288943975 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fea54079e30 0x7fea5407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:44.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.218+0000 7fea53fff640 1 -- 172.21.15.170:0/3288943975 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fea6009c930 con 0x7fea6c103400 2024-09-04T16:48:44.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.219+0000 7fea6affd640 1 --2- 172.21.15.170:0/3288943975 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fea54079e30 0x7fea5407c2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fea5c000c00 tx=0x7fea5c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:44.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.223+0000 7fea53fff640 1 -- 172.21.15.170:0/3288943975 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fea600642a0 con 0x7fea6c103400 2024-09-04T16:48:44.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.417+0000 7fea7166b640 1 -- 172.21.15.170:0/3288943975 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fea6c198310 con 0x7fea54079e30 2024-09-04T16:48:44.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.419+0000 7fea53fff640 1 -- 172.21.15.170:0/3288943975 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fea6c198310 con 0x7fea54079e30 2024-09-04T16:48:44.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.421+0000 7fea7166b640 1 -- 172.21.15.170:0/3288943975 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fea54079e30 msgr2=0x7fea5407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:44.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.421+0000 7fea7166b640 1 --2- 172.21.15.170:0/3288943975 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fea54079e30 0x7fea5407c2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fea5c000c00 tx=0x7fea5c031400 comp rx=0 tx=0).stop 2024-09-04T16:48:44.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.421+0000 7fea7166b640 1 -- 172.21.15.170:0/3288943975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea6c103400 msgr2=0x7fea6c19dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:44.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.421+0000 7fea7166b640 1 --2- 172.21.15.170:0/3288943975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea6c103400 0x7fea6c19dba0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fea6000d6c0 tx=0x7fea6000db80 comp rx=0 tx=0).stop 2024-09-04T16:48:44.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.421+0000 7fea7166b640 1 -- 172.21.15.170:0/3288943975 shutdown_connections 2024-09-04T16:48:44.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.421+0000 7fea7166b640 1 --2- 172.21.15.170:0/3288943975 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fea54079e30 0x7fea5407c2f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.421+0000 7fea7166b640 1 --2- 172.21.15.170:0/3288943975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea6c103400 0x7fea6c19dba0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.421+0000 7fea7166b640 1 --2- 172.21.15.170:0/3288943975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea6c102ae0 0x7fea6c19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.421+0000 7fea7166b640 1 -- 172.21.15.170:0/3288943975 >> 172.21.15.170:0/3288943975 conn(0x7fea6c0fc520 msgr2=0x7fea6c108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:44.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.421+0000 7fea7166b640 1 -- 172.21.15.170:0/3288943975 shutdown_connections 2024-09-04T16:48:44.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.421+0000 7fea7166b640 1 -- 172.21.15.170:0/3288943975 wait complete. 2024-09-04T16:48:44.431 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:48:44.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.503+0000 7ff19401f640 1 -- 172.21.15.170:0/2915792877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff18c103400 msgr2=0x7ff18c10b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:44.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.503+0000 7ff19401f640 1 --2- 172.21.15.170:0/2915792877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff18c103400 0x7ff18c10b8f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff180009880 tx=0x7ff18002a530 comp rx=0 tx=0).stop 2024-09-04T16:48:44.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.503+0000 7ff19401f640 1 -- 172.21.15.170:0/2915792877 shutdown_connections 2024-09-04T16:48:44.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.503+0000 7ff19401f640 1 --2- 172.21.15.170:0/2915792877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff18c103400 0x7ff18c10b8f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.503+0000 7ff19401f640 1 --2- 172.21.15.170:0/2915792877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff18c102ae0 0x7ff18c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.503+0000 7ff19401f640 1 -- 172.21.15.170:0/2915792877 >> 172.21.15.170:0/2915792877 conn(0x7ff18c0fc520 msgr2=0x7ff18c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:44.505 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:44 smithi170 ceph-mon[113855]: pgmap v570: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:44.505 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:48:44.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.503+0000 7ff19401f640 1 -- 172.21.15.170:0/2915792877 shutdown_connections 2024-09-04T16:48:44.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.503+0000 7ff19401f640 1 -- 172.21.15.170:0/2915792877 wait complete. 2024-09-04T16:48:44.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.504+0000 7ff19401f640 1 Processor -- start 2024-09-04T16:48:44.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.504+0000 7ff19401f640 1 -- start start 2024-09-04T16:48:44.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.504+0000 7ff19401f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff18c102ae0 0x7ff18c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:44.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.504+0000 7ff19401f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff18c103400 0x7ff18c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:44.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.504+0000 7ff19401f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c10ee10 con 0x7ff18c102ae0 2024-09-04T16:48:44.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.504+0000 7ff19401f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c10ec90 con 0x7ff18c103400 2024-09-04T16:48:44.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.505+0000 7ff191dbb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff18c102ae0 0x7ff18c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:44.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.505+0000 7ff191dbb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff18c102ae0 0x7ff18c19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33252/0 (socket says 172.21.15.170:33252) 2024-09-04T16:48:44.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.505+0000 7ff191dbb640 1 -- 172.21.15.170:0/3653070218 learned_addr learned my addr 172.21.15.170:0/3653070218 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:48:44.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.505+0000 7ff1915ba640 1 --2- 172.21.15.170:0/3653070218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff18c103400 0x7ff18c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:44.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.505+0000 7ff191dbb640 1 -- 172.21.15.170:0/3653070218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff18c103400 msgr2=0x7ff18c19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:44.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.505+0000 7ff191dbb640 1 --2- 172.21.15.170:0/3653070218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff18c103400 0x7ff18c19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.505+0000 7ff191dbb640 1 -- 172.21.15.170:0/3653070218 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18c197820 con 0x7ff18c102ae0 2024-09-04T16:48:44.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.505+0000 7ff191dbb640 1 --2- 172.21.15.170:0/3653070218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff18c102ae0 0x7ff18c19d6a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff18800d6f0 tx=0x7ff18800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:44.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.505+0000 7ff17effd640 1 -- 172.21.15.170:0/3653070218 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff188017070 con 0x7ff18c102ae0 2024-09-04T16:48:44.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.505+0000 7ff17effd640 1 -- 172.21.15.170:0/3653070218 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff18800de00 con 0x7ff18c102ae0 2024-09-04T16:48:44.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.505+0000 7ff17effd640 1 -- 172.21.15.170:0/3653070218 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff188004bb0 con 0x7ff18c102ae0 2024-09-04T16:48:44.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.505+0000 7ff19401f640 1 -- 172.21.15.170:0/3653070218 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18c197b10 con 0x7ff18c102ae0 2024-09-04T16:48:44.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.506+0000 7ff19401f640 1 -- 172.21.15.170:0/3653070218 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff18c198070 con 0x7ff18c102ae0 2024-09-04T16:48:44.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.507+0000 7ff19401f640 1 -- 172.21.15.170:0/3653070218 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff18c06abe0 con 0x7ff18c102ae0 2024-09-04T16:48:44.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.507+0000 7ff17effd640 1 -- 172.21.15.170:0/3653070218 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ff188009a30 con 0x7ff18c102ae0 2024-09-04T16:48:44.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.508+0000 7ff17effd640 1 --2- 172.21.15.170:0/3653070218 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff178079e80 0x7ff17807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:44.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.508+0000 7ff17effd640 1 -- 172.21.15.170:0/3653070218 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff18809c560 con 0x7ff18c102ae0 2024-09-04T16:48:44.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.508+0000 7ff1915ba640 1 --2- 172.21.15.170:0/3653070218 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff178079e80 0x7ff17807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:44.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.508+0000 7ff1915ba640 1 --2- 172.21.15.170:0/3653070218 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff178079e80 0x7ff17807c340 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff18c198b70 tx=0x7ff180031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:44.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.512+0000 7ff17effd640 1 -- 172.21.15.170:0/3653070218 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff188068160 con 0x7ff18c102ae0 2024-09-04T16:48:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:44 smithi193 ceph-mon[82547]: pgmap v570: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:44.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:48:44.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.706+0000 7ff19401f640 1 -- 172.21.15.170:0/3653070218 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff18c1983e0 con 0x7ff178079e80 2024-09-04T16:48:44.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.707+0000 7ff17effd640 1 -- 172.21.15.170:0/3653070218 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff18c1983e0 con 0x7ff178079e80 2024-09-04T16:48:44.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.709+0000 7ff19401f640 1 -- 172.21.15.170:0/3653070218 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff178079e80 msgr2=0x7ff17807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:44.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.709+0000 7ff19401f640 1 --2- 172.21.15.170:0/3653070218 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff178079e80 0x7ff17807c340 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff18c198b70 tx=0x7ff180031400 comp rx=0 tx=0).stop 2024-09-04T16:48:44.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.709+0000 7ff19401f640 1 -- 172.21.15.170:0/3653070218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff18c102ae0 msgr2=0x7ff18c19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:44.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.709+0000 7ff19401f640 1 --2- 172.21.15.170:0/3653070218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff18c102ae0 0x7ff18c19d6a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff18800d6f0 tx=0x7ff18800dbb0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.709+0000 7ff19401f640 1 -- 172.21.15.170:0/3653070218 shutdown_connections 2024-09-04T16:48:44.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.709+0000 7ff19401f640 1 --2- 172.21.15.170:0/3653070218 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff178079e80 0x7ff17807c340 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.709+0000 7ff19401f640 1 --2- 172.21.15.170:0/3653070218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff18c103400 0x7ff18c19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.709+0000 7ff19401f640 1 --2- 172.21.15.170:0/3653070218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff18c102ae0 0x7ff18c19d6a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.709+0000 7ff19401f640 1 -- 172.21.15.170:0/3653070218 >> 172.21.15.170:0/3653070218 conn(0x7ff18c0fc520 msgr2=0x7ff18c108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:44.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.709+0000 7ff19401f640 1 -- 172.21.15.170:0/3653070218 shutdown_connections 2024-09-04T16:48:44.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.709+0000 7ff19401f640 1 -- 172.21.15.170:0/3653070218 wait complete. 2024-09-04T16:48:44.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.790+0000 7f4d40ed6640 1 -- 172.21.15.170:0/1644953062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d3c107930 msgr2=0x7f4d3c107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:44.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.790+0000 7f4d40ed6640 1 --2- 172.21.15.170:0/1644953062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d3c107930 0x7f4d3c107d10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009880 tx=0x7f4d2c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.790+0000 7f4d40ed6640 1 -- 172.21.15.170:0/1644953062 shutdown_connections 2024-09-04T16:48:44.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.790+0000 7f4d40ed6640 1 --2- 172.21.15.170:0/1644953062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d3c101930 0x7f4d3c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.790+0000 7f4d40ed6640 1 --2- 172.21.15.170:0/1644953062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d3c107930 0x7f4d3c107d10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.790+0000 7f4d40ed6640 1 -- 172.21.15.170:0/1644953062 >> 172.21.15.170:0/1644953062 conn(0x7f4d3c0fd630 msgr2=0x7f4d3c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:44.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.790+0000 7f4d40ed6640 1 -- 172.21.15.170:0/1644953062 shutdown_connections 2024-09-04T16:48:44.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.790+0000 7f4d40ed6640 1 -- 172.21.15.170:0/1644953062 wait complete. 2024-09-04T16:48:44.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.791+0000 7f4d40ed6640 1 Processor -- start 2024-09-04T16:48:44.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.791+0000 7f4d40ed6640 1 -- start start 2024-09-04T16:48:44.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.791+0000 7f4d40ed6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d3c101930 0x7f4d3c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:44.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.791+0000 7f4d40ed6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d3c107930 0x7f4d3c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:44.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.791+0000 7f4d40ed6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c10ede0 con 0x7f4d3c107930 2024-09-04T16:48:44.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.791+0000 7f4d40ed6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c10ec60 con 0x7f4d3c101930 2024-09-04T16:48:44.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.791+0000 7f4d39d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d3c107930 0x7f4d3c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:44.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.791+0000 7f4d39d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d3c107930 0x7f4d3c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33270/0 (socket says 172.21.15.170:33270) 2024-09-04T16:48:44.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.791+0000 7f4d39d9b640 1 -- 172.21.15.170:0/4114851417 learned_addr learned my addr 172.21.15.170:0/4114851417 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:48:44.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.791+0000 7f4d3a59c640 1 --2- 172.21.15.170:0/4114851417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d3c101930 0x7f4d3c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:44.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.792+0000 7f4d39d9b640 1 -- 172.21.15.170:0/4114851417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d3c101930 msgr2=0x7f4d3c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:44.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.792+0000 7f4d39d9b640 1 --2- 172.21.15.170:0/4114851417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d3c101930 0x7f4d3c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.792+0000 7f4d39d9b640 1 -- 172.21.15.170:0/4114851417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3c074f70 con 0x7f4d3c107930 2024-09-04T16:48:44.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.792+0000 7f4d39d9b640 1 --2- 172.21.15.170:0/4114851417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d3c107930 0x7f4d3c074a30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000c810 tx=0x7f4d3000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:44.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.792+0000 7f4d2b7fe640 1 -- 172.21.15.170:0/4114851417 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d30004020 con 0x7f4d3c107930 2024-09-04T16:48:44.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.792+0000 7f4d40ed6640 1 -- 172.21.15.170:0/4114851417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d3c075260 con 0x7f4d3c107930 2024-09-04T16:48:44.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.792+0000 7f4d2b7fe640 1 -- 172.21.15.170:0/4114851417 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4d300041c0 con 0x7f4d3c107930 2024-09-04T16:48:44.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.792+0000 7f4d40ed6640 1 -- 172.21.15.170:0/4114851417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d3c1a3e50 con 0x7f4d3c107930 2024-09-04T16:48:44.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.792+0000 7f4d2b7fe640 1 -- 172.21.15.170:0/4114851417 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d300047a0 con 0x7f4d3c107930 2024-09-04T16:48:44.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.793+0000 7f4d40ed6640 1 -- 172.21.15.170:0/4114851417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d3c103070 con 0x7f4d3c107930 2024-09-04T16:48:44.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.794+0000 7f4d2b7fe640 1 -- 172.21.15.170:0/4114851417 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f4d300079b0 con 0x7f4d3c107930 2024-09-04T16:48:44.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.794+0000 7f4d2b7fe640 1 --2- 172.21.15.170:0/4114851417 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4d24079e90 0x7f4d2407c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:44.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.794+0000 7f4d2b7fe640 1 -- 172.21.15.170:0/4114851417 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4d3009c880 con 0x7f4d3c107930 2024-09-04T16:48:44.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.794+0000 7f4d3a59c640 1 --2- 172.21.15.170:0/4114851417 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4d24079e90 0x7f4d2407c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:44.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.795+0000 7f4d3a59c640 1 --2- 172.21.15.170:0/4114851417 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4d24079e90 0x7f4d2407c350 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c000c00 tx=0x7f4d2c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:44.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.799+0000 7f4d2b7fe640 1 -- 172.21.15.170:0/4114851417 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4d30014030 con 0x7f4d3c107930 2024-09-04T16:48:44.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.979+0000 7f4d40ed6640 1 -- 172.21.15.170:0/4114851417 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4d3c062630 con 0x7f4d24079e90 2024-09-04T16:48:44.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.988+0000 7f4d2b7fe640 1 -- 172.21.15.170:0/4114851417 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f4d3c062630 con 0x7f4d24079e90 2024-09-04T16:48:44.989 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:48:44.989 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (15m) 9m ago 26m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:48:44.989 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (18m) 9m ago 26m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:48:44.989 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (18m) 9m ago 25m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:48:44.990 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (13m) 9m ago 26m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:48:44.990 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (13m) 9m ago 25m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:48:44.990 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (15m) 9m ago 26m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:48:44.990 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (10m) 9m ago 21m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:48:44.990 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (10m) 9m ago 21m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:48:44.990 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (9m) 9m ago 21m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:48:44.990 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (9m) 9m ago 21m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:48:44.990 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (17m) 9m ago 27m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:48:44.990 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (16m) 9m ago 25m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:48:44.990 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (14m) 9m ago 27m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:48:44.990 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (14m) 9m ago 25m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:48:44.990 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (16m) 9m ago 26m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:48:44.990 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (16m) 9m ago 25m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:48:44.990 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (13m) 9m ago 24m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:48:44.991 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (12m) 9m ago 24m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:48:44.991 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (12m) 9m ago 23m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:48:44.991 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (11m) 9m ago 23m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:48:44.991 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (11m) 9m ago 22m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:48:44.991 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (10m) 9m ago 22m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:48:44.991 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (16m) 9m ago 26m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:48:44.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.991+0000 7f4d40ed6640 1 -- 172.21.15.170:0/4114851417 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4d24079e90 msgr2=0x7f4d2407c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:44.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.991+0000 7f4d40ed6640 1 --2- 172.21.15.170:0/4114851417 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4d24079e90 0x7f4d2407c350 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c000c00 tx=0x7f4d2c031400 comp rx=0 tx=0).stop 2024-09-04T16:48:44.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.991+0000 7f4d40ed6640 1 -- 172.21.15.170:0/4114851417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d3c107930 msgr2=0x7f4d3c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:44.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.991+0000 7f4d40ed6640 1 --2- 172.21.15.170:0/4114851417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d3c107930 0x7f4d3c074a30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000c810 tx=0x7f4d3000ccd0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.991+0000 7f4d40ed6640 1 -- 172.21.15.170:0/4114851417 shutdown_connections 2024-09-04T16:48:44.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.991+0000 7f4d40ed6640 1 --2- 172.21.15.170:0/4114851417 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4d24079e90 0x7f4d2407c350 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.991+0000 7f4d40ed6640 1 --2- 172.21.15.170:0/4114851417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d3c107930 0x7f4d3c074a30 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.991+0000 7f4d40ed6640 1 --2- 172.21.15.170:0/4114851417 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d3c101930 0x7f4d3c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:44.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.991+0000 7f4d40ed6640 1 -- 172.21.15.170:0/4114851417 >> 172.21.15.170:0/4114851417 conn(0x7f4d3c0fd630 msgr2=0x7f4d3c0fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:44.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.991+0000 7f4d40ed6640 1 -- 172.21.15.170:0/4114851417 shutdown_connections 2024-09-04T16:48:44.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:44.991+0000 7f4d40ed6640 1 -- 172.21.15.170:0/4114851417 wait complete. 2024-09-04T16:48:45.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.071+0000 7fa0b6afc640 1 -- 172.21.15.170:0/110357328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b0106820 msgr2=0x7fa0b0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:45.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.071+0000 7fa0b6afc640 1 --2- 172.21.15.170:0/110357328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b0106820 0x7fa0b0106c00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009880 tx=0x7fa0a802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.071+0000 7fa0b6afc640 1 -- 172.21.15.170:0/110357328 shutdown_connections 2024-09-04T16:48:45.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.071+0000 7fa0b6afc640 1 --2- 172.21.15.170:0/110357328 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0b0100820 0x7fa0b0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.071+0000 7fa0b6afc640 1 --2- 172.21.15.170:0/110357328 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b0106820 0x7fa0b0106c00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.071+0000 7fa0b6afc640 1 -- 172.21.15.170:0/110357328 >> 172.21.15.170:0/110357328 conn(0x7fa0b00fc520 msgr2=0x7fa0b00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:45.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.071+0000 7fa0b6afc640 1 -- 172.21.15.170:0/110357328 shutdown_connections 2024-09-04T16:48:45.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.071+0000 7fa0b6afc640 1 -- 172.21.15.170:0/110357328 wait complete. 2024-09-04T16:48:45.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.072+0000 7fa0b6afc640 1 Processor -- start 2024-09-04T16:48:45.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.072+0000 7fa0b6afc640 1 -- start start 2024-09-04T16:48:45.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.072+0000 7fa0b6afc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b0100820 0x7fa0b01987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:45.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.072+0000 7fa0b6afc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0b0106820 0x7fa0b0198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:45.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.072+0000 7fa0b6afc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b010dcd0 con 0x7fa0b0100820 2024-09-04T16:48:45.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.072+0000 7fa0b6afc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b010db50 con 0x7fa0b0106820 2024-09-04T16:48:45.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.072+0000 7fa0b4898640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b0100820 0x7fa0b01987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:45.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.072+0000 7fa0b4898640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b0100820 0x7fa0b01987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57920/0 (socket says 172.21.15.170:57920) 2024-09-04T16:48:45.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.072+0000 7fa0b4898640 1 -- 172.21.15.170:0/1292777333 learned_addr learned my addr 172.21.15.170:0/1292777333 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:48:45.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.072+0000 7fa0affff640 1 --2- 172.21.15.170:0/1292777333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0b0106820 0x7fa0b0198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:45.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.072+0000 7fa0b4898640 1 -- 172.21.15.170:0/1292777333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0b0106820 msgr2=0x7fa0b0198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:45.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.073+0000 7fa0b4898640 1 --2- 172.21.15.170:0/1292777333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0b0106820 0x7fa0b0198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.073+0000 7fa0b4898640 1 -- 172.21.15.170:0/1292777333 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b0199290 con 0x7fa0b0100820 2024-09-04T16:48:45.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.073+0000 7fa0b4898640 1 --2- 172.21.15.170:0/1292777333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b0100820 0x7fa0b01987e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8031460 tx=0x7fa0a80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:45.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.073+0000 7fa0adffb640 1 -- 172.21.15.170:0/1292777333 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0a803f070 con 0x7fa0b0100820 2024-09-04T16:48:45.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.073+0000 7fa0adffb640 1 -- 172.21.15.170:0/1292777333 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa0a8004cf0 con 0x7fa0b0100820 2024-09-04T16:48:45.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.073+0000 7fa0b6afc640 1 -- 172.21.15.170:0/1292777333 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b0199520 con 0x7fa0b0100820 2024-09-04T16:48:45.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.073+0000 7fa0adffb640 1 -- 172.21.15.170:0/1292777333 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0a8035030 con 0x7fa0b0100820 2024-09-04T16:48:45.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.073+0000 7fa0b6afc640 1 -- 172.21.15.170:0/1292777333 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b01a1ad0 con 0x7fa0b0100820 2024-09-04T16:48:45.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.074+0000 7fa0b6afc640 1 -- 172.21.15.170:0/1292777333 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b0101f60 con 0x7fa0b0100820 2024-09-04T16:48:45.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.075+0000 7fa0adffb640 1 -- 172.21.15.170:0/1292777333 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fa0a8042070 con 0x7fa0b0100820 2024-09-04T16:48:45.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.075+0000 7fa0adffb640 1 --2- 172.21.15.170:0/1292777333 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa09c079e80 0x7fa09c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:45.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.075+0000 7fa0adffb640 1 -- 172.21.15.170:0/1292777333 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa0a80bd4b0 con 0x7fa0b0100820 2024-09-04T16:48:45.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.076+0000 7fa0affff640 1 --2- 172.21.15.170:0/1292777333 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa09c079e80 0x7fa09c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:45.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.076+0000 7fa0affff640 1 --2- 172.21.15.170:0/1292777333 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa09c079e80 0x7fa09c07c340 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0007350 tx=0x7fa0a00072e0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:45.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.080+0000 7fa0adffb640 1 -- 172.21.15.170:0/1292777333 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa0a8084f40 con 0x7fa0b0100820 2024-09-04T16:48:45.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.342+0000 7fa0b6afc640 1 -- 172.21.15.170:0/1292777333 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa0b0103a30 con 0x7fa0b0100820 2024-09-04T16:48:45.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.343+0000 7fa0adffb640 1 -- 172.21.15.170:0/1292777333 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fa0a80890b0 con 0x7fa0b0100820 2024-09-04T16:48:45.344 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:48:45.344 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:48:45.344 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:48:45.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:48:45.344 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:48:45.344 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:48:45.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:48:45.344 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:48:45.344 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:48:45.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:48:45.344 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:48:45.344 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:48:45.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:48:45.345 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:48:45.345 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:48:45.345 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:48:45.345 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:48:45.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.345+0000 7fa0b6afc640 1 -- 172.21.15.170:0/1292777333 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa09c079e80 msgr2=0x7fa09c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:45.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.345+0000 7fa0b6afc640 1 --2- 172.21.15.170:0/1292777333 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa09c079e80 0x7fa09c07c340 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0007350 tx=0x7fa0a00072e0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.345+0000 7fa0b6afc640 1 -- 172.21.15.170:0/1292777333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b0100820 msgr2=0x7fa0b01987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:45.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.345+0000 7fa0b6afc640 1 --2- 172.21.15.170:0/1292777333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b0100820 0x7fa0b01987e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8031460 tx=0x7fa0a80048f0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.345+0000 7fa0b6afc640 1 -- 172.21.15.170:0/1292777333 shutdown_connections 2024-09-04T16:48:45.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.345+0000 7fa0b6afc640 1 --2- 172.21.15.170:0/1292777333 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa09c079e80 0x7fa09c07c340 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.345+0000 7fa0b6afc640 1 --2- 172.21.15.170:0/1292777333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0b0106820 0x7fa0b0198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.345+0000 7fa0b6afc640 1 --2- 172.21.15.170:0/1292777333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b0100820 0x7fa0b01987e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.345+0000 7fa0b6afc640 1 -- 172.21.15.170:0/1292777333 >> 172.21.15.170:0/1292777333 conn(0x7fa0b00fc520 msgr2=0x7fa0b00fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:45.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.345+0000 7fa0b6afc640 1 -- 172.21.15.170:0/1292777333 shutdown_connections 2024-09-04T16:48:45.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.345+0000 7fa0b6afc640 1 -- 172.21.15.170:0/1292777333 wait complete. 2024-09-04T16:48:45.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.428+0000 7fbfbee62640 1 -- 172.21.15.170:0/1760492633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfb810cf10 msgr2=0x7fbfb8110f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:45.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.428+0000 7fbfbee62640 1 --2- 172.21.15.170:0/1760492633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfb810cf10 0x7fbfb8110f60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009880 tx=0x7fbfac02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.428+0000 7fbfbee62640 1 -- 172.21.15.170:0/1760492633 shutdown_connections 2024-09-04T16:48:45.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.428+0000 7fbfbee62640 1 --2- 172.21.15.170:0/1760492633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfb810cf10 0x7fbfb8110f60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.428+0000 7fbfbee62640 1 --2- 172.21.15.170:0/1760492633 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbfb810c560 0x7fbfb810c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.428+0000 7fbfbee62640 1 -- 172.21.15.170:0/1760492633 >> 172.21.15.170:0/1760492633 conn(0x7fbfb806c700 msgr2=0x7fbfb806cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:45.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.428+0000 7fbfbee62640 1 -- 172.21.15.170:0/1760492633 shutdown_connections 2024-09-04T16:48:45.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.428+0000 7fbfbee62640 1 -- 172.21.15.170:0/1760492633 wait complete. 2024-09-04T16:48:45.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.428+0000 7fbfbee62640 1 Processor -- start 2024-09-04T16:48:45.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.428+0000 7fbfbee62640 1 -- start start 2024-09-04T16:48:45.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.429+0000 7fbfbee62640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbfb810c560 0x7fbfb81a23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:45.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.429+0000 7fbfbee62640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfb810cf10 0x7fbfb81a28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:45.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.429+0000 7fbfbee62640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb81197c0 con 0x7fbfb810cf10 2024-09-04T16:48:45.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.429+0000 7fbfbee62640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb8119640 con 0x7fbfb810c560 2024-09-04T16:48:45.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.429+0000 7fbfb7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfb810cf10 0x7fbfb81a28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:45.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.429+0000 7fbfb7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfb810cf10 0x7fbfb81a28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57940/0 (socket says 172.21.15.170:57940) 2024-09-04T16:48:45.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.429+0000 7fbfb7fff640 1 -- 172.21.15.170:0/4108418444 learned_addr learned my addr 172.21.15.170:0/4108418444 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:48:45.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.429+0000 7fbfbcbfe640 1 --2- 172.21.15.170:0/4108418444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbfb810c560 0x7fbfb81a23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:45.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.429+0000 7fbfb7fff640 1 -- 172.21.15.170:0/4108418444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbfb810c560 msgr2=0x7fbfb81a23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:45.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.429+0000 7fbfb7fff640 1 --2- 172.21.15.170:0/4108418444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbfb810c560 0x7fbfb81a23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.429+0000 7fbfb7fff640 1 -- 172.21.15.170:0/4108418444 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb81a6c70 con 0x7fbfb810cf10 2024-09-04T16:48:45.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.429+0000 7fbfbcbfe640 1 --2- 172.21.15.170:0/4108418444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbfb810c560 0x7fbfb81a23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:48:45.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.429+0000 7fbfb7fff640 1 --2- 172.21.15.170:0/4108418444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfb810cf10 0x7fbfb81a28e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbfac031460 tx=0x7fbfac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:45.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.429+0000 7fbfb5ffb640 1 -- 172.21.15.170:0/4108418444 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbfac03f070 con 0x7fbfb810cf10 2024-09-04T16:48:45.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.430+0000 7fbfbee62640 1 -- 172.21.15.170:0/4108418444 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb81a6f00 con 0x7fbfb810cf10 2024-09-04T16:48:45.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.430+0000 7fbfb5ffb640 1 -- 172.21.15.170:0/4108418444 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbfac004cf0 con 0x7fbfb810cf10 2024-09-04T16:48:45.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.430+0000 7fbfb5ffb640 1 -- 172.21.15.170:0/4108418444 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbfac035030 con 0x7fbfb810cf10 2024-09-04T16:48:45.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.430+0000 7fbfbee62640 1 -- 172.21.15.170:0/4108418444 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb81a7430 con 0x7fbfb810cf10 2024-09-04T16:48:45.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.431+0000 7fbfbee62640 1 -- 172.21.15.170:0/4108418444 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb810da40 con 0x7fbfb810cf10 2024-09-04T16:48:45.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.431+0000 7fbfb5ffb640 1 -- 172.21.15.170:0/4108418444 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fbfac042070 con 0x7fbfb810cf10 2024-09-04T16:48:45.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.432+0000 7fbfb5ffb640 1 --2- 172.21.15.170:0/4108418444 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbfa0079e30 0x7fbfa007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:45.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.432+0000 7fbfbcbfe640 1 --2- 172.21.15.170:0/4108418444 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbfa0079e30 0x7fbfa007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:45.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.432+0000 7fbfb5ffb640 1 -- 172.21.15.170:0/4108418444 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fbfac0bd520 con 0x7fbfb810cf10 2024-09-04T16:48:45.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.433+0000 7fbfbcbfe640 1 --2- 172.21.15.170:0/4108418444 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbfa0079e30 0x7fbfa007c2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80058c0 tx=0x7fbfa8005ec0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:45.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.437+0000 7fbfb5ffb640 1 -- 172.21.15.170:0/4108418444 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbfac084f30 con 0x7fbfb810cf10 2024-09-04T16:48:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:45 smithi170 ceph-mon[113855]: from='client.34866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:48:45.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.647+0000 7fbfbee62640 1 -- 172.21.15.170:0/4108418444 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbfb81a3700 con 0x7fbfb810cf10 2024-09-04T16:48:45.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.648+0000 7fbfb5ffb640 1 -- 172.21.15.170:0/4108418444 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7fbfac08d3e0 con 0x7fbfb810cf10 2024-09-04T16:48:45.649 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:48:45.649 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:48:45.649 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:48:45.649 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:48:45.649 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:48:45.649 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:48:45.649 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:48:45.649 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:48:45.649 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:48:45.649 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:48:45.649 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:48:45.650 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:48:45.650 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:48:45.650 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:48:45.650 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:48:45.650 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:48:45.650 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:48:45.650 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:48:45.650 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:48:45.650 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:48:45.650 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:48:45.650 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:48:45.650 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:48:45.650 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:48:45.651 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:48:45.651 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:48:45.651 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:48:45.651 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:48:45.651 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:48:45.651 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:48:45.651 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:48:45.651 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:48:45.651 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:48:45.651 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:48:45.651 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:48:45.651 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:48:45.651 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:48:45.652 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:48:45.652 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:48:45.652 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:48:45.652 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:48:45.652 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:48:45.652 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:48:45.653 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:48:45.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.650+0000 7fbfbee62640 1 -- 172.21.15.170:0/4108418444 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbfa0079e30 msgr2=0x7fbfa007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:45.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.650+0000 7fbfbee62640 1 --2- 172.21.15.170:0/4108418444 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbfa0079e30 0x7fbfa007c2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80058c0 tx=0x7fbfa8005ec0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.650+0000 7fbfbee62640 1 -- 172.21.15.170:0/4108418444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfb810cf10 msgr2=0x7fbfb81a28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:45.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.650+0000 7fbfbee62640 1 --2- 172.21.15.170:0/4108418444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfb810cf10 0x7fbfb81a28e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbfac031460 tx=0x7fbfac0048f0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.650+0000 7fbfbee62640 1 -- 172.21.15.170:0/4108418444 shutdown_connections 2024-09-04T16:48:45.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.650+0000 7fbfbee62640 1 --2- 172.21.15.170:0/4108418444 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbfa0079e30 0x7fbfa007c2f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.650+0000 7fbfbee62640 1 --2- 172.21.15.170:0/4108418444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfb810cf10 0x7fbfb81a28e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.650+0000 7fbfbee62640 1 --2- 172.21.15.170:0/4108418444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbfb810c560 0x7fbfb81a23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.650+0000 7fbfbee62640 1 -- 172.21.15.170:0/4108418444 >> 172.21.15.170:0/4108418444 conn(0x7fbfb806c700 msgr2=0x7fbfb810a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:45.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.650+0000 7fbfbee62640 1 -- 172.21.15.170:0/4108418444 shutdown_connections 2024-09-04T16:48:45.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.650+0000 7fbfbee62640 1 -- 172.21.15.170:0/4108418444 wait complete. 2024-09-04T16:48:45.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:45 smithi193 ceph-mon[82547]: from='client.34866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:48:45.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.733+0000 7fa733316640 1 -- 172.21.15.170:0/3787867625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa72c106810 msgr2=0x7fa72c106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:45.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.733+0000 7fa733316640 1 --2- 172.21.15.170:0/3787867625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa72c106810 0x7fa72c106bf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa728009880 tx=0x7fa72802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.733+0000 7fa733316640 1 -- 172.21.15.170:0/3787867625 shutdown_connections 2024-09-04T16:48:45.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.733+0000 7fa733316640 1 --2- 172.21.15.170:0/3787867625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa72c100810 0x7fa72c100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.733+0000 7fa733316640 1 --2- 172.21.15.170:0/3787867625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa72c106810 0x7fa72c106bf0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.733+0000 7fa733316640 1 -- 172.21.15.170:0/3787867625 >> 172.21.15.170:0/3787867625 conn(0x7fa72c0fc510 msgr2=0x7fa72c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:45.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.733+0000 7fa733316640 1 -- 172.21.15.170:0/3787867625 shutdown_connections 2024-09-04T16:48:45.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.733+0000 7fa733316640 1 -- 172.21.15.170:0/3787867625 wait complete. 2024-09-04T16:48:45.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.733+0000 7fa733316640 1 Processor -- start 2024-09-04T16:48:45.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.734+0000 7fa733316640 1 -- start start 2024-09-04T16:48:45.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.734+0000 7fa733316640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa72c100810 0x7fa72c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:45.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.734+0000 7fa733316640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa72c106810 0x7fa72c19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:45.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.734+0000 7fa733316640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c10dd40 con 0x7fa72c106810 2024-09-04T16:48:45.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.734+0000 7fa733316640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c10dbc0 con 0x7fa72c100810 2024-09-04T16:48:45.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.734+0000 7fa7308b1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa72c106810 0x7fa72c19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:45.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.734+0000 7fa7308b1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa72c106810 0x7fa72c19dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57968/0 (socket says 172.21.15.170:57968) 2024-09-04T16:48:45.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.734+0000 7fa7308b1640 1 -- 172.21.15.170:0/280407992 learned_addr learned my addr 172.21.15.170:0/280407992 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:48:45.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.734+0000 7fa7310b2640 1 --2- 172.21.15.170:0/280407992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa72c100810 0x7fa72c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:45.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.734+0000 7fa7308b1640 1 -- 172.21.15.170:0/280407992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa72c100810 msgr2=0x7fa72c19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:45.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.734+0000 7fa7308b1640 1 --2- 172.21.15.170:0/280407992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa72c100810 0x7fa72c19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.734+0000 7fa7308b1640 1 -- 172.21.15.170:0/280407992 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72c197830 con 0x7fa72c106810 2024-09-04T16:48:45.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.734+0000 7fa7308b1640 1 --2- 172.21.15.170:0/280407992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa72c106810 0x7fa72c19dbf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00b420 tx=0x7fa71c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:45.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.734+0000 7fa7227fc640 1 -- 172.21.15.170:0/280407992 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa71c011630 con 0x7fa72c106810 2024-09-04T16:48:45.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.734+0000 7fa7227fc640 1 -- 172.21.15.170:0/280407992 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa71c016070 con 0x7fa72c106810 2024-09-04T16:48:45.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.734+0000 7fa733316640 1 -- 172.21.15.170:0/280407992 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa72c197b20 con 0x7fa72c106810 2024-09-04T16:48:45.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.735+0000 7fa7227fc640 1 -- 172.21.15.170:0/280407992 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa71c010d40 con 0x7fa72c106810 2024-09-04T16:48:45.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.735+0000 7fa733316640 1 -- 172.21.15.170:0/280407992 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa72c1980b0 con 0x7fa72c106810 2024-09-04T16:48:45.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.736+0000 7fa733316640 1 -- 172.21.15.170:0/280407992 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa72c101f50 con 0x7fa72c106810 2024-09-04T16:48:45.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.736+0000 7fa7227fc640 1 -- 172.21.15.170:0/280407992 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fa71c01b460 con 0x7fa72c106810 2024-09-04T16:48:45.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.737+0000 7fa7227fc640 1 --2- 172.21.15.170:0/280407992 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa718079e80 0x7fa71807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:45.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.737+0000 7fa7227fc640 1 -- 172.21.15.170:0/280407992 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa71c09c1b0 con 0x7fa72c106810 2024-09-04T16:48:45.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.737+0000 7fa7310b2640 1 --2- 172.21.15.170:0/280407992 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa718079e80 0x7fa71807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:45.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.737+0000 7fa7310b2640 1 --2- 172.21.15.170:0/280407992 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa718079e80 0x7fa71807c340 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa728031460 tx=0x7fa728009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:45.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.743+0000 7fa7227fc640 1 -- 172.21.15.170:0/280407992 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa71c021250 con 0x7fa72c106810 2024-09-04T16:48:45.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.933+0000 7fa733316640 1 -- 172.21.15.170:0/280407992 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa72c1983c0 con 0x7fa718079e80 2024-09-04T16:48:45.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.934+0000 7fa7227fc640 1 -- 172.21.15.170:0/280407992 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa72c1983c0 con 0x7fa718079e80 2024-09-04T16:48:45.934 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:48:45.934 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:48:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:48:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:48:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:48:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:48:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:48:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:48:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:48:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:48:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:48:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:48:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:48:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:48:45.935 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:48:45.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.937+0000 7fa733316640 1 -- 172.21.15.170:0/280407992 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa718079e80 msgr2=0x7fa71807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:45.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.937+0000 7fa733316640 1 --2- 172.21.15.170:0/280407992 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa718079e80 0x7fa71807c340 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa728031460 tx=0x7fa728009560 comp rx=0 tx=0).stop 2024-09-04T16:48:45.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.937+0000 7fa733316640 1 -- 172.21.15.170:0/280407992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa72c106810 msgr2=0x7fa72c19dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:45.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.937+0000 7fa733316640 1 --2- 172.21.15.170:0/280407992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa72c106810 0x7fa72c19dbf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00b420 tx=0x7fa71c00b8e0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.937+0000 7fa733316640 1 -- 172.21.15.170:0/280407992 shutdown_connections 2024-09-04T16:48:45.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.937+0000 7fa733316640 1 --2- 172.21.15.170:0/280407992 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa718079e80 0x7fa71807c340 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.937+0000 7fa733316640 1 --2- 172.21.15.170:0/280407992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa72c106810 0x7fa72c19dbf0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.937+0000 7fa733316640 1 --2- 172.21.15.170:0/280407992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa72c100810 0x7fa72c19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:45.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.937+0000 7fa733316640 1 -- 172.21.15.170:0/280407992 >> 172.21.15.170:0/280407992 conn(0x7fa72c0fc510 msgr2=0x7fa72c06a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:45.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.937+0000 7fa733316640 1 -- 172.21.15.170:0/280407992 shutdown_connections 2024-09-04T16:48:45.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:45.937+0000 7fa733316640 1 -- 172.21.15.170:0/280407992 wait complete. 2024-09-04T16:48:46.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.020+0000 7f4c25af6640 1 -- 172.21.15.170:0/430778421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c20103460 msgr2=0x7f4c2010b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:46.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.020+0000 7f4c25af6640 1 --2- 172.21.15.170:0/430778421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c20103460 0x7f4c2010b950 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4c140098b0 tx=0x7f4c1402a560 comp rx=0 tx=0).stop 2024-09-04T16:48:46.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.020+0000 7f4c25af6640 1 -- 172.21.15.170:0/430778421 shutdown_connections 2024-09-04T16:48:46.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.020+0000 7f4c25af6640 1 --2- 172.21.15.170:0/430778421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c20103460 0x7f4c2010b950 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:46.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.020+0000 7f4c25af6640 1 --2- 172.21.15.170:0/430778421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c20102b40 0x7f4c20102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:46.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.020+0000 7f4c25af6640 1 -- 172.21.15.170:0/430778421 >> 172.21.15.170:0/430778421 conn(0x7f4c200fc520 msgr2=0x7f4c200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:46.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.020+0000 7f4c25af6640 1 -- 172.21.15.170:0/430778421 shutdown_connections 2024-09-04T16:48:46.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.020+0000 7f4c25af6640 1 -- 172.21.15.170:0/430778421 wait complete. 2024-09-04T16:48:46.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.021+0000 7f4c25af6640 1 Processor -- start 2024-09-04T16:48:46.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.021+0000 7f4c25af6640 1 -- start start 2024-09-04T16:48:46.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.021+0000 7f4c25af6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c20102b40 0x7f4c2019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:46.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.021+0000 7f4c25af6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c20103460 0x7f4c2019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:46.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.021+0000 7f4c25af6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2010ee10 con 0x7f4c20102b40 2024-09-04T16:48:46.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.021+0000 7f4c25af6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2010ec90 con 0x7f4c20103460 2024-09-04T16:48:46.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.021+0000 7f4c1f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c20102b40 0x7f4c2019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:46.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.021+0000 7f4c1f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c20102b40 0x7f4c2019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57984/0 (socket says 172.21.15.170:57984) 2024-09-04T16:48:46.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.021+0000 7f4c1f7fe640 1 -- 172.21.15.170:0/488363369 learned_addr learned my addr 172.21.15.170:0/488363369 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:48:46.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.021+0000 7f4c1effd640 1 --2- 172.21.15.170:0/488363369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c20103460 0x7f4c2019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:46.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.021+0000 7f4c1f7fe640 1 -- 172.21.15.170:0/488363369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c20103460 msgr2=0x7f4c2019dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:46.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.021+0000 7f4c1f7fe640 1 --2- 172.21.15.170:0/488363369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c20103460 0x7f4c2019dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:46.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.021+0000 7f4c1f7fe640 1 -- 172.21.15.170:0/488363369 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c20197840 con 0x7f4c20102b40 2024-09-04T16:48:46.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.021+0000 7f4c1effd640 1 --2- 172.21.15.170:0/488363369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c20103460 0x7f4c2019dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:48:46.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.022+0000 7f4c1f7fe640 1 --2- 172.21.15.170:0/488363369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c20102b40 0x7f4c2019d6c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000d6f0 tx=0x7f4c1000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:46.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.022+0000 7f4c1cff9640 1 -- 172.21.15.170:0/488363369 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c10017070 con 0x7f4c20102b40 2024-09-04T16:48:46.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.022+0000 7f4c25af6640 1 -- 172.21.15.170:0/488363369 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c20197b30 con 0x7f4c20102b40 2024-09-04T16:48:46.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.022+0000 7f4c1cff9640 1 -- 172.21.15.170:0/488363369 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4c1000de00 con 0x7f4c20102b40 2024-09-04T16:48:46.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.022+0000 7f4c1cff9640 1 -- 172.21.15.170:0/488363369 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c10004bb0 con 0x7f4c20102b40 2024-09-04T16:48:46.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.022+0000 7f4c25af6640 1 -- 172.21.15.170:0/488363369 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c201980c0 con 0x7f4c20102b40 2024-09-04T16:48:46.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.023+0000 7f4c25af6640 1 -- 172.21.15.170:0/488363369 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c2006ab80 con 0x7f4c20102b40 2024-09-04T16:48:46.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.024+0000 7f4c1cff9640 1 -- 172.21.15.170:0/488363369 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f4c10004e60 con 0x7f4c20102b40 2024-09-04T16:48:46.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.024+0000 7f4c1cff9640 1 --2- 172.21.15.170:0/488363369 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c08079e30 0x7f4c0807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:48:46.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.024+0000 7f4c1cff9640 1 -- 172.21.15.170:0/488363369 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4c1009c730 con 0x7f4c20102b40 2024-09-04T16:48:46.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.024+0000 7f4c1effd640 1 --2- 172.21.15.170:0/488363369 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c08079e30 0x7f4c0807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:48:46.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.025+0000 7f4c1effd640 1 --2- 172.21.15.170:0/488363369 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c08079e30 0x7f4c0807c2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4c14000c00 tx=0x7f4c140095f0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:48:46.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.029+0000 7f4c1cff9640 1 -- 172.21.15.170:0/488363369 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4c10064140 con 0x7f4c20102b40 2024-09-04T16:48:46.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.276+0000 7f4c25af6640 1 -- 172.21.15.170:0/488363369 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f4c20105fd0 con 0x7f4c20102b40 2024-09-04T16:48:46.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.276+0000 7f4c1cff9640 1 -- 172.21.15.170:0/488363369 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f4c100682b0 con 0x7f4c20102b40 2024-09-04T16:48:46.276 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:48:46.276 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:48:46.276 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:48:46.277 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:48:46.277 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:48:46.277 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:48:46.277 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:48:46.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.279+0000 7f4c25af6640 1 -- 172.21.15.170:0/488363369 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c08079e30 msgr2=0x7f4c0807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:46.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.279+0000 7f4c25af6640 1 --2- 172.21.15.170:0/488363369 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c08079e30 0x7f4c0807c2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4c14000c00 tx=0x7f4c140095f0 comp rx=0 tx=0).stop 2024-09-04T16:48:46.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.279+0000 7f4c25af6640 1 -- 172.21.15.170:0/488363369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c20102b40 msgr2=0x7f4c2019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:48:46.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.279+0000 7f4c25af6640 1 --2- 172.21.15.170:0/488363369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c20102b40 0x7f4c2019d6c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000d6f0 tx=0x7f4c1000dbb0 comp rx=0 tx=0).stop 2024-09-04T16:48:46.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.279+0000 7f4c25af6640 1 -- 172.21.15.170:0/488363369 shutdown_connections 2024-09-04T16:48:46.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.279+0000 7f4c25af6640 1 --2- 172.21.15.170:0/488363369 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c08079e30 0x7f4c0807c2f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:46.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.279+0000 7f4c25af6640 1 --2- 172.21.15.170:0/488363369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c20103460 0x7f4c2019dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:46.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.279+0000 7f4c25af6640 1 --2- 172.21.15.170:0/488363369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c20102b40 0x7f4c2019d6c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:48:46.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.279+0000 7f4c25af6640 1 -- 172.21.15.170:0/488363369 >> 172.21.15.170:0/488363369 conn(0x7f4c200fc520 msgr2=0x7f4c20103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:48:46.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.279+0000 7f4c25af6640 1 -- 172.21.15.170:0/488363369 shutdown_connections 2024-09-04T16:48:46.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:48:46.279+0000 7f4c25af6640 1 -- 172.21.15.170:0/488363369 wait complete. 2024-09-04T16:48:46.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:46 smithi170 ceph-mon[113855]: pgmap v571: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:46.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:46 smithi170 ceph-mon[113855]: from='client.34870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:48:46.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:46 smithi170 ceph-mon[113855]: from='client.34874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:48:46.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:46 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1292777333' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:48:46.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:46 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/4108418444' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:48:46.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:46 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/488363369' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:48:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:46 smithi193 ceph-mon[82547]: pgmap v571: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:46 smithi193 ceph-mon[82547]: from='client.34870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:48:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:46 smithi193 ceph-mon[82547]: from='client.34874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:48:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:46 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1292777333' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:48:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:46 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/4108418444' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:48:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:46 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/488363369' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:48:47.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:47 smithi170 ceph-mon[113855]: from='client.34886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:48:47.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:47 smithi193 ceph-mon[82547]: from='client.34886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:48:48.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:48 smithi170 ceph-mon[113855]: pgmap v572: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:48.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:48 smithi193 ceph-mon[82547]: pgmap v572: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:50.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:50 smithi170 ceph-mon[113855]: pgmap v573: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:50 smithi193 ceph-mon[82547]: pgmap v573: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:52.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:52 smithi170 ceph-mon[113855]: pgmap v574: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:52.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:52 smithi193 ceph-mon[82547]: pgmap v574: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:54 smithi170 ceph-mon[113855]: pgmap v575: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:54 smithi193 ceph-mon[82547]: pgmap v575: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:56.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:56 smithi193 ceph-mon[82547]: pgmap v576: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:56.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:56 smithi170 ceph-mon[113855]: pgmap v576: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:58.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:58 smithi193 ceph-mon[82547]: pgmap v577: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:58.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:58 smithi170 ceph-mon[113855]: pgmap v577: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:48:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:48:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:48:59.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:48:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:49:00.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:00 smithi170 ceph-mon[113855]: pgmap v578: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:00.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:00 smithi193 ceph-mon[82547]: pgmap v578: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:02 smithi193 ceph-mon[82547]: pgmap v579: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:02.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:02 smithi170 ceph-mon[113855]: pgmap v579: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:04 smithi193 ceph-mon[82547]: pgmap v580: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:04.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:04 smithi170 ceph-mon[113855]: pgmap v580: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:06.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:06 smithi170 ceph-mon[113855]: pgmap v581: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:06.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:06 smithi193 ceph-mon[82547]: pgmap v581: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:08.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:08 smithi193 ceph-mon[82547]: pgmap v582: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:08.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:08 smithi170 ceph-mon[113855]: pgmap v582: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:10.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:10 smithi170 ceph-mon[113855]: pgmap v583: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:10 smithi193 ceph-mon[82547]: pgmap v583: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:12.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:12 smithi170 ceph-mon[113855]: pgmap v584: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:12.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:12 smithi193 ceph-mon[82547]: pgmap v584: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:14 smithi193 ceph-mon[82547]: pgmap v585: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:49:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:14 smithi170 ceph-mon[113855]: pgmap v585: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:49:16.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.372+0000 7fc3635a3640 1 -- 172.21.15.170:0/242724608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc35c106820 msgr2=0x7fc35c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:16.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.372+0000 7fc3635a3640 1 --2- 172.21.15.170:0/242724608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc35c106820 0x7fc35c106c00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc358009880 tx=0x7fc35802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.372+0000 7fc3635a3640 1 -- 172.21.15.170:0/242724608 shutdown_connections 2024-09-04T16:49:16.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.372+0000 7fc3635a3640 1 --2- 172.21.15.170:0/242724608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc35c100820 0x7fc35c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.372+0000 7fc3635a3640 1 --2- 172.21.15.170:0/242724608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc35c106820 0x7fc35c106c00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.372+0000 7fc3635a3640 1 -- 172.21.15.170:0/242724608 >> 172.21.15.170:0/242724608 conn(0x7fc35c0fc520 msgr2=0x7fc35c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:16.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.372+0000 7fc3635a3640 1 -- 172.21.15.170:0/242724608 shutdown_connections 2024-09-04T16:49:16.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.372+0000 7fc3635a3640 1 -- 172.21.15.170:0/242724608 wait complete. 2024-09-04T16:49:16.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.373+0000 7fc3635a3640 1 Processor -- start 2024-09-04T16:49:16.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.373+0000 7fc3635a3640 1 -- start start 2024-09-04T16:49:16.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.373+0000 7fc3635a3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc35c100820 0x7fc35c198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:16.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.373+0000 7fc3635a3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc35c106820 0x7fc35c198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:16.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.373+0000 7fc3635a3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c10dcd0 con 0x7fc35c106820 2024-09-04T16:49:16.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.373+0000 7fc3635a3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c10db50 con 0x7fc35c100820 2024-09-04T16:49:16.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.373+0000 7fc360b3e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc35c106820 0x7fc35c198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:16.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.373+0000 7fc360b3e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc35c106820 0x7fc35c198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36402/0 (socket says 172.21.15.170:36402) 2024-09-04T16:49:16.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.373+0000 7fc360b3e640 1 -- 172.21.15.170:0/116025603 learned_addr learned my addr 172.21.15.170:0/116025603 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:49:16.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.374+0000 7fc36133f640 1 --2- 172.21.15.170:0/116025603 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc35c100820 0x7fc35c198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:16.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.374+0000 7fc360b3e640 1 -- 172.21.15.170:0/116025603 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc35c100820 msgr2=0x7fc35c198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:16.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.374+0000 7fc360b3e640 1 --2- 172.21.15.170:0/116025603 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc35c100820 0x7fc35c198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.374+0000 7fc360b3e640 1 -- 172.21.15.170:0/116025603 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35c199370 con 0x7fc35c106820 2024-09-04T16:49:16.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.374+0000 7fc360b3e640 1 --2- 172.21.15.170:0/116025603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc35c106820 0x7fc35c198d70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc35000d8d0 tx=0x7fc35000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:16.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.374+0000 7fc34e7fc640 1 -- 172.21.15.170:0/116025603 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc350017070 con 0x7fc35c106820 2024-09-04T16:49:16.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.374+0000 7fc34e7fc640 1 -- 172.21.15.170:0/116025603 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc350010460 con 0x7fc35c106820 2024-09-04T16:49:16.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.374+0000 7fc3635a3640 1 -- 172.21.15.170:0/116025603 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35c199660 con 0x7fc35c106820 2024-09-04T16:49:16.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.374+0000 7fc34e7fc640 1 -- 172.21.15.170:0/116025603 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc35000f5f0 con 0x7fc35c106820 2024-09-04T16:49:16.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.374+0000 7fc3635a3640 1 -- 172.21.15.170:0/116025603 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc35c1a1c60 con 0x7fc35c106820 2024-09-04T16:49:16.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.375+0000 7fc3635a3640 1 -- 172.21.15.170:0/116025603 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc35c101f60 con 0x7fc35c106820 2024-09-04T16:49:16.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.376+0000 7fc34e7fc640 1 -- 172.21.15.170:0/116025603 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fc350009a30 con 0x7fc35c106820 2024-09-04T16:49:16.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.376+0000 7fc34e7fc640 1 --2- 172.21.15.170:0/116025603 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc348079e80 0x7fc34807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:16.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.377+0000 7fc36133f640 1 --2- 172.21.15.170:0/116025603 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc348079e80 0x7fc34807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:16.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.377+0000 7fc34e7fc640 1 -- 172.21.15.170:0/116025603 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc35009c910 con 0x7fc35c106820 2024-09-04T16:49:16.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.377+0000 7fc36133f640 1 --2- 172.21.15.170:0/116025603 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc348079e80 0x7fc34807c340 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc3580096c0 tx=0x7fc358031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:16.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.381+0000 7fc34e7fc640 1 -- 172.21.15.170:0/116025603 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc35c199660 con 0x7fc35c106820 2024-09-04T16:49:16.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.575+0000 7fc3635a3640 1 -- 172.21.15.170:0/116025603 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc35c062630 con 0x7fc348079e80 2024-09-04T16:49:16.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.576+0000 7fc34e7fc640 1 -- 172.21.15.170:0/116025603 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc35c062630 con 0x7fc348079e80 2024-09-04T16:49:16.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.578+0000 7fc3635a3640 1 -- 172.21.15.170:0/116025603 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc348079e80 msgr2=0x7fc34807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:16.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.578+0000 7fc3635a3640 1 --2- 172.21.15.170:0/116025603 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc348079e80 0x7fc34807c340 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc3580096c0 tx=0x7fc358031400 comp rx=0 tx=0).stop 2024-09-04T16:49:16.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.578+0000 7fc3635a3640 1 -- 172.21.15.170:0/116025603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc35c106820 msgr2=0x7fc35c198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:16.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.578+0000 7fc3635a3640 1 --2- 172.21.15.170:0/116025603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc35c106820 0x7fc35c198d70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc35000d8d0 tx=0x7fc35000dd90 comp rx=0 tx=0).stop 2024-09-04T16:49:16.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.578+0000 7fc3635a3640 1 -- 172.21.15.170:0/116025603 shutdown_connections 2024-09-04T16:49:16.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.578+0000 7fc3635a3640 1 --2- 172.21.15.170:0/116025603 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc348079e80 0x7fc34807c340 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.578+0000 7fc3635a3640 1 --2- 172.21.15.170:0/116025603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc35c106820 0x7fc35c198d70 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.578+0000 7fc3635a3640 1 --2- 172.21.15.170:0/116025603 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc35c100820 0x7fc35c198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.578+0000 7fc3635a3640 1 -- 172.21.15.170:0/116025603 >> 172.21.15.170:0/116025603 conn(0x7fc35c0fc520 msgr2=0x7fc35c0fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:16.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.578+0000 7fc3635a3640 1 -- 172.21.15.170:0/116025603 shutdown_connections 2024-09-04T16:49:16.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.578+0000 7fc3635a3640 1 -- 172.21.15.170:0/116025603 wait complete. 2024-09-04T16:49:16.588 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:49:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:16 smithi193 ceph-mon[82547]: pgmap v586: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:16.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.661+0000 7f61ba22e640 1 -- 172.21.15.170:0/4243757208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61b4100820 msgr2=0x7f61b4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:16.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.661+0000 7f61ba22e640 1 --2- 172.21.15.170:0/4243757208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61b4100820 0x7f61b4100c80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009880 tx=0x7f61a802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.661+0000 7f61ba22e640 1 -- 172.21.15.170:0/4243757208 shutdown_connections 2024-09-04T16:49:16.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.661+0000 7f61ba22e640 1 --2- 172.21.15.170:0/4243757208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61b4100820 0x7f61b4100c80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.661+0000 7f61ba22e640 1 --2- 172.21.15.170:0/4243757208 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61b4106820 0x7f61b4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.661+0000 7f61ba22e640 1 -- 172.21.15.170:0/4243757208 >> 172.21.15.170:0/4243757208 conn(0x7f61b40fc520 msgr2=0x7f61b40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:16.662 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:16 smithi170 ceph-mon[113855]: pgmap v586: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:16.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.661+0000 7f61ba22e640 1 -- 172.21.15.170:0/4243757208 shutdown_connections 2024-09-04T16:49:16.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.661+0000 7f61ba22e640 1 -- 172.21.15.170:0/4243757208 wait complete. 2024-09-04T16:49:16.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.662+0000 7f61ba22e640 1 Processor -- start 2024-09-04T16:49:16.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.662+0000 7f61ba22e640 1 -- start start 2024-09-04T16:49:16.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.662+0000 7f61ba22e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61b4100820 0x7f61b419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:16.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.662+0000 7f61ba22e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61b4106820 0x7f61b419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:16.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.662+0000 7f61ba22e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f61b410dcf0 con 0x7f61b4100820 2024-09-04T16:49:16.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.662+0000 7f61ba22e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f61b410db70 con 0x7f61b4106820 2024-09-04T16:49:16.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.663+0000 7f61b37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61b4100820 0x7f61b419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:16.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.663+0000 7f61b37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61b4100820 0x7f61b419d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36426/0 (socket says 172.21.15.170:36426) 2024-09-04T16:49:16.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.663+0000 7f61b37fe640 1 -- 172.21.15.170:0/861292941 learned_addr learned my addr 172.21.15.170:0/861292941 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:49:16.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.663+0000 7f61b2ffd640 1 --2- 172.21.15.170:0/861292941 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61b4106820 0x7f61b419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:16.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.663+0000 7f61b37fe640 1 -- 172.21.15.170:0/861292941 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61b4106820 msgr2=0x7f61b419dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:16.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.663+0000 7f61b37fe640 1 --2- 172.21.15.170:0/861292941 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61b4106820 0x7f61b419dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.663+0000 7f61b37fe640 1 -- 172.21.15.170:0/861292941 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b4197810 con 0x7f61b4100820 2024-09-04T16:49:16.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.663+0000 7f61b37fe640 1 --2- 172.21.15.170:0/861292941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61b4100820 0x7f61b419d690 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f61a400d6f0 tx=0x7f61a400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:16.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.663+0000 7f61b0ff9640 1 -- 172.21.15.170:0/861292941 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f61a4017070 con 0x7f61b4100820 2024-09-04T16:49:16.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.663+0000 7f61ba22e640 1 -- 172.21.15.170:0/861292941 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b4197b00 con 0x7f61b4100820 2024-09-04T16:49:16.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.663+0000 7f61b0ff9640 1 -- 172.21.15.170:0/861292941 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f61a400de00 con 0x7f61b4100820 2024-09-04T16:49:16.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.663+0000 7f61b0ff9640 1 -- 172.21.15.170:0/861292941 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f61a4004bb0 con 0x7f61b4100820 2024-09-04T16:49:16.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.663+0000 7f61ba22e640 1 -- 172.21.15.170:0/861292941 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b4198060 con 0x7f61b4100820 2024-09-04T16:49:16.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.665+0000 7f61ba22e640 1 -- 172.21.15.170:0/861292941 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b4101f60 con 0x7f61b4100820 2024-09-04T16:49:16.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.665+0000 7f61b0ff9640 1 -- 172.21.15.170:0/861292941 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f61a4009a30 con 0x7f61b4100820 2024-09-04T16:49:16.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.666+0000 7f61b0ff9640 1 --2- 172.21.15.170:0/861292941 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f619c079e80 0x7f619c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:16.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.666+0000 7f61b2ffd640 1 --2- 172.21.15.170:0/861292941 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f619c079e80 0x7f619c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:16.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.666+0000 7f61b0ff9640 1 -- 172.21.15.170:0/861292941 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f61a409c600 con 0x7f61b4100820 2024-09-04T16:49:16.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.666+0000 7f61b2ffd640 1 --2- 172.21.15.170:0/861292941 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f619c079e80 0x7f619c07c340 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f61b4198b60 tx=0x7f61a8031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:16.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.670+0000 7f61b0ff9640 1 -- 172.21.15.170:0/861292941 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f61a4068160 con 0x7f61b4100820 2024-09-04T16:49:16.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.862+0000 7f61ba22e640 1 -- 172.21.15.170:0/861292941 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f61b4198310 con 0x7f619c079e80 2024-09-04T16:49:16.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.864+0000 7f61b0ff9640 1 -- 172.21.15.170:0/861292941 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f61b4198310 con 0x7f619c079e80 2024-09-04T16:49:16.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.866+0000 7f61ba22e640 1 -- 172.21.15.170:0/861292941 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f619c079e80 msgr2=0x7f619c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:16.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.866+0000 7f61ba22e640 1 --2- 172.21.15.170:0/861292941 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f619c079e80 0x7f619c07c340 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f61b4198b60 tx=0x7f61a8031400 comp rx=0 tx=0).stop 2024-09-04T16:49:16.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.866+0000 7f61ba22e640 1 -- 172.21.15.170:0/861292941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61b4100820 msgr2=0x7f61b419d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:16.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.866+0000 7f61ba22e640 1 --2- 172.21.15.170:0/861292941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61b4100820 0x7f61b419d690 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f61a400d6f0 tx=0x7f61a400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.866+0000 7f61ba22e640 1 -- 172.21.15.170:0/861292941 shutdown_connections 2024-09-04T16:49:16.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.866+0000 7f61ba22e640 1 --2- 172.21.15.170:0/861292941 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f619c079e80 0x7f619c07c340 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.866+0000 7f61ba22e640 1 --2- 172.21.15.170:0/861292941 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61b4106820 0x7f61b419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.866+0000 7f61ba22e640 1 --2- 172.21.15.170:0/861292941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61b4100820 0x7f61b419d690 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.866+0000 7f61ba22e640 1 -- 172.21.15.170:0/861292941 >> 172.21.15.170:0/861292941 conn(0x7f61b40fc520 msgr2=0x7f61b406a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:16.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.866+0000 7f61ba22e640 1 -- 172.21.15.170:0/861292941 shutdown_connections 2024-09-04T16:49:16.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.866+0000 7f61ba22e640 1 -- 172.21.15.170:0/861292941 wait complete. 2024-09-04T16:49:16.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.948+0000 7fb033284640 1 -- 172.21.15.170:0/2678006012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb02c100b70 msgr2=0x7fb02c104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:16.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.948+0000 7fb033284640 1 --2- 172.21.15.170:0/2678006012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb02c100b70 0x7fb02c104bc0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb028009880 tx=0x7fb02802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.948+0000 7fb033284640 1 -- 172.21.15.170:0/2678006012 shutdown_connections 2024-09-04T16:49:16.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.948+0000 7fb033284640 1 --2- 172.21.15.170:0/2678006012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb02c100b70 0x7fb02c104bc0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.948+0000 7fb033284640 1 --2- 172.21.15.170:0/2678006012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb02c1001c0 0x7fb02c1005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.948+0000 7fb033284640 1 -- 172.21.15.170:0/2678006012 >> 172.21.15.170:0/2678006012 conn(0x7fb02c0fbc40 msgr2=0x7fb02c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:16.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.948+0000 7fb033284640 1 -- 172.21.15.170:0/2678006012 shutdown_connections 2024-09-04T16:49:16.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.948+0000 7fb033284640 1 -- 172.21.15.170:0/2678006012 wait complete. 2024-09-04T16:49:16.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.949+0000 7fb033284640 1 Processor -- start 2024-09-04T16:49:16.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.949+0000 7fb033284640 1 -- start start 2024-09-04T16:49:16.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.949+0000 7fb033284640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb02c1001c0 0x7fb02c19c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:16.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.949+0000 7fb033284640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb02c100b70 0x7fb02c19cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:16.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.949+0000 7fb033284640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c10dcc0 con 0x7fb02c1001c0 2024-09-04T16:49:16.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.949+0000 7fb033284640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c10db40 con 0x7fb02c100b70 2024-09-04T16:49:16.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.949+0000 7fb031020640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb02c1001c0 0x7fb02c19c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:16.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.949+0000 7fb031020640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb02c1001c0 0x7fb02c19c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36448/0 (socket says 172.21.15.170:36448) 2024-09-04T16:49:16.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.949+0000 7fb031020640 1 -- 172.21.15.170:0/2680615285 learned_addr learned my addr 172.21.15.170:0/2680615285 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:49:16.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.950+0000 7fb03081f640 1 --2- 172.21.15.170:0/2680615285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb02c100b70 0x7fb02c19cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:16.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.950+0000 7fb031020640 1 -- 172.21.15.170:0/2680615285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb02c100b70 msgr2=0x7fb02c19cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:16.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.950+0000 7fb031020640 1 --2- 172.21.15.170:0/2680615285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb02c100b70 0x7fb02c19cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:16.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.950+0000 7fb031020640 1 -- 172.21.15.170:0/2680615285 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02c1966c0 con 0x7fb02c1001c0 2024-09-04T16:49:16.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.950+0000 7fb031020640 1 --2- 172.21.15.170:0/2680615285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb02c1001c0 0x7fb02c19c5f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb02000d6f0 tx=0x7fb02000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:16.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.950+0000 7fb01e7fc640 1 -- 172.21.15.170:0/2680615285 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb020017070 con 0x7fb02c1001c0 2024-09-04T16:49:16.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.950+0000 7fb033284640 1 -- 172.21.15.170:0/2680615285 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb02c1969b0 con 0x7fb02c1001c0 2024-09-04T16:49:16.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.950+0000 7fb01e7fc640 1 -- 172.21.15.170:0/2680615285 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb02000de00 con 0x7fb02c1001c0 2024-09-04T16:49:16.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.950+0000 7fb01e7fc640 1 -- 172.21.15.170:0/2680615285 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb020004bb0 con 0x7fb02c1001c0 2024-09-04T16:49:16.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.950+0000 7fb033284640 1 -- 172.21.15.170:0/2680615285 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb02c196f10 con 0x7fb02c1001c0 2024-09-04T16:49:16.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.951+0000 7fb033284640 1 -- 172.21.15.170:0/2680615285 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb02c1016a0 con 0x7fb02c1001c0 2024-09-04T16:49:16.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.952+0000 7fb01e7fc640 1 -- 172.21.15.170:0/2680615285 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fb020009a30 con 0x7fb02c1001c0 2024-09-04T16:49:16.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.952+0000 7fb01e7fc640 1 --2- 172.21.15.170:0/2680615285 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb018079e80 0x7fb01807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:16.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.953+0000 7fb03081f640 1 --2- 172.21.15.170:0/2680615285 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb018079e80 0x7fb01807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:16.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.953+0000 7fb01e7fc640 1 -- 172.21.15.170:0/2680615285 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb02009c560 con 0x7fb02c1001c0 2024-09-04T16:49:16.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.953+0000 7fb03081f640 1 --2- 172.21.15.170:0/2680615285 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb018079e80 0x7fb01807c340 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb02c197f10 tx=0x7fb028031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:16.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:16.957+0000 7fb01e7fc640 1 -- 172.21.15.170:0/2680615285 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb020068160 con 0x7fb02c1001c0 2024-09-04T16:49:17.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.140+0000 7fb033284640 1 -- 172.21.15.170:0/2680615285 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb02c197280 con 0x7fb018079e80 2024-09-04T16:49:17.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.149+0000 7fb01e7fc640 1 -- 172.21.15.170:0/2680615285 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb02c197280 con 0x7fb018079e80 2024-09-04T16:49:17.150 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:49:17.150 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (16m) 10m ago 27m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:49:17.150 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (19m) 10m ago 27m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:49:17.150 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (18m) 10m ago 26m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:49:17.150 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (14m) 10m ago 27m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:49:17.150 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (14m) 10m ago 26m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:49:17.150 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (15m) 10m ago 26m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:49:17.150 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (10m) 10m ago 21m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:49:17.150 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (10m) 10m ago 21m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:49:17.150 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (10m) 10m ago 21m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:49:17.151 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (10m) 10m ago 21m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:49:17.151 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (18m) 10m ago 28m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:49:17.151 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (17m) 10m ago 26m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:49:17.151 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (14m) 10m ago 28m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:49:17.151 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (14m) 10m ago 26m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:49:17.151 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (17m) 10m ago 27m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:49:17.151 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (17m) 10m ago 26m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:49:17.151 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (14m) 10m ago 25m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:49:17.151 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (13m) 10m ago 24m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:49:17.151 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (12m) 10m ago 24m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:49:17.151 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (12m) 10m ago 23m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:49:17.151 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (11m) 10m ago 23m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:49:17.151 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (11m) 10m ago 22m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:49:17.152 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (16m) 10m ago 26m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:49:17.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.151+0000 7fb033284640 1 -- 172.21.15.170:0/2680615285 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb018079e80 msgr2=0x7fb01807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:17.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.151+0000 7fb033284640 1 --2- 172.21.15.170:0/2680615285 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb018079e80 0x7fb01807c340 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb02c197f10 tx=0x7fb028031400 comp rx=0 tx=0).stop 2024-09-04T16:49:17.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.151+0000 7fb033284640 1 -- 172.21.15.170:0/2680615285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb02c1001c0 msgr2=0x7fb02c19c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:17.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.151+0000 7fb033284640 1 --2- 172.21.15.170:0/2680615285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb02c1001c0 0x7fb02c19c5f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb02000d6f0 tx=0x7fb02000dbb0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.152+0000 7fb033284640 1 -- 172.21.15.170:0/2680615285 shutdown_connections 2024-09-04T16:49:17.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.152+0000 7fb033284640 1 --2- 172.21.15.170:0/2680615285 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb018079e80 0x7fb01807c340 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.152+0000 7fb033284640 1 --2- 172.21.15.170:0/2680615285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb02c100b70 0x7fb02c19cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.152+0000 7fb033284640 1 --2- 172.21.15.170:0/2680615285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb02c1001c0 0x7fb02c19c5f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.152+0000 7fb033284640 1 -- 172.21.15.170:0/2680615285 >> 172.21.15.170:0/2680615285 conn(0x7fb02c0fbc40 msgr2=0x7fb02c0fd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:17.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.152+0000 7fb033284640 1 -- 172.21.15.170:0/2680615285 shutdown_connections 2024-09-04T16:49:17.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.152+0000 7fb033284640 1 -- 172.21.15.170:0/2680615285 wait complete. 2024-09-04T16:49:17.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.232+0000 7efef194e640 1 -- 172.21.15.170:0/279577139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efeec1007e0 msgr2=0x7efeec100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:17.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.232+0000 7efef194e640 1 --2- 172.21.15.170:0/279577139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efeec1007e0 0x7efeec100c40 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efed4009880 tx=0x7efed402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.232+0000 7efef194e640 1 -- 172.21.15.170:0/279577139 shutdown_connections 2024-09-04T16:49:17.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.232+0000 7efef194e640 1 --2- 172.21.15.170:0/279577139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efeec1007e0 0x7efeec100c40 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.232+0000 7efef194e640 1 --2- 172.21.15.170:0/279577139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efeec1067e0 0x7efeec106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.232+0000 7efef194e640 1 -- 172.21.15.170:0/279577139 >> 172.21.15.170:0/279577139 conn(0x7efeec0fc4c0 msgr2=0x7efeec0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:17.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.233+0000 7efef194e640 1 -- 172.21.15.170:0/279577139 shutdown_connections 2024-09-04T16:49:17.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.233+0000 7efef194e640 1 -- 172.21.15.170:0/279577139 wait complete. 2024-09-04T16:49:17.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.233+0000 7efef194e640 1 Processor -- start 2024-09-04T16:49:17.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.233+0000 7efef194e640 1 -- start start 2024-09-04T16:49:17.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.234+0000 7efef194e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efeec1007e0 0x7efeec1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:17.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.234+0000 7efef194e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efeec1067e0 0x7efeec198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:17.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.234+0000 7efef194e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efeec10dc90 con 0x7efeec1067e0 2024-09-04T16:49:17.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.234+0000 7efef194e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efeec10db10 con 0x7efeec1007e0 2024-09-04T16:49:17.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.234+0000 7efeea7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efeec1067e0 0x7efeec198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:17.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.234+0000 7efeea7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efeec1067e0 0x7efeec198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36468/0 (socket says 172.21.15.170:36468) 2024-09-04T16:49:17.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.234+0000 7efeea7fc640 1 -- 172.21.15.170:0/1462973124 learned_addr learned my addr 172.21.15.170:0/1462973124 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:49:17.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.234+0000 7efeeaffd640 1 --2- 172.21.15.170:0/1462973124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efeec1007e0 0x7efeec1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:17.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.234+0000 7efeea7fc640 1 -- 172.21.15.170:0/1462973124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efeec1007e0 msgr2=0x7efeec1987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:17.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.234+0000 7efeea7fc640 1 --2- 172.21.15.170:0/1462973124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efeec1007e0 0x7efeec1987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.234+0000 7efeea7fc640 1 -- 172.21.15.170:0/1462973124 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeec199300 con 0x7efeec1067e0 2024-09-04T16:49:17.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.234+0000 7efeea7fc640 1 --2- 172.21.15.170:0/1462973124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efeec1067e0 0x7efeec198d00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7efed4031460 tx=0x7efed40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:17.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.235+0000 7efef094c640 1 -- 172.21.15.170:0/1462973124 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efed403f070 con 0x7efeec1067e0 2024-09-04T16:49:17.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.235+0000 7efef094c640 1 -- 172.21.15.170:0/1462973124 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efed40035f0 con 0x7efeec1067e0 2024-09-04T16:49:17.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.235+0000 7efef194e640 1 -- 172.21.15.170:0/1462973124 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeec199590 con 0x7efeec1067e0 2024-09-04T16:49:17.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.235+0000 7efef094c640 1 -- 172.21.15.170:0/1462973124 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efed4035030 con 0x7efeec1067e0 2024-09-04T16:49:17.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.235+0000 7efef194e640 1 -- 172.21.15.170:0/1462973124 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeec1a1b40 con 0x7efeec1067e0 2024-09-04T16:49:17.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.236+0000 7efef194e640 1 -- 172.21.15.170:0/1462973124 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeec101f20 con 0x7efeec1067e0 2024-09-04T16:49:17.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.236+0000 7efef094c640 1 -- 172.21.15.170:0/1462973124 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7efed4042070 con 0x7efeec1067e0 2024-09-04T16:49:17.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.237+0000 7efef094c640 1 --2- 172.21.15.170:0/1462973124 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efed8079e30 0x7efed807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:17.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.238+0000 7efeeaffd640 1 --2- 172.21.15.170:0/1462973124 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efed8079e30 0x7efed807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:17.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.238+0000 7efef094c640 1 -- 172.21.15.170:0/1462973124 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7efed40bd120 con 0x7efeec1067e0 2024-09-04T16:49:17.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.238+0000 7efeeaffd640 1 --2- 172.21.15.170:0/1462973124 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efed8079e30 0x7efed807c2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efedc005fd0 tx=0x7efedc009870 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:17.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.242+0000 7efef094c640 1 -- 172.21.15.170:0/1462973124 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efed4084b30 con 0x7efeec1067e0 2024-09-04T16:49:17.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.487+0000 7efef194e640 1 -- 172.21.15.170:0/1462973124 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7efeec108d70 con 0x7efeec1067e0 2024-09-04T16:49:17.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.488+0000 7efef094c640 1 -- 172.21.15.170:0/1462973124 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7efed4088ca0 con 0x7efeec1067e0 2024-09-04T16:49:17.488 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:49:17.488 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:49:17.488 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:49:17.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:49:17.489 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:49:17.489 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:49:17.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:49:17.489 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:49:17.489 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:49:17.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:49:17.489 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:49:17.489 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:49:17.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:49:17.489 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:49:17.489 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:49:17.490 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:49:17.490 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:49:17.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.490+0000 7efef194e640 1 -- 172.21.15.170:0/1462973124 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efed8079e30 msgr2=0x7efed807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:17.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.490+0000 7efef194e640 1 --2- 172.21.15.170:0/1462973124 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efed8079e30 0x7efed807c2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efedc005fd0 tx=0x7efedc009870 comp rx=0 tx=0).stop 2024-09-04T16:49:17.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.490+0000 7efef194e640 1 -- 172.21.15.170:0/1462973124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efeec1067e0 msgr2=0x7efeec198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:17.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.490+0000 7efef194e640 1 --2- 172.21.15.170:0/1462973124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efeec1067e0 0x7efeec198d00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7efed4031460 tx=0x7efed40045e0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.490+0000 7efef194e640 1 -- 172.21.15.170:0/1462973124 shutdown_connections 2024-09-04T16:49:17.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.490+0000 7efef194e640 1 --2- 172.21.15.170:0/1462973124 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efed8079e30 0x7efed807c2f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.490+0000 7efef194e640 1 --2- 172.21.15.170:0/1462973124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efeec1067e0 0x7efeec198d00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.490+0000 7efef194e640 1 --2- 172.21.15.170:0/1462973124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efeec1007e0 0x7efeec1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.490+0000 7efef194e640 1 -- 172.21.15.170:0/1462973124 >> 172.21.15.170:0/1462973124 conn(0x7efeec0fc4c0 msgr2=0x7efeec0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:17.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.490+0000 7efef194e640 1 -- 172.21.15.170:0/1462973124 shutdown_connections 2024-09-04T16:49:17.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.490+0000 7efef194e640 1 -- 172.21.15.170:0/1462973124 wait complete. 2024-09-04T16:49:17.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.571+0000 7f2f6b705640 1 -- 172.21.15.170:0/2663881378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f64074590 msgr2=0x7f2f64074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:17.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.571+0000 7f2f6b705640 1 --2- 172.21.15.170:0/2663881378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f64074590 0x7f2f64074970 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009880 tx=0x7f2f6002a530 comp rx=0 tx=0).stop 2024-09-04T16:49:17.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.571+0000 7f2f6b705640 1 -- 172.21.15.170:0/2663881378 shutdown_connections 2024-09-04T16:49:17.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.571+0000 7f2f6b705640 1 --2- 172.21.15.170:0/2663881378 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f64074eb0 0x7f2f64112400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.571+0000 7f2f6b705640 1 --2- 172.21.15.170:0/2663881378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f64074590 0x7f2f64074970 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.571+0000 7f2f6b705640 1 -- 172.21.15.170:0/2663881378 >> 172.21.15.170:0/2663881378 conn(0x7f2f640fd630 msgr2=0x7f2f640ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:17.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.571+0000 7f2f6b705640 1 -- 172.21.15.170:0/2663881378 shutdown_connections 2024-09-04T16:49:17.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.571+0000 7f2f6b705640 1 -- 172.21.15.170:0/2663881378 wait complete. 2024-09-04T16:49:17.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.572+0000 7f2f6b705640 1 Processor -- start 2024-09-04T16:49:17.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.572+0000 7f2f6b705640 1 -- start start 2024-09-04T16:49:17.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.572+0000 7f2f6b705640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f64074590 0x7f2f6419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:17.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.572+0000 7f2f6b705640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f64074eb0 0x7f2f6419e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:17.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.572+0000 7f2f6b705640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2f64115470 con 0x7f2f64074590 2024-09-04T16:49:17.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.572+0000 7f2f6b705640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2f641152f0 con 0x7f2f64074eb0 2024-09-04T16:49:17.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.572+0000 7f2f694a1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f64074590 0x7f2f6419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:17.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.572+0000 7f2f694a1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f64074590 0x7f2f6419dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36482/0 (socket says 172.21.15.170:36482) 2024-09-04T16:49:17.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.572+0000 7f2f694a1640 1 -- 172.21.15.170:0/3348515287 learned_addr learned my addr 172.21.15.170:0/3348515287 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:49:17.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.573+0000 7f2f68ca0640 1 --2- 172.21.15.170:0/3348515287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f64074eb0 0x7f2f6419e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:17.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.573+0000 7f2f694a1640 1 -- 172.21.15.170:0/3348515287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f64074eb0 msgr2=0x7f2f6419e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:17.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.573+0000 7f2f694a1640 1 --2- 172.21.15.170:0/3348515287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f64074eb0 0x7f2f6419e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.573+0000 7f2f694a1640 1 -- 172.21.15.170:0/3348515287 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f641a28c0 con 0x7f2f64074590 2024-09-04T16:49:17.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.573+0000 7f2f694a1640 1 --2- 172.21.15.170:0/3348515287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f64074590 0x7f2f6419dff0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2f60031460 tx=0x7f2f600048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:17.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.573+0000 7f2f5a7fc640 1 -- 172.21.15.170:0/3348515287 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f6003f070 con 0x7f2f64074590 2024-09-04T16:49:17.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.573+0000 7f2f5a7fc640 1 -- 172.21.15.170:0/3348515287 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f60004cf0 con 0x7f2f64074590 2024-09-04T16:49:17.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.573+0000 7f2f6b705640 1 -- 172.21.15.170:0/3348515287 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f641a2b50 con 0x7f2f64074590 2024-09-04T16:49:17.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.573+0000 7f2f5a7fc640 1 -- 172.21.15.170:0/3348515287 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f60035030 con 0x7f2f64074590 2024-09-04T16:49:17.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.573+0000 7f2f6b705640 1 -- 172.21.15.170:0/3348515287 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f641a3080 con 0x7f2f64074590 2024-09-04T16:49:17.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.574+0000 7f2f6b705640 1 -- 172.21.15.170:0/3348515287 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f64075cd0 con 0x7f2f64074590 2024-09-04T16:49:17.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.575+0000 7f2f5a7fc640 1 -- 172.21.15.170:0/3348515287 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f2f60042070 con 0x7f2f64074590 2024-09-04T16:49:17.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.575+0000 7f2f5a7fc640 1 --2- 172.21.15.170:0/3348515287 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f50079e30 0x7f2f5007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:17.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.575+0000 7f2f5a7fc640 1 -- 172.21.15.170:0/3348515287 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2f600bd5d0 con 0x7f2f64074590 2024-09-04T16:49:17.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.575+0000 7f2f68ca0640 1 --2- 172.21.15.170:0/3348515287 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f50079e30 0x7f2f5007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:17.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.576+0000 7f2f68ca0640 1 --2- 172.21.15.170:0/3348515287 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f50079e30 0x7f2f5007c2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2f64104820 tx=0x7f2f54008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:17.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.580+0000 7f2f5a7fc640 1 -- 172.21.15.170:0/3348515287 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2f60084fe0 con 0x7f2f64074590 2024-09-04T16:49:17.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.787+0000 7f2f6b705640 1 -- 172.21.15.170:0/3348515287 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f2f6419f380 con 0x7f2f64074590 2024-09-04T16:49:17.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.788+0000 7f2f5a7fc640 1 -- 172.21.15.170:0/3348515287 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7f2f6419f380 con 0x7f2f64074590 2024-09-04T16:49:17.789 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:49:17.789 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:49:17.789 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:49:17.789 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:49:17.789 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:49:17.789 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:49:17.789 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:49:17.789 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:49:17.789 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:49:17.789 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:49:17.789 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:49:17.789 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:49:17.790 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:49:17.790 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:49:17.790 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:49:17.790 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:49:17.790 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:49:17.790 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:49:17.790 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:49:17.790 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:49:17.790 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:49:17.790 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:49:17.790 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:49:17.790 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:49:17.790 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:49:17.790 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:49:17.791 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:49:17.791 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:49:17.791 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:49:17.791 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:49:17.791 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:49:17.791 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:49:17.791 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:49:17.791 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:49:17.791 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:49:17.791 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:49:17.791 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:49:17.791 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:49:17.791 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:49:17.792 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:49:17.792 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:49:17.792 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:49:17.792 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:49:17.793 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:49:17.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.790+0000 7f2f6b705640 1 -- 172.21.15.170:0/3348515287 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f50079e30 msgr2=0x7f2f5007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:17.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.790+0000 7f2f6b705640 1 --2- 172.21.15.170:0/3348515287 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f50079e30 0x7f2f5007c2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2f64104820 tx=0x7f2f54008040 comp rx=0 tx=0).stop 2024-09-04T16:49:17.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.790+0000 7f2f6b705640 1 -- 172.21.15.170:0/3348515287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f64074590 msgr2=0x7f2f6419dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:17.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.790+0000 7f2f6b705640 1 --2- 172.21.15.170:0/3348515287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f64074590 0x7f2f6419dff0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2f60031460 tx=0x7f2f600048f0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.790+0000 7f2f6b705640 1 -- 172.21.15.170:0/3348515287 shutdown_connections 2024-09-04T16:49:17.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.790+0000 7f2f6b705640 1 --2- 172.21.15.170:0/3348515287 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2f50079e30 0x7f2f5007c2f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.790+0000 7f2f6b705640 1 --2- 172.21.15.170:0/3348515287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f64074eb0 0x7f2f6419e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.790+0000 7f2f6b705640 1 --2- 172.21.15.170:0/3348515287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f64074590 0x7f2f6419dff0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.790+0000 7f2f6b705640 1 -- 172.21.15.170:0/3348515287 >> 172.21.15.170:0/3348515287 conn(0x7f2f640fd630 msgr2=0x7f2f64104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:17.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.790+0000 7f2f6b705640 1 -- 172.21.15.170:0/3348515287 shutdown_connections 2024-09-04T16:49:17.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.790+0000 7f2f6b705640 1 -- 172.21.15.170:0/3348515287 wait complete. 2024-09-04T16:49:17.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.874+0000 7fdc6bdc6640 1 -- 172.21.15.170:0/1672117584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc641067e0 msgr2=0x7fdc64106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:17.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.874+0000 7fdc6bdc6640 1 --2- 172.21.15.170:0/1672117584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc641067e0 0x7fdc64106bc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fdc60009880 tx=0x7fdc6002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.874+0000 7fdc6bdc6640 1 -- 172.21.15.170:0/1672117584 shutdown_connections 2024-09-04T16:49:17.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.874+0000 7fdc6bdc6640 1 --2- 172.21.15.170:0/1672117584 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc641007e0 0x7fdc64100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.874+0000 7fdc6bdc6640 1 --2- 172.21.15.170:0/1672117584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc641067e0 0x7fdc64106bc0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.874+0000 7fdc6bdc6640 1 -- 172.21.15.170:0/1672117584 >> 172.21.15.170:0/1672117584 conn(0x7fdc640fc4c0 msgr2=0x7fdc640fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:17.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.875+0000 7fdc6bdc6640 1 -- 172.21.15.170:0/1672117584 shutdown_connections 2024-09-04T16:49:17.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.875+0000 7fdc6bdc6640 1 -- 172.21.15.170:0/1672117584 wait complete. 2024-09-04T16:49:17.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.875+0000 7fdc6bdc6640 1 Processor -- start 2024-09-04T16:49:17.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.875+0000 7fdc6bdc6640 1 -- start start 2024-09-04T16:49:17.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.875+0000 7fdc6bdc6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc641007e0 0x7fdc640fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:17.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.875+0000 7fdc6bdc6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc641067e0 0x7fdc640fd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:17.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.875+0000 7fdc6bdc6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6410dcb0 con 0x7fdc641067e0 2024-09-04T16:49:17.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.875+0000 7fdc6bdc6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6410db30 con 0x7fdc641007e0 2024-09-04T16:49:17.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.876+0000 7fdc69361640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc641067e0 0x7fdc640fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:17.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.876+0000 7fdc69361640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc641067e0 0x7fdc640fd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36500/0 (socket says 172.21.15.170:36500) 2024-09-04T16:49:17.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.876+0000 7fdc69361640 1 -- 172.21.15.170:0/1014086242 learned_addr learned my addr 172.21.15.170:0/1014086242 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:49:17.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.876+0000 7fdc69b62640 1 --2- 172.21.15.170:0/1014086242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc641007e0 0x7fdc640fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:17.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.876+0000 7fdc69361640 1 -- 172.21.15.170:0/1014086242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc641007e0 msgr2=0x7fdc640fcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:17.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.876+0000 7fdc69361640 1 --2- 172.21.15.170:0/1014086242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc641007e0 0x7fdc640fcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:17.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.876+0000 7fdc69361640 1 -- 172.21.15.170:0/1014086242 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc640fd6d0 con 0x7fdc641067e0 2024-09-04T16:49:17.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.876+0000 7fdc69361640 1 --2- 172.21.15.170:0/1014086242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc641067e0 0x7fdc640fd190 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400d6f0 tx=0x7fdc5400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:17.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.876+0000 7fdc5affd640 1 -- 172.21.15.170:0/1014086242 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdc54017070 con 0x7fdc641067e0 2024-09-04T16:49:17.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.876+0000 7fdc5affd640 1 -- 172.21.15.170:0/1014086242 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdc5400de00 con 0x7fdc641067e0 2024-09-04T16:49:17.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.876+0000 7fdc6bdc6640 1 -- 172.21.15.170:0/1014086242 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc640fd9c0 con 0x7fdc641067e0 2024-09-04T16:49:17.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.876+0000 7fdc5affd640 1 -- 172.21.15.170:0/1014086242 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdc54004bb0 con 0x7fdc641067e0 2024-09-04T16:49:17.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.876+0000 7fdc6bdc6640 1 -- 172.21.15.170:0/1014086242 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc641a3e10 con 0x7fdc641067e0 2024-09-04T16:49:17.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.877+0000 7fdc6bdc6640 1 -- 172.21.15.170:0/1014086242 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc64101f20 con 0x7fdc641067e0 2024-09-04T16:49:17.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.878+0000 7fdc5affd640 1 -- 172.21.15.170:0/1014086242 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fdc54009a30 con 0x7fdc641067e0 2024-09-04T16:49:17.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.878+0000 7fdc5affd640 1 --2- 172.21.15.170:0/1014086242 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdc50079e80 0x7fdc5007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:17.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.878+0000 7fdc5affd640 1 -- 172.21.15.170:0/1014086242 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fdc5409c570 con 0x7fdc641067e0 2024-09-04T16:49:17.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.878+0000 7fdc69b62640 1 --2- 172.21.15.170:0/1014086242 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdc50079e80 0x7fdc5007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:17.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.879+0000 7fdc69b62640 1 --2- 172.21.15.170:0/1014086242 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdc50079e80 0x7fdc5007c340 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdc600096c0 tx=0x7fdc60031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:17.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:17.883+0000 7fdc5affd640 1 -- 172.21.15.170:0/1014086242 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdc54068170 con 0x7fdc641067e0 2024-09-04T16:49:18.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.073+0000 7fdc6bdc6640 1 -- 172.21.15.170:0/1014086242 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fdc64062630 con 0x7fdc50079e80 2024-09-04T16:49:18.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.074+0000 7fdc5affd640 1 -- 172.21.15.170:0/1014086242 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fdc64062630 con 0x7fdc50079e80 2024-09-04T16:49:18.075 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:49:18.075 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:49:18.075 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:49:18.075 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:49:18.075 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:49:18.075 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:49:18.075 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:49:18.076 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:49:18.076 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:49:18.076 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:49:18.076 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:49:18.076 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:49:18.076 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:49:18.076 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:49:18.076 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:49:18.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.076+0000 7fdc6bdc6640 1 -- 172.21.15.170:0/1014086242 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdc50079e80 msgr2=0x7fdc5007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:18.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.076+0000 7fdc6bdc6640 1 --2- 172.21.15.170:0/1014086242 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdc50079e80 0x7fdc5007c340 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdc600096c0 tx=0x7fdc60031400 comp rx=0 tx=0).stop 2024-09-04T16:49:18.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.076+0000 7fdc6bdc6640 1 -- 172.21.15.170:0/1014086242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc641067e0 msgr2=0x7fdc640fd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:18.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.076+0000 7fdc6bdc6640 1 --2- 172.21.15.170:0/1014086242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc641067e0 0x7fdc640fd190 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400d6f0 tx=0x7fdc5400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:49:18.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.076+0000 7fdc6bdc6640 1 -- 172.21.15.170:0/1014086242 shutdown_connections 2024-09-04T16:49:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.077+0000 7fdc6bdc6640 1 --2- 172.21.15.170:0/1014086242 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdc50079e80 0x7fdc5007c340 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.077+0000 7fdc6bdc6640 1 --2- 172.21.15.170:0/1014086242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc641067e0 0x7fdc640fd190 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.077+0000 7fdc6bdc6640 1 --2- 172.21.15.170:0/1014086242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc641007e0 0x7fdc640fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.077+0000 7fdc6bdc6640 1 -- 172.21.15.170:0/1014086242 >> 172.21.15.170:0/1014086242 conn(0x7fdc640fc4c0 msgr2=0x7fdc64069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.077+0000 7fdc6bdc6640 1 -- 172.21.15.170:0/1014086242 shutdown_connections 2024-09-04T16:49:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.077+0000 7fdc6bdc6640 1 -- 172.21.15.170:0/1014086242 wait complete. 2024-09-04T16:49:18.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.158+0000 7fd6fcde9640 1 -- 172.21.15.170:0/975046922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6f8101930 msgr2=0x7fd6f8101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:18.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.158+0000 7fd6fcde9640 1 --2- 172.21.15.170:0/975046922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6f8101930 0x7fd6f8101d90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009880 tx=0x7fd6e002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:49:18.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.158+0000 7fd6fcde9640 1 -- 172.21.15.170:0/975046922 shutdown_connections 2024-09-04T16:49:18.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.158+0000 7fd6fcde9640 1 --2- 172.21.15.170:0/975046922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6f8101930 0x7fd6f8101d90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:18.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.158+0000 7fd6fcde9640 1 --2- 172.21.15.170:0/975046922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6f8107930 0x7fd6f8107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:18.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.158+0000 7fd6fcde9640 1 -- 172.21.15.170:0/975046922 >> 172.21.15.170:0/975046922 conn(0x7fd6f80fd630 msgr2=0x7fd6f80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:18.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.158+0000 7fd6fcde9640 1 -- 172.21.15.170:0/975046922 shutdown_connections 2024-09-04T16:49:18.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.158+0000 7fd6fcde9640 1 -- 172.21.15.170:0/975046922 wait complete. 2024-09-04T16:49:18.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.159+0000 7fd6fcde9640 1 Processor -- start 2024-09-04T16:49:18.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.159+0000 7fd6fcde9640 1 -- start start 2024-09-04T16:49:18.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.159+0000 7fd6fcde9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6f8101930 0x7fd6f819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:18.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.159+0000 7fd6fcde9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6f8107930 0x7fd6f819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:18.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.159+0000 7fd6fcde9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f810ede0 con 0x7fd6f8107930 2024-09-04T16:49:18.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.159+0000 7fd6fcde9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f810ec60 con 0x7fd6f8101930 2024-09-04T16:49:18.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.159+0000 7fd6f5d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6f8107930 0x7fd6f819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.159+0000 7fd6f5d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6f8107930 0x7fd6f819dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36516/0 (socket says 172.21.15.170:36516) 2024-09-04T16:49:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.159+0000 7fd6f5d9b640 1 -- 172.21.15.170:0/1140177989 learned_addr learned my addr 172.21.15.170:0/1140177989 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:49:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.160+0000 7fd6f659c640 1 --2- 172.21.15.170:0/1140177989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6f8101930 0x7fd6f819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.160+0000 7fd6f5d9b640 1 -- 172.21.15.170:0/1140177989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6f8101930 msgr2=0x7fd6f819d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.160+0000 7fd6f5d9b640 1 --2- 172.21.15.170:0/1140177989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6f8101930 0x7fd6f819d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.160+0000 7fd6f5d9b640 1 -- 172.21.15.170:0/1140177989 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f8197850 con 0x7fd6f8107930 2024-09-04T16:49:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.160+0000 7fd6f5d9b640 1 --2- 172.21.15.170:0/1140177989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6f8107930 0x7fd6f819dc10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0031460 tx=0x7fd6e00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.160+0000 7fd6ef7fe640 1 -- 172.21.15.170:0/1140177989 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd6e003f070 con 0x7fd6f8107930 2024-09-04T16:49:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.160+0000 7fd6ef7fe640 1 -- 172.21.15.170:0/1140177989 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd6e0004cf0 con 0x7fd6f8107930 2024-09-04T16:49:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.160+0000 7fd6ef7fe640 1 -- 172.21.15.170:0/1140177989 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd6e0035030 con 0x7fd6f8107930 2024-09-04T16:49:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.160+0000 7fd6fcde9640 1 -- 172.21.15.170:0/1140177989 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f8197ae0 con 0x7fd6f8107930 2024-09-04T16:49:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.160+0000 7fd6fcde9640 1 -- 172.21.15.170:0/1140177989 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f8198010 con 0x7fd6f8107930 2024-09-04T16:49:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.161+0000 7fd6fcde9640 1 -- 172.21.15.170:0/1140177989 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f8103070 con 0x7fd6f8107930 2024-09-04T16:49:18.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.162+0000 7fd6ef7fe640 1 -- 172.21.15.170:0/1140177989 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fd6e0042070 con 0x7fd6f8107930 2024-09-04T16:49:18.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.162+0000 7fd6ef7fe640 1 --2- 172.21.15.170:0/1140177989 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd6e4079e30 0x7fd6e407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:18.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.162+0000 7fd6ef7fe640 1 -- 172.21.15.170:0/1140177989 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd6e00bd520 con 0x7fd6f8107930 2024-09-04T16:49:18.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.162+0000 7fd6f659c640 1 --2- 172.21.15.170:0/1140177989 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd6e4079e30 0x7fd6e407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:18.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.163+0000 7fd6f659c640 1 --2- 172.21.15.170:0/1140177989 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd6e4079e30 0x7fd6e407c2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8005e10 tx=0x7fd6e8005da0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:18.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.167+0000 7fd6ef7fe640 1 -- 172.21.15.170:0/1140177989 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd6e0084f30 con 0x7fd6f8107930 2024-09-04T16:49:18.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.417+0000 7fd6fcde9640 1 -- 172.21.15.170:0/1140177989 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fd6f8198d80 con 0x7fd6f8107930 2024-09-04T16:49:18.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.417+0000 7fd6ef7fe640 1 -- 172.21.15.170:0/1140177989 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fd6e008d3e0 con 0x7fd6f8107930 2024-09-04T16:49:18.418 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:49:18.418 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:49:18.418 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:49:18.418 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:49:18.418 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:49:18.418 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:49:18.418 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:49:18.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.419+0000 7fd6fcde9640 1 -- 172.21.15.170:0/1140177989 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd6e4079e30 msgr2=0x7fd6e407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:18.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.419+0000 7fd6fcde9640 1 --2- 172.21.15.170:0/1140177989 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd6e4079e30 0x7fd6e407c2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8005e10 tx=0x7fd6e8005da0 comp rx=0 tx=0).stop 2024-09-04T16:49:18.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.419+0000 7fd6fcde9640 1 -- 172.21.15.170:0/1140177989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6f8107930 msgr2=0x7fd6f819dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:18.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.419+0000 7fd6fcde9640 1 --2- 172.21.15.170:0/1140177989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6f8107930 0x7fd6f819dc10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0031460 tx=0x7fd6e00048f0 comp rx=0 tx=0).stop 2024-09-04T16:49:18.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.419+0000 7fd6fcde9640 1 -- 172.21.15.170:0/1140177989 shutdown_connections 2024-09-04T16:49:18.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.419+0000 7fd6fcde9640 1 --2- 172.21.15.170:0/1140177989 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd6e4079e30 0x7fd6e407c2f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:18.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.419+0000 7fd6fcde9640 1 --2- 172.21.15.170:0/1140177989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6f8107930 0x7fd6f819dc10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:18.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.419+0000 7fd6fcde9640 1 --2- 172.21.15.170:0/1140177989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6f8101930 0x7fd6f819d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:18.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.419+0000 7fd6fcde9640 1 -- 172.21.15.170:0/1140177989 >> 172.21.15.170:0/1140177989 conn(0x7fd6f80fd630 msgr2=0x7fd6f80fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:18.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.419+0000 7fd6fcde9640 1 -- 172.21.15.170:0/1140177989 shutdown_connections 2024-09-04T16:49:18.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:18.419+0000 7fd6fcde9640 1 -- 172.21.15.170:0/1140177989 wait complete. 2024-09-04T16:49:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:18 smithi193 ceph-mon[82547]: from='client.34894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:49:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:18 smithi193 ceph-mon[82547]: pgmap v587: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:18 smithi193 ceph-mon[82547]: from='client.34898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:49:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:18 smithi193 ceph-mon[82547]: from='client.34902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:49:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:18 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1462973124' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:49:18.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:18 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3348515287' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:49:18.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:18 smithi170 ceph-mon[113855]: from='client.34894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:49:18.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:18 smithi170 ceph-mon[113855]: pgmap v587: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:18.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:18 smithi170 ceph-mon[113855]: from='client.34898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:49:18.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:18 smithi170 ceph-mon[113855]: from='client.34902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:49:18.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:18 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1462973124' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:49:18.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:18 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3348515287' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:49:19.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:19 smithi193 ceph-mon[82547]: from='client.34914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:49:19.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:19 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1140177989' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:49:19.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:19 smithi170 ceph-mon[113855]: from='client.34914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:49:19.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:19 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1140177989' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:49:20.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:20 smithi170 ceph-mon[113855]: pgmap v588: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:20.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:20 smithi193 ceph-mon[82547]: pgmap v588: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:22 smithi193 ceph-mon[82547]: pgmap v589: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:22.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:22 smithi170 ceph-mon[113855]: pgmap v589: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:24.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:24 smithi170 ceph-mon[113855]: pgmap v590: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:24.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:24 smithi193 ceph-mon[82547]: pgmap v590: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:26 smithi193 ceph-mon[82547]: pgmap v591: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:26.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:26 smithi170 ceph-mon[113855]: pgmap v591: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:28.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:28 smithi170 ceph-mon[113855]: pgmap v592: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:28.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:28 smithi193 ceph-mon[82547]: pgmap v592: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:29.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:49:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:49:30.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:30 smithi170 ceph-mon[113855]: pgmap v593: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:30.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:30 smithi193 ceph-mon[82547]: pgmap v593: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:32.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:32 smithi170 ceph-mon[113855]: pgmap v594: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:32.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:32 smithi193 ceph-mon[82547]: pgmap v594: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:34.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:34 smithi170 ceph-mon[113855]: pgmap v595: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:34.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:34 smithi193 ceph-mon[82547]: pgmap v595: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:36.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:36 smithi170 ceph-mon[113855]: pgmap v596: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:36 smithi193 ceph-mon[82547]: pgmap v596: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:38.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:38 smithi170 ceph-mon[113855]: pgmap v597: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:38 smithi193 ceph-mon[82547]: pgmap v597: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:40.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:40 smithi170 ceph-mon[113855]: pgmap v598: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:40.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:40 smithi193 ceph-mon[82547]: pgmap v598: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:42.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:42 smithi170 ceph-mon[113855]: pgmap v599: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:42 smithi193 ceph-mon[82547]: pgmap v599: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:44.780 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:44 smithi193 ceph-mon[82547]: pgmap v600: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:44.780 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:49:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:44 smithi170 ceph-mon[113855]: pgmap v600: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:49:46.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:46 smithi170 ceph-mon[113855]: pgmap v601: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:46.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:46 smithi193 ceph-mon[82547]: pgmap v601: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:48.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.514+0000 7f5ce8e57640 1 -- 172.21.15.170:0/1114044476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce41067e0 msgr2=0x7f5ce4106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:48.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.514+0000 7f5ce8e57640 1 --2- 172.21.15.170:0/1114044476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce41067e0 0x7f5ce4106bc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009c20 tx=0x7f5cd402a970 comp rx=0 tx=0).stop 2024-09-04T16:49:48.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:48 smithi170 ceph-mon[113855]: pgmap v602: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:48.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.514+0000 7f5ce8e57640 1 -- 172.21.15.170:0/1114044476 shutdown_connections 2024-09-04T16:49:48.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.514+0000 7f5ce8e57640 1 --2- 172.21.15.170:0/1114044476 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ce41007e0 0x7f5ce4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:48.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.514+0000 7f5ce8e57640 1 --2- 172.21.15.170:0/1114044476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce41067e0 0x7f5ce4106bc0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:48.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.514+0000 7f5ce8e57640 1 -- 172.21.15.170:0/1114044476 >> 172.21.15.170:0/1114044476 conn(0x7f5ce40fc4c0 msgr2=0x7f5ce40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:48.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.514+0000 7f5ce8e57640 1 -- 172.21.15.170:0/1114044476 shutdown_connections 2024-09-04T16:49:48.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.514+0000 7f5ce8e57640 1 -- 172.21.15.170:0/1114044476 wait complete. 2024-09-04T16:49:48.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.515+0000 7f5ce8e57640 1 Processor -- start 2024-09-04T16:49:48.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.515+0000 7f5ce8e57640 1 -- start start 2024-09-04T16:49:48.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.515+0000 7f5ce8e57640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce41007e0 0x7f5ce419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:48.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.515+0000 7f5ce8e57640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ce41067e0 0x7f5ce419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:48.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.515+0000 7f5ce8e57640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce410dcb0 con 0x7f5ce41007e0 2024-09-04T16:49:48.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.515+0000 7f5ce8e57640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce410db30 con 0x7f5ce41067e0 2024-09-04T16:49:48.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.515+0000 7f5ce259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce41007e0 0x7f5ce419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:48.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.516+0000 7f5ce259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce41007e0 0x7f5ce419d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60262/0 (socket says 172.21.15.170:60262) 2024-09-04T16:49:48.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.516+0000 7f5ce259c640 1 -- 172.21.15.170:0/4114403485 learned_addr learned my addr 172.21.15.170:0/4114403485 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:49:48.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.516+0000 7f5ce1d9b640 1 --2- 172.21.15.170:0/4114403485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ce41067e0 0x7f5ce419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:48.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.516+0000 7f5ce259c640 1 -- 172.21.15.170:0/4114403485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ce41067e0 msgr2=0x7f5ce419db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:48.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.516+0000 7f5ce259c640 1 --2- 172.21.15.170:0/4114403485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ce41067e0 0x7f5ce419db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:48.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.516+0000 7f5ce259c640 1 -- 172.21.15.170:0/4114403485 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce4197790 con 0x7f5ce41007e0 2024-09-04T16:49:48.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.516+0000 7f5ce259c640 1 --2- 172.21.15.170:0/4114403485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce41007e0 0x7f5ce419d610 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4006010 tx=0x7f5cd402f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:48.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.516+0000 7f5cd37fe640 1 -- 172.21.15.170:0/4114403485 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5cd4047070 con 0x7f5ce41007e0 2024-09-04T16:49:48.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.516+0000 7f5cd37fe640 1 -- 172.21.15.170:0/4114403485 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5cd402f7e0 con 0x7f5ce41007e0 2024-09-04T16:49:48.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.516+0000 7f5ce8e57640 1 -- 172.21.15.170:0/4114403485 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce4197a20 con 0x7f5ce41007e0 2024-09-04T16:49:48.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.516+0000 7f5cd37fe640 1 -- 172.21.15.170:0/4114403485 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5cd4034070 con 0x7f5ce41007e0 2024-09-04T16:49:48.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.516+0000 7f5ce8e57640 1 -- 172.21.15.170:0/4114403485 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce4197f50 con 0x7f5ce41007e0 2024-09-04T16:49:48.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.518+0000 7f5ce8e57640 1 -- 172.21.15.170:0/4114403485 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce4101f20 con 0x7f5ce41007e0 2024-09-04T16:49:48.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.518+0000 7f5cd37fe640 1 -- 172.21.15.170:0/4114403485 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5cd404a070 con 0x7f5ce41007e0 2024-09-04T16:49:48.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.519+0000 7f5cd37fe640 1 --2- 172.21.15.170:0/4114403485 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5ccc079e90 0x7f5ccc07c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:48.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.519+0000 7f5cd37fe640 1 -- 172.21.15.170:0/4114403485 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5cd40bd850 con 0x7f5ce41007e0 2024-09-04T16:49:48.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.519+0000 7f5ce1d9b640 1 --2- 172.21.15.170:0/4114403485 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5ccc079e90 0x7f5ccc07c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:48.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.519+0000 7f5ce1d9b640 1 --2- 172.21.15.170:0/4114403485 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5ccc079e90 0x7f5ccc07c350 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4105f20 tx=0x7f5cd800a250 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:48.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.523+0000 7f5cd37fe640 1 -- 172.21.15.170:0/4114403485 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5cd403f070 con 0x7f5ce41007e0 2024-09-04T16:49:48.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.715+0000 7f5ce8e57640 1 -- 172.21.15.170:0/4114403485 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5ce41982c0 con 0x7f5ccc079e90 2024-09-04T16:49:48.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.716+0000 7f5cd37fe640 1 -- 172.21.15.170:0/4114403485 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5ce41982c0 con 0x7f5ccc079e90 2024-09-04T16:49:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.718+0000 7f5ce8e57640 1 -- 172.21.15.170:0/4114403485 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5ccc079e90 msgr2=0x7f5ccc07c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.718+0000 7f5ce8e57640 1 --2- 172.21.15.170:0/4114403485 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5ccc079e90 0x7f5ccc07c350 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4105f20 tx=0x7f5cd800a250 comp rx=0 tx=0).stop 2024-09-04T16:49:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.718+0000 7f5ce8e57640 1 -- 172.21.15.170:0/4114403485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce41007e0 msgr2=0x7f5ce419d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.718+0000 7f5ce8e57640 1 --2- 172.21.15.170:0/4114403485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce41007e0 0x7f5ce419d610 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4006010 tx=0x7f5cd402f5f0 comp rx=0 tx=0).stop 2024-09-04T16:49:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.718+0000 7f5ce8e57640 1 -- 172.21.15.170:0/4114403485 shutdown_connections 2024-09-04T16:49:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.718+0000 7f5ce8e57640 1 --2- 172.21.15.170:0/4114403485 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5ccc079e90 0x7f5ccc07c350 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.718+0000 7f5ce8e57640 1 --2- 172.21.15.170:0/4114403485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ce41067e0 0x7f5ce419db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.718+0000 7f5ce8e57640 1 --2- 172.21.15.170:0/4114403485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce41007e0 0x7f5ce419d610 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.718+0000 7f5ce8e57640 1 -- 172.21.15.170:0/4114403485 >> 172.21.15.170:0/4114403485 conn(0x7f5ce40fc4c0 msgr2=0x7f5ce4069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:48.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.718+0000 7f5ce8e57640 1 -- 172.21.15.170:0/4114403485 shutdown_connections 2024-09-04T16:49:48.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.718+0000 7f5ce8e57640 1 -- 172.21.15.170:0/4114403485 wait complete. 2024-09-04T16:49:48.728 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:49:48.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.805+0000 7f891e960640 1 -- 172.21.15.170:0/750979620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8918100820 msgr2=0x7f8918100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:48.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.805+0000 7f891e960640 1 --2- 172.21.15.170:0/750979620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8918100820 0x7f8918100c80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8900009880 tx=0x7f890002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:49:48.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.805+0000 7f891e960640 1 -- 172.21.15.170:0/750979620 shutdown_connections 2024-09-04T16:49:48.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.805+0000 7f891e960640 1 --2- 172.21.15.170:0/750979620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8918100820 0x7f8918100c80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:48.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.805+0000 7f891e960640 1 --2- 172.21.15.170:0/750979620 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8918106820 0x7f8918106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:48.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.805+0000 7f891e960640 1 -- 172.21.15.170:0/750979620 >> 172.21.15.170:0/750979620 conn(0x7f89180fc520 msgr2=0x7f89180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:48.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.805+0000 7f891e960640 1 -- 172.21.15.170:0/750979620 shutdown_connections 2024-09-04T16:49:48.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.805+0000 7f891e960640 1 -- 172.21.15.170:0/750979620 wait complete. 2024-09-04T16:49:48.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.805+0000 7f891e960640 1 Processor -- start 2024-09-04T16:49:48.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.805+0000 7f891e960640 1 -- start start 2024-09-04T16:49:48.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.806+0000 7f891e960640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8918100820 0x7f891819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:48.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.806+0000 7f891e960640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8918106820 0x7f891819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:48.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.806+0000 7f891e960640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f891810dcd0 con 0x7f8918106820 2024-09-04T16:49:48.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.806+0000 7f891e960640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f891810db50 con 0x7f8918100820 2024-09-04T16:49:48.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.806+0000 7f89177fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8918106820 0x7f891819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:48.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.806+0000 7f89177fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8918106820 0x7f891819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60272/0 (socket says 172.21.15.170:60272) 2024-09-04T16:49:48.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.806+0000 7f8917fff640 1 --2- 172.21.15.170:0/329701254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8918100820 0x7f891819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:48.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.806+0000 7f89177fe640 1 -- 172.21.15.170:0/329701254 learned_addr learned my addr 172.21.15.170:0/329701254 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:49:48.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.806+0000 7f89177fe640 1 -- 172.21.15.170:0/329701254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8918100820 msgr2=0x7f891819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:48.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.806+0000 7f89177fe640 1 --2- 172.21.15.170:0/329701254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8918100820 0x7f891819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:48.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.806+0000 7f89177fe640 1 -- 172.21.15.170:0/329701254 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89181977f0 con 0x7f8918106820 2024-09-04T16:49:48.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.807+0000 7f89177fe640 1 --2- 172.21.15.170:0/329701254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8918106820 0x7f891819dbb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8900031460 tx=0x7f89000045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:48.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.807+0000 7f89157fa640 1 -- 172.21.15.170:0/329701254 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f890003f070 con 0x7f8918106820 2024-09-04T16:49:48.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.807+0000 7f89157fa640 1 -- 172.21.15.170:0/329701254 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f89000035f0 con 0x7f8918106820 2024-09-04T16:49:48.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.807+0000 7f89157fa640 1 -- 172.21.15.170:0/329701254 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8900035030 con 0x7f8918106820 2024-09-04T16:49:48.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.807+0000 7f891e960640 1 -- 172.21.15.170:0/329701254 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8918197a80 con 0x7f8918106820 2024-09-04T16:49:48.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.808+0000 7f891e960640 1 -- 172.21.15.170:0/329701254 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8918197fb0 con 0x7f8918106820 2024-09-04T16:49:48.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.809+0000 7f891e960640 1 -- 172.21.15.170:0/329701254 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8918101f60 con 0x7f8918106820 2024-09-04T16:49:48.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.809+0000 7f89157fa640 1 -- 172.21.15.170:0/329701254 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f8900042070 con 0x7f8918106820 2024-09-04T16:49:48.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.810+0000 7f89157fa640 1 --2- 172.21.15.170:0/329701254 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8904079e80 0x7f890407c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:48.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.810+0000 7f8917fff640 1 --2- 172.21.15.170:0/329701254 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8904079e80 0x7f890407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:48.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.810+0000 7f89157fa640 1 -- 172.21.15.170:0/329701254 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f89000bd300 con 0x7f8918106820 2024-09-04T16:49:48.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.811+0000 7f8917fff640 1 --2- 172.21.15.170:0/329701254 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8904079e80 0x7f890407c340 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8908005d00 tx=0x7f890800f820 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:48.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:48.814+0000 7f89157fa640 1 -- 172.21.15.170:0/329701254 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8900088f00 con 0x7f8918106820 2024-09-04T16:49:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:48 smithi193 ceph-mon[82547]: pgmap v602: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:49.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.009+0000 7f891e960640 1 -- 172.21.15.170:0/329701254 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8918198260 con 0x7f8904079e80 2024-09-04T16:49:49.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.010+0000 7f89157fa640 1 -- 172.21.15.170:0/329701254 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8918198260 con 0x7f8904079e80 2024-09-04T16:49:49.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.013+0000 7f891e960640 1 -- 172.21.15.170:0/329701254 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8904079e80 msgr2=0x7f890407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:49.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.013+0000 7f891e960640 1 --2- 172.21.15.170:0/329701254 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8904079e80 0x7f890407c340 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8908005d00 tx=0x7f890800f820 comp rx=0 tx=0).stop 2024-09-04T16:49:49.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.013+0000 7f891e960640 1 -- 172.21.15.170:0/329701254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8918106820 msgr2=0x7f891819dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:49.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.013+0000 7f891e960640 1 --2- 172.21.15.170:0/329701254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8918106820 0x7f891819dbb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8900031460 tx=0x7f89000045e0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.013+0000 7f891e960640 1 -- 172.21.15.170:0/329701254 shutdown_connections 2024-09-04T16:49:49.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.013+0000 7f891e960640 1 --2- 172.21.15.170:0/329701254 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8904079e80 0x7f890407c340 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.013+0000 7f891e960640 1 --2- 172.21.15.170:0/329701254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8918106820 0x7f891819dbb0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.013+0000 7f891e960640 1 --2- 172.21.15.170:0/329701254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8918100820 0x7f891819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.013+0000 7f891e960640 1 -- 172.21.15.170:0/329701254 >> 172.21.15.170:0/329701254 conn(0x7f89180fc520 msgr2=0x7f891806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:49.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.013+0000 7f891e960640 1 -- 172.21.15.170:0/329701254 shutdown_connections 2024-09-04T16:49:49.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.013+0000 7f891e960640 1 -- 172.21.15.170:0/329701254 wait complete. 2024-09-04T16:49:49.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.096+0000 7f68075ea640 1 -- 172.21.15.170:0/2523070266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6800074eb0 msgr2=0x7f6800112400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:49.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.096+0000 7f68075ea640 1 --2- 172.21.15.170:0/2523070266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6800074eb0 0x7f6800112400 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009880 tx=0x7f67f002a530 comp rx=0 tx=0).stop 2024-09-04T16:49:49.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.096+0000 7f68075ea640 1 -- 172.21.15.170:0/2523070266 shutdown_connections 2024-09-04T16:49:49.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.096+0000 7f68075ea640 1 --2- 172.21.15.170:0/2523070266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6800074eb0 0x7f6800112400 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.096+0000 7f68075ea640 1 --2- 172.21.15.170:0/2523070266 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6800074590 0x7f6800074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.096+0000 7f68075ea640 1 -- 172.21.15.170:0/2523070266 >> 172.21.15.170:0/2523070266 conn(0x7f68000fd630 msgr2=0x7f68000ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:49.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.096+0000 7f68075ea640 1 -- 172.21.15.170:0/2523070266 shutdown_connections 2024-09-04T16:49:49.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.096+0000 7f68075ea640 1 -- 172.21.15.170:0/2523070266 wait complete. 2024-09-04T16:49:49.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.096+0000 7f68075ea640 1 Processor -- start 2024-09-04T16:49:49.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.097+0000 7f68075ea640 1 -- start start 2024-09-04T16:49:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.097+0000 7f68075ea640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6800074590 0x7f680019df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.097+0000 7f68075ea640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6800074eb0 0x7f680019e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.097+0000 7f68075ea640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6800115410 con 0x7f6800074590 2024-09-04T16:49:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.097+0000 7f68075ea640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6800115290 con 0x7f6800074eb0 2024-09-04T16:49:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.097+0000 7f6805386640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6800074590 0x7f680019df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.097+0000 7f6805386640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6800074590 0x7f680019df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60284/0 (socket says 172.21.15.170:60284) 2024-09-04T16:49:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.097+0000 7f6805386640 1 -- 172.21.15.170:0/3710865178 learned_addr learned my addr 172.21.15.170:0/3710865178 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:49:49.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.097+0000 7f6804b85640 1 --2- 172.21.15.170:0/3710865178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6800074eb0 0x7f680019e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:49.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.097+0000 7f6805386640 1 -- 172.21.15.170:0/3710865178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6800074eb0 msgr2=0x7f680019e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:49.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.097+0000 7f6805386640 1 --2- 172.21.15.170:0/3710865178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6800074eb0 0x7f680019e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.097+0000 7f6805386640 1 -- 172.21.15.170:0/3710865178 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68001a2860 con 0x7f6800074590 2024-09-04T16:49:49.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.098+0000 7f6805386640 1 --2- 172.21.15.170:0/3710865178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6800074590 0x7f680019df90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00d6f0 tx=0x7f67fc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:49.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.098+0000 7f67f67fc640 1 -- 172.21.15.170:0/3710865178 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67fc017070 con 0x7f6800074590 2024-09-04T16:49:49.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.098+0000 7f67f67fc640 1 -- 172.21.15.170:0/3710865178 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f67fc00de00 con 0x7f6800074590 2024-09-04T16:49:49.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.098+0000 7f68075ea640 1 -- 172.21.15.170:0/3710865178 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68001a2b50 con 0x7f6800074590 2024-09-04T16:49:49.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.098+0000 7f67f67fc640 1 -- 172.21.15.170:0/3710865178 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67fc004bb0 con 0x7f6800074590 2024-09-04T16:49:49.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.098+0000 7f68075ea640 1 -- 172.21.15.170:0/3710865178 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68001a30e0 con 0x7f6800074590 2024-09-04T16:49:49.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.099+0000 7f68075ea640 1 -- 172.21.15.170:0/3710865178 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6800075cd0 con 0x7f6800074590 2024-09-04T16:49:49.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.099+0000 7f67f67fc640 1 -- 172.21.15.170:0/3710865178 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f67fc009a30 con 0x7f6800074590 2024-09-04T16:49:49.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.100+0000 7f67f67fc640 1 --2- 172.21.15.170:0/3710865178 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f67ec079e80 0x7f67ec07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:49.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.100+0000 7f67f67fc640 1 -- 172.21.15.170:0/3710865178 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f67fc09c560 con 0x7f6800074590 2024-09-04T16:49:49.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.100+0000 7f6804b85640 1 --2- 172.21.15.170:0/3710865178 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f67ec079e80 0x7f67ec07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:49.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.100+0000 7f6804b85640 1 --2- 172.21.15.170:0/3710865178 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f67ec079e80 0x7f67ec07c340 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6800104820 tx=0x7f67f0031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:49.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.104+0000 7f67f67fc640 1 -- 172.21.15.170:0/3710865178 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f67fc068160 con 0x7f6800074590 2024-09-04T16:49:49.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.286+0000 7f68075ea640 1 -- 172.21.15.170:0/3710865178 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f68001a3390 con 0x7f67ec079e80 2024-09-04T16:49:49.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.295+0000 7f67f67fc640 1 -- 172.21.15.170:0/3710865178 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f68001a3390 con 0x7f67ec079e80 2024-09-04T16:49:49.296 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:49:49.296 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (16m) 11m ago 27m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:49:49.296 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (19m) 11m ago 27m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:49:49.296 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (19m) 10m ago 26m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:49:49.296 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (14m) 11m ago 27m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:49:49.296 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (14m) 10m ago 26m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:49:49.296 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (16m) 11m ago 27m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:49:49.296 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (11m) 11m ago 22m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:49:49.296 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (11m) 11m ago 22m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:49:49.297 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (10m) 10m ago 22m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:49:49.297 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (10m) 10m ago 22m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:49:49.297 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (19m) 11m ago 28m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:49:49.297 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (17m) 10m ago 26m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:49:49.297 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (15m) 11m ago 29m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:49:49.297 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (15m) 10m ago 26m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:49:49.297 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (17m) 11m ago 27m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:49:49.297 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (17m) 10m ago 26m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:49:49.297 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (14m) 11m ago 25m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:49:49.297 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (13m) 11m ago 25m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:49:49.297 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (13m) 11m ago 24m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:49:49.297 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (12m) 10m ago 24m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:49:49.297 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (12m) 10m ago 23m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:49:49.298 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (11m) 10m ago 23m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:49:49.298 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (17m) 11m ago 27m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:49:49.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.298+0000 7f68075ea640 1 -- 172.21.15.170:0/3710865178 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f67ec079e80 msgr2=0x7f67ec07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:49.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.298+0000 7f68075ea640 1 --2- 172.21.15.170:0/3710865178 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f67ec079e80 0x7f67ec07c340 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6800104820 tx=0x7f67f0031400 comp rx=0 tx=0).stop 2024-09-04T16:49:49.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.298+0000 7f68075ea640 1 -- 172.21.15.170:0/3710865178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6800074590 msgr2=0x7f680019df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:49.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.298+0000 7f68075ea640 1 --2- 172.21.15.170:0/3710865178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6800074590 0x7f680019df90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00d6f0 tx=0x7f67fc00dbb0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.298+0000 7f68075ea640 1 -- 172.21.15.170:0/3710865178 shutdown_connections 2024-09-04T16:49:49.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.298+0000 7f68075ea640 1 --2- 172.21.15.170:0/3710865178 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f67ec079e80 0x7f67ec07c340 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.298+0000 7f68075ea640 1 --2- 172.21.15.170:0/3710865178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6800074eb0 0x7f680019e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.298+0000 7f68075ea640 1 --2- 172.21.15.170:0/3710865178 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6800074590 0x7f680019df90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.298+0000 7f68075ea640 1 -- 172.21.15.170:0/3710865178 >> 172.21.15.170:0/3710865178 conn(0x7f68000fd630 msgr2=0x7f6800104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:49.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.298+0000 7f68075ea640 1 -- 172.21.15.170:0/3710865178 shutdown_connections 2024-09-04T16:49:49.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.298+0000 7f68075ea640 1 -- 172.21.15.170:0/3710865178 wait complete. 2024-09-04T16:49:49.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.379+0000 7f6c21267640 1 -- 172.21.15.170:0/3087441015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c1c1007f0 msgr2=0x7f6c1c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:49.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.379+0000 7f6c21267640 1 --2- 172.21.15.170:0/3087441015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c1c1007f0 0x7f6c1c100c50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6c04009880 tx=0x7f6c0402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.379+0000 7f6c21267640 1 -- 172.21.15.170:0/3087441015 shutdown_connections 2024-09-04T16:49:49.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.379+0000 7f6c21267640 1 --2- 172.21.15.170:0/3087441015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c1c1007f0 0x7f6c1c100c50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.379+0000 7f6c21267640 1 --2- 172.21.15.170:0/3087441015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c1c1067f0 0x7f6c1c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.379+0000 7f6c21267640 1 -- 172.21.15.170:0/3087441015 >> 172.21.15.170:0/3087441015 conn(0x7f6c1c0fc4f0 msgr2=0x7f6c1c0fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:49.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.379+0000 7f6c21267640 1 -- 172.21.15.170:0/3087441015 shutdown_connections 2024-09-04T16:49:49.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.379+0000 7f6c21267640 1 -- 172.21.15.170:0/3087441015 wait complete. 2024-09-04T16:49:49.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.379+0000 7f6c21267640 1 Processor -- start 2024-09-04T16:49:49.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.380+0000 7f6c21267640 1 -- start start 2024-09-04T16:49:49.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.380+0000 7f6c21267640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c1c1007f0 0x7f6c1c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:49.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.380+0000 7f6c21267640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c1c1067f0 0x7f6c1c19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:49.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.380+0000 7f6c21267640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c10dcc0 con 0x7f6c1c1007f0 2024-09-04T16:49:49.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.380+0000 7f6c21267640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c10db40 con 0x7f6c1c1067f0 2024-09-04T16:49:49.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.380+0000 7f6c1affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c1c1007f0 0x7f6c1c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:49.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.380+0000 7f6c1affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c1c1007f0 0x7f6c1c19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60300/0 (socket says 172.21.15.170:60300) 2024-09-04T16:49:49.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.380+0000 7f6c1affd640 1 -- 172.21.15.170:0/1525353163 learned_addr learned my addr 172.21.15.170:0/1525353163 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:49:49.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.380+0000 7f6c1a7fc640 1 --2- 172.21.15.170:0/1525353163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c1c1067f0 0x7f6c1c19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:49.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.380+0000 7f6c1affd640 1 -- 172.21.15.170:0/1525353163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c1c1067f0 msgr2=0x7f6c1c19dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:49.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.380+0000 7f6c1affd640 1 --2- 172.21.15.170:0/1525353163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c1c1067f0 0x7f6c1c19dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.380+0000 7f6c1affd640 1 -- 172.21.15.170:0/1525353163 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c197830 con 0x7f6c1c1007f0 2024-09-04T16:49:49.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.380+0000 7f6c1affd640 1 --2- 172.21.15.170:0/1525353163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c1c1007f0 0x7f6c1c19d6b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00c8f0 tx=0x7f6c0c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:49.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.380+0000 7f6c13fff640 1 -- 172.21.15.170:0/1525353163 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c0c0079b0 con 0x7f6c1c1007f0 2024-09-04T16:49:49.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.381+0000 7f6c21267640 1 -- 172.21.15.170:0/1525353163 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1c197b20 con 0x7f6c1c1007f0 2024-09-04T16:49:49.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.381+0000 7f6c13fff640 1 -- 172.21.15.170:0/1525353163 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6c0c0054e0 con 0x7f6c1c1007f0 2024-09-04T16:49:49.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.381+0000 7f6c13fff640 1 -- 172.21.15.170:0/1525353163 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c0c004dd0 con 0x7f6c1c1007f0 2024-09-04T16:49:49.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.381+0000 7f6c21267640 1 -- 172.21.15.170:0/1525353163 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1c1980b0 con 0x7f6c1c1007f0 2024-09-04T16:49:49.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.382+0000 7f6c21267640 1 -- 172.21.15.170:0/1525353163 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c1c101f30 con 0x7f6c1c1007f0 2024-09-04T16:49:49.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.382+0000 7f6c13fff640 1 -- 172.21.15.170:0/1525353163 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f6c0c005020 con 0x7f6c1c1007f0 2024-09-04T16:49:49.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.383+0000 7f6c13fff640 1 --2- 172.21.15.170:0/1525353163 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6c08079dd0 0x7f6c0807c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:49.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.383+0000 7f6c13fff640 1 -- 172.21.15.170:0/1525353163 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6c0c09cad0 con 0x7f6c1c1007f0 2024-09-04T16:49:49.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.383+0000 7f6c1a7fc640 1 --2- 172.21.15.170:0/1525353163 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6c08079dd0 0x7f6c0807c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:49.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.383+0000 7f6c1a7fc640 1 --2- 172.21.15.170:0/1525353163 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6c08079dd0 0x7f6c0807c290 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6c04031460 tx=0x7f6c04009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:49.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.387+0000 7f6c13fff640 1 -- 172.21.15.170:0/1525353163 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6c0c014030 con 0x7f6c1c1007f0 2024-09-04T16:49:49.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.630+0000 7f6c21267640 1 -- 172.21.15.170:0/1525353163 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6c1c109d70 con 0x7f6c1c1007f0 2024-09-04T16:49:49.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.631+0000 7f6c13fff640 1 -- 172.21.15.170:0/1525353163 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f6c0c09c280 con 0x7f6c1c1007f0 2024-09-04T16:49:49.632 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:49:49.632 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:49:49.632 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:49:49.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:49:49.632 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:49:49.632 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:49:49.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:49:49.632 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:49:49.632 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:49:49.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:49:49.633 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:49:49.633 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:49:49.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:49:49.633 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:49:49.633 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:49:49.633 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:49:49.633 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:49:49.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.633+0000 7f6c21267640 1 -- 172.21.15.170:0/1525353163 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6c08079dd0 msgr2=0x7f6c0807c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:49.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.633+0000 7f6c21267640 1 --2- 172.21.15.170:0/1525353163 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6c08079dd0 0x7f6c0807c290 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6c04031460 tx=0x7f6c04009560 comp rx=0 tx=0).stop 2024-09-04T16:49:49.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.633+0000 7f6c21267640 1 -- 172.21.15.170:0/1525353163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c1c1007f0 msgr2=0x7f6c1c19d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:49.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.633+0000 7f6c21267640 1 --2- 172.21.15.170:0/1525353163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c1c1007f0 0x7f6c1c19d6b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00c8f0 tx=0x7f6c0c00cdb0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.633+0000 7f6c21267640 1 -- 172.21.15.170:0/1525353163 shutdown_connections 2024-09-04T16:49:49.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.633+0000 7f6c21267640 1 --2- 172.21.15.170:0/1525353163 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6c08079dd0 0x7f6c0807c290 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.633+0000 7f6c21267640 1 --2- 172.21.15.170:0/1525353163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c1c1067f0 0x7f6c1c19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.633+0000 7f6c21267640 1 --2- 172.21.15.170:0/1525353163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c1c1007f0 0x7f6c1c19d6b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.633+0000 7f6c21267640 1 -- 172.21.15.170:0/1525353163 >> 172.21.15.170:0/1525353163 conn(0x7f6c1c0fc4f0 msgr2=0x7f6c1c06a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:49.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.633+0000 7f6c21267640 1 -- 172.21.15.170:0/1525353163 shutdown_connections 2024-09-04T16:49:49.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.633+0000 7f6c21267640 1 -- 172.21.15.170:0/1525353163 wait complete. 2024-09-04T16:49:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.715+0000 7f4d766a5640 1 -- 172.21.15.170:0/1619050416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d701007e0 msgr2=0x7f4d70100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.715+0000 7f4d766a5640 1 --2- 172.21.15.170:0/1619050416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d701007e0 0x7f4d70100c40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4d58009880 tx=0x7f4d5802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.715+0000 7f4d766a5640 1 -- 172.21.15.170:0/1619050416 shutdown_connections 2024-09-04T16:49:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.715+0000 7f4d766a5640 1 --2- 172.21.15.170:0/1619050416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d701007e0 0x7f4d70100c40 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.715+0000 7f4d766a5640 1 --2- 172.21.15.170:0/1619050416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d701067e0 0x7f4d70106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.715+0000 7f4d766a5640 1 -- 172.21.15.170:0/1619050416 >> 172.21.15.170:0/1619050416 conn(0x7f4d700fc4c0 msgr2=0x7f4d700fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.715+0000 7f4d766a5640 1 -- 172.21.15.170:0/1619050416 shutdown_connections 2024-09-04T16:49:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.715+0000 7f4d766a5640 1 -- 172.21.15.170:0/1619050416 wait complete. 2024-09-04T16:49:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.715+0000 7f4d766a5640 1 Processor -- start 2024-09-04T16:49:49.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.715+0000 7f4d766a5640 1 -- start start 2024-09-04T16:49:49.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.716+0000 7f4d766a5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d701007e0 0x7f4d7019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:49.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.716+0000 7f4d766a5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d701067e0 0x7f4d7019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:49.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.716+0000 7f4d766a5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7010dd10 con 0x7f4d701007e0 2024-09-04T16:49:49.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.716+0000 7f4d766a5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7010db90 con 0x7f4d701067e0 2024-09-04T16:49:49.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.716+0000 7f4d6ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d701007e0 0x7f4d7019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:49.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.716+0000 7f4d6ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d701007e0 0x7f4d7019c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60312/0 (socket says 172.21.15.170:60312) 2024-09-04T16:49:49.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.716+0000 7f4d6ffff640 1 -- 172.21.15.170:0/2787023330 learned_addr learned my addr 172.21.15.170:0/2787023330 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:49:49.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.716+0000 7f4d6ffff640 1 -- 172.21.15.170:0/2787023330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d701067e0 msgr2=0x7f4d7019cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:49.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.716+0000 7f4d6ffff640 1 --2- 172.21.15.170:0/2787023330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d701067e0 0x7f4d7019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.716+0000 7f4d6ffff640 1 -- 172.21.15.170:0/2787023330 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d70196700 con 0x7f4d701007e0 2024-09-04T16:49:49.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.716+0000 7f4d6ffff640 1 --2- 172.21.15.170:0/2787023330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d701007e0 0x7f4d7019c630 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000b420 tx=0x7f4d6000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:49.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.716+0000 7f4d6d7fa640 1 -- 172.21.15.170:0/2787023330 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d60011630 con 0x7f4d701007e0 2024-09-04T16:49:49.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.717+0000 7f4d6d7fa640 1 -- 172.21.15.170:0/2787023330 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4d60016070 con 0x7f4d701007e0 2024-09-04T16:49:49.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.717+0000 7f4d766a5640 1 -- 172.21.15.170:0/2787023330 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d701969f0 con 0x7f4d701007e0 2024-09-04T16:49:49.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.717+0000 7f4d6d7fa640 1 -- 172.21.15.170:0/2787023330 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d60010d40 con 0x7f4d701007e0 2024-09-04T16:49:49.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.717+0000 7f4d766a5640 1 -- 172.21.15.170:0/2787023330 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d70196f80 con 0x7f4d701007e0 2024-09-04T16:49:49.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.718+0000 7f4d766a5640 1 -- 172.21.15.170:0/2787023330 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d70101f20 con 0x7f4d701007e0 2024-09-04T16:49:49.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.718+0000 7f4d6d7fa640 1 -- 172.21.15.170:0/2787023330 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f4d6001b460 con 0x7f4d701007e0 2024-09-04T16:49:49.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.719+0000 7f4d6d7fa640 1 --2- 172.21.15.170:0/2787023330 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4d5c079e30 0x7f4d5c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:49.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.719+0000 7f4d6d7fa640 1 -- 172.21.15.170:0/2787023330 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4d6009c2d0 con 0x7f4d701007e0 2024-09-04T16:49:49.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.719+0000 7f4d6f7fe640 1 --2- 172.21.15.170:0/2787023330 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4d5c079e30 0x7f4d5c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:49.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.719+0000 7f4d6f7fe640 1 --2- 172.21.15.170:0/2787023330 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4d5c079e30 0x7f4d5c07c2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4d580096c0 tx=0x7f4d58000bc0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:49.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.723+0000 7f4d6d7fa640 1 -- 172.21.15.170:0/2787023330 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4d60021250 con 0x7f4d701007e0 2024-09-04T16:49:49.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.932+0000 7f4d766a5640 1 -- 172.21.15.170:0/2787023330 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4d701972c0 con 0x7f4d701007e0 2024-09-04T16:49:49.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.932+0000 7f4d6d7fa640 1 -- 172.21.15.170:0/2787023330 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7f4d60063c40 con 0x7f4d701007e0 2024-09-04T16:49:49.933 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:49:49.933 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:49:49.933 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:49:49.933 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:49:49.934 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:49:49.934 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:49:49.934 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:49:49.934 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:49:49.934 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:49:49.934 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:49:49.934 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:49:49.934 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:49:49.934 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:49:49.934 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:49:49.934 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:49:49.934 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:49:49.934 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:49:49.934 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:49:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:49:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:49:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:49:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:49:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:49:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:49:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:49:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:49:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:49:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:49:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:49:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:49:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:49:49.936 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:49:49.936 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:49:49.936 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:49:49.936 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:49:49.936 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:49:49.936 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:49:49.936 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:49:49.936 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:49:49.936 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:49:49.936 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:49:49.936 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:49:49.936 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:49:49.937 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:49:49.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.935+0000 7f4d766a5640 1 -- 172.21.15.170:0/2787023330 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4d5c079e30 msgr2=0x7f4d5c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:49.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.935+0000 7f4d766a5640 1 --2- 172.21.15.170:0/2787023330 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4d5c079e30 0x7f4d5c07c2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4d580096c0 tx=0x7f4d58000bc0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.935+0000 7f4d766a5640 1 -- 172.21.15.170:0/2787023330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d701007e0 msgr2=0x7f4d7019c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:49.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.935+0000 7f4d766a5640 1 --2- 172.21.15.170:0/2787023330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d701007e0 0x7f4d7019c630 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000b420 tx=0x7f4d6000b8e0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.935+0000 7f4d766a5640 1 -- 172.21.15.170:0/2787023330 shutdown_connections 2024-09-04T16:49:49.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.935+0000 7f4d766a5640 1 --2- 172.21.15.170:0/2787023330 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4d5c079e30 0x7f4d5c07c2f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.935+0000 7f4d766a5640 1 --2- 172.21.15.170:0/2787023330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d701067e0 0x7f4d7019cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.935+0000 7f4d766a5640 1 --2- 172.21.15.170:0/2787023330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d701007e0 0x7f4d7019c630 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:49.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.935+0000 7f4d766a5640 1 -- 172.21.15.170:0/2787023330 >> 172.21.15.170:0/2787023330 conn(0x7f4d700fc4c0 msgr2=0x7f4d700fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:49.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.935+0000 7f4d766a5640 1 -- 172.21.15.170:0/2787023330 shutdown_connections 2024-09-04T16:49:49.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:49.935+0000 7f4d766a5640 1 -- 172.21.15.170:0/2787023330 wait complete. 2024-09-04T16:49:50.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.018+0000 7fa1877cc640 1 -- 172.21.15.170:0/2873287581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa180107930 msgr2=0x7fa180107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:50.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.018+0000 7fa1877cc640 1 --2- 172.21.15.170:0/2873287581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa180107930 0x7fa180107d10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa17c009880 tx=0x7fa17c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:49:50.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.018+0000 7fa1877cc640 1 -- 172.21.15.170:0/2873287581 shutdown_connections 2024-09-04T16:49:50.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.018+0000 7fa1877cc640 1 --2- 172.21.15.170:0/2873287581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa180101930 0x7fa180101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:50.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.018+0000 7fa1877cc640 1 --2- 172.21.15.170:0/2873287581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa180107930 0x7fa180107d10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:50.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.018+0000 7fa1877cc640 1 -- 172.21.15.170:0/2873287581 >> 172.21.15.170:0/2873287581 conn(0x7fa1800fd630 msgr2=0x7fa1800ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:50.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.018+0000 7fa1877cc640 1 -- 172.21.15.170:0/2873287581 shutdown_connections 2024-09-04T16:49:50.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.018+0000 7fa1877cc640 1 -- 172.21.15.170:0/2873287581 wait complete. 2024-09-04T16:49:50.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.019+0000 7fa1877cc640 1 Processor -- start 2024-09-04T16:49:50.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.019+0000 7fa1877cc640 1 -- start start 2024-09-04T16:49:50.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.019+0000 7fa1877cc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa180101930 0x7fa18019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:50.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.019+0000 7fa1877cc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa180107930 0x7fa18019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:50.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.019+0000 7fa1877cc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa18010ee00 con 0x7fa180101930 2024-09-04T16:49:50.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.019+0000 7fa1877cc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa18010ec80 con 0x7fa180107930 2024-09-04T16:49:50.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.019+0000 7fa185568640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa180101930 0x7fa18019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:50.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.019+0000 7fa185568640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa180101930 0x7fa18019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60326/0 (socket says 172.21.15.170:60326) 2024-09-04T16:49:50.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.019+0000 7fa185568640 1 -- 172.21.15.170:0/811902039 learned_addr learned my addr 172.21.15.170:0/811902039 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:49:50.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.019+0000 7fa184d67640 1 --2- 172.21.15.170:0/811902039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa180107930 0x7fa18019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:50.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.019+0000 7fa185568640 1 -- 172.21.15.170:0/811902039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa180107930 msgr2=0x7fa18019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:50.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.019+0000 7fa185568640 1 --2- 172.21.15.170:0/811902039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa180107930 0x7fa18019dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:50.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.019+0000 7fa185568640 1 -- 172.21.15.170:0/811902039 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1801977f0 con 0x7fa180101930 2024-09-04T16:49:50.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.019+0000 7fa184d67640 1 --2- 172.21.15.170:0/811902039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa180107930 0x7fa18019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:49:50.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.020+0000 7fa185568640 1 --2- 172.21.15.170:0/811902039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa180101930 0x7fa18019d670 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa17c031460 tx=0x7fa17c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:50.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.020+0000 7fa1767fc640 1 -- 172.21.15.170:0/811902039 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa17c03f070 con 0x7fa180101930 2024-09-04T16:49:50.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.020+0000 7fa1877cc640 1 -- 172.21.15.170:0/811902039 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa180197a80 con 0x7fa180101930 2024-09-04T16:49:50.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.020+0000 7fa1767fc640 1 -- 172.21.15.170:0/811902039 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa17c0035f0 con 0x7fa180101930 2024-09-04T16:49:50.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.020+0000 7fa1767fc640 1 -- 172.21.15.170:0/811902039 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa17c035030 con 0x7fa180101930 2024-09-04T16:49:50.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.020+0000 7fa1877cc640 1 -- 172.21.15.170:0/811902039 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa180197fb0 con 0x7fa180101930 2024-09-04T16:49:50.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.021+0000 7fa1877cc640 1 -- 172.21.15.170:0/811902039 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa180103070 con 0x7fa180101930 2024-09-04T16:49:50.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.021+0000 7fa1767fc640 1 -- 172.21.15.170:0/811902039 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fa17c042070 con 0x7fa180101930 2024-09-04T16:49:50.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.022+0000 7fa1767fc640 1 --2- 172.21.15.170:0/811902039 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa16c079e30 0x7fa16c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:50.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.022+0000 7fa1767fc640 1 -- 172.21.15.170:0/811902039 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa17c0bd460 con 0x7fa180101930 2024-09-04T16:49:50.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.022+0000 7fa184d67640 1 --2- 172.21.15.170:0/811902039 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa16c079e30 0x7fa16c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:50.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.022+0000 7fa184d67640 1 --2- 172.21.15.170:0/811902039 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa16c079e30 0x7fa16c07c2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa1700058c0 tx=0x7fa170005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:50.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.026+0000 7fa1767fc640 1 -- 172.21.15.170:0/811902039 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa17c084e70 con 0x7fa180101930 2024-09-04T16:49:50.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.217+0000 7fa1877cc640 1 -- 172.21.15.170:0/811902039 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa180198260 con 0x7fa16c079e30 2024-09-04T16:49:50.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.219+0000 7fa1767fc640 1 -- 172.21.15.170:0/811902039 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa180198260 con 0x7fa16c079e30 2024-09-04T16:49:50.219 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:49:50.219 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:49:50.219 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:49:50.219 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:49:50.220 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:49:50.220 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:49:50.220 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:49:50.220 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:49:50.220 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:49:50.220 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:49:50.220 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:49:50.220 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:49:50.220 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:49:50.220 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:49:50.220 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:49:50.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.221+0000 7fa1877cc640 1 -- 172.21.15.170:0/811902039 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa16c079e30 msgr2=0x7fa16c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:50.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.221+0000 7fa1877cc640 1 --2- 172.21.15.170:0/811902039 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa16c079e30 0x7fa16c07c2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa1700058c0 tx=0x7fa170005850 comp rx=0 tx=0).stop 2024-09-04T16:49:50.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.221+0000 7fa1877cc640 1 -- 172.21.15.170:0/811902039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa180101930 msgr2=0x7fa18019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:50.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.221+0000 7fa1877cc640 1 --2- 172.21.15.170:0/811902039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa180101930 0x7fa18019d670 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa17c031460 tx=0x7fa17c0045e0 comp rx=0 tx=0).stop 2024-09-04T16:49:50.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.221+0000 7fa1877cc640 1 -- 172.21.15.170:0/811902039 shutdown_connections 2024-09-04T16:49:50.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.221+0000 7fa1877cc640 1 --2- 172.21.15.170:0/811902039 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa16c079e30 0x7fa16c07c2f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:50.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.221+0000 7fa1877cc640 1 --2- 172.21.15.170:0/811902039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa180107930 0x7fa18019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:50.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.221+0000 7fa1877cc640 1 --2- 172.21.15.170:0/811902039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa180101930 0x7fa18019d670 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:50.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.221+0000 7fa1877cc640 1 -- 172.21.15.170:0/811902039 >> 172.21.15.170:0/811902039 conn(0x7fa1800fd630 msgr2=0x7fa1800fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:50.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.221+0000 7fa1877cc640 1 -- 172.21.15.170:0/811902039 shutdown_connections 2024-09-04T16:49:50.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.221+0000 7fa1877cc640 1 -- 172.21.15.170:0/811902039 wait complete. 2024-09-04T16:49:50.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.303+0000 7fcd839c3640 1 -- 172.21.15.170:0/413757661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd7c106810 msgr2=0x7fcd7c106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:50.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.303+0000 7fcd839c3640 1 --2- 172.21.15.170:0/413757661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd7c106810 0x7fcd7c106bf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009c20 tx=0x7fcd7802a970 comp rx=0 tx=0).stop 2024-09-04T16:49:50.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.303+0000 7fcd839c3640 1 -- 172.21.15.170:0/413757661 shutdown_connections 2024-09-04T16:49:50.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.303+0000 7fcd839c3640 1 --2- 172.21.15.170:0/413757661 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd7c100810 0x7fcd7c100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:50.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.303+0000 7fcd839c3640 1 --2- 172.21.15.170:0/413757661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd7c106810 0x7fcd7c106bf0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:50.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.303+0000 7fcd839c3640 1 -- 172.21.15.170:0/413757661 >> 172.21.15.170:0/413757661 conn(0x7fcd7c0fc510 msgr2=0x7fcd7c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:50.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.303+0000 7fcd839c3640 1 -- 172.21.15.170:0/413757661 shutdown_connections 2024-09-04T16:49:50.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.303+0000 7fcd839c3640 1 -- 172.21.15.170:0/413757661 wait complete. 2024-09-04T16:49:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.304+0000 7fcd839c3640 1 Processor -- start 2024-09-04T16:49:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.304+0000 7fcd839c3640 1 -- start start 2024-09-04T16:49:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.304+0000 7fcd839c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd7c100810 0x7fcd7c1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.304+0000 7fcd839c3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd7c106810 0x7fcd7c198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.304+0000 7fcd839c3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7c10dce0 con 0x7fcd7c106810 2024-09-04T16:49:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.304+0000 7fcd839c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7c10db60 con 0x7fcd7c100810 2024-09-04T16:49:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.305+0000 7fcd80f5e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd7c106810 0x7fcd7c198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.305+0000 7fcd80f5e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd7c106810 0x7fcd7c198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60348/0 (socket says 172.21.15.170:60348) 2024-09-04T16:49:50.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.305+0000 7fcd80f5e640 1 -- 172.21.15.170:0/2088517456 learned_addr learned my addr 172.21.15.170:0/2088517456 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:49:50.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.305+0000 7fcd8175f640 1 --2- 172.21.15.170:0/2088517456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd7c100810 0x7fcd7c1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:50.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.305+0000 7fcd80f5e640 1 -- 172.21.15.170:0/2088517456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd7c100810 msgr2=0x7fcd7c1987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:50.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.305+0000 7fcd80f5e640 1 --2- 172.21.15.170:0/2088517456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd7c100810 0x7fcd7c1987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:50.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.305+0000 7fcd80f5e640 1 -- 172.21.15.170:0/2088517456 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7c199330 con 0x7fcd7c106810 2024-09-04T16:49:50.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.305+0000 7fcd80f5e640 1 --2- 172.21.15.170:0/2088517456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd7c106810 0x7fcd7c198d30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00d6f0 tx=0x7fcd6c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:50.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.305+0000 7fcd727fc640 1 -- 172.21.15.170:0/2088517456 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd6c017070 con 0x7fcd7c106810 2024-09-04T16:49:50.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.305+0000 7fcd727fc640 1 -- 172.21.15.170:0/2088517456 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd6c00de00 con 0x7fcd7c106810 2024-09-04T16:49:50.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.305+0000 7fcd839c3640 1 -- 172.21.15.170:0/2088517456 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd7c199620 con 0x7fcd7c106810 2024-09-04T16:49:50.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.305+0000 7fcd727fc640 1 -- 172.21.15.170:0/2088517456 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd6c004bb0 con 0x7fcd7c106810 2024-09-04T16:49:50.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.305+0000 7fcd839c3640 1 -- 172.21.15.170:0/2088517456 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd7c1a1c20 con 0x7fcd7c106810 2024-09-04T16:49:50.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.306+0000 7fcd839c3640 1 -- 172.21.15.170:0/2088517456 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd7c101f50 con 0x7fcd7c106810 2024-09-04T16:49:50.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.307+0000 7fcd727fc640 1 -- 172.21.15.170:0/2088517456 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fcd6c004e60 con 0x7fcd7c106810 2024-09-04T16:49:50.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.307+0000 7fcd727fc640 1 --2- 172.21.15.170:0/2088517456 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd68079e30 0x7fcd6807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:49:50.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.307+0000 7fcd727fc640 1 -- 172.21.15.170:0/2088517456 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fcd6c09c680 con 0x7fcd7c106810 2024-09-04T16:49:50.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.307+0000 7fcd8175f640 1 --2- 172.21.15.170:0/2088517456 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd68079e30 0x7fcd6807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:49:50.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.308+0000 7fcd8175f640 1 --2- 172.21.15.170:0/2088517456 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd68079e30 0x7fcd6807c2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009430 tx=0x7fcd7803c040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:49:50.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.312+0000 7fcd727fc640 1 -- 172.21.15.170:0/2088517456 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcd7c199620 con 0x7fcd7c106810 2024-09-04T16:49:50.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.557+0000 7fcd839c3640 1 -- 172.21.15.170:0/2088517456 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fcd7c06a8f0 con 0x7fcd7c106810 2024-09-04T16:49:50.558 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:50 smithi170 ceph-mon[113855]: pgmap v603: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:50.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:50 smithi170 ceph-mon[113855]: from='client.34922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:49:50.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:50 smithi170 ceph-mon[113855]: from='client.34926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:49:50.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:50 smithi170 ceph-mon[113855]: from='client.34930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:49:50.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:50 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1525353163' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:49:50.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:50 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2787023330' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:49:50.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.558+0000 7fcd727fc640 1 -- 172.21.15.170:0/2088517456 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fcd6c068200 con 0x7fcd7c106810 2024-09-04T16:49:50.559 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:49:50.559 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:49:50.559 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:49:50.560 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:49:50.560 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:49:50.560 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:49:50.560 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:49:50.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.560+0000 7fcd839c3640 1 -- 172.21.15.170:0/2088517456 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd68079e30 msgr2=0x7fcd6807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:50.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.560+0000 7fcd839c3640 1 --2- 172.21.15.170:0/2088517456 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd68079e30 0x7fcd6807c2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009430 tx=0x7fcd7803c040 comp rx=0 tx=0).stop 2024-09-04T16:49:50.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.560+0000 7fcd839c3640 1 -- 172.21.15.170:0/2088517456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd7c106810 msgr2=0x7fcd7c198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:49:50.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.560+0000 7fcd839c3640 1 --2- 172.21.15.170:0/2088517456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd7c106810 0x7fcd7c198d30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00d6f0 tx=0x7fcd6c00dbb0 comp rx=0 tx=0).stop 2024-09-04T16:49:50.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.560+0000 7fcd839c3640 1 -- 172.21.15.170:0/2088517456 shutdown_connections 2024-09-04T16:49:50.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.560+0000 7fcd839c3640 1 --2- 172.21.15.170:0/2088517456 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd68079e30 0x7fcd6807c2f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:50.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.560+0000 7fcd839c3640 1 --2- 172.21.15.170:0/2088517456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd7c106810 0x7fcd7c198d30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:50.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.560+0000 7fcd839c3640 1 --2- 172.21.15.170:0/2088517456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd7c100810 0x7fcd7c1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:49:50.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.560+0000 7fcd839c3640 1 -- 172.21.15.170:0/2088517456 >> 172.21.15.170:0/2088517456 conn(0x7fcd7c0fc510 msgr2=0x7fcd7c0fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:49:50.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.560+0000 7fcd839c3640 1 -- 172.21.15.170:0/2088517456 shutdown_connections 2024-09-04T16:49:50.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:49:50.560+0000 7fcd839c3640 1 -- 172.21.15.170:0/2088517456 wait complete. 2024-09-04T16:49:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:50 smithi193 ceph-mon[82547]: pgmap v603: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:50 smithi193 ceph-mon[82547]: from='client.34922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:49:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:50 smithi193 ceph-mon[82547]: from='client.34926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:49:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:50 smithi193 ceph-mon[82547]: from='client.34930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:49:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:50 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1525353163' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:49:50.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:50 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2787023330' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:49:51.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:51 smithi170 ceph-mon[113855]: from='client.34942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:49:51.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:51 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2088517456' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:49:51.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:51 smithi193 ceph-mon[82547]: from='client.34942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:49:51.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:51 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2088517456' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:49:52.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:52 smithi170 ceph-mon[113855]: pgmap v604: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:52 smithi193 ceph-mon[82547]: pgmap v604: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:54 smithi170 ceph-mon[113855]: pgmap v605: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:54 smithi193 ceph-mon[82547]: pgmap v605: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:56.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:56 smithi170 ceph-mon[113855]: pgmap v606: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:56.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:56 smithi193 ceph-mon[82547]: pgmap v606: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:58.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:58 smithi170 ceph-mon[113855]: pgmap v607: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:58.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:58 smithi193 ceph-mon[82547]: pgmap v607: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:49:59.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:49:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:49:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:49:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:50:00.276 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:00 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170[113851]: 2024-09-04T16:49:59.999+0000 7f15836be640 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:50:00.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:00 smithi170 ceph-mon[113855]: pgmap v608: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:00 smithi170 ceph-mon[113855]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:50:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:00 smithi193 ceph-mon[82547]: pgmap v608: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:00 smithi193 ceph-mon[82547]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:50:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:02 smithi170 ceph-mon[113855]: pgmap v609: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:02.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:02 smithi193 ceph-mon[82547]: pgmap v609: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:04.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:04 smithi170 ceph-mon[113855]: pgmap v610: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:04.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:04 smithi193 ceph-mon[82547]: pgmap v610: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:06.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:06 smithi170 ceph-mon[113855]: pgmap v611: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:06.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:06 smithi193 ceph-mon[82547]: pgmap v611: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:08.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:08 smithi170 ceph-mon[113855]: pgmap v612: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:08 smithi193 ceph-mon[82547]: pgmap v612: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:10.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:10 smithi170 ceph-mon[113855]: pgmap v613: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:10.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:10 smithi193 ceph-mon[82547]: pgmap v613: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:12.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:12 smithi170 ceph-mon[113855]: pgmap v614: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:12.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:12 smithi193 ceph-mon[82547]: pgmap v614: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:14.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:14 smithi170 ceph-mon[113855]: pgmap v615: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:14.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:50:14.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:14 smithi193 ceph-mon[82547]: pgmap v615: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:14.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:50:16.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:16 smithi170 ceph-mon[113855]: pgmap v616: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:16.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:16 smithi193 ceph-mon[82547]: pgmap v616: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:18.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:18 smithi170 ceph-mon[113855]: pgmap v617: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:18.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:18 smithi193 ceph-mon[82547]: pgmap v617: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:20.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:20 smithi170 ceph-mon[113855]: pgmap v618: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:20.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.655+0000 7f9b2e7ae640 1 -- 172.21.15.170:0/3752558367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b281033c0 msgr2=0x7f9b2810b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:20.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.655+0000 7f9b2e7ae640 1 --2- 172.21.15.170:0/3752558367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b281033c0 0x7f9b2810b8b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009880 tx=0x7f9b1c02a530 comp rx=0 tx=0).stop 2024-09-04T16:50:20.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.655+0000 7f9b2e7ae640 1 -- 172.21.15.170:0/3752558367 shutdown_connections 2024-09-04T16:50:20.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.655+0000 7f9b2e7ae640 1 --2- 172.21.15.170:0/3752558367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b281033c0 0x7f9b2810b8b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:20.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.655+0000 7f9b2e7ae640 1 --2- 172.21.15.170:0/3752558367 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b28102aa0 0x7f9b28102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:20.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.655+0000 7f9b2e7ae640 1 -- 172.21.15.170:0/3752558367 >> 172.21.15.170:0/3752558367 conn(0x7f9b280fc4c0 msgr2=0x7f9b280fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:20.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.655+0000 7f9b2e7ae640 1 -- 172.21.15.170:0/3752558367 shutdown_connections 2024-09-04T16:50:20.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.655+0000 7f9b2e7ae640 1 -- 172.21.15.170:0/3752558367 wait complete. 2024-09-04T16:50:20.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.655+0000 7f9b2e7ae640 1 Processor -- start 2024-09-04T16:50:20.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.656+0000 7f9b2e7ae640 1 -- start start 2024-09-04T16:50:20.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:20 smithi193 ceph-mon[82547]: pgmap v618: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:20.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.656+0000 7f9b2e7ae640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b28102aa0 0x7f9b28100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:20.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.656+0000 7f9b2e7ae640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b281033c0 0x7f9b28100c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:20.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.656+0000 7f9b2e7ae640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2810edd0 con 0x7f9b281033c0 2024-09-04T16:50:20.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.656+0000 7f9b2e7ae640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2810ec50 con 0x7f9b28102aa0 2024-09-04T16:50:20.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.656+0000 7f9b277fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b281033c0 0x7f9b28100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:20.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.656+0000 7f9b277fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b281033c0 0x7f9b28100c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43746/0 (socket says 172.21.15.170:43746) 2024-09-04T16:50:20.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.656+0000 7f9b277fe640 1 -- 172.21.15.170:0/1189859338 learned_addr learned my addr 172.21.15.170:0/1189859338 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:50:20.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.656+0000 7f9b27fff640 1 --2- 172.21.15.170:0/1189859338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b28102aa0 0x7f9b28100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:20.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.656+0000 7f9b277fe640 1 -- 172.21.15.170:0/1189859338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b28102aa0 msgr2=0x7f9b28100700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:20.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.656+0000 7f9b277fe640 1 --2- 172.21.15.170:0/1189859338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b28102aa0 0x7f9b28100700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:20.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.656+0000 7f9b277fe640 1 -- 172.21.15.170:0/1189859338 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b28101180 con 0x7f9b281033c0 2024-09-04T16:50:20.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.657+0000 7f9b277fe640 1 --2- 172.21.15.170:0/1189859338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b281033c0 0x7f9b28100c40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c031460 tx=0x7f9b1c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:20.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.657+0000 7f9b257fa640 1 -- 172.21.15.170:0/1189859338 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b1c03f070 con 0x7f9b281033c0 2024-09-04T16:50:20.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.657+0000 7f9b2e7ae640 1 -- 172.21.15.170:0/1189859338 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b28101410 con 0x7f9b281033c0 2024-09-04T16:50:20.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.657+0000 7f9b257fa640 1 -- 172.21.15.170:0/1189859338 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9b1c0035f0 con 0x7f9b281033c0 2024-09-04T16:50:20.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.657+0000 7f9b257fa640 1 -- 172.21.15.170:0/1189859338 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b1c035030 con 0x7f9b281033c0 2024-09-04T16:50:20.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.657+0000 7f9b2e7ae640 1 -- 172.21.15.170:0/1189859338 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b281a3e20 con 0x7f9b281033c0 2024-09-04T16:50:20.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.658+0000 7f9b2e7ae640 1 -- 172.21.15.170:0/1189859338 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b2806a410 con 0x7f9b281033c0 2024-09-04T16:50:20.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.659+0000 7f9b257fa640 1 -- 172.21.15.170:0/1189859338 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f9b1c042070 con 0x7f9b281033c0 2024-09-04T16:50:20.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.659+0000 7f9b257fa640 1 --2- 172.21.15.170:0/1189859338 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b10079e30 0x7f9b1007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:20.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.659+0000 7f9b257fa640 1 -- 172.21.15.170:0/1189859338 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9b1c0bd430 con 0x7f9b281033c0 2024-09-04T16:50:20.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.659+0000 7f9b27fff640 1 --2- 172.21.15.170:0/1189859338 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b10079e30 0x7f9b1007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:20.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.660+0000 7f9b27fff640 1 --2- 172.21.15.170:0/1189859338 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b10079e30 0x7f9b1007c2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9b18005fd0 tx=0x7f9b18005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:20.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.664+0000 7f9b257fa640 1 -- 172.21.15.170:0/1189859338 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9b1c084e40 con 0x7f9b281033c0 2024-09-04T16:50:20.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.856+0000 7f9b2e7ae640 1 -- 172.21.15.170:0/1189859338 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9b28101c30 con 0x7f9b10079e30 2024-09-04T16:50:20.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.857+0000 7f9b257fa640 1 -- 172.21.15.170:0/1189859338 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9b28101c30 con 0x7f9b10079e30 2024-09-04T16:50:20.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.859+0000 7f9b2e7ae640 1 -- 172.21.15.170:0/1189859338 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b10079e30 msgr2=0x7f9b1007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:20.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.859+0000 7f9b2e7ae640 1 --2- 172.21.15.170:0/1189859338 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b10079e30 0x7f9b1007c2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9b18005fd0 tx=0x7f9b18005850 comp rx=0 tx=0).stop 2024-09-04T16:50:20.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.859+0000 7f9b2e7ae640 1 -- 172.21.15.170:0/1189859338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b281033c0 msgr2=0x7f9b28100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:20.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.859+0000 7f9b2e7ae640 1 --2- 172.21.15.170:0/1189859338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b281033c0 0x7f9b28100c40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c031460 tx=0x7f9b1c004530 comp rx=0 tx=0).stop 2024-09-04T16:50:20.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.859+0000 7f9b2e7ae640 1 -- 172.21.15.170:0/1189859338 shutdown_connections 2024-09-04T16:50:20.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.859+0000 7f9b2e7ae640 1 --2- 172.21.15.170:0/1189859338 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b10079e30 0x7f9b1007c2f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:20.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.859+0000 7f9b2e7ae640 1 --2- 172.21.15.170:0/1189859338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b281033c0 0x7f9b28100c40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:20.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.859+0000 7f9b2e7ae640 1 --2- 172.21.15.170:0/1189859338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b28102aa0 0x7f9b28100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:20.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.859+0000 7f9b2e7ae640 1 -- 172.21.15.170:0/1189859338 >> 172.21.15.170:0/1189859338 conn(0x7f9b280fc4c0 msgr2=0x7f9b28107d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:20.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.859+0000 7f9b2e7ae640 1 -- 172.21.15.170:0/1189859338 shutdown_connections 2024-09-04T16:50:20.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.859+0000 7f9b2e7ae640 1 -- 172.21.15.170:0/1189859338 wait complete. 2024-09-04T16:50:20.869 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:50:20.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.943+0000 7f440e572640 1 -- 172.21.15.170:0/3065426914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4408107930 msgr2=0x7f4408107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:20.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.943+0000 7f440e572640 1 --2- 172.21.15.170:0/3065426914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4408107930 0x7f4408107d10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009880 tx=0x7f43f802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:50:20.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.943+0000 7f440e572640 1 -- 172.21.15.170:0/3065426914 shutdown_connections 2024-09-04T16:50:20.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.943+0000 7f440e572640 1 --2- 172.21.15.170:0/3065426914 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4408101930 0x7f4408101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:20.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.943+0000 7f440e572640 1 --2- 172.21.15.170:0/3065426914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4408107930 0x7f4408107d10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:20.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.943+0000 7f440e572640 1 -- 172.21.15.170:0/3065426914 >> 172.21.15.170:0/3065426914 conn(0x7f44080fd630 msgr2=0x7f44080ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:20.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.943+0000 7f440e572640 1 -- 172.21.15.170:0/3065426914 shutdown_connections 2024-09-04T16:50:20.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.943+0000 7f440e572640 1 -- 172.21.15.170:0/3065426914 wait complete. 2024-09-04T16:50:20.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.944+0000 7f440e572640 1 Processor -- start 2024-09-04T16:50:20.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.944+0000 7f440e572640 1 -- start start 2024-09-04T16:50:20.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.944+0000 7f440e572640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4408101930 0x7f440819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:20.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.944+0000 7f440e572640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4408107930 0x7f440819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:20.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.944+0000 7f440e572640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f440810ee00 con 0x7f4408101930 2024-09-04T16:50:20.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.944+0000 7f440e572640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f440810ec80 con 0x7f4408107930 2024-09-04T16:50:20.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.944+0000 7f4407fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4408101930 0x7f440819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:20.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.944+0000 7f4407fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4408101930 0x7f440819d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43754/0 (socket says 172.21.15.170:43754) 2024-09-04T16:50:20.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.944+0000 7f4407fff640 1 -- 172.21.15.170:0/3664976918 learned_addr learned my addr 172.21.15.170:0/3664976918 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:50:20.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.944+0000 7f44077fe640 1 --2- 172.21.15.170:0/3664976918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4408107930 0x7f440819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:20.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.945+0000 7f4407fff640 1 -- 172.21.15.170:0/3664976918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4408107930 msgr2=0x7f440819dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:20.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.945+0000 7f4407fff640 1 --2- 172.21.15.170:0/3664976918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4408107930 0x7f440819dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:20.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.945+0000 7f4407fff640 1 -- 172.21.15.170:0/3664976918 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44081977f0 con 0x7f4408101930 2024-09-04T16:50:20.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.945+0000 7f4407fff640 1 --2- 172.21.15.170:0/3664976918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4408101930 0x7f440819d670 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f43f8031460 tx=0x7f43f80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:20.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.945+0000 7f44057fa640 1 -- 172.21.15.170:0/3664976918 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f43f803f070 con 0x7f4408101930 2024-09-04T16:50:20.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.945+0000 7f44057fa640 1 -- 172.21.15.170:0/3664976918 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f43f80035f0 con 0x7f4408101930 2024-09-04T16:50:20.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.945+0000 7f440e572640 1 -- 172.21.15.170:0/3664976918 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4408197a80 con 0x7f4408101930 2024-09-04T16:50:20.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.945+0000 7f44057fa640 1 -- 172.21.15.170:0/3664976918 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f43f8035030 con 0x7f4408101930 2024-09-04T16:50:20.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.945+0000 7f440e572640 1 -- 172.21.15.170:0/3664976918 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4408197fb0 con 0x7f4408101930 2024-09-04T16:50:20.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.946+0000 7f440e572640 1 -- 172.21.15.170:0/3664976918 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4408103070 con 0x7f4408101930 2024-09-04T16:50:20.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.947+0000 7f44057fa640 1 -- 172.21.15.170:0/3664976918 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f43f8042070 con 0x7f4408101930 2024-09-04T16:50:20.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.948+0000 7f44057fa640 1 --2- 172.21.15.170:0/3664976918 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f43f0079e30 0x7f43f007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:20.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.948+0000 7f44057fa640 1 -- 172.21.15.170:0/3664976918 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f43f80bd3b0 con 0x7f4408101930 2024-09-04T16:50:20.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.948+0000 7f44077fe640 1 --2- 172.21.15.170:0/3664976918 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f43f0079e30 0x7f43f007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:20.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.948+0000 7f44077fe640 1 --2- 172.21.15.170:0/3664976918 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f43f0079e30 0x7f43f007c2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f44080ffc20 tx=0x7f43fc00b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:20.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:20.952+0000 7f44057fa640 1 -- 172.21.15.170:0/3664976918 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f43f8088f30 con 0x7f4408101930 2024-09-04T16:50:21.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.145+0000 7f440e572640 1 -- 172.21.15.170:0/3664976918 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4408198260 con 0x7f43f0079e30 2024-09-04T16:50:21.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.146+0000 7f44057fa640 1 -- 172.21.15.170:0/3664976918 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f4408198260 con 0x7f43f0079e30 2024-09-04T16:50:21.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.148+0000 7f440e572640 1 -- 172.21.15.170:0/3664976918 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f43f0079e30 msgr2=0x7f43f007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:21.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.148+0000 7f440e572640 1 --2- 172.21.15.170:0/3664976918 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f43f0079e30 0x7f43f007c2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f44080ffc20 tx=0x7f43fc00b390 comp rx=0 tx=0).stop 2024-09-04T16:50:21.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.148+0000 7f440e572640 1 -- 172.21.15.170:0/3664976918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4408101930 msgr2=0x7f440819d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:21.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.148+0000 7f440e572640 1 --2- 172.21.15.170:0/3664976918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4408101930 0x7f440819d670 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f43f8031460 tx=0x7f43f80045e0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.149+0000 7f440e572640 1 -- 172.21.15.170:0/3664976918 shutdown_connections 2024-09-04T16:50:21.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.149+0000 7f440e572640 1 --2- 172.21.15.170:0/3664976918 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f43f0079e30 0x7f43f007c2f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.149+0000 7f440e572640 1 --2- 172.21.15.170:0/3664976918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4408107930 0x7f440819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.149+0000 7f440e572640 1 --2- 172.21.15.170:0/3664976918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4408101930 0x7f440819d670 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.149+0000 7f440e572640 1 -- 172.21.15.170:0/3664976918 >> 172.21.15.170:0/3664976918 conn(0x7f44080fd630 msgr2=0x7f44080fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:21.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.149+0000 7f440e572640 1 -- 172.21.15.170:0/3664976918 shutdown_connections 2024-09-04T16:50:21.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.149+0000 7f440e572640 1 -- 172.21.15.170:0/3664976918 wait complete. 2024-09-04T16:50:21.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.232+0000 7fba01ca4640 1 -- 172.21.15.170:0/794290192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9fc1007e0 msgr2=0x7fb9fc100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:21.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.232+0000 7fba01ca4640 1 --2- 172.21.15.170:0/794290192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9fc1007e0 0x7fb9fc100c40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009880 tx=0x7fb9ec02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.232+0000 7fba01ca4640 1 -- 172.21.15.170:0/794290192 shutdown_connections 2024-09-04T16:50:21.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.232+0000 7fba01ca4640 1 --2- 172.21.15.170:0/794290192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9fc1007e0 0x7fb9fc100c40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.232+0000 7fba01ca4640 1 --2- 172.21.15.170:0/794290192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9fc1067e0 0x7fb9fc106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.232+0000 7fba01ca4640 1 -- 172.21.15.170:0/794290192 >> 172.21.15.170:0/794290192 conn(0x7fb9fc0fc4c0 msgr2=0x7fb9fc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:21.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.233+0000 7fba01ca4640 1 -- 172.21.15.170:0/794290192 shutdown_connections 2024-09-04T16:50:21.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.233+0000 7fba01ca4640 1 -- 172.21.15.170:0/794290192 wait complete. 2024-09-04T16:50:21.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.233+0000 7fba01ca4640 1 Processor -- start 2024-09-04T16:50:21.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.233+0000 7fba01ca4640 1 -- start start 2024-09-04T16:50:21.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.233+0000 7fba01ca4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9fc1007e0 0x7fb9fc19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:21.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.234+0000 7fba01ca4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9fc1067e0 0x7fb9fc19cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:21.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.234+0000 7fba01ca4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc10dcb0 con 0x7fb9fc1067e0 2024-09-04T16:50:21.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.234+0000 7fba01ca4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc10db30 con 0x7fb9fc1007e0 2024-09-04T16:50:21.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.234+0000 7fb9faffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9fc1067e0 0x7fb9fc19cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.234+0000 7fb9faffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9fc1067e0 0x7fb9fc19cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43766/0 (socket says 172.21.15.170:43766) 2024-09-04T16:50:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.234+0000 7fb9faffd640 1 -- 172.21.15.170:0/2380345988 learned_addr learned my addr 172.21.15.170:0/2380345988 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:50:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.234+0000 7fb9fb7fe640 1 --2- 172.21.15.170:0/2380345988 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9fc1007e0 0x7fb9fc19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.234+0000 7fb9faffd640 1 -- 172.21.15.170:0/2380345988 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9fc1007e0 msgr2=0x7fb9fc19c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.234+0000 7fb9faffd640 1 --2- 172.21.15.170:0/2380345988 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9fc1007e0 0x7fb9fc19c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.234+0000 7fb9faffd640 1 -- 172.21.15.170:0/2380345988 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc1966a0 con 0x7fb9fc1067e0 2024-09-04T16:50:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.234+0000 7fb9faffd640 1 --2- 172.21.15.170:0/2380345988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9fc1067e0 0x7fb9fc19cb10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec031460 tx=0x7fb9ec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.234+0000 7fb9f8ff9640 1 -- 172.21.15.170:0/2380345988 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9ec03f070 con 0x7fb9fc1067e0 2024-09-04T16:50:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.234+0000 7fb9f8ff9640 1 -- 172.21.15.170:0/2380345988 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb9ec004cf0 con 0x7fb9fc1067e0 2024-09-04T16:50:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.234+0000 7fba01ca4640 1 -- 172.21.15.170:0/2380345988 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9fc196930 con 0x7fb9fc1067e0 2024-09-04T16:50:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.234+0000 7fb9f8ff9640 1 -- 172.21.15.170:0/2380345988 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9ec035030 con 0x7fb9fc1067e0 2024-09-04T16:50:21.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.234+0000 7fba01ca4640 1 -- 172.21.15.170:0/2380345988 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9fc196e30 con 0x7fb9fc1067e0 2024-09-04T16:50:21.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.235+0000 7fba01ca4640 1 -- 172.21.15.170:0/2380345988 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9fc101f20 con 0x7fb9fc1067e0 2024-09-04T16:50:21.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.236+0000 7fb9f8ff9640 1 -- 172.21.15.170:0/2380345988 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fb9ec042070 con 0x7fb9fc1067e0 2024-09-04T16:50:21.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.237+0000 7fb9f8ff9640 1 --2- 172.21.15.170:0/2380345988 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb9e4079e80 0x7fb9e407c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:21.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.237+0000 7fb9f8ff9640 1 -- 172.21.15.170:0/2380345988 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb9ec0bd400 con 0x7fb9fc1067e0 2024-09-04T16:50:21.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.237+0000 7fb9fb7fe640 1 --2- 172.21.15.170:0/2380345988 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb9e4079e80 0x7fb9e407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:21.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.237+0000 7fb9fb7fe640 1 --2- 172.21.15.170:0/2380345988 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb9e4079e80 0x7fb9e407c340 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00058c0 tx=0x7fb9f000a250 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:21.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.241+0000 7fb9f8ff9640 1 -- 172.21.15.170:0/2380345988 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb9ec089000 con 0x7fb9fc1067e0 2024-09-04T16:50:21.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.423+0000 7fba01ca4640 1 -- 172.21.15.170:0/2380345988 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb9fc197140 con 0x7fb9e4079e80 2024-09-04T16:50:21.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.432+0000 7fb9f8ff9640 1 -- 172.21.15.170:0/2380345988 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb9fc197140 con 0x7fb9e4079e80 2024-09-04T16:50:21.433 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:50:21.433 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (17m) 11m ago 28m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:50:21.433 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (20m) 11m ago 28m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:50:21.433 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (19m) 11m ago 27m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:50:21.433 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (15m) 11m ago 28m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:50:21.433 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (15m) 11m ago 27m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:50:21.433 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (16m) 11m ago 27m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:50:21.433 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (11m) 11m ago 22m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:50:21.433 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (11m) 11m ago 22m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:50:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (11m) 11m ago 22m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:50:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (11m) 11m ago 22m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:50:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (19m) 11m ago 29m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:50:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (18m) 11m ago 27m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:50:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (16m) 11m ago 29m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:50:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (15m) 11m ago 27m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:50:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (18m) 11m ago 28m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:50:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (18m) 11m ago 27m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:50:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (15m) 11m ago 26m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:50:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (14m) 11m ago 25m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:50:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (13m) 11m ago 25m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:50:21.435 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (13m) 11m ago 24m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:50:21.435 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (12m) 11m ago 24m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:50:21.435 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (12m) 11m ago 23m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:50:21.435 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (17m) 11m ago 27m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:50:21.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.434+0000 7fba01ca4640 1 -- 172.21.15.170:0/2380345988 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb9e4079e80 msgr2=0x7fb9e407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:21.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.434+0000 7fba01ca4640 1 --2- 172.21.15.170:0/2380345988 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb9e4079e80 0x7fb9e407c340 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00058c0 tx=0x7fb9f000a250 comp rx=0 tx=0).stop 2024-09-04T16:50:21.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.434+0000 7fba01ca4640 1 -- 172.21.15.170:0/2380345988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9fc1067e0 msgr2=0x7fb9fc19cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:21.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.434+0000 7fba01ca4640 1 --2- 172.21.15.170:0/2380345988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9fc1067e0 0x7fb9fc19cb10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec031460 tx=0x7fb9ec0048f0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.434+0000 7fba01ca4640 1 -- 172.21.15.170:0/2380345988 shutdown_connections 2024-09-04T16:50:21.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.434+0000 7fba01ca4640 1 --2- 172.21.15.170:0/2380345988 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb9e4079e80 0x7fb9e407c340 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.434+0000 7fba01ca4640 1 --2- 172.21.15.170:0/2380345988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9fc1067e0 0x7fb9fc19cb10 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.434+0000 7fba01ca4640 1 --2- 172.21.15.170:0/2380345988 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9fc1007e0 0x7fb9fc19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.434+0000 7fba01ca4640 1 -- 172.21.15.170:0/2380345988 >> 172.21.15.170:0/2380345988 conn(0x7fb9fc0fc4c0 msgr2=0x7fb9fc0fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:21.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.434+0000 7fba01ca4640 1 -- 172.21.15.170:0/2380345988 shutdown_connections 2024-09-04T16:50:21.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.434+0000 7fba01ca4640 1 -- 172.21.15.170:0/2380345988 wait complete. 2024-09-04T16:50:21.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.515+0000 7f6a69bf7640 1 -- 172.21.15.170:0/2337462954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a64103400 msgr2=0x7f6a6410b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:21.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.515+0000 7f6a69bf7640 1 --2- 172.21.15.170:0/2337462954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a64103400 0x7f6a6410b8f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009880 tx=0x7f6a5802a530 comp rx=0 tx=0).stop 2024-09-04T16:50:21.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.515+0000 7f6a69bf7640 1 -- 172.21.15.170:0/2337462954 shutdown_connections 2024-09-04T16:50:21.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.515+0000 7f6a69bf7640 1 --2- 172.21.15.170:0/2337462954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a64103400 0x7f6a6410b8f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.515+0000 7f6a69bf7640 1 --2- 172.21.15.170:0/2337462954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a64102ae0 0x7f6a64102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.515+0000 7f6a69bf7640 1 -- 172.21.15.170:0/2337462954 >> 172.21.15.170:0/2337462954 conn(0x7f6a640fc520 msgr2=0x7f6a640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:21.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.515+0000 7f6a69bf7640 1 -- 172.21.15.170:0/2337462954 shutdown_connections 2024-09-04T16:50:21.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.515+0000 7f6a69bf7640 1 -- 172.21.15.170:0/2337462954 wait complete. 2024-09-04T16:50:21.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.516+0000 7f6a69bf7640 1 Processor -- start 2024-09-04T16:50:21.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.516+0000 7f6a69bf7640 1 -- start start 2024-09-04T16:50:21.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.516+0000 7f6a69bf7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a64102ae0 0x7f6a6419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:21.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.516+0000 7f6a69bf7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a64103400 0x7f6a6419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:21.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.517+0000 7f6a69bf7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6410ee10 con 0x7f6a64102ae0 2024-09-04T16:50:21.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.517+0000 7f6a69bf7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6410ec90 con 0x7f6a64103400 2024-09-04T16:50:21.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.517+0000 7f6a637fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a64102ae0 0x7f6a6419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:21.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.517+0000 7f6a637fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a64102ae0 0x7f6a6419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43796/0 (socket says 172.21.15.170:43796) 2024-09-04T16:50:21.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.517+0000 7f6a637fe640 1 -- 172.21.15.170:0/4171470241 learned_addr learned my addr 172.21.15.170:0/4171470241 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:50:21.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.517+0000 7f6a62ffd640 1 --2- 172.21.15.170:0/4171470241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a64103400 0x7f6a6419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:21.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.517+0000 7f6a637fe640 1 -- 172.21.15.170:0/4171470241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a64103400 msgr2=0x7f6a6419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.517+0000 7f6a637fe640 1 --2- 172.21.15.170:0/4171470241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a64103400 0x7f6a6419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.517+0000 7f6a637fe640 1 -- 172.21.15.170:0/4171470241 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a64197820 con 0x7f6a64102ae0 2024-09-04T16:50:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.517+0000 7f6a637fe640 1 --2- 172.21.15.170:0/4171470241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a64102ae0 0x7f6a6419d6a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400ea00 tx=0x7f6a5400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.517+0000 7f6a60ff9640 1 -- 172.21.15.170:0/4171470241 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a5400cb80 con 0x7f6a64102ae0 2024-09-04T16:50:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.517+0000 7f6a60ff9640 1 -- 172.21.15.170:0/4171470241 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a5400cd20 con 0x7f6a64102ae0 2024-09-04T16:50:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.517+0000 7f6a69bf7640 1 -- 172.21.15.170:0/4171470241 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a64197b10 con 0x7f6a64102ae0 2024-09-04T16:50:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.517+0000 7f6a60ff9640 1 -- 172.21.15.170:0/4171470241 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a54011470 con 0x7f6a64102ae0 2024-09-04T16:50:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.518+0000 7f6a69bf7640 1 -- 172.21.15.170:0/4171470241 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a64198070 con 0x7f6a64102ae0 2024-09-04T16:50:21.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.519+0000 7f6a69bf7640 1 -- 172.21.15.170:0/4171470241 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6406abe0 con 0x7f6a64102ae0 2024-09-04T16:50:21.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.519+0000 7f6a60ff9640 1 -- 172.21.15.170:0/4171470241 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f6a54005020 con 0x7f6a64102ae0 2024-09-04T16:50:21.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.520+0000 7f6a60ff9640 1 --2- 172.21.15.170:0/4171470241 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6a4c079e40 0x7f6a4c07c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:21.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.520+0000 7f6a60ff9640 1 -- 172.21.15.170:0/4171470241 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6a5409cf40 con 0x7f6a64102ae0 2024-09-04T16:50:21.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.520+0000 7f6a62ffd640 1 --2- 172.21.15.170:0/4171470241 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6a4c079e40 0x7f6a4c07c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:21.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.520+0000 7f6a62ffd640 1 --2- 172.21.15.170:0/4171470241 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6a4c079e40 0x7f6a4c07c300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6a64198b70 tx=0x7f6a58031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.524+0000 7f6a60ff9640 1 -- 172.21.15.170:0/4171470241 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6a54016030 con 0x7f6a64102ae0 2024-09-04T16:50:21.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.768+0000 7f6a69bf7640 1 -- 172.21.15.170:0/4171470241 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6a64105f80 con 0x7f6a64102ae0 2024-09-04T16:50:21.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.769+0000 7f6a60ff9640 1 -- 172.21.15.170:0/4171470241 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f6a54068a20 con 0x7f6a64102ae0 2024-09-04T16:50:21.770 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:50:21.770 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:50:21.770 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:50:21.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:50:21.770 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:50:21.770 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:50:21.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:50:21.770 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:50:21.770 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:50:21.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:50:21.771 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:50:21.771 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:50:21.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:50:21.771 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:50:21.771 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:50:21.771 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:50:21.771 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:50:21.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.772+0000 7f6a69bf7640 1 -- 172.21.15.170:0/4171470241 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6a4c079e40 msgr2=0x7f6a4c07c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:21.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.772+0000 7f6a69bf7640 1 --2- 172.21.15.170:0/4171470241 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6a4c079e40 0x7f6a4c07c300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6a64198b70 tx=0x7f6a58031400 comp rx=0 tx=0).stop 2024-09-04T16:50:21.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.772+0000 7f6a69bf7640 1 -- 172.21.15.170:0/4171470241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a64102ae0 msgr2=0x7f6a6419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:21.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.772+0000 7f6a69bf7640 1 --2- 172.21.15.170:0/4171470241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a64102ae0 0x7f6a6419d6a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400ea00 tx=0x7f6a5400eec0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.772+0000 7f6a69bf7640 1 -- 172.21.15.170:0/4171470241 shutdown_connections 2024-09-04T16:50:21.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.772+0000 7f6a69bf7640 1 --2- 172.21.15.170:0/4171470241 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6a4c079e40 0x7f6a4c07c300 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.772+0000 7f6a69bf7640 1 --2- 172.21.15.170:0/4171470241 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a64103400 0x7f6a6419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.772+0000 7f6a69bf7640 1 --2- 172.21.15.170:0/4171470241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a64102ae0 0x7f6a6419d6a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.772+0000 7f6a69bf7640 1 -- 172.21.15.170:0/4171470241 >> 172.21.15.170:0/4171470241 conn(0x7f6a640fc520 msgr2=0x7f6a64108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:21.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.772+0000 7f6a69bf7640 1 -- 172.21.15.170:0/4171470241 shutdown_connections 2024-09-04T16:50:21.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.772+0000 7f6a69bf7640 1 -- 172.21.15.170:0/4171470241 wait complete. 2024-09-04T16:50:21.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.853+0000 7f0692936640 1 -- 172.21.15.170:0/2415327458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f068c100f80 msgr2=0x7f068c1013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:21.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.853+0000 7f0692936640 1 --2- 172.21.15.170:0/2415327458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f068c100f80 0x7f068c1013e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0680009880 tx=0x7f068002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.853+0000 7f0692936640 1 -- 172.21.15.170:0/2415327458 shutdown_connections 2024-09-04T16:50:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.853+0000 7f0692936640 1 --2- 172.21.15.170:0/2415327458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f068c100f80 0x7f068c1013e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.853+0000 7f0692936640 1 --2- 172.21.15.170:0/2415327458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f068c1057b0 0x7f068c105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.853+0000 7f0692936640 1 -- 172.21.15.170:0/2415327458 >> 172.21.15.170:0/2415327458 conn(0x7f068c0fbc40 msgr2=0x7f068c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.853+0000 7f0692936640 1 -- 172.21.15.170:0/2415327458 shutdown_connections 2024-09-04T16:50:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.853+0000 7f0692936640 1 -- 172.21.15.170:0/2415327458 wait complete. 2024-09-04T16:50:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.854+0000 7f0692936640 1 Processor -- start 2024-09-04T16:50:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.854+0000 7f0692936640 1 -- start start 2024-09-04T16:50:21.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.854+0000 7f0692936640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f068c100f80 0x7f068c1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.854+0000 7f0692936640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f068c1057b0 0x7f068c198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.854+0000 7f0692936640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f068c10dca0 con 0x7f068c1057b0 2024-09-04T16:50:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.854+0000 7f0692936640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f068c10db20 con 0x7f068c100f80 2024-09-04T16:50:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.854+0000 7f068b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f068c1057b0 0x7f068c198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.855+0000 7f068b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f068c1057b0 0x7f068c198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43818/0 (socket says 172.21.15.170:43818) 2024-09-04T16:50:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.855+0000 7f068b7fe640 1 -- 172.21.15.170:0/3535006064 learned_addr learned my addr 172.21.15.170:0/3535006064 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:50:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.855+0000 7f068bfff640 1 --2- 172.21.15.170:0/3535006064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f068c100f80 0x7f068c1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.855+0000 7f068b7fe640 1 -- 172.21.15.170:0/3535006064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f068c100f80 msgr2=0x7f068c1987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.855+0000 7f068b7fe640 1 --2- 172.21.15.170:0/3535006064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f068c100f80 0x7f068c1987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.855+0000 7f068b7fe640 1 -- 172.21.15.170:0/3535006064 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068c1992f0 con 0x7f068c1057b0 2024-09-04T16:50:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.855+0000 7f068b7fe640 1 --2- 172.21.15.170:0/3535006064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f068c1057b0 0x7f068c198cf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0680031460 tx=0x7f06800045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.855+0000 7f06897fa640 1 -- 172.21.15.170:0/3535006064 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f068003f070 con 0x7f068c1057b0 2024-09-04T16:50:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.855+0000 7f06897fa640 1 -- 172.21.15.170:0/3535006064 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06800035f0 con 0x7f068c1057b0 2024-09-04T16:50:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.855+0000 7f0692936640 1 -- 172.21.15.170:0/3535006064 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068c199580 con 0x7f068c1057b0 2024-09-04T16:50:21.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.855+0000 7f06897fa640 1 -- 172.21.15.170:0/3535006064 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0680035030 con 0x7f068c1057b0 2024-09-04T16:50:21.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.855+0000 7f0692936640 1 -- 172.21.15.170:0/3535006064 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f068c1a1b30 con 0x7f068c1057b0 2024-09-04T16:50:21.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.856+0000 7f0692936640 1 -- 172.21.15.170:0/3535006064 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f068c101f90 con 0x7f068c1057b0 2024-09-04T16:50:21.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.857+0000 7f06897fa640 1 -- 172.21.15.170:0/3535006064 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f0680042070 con 0x7f068c1057b0 2024-09-04T16:50:21.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.857+0000 7f06897fa640 1 --2- 172.21.15.170:0/3535006064 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0674079e30 0x7f067407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:21.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.858+0000 7f068bfff640 1 --2- 172.21.15.170:0/3535006064 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0674079e30 0x7f067407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:21.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.858+0000 7f06897fa640 1 -- 172.21.15.170:0/3535006064 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f06800bd3b0 con 0x7f068c1057b0 2024-09-04T16:50:21.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.858+0000 7f068bfff640 1 --2- 172.21.15.170:0/3535006064 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0674079e30 0x7f067407c2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f067c005fd0 tx=0x7f067c00b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:21.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:21.862+0000 7f06897fa640 1 -- 172.21.15.170:0/3535006064 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0680088f30 con 0x7f068c1057b0 2024-09-04T16:50:22.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.072+0000 7f0692936640 1 -- 172.21.15.170:0/3535006064 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f068c108cf0 con 0x7f068c1057b0 2024-09-04T16:50:22.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.072+0000 7f06897fa640 1 -- 172.21.15.170:0/3535006064 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7f068008d950 con 0x7f068c1057b0 2024-09-04T16:50:22.073 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:50:22.073 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:50:22.073 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:50:22.074 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:50:22.074 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:50:22.074 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:50:22.074 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:50:22.074 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:50:22.074 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:50:22.074 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:50:22.074 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:50:22.074 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:50:22.074 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:50:22.074 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:50:22.074 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:50:22.074 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:50:22.075 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:50:22.075 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:50:22.075 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:50:22.075 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:50:22.075 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:50:22.075 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:50:22.075 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:50:22.075 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:50:22.075 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:50:22.075 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:50:22.075 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:50:22.075 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:50:22.075 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:50:22.076 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:50:22.076 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:50:22.076 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:50:22.076 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:50:22.076 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:50:22.076 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:50:22.076 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:50:22.076 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:50:22.076 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:50:22.076 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:50:22.076 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:50:22.076 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:50:22.076 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:50:22.076 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:50:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:50:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.075+0000 7f0692936640 1 -- 172.21.15.170:0/3535006064 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0674079e30 msgr2=0x7f067407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.075+0000 7f0692936640 1 --2- 172.21.15.170:0/3535006064 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0674079e30 0x7f067407c2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f067c005fd0 tx=0x7f067c00b390 comp rx=0 tx=0).stop 2024-09-04T16:50:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.075+0000 7f0692936640 1 -- 172.21.15.170:0/3535006064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f068c1057b0 msgr2=0x7f068c198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.075+0000 7f0692936640 1 --2- 172.21.15.170:0/3535006064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f068c1057b0 0x7f068c198cf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0680031460 tx=0x7f06800045e0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.075+0000 7f0692936640 1 -- 172.21.15.170:0/3535006064 shutdown_connections 2024-09-04T16:50:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.075+0000 7f0692936640 1 --2- 172.21.15.170:0/3535006064 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0674079e30 0x7f067407c2f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.075+0000 7f0692936640 1 --2- 172.21.15.170:0/3535006064 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f068c1057b0 0x7f068c198cf0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.075+0000 7f0692936640 1 --2- 172.21.15.170:0/3535006064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f068c100f80 0x7f068c1987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.075+0000 7f0692936640 1 -- 172.21.15.170:0/3535006064 >> 172.21.15.170:0/3535006064 conn(0x7f068c0fbc40 msgr2=0x7f068c0fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.075+0000 7f0692936640 1 -- 172.21.15.170:0/3535006064 shutdown_connections 2024-09-04T16:50:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.075+0000 7f0692936640 1 -- 172.21.15.170:0/3535006064 wait complete. 2024-09-04T16:50:22.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.158+0000 7f77c1c5a640 1 -- 172.21.15.170:0/1111799972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77bc1007e0 msgr2=0x7f77bc100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:22.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.158+0000 7f77c1c5a640 1 --2- 172.21.15.170:0/1111799972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77bc1007e0 0x7f77bc100c40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f77b0009c20 tx=0x7f77b002a970 comp rx=0 tx=0).stop 2024-09-04T16:50:22.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.158+0000 7f77c1c5a640 1 -- 172.21.15.170:0/1111799972 shutdown_connections 2024-09-04T16:50:22.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.158+0000 7f77c1c5a640 1 --2- 172.21.15.170:0/1111799972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77bc1007e0 0x7f77bc100c40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.158+0000 7f77c1c5a640 1 --2- 172.21.15.170:0/1111799972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77bc1067e0 0x7f77bc106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.158+0000 7f77c1c5a640 1 -- 172.21.15.170:0/1111799972 >> 172.21.15.170:0/1111799972 conn(0x7f77bc0fc4c0 msgr2=0x7f77bc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:22.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.158+0000 7f77c1c5a640 1 -- 172.21.15.170:0/1111799972 shutdown_connections 2024-09-04T16:50:22.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.158+0000 7f77c1c5a640 1 -- 172.21.15.170:0/1111799972 wait complete. 2024-09-04T16:50:22.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.158+0000 7f77c1c5a640 1 Processor -- start 2024-09-04T16:50:22.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.159+0000 7f77c1c5a640 1 -- start start 2024-09-04T16:50:22.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.159+0000 7f77c1c5a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77bc1007e0 0x7f77bc19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:22.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.159+0000 7f77c1c5a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77bc1067e0 0x7f77bc19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:22.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.159+0000 7f77c1c5a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc10dcb0 con 0x7f77bc1067e0 2024-09-04T16:50:22.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.159+0000 7f77c1c5a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc10db30 con 0x7f77bc1007e0 2024-09-04T16:50:22.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.159+0000 7f77baffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77bc1067e0 0x7f77bc19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:22.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.159+0000 7f77baffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77bc1067e0 0x7f77bc19dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43836/0 (socket says 172.21.15.170:43836) 2024-09-04T16:50:22.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.159+0000 7f77baffd640 1 -- 172.21.15.170:0/3753437158 learned_addr learned my addr 172.21.15.170:0/3753437158 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:50:22.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.159+0000 7f77bb7fe640 1 --2- 172.21.15.170:0/3753437158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77bc1007e0 0x7f77bc19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:22.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.159+0000 7f77baffd640 1 -- 172.21.15.170:0/3753437158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77bc1007e0 msgr2=0x7f77bc19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:22.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.159+0000 7f77baffd640 1 --2- 172.21.15.170:0/3753437158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77bc1007e0 0x7f77bc19d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.159+0000 7f77baffd640 1 -- 172.21.15.170:0/3753437158 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77bc197830 con 0x7f77bc1067e0 2024-09-04T16:50:22.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.159+0000 7f77baffd640 1 --2- 172.21.15.170:0/3753437158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77bc1067e0 0x7f77bc19dbf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f77b002ae90 tx=0x7f77b002fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:22.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.160+0000 7f77b8ff9640 1 -- 172.21.15.170:0/3753437158 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77b0047070 con 0x7f77bc1067e0 2024-09-04T16:50:22.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.160+0000 7f77c1c5a640 1 -- 172.21.15.170:0/3753437158 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77bc197ac0 con 0x7f77bc1067e0 2024-09-04T16:50:22.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.160+0000 7f77b8ff9640 1 -- 172.21.15.170:0/3753437158 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f77b0003e30 con 0x7f77bc1067e0 2024-09-04T16:50:22.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.160+0000 7f77b8ff9640 1 -- 172.21.15.170:0/3753437158 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77b0034070 con 0x7f77bc1067e0 2024-09-04T16:50:22.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.160+0000 7f77c1c5a640 1 -- 172.21.15.170:0/3753437158 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77bc197ff0 con 0x7f77bc1067e0 2024-09-04T16:50:22.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.161+0000 7f77c1c5a640 1 -- 172.21.15.170:0/3753437158 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77bc101f20 con 0x7f77bc1067e0 2024-09-04T16:50:22.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.161+0000 7f77b8ff9640 1 -- 172.21.15.170:0/3753437158 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f77b004a070 con 0x7f77bc1067e0 2024-09-04T16:50:22.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.162+0000 7f77b8ff9640 1 --2- 172.21.15.170:0/3753437158 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f77a4079e30 0x7f77a407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:22.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.162+0000 7f77b8ff9640 1 -- 172.21.15.170:0/3753437158 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f77b00bd6c0 con 0x7f77bc1067e0 2024-09-04T16:50:22.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.162+0000 7f77bb7fe640 1 --2- 172.21.15.170:0/3753437158 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f77a4079e30 0x7f77a407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:22.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.162+0000 7f77bb7fe640 1 --2- 172.21.15.170:0/3753437158 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f77a4079e30 0x7f77a407c2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009bd0 tx=0x7f77ac005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:22.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.166+0000 7f77b8ff9640 1 -- 172.21.15.170:0/3753437158 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f77b003f070 con 0x7f77bc1067e0 2024-09-04T16:50:22.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.357+0000 7f77c1c5a640 1 -- 172.21.15.170:0/3753437158 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f77bc1982a0 con 0x7f77a4079e30 2024-09-04T16:50:22.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.358+0000 7f77b8ff9640 1 -- 172.21.15.170:0/3753437158 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f77bc1982a0 con 0x7f77a4079e30 2024-09-04T16:50:22.359 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:50:22.359 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:50:22.359 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:50:22.359 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:50:22.359 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:50:22.359 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:50:22.359 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:50:22.360 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:50:22.360 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:50:22.360 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:50:22.360 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:50:22.360 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:50:22.360 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:50:22.360 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:50:22.360 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:50:22.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.361+0000 7f77c1c5a640 1 -- 172.21.15.170:0/3753437158 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f77a4079e30 msgr2=0x7f77a407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:22.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.361+0000 7f77c1c5a640 1 --2- 172.21.15.170:0/3753437158 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f77a4079e30 0x7f77a407c2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009bd0 tx=0x7f77ac005f90 comp rx=0 tx=0).stop 2024-09-04T16:50:22.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.361+0000 7f77c1c5a640 1 -- 172.21.15.170:0/3753437158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77bc1067e0 msgr2=0x7f77bc19dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:22.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.361+0000 7f77c1c5a640 1 --2- 172.21.15.170:0/3753437158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77bc1067e0 0x7f77bc19dbf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f77b002ae90 tx=0x7f77b002fd60 comp rx=0 tx=0).stop 2024-09-04T16:50:22.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.361+0000 7f77c1c5a640 1 -- 172.21.15.170:0/3753437158 shutdown_connections 2024-09-04T16:50:22.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.361+0000 7f77c1c5a640 1 --2- 172.21.15.170:0/3753437158 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f77a4079e30 0x7f77a407c2f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.361+0000 7f77c1c5a640 1 --2- 172.21.15.170:0/3753437158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77bc1067e0 0x7f77bc19dbf0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.361+0000 7f77c1c5a640 1 --2- 172.21.15.170:0/3753437158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77bc1007e0 0x7f77bc19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.361+0000 7f77c1c5a640 1 -- 172.21.15.170:0/3753437158 >> 172.21.15.170:0/3753437158 conn(0x7f77bc0fc4c0 msgr2=0x7f77bc069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:22.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.361+0000 7f77c1c5a640 1 -- 172.21.15.170:0/3753437158 shutdown_connections 2024-09-04T16:50:22.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.361+0000 7f77c1c5a640 1 -- 172.21.15.170:0/3753437158 wait complete. 2024-09-04T16:50:22.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.442+0000 7f2653957640 1 -- 172.21.15.170:0/2021985932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f264c103400 msgr2=0x7f264c10b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:22.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.442+0000 7f2653957640 1 --2- 172.21.15.170:0/2021985932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f264c103400 0x7f264c10b8f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f263c009880 tx=0x7f263c02a530 comp rx=0 tx=0).stop 2024-09-04T16:50:22.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.442+0000 7f2653957640 1 -- 172.21.15.170:0/2021985932 shutdown_connections 2024-09-04T16:50:22.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.442+0000 7f2653957640 1 --2- 172.21.15.170:0/2021985932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f264c103400 0x7f264c10b8f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.442+0000 7f2653957640 1 --2- 172.21.15.170:0/2021985932 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f264c102ae0 0x7f264c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.443+0000 7f2653957640 1 -- 172.21.15.170:0/2021985932 >> 172.21.15.170:0/2021985932 conn(0x7f264c0fc520 msgr2=0x7f264c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:22.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.443+0000 7f2653957640 1 -- 172.21.15.170:0/2021985932 shutdown_connections 2024-09-04T16:50:22.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.443+0000 7f2653957640 1 -- 172.21.15.170:0/2021985932 wait complete. 2024-09-04T16:50:22.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.443+0000 7f2653957640 1 Processor -- start 2024-09-04T16:50:22.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.443+0000 7f2653957640 1 -- start start 2024-09-04T16:50:22.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.443+0000 7f2653957640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f264c102ae0 0x7f264c100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:22.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.443+0000 7f2653957640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f264c103400 0x7f264c100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:22.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.443+0000 7f2653957640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f264c10ee10 con 0x7f264c103400 2024-09-04T16:50:22.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.443+0000 7f2653957640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f264c10ec90 con 0x7f264c102ae0 2024-09-04T16:50:22.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.444+0000 7f2650ef2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f264c103400 0x7f264c100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:22.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.444+0000 7f2650ef2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f264c103400 0x7f264c100c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43854/0 (socket says 172.21.15.170:43854) 2024-09-04T16:50:22.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.444+0000 7f2650ef2640 1 -- 172.21.15.170:0/2333029863 learned_addr learned my addr 172.21.15.170:0/2333029863 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:50:22.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.444+0000 7f26516f3640 1 --2- 172.21.15.170:0/2333029863 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f264c102ae0 0x7f264c100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:22.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.444+0000 7f2650ef2640 1 -- 172.21.15.170:0/2333029863 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f264c102ae0 msgr2=0x7f264c100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:22.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.444+0000 7f2650ef2640 1 --2- 172.21.15.170:0/2333029863 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f264c102ae0 0x7f264c100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.444+0000 7f2650ef2640 1 -- 172.21.15.170:0/2333029863 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264c1011c0 con 0x7f264c103400 2024-09-04T16:50:22.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.444+0000 7f2650ef2640 1 --2- 172.21.15.170:0/2333029863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f264c103400 0x7f264c100c80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f263c031460 tx=0x7f263c0045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:22.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.444+0000 7f26427fc640 1 -- 172.21.15.170:0/2333029863 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f263c03f070 con 0x7f264c103400 2024-09-04T16:50:22.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.444+0000 7f26427fc640 1 -- 172.21.15.170:0/2333029863 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f263c0035f0 con 0x7f264c103400 2024-09-04T16:50:22.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.444+0000 7f2653957640 1 -- 172.21.15.170:0/2333029863 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f264c101450 con 0x7f264c103400 2024-09-04T16:50:22.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.444+0000 7f26427fc640 1 -- 172.21.15.170:0/2333029863 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f263c035030 con 0x7f264c103400 2024-09-04T16:50:22.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.444+0000 7f2653957640 1 -- 172.21.15.170:0/2333029863 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f264c1a3de0 con 0x7f264c103400 2024-09-04T16:50:22.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.446+0000 7f2653957640 1 -- 172.21.15.170:0/2333029863 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f264c06abe0 con 0x7f264c103400 2024-09-04T16:50:22.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.446+0000 7f26427fc640 1 -- 172.21.15.170:0/2333029863 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f263c042070 con 0x7f264c103400 2024-09-04T16:50:22.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.447+0000 7f26427fc640 1 --2- 172.21.15.170:0/2333029863 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2638079e80 0x7f263807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:22.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.447+0000 7f26427fc640 1 -- 172.21.15.170:0/2333029863 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f263c0bd1d0 con 0x7f264c103400 2024-09-04T16:50:22.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.447+0000 7f26516f3640 1 --2- 172.21.15.170:0/2333029863 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2638079e80 0x7f263807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:22.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.447+0000 7f26516f3640 1 --2- 172.21.15.170:0/2333029863 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2638079e80 0x7f263807c340 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2648009bd0 tx=0x7f2648005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:22.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.451+0000 7f26427fc640 1 -- 172.21.15.170:0/2333029863 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f263c088dd0 con 0x7f264c103400 2024-09-04T16:50:22.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.694+0000 7f2653957640 1 -- 172.21.15.170:0/2333029863 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f264c101c70 con 0x7f264c103400 2024-09-04T16:50:22.695 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:22 smithi170 ceph-mon[113855]: pgmap v619: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:22.696 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:22 smithi170 ceph-mon[113855]: from='client.34950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:50:22.696 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:22 smithi170 ceph-mon[113855]: from='client.34954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:50:22.696 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:22 smithi170 ceph-mon[113855]: from='client.34958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:50:22.696 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:22 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/4171470241' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:50:22.696 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:22 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3535006064' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:50:22.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.695+0000 7f26427fc640 1 -- 172.21.15.170:0/2333029863 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f263c08d7f0 con 0x7f264c103400 2024-09-04T16:50:22.696 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:50:22.697 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:50:22.697 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:50:22.697 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:50:22.697 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:50:22.697 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:50:22.697 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:50:22.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.697+0000 7f2653957640 1 -- 172.21.15.170:0/2333029863 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2638079e80 msgr2=0x7f263807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:22.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.697+0000 7f2653957640 1 --2- 172.21.15.170:0/2333029863 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2638079e80 0x7f263807c340 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2648009bd0 tx=0x7f2648005f90 comp rx=0 tx=0).stop 2024-09-04T16:50:22.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.697+0000 7f2653957640 1 -- 172.21.15.170:0/2333029863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f264c103400 msgr2=0x7f264c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:22.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.697+0000 7f2653957640 1 --2- 172.21.15.170:0/2333029863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f264c103400 0x7f264c100c80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f263c031460 tx=0x7f263c0045c0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.697+0000 7f2653957640 1 -- 172.21.15.170:0/2333029863 shutdown_connections 2024-09-04T16:50:22.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.697+0000 7f2653957640 1 --2- 172.21.15.170:0/2333029863 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2638079e80 0x7f263807c340 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.697+0000 7f2653957640 1 --2- 172.21.15.170:0/2333029863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f264c103400 0x7f264c100c80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.697+0000 7f2653957640 1 --2- 172.21.15.170:0/2333029863 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f264c102ae0 0x7f264c100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:22.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.697+0000 7f2653957640 1 -- 172.21.15.170:0/2333029863 >> 172.21.15.170:0/2333029863 conn(0x7f264c0fc520 msgr2=0x7f264c108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:22.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.697+0000 7f2653957640 1 -- 172.21.15.170:0/2333029863 shutdown_connections 2024-09-04T16:50:22.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:22.697+0000 7f2653957640 1 -- 172.21.15.170:0/2333029863 wait complete. 2024-09-04T16:50:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:22 smithi193 ceph-mon[82547]: pgmap v619: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:22 smithi193 ceph-mon[82547]: from='client.34950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:50:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:22 smithi193 ceph-mon[82547]: from='client.34954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:50:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:22 smithi193 ceph-mon[82547]: from='client.34958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:50:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:22 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/4171470241' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:50:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:22 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3535006064' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:50:23.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:23 smithi170 ceph-mon[113855]: from='client.34970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:50:23.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:23 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2333029863' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:50:23.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:23 smithi193 ceph-mon[82547]: from='client.34970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:50:23.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:23 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2333029863' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:50:24.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:24 smithi170 ceph-mon[113855]: pgmap v620: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:24 smithi193 ceph-mon[82547]: pgmap v620: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:26.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:26 smithi170 ceph-mon[113855]: pgmap v621: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:26.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:26 smithi193 ceph-mon[82547]: pgmap v621: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:28.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:28 smithi170 ceph-mon[113855]: pgmap v622: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:28.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:28 smithi193 ceph-mon[82547]: pgmap v622: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:29.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:50:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:50:30.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:30 smithi170 ceph-mon[113855]: pgmap v623: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:30.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:30 smithi193 ceph-mon[82547]: pgmap v623: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:32.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:32 smithi170 ceph-mon[113855]: pgmap v624: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:32.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:32 smithi193 ceph-mon[82547]: pgmap v624: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:34.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:34 smithi170 ceph-mon[113855]: pgmap v625: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:34.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:34 smithi193 ceph-mon[82547]: pgmap v625: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:36.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:36 smithi170 ceph-mon[113855]: pgmap v626: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:36 smithi193 ceph-mon[82547]: pgmap v626: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:38.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:38 smithi170 ceph-mon[113855]: pgmap v627: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:38 smithi193 ceph-mon[82547]: pgmap v627: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:40.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:40 smithi170 ceph-mon[113855]: pgmap v628: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:40.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:40 smithi193 ceph-mon[82547]: pgmap v628: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:42.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:42 smithi170 ceph-mon[113855]: pgmap v629: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:42 smithi193 ceph-mon[82547]: pgmap v629: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:44.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:44 smithi170 ceph-mon[113855]: pgmap v630: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:50:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:44 smithi193 ceph-mon[82547]: pgmap v630: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:50:46.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:46 smithi170 ceph-mon[113855]: pgmap v631: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:46.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:46 smithi193 ceph-mon[82547]: pgmap v631: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:48.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:48 smithi170 ceph-mon[113855]: pgmap v632: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:48 smithi193 ceph-mon[82547]: pgmap v632: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:50 smithi170 ceph-mon[113855]: pgmap v633: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:50 smithi193 ceph-mon[82547]: pgmap v633: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:52.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.792+0000 7f65469b7640 1 -- 172.21.15.170:0/3443270205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6540107930 msgr2=0x7f6540107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:52.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.792+0000 7f65469b7640 1 --2- 172.21.15.170:0/3443270205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6540107930 0x7f6540107d10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6530009880 tx=0x7f653002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:50:52.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.792+0000 7f65469b7640 1 -- 172.21.15.170:0/3443270205 shutdown_connections 2024-09-04T16:50:52.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.792+0000 7f65469b7640 1 --2- 172.21.15.170:0/3443270205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6540101930 0x7f6540101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:52.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.792+0000 7f65469b7640 1 --2- 172.21.15.170:0/3443270205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6540107930 0x7f6540107d10 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:52.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.792+0000 7f65469b7640 1 -- 172.21.15.170:0/3443270205 >> 172.21.15.170:0/3443270205 conn(0x7f65400fd630 msgr2=0x7f65400ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:52.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.792+0000 7f65469b7640 1 -- 172.21.15.170:0/3443270205 shutdown_connections 2024-09-04T16:50:52.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.792+0000 7f65469b7640 1 -- 172.21.15.170:0/3443270205 wait complete. 2024-09-04T16:50:52.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.793+0000 7f65469b7640 1 Processor -- start 2024-09-04T16:50:52.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.793+0000 7f65469b7640 1 -- start start 2024-09-04T16:50:52.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.793+0000 7f65469b7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6540101930 0x7f654019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:52.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.793+0000 7f65469b7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6540107930 0x7f654019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:52.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.793+0000 7f65469b7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f654010ee00 con 0x7f6540101930 2024-09-04T16:50:52.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.793+0000 7f65469b7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f654010ec80 con 0x7f6540107930 2024-09-04T16:50:52.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.793+0000 7f653ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6540101930 0x7f654019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:52.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.793+0000 7f653ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6540101930 0x7f654019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51212/0 (socket says 172.21.15.170:51212) 2024-09-04T16:50:52.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.793+0000 7f653ffff640 1 -- 172.21.15.170:0/2978059774 learned_addr learned my addr 172.21.15.170:0/2978059774 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:50:52.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.793+0000 7f6537fff640 1 --2- 172.21.15.170:0/2978059774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6540107930 0x7f654019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:52.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.793+0000 7f653ffff640 1 -- 172.21.15.170:0/2978059774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6540107930 msgr2=0x7f654019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:52.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.793+0000 7f653ffff640 1 --2- 172.21.15.170:0/2978059774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6540107930 0x7f654019dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:52.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.793+0000 7f653ffff640 1 -- 172.21.15.170:0/2978059774 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65401977f0 con 0x7f6540101930 2024-09-04T16:50:52.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.794+0000 7f653ffff640 1 --2- 172.21.15.170:0/2978059774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6540101930 0x7f654019d670 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6530031460 tx=0x7f6530004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:52.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.794+0000 7f653dffb640 1 -- 172.21.15.170:0/2978059774 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f653003f070 con 0x7f6540101930 2024-09-04T16:50:52.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.794+0000 7f653dffb640 1 -- 172.21.15.170:0/2978059774 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f65300035f0 con 0x7f6540101930 2024-09-04T16:50:52.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.794+0000 7f65469b7640 1 -- 172.21.15.170:0/2978059774 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6540197a80 con 0x7f6540101930 2024-09-04T16:50:52.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.794+0000 7f653dffb640 1 -- 172.21.15.170:0/2978059774 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6530035030 con 0x7f6540101930 2024-09-04T16:50:52.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.794+0000 7f65469b7640 1 -- 172.21.15.170:0/2978059774 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6540197fb0 con 0x7f6540101930 2024-09-04T16:50:52.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.795+0000 7f65469b7640 1 -- 172.21.15.170:0/2978059774 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6540103070 con 0x7f6540101930 2024-09-04T16:50:52.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.796+0000 7f653dffb640 1 -- 172.21.15.170:0/2978059774 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f6530042070 con 0x7f6540101930 2024-09-04T16:50:52.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.796+0000 7f653dffb640 1 --2- 172.21.15.170:0/2978059774 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f652c079e30 0x7f652c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:52.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.796+0000 7f653dffb640 1 -- 172.21.15.170:0/2978059774 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f65300bd430 con 0x7f6540101930 2024-09-04T16:50:52.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.796+0000 7f6537fff640 1 --2- 172.21.15.170:0/2978059774 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f652c079e30 0x7f652c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:52.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.797+0000 7f6537fff640 1 --2- 172.21.15.170:0/2978059774 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f652c079e30 0x7f652c07c2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f65400ffc20 tx=0x7f6528005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:52.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.801+0000 7f653dffb640 1 -- 172.21.15.170:0/2978059774 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6530084e40 con 0x7f6540101930 2024-09-04T16:50:52.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:52 smithi170 ceph-mon[113855]: pgmap v634: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:52 smithi193 ceph-mon[82547]: pgmap v634: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:52.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.992+0000 7f65469b7640 1 -- 172.21.15.170:0/2978059774 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6540198320 con 0x7f652c079e30 2024-09-04T16:50:52.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.994+0000 7f653dffb640 1 -- 172.21.15.170:0/2978059774 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6540198320 con 0x7f652c079e30 2024-09-04T16:50:52.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.996+0000 7f65469b7640 1 -- 172.21.15.170:0/2978059774 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f652c079e30 msgr2=0x7f652c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:52.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.996+0000 7f65469b7640 1 --2- 172.21.15.170:0/2978059774 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f652c079e30 0x7f652c07c2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f65400ffc20 tx=0x7f6528005f90 comp rx=0 tx=0).stop 2024-09-04T16:50:52.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.996+0000 7f65469b7640 1 -- 172.21.15.170:0/2978059774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6540101930 msgr2=0x7f654019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:52.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.996+0000 7f65469b7640 1 --2- 172.21.15.170:0/2978059774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6540101930 0x7f654019d670 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6530031460 tx=0x7f6530004530 comp rx=0 tx=0).stop 2024-09-04T16:50:52.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.996+0000 7f65469b7640 1 -- 172.21.15.170:0/2978059774 shutdown_connections 2024-09-04T16:50:52.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.996+0000 7f65469b7640 1 --2- 172.21.15.170:0/2978059774 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f652c079e30 0x7f652c07c2f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:52.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.996+0000 7f65469b7640 1 --2- 172.21.15.170:0/2978059774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6540107930 0x7f654019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:52.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.996+0000 7f65469b7640 1 --2- 172.21.15.170:0/2978059774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6540101930 0x7f654019d670 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:52.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.996+0000 7f65469b7640 1 -- 172.21.15.170:0/2978059774 >> 172.21.15.170:0/2978059774 conn(0x7f65400fd630 msgr2=0x7f65400fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:52.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.996+0000 7f65469b7640 1 -- 172.21.15.170:0/2978059774 shutdown_connections 2024-09-04T16:50:52.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:52.996+0000 7f65469b7640 1 -- 172.21.15.170:0/2978059774 wait complete. 2024-09-04T16:50:53.006 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:50:53.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.078+0000 7f5cb77ff640 1 -- 172.21.15.170:0/2612574483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb0106820 msgr2=0x7f5cb0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:53.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.078+0000 7f5cb77ff640 1 --2- 172.21.15.170:0/2612574483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb0106820 0x7f5cb0106c00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0009880 tx=0x7f5ca002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.078+0000 7f5cb77ff640 1 -- 172.21.15.170:0/2612574483 shutdown_connections 2024-09-04T16:50:53.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.078+0000 7f5cb77ff640 1 --2- 172.21.15.170:0/2612574483 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cb0100820 0x7f5cb0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.078+0000 7f5cb77ff640 1 --2- 172.21.15.170:0/2612574483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb0106820 0x7f5cb0106c00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.078+0000 7f5cb77ff640 1 -- 172.21.15.170:0/2612574483 >> 172.21.15.170:0/2612574483 conn(0x7f5cb00fc520 msgr2=0x7f5cb00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:53.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.078+0000 7f5cb77ff640 1 -- 172.21.15.170:0/2612574483 shutdown_connections 2024-09-04T16:50:53.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.078+0000 7f5cb77ff640 1 -- 172.21.15.170:0/2612574483 wait complete. 2024-09-04T16:50:53.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.079+0000 7f5cb77ff640 1 Processor -- start 2024-09-04T16:50:53.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.079+0000 7f5cb77ff640 1 -- start start 2024-09-04T16:50:53.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.079+0000 7f5cb77ff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb0100820 0x7f5cb019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:53.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.079+0000 7f5cb77ff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cb0106820 0x7f5cb019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:53.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.079+0000 7f5cb77ff640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb010dd50 con 0x7f5cb0100820 2024-09-04T16:50:53.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.079+0000 7f5cb77ff640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb010dbd0 con 0x7f5cb0106820 2024-09-04T16:50:53.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.079+0000 7f5cb559b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb0100820 0x7f5cb019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:53.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.079+0000 7f5cb559b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb0100820 0x7f5cb019c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51234/0 (socket says 172.21.15.170:51234) 2024-09-04T16:50:53.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.079+0000 7f5cb559b640 1 -- 172.21.15.170:0/3691355587 learned_addr learned my addr 172.21.15.170:0/3691355587 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:50:53.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.079+0000 7f5cb4d9a640 1 --2- 172.21.15.170:0/3691355587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cb0106820 0x7f5cb019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:53.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.080+0000 7f5cb559b640 1 -- 172.21.15.170:0/3691355587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cb0106820 msgr2=0x7f5cb019cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:53.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.080+0000 7f5cb559b640 1 --2- 172.21.15.170:0/3691355587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cb0106820 0x7f5cb019cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.080+0000 7f5cb559b640 1 -- 172.21.15.170:0/3691355587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb0196720 con 0x7f5cb0100820 2024-09-04T16:50:53.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.080+0000 7f5cb4d9a640 1 --2- 172.21.15.170:0/3691355587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cb0106820 0x7f5cb019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:50:53.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.080+0000 7f5cb559b640 1 --2- 172.21.15.170:0/3691355587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb0100820 0x7f5cb019c650 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0031460 tx=0x7f5ca00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:53.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.080+0000 7f5ca67fc640 1 -- 172.21.15.170:0/3691355587 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ca003f070 con 0x7f5cb0100820 2024-09-04T16:50:53.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.080+0000 7f5ca67fc640 1 -- 172.21.15.170:0/3691355587 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5ca0004cf0 con 0x7f5cb0100820 2024-09-04T16:50:53.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.080+0000 7f5ca67fc640 1 -- 172.21.15.170:0/3691355587 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ca0035030 con 0x7f5cb0100820 2024-09-04T16:50:53.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.080+0000 7f5cb77ff640 1 -- 172.21.15.170:0/3691355587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb01969b0 con 0x7f5cb0100820 2024-09-04T16:50:53.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.080+0000 7f5cb77ff640 1 -- 172.21.15.170:0/3691355587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb0196eb0 con 0x7f5cb0100820 2024-09-04T16:50:53.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.081+0000 7f5cb77ff640 1 -- 172.21.15.170:0/3691355587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cb0101f60 con 0x7f5cb0100820 2024-09-04T16:50:53.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.081+0000 7f5ca67fc640 1 -- 172.21.15.170:0/3691355587 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5ca0042070 con 0x7f5cb0100820 2024-09-04T16:50:53.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.082+0000 7f5ca67fc640 1 --2- 172.21.15.170:0/3691355587 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5c9c079e80 0x7f5c9c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:53.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.082+0000 7f5ca67fc640 1 -- 172.21.15.170:0/3691355587 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5ca00bd4f0 con 0x7f5cb0100820 2024-09-04T16:50:53.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.082+0000 7f5cb4d9a640 1 --2- 172.21.15.170:0/3691355587 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5c9c079e80 0x7f5c9c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:53.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.082+0000 7f5cb4d9a640 1 --2- 172.21.15.170:0/3691355587 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5c9c079e80 0x7f5c9c07c340 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0197f70 tx=0x7f5cac008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:53.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.086+0000 7f5ca67fc640 1 -- 172.21.15.170:0/3691355587 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5ca0084f80 con 0x7f5cb0100820 2024-09-04T16:50:53.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.279+0000 7f5cb77ff640 1 -- 172.21.15.170:0/3691355587 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5cb0197160 con 0x7f5c9c079e80 2024-09-04T16:50:53.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.280+0000 7f5ca67fc640 1 -- 172.21.15.170:0/3691355587 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5cb0197160 con 0x7f5c9c079e80 2024-09-04T16:50:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.282+0000 7f5cb77ff640 1 -- 172.21.15.170:0/3691355587 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5c9c079e80 msgr2=0x7f5c9c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.282+0000 7f5cb77ff640 1 --2- 172.21.15.170:0/3691355587 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5c9c079e80 0x7f5c9c07c340 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0197f70 tx=0x7f5cac008040 comp rx=0 tx=0).stop 2024-09-04T16:50:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.282+0000 7f5cb77ff640 1 -- 172.21.15.170:0/3691355587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb0100820 msgr2=0x7f5cb019c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.282+0000 7f5cb77ff640 1 --2- 172.21.15.170:0/3691355587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb0100820 0x7f5cb019c650 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0031460 tx=0x7f5ca00048f0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.282+0000 7f5cb77ff640 1 -- 172.21.15.170:0/3691355587 shutdown_connections 2024-09-04T16:50:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.282+0000 7f5cb77ff640 1 --2- 172.21.15.170:0/3691355587 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5c9c079e80 0x7f5c9c07c340 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.282+0000 7f5cb77ff640 1 --2- 172.21.15.170:0/3691355587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cb0106820 0x7f5cb019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.282+0000 7f5cb77ff640 1 --2- 172.21.15.170:0/3691355587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb0100820 0x7f5cb019c650 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.282+0000 7f5cb77ff640 1 -- 172.21.15.170:0/3691355587 >> 172.21.15.170:0/3691355587 conn(0x7f5cb00fc520 msgr2=0x7f5cb00fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.282+0000 7f5cb77ff640 1 -- 172.21.15.170:0/3691355587 shutdown_connections 2024-09-04T16:50:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.282+0000 7f5cb77ff640 1 -- 172.21.15.170:0/3691355587 wait complete. 2024-09-04T16:50:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.363+0000 7fd7552c1640 1 -- 172.21.15.170:0/3027429139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7501007e0 msgr2=0x7fd750100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.363+0000 7fd7552c1640 1 --2- 172.21.15.170:0/3027429139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7501007e0 0x7fd750100c40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd744009880 tx=0x7fd74402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.364+0000 7fd7552c1640 1 -- 172.21.15.170:0/3027429139 shutdown_connections 2024-09-04T16:50:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.364+0000 7fd7552c1640 1 --2- 172.21.15.170:0/3027429139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7501007e0 0x7fd750100c40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.364+0000 7fd7552c1640 1 --2- 172.21.15.170:0/3027429139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7501067e0 0x7fd750106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.364+0000 7fd7552c1640 1 -- 172.21.15.170:0/3027429139 >> 172.21.15.170:0/3027429139 conn(0x7fd7500fc4c0 msgr2=0x7fd7500fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.364+0000 7fd7552c1640 1 -- 172.21.15.170:0/3027429139 shutdown_connections 2024-09-04T16:50:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.364+0000 7fd7552c1640 1 -- 172.21.15.170:0/3027429139 wait complete. 2024-09-04T16:50:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.364+0000 7fd7552c1640 1 Processor -- start 2024-09-04T16:50:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.364+0000 7fd7552c1640 1 -- start start 2024-09-04T16:50:53.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd7552c1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7501007e0 0x7fd7501965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:53.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd7552c1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7501067e0 0x7fd750196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:53.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd7552c1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd75010dcb0 con 0x7fd7501067e0 2024-09-04T16:50:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd7552c1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd75010db30 con 0x7fd7501007e0 2024-09-04T16:50:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd74e7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7501067e0 0x7fd750196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd74e7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7501067e0 0x7fd750196b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51266/0 (socket says 172.21.15.170:51266) 2024-09-04T16:50:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd74e7fc640 1 -- 172.21.15.170:0/1947857610 learned_addr learned my addr 172.21.15.170:0/1947857610 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:50:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd74effd640 1 --2- 172.21.15.170:0/1947857610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7501007e0 0x7fd7501965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:53.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd74e7fc640 1 -- 172.21.15.170:0/1947857610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7501007e0 msgr2=0x7fd7501965d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:53.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd74e7fc640 1 --2- 172.21.15.170:0/1947857610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7501007e0 0x7fd7501965d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd74e7fc640 1 -- 172.21.15.170:0/1947857610 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd750197050 con 0x7fd7501067e0 2024-09-04T16:50:53.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd74e7fc640 1 --2- 172.21.15.170:0/1947857610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7501067e0 0x7fd750196b10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd744031460 tx=0x7fd7440045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:53.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd737fff640 1 -- 172.21.15.170:0/1947857610 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd74403f070 con 0x7fd7501067e0 2024-09-04T16:50:53.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd737fff640 1 -- 172.21.15.170:0/1947857610 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd7440035f0 con 0x7fd7501067e0 2024-09-04T16:50:53.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd7552c1640 1 -- 172.21.15.170:0/1947857610 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7501972e0 con 0x7fd7501067e0 2024-09-04T16:50:53.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd737fff640 1 -- 172.21.15.170:0/1947857610 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd744035030 con 0x7fd7501067e0 2024-09-04T16:50:53.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.365+0000 7fd7552c1640 1 -- 172.21.15.170:0/1947857610 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7501a3e10 con 0x7fd7501067e0 2024-09-04T16:50:53.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.366+0000 7fd7552c1640 1 -- 172.21.15.170:0/1947857610 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd750101f20 con 0x7fd7501067e0 2024-09-04T16:50:53.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.367+0000 7fd737fff640 1 -- 172.21.15.170:0/1947857610 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fd744042070 con 0x7fd7501067e0 2024-09-04T16:50:53.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.367+0000 7fd737fff640 1 --2- 172.21.15.170:0/1947857610 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd738079e30 0x7fd73807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:53.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.368+0000 7fd737fff640 1 -- 172.21.15.170:0/1947857610 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd7440bd3b0 con 0x7fd7501067e0 2024-09-04T16:50:53.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.368+0000 7fd74effd640 1 --2- 172.21.15.170:0/1947857610 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd738079e30 0x7fd73807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:53.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.368+0000 7fd74effd640 1 --2- 172.21.15.170:0/1947857610 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd738079e30 0x7fd73807c2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd740005fd0 tx=0x7fd740009680 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:53.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.372+0000 7fd737fff640 1 -- 172.21.15.170:0/1947857610 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd744088f30 con 0x7fd7501067e0 2024-09-04T16:50:53.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.553+0000 7fd7552c1640 1 -- 172.21.15.170:0/1947857610 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd750062630 con 0x7fd738079e30 2024-09-04T16:50:53.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.563+0000 7fd737fff640 1 -- 172.21.15.170:0/1947857610 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fd750062630 con 0x7fd738079e30 2024-09-04T16:50:53.564 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:50:53.564 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (17m) 12m ago 28m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:50:53.564 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (21m) 12m ago 28m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:50:53.564 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (20m) 11m ago 27m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:50:53.564 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (16m) 12m ago 28m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:50:53.564 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (15m) 11m ago 27m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:50:53.564 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (17m) 12m ago 28m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:50:53.564 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (12m) 12m ago 23m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:50:53.564 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (12m) 12m ago 23m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:50:53.564 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (11m) 11m ago 23m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:50:53.564 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (11m) 11m ago 23m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:50:53.565 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (20m) 12m ago 30m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:50:53.565 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (19m) 11m ago 27m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:50:53.565 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (16m) 12m ago 30m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:50:53.565 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (16m) 11m ago 27m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:50:53.565 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (18m) 12m ago 28m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:50:53.565 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (18m) 11m ago 27m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:50:53.565 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (15m) 12m ago 26m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:50:53.565 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (15m) 12m ago 26m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:50:53.565 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (14m) 12m ago 25m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:50:53.565 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (13m) 11m ago 25m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:50:53.565 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (13m) 11m ago 24m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:50:53.565 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (12m) 11m ago 24m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:50:53.565 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (18m) 12m ago 28m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:50:53.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.566+0000 7fd7552c1640 1 -- 172.21.15.170:0/1947857610 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd738079e30 msgr2=0x7fd73807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:53.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.566+0000 7fd7552c1640 1 --2- 172.21.15.170:0/1947857610 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd738079e30 0x7fd73807c2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd740005fd0 tx=0x7fd740009680 comp rx=0 tx=0).stop 2024-09-04T16:50:53.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.566+0000 7fd7552c1640 1 -- 172.21.15.170:0/1947857610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7501067e0 msgr2=0x7fd750196b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:53.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.566+0000 7fd7552c1640 1 --2- 172.21.15.170:0/1947857610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7501067e0 0x7fd750196b10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd744031460 tx=0x7fd7440045e0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.566+0000 7fd7552c1640 1 -- 172.21.15.170:0/1947857610 shutdown_connections 2024-09-04T16:50:53.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.566+0000 7fd7552c1640 1 --2- 172.21.15.170:0/1947857610 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd738079e30 0x7fd73807c2f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.566+0000 7fd7552c1640 1 --2- 172.21.15.170:0/1947857610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7501067e0 0x7fd750196b10 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.566+0000 7fd7552c1640 1 --2- 172.21.15.170:0/1947857610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7501007e0 0x7fd7501965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.566+0000 7fd7552c1640 1 -- 172.21.15.170:0/1947857610 >> 172.21.15.170:0/1947857610 conn(0x7fd7500fc4c0 msgr2=0x7fd7500fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:53.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.566+0000 7fd7552c1640 1 -- 172.21.15.170:0/1947857610 shutdown_connections 2024-09-04T16:50:53.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.566+0000 7fd7552c1640 1 -- 172.21.15.170:0/1947857610 wait complete. 2024-09-04T16:50:53.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.645+0000 7fd41c7ca640 1 -- 172.21.15.170:0/3375648411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd414103400 msgr2=0x7fd41410b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:53.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.645+0000 7fd41c7ca640 1 --2- 172.21.15.170:0/3375648411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd414103400 0x7fd41410b8f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd404009880 tx=0x7fd40402a530 comp rx=0 tx=0).stop 2024-09-04T16:50:53.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.645+0000 7fd41c7ca640 1 -- 172.21.15.170:0/3375648411 shutdown_connections 2024-09-04T16:50:53.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.645+0000 7fd41c7ca640 1 --2- 172.21.15.170:0/3375648411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd414103400 0x7fd41410b8f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.645+0000 7fd41c7ca640 1 --2- 172.21.15.170:0/3375648411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd414102ae0 0x7fd414102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.645+0000 7fd41c7ca640 1 -- 172.21.15.170:0/3375648411 >> 172.21.15.170:0/3375648411 conn(0x7fd4140fc520 msgr2=0x7fd4140fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:53.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.645+0000 7fd41c7ca640 1 -- 172.21.15.170:0/3375648411 shutdown_connections 2024-09-04T16:50:53.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.645+0000 7fd41c7ca640 1 -- 172.21.15.170:0/3375648411 wait complete. 2024-09-04T16:50:53.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.646+0000 7fd41c7ca640 1 Processor -- start 2024-09-04T16:50:53.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.646+0000 7fd41c7ca640 1 -- start start 2024-09-04T16:50:53.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.646+0000 7fd41c7ca640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd414102ae0 0x7fd414100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:53.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.646+0000 7fd41c7ca640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd414103400 0x7fd414100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:53.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.646+0000 7fd41c7ca640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd41410edf0 con 0x7fd414102ae0 2024-09-04T16:50:53.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.646+0000 7fd41c7ca640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd41410ec70 con 0x7fd414103400 2024-09-04T16:50:53.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.646+0000 7fd41a566640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd414102ae0 0x7fd414100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:53.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.646+0000 7fd41a566640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd414102ae0 0x7fd414100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51286/0 (socket says 172.21.15.170:51286) 2024-09-04T16:50:53.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.646+0000 7fd41a566640 1 -- 172.21.15.170:0/4126539493 learned_addr learned my addr 172.21.15.170:0/4126539493 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:50:53.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.646+0000 7fd419d65640 1 --2- 172.21.15.170:0/4126539493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd414103400 0x7fd414100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:53.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.646+0000 7fd41a566640 1 -- 172.21.15.170:0/4126539493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd414103400 msgr2=0x7fd414100c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:53.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.646+0000 7fd41a566640 1 --2- 172.21.15.170:0/4126539493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd414103400 0x7fd414100c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.646+0000 7fd41a566640 1 -- 172.21.15.170:0/4126539493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4141011c0 con 0x7fd414102ae0 2024-09-04T16:50:53.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.646+0000 7fd419d65640 1 --2- 172.21.15.170:0/4126539493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd414103400 0x7fd414100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:50:53.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.647+0000 7fd41a566640 1 --2- 172.21.15.170:0/4126539493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd414102ae0 0x7fd414100740 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd41000c8a0 tx=0x7fd41000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:53.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.647+0000 7fd40b7fe640 1 -- 172.21.15.170:0/4126539493 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd4100079b0 con 0x7fd414102ae0 2024-09-04T16:50:53.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.647+0000 7fd40b7fe640 1 -- 172.21.15.170:0/4126539493 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd410007b50 con 0x7fd414102ae0 2024-09-04T16:50:53.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.647+0000 7fd41c7ca640 1 -- 172.21.15.170:0/4126539493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4141014b0 con 0x7fd414102ae0 2024-09-04T16:50:53.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.647+0000 7fd40b7fe640 1 -- 172.21.15.170:0/4126539493 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd410018700 con 0x7fd414102ae0 2024-09-04T16:50:53.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.647+0000 7fd41c7ca640 1 -- 172.21.15.170:0/4126539493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4141a3e20 con 0x7fd414102ae0 2024-09-04T16:50:53.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.648+0000 7fd41c7ca640 1 -- 172.21.15.170:0/4126539493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd41406abe0 con 0x7fd414102ae0 2024-09-04T16:50:53.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.649+0000 7fd40b7fe640 1 -- 172.21.15.170:0/4126539493 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fd410007d00 con 0x7fd414102ae0 2024-09-04T16:50:53.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.649+0000 7fd40b7fe640 1 --2- 172.21.15.170:0/4126539493 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd400079e30 0x7fd40007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:53.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.649+0000 7fd40b7fe640 1 -- 172.21.15.170:0/4126539493 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd41009cd50 con 0x7fd414102ae0 2024-09-04T16:50:53.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.649+0000 7fd419d65640 1 --2- 172.21.15.170:0/4126539493 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd400079e30 0x7fd40007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:53.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.650+0000 7fd419d65640 1 --2- 172.21.15.170:0/4126539493 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd400079e30 0x7fd40007c2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd4141021d0 tx=0x7fd404009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:53.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.654+0000 7fd40b7fe640 1 -- 172.21.15.170:0/4126539493 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd410014030 con 0x7fd414102ae0 2024-09-04T16:50:53.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.899+0000 7fd41c7ca640 1 -- 172.21.15.170:0/4126539493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd414105f80 con 0x7fd414102ae0 2024-09-04T16:50:53.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.900+0000 7fd40b7fe640 1 -- 172.21.15.170:0/4126539493 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fd4100688d0 con 0x7fd414102ae0 2024-09-04T16:50:53.901 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:50:53.901 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:50:53.901 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:50:53.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:50:53.901 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:50:53.901 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:50:53.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:50:53.901 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:50:53.901 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:50:53.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:50:53.902 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:50:53.902 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:50:53.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:50:53.902 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:50:53.902 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:50:53.902 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:50:53.902 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:50:53.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.902+0000 7fd41c7ca640 1 -- 172.21.15.170:0/4126539493 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd400079e30 msgr2=0x7fd40007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:53.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.902+0000 7fd41c7ca640 1 --2- 172.21.15.170:0/4126539493 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd400079e30 0x7fd40007c2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd4141021d0 tx=0x7fd404009560 comp rx=0 tx=0).stop 2024-09-04T16:50:53.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.902+0000 7fd41c7ca640 1 -- 172.21.15.170:0/4126539493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd414102ae0 msgr2=0x7fd414100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:53.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.902+0000 7fd41c7ca640 1 --2- 172.21.15.170:0/4126539493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd414102ae0 0x7fd414100740 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd41000c8a0 tx=0x7fd41000cd60 comp rx=0 tx=0).stop 2024-09-04T16:50:53.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.902+0000 7fd41c7ca640 1 -- 172.21.15.170:0/4126539493 shutdown_connections 2024-09-04T16:50:53.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.902+0000 7fd41c7ca640 1 --2- 172.21.15.170:0/4126539493 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd400079e30 0x7fd40007c2f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.902+0000 7fd41c7ca640 1 --2- 172.21.15.170:0/4126539493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd414103400 0x7fd414100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.902+0000 7fd41c7ca640 1 --2- 172.21.15.170:0/4126539493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd414102ae0 0x7fd414100740 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.902+0000 7fd41c7ca640 1 -- 172.21.15.170:0/4126539493 >> 172.21.15.170:0/4126539493 conn(0x7fd4140fc520 msgr2=0x7fd414108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:53.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.902+0000 7fd41c7ca640 1 -- 172.21.15.170:0/4126539493 shutdown_connections 2024-09-04T16:50:53.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.902+0000 7fd41c7ca640 1 -- 172.21.15.170:0/4126539493 wait complete. 2024-09-04T16:50:53.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.983+0000 7fb1ee4da640 1 -- 172.21.15.170:0/3453294292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8100bb0 msgr2=0x7fb1e8104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:53.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.983+0000 7fb1ee4da640 1 --2- 172.21.15.170:0/3453294292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8100bb0 0x7fb1e8104c00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000a990 tx=0x7fb1d002b7d0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.983+0000 7fb1ee4da640 1 -- 172.21.15.170:0/3453294292 shutdown_connections 2024-09-04T16:50:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.983+0000 7fb1ee4da640 1 --2- 172.21.15.170:0/3453294292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8100bb0 0x7fb1e8104c00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.983+0000 7fb1ee4da640 1 --2- 172.21.15.170:0/3453294292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1e8100200 0x7fb1e81005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.983+0000 7fb1ee4da640 1 -- 172.21.15.170:0/3453294292 >> 172.21.15.170:0/3453294292 conn(0x7fb1e80fbc60 msgr2=0x7fb1e80fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.983+0000 7fb1ee4da640 1 -- 172.21.15.170:0/3453294292 shutdown_connections 2024-09-04T16:50:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.983+0000 7fb1ee4da640 1 -- 172.21.15.170:0/3453294292 wait complete. 2024-09-04T16:50:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.984+0000 7fb1ee4da640 1 Processor -- start 2024-09-04T16:50:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.984+0000 7fb1ee4da640 1 -- start start 2024-09-04T16:50:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.984+0000 7fb1ee4da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8100200 0x7fb1e819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.984+0000 7fb1ee4da640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1e8100bb0 0x7fb1e819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.984+0000 7fb1ee4da640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e810cb60 con 0x7fb1e8100200 2024-09-04T16:50:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.984+0000 7fb1ee4da640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e810c9e0 con 0x7fb1e8100bb0 2024-09-04T16:50:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.984+0000 7fb1e7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8100200 0x7fb1e819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.984+0000 7fb1e7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8100200 0x7fb1e819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51310/0 (socket says 172.21.15.170:51310) 2024-09-04T16:50:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.984+0000 7fb1e7fff640 1 -- 172.21.15.170:0/254493712 learned_addr learned my addr 172.21.15.170:0/254493712 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:50:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.984+0000 7fb1e77fe640 1 --2- 172.21.15.170:0/254493712 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1e8100bb0 0x7fb1e819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.984+0000 7fb1e7fff640 1 -- 172.21.15.170:0/254493712 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1e8100bb0 msgr2=0x7fb1e819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.984+0000 7fb1e7fff640 1 --2- 172.21.15.170:0/254493712 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1e8100bb0 0x7fb1e819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.984+0000 7fb1e7fff640 1 -- 172.21.15.170:0/254493712 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e81977b0 con 0x7fb1e8100200 2024-09-04T16:50:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.985+0000 7fb1e7fff640 1 --2- 172.21.15.170:0/254493712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8100200 0x7fb1e819d630 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800d8d0 tx=0x7fb1d800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.985+0000 7fb1e57fa640 1 -- 172.21.15.170:0/254493712 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1d8017030 con 0x7fb1e8100200 2024-09-04T16:50:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.985+0000 7fb1e57fa640 1 -- 172.21.15.170:0/254493712 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb1d8004020 con 0x7fb1e8100200 2024-09-04T16:50:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.985+0000 7fb1ee4da640 1 -- 172.21.15.170:0/254493712 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e8197aa0 con 0x7fb1e8100200 2024-09-04T16:50:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.985+0000 7fb1e57fa640 1 -- 172.21.15.170:0/254493712 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1d80047a0 con 0x7fb1e8100200 2024-09-04T16:50:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.985+0000 7fb1ee4da640 1 -- 172.21.15.170:0/254493712 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e8198000 con 0x7fb1e8100200 2024-09-04T16:50:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.986+0000 7fb1ee4da640 1 -- 172.21.15.170:0/254493712 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e81016e0 con 0x7fb1e8100200 2024-09-04T16:50:53.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.987+0000 7fb1e57fa640 1 -- 172.21.15.170:0/254493712 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fb1d80041d0 con 0x7fb1e8100200 2024-09-04T16:50:53.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.987+0000 7fb1e57fa640 1 --2- 172.21.15.170:0/254493712 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb1d4079e30 0x7fb1d407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:53.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.987+0000 7fb1e57fa640 1 -- 172.21.15.170:0/254493712 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb1d8018070 con 0x7fb1e8100200 2024-09-04T16:50:53.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.987+0000 7fb1e77fe640 1 --2- 172.21.15.170:0/254493712 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb1d4079e30 0x7fb1d407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:53.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.987+0000 7fb1e77fe640 1 --2- 172.21.15.170:0/254493712 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb1d4079e30 0x7fb1d407c2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8198b00 tx=0x7fb1d0008500 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:53.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:53.991+0000 7fb1e57fa640 1 -- 172.21.15.170:0/254493712 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb1d8064300 con 0x7fb1e8100200 2024-09-04T16:50:54.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.201+0000 7fb1ee4da640 1 -- 172.21.15.170:0/254493712 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb1e810a520 con 0x7fb1e8100200 2024-09-04T16:50:54.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.202+0000 7fb1e57fa640 1 -- 172.21.15.170:0/254493712 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7fb1d8068470 con 0x7fb1e8100200 2024-09-04T16:50:54.203 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:50:54.203 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:50:54.203 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:50:54.203 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:50:54.203 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:50:54.203 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:50:54.203 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:50:54.203 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:50:54.203 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:50:54.204 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:50:54.204 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:50:54.204 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:50:54.204 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:50:54.204 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:50:54.204 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:50:54.204 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:50:54.204 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:50:54.204 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:50:54.204 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:50:54.204 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:50:54.204 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:50:54.204 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:50:54.205 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:50:54.205 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:50:54.205 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:50:54.205 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:50:54.205 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:50:54.205 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:50:54.205 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:50:54.205 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:50:54.205 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:50:54.205 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:50:54.206 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:50:54.206 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:50:54.206 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:50:54.206 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:50:54.206 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:50:54.206 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:50:54.206 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:50:54.206 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:50:54.206 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:50:54.206 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:50:54.206 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:50:54.207 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:50:54.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.204+0000 7fb1ee4da640 1 -- 172.21.15.170:0/254493712 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb1d4079e30 msgr2=0x7fb1d407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:54.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.204+0000 7fb1ee4da640 1 --2- 172.21.15.170:0/254493712 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb1d4079e30 0x7fb1d407c2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8198b00 tx=0x7fb1d0008500 comp rx=0 tx=0).stop 2024-09-04T16:50:54.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.204+0000 7fb1ee4da640 1 -- 172.21.15.170:0/254493712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8100200 msgr2=0x7fb1e819d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:54.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.204+0000 7fb1ee4da640 1 --2- 172.21.15.170:0/254493712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8100200 0x7fb1e819d630 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800d8d0 tx=0x7fb1d800dd90 comp rx=0 tx=0).stop 2024-09-04T16:50:54.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.205+0000 7fb1ee4da640 1 -- 172.21.15.170:0/254493712 shutdown_connections 2024-09-04T16:50:54.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.205+0000 7fb1ee4da640 1 --2- 172.21.15.170:0/254493712 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb1d4079e30 0x7fb1d407c2f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.205+0000 7fb1ee4da640 1 --2- 172.21.15.170:0/254493712 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1e8100bb0 0x7fb1e819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.205+0000 7fb1ee4da640 1 --2- 172.21.15.170:0/254493712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1e8100200 0x7fb1e819d630 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.205+0000 7fb1ee4da640 1 -- 172.21.15.170:0/254493712 >> 172.21.15.170:0/254493712 conn(0x7fb1e80fbc60 msgr2=0x7fb1e80fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:54.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.205+0000 7fb1ee4da640 1 -- 172.21.15.170:0/254493712 shutdown_connections 2024-09-04T16:50:54.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.205+0000 7fb1ee4da640 1 -- 172.21.15.170:0/254493712 wait complete. 2024-09-04T16:50:54.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.290+0000 7f44debc5640 1 -- 172.21.15.170:0/4046326759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8100820 msgr2=0x7f44d8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:54.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.290+0000 7f44debc5640 1 --2- 172.21.15.170:0/4046326759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8100820 0x7f44d8100c80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f44c4009880 tx=0x7f44c402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.290+0000 7f44debc5640 1 -- 172.21.15.170:0/4046326759 shutdown_connections 2024-09-04T16:50:54.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.290+0000 7f44debc5640 1 --2- 172.21.15.170:0/4046326759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8100820 0x7f44d8100c80 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.290+0000 7f44debc5640 1 --2- 172.21.15.170:0/4046326759 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44d8106820 0x7f44d8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.290+0000 7f44debc5640 1 -- 172.21.15.170:0/4046326759 >> 172.21.15.170:0/4046326759 conn(0x7f44d80fc520 msgr2=0x7f44d80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:54.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.290+0000 7f44debc5640 1 -- 172.21.15.170:0/4046326759 shutdown_connections 2024-09-04T16:50:54.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.290+0000 7f44debc5640 1 -- 172.21.15.170:0/4046326759 wait complete. 2024-09-04T16:50:54.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.291+0000 7f44debc5640 1 Processor -- start 2024-09-04T16:50:54.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.291+0000 7f44debc5640 1 -- start start 2024-09-04T16:50:54.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.291+0000 7f44debc5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44d8100820 0x7f44d8198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:54.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.291+0000 7f44debc5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8106820 0x7f44d8198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:54.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.291+0000 7f44debc5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f44d810dcf0 con 0x7f44d8106820 2024-09-04T16:50:54.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.291+0000 7f44debc5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f44d810db70 con 0x7f44d8100820 2024-09-04T16:50:54.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.291+0000 7f44d7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8106820 0x7f44d8198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:54.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.291+0000 7f44d7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8106820 0x7f44d8198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51322/0 (socket says 172.21.15.170:51322) 2024-09-04T16:50:54.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.291+0000 7f44d7fff640 1 -- 172.21.15.170:0/2997322369 learned_addr learned my addr 172.21.15.170:0/2997322369 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:50:54.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.291+0000 7f44dc961640 1 --2- 172.21.15.170:0/2997322369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44d8100820 0x7f44d8198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:54.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.291+0000 7f44d7fff640 1 -- 172.21.15.170:0/2997322369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44d8100820 msgr2=0x7f44d8198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:54.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.291+0000 7f44d7fff640 1 --2- 172.21.15.170:0/2997322369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44d8100820 0x7f44d8198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.291+0000 7f44d7fff640 1 -- 172.21.15.170:0/2997322369 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d8199390 con 0x7f44d8106820 2024-09-04T16:50:54.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.291+0000 7f44dc961640 1 --2- 172.21.15.170:0/2997322369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44d8100820 0x7f44d8198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:50:54.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.292+0000 7f44d7fff640 1 --2- 172.21.15.170:0/2997322369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8106820 0x7f44d8198d40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f44c4031460 tx=0x7f44c40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:54.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.292+0000 7f44d5ffb640 1 -- 172.21.15.170:0/2997322369 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f44c403f070 con 0x7f44d8106820 2024-09-04T16:50:54.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.292+0000 7f44debc5640 1 -- 172.21.15.170:0/2997322369 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d8199620 con 0x7f44d8106820 2024-09-04T16:50:54.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.292+0000 7f44d5ffb640 1 -- 172.21.15.170:0/2997322369 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f44c40035f0 con 0x7f44d8106820 2024-09-04T16:50:54.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.292+0000 7f44d5ffb640 1 -- 172.21.15.170:0/2997322369 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f44c4035030 con 0x7f44d8106820 2024-09-04T16:50:54.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.292+0000 7f44debc5640 1 -- 172.21.15.170:0/2997322369 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d81a1bd0 con 0x7f44d8106820 2024-09-04T16:50:54.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.293+0000 7f44debc5640 1 -- 172.21.15.170:0/2997322369 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44d8101f60 con 0x7f44d8106820 2024-09-04T16:50:54.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.294+0000 7f44d5ffb640 1 -- 172.21.15.170:0/2997322369 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f44c4042070 con 0x7f44d8106820 2024-09-04T16:50:54.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.294+0000 7f44d5ffb640 1 --2- 172.21.15.170:0/2997322369 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f44c8079e30 0x7f44c807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:54.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.294+0000 7f44d5ffb640 1 -- 172.21.15.170:0/2997322369 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f44c40bd4c0 con 0x7f44d8106820 2024-09-04T16:50:54.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.294+0000 7f44dc961640 1 --2- 172.21.15.170:0/2997322369 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f44c8079e30 0x7f44c807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:54.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.295+0000 7f44dc961640 1 --2- 172.21.15.170:0/2997322369 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f44c8079e30 0x7f44c807c2f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0058c0 tx=0x7f44cc005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:54.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.298+0000 7f44d5ffb640 1 -- 172.21.15.170:0/2997322369 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f44c4084e70 con 0x7f44d8106820 2024-09-04T16:50:54.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.490+0000 7f44debc5640 1 -- 172.21.15.170:0/2997322369 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f44d8062630 con 0x7f44c8079e30 2024-09-04T16:50:54.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.491+0000 7f44d5ffb640 1 -- 172.21.15.170:0/2997322369 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f44d8062630 con 0x7f44c8079e30 2024-09-04T16:50:54.492 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:50:54.492 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:50:54.492 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:50:54.492 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:50:54.492 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:50:54.492 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:50:54.492 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:50:54.492 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:50:54.492 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:50:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:50:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:50:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:50:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:50:54.493 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:50:54.493 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:50:54.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.493+0000 7f44debc5640 1 -- 172.21.15.170:0/2997322369 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f44c8079e30 msgr2=0x7f44c807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:54.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.493+0000 7f44debc5640 1 --2- 172.21.15.170:0/2997322369 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f44c8079e30 0x7f44c807c2f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0058c0 tx=0x7f44cc005850 comp rx=0 tx=0).stop 2024-09-04T16:50:54.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.493+0000 7f44debc5640 1 -- 172.21.15.170:0/2997322369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8106820 msgr2=0x7f44d8198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:54.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.493+0000 7f44debc5640 1 --2- 172.21.15.170:0/2997322369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8106820 0x7f44d8198d40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f44c4031460 tx=0x7f44c40045e0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.493+0000 7f44debc5640 1 -- 172.21.15.170:0/2997322369 shutdown_connections 2024-09-04T16:50:54.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.493+0000 7f44debc5640 1 --2- 172.21.15.170:0/2997322369 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f44c8079e30 0x7f44c807c2f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.493+0000 7f44debc5640 1 --2- 172.21.15.170:0/2997322369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d8106820 0x7f44d8198d40 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.493+0000 7f44debc5640 1 --2- 172.21.15.170:0/2997322369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44d8100820 0x7f44d8198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.493+0000 7f44debc5640 1 -- 172.21.15.170:0/2997322369 >> 172.21.15.170:0/2997322369 conn(0x7f44d80fc520 msgr2=0x7f44d80fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:54.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.493+0000 7f44debc5640 1 -- 172.21.15.170:0/2997322369 shutdown_connections 2024-09-04T16:50:54.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.493+0000 7f44debc5640 1 -- 172.21.15.170:0/2997322369 wait complete. 2024-09-04T16:50:54.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.575+0000 7f4b30ab4640 1 -- 172.21.15.170:0/3290388306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b2c1007e0 msgr2=0x7f4b2c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:54.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.575+0000 7f4b30ab4640 1 --2- 172.21.15.170:0/3290388306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b2c1007e0 0x7f4b2c100c40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009880 tx=0x7f4b1402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.576+0000 7f4b30ab4640 1 -- 172.21.15.170:0/3290388306 shutdown_connections 2024-09-04T16:50:54.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.576+0000 7f4b30ab4640 1 --2- 172.21.15.170:0/3290388306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b2c1007e0 0x7f4b2c100c40 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.576+0000 7f4b30ab4640 1 --2- 172.21.15.170:0/3290388306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b2c1067e0 0x7f4b2c106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.576+0000 7f4b30ab4640 1 -- 172.21.15.170:0/3290388306 >> 172.21.15.170:0/3290388306 conn(0x7f4b2c0fc4c0 msgr2=0x7f4b2c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:54.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.576+0000 7f4b30ab4640 1 -- 172.21.15.170:0/3290388306 shutdown_connections 2024-09-04T16:50:54.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.576+0000 7f4b30ab4640 1 -- 172.21.15.170:0/3290388306 wait complete. 2024-09-04T16:50:54.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.576+0000 7f4b30ab4640 1 Processor -- start 2024-09-04T16:50:54.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.576+0000 7f4b30ab4640 1 -- start start 2024-09-04T16:50:54.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b30ab4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b2c1007e0 0x7f4b2c19f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:54.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b30ab4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b2c1067e0 0x7f4b2c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:54.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b30ab4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c10dd10 con 0x7f4b2c1007e0 2024-09-04T16:50:54.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b30ab4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c10db90 con 0x7f4b2c1067e0 2024-09-04T16:50:54.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b2a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b2c1007e0 0x7f4b2c19f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:54.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b2a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b2c1007e0 0x7f4b2c19f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51346/0 (socket says 172.21.15.170:51346) 2024-09-04T16:50:54.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b2a59c640 1 -- 172.21.15.170:0/1697029713 learned_addr learned my addr 172.21.15.170:0/1697029713 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:50:54.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b29d9b640 1 --2- 172.21.15.170:0/1697029713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b2c1067e0 0x7f4b2c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:54.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b2a59c640 1 -- 172.21.15.170:0/1697029713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b2c1067e0 msgr2=0x7f4b2c19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:54.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b2a59c640 1 --2- 172.21.15.170:0/1697029713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b2c1067e0 0x7f4b2c19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b2a59c640 1 -- 172.21.15.170:0/1697029713 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2c199a20 con 0x7f4b2c1007e0 2024-09-04T16:50:54.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b2a59c640 1 --2- 172.21.15.170:0/1697029713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b2c1007e0 0x7f4b2c19f860 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400ba50 tx=0x7f4b2400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:54.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b237fe640 1 -- 172.21.15.170:0/1697029713 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b24019070 con 0x7f4b2c1007e0 2024-09-04T16:50:54.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b30ab4640 1 -- 172.21.15.170:0/1697029713 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2c199d10 con 0x7f4b2c1007e0 2024-09-04T16:50:54.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b237fe640 1 -- 172.21.15.170:0/1697029713 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b2400ce20 con 0x7f4b2c1007e0 2024-09-04T16:50:54.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b237fe640 1 -- 172.21.15.170:0/1697029713 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b240075a0 con 0x7f4b2c1007e0 2024-09-04T16:50:54.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.577+0000 7f4b30ab4640 1 -- 172.21.15.170:0/1697029713 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2c19a270 con 0x7f4b2c1007e0 2024-09-04T16:50:54.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.578+0000 7f4b30ab4640 1 -- 172.21.15.170:0/1697029713 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b2c101f20 con 0x7f4b2c1007e0 2024-09-04T16:50:54.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.579+0000 7f4b237fe640 1 -- 172.21.15.170:0/1697029713 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f4b2401c070 con 0x7f4b2c1007e0 2024-09-04T16:50:54.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.580+0000 7f4b237fe640 1 --2- 172.21.15.170:0/1697029713 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4b18079e30 0x7f4b1807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:50:54.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.580+0000 7f4b237fe640 1 -- 172.21.15.170:0/1697029713 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4b2409c3a0 con 0x7f4b2c1007e0 2024-09-04T16:50:54.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.580+0000 7f4b29d9b640 1 --2- 172.21.15.170:0/1697029713 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4b18079e30 0x7f4b1807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:50:54.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.580+0000 7f4b29d9b640 1 --2- 172.21.15.170:0/1697029713 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4b18079e30 0x7f4b1807c2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c19b210 tx=0x7f4b14031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:50:54.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.584+0000 7f4b237fe640 1 -- 172.21.15.170:0/1697029713 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4b24063db0 con 0x7f4b2c1007e0 2024-09-04T16:50:54.768 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:54 smithi170 ceph-mon[113855]: pgmap v635: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:54.768 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:54 smithi170 ceph-mon[113855]: from='client.34978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:50:54.768 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:54 smithi170 ceph-mon[113855]: from='client.34982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:50:54.768 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:54 smithi170 ceph-mon[113855]: from='client.34986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:50:54.768 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:54 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/4126539493' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:50:54.768 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:54 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/254493712' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:50:54.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.829+0000 7f4b30ab4640 1 -- 172.21.15.170:0/1697029713 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f4b2c19b040 con 0x7f4b2c1007e0 2024-09-04T16:50:54.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.829+0000 7f4b237fe640 1 -- 172.21.15.170:0/1697029713 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f4b24067f20 con 0x7f4b2c1007e0 2024-09-04T16:50:54.830 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:50:54.830 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:50:54.830 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:50:54.830 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:50:54.830 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:50:54.830 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:50:54.830 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:50:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.831+0000 7f4b30ab4640 1 -- 172.21.15.170:0/1697029713 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4b18079e30 msgr2=0x7f4b1807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.831+0000 7f4b30ab4640 1 --2- 172.21.15.170:0/1697029713 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4b18079e30 0x7f4b1807c2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c19b210 tx=0x7f4b14031400 comp rx=0 tx=0).stop 2024-09-04T16:50:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.831+0000 7f4b30ab4640 1 -- 172.21.15.170:0/1697029713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b2c1007e0 msgr2=0x7f4b2c19f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:50:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.831+0000 7f4b30ab4640 1 --2- 172.21.15.170:0/1697029713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b2c1007e0 0x7f4b2c19f860 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400ba50 tx=0x7f4b2400bf10 comp rx=0 tx=0).stop 2024-09-04T16:50:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.832+0000 7f4b30ab4640 1 -- 172.21.15.170:0/1697029713 shutdown_connections 2024-09-04T16:50:54.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.832+0000 7f4b30ab4640 1 --2- 172.21.15.170:0/1697029713 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4b18079e30 0x7f4b1807c2f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.832+0000 7f4b30ab4640 1 --2- 172.21.15.170:0/1697029713 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b2c1067e0 0x7f4b2c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.832+0000 7f4b30ab4640 1 --2- 172.21.15.170:0/1697029713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b2c1007e0 0x7f4b2c19f860 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:50:54.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.832+0000 7f4b30ab4640 1 -- 172.21.15.170:0/1697029713 >> 172.21.15.170:0/1697029713 conn(0x7f4b2c0fc4c0 msgr2=0x7f4b2c069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:50:54.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.832+0000 7f4b30ab4640 1 -- 172.21.15.170:0/1697029713 shutdown_connections 2024-09-04T16:50:54.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:50:54.832+0000 7f4b30ab4640 1 -- 172.21.15.170:0/1697029713 wait complete. 2024-09-04T16:50:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:54 smithi193 ceph-mon[82547]: pgmap v635: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:54 smithi193 ceph-mon[82547]: from='client.34978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:50:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:54 smithi193 ceph-mon[82547]: from='client.34982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:50:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:54 smithi193 ceph-mon[82547]: from='client.34986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:50:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:54 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/4126539493' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:50:54.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:54 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/254493712' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:50:55.836 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:55 smithi193 ceph-mon[82547]: from='client.34998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:50:55.837 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:55 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1697029713' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:50:55.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:55 smithi170 ceph-mon[113855]: from='client.34998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:50:55.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:55 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1697029713' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:50:56.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:56 smithi170 ceph-mon[113855]: pgmap v636: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:56.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:56 smithi193 ceph-mon[82547]: pgmap v636: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:58.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:58 smithi170 ceph-mon[113855]: pgmap v637: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:58.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:58 smithi193 ceph-mon[82547]: pgmap v637: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:50:59.845 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:50:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:50:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:50:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:51:00.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:00 smithi170 ceph-mon[113855]: pgmap v638: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:00 smithi193 ceph-mon[82547]: pgmap v638: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:01.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:01 smithi170 ceph-mon[113855]: pgmap v639: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:01.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:01 smithi193 ceph-mon[82547]: pgmap v639: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:04.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:03 smithi170 ceph-mon[113855]: pgmap v640: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:04.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:03 smithi193 ceph-mon[82547]: pgmap v640: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:05.988 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:05 smithi193 ceph-mon[82547]: pgmap v641: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:06.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:05 smithi170 ceph-mon[113855]: pgmap v641: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:08.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:07 smithi170 ceph-mon[113855]: pgmap v642: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:08.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:07 smithi193 ceph-mon[82547]: pgmap v642: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:10.002 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:09 smithi170 ceph-mon[113855]: pgmap v643: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:10.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:09 smithi193 ceph-mon[82547]: pgmap v643: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:12.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:11 smithi170 ceph-mon[113855]: pgmap v644: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:12.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:11 smithi193 ceph-mon[82547]: pgmap v644: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:14.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:13 smithi170 ceph-mon[113855]: pgmap v645: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:14.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:13 smithi193 ceph-mon[82547]: pgmap v645: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:15.080 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:51:15.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:51:16.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:15 smithi170 ceph-mon[113855]: pgmap v646: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:16.140 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:15 smithi193 ceph-mon[82547]: pgmap v646: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:18.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:17 smithi170 ceph-mon[113855]: pgmap v647: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:18.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:17 smithi193 ceph-mon[82547]: pgmap v647: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:20.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:19 smithi170 ceph-mon[113855]: pgmap v648: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:20.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:19 smithi193 ceph-mon[82547]: pgmap v648: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:22.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:21 smithi170 ceph-mon[113855]: pgmap v649: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:22.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:21 smithi193 ceph-mon[82547]: pgmap v649: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:24.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:23 smithi170 ceph-mon[113855]: pgmap v650: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:24.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:23 smithi193 ceph-mon[82547]: pgmap v650: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:24.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.927+0000 7f2aca127640 1 -- 172.21.15.170:0/2755885791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ac4107930 msgr2=0x7f2ac4107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:24.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.927+0000 7f2aca127640 1 --2- 172.21.15.170:0/2755885791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ac4107930 0x7f2ac4107d10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4009880 tx=0x7f2ab402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:51:24.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.927+0000 7f2aca127640 1 -- 172.21.15.170:0/2755885791 shutdown_connections 2024-09-04T16:51:24.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.927+0000 7f2aca127640 1 --2- 172.21.15.170:0/2755885791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ac4101930 0x7f2ac4101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:24.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.927+0000 7f2aca127640 1 --2- 172.21.15.170:0/2755885791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ac4107930 0x7f2ac4107d10 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:24.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.927+0000 7f2aca127640 1 -- 172.21.15.170:0/2755885791 >> 172.21.15.170:0/2755885791 conn(0x7f2ac40fd630 msgr2=0x7f2ac40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:24.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.927+0000 7f2aca127640 1 -- 172.21.15.170:0/2755885791 shutdown_connections 2024-09-04T16:51:24.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.927+0000 7f2aca127640 1 -- 172.21.15.170:0/2755885791 wait complete. 2024-09-04T16:51:24.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.928+0000 7f2aca127640 1 Processor -- start 2024-09-04T16:51:24.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.928+0000 7f2aca127640 1 -- start start 2024-09-04T16:51:24.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.928+0000 7f2aca127640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ac4101930 0x7f2ac419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.928+0000 7f2aca127640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ac4107930 0x7f2ac419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.928+0000 7f2aca127640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac410ede0 con 0x7f2ac4101930 2024-09-04T16:51:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.928+0000 7f2aca127640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac410ec60 con 0x7f2ac4107930 2024-09-04T16:51:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.928+0000 7f2ac37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ac4101930 0x7f2ac419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.928+0000 7f2ac37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ac4101930 0x7f2ac419d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36536/0 (socket says 172.21.15.170:36536) 2024-09-04T16:51:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.928+0000 7f2ac37fe640 1 -- 172.21.15.170:0/3714310188 learned_addr learned my addr 172.21.15.170:0/3714310188 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:51:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.928+0000 7f2abbfff640 1 --2- 172.21.15.170:0/3714310188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ac4107930 0x7f2ac419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.928+0000 7f2ac37fe640 1 -- 172.21.15.170:0/3714310188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ac4107930 msgr2=0x7f2ac419dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.928+0000 7f2ac37fe640 1 --2- 172.21.15.170:0/3714310188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ac4107930 0x7f2ac419dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.928+0000 7f2ac37fe640 1 -- 172.21.15.170:0/3714310188 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac4197810 con 0x7f2ac4101930 2024-09-04T16:51:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.929+0000 7f2ac37fe640 1 --2- 172.21.15.170:0/3714310188 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ac4101930 0x7f2ac419d690 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4031460 tx=0x7f2ab40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:24.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.929+0000 7f2ac17fa640 1 -- 172.21.15.170:0/3714310188 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ab403f070 con 0x7f2ac4101930 2024-09-04T16:51:24.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.929+0000 7f2ac17fa640 1 -- 172.21.15.170:0/3714310188 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ab40035f0 con 0x7f2ac4101930 2024-09-04T16:51:24.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.929+0000 7f2ac17fa640 1 -- 172.21.15.170:0/3714310188 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ab4035030 con 0x7f2ac4101930 2024-09-04T16:51:24.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.929+0000 7f2aca127640 1 -- 172.21.15.170:0/3714310188 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac4197aa0 con 0x7f2ac4101930 2024-09-04T16:51:24.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.929+0000 7f2aca127640 1 -- 172.21.15.170:0/3714310188 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac4197fd0 con 0x7f2ac4101930 2024-09-04T16:51:24.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.930+0000 7f2aca127640 1 -- 172.21.15.170:0/3714310188 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ac4103070 con 0x7f2ac4101930 2024-09-04T16:51:24.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.931+0000 7f2ac17fa640 1 -- 172.21.15.170:0/3714310188 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f2ab4042070 con 0x7f2ac4101930 2024-09-04T16:51:24.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.931+0000 7f2ac17fa640 1 --2- 172.21.15.170:0/3714310188 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2ab0079e30 0x7f2ab007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:24.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.932+0000 7f2ac17fa640 1 -- 172.21.15.170:0/3714310188 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2ab40bd3b0 con 0x7f2ac4101930 2024-09-04T16:51:24.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.932+0000 7f2abbfff640 1 --2- 172.21.15.170:0/3714310188 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2ab0079e30 0x7f2ab007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:24.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.932+0000 7f2abbfff640 1 --2- 172.21.15.170:0/3714310188 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2ab0079e30 0x7f2ab007c2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4100d40 tx=0x7f2aac00b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:24.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:24.937+0000 7f2ac17fa640 1 -- 172.21.15.170:0/3714310188 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2ab4088f30 con 0x7f2ac4101930 2024-09-04T16:51:25.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.126+0000 7f2aca127640 1 -- 172.21.15.170:0/3714310188 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2ac4198280 con 0x7f2ab0079e30 2024-09-04T16:51:25.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.127+0000 7f2ac17fa640 1 -- 172.21.15.170:0/3714310188 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2ac4198280 con 0x7f2ab0079e30 2024-09-04T16:51:25.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.130+0000 7f2aca127640 1 -- 172.21.15.170:0/3714310188 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2ab0079e30 msgr2=0x7f2ab007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:25.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.130+0000 7f2aca127640 1 --2- 172.21.15.170:0/3714310188 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2ab0079e30 0x7f2ab007c2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4100d40 tx=0x7f2aac00b390 comp rx=0 tx=0).stop 2024-09-04T16:51:25.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.130+0000 7f2aca127640 1 -- 172.21.15.170:0/3714310188 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ac4101930 msgr2=0x7f2ac419d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:25.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.130+0000 7f2aca127640 1 --2- 172.21.15.170:0/3714310188 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ac4101930 0x7f2ac419d690 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4031460 tx=0x7f2ab40045e0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.130+0000 7f2aca127640 1 -- 172.21.15.170:0/3714310188 shutdown_connections 2024-09-04T16:51:25.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.130+0000 7f2aca127640 1 --2- 172.21.15.170:0/3714310188 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2ab0079e30 0x7f2ab007c2f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.130+0000 7f2aca127640 1 --2- 172.21.15.170:0/3714310188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ac4107930 0x7f2ac419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.130+0000 7f2aca127640 1 --2- 172.21.15.170:0/3714310188 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ac4101930 0x7f2ac419d690 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.130+0000 7f2aca127640 1 -- 172.21.15.170:0/3714310188 >> 172.21.15.170:0/3714310188 conn(0x7f2ac40fd630 msgr2=0x7f2ac40fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:25.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.130+0000 7f2aca127640 1 -- 172.21.15.170:0/3714310188 shutdown_connections 2024-09-04T16:51:25.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.130+0000 7f2aca127640 1 -- 172.21.15.170:0/3714310188 wait complete. 2024-09-04T16:51:25.139 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:51:25.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.213+0000 7f8929529640 1 -- 172.21.15.170:0/770480114 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89241033c0 msgr2=0x7f892410b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:25.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.213+0000 7f8929529640 1 --2- 172.21.15.170:0/770480114 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89241033c0 0x7f892410b8b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f890c009880 tx=0x7f890c02a530 comp rx=0 tx=0).stop 2024-09-04T16:51:25.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.213+0000 7f8929529640 1 -- 172.21.15.170:0/770480114 shutdown_connections 2024-09-04T16:51:25.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.213+0000 7f8929529640 1 --2- 172.21.15.170:0/770480114 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89241033c0 0x7f892410b8b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.213+0000 7f8929529640 1 --2- 172.21.15.170:0/770480114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8924102aa0 0x7f8924102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.213+0000 7f8929529640 1 -- 172.21.15.170:0/770480114 >> 172.21.15.170:0/770480114 conn(0x7f89240fc4c0 msgr2=0x7f89240fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:25.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.213+0000 7f8929529640 1 -- 172.21.15.170:0/770480114 shutdown_connections 2024-09-04T16:51:25.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.213+0000 7f8929529640 1 -- 172.21.15.170:0/770480114 wait complete. 2024-09-04T16:51:25.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.214+0000 7f8929529640 1 Processor -- start 2024-09-04T16:51:25.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.214+0000 7f8929529640 1 -- start start 2024-09-04T16:51:25.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.214+0000 7f8929529640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8924102aa0 0x7f8924100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:25.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.214+0000 7f8929529640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89241033c0 0x7f8924100c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:25.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.214+0000 7f8929529640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f892410edb0 con 0x7f89241033c0 2024-09-04T16:51:25.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.214+0000 7f8929529640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f892410ec30 con 0x7f8924102aa0 2024-09-04T16:51:25.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.214+0000 7f891a7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89241033c0 0x7f8924100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:25.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.214+0000 7f891a7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89241033c0 0x7f8924100c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38042/0 (socket says 172.21.15.170:38042) 2024-09-04T16:51:25.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.214+0000 7f891a7fc640 1 -- 172.21.15.170:0/3209626217 learned_addr learned my addr 172.21.15.170:0/3209626217 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:51:25.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.215+0000 7f8922ffd640 1 --2- 172.21.15.170:0/3209626217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8924102aa0 0x7f8924100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:25.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.215+0000 7f891a7fc640 1 -- 172.21.15.170:0/3209626217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8924102aa0 msgr2=0x7f8924100700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:25.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.215+0000 7f891a7fc640 1 --2- 172.21.15.170:0/3209626217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8924102aa0 0x7f8924100700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.215+0000 7f891a7fc640 1 -- 172.21.15.170:0/3209626217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8924101180 con 0x7f89241033c0 2024-09-04T16:51:25.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.215+0000 7f891a7fc640 1 --2- 172.21.15.170:0/3209626217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89241033c0 0x7f8924100c40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f890c031460 tx=0x7f890c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:25.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.215+0000 7f8920ff9640 1 -- 172.21.15.170:0/3209626217 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f890c03f070 con 0x7f89241033c0 2024-09-04T16:51:25.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.215+0000 7f8929529640 1 -- 172.21.15.170:0/3209626217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8924101410 con 0x7f89241033c0 2024-09-04T16:51:25.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.215+0000 7f8920ff9640 1 -- 172.21.15.170:0/3209626217 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f890c0035f0 con 0x7f89241033c0 2024-09-04T16:51:25.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.215+0000 7f8920ff9640 1 -- 172.21.15.170:0/3209626217 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f890c035030 con 0x7f89241033c0 2024-09-04T16:51:25.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.215+0000 7f8929529640 1 -- 172.21.15.170:0/3209626217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89241a3de0 con 0x7f89241033c0 2024-09-04T16:51:25.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.216+0000 7f8929529640 1 -- 172.21.15.170:0/3209626217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f892406a410 con 0x7f89241033c0 2024-09-04T16:51:25.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.217+0000 7f8920ff9640 1 -- 172.21.15.170:0/3209626217 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f890c042070 con 0x7f89241033c0 2024-09-04T16:51:25.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.218+0000 7f8920ff9640 1 --2- 172.21.15.170:0/3209626217 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8910079e30 0x7f891007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:25.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.218+0000 7f8920ff9640 1 -- 172.21.15.170:0/3209626217 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f890c0bd430 con 0x7f89241033c0 2024-09-04T16:51:25.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.218+0000 7f8922ffd640 1 --2- 172.21.15.170:0/3209626217 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8910079e30 0x7f891007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:25.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.218+0000 7f8922ffd640 1 --2- 172.21.15.170:0/3209626217 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8910079e30 0x7f891007c2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8914005fd0 tx=0x7f8914005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:25.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.222+0000 7f8920ff9640 1 -- 172.21.15.170:0/3209626217 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f890c084e40 con 0x7f89241033c0 2024-09-04T16:51:25.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.434+0000 7f8929529640 1 -- 172.21.15.170:0/3209626217 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8924062630 con 0x7f8910079e30 2024-09-04T16:51:25.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.435+0000 7f8920ff9640 1 -- 172.21.15.170:0/3209626217 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8924062630 con 0x7f8910079e30 2024-09-04T16:51:25.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.438+0000 7f8929529640 1 -- 172.21.15.170:0/3209626217 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8910079e30 msgr2=0x7f891007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:25.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.438+0000 7f8929529640 1 --2- 172.21.15.170:0/3209626217 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8910079e30 0x7f891007c2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8914005fd0 tx=0x7f8914005850 comp rx=0 tx=0).stop 2024-09-04T16:51:25.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.438+0000 7f8929529640 1 -- 172.21.15.170:0/3209626217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89241033c0 msgr2=0x7f8924100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:25.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.438+0000 7f8929529640 1 --2- 172.21.15.170:0/3209626217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89241033c0 0x7f8924100c40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f890c031460 tx=0x7f890c004530 comp rx=0 tx=0).stop 2024-09-04T16:51:25.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.438+0000 7f8929529640 1 -- 172.21.15.170:0/3209626217 shutdown_connections 2024-09-04T16:51:25.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.438+0000 7f8929529640 1 --2- 172.21.15.170:0/3209626217 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8910079e30 0x7f891007c2f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.438+0000 7f8929529640 1 --2- 172.21.15.170:0/3209626217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89241033c0 0x7f8924100c40 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.438+0000 7f8929529640 1 --2- 172.21.15.170:0/3209626217 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8924102aa0 0x7f8924100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.438+0000 7f8929529640 1 -- 172.21.15.170:0/3209626217 >> 172.21.15.170:0/3209626217 conn(0x7f89240fc4c0 msgr2=0x7f8924108e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:25.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.438+0000 7f8929529640 1 -- 172.21.15.170:0/3209626217 shutdown_connections 2024-09-04T16:51:25.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.438+0000 7f8929529640 1 -- 172.21.15.170:0/3209626217 wait complete. 2024-09-04T16:51:25.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.519+0000 7f8bec669640 1 -- 172.21.15.170:0/226056011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be4107910 msgr2=0x7f8be4107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:25.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.519+0000 7f8bec669640 1 --2- 172.21.15.170:0/226056011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be4107910 0x7f8be4107cf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009880 tx=0x7f8be002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.520+0000 7f8bec669640 1 -- 172.21.15.170:0/226056011 shutdown_connections 2024-09-04T16:51:25.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.520+0000 7f8bec669640 1 --2- 172.21.15.170:0/226056011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8be4101910 0x7f8be4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.520+0000 7f8bec669640 1 --2- 172.21.15.170:0/226056011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be4107910 0x7f8be4107cf0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.520+0000 7f8bec669640 1 -- 172.21.15.170:0/226056011 >> 172.21.15.170:0/226056011 conn(0x7f8be40fd5f0 msgr2=0x7f8be40ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:25.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.520+0000 7f8bec669640 1 -- 172.21.15.170:0/226056011 shutdown_connections 2024-09-04T16:51:25.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.520+0000 7f8bec669640 1 -- 172.21.15.170:0/226056011 wait complete. 2024-09-04T16:51:25.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.520+0000 7f8bec669640 1 Processor -- start 2024-09-04T16:51:25.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.520+0000 7f8bec669640 1 -- start start 2024-09-04T16:51:25.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.520+0000 7f8bec669640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be4101910 0x7f8be419f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:25.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.520+0000 7f8bec669640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8be4107910 0x7f8be419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:25.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.521+0000 7f8bec669640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8be410edc0 con 0x7f8be4101910 2024-09-04T16:51:25.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.521+0000 7f8bec669640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8be410ec40 con 0x7f8be4107910 2024-09-04T16:51:25.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.521+0000 7f8bea405640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be4101910 0x7f8be419f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:25.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.521+0000 7f8bea405640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be4101910 0x7f8be419f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38052/0 (socket says 172.21.15.170:38052) 2024-09-04T16:51:25.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.521+0000 7f8bea405640 1 -- 172.21.15.170:0/3729194953 learned_addr learned my addr 172.21.15.170:0/3729194953 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:51:25.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.521+0000 7f8be9c04640 1 --2- 172.21.15.170:0/3729194953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8be4107910 0x7f8be419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:25.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.521+0000 7f8bea405640 1 -- 172.21.15.170:0/3729194953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8be4107910 msgr2=0x7f8be419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:25.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.521+0000 7f8bea405640 1 --2- 172.21.15.170:0/3729194953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8be4107910 0x7f8be419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.521+0000 7f8bea405640 1 -- 172.21.15.170:0/3729194953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be4199960 con 0x7f8be4101910 2024-09-04T16:51:25.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.521+0000 7f8bea405640 1 --2- 172.21.15.170:0/3729194953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be4101910 0x7f8be419f7a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8be0031460 tx=0x7f8be00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:25.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.521+0000 7f8bdb7fe640 1 -- 172.21.15.170:0/3729194953 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8be003f070 con 0x7f8be4101910 2024-09-04T16:51:25.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.521+0000 7f8bec669640 1 -- 172.21.15.170:0/3729194953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be4199bf0 con 0x7f8be4101910 2024-09-04T16:51:25.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.521+0000 7f8bdb7fe640 1 -- 172.21.15.170:0/3729194953 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8be00044d0 con 0x7f8be4101910 2024-09-04T16:51:25.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.522+0000 7f8bdb7fe640 1 -- 172.21.15.170:0/3729194953 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8be0035030 con 0x7f8be4101910 2024-09-04T16:51:25.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.522+0000 7f8bec669640 1 -- 172.21.15.170:0/3729194953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be419a120 con 0x7f8be4101910 2024-09-04T16:51:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.524+0000 7f8bec669640 1 -- 172.21.15.170:0/3729194953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be4103050 con 0x7f8be4101910 2024-09-04T16:51:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.524+0000 7f8bdb7fe640 1 -- 172.21.15.170:0/3729194953 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f8be0042070 con 0x7f8be4101910 2024-09-04T16:51:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.524+0000 7f8bdb7fe640 1 --2- 172.21.15.170:0/3729194953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8bd0079e90 0x7f8bd007c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.524+0000 7f8bdb7fe640 1 -- 172.21.15.170:0/3729194953 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8be00bd4e0 con 0x7f8be4101910 2024-09-04T16:51:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.524+0000 7f8be9c04640 1 --2- 172.21.15.170:0/3729194953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8bd0079e90 0x7f8bd007c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:25.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.524+0000 7f8be9c04640 1 --2- 172.21.15.170:0/3729194953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8bd0079e90 0x7f8bd007c350 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8be4100b00 tx=0x7f8bd400a4c0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:25.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.528+0000 7f8bdb7fe640 1 -- 172.21.15.170:0/3729194953 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8be0004cf0 con 0x7f8be4101910 2024-09-04T16:51:25.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.712+0000 7f8bec669640 1 -- 172.21.15.170:0/3729194953 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8be419a3d0 con 0x7f8bd0079e90 2024-09-04T16:51:25.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.721+0000 7f8bdb7fe640 1 -- 172.21.15.170:0/3729194953 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f8be419a3d0 con 0x7f8bd0079e90 2024-09-04T16:51:25.721 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:51:25.721 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (18m) 12m ago 29m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:51:25.722 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (21m) 12m ago 29m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:51:25.722 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (20m) 12m ago 28m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:51:25.722 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (16m) 12m ago 29m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:51:25.722 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (16m) 12m ago 28m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:51:25.722 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (18m) 12m ago 29m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:51:25.722 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (12m) 12m ago 23m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:51:25.722 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (13m) 12m ago 24m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:51:25.722 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (12m) 12m ago 23m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:51:25.722 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (12m) 12m ago 23m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:51:25.722 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (20m) 12m ago 30m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:51:25.722 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (19m) 12m ago 28m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:51:25.722 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (17m) 12m ago 30m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:51:25.722 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (16m) 12m ago 28m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:51:25.723 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (19m) 12m ago 29m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:51:25.723 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (19m) 12m ago 28m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:51:25.723 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (16m) 12m ago 27m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:51:25.723 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (15m) 12m ago 26m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:51:25.723 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (14m) 12m ago 26m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:51:25.723 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (14m) 12m ago 25m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:51:25.723 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (13m) 12m ago 25m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:51:25.723 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (13m) 12m ago 24m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:51:25.723 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (18m) 12m ago 28m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:51:25.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.724+0000 7f8bec669640 1 -- 172.21.15.170:0/3729194953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8bd0079e90 msgr2=0x7f8bd007c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:25.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.724+0000 7f8bec669640 1 --2- 172.21.15.170:0/3729194953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8bd0079e90 0x7f8bd007c350 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8be4100b00 tx=0x7f8bd400a4c0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.724+0000 7f8bec669640 1 -- 172.21.15.170:0/3729194953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be4101910 msgr2=0x7f8be419f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:25.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.724+0000 7f8bec669640 1 --2- 172.21.15.170:0/3729194953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be4101910 0x7f8be419f7a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8be0031460 tx=0x7f8be00048f0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.724+0000 7f8bec669640 1 -- 172.21.15.170:0/3729194953 shutdown_connections 2024-09-04T16:51:25.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.724+0000 7f8bec669640 1 --2- 172.21.15.170:0/3729194953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8bd0079e90 0x7f8bd007c350 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.724+0000 7f8bec669640 1 --2- 172.21.15.170:0/3729194953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8be4107910 0x7f8be419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.724+0000 7f8bec669640 1 --2- 172.21.15.170:0/3729194953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8be4101910 0x7f8be419f7a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.724+0000 7f8bec669640 1 -- 172.21.15.170:0/3729194953 >> 172.21.15.170:0/3729194953 conn(0x7f8be40fd5f0 msgr2=0x7f8be40fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:25.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.724+0000 7f8bec669640 1 -- 172.21.15.170:0/3729194953 shutdown_connections 2024-09-04T16:51:25.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.724+0000 7f8bec669640 1 -- 172.21.15.170:0/3729194953 wait complete. 2024-09-04T16:51:25.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.804+0000 7facbd848640 1 -- 172.21.15.170:0/4217249781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facb81067e0 msgr2=0x7facb8106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:25.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.804+0000 7facbd848640 1 --2- 172.21.15.170:0/4217249781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facb81067e0 0x7facb8106bc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7facb0009c20 tx=0x7facb002a970 comp rx=0 tx=0).stop 2024-09-04T16:51:25.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.804+0000 7facbd848640 1 -- 172.21.15.170:0/4217249781 shutdown_connections 2024-09-04T16:51:25.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.804+0000 7facbd848640 1 --2- 172.21.15.170:0/4217249781 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7facb81007e0 0x7facb8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.804+0000 7facbd848640 1 --2- 172.21.15.170:0/4217249781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facb81067e0 0x7facb8106bc0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.804+0000 7facbd848640 1 -- 172.21.15.170:0/4217249781 >> 172.21.15.170:0/4217249781 conn(0x7facb80fc4c0 msgr2=0x7facb80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:25.804 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:25 smithi170 ceph-mon[113855]: pgmap v651: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:25.805 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:25 smithi170 ceph-mon[113855]: from='client.35006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:51:25.805 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:25 smithi170 ceph-mon[113855]: from='client.35010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:51:25.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.804+0000 7facbd848640 1 -- 172.21.15.170:0/4217249781 shutdown_connections 2024-09-04T16:51:25.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.804+0000 7facbd848640 1 -- 172.21.15.170:0/4217249781 wait complete. 2024-09-04T16:51:25.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.805+0000 7facbd848640 1 Processor -- start 2024-09-04T16:51:25.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.805+0000 7facbd848640 1 -- start start 2024-09-04T16:51:25.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.805+0000 7facbd848640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7facb81007e0 0x7facb819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:25.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.805+0000 7facbd848640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facb81067e0 0x7facb819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:25.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.805+0000 7facbd848640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7facb810edb0 con 0x7facb81067e0 2024-09-04T16:51:25.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.805+0000 7facbd848640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7facb810ec30 con 0x7facb81007e0 2024-09-04T16:51:25.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.805+0000 7facb67fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facb81067e0 0x7facb819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:25.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.805+0000 7facb67fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facb81067e0 0x7facb819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38060/0 (socket says 172.21.15.170:38060) 2024-09-04T16:51:25.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.805+0000 7facb67fc640 1 -- 172.21.15.170:0/2229576962 learned_addr learned my addr 172.21.15.170:0/2229576962 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:51:25.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.806+0000 7facb6ffd640 1 --2- 172.21.15.170:0/2229576962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7facb81007e0 0x7facb819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:25.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.806+0000 7facb67fc640 1 -- 172.21.15.170:0/2229576962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7facb81007e0 msgr2=0x7facb819d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:25.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.806+0000 7facb67fc640 1 --2- 172.21.15.170:0/2229576962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7facb81007e0 0x7facb819d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:25.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.806+0000 7facb67fc640 1 -- 172.21.15.170:0/2229576962 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb81977c0 con 0x7facb81067e0 2024-09-04T16:51:25.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.806+0000 7facb6ffd640 1 --2- 172.21.15.170:0/2229576962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7facb81007e0 0x7facb819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:51:25.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.806+0000 7facb67fc640 1 --2- 172.21.15.170:0/2229576962 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facb81067e0 0x7facb819db80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7faca000d8d0 tx=0x7faca000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:25.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.806+0000 7facbc846640 1 -- 172.21.15.170:0/2229576962 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faca0017070 con 0x7facb81067e0 2024-09-04T16:51:25.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.806+0000 7facbc846640 1 -- 172.21.15.170:0/2229576962 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faca0010460 con 0x7facb81067e0 2024-09-04T16:51:25.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.806+0000 7facbd848640 1 -- 172.21.15.170:0/2229576962 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb8197ab0 con 0x7facb81067e0 2024-09-04T16:51:25.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.806+0000 7facbc846640 1 -- 172.21.15.170:0/2229576962 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faca000f5f0 con 0x7facb81067e0 2024-09-04T16:51:25.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.806+0000 7facbd848640 1 -- 172.21.15.170:0/2229576962 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb8198040 con 0x7facb81067e0 2024-09-04T16:51:25.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.807+0000 7facbd848640 1 -- 172.21.15.170:0/2229576962 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facb8101f20 con 0x7facb81067e0 2024-09-04T16:51:25.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.808+0000 7facbc846640 1 -- 172.21.15.170:0/2229576962 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7faca0009a30 con 0x7facb81067e0 2024-09-04T16:51:25.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.809+0000 7facbc846640 1 --2- 172.21.15.170:0/2229576962 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faca4079e80 0x7faca407c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:25.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.809+0000 7facb6ffd640 1 --2- 172.21.15.170:0/2229576962 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faca4079e80 0x7faca407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:25.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.809+0000 7facbc846640 1 -- 172.21.15.170:0/2229576962 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7faca009c910 con 0x7facb81067e0 2024-09-04T16:51:25.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.809+0000 7facb6ffd640 1 --2- 172.21.15.170:0/2229576962 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faca4079e80 0x7faca407c340 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7facb0006010 tx=0x7facb002f9d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:25.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:25.813+0000 7facbc846640 1 -- 172.21.15.170:0/2229576962 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faca00643a0 con 0x7facb81067e0 2024-09-04T16:51:26.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.053+0000 7facbd848640 1 -- 172.21.15.170:0/2229576962 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7facb81039f0 con 0x7facb81067e0 2024-09-04T16:51:26.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.053+0000 7facbc846640 1 -- 172.21.15.170:0/2229576962 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7faca0068510 con 0x7facb81067e0 2024-09-04T16:51:26.053 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:51:26.053 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:51:26.054 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:51:26.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:51:26.054 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:51:26.054 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:51:26.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:51:26.054 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:51:26.054 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:51:26.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:51:26.054 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:51:26.054 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:51:26.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:51:26.054 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:51:26.055 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:51:26.055 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:51:26.055 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:51:26.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.055+0000 7facbd848640 1 -- 172.21.15.170:0/2229576962 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faca4079e80 msgr2=0x7faca407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:26.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.055+0000 7facbd848640 1 --2- 172.21.15.170:0/2229576962 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faca4079e80 0x7faca407c340 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7facb0006010 tx=0x7facb002f9d0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.055+0000 7facbd848640 1 -- 172.21.15.170:0/2229576962 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facb81067e0 msgr2=0x7facb819db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:26.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.055+0000 7facbd848640 1 --2- 172.21.15.170:0/2229576962 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facb81067e0 0x7facb819db80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7faca000d8d0 tx=0x7faca000dd90 comp rx=0 tx=0).stop 2024-09-04T16:51:26.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.055+0000 7facbd848640 1 -- 172.21.15.170:0/2229576962 shutdown_connections 2024-09-04T16:51:26.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.055+0000 7facbd848640 1 --2- 172.21.15.170:0/2229576962 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7faca4079e80 0x7faca407c340 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.055+0000 7facbd848640 1 --2- 172.21.15.170:0/2229576962 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facb81067e0 0x7facb819db80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.055+0000 7facbd848640 1 --2- 172.21.15.170:0/2229576962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7facb81007e0 0x7facb819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.055+0000 7facbd848640 1 -- 172.21.15.170:0/2229576962 >> 172.21.15.170:0/2229576962 conn(0x7facb80fc4c0 msgr2=0x7facb80fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:26.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.056+0000 7facbd848640 1 -- 172.21.15.170:0/2229576962 shutdown_connections 2024-09-04T16:51:26.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.056+0000 7facbd848640 1 -- 172.21.15.170:0/2229576962 wait complete. 2024-09-04T16:51:26.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.137+0000 7ff1d34af640 1 -- 172.21.15.170:0/3653159176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1cc106820 msgr2=0x7ff1cc106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:26.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.137+0000 7ff1d34af640 1 --2- 172.21.15.170:0/3653159176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1cc106820 0x7ff1cc106c00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009880 tx=0x7ff1c002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.137+0000 7ff1d34af640 1 -- 172.21.15.170:0/3653159176 shutdown_connections 2024-09-04T16:51:26.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.137+0000 7ff1d34af640 1 --2- 172.21.15.170:0/3653159176 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1cc100820 0x7ff1cc100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.137+0000 7ff1d34af640 1 --2- 172.21.15.170:0/3653159176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1cc106820 0x7ff1cc106c00 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.137+0000 7ff1d34af640 1 -- 172.21.15.170:0/3653159176 >> 172.21.15.170:0/3653159176 conn(0x7ff1cc0fc520 msgr2=0x7ff1cc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:26.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.137+0000 7ff1d34af640 1 -- 172.21.15.170:0/3653159176 shutdown_connections 2024-09-04T16:51:26.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.137+0000 7ff1d34af640 1 -- 172.21.15.170:0/3653159176 wait complete. 2024-09-04T16:51:26.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.138+0000 7ff1d34af640 1 Processor -- start 2024-09-04T16:51:26.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.138+0000 7ff1d34af640 1 -- start start 2024-09-04T16:51:26.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.138+0000 7ff1d34af640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1cc100820 0x7ff1cc196650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:26.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.138+0000 7ff1d34af640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1cc106820 0x7ff1cc196b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:26.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.138+0000 7ff1d34af640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc10dd50 con 0x7ff1cc106820 2024-09-04T16:51:26.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.138+0000 7ff1d34af640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc10dbd0 con 0x7ff1cc100820 2024-09-04T16:51:26.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.138+0000 7ff1d0a4a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1cc106820 0x7ff1cc196b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:26.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.138+0000 7ff1d0a4a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1cc106820 0x7ff1cc196b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38084/0 (socket says 172.21.15.170:38084) 2024-09-04T16:51:26.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.138+0000 7ff1d0a4a640 1 -- 172.21.15.170:0/3554448100 learned_addr learned my addr 172.21.15.170:0/3554448100 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:51:26.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.138+0000 7ff1d124b640 1 --2- 172.21.15.170:0/3554448100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1cc100820 0x7ff1cc196650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:26.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.138+0000 7ff1d0a4a640 1 -- 172.21.15.170:0/3554448100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1cc100820 msgr2=0x7ff1cc196650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:26.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.138+0000 7ff1d0a4a640 1 --2- 172.21.15.170:0/3554448100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1cc100820 0x7ff1cc196650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.138+0000 7ff1d0a4a640 1 -- 172.21.15.170:0/3554448100 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1cc1970d0 con 0x7ff1cc106820 2024-09-04T16:51:26.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.138+0000 7ff1d0a4a640 1 --2- 172.21.15.170:0/3554448100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1cc106820 0x7ff1cc196b90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800b420 tx=0x7ff1c800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:26.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.139+0000 7ff1be7fc640 1 -- 172.21.15.170:0/3554448100 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff1c8011630 con 0x7ff1cc106820 2024-09-04T16:51:26.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.139+0000 7ff1be7fc640 1 -- 172.21.15.170:0/3554448100 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff1c8016070 con 0x7ff1cc106820 2024-09-04T16:51:26.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.139+0000 7ff1d34af640 1 -- 172.21.15.170:0/3554448100 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1cc1973c0 con 0x7ff1cc106820 2024-09-04T16:51:26.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.139+0000 7ff1be7fc640 1 -- 172.21.15.170:0/3554448100 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff1c8010d40 con 0x7ff1cc106820 2024-09-04T16:51:26.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.139+0000 7ff1d34af640 1 -- 172.21.15.170:0/3554448100 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1cc1a3e90 con 0x7ff1cc106820 2024-09-04T16:51:26.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.140+0000 7ff1d34af640 1 -- 172.21.15.170:0/3554448100 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1cc101f60 con 0x7ff1cc106820 2024-09-04T16:51:26.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.140+0000 7ff1be7fc640 1 -- 172.21.15.170:0/3554448100 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ff1c801b460 con 0x7ff1cc106820 2024-09-04T16:51:26.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.141+0000 7ff1be7fc640 1 --2- 172.21.15.170:0/3554448100 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff1b8079e80 0x7ff1b807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:26.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.141+0000 7ff1be7fc640 1 -- 172.21.15.170:0/3554448100 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff1c809c0d0 con 0x7ff1cc106820 2024-09-04T16:51:26.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.141+0000 7ff1d124b640 1 --2- 172.21.15.170:0/3554448100 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff1b8079e80 0x7ff1b807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:26.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.141+0000 7ff1d124b640 1 --2- 172.21.15.170:0/3554448100 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff1b8079e80 0x7ff1b807c340 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00096c0 tx=0x7ff1c0031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:26.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.145+0000 7ff1be7fc640 1 -- 172.21.15.170:0/3554448100 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff1c8063b60 con 0x7ff1cc106820 2024-09-04T16:51:26.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:25 smithi193 ceph-mon[82547]: pgmap v651: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:26.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:25 smithi193 ceph-mon[82547]: from='client.35006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:51:26.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:25 smithi193 ceph-mon[82547]: from='client.35010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:51:26.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.351+0000 7ff1d34af640 1 -- 172.21.15.170:0/3554448100 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff1cc108df0 con 0x7ff1cc106820 2024-09-04T16:51:26.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.352+0000 7ff1be7fc640 1 -- 172.21.15.170:0/3554448100 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7ff1c8067cd0 con 0x7ff1cc106820 2024-09-04T16:51:26.352 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:51:26.352 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:51:26.352 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:51:26.352 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:51:26.352 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:51:26.352 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:51:26.352 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:51:26.352 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:51:26.352 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:51:26.353 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:51:26.353 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:51:26.353 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:51:26.353 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:51:26.353 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:51:26.353 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:51:26.353 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:51:26.353 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:51:26.353 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:51:26.353 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:51:26.353 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:51:26.353 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:51:26.354 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:51:26.354 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:51:26.354 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:51:26.354 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:51:26.354 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:51:26.354 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:51:26.354 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:51:26.354 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:51:26.354 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:51:26.354 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:51:26.354 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:51:26.355 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:51:26.355 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:51:26.355 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:51:26.355 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:51:26.355 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:51:26.355 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:51:26.355 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:51:26.355 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:51:26.355 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:51:26.355 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:51:26.355 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:51:26.356 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:51:26.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.354+0000 7ff1d34af640 1 -- 172.21.15.170:0/3554448100 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff1b8079e80 msgr2=0x7ff1b807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:26.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.354+0000 7ff1d34af640 1 --2- 172.21.15.170:0/3554448100 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff1b8079e80 0x7ff1b807c340 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00096c0 tx=0x7ff1c0031400 comp rx=0 tx=0).stop 2024-09-04T16:51:26.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.354+0000 7ff1d34af640 1 -- 172.21.15.170:0/3554448100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1cc106820 msgr2=0x7ff1cc196b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:26.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.354+0000 7ff1d34af640 1 --2- 172.21.15.170:0/3554448100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1cc106820 0x7ff1cc196b90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800b420 tx=0x7ff1c800b8e0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.354+0000 7ff1d34af640 1 -- 172.21.15.170:0/3554448100 shutdown_connections 2024-09-04T16:51:26.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.354+0000 7ff1d34af640 1 --2- 172.21.15.170:0/3554448100 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff1b8079e80 0x7ff1b807c340 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.354+0000 7ff1d34af640 1 --2- 172.21.15.170:0/3554448100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1cc106820 0x7ff1cc196b90 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.354+0000 7ff1d34af640 1 --2- 172.21.15.170:0/3554448100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1cc100820 0x7ff1cc196650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.354+0000 7ff1d34af640 1 -- 172.21.15.170:0/3554448100 >> 172.21.15.170:0/3554448100 conn(0x7ff1cc0fc520 msgr2=0x7ff1cc0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:26.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.354+0000 7ff1d34af640 1 -- 172.21.15.170:0/3554448100 shutdown_connections 2024-09-04T16:51:26.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.354+0000 7ff1d34af640 1 -- 172.21.15.170:0/3554448100 wait complete. 2024-09-04T16:51:26.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.436+0000 7f9ca59c5640 1 -- 172.21.15.170:0/3099554597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ca0102b00 msgr2=0x7f9ca0102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:26.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.436+0000 7f9ca59c5640 1 --2- 172.21.15.170:0/3099554597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ca0102b00 0x7f9ca0102ee0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009c50 tx=0x7f9c9002aa30 comp rx=0 tx=0).stop 2024-09-04T16:51:26.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.436+0000 7f9ca59c5640 1 -- 172.21.15.170:0/3099554597 shutdown_connections 2024-09-04T16:51:26.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.436+0000 7f9ca59c5640 1 --2- 172.21.15.170:0/3099554597 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ca0103420 0x7f9ca010b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.436+0000 7f9ca59c5640 1 --2- 172.21.15.170:0/3099554597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ca0102b00 0x7f9ca0102ee0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.436+0000 7f9ca59c5640 1 -- 172.21.15.170:0/3099554597 >> 172.21.15.170:0/3099554597 conn(0x7f9ca00fc4c0 msgr2=0x7f9ca00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:26.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.436+0000 7f9ca59c5640 1 -- 172.21.15.170:0/3099554597 shutdown_connections 2024-09-04T16:51:26.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.436+0000 7f9ca59c5640 1 -- 172.21.15.170:0/3099554597 wait complete. 2024-09-04T16:51:26.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.437+0000 7f9ca59c5640 1 Processor -- start 2024-09-04T16:51:26.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.437+0000 7f9ca59c5640 1 -- start start 2024-09-04T16:51:26.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.437+0000 7f9ca59c5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ca0102b00 0x7f9ca019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:26.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.437+0000 7f9ca59c5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ca0103420 0x7f9ca019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:26.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.437+0000 7f9ca59c5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca010edd0 con 0x7f9ca0103420 2024-09-04T16:51:26.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.437+0000 7f9ca59c5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca010ec50 con 0x7f9ca0102b00 2024-09-04T16:51:26.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.438+0000 7f9c9e7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ca0103420 0x7f9ca019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:26.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.438+0000 7f9c9e7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ca0103420 0x7f9ca019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38116/0 (socket says 172.21.15.170:38116) 2024-09-04T16:51:26.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.438+0000 7f9c9e7fc640 1 -- 172.21.15.170:0/1370189313 learned_addr learned my addr 172.21.15.170:0/1370189313 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:51:26.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.438+0000 7f9c9effd640 1 --2- 172.21.15.170:0/1370189313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ca0102b00 0x7f9ca019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:26.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.438+0000 7f9c9e7fc640 1 -- 172.21.15.170:0/1370189313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ca0102b00 msgr2=0x7f9ca019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:26.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.438+0000 7f9c9e7fc640 1 --2- 172.21.15.170:0/1370189313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ca0102b00 0x7f9ca019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.438+0000 7f9c9e7fc640 1 -- 172.21.15.170:0/1370189313 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca0197800 con 0x7f9ca0103420 2024-09-04T16:51:26.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.438+0000 7f9c9e7fc640 1 --2- 172.21.15.170:0/1370189313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ca0103420 0x7f9ca019dbc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400d6f0 tx=0x7f9c9400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:26.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.438+0000 7f9ca49c3640 1 -- 172.21.15.170:0/1370189313 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c94017070 con 0x7f9ca0103420 2024-09-04T16:51:26.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.438+0000 7f9ca49c3640 1 -- 172.21.15.170:0/1370189313 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9c9400de00 con 0x7f9ca0103420 2024-09-04T16:51:26.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.438+0000 7f9ca49c3640 1 -- 172.21.15.170:0/1370189313 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c94004bb0 con 0x7f9ca0103420 2024-09-04T16:51:26.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.438+0000 7f9ca59c5640 1 -- 172.21.15.170:0/1370189313 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca0197af0 con 0x7f9ca0103420 2024-09-04T16:51:26.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.438+0000 7f9ca59c5640 1 -- 172.21.15.170:0/1370189313 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca0198080 con 0x7f9ca0103420 2024-09-04T16:51:26.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.439+0000 7f9ca59c5640 1 -- 172.21.15.170:0/1370189313 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca006a3b0 con 0x7f9ca0103420 2024-09-04T16:51:26.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.440+0000 7f9ca49c3640 1 -- 172.21.15.170:0/1370189313 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f9c94009a30 con 0x7f9ca0103420 2024-09-04T16:51:26.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.441+0000 7f9ca49c3640 1 --2- 172.21.15.170:0/1370189313 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9c88079e80 0x7f9c8807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:26.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.441+0000 7f9ca49c3640 1 -- 172.21.15.170:0/1370189313 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9c9409c570 con 0x7f9ca0103420 2024-09-04T16:51:26.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.441+0000 7f9c9effd640 1 --2- 172.21.15.170:0/1370189313 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9c88079e80 0x7f9c8807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:26.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.441+0000 7f9c9effd640 1 --2- 172.21.15.170:0/1370189313 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9c88079e80 0x7f9c8807c340 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009430 tx=0x7f9c9003a040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:26.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.445+0000 7f9ca49c3640 1 -- 172.21.15.170:0/1370189313 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9c94068170 con 0x7f9ca0103420 2024-09-04T16:51:26.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.638+0000 7f9ca59c5640 1 -- 172.21.15.170:0/1370189313 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9ca01983a0 con 0x7f9c88079e80 2024-09-04T16:51:26.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.640+0000 7f9ca49c3640 1 -- 172.21.15.170:0/1370189313 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9ca01983a0 con 0x7f9c88079e80 2024-09-04T16:51:26.639 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:51:26.639 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:51:26.639 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:51:26.640 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:51:26.640 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:51:26.640 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:51:26.640 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:51:26.640 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:51:26.640 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:51:26.640 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:51:26.640 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:51:26.640 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:51:26.640 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:51:26.640 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:51:26.640 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:51:26.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.642+0000 7f9ca59c5640 1 -- 172.21.15.170:0/1370189313 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9c88079e80 msgr2=0x7f9c8807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:26.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.642+0000 7f9ca59c5640 1 --2- 172.21.15.170:0/1370189313 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9c88079e80 0x7f9c8807c340 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009430 tx=0x7f9c9003a040 comp rx=0 tx=0).stop 2024-09-04T16:51:26.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.642+0000 7f9ca59c5640 1 -- 172.21.15.170:0/1370189313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ca0103420 msgr2=0x7f9ca019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:26.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.642+0000 7f9ca59c5640 1 --2- 172.21.15.170:0/1370189313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ca0103420 0x7f9ca019dbc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400d6f0 tx=0x7f9c9400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.642+0000 7f9ca59c5640 1 -- 172.21.15.170:0/1370189313 shutdown_connections 2024-09-04T16:51:26.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.642+0000 7f9ca59c5640 1 --2- 172.21.15.170:0/1370189313 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9c88079e80 0x7f9c8807c340 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.642+0000 7f9ca59c5640 1 --2- 172.21.15.170:0/1370189313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ca0103420 0x7f9ca019dbc0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.642+0000 7f9ca59c5640 1 --2- 172.21.15.170:0/1370189313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ca0102b00 0x7f9ca019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.642+0000 7f9ca59c5640 1 -- 172.21.15.170:0/1370189313 >> 172.21.15.170:0/1370189313 conn(0x7f9ca00fc4c0 msgr2=0x7f9ca0103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:26.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.642+0000 7f9ca59c5640 1 -- 172.21.15.170:0/1370189313 shutdown_connections 2024-09-04T16:51:26.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.642+0000 7f9ca59c5640 1 -- 172.21.15.170:0/1370189313 wait complete. 2024-09-04T16:51:26.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.723+0000 7f088f742640 1 -- 172.21.15.170:0/3489611283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08881007e0 msgr2=0x7f0888100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:26.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.723+0000 7f088f742640 1 --2- 172.21.15.170:0/3489611283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08881007e0 0x7f0888100c40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f087c009880 tx=0x7f087c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.724+0000 7f088f742640 1 -- 172.21.15.170:0/3489611283 shutdown_connections 2024-09-04T16:51:26.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.724+0000 7f088f742640 1 --2- 172.21.15.170:0/3489611283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08881007e0 0x7f0888100c40 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.724+0000 7f088f742640 1 --2- 172.21.15.170:0/3489611283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08881067e0 0x7f0888106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.724+0000 7f088f742640 1 -- 172.21.15.170:0/3489611283 >> 172.21.15.170:0/3489611283 conn(0x7f08880fc4c0 msgr2=0x7f08880fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:26.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.724+0000 7f088f742640 1 -- 172.21.15.170:0/3489611283 shutdown_connections 2024-09-04T16:51:26.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.724+0000 7f088f742640 1 -- 172.21.15.170:0/3489611283 wait complete. 2024-09-04T16:51:26.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.724+0000 7f088f742640 1 Processor -- start 2024-09-04T16:51:26.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.724+0000 7f088f742640 1 -- start start 2024-09-04T16:51:26.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.724+0000 7f088f742640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08881007e0 0x7f08881987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:26.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.724+0000 7f088f742640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08881067e0 0x7f0888198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:26.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.724+0000 7f088f742640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f088810dc90 con 0x7f08881007e0 2024-09-04T16:51:26.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.724+0000 7f088f742640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f088810db10 con 0x7f08881067e0 2024-09-04T16:51:26.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.725+0000 7f088d4de640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08881007e0 0x7f08881987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:26.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.725+0000 7f088d4de640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08881007e0 0x7f08881987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38148/0 (socket says 172.21.15.170:38148) 2024-09-04T16:51:26.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.725+0000 7f088d4de640 1 -- 172.21.15.170:0/2484369669 learned_addr learned my addr 172.21.15.170:0/2484369669 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:51:26.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.725+0000 7f088ccdd640 1 --2- 172.21.15.170:0/2484369669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08881067e0 0x7f0888198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:26.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.725+0000 7f088d4de640 1 -- 172.21.15.170:0/2484369669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08881067e0 msgr2=0x7f0888198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:26.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.725+0000 7f088d4de640 1 --2- 172.21.15.170:0/2484369669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08881067e0 0x7f0888198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.725+0000 7f088d4de640 1 -- 172.21.15.170:0/2484369669 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0888199300 con 0x7f08881007e0 2024-09-04T16:51:26.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.725+0000 7f088ccdd640 1 --2- 172.21.15.170:0/2484369669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08881067e0 0x7f0888198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:51:26.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.725+0000 7f088d4de640 1 --2- 172.21.15.170:0/2484369669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08881007e0 0x7f08881987c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f088400d8d0 tx=0x7f088400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:26.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.725+0000 7f087a7fc640 1 -- 172.21.15.170:0/2484369669 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0884017030 con 0x7f08881007e0 2024-09-04T16:51:26.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.725+0000 7f087a7fc640 1 -- 172.21.15.170:0/2484369669 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0884004020 con 0x7f08881007e0 2024-09-04T16:51:26.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.725+0000 7f088f742640 1 -- 172.21.15.170:0/2484369669 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08881995f0 con 0x7f08881007e0 2024-09-04T16:51:26.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.725+0000 7f087a7fc640 1 -- 172.21.15.170:0/2484369669 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f08840047a0 con 0x7f08881007e0 2024-09-04T16:51:26.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.725+0000 7f088f742640 1 -- 172.21.15.170:0/2484369669 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08881a1bf0 con 0x7f08881007e0 2024-09-04T16:51:26.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.726+0000 7f088f742640 1 -- 172.21.15.170:0/2484369669 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0888101f20 con 0x7f08881007e0 2024-09-04T16:51:26.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.727+0000 7f087a7fc640 1 -- 172.21.15.170:0/2484369669 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f08840041d0 con 0x7f08881007e0 2024-09-04T16:51:26.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.727+0000 7f087a7fc640 1 --2- 172.21.15.170:0/2484369669 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0874079e30 0x7f087407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:26.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.727+0000 7f087a7fc640 1 -- 172.21.15.170:0/2484369669 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f0884018070 con 0x7f08881007e0 2024-09-04T16:51:26.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.727+0000 7f088ccdd640 1 --2- 172.21.15.170:0/2484369669 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0874079e30 0x7f087407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:26.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.728+0000 7f088ccdd640 1 --2- 172.21.15.170:0/2484369669 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0874079e30 0x7f087407c2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f087c006010 tx=0x7f087c0095f0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:26.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.731+0000 7f087a7fc640 1 -- 172.21.15.170:0/2484369669 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f08881995f0 con 0x7f08881007e0 2024-09-04T16:51:26.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.973+0000 7f088f742640 1 -- 172.21.15.170:0/2484369669 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0888100c40 con 0x7f08881007e0 2024-09-04T16:51:26.973 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:26 smithi170 ceph-mon[113855]: from='client.35014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:51:26.973 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:26 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2229576962' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:51:26.973 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:26 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3554448100' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:51:26.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.974+0000 7f087a7fc640 1 -- 172.21.15.170:0/2484369669 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f08840642f0 con 0x7f08881007e0 2024-09-04T16:51:26.974 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:51:26.974 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:51:26.974 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:51:26.974 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:51:26.974 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:51:26.974 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:51:26.974 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:51:26.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.976+0000 7f088f742640 1 -- 172.21.15.170:0/2484369669 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0874079e30 msgr2=0x7f087407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:26.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.976+0000 7f088f742640 1 --2- 172.21.15.170:0/2484369669 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0874079e30 0x7f087407c2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f087c006010 tx=0x7f087c0095f0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.976+0000 7f088f742640 1 -- 172.21.15.170:0/2484369669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08881007e0 msgr2=0x7f08881987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:26.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.976+0000 7f088f742640 1 --2- 172.21.15.170:0/2484369669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08881007e0 0x7f08881987c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f088400d8d0 tx=0x7f088400dd90 comp rx=0 tx=0).stop 2024-09-04T16:51:26.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.976+0000 7f088f742640 1 -- 172.21.15.170:0/2484369669 shutdown_connections 2024-09-04T16:51:26.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.976+0000 7f088f742640 1 --2- 172.21.15.170:0/2484369669 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0874079e30 0x7f087407c2f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.976+0000 7f088f742640 1 --2- 172.21.15.170:0/2484369669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08881067e0 0x7f0888198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.976+0000 7f088f742640 1 --2- 172.21.15.170:0/2484369669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08881007e0 0x7f08881987c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:26.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.976+0000 7f088f742640 1 -- 172.21.15.170:0/2484369669 >> 172.21.15.170:0/2484369669 conn(0x7f08880fc4c0 msgr2=0x7f08880fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:26.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.976+0000 7f088f742640 1 -- 172.21.15.170:0/2484369669 shutdown_connections 2024-09-04T16:51:26.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:26.976+0000 7f088f742640 1 -- 172.21.15.170:0/2484369669 wait complete. 2024-09-04T16:51:27.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:26 smithi193 ceph-mon[82547]: from='client.35014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:51:27.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:26 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2229576962' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:51:27.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:26 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3554448100' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:51:28.058 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:27 smithi193 ceph-mon[82547]: pgmap v652: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:28.058 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:27 smithi193 ceph-mon[82547]: from='client.35026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:51:28.058 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:27 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2484369669' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:51:28.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:27 smithi170 ceph-mon[113855]: pgmap v652: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:28.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:27 smithi170 ceph-mon[113855]: from='client.35026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:51:28.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:27 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2484369669' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:51:30.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:29 smithi170 ceph-mon[113855]: pgmap v653: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:30.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:51:30.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:29 smithi193 ceph-mon[82547]: pgmap v653: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:30.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:51:32.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:31 smithi170 ceph-mon[113855]: pgmap v654: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:32.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:31 smithi193 ceph-mon[82547]: pgmap v654: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:34.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:33 smithi170 ceph-mon[113855]: pgmap v655: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:34.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:33 smithi193 ceph-mon[82547]: pgmap v655: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:36.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:35 smithi170 ceph-mon[113855]: pgmap v656: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:36.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:35 smithi193 ceph-mon[82547]: pgmap v656: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:37.971 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:37 smithi193 ceph-mon[82547]: pgmap v657: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:38.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:37 smithi170 ceph-mon[113855]: pgmap v657: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:40.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:39 smithi170 ceph-mon[113855]: pgmap v658: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:40.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:39 smithi193 ceph-mon[82547]: pgmap v658: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:41.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:41 smithi193 ceph-mon[82547]: pgmap v659: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:42.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:41 smithi170 ceph-mon[113855]: pgmap v659: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:44.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:43 smithi170 ceph-mon[113855]: pgmap v660: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:44.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:43 smithi193 ceph-mon[82547]: pgmap v660: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:45.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:51:45.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:51:45.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:45 smithi170 ceph-mon[113855]: pgmap v661: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:46.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:45 smithi193 ceph-mon[82547]: pgmap v661: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:48.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:47 smithi170 ceph-mon[113855]: pgmap v662: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:48.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:47 smithi193 ceph-mon[82547]: pgmap v662: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:50.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:49 smithi170 ceph-mon[113855]: pgmap v663: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:50.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:49 smithi193 ceph-mon[82547]: pgmap v663: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:52.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:51 smithi170 ceph-mon[113855]: pgmap v664: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:52.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:51 smithi193 ceph-mon[82547]: pgmap v664: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:54.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:53 smithi170 ceph-mon[113855]: pgmap v665: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:54.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:53 smithi193 ceph-mon[82547]: pgmap v665: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:56.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:55 smithi170 ceph-mon[113855]: pgmap v666: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:56.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:55 smithi193 ceph-mon[82547]: pgmap v666: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:57.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.070+0000 7f85861e5640 1 -- 172.21.15.170:0/620496219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8580100a80 msgr2=0x7f85801065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:57.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.070+0000 7f85861e5640 1 --2- 172.21.15.170:0/620496219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8580100a80 0x7f85801065c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8574009880 tx=0x7f857402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.070+0000 7f85861e5640 1 -- 172.21.15.170:0/620496219 shutdown_connections 2024-09-04T16:51:57.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.070+0000 7f85861e5640 1 --2- 172.21.15.170:0/620496219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8580100a80 0x7f85801065c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.070+0000 7f85861e5640 1 --2- 172.21.15.170:0/620496219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85801000d0 0x7f85801004b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.070+0000 7f85861e5640 1 -- 172.21.15.170:0/620496219 >> 172.21.15.170:0/620496219 conn(0x7f85800fbc60 msgr2=0x7f85800fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:57.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.071+0000 7f85861e5640 1 -- 172.21.15.170:0/620496219 shutdown_connections 2024-09-04T16:51:57.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.071+0000 7f85861e5640 1 -- 172.21.15.170:0/620496219 wait complete. 2024-09-04T16:51:57.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.071+0000 7f85861e5640 1 Processor -- start 2024-09-04T16:51:57.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.071+0000 7f85861e5640 1 -- start start 2024-09-04T16:51:57.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.072+0000 7f85861e5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85801000d0 0x7f858019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:57.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.072+0000 7f85861e5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8580100a80 0x7f858019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:57.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.072+0000 7f85861e5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f858010edf0 con 0x7f85801000d0 2024-09-04T16:51:57.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.072+0000 7f85861e5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f858010ec70 con 0x7f8580100a80 2024-09-04T16:51:57.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.072+0000 7f857f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85801000d0 0x7f858019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:57.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.072+0000 7f857f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85801000d0 0x7f858019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48698/0 (socket says 172.21.15.170:48698) 2024-09-04T16:51:57.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.072+0000 7f857f7fe640 1 -- 172.21.15.170:0/1455665358 learned_addr learned my addr 172.21.15.170:0/1455665358 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:51:57.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.072+0000 7f857effd640 1 --2- 172.21.15.170:0/1455665358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8580100a80 0x7f858019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:57.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.072+0000 7f857f7fe640 1 -- 172.21.15.170:0/1455665358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8580100a80 msgr2=0x7f858019dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:57.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.072+0000 7f857f7fe640 1 --2- 172.21.15.170:0/1455665358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8580100a80 0x7f858019dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.072+0000 7f857f7fe640 1 -- 172.21.15.170:0/1455665358 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8580197860 con 0x7f85801000d0 2024-09-04T16:51:57.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.072+0000 7f857f7fe640 1 --2- 172.21.15.170:0/1455665358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85801000d0 0x7f858019d6a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f857000d8d0 tx=0x7f857000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:57.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.072+0000 7f857cff9640 1 -- 172.21.15.170:0/1455665358 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8570017070 con 0x7f85801000d0 2024-09-04T16:51:57.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.073+0000 7f857cff9640 1 -- 172.21.15.170:0/1455665358 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8570010460 con 0x7f85801000d0 2024-09-04T16:51:57.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.073+0000 7f857cff9640 1 -- 172.21.15.170:0/1455665358 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f857000f5f0 con 0x7f85801000d0 2024-09-04T16:51:57.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.073+0000 7f85861e5640 1 -- 172.21.15.170:0/1455665358 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8580197b50 con 0x7f85801000d0 2024-09-04T16:51:57.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.073+0000 7f85861e5640 1 -- 172.21.15.170:0/1455665358 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85801980b0 con 0x7f85801000d0 2024-09-04T16:51:57.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.074+0000 7f85861e5640 1 -- 172.21.15.170:0/1455665358 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8580103190 con 0x7f85801000d0 2024-09-04T16:51:57.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.075+0000 7f857cff9640 1 -- 172.21.15.170:0/1455665358 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f8570009a30 con 0x7f85801000d0 2024-09-04T16:51:57.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.075+0000 7f857cff9640 1 --2- 172.21.15.170:0/1455665358 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8568079e80 0x7f856807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:57.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.075+0000 7f857cff9640 1 -- 172.21.15.170:0/1455665358 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f857009c860 con 0x7f85801000d0 2024-09-04T16:51:57.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.075+0000 7f857effd640 1 --2- 172.21.15.170:0/1455665358 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8568079e80 0x7f856807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:57.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.076+0000 7f857effd640 1 --2- 172.21.15.170:0/1455665358 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8568079e80 0x7f856807c340 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8574000c00 tx=0x7f8574031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:57.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.080+0000 7f857cff9640 1 -- 172.21.15.170:0/1455665358 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8570068460 con 0x7f85801000d0 2024-09-04T16:51:57.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.284+0000 7f85861e5640 1 -- 172.21.15.170:0/1455665358 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8580198d90 con 0x7f8568079e80 2024-09-04T16:51:57.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.286+0000 7f857cff9640 1 -- 172.21.15.170:0/1455665358 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8580198d90 con 0x7f8568079e80 2024-09-04T16:51:57.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.288+0000 7f85861e5640 1 -- 172.21.15.170:0/1455665358 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8568079e80 msgr2=0x7f856807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:57.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.288+0000 7f85861e5640 1 --2- 172.21.15.170:0/1455665358 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8568079e80 0x7f856807c340 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8574000c00 tx=0x7f8574031400 comp rx=0 tx=0).stop 2024-09-04T16:51:57.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.288+0000 7f85861e5640 1 -- 172.21.15.170:0/1455665358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85801000d0 msgr2=0x7f858019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:57.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.288+0000 7f85861e5640 1 --2- 172.21.15.170:0/1455665358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85801000d0 0x7f858019d6a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f857000d8d0 tx=0x7f857000dd90 comp rx=0 tx=0).stop 2024-09-04T16:51:57.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.288+0000 7f85861e5640 1 -- 172.21.15.170:0/1455665358 shutdown_connections 2024-09-04T16:51:57.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.288+0000 7f85861e5640 1 --2- 172.21.15.170:0/1455665358 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8568079e80 0x7f856807c340 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.288+0000 7f85861e5640 1 --2- 172.21.15.170:0/1455665358 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8580100a80 0x7f858019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.288+0000 7f85861e5640 1 --2- 172.21.15.170:0/1455665358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85801000d0 0x7f858019d6a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.288+0000 7f85861e5640 1 -- 172.21.15.170:0/1455665358 >> 172.21.15.170:0/1455665358 conn(0x7f85800fbc60 msgr2=0x7f85800fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:57.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.288+0000 7f85861e5640 1 -- 172.21.15.170:0/1455665358 shutdown_connections 2024-09-04T16:51:57.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.288+0000 7f85861e5640 1 -- 172.21.15.170:0/1455665358 wait complete. 2024-09-04T16:51:57.298 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:51:57.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.371+0000 7ff65b5af640 1 -- 172.21.15.170:0/1476890851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff654102ae0 msgr2=0x7ff654102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:57.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.371+0000 7ff65b5af640 1 --2- 172.21.15.170:0/1476890851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff654102ae0 0x7ff654102ec0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff650009880 tx=0x7ff65002a530 comp rx=0 tx=0).stop 2024-09-04T16:51:57.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.371+0000 7ff65b5af640 1 -- 172.21.15.170:0/1476890851 shutdown_connections 2024-09-04T16:51:57.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.371+0000 7ff65b5af640 1 --2- 172.21.15.170:0/1476890851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff654103400 0x7ff65410b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.371+0000 7ff65b5af640 1 --2- 172.21.15.170:0/1476890851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff654102ae0 0x7ff654102ec0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.371+0000 7ff65b5af640 1 -- 172.21.15.170:0/1476890851 >> 172.21.15.170:0/1476890851 conn(0x7ff6540fc520 msgr2=0x7ff6540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:57.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.371+0000 7ff65b5af640 1 -- 172.21.15.170:0/1476890851 shutdown_connections 2024-09-04T16:51:57.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.371+0000 7ff65b5af640 1 -- 172.21.15.170:0/1476890851 wait complete. 2024-09-04T16:51:57.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.372+0000 7ff65b5af640 1 Processor -- start 2024-09-04T16:51:57.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.372+0000 7ff65b5af640 1 -- start start 2024-09-04T16:51:57.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.372+0000 7ff65b5af640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff654102ae0 0x7ff65419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:57.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.372+0000 7ff65b5af640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff654103400 0x7ff65419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:57.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.372+0000 7ff65b5af640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff65410ee10 con 0x7ff654102ae0 2024-09-04T16:51:57.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.372+0000 7ff65b5af640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff65410ec90 con 0x7ff654103400 2024-09-04T16:51:57.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.372+0000 7ff65934b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff654102ae0 0x7ff65419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:57.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.372+0000 7ff65934b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff654102ae0 0x7ff65419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48714/0 (socket says 172.21.15.170:48714) 2024-09-04T16:51:57.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.372+0000 7ff65934b640 1 -- 172.21.15.170:0/3395264352 learned_addr learned my addr 172.21.15.170:0/3395264352 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:51:57.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.372+0000 7ff658b4a640 1 --2- 172.21.15.170:0/3395264352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff654103400 0x7ff65419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:57.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.373+0000 7ff65934b640 1 -- 172.21.15.170:0/3395264352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff654103400 msgr2=0x7ff65419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:57.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.373+0000 7ff65934b640 1 --2- 172.21.15.170:0/3395264352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff654103400 0x7ff65419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.373+0000 7ff65934b640 1 -- 172.21.15.170:0/3395264352 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff654197800 con 0x7ff654102ae0 2024-09-04T16:51:57.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.373+0000 7ff65934b640 1 --2- 172.21.15.170:0/3395264352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff654102ae0 0x7ff65419d680 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff650031460 tx=0x7ff6500045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:57.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.373+0000 7ff64a7fc640 1 -- 172.21.15.170:0/3395264352 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff65003f070 con 0x7ff654102ae0 2024-09-04T16:51:57.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.373+0000 7ff64a7fc640 1 -- 172.21.15.170:0/3395264352 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6500035f0 con 0x7ff654102ae0 2024-09-04T16:51:57.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.373+0000 7ff65b5af640 1 -- 172.21.15.170:0/3395264352 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff654197a90 con 0x7ff654102ae0 2024-09-04T16:51:57.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.373+0000 7ff64a7fc640 1 -- 172.21.15.170:0/3395264352 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff650035030 con 0x7ff654102ae0 2024-09-04T16:51:57.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.373+0000 7ff65b5af640 1 -- 172.21.15.170:0/3395264352 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff654197fc0 con 0x7ff654102ae0 2024-09-04T16:51:57.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.374+0000 7ff65b5af640 1 -- 172.21.15.170:0/3395264352 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff65406abe0 con 0x7ff654102ae0 2024-09-04T16:51:57.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.374+0000 7ff64a7fc640 1 -- 172.21.15.170:0/3395264352 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7ff650042070 con 0x7ff654102ae0 2024-09-04T16:51:57.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.375+0000 7ff64a7fc640 1 --2- 172.21.15.170:0/3395264352 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff640079e30 0x7ff64007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:57.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.375+0000 7ff64a7fc640 1 -- 172.21.15.170:0/3395264352 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff6500bd3d0 con 0x7ff654102ae0 2024-09-04T16:51:57.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.375+0000 7ff658b4a640 1 --2- 172.21.15.170:0/3395264352 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff640079e30 0x7ff64007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:57.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.375+0000 7ff658b4a640 1 --2- 172.21.15.170:0/3395264352 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff640079e30 0x7ff64007c2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff6540fe4d0 tx=0x7ff64400b2e0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:57.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.379+0000 7ff64a7fc640 1 -- 172.21.15.170:0/3395264352 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff650088f50 con 0x7ff654102ae0 2024-09-04T16:51:57.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.572+0000 7ff65b5af640 1 -- 172.21.15.170:0/3395264352 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff654198270 con 0x7ff640079e30 2024-09-04T16:51:57.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.574+0000 7ff64a7fc640 1 -- 172.21.15.170:0/3395264352 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff654198270 con 0x7ff640079e30 2024-09-04T16:51:57.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.576+0000 7ff65b5af640 1 -- 172.21.15.170:0/3395264352 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff640079e30 msgr2=0x7ff64007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:57.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.576+0000 7ff65b5af640 1 --2- 172.21.15.170:0/3395264352 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff640079e30 0x7ff64007c2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff6540fe4d0 tx=0x7ff64400b2e0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.576+0000 7ff65b5af640 1 -- 172.21.15.170:0/3395264352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff654102ae0 msgr2=0x7ff65419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:57.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.576+0000 7ff65b5af640 1 --2- 172.21.15.170:0/3395264352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff654102ae0 0x7ff65419d680 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff650031460 tx=0x7ff6500045e0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.576+0000 7ff65b5af640 1 -- 172.21.15.170:0/3395264352 shutdown_connections 2024-09-04T16:51:57.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.576+0000 7ff65b5af640 1 --2- 172.21.15.170:0/3395264352 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7ff640079e30 0x7ff64007c2f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.576+0000 7ff65b5af640 1 --2- 172.21.15.170:0/3395264352 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff654103400 0x7ff65419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.576+0000 7ff65b5af640 1 --2- 172.21.15.170:0/3395264352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff654102ae0 0x7ff65419d680 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.576+0000 7ff65b5af640 1 -- 172.21.15.170:0/3395264352 >> 172.21.15.170:0/3395264352 conn(0x7ff6540fc520 msgr2=0x7ff654108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:57.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.576+0000 7ff65b5af640 1 -- 172.21.15.170:0/3395264352 shutdown_connections 2024-09-04T16:51:57.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.576+0000 7ff65b5af640 1 -- 172.21.15.170:0/3395264352 wait complete. 2024-09-04T16:51:57.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.657+0000 7f6e79e3b640 1 -- 172.21.15.170:0/1021161887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e74101930 msgr2=0x7f6e74101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:57.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.657+0000 7f6e79e3b640 1 --2- 172.21.15.170:0/1021161887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e74101930 0x7f6e74101d90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009880 tx=0x7f6e5c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.657+0000 7f6e79e3b640 1 -- 172.21.15.170:0/1021161887 shutdown_connections 2024-09-04T16:51:57.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.657+0000 7f6e79e3b640 1 --2- 172.21.15.170:0/1021161887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e74101930 0x7f6e74101d90 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.657+0000 7f6e79e3b640 1 --2- 172.21.15.170:0/1021161887 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e74107930 0x7f6e74107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.657+0000 7f6e79e3b640 1 -- 172.21.15.170:0/1021161887 >> 172.21.15.170:0/1021161887 conn(0x7f6e740fd630 msgr2=0x7f6e740ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:57.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.657+0000 7f6e79e3b640 1 -- 172.21.15.170:0/1021161887 shutdown_connections 2024-09-04T16:51:57.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.657+0000 7f6e79e3b640 1 -- 172.21.15.170:0/1021161887 wait complete. 2024-09-04T16:51:57.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.658+0000 7f6e79e3b640 1 Processor -- start 2024-09-04T16:51:57.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.658+0000 7f6e79e3b640 1 -- start start 2024-09-04T16:51:57.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.658+0000 7f6e79e3b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e74101930 0x7f6e740744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:57.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.658+0000 7f6e79e3b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e74107930 0x7f6e74074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:57.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.658+0000 7f6e79e3b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7410ee00 con 0x7f6e74107930 2024-09-04T16:51:57.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.658+0000 7f6e79e3b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7410ec80 con 0x7f6e74101930 2024-09-04T16:51:57.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.658+0000 7f6e6bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e74107930 0x7f6e74074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:57.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.658+0000 7f6e6bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e74107930 0x7f6e74074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48726/0 (socket says 172.21.15.170:48726) 2024-09-04T16:51:57.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.658+0000 7f6e6bfff640 1 -- 172.21.15.170:0/2050461374 learned_addr learned my addr 172.21.15.170:0/2050461374 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:51:57.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.658+0000 7f6e737fe640 1 --2- 172.21.15.170:0/2050461374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e74101930 0x7f6e740744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:57.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.659+0000 7f6e6bfff640 1 -- 172.21.15.170:0/2050461374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e74101930 msgr2=0x7f6e740744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:57.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.659+0000 7f6e6bfff640 1 --2- 172.21.15.170:0/2050461374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e74101930 0x7f6e740744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.659+0000 7f6e6bfff640 1 -- 172.21.15.170:0/2050461374 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e74074f70 con 0x7f6e74107930 2024-09-04T16:51:57.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.659+0000 7f6e6bfff640 1 --2- 172.21.15.170:0/2050461374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e74107930 0x7f6e74074a30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c031460 tx=0x7f6e5c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:57.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.659+0000 7f6e717fa640 1 -- 172.21.15.170:0/2050461374 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6e5c03f070 con 0x7f6e74107930 2024-09-04T16:51:57.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.659+0000 7f6e717fa640 1 -- 172.21.15.170:0/2050461374 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e5c0035f0 con 0x7f6e74107930 2024-09-04T16:51:57.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.659+0000 7f6e79e3b640 1 -- 172.21.15.170:0/2050461374 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e74075200 con 0x7f6e74107930 2024-09-04T16:51:57.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.659+0000 7f6e717fa640 1 -- 172.21.15.170:0/2050461374 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6e5c035030 con 0x7f6e74107930 2024-09-04T16:51:57.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.659+0000 7f6e79e3b640 1 -- 172.21.15.170:0/2050461374 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e741a3dd0 con 0x7f6e74107930 2024-09-04T16:51:57.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.660+0000 7f6e79e3b640 1 -- 172.21.15.170:0/2050461374 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e74103070 con 0x7f6e74107930 2024-09-04T16:51:57.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.661+0000 7f6e717fa640 1 -- 172.21.15.170:0/2050461374 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f6e5c042070 con 0x7f6e74107930 2024-09-04T16:51:57.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.661+0000 7f6e717fa640 1 --2- 172.21.15.170:0/2050461374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6e60079e30 0x7f6e6007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:57.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.661+0000 7f6e717fa640 1 -- 172.21.15.170:0/2050461374 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6e5c0bd3b0 con 0x7f6e74107930 2024-09-04T16:51:57.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.661+0000 7f6e737fe640 1 --2- 172.21.15.170:0/2050461374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6e60079e30 0x7f6e6007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:57.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.662+0000 7f6e737fe640 1 --2- 172.21.15.170:0/2050461374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6e60079e30 0x7f6e6007c2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6e64005fd0 tx=0x7f6e6400b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:57.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.666+0000 7f6e717fa640 1 -- 172.21.15.170:0/2050461374 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6e5c088f30 con 0x7f6e74107930 2024-09-04T16:51:57.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.856+0000 7f6e79e3b640 1 -- 172.21.15.170:0/2050461374 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6e74062630 con 0x7f6e60079e30 2024-09-04T16:51:57.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.866+0000 7f6e717fa640 1 -- 172.21.15.170:0/2050461374 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f6e74062630 con 0x7f6e60079e30 2024-09-04T16:51:57.867 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:51:57.867 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (18m) 13m ago 29m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:51:57.867 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (22m) 13m ago 29m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:51:57.867 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (21m) 12m ago 29m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:51:57.867 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (17m) 13m ago 29m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:51:57.867 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (17m) 12m ago 29m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:51:57.867 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (18m) 13m ago 29m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:51:57.867 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (13m) 13m ago 24m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:51:57.867 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (13m) 13m ago 24m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:51:57.868 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (12m) 12m ago 24m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:51:57.868 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (13m) 12m ago 24m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:51:57.868 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (21m) 13m ago 31m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:51:57.868 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (20m) 12m ago 28m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:51:57.868 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (17m) 13m ago 31m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:51:57.868 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (17m) 12m ago 28m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:51:57.868 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (19m) 13m ago 29m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:51:57.868 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (19m) 12m ago 28m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:51:57.868 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (16m) 13m ago 27m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:51:57.868 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (16m) 13m ago 27m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:51:57.868 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (15m) 13m ago 26m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:51:57.868 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (14m) 12m ago 26m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:51:57.868 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (14m) 12m ago 25m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:51:57.869 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (13m) 12m ago 25m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:51:57.869 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (19m) 13m ago 29m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:51:57.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.868+0000 7f6e79e3b640 1 -- 172.21.15.170:0/2050461374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6e60079e30 msgr2=0x7f6e6007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:57.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.868+0000 7f6e79e3b640 1 --2- 172.21.15.170:0/2050461374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6e60079e30 0x7f6e6007c2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6e64005fd0 tx=0x7f6e6400b390 comp rx=0 tx=0).stop 2024-09-04T16:51:57.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.868+0000 7f6e79e3b640 1 -- 172.21.15.170:0/2050461374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e74107930 msgr2=0x7f6e74074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:57.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.868+0000 7f6e79e3b640 1 --2- 172.21.15.170:0/2050461374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e74107930 0x7f6e74074a30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c031460 tx=0x7f6e5c0045e0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.868+0000 7f6e79e3b640 1 -- 172.21.15.170:0/2050461374 shutdown_connections 2024-09-04T16:51:57.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.868+0000 7f6e79e3b640 1 --2- 172.21.15.170:0/2050461374 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6e60079e30 0x7f6e6007c2f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.868+0000 7f6e79e3b640 1 --2- 172.21.15.170:0/2050461374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e74107930 0x7f6e74074a30 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.868+0000 7f6e79e3b640 1 --2- 172.21.15.170:0/2050461374 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e74101930 0x7f6e740744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.868+0000 7f6e79e3b640 1 -- 172.21.15.170:0/2050461374 >> 172.21.15.170:0/2050461374 conn(0x7f6e740fd630 msgr2=0x7f6e740fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:57.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.868+0000 7f6e79e3b640 1 -- 172.21.15.170:0/2050461374 shutdown_connections 2024-09-04T16:51:57.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.868+0000 7f6e79e3b640 1 -- 172.21.15.170:0/2050461374 wait complete. 2024-09-04T16:51:57.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.950+0000 7f40558fa640 1 -- 172.21.15.170:0/3549194860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4050107910 msgr2=0x7f4050107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:57.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.950+0000 7f40558fa640 1 --2- 172.21.15.170:0/3549194860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4050107910 0x7f4050107cf0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4044009880 tx=0x7f404402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.950+0000 7f40558fa640 1 -- 172.21.15.170:0/3549194860 shutdown_connections 2024-09-04T16:51:57.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.950+0000 7f40558fa640 1 --2- 172.21.15.170:0/3549194860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4050101910 0x7f4050101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.950+0000 7f40558fa640 1 --2- 172.21.15.170:0/3549194860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4050107910 0x7f4050107cf0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.950+0000 7f40558fa640 1 -- 172.21.15.170:0/3549194860 >> 172.21.15.170:0/3549194860 conn(0x7f40500fd5f0 msgr2=0x7f40500ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:57.951 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:57 smithi170 ceph-mon[113855]: pgmap v667: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:57.951 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:57 smithi170 ceph-mon[113855]: from='client.35034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:51:57.951 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:57 smithi170 ceph-mon[113855]: from='client.35038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:51:57.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.950+0000 7f40558fa640 1 -- 172.21.15.170:0/3549194860 shutdown_connections 2024-09-04T16:51:57.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.950+0000 7f40558fa640 1 -- 172.21.15.170:0/3549194860 wait complete. 2024-09-04T16:51:57.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.951+0000 7f40558fa640 1 Processor -- start 2024-09-04T16:51:57.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.951+0000 7f40558fa640 1 -- start start 2024-09-04T16:51:57.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.951+0000 7f40558fa640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4050101910 0x7f40500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:57.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.951+0000 7f40558fa640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4050107910 0x7f4050074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:57.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.951+0000 7f40558fa640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f405010ede0 con 0x7f4050101910 2024-09-04T16:51:57.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.951+0000 7f40558fa640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f405010ec60 con 0x7f4050107910 2024-09-04T16:51:57.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.951+0000 7f404effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4050101910 0x7f40500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:57.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.951+0000 7f404effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4050101910 0x7f40500744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48744/0 (socket says 172.21.15.170:48744) 2024-09-04T16:51:57.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.951+0000 7f404effd640 1 -- 172.21.15.170:0/3604365061 learned_addr learned my addr 172.21.15.170:0/3604365061 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:51:57.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.952+0000 7f404e7fc640 1 --2- 172.21.15.170:0/3604365061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4050107910 0x7f4050074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:57.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.952+0000 7f404effd640 1 -- 172.21.15.170:0/3604365061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4050107910 msgr2=0x7f4050074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:57.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.952+0000 7f404effd640 1 --2- 172.21.15.170:0/3604365061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4050107910 0x7f4050074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:57.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.952+0000 7f404effd640 1 -- 172.21.15.170:0/3604365061 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4050074f70 con 0x7f4050101910 2024-09-04T16:51:57.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.952+0000 7f404effd640 1 --2- 172.21.15.170:0/3604365061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4050101910 0x7f40500744f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4044031460 tx=0x7f40440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:57.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.952+0000 7f40548f8640 1 -- 172.21.15.170:0/3604365061 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f404403f070 con 0x7f4050101910 2024-09-04T16:51:57.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.952+0000 7f40548f8640 1 -- 172.21.15.170:0/3604365061 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4044004cf0 con 0x7f4050101910 2024-09-04T16:51:57.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.952+0000 7f40558fa640 1 -- 172.21.15.170:0/3604365061 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4050075200 con 0x7f4050101910 2024-09-04T16:51:57.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.952+0000 7f40548f8640 1 -- 172.21.15.170:0/3604365061 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4044035030 con 0x7f4050101910 2024-09-04T16:51:57.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.952+0000 7f40558fa640 1 -- 172.21.15.170:0/3604365061 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40501a3dd0 con 0x7f4050101910 2024-09-04T16:51:57.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.953+0000 7f40558fa640 1 -- 172.21.15.170:0/3604365061 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4050103050 con 0x7f4050101910 2024-09-04T16:51:57.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.954+0000 7f40548f8640 1 -- 172.21.15.170:0/3604365061 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f4044042070 con 0x7f4050101910 2024-09-04T16:51:57.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.955+0000 7f40548f8640 1 --2- 172.21.15.170:0/3604365061 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4038079e80 0x7f403807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:57.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.955+0000 7f404e7fc640 1 --2- 172.21.15.170:0/3604365061 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4038079e80 0x7f403807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:57.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.955+0000 7f40548f8640 1 -- 172.21.15.170:0/3604365061 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f40440bd4b0 con 0x7f4050101910 2024-09-04T16:51:57.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.955+0000 7f404e7fc640 1 --2- 172.21.15.170:0/3604365061 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4038079e80 0x7f403807c340 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4040005fd0 tx=0x7f4040005e20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:57.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:57.959+0000 7f40548f8640 1 -- 172.21.15.170:0/3604365061 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4044084f40 con 0x7f4050101910 2024-09-04T16:51:58.057 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:57 smithi193 ceph-mon[82547]: pgmap v667: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:51:58.058 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:57 smithi193 ceph-mon[82547]: from='client.35034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:51:58.058 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:57 smithi193 ceph-mon[82547]: from='client.35038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:51:58.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.203+0000 7f40558fa640 1 -- 172.21.15.170:0/3604365061 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4050109e80 con 0x7f4050101910 2024-09-04T16:51:58.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.204+0000 7f40548f8640 1 -- 172.21.15.170:0/3604365061 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f40440890b0 con 0x7f4050101910 2024-09-04T16:51:58.205 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:51:58.205 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:51:58.205 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:51:58.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:51:58.205 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:51:58.205 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:51:58.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:51:58.205 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:51:58.205 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:51:58.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:51:58.205 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:51:58.205 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:51:58.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:51:58.206 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:51:58.206 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:51:58.206 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:51:58.206 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:51:58.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.206+0000 7f40558fa640 1 -- 172.21.15.170:0/3604365061 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4038079e80 msgr2=0x7f403807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:58.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.206+0000 7f40558fa640 1 --2- 172.21.15.170:0/3604365061 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4038079e80 0x7f403807c340 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4040005fd0 tx=0x7f4040005e20 comp rx=0 tx=0).stop 2024-09-04T16:51:58.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.206+0000 7f40558fa640 1 -- 172.21.15.170:0/3604365061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4050101910 msgr2=0x7f40500744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:58.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.206+0000 7f40558fa640 1 --2- 172.21.15.170:0/3604365061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4050101910 0x7f40500744f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4044031460 tx=0x7f40440048f0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.206+0000 7f40558fa640 1 -- 172.21.15.170:0/3604365061 shutdown_connections 2024-09-04T16:51:58.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.206+0000 7f40558fa640 1 --2- 172.21.15.170:0/3604365061 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4038079e80 0x7f403807c340 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.206+0000 7f40558fa640 1 --2- 172.21.15.170:0/3604365061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4050107910 0x7f4050074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.206+0000 7f40558fa640 1 --2- 172.21.15.170:0/3604365061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4050101910 0x7f40500744f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.206+0000 7f40558fa640 1 -- 172.21.15.170:0/3604365061 >> 172.21.15.170:0/3604365061 conn(0x7f40500fd5f0 msgr2=0x7f40500fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:58.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.206+0000 7f40558fa640 1 -- 172.21.15.170:0/3604365061 shutdown_connections 2024-09-04T16:51:58.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.206+0000 7f40558fa640 1 -- 172.21.15.170:0/3604365061 wait complete. 2024-09-04T16:51:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.288+0000 7fd9c234e640 1 -- 172.21.15.170:0/2034753970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9bc100820 msgr2=0x7fd9bc100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.288+0000 7fd9c234e640 1 --2- 172.21.15.170:0/2034753970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9bc100820 0x7fd9bc100c80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009880 tx=0x7fd9b002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.288+0000 7fd9c234e640 1 -- 172.21.15.170:0/2034753970 shutdown_connections 2024-09-04T16:51:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.288+0000 7fd9c234e640 1 --2- 172.21.15.170:0/2034753970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9bc100820 0x7fd9bc100c80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.288+0000 7fd9c234e640 1 --2- 172.21.15.170:0/2034753970 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9bc106820 0x7fd9bc106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.288+0000 7fd9c234e640 1 -- 172.21.15.170:0/2034753970 >> 172.21.15.170:0/2034753970 conn(0x7fd9bc0fc520 msgr2=0x7fd9bc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.288+0000 7fd9c234e640 1 -- 172.21.15.170:0/2034753970 shutdown_connections 2024-09-04T16:51:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.288+0000 7fd9c234e640 1 -- 172.21.15.170:0/2034753970 wait complete. 2024-09-04T16:51:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.289+0000 7fd9c234e640 1 Processor -- start 2024-09-04T16:51:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.289+0000 7fd9c234e640 1 -- start start 2024-09-04T16:51:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.289+0000 7fd9c234e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9bc100820 0x7fd9bc1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.289+0000 7fd9c234e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9bc106820 0x7fd9bc198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.289+0000 7fd9c234e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd9bc10dcd0 con 0x7fd9bc106820 2024-09-04T16:51:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.289+0000 7fd9c234e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd9bc10db50 con 0x7fd9bc100820 2024-09-04T16:51:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.289+0000 7fd9bb7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9bc106820 0x7fd9bc198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.289+0000 7fd9bb7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9bc106820 0x7fd9bc198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48760/0 (socket says 172.21.15.170:48760) 2024-09-04T16:51:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.289+0000 7fd9bb7fe640 1 -- 172.21.15.170:0/1766642476 learned_addr learned my addr 172.21.15.170:0/1766642476 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:51:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.289+0000 7fd9bbfff640 1 --2- 172.21.15.170:0/1766642476 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9bc100820 0x7fd9bc1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.290+0000 7fd9bb7fe640 1 -- 172.21.15.170:0/1766642476 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9bc100820 msgr2=0x7fd9bc1987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.290+0000 7fd9bb7fe640 1 --2- 172.21.15.170:0/1766642476 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9bc100820 0x7fd9bc1987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.290+0000 7fd9bb7fe640 1 -- 172.21.15.170:0/1766642476 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9bc199330 con 0x7fd9bc106820 2024-09-04T16:51:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.290+0000 7fd9bb7fe640 1 --2- 172.21.15.170:0/1766642476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9bc106820 0x7fd9bc198d30 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0031460 tx=0x7fd9b00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.290+0000 7fd9b97fa640 1 -- 172.21.15.170:0/1766642476 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd9b003f070 con 0x7fd9bc106820 2024-09-04T16:51:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.290+0000 7fd9b97fa640 1 -- 172.21.15.170:0/1766642476 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd9b00035f0 con 0x7fd9bc106820 2024-09-04T16:51:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.290+0000 7fd9c234e640 1 -- 172.21.15.170:0/1766642476 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9bc1995c0 con 0x7fd9bc106820 2024-09-04T16:51:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.290+0000 7fd9b97fa640 1 -- 172.21.15.170:0/1766642476 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd9b0035030 con 0x7fd9bc106820 2024-09-04T16:51:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.290+0000 7fd9c234e640 1 -- 172.21.15.170:0/1766642476 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9bc1a1b70 con 0x7fd9bc106820 2024-09-04T16:51:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.291+0000 7fd9c234e640 1 -- 172.21.15.170:0/1766642476 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9bc101f60 con 0x7fd9bc106820 2024-09-04T16:51:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.292+0000 7fd9b97fa640 1 -- 172.21.15.170:0/1766642476 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fd9b0042070 con 0x7fd9bc106820 2024-09-04T16:51:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.292+0000 7fd9b97fa640 1 --2- 172.21.15.170:0/1766642476 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd9a4079e80 0x7fd9a407c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.292+0000 7fd9b97fa640 1 -- 172.21.15.170:0/1766642476 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd9b00bd300 con 0x7fd9bc106820 2024-09-04T16:51:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.292+0000 7fd9bbfff640 1 --2- 172.21.15.170:0/1766642476 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd9a4079e80 0x7fd9a407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:58.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.293+0000 7fd9bbfff640 1 --2- 172.21.15.170:0/1766642476 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd9a4079e80 0x7fd9a407c340 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00bbe0 tx=0x7fd9ac00b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:58.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.297+0000 7fd9b97fa640 1 -- 172.21.15.170:0/1766642476 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd9b0088f00 con 0x7fd9bc106820 2024-09-04T16:51:58.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.504+0000 7fd9c234e640 1 -- 172.21.15.170:0/1766642476 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd9bc108db0 con 0x7fd9bc106820 2024-09-04T16:51:58.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.505+0000 7fd9b97fa640 1 -- 172.21.15.170:0/1766642476 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7fd9b008d920 con 0x7fd9bc106820 2024-09-04T16:51:58.506 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:51:58.506 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:51:58.506 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:51:58.506 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:51:58.506 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:51:58.506 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:51:58.506 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:51:58.506 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:51:58.507 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:51:58.507 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:51:58.507 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:51:58.507 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:51:58.507 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:51:58.507 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:51:58.507 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:51:58.507 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:51:58.507 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:51:58.507 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:51:58.507 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:51:58.507 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:51:58.507 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:51:58.508 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:51:58.508 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:51:58.508 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:51:58.508 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:51:58.508 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:51:58.508 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:51:58.508 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:51:58.508 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:51:58.508 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:51:58.508 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:51:58.508 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:51:58.508 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:51:58.508 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:51:58.509 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:51:58.509 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:51:58.509 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:51:58.509 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:51:58.509 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:51:58.509 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:51:58.509 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:51:58.509 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:51:58.509 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:51:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:51:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.507+0000 7fd9c234e640 1 -- 172.21.15.170:0/1766642476 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd9a4079e80 msgr2=0x7fd9a407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.507+0000 7fd9c234e640 1 --2- 172.21.15.170:0/1766642476 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd9a4079e80 0x7fd9a407c340 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00bbe0 tx=0x7fd9ac00b390 comp rx=0 tx=0).stop 2024-09-04T16:51:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.507+0000 7fd9c234e640 1 -- 172.21.15.170:0/1766642476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9bc106820 msgr2=0x7fd9bc198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.508+0000 7fd9c234e640 1 --2- 172.21.15.170:0/1766642476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9bc106820 0x7fd9bc198d30 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0031460 tx=0x7fd9b00045e0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.508+0000 7fd9c234e640 1 -- 172.21.15.170:0/1766642476 shutdown_connections 2024-09-04T16:51:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.508+0000 7fd9c234e640 1 --2- 172.21.15.170:0/1766642476 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd9a4079e80 0x7fd9a407c340 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.508+0000 7fd9c234e640 1 --2- 172.21.15.170:0/1766642476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9bc106820 0x7fd9bc198d30 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.508+0000 7fd9c234e640 1 --2- 172.21.15.170:0/1766642476 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9bc100820 0x7fd9bc1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.508+0000 7fd9c234e640 1 -- 172.21.15.170:0/1766642476 >> 172.21.15.170:0/1766642476 conn(0x7fd9bc0fc520 msgr2=0x7fd9bc0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.508+0000 7fd9c234e640 1 -- 172.21.15.170:0/1766642476 shutdown_connections 2024-09-04T16:51:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.508+0000 7fd9c234e640 1 -- 172.21.15.170:0/1766642476 wait complete. 2024-09-04T16:51:58.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.591+0000 7f398719a640 1 -- 172.21.15.170:0/4189542717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3980102b40 msgr2=0x7f3980102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:58.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.591+0000 7f398719a640 1 --2- 172.21.15.170:0/4189542717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3980102b40 0x7f3980102f20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f39740098b0 tx=0x7f397402a560 comp rx=0 tx=0).stop 2024-09-04T16:51:58.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.591+0000 7f398719a640 1 -- 172.21.15.170:0/4189542717 shutdown_connections 2024-09-04T16:51:58.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.591+0000 7f398719a640 1 --2- 172.21.15.170:0/4189542717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3980103460 0x7f398010b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.591+0000 7f398719a640 1 --2- 172.21.15.170:0/4189542717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3980102b40 0x7f3980102f20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.591+0000 7f398719a640 1 -- 172.21.15.170:0/4189542717 >> 172.21.15.170:0/4189542717 conn(0x7f39800fc520 msgr2=0x7f39800fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:58.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.591+0000 7f398719a640 1 -- 172.21.15.170:0/4189542717 shutdown_connections 2024-09-04T16:51:58.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.591+0000 7f398719a640 1 -- 172.21.15.170:0/4189542717 wait complete. 2024-09-04T16:51:58.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.591+0000 7f398719a640 1 Processor -- start 2024-09-04T16:51:58.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.591+0000 7f398719a640 1 -- start start 2024-09-04T16:51:58.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.592+0000 7f398719a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3980102b40 0x7f398019d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:58.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.592+0000 7f398719a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3980103460 0x7f398019dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:58.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.592+0000 7f398719a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f398010ee70 con 0x7f3980102b40 2024-09-04T16:51:58.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.592+0000 7f398719a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f398010ecf0 con 0x7f3980103460 2024-09-04T16:51:58.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.592+0000 7f3984f36640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3980102b40 0x7f398019d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:58.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.592+0000 7f3984f36640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3980102b40 0x7f398019d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48782/0 (socket says 172.21.15.170:48782) 2024-09-04T16:51:58.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.592+0000 7f3984f36640 1 -- 172.21.15.170:0/942648173 learned_addr learned my addr 172.21.15.170:0/942648173 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:51:58.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.592+0000 7f397ffff640 1 --2- 172.21.15.170:0/942648173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3980103460 0x7f398019dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:58.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.592+0000 7f3984f36640 1 -- 172.21.15.170:0/942648173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3980103460 msgr2=0x7f398019dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:58.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.592+0000 7f3984f36640 1 --2- 172.21.15.170:0/942648173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3980103460 0x7f398019dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.592+0000 7f3984f36640 1 -- 172.21.15.170:0/942648173 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3980197900 con 0x7f3980102b40 2024-09-04T16:51:58.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.592+0000 7f3984f36640 1 --2- 172.21.15.170:0/942648173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3980102b40 0x7f398019d740 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3974031460 tx=0x7f39740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:58.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.592+0000 7f397dffb640 1 -- 172.21.15.170:0/942648173 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f397403f070 con 0x7f3980102b40 2024-09-04T16:51:58.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.592+0000 7f397dffb640 1 -- 172.21.15.170:0/942648173 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39740044d0 con 0x7f3980102b40 2024-09-04T16:51:58.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.592+0000 7f398719a640 1 -- 172.21.15.170:0/942648173 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3980197b90 con 0x7f3980102b40 2024-09-04T16:51:58.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.592+0000 7f397dffb640 1 -- 172.21.15.170:0/942648173 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3974035030 con 0x7f3980102b40 2024-09-04T16:51:58.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.593+0000 7f398719a640 1 -- 172.21.15.170:0/942648173 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39801980c0 con 0x7f3980102b40 2024-09-04T16:51:58.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.593+0000 7f398719a640 1 -- 172.21.15.170:0/942648173 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f398006ab80 con 0x7f3980102b40 2024-09-04T16:51:58.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.594+0000 7f397dffb640 1 -- 172.21.15.170:0/942648173 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f3974042070 con 0x7f3980102b40 2024-09-04T16:51:58.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.594+0000 7f397dffb640 1 --2- 172.21.15.170:0/942648173 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3970079e30 0x7f397007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:58.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.595+0000 7f397dffb640 1 -- 172.21.15.170:0/942648173 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f39740bd580 con 0x7f3980102b40 2024-09-04T16:51:58.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.595+0000 7f397ffff640 1 --2- 172.21.15.170:0/942648173 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3970079e30 0x7f397007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:58.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.595+0000 7f397ffff640 1 --2- 172.21.15.170:0/942648173 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3970079e30 0x7f397007c2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f39801089a0 tx=0x7f396c008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:58.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.599+0000 7f397dffb640 1 -- 172.21.15.170:0/942648173 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3974004cf0 con 0x7f3980102b40 2024-09-04T16:51:58.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.790+0000 7f398719a640 1 -- 172.21.15.170:0/942648173 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3980198e30 con 0x7f3970079e30 2024-09-04T16:51:58.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.792+0000 7f397dffb640 1 -- 172.21.15.170:0/942648173 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3980198e30 con 0x7f3970079e30 2024-09-04T16:51:58.792 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:51:58.792 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:51:58.792 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:51:58.793 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:51:58.793 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:51:58.793 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:51:58.793 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:51:58.793 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:51:58.793 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:51:58.793 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:51:58.793 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:51:58.793 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:51:58.793 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:51:58.793 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:51:58.793 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:51:58.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.794+0000 7f398719a640 1 -- 172.21.15.170:0/942648173 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3970079e30 msgr2=0x7f397007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:58.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.794+0000 7f398719a640 1 --2- 172.21.15.170:0/942648173 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3970079e30 0x7f397007c2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f39801089a0 tx=0x7f396c008040 comp rx=0 tx=0).stop 2024-09-04T16:51:58.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.794+0000 7f398719a640 1 -- 172.21.15.170:0/942648173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3980102b40 msgr2=0x7f398019d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:58.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.794+0000 7f398719a640 1 --2- 172.21.15.170:0/942648173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3980102b40 0x7f398019d740 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3974031460 tx=0x7f39740048f0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.794+0000 7f398719a640 1 -- 172.21.15.170:0/942648173 shutdown_connections 2024-09-04T16:51:58.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.794+0000 7f398719a640 1 --2- 172.21.15.170:0/942648173 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3970079e30 0x7f397007c2f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.794+0000 7f398719a640 1 --2- 172.21.15.170:0/942648173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3980103460 0x7f398019dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.794+0000 7f398719a640 1 --2- 172.21.15.170:0/942648173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3980102b40 0x7f398019d740 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.794+0000 7f398719a640 1 -- 172.21.15.170:0/942648173 >> 172.21.15.170:0/942648173 conn(0x7f39800fc520 msgr2=0x7f3980107e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:58.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.794+0000 7f398719a640 1 -- 172.21.15.170:0/942648173 shutdown_connections 2024-09-04T16:51:58.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.794+0000 7f398719a640 1 -- 172.21.15.170:0/942648173 wait complete. 2024-09-04T16:51:58.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.875+0000 7f34ea6d7640 1 -- 172.21.15.170:0/3888646448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34e41067e0 msgr2=0x7f34e4106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:58.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.875+0000 7f34ea6d7640 1 --2- 172.21.15.170:0/3888646448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34e41067e0 0x7f34e4106bc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009880 tx=0x7f34d402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.875+0000 7f34ea6d7640 1 -- 172.21.15.170:0/3888646448 shutdown_connections 2024-09-04T16:51:58.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.875+0000 7f34ea6d7640 1 --2- 172.21.15.170:0/3888646448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34e41007e0 0x7f34e4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.875+0000 7f34ea6d7640 1 --2- 172.21.15.170:0/3888646448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34e41067e0 0x7f34e4106bc0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.875+0000 7f34ea6d7640 1 -- 172.21.15.170:0/3888646448 >> 172.21.15.170:0/3888646448 conn(0x7f34e40fc4c0 msgr2=0x7f34e40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:58.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.875+0000 7f34ea6d7640 1 -- 172.21.15.170:0/3888646448 shutdown_connections 2024-09-04T16:51:58.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.875+0000 7f34ea6d7640 1 -- 172.21.15.170:0/3888646448 wait complete. 2024-09-04T16:51:58.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.876+0000 7f34ea6d7640 1 Processor -- start 2024-09-04T16:51:58.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.876+0000 7f34ea6d7640 1 -- start start 2024-09-04T16:51:58.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.876+0000 7f34ea6d7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34e41007e0 0x7f34e41987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:58.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.876+0000 7f34ea6d7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34e41067e0 0x7f34e4198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:58.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.876+0000 7f34ea6d7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f34e410dc90 con 0x7f34e41007e0 2024-09-04T16:51:58.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.876+0000 7f34ea6d7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f34e410db10 con 0x7f34e41067e0 2024-09-04T16:51:58.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.876+0000 7f34e3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34e41007e0 0x7f34e41987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:58.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.876+0000 7f34e3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34e41007e0 0x7f34e41987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48806/0 (socket says 172.21.15.170:48806) 2024-09-04T16:51:58.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.876+0000 7f34e3fff640 1 -- 172.21.15.170:0/2049503146 learned_addr learned my addr 172.21.15.170:0/2049503146 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:51:58.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.877+0000 7f34e37fe640 1 --2- 172.21.15.170:0/2049503146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34e41067e0 0x7f34e4198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:58.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.877+0000 7f34e3fff640 1 -- 172.21.15.170:0/2049503146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34e41067e0 msgr2=0x7f34e4198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:58.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.877+0000 7f34e3fff640 1 --2- 172.21.15.170:0/2049503146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34e41067e0 0x7f34e4198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:58.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.877+0000 7f34e3fff640 1 -- 172.21.15.170:0/2049503146 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e4199300 con 0x7f34e41007e0 2024-09-04T16:51:58.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.877+0000 7f34e3fff640 1 --2- 172.21.15.170:0/2049503146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34e41007e0 0x7f34e41987c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f34d4031460 tx=0x7f34d40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:58.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.877+0000 7f34e17fa640 1 -- 172.21.15.170:0/2049503146 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34d403f070 con 0x7f34e41007e0 2024-09-04T16:51:58.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.877+0000 7f34ea6d7640 1 -- 172.21.15.170:0/2049503146 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e4199590 con 0x7f34e41007e0 2024-09-04T16:51:58.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.877+0000 7f34e17fa640 1 -- 172.21.15.170:0/2049503146 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f34d40035f0 con 0x7f34e41007e0 2024-09-04T16:51:58.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.877+0000 7f34e17fa640 1 -- 172.21.15.170:0/2049503146 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34d4035030 con 0x7f34e41007e0 2024-09-04T16:51:58.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.877+0000 7f34ea6d7640 1 -- 172.21.15.170:0/2049503146 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e41a1b40 con 0x7f34e41007e0 2024-09-04T16:51:58.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.878+0000 7f34ea6d7640 1 -- 172.21.15.170:0/2049503146 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e4101f20 con 0x7f34e41007e0 2024-09-04T16:51:58.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.879+0000 7f34e17fa640 1 -- 172.21.15.170:0/2049503146 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f34d4042070 con 0x7f34e41007e0 2024-09-04T16:51:58.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.879+0000 7f34e17fa640 1 --2- 172.21.15.170:0/2049503146 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34cc079e30 0x7f34cc07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:51:58.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.880+0000 7f34e17fa640 1 -- 172.21.15.170:0/2049503146 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f34d40bd3b0 con 0x7f34e41007e0 2024-09-04T16:51:58.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.880+0000 7f34e37fe640 1 --2- 172.21.15.170:0/2049503146 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34cc079e30 0x7f34cc07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:51:58.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.880+0000 7f34e37fe640 1 --2- 172.21.15.170:0/2049503146 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34cc079e30 0x7f34cc07c2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f34e406a680 tx=0x7f34d800b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:51:58.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:58.884+0000 7f34e17fa640 1 -- 172.21.15.170:0/2049503146 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f34d4088f30 con 0x7f34e41007e0 2024-09-04T16:51:59.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:58 smithi170 ceph-mon[113855]: from='client.35042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:51:59.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:58 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3604365061' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:51:59.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:58 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1766642476' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:51:59.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:59.127+0000 7f34ea6d7640 1 -- 172.21.15.170:0/2049503146 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f34e41039f0 con 0x7f34e41007e0 2024-09-04T16:51:59.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:59.127+0000 7f34e17fa640 1 -- 172.21.15.170:0/2049503146 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f34d408d950 con 0x7f34e41007e0 2024-09-04T16:51:59.128 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:51:59.128 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:51:59.128 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:51:59.128 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:51:59.128 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:51:59.128 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:51:59.129 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:51:59.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:59.130+0000 7f34ea6d7640 1 -- 172.21.15.170:0/2049503146 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34cc079e30 msgr2=0x7f34cc07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:59.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:59.130+0000 7f34ea6d7640 1 --2- 172.21.15.170:0/2049503146 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34cc079e30 0x7f34cc07c2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f34e406a680 tx=0x7f34d800b390 comp rx=0 tx=0).stop 2024-09-04T16:51:59.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:59.130+0000 7f34ea6d7640 1 -- 172.21.15.170:0/2049503146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34e41007e0 msgr2=0x7f34e41987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:51:59.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:59.130+0000 7f34ea6d7640 1 --2- 172.21.15.170:0/2049503146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34e41007e0 0x7f34e41987c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f34d4031460 tx=0x7f34d40045e0 comp rx=0 tx=0).stop 2024-09-04T16:51:59.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:59.130+0000 7f34ea6d7640 1 -- 172.21.15.170:0/2049503146 shutdown_connections 2024-09-04T16:51:59.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:59.130+0000 7f34ea6d7640 1 --2- 172.21.15.170:0/2049503146 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34cc079e30 0x7f34cc07c2f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:59.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:59.130+0000 7f34ea6d7640 1 --2- 172.21.15.170:0/2049503146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34e41067e0 0x7f34e4198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:59.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:59.130+0000 7f34ea6d7640 1 --2- 172.21.15.170:0/2049503146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34e41007e0 0x7f34e41987c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:51:59.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:59.130+0000 7f34ea6d7640 1 -- 172.21.15.170:0/2049503146 >> 172.21.15.170:0/2049503146 conn(0x7f34e40fc4c0 msgr2=0x7f34e40fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:51:59.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:59.130+0000 7f34ea6d7640 1 -- 172.21.15.170:0/2049503146 shutdown_connections 2024-09-04T16:51:59.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:51:59.130+0000 7f34ea6d7640 1 -- 172.21.15.170:0/2049503146 wait complete. 2024-09-04T16:51:59.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:58 smithi193 ceph-mon[82547]: from='client.35042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:51:59.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:58 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3604365061' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:51:59.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:58 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1766642476' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:52:00.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:59 smithi170 ceph-mon[113855]: pgmap v668: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:00.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:59 smithi170 ceph-mon[113855]: from='client.35054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:52:00.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:59 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2049503146' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:52:00.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:51:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:52:00.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:59 smithi193 ceph-mon[82547]: pgmap v668: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:00.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:59 smithi193 ceph-mon[82547]: from='client.35054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:52:00.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:59 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2049503146' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:52:00.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:51:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:52:02.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:01 smithi170 ceph-mon[113855]: pgmap v669: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:02.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:01 smithi193 ceph-mon[82547]: pgmap v669: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:04.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:03 smithi170 ceph-mon[113855]: pgmap v670: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:04.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:03 smithi193 ceph-mon[82547]: pgmap v670: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:06.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:05 smithi170 ceph-mon[113855]: pgmap v671: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:06.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:05 smithi193 ceph-mon[82547]: pgmap v671: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:08.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:07 smithi170 ceph-mon[113855]: pgmap v672: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:08.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:07 smithi193 ceph-mon[82547]: pgmap v672: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:10.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:09 smithi170 ceph-mon[113855]: pgmap v673: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:10.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:09 smithi193 ceph-mon[82547]: pgmap v673: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:12.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:11 smithi170 ceph-mon[113855]: pgmap v674: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:12.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:11 smithi193 ceph-mon[82547]: pgmap v674: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:14.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:13 smithi170 ceph-mon[113855]: pgmap v675: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:14.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:13 smithi193 ceph-mon[82547]: pgmap v675: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:15.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:52:15.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:52:16.037 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:15 smithi170 ceph-mon[113855]: pgmap v676: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:16.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:15 smithi193 ceph-mon[82547]: pgmap v676: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:18.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:17 smithi170 ceph-mon[113855]: pgmap v677: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:18.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:17 smithi193 ceph-mon[82547]: pgmap v677: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:20.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:19 smithi170 ceph-mon[113855]: pgmap v678: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:20.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:19 smithi193 ceph-mon[82547]: pgmap v678: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:22.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:21 smithi170 ceph-mon[113855]: pgmap v679: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:22.121 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:21 smithi193 ceph-mon[82547]: pgmap v679: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:24.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:23 smithi170 ceph-mon[113855]: pgmap v680: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:24.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:23 smithi193 ceph-mon[82547]: pgmap v680: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:26.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:25 smithi170 ceph-mon[113855]: pgmap v681: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:26.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:25 smithi193 ceph-mon[82547]: pgmap v681: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:28.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:27 smithi170 ceph-mon[113855]: pgmap v682: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:28.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:27 smithi193 ceph-mon[82547]: pgmap v682: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:29.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.234+0000 7f19bf7e0640 1 -- 172.21.15.170:0/321323134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b8100a80 msgr2=0x7f19b81065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:29.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.234+0000 7f19bf7e0640 1 --2- 172.21.15.170:0/321323134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b8100a80 0x7f19b81065c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009880 tx=0x7f19ac02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.234+0000 7f19bf7e0640 1 -- 172.21.15.170:0/321323134 shutdown_connections 2024-09-04T16:52:29.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.234+0000 7f19bf7e0640 1 --2- 172.21.15.170:0/321323134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b8100a80 0x7f19b81065c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.234+0000 7f19bf7e0640 1 --2- 172.21.15.170:0/321323134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19b81000d0 0x7f19b81004b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.234+0000 7f19bf7e0640 1 -- 172.21.15.170:0/321323134 >> 172.21.15.170:0/321323134 conn(0x7f19b80fbc60 msgr2=0x7f19b80fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:52:29.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.234+0000 7f19bf7e0640 1 -- 172.21.15.170:0/321323134 shutdown_connections 2024-09-04T16:52:29.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.234+0000 7f19bf7e0640 1 -- 172.21.15.170:0/321323134 wait complete. 2024-09-04T16:52:29.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.234+0000 7f19bf7e0640 1 Processor -- start 2024-09-04T16:52:29.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.235+0000 7f19bf7e0640 1 -- start start 2024-09-04T16:52:29.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.235+0000 7f19bf7e0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19b81000d0 0x7f19b819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:29.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.235+0000 7f19bf7e0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b8100a80 0x7f19b819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:29.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.235+0000 7f19bf7e0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f19b810ee10 con 0x7f19b8100a80 2024-09-04T16:52:29.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.235+0000 7f19bf7e0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f19b810ec90 con 0x7f19b81000d0 2024-09-04T16:52:29.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.235+0000 7f19bcd7b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b8100a80 0x7f19b819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:29.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.235+0000 7f19bcd7b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b8100a80 0x7f19b819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51890/0 (socket says 172.21.15.170:51890) 2024-09-04T16:52:29.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.235+0000 7f19bcd7b640 1 -- 172.21.15.170:0/1896505715 learned_addr learned my addr 172.21.15.170:0/1896505715 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:52:29.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.235+0000 7f19bd57c640 1 --2- 172.21.15.170:0/1896505715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19b81000d0 0x7f19b819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:29.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.235+0000 7f19bcd7b640 1 -- 172.21.15.170:0/1896505715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19b81000d0 msgr2=0x7f19b819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:29.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.235+0000 7f19bcd7b640 1 --2- 172.21.15.170:0/1896505715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19b81000d0 0x7f19b819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.235+0000 7f19bcd7b640 1 -- 172.21.15.170:0/1896505715 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b8197820 con 0x7f19b8100a80 2024-09-04T16:52:29.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.235+0000 7f19bcd7b640 1 --2- 172.21.15.170:0/1896505715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b8100a80 0x7f19b819dbe0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f19ac031460 tx=0x7f19ac0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:52:29.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.236+0000 7f19b67fc640 1 -- 172.21.15.170:0/1896505715 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19ac03f070 con 0x7f19b8100a80 2024-09-04T16:52:29.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.236+0000 7f19bf7e0640 1 -- 172.21.15.170:0/1896505715 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b8197ab0 con 0x7f19b8100a80 2024-09-04T16:52:29.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.236+0000 7f19b67fc640 1 -- 172.21.15.170:0/1896505715 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f19ac0035f0 con 0x7f19b8100a80 2024-09-04T16:52:29.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.236+0000 7f19bf7e0640 1 -- 172.21.15.170:0/1896505715 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b8197fe0 con 0x7f19b8100a80 2024-09-04T16:52:29.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.236+0000 7f19b67fc640 1 -- 172.21.15.170:0/1896505715 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19ac035030 con 0x7f19b8100a80 2024-09-04T16:52:29.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.237+0000 7f19bf7e0640 1 -- 172.21.15.170:0/1896505715 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19b8103190 con 0x7f19b8100a80 2024-09-04T16:52:29.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.237+0000 7f19b67fc640 1 -- 172.21.15.170:0/1896505715 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f19ac042070 con 0x7f19b8100a80 2024-09-04T16:52:29.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.238+0000 7f19b67fc640 1 --2- 172.21.15.170:0/1896505715 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f19a0079e80 0x7f19a007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:29.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.238+0000 7f19b67fc640 1 -- 172.21.15.170:0/1896505715 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f19ac0bd320 con 0x7f19b8100a80 2024-09-04T16:52:29.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.238+0000 7f19bd57c640 1 --2- 172.21.15.170:0/1896505715 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f19a0079e80 0x7f19a007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:29.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.238+0000 7f19bd57c640 1 --2- 172.21.15.170:0/1896505715 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f19a0079e80 0x7f19a007c340 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f19a8005c40 tx=0x7f19a8005bd0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:52:29.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.242+0000 7f19b67fc640 1 -- 172.21.15.170:0/1896505715 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f19ac084db0 con 0x7f19b8100a80 2024-09-04T16:52:29.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.434+0000 7f19bf7e0640 1 -- 172.21.15.170:0/1896505715 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f19b8198290 con 0x7f19a0079e80 2024-09-04T16:52:29.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.435+0000 7f19b67fc640 1 -- 172.21.15.170:0/1896505715 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f19b8198290 con 0x7f19a0079e80 2024-09-04T16:52:29.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.437+0000 7f19bf7e0640 1 -- 172.21.15.170:0/1896505715 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f19a0079e80 msgr2=0x7f19a007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:29.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.437+0000 7f19bf7e0640 1 --2- 172.21.15.170:0/1896505715 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f19a0079e80 0x7f19a007c340 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f19a8005c40 tx=0x7f19a8005bd0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.437+0000 7f19bf7e0640 1 -- 172.21.15.170:0/1896505715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b8100a80 msgr2=0x7f19b819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:29.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.437+0000 7f19bf7e0640 1 --2- 172.21.15.170:0/1896505715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b8100a80 0x7f19b819dbe0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f19ac031460 tx=0x7f19ac0045e0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.437+0000 7f19bf7e0640 1 -- 172.21.15.170:0/1896505715 shutdown_connections 2024-09-04T16:52:29.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.437+0000 7f19bf7e0640 1 --2- 172.21.15.170:0/1896505715 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f19a0079e80 0x7f19a007c340 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.437+0000 7f19bf7e0640 1 --2- 172.21.15.170:0/1896505715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19b8100a80 0x7f19b819dbe0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.437+0000 7f19bf7e0640 1 --2- 172.21.15.170:0/1896505715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19b81000d0 0x7f19b819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.437+0000 7f19bf7e0640 1 -- 172.21.15.170:0/1896505715 >> 172.21.15.170:0/1896505715 conn(0x7f19b80fbc60 msgr2=0x7f19b80fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:52:29.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.437+0000 7f19bf7e0640 1 -- 172.21.15.170:0/1896505715 shutdown_connections 2024-09-04T16:52:29.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.437+0000 7f19bf7e0640 1 -- 172.21.15.170:0/1896505715 wait complete. 2024-09-04T16:52:29.447 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:52:29.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.520+0000 7f5c0c62e640 1 -- 172.21.15.170:0/3310794161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c041033c0 msgr2=0x7f5c0410b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:29.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.520+0000 7f5c0c62e640 1 --2- 172.21.15.170:0/3310794161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c041033c0 0x7f5c0410b8b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009880 tx=0x7f5bf802a530 comp rx=0 tx=0).stop 2024-09-04T16:52:29.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.520+0000 7f5c0c62e640 1 -- 172.21.15.170:0/3310794161 shutdown_connections 2024-09-04T16:52:29.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.520+0000 7f5c0c62e640 1 --2- 172.21.15.170:0/3310794161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c041033c0 0x7f5c0410b8b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.520+0000 7f5c0c62e640 1 --2- 172.21.15.170:0/3310794161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c04102aa0 0x7f5c04102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.520+0000 7f5c0c62e640 1 -- 172.21.15.170:0/3310794161 >> 172.21.15.170:0/3310794161 conn(0x7f5c040fc4c0 msgr2=0x7f5c040fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:52:29.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.520+0000 7f5c0c62e640 1 -- 172.21.15.170:0/3310794161 shutdown_connections 2024-09-04T16:52:29.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.520+0000 7f5c0c62e640 1 -- 172.21.15.170:0/3310794161 wait complete. 2024-09-04T16:52:29.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.520+0000 7f5c0c62e640 1 Processor -- start 2024-09-04T16:52:29.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.520+0000 7f5c0c62e640 1 -- start start 2024-09-04T16:52:29.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.521+0000 7f5c0c62e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c04102aa0 0x7f5c04100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:29.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.521+0000 7f5c0c62e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c041033c0 0x7f5c04100c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:29.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.521+0000 7f5c0c62e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0410edb0 con 0x7f5c04102aa0 2024-09-04T16:52:29.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.521+0000 7f5c0c62e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0410ec30 con 0x7f5c041033c0 2024-09-04T16:52:29.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.521+0000 7f5c0a3ca640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c04102aa0 0x7f5c04100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:29.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.521+0000 7f5c0a3ca640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c04102aa0 0x7f5c04100700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51920/0 (socket says 172.21.15.170:51920) 2024-09-04T16:52:29.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.521+0000 7f5c0a3ca640 1 -- 172.21.15.170:0/403268421 learned_addr learned my addr 172.21.15.170:0/403268421 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:52:29.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.521+0000 7f5c09bc9640 1 --2- 172.21.15.170:0/403268421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c041033c0 0x7f5c04100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:29.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.521+0000 7f5c0a3ca640 1 -- 172.21.15.170:0/403268421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c041033c0 msgr2=0x7f5c04100c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:29.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.521+0000 7f5c0a3ca640 1 --2- 172.21.15.170:0/403268421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c041033c0 0x7f5c04100c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.521+0000 7f5c0a3ca640 1 -- 172.21.15.170:0/403268421 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c04101180 con 0x7f5c04102aa0 2024-09-04T16:52:29.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.521+0000 7f5c0a3ca640 1 --2- 172.21.15.170:0/403268421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c04102aa0 0x7f5c04100700 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400db80 tx=0x7f5bf400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:52:29.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.521+0000 7f5c037fe640 1 -- 172.21.15.170:0/403268421 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5bf4017070 con 0x7f5c04102aa0 2024-09-04T16:52:29.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.522+0000 7f5c037fe640 1 -- 172.21.15.170:0/403268421 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5bf4003e30 con 0x7f5c04102aa0 2024-09-04T16:52:29.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.522+0000 7f5c037fe640 1 -- 172.21.15.170:0/403268421 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5bf4010460 con 0x7f5c04102aa0 2024-09-04T16:52:29.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.522+0000 7f5c0c62e640 1 -- 172.21.15.170:0/403268421 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c04101470 con 0x7f5c04102aa0 2024-09-04T16:52:29.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.522+0000 7f5c0c62e640 1 -- 172.21.15.170:0/403268421 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c041a3ea0 con 0x7f5c04102aa0 2024-09-04T16:52:29.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.523+0000 7f5c0c62e640 1 -- 172.21.15.170:0/403268421 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c0406a410 con 0x7f5c04102aa0 2024-09-04T16:52:29.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.523+0000 7f5c037fe640 1 -- 172.21.15.170:0/403268421 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5bf400dc70 con 0x7f5c04102aa0 2024-09-04T16:52:29.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.524+0000 7f5c037fe640 1 --2- 172.21.15.170:0/403268421 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5bec079e30 0x7f5bec07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:29.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.524+0000 7f5c037fe640 1 -- 172.21.15.170:0/403268421 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5bf409cf50 con 0x7f5c04102aa0 2024-09-04T16:52:29.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.524+0000 7f5c09bc9640 1 --2- 172.21.15.170:0/403268421 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5bec079e30 0x7f5bec07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:29.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.524+0000 7f5c09bc9640 1 --2- 172.21.15.170:0/403268421 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5bec079e30 0x7f5bec07c2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5c04102190 tx=0x7f5bf8031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:52:29.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.528+0000 7f5c037fe640 1 -- 172.21.15.170:0/403268421 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5bf4064960 con 0x7f5c04102aa0 2024-09-04T16:52:29.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.717+0000 7f5c0c62e640 1 -- 172.21.15.170:0/403268421 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5c04062630 con 0x7f5bec079e30 2024-09-04T16:52:29.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.718+0000 7f5c037fe640 1 -- 172.21.15.170:0/403268421 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5c04062630 con 0x7f5bec079e30 2024-09-04T16:52:29.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.720+0000 7f5c0c62e640 1 -- 172.21.15.170:0/403268421 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5bec079e30 msgr2=0x7f5bec07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:29.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.720+0000 7f5c0c62e640 1 --2- 172.21.15.170:0/403268421 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5bec079e30 0x7f5bec07c2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5c04102190 tx=0x7f5bf8031400 comp rx=0 tx=0).stop 2024-09-04T16:52:29.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.720+0000 7f5c0c62e640 1 -- 172.21.15.170:0/403268421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c04102aa0 msgr2=0x7f5c04100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:29.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.720+0000 7f5c0c62e640 1 --2- 172.21.15.170:0/403268421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c04102aa0 0x7f5c04100700 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400db80 tx=0x7f5bf400b630 comp rx=0 tx=0).stop 2024-09-04T16:52:29.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.720+0000 7f5c0c62e640 1 -- 172.21.15.170:0/403268421 shutdown_connections 2024-09-04T16:52:29.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.720+0000 7f5c0c62e640 1 --2- 172.21.15.170:0/403268421 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5bec079e30 0x7f5bec07c2f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.720+0000 7f5c0c62e640 1 --2- 172.21.15.170:0/403268421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c041033c0 0x7f5c04100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.720+0000 7f5c0c62e640 1 --2- 172.21.15.170:0/403268421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c04102aa0 0x7f5c04100700 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.720+0000 7f5c0c62e640 1 -- 172.21.15.170:0/403268421 >> 172.21.15.170:0/403268421 conn(0x7f5c040fc4c0 msgr2=0x7f5c04108e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:52:29.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.721+0000 7f5c0c62e640 1 -- 172.21.15.170:0/403268421 shutdown_connections 2024-09-04T16:52:29.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.721+0000 7f5c0c62e640 1 -- 172.21.15.170:0/403268421 wait complete. 2024-09-04T16:52:29.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.801+0000 7f64e6218640 1 -- 172.21.15.170:0/3156920054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64e0106810 msgr2=0x7f64e0106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:29.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.801+0000 7f64e6218640 1 --2- 172.21.15.170:0/3156920054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64e0106810 0x7f64e0106bf0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f64d0009c20 tx=0x7f64d002a970 comp rx=0 tx=0).stop 2024-09-04T16:52:29.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.801+0000 7f64e6218640 1 -- 172.21.15.170:0/3156920054 shutdown_connections 2024-09-04T16:52:29.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.802+0000 7f64e6218640 1 --2- 172.21.15.170:0/3156920054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64e0100810 0x7f64e0100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.802+0000 7f64e6218640 1 --2- 172.21.15.170:0/3156920054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64e0106810 0x7f64e0106bf0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.802+0000 7f64e6218640 1 -- 172.21.15.170:0/3156920054 >> 172.21.15.170:0/3156920054 conn(0x7f64e00fc510 msgr2=0x7f64e00fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:52:29.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.802+0000 7f64e6218640 1 -- 172.21.15.170:0/3156920054 shutdown_connections 2024-09-04T16:52:29.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.802+0000 7f64e6218640 1 -- 172.21.15.170:0/3156920054 wait complete. 2024-09-04T16:52:29.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.802+0000 7f64e6218640 1 Processor -- start 2024-09-04T16:52:29.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.803+0000 7f64e6218640 1 -- start start 2024-09-04T16:52:29.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.803+0000 7f64e6218640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64e0100810 0x7f64e019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:29.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.803+0000 7f64e6218640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64e0106810 0x7f64e019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:29.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.803+0000 7f64e6218640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f64e010dce0 con 0x7f64e0100810 2024-09-04T16:52:29.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.803+0000 7f64e6218640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f64e010db60 con 0x7f64e0106810 2024-09-04T16:52:29.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.803+0000 7f64df7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64e0100810 0x7f64e019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:29.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.803+0000 7f64df7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64e0100810 0x7f64e019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51946/0 (socket says 172.21.15.170:51946) 2024-09-04T16:52:29.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.803+0000 7f64df7fe640 1 -- 172.21.15.170:0/2748383348 learned_addr learned my addr 172.21.15.170:0/2748383348 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:52:29.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.803+0000 7f64deffd640 1 --2- 172.21.15.170:0/2748383348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64e0106810 0x7f64e019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:29.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.803+0000 7f64df7fe640 1 -- 172.21.15.170:0/2748383348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64e0106810 msgr2=0x7f64e019dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:29.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.803+0000 7f64df7fe640 1 --2- 172.21.15.170:0/2748383348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64e0106810 0x7f64e019dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:29.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.803+0000 7f64df7fe640 1 -- 172.21.15.170:0/2748383348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e0197860 con 0x7f64e0100810 2024-09-04T16:52:29.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.804+0000 7f64df7fe640 1 --2- 172.21.15.170:0/2748383348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64e0100810 0x7f64e019d6a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f64d002ae90 tx=0x7f64d002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:52:29.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.804+0000 7f64dcff9640 1 -- 172.21.15.170:0/2748383348 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64d0047070 con 0x7f64e0100810 2024-09-04T16:52:29.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.804+0000 7f64e6218640 1 -- 172.21.15.170:0/2748383348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e0197af0 con 0x7f64e0100810 2024-09-04T16:52:29.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.804+0000 7f64dcff9640 1 -- 172.21.15.170:0/2748383348 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64d002f7e0 con 0x7f64e0100810 2024-09-04T16:52:29.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.804+0000 7f64dcff9640 1 -- 172.21.15.170:0/2748383348 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64d0034070 con 0x7f64e0100810 2024-09-04T16:52:29.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.804+0000 7f64e6218640 1 -- 172.21.15.170:0/2748383348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e0198020 con 0x7f64e0100810 2024-09-04T16:52:29.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.805+0000 7f64e6218640 1 -- 172.21.15.170:0/2748383348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e0101f50 con 0x7f64e0100810 2024-09-04T16:52:29.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.806+0000 7f64dcff9640 1 -- 172.21.15.170:0/2748383348 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f64d004a070 con 0x7f64e0100810 2024-09-04T16:52:29.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.806+0000 7f64dcff9640 1 --2- 172.21.15.170:0/2748383348 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f64cc079e80 0x7f64cc07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:29.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.806+0000 7f64dcff9640 1 -- 172.21.15.170:0/2748383348 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f64d00bd7e0 con 0x7f64e0100810 2024-09-04T16:52:29.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.806+0000 7f64deffd640 1 --2- 172.21.15.170:0/2748383348 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f64cc079e80 0x7f64cc07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:29.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.807+0000 7f64deffd640 1 --2- 172.21.15.170:0/2748383348 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f64cc079e80 0x7f64cc07c340 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f64c8005fd0 tx=0x7f64c8005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:52:29.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.813+0000 7f64dcff9640 1 -- 172.21.15.170:0/2748383348 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f64d003f070 con 0x7f64e0100810 2024-09-04T16:52:29.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:29.995+0000 7f64e6218640 1 -- 172.21.15.170:0/2748383348 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f64e0198ea0 con 0x7f64cc079e80 2024-09-04T16:52:30.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.005+0000 7f64dcff9640 1 -- 172.21.15.170:0/2748383348 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f64e0198ea0 con 0x7f64cc079e80 2024-09-04T16:52:30.005 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:52:30.005 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (19m) 13m ago 30m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:52:30.006 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (22m) 13m ago 30m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:52:30.006 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (22m) 13m ago 29m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:52:30.006 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (17m) 13m ago 30m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:52:30.006 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (17m) 13m ago 29m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:52:30.006 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (19m) 13m ago 30m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:52:30.006 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (13m) 13m ago 24m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:52:30.006 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (14m) 13m ago 25m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:52:30.006 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (13m) 13m ago 24m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:52:30.006 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (13m) 13m ago 25m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:52:30.006 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (21m) 13m ago 31m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:52:30.006 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (20m) 13m ago 29m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:52:30.006 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (18m) 13m ago 31m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:52:30.007 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (17m) 13m ago 29m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:52:30.007 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (20m) 13m ago 30m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:52:30.007 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (20m) 13m ago 29m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:52:30.007 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (17m) 13m ago 28m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:52:30.007 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (16m) 13m ago 27m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:52:30.007 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (16m) 13m ago 27m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:52:30.007 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (15m) 13m ago 26m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:52:30.007 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (14m) 13m ago 26m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:52:30.007 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (14m) 13m ago 26m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:52:30.007 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (19m) 13m ago 29m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:52:30.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.007+0000 7f64e6218640 1 -- 172.21.15.170:0/2748383348 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f64cc079e80 msgr2=0x7f64cc07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:30.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.007+0000 7f64e6218640 1 --2- 172.21.15.170:0/2748383348 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f64cc079e80 0x7f64cc07c340 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f64c8005fd0 tx=0x7f64c8005850 comp rx=0 tx=0).stop 2024-09-04T16:52:30.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.007+0000 7f64e6218640 1 -- 172.21.15.170:0/2748383348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64e0100810 msgr2=0x7f64e019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:30.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.007+0000 7f64e6218640 1 --2- 172.21.15.170:0/2748383348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64e0100810 0x7f64e019d6a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f64d002ae90 tx=0x7f64d002f5f0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.007+0000 7f64e6218640 1 -- 172.21.15.170:0/2748383348 shutdown_connections 2024-09-04T16:52:30.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.007+0000 7f64e6218640 1 --2- 172.21.15.170:0/2748383348 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f64cc079e80 0x7f64cc07c340 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.007+0000 7f64e6218640 1 --2- 172.21.15.170:0/2748383348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64e0106810 0x7f64e019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.007+0000 7f64e6218640 1 --2- 172.21.15.170:0/2748383348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64e0100810 0x7f64e019d6a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.008+0000 7f64e6218640 1 -- 172.21.15.170:0/2748383348 >> 172.21.15.170:0/2748383348 conn(0x7f64e00fc510 msgr2=0x7f64e0104660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:52:30.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.008+0000 7f64e6218640 1 -- 172.21.15.170:0/2748383348 shutdown_connections 2024-09-04T16:52:30.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.008+0000 7f64e6218640 1 -- 172.21.15.170:0/2748383348 wait complete. 2024-09-04T16:52:30.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.088+0000 7fbb6a8aa640 1 -- 172.21.15.170:0/1563314719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb64100fc0 msgr2=0x7fbb64101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:30.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.088+0000 7fbb6a8aa640 1 --2- 172.21.15.170:0/1563314719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb64100fc0 0x7fbb64101420 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009880 tx=0x7fbb5802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.088+0000 7fbb6a8aa640 1 -- 172.21.15.170:0/1563314719 shutdown_connections 2024-09-04T16:52:30.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.088+0000 7fbb6a8aa640 1 --2- 172.21.15.170:0/1563314719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb64100fc0 0x7fbb64101420 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.088+0000 7fbb6a8aa640 1 --2- 172.21.15.170:0/1563314719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb641057f0 0x7fbb64105bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.088+0000 7fbb6a8aa640 1 -- 172.21.15.170:0/1563314719 >> 172.21.15.170:0/1563314719 conn(0x7fbb640fbc60 msgr2=0x7fbb640fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:52:30.090 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:29 smithi170 ceph-mon[113855]: pgmap v683: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:30.090 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:52:30.090 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:29 smithi170 ceph-mon[113855]: from='client.35062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:52:30.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.089+0000 7fbb6a8aa640 1 -- 172.21.15.170:0/1563314719 shutdown_connections 2024-09-04T16:52:30.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.089+0000 7fbb6a8aa640 1 -- 172.21.15.170:0/1563314719 wait complete. 2024-09-04T16:52:30.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.089+0000 7fbb6a8aa640 1 Processor -- start 2024-09-04T16:52:30.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.089+0000 7fbb6a8aa640 1 -- start start 2024-09-04T16:52:30.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.090+0000 7fbb6a8aa640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb64100fc0 0x7fbb6419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:30.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.090+0000 7fbb6a8aa640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb641057f0 0x7fbb6419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:30.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.090+0000 7fbb6a8aa640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6410dcc0 con 0x7fbb64100fc0 2024-09-04T16:52:30.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.090+0000 7fbb6a8aa640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6410db40 con 0x7fbb641057f0 2024-09-04T16:52:30.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.090+0000 7fbb63fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb64100fc0 0x7fbb6419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:30.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.090+0000 7fbb63fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb64100fc0 0x7fbb6419d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51958/0 (socket says 172.21.15.170:51958) 2024-09-04T16:52:30.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.090+0000 7fbb63fff640 1 -- 172.21.15.170:0/781165061 learned_addr learned my addr 172.21.15.170:0/781165061 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:52:30.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.090+0000 7fbb637fe640 1 --2- 172.21.15.170:0/781165061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb641057f0 0x7fbb6419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:30.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.090+0000 7fbb63fff640 1 -- 172.21.15.170:0/781165061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb641057f0 msgr2=0x7fbb6419db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:30.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.090+0000 7fbb63fff640 1 --2- 172.21.15.170:0/781165061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb641057f0 0x7fbb6419db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.090+0000 7fbb63fff640 1 -- 172.21.15.170:0/781165061 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb64197790 con 0x7fbb64100fc0 2024-09-04T16:52:30.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.090+0000 7fbb63fff640 1 --2- 172.21.15.170:0/781165061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb64100fc0 0x7fbb6419d610 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400d8d0 tx=0x7fbb5400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:52:30.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.091+0000 7fbb617fa640 1 -- 172.21.15.170:0/781165061 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb54017030 con 0x7fbb64100fc0 2024-09-04T16:52:30.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.091+0000 7fbb6a8aa640 1 -- 172.21.15.170:0/781165061 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb64197a80 con 0x7fbb64100fc0 2024-09-04T16:52:30.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.091+0000 7fbb617fa640 1 -- 172.21.15.170:0/781165061 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb54004020 con 0x7fbb64100fc0 2024-09-04T16:52:30.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.091+0000 7fbb617fa640 1 -- 172.21.15.170:0/781165061 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb540047a0 con 0x7fbb64100fc0 2024-09-04T16:52:30.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.091+0000 7fbb6a8aa640 1 -- 172.21.15.170:0/781165061 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb64197fe0 con 0x7fbb64100fc0 2024-09-04T16:52:30.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.092+0000 7fbb6a8aa640 1 -- 172.21.15.170:0/781165061 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb64101fd0 con 0x7fbb64100fc0 2024-09-04T16:52:30.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.093+0000 7fbb617fa640 1 -- 172.21.15.170:0/781165061 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fbb540041d0 con 0x7fbb64100fc0 2024-09-04T16:52:30.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.093+0000 7fbb617fa640 1 --2- 172.21.15.170:0/781165061 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbb4c079e80 0x7fbb4c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:30.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.093+0000 7fbb637fe640 1 --2- 172.21.15.170:0/781165061 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbb4c079e80 0x7fbb4c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:30.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.093+0000 7fbb617fa640 1 -- 172.21.15.170:0/781165061 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fbb54018070 con 0x7fbb64100fc0 2024-09-04T16:52:30.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.094+0000 7fbb637fe640 1 --2- 172.21.15.170:0/781165061 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbb4c079e80 0x7fbb4c07c340 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbb64198ae0 tx=0x7fbb58031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:52:30.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.097+0000 7fbb617fa640 1 -- 172.21.15.170:0/781165061 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbb54064a50 con 0x7fbb64100fc0 2024-09-04T16:52:30.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:29 smithi193 ceph-mon[82547]: pgmap v683: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:30.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:52:30.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:29 smithi193 ceph-mon[82547]: from='client.35062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:52:30.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.343+0000 7fbb6a8aa640 1 -- 172.21.15.170:0/781165061 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fbb64109d40 con 0x7fbb64100fc0 2024-09-04T16:52:30.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.343+0000 7fbb617fa640 1 -- 172.21.15.170:0/781165061 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fbb54068bc0 con 0x7fbb64100fc0 2024-09-04T16:52:30.344 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:52:30.344 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:52:30.344 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:52:30.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:52:30.345 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:52:30.345 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:52:30.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:52:30.345 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:52:30.345 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:52:30.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:52:30.345 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:52:30.345 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:52:30.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:52:30.345 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:52:30.345 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:52:30.345 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:52:30.345 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:52:30.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.345+0000 7fbb6a8aa640 1 -- 172.21.15.170:0/781165061 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbb4c079e80 msgr2=0x7fbb4c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:30.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.345+0000 7fbb6a8aa640 1 --2- 172.21.15.170:0/781165061 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbb4c079e80 0x7fbb4c07c340 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbb64198ae0 tx=0x7fbb58031400 comp rx=0 tx=0).stop 2024-09-04T16:52:30.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.345+0000 7fbb6a8aa640 1 -- 172.21.15.170:0/781165061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb64100fc0 msgr2=0x7fbb6419d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:30.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.345+0000 7fbb6a8aa640 1 --2- 172.21.15.170:0/781165061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb64100fc0 0x7fbb6419d610 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400d8d0 tx=0x7fbb5400dd90 comp rx=0 tx=0).stop 2024-09-04T16:52:30.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.345+0000 7fbb6a8aa640 1 -- 172.21.15.170:0/781165061 shutdown_connections 2024-09-04T16:52:30.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.345+0000 7fbb6a8aa640 1 --2- 172.21.15.170:0/781165061 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbb4c079e80 0x7fbb4c07c340 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.345+0000 7fbb6a8aa640 1 --2- 172.21.15.170:0/781165061 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbb641057f0 0x7fbb6419db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.345+0000 7fbb6a8aa640 1 --2- 172.21.15.170:0/781165061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb64100fc0 0x7fbb6419d610 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.345+0000 7fbb6a8aa640 1 -- 172.21.15.170:0/781165061 >> 172.21.15.170:0/781165061 conn(0x7fbb640fbc60 msgr2=0x7fbb64100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:52:30.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.346+0000 7fbb6a8aa640 1 -- 172.21.15.170:0/781165061 shutdown_connections 2024-09-04T16:52:30.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.346+0000 7fbb6a8aa640 1 -- 172.21.15.170:0/781165061 wait complete. 2024-09-04T16:52:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.427+0000 7fbe64afd640 1 -- 172.21.15.170:0/1649023626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe60106820 msgr2=0x7fbe60106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.427+0000 7fbe64afd640 1 --2- 172.21.15.170:0/1649023626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe60106820 0x7fbe60106c00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009880 tx=0x7fbe5002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.427+0000 7fbe64afd640 1 -- 172.21.15.170:0/1649023626 shutdown_connections 2024-09-04T16:52:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.427+0000 7fbe64afd640 1 --2- 172.21.15.170:0/1649023626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbe60100820 0x7fbe60100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.427+0000 7fbe64afd640 1 --2- 172.21.15.170:0/1649023626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe60106820 0x7fbe60106c00 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.427+0000 7fbe64afd640 1 -- 172.21.15.170:0/1649023626 >> 172.21.15.170:0/1649023626 conn(0x7fbe600fc520 msgr2=0x7fbe600fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:52:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.427+0000 7fbe64afd640 1 -- 172.21.15.170:0/1649023626 shutdown_connections 2024-09-04T16:52:30.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.427+0000 7fbe64afd640 1 -- 172.21.15.170:0/1649023626 wait complete. 2024-09-04T16:52:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.428+0000 7fbe64afd640 1 Processor -- start 2024-09-04T16:52:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.428+0000 7fbe64afd640 1 -- start start 2024-09-04T16:52:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.428+0000 7fbe64afd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe60100820 0x7fbe60198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.428+0000 7fbe64afd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbe60106820 0x7fbe60198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.428+0000 7fbe64afd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6010dcf0 con 0x7fbe60100820 2024-09-04T16:52:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.428+0000 7fbe64afd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6010db70 con 0x7fbe60106820 2024-09-04T16:52:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.429+0000 7fbe5e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe60100820 0x7fbe60198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.429+0000 7fbe5e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe60100820 0x7fbe60198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51982/0 (socket says 172.21.15.170:51982) 2024-09-04T16:52:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.429+0000 7fbe5e59c640 1 -- 172.21.15.170:0/3693116389 learned_addr learned my addr 172.21.15.170:0/3693116389 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:52:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.429+0000 7fbe55d9b640 1 --2- 172.21.15.170:0/3693116389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbe60106820 0x7fbe60198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.429+0000 7fbe5e59c640 1 -- 172.21.15.170:0/3693116389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbe60106820 msgr2=0x7fbe60198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.429+0000 7fbe5e59c640 1 --2- 172.21.15.170:0/3693116389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbe60106820 0x7fbe60198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.429+0000 7fbe5e59c640 1 -- 172.21.15.170:0/3693116389 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe60199380 con 0x7fbe60100820 2024-09-04T16:52:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.429+0000 7fbe5e59c640 1 --2- 172.21.15.170:0/3693116389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe60100820 0x7fbe60198840 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbe50031460 tx=0x7fbe500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:52:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.429+0000 7fbe57fff640 1 -- 172.21.15.170:0/3693116389 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe5003f070 con 0x7fbe60100820 2024-09-04T16:52:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.429+0000 7fbe57fff640 1 -- 172.21.15.170:0/3693116389 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbe50004cf0 con 0x7fbe60100820 2024-09-04T16:52:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.429+0000 7fbe64afd640 1 -- 172.21.15.170:0/3693116389 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe60199610 con 0x7fbe60100820 2024-09-04T16:52:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.429+0000 7fbe57fff640 1 -- 172.21.15.170:0/3693116389 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe50035030 con 0x7fbe60100820 2024-09-04T16:52:30.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.429+0000 7fbe64afd640 1 -- 172.21.15.170:0/3693116389 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe601a1bc0 con 0x7fbe60100820 2024-09-04T16:52:30.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.431+0000 7fbe64afd640 1 -- 172.21.15.170:0/3693116389 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe60101f60 con 0x7fbe60100820 2024-09-04T16:52:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.431+0000 7fbe57fff640 1 -- 172.21.15.170:0/3693116389 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fbe50042070 con 0x7fbe60100820 2024-09-04T16:52:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.432+0000 7fbe57fff640 1 --2- 172.21.15.170:0/3693116389 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbe4c079e80 0x7fbe4c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.432+0000 7fbe57fff640 1 -- 172.21.15.170:0/3693116389 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fbe500bd400 con 0x7fbe60100820 2024-09-04T16:52:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.432+0000 7fbe55d9b640 1 --2- 172.21.15.170:0/3693116389 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbe4c079e80 0x7fbe4c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.432+0000 7fbe55d9b640 1 --2- 172.21.15.170:0/3693116389 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbe4c079e80 0x7fbe4c07c340 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbe6006ae50 tx=0x7fbe4800a250 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:52:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.436+0000 7fbe57fff640 1 -- 172.21.15.170:0/3693116389 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbe50089000 con 0x7fbe60100820 2024-09-04T16:52:30.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.648+0000 7fbe64afd640 1 -- 172.21.15.170:0/3693116389 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbe60108d90 con 0x7fbe60100820 2024-09-04T16:52:30.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.648+0000 7fbe57fff640 1 -- 172.21.15.170:0/3693116389 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7fbe5008d340 con 0x7fbe60100820 2024-09-04T16:52:30.649 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:52:30.649 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:52:30.649 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:52:30.649 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:52:30.649 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:52:30.649 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:52:30.649 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:52:30.649 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:52:30.650 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:52:30.650 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:52:30.650 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:52:30.650 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:52:30.650 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:52:30.650 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:52:30.650 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:52:30.650 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:52:30.650 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:52:30.650 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:52:30.650 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:52:30.650 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:52:30.650 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:52:30.651 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:52:30.651 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:52:30.651 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:52:30.651 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:52:30.651 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:52:30.651 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:52:30.651 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:52:30.651 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:52:30.651 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:52:30.651 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:52:30.651 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:52:30.651 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:52:30.651 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:52:30.652 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:52:30.652 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:52:30.652 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:52:30.652 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:52:30.652 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:52:30.652 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:52:30.652 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:52:30.652 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:52:30.652 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:52:30.653 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:52:30.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.650+0000 7fbe64afd640 1 -- 172.21.15.170:0/3693116389 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbe4c079e80 msgr2=0x7fbe4c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:30.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.650+0000 7fbe64afd640 1 --2- 172.21.15.170:0/3693116389 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbe4c079e80 0x7fbe4c07c340 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbe6006ae50 tx=0x7fbe4800a250 comp rx=0 tx=0).stop 2024-09-04T16:52:30.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.650+0000 7fbe64afd640 1 -- 172.21.15.170:0/3693116389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe60100820 msgr2=0x7fbe60198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:30.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.650+0000 7fbe64afd640 1 --2- 172.21.15.170:0/3693116389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe60100820 0x7fbe60198840 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbe50031460 tx=0x7fbe500048f0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.650+0000 7fbe64afd640 1 -- 172.21.15.170:0/3693116389 shutdown_connections 2024-09-04T16:52:30.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.650+0000 7fbe64afd640 1 --2- 172.21.15.170:0/3693116389 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fbe4c079e80 0x7fbe4c07c340 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.650+0000 7fbe64afd640 1 --2- 172.21.15.170:0/3693116389 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbe60106820 0x7fbe60198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.650+0000 7fbe64afd640 1 --2- 172.21.15.170:0/3693116389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe60100820 0x7fbe60198840 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.650+0000 7fbe64afd640 1 -- 172.21.15.170:0/3693116389 >> 172.21.15.170:0/3693116389 conn(0x7fbe600fc520 msgr2=0x7fbe600fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:52:30.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.650+0000 7fbe64afd640 1 -- 172.21.15.170:0/3693116389 shutdown_connections 2024-09-04T16:52:30.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.650+0000 7fbe64afd640 1 -- 172.21.15.170:0/3693116389 wait complete. 2024-09-04T16:52:30.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.732+0000 7f6b13ab0640 1 -- 172.21.15.170:0/3455002706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b0c107930 msgr2=0x7f6b0c107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:30.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.732+0000 7f6b13ab0640 1 --2- 172.21.15.170:0/3455002706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b0c107930 0x7f6b0c107d10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009880 tx=0x7f6b0002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.732+0000 7f6b13ab0640 1 -- 172.21.15.170:0/3455002706 shutdown_connections 2024-09-04T16:52:30.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.732+0000 7f6b13ab0640 1 --2- 172.21.15.170:0/3455002706 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b0c101930 0x7f6b0c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.732+0000 7f6b13ab0640 1 --2- 172.21.15.170:0/3455002706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b0c107930 0x7f6b0c107d10 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.732+0000 7f6b13ab0640 1 -- 172.21.15.170:0/3455002706 >> 172.21.15.170:0/3455002706 conn(0x7f6b0c0fd630 msgr2=0x7f6b0c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:52:30.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.732+0000 7f6b13ab0640 1 -- 172.21.15.170:0/3455002706 shutdown_connections 2024-09-04T16:52:30.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.732+0000 7f6b13ab0640 1 -- 172.21.15.170:0/3455002706 wait complete. 2024-09-04T16:52:30.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.733+0000 7f6b13ab0640 1 Processor -- start 2024-09-04T16:52:30.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.733+0000 7f6b13ab0640 1 -- start start 2024-09-04T16:52:30.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.733+0000 7f6b13ab0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b0c101930 0x7f6b0c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:30.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.733+0000 7f6b13ab0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b0c107930 0x7f6b0c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:30.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.733+0000 7f6b13ab0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c10ede0 con 0x7f6b0c101930 2024-09-04T16:52:30.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.733+0000 7f6b13ab0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c10ec60 con 0x7f6b0c107930 2024-09-04T16:52:30.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.733+0000 7f6b1184c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b0c101930 0x7f6b0c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:30.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.733+0000 7f6b1184c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b0c101930 0x7f6b0c19d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51994/0 (socket says 172.21.15.170:51994) 2024-09-04T16:52:30.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.733+0000 7f6b1184c640 1 -- 172.21.15.170:0/587051488 learned_addr learned my addr 172.21.15.170:0/587051488 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:52:30.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.733+0000 7f6b1104b640 1 --2- 172.21.15.170:0/587051488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b0c107930 0x7f6b0c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:30.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.733+0000 7f6b1184c640 1 -- 172.21.15.170:0/587051488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b0c107930 msgr2=0x7f6b0c19dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:30.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.733+0000 7f6b1184c640 1 --2- 172.21.15.170:0/587051488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b0c107930 0x7f6b0c19dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.733+0000 7f6b1184c640 1 -- 172.21.15.170:0/587051488 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c197810 con 0x7f6b0c101930 2024-09-04T16:52:30.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.733+0000 7f6b1104b640 1 --2- 172.21.15.170:0/587051488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b0c107930 0x7f6b0c19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:52:30.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.734+0000 7f6b1184c640 1 --2- 172.21.15.170:0/587051488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b0c101930 0x7f6b0c19d690 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6b00031460 tx=0x7f6b000045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:52:30.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.734+0000 7f6afeffd640 1 -- 172.21.15.170:0/587051488 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b0003f070 con 0x7f6b0c101930 2024-09-04T16:52:30.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.734+0000 7f6afeffd640 1 -- 172.21.15.170:0/587051488 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b000035f0 con 0x7f6b0c101930 2024-09-04T16:52:30.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.734+0000 7f6b13ab0640 1 -- 172.21.15.170:0/587051488 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0c197aa0 con 0x7f6b0c101930 2024-09-04T16:52:30.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.734+0000 7f6afeffd640 1 -- 172.21.15.170:0/587051488 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b00035030 con 0x7f6b0c101930 2024-09-04T16:52:30.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.734+0000 7f6b13ab0640 1 -- 172.21.15.170:0/587051488 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b0c197fd0 con 0x7f6b0c101930 2024-09-04T16:52:30.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.735+0000 7f6b13ab0640 1 -- 172.21.15.170:0/587051488 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b0c103070 con 0x7f6b0c101930 2024-09-04T16:52:30.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.735+0000 7f6afeffd640 1 -- 172.21.15.170:0/587051488 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f6b00042070 con 0x7f6b0c101930 2024-09-04T16:52:30.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.736+0000 7f6afeffd640 1 --2- 172.21.15.170:0/587051488 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6af8079e30 0x7f6af807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:30.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.736+0000 7f6afeffd640 1 -- 172.21.15.170:0/587051488 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6b000bd460 con 0x7f6b0c101930 2024-09-04T16:52:30.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.736+0000 7f6b1104b640 1 --2- 172.21.15.170:0/587051488 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6af8079e30 0x7f6af807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:30.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.737+0000 7f6b1104b640 1 --2- 172.21.15.170:0/587051488 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6af8079e30 0x7f6af807c2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6b080058c0 tx=0x7f6b08005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:52:30.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.740+0000 7f6afeffd640 1 -- 172.21.15.170:0/587051488 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6b00084e70 con 0x7f6b0c101930 2024-09-04T16:52:30.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.934+0000 7f6b13ab0640 1 -- 172.21.15.170:0/587051488 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6b0c198280 con 0x7f6af8079e30 2024-09-04T16:52:30.935 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:30 smithi170 ceph-mon[113855]: from='client.35066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:52:30.935 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:30 smithi170 ceph-mon[113855]: from='client.35070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:52:30.935 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:30 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/781165061' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:52:30.935 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:30 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3693116389' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:52:30.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.935+0000 7f6afeffd640 1 -- 172.21.15.170:0/587051488 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6b0c198280 con 0x7f6af8079e30 2024-09-04T16:52:30.936 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:52:30.936 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:52:30.936 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:52:30.936 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:52:30.936 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:52:30.936 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:52:30.936 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:52:30.936 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:52:30.936 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:52:30.936 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:52:30.936 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:52:30.937 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:52:30.937 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:52:30.937 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:52:30.937 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:52:30.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.937+0000 7f6b13ab0640 1 -- 172.21.15.170:0/587051488 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6af8079e30 msgr2=0x7f6af807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:30.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.937+0000 7f6b13ab0640 1 --2- 172.21.15.170:0/587051488 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6af8079e30 0x7f6af807c2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6b080058c0 tx=0x7f6b08005850 comp rx=0 tx=0).stop 2024-09-04T16:52:30.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.937+0000 7f6b13ab0640 1 -- 172.21.15.170:0/587051488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b0c101930 msgr2=0x7f6b0c19d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:30.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.937+0000 7f6b13ab0640 1 --2- 172.21.15.170:0/587051488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b0c101930 0x7f6b0c19d690 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6b00031460 tx=0x7f6b000045e0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.937+0000 7f6b13ab0640 1 -- 172.21.15.170:0/587051488 shutdown_connections 2024-09-04T16:52:30.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.937+0000 7f6b13ab0640 1 --2- 172.21.15.170:0/587051488 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6af8079e30 0x7f6af807c2f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.937+0000 7f6b13ab0640 1 --2- 172.21.15.170:0/587051488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b0c107930 0x7f6b0c19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.937+0000 7f6b13ab0640 1 --2- 172.21.15.170:0/587051488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b0c101930 0x7f6b0c19d690 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:30.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.937+0000 7f6b13ab0640 1 -- 172.21.15.170:0/587051488 >> 172.21.15.170:0/587051488 conn(0x7f6b0c0fd630 msgr2=0x7f6b0c0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:52:30.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.937+0000 7f6b13ab0640 1 -- 172.21.15.170:0/587051488 shutdown_connections 2024-09-04T16:52:30.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:30.937+0000 7f6b13ab0640 1 -- 172.21.15.170:0/587051488 wait complete. 2024-09-04T16:52:31.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.018+0000 7fc2410ff640 1 -- 172.21.15.170:0/400752808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc23c1007e0 msgr2=0x7fc23c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:31.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.018+0000 7fc2410ff640 1 --2- 172.21.15.170:0/400752808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc23c1007e0 0x7fc23c100c40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc224009880 tx=0x7fc22402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:52:31.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.018+0000 7fc2410ff640 1 -- 172.21.15.170:0/400752808 shutdown_connections 2024-09-04T16:52:31.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.018+0000 7fc2410ff640 1 --2- 172.21.15.170:0/400752808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc23c1007e0 0x7fc23c100c40 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:31.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.018+0000 7fc2410ff640 1 --2- 172.21.15.170:0/400752808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc23c1067e0 0x7fc23c106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:31.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.018+0000 7fc2410ff640 1 -- 172.21.15.170:0/400752808 >> 172.21.15.170:0/400752808 conn(0x7fc23c0fc4c0 msgr2=0x7fc23c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:52:31.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.018+0000 7fc2410ff640 1 -- 172.21.15.170:0/400752808 shutdown_connections 2024-09-04T16:52:31.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.018+0000 7fc2410ff640 1 -- 172.21.15.170:0/400752808 wait complete. 2024-09-04T16:52:31.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.019+0000 7fc2410ff640 1 Processor -- start 2024-09-04T16:52:31.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.019+0000 7fc2410ff640 1 -- start start 2024-09-04T16:52:31.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc2410ff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc23c1007e0 0x7fc23c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:31.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc2410ff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc23c1067e0 0x7fc23c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:31.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc2410ff640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c10dd10 con 0x7fc23c1007e0 2024-09-04T16:52:31.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc2410ff640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c10db90 con 0x7fc23c1067e0 2024-09-04T16:52:31.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc23ad9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc23c1007e0 0x7fc23c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:31.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc23ad9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc23c1007e0 0x7fc23c19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:52006/0 (socket says 172.21.15.170:52006) 2024-09-04T16:52:31.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc23ad9d640 1 -- 172.21.15.170:0/2358352896 learned_addr learned my addr 172.21.15.170:0/2358352896 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:52:31.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc23259c640 1 --2- 172.21.15.170:0/2358352896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc23c1067e0 0x7fc23c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:31.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc23ad9d640 1 -- 172.21.15.170:0/2358352896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc23c1067e0 msgr2=0x7fc23c19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:31.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc23ad9d640 1 --2- 172.21.15.170:0/2358352896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc23c1067e0 0x7fc23c19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:31.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc23ad9d640 1 -- 172.21.15.170:0/2358352896 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23c197820 con 0x7fc23c1007e0 2024-09-04T16:52:31.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc23259c640 1 --2- 172.21.15.170:0/2358352896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc23c1067e0 0x7fc23c19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:52:31.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc23ad9d640 1 --2- 172.21.15.170:0/2358352896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc23c1007e0 0x7fc23c19d6a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00b420 tx=0x7fc22c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:52:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc238d99640 1 -- 172.21.15.170:0/2358352896 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc22c011630 con 0x7fc23c1007e0 2024-09-04T16:52:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc238d99640 1 -- 172.21.15.170:0/2358352896 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc22c016070 con 0x7fc23c1007e0 2024-09-04T16:52:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc2410ff640 1 -- 172.21.15.170:0/2358352896 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc23c197b10 con 0x7fc23c1007e0 2024-09-04T16:52:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc238d99640 1 -- 172.21.15.170:0/2358352896 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc22c010d40 con 0x7fc23c1007e0 2024-09-04T16:52:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.020+0000 7fc2410ff640 1 -- 172.21.15.170:0/2358352896 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc23c1980a0 con 0x7fc23c1007e0 2024-09-04T16:52:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.022+0000 7fc2410ff640 1 -- 172.21.15.170:0/2358352896 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc23c101f20 con 0x7fc23c1007e0 2024-09-04T16:52:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.022+0000 7fc238d99640 1 -- 172.21.15.170:0/2358352896 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fc22c01b460 con 0x7fc23c1007e0 2024-09-04T16:52:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.022+0000 7fc238d99640 1 --2- 172.21.15.170:0/2358352896 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc228079e80 0x7fc22807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:52:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.023+0000 7fc238d99640 1 -- 172.21.15.170:0/2358352896 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc22c09c1b0 con 0x7fc23c1007e0 2024-09-04T16:52:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.023+0000 7fc23259c640 1 --2- 172.21.15.170:0/2358352896 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc228079e80 0x7fc22807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:52:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.023+0000 7fc23259c640 1 --2- 172.21.15.170:0/2358352896 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc228079e80 0x7fc22807c340 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc224031460 tx=0x7fc2240095f0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:52:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.027+0000 7fc238d99640 1 -- 172.21.15.170:0/2358352896 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc22c021250 con 0x7fc23c1007e0 2024-09-04T16:52:31.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:30 smithi193 ceph-mon[82547]: from='client.35066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:52:31.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:30 smithi193 ceph-mon[82547]: from='client.35070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:52:31.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:30 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/781165061' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:52:31.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:30 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3693116389' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:52:31.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.268+0000 7fc2410ff640 1 -- 172.21.15.170:0/2358352896 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fc23c109d80 con 0x7fc23c1007e0 2024-09-04T16:52:31.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.268+0000 7fc238d99640 1 -- 172.21.15.170:0/2358352896 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fc22c063c40 con 0x7fc23c1007e0 2024-09-04T16:52:31.269 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:52:31.270 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:52:31.270 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:52:31.270 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:52:31.270 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:52:31.270 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:52:31.270 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:52:31.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.270+0000 7fc2410ff640 1 -- 172.21.15.170:0/2358352896 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc228079e80 msgr2=0x7fc22807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:31.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.271+0000 7fc2410ff640 1 --2- 172.21.15.170:0/2358352896 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc228079e80 0x7fc22807c340 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc224031460 tx=0x7fc2240095f0 comp rx=0 tx=0).stop 2024-09-04T16:52:31.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.271+0000 7fc2410ff640 1 -- 172.21.15.170:0/2358352896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc23c1007e0 msgr2=0x7fc23c19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:52:31.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.271+0000 7fc2410ff640 1 --2- 172.21.15.170:0/2358352896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc23c1007e0 0x7fc23c19d6a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00b420 tx=0x7fc22c00b8e0 comp rx=0 tx=0).stop 2024-09-04T16:52:31.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.271+0000 7fc2410ff640 1 -- 172.21.15.170:0/2358352896 shutdown_connections 2024-09-04T16:52:31.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.271+0000 7fc2410ff640 1 --2- 172.21.15.170:0/2358352896 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc228079e80 0x7fc22807c340 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:31.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.271+0000 7fc2410ff640 1 --2- 172.21.15.170:0/2358352896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc23c1067e0 0x7fc23c19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:31.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.271+0000 7fc2410ff640 1 --2- 172.21.15.170:0/2358352896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc23c1007e0 0x7fc23c19d6a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:52:31.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.271+0000 7fc2410ff640 1 -- 172.21.15.170:0/2358352896 >> 172.21.15.170:0/2358352896 conn(0x7fc23c0fc4c0 msgr2=0x7fc23c069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:52:31.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.271+0000 7fc2410ff640 1 -- 172.21.15.170:0/2358352896 shutdown_connections 2024-09-04T16:52:31.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:52:31.271+0000 7fc2410ff640 1 -- 172.21.15.170:0/2358352896 wait complete. 2024-09-04T16:52:32.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:31 smithi170 ceph-mon[113855]: pgmap v684: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:32.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:31 smithi170 ceph-mon[113855]: from='client.35082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:52:32.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:31 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2358352896' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:52:32.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:31 smithi193 ceph-mon[82547]: pgmap v684: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:32.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:31 smithi193 ceph-mon[82547]: from='client.35082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:52:32.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:31 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2358352896' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:52:34.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:33 smithi170 ceph-mon[113855]: pgmap v685: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:34.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:33 smithi193 ceph-mon[82547]: pgmap v685: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:36.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:35 smithi170 ceph-mon[113855]: pgmap v686: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:36.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:35 smithi193 ceph-mon[82547]: pgmap v686: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:38.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:37 smithi170 ceph-mon[113855]: pgmap v687: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:38.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:37 smithi193 ceph-mon[82547]: pgmap v687: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:40.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:39 smithi170 ceph-mon[113855]: pgmap v688: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:40.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:39 smithi193 ceph-mon[82547]: pgmap v688: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:42.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:41 smithi170 ceph-mon[113855]: pgmap v689: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:42.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:41 smithi193 ceph-mon[82547]: pgmap v689: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:44.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:43 smithi170 ceph-mon[113855]: pgmap v690: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:44.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:43 smithi193 ceph-mon[82547]: pgmap v690: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:45.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:52:45.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:52:46.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:45 smithi170 ceph-mon[113855]: pgmap v691: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:46.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:45 smithi193 ceph-mon[82547]: pgmap v691: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:48.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:47 smithi170 ceph-mon[113855]: pgmap v692: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:48.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:47 smithi193 ceph-mon[82547]: pgmap v692: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:50.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:49 smithi170 ceph-mon[113855]: pgmap v693: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:50.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:49 smithi193 ceph-mon[82547]: pgmap v693: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:52.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:51 smithi170 ceph-mon[113855]: pgmap v694: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:52.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:51 smithi193 ceph-mon[82547]: pgmap v694: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:54.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:54 smithi170 ceph-mon[113855]: pgmap v695: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:54.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:54 smithi193 ceph-mon[82547]: pgmap v695: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:56.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:56 smithi170 ceph-mon[113855]: pgmap v696: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:56.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:56 smithi193 ceph-mon[82547]: pgmap v696: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:58.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:52:58 smithi170 ceph-mon[113855]: pgmap v697: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:52:58.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:52:58 smithi193 ceph-mon[82547]: pgmap v697: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:00.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:00 smithi170 ceph-mon[113855]: pgmap v698: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:00.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:00 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:53:00.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:00 smithi193 ceph-mon[82547]: pgmap v698: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:00.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:00 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:53:01.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.365+0000 7f80e8a32640 1 -- 172.21.15.170:0/412925901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80e4101930 msgr2=0x7f80e4101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:01.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.365+0000 7f80e8a32640 1 --2- 172.21.15.170:0/412925901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80e4101930 0x7f80e4101d90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009880 tx=0x7f80cc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.365+0000 7f80e8a32640 1 -- 172.21.15.170:0/412925901 shutdown_connections 2024-09-04T16:53:01.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.365+0000 7f80e8a32640 1 --2- 172.21.15.170:0/412925901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80e4101930 0x7f80e4101d90 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.365+0000 7f80e8a32640 1 --2- 172.21.15.170:0/412925901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80e4107930 0x7f80e4107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.365+0000 7f80e8a32640 1 -- 172.21.15.170:0/412925901 >> 172.21.15.170:0/412925901 conn(0x7f80e40fd630 msgr2=0x7f80e40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:01.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.365+0000 7f80e8a32640 1 -- 172.21.15.170:0/412925901 shutdown_connections 2024-09-04T16:53:01.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.365+0000 7f80e8a32640 1 -- 172.21.15.170:0/412925901 wait complete. 2024-09-04T16:53:01.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.366+0000 7f80e8a32640 1 Processor -- start 2024-09-04T16:53:01.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.366+0000 7f80e8a32640 1 -- start start 2024-09-04T16:53:01.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.367+0000 7f80e8a32640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80e4101930 0x7f80e419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:01.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.367+0000 7f80e8a32640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80e4107930 0x7f80e419dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:01.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.367+0000 7f80e8a32640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f80e410ede0 con 0x7f80e4107930 2024-09-04T16:53:01.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.367+0000 7f80e8a32640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f80e410ec60 con 0x7f80e4101930 2024-09-04T16:53:01.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.367+0000 7f80d9d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80e4107930 0x7f80e419dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:01.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.367+0000 7f80d9d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80e4107930 0x7f80e419dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53754/0 (socket says 172.21.15.170:53754) 2024-09-04T16:53:01.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.367+0000 7f80d9d9b640 1 -- 172.21.15.170:0/3532417777 learned_addr learned my addr 172.21.15.170:0/3532417777 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:53:01.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.367+0000 7f80e259c640 1 --2- 172.21.15.170:0/3532417777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80e4101930 0x7f80e419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:01.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.367+0000 7f80d9d9b640 1 -- 172.21.15.170:0/3532417777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80e4101930 msgr2=0x7f80e419d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:01.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.367+0000 7f80d9d9b640 1 --2- 172.21.15.170:0/3532417777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80e4101930 0x7f80e419d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.367+0000 7f80d9d9b640 1 -- 172.21.15.170:0/3532417777 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e4197850 con 0x7f80e4107930 2024-09-04T16:53:01.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.367+0000 7f80d9d9b640 1 --2- 172.21.15.170:0/3532417777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80e4107930 0x7f80e419dc10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f80cc031460 tx=0x7f80cc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:01.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.368+0000 7f80dbfff640 1 -- 172.21.15.170:0/3532417777 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80cc03f070 con 0x7f80e4107930 2024-09-04T16:53:01.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.368+0000 7f80dbfff640 1 -- 172.21.15.170:0/3532417777 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f80cc0035f0 con 0x7f80e4107930 2024-09-04T16:53:01.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.368+0000 7f80e8a32640 1 -- 172.21.15.170:0/3532417777 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e4197ae0 con 0x7f80e4107930 2024-09-04T16:53:01.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.368+0000 7f80dbfff640 1 -- 172.21.15.170:0/3532417777 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80cc035030 con 0x7f80e4107930 2024-09-04T16:53:01.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.368+0000 7f80e8a32640 1 -- 172.21.15.170:0/3532417777 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e4198010 con 0x7f80e4107930 2024-09-04T16:53:01.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.369+0000 7f80e8a32640 1 -- 172.21.15.170:0/3532417777 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e4103070 con 0x7f80e4107930 2024-09-04T16:53:01.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.369+0000 7f80dbfff640 1 -- 172.21.15.170:0/3532417777 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f80cc042070 con 0x7f80e4107930 2024-09-04T16:53:01.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.370+0000 7f80dbfff640 1 --2- 172.21.15.170:0/3532417777 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f80d0079e30 0x7f80d007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:01.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.370+0000 7f80e259c640 1 --2- 172.21.15.170:0/3532417777 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f80d0079e30 0x7f80d007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:01.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.370+0000 7f80dbfff640 1 -- 172.21.15.170:0/3532417777 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f80cc0bd3b0 con 0x7f80e4107930 2024-09-04T16:53:01.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.371+0000 7f80e259c640 1 --2- 172.21.15.170:0/3532417777 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f80d0079e30 0x7f80d007c2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f80d4005d00 tx=0x7f80d400b410 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:01.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.374+0000 7f80dbfff640 1 -- 172.21.15.170:0/3532417777 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f80cc088f30 con 0x7f80e4107930 2024-09-04T16:53:01.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.566+0000 7f80e8a32640 1 -- 172.21.15.170:0/3532417777 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f80e41982c0 con 0x7f80d0079e30 2024-09-04T16:53:01.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.567+0000 7f80dbfff640 1 -- 172.21.15.170:0/3532417777 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f80e41982c0 con 0x7f80d0079e30 2024-09-04T16:53:01.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.569+0000 7f80e8a32640 1 -- 172.21.15.170:0/3532417777 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f80d0079e30 msgr2=0x7f80d007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:01.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.569+0000 7f80e8a32640 1 --2- 172.21.15.170:0/3532417777 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f80d0079e30 0x7f80d007c2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f80d4005d00 tx=0x7f80d400b410 comp rx=0 tx=0).stop 2024-09-04T16:53:01.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.569+0000 7f80e8a32640 1 -- 172.21.15.170:0/3532417777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80e4107930 msgr2=0x7f80e419dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:01.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.569+0000 7f80e8a32640 1 --2- 172.21.15.170:0/3532417777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80e4107930 0x7f80e419dc10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f80cc031460 tx=0x7f80cc0045e0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.569+0000 7f80e8a32640 1 -- 172.21.15.170:0/3532417777 shutdown_connections 2024-09-04T16:53:01.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.569+0000 7f80e8a32640 1 --2- 172.21.15.170:0/3532417777 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f80d0079e30 0x7f80d007c2f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.569+0000 7f80e8a32640 1 --2- 172.21.15.170:0/3532417777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80e4107930 0x7f80e419dc10 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.569+0000 7f80e8a32640 1 --2- 172.21.15.170:0/3532417777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80e4101930 0x7f80e419d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.569+0000 7f80e8a32640 1 -- 172.21.15.170:0/3532417777 >> 172.21.15.170:0/3532417777 conn(0x7f80e40fd630 msgr2=0x7f80e40fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:01.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.570+0000 7f80e8a32640 1 -- 172.21.15.170:0/3532417777 shutdown_connections 2024-09-04T16:53:01.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.570+0000 7f80e8a32640 1 -- 172.21.15.170:0/3532417777 wait complete. 2024-09-04T16:53:01.579 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:53:01.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.653+0000 7f2fe25d9640 1 -- 172.21.15.170:0/1659113233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fdc074e30 msgr2=0x7f2fdc10dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:01.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.653+0000 7f2fe25d9640 1 --2- 172.21.15.170:0/1659113233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fdc074e30 0x7f2fdc10dcb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009880 tx=0x7f2fd002a530 comp rx=0 tx=0).stop 2024-09-04T16:53:01.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.653+0000 7f2fe25d9640 1 -- 172.21.15.170:0/1659113233 shutdown_connections 2024-09-04T16:53:01.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.653+0000 7f2fe25d9640 1 --2- 172.21.15.170:0/1659113233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fdc074e30 0x7f2fdc10dcb0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.653+0000 7f2fe25d9640 1 --2- 172.21.15.170:0/1659113233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fdc074510 0x7f2fdc0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.653+0000 7f2fe25d9640 1 -- 172.21.15.170:0/1659113233 >> 172.21.15.170:0/1659113233 conn(0x7f2fdc0fd630 msgr2=0x7f2fdc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:01.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.653+0000 7f2fe25d9640 1 -- 172.21.15.170:0/1659113233 shutdown_connections 2024-09-04T16:53:01.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.653+0000 7f2fe25d9640 1 -- 172.21.15.170:0/1659113233 wait complete. 2024-09-04T16:53:01.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.654+0000 7f2fe25d9640 1 Processor -- start 2024-09-04T16:53:01.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.654+0000 7f2fe25d9640 1 -- start start 2024-09-04T16:53:01.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.654+0000 7f2fe25d9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fdc074510 0x7f2fdc19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:01.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.654+0000 7f2fe25d9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fdc074e30 0x7f2fdc19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:01.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.654+0000 7f2fe25d9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc110ff0 con 0x7f2fdc074510 2024-09-04T16:53:01.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.654+0000 7f2fe25d9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc110e70 con 0x7f2fdc074e30 2024-09-04T16:53:01.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.654+0000 7f2fdbfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fdc074510 0x7f2fdc19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:01.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.654+0000 7f2fdbfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fdc074510 0x7f2fdc19f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53764/0 (socket says 172.21.15.170:53764) 2024-09-04T16:53:01.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.654+0000 7f2fdbfff640 1 -- 172.21.15.170:0/1004587684 learned_addr learned my addr 172.21.15.170:0/1004587684 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:53:01.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.654+0000 7f2fdb7fe640 1 --2- 172.21.15.170:0/1004587684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fdc074e30 0x7f2fdc19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:01.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.655+0000 7f2fdbfff640 1 -- 172.21.15.170:0/1004587684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fdc074e30 msgr2=0x7f2fdc19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:01.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.655+0000 7f2fdbfff640 1 --2- 172.21.15.170:0/1004587684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fdc074e30 0x7f2fdc19fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.655+0000 7f2fdbfff640 1 -- 172.21.15.170:0/1004587684 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fdc1999e0 con 0x7f2fdc074510 2024-09-04T16:53:01.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.655+0000 7f2fdbfff640 1 --2- 172.21.15.170:0/1004587684 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fdc074510 0x7f2fdc19f820 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00c810 tx=0x7f2fcc00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:01.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.655+0000 7f2fd97fa640 1 -- 172.21.15.170:0/1004587684 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fcc004020 con 0x7f2fdc074510 2024-09-04T16:53:01.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.655+0000 7f2fd97fa640 1 -- 172.21.15.170:0/1004587684 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2fcc0041c0 con 0x7f2fdc074510 2024-09-04T16:53:01.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.655+0000 7f2fe25d9640 1 -- 172.21.15.170:0/1004587684 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fdc199cd0 con 0x7f2fdc074510 2024-09-04T16:53:01.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.655+0000 7f2fd97fa640 1 -- 172.21.15.170:0/1004587684 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fcc0047a0 con 0x7f2fdc074510 2024-09-04T16:53:01.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.655+0000 7f2fe25d9640 1 -- 172.21.15.170:0/1004587684 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fdc19a230 con 0x7f2fdc074510 2024-09-04T16:53:01.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.656+0000 7f2fe25d9640 1 -- 172.21.15.170:0/1004587684 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fdc075c50 con 0x7f2fdc074510 2024-09-04T16:53:01.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.657+0000 7f2fd97fa640 1 -- 172.21.15.170:0/1004587684 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f2fcc0079b0 con 0x7f2fdc074510 2024-09-04T16:53:01.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.657+0000 7f2fd97fa640 1 --2- 172.21.15.170:0/1004587684 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2fc4079e30 0x7f2fc407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:01.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.657+0000 7f2fd97fa640 1 -- 172.21.15.170:0/1004587684 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2fcc09c930 con 0x7f2fdc074510 2024-09-04T16:53:01.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.657+0000 7f2fdb7fe640 1 --2- 172.21.15.170:0/1004587684 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2fc4079e30 0x7f2fc407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:01.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.658+0000 7f2fdb7fe640 1 --2- 172.21.15.170:0/1004587684 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2fc4079e30 0x7f2fc407c2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc19b1d0 tx=0x7f2fd0031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:01.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.662+0000 7f2fd97fa640 1 -- 172.21.15.170:0/1004587684 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2fcc014030 con 0x7f2fdc074510 2024-09-04T16:53:01.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.855+0000 7f2fe25d9640 1 -- 172.21.15.170:0/1004587684 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2fdc19af10 con 0x7f2fc4079e30 2024-09-04T16:53:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.857+0000 7f2fd97fa640 1 -- 172.21.15.170:0/1004587684 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2fdc19af10 con 0x7f2fc4079e30 2024-09-04T16:53:01.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.859+0000 7f2fe25d9640 1 -- 172.21.15.170:0/1004587684 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2fc4079e30 msgr2=0x7f2fc407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:01.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.859+0000 7f2fe25d9640 1 --2- 172.21.15.170:0/1004587684 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2fc4079e30 0x7f2fc407c2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc19b1d0 tx=0x7f2fd0031400 comp rx=0 tx=0).stop 2024-09-04T16:53:01.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.859+0000 7f2fe25d9640 1 -- 172.21.15.170:0/1004587684 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fdc074510 msgr2=0x7f2fdc19f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:01.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.859+0000 7f2fe25d9640 1 --2- 172.21.15.170:0/1004587684 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fdc074510 0x7f2fdc19f820 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00c810 tx=0x7f2fcc00ccd0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.859+0000 7f2fe25d9640 1 -- 172.21.15.170:0/1004587684 shutdown_connections 2024-09-04T16:53:01.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.859+0000 7f2fe25d9640 1 --2- 172.21.15.170:0/1004587684 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f2fc4079e30 0x7f2fc407c2f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.859+0000 7f2fe25d9640 1 --2- 172.21.15.170:0/1004587684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fdc074e30 0x7f2fdc19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.859+0000 7f2fe25d9640 1 --2- 172.21.15.170:0/1004587684 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fdc074510 0x7f2fdc19f820 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.859+0000 7f2fe25d9640 1 -- 172.21.15.170:0/1004587684 >> 172.21.15.170:0/1004587684 conn(0x7f2fdc0fd630 msgr2=0x7f2fdc10b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:01.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.859+0000 7f2fe25d9640 1 -- 172.21.15.170:0/1004587684 shutdown_connections 2024-09-04T16:53:01.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.859+0000 7f2fe25d9640 1 -- 172.21.15.170:0/1004587684 wait complete. 2024-09-04T16:53:01.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.940+0000 7fe449dbc640 1 -- 172.21.15.170:0/830470771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe444101930 msgr2=0x7fe444101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:01.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.940+0000 7fe449dbc640 1 --2- 172.21.15.170:0/830470771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe444101930 0x7fe444101d90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe438009880 tx=0x7fe43802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.940+0000 7fe449dbc640 1 -- 172.21.15.170:0/830470771 shutdown_connections 2024-09-04T16:53:01.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.940+0000 7fe449dbc640 1 --2- 172.21.15.170:0/830470771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe444101930 0x7fe444101d90 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.940+0000 7fe449dbc640 1 --2- 172.21.15.170:0/830470771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe444107930 0x7fe444107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.940+0000 7fe449dbc640 1 -- 172.21.15.170:0/830470771 >> 172.21.15.170:0/830470771 conn(0x7fe4440fd630 msgr2=0x7fe4440ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:01.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.940+0000 7fe449dbc640 1 -- 172.21.15.170:0/830470771 shutdown_connections 2024-09-04T16:53:01.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.940+0000 7fe449dbc640 1 -- 172.21.15.170:0/830470771 wait complete. 2024-09-04T16:53:01.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.941+0000 7fe449dbc640 1 Processor -- start 2024-09-04T16:53:01.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.941+0000 7fe449dbc640 1 -- start start 2024-09-04T16:53:01.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.941+0000 7fe449dbc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe444101930 0x7fe44419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:01.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.941+0000 7fe449dbc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe444107930 0x7fe44419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:01.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.941+0000 7fe449dbc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe44410ee00 con 0x7fe444101930 2024-09-04T16:53:01.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.941+0000 7fe449dbc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe44410ec80 con 0x7fe444107930 2024-09-04T16:53:01.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.941+0000 7fe4437fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe444101930 0x7fe44419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:01.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.941+0000 7fe4437fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe444101930 0x7fe44419d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53780/0 (socket says 172.21.15.170:53780) 2024-09-04T16:53:01.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.941+0000 7fe4437fe640 1 -- 172.21.15.170:0/1968250686 learned_addr learned my addr 172.21.15.170:0/1968250686 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:53:01.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.941+0000 7fe442ffd640 1 --2- 172.21.15.170:0/1968250686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe444107930 0x7fe44419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:01.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.942+0000 7fe4437fe640 1 -- 172.21.15.170:0/1968250686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe444107930 msgr2=0x7fe44419dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:01.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.942+0000 7fe4437fe640 1 --2- 172.21.15.170:0/1968250686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe444107930 0x7fe44419dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:01.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.942+0000 7fe4437fe640 1 -- 172.21.15.170:0/1968250686 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe444197810 con 0x7fe444101930 2024-09-04T16:53:01.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.942+0000 7fe4437fe640 1 --2- 172.21.15.170:0/1968250686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe444101930 0x7fe44419d690 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe43400e970 tx=0x7fe43400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:01.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.942+0000 7fe440ff9640 1 -- 172.21.15.170:0/1968250686 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe43400cac0 con 0x7fe444101930 2024-09-04T16:53:01.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.942+0000 7fe440ff9640 1 -- 172.21.15.170:0/1968250686 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe4340054e0 con 0x7fe444101930 2024-09-04T16:53:01.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.942+0000 7fe449dbc640 1 -- 172.21.15.170:0/1968250686 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe444197b00 con 0x7fe444101930 2024-09-04T16:53:01.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.942+0000 7fe440ff9640 1 -- 172.21.15.170:0/1968250686 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe434010430 con 0x7fe444101930 2024-09-04T16:53:01.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.942+0000 7fe449dbc640 1 -- 172.21.15.170:0/1968250686 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe444198060 con 0x7fe444101930 2024-09-04T16:53:01.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.943+0000 7fe449dbc640 1 -- 172.21.15.170:0/1968250686 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe444103070 con 0x7fe444101930 2024-09-04T16:53:01.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.944+0000 7fe440ff9640 1 -- 172.21.15.170:0/1968250686 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fe434004e80 con 0x7fe444101930 2024-09-04T16:53:01.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.945+0000 7fe440ff9640 1 --2- 172.21.15.170:0/1968250686 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe42c079e30 0x7fe42c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:01.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.945+0000 7fe440ff9640 1 -- 172.21.15.170:0/1968250686 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe43409d0d0 con 0x7fe444101930 2024-09-04T16:53:01.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.945+0000 7fe442ffd640 1 --2- 172.21.15.170:0/1968250686 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe42c079e30 0x7fe42c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:01.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.945+0000 7fe442ffd640 1 --2- 172.21.15.170:0/1968250686 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe42c079e30 0x7fe42c07c2f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe444198b60 tx=0x7fe438031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:01.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:01.949+0000 7fe440ff9640 1 -- 172.21.15.170:0/1968250686 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe434064ae0 con 0x7fe444101930 2024-09-04T16:53:02.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.133+0000 7fe449dbc640 1 -- 172.21.15.170:0/1968250686 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe444198370 con 0x7fe42c079e30 2024-09-04T16:53:02.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.142+0000 7fe440ff9640 1 -- 172.21.15.170:0/1968250686 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fe444198370 con 0x7fe42c079e30 2024-09-04T16:53:02.142 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:53:02.143 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (20m) 14m ago 30m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:53:02.143 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (23m) 14m ago 31m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:53:02.143 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (22m) 13m ago 30m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:53:02.143 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (18m) 14m ago 31m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:53:02.143 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (18m) 13m ago 30m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:53:02.143 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (19m) 14m ago 30m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:53:02.143 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (14m) 14m ago 25m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:53:02.143 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (14m) 14m ago 25m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:53:02.143 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (13m) 13m ago 25m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:53:02.143 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (14m) 13m ago 25m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:53:02.143 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (22m) 14m ago 32m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:53:02.143 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (21m) 13m ago 29m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:53:02.144 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (18m) 14m ago 32m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:53:02.144 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (18m) 13m ago 29m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:53:02.144 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (20m) 14m ago 30m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:53:02.144 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (20m) 13m ago 30m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:53:02.144 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (17m) 14m ago 28m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:53:02.144 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (17m) 14m ago 28m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:53:02.144 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (16m) 14m ago 27m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:53:02.144 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (15m) 13m ago 27m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:53:02.144 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (15m) 13m ago 27m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:53:02.144 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (14m) 13m ago 26m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:53:02.144 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (20m) 14m ago 30m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:53:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.144+0000 7fe449dbc640 1 -- 172.21.15.170:0/1968250686 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe42c079e30 msgr2=0x7fe42c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.144+0000 7fe449dbc640 1 --2- 172.21.15.170:0/1968250686 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe42c079e30 0x7fe42c07c2f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe444198b60 tx=0x7fe438031400 comp rx=0 tx=0).stop 2024-09-04T16:53:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.144+0000 7fe449dbc640 1 -- 172.21.15.170:0/1968250686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe444101930 msgr2=0x7fe44419d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.144+0000 7fe449dbc640 1 --2- 172.21.15.170:0/1968250686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe444101930 0x7fe44419d690 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe43400e970 tx=0x7fe43400ed70 comp rx=0 tx=0).stop 2024-09-04T16:53:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.144+0000 7fe449dbc640 1 -- 172.21.15.170:0/1968250686 shutdown_connections 2024-09-04T16:53:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.144+0000 7fe449dbc640 1 --2- 172.21.15.170:0/1968250686 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe42c079e30 0x7fe42c07c2f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.144+0000 7fe449dbc640 1 --2- 172.21.15.170:0/1968250686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe444107930 0x7fe44419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.144+0000 7fe449dbc640 1 --2- 172.21.15.170:0/1968250686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe444101930 0x7fe44419d690 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.144+0000 7fe449dbc640 1 -- 172.21.15.170:0/1968250686 >> 172.21.15.170:0/1968250686 conn(0x7fe4440fd630 msgr2=0x7fe4440fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.145+0000 7fe449dbc640 1 -- 172.21.15.170:0/1968250686 shutdown_connections 2024-09-04T16:53:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.145+0000 7fe449dbc640 1 -- 172.21.15.170:0/1968250686 wait complete. 2024-09-04T16:53:02.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.225+0000 7f8f4d7b5640 1 -- 172.21.15.170:0/312528788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f48102ae0 msgr2=0x7f8f48102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:02.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.225+0000 7f8f4d7b5640 1 --2- 172.21.15.170:0/312528788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f48102ae0 0x7f8f48102ec0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009880 tx=0x7f8f3802a530 comp rx=0 tx=0).stop 2024-09-04T16:53:02.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.225+0000 7f8f4d7b5640 1 -- 172.21.15.170:0/312528788 shutdown_connections 2024-09-04T16:53:02.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.225+0000 7f8f4d7b5640 1 --2- 172.21.15.170:0/312528788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f48103400 0x7f8f4810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.225+0000 7f8f4d7b5640 1 --2- 172.21.15.170:0/312528788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f48102ae0 0x7f8f48102ec0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.225+0000 7f8f4d7b5640 1 -- 172.21.15.170:0/312528788 >> 172.21.15.170:0/312528788 conn(0x7f8f480fc520 msgr2=0x7f8f480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:02.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.225+0000 7f8f4d7b5640 1 -- 172.21.15.170:0/312528788 shutdown_connections 2024-09-04T16:53:02.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.225+0000 7f8f4d7b5640 1 -- 172.21.15.170:0/312528788 wait complete. 2024-09-04T16:53:02.227 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:02 smithi170 ceph-mon[113855]: pgmap v699: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:02.227 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:02 smithi170 ceph-mon[113855]: from='client.35090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:53:02.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.226+0000 7f8f4d7b5640 1 Processor -- start 2024-09-04T16:53:02.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.226+0000 7f8f4d7b5640 1 -- start start 2024-09-04T16:53:02.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.226+0000 7f8f4d7b5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f48102ae0 0x7f8f48100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:02.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.226+0000 7f8f4d7b5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f48103400 0x7f8f48100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:02.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.226+0000 7f8f4d7b5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4810edf0 con 0x7f8f48103400 2024-09-04T16:53:02.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.226+0000 7f8f4d7b5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4810ec70 con 0x7f8f48102ae0 2024-09-04T16:53:02.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.226+0000 7f8f3ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f48103400 0x7f8f48100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:02.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.226+0000 7f8f3ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f48103400 0x7f8f48100c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53804/0 (socket says 172.21.15.170:53804) 2024-09-04T16:53:02.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.226+0000 7f8f3ffff640 1 -- 172.21.15.170:0/1565717554 learned_addr learned my addr 172.21.15.170:0/1565717554 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:53:02.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.226+0000 7f8f46ffd640 1 --2- 172.21.15.170:0/1565717554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f48102ae0 0x7f8f48100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:02.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.227+0000 7f8f3ffff640 1 -- 172.21.15.170:0/1565717554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f48102ae0 msgr2=0x7f8f48100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:02.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.227+0000 7f8f3ffff640 1 --2- 172.21.15.170:0/1565717554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f48102ae0 0x7f8f48100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.227+0000 7f8f3ffff640 1 -- 172.21.15.170:0/1565717554 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f481011c0 con 0x7f8f48103400 2024-09-04T16:53:02.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.227+0000 7f8f3ffff640 1 --2- 172.21.15.170:0/1565717554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f48103400 0x7f8f48100c80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000c8f0 tx=0x7f8f3000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:02.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.227+0000 7f8f44ff9640 1 -- 172.21.15.170:0/1565717554 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f300079b0 con 0x7f8f48103400 2024-09-04T16:53:02.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.227+0000 7f8f44ff9640 1 -- 172.21.15.170:0/1565717554 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f30007b50 con 0x7f8f48103400 2024-09-04T16:53:02.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.227+0000 7f8f4d7b5640 1 -- 172.21.15.170:0/1565717554 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f481014b0 con 0x7f8f48103400 2024-09-04T16:53:02.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.227+0000 7f8f44ff9640 1 -- 172.21.15.170:0/1565717554 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f30018610 con 0x7f8f48103400 2024-09-04T16:53:02.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.227+0000 7f8f4d7b5640 1 -- 172.21.15.170:0/1565717554 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f481a3e00 con 0x7f8f48103400 2024-09-04T16:53:02.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.228+0000 7f8f4d7b5640 1 -- 172.21.15.170:0/1565717554 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f4806abe0 con 0x7f8f48103400 2024-09-04T16:53:02.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.229+0000 7f8f44ff9640 1 -- 172.21.15.170:0/1565717554 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f8f30007d00 con 0x7f8f48103400 2024-09-04T16:53:02.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.229+0000 7f8f44ff9640 1 --2- 172.21.15.170:0/1565717554 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8f34079e30 0x7f8f3407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:02.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.229+0000 7f8f44ff9640 1 -- 172.21.15.170:0/1565717554 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8f3009cbd0 con 0x7f8f48103400 2024-09-04T16:53:02.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.229+0000 7f8f46ffd640 1 --2- 172.21.15.170:0/1565717554 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8f34079e30 0x7f8f3407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:02.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.230+0000 7f8f46ffd640 1 --2- 172.21.15.170:0/1565717554 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8f34079e30 0x7f8f3407c2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8f38000c00 tx=0x7f8f38031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:02.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.234+0000 7f8f44ff9640 1 -- 172.21.15.170:0/1565717554 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8f30014030 con 0x7f8f48103400 2024-09-04T16:53:02.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:02 smithi193 ceph-mon[82547]: pgmap v699: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:02.431 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:02 smithi193 ceph-mon[82547]: from='client.35090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:53:02.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.476+0000 7f8f4d7b5640 1 -- 172.21.15.170:0/1565717554 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8f48105fb0 con 0x7f8f48103400 2024-09-04T16:53:02.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.476+0000 7f8f44ff9640 1 -- 172.21.15.170:0/1565717554 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f8f300645e0 con 0x7f8f48103400 2024-09-04T16:53:02.477 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:53:02.477 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:53:02.477 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:53:02.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:53:02.478 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:53:02.478 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:53:02.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:53:02.478 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:53:02.478 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:53:02.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:53:02.478 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:53:02.478 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:53:02.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:53:02.478 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:53:02.478 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:53:02.478 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:53:02.478 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:53:02.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.478+0000 7f8f4d7b5640 1 -- 172.21.15.170:0/1565717554 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8f34079e30 msgr2=0x7f8f3407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:02.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.478+0000 7f8f4d7b5640 1 --2- 172.21.15.170:0/1565717554 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8f34079e30 0x7f8f3407c2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8f38000c00 tx=0x7f8f38031400 comp rx=0 tx=0).stop 2024-09-04T16:53:02.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.478+0000 7f8f4d7b5640 1 -- 172.21.15.170:0/1565717554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f48103400 msgr2=0x7f8f48100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:02.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.478+0000 7f8f4d7b5640 1 --2- 172.21.15.170:0/1565717554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f48103400 0x7f8f48100c80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000c8f0 tx=0x7f8f3000cdb0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.478+0000 7f8f4d7b5640 1 -- 172.21.15.170:0/1565717554 shutdown_connections 2024-09-04T16:53:02.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.478+0000 7f8f4d7b5640 1 --2- 172.21.15.170:0/1565717554 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8f34079e30 0x7f8f3407c2f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.478+0000 7f8f4d7b5640 1 --2- 172.21.15.170:0/1565717554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f48103400 0x7f8f48100c80 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.478+0000 7f8f4d7b5640 1 --2- 172.21.15.170:0/1565717554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f48102ae0 0x7f8f48100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.478+0000 7f8f4d7b5640 1 -- 172.21.15.170:0/1565717554 >> 172.21.15.170:0/1565717554 conn(0x7f8f480fc520 msgr2=0x7f8f48108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:02.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.479+0000 7f8f4d7b5640 1 -- 172.21.15.170:0/1565717554 shutdown_connections 2024-09-04T16:53:02.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.479+0000 7f8f4d7b5640 1 -- 172.21.15.170:0/1565717554 wait complete. 2024-09-04T16:53:02.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.560+0000 7f6f6fdfb640 1 -- 172.21.15.170:0/1839975998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f68103460 msgr2=0x7f6f6810b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:02.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.560+0000 7f6f6fdfb640 1 --2- 172.21.15.170:0/1839975998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f68103460 0x7f6f6810b950 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6f580098b0 tx=0x7f6f5802a560 comp rx=0 tx=0).stop 2024-09-04T16:53:02.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.561+0000 7f6f6fdfb640 1 -- 172.21.15.170:0/1839975998 shutdown_connections 2024-09-04T16:53:02.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.561+0000 7f6f6fdfb640 1 --2- 172.21.15.170:0/1839975998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f68103460 0x7f6f6810b950 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.561+0000 7f6f6fdfb640 1 --2- 172.21.15.170:0/1839975998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f68102b40 0x7f6f68102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.561+0000 7f6f6fdfb640 1 -- 172.21.15.170:0/1839975998 >> 172.21.15.170:0/1839975998 conn(0x7f6f680fc520 msgr2=0x7f6f680fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:02.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.561+0000 7f6f6fdfb640 1 -- 172.21.15.170:0/1839975998 shutdown_connections 2024-09-04T16:53:02.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.561+0000 7f6f6fdfb640 1 -- 172.21.15.170:0/1839975998 wait complete. 2024-09-04T16:53:02.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.561+0000 7f6f6fdfb640 1 Processor -- start 2024-09-04T16:53:02.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.561+0000 7f6f6fdfb640 1 -- start start 2024-09-04T16:53:02.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.561+0000 7f6f6fdfb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f68102b40 0x7f6f681007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:02.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.561+0000 7f6f6fdfb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f68103460 0x7f6f68100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:02.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.561+0000 7f6f6fdfb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6810ee10 con 0x7f6f68103460 2024-09-04T16:53:02.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.561+0000 7f6f6fdfb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6810ec90 con 0x7f6f68102b40 2024-09-04T16:53:02.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.562+0000 7f6f6d396640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f68103460 0x7f6f68100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:02.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.562+0000 7f6f6d396640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f68103460 0x7f6f68100ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53814/0 (socket says 172.21.15.170:53814) 2024-09-04T16:53:02.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.562+0000 7f6f6db97640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f68102b40 0x7f6f681007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:02.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.562+0000 7f6f6d396640 1 -- 172.21.15.170:0/2719328234 learned_addr learned my addr 172.21.15.170:0/2719328234 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:53:02.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.562+0000 7f6f6d396640 1 -- 172.21.15.170:0/2719328234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f68102b40 msgr2=0x7f6f681007a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:02.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.562+0000 7f6f6d396640 1 --2- 172.21.15.170:0/2719328234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f68102b40 0x7f6f681007a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.562+0000 7f6f6d396640 1 -- 172.21.15.170:0/2719328234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f68101220 con 0x7f6f68103460 2024-09-04T16:53:02.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.562+0000 7f6f6d396640 1 --2- 172.21.15.170:0/2719328234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f68103460 0x7f6f68100ce0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6f58031460 tx=0x7f6f580045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:02.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.562+0000 7f6f5effd640 1 -- 172.21.15.170:0/2719328234 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f5803f070 con 0x7f6f68103460 2024-09-04T16:53:02.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.562+0000 7f6f6fdfb640 1 -- 172.21.15.170:0/2719328234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f681014b0 con 0x7f6f68103460 2024-09-04T16:53:02.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.562+0000 7f6f5effd640 1 -- 172.21.15.170:0/2719328234 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f580035f0 con 0x7f6f68103460 2024-09-04T16:53:02.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.562+0000 7f6f5effd640 1 -- 172.21.15.170:0/2719328234 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f58035030 con 0x7f6f68103460 2024-09-04T16:53:02.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.562+0000 7f6f6fdfb640 1 -- 172.21.15.170:0/2719328234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f681a3e00 con 0x7f6f68103460 2024-09-04T16:53:02.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.563+0000 7f6f6fdfb640 1 -- 172.21.15.170:0/2719328234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f6806ab80 con 0x7f6f68103460 2024-09-04T16:53:02.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.564+0000 7f6f5effd640 1 -- 172.21.15.170:0/2719328234 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f6f58042070 con 0x7f6f68103460 2024-09-04T16:53:02.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.564+0000 7f6f5effd640 1 --2- 172.21.15.170:0/2719328234 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6f54079e30 0x7f6f5407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:02.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.565+0000 7f6f5effd640 1 -- 172.21.15.170:0/2719328234 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6f580bd390 con 0x7f6f68103460 2024-09-04T16:53:02.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.565+0000 7f6f6db97640 1 --2- 172.21.15.170:0/2719328234 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6f54079e30 0x7f6f5407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:02.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.565+0000 7f6f6db97640 1 --2- 172.21.15.170:0/2719328234 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6f54079e30 0x7f6f5407c2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6f64005fd0 tx=0x7f6f6400b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:02.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.569+0000 7f6f5effd640 1 -- 172.21.15.170:0/2719328234 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6f58088f10 con 0x7f6f68103460 2024-09-04T16:53:02.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.778+0000 7f6f6fdfb640 1 -- 172.21.15.170:0/2719328234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6f68105fd0 con 0x7f6f68103460 2024-09-04T16:53:02.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.779+0000 7f6f5effd640 1 -- 172.21.15.170:0/2719328234 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7f6f5808d930 con 0x7f6f68103460 2024-09-04T16:53:02.779 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:53:02.779 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:53:02.780 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:53:02.780 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:53:02.780 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:53:02.780 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:53:02.780 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:53:02.780 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:53:02.780 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:53:02.780 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:53:02.780 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:53:02.780 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:53:02.780 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:53:02.780 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:53:02.780 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:53:02.780 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:53:02.781 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:53:02.781 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:53:02.781 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:53:02.781 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:53:02.781 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:53:02.781 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:53:02.781 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:53:02.781 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:53:02.781 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:53:02.781 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:53:02.781 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:53:02.781 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:53:02.781 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:53:02.782 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:53:02.782 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:53:02.782 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:53:02.782 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:53:02.782 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:53:02.782 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:53:02.782 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:53:02.782 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:53:02.782 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:53:02.782 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:53:02.782 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:53:02.782 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:53:02.782 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:53:02.782 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:53:02.783 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:53:02.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.781+0000 7f6f6fdfb640 1 -- 172.21.15.170:0/2719328234 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6f54079e30 msgr2=0x7f6f5407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:02.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.781+0000 7f6f6fdfb640 1 --2- 172.21.15.170:0/2719328234 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6f54079e30 0x7f6f5407c2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6f64005fd0 tx=0x7f6f6400b390 comp rx=0 tx=0).stop 2024-09-04T16:53:02.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.781+0000 7f6f6fdfb640 1 -- 172.21.15.170:0/2719328234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f68103460 msgr2=0x7f6f68100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:02.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.781+0000 7f6f6fdfb640 1 --2- 172.21.15.170:0/2719328234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f68103460 0x7f6f68100ce0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6f58031460 tx=0x7f6f580045c0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.781+0000 7f6f6fdfb640 1 -- 172.21.15.170:0/2719328234 shutdown_connections 2024-09-04T16:53:02.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.781+0000 7f6f6fdfb640 1 --2- 172.21.15.170:0/2719328234 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6f54079e30 0x7f6f5407c2f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.781+0000 7f6f6fdfb640 1 --2- 172.21.15.170:0/2719328234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f68103460 0x7f6f68100ce0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.781+0000 7f6f6fdfb640 1 --2- 172.21.15.170:0/2719328234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f68102b40 0x7f6f681007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.781+0000 7f6f6fdfb640 1 -- 172.21.15.170:0/2719328234 >> 172.21.15.170:0/2719328234 conn(0x7f6f680fc520 msgr2=0x7f6f68103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:02.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.781+0000 7f6f6fdfb640 1 -- 172.21.15.170:0/2719328234 shutdown_connections 2024-09-04T16:53:02.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.781+0000 7f6f6fdfb640 1 -- 172.21.15.170:0/2719328234 wait complete. 2024-09-04T16:53:02.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.862+0000 7f0e6b49f640 1 -- 172.21.15.170:0/1619547133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e64100820 msgr2=0x7f0e64100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:02.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.862+0000 7f0e6b49f640 1 --2- 172.21.15.170:0/1619547133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e64100820 0x7f0e64100c80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009880 tx=0x7f0e6002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.863+0000 7f0e6b49f640 1 -- 172.21.15.170:0/1619547133 shutdown_connections 2024-09-04T16:53:02.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.863+0000 7f0e6b49f640 1 --2- 172.21.15.170:0/1619547133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e64100820 0x7f0e64100c80 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.863+0000 7f0e6b49f640 1 --2- 172.21.15.170:0/1619547133 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e64106820 0x7f0e64106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.863+0000 7f0e6b49f640 1 -- 172.21.15.170:0/1619547133 >> 172.21.15.170:0/1619547133 conn(0x7f0e640fc520 msgr2=0x7f0e640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.863+0000 7f0e6b49f640 1 -- 172.21.15.170:0/1619547133 shutdown_connections 2024-09-04T16:53:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.863+0000 7f0e6b49f640 1 -- 172.21.15.170:0/1619547133 wait complete. 2024-09-04T16:53:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.863+0000 7f0e6b49f640 1 Processor -- start 2024-09-04T16:53:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.863+0000 7f0e6b49f640 1 -- start start 2024-09-04T16:53:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.863+0000 7f0e6b49f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e64100820 0x7f0e641965f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.863+0000 7f0e6b49f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e64106820 0x7f0e64196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.863+0000 7f0e6b49f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6410dcd0 con 0x7f0e64106820 2024-09-04T16:53:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.863+0000 7f0e6b49f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6410db50 con 0x7f0e64100820 2024-09-04T16:53:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.864+0000 7f0e68a3a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e64106820 0x7f0e64196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.864+0000 7f0e68a3a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e64106820 0x7f0e64196b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53838/0 (socket says 172.21.15.170:53838) 2024-09-04T16:53:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.864+0000 7f0e68a3a640 1 -- 172.21.15.170:0/3569188307 learned_addr learned my addr 172.21.15.170:0/3569188307 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:53:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.864+0000 7f0e6923b640 1 --2- 172.21.15.170:0/3569188307 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e64100820 0x7f0e641965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.864+0000 7f0e68a3a640 1 -- 172.21.15.170:0/3569188307 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e64100820 msgr2=0x7f0e641965f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.864+0000 7f0e68a3a640 1 --2- 172.21.15.170:0/3569188307 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e64100820 0x7f0e641965f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.864+0000 7f0e68a3a640 1 -- 172.21.15.170:0/3569188307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e64197070 con 0x7f0e64106820 2024-09-04T16:53:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.864+0000 7f0e68a3a640 1 --2- 172.21.15.170:0/3569188307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e64106820 0x7f0e64196b30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0e60031460 tx=0x7f0e600048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.864+0000 7f0e5a7fc640 1 -- 172.21.15.170:0/3569188307 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e6003f070 con 0x7f0e64106820 2024-09-04T16:53:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.864+0000 7f0e5a7fc640 1 -- 172.21.15.170:0/3569188307 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0e60004cf0 con 0x7f0e64106820 2024-09-04T16:53:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.864+0000 7f0e6b49f640 1 -- 172.21.15.170:0/3569188307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e64197300 con 0x7f0e64106820 2024-09-04T16:53:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.864+0000 7f0e6b49f640 1 -- 172.21.15.170:0/3569188307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e641a3e30 con 0x7f0e64106820 2024-09-04T16:53:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.864+0000 7f0e5a7fc640 1 -- 172.21.15.170:0/3569188307 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e60035030 con 0x7f0e64106820 2024-09-04T16:53:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.865+0000 7f0e6b49f640 1 -- 172.21.15.170:0/3569188307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e64101f60 con 0x7f0e64106820 2024-09-04T16:53:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.866+0000 7f0e5a7fc640 1 -- 172.21.15.170:0/3569188307 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f0e60042070 con 0x7f0e64106820 2024-09-04T16:53:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.866+0000 7f0e5a7fc640 1 --2- 172.21.15.170:0/3569188307 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0e50079e80 0x7f0e5007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.866+0000 7f0e5a7fc640 1 -- 172.21.15.170:0/3569188307 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f0e600bd430 con 0x7f0e64106820 2024-09-04T16:53:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.866+0000 7f0e6923b640 1 --2- 172.21.15.170:0/3569188307 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0e50079e80 0x7f0e5007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.867+0000 7f0e6923b640 1 --2- 172.21.15.170:0/3569188307 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0e50079e80 0x7f0e5007c340 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400abe0 tx=0x7f0e5400a2d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:02.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:02.871+0000 7f0e5a7fc640 1 -- 172.21.15.170:0/3569188307 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0e60084ec0 con 0x7f0e64106820 2024-09-04T16:53:03.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.062+0000 7f0e6b49f640 1 -- 172.21.15.170:0/3569188307 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0e64062630 con 0x7f0e50079e80 2024-09-04T16:53:03.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.063+0000 7f0e5a7fc640 1 -- 172.21.15.170:0/3569188307 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f0e64062630 con 0x7f0e50079e80 2024-09-04T16:53:03.064 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:53:03.064 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:53:03.064 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:53:03.064 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:53:03.064 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:53:03.064 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:53:03.064 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:53:03.064 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:53:03.064 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:53:03.064 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:53:03.064 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:53:03.065 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:53:03.065 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:53:03.065 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:53:03.065 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:53:03.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.065+0000 7f0e6b49f640 1 -- 172.21.15.170:0/3569188307 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0e50079e80 msgr2=0x7f0e5007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:03.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.065+0000 7f0e6b49f640 1 --2- 172.21.15.170:0/3569188307 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0e50079e80 0x7f0e5007c340 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400abe0 tx=0x7f0e5400a2d0 comp rx=0 tx=0).stop 2024-09-04T16:53:03.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.065+0000 7f0e6b49f640 1 -- 172.21.15.170:0/3569188307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e64106820 msgr2=0x7f0e64196b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.065+0000 7f0e6b49f640 1 --2- 172.21.15.170:0/3569188307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e64106820 0x7f0e64196b30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0e60031460 tx=0x7f0e600048f0 comp rx=0 tx=0).stop 2024-09-04T16:53:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.065+0000 7f0e6b49f640 1 -- 172.21.15.170:0/3569188307 shutdown_connections 2024-09-04T16:53:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.065+0000 7f0e6b49f640 1 --2- 172.21.15.170:0/3569188307 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0e50079e80 0x7f0e5007c340 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.065+0000 7f0e6b49f640 1 --2- 172.21.15.170:0/3569188307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e64106820 0x7f0e64196b30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.065+0000 7f0e6b49f640 1 --2- 172.21.15.170:0/3569188307 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e64100820 0x7f0e641965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.065+0000 7f0e6b49f640 1 -- 172.21.15.170:0/3569188307 >> 172.21.15.170:0/3569188307 conn(0x7f0e640fc520 msgr2=0x7f0e640fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.065+0000 7f0e6b49f640 1 -- 172.21.15.170:0/3569188307 shutdown_connections 2024-09-04T16:53:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.065+0000 7f0e6b49f640 1 -- 172.21.15.170:0/3569188307 wait complete. 2024-09-04T16:53:03.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.147+0000 7f13a6ef1640 1 -- 172.21.15.170:0/2314174557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13a0101930 msgr2=0x7f13a0101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:03.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.147+0000 7f13a6ef1640 1 --2- 172.21.15.170:0/2314174557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13a0101930 0x7f13a0101d90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f138c009880 tx=0x7f138c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:53:03.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.147+0000 7f13a6ef1640 1 -- 172.21.15.170:0/2314174557 shutdown_connections 2024-09-04T16:53:03.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.147+0000 7f13a6ef1640 1 --2- 172.21.15.170:0/2314174557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13a0101930 0x7f13a0101d90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:03.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.147+0000 7f13a6ef1640 1 --2- 172.21.15.170:0/2314174557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13a0107930 0x7f13a0107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:03.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.147+0000 7f13a6ef1640 1 -- 172.21.15.170:0/2314174557 >> 172.21.15.170:0/2314174557 conn(0x7f13a00fd630 msgr2=0x7f13a00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:03.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.147+0000 7f13a6ef1640 1 -- 172.21.15.170:0/2314174557 shutdown_connections 2024-09-04T16:53:03.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.147+0000 7f13a6ef1640 1 -- 172.21.15.170:0/2314174557 wait complete. 2024-09-04T16:53:03.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.148+0000 7f13a6ef1640 1 Processor -- start 2024-09-04T16:53:03.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.148+0000 7f13a6ef1640 1 -- start start 2024-09-04T16:53:03.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.148+0000 7f13a6ef1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13a0101930 0x7f13a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:03.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.148+0000 7f13a6ef1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13a0107930 0x7f13a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:03.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.148+0000 7f13a6ef1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f13a010ede0 con 0x7f13a0107930 2024-09-04T16:53:03.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.148+0000 7f13a6ef1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f13a010ec60 con 0x7f13a0101930 2024-09-04T16:53:03.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.148+0000 7f139ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13a0107930 0x7f13a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:03.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.148+0000 7f139ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13a0107930 0x7f13a0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53858/0 (socket says 172.21.15.170:53858) 2024-09-04T16:53:03.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.148+0000 7f139ffff640 1 -- 172.21.15.170:0/1005658081 learned_addr learned my addr 172.21.15.170:0/1005658081 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:53:03.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.148+0000 7f13a4c8d640 1 --2- 172.21.15.170:0/1005658081 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13a0101930 0x7f13a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:03.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.148+0000 7f139ffff640 1 -- 172.21.15.170:0/1005658081 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13a0101930 msgr2=0x7f13a00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:03.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.148+0000 7f139ffff640 1 --2- 172.21.15.170:0/1005658081 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13a0101930 0x7f13a00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:03.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.148+0000 7f139ffff640 1 -- 172.21.15.170:0/1005658081 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a0074f70 con 0x7f13a0107930 2024-09-04T16:53:03.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.149+0000 7f139ffff640 1 --2- 172.21.15.170:0/1005658081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13a0107930 0x7f13a0074a30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f138c031460 tx=0x7f138c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:03.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.149+0000 7f139dffb640 1 -- 172.21.15.170:0/1005658081 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f138c03f070 con 0x7f13a0107930 2024-09-04T16:53:03.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.149+0000 7f139dffb640 1 -- 172.21.15.170:0/1005658081 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f138c0035f0 con 0x7f13a0107930 2024-09-04T16:53:03.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.149+0000 7f13a6ef1640 1 -- 172.21.15.170:0/1005658081 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a0075200 con 0x7f13a0107930 2024-09-04T16:53:03.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.149+0000 7f139dffb640 1 -- 172.21.15.170:0/1005658081 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f138c035030 con 0x7f13a0107930 2024-09-04T16:53:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.149+0000 7f13a6ef1640 1 -- 172.21.15.170:0/1005658081 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a01a3e10 con 0x7f13a0107930 2024-09-04T16:53:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.150+0000 7f13a6ef1640 1 -- 172.21.15.170:0/1005658081 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a0103070 con 0x7f13a0107930 2024-09-04T16:53:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.151+0000 7f139dffb640 1 -- 172.21.15.170:0/1005658081 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f138c042070 con 0x7f13a0107930 2024-09-04T16:53:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.151+0000 7f139dffb640 1 --2- 172.21.15.170:0/1005658081 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1390079e30 0x7f139007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.151+0000 7f139dffb640 1 -- 172.21.15.170:0/1005658081 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f138c0bd460 con 0x7f13a0107930 2024-09-04T16:53:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.151+0000 7f13a4c8d640 1 --2- 172.21.15.170:0/1005658081 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1390079e30 0x7f139007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.152+0000 7f13a4c8d640 1 --2- 172.21.15.170:0/1005658081 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1390079e30 0x7f139007c2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1394005fd0 tx=0x7f139400b590 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:03.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.156+0000 7f139dffb640 1 -- 172.21.15.170:0/1005658081 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f138c084e70 con 0x7f13a0107930 2024-09-04T16:53:03.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:03 smithi170 ceph-mon[113855]: from='client.35094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:53:03.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:03 smithi170 ceph-mon[113855]: from='client.35098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:53:03.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:03 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1565717554' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:53:03.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:03 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2719328234' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:53:03.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.401+0000 7f13a6ef1640 1 -- 172.21.15.170:0/1005658081 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f13a0109ec0 con 0x7f13a0107930 2024-09-04T16:53:03.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.401+0000 7f139dffb640 1 -- 172.21.15.170:0/1005658081 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f138c088fe0 con 0x7f13a0107930 2024-09-04T16:53:03.402 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:53:03.403 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:53:03.403 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:53:03.403 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:53:03.403 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:53:03.403 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:53:03.403 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:53:03.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.404+0000 7f13a6ef1640 1 -- 172.21.15.170:0/1005658081 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1390079e30 msgr2=0x7f139007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:03.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.404+0000 7f13a6ef1640 1 --2- 172.21.15.170:0/1005658081 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1390079e30 0x7f139007c2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1394005fd0 tx=0x7f139400b590 comp rx=0 tx=0).stop 2024-09-04T16:53:03.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.404+0000 7f13a6ef1640 1 -- 172.21.15.170:0/1005658081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13a0107930 msgr2=0x7f13a0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:03.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.404+0000 7f13a6ef1640 1 --2- 172.21.15.170:0/1005658081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13a0107930 0x7f13a0074a30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f138c031460 tx=0x7f138c0045e0 comp rx=0 tx=0).stop 2024-09-04T16:53:03.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.404+0000 7f13a6ef1640 1 -- 172.21.15.170:0/1005658081 shutdown_connections 2024-09-04T16:53:03.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.404+0000 7f13a6ef1640 1 --2- 172.21.15.170:0/1005658081 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1390079e30 0x7f139007c2f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:03.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.404+0000 7f13a6ef1640 1 --2- 172.21.15.170:0/1005658081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13a0107930 0x7f13a0074a30 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:03.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.404+0000 7f13a6ef1640 1 --2- 172.21.15.170:0/1005658081 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13a0101930 0x7f13a00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:03.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.404+0000 7f13a6ef1640 1 -- 172.21.15.170:0/1005658081 >> 172.21.15.170:0/1005658081 conn(0x7f13a00fd630 msgr2=0x7f13a00fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:03.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.404+0000 7f13a6ef1640 1 -- 172.21.15.170:0/1005658081 shutdown_connections 2024-09-04T16:53:03.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:03.404+0000 7f13a6ef1640 1 -- 172.21.15.170:0/1005658081 wait complete. 2024-09-04T16:53:03.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:03 smithi193 ceph-mon[82547]: from='client.35094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:53:03.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:03 smithi193 ceph-mon[82547]: from='client.35098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:53:03.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:03 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1565717554' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:53:03.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:03 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2719328234' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:53:04.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:04 smithi170 ceph-mon[113855]: pgmap v700: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:04.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:04 smithi170 ceph-mon[113855]: from='client.35110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:53:04.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:04 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1005658081' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:53:04.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:04 smithi193 ceph-mon[82547]: pgmap v700: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:04.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:04 smithi193 ceph-mon[82547]: from='client.35110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:53:04.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:04 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1005658081' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:53:06.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:06 smithi170 ceph-mon[113855]: pgmap v701: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:06.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:06 smithi193 ceph-mon[82547]: pgmap v701: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:08.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:08 smithi193 ceph-mon[82547]: pgmap v702: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:08.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:08 smithi170 ceph-mon[113855]: pgmap v702: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:10.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:10 smithi170 ceph-mon[113855]: pgmap v703: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:10.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:10 smithi193 ceph-mon[82547]: pgmap v703: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:12.220 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:12 smithi170 ceph-mon[113855]: pgmap v704: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:12.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:12 smithi193 ceph-mon[82547]: pgmap v704: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:14.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:14 smithi170 ceph-mon[113855]: pgmap v705: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:14.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:14 smithi193 ceph-mon[82547]: pgmap v705: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:15.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:15 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:53:15.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:15 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:53:16.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:16 smithi170 ceph-mon[113855]: pgmap v706: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:16.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:16 smithi193 ceph-mon[82547]: pgmap v706: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:18.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:18 smithi170 ceph-mon[113855]: pgmap v707: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:18.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:18 smithi193 ceph-mon[82547]: pgmap v707: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:20.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:20 smithi170 ceph-mon[113855]: pgmap v708: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:20.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:20 smithi193 ceph-mon[82547]: pgmap v708: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:22.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:22 smithi170 ceph-mon[113855]: pgmap v709: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:22.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:22 smithi193 ceph-mon[82547]: pgmap v709: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:24.328 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:24 smithi170 ceph-mon[113855]: pgmap v710: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:24.410 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:24 smithi193 ceph-mon[82547]: pgmap v710: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:26.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:26 smithi170 ceph-mon[113855]: pgmap v711: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:26.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:26 smithi193 ceph-mon[82547]: pgmap v711: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:28.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:28 smithi170 ceph-mon[113855]: pgmap v712: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:28.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:28 smithi193 ceph-mon[82547]: pgmap v712: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:30.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:30 smithi170 ceph-mon[113855]: pgmap v713: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:30.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:53:30.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:30 smithi193 ceph-mon[82547]: pgmap v713: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:30.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:53:32.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:32 smithi170 ceph-mon[113855]: pgmap v714: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:32.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:32 smithi193 ceph-mon[82547]: pgmap v714: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:33.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.494+0000 7f003a7b4640 1 -- 172.21.15.170:0/3401440052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0034107930 msgr2=0x7f0034107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:33.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.494+0000 7f003a7b4640 1 --2- 172.21.15.170:0/3401440052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0034107930 0x7f0034107d10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0024009880 tx=0x7f002402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:53:33.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.494+0000 7f003a7b4640 1 -- 172.21.15.170:0/3401440052 shutdown_connections 2024-09-04T16:53:33.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.494+0000 7f003a7b4640 1 --2- 172.21.15.170:0/3401440052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0034101930 0x7f0034101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:33.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.494+0000 7f003a7b4640 1 --2- 172.21.15.170:0/3401440052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0034107930 0x7f0034107d10 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:33.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.494+0000 7f003a7b4640 1 -- 172.21.15.170:0/3401440052 >> 172.21.15.170:0/3401440052 conn(0x7f00340fd630 msgr2=0x7f00340ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:33.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.494+0000 7f003a7b4640 1 -- 172.21.15.170:0/3401440052 shutdown_connections 2024-09-04T16:53:33.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.494+0000 7f003a7b4640 1 -- 172.21.15.170:0/3401440052 wait complete. 2024-09-04T16:53:33.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.495+0000 7f003a7b4640 1 Processor -- start 2024-09-04T16:53:33.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.495+0000 7f003a7b4640 1 -- start start 2024-09-04T16:53:33.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.495+0000 7f003a7b4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0034101930 0x7f003419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:33.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.495+0000 7f003a7b4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0034107930 0x7f003419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:33.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.495+0000 7f003a7b4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f003410ee00 con 0x7f0034107930 2024-09-04T16:53:33.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.495+0000 7f003a7b4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f003410ec80 con 0x7f0034101930 2024-09-04T16:53:33.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.495+0000 7f00337fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0034107930 0x7f003419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:33.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.495+0000 7f00337fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0034107930 0x7f003419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47152/0 (socket says 172.21.15.170:47152) 2024-09-04T16:53:33.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.495+0000 7f00337fe640 1 -- 172.21.15.170:0/325847599 learned_addr learned my addr 172.21.15.170:0/325847599 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:53:33.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.496+0000 7f0033fff640 1 --2- 172.21.15.170:0/325847599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0034101930 0x7f003419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:33.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.496+0000 7f00337fe640 1 -- 172.21.15.170:0/325847599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0034101930 msgr2=0x7f003419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:33.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.496+0000 7f00337fe640 1 --2- 172.21.15.170:0/325847599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0034101930 0x7f003419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:33.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.496+0000 7f00337fe640 1 -- 172.21.15.170:0/325847599 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00341977f0 con 0x7f0034107930 2024-09-04T16:53:33.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.496+0000 7f0033fff640 1 --2- 172.21.15.170:0/325847599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0034101930 0x7f003419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:53:33.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.496+0000 7f00337fe640 1 --2- 172.21.15.170:0/325847599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0034107930 0x7f003419dbb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f001c00d6f0 tx=0x7f001c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:33.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.496+0000 7f00317fa640 1 -- 172.21.15.170:0/325847599 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f001c017070 con 0x7f0034107930 2024-09-04T16:53:33.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.496+0000 7f00317fa640 1 -- 172.21.15.170:0/325847599 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f001c00de00 con 0x7f0034107930 2024-09-04T16:53:33.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.496+0000 7f003a7b4640 1 -- 172.21.15.170:0/325847599 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0034197ae0 con 0x7f0034107930 2024-09-04T16:53:33.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.496+0000 7f00317fa640 1 -- 172.21.15.170:0/325847599 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f001c004bb0 con 0x7f0034107930 2024-09-04T16:53:33.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.496+0000 7f003a7b4640 1 -- 172.21.15.170:0/325847599 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0034198070 con 0x7f0034107930 2024-09-04T16:53:33.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.497+0000 7f003a7b4640 1 -- 172.21.15.170:0/325847599 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0034103070 con 0x7f0034107930 2024-09-04T16:53:33.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.498+0000 7f00317fa640 1 -- 172.21.15.170:0/325847599 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f001c004e60 con 0x7f0034107930 2024-09-04T16:53:33.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.498+0000 7f00317fa640 1 --2- 172.21.15.170:0/325847599 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0020079e30 0x7f002007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:33.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.499+0000 7f0033fff640 1 --2- 172.21.15.170:0/325847599 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0020079e30 0x7f002007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:33.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.499+0000 7f00317fa640 1 -- 172.21.15.170:0/325847599 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f001c09c730 con 0x7f0034107930 2024-09-04T16:53:33.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.499+0000 7f0033fff640 1 --2- 172.21.15.170:0/325847599 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0020079e30 0x7f002007c2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0024006010 tx=0x7f00240095f0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:33.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.503+0000 7f00317fa640 1 -- 172.21.15.170:0/325847599 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f001c064140 con 0x7f0034107930 2024-09-04T16:53:33.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.695+0000 7f003a7b4640 1 -- 172.21.15.170:0/325847599 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0034198320 con 0x7f0020079e30 2024-09-04T16:53:33.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.696+0000 7f00317fa640 1 -- 172.21.15.170:0/325847599 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f0034198320 con 0x7f0020079e30 2024-09-04T16:53:33.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.699+0000 7f003a7b4640 1 -- 172.21.15.170:0/325847599 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0020079e30 msgr2=0x7f002007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:33.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.699+0000 7f003a7b4640 1 --2- 172.21.15.170:0/325847599 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0020079e30 0x7f002007c2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0024006010 tx=0x7f00240095f0 comp rx=0 tx=0).stop 2024-09-04T16:53:33.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.699+0000 7f003a7b4640 1 -- 172.21.15.170:0/325847599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0034107930 msgr2=0x7f003419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:33.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.699+0000 7f003a7b4640 1 --2- 172.21.15.170:0/325847599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0034107930 0x7f003419dbb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f001c00d6f0 tx=0x7f001c00dbb0 comp rx=0 tx=0).stop 2024-09-04T16:53:33.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.699+0000 7f003a7b4640 1 -- 172.21.15.170:0/325847599 shutdown_connections 2024-09-04T16:53:33.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.699+0000 7f003a7b4640 1 --2- 172.21.15.170:0/325847599 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f0020079e30 0x7f002007c2f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:33.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.699+0000 7f003a7b4640 1 --2- 172.21.15.170:0/325847599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0034107930 0x7f003419dbb0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:33.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.699+0000 7f003a7b4640 1 --2- 172.21.15.170:0/325847599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0034101930 0x7f003419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:33.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.699+0000 7f003a7b4640 1 -- 172.21.15.170:0/325847599 >> 172.21.15.170:0/325847599 conn(0x7f00340fd630 msgr2=0x7f00340fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:33.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.699+0000 7f003a7b4640 1 -- 172.21.15.170:0/325847599 shutdown_connections 2024-09-04T16:53:33.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.699+0000 7f003a7b4640 1 -- 172.21.15.170:0/325847599 wait complete. 2024-09-04T16:53:33.709 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:53:33.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.781+0000 7f002989d640 1 -- 172.21.15.170:0/45860987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0024102b40 msgr2=0x7f0024102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:33.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.781+0000 7f002989d640 1 --2- 172.21.15.170:0/45860987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0024102b40 0x7f0024102f20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0014009c50 tx=0x7f001402aa30 comp rx=0 tx=0).stop 2024-09-04T16:53:33.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.781+0000 7f002989d640 1 -- 172.21.15.170:0/45860987 shutdown_connections 2024-09-04T16:53:33.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.781+0000 7f002989d640 1 --2- 172.21.15.170:0/45860987 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0024103460 0x7f002410b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:33.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.781+0000 7f002989d640 1 --2- 172.21.15.170:0/45860987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0024102b40 0x7f0024102f20 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:33.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.781+0000 7f002989d640 1 -- 172.21.15.170:0/45860987 >> 172.21.15.170:0/45860987 conn(0x7f00240fc520 msgr2=0x7f00240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:33.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.781+0000 7f002989d640 1 -- 172.21.15.170:0/45860987 shutdown_connections 2024-09-04T16:53:33.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.781+0000 7f002989d640 1 -- 172.21.15.170:0/45860987 wait complete. 2024-09-04T16:53:33.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.782+0000 7f002989d640 1 Processor -- start 2024-09-04T16:53:33.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.782+0000 7f002989d640 1 -- start start 2024-09-04T16:53:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.782+0000 7f002989d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0024102b40 0x7f002419d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.782+0000 7f002989d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0024103460 0x7f002419dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.782+0000 7f002989d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f002410ee70 con 0x7f0024103460 2024-09-04T16:53:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.782+0000 7f002989d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f002410ecf0 con 0x7f0024102b40 2024-09-04T16:53:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.782+0000 7f00227fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0024103460 0x7f002419dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.782+0000 7f00227fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0024103460 0x7f002419dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47160/0 (socket says 172.21.15.170:47160) 2024-09-04T16:53:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.782+0000 7f00227fc640 1 -- 172.21.15.170:0/2223607748 learned_addr learned my addr 172.21.15.170:0/2223607748 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:53:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.783+0000 7f0022ffd640 1 --2- 172.21.15.170:0/2223607748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0024102b40 0x7f002419d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.783+0000 7f00227fc640 1 -- 172.21.15.170:0/2223607748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0024102b40 msgr2=0x7f002419d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.783+0000 7f00227fc640 1 --2- 172.21.15.170:0/2223607748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0024102b40 0x7f002419d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.783+0000 7f00227fc640 1 -- 172.21.15.170:0/2223607748 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00241978e0 con 0x7f0024103460 2024-09-04T16:53:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.783+0000 7f00227fc640 1 --2- 172.21.15.170:0/2223607748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0024103460 0x7f002419dc60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f001800b420 tx=0x7f001800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.783+0000 7f002889b640 1 -- 172.21.15.170:0/2223607748 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0018011630 con 0x7f0024103460 2024-09-04T16:53:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.783+0000 7f002889b640 1 -- 172.21.15.170:0/2223607748 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0018016070 con 0x7f0024103460 2024-09-04T16:53:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.783+0000 7f002989d640 1 -- 172.21.15.170:0/2223607748 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0024197bd0 con 0x7f0024103460 2024-09-04T16:53:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.784+0000 7f002989d640 1 -- 172.21.15.170:0/2223607748 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0024198160 con 0x7f0024103460 2024-09-04T16:53:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.784+0000 7f002889b640 1 -- 172.21.15.170:0/2223607748 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0018010d40 con 0x7f0024103460 2024-09-04T16:53:33.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.785+0000 7f002989d640 1 -- 172.21.15.170:0/2223607748 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f002406ab80 con 0x7f0024103460 2024-09-04T16:53:33.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.785+0000 7f002889b640 1 -- 172.21.15.170:0/2223607748 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f001801b480 con 0x7f0024103460 2024-09-04T16:53:33.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.786+0000 7f002889b640 1 --2- 172.21.15.170:0/2223607748 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f000c079e30 0x7f000c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:33.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.786+0000 7f002889b640 1 -- 172.21.15.170:0/2223607748 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f001809c1f0 con 0x7f0024103460 2024-09-04T16:53:33.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.786+0000 7f0022ffd640 1 --2- 172.21.15.170:0/2223607748 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f000c079e30 0x7f000c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:33.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.786+0000 7f0022ffd640 1 --2- 172.21.15.170:0/2223607748 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f000c079e30 0x7f000c07c2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0014000f80 tx=0x7f001403a040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:33.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.790+0000 7f002889b640 1 -- 172.21.15.170:0/2223607748 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0018063c00 con 0x7f0024103460 2024-09-04T16:53:33.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.981+0000 7f002989d640 1 -- 172.21.15.170:0/2223607748 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0024198e10 con 0x7f000c079e30 2024-09-04T16:53:33.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.982+0000 7f002889b640 1 -- 172.21.15.170:0/2223607748 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f00140481c0 con 0x7f000c079e30 2024-09-04T16:53:33.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.984+0000 7f002989d640 1 -- 172.21.15.170:0/2223607748 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f000c079e30 msgr2=0x7f000c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:33.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.984+0000 7f002989d640 1 --2- 172.21.15.170:0/2223607748 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f000c079e30 0x7f000c07c2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0014000f80 tx=0x7f001403a040 comp rx=0 tx=0).stop 2024-09-04T16:53:33.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.984+0000 7f002989d640 1 -- 172.21.15.170:0/2223607748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0024103460 msgr2=0x7f002419dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:33.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.984+0000 7f002989d640 1 --2- 172.21.15.170:0/2223607748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0024103460 0x7f002419dc60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f001800b420 tx=0x7f001800b8e0 comp rx=0 tx=0).stop 2024-09-04T16:53:33.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.984+0000 7f002989d640 1 -- 172.21.15.170:0/2223607748 shutdown_connections 2024-09-04T16:53:33.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.985+0000 7f002989d640 1 --2- 172.21.15.170:0/2223607748 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f000c079e30 0x7f000c07c2f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:33.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.985+0000 7f002989d640 1 --2- 172.21.15.170:0/2223607748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0024103460 0x7f002419dc60 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:33.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.985+0000 7f002989d640 1 --2- 172.21.15.170:0/2223607748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0024102b40 0x7f002419d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:33.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.985+0000 7f002989d640 1 -- 172.21.15.170:0/2223607748 >> 172.21.15.170:0/2223607748 conn(0x7f00240fc520 msgr2=0x7f0024103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:33.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.985+0000 7f002989d640 1 -- 172.21.15.170:0/2223607748 shutdown_connections 2024-09-04T16:53:33.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:33.985+0000 7f002989d640 1 -- 172.21.15.170:0/2223607748 wait complete. 2024-09-04T16:53:34.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.067+0000 7f3b9d2d9640 1 -- 172.21.15.170:0/3237288282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98106800 msgr2=0x7f3b98106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:34.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.067+0000 7f3b9d2d9640 1 --2- 172.21.15.170:0/3237288282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98106800 0x7f3b98106be0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009880 tx=0x7f3b8c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.067+0000 7f3b9d2d9640 1 -- 172.21.15.170:0/3237288282 shutdown_connections 2024-09-04T16:53:34.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.067+0000 7f3b9d2d9640 1 --2- 172.21.15.170:0/3237288282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b98100800 0x7f3b98100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.067+0000 7f3b9d2d9640 1 --2- 172.21.15.170:0/3237288282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98106800 0x7f3b98106be0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.067+0000 7f3b9d2d9640 1 -- 172.21.15.170:0/3237288282 >> 172.21.15.170:0/3237288282 conn(0x7f3b980fc4e0 msgr2=0x7f3b980fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:34.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.067+0000 7f3b9d2d9640 1 -- 172.21.15.170:0/3237288282 shutdown_connections 2024-09-04T16:53:34.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.067+0000 7f3b9d2d9640 1 -- 172.21.15.170:0/3237288282 wait complete. 2024-09-04T16:53:34.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.067+0000 7f3b9d2d9640 1 Processor -- start 2024-09-04T16:53:34.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.068+0000 7f3b9d2d9640 1 -- start start 2024-09-04T16:53:34.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.068+0000 7f3b9d2d9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b98100800 0x7f3b98198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:34.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.068+0000 7f3b9d2d9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98106800 0x7f3b98198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:34.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.068+0000 7f3b9d2d9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9810dcd0 con 0x7f3b98106800 2024-09-04T16:53:34.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.068+0000 7f3b9d2d9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9810db50 con 0x7f3b98100800 2024-09-04T16:53:34.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.068+0000 7f3b967fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98106800 0x7f3b98198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:34.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.068+0000 7f3b967fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98106800 0x7f3b98198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47180/0 (socket says 172.21.15.170:47180) 2024-09-04T16:53:34.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.068+0000 7f3b967fc640 1 -- 172.21.15.170:0/577953203 learned_addr learned my addr 172.21.15.170:0/577953203 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:53:34.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.068+0000 7f3b96ffd640 1 --2- 172.21.15.170:0/577953203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b98100800 0x7f3b98198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:34.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.068+0000 7f3b967fc640 1 -- 172.21.15.170:0/577953203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b98100800 msgr2=0x7f3b98198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:34.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.068+0000 7f3b967fc640 1 --2- 172.21.15.170:0/577953203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b98100800 0x7f3b98198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.068+0000 7f3b967fc640 1 -- 172.21.15.170:0/577953203 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b98199350 con 0x7f3b98106800 2024-09-04T16:53:34.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.069+0000 7f3b967fc640 1 --2- 172.21.15.170:0/577953203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98106800 0x7f3b98198d50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800d6f0 tx=0x7f3b8800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:34.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.069+0000 7f3b7ffff640 1 -- 172.21.15.170:0/577953203 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b88017070 con 0x7f3b98106800 2024-09-04T16:53:34.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.069+0000 7f3b7ffff640 1 -- 172.21.15.170:0/577953203 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3b8800de00 con 0x7f3b98106800 2024-09-04T16:53:34.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.069+0000 7f3b9d2d9640 1 -- 172.21.15.170:0/577953203 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b98199640 con 0x7f3b98106800 2024-09-04T16:53:34.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.069+0000 7f3b7ffff640 1 -- 172.21.15.170:0/577953203 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b88004bb0 con 0x7f3b98106800 2024-09-04T16:53:34.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.069+0000 7f3b9d2d9640 1 -- 172.21.15.170:0/577953203 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b981a1c40 con 0x7f3b98106800 2024-09-04T16:53:34.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.070+0000 7f3b9d2d9640 1 -- 172.21.15.170:0/577953203 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b98101f40 con 0x7f3b98106800 2024-09-04T16:53:34.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.071+0000 7f3b7ffff640 1 -- 172.21.15.170:0/577953203 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f3b88009a30 con 0x7f3b98106800 2024-09-04T16:53:34.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.071+0000 7f3b7ffff640 1 --2- 172.21.15.170:0/577953203 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3b80079e80 0x7f3b8007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:34.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.071+0000 7f3b7ffff640 1 -- 172.21.15.170:0/577953203 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3b8809c560 con 0x7f3b98106800 2024-09-04T16:53:34.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.071+0000 7f3b96ffd640 1 --2- 172.21.15.170:0/577953203 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3b80079e80 0x7f3b8007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:34.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.072+0000 7f3b96ffd640 1 --2- 172.21.15.170:0/577953203 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3b80079e80 0x7f3b8007c340 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0096c0 tx=0x7f3b8c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:34.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.076+0000 7f3b7ffff640 1 -- 172.21.15.170:0/577953203 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3b98199640 con 0x7f3b98106800 2024-09-04T16:53:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.259+0000 7f3b9d2d9640 1 -- 172.21.15.170:0/577953203 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3b98062630 con 0x7f3b80079e80 2024-09-04T16:53:34.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.269+0000 7f3b7ffff640 1 -- 172.21.15.170:0/577953203 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f3b98062630 con 0x7f3b80079e80 2024-09-04T16:53:34.269 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:53:34.269 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (20m) 14m ago 31m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:53:34.269 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (23m) 14m ago 31m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:53:34.269 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (23m) 14m ago 30m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:53:34.270 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (18m) 14m ago 31m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:53:34.270 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (18m) 14m ago 30m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:53:34.270 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (20m) 14m ago 31m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:53:34.270 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (14m) 14m ago 26m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:53:34.270 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (15m) 14m ago 26m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:53:34.270 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (14m) 14m ago 26m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:53:34.270 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (14m) 14m ago 26m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:53:34.270 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (22m) 14m ago 32m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:53:34.270 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (21m) 14m ago 30m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:53:34.270 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (19m) 14m ago 32m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:53:34.270 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (18m) 14m ago 30m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:53:34.270 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (21m) 14m ago 31m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:53:34.270 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (21m) 14m ago 30m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:53:34.270 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (18m) 14m ago 29m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:53:34.271 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (17m) 14m ago 28m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:53:34.271 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (17m) 14m ago 28m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:53:34.271 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (16m) 14m ago 28m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:53:34.271 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (15m) 14m ago 27m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:53:34.271 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (15m) 14m ago 27m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:53:34.271 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (20m) 14m ago 30m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:53:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.271+0000 7f3b9d2d9640 1 -- 172.21.15.170:0/577953203 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3b80079e80 msgr2=0x7f3b8007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.271+0000 7f3b9d2d9640 1 --2- 172.21.15.170:0/577953203 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3b80079e80 0x7f3b8007c340 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0096c0 tx=0x7f3b8c031400 comp rx=0 tx=0).stop 2024-09-04T16:53:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.271+0000 7f3b9d2d9640 1 -- 172.21.15.170:0/577953203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98106800 msgr2=0x7f3b98198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.271+0000 7f3b9d2d9640 1 --2- 172.21.15.170:0/577953203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98106800 0x7f3b98198d50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800d6f0 tx=0x7f3b8800dbb0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.271+0000 7f3b9d2d9640 1 -- 172.21.15.170:0/577953203 shutdown_connections 2024-09-04T16:53:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.271+0000 7f3b9d2d9640 1 --2- 172.21.15.170:0/577953203 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3b80079e80 0x7f3b8007c340 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.271+0000 7f3b9d2d9640 1 --2- 172.21.15.170:0/577953203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98106800 0x7f3b98198d50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.271+0000 7f3b9d2d9640 1 --2- 172.21.15.170:0/577953203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b98100800 0x7f3b98198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.271+0000 7f3b9d2d9640 1 -- 172.21.15.170:0/577953203 >> 172.21.15.170:0/577953203 conn(0x7f3b980fc4e0 msgr2=0x7f3b980fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.271+0000 7f3b9d2d9640 1 -- 172.21.15.170:0/577953203 shutdown_connections 2024-09-04T16:53:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.271+0000 7f3b9d2d9640 1 -- 172.21.15.170:0/577953203 wait complete. 2024-09-04T16:53:34.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.351+0000 7fca0f735640 1 -- 172.21.15.170:0/3029748428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca08106800 msgr2=0x7fca08106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:34.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.351+0000 7fca0f735640 1 --2- 172.21.15.170:0/3029748428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca08106800 0x7fca08106be0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009880 tx=0x7fc9f802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:34 smithi170 ceph-mon[113855]: pgmap v715: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:34.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.351+0000 7fca0f735640 1 -- 172.21.15.170:0/3029748428 shutdown_connections 2024-09-04T16:53:34.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.351+0000 7fca0f735640 1 --2- 172.21.15.170:0/3029748428 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca08100800 0x7fca08100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.351+0000 7fca0f735640 1 --2- 172.21.15.170:0/3029748428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca08106800 0x7fca08106be0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.351+0000 7fca0f735640 1 -- 172.21.15.170:0/3029748428 >> 172.21.15.170:0/3029748428 conn(0x7fca080fc4e0 msgr2=0x7fca080fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.351+0000 7fca0f735640 1 -- 172.21.15.170:0/3029748428 shutdown_connections 2024-09-04T16:53:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.351+0000 7fca0f735640 1 -- 172.21.15.170:0/3029748428 wait complete. 2024-09-04T16:53:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.351+0000 7fca0f735640 1 Processor -- start 2024-09-04T16:53:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.352+0000 7fca0f735640 1 -- start start 2024-09-04T16:53:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.352+0000 7fca0f735640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca08100800 0x7fca080fcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.352+0000 7fca0f735640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca08106800 0x7fca080fd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.352+0000 7fca0f735640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fca0810dcd0 con 0x7fca08100800 2024-09-04T16:53:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.352+0000 7fca0f735640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fca0810db50 con 0x7fca08106800 2024-09-04T16:53:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.352+0000 7fca0d4d1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca08100800 0x7fca080fcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:34.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.352+0000 7fca0d4d1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca08100800 0x7fca080fcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47198/0 (socket says 172.21.15.170:47198) 2024-09-04T16:53:34.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.352+0000 7fca0d4d1640 1 -- 172.21.15.170:0/89274253 learned_addr learned my addr 172.21.15.170:0/89274253 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:53:34.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.352+0000 7fca0ccd0640 1 --2- 172.21.15.170:0/89274253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca08106800 0x7fca080fd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:34.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.352+0000 7fca0d4d1640 1 -- 172.21.15.170:0/89274253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca08106800 msgr2=0x7fca080fd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:34.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.352+0000 7fca0d4d1640 1 --2- 172.21.15.170:0/89274253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca08106800 0x7fca080fd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.352+0000 7fca0d4d1640 1 -- 172.21.15.170:0/89274253 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca080fd6f0 con 0x7fca08100800 2024-09-04T16:53:34.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.352+0000 7fca0d4d1640 1 --2- 172.21.15.170:0/89274253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca08100800 0x7fca080fcc70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8031460 tx=0x7fc9f80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:34.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.353+0000 7fc9fe7fc640 1 -- 172.21.15.170:0/89274253 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9f803f070 con 0x7fca08100800 2024-09-04T16:53:34.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.353+0000 7fc9fe7fc640 1 -- 172.21.15.170:0/89274253 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc9f80035f0 con 0x7fca08100800 2024-09-04T16:53:34.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.353+0000 7fca0f735640 1 -- 172.21.15.170:0/89274253 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca080fd980 con 0x7fca08100800 2024-09-04T16:53:34.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.353+0000 7fca0f735640 1 -- 172.21.15.170:0/89274253 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca081a3db0 con 0x7fca08100800 2024-09-04T16:53:34.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.353+0000 7fc9fe7fc640 1 -- 172.21.15.170:0/89274253 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9f8035030 con 0x7fca08100800 2024-09-04T16:53:34.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.354+0000 7fca0f735640 1 -- 172.21.15.170:0/89274253 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9ec005290 con 0x7fca08100800 2024-09-04T16:53:34.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.355+0000 7fc9fe7fc640 1 -- 172.21.15.170:0/89274253 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fc9f8042070 con 0x7fca08100800 2024-09-04T16:53:34.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.355+0000 7fc9fe7fc640 1 --2- 172.21.15.170:0/89274253 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc9f4079e30 0x7fc9f407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:34.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.355+0000 7fc9fe7fc640 1 -- 172.21.15.170:0/89274253 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc9f80bd2a0 con 0x7fca08100800 2024-09-04T16:53:34.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.355+0000 7fca0ccd0640 1 --2- 172.21.15.170:0/89274253 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc9f4079e30 0x7fc9f407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:34.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.356+0000 7fca0ccd0640 1 --2- 172.21.15.170:0/89274253 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc9f4079e30 0x7fc9f407c2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fca080fe700 tx=0x7fca0400b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:34.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.359+0000 7fc9fe7fc640 1 -- 172.21.15.170:0/89274253 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc9f8088e20 con 0x7fca08100800 2024-09-04T16:53:34.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:34 smithi193 ceph-mon[82547]: pgmap v715: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:34.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.602+0000 7fca0f735640 1 -- 172.21.15.170:0/89274253 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc9ec005d90 con 0x7fca08100800 2024-09-04T16:53:34.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.602+0000 7fc9fe7fc640 1 -- 172.21.15.170:0/89274253 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fc9f808d160 con 0x7fca08100800 2024-09-04T16:53:34.603 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:53:34.603 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:53:34.603 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:53:34.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:53:34.603 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:53:34.603 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:53:34.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:53:34.604 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:53:34.604 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:53:34.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:53:34.604 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:53:34.604 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:53:34.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:53:34.604 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:53:34.604 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:53:34.604 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:53:34.604 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:53:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.604+0000 7fca0f735640 1 -- 172.21.15.170:0/89274253 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc9f4079e30 msgr2=0x7fc9f407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.604+0000 7fca0f735640 1 --2- 172.21.15.170:0/89274253 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc9f4079e30 0x7fc9f407c2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fca080fe700 tx=0x7fca0400b390 comp rx=0 tx=0).stop 2024-09-04T16:53:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.604+0000 7fca0f735640 1 -- 172.21.15.170:0/89274253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca08100800 msgr2=0x7fca080fcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.604+0000 7fca0f735640 1 --2- 172.21.15.170:0/89274253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca08100800 0x7fca080fcc70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8031460 tx=0x7fc9f80045e0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.604+0000 7fca0f735640 1 -- 172.21.15.170:0/89274253 shutdown_connections 2024-09-04T16:53:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.604+0000 7fca0f735640 1 --2- 172.21.15.170:0/89274253 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc9f4079e30 0x7fc9f407c2f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.604+0000 7fca0f735640 1 --2- 172.21.15.170:0/89274253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca08106800 0x7fca080fd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.604+0000 7fca0f735640 1 --2- 172.21.15.170:0/89274253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca08100800 0x7fca080fcc70 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.604+0000 7fca0f735640 1 -- 172.21.15.170:0/89274253 >> 172.21.15.170:0/89274253 conn(0x7fca080fc4e0 msgr2=0x7fca0806a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:34.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.605+0000 7fca0f735640 1 -- 172.21.15.170:0/89274253 shutdown_connections 2024-09-04T16:53:34.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.605+0000 7fca0f735640 1 -- 172.21.15.170:0/89274253 wait complete. 2024-09-04T16:53:34.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.686+0000 7f6f77947640 1 -- 172.21.15.170:0/1407003526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f70102ae0 msgr2=0x7f6f70102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:34.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.686+0000 7f6f77947640 1 --2- 172.21.15.170:0/1407003526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f70102ae0 0x7f6f70102ec0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c009880 tx=0x7f6f6c02a530 comp rx=0 tx=0).stop 2024-09-04T16:53:34.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.686+0000 7f6f77947640 1 -- 172.21.15.170:0/1407003526 shutdown_connections 2024-09-04T16:53:34.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.686+0000 7f6f77947640 1 --2- 172.21.15.170:0/1407003526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f70103400 0x7f6f7010b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.686+0000 7f6f77947640 1 --2- 172.21.15.170:0/1407003526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f70102ae0 0x7f6f70102ec0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.686+0000 7f6f77947640 1 -- 172.21.15.170:0/1407003526 >> 172.21.15.170:0/1407003526 conn(0x7f6f700fc520 msgr2=0x7f6f700fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:34.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.687+0000 7f6f77947640 1 -- 172.21.15.170:0/1407003526 shutdown_connections 2024-09-04T16:53:34.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.687+0000 7f6f77947640 1 -- 172.21.15.170:0/1407003526 wait complete. 2024-09-04T16:53:34.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.687+0000 7f6f77947640 1 Processor -- start 2024-09-04T16:53:34.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.687+0000 7f6f77947640 1 -- start start 2024-09-04T16:53:34.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.687+0000 7f6f77947640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f70102ae0 0x7f6f7019d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:34.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.687+0000 7f6f77947640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f70103400 0x7f6f7019dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:34.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.687+0000 7f6f77947640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7010ee10 con 0x7f6f70103400 2024-09-04T16:53:34.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.687+0000 7f6f77947640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7010ec90 con 0x7f6f70102ae0 2024-09-04T16:53:34.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.688+0000 7f6f74ee2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f70103400 0x7f6f7019dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:34.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.688+0000 7f6f74ee2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f70103400 0x7f6f7019dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47204/0 (socket says 172.21.15.170:47204) 2024-09-04T16:53:34.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.688+0000 7f6f74ee2640 1 -- 172.21.15.170:0/30716115 learned_addr learned my addr 172.21.15.170:0/30716115 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:53:34.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.688+0000 7f6f756e3640 1 --2- 172.21.15.170:0/30716115 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f70102ae0 0x7f6f7019d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:34.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.688+0000 7f6f74ee2640 1 -- 172.21.15.170:0/30716115 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f70102ae0 msgr2=0x7f6f7019d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:34.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.688+0000 7f6f74ee2640 1 --2- 172.21.15.170:0/30716115 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f70102ae0 0x7f6f7019d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.688+0000 7f6f74ee2640 1 -- 172.21.15.170:0/30716115 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f70197920 con 0x7f6f70103400 2024-09-04T16:53:34.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.688+0000 7f6f74ee2640 1 --2- 172.21.15.170:0/30716115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f70103400 0x7f6f7019dca0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000d6d0 tx=0x7f6f6000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:34.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.688+0000 7f6f667fc640 1 -- 172.21.15.170:0/30716115 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f60017070 con 0x7f6f70103400 2024-09-04T16:53:34.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.688+0000 7f6f667fc640 1 -- 172.21.15.170:0/30716115 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f600054e0 con 0x7f6f70103400 2024-09-04T16:53:34.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.688+0000 7f6f77947640 1 -- 172.21.15.170:0/30716115 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f70197c10 con 0x7f6f70103400 2024-09-04T16:53:34.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.688+0000 7f6f667fc640 1 -- 172.21.15.170:0/30716115 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f60004ae0 con 0x7f6f70103400 2024-09-04T16:53:34.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.688+0000 7f6f77947640 1 -- 172.21.15.170:0/30716115 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f701981a0 con 0x7f6f70103400 2024-09-04T16:53:34.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.689+0000 7f6f77947640 1 -- 172.21.15.170:0/30716115 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f7006abe0 con 0x7f6f70103400 2024-09-04T16:53:34.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.690+0000 7f6f667fc640 1 -- 172.21.15.170:0/30716115 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f6f60004de0 con 0x7f6f70103400 2024-09-04T16:53:34.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.690+0000 7f6f667fc640 1 --2- 172.21.15.170:0/30716115 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6f5c079e30 0x7f6f5c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:34.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.690+0000 7f6f667fc640 1 -- 172.21.15.170:0/30716115 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6f6009c6f0 con 0x7f6f70103400 2024-09-04T16:53:34.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.690+0000 7f6f756e3640 1 --2- 172.21.15.170:0/30716115 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6f5c079e30 0x7f6f5c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:34.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.691+0000 7f6f756e3640 1 --2- 172.21.15.170:0/30716115 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6f5c079e30 0x7f6f5c07c2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c000c00 tx=0x7f6f6c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:34.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.695+0000 7f6f667fc640 1 -- 172.21.15.170:0/30716115 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6f60064100 con 0x7f6f70103400 2024-09-04T16:53:34.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.905+0000 7f6f77947640 1 -- 172.21.15.170:0/30716115 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6f70105fb0 con 0x7f6f70103400 2024-09-04T16:53:34.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.906+0000 7f6f667fc640 1 -- 172.21.15.170:0/30716115 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7f6f60068270 con 0x7f6f70103400 2024-09-04T16:53:34.906 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:53:34.906 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:53:34.907 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:53:34.907 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:53:34.907 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:53:34.907 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:53:34.907 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:53:34.907 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:53:34.907 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:53:34.907 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:53:34.908 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:53:34.908 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:53:34.908 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:53:34.908 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:53:34.908 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:53:34.908 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:53:34.908 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:53:34.908 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:53:34.908 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:53:34.908 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:53:34.908 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:53:34.908 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:53:34.908 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:53:34.909 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:53:34.909 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:53:34.909 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:53:34.909 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:53:34.909 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:53:34.909 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:53:34.909 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:53:34.909 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:53:34.909 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:53:34.909 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:53:34.910 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:53:34.910 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:53:34.910 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:53:34.910 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:53:34.910 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:53:34.910 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:53:34.910 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:53:34.910 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:53:34.910 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:53:34.910 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:53:34.911 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:53:34.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.908+0000 7f6f77947640 1 -- 172.21.15.170:0/30716115 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6f5c079e30 msgr2=0x7f6f5c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:34.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.908+0000 7f6f77947640 1 --2- 172.21.15.170:0/30716115 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6f5c079e30 0x7f6f5c07c2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c000c00 tx=0x7f6f6c031400 comp rx=0 tx=0).stop 2024-09-04T16:53:34.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.908+0000 7f6f77947640 1 -- 172.21.15.170:0/30716115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f70103400 msgr2=0x7f6f7019dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:34.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.908+0000 7f6f77947640 1 --2- 172.21.15.170:0/30716115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f70103400 0x7f6f7019dca0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000d6d0 tx=0x7f6f6000db90 comp rx=0 tx=0).stop 2024-09-04T16:53:34.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.908+0000 7f6f77947640 1 -- 172.21.15.170:0/30716115 shutdown_connections 2024-09-04T16:53:34.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.908+0000 7f6f77947640 1 --2- 172.21.15.170:0/30716115 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6f5c079e30 0x7f6f5c07c2f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.908+0000 7f6f77947640 1 --2- 172.21.15.170:0/30716115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f70103400 0x7f6f7019dca0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.908+0000 7f6f77947640 1 --2- 172.21.15.170:0/30716115 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f70102ae0 0x7f6f7019d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.908+0000 7f6f77947640 1 -- 172.21.15.170:0/30716115 >> 172.21.15.170:0/30716115 conn(0x7f6f700fc520 msgr2=0x7f6f70108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:34.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.908+0000 7f6f77947640 1 -- 172.21.15.170:0/30716115 shutdown_connections 2024-09-04T16:53:34.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.908+0000 7f6f77947640 1 -- 172.21.15.170:0/30716115 wait complete. 2024-09-04T16:53:34.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.991+0000 7f9a6b8cd640 1 -- 172.21.15.170:0/2668198222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a64102ae0 msgr2=0x7f9a64102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:34.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.991+0000 7f9a6b8cd640 1 --2- 172.21.15.170:0/2668198222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a64102ae0 0x7f9a64102ec0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009880 tx=0x7f9a6002a530 comp rx=0 tx=0).stop 2024-09-04T16:53:34.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.991+0000 7f9a6b8cd640 1 -- 172.21.15.170:0/2668198222 shutdown_connections 2024-09-04T16:53:34.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.991+0000 7f9a6b8cd640 1 --2- 172.21.15.170:0/2668198222 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9a64103400 0x7f9a6410b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.991+0000 7f9a6b8cd640 1 --2- 172.21.15.170:0/2668198222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a64102ae0 0x7f9a64102ec0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.991+0000 7f9a6b8cd640 1 -- 172.21.15.170:0/2668198222 >> 172.21.15.170:0/2668198222 conn(0x7f9a640fc520 msgr2=0x7f9a640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:34.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.991+0000 7f9a6b8cd640 1 -- 172.21.15.170:0/2668198222 shutdown_connections 2024-09-04T16:53:34.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.991+0000 7f9a6b8cd640 1 -- 172.21.15.170:0/2668198222 wait complete. 2024-09-04T16:53:34.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.992+0000 7f9a6b8cd640 1 Processor -- start 2024-09-04T16:53:34.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.992+0000 7f9a6b8cd640 1 -- start start 2024-09-04T16:53:34.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.992+0000 7f9a6b8cd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a64102ae0 0x7f9a6419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:34.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.992+0000 7f9a6b8cd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9a64103400 0x7f9a6419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:34.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.992+0000 7f9a6b8cd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6410ee10 con 0x7f9a64102ae0 2024-09-04T16:53:34.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.992+0000 7f9a6b8cd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6410ec90 con 0x7f9a64103400 2024-09-04T16:53:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.992+0000 7f9a69669640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a64102ae0 0x7f9a6419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.992+0000 7f9a69669640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a64102ae0 0x7f9a6419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58608/0 (socket says 172.21.15.170:58608) 2024-09-04T16:53:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.992+0000 7f9a69669640 1 -- 172.21.15.170:0/1890741159 learned_addr learned my addr 172.21.15.170:0/1890741159 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:53:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.992+0000 7f9a68e68640 1 --2- 172.21.15.170:0/1890741159 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9a64103400 0x7f9a6419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.993+0000 7f9a69669640 1 -- 172.21.15.170:0/1890741159 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9a64103400 msgr2=0x7f9a6419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.993+0000 7f9a69669640 1 --2- 172.21.15.170:0/1890741159 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9a64103400 0x7f9a6419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.993+0000 7f9a69669640 1 -- 172.21.15.170:0/1890741159 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a64197800 con 0x7f9a64102ae0 2024-09-04T16:53:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.993+0000 7f9a69669640 1 --2- 172.21.15.170:0/1890741159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a64102ae0 0x7f9a6419d680 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9a60031460 tx=0x7f9a600045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.993+0000 7f9a5a7fc640 1 -- 172.21.15.170:0/1890741159 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a6003f070 con 0x7f9a64102ae0 2024-09-04T16:53:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.993+0000 7f9a5a7fc640 1 -- 172.21.15.170:0/1890741159 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9a600035f0 con 0x7f9a64102ae0 2024-09-04T16:53:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.993+0000 7f9a6b8cd640 1 -- 172.21.15.170:0/1890741159 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a64197a90 con 0x7f9a64102ae0 2024-09-04T16:53:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.993+0000 7f9a5a7fc640 1 -- 172.21.15.170:0/1890741159 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a60035030 con 0x7f9a64102ae0 2024-09-04T16:53:34.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.993+0000 7f9a6b8cd640 1 -- 172.21.15.170:0/1890741159 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a64197fc0 con 0x7f9a64102ae0 2024-09-04T16:53:34.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.994+0000 7f9a6b8cd640 1 -- 172.21.15.170:0/1890741159 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a6406abe0 con 0x7f9a64102ae0 2024-09-04T16:53:34.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.995+0000 7f9a5a7fc640 1 -- 172.21.15.170:0/1890741159 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f9a60042070 con 0x7f9a64102ae0 2024-09-04T16:53:34.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.995+0000 7f9a5a7fc640 1 --2- 172.21.15.170:0/1890741159 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9a50079e30 0x7f9a5007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:34.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.995+0000 7f9a5a7fc640 1 -- 172.21.15.170:0/1890741159 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9a600bd3b0 con 0x7f9a64102ae0 2024-09-04T16:53:34.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.995+0000 7f9a68e68640 1 --2- 172.21.15.170:0/1890741159 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9a50079e30 0x7f9a5007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:34.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.995+0000 7f9a68e68640 1 --2- 172.21.15.170:0/1890741159 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9a50079e30 0x7f9a5007c2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9a640fe4d0 tx=0x7f9a5400b2e0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:35.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:34.999+0000 7f9a5a7fc640 1 -- 172.21.15.170:0/1890741159 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9a60088f30 con 0x7f9a64102ae0 2024-09-04T16:53:35.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.194+0000 7f9a6b8cd640 1 -- 172.21.15.170:0/1890741159 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9a64198330 con 0x7f9a50079e30 2024-09-04T16:53:35.195 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:35 smithi170 ceph-mon[113855]: from='client.35118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:53:35.195 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:35 smithi170 ceph-mon[113855]: from='client.35122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:53:35.195 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:35 smithi170 ceph-mon[113855]: from='client.35126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:53:35.195 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:35 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/89274253' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:53:35.195 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:35 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/30716115' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:53:35.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.195+0000 7f9a5a7fc640 1 -- 172.21.15.170:0/1890741159 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9a64198330 con 0x7f9a50079e30 2024-09-04T16:53:35.196 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:53:35.196 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:53:35.196 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:53:35.196 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:53:35.196 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:53:35.196 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:53:35.197 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:53:35.197 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:53:35.197 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:53:35.197 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:53:35.197 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:53:35.197 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:53:35.197 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:53:35.197 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:53:35.197 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:53:35.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.198+0000 7f9a6b8cd640 1 -- 172.21.15.170:0/1890741159 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9a50079e30 msgr2=0x7f9a5007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.198+0000 7f9a6b8cd640 1 --2- 172.21.15.170:0/1890741159 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9a50079e30 0x7f9a5007c2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9a640fe4d0 tx=0x7f9a5400b2e0 comp rx=0 tx=0).stop 2024-09-04T16:53:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.198+0000 7f9a6b8cd640 1 -- 172.21.15.170:0/1890741159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a64102ae0 msgr2=0x7f9a6419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.198+0000 7f9a6b8cd640 1 --2- 172.21.15.170:0/1890741159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a64102ae0 0x7f9a6419d680 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9a60031460 tx=0x7f9a600045e0 comp rx=0 tx=0).stop 2024-09-04T16:53:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.198+0000 7f9a6b8cd640 1 -- 172.21.15.170:0/1890741159 shutdown_connections 2024-09-04T16:53:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.198+0000 7f9a6b8cd640 1 --2- 172.21.15.170:0/1890741159 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9a50079e30 0x7f9a5007c2f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.198+0000 7f9a6b8cd640 1 --2- 172.21.15.170:0/1890741159 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9a64103400 0x7f9a6419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.198+0000 7f9a6b8cd640 1 --2- 172.21.15.170:0/1890741159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a64102ae0 0x7f9a6419d680 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.198+0000 7f9a6b8cd640 1 -- 172.21.15.170:0/1890741159 >> 172.21.15.170:0/1890741159 conn(0x7f9a640fc520 msgr2=0x7f9a64108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.198+0000 7f9a6b8cd640 1 -- 172.21.15.170:0/1890741159 shutdown_connections 2024-09-04T16:53:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.198+0000 7f9a6b8cd640 1 -- 172.21.15.170:0/1890741159 wait complete. 2024-09-04T16:53:35.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.280+0000 7fdb15e7b640 1 -- 172.21.15.170:0/251234340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb10103400 msgr2=0x7fdb1010b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:35.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.280+0000 7fdb15e7b640 1 --2- 172.21.15.170:0/251234340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb10103400 0x7fdb1010b8f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009880 tx=0x7fdb0402a530 comp rx=0 tx=0).stop 2024-09-04T16:53:35.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.280+0000 7fdb15e7b640 1 -- 172.21.15.170:0/251234340 shutdown_connections 2024-09-04T16:53:35.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.280+0000 7fdb15e7b640 1 --2- 172.21.15.170:0/251234340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb10103400 0x7fdb1010b8f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:35.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.280+0000 7fdb15e7b640 1 --2- 172.21.15.170:0/251234340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb10102ae0 0x7fdb10102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:35.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.280+0000 7fdb15e7b640 1 -- 172.21.15.170:0/251234340 >> 172.21.15.170:0/251234340 conn(0x7fdb100fc520 msgr2=0x7fdb100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:35.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.280+0000 7fdb15e7b640 1 -- 172.21.15.170:0/251234340 shutdown_connections 2024-09-04T16:53:35.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.280+0000 7fdb15e7b640 1 -- 172.21.15.170:0/251234340 wait complete. 2024-09-04T16:53:35.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.281+0000 7fdb15e7b640 1 Processor -- start 2024-09-04T16:53:35.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.281+0000 7fdb15e7b640 1 -- start start 2024-09-04T16:53:35.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.281+0000 7fdb15e7b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb10102ae0 0x7fdb1019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:35.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.281+0000 7fdb15e7b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb10103400 0x7fdb1019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:35.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.281+0000 7fdb15e7b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1010ee70 con 0x7fdb10102ae0 2024-09-04T16:53:35.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.281+0000 7fdb15e7b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1010ecf0 con 0x7fdb10103400 2024-09-04T16:53:35.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.281+0000 7fdb0f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb10102ae0 0x7fdb1019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:35.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.281+0000 7fdb0f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb10102ae0 0x7fdb1019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58616/0 (socket says 172.21.15.170:58616) 2024-09-04T16:53:35.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.281+0000 7fdb0f7fe640 1 -- 172.21.15.170:0/1383258461 learned_addr learned my addr 172.21.15.170:0/1383258461 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:53:35.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.282+0000 7fdb0effd640 1 --2- 172.21.15.170:0/1383258461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb10103400 0x7fdb1019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:35.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.282+0000 7fdb0f7fe640 1 -- 172.21.15.170:0/1383258461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb10103400 msgr2=0x7fdb1019dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:35.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.282+0000 7fdb0f7fe640 1 --2- 172.21.15.170:0/1383258461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb10103400 0x7fdb1019dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:35.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.282+0000 7fdb0f7fe640 1 -- 172.21.15.170:0/1383258461 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb10197880 con 0x7fdb10102ae0 2024-09-04T16:53:35.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.282+0000 7fdb0f7fe640 1 --2- 172.21.15.170:0/1383258461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb10102ae0 0x7fdb1019d6c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000b420 tx=0x7fdb0000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:35.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.282+0000 7fdb0cff9640 1 -- 172.21.15.170:0/1383258461 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb00011630 con 0x7fdb10102ae0 2024-09-04T16:53:35.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.282+0000 7fdb0cff9640 1 -- 172.21.15.170:0/1383258461 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb00016070 con 0x7fdb10102ae0 2024-09-04T16:53:35.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.282+0000 7fdb0cff9640 1 -- 172.21.15.170:0/1383258461 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb00010d40 con 0x7fdb10102ae0 2024-09-04T16:53:35.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.282+0000 7fdb15e7b640 1 -- 172.21.15.170:0/1383258461 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb10197b70 con 0x7fdb10102ae0 2024-09-04T16:53:35.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.282+0000 7fdb15e7b640 1 -- 172.21.15.170:0/1383258461 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb101980d0 con 0x7fdb10102ae0 2024-09-04T16:53:35.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.283+0000 7fdb15e7b640 1 -- 172.21.15.170:0/1383258461 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb1006abe0 con 0x7fdb10102ae0 2024-09-04T16:53:35.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.284+0000 7fdb0cff9640 1 -- 172.21.15.170:0/1383258461 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fdb0001b460 con 0x7fdb10102ae0 2024-09-04T16:53:35.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.284+0000 7fdb0cff9640 1 --2- 172.21.15.170:0/1383258461 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdaf8079e30 0x7fdaf807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:53:35.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.285+0000 7fdb0effd640 1 --2- 172.21.15.170:0/1383258461 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdaf8079e30 0x7fdaf807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:53:35.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.285+0000 7fdb0cff9640 1 -- 172.21.15.170:0/1383258461 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fdb0009c170 con 0x7fdb10102ae0 2024-09-04T16:53:35.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.285+0000 7fdb0effd640 1 --2- 172.21.15.170:0/1383258461 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdaf8079e30 0x7fdaf807c2f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdb10199070 tx=0x7fdb04031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:53:35.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.289+0000 7fdb0cff9640 1 -- 172.21.15.170:0/1383258461 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdb00063b80 con 0x7fdb10102ae0 2024-09-04T16:53:35.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:35 smithi193 ceph-mon[82547]: from='client.35118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:53:35.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:35 smithi193 ceph-mon[82547]: from='client.35122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:53:35.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:35 smithi193 ceph-mon[82547]: from='client.35126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:53:35.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:35 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/89274253' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:53:35.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:35 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/30716115' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:53:35.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.530+0000 7fdb15e7b640 1 -- 172.21.15.170:0/1383258461 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fdb10198db0 con 0x7fdb10102ae0 2024-09-04T16:53:35.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.531+0000 7fdb0cff9640 1 -- 172.21.15.170:0/1383258461 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fdb00067cf0 con 0x7fdb10102ae0 2024-09-04T16:53:35.532 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:53:35.532 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:53:35.532 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:53:35.533 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:53:35.533 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:53:35.533 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:53:35.533 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:53:35.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.533+0000 7fdb15e7b640 1 -- 172.21.15.170:0/1383258461 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdaf8079e30 msgr2=0x7fdaf807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:35.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.533+0000 7fdb15e7b640 1 --2- 172.21.15.170:0/1383258461 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdaf8079e30 0x7fdaf807c2f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdb10199070 tx=0x7fdb04031400 comp rx=0 tx=0).stop 2024-09-04T16:53:35.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.533+0000 7fdb15e7b640 1 -- 172.21.15.170:0/1383258461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb10102ae0 msgr2=0x7fdb1019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:53:35.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.533+0000 7fdb15e7b640 1 --2- 172.21.15.170:0/1383258461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb10102ae0 0x7fdb1019d6c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000b420 tx=0x7fdb0000b8e0 comp rx=0 tx=0).stop 2024-09-04T16:53:35.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.533+0000 7fdb15e7b640 1 -- 172.21.15.170:0/1383258461 shutdown_connections 2024-09-04T16:53:35.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.533+0000 7fdb15e7b640 1 --2- 172.21.15.170:0/1383258461 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fdaf8079e30 0x7fdaf807c2f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:35.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.533+0000 7fdb15e7b640 1 --2- 172.21.15.170:0/1383258461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb10103400 0x7fdb1019dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:35.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.533+0000 7fdb15e7b640 1 --2- 172.21.15.170:0/1383258461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb10102ae0 0x7fdb1019d6c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:53:35.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.533+0000 7fdb15e7b640 1 -- 172.21.15.170:0/1383258461 >> 172.21.15.170:0/1383258461 conn(0x7fdb100fc520 msgr2=0x7fdb10108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:53:35.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.533+0000 7fdb15e7b640 1 -- 172.21.15.170:0/1383258461 shutdown_connections 2024-09-04T16:53:35.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:53:35.533+0000 7fdb15e7b640 1 -- 172.21.15.170:0/1383258461 wait complete. 2024-09-04T16:53:36.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:36 smithi170 ceph-mon[113855]: pgmap v716: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:36.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:36 smithi170 ceph-mon[113855]: from='client.35138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:53:36.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:36 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1383258461' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:53:36.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:36 smithi193 ceph-mon[82547]: pgmap v716: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:36.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:36 smithi193 ceph-mon[82547]: from='client.35138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:53:36.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:36 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1383258461' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:53:38.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:38 smithi170 ceph-mon[113855]: pgmap v717: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:38.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:38 smithi193 ceph-mon[82547]: pgmap v717: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:40.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:40 smithi170 ceph-mon[113855]: pgmap v718: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:40.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:40 smithi193 ceph-mon[82547]: pgmap v718: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:42.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:42 smithi170 ceph-mon[113855]: pgmap v719: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:42.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:42 smithi193 ceph-mon[82547]: pgmap v719: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:44.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:44 smithi170 ceph-mon[113855]: pgmap v720: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:44.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:44 smithi193 ceph-mon[82547]: pgmap v720: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:45.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:45 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:53:45.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:45 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:53:46.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:46 smithi193 ceph-mon[82547]: pgmap v721: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:46.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:46 smithi170 ceph-mon[113855]: pgmap v721: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:48.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:48 smithi193 ceph-mon[82547]: pgmap v722: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:48.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:48 smithi170 ceph-mon[113855]: pgmap v722: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:50.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:50 smithi193 ceph-mon[82547]: pgmap v723: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:50.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:50 smithi170 ceph-mon[113855]: pgmap v723: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:52.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:52 smithi193 ceph-mon[82547]: pgmap v724: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:52.527 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:52 smithi170 ceph-mon[113855]: pgmap v724: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:54.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:54 smithi193 ceph-mon[82547]: pgmap v725: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:54 smithi170 ceph-mon[113855]: pgmap v725: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:56.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:56 smithi193 ceph-mon[82547]: pgmap v726: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:56.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:56 smithi170 ceph-mon[113855]: pgmap v726: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:58.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:53:58 smithi193 ceph-mon[82547]: pgmap v727: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:53:58.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:53:58 smithi170 ceph-mon[113855]: pgmap v727: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:00.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:00 smithi193 ceph-mon[82547]: pgmap v728: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:00.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:00 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:54:00.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:00 smithi170 ceph-mon[113855]: pgmap v728: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:00 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:54:02.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:02 smithi193 ceph-mon[82547]: pgmap v729: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:02.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:02 smithi170 ceph-mon[113855]: pgmap v729: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:04.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:04 smithi193 ceph-mon[82547]: pgmap v730: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:04.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:04 smithi170 ceph-mon[113855]: pgmap v730: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:05.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.628+0000 7f7f139de640 1 -- 172.21.15.170:0/2036320007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f0c1008d0 msgr2=0x7f7f0c100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:05.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.628+0000 7f7f139de640 1 --2- 172.21.15.170:0/2036320007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f0c1008d0 0x7f7f0c100cb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009880 tx=0x7f7f0802a530 comp rx=0 tx=0).stop 2024-09-04T16:54:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.628+0000 7f7f139de640 1 -- 172.21.15.170:0/2036320007 shutdown_connections 2024-09-04T16:54:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.628+0000 7f7f139de640 1 --2- 172.21.15.170:0/2036320007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7f0c1011f0 0x7f7f0c1056c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.628+0000 7f7f139de640 1 --2- 172.21.15.170:0/2036320007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f0c1008d0 0x7f7f0c100cb0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.628+0000 7f7f139de640 1 -- 172.21.15.170:0/2036320007 >> 172.21.15.170:0/2036320007 conn(0x7f7f0c0fc520 msgr2=0x7f7f0c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.629+0000 7f7f139de640 1 -- 172.21.15.170:0/2036320007 shutdown_connections 2024-09-04T16:54:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.629+0000 7f7f139de640 1 -- 172.21.15.170:0/2036320007 wait complete. 2024-09-04T16:54:05.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.629+0000 7f7f139de640 1 Processor -- start 2024-09-04T16:54:05.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.629+0000 7f7f139de640 1 -- start start 2024-09-04T16:54:05.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.629+0000 7f7f139de640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f0c1008d0 0x7f7f0c19df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:05.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.629+0000 7f7f139de640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7f0c1011f0 0x7f7f0c19e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:05.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.629+0000 7f7f139de640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c115410 con 0x7f7f0c1008d0 2024-09-04T16:54:05.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.629+0000 7f7f139de640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c115290 con 0x7f7f0c1011f0 2024-09-04T16:54:05.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.630+0000 7f7f1177a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f0c1008d0 0x7f7f0c19df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:05.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.630+0000 7f7f1177a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f0c1008d0 0x7f7f0c19df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44938/0 (socket says 172.21.15.170:44938) 2024-09-04T16:54:05.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.630+0000 7f7f1177a640 1 -- 172.21.15.170:0/1438317488 learned_addr learned my addr 172.21.15.170:0/1438317488 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:54:05.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.630+0000 7f7f10f79640 1 --2- 172.21.15.170:0/1438317488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7f0c1011f0 0x7f7f0c19e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:05.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.630+0000 7f7f1177a640 1 -- 172.21.15.170:0/1438317488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7f0c1011f0 msgr2=0x7f7f0c19e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:05.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.630+0000 7f7f1177a640 1 --2- 172.21.15.170:0/1438317488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7f0c1011f0 0x7f7f0c19e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:05.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.630+0000 7f7f1177a640 1 -- 172.21.15.170:0/1438317488 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0c1a2860 con 0x7f7f0c1008d0 2024-09-04T16:54:05.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.630+0000 7f7f1177a640 1 --2- 172.21.15.170:0/1438317488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f0c1008d0 0x7f7f0c19df90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7f08031460 tx=0x7f7f080045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:05.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.630+0000 7f7f027fc640 1 -- 172.21.15.170:0/1438317488 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f0803f070 con 0x7f7f0c1008d0 2024-09-04T16:54:05.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.630+0000 7f7f139de640 1 -- 172.21.15.170:0/1438317488 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0c1a2af0 con 0x7f7f0c1008d0 2024-09-04T16:54:05.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.630+0000 7f7f027fc640 1 -- 172.21.15.170:0/1438317488 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7f080035f0 con 0x7f7f0c1008d0 2024-09-04T16:54:05.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.630+0000 7f7f027fc640 1 -- 172.21.15.170:0/1438317488 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f08035030 con 0x7f7f0c1008d0 2024-09-04T16:54:05.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.630+0000 7f7f139de640 1 -- 172.21.15.170:0/1438317488 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f0c1a3020 con 0x7f7f0c1008d0 2024-09-04T16:54:05.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.632+0000 7f7f139de640 1 -- 172.21.15.170:0/1438317488 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f0c06abe0 con 0x7f7f0c1008d0 2024-09-04T16:54:05.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.632+0000 7f7f027fc640 1 -- 172.21.15.170:0/1438317488 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f7f08042070 con 0x7f7f0c1008d0 2024-09-04T16:54:05.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.633+0000 7f7f027fc640 1 --2- 172.21.15.170:0/1438317488 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7ef8079e30 0x7f7ef807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:05.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.633+0000 7f7f027fc640 1 -- 172.21.15.170:0/1438317488 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f7f080bd460 con 0x7f7f0c1008d0 2024-09-04T16:54:05.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.633+0000 7f7f10f79640 1 --2- 172.21.15.170:0/1438317488 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7ef8079e30 0x7f7ef807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:05.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.633+0000 7f7f10f79640 1 --2- 172.21.15.170:0/1438317488 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7ef8079e30 0x7f7ef807c2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0058c0 tx=0x7f7efc005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:05.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.637+0000 7f7f027fc640 1 -- 172.21.15.170:0/1438317488 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7f08084e70 con 0x7f7f0c1008d0 2024-09-04T16:54:05.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.830+0000 7f7f139de640 1 -- 172.21.15.170:0/1438317488 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7f0c1a32d0 con 0x7f7ef8079e30 2024-09-04T16:54:05.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.831+0000 7f7f027fc640 1 -- 172.21.15.170:0/1438317488 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7f0c1a32d0 con 0x7f7ef8079e30 2024-09-04T16:54:05.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.834+0000 7f7f139de640 1 -- 172.21.15.170:0/1438317488 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7ef8079e30 msgr2=0x7f7ef807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.834+0000 7f7f139de640 1 --2- 172.21.15.170:0/1438317488 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7ef8079e30 0x7f7ef807c2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0058c0 tx=0x7f7efc005850 comp rx=0 tx=0).stop 2024-09-04T16:54:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.834+0000 7f7f139de640 1 -- 172.21.15.170:0/1438317488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f0c1008d0 msgr2=0x7f7f0c19df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.834+0000 7f7f139de640 1 --2- 172.21.15.170:0/1438317488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f0c1008d0 0x7f7f0c19df90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7f08031460 tx=0x7f7f080045e0 comp rx=0 tx=0).stop 2024-09-04T16:54:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.834+0000 7f7f139de640 1 -- 172.21.15.170:0/1438317488 shutdown_connections 2024-09-04T16:54:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.834+0000 7f7f139de640 1 --2- 172.21.15.170:0/1438317488 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7ef8079e30 0x7f7ef807c2f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.834+0000 7f7f139de640 1 --2- 172.21.15.170:0/1438317488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7f0c1011f0 0x7f7f0c19e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.834+0000 7f7f139de640 1 --2- 172.21.15.170:0/1438317488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f0c1008d0 0x7f7f0c19df90 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:05.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.834+0000 7f7f139de640 1 -- 172.21.15.170:0/1438317488 >> 172.21.15.170:0/1438317488 conn(0x7f7f0c0fc520 msgr2=0x7f7f0c112b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:05.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.834+0000 7f7f139de640 1 -- 172.21.15.170:0/1438317488 shutdown_connections 2024-09-04T16:54:05.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.834+0000 7f7f139de640 1 -- 172.21.15.170:0/1438317488 wait complete. 2024-09-04T16:54:05.842 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:54:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.916+0000 7f8d1fca4640 1 -- 172.21.15.170:0/2764524977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d18102ae0 msgr2=0x7f8d18102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.916+0000 7f8d1fca4640 1 --2- 172.21.15.170:0/2764524977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d18102ae0 0x7f8d18102ec0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8d10009880 tx=0x7f8d1002a530 comp rx=0 tx=0).stop 2024-09-04T16:54:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.916+0000 7f8d1fca4640 1 -- 172.21.15.170:0/2764524977 shutdown_connections 2024-09-04T16:54:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.916+0000 7f8d1fca4640 1 --2- 172.21.15.170:0/2764524977 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d18103400 0x7f8d1810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.916+0000 7f8d1fca4640 1 --2- 172.21.15.170:0/2764524977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d18102ae0 0x7f8d18102ec0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.916+0000 7f8d1fca4640 1 -- 172.21.15.170:0/2764524977 >> 172.21.15.170:0/2764524977 conn(0x7f8d180fc520 msgr2=0x7f8d180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.916+0000 7f8d1fca4640 1 -- 172.21.15.170:0/2764524977 shutdown_connections 2024-09-04T16:54:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.916+0000 7f8d1fca4640 1 -- 172.21.15.170:0/2764524977 wait complete. 2024-09-04T16:54:05.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.917+0000 7f8d1fca4640 1 Processor -- start 2024-09-04T16:54:05.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.917+0000 7f8d1fca4640 1 -- start start 2024-09-04T16:54:05.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.917+0000 7f8d1fca4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d18102ae0 0x7f8d18100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:05.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.917+0000 7f8d1fca4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d18103400 0x7f8d18100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:05.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.917+0000 7f8d1fca4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1810ee10 con 0x7f8d18102ae0 2024-09-04T16:54:05.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.917+0000 7f8d1fca4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1810ec90 con 0x7f8d18103400 2024-09-04T16:54:05.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.917+0000 7f8d1da40640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d18102ae0 0x7f8d18100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:05.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.917+0000 7f8d1da40640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d18102ae0 0x7f8d18100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44958/0 (socket says 172.21.15.170:44958) 2024-09-04T16:54:05.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.917+0000 7f8d1da40640 1 -- 172.21.15.170:0/1349096462 learned_addr learned my addr 172.21.15.170:0/1349096462 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:54:05.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.917+0000 7f8d1d23f640 1 --2- 172.21.15.170:0/1349096462 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d18103400 0x7f8d18100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:05.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.917+0000 7f8d1da40640 1 -- 172.21.15.170:0/1349096462 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d18103400 msgr2=0x7f8d18100c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:05.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.917+0000 7f8d1da40640 1 --2- 172.21.15.170:0/1349096462 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d18103400 0x7f8d18100c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:05.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.917+0000 7f8d1da40640 1 -- 172.21.15.170:0/1349096462 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d181011c0 con 0x7f8d18102ae0 2024-09-04T16:54:05.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.918+0000 7f8d1da40640 1 --2- 172.21.15.170:0/1349096462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d18102ae0 0x7f8d18100740 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8d10031460 tx=0x7f8d10004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:05.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.918+0000 7f8d16ffd640 1 -- 172.21.15.170:0/1349096462 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d1003f070 con 0x7f8d18102ae0 2024-09-04T16:54:05.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.918+0000 7f8d16ffd640 1 -- 172.21.15.170:0/1349096462 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d100035f0 con 0x7f8d18102ae0 2024-09-04T16:54:05.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.918+0000 7f8d1fca4640 1 -- 172.21.15.170:0/1349096462 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d18101450 con 0x7f8d18102ae0 2024-09-04T16:54:05.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.918+0000 7f8d1fca4640 1 -- 172.21.15.170:0/1349096462 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d181a3dc0 con 0x7f8d18102ae0 2024-09-04T16:54:05.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.919+0000 7f8d16ffd640 1 -- 172.21.15.170:0/1349096462 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d10035030 con 0x7f8d18102ae0 2024-09-04T16:54:05.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.919+0000 7f8d1fca4640 1 -- 172.21.15.170:0/1349096462 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d1806abe0 con 0x7f8d18102ae0 2024-09-04T16:54:05.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.920+0000 7f8d16ffd640 1 -- 172.21.15.170:0/1349096462 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f8d10042070 con 0x7f8d18102ae0 2024-09-04T16:54:05.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.920+0000 7f8d16ffd640 1 --2- 172.21.15.170:0/1349096462 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d00079e80 0x7f8d0007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:05.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.920+0000 7f8d16ffd640 1 -- 172.21.15.170:0/1349096462 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8d100bd2d0 con 0x7f8d18102ae0 2024-09-04T16:54:05.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.920+0000 7f8d1d23f640 1 --2- 172.21.15.170:0/1349096462 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d00079e80 0x7f8d0007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:05.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.921+0000 7f8d1d23f640 1 --2- 172.21.15.170:0/1349096462 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d00079e80 0x7f8d0007c340 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8d181021d0 tx=0x7f8d0c005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:05.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:05.925+0000 7f8d16ffd640 1 -- 172.21.15.170:0/1349096462 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8d10088ed0 con 0x7f8d18102ae0 2024-09-04T16:54:06.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.114+0000 7f8d1fca4640 1 -- 172.21.15.170:0/1349096462 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8d18062630 con 0x7f8d00079e80 2024-09-04T16:54:06.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.115+0000 7f8d16ffd640 1 -- 172.21.15.170:0/1349096462 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8d18062630 con 0x7f8d00079e80 2024-09-04T16:54:06.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.117+0000 7f8d1fca4640 1 -- 172.21.15.170:0/1349096462 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d00079e80 msgr2=0x7f8d0007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:06.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.117+0000 7f8d1fca4640 1 --2- 172.21.15.170:0/1349096462 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d00079e80 0x7f8d0007c340 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8d181021d0 tx=0x7f8d0c005f90 comp rx=0 tx=0).stop 2024-09-04T16:54:06.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.117+0000 7f8d1fca4640 1 -- 172.21.15.170:0/1349096462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d18102ae0 msgr2=0x7f8d18100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:06.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.117+0000 7f8d1fca4640 1 --2- 172.21.15.170:0/1349096462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d18102ae0 0x7f8d18100740 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8d10031460 tx=0x7f8d10004530 comp rx=0 tx=0).stop 2024-09-04T16:54:06.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.117+0000 7f8d1fca4640 1 -- 172.21.15.170:0/1349096462 shutdown_connections 2024-09-04T16:54:06.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.117+0000 7f8d1fca4640 1 --2- 172.21.15.170:0/1349096462 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f8d00079e80 0x7f8d0007c340 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.117+0000 7f8d1fca4640 1 --2- 172.21.15.170:0/1349096462 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d18103400 0x7f8d18100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.117+0000 7f8d1fca4640 1 --2- 172.21.15.170:0/1349096462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d18102ae0 0x7f8d18100740 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.117+0000 7f8d1fca4640 1 -- 172.21.15.170:0/1349096462 >> 172.21.15.170:0/1349096462 conn(0x7f8d180fc520 msgr2=0x7f8d18108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:06.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.118+0000 7f8d1fca4640 1 -- 172.21.15.170:0/1349096462 shutdown_connections 2024-09-04T16:54:06.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.118+0000 7f8d1fca4640 1 -- 172.21.15.170:0/1349096462 wait complete. 2024-09-04T16:54:06.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.200+0000 7f5abc62d640 1 -- 172.21.15.170:0/1157895725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab4103460 msgr2=0x7f5ab410b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:06.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.200+0000 7f5abc62d640 1 --2- 172.21.15.170:0/1157895725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab4103460 0x7f5ab410b950 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80098b0 tx=0x7f5aa802a560 comp rx=0 tx=0).stop 2024-09-04T16:54:06.201 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:06 smithi170 ceph-mon[113855]: pgmap v731: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:06.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.201+0000 7f5abc62d640 1 -- 172.21.15.170:0/1157895725 shutdown_connections 2024-09-04T16:54:06.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.201+0000 7f5abc62d640 1 --2- 172.21.15.170:0/1157895725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab4103460 0x7f5ab410b950 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.201+0000 7f5abc62d640 1 --2- 172.21.15.170:0/1157895725 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ab4102b40 0x7f5ab4102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.201+0000 7f5abc62d640 1 -- 172.21.15.170:0/1157895725 >> 172.21.15.170:0/1157895725 conn(0x7f5ab40fc520 msgr2=0x7f5ab40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:06.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.201+0000 7f5abc62d640 1 -- 172.21.15.170:0/1157895725 shutdown_connections 2024-09-04T16:54:06.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.201+0000 7f5abc62d640 1 -- 172.21.15.170:0/1157895725 wait complete. 2024-09-04T16:54:06.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.201+0000 7f5abc62d640 1 Processor -- start 2024-09-04T16:54:06.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.201+0000 7f5abc62d640 1 -- start start 2024-09-04T16:54:06.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.201+0000 7f5abc62d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab4102b40 0x7f5ab419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:06.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5abc62d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ab4103460 0x7f5ab419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:06.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5abc62d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab410ee10 con 0x7f5ab4102b40 2024-09-04T16:54:06.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5abc62d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab410ec90 con 0x7f5ab4103460 2024-09-04T16:54:06.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5aba3c9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab4102b40 0x7f5ab419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:06.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5aba3c9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab4102b40 0x7f5ab419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44966/0 (socket says 172.21.15.170:44966) 2024-09-04T16:54:06.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5aba3c9640 1 -- 172.21.15.170:0/3819089385 learned_addr learned my addr 172.21.15.170:0/3819089385 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:54:06.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5ab9bc8640 1 --2- 172.21.15.170:0/3819089385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ab4103460 0x7f5ab419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:06.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5aba3c9640 1 -- 172.21.15.170:0/3819089385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ab4103460 msgr2=0x7f5ab419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:06.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5aba3c9640 1 --2- 172.21.15.170:0/3819089385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ab4103460 0x7f5ab419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5aba3c9640 1 -- 172.21.15.170:0/3819089385 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab4197840 con 0x7f5ab4102b40 2024-09-04T16:54:06.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5ab9bc8640 1 --2- 172.21.15.170:0/3819089385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ab4103460 0x7f5ab419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:54:06.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5aba3c9640 1 --2- 172.21.15.170:0/3819089385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab4102b40 0x7f5ab419d6c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000c8f0 tx=0x7f5ab000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:06.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5aa77fe640 1 -- 172.21.15.170:0/3819089385 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ab00079b0 con 0x7f5ab4102b40 2024-09-04T16:54:06.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5aa77fe640 1 -- 172.21.15.170:0/3819089385 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5ab00054e0 con 0x7f5ab4102b40 2024-09-04T16:54:06.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5abc62d640 1 -- 172.21.15.170:0/3819089385 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab4197b30 con 0x7f5ab4102b40 2024-09-04T16:54:06.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5aa77fe640 1 -- 172.21.15.170:0/3819089385 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ab0004dd0 con 0x7f5ab4102b40 2024-09-04T16:54:06.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.202+0000 7f5abc62d640 1 -- 172.21.15.170:0/3819089385 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab41980c0 con 0x7f5ab4102b40 2024-09-04T16:54:06.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.204+0000 7f5abc62d640 1 -- 172.21.15.170:0/3819089385 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ab406ab80 con 0x7f5ab4102b40 2024-09-04T16:54:06.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.204+0000 7f5aa77fe640 1 -- 172.21.15.170:0/3819089385 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5ab0005020 con 0x7f5ab4102b40 2024-09-04T16:54:06.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.205+0000 7f5aa77fe640 1 --2- 172.21.15.170:0/3819089385 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5aa0079e30 0x7f5aa007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:06.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.205+0000 7f5aa77fe640 1 -- 172.21.15.170:0/3819089385 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5ab009c9d0 con 0x7f5ab4102b40 2024-09-04T16:54:06.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.205+0000 7f5ab9bc8640 1 --2- 172.21.15.170:0/3819089385 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5aa0079e30 0x7f5aa007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:06.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.205+0000 7f5ab9bc8640 1 --2- 172.21.15.170:0/3819089385 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5aa0079e30 0x7f5aa007c2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8000c00 tx=0x7f5aa80095f0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:06.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.209+0000 7f5aa77fe640 1 -- 172.21.15.170:0/3819089385 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5ab0014030 con 0x7f5ab4102b40 2024-09-04T16:54:06.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.392+0000 7f5abc62d640 1 -- 172.21.15.170:0/3819089385 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5ab41983d0 con 0x7f5aa0079e30 2024-09-04T16:54:06.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.402+0000 7f5aa77fe640 1 -- 172.21.15.170:0/3819089385 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5ab41983d0 con 0x7f5aa0079e30 2024-09-04T16:54:06.403 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:54:06.403 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (21m) 15m ago 31m 21.1M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:54:06.403 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (24m) 15m ago 32m 9303k - 19.1.1-252-g48920dab b708f9119ac7 7e8d6b528586 2024-09-04T16:54:06.403 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (23m) 14m ago 31m 8808k - 19.1.1-252-g48920dab b708f9119ac7 233a7a9337b8 2024-09-04T16:54:06.403 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (19m) 15m ago 32m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:54:06.403 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (19m) 14m ago 31m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:54:06.403 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (20m) 15m ago 31m 79.0M - c8b91775d855 6e3778aab5e6 2024-09-04T16:54:06.403 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (15m) 15m ago 26m 15.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:54:06.403 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (15m) 15m ago 26m 15.2M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:54:06.403 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (14m) 14m ago 26m 11.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:54:06.403 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (15m) 14m ago 26m 13.8M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:54:06.404 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (23m) 15m ago 33m 529M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:54:06.404 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (22m) 14m ago 31m 458M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:54:06.404 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (19m) 15m ago 33m 52.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:54:06.404 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (19m) 14m ago 30m 41.4M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:54:06.404 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (21m) 15m ago 32m 11.9M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:54:06.404 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (21m) 14m ago 31m 12.6M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:54:06.404 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (18m) 15m ago 29m 87.9M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:54:06.404 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (18m) 15m ago 29m 89.1M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:54:06.404 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (17m) 15m ago 28m 83.8M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:54:06.404 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (17m) 14m ago 28m 98.9M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:54:06.404 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (16m) 14m ago 28m 96.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:54:06.404 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (15m) 14m ago 27m 77.2M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:54:06.404 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (21m) 15m ago 31m 56.1M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:54:06.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.404+0000 7f5abc62d640 1 -- 172.21.15.170:0/3819089385 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5aa0079e30 msgr2=0x7f5aa007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:06.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.404+0000 7f5abc62d640 1 --2- 172.21.15.170:0/3819089385 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5aa0079e30 0x7f5aa007c2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8000c00 tx=0x7f5aa80095f0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.404+0000 7f5abc62d640 1 -- 172.21.15.170:0/3819089385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab4102b40 msgr2=0x7f5ab419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:06.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.404+0000 7f5abc62d640 1 --2- 172.21.15.170:0/3819089385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab4102b40 0x7f5ab419d6c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000c8f0 tx=0x7f5ab000cdb0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.404+0000 7f5abc62d640 1 -- 172.21.15.170:0/3819089385 shutdown_connections 2024-09-04T16:54:06.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.404+0000 7f5abc62d640 1 --2- 172.21.15.170:0/3819089385 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5aa0079e30 0x7f5aa007c2f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.404+0000 7f5abc62d640 1 --2- 172.21.15.170:0/3819089385 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ab4103460 0x7f5ab419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.404+0000 7f5abc62d640 1 --2- 172.21.15.170:0/3819089385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab4102b40 0x7f5ab419d6c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.404+0000 7f5abc62d640 1 -- 172.21.15.170:0/3819089385 >> 172.21.15.170:0/3819089385 conn(0x7f5ab40fc520 msgr2=0x7f5ab4103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:06.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.405+0000 7f5abc62d640 1 -- 172.21.15.170:0/3819089385 shutdown_connections 2024-09-04T16:54:06.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.405+0000 7f5abc62d640 1 -- 172.21.15.170:0/3819089385 wait complete. 2024-09-04T16:54:06.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:06 smithi193 ceph-mon[82547]: pgmap v731: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:06.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.485+0000 7f4c3b321640 1 -- 172.21.15.170:0/3410588943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c34107930 msgr2=0x7f4c34107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:06.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.485+0000 7f4c3b321640 1 --2- 172.21.15.170:0/3410588943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c34107930 0x7f4c34107d10 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009880 tx=0x7f4c3002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.485+0000 7f4c3b321640 1 -- 172.21.15.170:0/3410588943 shutdown_connections 2024-09-04T16:54:06.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.485+0000 7f4c3b321640 1 --2- 172.21.15.170:0/3410588943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c34101930 0x7f4c34101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.485+0000 7f4c3b321640 1 --2- 172.21.15.170:0/3410588943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c34107930 0x7f4c34107d10 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.485+0000 7f4c3b321640 1 -- 172.21.15.170:0/3410588943 >> 172.21.15.170:0/3410588943 conn(0x7f4c340fd630 msgr2=0x7f4c340ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:06.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.485+0000 7f4c3b321640 1 -- 172.21.15.170:0/3410588943 shutdown_connections 2024-09-04T16:54:06.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.485+0000 7f4c3b321640 1 -- 172.21.15.170:0/3410588943 wait complete. 2024-09-04T16:54:06.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.486+0000 7f4c3b321640 1 Processor -- start 2024-09-04T16:54:06.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.486+0000 7f4c3b321640 1 -- start start 2024-09-04T16:54:06.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.486+0000 7f4c3b321640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c34101930 0x7f4c3419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:06.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.486+0000 7f4c3b321640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c34107930 0x7f4c3419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:06.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.486+0000 7f4c3b321640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3410ee00 con 0x7f4c34107930 2024-09-04T16:54:06.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.486+0000 7f4c3b321640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3410ec80 con 0x7f4c34101930 2024-09-04T16:54:06.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.486+0000 7f4c388bc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c34107930 0x7f4c3419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:06.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.486+0000 7f4c388bc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c34107930 0x7f4c3419fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44988/0 (socket says 172.21.15.170:44988) 2024-09-04T16:54:06.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.486+0000 7f4c388bc640 1 -- 172.21.15.170:0/1801039282 learned_addr learned my addr 172.21.15.170:0/1801039282 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:54:06.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.486+0000 7f4c390bd640 1 --2- 172.21.15.170:0/1801039282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c34101930 0x7f4c3419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:06.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.487+0000 7f4c388bc640 1 -- 172.21.15.170:0/1801039282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c34101930 msgr2=0x7f4c3419f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:06.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.487+0000 7f4c388bc640 1 --2- 172.21.15.170:0/1801039282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c34101930 0x7f4c3419f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.487+0000 7f4c388bc640 1 -- 172.21.15.170:0/1801039282 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c341999e0 con 0x7f4c34107930 2024-09-04T16:54:06.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.487+0000 7f4c390bd640 1 --2- 172.21.15.170:0/1801039282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c34101930 0x7f4c3419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:54:06.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.487+0000 7f4c388bc640 1 --2- 172.21.15.170:0/1801039282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c34107930 0x7f4c3419fd60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400d6f0 tx=0x7f4c2400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:06.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.487+0000 7f4c2a7fc640 1 -- 172.21.15.170:0/1801039282 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c24017070 con 0x7f4c34107930 2024-09-04T16:54:06.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.487+0000 7f4c2a7fc640 1 -- 172.21.15.170:0/1801039282 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4c2400de00 con 0x7f4c34107930 2024-09-04T16:54:06.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.487+0000 7f4c3b321640 1 -- 172.21.15.170:0/1801039282 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c34199cd0 con 0x7f4c34107930 2024-09-04T16:54:06.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.487+0000 7f4c2a7fc640 1 -- 172.21.15.170:0/1801039282 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c24004bb0 con 0x7f4c34107930 2024-09-04T16:54:06.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.487+0000 7f4c3b321640 1 -- 172.21.15.170:0/1801039282 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c3419a260 con 0x7f4c34107930 2024-09-04T16:54:06.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.488+0000 7f4c3b321640 1 -- 172.21.15.170:0/1801039282 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c34103070 con 0x7f4c34107930 2024-09-04T16:54:06.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.489+0000 7f4c2a7fc640 1 -- 172.21.15.170:0/1801039282 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f4c24009a30 con 0x7f4c34107930 2024-09-04T16:54:06.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.489+0000 7f4c2a7fc640 1 --2- 172.21.15.170:0/1801039282 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c20079e80 0x7f4c2007c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:06.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.489+0000 7f4c2a7fc640 1 -- 172.21.15.170:0/1801039282 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4c2409c610 con 0x7f4c34107930 2024-09-04T16:54:06.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.490+0000 7f4c390bd640 1 --2- 172.21.15.170:0/1801039282 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c20079e80 0x7f4c2007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:06.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.490+0000 7f4c390bd640 1 --2- 172.21.15.170:0/1801039282 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c20079e80 0x7f4c2007c340 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4c30000c00 tx=0x7f4c30031420 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:06.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.494+0000 7f4c2a7fc640 1 -- 172.21.15.170:0/1801039282 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4c240640a0 con 0x7f4c34107930 2024-09-04T16:54:06.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.734+0000 7f4c3b321640 1 -- 172.21.15.170:0/1801039282 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4c3419af10 con 0x7f4c34107930 2024-09-04T16:54:06.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.735+0000 7f4c2a7fc640 1 -- 172.21.15.170:0/1801039282 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f4c24068210 con 0x7f4c34107930 2024-09-04T16:54:06.736 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:54:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:54:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:54:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:54:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:54:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:54:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:54:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:54:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:54:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:54:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:54:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:54:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:54:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:54:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:54:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:54:06.737 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:54:06.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.738+0000 7f4c3b321640 1 -- 172.21.15.170:0/1801039282 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c20079e80 msgr2=0x7f4c2007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:06.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.738+0000 7f4c3b321640 1 --2- 172.21.15.170:0/1801039282 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c20079e80 0x7f4c2007c340 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4c30000c00 tx=0x7f4c30031420 comp rx=0 tx=0).stop 2024-09-04T16:54:06.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.738+0000 7f4c3b321640 1 -- 172.21.15.170:0/1801039282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c34107930 msgr2=0x7f4c3419fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:06.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.738+0000 7f4c3b321640 1 --2- 172.21.15.170:0/1801039282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c34107930 0x7f4c3419fd60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400d6f0 tx=0x7f4c2400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.738+0000 7f4c3b321640 1 -- 172.21.15.170:0/1801039282 shutdown_connections 2024-09-04T16:54:06.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.738+0000 7f4c3b321640 1 --2- 172.21.15.170:0/1801039282 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4c20079e80 0x7f4c2007c340 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.738+0000 7f4c3b321640 1 --2- 172.21.15.170:0/1801039282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c34107930 0x7f4c3419fd60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.738+0000 7f4c3b321640 1 --2- 172.21.15.170:0/1801039282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c34101930 0x7f4c3419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.738+0000 7f4c3b321640 1 -- 172.21.15.170:0/1801039282 >> 172.21.15.170:0/1801039282 conn(0x7f4c340fd630 msgr2=0x7f4c34074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:06.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.738+0000 7f4c3b321640 1 -- 172.21.15.170:0/1801039282 shutdown_connections 2024-09-04T16:54:06.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.738+0000 7f4c3b321640 1 -- 172.21.15.170:0/1801039282 wait complete. 2024-09-04T16:54:06.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.819+0000 7f9b58e57640 1 -- 172.21.15.170:0/257244388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b54101930 msgr2=0x7f9b54101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:06.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.819+0000 7f9b58e57640 1 --2- 172.21.15.170:0/257244388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b54101930 0x7f9b54101d90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9b48009880 tx=0x7f9b4802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.819+0000 7f9b58e57640 1 -- 172.21.15.170:0/257244388 shutdown_connections 2024-09-04T16:54:06.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.819+0000 7f9b58e57640 1 --2- 172.21.15.170:0/257244388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b54101930 0x7f9b54101d90 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.819+0000 7f9b58e57640 1 --2- 172.21.15.170:0/257244388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b54107930 0x7f9b54107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.819+0000 7f9b58e57640 1 -- 172.21.15.170:0/257244388 >> 172.21.15.170:0/257244388 conn(0x7f9b540fd630 msgr2=0x7f9b540ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:06.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.819+0000 7f9b58e57640 1 -- 172.21.15.170:0/257244388 shutdown_connections 2024-09-04T16:54:06.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.819+0000 7f9b58e57640 1 -- 172.21.15.170:0/257244388 wait complete. 2024-09-04T16:54:06.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.820+0000 7f9b58e57640 1 Processor -- start 2024-09-04T16:54:06.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.820+0000 7f9b58e57640 1 -- start start 2024-09-04T16:54:06.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.820+0000 7f9b58e57640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b54101930 0x7f9b5419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:06.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.820+0000 7f9b58e57640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b54107930 0x7f9b5419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:06.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.820+0000 7f9b58e57640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5410ee00 con 0x7f9b54101930 2024-09-04T16:54:06.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.820+0000 7f9b58e57640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5410ec80 con 0x7f9b54107930 2024-09-04T16:54:06.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.820+0000 7f9b5259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b54101930 0x7f9b5419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:06.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.820+0000 7f9b5259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b54101930 0x7f9b5419d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:45002/0 (socket says 172.21.15.170:45002) 2024-09-04T16:54:06.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.820+0000 7f9b5259c640 1 -- 172.21.15.170:0/1835529343 learned_addr learned my addr 172.21.15.170:0/1835529343 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:54:06.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.821+0000 7f9b51d9b640 1 --2- 172.21.15.170:0/1835529343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b54107930 0x7f9b5419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:06.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.821+0000 7f9b5259c640 1 -- 172.21.15.170:0/1835529343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b54107930 msgr2=0x7f9b5419dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:06.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.821+0000 7f9b5259c640 1 --2- 172.21.15.170:0/1835529343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b54107930 0x7f9b5419dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:06.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.821+0000 7f9b5259c640 1 -- 172.21.15.170:0/1835529343 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b54197810 con 0x7f9b54101930 2024-09-04T16:54:06.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.821+0000 7f9b51d9b640 1 --2- 172.21.15.170:0/1835529343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b54107930 0x7f9b5419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:54:06.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.821+0000 7f9b5259c640 1 --2- 172.21.15.170:0/1835529343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b54101930 0x7f9b5419d690 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400d6f0 tx=0x7f9b4400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:06.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.821+0000 7f9b437fe640 1 -- 172.21.15.170:0/1835529343 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b44017070 con 0x7f9b54101930 2024-09-04T16:54:06.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.821+0000 7f9b437fe640 1 -- 172.21.15.170:0/1835529343 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9b4400de00 con 0x7f9b54101930 2024-09-04T16:54:06.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.821+0000 7f9b58e57640 1 -- 172.21.15.170:0/1835529343 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b54197b00 con 0x7f9b54101930 2024-09-04T16:54:06.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.821+0000 7f9b437fe640 1 -- 172.21.15.170:0/1835529343 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b44004bb0 con 0x7f9b54101930 2024-09-04T16:54:06.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.821+0000 7f9b58e57640 1 -- 172.21.15.170:0/1835529343 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b54198090 con 0x7f9b54101930 2024-09-04T16:54:06.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.822+0000 7f9b58e57640 1 -- 172.21.15.170:0/1835529343 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b54103070 con 0x7f9b54101930 2024-09-04T16:54:06.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.823+0000 7f9b437fe640 1 -- 172.21.15.170:0/1835529343 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f9b44004e60 con 0x7f9b54101930 2024-09-04T16:54:06.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.823+0000 7f9b437fe640 1 --2- 172.21.15.170:0/1835529343 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b3c079e40 0x7f9b3c07c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:06.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.823+0000 7f9b437fe640 1 -- 172.21.15.170:0/1835529343 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9b4409c730 con 0x7f9b54101930 2024-09-04T16:54:06.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.823+0000 7f9b51d9b640 1 --2- 172.21.15.170:0/1835529343 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b3c079e40 0x7f9b3c07c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:06.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.824+0000 7f9b51d9b640 1 --2- 172.21.15.170:0/1835529343 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b3c079e40 0x7f9b3c07c300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9b48031460 tx=0x7f9b480041a0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:06.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:06.827+0000 7f9b437fe640 1 -- 172.21.15.170:0/1835529343 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9b44064140 con 0x7f9b54101930 2024-09-04T16:54:07.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.038+0000 7f9b58e57640 1 -- 172.21.15.170:0/1835529343 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9b54109ea0 con 0x7f9b54101930 2024-09-04T16:54:07.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.039+0000 7f9b437fe640 1 -- 172.21.15.170:0/1835529343 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2000 (secure 0 0 0) 0x7f9b440682b0 con 0x7f9b54101930 2024-09-04T16:54:07.040 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-09-04T16:54:07.040 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:39:11:508921+0000 2024-09-04T16:54:07.040 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:54:07.040 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:54:07.040 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:54:07.041 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:54:07.041 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:54:07.041 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:54:07.041 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 16 2024-09-04T16:54:07.041 INFO:teuthology.orchestra.run.smithi170.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-04T16:54:07.041 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:54:07.041 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:38:15.784227+0000 2024-09-04T16:54:07.041 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:54:07.041 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:54:07.041 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:54:07.041 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:54:07.041 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:54:07.042 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:54:07.042 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:54:07.042 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:54:07.042 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:54:07.042 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:54:07.042 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:54:07.042 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:54:07.042 INFO:teuthology.orchestra.run.smithi170.stdout:up {} 2024-09-04T16:54:07.042 INFO:teuthology.orchestra.run.smithi170.stdout:failed 0,1 2024-09-04T16:54:07.042 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:54:07.042 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:54:07.042 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:54:07.042 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:54:07.043 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:54:07.043 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:54:07.043 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:54:07.043 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:54:07.043 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 0 members: 2024-09-04T16:54:07.043 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:54:07.043 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:54:07.043 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:54:07.043 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:54:07.043 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:54:07.043 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{-1:34356} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:54:07.043 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:54:07.043 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:54:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:54:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.041+0000 7f9b58e57640 1 -- 172.21.15.170:0/1835529343 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b3c079e40 msgr2=0x7f9b3c07c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.041+0000 7f9b58e57640 1 --2- 172.21.15.170:0/1835529343 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b3c079e40 0x7f9b3c07c300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9b48031460 tx=0x7f9b480041a0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.041+0000 7f9b58e57640 1 -- 172.21.15.170:0/1835529343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b54101930 msgr2=0x7f9b5419d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.041+0000 7f9b58e57640 1 --2- 172.21.15.170:0/1835529343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b54101930 0x7f9b5419d690 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400d6f0 tx=0x7f9b4400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.041+0000 7f9b58e57640 1 -- 172.21.15.170:0/1835529343 shutdown_connections 2024-09-04T16:54:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.041+0000 7f9b58e57640 1 --2- 172.21.15.170:0/1835529343 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9b3c079e40 0x7f9b3c07c300 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.041+0000 7f9b58e57640 1 --2- 172.21.15.170:0/1835529343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b54107930 0x7f9b5419dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.041+0000 7f9b58e57640 1 --2- 172.21.15.170:0/1835529343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b54101930 0x7f9b5419d690 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.041+0000 7f9b58e57640 1 -- 172.21.15.170:0/1835529343 >> 172.21.15.170:0/1835529343 conn(0x7f9b540fd630 msgr2=0x7f9b540fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.041+0000 7f9b58e57640 1 -- 172.21.15.170:0/1835529343 shutdown_connections 2024-09-04T16:54:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.041+0000 7f9b58e57640 1 -- 172.21.15.170:0/1835529343 wait complete. 2024-09-04T16:54:07.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.123+0000 7fcd6e9c2640 1 -- 172.21.15.170:0/417467461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd68106810 msgr2=0x7fcd68106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:07.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.123+0000 7fcd6e9c2640 1 --2- 172.21.15.170:0/417467461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd68106810 0x7fcd68106bf0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009880 tx=0x7fcd5802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.123+0000 7fcd6e9c2640 1 -- 172.21.15.170:0/417467461 shutdown_connections 2024-09-04T16:54:07.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.123+0000 7fcd6e9c2640 1 --2- 172.21.15.170:0/417467461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd68100810 0x7fcd68100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.123+0000 7fcd6e9c2640 1 --2- 172.21.15.170:0/417467461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd68106810 0x7fcd68106bf0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.123+0000 7fcd6e9c2640 1 -- 172.21.15.170:0/417467461 >> 172.21.15.170:0/417467461 conn(0x7fcd680fc510 msgr2=0x7fcd680fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:07.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.123+0000 7fcd6e9c2640 1 -- 172.21.15.170:0/417467461 shutdown_connections 2024-09-04T16:54:07.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.123+0000 7fcd6e9c2640 1 -- 172.21.15.170:0/417467461 wait complete. 2024-09-04T16:54:07.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.124+0000 7fcd6e9c2640 1 Processor -- start 2024-09-04T16:54:07.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.124+0000 7fcd6e9c2640 1 -- start start 2024-09-04T16:54:07.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.124+0000 7fcd6e9c2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd68100810 0x7fcd681987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.124+0000 7fcd6e9c2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd68106810 0x7fcd68198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.124+0000 7fcd6e9c2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6810dcc0 con 0x7fcd68100810 2024-09-04T16:54:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.124+0000 7fcd6e9c2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6810db40 con 0x7fcd68106810 2024-09-04T16:54:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.124+0000 7fcd67fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd68100810 0x7fcd681987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.124+0000 7fcd67fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd68100810 0x7fcd681987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:45016/0 (socket says 172.21.15.170:45016) 2024-09-04T16:54:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.124+0000 7fcd67fff640 1 -- 172.21.15.170:0/1710197913 learned_addr learned my addr 172.21.15.170:0/1710197913 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:54:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.124+0000 7fcd677fe640 1 --2- 172.21.15.170:0/1710197913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd68106810 0x7fcd68198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.125+0000 7fcd67fff640 1 -- 172.21.15.170:0/1710197913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd68106810 msgr2=0x7fcd68198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.125+0000 7fcd67fff640 1 --2- 172.21.15.170:0/1710197913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd68106810 0x7fcd68198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.125+0000 7fcd67fff640 1 -- 172.21.15.170:0/1710197913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd681992a0 con 0x7fcd68100810 2024-09-04T16:54:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.125+0000 7fcd67fff640 1 --2- 172.21.15.170:0/1710197913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd68100810 0x7fcd681987f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fcd58031460 tx=0x7fcd580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:07.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.125+0000 7fcd657fa640 1 -- 172.21.15.170:0/1710197913 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd5803f070 con 0x7fcd68100810 2024-09-04T16:54:07.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.125+0000 7fcd657fa640 1 -- 172.21.15.170:0/1710197913 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd58004cf0 con 0x7fcd68100810 2024-09-04T16:54:07.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.125+0000 7fcd6e9c2640 1 -- 172.21.15.170:0/1710197913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd68199530 con 0x7fcd68100810 2024-09-04T16:54:07.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.125+0000 7fcd657fa640 1 -- 172.21.15.170:0/1710197913 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd58035030 con 0x7fcd68100810 2024-09-04T16:54:07.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.125+0000 7fcd6e9c2640 1 -- 172.21.15.170:0/1710197913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd681a1ae0 con 0x7fcd68100810 2024-09-04T16:54:07.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.126+0000 7fcd6e9c2640 1 -- 172.21.15.170:0/1710197913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd68101f50 con 0x7fcd68100810 2024-09-04T16:54:07.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.127+0000 7fcd657fa640 1 -- 172.21.15.170:0/1710197913 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fcd58042070 con 0x7fcd68100810 2024-09-04T16:54:07.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.127+0000 7fcd657fa640 1 --2- 172.21.15.170:0/1710197913 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd54079e30 0x7fcd5407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:07.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.127+0000 7fcd657fa640 1 -- 172.21.15.170:0/1710197913 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fcd580bd480 con 0x7fcd68100810 2024-09-04T16:54:07.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.127+0000 7fcd677fe640 1 --2- 172.21.15.170:0/1710197913 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd54079e30 0x7fcd5407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:07.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.128+0000 7fcd677fe640 1 --2- 172.21.15.170:0/1710197913 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd54079e30 0x7fcd5407c2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcd6806ae50 tx=0x7fcd5000a2d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:07.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.132+0000 7fcd657fa640 1 -- 172.21.15.170:0/1710197913 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcd58084e90 con 0x7fcd68100810 2024-09-04T16:54:07.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.323+0000 7fcd6e9c2640 1 -- 172.21.15.170:0/1710197913 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcd68062630 con 0x7fcd54079e30 2024-09-04T16:54:07.324 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:07 smithi170 ceph-mon[113855]: from='client.35146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:54:07.324 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:07 smithi170 ceph-mon[113855]: from='client.35150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:54:07.324 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:07 smithi170 ceph-mon[113855]: from='client.35154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:54:07.324 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:07 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1801039282' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:07.325 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:07 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1835529343' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:54:07.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.324+0000 7fcd657fa640 1 -- 172.21.15.170:0/1710197913 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fcd68062630 con 0x7fcd54079e30 2024-09-04T16:54:07.325 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:54:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4", 2024-09-04T16:54:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": true, 2024-09-04T16:54:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-04T16:54:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [ 2024-09-04T16:54:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-09-04T16:54:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr", 2024-09-04T16:54:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "osd", 2024-09-04T16:54:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "mds", 2024-09-04T16:54:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "mon" 2024-09-04T16:54:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-09-04T16:54:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": "16/23 daemons upgraded", 2024-09-04T16:54:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "Currently upgrading mds daemons", 2024-09-04T16:54:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:54:07.326 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:54:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.327+0000 7fcd6e9c2640 1 -- 172.21.15.170:0/1710197913 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd54079e30 msgr2=0x7fcd5407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.327+0000 7fcd6e9c2640 1 --2- 172.21.15.170:0/1710197913 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd54079e30 0x7fcd5407c2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcd6806ae50 tx=0x7fcd5000a2d0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.327+0000 7fcd6e9c2640 1 -- 172.21.15.170:0/1710197913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd68100810 msgr2=0x7fcd681987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.327+0000 7fcd6e9c2640 1 --2- 172.21.15.170:0/1710197913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd68100810 0x7fcd681987f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fcd58031460 tx=0x7fcd580048f0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.327+0000 7fcd6e9c2640 1 -- 172.21.15.170:0/1710197913 shutdown_connections 2024-09-04T16:54:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.327+0000 7fcd6e9c2640 1 --2- 172.21.15.170:0/1710197913 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fcd54079e30 0x7fcd5407c2f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.327+0000 7fcd6e9c2640 1 --2- 172.21.15.170:0/1710197913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd68106810 0x7fcd68198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.327+0000 7fcd6e9c2640 1 --2- 172.21.15.170:0/1710197913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd68100810 0x7fcd681987f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.327+0000 7fcd6e9c2640 1 -- 172.21.15.170:0/1710197913 >> 172.21.15.170:0/1710197913 conn(0x7fcd680fc510 msgr2=0x7fcd680fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.327+0000 7fcd6e9c2640 1 -- 172.21.15.170:0/1710197913 shutdown_connections 2024-09-04T16:54:07.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.327+0000 7fcd6e9c2640 1 -- 172.21.15.170:0/1710197913 wait complete. 2024-09-04T16:54:07.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:07 smithi193 ceph-mon[82547]: from='client.35146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:54:07.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:07 smithi193 ceph-mon[82547]: from='client.35150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:54:07.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:07 smithi193 ceph-mon[82547]: from='client.35154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:54:07.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:07 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1801039282' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:07.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:07 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1835529343' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:54:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.408+0000 7f1eb2fdc640 1 -- 172.21.15.170:0/3053468382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eac106820 msgr2=0x7f1eac106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.408+0000 7f1eb2fdc640 1 --2- 172.21.15.170:0/3053468382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eac106820 0x7f1eac106c00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0009880 tx=0x7f1ea002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.408+0000 7f1eb2fdc640 1 -- 172.21.15.170:0/3053468382 shutdown_connections 2024-09-04T16:54:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.408+0000 7f1eb2fdc640 1 --2- 172.21.15.170:0/3053468382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1eac100820 0x7f1eac100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.408+0000 7f1eb2fdc640 1 --2- 172.21.15.170:0/3053468382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eac106820 0x7f1eac106c00 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.408+0000 7f1eb2fdc640 1 -- 172.21.15.170:0/3053468382 >> 172.21.15.170:0/3053468382 conn(0x7f1eac0fc520 msgr2=0x7f1eac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.408+0000 7f1eb2fdc640 1 -- 172.21.15.170:0/3053468382 shutdown_connections 2024-09-04T16:54:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.408+0000 7f1eb2fdc640 1 -- 172.21.15.170:0/3053468382 wait complete. 2024-09-04T16:54:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.409+0000 7f1eb2fdc640 1 Processor -- start 2024-09-04T16:54:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.409+0000 7f1eb2fdc640 1 -- start start 2024-09-04T16:54:07.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.409+0000 7f1eb2fdc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eac100820 0x7f1eac107750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.409+0000 7f1eb2fdc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1eac106820 0x7f1eac107c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.409+0000 7f1eb2fdc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1eac10dcd0 con 0x7f1eac100820 2024-09-04T16:54:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.409+0000 7f1eb2fdc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1eac10db50 con 0x7f1eac106820 2024-09-04T16:54:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.409+0000 7f1eb0d78640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eac100820 0x7f1eac107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.409+0000 7f1eb0d78640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eac100820 0x7f1eac107750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:45020/0 (socket says 172.21.15.170:45020) 2024-09-04T16:54:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.409+0000 7f1eb0d78640 1 -- 172.21.15.170:0/3313796211 learned_addr learned my addr 172.21.15.170:0/3313796211 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:54:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.409+0000 7f1eb0d78640 1 -- 172.21.15.170:0/3313796211 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1eac106820 msgr2=0x7f1eac107c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.409+0000 7f1eabfff640 1 --2- 172.21.15.170:0/3313796211 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1eac106820 0x7f1eac107c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.409+0000 7f1eb0d78640 1 --2- 172.21.15.170:0/3313796211 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1eac106820 0x7f1eac107c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.409+0000 7f1eb0d78640 1 -- 172.21.15.170:0/3313796211 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eac1081d0 con 0x7f1eac100820 2024-09-04T16:54:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.410+0000 7f1eb0d78640 1 --2- 172.21.15.170:0/3313796211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eac100820 0x7f1eac107750 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0031460 tx=0x7f1ea00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.410+0000 7f1ea9ffb640 1 -- 172.21.15.170:0/3313796211 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ea003f070 con 0x7f1eac100820 2024-09-04T16:54:07.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.410+0000 7f1ea9ffb640 1 -- 172.21.15.170:0/3313796211 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1ea00035f0 con 0x7f1eac100820 2024-09-04T16:54:07.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.410+0000 7f1eb2fdc640 1 -- 172.21.15.170:0/3313796211 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eac108460 con 0x7f1eac100820 2024-09-04T16:54:07.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.410+0000 7f1ea9ffb640 1 -- 172.21.15.170:0/3313796211 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ea0035030 con 0x7f1eac100820 2024-09-04T16:54:07.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.410+0000 7f1eb2fdc640 1 -- 172.21.15.170:0/3313796211 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eac1a3e00 con 0x7f1eac100820 2024-09-04T16:54:07.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.411+0000 7f1eb2fdc640 1 -- 172.21.15.170:0/3313796211 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eac101f60 con 0x7f1eac100820 2024-09-04T16:54:07.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.412+0000 7f1ea9ffb640 1 -- 172.21.15.170:0/3313796211 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f1ea0042070 con 0x7f1eac100820 2024-09-04T16:54:07.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.412+0000 7f1ea9ffb640 1 --2- 172.21.15.170:0/3313796211 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1e9c079e30 0x7f1e9c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:07.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.412+0000 7f1ea9ffb640 1 -- 172.21.15.170:0/3313796211 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f1ea00bd460 con 0x7f1eac100820 2024-09-04T16:54:07.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.412+0000 7f1eabfff640 1 --2- 172.21.15.170:0/3313796211 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1e9c079e30 0x7f1e9c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:07.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.413+0000 7f1eabfff640 1 --2- 172.21.15.170:0/3313796211 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1e9c079e30 0x7f1e9c07c2f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1e98005fd0 tx=0x7f1e98009470 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:07.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.416+0000 7f1ea9ffb640 1 -- 172.21.15.170:0/3313796211 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1ea0084e70 con 0x7f1eac100820 2024-09-04T16:54:07.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.660+0000 7f1eb2fdc640 1 -- 172.21.15.170:0/3313796211 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f1eac1a4140 con 0x7f1eac100820 2024-09-04T16:54:07.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.660+0000 7f1ea9ffb640 1 -- 172.21.15.170:0/3313796211 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f1ea0088fe0 con 0x7f1eac100820 2024-09-04T16:54:07.661 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-04T16:54:07.661 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-04T16:54:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is degraded 2024-09-04T16:54:07.661 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:54:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:54:07.661 INFO:teuthology.orchestra.run.smithi170.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-04T16:54:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-04T16:54:07.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.662+0000 7f1eb2fdc640 1 -- 172.21.15.170:0/3313796211 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1e9c079e30 msgr2=0x7f1e9c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:07.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.662+0000 7f1eb2fdc640 1 --2- 172.21.15.170:0/3313796211 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1e9c079e30 0x7f1e9c07c2f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1e98005fd0 tx=0x7f1e98009470 comp rx=0 tx=0).stop 2024-09-04T16:54:07.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.662+0000 7f1eb2fdc640 1 -- 172.21.15.170:0/3313796211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eac100820 msgr2=0x7f1eac107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:07.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.662+0000 7f1eb2fdc640 1 --2- 172.21.15.170:0/3313796211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eac100820 0x7f1eac107750 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0031460 tx=0x7f1ea00045e0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.662+0000 7f1eb2fdc640 1 -- 172.21.15.170:0/3313796211 shutdown_connections 2024-09-04T16:54:07.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.662+0000 7f1eb2fdc640 1 --2- 172.21.15.170:0/3313796211 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f1e9c079e30 0x7f1e9c07c2f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.662+0000 7f1eb2fdc640 1 --2- 172.21.15.170:0/3313796211 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1eac106820 0x7f1eac107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.662+0000 7f1eb2fdc640 1 --2- 172.21.15.170:0/3313796211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eac100820 0x7f1eac107750 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:07.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.662+0000 7f1eb2fdc640 1 -- 172.21.15.170:0/3313796211 >> 172.21.15.170:0/3313796211 conn(0x7f1eac0fc520 msgr2=0x7f1eac06a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:07.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.662+0000 7f1eb2fdc640 1 -- 172.21.15.170:0/3313796211 shutdown_connections 2024-09-04T16:54:07.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:07.662+0000 7f1eb2fdc640 1 -- 172.21.15.170:0/3313796211 wait complete. 2024-09-04T16:54:08.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:08 smithi193 ceph-mon[82547]: pgmap v732: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:08.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:08 smithi193 ceph-mon[82547]: from='client.35166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:54:08.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:08 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3313796211' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:54:08.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:08 smithi170 ceph-mon[113855]: pgmap v732: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:08.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:08 smithi170 ceph-mon[113855]: from='client.35166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:54:08.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:08 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3313796211' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:54:10.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:10 smithi193 ceph-mon[82547]: pgmap v733: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:10 smithi170 ceph-mon[113855]: pgmap v733: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:11.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:54:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:54:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:54:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi170.rzbrux"} : dispatch 2024-09-04T16:54:11.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi170.rzbrux"}]': finished 2024-09-04T16:54:11.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi170.zkhdil"} : dispatch 2024-09-04T16:54:11.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi170.zkhdil"}]': finished 2024-09-04T16:54:11.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi193.kabapr"} : dispatch 2024-09-04T16:54:11.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi193.kabapr"}]': finished 2024-09-04T16:54:11.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi193.xostco"} : dispatch 2024-09-04T16:54:11.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi193.xostco"}]': finished 2024-09-04T16:54:11.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:11 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-04T16:54:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:54:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:54:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:54:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:11.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:11.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:11.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:11.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi170.rzbrux"} : dispatch 2024-09-04T16:54:11.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi170.rzbrux"}]': finished 2024-09-04T16:54:11.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi170.zkhdil"} : dispatch 2024-09-04T16:54:11.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi170.zkhdil"}]': finished 2024-09-04T16:54:11.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi193.kabapr"} : dispatch 2024-09-04T16:54:11.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi193.kabapr"}]': finished 2024-09-04T16:54:11.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi193.xostco"} : dispatch 2024-09-04T16:54:11.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi193.xostco"}]': finished 2024-09-04T16:54:11.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:11 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-04T16:54:12.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:12 smithi193 ceph-mon[82547]: pgmap v734: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:12 smithi193 ceph-mon[82547]: pgmap v735: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:12 smithi193 ceph-mon[82547]: Upgrade: Setting container_image for all mds 2024-09-04T16:54:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:12 smithi193 ceph-mon[82547]: Upgrade: Setting filesystem cephfs Joinable 2024-09-04T16:54:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:12 smithi193 ceph-mon[82547]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-04T16:54:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-04T16:54:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:12 smithi193 ceph-mon[82547]: Standby daemon mds.cephfs.smithi170.zkhdil assigned to filesystem cephfs as rank 0 2024-09-04T16:54:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:12 smithi193 ceph-mon[82547]: Standby daemon mds.cephfs.smithi170.rzbrux assigned to filesystem cephfs as rank 1 2024-09-04T16:54:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:12 smithi193 ceph-mon[82547]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-04T16:54:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:12 smithi193 ceph-mon[82547]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-04T16:54:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:12 smithi193 ceph-mon[82547]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:replay,1=cephfs.smithi170.rzbrux=up:replay} 2 up:standby 2024-09-04T16:54:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:12.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:12.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:12.408 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:12 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:12.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:12 smithi170 ceph-mon[113855]: pgmap v734: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:12.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:12 smithi170 ceph-mon[113855]: pgmap v735: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:12.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:12 smithi170 ceph-mon[113855]: Upgrade: Setting container_image for all mds 2024-09-04T16:54:12.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:12 smithi170 ceph-mon[113855]: Upgrade: Setting filesystem cephfs Joinable 2024-09-04T16:54:12.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:12 smithi170 ceph-mon[113855]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-04T16:54:12.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-04T16:54:12.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:12 smithi170 ceph-mon[113855]: Standby daemon mds.cephfs.smithi170.zkhdil assigned to filesystem cephfs as rank 0 2024-09-04T16:54:12.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:12 smithi170 ceph-mon[113855]: Standby daemon mds.cephfs.smithi170.rzbrux assigned to filesystem cephfs as rank 1 2024-09-04T16:54:12.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:12 smithi170 ceph-mon[113855]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-04T16:54:12.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:12 smithi170 ceph-mon[113855]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-04T16:54:12.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:12 smithi170 ceph-mon[113855]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:replay,1=cephfs.smithi170.rzbrux=up:replay} 2 up:standby 2024-09-04T16:54:12.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:12.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:12.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:12.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:12.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:12 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:13.570 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:13 smithi170 ceph-mon[113855]: Upgrade: Setting container_image for all rgw 2024-09-04T16:54:13.570 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:13 smithi170 ceph-mon[113855]: Upgrade: Setting container_image for all rbd-mirror 2024-09-04T16:54:13.570 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:13 smithi170 ceph-mon[113855]: mds.? [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] up:resolve 2024-09-04T16:54:13.570 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:13 smithi170 ceph-mon[113855]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:replay,1=cephfs.smithi170.rzbrux=up:resolve} 2 up:standby 2024-09-04T16:54:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:13 smithi193 ceph-mon[82547]: Upgrade: Setting container_image for all rgw 2024-09-04T16:54:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:13 smithi193 ceph-mon[82547]: Upgrade: Setting container_image for all rbd-mirror 2024-09-04T16:54:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:13 smithi193 ceph-mon[82547]: mds.? [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] up:resolve 2024-09-04T16:54:13.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:13 smithi193 ceph-mon[82547]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:replay,1=cephfs.smithi170.rzbrux=up:resolve} 2 up:standby 2024-09-04T16:54:14.331 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:14 smithi170 ceph-mon[113855]: pgmap v736: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-09-04T16:54:14.331 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:14.331 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-04T16:54:14.331 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:54:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:14 smithi193 ceph-mon[82547]: pgmap v736: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-09-04T16:54:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-04T16:54:14.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:54:15.431 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:15 smithi170 ceph-mon[113855]: Upgrade: Updating ceph-exporter.smithi170 (1/2) 2024-09-04T16:54:15.431 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:15 smithi170 ceph-mon[113855]: Deploying daemon ceph-exporter.smithi170 on smithi170 2024-09-04T16:54:15.431 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:15 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:15.431 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:15 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:54:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:15 smithi193 ceph-mon[82547]: Upgrade: Updating ceph-exporter.smithi170 (1/2) 2024-09-04T16:54:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:15 smithi193 ceph-mon[82547]: Deploying daemon ceph-exporter.smithi170 on smithi170 2024-09-04T16:54:15.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:15 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:15.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:15 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:54:16.351 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:16 smithi170 ceph-mon[113855]: pgmap v737: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 1 op/s 2024-09-04T16:54:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:16 smithi193 ceph-mon[82547]: pgmap v737: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 1 op/s 2024-09-04T16:54:18.304 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:18 smithi193 ceph-mon[82547]: pgmap v738: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 9.8 MiB/s rd, 4 op/s 2024-09-04T16:54:18.304 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:18 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:18.304 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:18 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:18.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:18 smithi170 ceph-mon[113855]: pgmap v738: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 9.8 MiB/s rd, 4 op/s 2024-09-04T16:54:18.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:18 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:18.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:18 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:20.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:20 smithi170 ceph-mon[113855]: pgmap v739: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 7 op/s 2024-09-04T16:54:20.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:20 smithi170 ceph-mon[113855]: Upgrade: Updating ceph-exporter.smithi193 (2/2) 2024-09-04T16:54:20.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:20 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:20.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:20 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi193", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-04T16:54:20.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:20 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:54:20.277 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:20 smithi170 ceph-mon[113855]: Deploying daemon ceph-exporter.smithi193 on smithi193 2024-09-04T16:54:20.334 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:20 smithi193 ceph-mon[82547]: pgmap v739: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 7 op/s 2024-09-04T16:54:20.334 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:20 smithi193 ceph-mon[82547]: Upgrade: Updating ceph-exporter.smithi193 (2/2) 2024-09-04T16:54:20.334 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:20 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:20.334 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:20 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi193", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-04T16:54:20.334 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:20 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:54:20.334 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:20 smithi193 ceph-mon[82547]: Deploying daemon ceph-exporter.smithi193 on smithi193 2024-09-04T16:54:21.400 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:21 smithi193 ceph-mon[82547]: mds.? [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] up:resolve 2024-09-04T16:54:21.401 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:21 smithi193 ceph-mon[82547]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:resolve,1=cephfs.smithi170.rzbrux=up:resolve} 2 up:standby 2024-09-04T16:54:21.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:21 smithi170 ceph-mon[113855]: mds.? [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] up:resolve 2024-09-04T16:54:21.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:21 smithi170 ceph-mon[113855]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:resolve,1=cephfs.smithi170.rzbrux=up:resolve} 2 up:standby 2024-09-04T16:54:22.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:22 smithi193 ceph-mon[82547]: pgmap v740: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 7 op/s 2024-09-04T16:54:22.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:22 smithi193 ceph-mon[82547]: reconnect by client.14614 192.168.0.1:0/1095769706 after 0.000999975 2024-09-04T16:54:22.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:22 smithi193 ceph-mon[82547]: reconnect by client.24339 192.168.0.1:0/3752787761 after 0.000999975 2024-09-04T16:54:22.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:22 smithi193 ceph-mon[82547]: reconnect by client.14614 192.168.0.1:0/1095769706 after 0.00199995 2024-09-04T16:54:22.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:22 smithi193 ceph-mon[82547]: reconnect by client.24339 192.168.0.1:0/3752787761 after 0.00199995 2024-09-04T16:54:22.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:22 smithi193 ceph-mon[82547]: mds.? [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] up:reconnect 2024-09-04T16:54:22.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:22 smithi193 ceph-mon[82547]: mds.? [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] up:reconnect 2024-09-04T16:54:22.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:22 smithi193 ceph-mon[82547]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:reconnect,1=cephfs.smithi170.rzbrux=up:reconnect} 2 up:standby 2024-09-04T16:54:22.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:22 smithi170 ceph-mon[113855]: pgmap v740: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 7 op/s 2024-09-04T16:54:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:22 smithi170 ceph-mon[113855]: reconnect by client.14614 192.168.0.1:0/1095769706 after 0.000999975 2024-09-04T16:54:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:22 smithi170 ceph-mon[113855]: reconnect by client.24339 192.168.0.1:0/3752787761 after 0.000999975 2024-09-04T16:54:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:22 smithi170 ceph-mon[113855]: reconnect by client.14614 192.168.0.1:0/1095769706 after 0.00199995 2024-09-04T16:54:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:22 smithi170 ceph-mon[113855]: reconnect by client.24339 192.168.0.1:0/3752787761 after 0.00199995 2024-09-04T16:54:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:22 smithi170 ceph-mon[113855]: mds.? [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] up:reconnect 2024-09-04T16:54:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:22 smithi170 ceph-mon[113855]: mds.? [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] up:reconnect 2024-09-04T16:54:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:22 smithi170 ceph-mon[113855]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:reconnect,1=cephfs.smithi170.rzbrux=up:reconnect} 2 up:standby 2024-09-04T16:54:23.488 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:23 smithi193 ceph-mon[82547]: mds.? [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] up:rejoin 2024-09-04T16:54:23.488 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:23 smithi193 ceph-mon[82547]: mds.? [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] up:rejoin 2024-09-04T16:54:23.488 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:23 smithi193 ceph-mon[82547]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:rejoin,1=cephfs.smithi170.rzbrux=up:rejoin} 2 up:standby 2024-09-04T16:54:23.488 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:23 smithi193 ceph-mon[82547]: daemon mds.cephfs.smithi170.rzbrux is now active in filesystem cephfs as rank 1 2024-09-04T16:54:23.488 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:23 smithi193 ceph-mon[82547]: daemon mds.cephfs.smithi170.zkhdil is now active in filesystem cephfs as rank 0 2024-09-04T16:54:23.489 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:23 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:23.489 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:23 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:23.489 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:23 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:54:23.489 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:23 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:23.489 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:23 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:23.489 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:23 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:23.489 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:23 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:23 smithi170 ceph-mon[113855]: mds.? [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] up:rejoin 2024-09-04T16:54:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:23 smithi170 ceph-mon[113855]: mds.? [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] up:rejoin 2024-09-04T16:54:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:23 smithi170 ceph-mon[113855]: fsmap cephfs:2/2 {0=cephfs.smithi170.zkhdil=up:rejoin,1=cephfs.smithi170.rzbrux=up:rejoin} 2 up:standby 2024-09-04T16:54:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:23 smithi170 ceph-mon[113855]: daemon mds.cephfs.smithi170.rzbrux is now active in filesystem cephfs as rank 1 2024-09-04T16:54:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:23 smithi170 ceph-mon[113855]: daemon mds.cephfs.smithi170.zkhdil is now active in filesystem cephfs as rank 0 2024-09-04T16:54:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:23 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:23 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:23 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:54:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:23 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:23.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:23 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:23.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:23 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:23.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:23 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:24.457 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:24 smithi193 ceph-mon[82547]: pgmap v741: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 7 op/s 2024-09-04T16:54:24.458 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:24 smithi193 ceph-mon[82547]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-04T16:54:24.458 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:24 smithi193 ceph-mon[82547]: mds.? [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] up:active 2024-09-04T16:54:24.458 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:24 smithi193 ceph-mon[82547]: mds.? [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] up:active 2024-09-04T16:54:24.458 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:24 smithi193 ceph-mon[82547]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:active} 2 up:standby 2024-09-04T16:54:24.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:24 smithi170 ceph-mon[113855]: pgmap v741: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 7 op/s 2024-09-04T16:54:24.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:24 smithi170 ceph-mon[113855]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-04T16:54:24.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:24 smithi170 ceph-mon[113855]: mds.? [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] up:active 2024-09-04T16:54:24.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:24 smithi170 ceph-mon[113855]: mds.? [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] up:active 2024-09-04T16:54:24.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:24 smithi170 ceph-mon[113855]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:active} 2 up:standby 2024-09-04T16:54:26.548 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:26 smithi170 ceph-mon[113855]: pgmap v742: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-04T16:54:26.549 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:26 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:26.549 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:26 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:26 smithi193 ceph-mon[82547]: pgmap v742: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-04T16:54:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:26 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:26 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:27.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:27 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:27.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:27 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:27.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:27 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:27.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:27 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:27.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:27 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:27.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:27 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:27.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:27 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:27.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:27 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:28.538 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:28 smithi170 ceph-mon[113855]: pgmap v743: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 85 B/s wr, 10 op/s 2024-09-04T16:54:28.538 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:28 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:28.538 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:28 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:28 smithi193 ceph-mon[82547]: pgmap v743: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 85 B/s wr, 10 op/s 2024-09-04T16:54:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:28 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:28 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:30.231 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:30 smithi170 ceph-mon[113855]: pgmap v744: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-09-04T16:54:30.231 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:30.231 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:54:30.231 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:30.231 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:30 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:30 smithi193 ceph-mon[82547]: pgmap v744: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-09-04T16:54:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:54:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:30.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:30 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:32.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:32 smithi170 ceph-mon[113855]: pgmap v745: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-04T16:54:32.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:32 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:32.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:32 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:32.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:32 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:54:32.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:32 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:54:32.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:32 smithi170 ceph-mon[113855]: pgmap v746: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.9 KiB/s wr, 13 op/s 2024-09-04T16:54:32.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:32 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:32.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:32 smithi170 ceph-mon[113855]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-04T16:54:32.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:32 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:54:32.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:32 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:32.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:32 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:32.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:32 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:32.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:32 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:32.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:32 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:32.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:32 smithi170 ceph-mon[113855]: Upgrade: Setting filesystem cephfs Joinable 2024-09-04T16:54:32.353 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:32 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-04T16:54:32.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:32 smithi193 ceph-mon[82547]: pgmap v745: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-04T16:54:32.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:32 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:32.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:32 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:32.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:32 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:54:32.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:32 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:54:32.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:32 smithi193 ceph-mon[82547]: pgmap v746: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.9 KiB/s wr, 13 op/s 2024-09-04T16:54:32.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:32 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:32.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:32 smithi193 ceph-mon[82547]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-04T16:54:32.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:32 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:54:32.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:32 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:32.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:32 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:32.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:32 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:32.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:32 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:32.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:32 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:32.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:32 smithi193 ceph-mon[82547]: Upgrade: Setting filesystem cephfs Joinable 2024-09-04T16:54:32.407 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:32 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-04T16:54:33.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-04T16:54:33.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:active} 2 up:standby 2024-09-04T16:54:33.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.603 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: Upgrade: Setting container_image for all ceph-exporter 2024-09-04T16:54:33.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:33.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi170"} : dispatch 2024-09-04T16:54:33.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi170"}]': finished 2024-09-04T16:54:33.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi193"} : dispatch 2024-09-04T16:54:33.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi193"}]': finished 2024-09-04T16:54:33.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: Upgrade: Setting container_image for all iscsi 2024-09-04T16:54:33.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:33.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: Upgrade: Setting container_image for all nfs 2024-09-04T16:54:33.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:33.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: Upgrade: Setting container_image for all nvmeof 2024-09-04T16:54:33.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:33.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.605 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: Upgrade: Finalizing container_image settings 2024-09-04T16:54:33.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-04T16:54:33.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-04T16:54:33.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-04T16:54:33.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-04T16:54:33.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-04T16:54:33.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-04T16:54:33.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-04T16:54:33.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-04T16:54:33.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-04T16:54:33.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-04T16:54:33.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-04T16:54:33.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-04T16:54:33.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-04T16:54:33.607 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-04T16:54:33.607 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-04T16:54:33.607 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-04T16:54:33.607 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-04T16:54:33.607 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-04T16:54:33.607 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-04T16:54:33.607 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-04T16:54:33.607 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-04T16:54:33.607 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-04T16:54:33.607 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-04T16:54:33.607 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-04T16:54:33.607 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-04T16:54:33.608 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-04T16:54:33.608 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-04T16:54:33.608 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-04T16:54:33.608 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-04T16:54:33.608 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: Upgrade: Complete! 2024-09-04T16:54:33.608 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-04T16:54:33.608 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-04T16:54:33.608 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:54:33.608 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:54:33.608 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:54:33.608 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:33.608 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:54:33.608 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:54:33.608 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:54:33.609 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:33.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-04T16:54:33.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: fsmap cephfs:2 {0=cephfs.smithi170.zkhdil=up:active,1=cephfs.smithi170.rzbrux=up:active} 2 up:standby 2024-09-04T16:54:33.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: Upgrade: Setting container_image for all ceph-exporter 2024-09-04T16:54:33.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:33.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi170"} : dispatch 2024-09-04T16:54:33.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi170"}]': finished 2024-09-04T16:54:33.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi193"} : dispatch 2024-09-04T16:54:33.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi193"}]': finished 2024-09-04T16:54:33.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: Upgrade: Setting container_image for all iscsi 2024-09-04T16:54:33.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:33.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: Upgrade: Setting container_image for all nfs 2024-09-04T16:54:33.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:33.658 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: Upgrade: Setting container_image for all nvmeof 2024-09-04T16:54:33.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:33.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:33.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: Upgrade: Finalizing container_image settings 2024-09-04T16:54:33.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-04T16:54:33.659 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-04T16:54:33.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-04T16:54:33.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-04T16:54:33.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-04T16:54:33.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-04T16:54:33.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-04T16:54:33.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-04T16:54:33.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-04T16:54:33.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-04T16:54:33.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-04T16:54:33.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-04T16:54:33.660 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-04T16:54:33.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-04T16:54:33.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-04T16:54:33.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-04T16:54:33.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-04T16:54:33.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-04T16:54:33.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-04T16:54:33.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-04T16:54:33.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-04T16:54:33.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-04T16:54:33.661 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-04T16:54:33.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-04T16:54:33.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-04T16:54:33.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-04T16:54:33.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-04T16:54:33.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-04T16:54:33.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-04T16:54:33.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: Upgrade: Complete! 2024-09-04T16:54:33.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-04T16:54:33.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-04T16:54:33.662 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:54:33.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:54:33.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:54:33.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:33.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:54:33.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:54:33.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:54:33.663 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:34 smithi193 ceph-mon[82547]: pgmap v747: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 4.9 KiB/s wr, 12 op/s 2024-09-04T16:54:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:34.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:34 smithi170 ceph-mon[113855]: pgmap v747: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 4.9 KiB/s wr, 12 op/s 2024-09-04T16:54:34.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:36.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:36 smithi170 ceph-mon[113855]: pgmap v748: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 4.9 KiB/s wr, 12 op/s 2024-09-04T16:54:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:36 smithi193 ceph-mon[82547]: pgmap v748: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 4.9 KiB/s wr, 12 op/s 2024-09-04T16:54:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.750+0000 7f6b3ecdd640 1 -- 172.21.15.170:0/2954466752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b381018f0 msgr2=0x7f6b38101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.750+0000 7f6b3ecdd640 1 --2- 172.21.15.170:0/2954466752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b381018f0 0x7f6b38101d50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009880 tx=0x7f6b2402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:54:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.750+0000 7f6b3ecdd640 1 -- 172.21.15.170:0/2954466752 shutdown_connections 2024-09-04T16:54:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.750+0000 7f6b3ecdd640 1 --2- 172.21.15.170:0/2954466752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b381018f0 0x7f6b38101d50 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.750+0000 7f6b3ecdd640 1 --2- 172.21.15.170:0/2954466752 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b381078f0 0x7f6b38107cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.750+0000 7f6b3ecdd640 1 -- 172.21.15.170:0/2954466752 >> 172.21.15.170:0/2954466752 conn(0x7f6b380fd630 msgr2=0x7f6b380ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.750+0000 7f6b3ecdd640 1 -- 172.21.15.170:0/2954466752 shutdown_connections 2024-09-04T16:54:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.750+0000 7f6b3ecdd640 1 -- 172.21.15.170:0/2954466752 wait complete. 2024-09-04T16:54:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.750+0000 7f6b3ecdd640 1 Processor -- start 2024-09-04T16:54:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.750+0000 7f6b3ecdd640 1 -- start start 2024-09-04T16:54:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.750+0000 7f6b3ecdd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b381018f0 0x7f6b380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.750+0000 7f6b3ecdd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b381078f0 0x7f6b38074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.750+0000 7f6b3ecdd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3810edc0 con 0x7f6b381018f0 2024-09-04T16:54:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.750+0000 7f6b3ecdd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3810ec40 con 0x7f6b381078f0 2024-09-04T16:54:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.751+0000 7f6b3ca79640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b381018f0 0x7f6b380744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.751+0000 7f6b3ca79640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b381018f0 0x7f6b380744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:45502/0 (socket says 172.21.15.170:45502) 2024-09-04T16:54:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.751+0000 7f6b3ca79640 1 -- 172.21.15.170:0/2130753611 learned_addr learned my addr 172.21.15.170:0/2130753611 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:54:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.751+0000 7f6b37fff640 1 --2- 172.21.15.170:0/2130753611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b381078f0 0x7f6b38074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.751+0000 7f6b3ca79640 1 -- 172.21.15.170:0/2130753611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b381078f0 msgr2=0x7f6b38074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.751+0000 7f6b3ca79640 1 --2- 172.21.15.170:0/2130753611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b381078f0 0x7f6b38074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.751+0000 7f6b3ca79640 1 -- 172.21.15.170:0/2130753611 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b38074f70 con 0x7f6b381018f0 2024-09-04T16:54:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.751+0000 7f6b3ca79640 1 --2- 172.21.15.170:0/2130753611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b381018f0 0x7f6b380744f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00c8f0 tx=0x7f6b2c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.751+0000 7f6b35ffb640 1 -- 172.21.15.170:0/2130753611 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b2c0079b0 con 0x7f6b381018f0 2024-09-04T16:54:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.751+0000 7f6b3ecdd640 1 -- 172.21.15.170:0/2130753611 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b38075260 con 0x7f6b381018f0 2024-09-04T16:54:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.751+0000 7f6b35ffb640 1 -- 172.21.15.170:0/2130753611 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b2c0054e0 con 0x7f6b381018f0 2024-09-04T16:54:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.751+0000 7f6b35ffb640 1 -- 172.21.15.170:0/2130753611 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b2c004dd0 con 0x7f6b381018f0 2024-09-04T16:54:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.752+0000 7f6b3ecdd640 1 -- 172.21.15.170:0/2130753611 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b381a3e30 con 0x7f6b381018f0 2024-09-04T16:54:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.753+0000 7f6b3ecdd640 1 -- 172.21.15.170:0/2130753611 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b38103030 con 0x7f6b381018f0 2024-09-04T16:54:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.753+0000 7f6b35ffb640 1 -- 172.21.15.170:0/2130753611 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f6b2c005020 con 0x7f6b381018f0 2024-09-04T16:54:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.754+0000 7f6b35ffb640 1 --2- 172.21.15.170:0/2130753611 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6b28079dd0 0x7f6b2807c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.754+0000 7f6b35ffb640 1 -- 172.21.15.170:0/2130753611 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6b2c09ca90 con 0x7f6b381018f0 2024-09-04T16:54:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.754+0000 7f6b37fff640 1 --2- 172.21.15.170:0/2130753611 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6b28079dd0 0x7f6b2807c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.754+0000 7f6b37fff640 1 --2- 172.21.15.170:0/2130753611 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6b28079dd0 0x7f6b2807c290 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6b38075f80 tx=0x7f6b24031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:37.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.758+0000 7f6b35ffb640 1 -- 172.21.15.170:0/2130753611 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6b2c014030 con 0x7f6b381018f0 2024-09-04T16:54:37.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.957+0000 7f6b3ecdd640 1 -- 172.21.15.170:0/2130753611 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6b38062630 con 0x7f6b28079dd0 2024-09-04T16:54:37.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.958+0000 7f6b35ffb640 1 -- 172.21.15.170:0/2130753611 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f6b38062630 con 0x7f6b28079dd0 2024-09-04T16:54:37.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.961+0000 7f6b3ecdd640 1 -- 172.21.15.170:0/2130753611 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6b28079dd0 msgr2=0x7f6b2807c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:37.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.961+0000 7f6b3ecdd640 1 --2- 172.21.15.170:0/2130753611 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6b28079dd0 0x7f6b2807c290 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6b38075f80 tx=0x7f6b24031400 comp rx=0 tx=0).stop 2024-09-04T16:54:37.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.961+0000 7f6b3ecdd640 1 -- 172.21.15.170:0/2130753611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b381018f0 msgr2=0x7f6b380744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:37.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.961+0000 7f6b3ecdd640 1 --2- 172.21.15.170:0/2130753611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b381018f0 0x7f6b380744f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00c8f0 tx=0x7f6b2c00cdb0 comp rx=0 tx=0).stop 2024-09-04T16:54:37.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.961+0000 7f6b3ecdd640 1 -- 172.21.15.170:0/2130753611 shutdown_connections 2024-09-04T16:54:37.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.961+0000 7f6b3ecdd640 1 --2- 172.21.15.170:0/2130753611 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6b28079dd0 0x7f6b2807c290 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:37.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.961+0000 7f6b3ecdd640 1 --2- 172.21.15.170:0/2130753611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b381078f0 0x7f6b38074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:37.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.961+0000 7f6b3ecdd640 1 --2- 172.21.15.170:0/2130753611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b381018f0 0x7f6b380744f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:37.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.961+0000 7f6b3ecdd640 1 -- 172.21.15.170:0/2130753611 >> 172.21.15.170:0/2130753611 conn(0x7f6b380fd630 msgr2=0x7f6b380fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:37.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.961+0000 7f6b3ecdd640 1 -- 172.21.15.170:0/2130753611 shutdown_connections 2024-09-04T16:54:37.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:37.961+0000 7f6b3ecdd640 1 -- 172.21.15.170:0/2130753611 wait complete. 2024-09-04T16:54:38.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:38 smithi170 ceph-mon[113855]: pgmap v749: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 5.6 KiB/s rd, 4.8 KiB/s wr, 7 op/s 2024-09-04T16:54:38.641 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph orch ps' 2024-09-04T16:54:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:38 smithi193 ceph-mon[82547]: pgmap v749: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 5.6 KiB/s rd, 4.8 KiB/s wr, 7 op/s 2024-09-04T16:54:38.933 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:54:39.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.389+0000 7fa587328640 1 -- 172.21.15.170:0/1624138558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa580101930 msgr2=0x7fa580101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:39.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.389+0000 7fa587328640 1 --2- 172.21.15.170:0/1624138558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa580101930 0x7fa580101d90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa570009880 tx=0x7fa57002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:54:39.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.389+0000 7fa587328640 1 -- 172.21.15.170:0/1624138558 shutdown_connections 2024-09-04T16:54:39.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.389+0000 7fa587328640 1 --2- 172.21.15.170:0/1624138558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa580101930 0x7fa580101d90 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:39.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.389+0000 7fa587328640 1 --2- 172.21.15.170:0/1624138558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa580107930 0x7fa580107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:39.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.389+0000 7fa587328640 1 -- 172.21.15.170:0/1624138558 >> 172.21.15.170:0/1624138558 conn(0x7fa5800fd630 msgr2=0x7fa5800ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:39.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.390+0000 7fa587328640 1 -- 172.21.15.170:0/1624138558 shutdown_connections 2024-09-04T16:54:39.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.390+0000 7fa587328640 1 -- 172.21.15.170:0/1624138558 wait complete. 2024-09-04T16:54:39.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.390+0000 7fa587328640 1 Processor -- start 2024-09-04T16:54:39.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.390+0000 7fa587328640 1 -- start start 2024-09-04T16:54:39.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.390+0000 7fa587328640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa580101930 0x7fa58019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:39.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.390+0000 7fa587328640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa580107930 0x7fa58019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:39.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.390+0000 7fa587328640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa58010ee00 con 0x7fa580107930 2024-09-04T16:54:39.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.390+0000 7fa587328640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa58010ec80 con 0x7fa580101930 2024-09-04T16:54:39.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.390+0000 7fa5848c3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa580107930 0x7fa58019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:39.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.391+0000 7fa5848c3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa580107930 0x7fa58019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:45526/0 (socket says 172.21.15.170:45526) 2024-09-04T16:54:39.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.391+0000 7fa5848c3640 1 -- 172.21.15.170:0/2352156279 learned_addr learned my addr 172.21.15.170:0/2352156279 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:54:39.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.391+0000 7fa5850c4640 1 --2- 172.21.15.170:0/2352156279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa580101930 0x7fa58019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:39.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.391+0000 7fa5848c3640 1 -- 172.21.15.170:0/2352156279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa580101930 msgr2=0x7fa58019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:39.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.391+0000 7fa5848c3640 1 --2- 172.21.15.170:0/2352156279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa580101930 0x7fa58019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:39.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.391+0000 7fa5848c3640 1 -- 172.21.15.170:0/2352156279 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa580197810 con 0x7fa580107930 2024-09-04T16:54:39.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.391+0000 7fa5848c3640 1 --2- 172.21.15.170:0/2352156279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa580107930 0x7fa58019dbd0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa570031460 tx=0x7fa5700045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:39.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.391+0000 7fa5767fc640 1 -- 172.21.15.170:0/2352156279 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa57003f070 con 0x7fa580107930 2024-09-04T16:54:39.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.391+0000 7fa587328640 1 -- 172.21.15.170:0/2352156279 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa580197aa0 con 0x7fa580107930 2024-09-04T16:54:39.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.391+0000 7fa5767fc640 1 -- 172.21.15.170:0/2352156279 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa5700035f0 con 0x7fa580107930 2024-09-04T16:54:39.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.391+0000 7fa5767fc640 1 -- 172.21.15.170:0/2352156279 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa570035030 con 0x7fa580107930 2024-09-04T16:54:39.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.391+0000 7fa587328640 1 -- 172.21.15.170:0/2352156279 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa580197fd0 con 0x7fa580107930 2024-09-04T16:54:39.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.392+0000 7fa587328640 1 -- 172.21.15.170:0/2352156279 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa580103070 con 0x7fa580107930 2024-09-04T16:54:39.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.393+0000 7fa5767fc640 1 -- 172.21.15.170:0/2352156279 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fa570042070 con 0x7fa580107930 2024-09-04T16:54:39.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.393+0000 7fa5767fc640 1 --2- 172.21.15.170:0/2352156279 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa56c079e30 0x7fa56c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:39.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.393+0000 7fa5767fc640 1 -- 172.21.15.170:0/2352156279 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa5700bd3b0 con 0x7fa580107930 2024-09-04T16:54:39.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.393+0000 7fa5850c4640 1 --2- 172.21.15.170:0/2352156279 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa56c079e30 0x7fa56c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:39.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.394+0000 7fa5850c4640 1 --2- 172.21.15.170:0/2352156279 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa56c079e30 0x7fa56c07c2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa57c005fd0 tx=0x7fa57c00b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:39.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.398+0000 7fa5767fc640 1 -- 172.21.15.170:0/2352156279 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa570088f30 con 0x7fa580107930 2024-09-04T16:54:39.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.583+0000 7fa587328640 1 -- 172.21.15.170:0/2352156279 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa580198340 con 0x7fa56c079e30 2024-09-04T16:54:39.585 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:39 smithi170 ceph-mon[113855]: from='client.35176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:54:39.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.593+0000 7fa5767fc640 1 -- 172.21.15.170:0/2352156279 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fa580198340 con 0x7fa56c079e30 2024-09-04T16:54:39.594 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:54:39.594 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (21m) 12s ago 32m 22.0M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:54:39.594 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (22s) 12s ago 32m 7847k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 72c3e194c1e7 2024-09-04T16:54:39.594 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (17s) 13s ago 31m 9462k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a02dfc0e60bf 2024-09-04T16:54:39.594 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (19m) 12s ago 32m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:54:39.594 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (19m) 13s ago 31m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:54:39.594 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (21m) 12s ago 32m 82.2M - c8b91775d855 6e3778aab5e6 2024-09-04T16:54:39.594 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (15m) 12s ago 27m 24.9M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:54:39.595 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (16m) 12s ago 27m 87.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:54:39.595 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (15m) 13s ago 27m 20.7M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:54:39.595 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (15m) 13s ago 27m 20.7M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:54:39.595 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (23m) 12s ago 33m 532M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:54:39.595 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (22m) 13s ago 31m 463M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:54:39.595 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (20m) 12s ago 33m 71.0M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:54:39.595 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (20m) 13s ago 31m 49.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:54:39.595 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (22m) 12s ago 32m 10.6M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:54:39.595 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (22m) 13s ago 31m 12.4M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:54:39.595 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (19m) 12s ago 30m 95.2M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:54:39.595 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (18m) 12s ago 29m 101M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:54:39.595 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (18m) 12s ago 29m 96.5M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:54:39.595 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (17m) 13s ago 29m 111M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:54:39.596 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (17m) 13s ago 28m 103M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:54:39.596 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (16m) 13s ago 28m 89.4M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:54:39.596 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (22m) 12s ago 32m 69.3M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:54:39.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.595+0000 7fa587328640 1 -- 172.21.15.170:0/2352156279 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa56c079e30 msgr2=0x7fa56c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:39.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.595+0000 7fa587328640 1 --2- 172.21.15.170:0/2352156279 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa56c079e30 0x7fa56c07c2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa57c005fd0 tx=0x7fa57c00b390 comp rx=0 tx=0).stop 2024-09-04T16:54:39.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.595+0000 7fa587328640 1 -- 172.21.15.170:0/2352156279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa580107930 msgr2=0x7fa58019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:39.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.595+0000 7fa587328640 1 --2- 172.21.15.170:0/2352156279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa580107930 0x7fa58019dbd0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa570031460 tx=0x7fa5700045e0 comp rx=0 tx=0).stop 2024-09-04T16:54:39.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.595+0000 7fa587328640 1 -- 172.21.15.170:0/2352156279 shutdown_connections 2024-09-04T16:54:39.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.595+0000 7fa587328640 1 --2- 172.21.15.170:0/2352156279 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa56c079e30 0x7fa56c07c2f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:39.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.595+0000 7fa587328640 1 --2- 172.21.15.170:0/2352156279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa580107930 0x7fa58019dbd0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:39.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.595+0000 7fa587328640 1 --2- 172.21.15.170:0/2352156279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa580101930 0x7fa58019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:39.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.595+0000 7fa587328640 1 -- 172.21.15.170:0/2352156279 >> 172.21.15.170:0/2352156279 conn(0x7fa5800fd630 msgr2=0x7fa5800fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:39.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.595+0000 7fa587328640 1 -- 172.21.15.170:0/2352156279 shutdown_connections 2024-09-04T16:54:39.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:39.595+0000 7fa587328640 1 -- 172.21.15.170:0/2352156279 wait complete. 2024-09-04T16:54:39.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:39 smithi193 ceph-mon[82547]: from='client.35176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:54:40.258 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph orch upgrade status' 2024-09-04T16:54:40.509 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:54:40.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:40 smithi170 ceph-mon[113855]: pgmap v750: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:40.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:40 smithi170 ceph-mon[113855]: from='client.35180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:54:40.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:40 smithi193 ceph-mon[82547]: pgmap v750: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:40.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:40 smithi193 ceph-mon[82547]: from='client.35180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:54:41.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.997+0000 7f42f897f640 1 -- 172.21.15.170:0/558111209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f4103460 msgr2=0x7f42f410b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:41.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.997+0000 7f42f897f640 1 --2- 172.21.15.170:0/558111209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f4103460 0x7f42f410b950 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f42e80098b0 tx=0x7f42e802a560 comp rx=0 tx=0).stop 2024-09-04T16:54:41.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.997+0000 7f42f897f640 1 -- 172.21.15.170:0/558111209 shutdown_connections 2024-09-04T16:54:41.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.997+0000 7f42f897f640 1 --2- 172.21.15.170:0/558111209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f4103460 0x7f42f410b950 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:41.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.997+0000 7f42f897f640 1 --2- 172.21.15.170:0/558111209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f4102b40 0x7f42f4102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:41.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.997+0000 7f42f897f640 1 -- 172.21.15.170:0/558111209 >> 172.21.15.170:0/558111209 conn(0x7f42f40fc520 msgr2=0x7f42f40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:41.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.997+0000 7f42f897f640 1 -- 172.21.15.170:0/558111209 shutdown_connections 2024-09-04T16:54:41.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.997+0000 7f42f897f640 1 -- 172.21.15.170:0/558111209 wait complete. 2024-09-04T16:54:41.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.998+0000 7f42f897f640 1 Processor -- start 2024-09-04T16:54:41.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.998+0000 7f42f897f640 1 -- start start 2024-09-04T16:54:41.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.998+0000 7f42f897f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f4102b40 0x7f42f419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:41.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.998+0000 7f42f897f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f4103460 0x7f42f419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:41.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.998+0000 7f42f897f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f42f410ee10 con 0x7f42f4102b40 2024-09-04T16:54:41.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.998+0000 7f42f897f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42f410ec90 con 0x7f42f4103460 2024-09-04T16:54:41.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.998+0000 7f42f259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f4102b40 0x7f42f419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:41.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.998+0000 7f42f259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f4102b40 0x7f42f419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:45546/0 (socket says 172.21.15.170:45546) 2024-09-04T16:54:41.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.999+0000 7f42f259c640 1 -- 172.21.15.170:0/303867240 learned_addr learned my addr 172.21.15.170:0/303867240 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:54:41.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.999+0000 7f42f1d9b640 1 --2- 172.21.15.170:0/303867240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f4103460 0x7f42f419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:41.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.999+0000 7f42f259c640 1 -- 172.21.15.170:0/303867240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f4103460 msgr2=0x7f42f419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:41.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.999+0000 7f42f259c640 1 --2- 172.21.15.170:0/303867240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f4103460 0x7f42f419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:41.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.999+0000 7f42f259c640 1 -- 172.21.15.170:0/303867240 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f4197880 con 0x7f42f4102b40 2024-09-04T16:54:41.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.999+0000 7f42f259c640 1 --2- 172.21.15.170:0/303867240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f4102b40 0x7f42f419d6c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f42e400d6f0 tx=0x7f42e400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:41.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.999+0000 7f42e37fe640 1 -- 172.21.15.170:0/303867240 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42e4017070 con 0x7f42f4102b40 2024-09-04T16:54:41.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.999+0000 7f42e37fe640 1 -- 172.21.15.170:0/303867240 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42e400de00 con 0x7f42f4102b40 2024-09-04T16:54:41.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.999+0000 7f42f897f640 1 -- 172.21.15.170:0/303867240 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f4197b70 con 0x7f42f4102b40 2024-09-04T16:54:41.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.999+0000 7f42e37fe640 1 -- 172.21.15.170:0/303867240 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42e4004bb0 con 0x7f42f4102b40 2024-09-04T16:54:41.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:40.999+0000 7f42f897f640 1 -- 172.21.15.170:0/303867240 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f4198100 con 0x7f42f4102b40 2024-09-04T16:54:41.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.000+0000 7f42f897f640 1 -- 172.21.15.170:0/303867240 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f406ab80 con 0x7f42f4102b40 2024-09-04T16:54:41.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.001+0000 7f42e37fe640 1 -- 172.21.15.170:0/303867240 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f42e4009a30 con 0x7f42f4102b40 2024-09-04T16:54:41.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.001+0000 7f42e37fe640 1 --2- 172.21.15.170:0/303867240 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42dc079e80 0x7f42dc07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:41.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.001+0000 7f42e37fe640 1 -- 172.21.15.170:0/303867240 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f42e409c610 con 0x7f42f4102b40 2024-09-04T16:54:41.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.001+0000 7f42f1d9b640 1 --2- 172.21.15.170:0/303867240 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42dc079e80 0x7f42dc07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:41.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.002+0000 7f42f1d9b640 1 --2- 172.21.15.170:0/303867240 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42dc079e80 0x7f42dc07c340 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f42e8000c00 tx=0x7f42e8031420 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:41.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.005+0000 7f42e37fe640 1 -- 172.21.15.170:0/303867240 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f42e40640a0 con 0x7f42f4102b40 2024-09-04T16:54:41.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.199+0000 7f42f897f640 1 -- 172.21.15.170:0/303867240 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f42f4198db0 con 0x7f42dc079e80 2024-09-04T16:54:41.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.200+0000 7f42e37fe640 1 -- 172.21.15.170:0/303867240 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f42f4198db0 con 0x7f42dc079e80 2024-09-04T16:54:41.201 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:54:41.201 INFO:teuthology.orchestra.run.smithi170.stdout: "target_image": null, 2024-09-04T16:54:41.201 INFO:teuthology.orchestra.run.smithi170.stdout: "in_progress": false, 2024-09-04T16:54:41.201 INFO:teuthology.orchestra.run.smithi170.stdout: "which": "", 2024-09-04T16:54:41.201 INFO:teuthology.orchestra.run.smithi170.stdout: "services_complete": [], 2024-09-04T16:54:41.201 INFO:teuthology.orchestra.run.smithi170.stdout: "progress": null, 2024-09-04T16:54:41.201 INFO:teuthology.orchestra.run.smithi170.stdout: "message": "", 2024-09-04T16:54:41.201 INFO:teuthology.orchestra.run.smithi170.stdout: "is_paused": false 2024-09-04T16:54:41.201 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:54:41.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.202+0000 7f42f897f640 1 -- 172.21.15.170:0/303867240 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42dc079e80 msgr2=0x7f42dc07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:41.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.202+0000 7f42f897f640 1 --2- 172.21.15.170:0/303867240 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42dc079e80 0x7f42dc07c340 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f42e8000c00 tx=0x7f42e8031420 comp rx=0 tx=0).stop 2024-09-04T16:54:41.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.203+0000 7f42f897f640 1 -- 172.21.15.170:0/303867240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f4102b40 msgr2=0x7f42f419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:41.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.203+0000 7f42f897f640 1 --2- 172.21.15.170:0/303867240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f4102b40 0x7f42f419d6c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f42e400d6f0 tx=0x7f42e400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:54:41.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.203+0000 7f42f897f640 1 -- 172.21.15.170:0/303867240 shutdown_connections 2024-09-04T16:54:41.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.203+0000 7f42f897f640 1 --2- 172.21.15.170:0/303867240 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f42dc079e80 0x7f42dc07c340 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:41.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.203+0000 7f42f897f640 1 --2- 172.21.15.170:0/303867240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f4103460 0x7f42f419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:41.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.203+0000 7f42f897f640 1 --2- 172.21.15.170:0/303867240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f4102b40 0x7f42f419d6c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:41.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.203+0000 7f42f897f640 1 -- 172.21.15.170:0/303867240 >> 172.21.15.170:0/303867240 conn(0x7f42f40fc520 msgr2=0x7f42f4103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:41.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.203+0000 7f42f897f640 1 -- 172.21.15.170:0/303867240 shutdown_connections 2024-09-04T16:54:41.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:41.203+0000 7f42f897f640 1 -- 172.21.15.170:0/303867240 wait complete. 2024-09-04T16:54:41.901 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph health detail' 2024-09-04T16:54:42.150 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:54:42.567 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:42 smithi170 ceph-mon[113855]: pgmap v751: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:42.567 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:42 smithi170 ceph-mon[113855]: from='client.35184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:54:42.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.646+0000 7efe25132640 1 -- 172.21.15.170:0/2823332644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe20102b00 msgr2=0x7efe20102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:42.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.646+0000 7efe25132640 1 --2- 172.21.15.170:0/2823332644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe20102b00 0x7efe20102ee0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7efe100098b0 tx=0x7efe1002a560 comp rx=0 tx=0).stop 2024-09-04T16:54:42.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.646+0000 7efe25132640 1 -- 172.21.15.170:0/2823332644 shutdown_connections 2024-09-04T16:54:42.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.646+0000 7efe25132640 1 --2- 172.21.15.170:0/2823332644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe20103420 0x7efe2010b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:42.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.646+0000 7efe25132640 1 --2- 172.21.15.170:0/2823332644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe20102b00 0x7efe20102ee0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:42.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.646+0000 7efe25132640 1 -- 172.21.15.170:0/2823332644 >> 172.21.15.170:0/2823332644 conn(0x7efe200fc4c0 msgr2=0x7efe200fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:42.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.646+0000 7efe25132640 1 -- 172.21.15.170:0/2823332644 shutdown_connections 2024-09-04T16:54:42.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.646+0000 7efe25132640 1 -- 172.21.15.170:0/2823332644 wait complete. 2024-09-04T16:54:42.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.647+0000 7efe25132640 1 Processor -- start 2024-09-04T16:54:42.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.647+0000 7efe25132640 1 -- start start 2024-09-04T16:54:42.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.647+0000 7efe25132640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe20102b00 0x7efe2019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:42.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.647+0000 7efe25132640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe20103420 0x7efe2019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:42.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.647+0000 7efe25132640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efe2010edd0 con 0x7efe20102b00 2024-09-04T16:54:42.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.647+0000 7efe25132640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efe2010ec50 con 0x7efe20103420 2024-09-04T16:54:42.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.647+0000 7efe1ed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe20102b00 0x7efe2019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:42.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.647+0000 7efe1ed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe20102b00 0x7efe2019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:45568/0 (socket says 172.21.15.170:45568) 2024-09-04T16:54:42.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.647+0000 7efe1ed9d640 1 -- 172.21.15.170:0/3387272833 learned_addr learned my addr 172.21.15.170:0/3387272833 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:54:42.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.647+0000 7efe1e59c640 1 --2- 172.21.15.170:0/3387272833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe20103420 0x7efe2019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:42.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.648+0000 7efe1ed9d640 1 -- 172.21.15.170:0/3387272833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe20103420 msgr2=0x7efe2019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:42.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.648+0000 7efe1ed9d640 1 --2- 172.21.15.170:0/3387272833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe20103420 0x7efe2019dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:42.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.648+0000 7efe1ed9d640 1 -- 172.21.15.170:0/3387272833 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe201977e0 con 0x7efe20102b00 2024-09-04T16:54:42.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.648+0000 7efe1ed9d640 1 --2- 172.21.15.170:0/3387272833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe20102b00 0x7efe2019d660 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7efe10031460 tx=0x7efe100045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:42.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.648+0000 7efe07fff640 1 -- 172.21.15.170:0/3387272833 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe1003f070 con 0x7efe20102b00 2024-09-04T16:54:42.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.648+0000 7efe07fff640 1 -- 172.21.15.170:0/3387272833 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe100035f0 con 0x7efe20102b00 2024-09-04T16:54:42.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.648+0000 7efe25132640 1 -- 172.21.15.170:0/3387272833 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe20197a70 con 0x7efe20102b00 2024-09-04T16:54:42.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.648+0000 7efe07fff640 1 -- 172.21.15.170:0/3387272833 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe10035030 con 0x7efe20102b00 2024-09-04T16:54:42.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.648+0000 7efe25132640 1 -- 172.21.15.170:0/3387272833 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe20197fa0 con 0x7efe20102b00 2024-09-04T16:54:42.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.649+0000 7efe25132640 1 -- 172.21.15.170:0/3387272833 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe2006a3b0 con 0x7efe20102b00 2024-09-04T16:54:42.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.650+0000 7efe07fff640 1 -- 172.21.15.170:0/3387272833 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7efe10042070 con 0x7efe20102b00 2024-09-04T16:54:42.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.650+0000 7efe07fff640 1 --2- 172.21.15.170:0/3387272833 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efe08079e30 0x7efe0807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:42.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.650+0000 7efe1e59c640 1 --2- 172.21.15.170:0/3387272833 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efe08079e30 0x7efe0807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:42.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.650+0000 7efe07fff640 1 -- 172.21.15.170:0/3387272833 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7efe100bd3c0 con 0x7efe20102b00 2024-09-04T16:54:42.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.651+0000 7efe1e59c640 1 --2- 172.21.15.170:0/3387272833 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efe08079e30 0x7efe0807c2f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efe201088d0 tx=0x7efe1400b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:42.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.655+0000 7efe07fff640 1 -- 172.21.15.170:0/3387272833 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efe10088f40 con 0x7efe20102b00 2024-09-04T16:54:42.735 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:42 smithi193 ceph-mon[82547]: pgmap v751: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:42.735 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:42 smithi193 ceph-mon[82547]: from='client.35184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:54:42.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.901+0000 7efe25132640 1 -- 172.21.15.170:0/3387272833 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7efe20105f60 con 0x7efe20102b00 2024-09-04T16:54:42.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.902+0000 7efe07fff640 1 -- 172.21.15.170:0/3387272833 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7efe1008d960 con 0x7efe20102b00 2024-09-04T16:54:42.903 INFO:teuthology.orchestra.run.smithi170.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-04T16:54:42.903 INFO:teuthology.orchestra.run.smithi170.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T16:54:42.903 INFO:teuthology.orchestra.run.smithi170.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T16:54:42.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.904+0000 7efe25132640 1 -- 172.21.15.170:0/3387272833 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efe08079e30 msgr2=0x7efe0807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:42.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.904+0000 7efe25132640 1 --2- 172.21.15.170:0/3387272833 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efe08079e30 0x7efe0807c2f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efe201088d0 tx=0x7efe1400b390 comp rx=0 tx=0).stop 2024-09-04T16:54:42.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.904+0000 7efe25132640 1 -- 172.21.15.170:0/3387272833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe20102b00 msgr2=0x7efe2019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:42.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.904+0000 7efe25132640 1 --2- 172.21.15.170:0/3387272833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe20102b00 0x7efe2019d660 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7efe10031460 tx=0x7efe100045c0 comp rx=0 tx=0).stop 2024-09-04T16:54:42.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.904+0000 7efe25132640 1 -- 172.21.15.170:0/3387272833 shutdown_connections 2024-09-04T16:54:42.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.904+0000 7efe25132640 1 --2- 172.21.15.170:0/3387272833 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efe08079e30 0x7efe0807c2f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:42.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.904+0000 7efe25132640 1 --2- 172.21.15.170:0/3387272833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe20103420 0x7efe2019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:42.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.904+0000 7efe25132640 1 --2- 172.21.15.170:0/3387272833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe20102b00 0x7efe2019d660 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:42.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.904+0000 7efe25132640 1 -- 172.21.15.170:0/3387272833 >> 172.21.15.170:0/3387272833 conn(0x7efe200fc4c0 msgr2=0x7efe20108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:42.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.904+0000 7efe25132640 1 -- 172.21.15.170:0/3387272833 shutdown_connections 2024-09-04T16:54:42.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:42.904+0000 7efe25132640 1 -- 172.21.15.170:0/3387272833 wait complete. 2024-09-04T16:54:43.555 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:43 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3387272833' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:54:43.583 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph versions' 2024-09-04T16:54:43.830 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:54:43.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:43 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3387272833' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-04T16:54:44.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.305+0000 7fb4f1195640 1 -- 172.21.15.170:0/307786209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4ec100820 msgr2=0x7fb4ec100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:44.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.305+0000 7fb4f1195640 1 --2- 172.21.15.170:0/307786209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4ec100820 0x7fb4ec100c80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009880 tx=0x7fb4d402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:54:44.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.305+0000 7fb4f1195640 1 -- 172.21.15.170:0/307786209 shutdown_connections 2024-09-04T16:54:44.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.305+0000 7fb4f1195640 1 --2- 172.21.15.170:0/307786209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4ec100820 0x7fb4ec100c80 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:44.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.305+0000 7fb4f1195640 1 --2- 172.21.15.170:0/307786209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4ec106820 0x7fb4ec106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:44.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.305+0000 7fb4f1195640 1 -- 172.21.15.170:0/307786209 >> 172.21.15.170:0/307786209 conn(0x7fb4ec0fc520 msgr2=0x7fb4ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:44.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.305+0000 7fb4f1195640 1 -- 172.21.15.170:0/307786209 shutdown_connections 2024-09-04T16:54:44.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.305+0000 7fb4f1195640 1 -- 172.21.15.170:0/307786209 wait complete. 2024-09-04T16:54:44.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.305+0000 7fb4f1195640 1 Processor -- start 2024-09-04T16:54:44.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.306+0000 7fb4f1195640 1 -- start start 2024-09-04T16:54:44.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.306+0000 7fb4f1195640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4ec100820 0x7fb4ec19f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:44.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.306+0000 7fb4f1195640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4ec106820 0x7fb4ec19fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:44.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.306+0000 7fb4f1195640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec10dd50 con 0x7fb4ec106820 2024-09-04T16:54:44.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.306+0000 7fb4f1195640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec10dbd0 con 0x7fb4ec100820 2024-09-04T16:54:44.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.306+0000 7fb4e3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4ec106820 0x7fb4ec19fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:44.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.306+0000 7fb4e3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4ec106820 0x7fb4ec19fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:45586/0 (socket says 172.21.15.170:45586) 2024-09-04T16:54:44.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.306+0000 7fb4e3fff640 1 -- 172.21.15.170:0/3856373072 learned_addr learned my addr 172.21.15.170:0/3856373072 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:54:44.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.306+0000 7fb4e3fff640 1 -- 172.21.15.170:0/3856373072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4ec100820 msgr2=0x7fb4ec19f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:44.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.306+0000 7fb4ead9d640 1 --2- 172.21.15.170:0/3856373072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4ec100820 0x7fb4ec19f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:44.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.306+0000 7fb4e3fff640 1 --2- 172.21.15.170:0/3856373072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4ec100820 0x7fb4ec19f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:44.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.306+0000 7fb4e3fff640 1 -- 172.21.15.170:0/3856373072 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ec199ae0 con 0x7fb4ec106820 2024-09-04T16:54:44.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.306+0000 7fb4e3fff640 1 --2- 172.21.15.170:0/3856373072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4ec106820 0x7fb4ec19fe60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4031460 tx=0x7fb4d40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:44.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.306+0000 7fb4e8d99640 1 -- 172.21.15.170:0/3856373072 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4d403f070 con 0x7fb4ec106820 2024-09-04T16:54:44.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.307+0000 7fb4e8d99640 1 -- 172.21.15.170:0/3856373072 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb4d4004cf0 con 0x7fb4ec106820 2024-09-04T16:54:44.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.307+0000 7fb4e8d99640 1 -- 172.21.15.170:0/3856373072 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4d4035030 con 0x7fb4ec106820 2024-09-04T16:54:44.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.307+0000 7fb4f1195640 1 -- 172.21.15.170:0/3856373072 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4ec199d70 con 0x7fb4ec106820 2024-09-04T16:54:44.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.307+0000 7fb4f1195640 1 -- 172.21.15.170:0/3856373072 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4ec19a2a0 con 0x7fb4ec106820 2024-09-04T16:54:44.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.308+0000 7fb4f1195640 1 -- 172.21.15.170:0/3856373072 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4ec101f60 con 0x7fb4ec106820 2024-09-04T16:54:44.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.308+0000 7fb4e8d99640 1 -- 172.21.15.170:0/3856373072 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fb4d4042070 con 0x7fb4ec106820 2024-09-04T16:54:44.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.309+0000 7fb4e8d99640 1 --2- 172.21.15.170:0/3856373072 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb4d8079e80 0x7fb4d807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:54:44.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.309+0000 7fb4e8d99640 1 -- 172.21.15.170:0/3856373072 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb4d40bd550 con 0x7fb4ec106820 2024-09-04T16:54:44.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.309+0000 7fb4ead9d640 1 --2- 172.21.15.170:0/3856373072 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb4d8079e80 0x7fb4d807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:54:44.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.309+0000 7fb4ead9d640 1 --2- 172.21.15.170:0/3856373072 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb4d8079e80 0x7fb4d807c340 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00a810 tx=0x7fb4dc008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:54:44.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.313+0000 7fb4e8d99640 1 -- 172.21.15.170:0/3856373072 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb4d4084f80 con 0x7fb4ec106820 2024-09-04T16:54:44.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.561+0000 7fb4f1195640 1 -- 172.21.15.170:0/3856373072 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb4ec19b070 con 0x7fb4ec106820 2024-09-04T16:54:44.561 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:44 smithi170 ceph-mon[113855]: pgmap v752: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:44.561 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:44.561 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:54:44.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.562+0000 7fb4e8d99640 1 -- 172.21.15.170:0/3856373072 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fb4d40890f0 con 0x7fb4ec106820 2024-09-04T16:54:44.562 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:54:44.562 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:54:44.562 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:54:44.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:54:44.562 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:54:44.562 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:54:44.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:54:44.563 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:54:44.563 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:54:44.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:54:44.563 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:54:44.563 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:54:44.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:54:44.563 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:54:44.563 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:54:44.563 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:54:44.563 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:54:44.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.564+0000 7fb4f1195640 1 -- 172.21.15.170:0/3856373072 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb4d8079e80 msgr2=0x7fb4d807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:44.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.564+0000 7fb4f1195640 1 --2- 172.21.15.170:0/3856373072 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb4d8079e80 0x7fb4d807c340 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00a810 tx=0x7fb4dc008040 comp rx=0 tx=0).stop 2024-09-04T16:54:44.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.564+0000 7fb4f1195640 1 -- 172.21.15.170:0/3856373072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4ec106820 msgr2=0x7fb4ec19fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:54:44.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.564+0000 7fb4f1195640 1 --2- 172.21.15.170:0/3856373072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4ec106820 0x7fb4ec19fe60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4031460 tx=0x7fb4d40048f0 comp rx=0 tx=0).stop 2024-09-04T16:54:44.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.564+0000 7fb4f1195640 1 -- 172.21.15.170:0/3856373072 shutdown_connections 2024-09-04T16:54:44.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.564+0000 7fb4f1195640 1 --2- 172.21.15.170:0/3856373072 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fb4d8079e80 0x7fb4d807c340 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:44.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.564+0000 7fb4f1195640 1 --2- 172.21.15.170:0/3856373072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4ec106820 0x7fb4ec19fe60 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:44.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.564+0000 7fb4f1195640 1 --2- 172.21.15.170:0/3856373072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4ec100820 0x7fb4ec19f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:54:44.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.564+0000 7fb4f1195640 1 -- 172.21.15.170:0/3856373072 >> 172.21.15.170:0/3856373072 conn(0x7fb4ec0fc520 msgr2=0x7fb4ec0fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:54:44.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.564+0000 7fb4f1195640 1 -- 172.21.15.170:0/3856373072 shutdown_connections 2024-09-04T16:54:44.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:54:44.564+0000 7fb4f1195640 1 -- 172.21.15.170:0/3856373072 wait complete. 2024-09-04T16:54:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:44 smithi193 ceph-mon[82547]: pgmap v752: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:54:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:54:45.191 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-04T16:54:45.443 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:54:45.731 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:45 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3856373072' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:45.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:45 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3856373072' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:54:45.966 INFO:teuthology.orchestra.run.smithi170.stdout:wait for servicemap items w/ changing names to refresh 2024-09-04T16:54:46.665 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'sleep 60' 2024-09-04T16:54:46.687 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:46 smithi170 ceph-mon[113855]: pgmap v753: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:46.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:46 smithi193 ceph-mon[82547]: pgmap v753: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:46.914 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:54:48.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:48 smithi170 ceph-mon[113855]: pgmap v754: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:48.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:48 smithi193 ceph-mon[82547]: pgmap v754: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:50.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:50 smithi170 ceph-mon[113855]: pgmap v755: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:50 smithi193 ceph-mon[82547]: pgmap v755: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:52.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:52 smithi170 ceph-mon[113855]: pgmap v756: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:52.886 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:52 smithi193 ceph-mon[82547]: pgmap v756: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:54 smithi170 ceph-mon[113855]: pgmap v757: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:54 smithi193 ceph-mon[82547]: pgmap v757: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:56.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:56 smithi170 ceph-mon[113855]: pgmap v758: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:56.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:56 smithi193 ceph-mon[82547]: pgmap v758: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:58.672 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:58 smithi193 ceph-mon[82547]: pgmap v759: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:58.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:58 smithi170 ceph-mon[113855]: pgmap v759: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:54:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:54:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:54:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:54:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:55:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:00 smithi170 ceph-mon[113855]: pgmap v760: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:00 smithi193 ceph-mon[82547]: pgmap v760: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:02.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:02 smithi170 ceph-mon[113855]: pgmap v761: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:02.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:02 smithi193 ceph-mon[82547]: pgmap v761: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:04.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:04 smithi170 ceph-mon[113855]: pgmap v762: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:04.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:04 smithi193 ceph-mon[82547]: pgmap v762: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:06.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:06 smithi170 ceph-mon[113855]: pgmap v763: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:06.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:06 smithi193 ceph-mon[82547]: pgmap v763: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:08.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:08 smithi170 ceph-mon[113855]: pgmap v764: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:08 smithi193 ceph-mon[82547]: pgmap v764: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:10.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:10 smithi170 ceph-mon[113855]: pgmap v765: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:10.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:10 smithi193 ceph-mon[82547]: pgmap v765: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:12.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:12 smithi170 ceph-mon[113855]: pgmap v766: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:12.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:12 smithi193 ceph-mon[82547]: pgmap v766: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:14 smithi170 ceph-mon[113855]: pgmap v767: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:55:14.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:14 smithi193 ceph-mon[82547]: pgmap v767: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:14.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:55:16.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:16 smithi170 ceph-mon[113855]: pgmap v768: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:16.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:16 smithi193 ceph-mon[82547]: pgmap v768: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:18 smithi193 ceph-mon[82547]: pgmap v769: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:18.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:18 smithi170 ceph-mon[113855]: pgmap v769: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:20.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:20 smithi170 ceph-mon[113855]: pgmap v770: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:20.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:20 smithi193 ceph-mon[82547]: pgmap v770: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:22.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:22 smithi170 ceph-mon[113855]: pgmap v771: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:22 smithi193 ceph-mon[82547]: pgmap v771: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:24.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:24 smithi170 ceph-mon[113855]: pgmap v772: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:24 smithi193 ceph-mon[82547]: pgmap v772: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:26.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:26 smithi170 ceph-mon[113855]: pgmap v773: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:26.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:26 smithi193 ceph-mon[82547]: pgmap v773: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:28.708 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:28 smithi193 ceph-mon[82547]: pgmap v774: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:28.846 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:28 smithi170 ceph-mon[113855]: pgmap v774: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:29.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:55:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:55:30.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:30 smithi170 ceph-mon[113855]: pgmap v775: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:30.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:30 smithi193 ceph-mon[82547]: pgmap v775: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:32.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:32 smithi170 ceph-mon[113855]: pgmap v776: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:32.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:32 smithi193 ceph-mon[82547]: pgmap v776: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:33.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:55:33.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:55:33.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:55:33.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:55:33.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:55:33.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:55:33.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:55:33.907 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:55:34.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:34 smithi170 ceph-mon[113855]: pgmap v777: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:34.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:34 smithi193 ceph-mon[82547]: pgmap v777: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:36.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:36 smithi170 ceph-mon[113855]: pgmap v778: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:36 smithi193 ceph-mon[82547]: pgmap v778: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:38 smithi170 ceph-mon[113855]: pgmap v779: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:38 smithi193 ceph-mon[82547]: pgmap v779: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:40.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:40 smithi170 ceph-mon[113855]: pgmap v780: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:40.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:40 smithi193 ceph-mon[82547]: pgmap v780: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:42.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:42 smithi170 ceph-mon[113855]: pgmap v781: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:42 smithi193 ceph-mon[82547]: pgmap v781: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:44.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:44 smithi170 ceph-mon[113855]: pgmap v782: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:55:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:44 smithi193 ceph-mon[82547]: pgmap v782: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:55:46.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:46 smithi170 ceph-mon[113855]: pgmap v783: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:46.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:46 smithi193 ceph-mon[82547]: pgmap v783: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:48.078 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph orch ps' 2024-09-04T16:55:48.377 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:55:48.790 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:48 smithi170 ceph-mon[113855]: pgmap v784: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:48.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.873+0000 7efd01645640 1 -- 172.21.15.170:0/1119527381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcfc1007e0 msgr2=0x7efcfc100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:48.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.873+0000 7efd01645640 1 --2- 172.21.15.170:0/1119527381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcfc1007e0 0x7efcfc100c40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7efce4009880 tx=0x7efce402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:55:48.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.873+0000 7efd01645640 1 -- 172.21.15.170:0/1119527381 shutdown_connections 2024-09-04T16:55:48.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.873+0000 7efd01645640 1 --2- 172.21.15.170:0/1119527381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcfc1007e0 0x7efcfc100c40 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:48.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.873+0000 7efd01645640 1 --2- 172.21.15.170:0/1119527381 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcfc1067e0 0x7efcfc106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:48.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.873+0000 7efd01645640 1 -- 172.21.15.170:0/1119527381 >> 172.21.15.170:0/1119527381 conn(0x7efcfc0fc4c0 msgr2=0x7efcfc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:55:48.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.873+0000 7efd01645640 1 -- 172.21.15.170:0/1119527381 shutdown_connections 2024-09-04T16:55:48.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.873+0000 7efd01645640 1 -- 172.21.15.170:0/1119527381 wait complete. 2024-09-04T16:55:48.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.874+0000 7efd01645640 1 Processor -- start 2024-09-04T16:55:48.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.874+0000 7efd01645640 1 -- start start 2024-09-04T16:55:48.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.874+0000 7efd01645640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcfc1007e0 0x7efcfc1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:48.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.874+0000 7efd01645640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcfc1067e0 0x7efcfc198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:48.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.874+0000 7efd01645640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc10dcb0 con 0x7efcfc1007e0 2024-09-04T16:55:48.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.874+0000 7efd01645640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc10db30 con 0x7efcfc1067e0 2024-09-04T16:55:48.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.874+0000 7efcfaffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcfc1007e0 0x7efcfc1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:48.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.874+0000 7efcfaffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcfc1007e0 0x7efcfc1987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38022/0 (socket says 172.21.15.170:38022) 2024-09-04T16:55:48.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.874+0000 7efcfaffd640 1 -- 172.21.15.170:0/1296645331 learned_addr learned my addr 172.21.15.170:0/1296645331 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:55:48.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.874+0000 7efcf27fc640 1 --2- 172.21.15.170:0/1296645331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcfc1067e0 0x7efcfc198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:48.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.875+0000 7efcfaffd640 1 -- 172.21.15.170:0/1296645331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcfc1067e0 msgr2=0x7efcfc198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:48.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.875+0000 7efcfaffd640 1 --2- 172.21.15.170:0/1296645331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcfc1067e0 0x7efcfc198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:48.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.875+0000 7efcfaffd640 1 -- 172.21.15.170:0/1296645331 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcfc199320 con 0x7efcfc1007e0 2024-09-04T16:55:48.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.875+0000 7efcfaffd640 1 --2- 172.21.15.170:0/1296645331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcfc1007e0 0x7efcfc1987e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7efcec00d6f0 tx=0x7efcec00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:55:48.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.875+0000 7efcf8ff9640 1 -- 172.21.15.170:0/1296645331 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efcec017070 con 0x7efcfc1007e0 2024-09-04T16:55:48.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.875+0000 7efd01645640 1 -- 172.21.15.170:0/1296645331 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcfc199610 con 0x7efcfc1007e0 2024-09-04T16:55:48.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.875+0000 7efcf8ff9640 1 -- 172.21.15.170:0/1296645331 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efcec00de00 con 0x7efcfc1007e0 2024-09-04T16:55:48.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.875+0000 7efcf8ff9640 1 -- 172.21.15.170:0/1296645331 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efcec004bb0 con 0x7efcfc1007e0 2024-09-04T16:55:48.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.875+0000 7efd01645640 1 -- 172.21.15.170:0/1296645331 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcfc1a1c10 con 0x7efcfc1007e0 2024-09-04T16:55:48.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.876+0000 7efd01645640 1 -- 172.21.15.170:0/1296645331 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcfc101f20 con 0x7efcfc1007e0 2024-09-04T16:55:48.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.877+0000 7efcf8ff9640 1 -- 172.21.15.170:0/1296645331 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7efcec004e60 con 0x7efcfc1007e0 2024-09-04T16:55:48.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.877+0000 7efcf8ff9640 1 --2- 172.21.15.170:0/1296645331 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efce8079e30 0x7efce807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:48.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.877+0000 7efcf8ff9640 1 -- 172.21.15.170:0/1296645331 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7efcec09c680 con 0x7efcfc1007e0 2024-09-04T16:55:48.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.877+0000 7efcf27fc640 1 --2- 172.21.15.170:0/1296645331 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efce8079e30 0x7efce807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:48.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.878+0000 7efcf27fc640 1 --2- 172.21.15.170:0/1296645331 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efce8079e30 0x7efce807c2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efcfc06a680 tx=0x7efce4031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:55:48.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:48.881+0000 7efcf8ff9640 1 -- 172.21.15.170:0/1296645331 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efcfc199610 con 0x7efcfc1007e0 2024-09-04T16:55:48.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:48 smithi193 ceph-mon[82547]: pgmap v784: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:49.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:49.065+0000 7efd01645640 1 -- 172.21.15.170:0/1296645331 --> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7efcfc062630 con 0x7efce8079e30 2024-09-04T16:55:49.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:49.074+0000 7efcf8ff9640 1 -- 172.21.15.170:0/1296645331 <== mgr.14774 v2:172.21.15.170:6800/3535185718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7efcfc062630 con 0x7efce8079e30 2024-09-04T16:55:49.075 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-04T16:55:49.075 INFO:teuthology.orchestra.run.smithi170.stdout:alertmanager.smithi170 smithi170 *:9093,9094 running (22m) 81s ago 33m 22.0M - 0.27.0 11f11916f8cd 7167236e749c 2024-09-04T16:55:49.076 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi170 smithi170 running (91s) 81s ago 33m 7847k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 72c3e194c1e7 2024-09-04T16:55:49.076 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-exporter.smithi193 smithi193 running (87s) 83s ago 32m 9462k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a02dfc0e60bf 2024-09-04T16:55:49.076 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi170 smithi170 running (20m) 81s ago 33m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 d641da7a8dc7 2024-09-04T16:55:49.076 INFO:teuthology.orchestra.run.smithi170.stdout:crash.smithi193 smithi193 running (20m) 83s ago 32m 6895k - 19.3.0-4702-gf9fcca52 8cfc4091ae56 780ceeff3ffe 2024-09-04T16:55:49.076 INFO:teuthology.orchestra.run.smithi170.stdout:grafana.smithi170 smithi170 *:3000 running (22m) 81s ago 33m 82.2M - c8b91775d855 6e3778aab5e6 2024-09-04T16:55:49.076 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.rzbrux smithi170 running (17m) 81s ago 28m 24.9M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 be20e3333bf3 2024-09-04T16:55:49.076 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi170.zkhdil smithi170 running (17m) 81s ago 28m 87.4M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6683a1c93c36 2024-09-04T16:55:49.076 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.kabapr smithi193 running (16m) 83s ago 28m 20.7M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 a0ebb094a2e1 2024-09-04T16:55:49.076 INFO:teuthology.orchestra.run.smithi170.stdout:mds.cephfs.smithi193.xostco smithi193 running (16m) 83s ago 28m 20.7M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 6659d6f0de8a 2024-09-04T16:55:49.076 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi170.fbszap smithi170 *:8443,9283,8765 running (25m) 81s ago 34m 532M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 1dfe8c08ec34 2024-09-04T16:55:49.076 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.smithi193.gvfizn smithi193 *:8443,9283,8765 running (23m) 83s ago 32m 463M - 19.3.0-4702-gf9fcca52 8cfc4091ae56 dd3245d415b9 2024-09-04T16:55:49.077 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi170 smithi170 running (21m) 81s ago 35m 71.0M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 ea912d4e404d 2024-09-04T16:55:49.077 INFO:teuthology.orchestra.run.smithi170.stdout:mon.smithi193 smithi193 running (21m) 83s ago 32m 49.1M 2048M 19.3.0-4702-gf9fcca52 8cfc4091ae56 6a9e9faed0c8 2024-09-04T16:55:49.077 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi170 smithi170 *:9100 running (23m) 81s ago 33m 10.6M - 1.7.0 72c9c2088986 8eab30921365 2024-09-04T16:55:49.077 INFO:teuthology.orchestra.run.smithi170.stdout:node-exporter.smithi193 smithi193 *:9100 running (23m) 83s ago 32m 12.4M - 1.7.0 72c9c2088986 f68a4be99cf8 2024-09-04T16:55:49.077 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (20m) 81s ago 31m 95.2M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 22f8c54550e0 2024-09-04T16:55:49.077 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi170 running (19m) 81s ago 31m 101M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 e39a15bc741a 2024-09-04T16:55:49.077 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi170 running (19m) 81s ago 30m 96.5M 1216M 19.3.0-4702-gf9fcca52 8cfc4091ae56 50a84942a2f5 2024-09-04T16:55:49.077 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi193 running (18m) 83s ago 30m 111M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 c571a091a612 2024-09-04T16:55:49.077 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi193 running (18m) 83s ago 29m 103M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 b402c5732f0b 2024-09-04T16:55:49.077 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi193 running (17m) 83s ago 29m 89.4M 2240M 19.3.0-4702-gf9fcca52 8cfc4091ae56 877ff342899c 2024-09-04T16:55:49.077 INFO:teuthology.orchestra.run.smithi170.stdout:prometheus.smithi170 smithi170 *:9095 running (23m) 81s ago 33m 69.3M - 2.51.0 1d3b7f56885b 608f1a7d8a66 2024-09-04T16:55:49.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:49.077+0000 7efd01645640 1 -- 172.21.15.170:0/1296645331 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efce8079e30 msgr2=0x7efce807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:49.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:49.077+0000 7efd01645640 1 --2- 172.21.15.170:0/1296645331 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efce8079e30 0x7efce807c2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efcfc06a680 tx=0x7efce4031400 comp rx=0 tx=0).stop 2024-09-04T16:55:49.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:49.077+0000 7efd01645640 1 -- 172.21.15.170:0/1296645331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcfc1007e0 msgr2=0x7efcfc1987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:49.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:49.077+0000 7efd01645640 1 --2- 172.21.15.170:0/1296645331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcfc1007e0 0x7efcfc1987e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7efcec00d6f0 tx=0x7efcec00dbb0 comp rx=0 tx=0).stop 2024-09-04T16:55:49.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:49.077+0000 7efd01645640 1 -- 172.21.15.170:0/1296645331 shutdown_connections 2024-09-04T16:55:49.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:49.077+0000 7efd01645640 1 --2- 172.21.15.170:0/1296645331 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7efce8079e30 0x7efce807c2f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:49.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:49.077+0000 7efd01645640 1 --2- 172.21.15.170:0/1296645331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcfc1067e0 0x7efcfc198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:49.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:49.077+0000 7efd01645640 1 --2- 172.21.15.170:0/1296645331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcfc1007e0 0x7efcfc1987e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:49.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:49.077+0000 7efd01645640 1 -- 172.21.15.170:0/1296645331 >> 172.21.15.170:0/1296645331 conn(0x7efcfc0fc4c0 msgr2=0x7efcfc0fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:55:49.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:49.077+0000 7efd01645640 1 -- 172.21.15.170:0/1296645331 shutdown_connections 2024-09-04T16:55:49.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:49.077+0000 7efd01645640 1 -- 172.21.15.170:0/1296645331 wait complete. 2024-09-04T16:55:49.793 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph versions' 2024-09-04T16:55:50.052 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:55:50.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.571+0000 7f938e2d5640 1 -- 172.21.15.170:0/995129981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9388107930 msgr2=0x7f9388107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:50.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.571+0000 7f938e2d5640 1 --2- 172.21.15.170:0/995129981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9388107930 0x7f9388107d10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9378009880 tx=0x7f937802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:55:50.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.571+0000 7f938e2d5640 1 -- 172.21.15.170:0/995129981 shutdown_connections 2024-09-04T16:55:50.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.571+0000 7f938e2d5640 1 --2- 172.21.15.170:0/995129981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9388101930 0x7f9388101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:50.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.571+0000 7f938e2d5640 1 --2- 172.21.15.170:0/995129981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9388107930 0x7f9388107d10 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:50.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.571+0000 7f938e2d5640 1 -- 172.21.15.170:0/995129981 >> 172.21.15.170:0/995129981 conn(0x7f93880fd630 msgr2=0x7f93880ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:55:50.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.571+0000 7f938e2d5640 1 -- 172.21.15.170:0/995129981 shutdown_connections 2024-09-04T16:55:50.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.571+0000 7f938e2d5640 1 -- 172.21.15.170:0/995129981 wait complete. 2024-09-04T16:55:50.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.572+0000 7f938e2d5640 1 Processor -- start 2024-09-04T16:55:50.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.572+0000 7f938e2d5640 1 -- start start 2024-09-04T16:55:50.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.572+0000 7f938e2d5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9388101930 0x7f938819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:50.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.572+0000 7f938e2d5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9388107930 0x7f938819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:50.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.572+0000 7f938e2d5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f938810ee00 con 0x7f9388107930 2024-09-04T16:55:50.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.572+0000 7f938e2d5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f938810ec80 con 0x7f9388101930 2024-09-04T16:55:50.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.572+0000 7f93877fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9388107930 0x7f938819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:50.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.572+0000 7f93877fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9388107930 0x7f938819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38038/0 (socket says 172.21.15.170:38038) 2024-09-04T16:55:50.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.572+0000 7f93877fe640 1 -- 172.21.15.170:0/876670805 learned_addr learned my addr 172.21.15.170:0/876670805 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:55:50.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.572+0000 7f9387fff640 1 --2- 172.21.15.170:0/876670805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9388101930 0x7f938819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:50.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.573+0000 7f93877fe640 1 -- 172.21.15.170:0/876670805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9388101930 msgr2=0x7f938819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:50.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.573+0000 7f93877fe640 1 --2- 172.21.15.170:0/876670805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9388101930 0x7f938819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:50.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.573+0000 7f93877fe640 1 -- 172.21.15.170:0/876670805 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93881977f0 con 0x7f9388107930 2024-09-04T16:55:50.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.573+0000 7f93877fe640 1 --2- 172.21.15.170:0/876670805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9388107930 0x7f938819dbb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f937000c8f0 tx=0x7f937000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:55:50.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.573+0000 7f93857fa640 1 -- 172.21.15.170:0/876670805 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93700079b0 con 0x7f9388107930 2024-09-04T16:55:50.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.573+0000 7f93857fa640 1 -- 172.21.15.170:0/876670805 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f93700054e0 con 0x7f9388107930 2024-09-04T16:55:50.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.573+0000 7f93857fa640 1 -- 172.21.15.170:0/876670805 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9370004dd0 con 0x7f9388107930 2024-09-04T16:55:50.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.573+0000 7f938e2d5640 1 -- 172.21.15.170:0/876670805 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9388197ae0 con 0x7f9388107930 2024-09-04T16:55:50.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.573+0000 7f938e2d5640 1 -- 172.21.15.170:0/876670805 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9388198070 con 0x7f9388107930 2024-09-04T16:55:50.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.574+0000 7f938e2d5640 1 -- 172.21.15.170:0/876670805 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9388103070 con 0x7f9388107930 2024-09-04T16:55:50.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.575+0000 7f93857fa640 1 -- 172.21.15.170:0/876670805 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f9370005020 con 0x7f9388107930 2024-09-04T16:55:50.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.575+0000 7f93857fa640 1 --2- 172.21.15.170:0/876670805 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9374079e30 0x7f937407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:50.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.575+0000 7f93857fa640 1 -- 172.21.15.170:0/876670805 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f937009c8c0 con 0x7f9388107930 2024-09-04T16:55:50.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.576+0000 7f9387fff640 1 --2- 172.21.15.170:0/876670805 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9374079e30 0x7f937407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:50.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.576+0000 7f9387fff640 1 --2- 172.21.15.170:0/876670805 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9374079e30 0x7f937407c2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9378000c00 tx=0x7f9378031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:55:50.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.580+0000 7f93857fa640 1 -- 172.21.15.170:0/876670805 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9370014030 con 0x7f9388107930 2024-09-04T16:55:50.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.827+0000 7f938e2d5640 1 -- 172.21.15.170:0/876670805 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9388109ea0 con 0x7f9388107930 2024-09-04T16:55:50.828 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:50 smithi170 ceph-mon[113855]: from='client.35196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:55:50.828 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:50 smithi170 ceph-mon[113855]: pgmap v785: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:50.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.828+0000 7f93857fa640 1 -- 172.21.15.170:0/876670805 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f93700684c0 con 0x7f9388107930 2024-09-04T16:55:50.829 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-09-04T16:55:50.829 INFO:teuthology.orchestra.run.smithi170.stdout: "mon": { 2024-09-04T16:55:50.829 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:55:50.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:55:50.829 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr": { 2024-09-04T16:55:50.829 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 2 2024-09-04T16:55:50.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:55:50.829 INFO:teuthology.orchestra.run.smithi170.stdout: "osd": { 2024-09-04T16:55:50.829 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 6 2024-09-04T16:55:50.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:55:50.830 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-09-04T16:55:50.830 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 4 2024-09-04T16:55:50.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-09-04T16:55:50.830 INFO:teuthology.orchestra.run.smithi170.stdout: "overall": { 2024-09-04T16:55:50.830 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)": 14 2024-09-04T16:55:50.830 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-09-04T16:55:50.830 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-09-04T16:55:50.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.830+0000 7f938e2d5640 1 -- 172.21.15.170:0/876670805 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9374079e30 msgr2=0x7f937407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:50.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.830+0000 7f938e2d5640 1 --2- 172.21.15.170:0/876670805 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9374079e30 0x7f937407c2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9378000c00 tx=0x7f9378031400 comp rx=0 tx=0).stop 2024-09-04T16:55:50.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.830+0000 7f938e2d5640 1 -- 172.21.15.170:0/876670805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9388107930 msgr2=0x7f938819dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:50.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.830+0000 7f938e2d5640 1 --2- 172.21.15.170:0/876670805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9388107930 0x7f938819dbb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f937000c8f0 tx=0x7f937000cdb0 comp rx=0 tx=0).stop 2024-09-04T16:55:50.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.830+0000 7f938e2d5640 1 -- 172.21.15.170:0/876670805 shutdown_connections 2024-09-04T16:55:50.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.830+0000 7f938e2d5640 1 --2- 172.21.15.170:0/876670805 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f9374079e30 0x7f937407c2f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:50.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.830+0000 7f938e2d5640 1 --2- 172.21.15.170:0/876670805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9388107930 0x7f938819dbb0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:50.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.830+0000 7f938e2d5640 1 --2- 172.21.15.170:0/876670805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9388101930 0x7f938819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:50.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.830+0000 7f938e2d5640 1 -- 172.21.15.170:0/876670805 >> 172.21.15.170:0/876670805 conn(0x7f93880fd630 msgr2=0x7f93880fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:55:50.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.831+0000 7f938e2d5640 1 -- 172.21.15.170:0/876670805 shutdown_connections 2024-09-04T16:55:50.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:50.831+0000 7f938e2d5640 1 -- 172.21.15.170:0/876670805 wait complete. 2024-09-04T16:55:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:50 smithi193 ceph-mon[82547]: from='client.35196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-04T16:55:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:50 smithi193 ceph-mon[82547]: pgmap v785: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:51.524 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-04T16:55:51.775 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:55:51.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:51 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/876670805' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:55:51.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:51 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/876670805' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:55:52.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.253+0000 7f01cee41640 1 -- 172.21.15.170:0/3753815297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c8103400 msgr2=0x7f01c810b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:52.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.253+0000 7f01cee41640 1 --2- 172.21.15.170:0/3753815297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c8103400 0x7f01c810b8f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009880 tx=0x7f01b402a530 comp rx=0 tx=0).stop 2024-09-04T16:55:52.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.253+0000 7f01cee41640 1 -- 172.21.15.170:0/3753815297 shutdown_connections 2024-09-04T16:55:52.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.253+0000 7f01cee41640 1 --2- 172.21.15.170:0/3753815297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c8103400 0x7f01c810b8f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:52.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.253+0000 7f01cee41640 1 --2- 172.21.15.170:0/3753815297 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01c8102ae0 0x7f01c8102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:52.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.254+0000 7f01cee41640 1 -- 172.21.15.170:0/3753815297 >> 172.21.15.170:0/3753815297 conn(0x7f01c80fc520 msgr2=0x7f01c80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:55:52.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.254+0000 7f01cee41640 1 -- 172.21.15.170:0/3753815297 shutdown_connections 2024-09-04T16:55:52.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.254+0000 7f01cee41640 1 -- 172.21.15.170:0/3753815297 wait complete. 2024-09-04T16:55:52.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.254+0000 7f01cee41640 1 Processor -- start 2024-09-04T16:55:52.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.254+0000 7f01cee41640 1 -- start start 2024-09-04T16:55:52.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.254+0000 7f01cee41640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01c8102ae0 0x7f01c819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:52.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.254+0000 7f01cee41640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c8103400 0x7f01c819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:52.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.254+0000 7f01cee41640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f01c810edf0 con 0x7f01c8103400 2024-09-04T16:55:52.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.254+0000 7f01cee41640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f01c810ec70 con 0x7f01c8102ae0 2024-09-04T16:55:52.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.254+0000 7f01c7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c8103400 0x7f01c819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:52.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.254+0000 7f01c7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c8103400 0x7f01c819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38054/0 (socket says 172.21.15.170:38054) 2024-09-04T16:55:52.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.254+0000 7f01c7fff640 1 -- 172.21.15.170:0/3470869414 learned_addr learned my addr 172.21.15.170:0/3470869414 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:55:52.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.255+0000 7f01ccbdd640 1 --2- 172.21.15.170:0/3470869414 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01c8102ae0 0x7f01c819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:52.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.255+0000 7f01c7fff640 1 -- 172.21.15.170:0/3470869414 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01c8102ae0 msgr2=0x7f01c819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:52.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.255+0000 7f01c7fff640 1 --2- 172.21.15.170:0/3470869414 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01c8102ae0 0x7f01c819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:52.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.255+0000 7f01c7fff640 1 -- 172.21.15.170:0/3470869414 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c8197800 con 0x7f01c8103400 2024-09-04T16:55:52.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.255+0000 7f01c7fff640 1 --2- 172.21.15.170:0/3470869414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c8103400 0x7f01c819dbc0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f01b4031460 tx=0x7f01b4004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:55:52.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.255+0000 7f01c5ffb640 1 -- 172.21.15.170:0/3470869414 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01b403f070 con 0x7f01c8103400 2024-09-04T16:55:52.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.255+0000 7f01c5ffb640 1 -- 172.21.15.170:0/3470869414 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f01b40035f0 con 0x7f01c8103400 2024-09-04T16:55:52.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.255+0000 7f01cee41640 1 -- 172.21.15.170:0/3470869414 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c8197a90 con 0x7f01c8103400 2024-09-04T16:55:52.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.255+0000 7f01c5ffb640 1 -- 172.21.15.170:0/3470869414 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01b4035030 con 0x7f01c8103400 2024-09-04T16:55:52.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.255+0000 7f01cee41640 1 -- 172.21.15.170:0/3470869414 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c8197fc0 con 0x7f01c8103400 2024-09-04T16:55:52.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.256+0000 7f01cee41640 1 -- 172.21.15.170:0/3470869414 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c806abe0 con 0x7f01c8103400 2024-09-04T16:55:52.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.257+0000 7f01c5ffb640 1 -- 172.21.15.170:0/3470869414 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f01b4042070 con 0x7f01c8103400 2024-09-04T16:55:52.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.258+0000 7f01c5ffb640 1 --2- 172.21.15.170:0/3470869414 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f01b8079e30 0x7f01b807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:52.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.258+0000 7f01c5ffb640 1 -- 172.21.15.170:0/3470869414 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f01b40bd420 con 0x7f01c8103400 2024-09-04T16:55:52.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.258+0000 7f01ccbdd640 1 --2- 172.21.15.170:0/3470869414 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f01b8079e30 0x7f01b807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:52.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.258+0000 7f01ccbdd640 1 --2- 172.21.15.170:0/3470869414 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f01b8079e30 0x7f01b807c2f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f01bc005d00 tx=0x7f01bc00b410 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:55:52.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.262+0000 7f01c5ffb640 1 -- 172.21.15.170:0/3470869414 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f01b4088f00 con 0x7f01c8103400 2024-09-04T16:55:52.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.505+0000 7f01cee41640 1 -- 172.21.15.170:0/3470869414 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f01c8105f80 con 0x7f01c8103400 2024-09-04T16:55:52.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.506+0000 7f01c5ffb640 1 -- 172.21.15.170:0/3470869414 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f01b408d240 con 0x7f01c8103400 2024-09-04T16:55:52.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.508+0000 7f01cee41640 1 -- 172.21.15.170:0/3470869414 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f01b8079e30 msgr2=0x7f01b807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:52.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.508+0000 7f01cee41640 1 --2- 172.21.15.170:0/3470869414 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f01b8079e30 0x7f01b807c2f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f01bc005d00 tx=0x7f01bc00b410 comp rx=0 tx=0).stop 2024-09-04T16:55:52.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.508+0000 7f01cee41640 1 -- 172.21.15.170:0/3470869414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c8103400 msgr2=0x7f01c819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:52.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.508+0000 7f01cee41640 1 --2- 172.21.15.170:0/3470869414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c8103400 0x7f01c819dbc0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f01b4031460 tx=0x7f01b4004530 comp rx=0 tx=0).stop 2024-09-04T16:55:52.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.508+0000 7f01cee41640 1 -- 172.21.15.170:0/3470869414 shutdown_connections 2024-09-04T16:55:52.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.508+0000 7f01cee41640 1 --2- 172.21.15.170:0/3470869414 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f01b8079e30 0x7f01b807c2f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:52.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.508+0000 7f01cee41640 1 --2- 172.21.15.170:0/3470869414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c8103400 0x7f01c819dbc0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:52.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.508+0000 7f01cee41640 1 --2- 172.21.15.170:0/3470869414 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01c8102ae0 0x7f01c819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:52.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.508+0000 7f01cee41640 1 -- 172.21.15.170:0/3470869414 >> 172.21.15.170:0/3470869414 conn(0x7f01c80fc520 msgr2=0x7f01c8108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:55:52.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.508+0000 7f01cee41640 1 -- 172.21.15.170:0/3470869414 shutdown_connections 2024-09-04T16:55:52.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:52.508+0000 7f01cee41640 1 -- 172.21.15.170:0/3470869414 wait complete. 2024-09-04T16:55:52.518 INFO:teuthology.orchestra.run.smithi170.stdout:true 2024-09-04T16:55:52.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:52 smithi170 ceph-mon[113855]: pgmap v786: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:52.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:52 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3470869414' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:55:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:52 smithi193 ceph-mon[82547]: pgmap v786: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:52 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3470869414' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:55:53.166 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -e sha1=f9fcca5273b6971f640393d33a94730179073754 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-04T16:55:53.416 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:55:53.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.927+0000 7fd135e19640 1 -- 172.21.15.170:0/369483419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1301007e0 msgr2=0x7fd130100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:53.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.927+0000 7fd135e19640 1 --2- 172.21.15.170:0/369483419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1301007e0 0x7fd130100c40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd124009880 tx=0x7fd12402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:55:53.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.928+0000 7fd135e19640 1 -- 172.21.15.170:0/369483419 shutdown_connections 2024-09-04T16:55:53.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.928+0000 7fd135e19640 1 --2- 172.21.15.170:0/369483419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1301007e0 0x7fd130100c40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:53.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.928+0000 7fd135e19640 1 --2- 172.21.15.170:0/369483419 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1301067e0 0x7fd130106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:53.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.928+0000 7fd135e19640 1 -- 172.21.15.170:0/369483419 >> 172.21.15.170:0/369483419 conn(0x7fd1300fc4c0 msgr2=0x7fd1300fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:55:53.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.928+0000 7fd135e19640 1 -- 172.21.15.170:0/369483419 shutdown_connections 2024-09-04T16:55:53.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.928+0000 7fd135e19640 1 -- 172.21.15.170:0/369483419 wait complete. 2024-09-04T16:55:53.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.928+0000 7fd135e19640 1 Processor -- start 2024-09-04T16:55:53.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.928+0000 7fd135e19640 1 -- start start 2024-09-04T16:55:53.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd135e19640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1301007e0 0x7fd13019c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:53.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd135e19640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1301067e0 0x7fd13019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:53.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd135e19640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd13010dcb0 con 0x7fd1301067e0 2024-09-04T16:55:53.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd135e19640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd13010db30 con 0x7fd1301007e0 2024-09-04T16:55:53.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd12effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1301067e0 0x7fd13019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:53.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd12effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1301067e0 0x7fd13019cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:38068/0 (socket says 172.21.15.170:38068) 2024-09-04T16:55:53.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd12effd640 1 -- 172.21.15.170:0/2273690335 learned_addr learned my addr 172.21.15.170:0/2273690335 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:55:53.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd12f7fe640 1 --2- 172.21.15.170:0/2273690335 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1301007e0 0x7fd13019c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:53.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd12effd640 1 -- 172.21.15.170:0/2273690335 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1301007e0 msgr2=0x7fd13019c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:53.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd12effd640 1 --2- 172.21.15.170:0/2273690335 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1301007e0 0x7fd13019c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:53.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd12effd640 1 -- 172.21.15.170:0/2273690335 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1301966a0 con 0x7fd1301067e0 2024-09-04T16:55:53.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd12effd640 1 --2- 172.21.15.170:0/2273690335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1301067e0 0x7fd13019cb10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd124031460 tx=0x7fd124004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:55:53.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd12cff9640 1 -- 172.21.15.170:0/2273690335 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd124035070 con 0x7fd1301067e0 2024-09-04T16:55:53.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd135e19640 1 -- 172.21.15.170:0/2273690335 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd130196930 con 0x7fd1301067e0 2024-09-04T16:55:53.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd12cff9640 1 -- 172.21.15.170:0/2273690335 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd1240035f0 con 0x7fd1301067e0 2024-09-04T16:55:53.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd12cff9640 1 -- 172.21.15.170:0/2273690335 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd124031800 con 0x7fd1301067e0 2024-09-04T16:55:53.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.929+0000 7fd135e19640 1 -- 172.21.15.170:0/2273690335 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd130196e30 con 0x7fd1301067e0 2024-09-04T16:55:53.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.930+0000 7fd135e19640 1 -- 172.21.15.170:0/2273690335 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd130101f20 con 0x7fd1301067e0 2024-09-04T16:55:53.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.931+0000 7fd12cff9640 1 -- 172.21.15.170:0/2273690335 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fd124003ca0 con 0x7fd1301067e0 2024-09-04T16:55:53.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.932+0000 7fd12cff9640 1 --2- 172.21.15.170:0/2273690335 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd118079e30 0x7fd11807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:53.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.932+0000 7fd12f7fe640 1 --2- 172.21.15.170:0/2273690335 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd118079e30 0x7fd11807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:53.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.932+0000 7fd12cff9640 1 -- 172.21.15.170:0/2273690335 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd12403e070 con 0x7fd1301067e0 2024-09-04T16:55:53.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.932+0000 7fd12f7fe640 1 --2- 172.21.15.170:0/2273690335 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd118079e30 0x7fd11807c2f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd120005fd0 tx=0x7fd120009500 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:55:53.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:53.936+0000 7fd12cff9640 1 -- 172.21.15.170:0/2273690335 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd1240867c0 con 0x7fd1301067e0 2024-09-04T16:55:54.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:54.183+0000 7fd135e19640 1 -- 172.21.15.170:0/2273690335 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd1301970e0 con 0x7fd1301067e0 2024-09-04T16:55:54.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:54.183+0000 7fd12cff9640 1 -- 172.21.15.170:0/2273690335 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fd12408a930 con 0x7fd1301067e0 2024-09-04T16:55:54.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:54.186+0000 7fd135e19640 1 -- 172.21.15.170:0/2273690335 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd118079e30 msgr2=0x7fd11807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:54.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:54.186+0000 7fd135e19640 1 --2- 172.21.15.170:0/2273690335 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd118079e30 0x7fd11807c2f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd120005fd0 tx=0x7fd120009500 comp rx=0 tx=0).stop 2024-09-04T16:55:54.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:54.186+0000 7fd135e19640 1 -- 172.21.15.170:0/2273690335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1301067e0 msgr2=0x7fd13019cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:54.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:54.186+0000 7fd135e19640 1 --2- 172.21.15.170:0/2273690335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1301067e0 0x7fd13019cb10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd124031460 tx=0x7fd124004530 comp rx=0 tx=0).stop 2024-09-04T16:55:54.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:54.186+0000 7fd135e19640 1 -- 172.21.15.170:0/2273690335 shutdown_connections 2024-09-04T16:55:54.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:54.186+0000 7fd135e19640 1 --2- 172.21.15.170:0/2273690335 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd118079e30 0x7fd11807c2f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:54.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:54.186+0000 7fd135e19640 1 --2- 172.21.15.170:0/2273690335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1301067e0 0x7fd13019cb10 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:54.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:54.186+0000 7fd135e19640 1 --2- 172.21.15.170:0/2273690335 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd1301007e0 0x7fd13019c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:54.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:54.186+0000 7fd135e19640 1 -- 172.21.15.170:0/2273690335 >> 172.21.15.170:0/2273690335 conn(0x7fd1300fc4c0 msgr2=0x7fd1300fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:55:54.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:54.186+0000 7fd135e19640 1 -- 172.21.15.170:0/2273690335 shutdown_connections 2024-09-04T16:55:54.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:54.186+0000 7fd135e19640 1 -- 172.21.15.170:0/2273690335 wait complete. 2024-09-04T16:55:54.195 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph version 19.3.0-4702-gf9fcca52 (f9fcca5273b6971f640393d33a94730179073754) squid (dev)" 2024-09-04T16:55:54.820 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:54 smithi170 ceph-mon[113855]: pgmap v787: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:54.820 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:54 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2273690335' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:55:54.849 DEBUG:teuthology.parallel:result is None 2024-09-04T16:55:54.849 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-04T16:55:54.861 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi170.front.sepia.ceph.com 2024-09-04T16:55:54.861 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-04T16:55:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:54 smithi193 ceph-mon[82547]: pgmap v787: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:54 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2273690335' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-04T16:55:55.109 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:55:55.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.587+0000 7fd7aa045640 1 -- 172.21.15.170:0/4275148851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a41007e0 msgr2=0x7fd7a4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:55.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.587+0000 7fd7aa045640 1 --2- 172.21.15.170:0/4275148851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a41007e0 0x7fd7a4100c40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009880 tx=0x7fd78c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:55:55.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.587+0000 7fd7aa045640 1 -- 172.21.15.170:0/4275148851 shutdown_connections 2024-09-04T16:55:55.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.587+0000 7fd7aa045640 1 --2- 172.21.15.170:0/4275148851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a41007e0 0x7fd7a4100c40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:55.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.587+0000 7fd7aa045640 1 --2- 172.21.15.170:0/4275148851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7a41067e0 0x7fd7a4106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:55.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.587+0000 7fd7aa045640 1 -- 172.21.15.170:0/4275148851 >> 172.21.15.170:0/4275148851 conn(0x7fd7a40fc4c0 msgr2=0x7fd7a40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:55:55.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.587+0000 7fd7aa045640 1 -- 172.21.15.170:0/4275148851 shutdown_connections 2024-09-04T16:55:55.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.587+0000 7fd7aa045640 1 -- 172.21.15.170:0/4275148851 wait complete. 2024-09-04T16:55:55.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.587+0000 7fd7aa045640 1 Processor -- start 2024-09-04T16:55:55.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.587+0000 7fd7aa045640 1 -- start start 2024-09-04T16:55:55.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.588+0000 7fd7aa045640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7a41007e0 0x7fd7a410cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:55.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.588+0000 7fd7aa045640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a41067e0 0x7fd7a410d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:55.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.588+0000 7fd7aa045640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a410ee10 con 0x7fd7a41067e0 2024-09-04T16:55:55.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.588+0000 7fd7aa045640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a410ec90 con 0x7fd7a41007e0 2024-09-04T16:55:55.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.588+0000 7fd79affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a41067e0 0x7fd7a410d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:55.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.588+0000 7fd79affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a41067e0 0x7fd7a410d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41616/0 (socket says 172.21.15.170:41616) 2024-09-04T16:55:55.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.588+0000 7fd79affd640 1 -- 172.21.15.170:0/3655755570 learned_addr learned my addr 172.21.15.170:0/3655755570 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:55:55.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.588+0000 7fd7a37fe640 1 --2- 172.21.15.170:0/3655755570 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7a41007e0 0x7fd7a410cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:55.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.588+0000 7fd79affd640 1 -- 172.21.15.170:0/3655755570 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7a41007e0 msgr2=0x7fd7a410cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:55.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.588+0000 7fd79affd640 1 --2- 172.21.15.170:0/3655755570 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7a41007e0 0x7fd7a410cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:55.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.588+0000 7fd79affd640 1 -- 172.21.15.170:0/3655755570 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a410d580 con 0x7fd7a41067e0 2024-09-04T16:55:55.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.588+0000 7fd7a37fe640 1 --2- 172.21.15.170:0/3655755570 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7a41007e0 0x7fd7a410cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:55:55.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.588+0000 7fd79affd640 1 --2- 172.21.15.170:0/3655755570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a41067e0 0x7fd7a410d040 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd78c031460 tx=0x7fd78c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:55:55.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.588+0000 7fd7a17fa640 1 -- 172.21.15.170:0/3655755570 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd78c03f070 con 0x7fd7a41067e0 2024-09-04T16:55:55.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.589+0000 7fd7aa045640 1 -- 172.21.15.170:0/3655755570 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a410d810 con 0x7fd7a41067e0 2024-09-04T16:55:55.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.589+0000 7fd7a17fa640 1 -- 172.21.15.170:0/3655755570 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd78c004cf0 con 0x7fd7a41067e0 2024-09-04T16:55:55.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.589+0000 7fd7aa045640 1 -- 172.21.15.170:0/3655755570 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a41a3dc0 con 0x7fd7a41067e0 2024-09-04T16:55:55.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.589+0000 7fd7a17fa640 1 -- 172.21.15.170:0/3655755570 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd78c035030 con 0x7fd7a41067e0 2024-09-04T16:55:55.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.589+0000 7fd7aa045640 1 -- 172.21.15.170:0/3655755570 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a4101f20 con 0x7fd7a41067e0 2024-09-04T16:55:55.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.590+0000 7fd7a17fa640 1 -- 172.21.15.170:0/3655755570 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fd78c042070 con 0x7fd7a41067e0 2024-09-04T16:55:55.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.591+0000 7fd7a17fa640 1 --2- 172.21.15.170:0/3655755570 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd790079e30 0x7fd79007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:55.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.591+0000 7fd7a17fa640 1 -- 172.21.15.170:0/3655755570 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd78c0bd670 con 0x7fd7a41067e0 2024-09-04T16:55:55.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.591+0000 7fd7a37fe640 1 --2- 172.21.15.170:0/3655755570 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd790079e30 0x7fd79007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:55.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.591+0000 7fd7a37fe640 1 --2- 172.21.15.170:0/3655755570 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd790079e30 0x7fd79007c2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd794006fd0 tx=0x7fd794008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:55:55.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.595+0000 7fd7a17fa640 1 -- 172.21.15.170:0/3655755570 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd78c084fe0 con 0x7fd7a41067e0 2024-09-04T16:55:55.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.806+0000 7fd7aa045640 1 -- 172.21.15.170:0/3655755570 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd7a4108d70 con 0x7fd7a41067e0 2024-09-04T16:55:55.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.806+0000 7fd7a17fa640 1 -- 172.21.15.170:0/3655755570 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) ==== 76+0+2036 (secure 0 0 0) 0x7fd78c089150 con 0x7fd7a41067e0 2024-09-04T16:55:55.807 INFO:teuthology.orchestra.run.smithi170.stdout:e33 2024-09-04T16:55:55.807 INFO:teuthology.orchestra.run.smithi170.stdout:btime 2024-09-04T16:54:32:193770+0000 2024-09-04T16:55:55.807 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-04T16:55:55.807 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:55:55.807 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-09-04T16:55:55.808 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:55:55.808 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-09-04T16:55:55.808 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-09-04T16:55:55.808 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 33 2024-09-04T16:55:55.808 INFO:teuthology.orchestra.run.smithi170.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-04T16:55:55.808 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-09-04T16:27:21.512483+0000 2024-09-04T16:55:55.808 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-09-04T16:54:31.218095+0000 2024-09-04T16:55:55.808 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-09-04T16:55:55.808 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-09-04T16:55:55.808 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 60 2024-09-04T16:55:55.808 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-09-04T16:55:55.808 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-09-04T16:55:55.808 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-09-04T16:55:55.809 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-09-04T16:55:55.809 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-09-04T16:55:55.809 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 75 2024-09-04T16:55:55.809 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-04T16:55:55.809 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 2 2024-09-04T16:55:55.809 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1 2024-09-04T16:55:55.809 INFO:teuthology.orchestra.run.smithi170.stdout:up {0=34324,1=34356} 2024-09-04T16:55:55.809 INFO:teuthology.orchestra.run.smithi170.stdout:failed 2024-09-04T16:55:55.809 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-09-04T16:55:55.809 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-09-04T16:55:55.809 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-09-04T16:55:55.809 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-09-04T16:55:55.809 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data enabled 2024-09-04T16:55:55.810 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-09-04T16:55:55.810 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-09-04T16:55:55.810 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 1 2024-09-04T16:55:55.810 INFO:teuthology.orchestra.run.smithi170.stdout:qdb_cluster leader: 34324 members: 34356,34324 2024-09-04T16:55:55.810 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.zkhdil{0:34324} state up:active seq 243 join_fscid=1 addr [v2:172.21.15.170:6828/1635879781,v1:172.21.15.170:6829/1635879781] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:55:55.810 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi170.rzbrux{1:34356} state up:active seq 239 join_fscid=1 addr [v2:172.21.15.170:6826/455916915,v1:172.21.15.170:6827/455916915] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:55:55.810 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:55:55.810 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:55:55.810 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-09-04T16:55:55.810 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:55:55.810 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.xostco{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6824/1344840973,v1:172.21.15.193:6825/1344840973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:55:55.810 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.cephfs.smithi193.kabapr{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.193:6826/45732148,v1:172.21.15.193:6827/45732148] compat {c=[1],r=[1],i=[1fff]}] 2024-09-04T16:55:55.811 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 33 2024-09-04T16:55:55.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.809+0000 7fd7aa045640 1 -- 172.21.15.170:0/3655755570 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd790079e30 msgr2=0x7fd79007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:55.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.809+0000 7fd7aa045640 1 --2- 172.21.15.170:0/3655755570 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd790079e30 0x7fd79007c2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd794006fd0 tx=0x7fd794008040 comp rx=0 tx=0).stop 2024-09-04T16:55:55.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.809+0000 7fd7aa045640 1 -- 172.21.15.170:0/3655755570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a41067e0 msgr2=0x7fd7a410d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:55.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.809+0000 7fd7aa045640 1 --2- 172.21.15.170:0/3655755570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a41067e0 0x7fd7a410d040 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd78c031460 tx=0x7fd78c0048f0 comp rx=0 tx=0).stop 2024-09-04T16:55:55.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.809+0000 7fd7aa045640 1 -- 172.21.15.170:0/3655755570 shutdown_connections 2024-09-04T16:55:55.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.809+0000 7fd7aa045640 1 --2- 172.21.15.170:0/3655755570 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd790079e30 0x7fd79007c2f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:55.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.809+0000 7fd7aa045640 1 --2- 172.21.15.170:0/3655755570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7a41067e0 0x7fd7a410d040 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:55.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.809+0000 7fd7aa045640 1 --2- 172.21.15.170:0/3655755570 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd7a41007e0 0x7fd7a410cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:55.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.809+0000 7fd7aa045640 1 -- 172.21.15.170:0/3655755570 >> 172.21.15.170:0/3655755570 conn(0x7fd7a40fc4c0 msgr2=0x7fd7a40fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:55:55.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.809+0000 7fd7aa045640 1 -- 172.21.15.170:0/3655755570 shutdown_connections 2024-09-04T16:55:55.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:55.809+0000 7fd7aa045640 1 -- 172.21.15.170:0/3655755570 wait complete. 2024-09-04T16:55:56.482 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-04T16:55:56.493 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-04T16:55:56.743 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:55:56.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:56 smithi170 ceph-mon[113855]: pgmap v788: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:56.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:56 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3655755570' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:55:56.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:56 smithi193 ceph-mon[82547]: pgmap v788: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:56.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:56 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3655755570' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-04T16:55:57.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.219+0000 7f92fd2e3640 1 -- 172.21.15.170:0/3725594487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92f81067e0 msgr2=0x7f92f8106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:57.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.219+0000 7f92fd2e3640 1 --2- 172.21.15.170:0/3725594487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92f81067e0 0x7f92f8106bc0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f92e8009880 tx=0x7f92e802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:55:57.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.219+0000 7f92fd2e3640 1 -- 172.21.15.170:0/3725594487 shutdown_connections 2024-09-04T16:55:57.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.219+0000 7f92fd2e3640 1 --2- 172.21.15.170:0/3725594487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92f81007e0 0x7f92f8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:57.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.219+0000 7f92fd2e3640 1 --2- 172.21.15.170:0/3725594487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92f81067e0 0x7f92f8106bc0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:57.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.219+0000 7f92fd2e3640 1 -- 172.21.15.170:0/3725594487 >> 172.21.15.170:0/3725594487 conn(0x7f92f80fc4c0 msgr2=0x7f92f80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:55:57.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.219+0000 7f92fd2e3640 1 -- 172.21.15.170:0/3725594487 shutdown_connections 2024-09-04T16:55:57.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.219+0000 7f92fd2e3640 1 -- 172.21.15.170:0/3725594487 wait complete. 2024-09-04T16:55:57.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.219+0000 7f92fd2e3640 1 Processor -- start 2024-09-04T16:55:57.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.220+0000 7f92fd2e3640 1 -- start start 2024-09-04T16:55:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.220+0000 7f92fd2e3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92f81007e0 0x7f92f819c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.220+0000 7f92fd2e3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92f81067e0 0x7f92f819caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.220+0000 7f92fd2e3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f92f810dc90 con 0x7f92f81007e0 2024-09-04T16:55:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.220+0000 7f92fd2e3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f92f810db10 con 0x7f92f81067e0 2024-09-04T16:55:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.220+0000 7f92f67fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92f81067e0 0x7f92f819caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.220+0000 7f92f67fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92f81067e0 0x7f92f819caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.170:49950/0 (socket says 172.21.15.170:49950) 2024-09-04T16:55:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.220+0000 7f92f67fc640 1 -- 172.21.15.170:0/633206818 learned_addr learned my addr 172.21.15.170:0/633206818 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:55:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.220+0000 7f92f6ffd640 1 --2- 172.21.15.170:0/633206818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92f81007e0 0x7f92f819c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.221+0000 7f92f6ffd640 1 -- 172.21.15.170:0/633206818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92f81067e0 msgr2=0x7f92f819caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.221+0000 7f92f6ffd640 1 --2- 172.21.15.170:0/633206818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92f81067e0 0x7f92f819caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.221+0000 7f92f6ffd640 1 -- 172.21.15.170:0/633206818 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f8196680 con 0x7f92f81007e0 2024-09-04T16:55:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.221+0000 7f92f67fc640 1 --2- 172.21.15.170:0/633206818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92f81067e0 0x7f92f819caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-04T16:55:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.221+0000 7f92f6ffd640 1 --2- 172.21.15.170:0/633206818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92f81007e0 0x7f92f819c5b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f92e802a9c0 tx=0x7f92e80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:55:57.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.221+0000 7f92effff640 1 -- 172.21.15.170:0/633206818 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f92e803f070 con 0x7f92f81007e0 2024-09-04T16:55:57.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.221+0000 7f92fd2e3640 1 -- 172.21.15.170:0/633206818 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f8196910 con 0x7f92f81007e0 2024-09-04T16:55:57.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.221+0000 7f92effff640 1 -- 172.21.15.170:0/633206818 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f92e80035f0 con 0x7f92f81007e0 2024-09-04T16:55:57.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.221+0000 7f92effff640 1 -- 172.21.15.170:0/633206818 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f92e8035030 con 0x7f92f81007e0 2024-09-04T16:55:57.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.221+0000 7f92fd2e3640 1 -- 172.21.15.170:0/633206818 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f8196e10 con 0x7f92f81007e0 2024-09-04T16:55:57.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.222+0000 7f92fd2e3640 1 -- 172.21.15.170:0/633206818 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f8101f20 con 0x7f92f81007e0 2024-09-04T16:55:57.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.223+0000 7f92effff640 1 -- 172.21.15.170:0/633206818 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f92e8042070 con 0x7f92f81007e0 2024-09-04T16:55:57.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.223+0000 7f92effff640 1 --2- 172.21.15.170:0/633206818 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f92e4079e40 0x7f92e407c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:57.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.224+0000 7f92effff640 1 -- 172.21.15.170:0/633206818 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f92e80bd3f0 con 0x7f92f81007e0 2024-09-04T16:55:57.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.224+0000 7f92f67fc640 1 --2- 172.21.15.170:0/633206818 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f92e4079e40 0x7f92e407c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:57.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.224+0000 7f92f67fc640 1 --2- 172.21.15.170:0/633206818 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f92e4079e40 0x7f92e407c300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f92f8197ed0 tx=0x7f92e000b4a0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:55:57.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.228+0000 7f92effff640 1 -- 172.21.15.170:0/633206818 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f92e8088f70 con 0x7f92f81007e0 2024-09-04T16:55:57.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.441+0000 7f92fd2e3640 1 -- 172.21.15.170:0/633206818 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92f81039f0 con 0x7f92f81007e0 2024-09-04T16:55:57.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.441+0000 7f92effff640 1 -- 172.21.15.170:0/633206818 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5345 (secure 0 0 0) 0x7f92e808d990 con 0x7f92f81007e0 2024-09-04T16:55:57.442 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:55:57.442 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":33,"btime":"2024-09-04T16:54:32:193770+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44313,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1344840973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1344840973},{"type":"v1","addr":"172.21.15.193:6825","nonce":1344840973}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44339,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6827/45732148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":45732148},{"type":"v1","addr":"172.21.15.193:6827","nonce":45732148}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:54:31.218095+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34324,"mds_1":34356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34324":{"gid":34324,"name":"cephfs.smithi170.zkhdil","rank":0,"incarnation":27,"state":"up:active","state_seq":243,"addr":"172.21.15.170:6829/1635879781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1635879781},{"type":"v1","addr":"172.21.15.170:6829","nonce":1635879781}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34356":{"gid":34356,"name":"cephfs.smithi170.rzbrux","rank":1,"incarnation":27,"state":"up:active","state_seq":239,"addr":"172.21.15.170:6827/455916915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":455916915},{"type":"v1","addr":"172.21.15.170:6827","nonce":455916915}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34324,"qdb_cluster":[34356,34324]},"id":1}]} 2024-09-04T16:55:57.443 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 33 2024-09-04T16:55:57.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.445+0000 7f92fd2e3640 1 -- 172.21.15.170:0/633206818 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f92e4079e40 msgr2=0x7f92e407c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:57.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.445+0000 7f92fd2e3640 1 --2- 172.21.15.170:0/633206818 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f92e4079e40 0x7f92e407c300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f92f8197ed0 tx=0x7f92e000b4a0 comp rx=0 tx=0).stop 2024-09-04T16:55:57.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.445+0000 7f92fd2e3640 1 -- 172.21.15.170:0/633206818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92f81007e0 msgr2=0x7f92f819c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:57.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.445+0000 7f92fd2e3640 1 --2- 172.21.15.170:0/633206818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92f81007e0 0x7f92f819c5b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f92e802a9c0 tx=0x7f92e80045e0 comp rx=0 tx=0).stop 2024-09-04T16:55:57.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.445+0000 7f92fd2e3640 1 -- 172.21.15.170:0/633206818 shutdown_connections 2024-09-04T16:55:57.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.445+0000 7f92fd2e3640 1 --2- 172.21.15.170:0/633206818 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f92e4079e40 0x7f92e407c300 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:57.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.445+0000 7f92fd2e3640 1 --2- 172.21.15.170:0/633206818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f92f81067e0 0x7f92f819caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:57.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.445+0000 7f92fd2e3640 1 --2- 172.21.15.170:0/633206818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92f81007e0 0x7f92f819c5b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:57.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.445+0000 7f92fd2e3640 1 -- 172.21.15.170:0/633206818 >> 172.21.15.170:0/633206818 conn(0x7f92f80fc4c0 msgr2=0x7f92f80fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:55:57.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.445+0000 7f92fd2e3640 1 -- 172.21.15.170:0/633206818 shutdown_connections 2024-09-04T16:55:57.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:57.445+0000 7f92fd2e3640 1 -- 172.21.15.170:0/633206818 wait complete. 2024-09-04T16:55:57.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:57 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/633206818' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-04T16:55:57.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:57 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/633206818' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-04T16:55:58.073 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 2, 'flags': 18} 2024-09-04T16:55:58.073 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 16 2024-09-04T16:55:58.321 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:55:58.698 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:58 smithi170 ceph-mon[113855]: pgmap v789: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:58.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.778+0000 7fadf71a3640 1 -- 172.21.15.170:0/2880235974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadf0100810 msgr2=0x7fadf0100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:58.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.778+0000 7fadf71a3640 1 --2- 172.21.15.170:0/2880235974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadf0100810 0x7fadf0100c70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7faddc009880 tx=0x7faddc02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:55:58.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.778+0000 7fadf71a3640 1 -- 172.21.15.170:0/2880235974 shutdown_connections 2024-09-04T16:55:58.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.778+0000 7fadf71a3640 1 --2- 172.21.15.170:0/2880235974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadf0100810 0x7fadf0100c70 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:58.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.778+0000 7fadf71a3640 1 --2- 172.21.15.170:0/2880235974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadf0106810 0x7fadf0106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:58.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.778+0000 7fadf71a3640 1 -- 172.21.15.170:0/2880235974 >> 172.21.15.170:0/2880235974 conn(0x7fadf00fc510 msgr2=0x7fadf00fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:55:58.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.778+0000 7fadf71a3640 1 -- 172.21.15.170:0/2880235974 shutdown_connections 2024-09-04T16:55:58.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.778+0000 7fadf71a3640 1 -- 172.21.15.170:0/2880235974 wait complete. 2024-09-04T16:55:58.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.779+0000 7fadf71a3640 1 Processor -- start 2024-09-04T16:55:58.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.779+0000 7fadf71a3640 1 -- start start 2024-09-04T16:55:58.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.779+0000 7fadf71a3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadf0100810 0x7fadf019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:58.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.779+0000 7fadf71a3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadf0106810 0x7fadf019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:58.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.779+0000 7fadf71a3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fadf010dcc0 con 0x7fadf0100810 2024-09-04T16:55:58.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.779+0000 7fadf71a3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fadf010db40 con 0x7fadf0106810 2024-09-04T16:55:58.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.779+0000 7fadf4f3f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadf0100810 0x7fadf019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:58.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.779+0000 7fadf4f3f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadf0100810 0x7fadf019d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41660/0 (socket says 172.21.15.170:41660) 2024-09-04T16:55:58.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.779+0000 7fadf4f3f640 1 -- 172.21.15.170:0/4005442229 learned_addr learned my addr 172.21.15.170:0/4005442229 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:55:58.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.779+0000 7fadf4f3f640 1 -- 172.21.15.170:0/4005442229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadf0106810 msgr2=0x7fadf019dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:58.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.779+0000 7fadeffff640 1 --2- 172.21.15.170:0/4005442229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadf0106810 0x7fadf019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:58.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.779+0000 7fadf4f3f640 1 --2- 172.21.15.170:0/4005442229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadf0106810 0x7fadf019dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:58.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.779+0000 7fadf4f3f640 1 -- 172.21.15.170:0/4005442229 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf0197810 con 0x7fadf0100810 2024-09-04T16:55:58.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.779+0000 7fadeffff640 1 --2- 172.21.15.170:0/4005442229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadf0106810 0x7fadf019dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:55:58.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.779+0000 7fadf4f3f640 1 --2- 172.21.15.170:0/4005442229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadf0100810 0x7fadf019d690 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fade400c8a0 tx=0x7fade400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:55:58.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.780+0000 7fadedffb640 1 -- 172.21.15.170:0/4005442229 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fade40079b0 con 0x7fadf0100810 2024-09-04T16:55:58.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.780+0000 7fadf71a3640 1 -- 172.21.15.170:0/4005442229 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf0197b00 con 0x7fadf0100810 2024-09-04T16:55:58.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.780+0000 7fadedffb640 1 -- 172.21.15.170:0/4005442229 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fade4007b50 con 0x7fadf0100810 2024-09-04T16:55:58.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.780+0000 7fadedffb640 1 -- 172.21.15.170:0/4005442229 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fade4018700 con 0x7fadf0100810 2024-09-04T16:55:58.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.780+0000 7fadf71a3640 1 -- 172.21.15.170:0/4005442229 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf0198090 con 0x7fadf0100810 2024-09-04T16:55:58.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.781+0000 7fadf71a3640 1 -- 172.21.15.170:0/4005442229 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf0101f50 con 0x7fadf0100810 2024-09-04T16:55:58.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.781+0000 7fadedffb640 1 -- 172.21.15.170:0/4005442229 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fade4007d00 con 0x7fadf0100810 2024-09-04T16:55:58.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.782+0000 7fadedffb640 1 --2- 172.21.15.170:0/4005442229 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fade0079e30 0x7fade007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:55:58.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.782+0000 7fadedffb640 1 -- 172.21.15.170:0/4005442229 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fade409cd70 con 0x7fadf0100810 2024-09-04T16:55:58.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.782+0000 7fadeffff640 1 --2- 172.21.15.170:0/4005442229 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fade0079e30 0x7fade007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:55:58.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.782+0000 7fadeffff640 1 --2- 172.21.15.170:0/4005442229 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fade0079e30 0x7fade007c2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faddc031460 tx=0x7faddc0095f0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:55:58.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.786+0000 7fadedffb640 1 -- 172.21.15.170:0/4005442229 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fade4014030 con 0x7fadf0100810 2024-09-04T16:55:58.806 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:58 smithi193 ceph-mon[82547]: pgmap v789: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:55:58.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.996+0000 7fadf71a3640 1 -- 172.21.15.170:0/4005442229 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) -- 0x7fadf0198d40 con 0x7fadf0100810 2024-09-04T16:55:58.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.996+0000 7fadedffb640 1 -- 172.21.15.170:0/4005442229 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v33) ==== 107+0+3610 (secure 0 0 0) 0x7fade4064780 con 0x7fadf0100810 2024-09-04T16:55:58.997 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:55:58.997 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":16,"btime":"2024-09-04T16:38:15:784231+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24315,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.193:6827/288890560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":288890560},{"type":"v1","addr":"172.21.15.193:6827","nonce":288890560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":24319,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1128257367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1128257367},{"type":"v1","addr":"172.21.15.193:6825","nonce":1128257367}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:38:15.784227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-04T16:55:58.998 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 16 2024-09-04T16:55:59.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.999+0000 7fadf71a3640 1 -- 172.21.15.170:0/4005442229 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fade0079e30 msgr2=0x7fade007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:59.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.999+0000 7fadf71a3640 1 --2- 172.21.15.170:0/4005442229 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fade0079e30 0x7fade007c2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faddc031460 tx=0x7faddc0095f0 comp rx=0 tx=0).stop 2024-09-04T16:55:59.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.999+0000 7fadf71a3640 1 -- 172.21.15.170:0/4005442229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadf0100810 msgr2=0x7fadf019d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:55:59.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.999+0000 7fadf71a3640 1 --2- 172.21.15.170:0/4005442229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadf0100810 0x7fadf019d690 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fade400c8a0 tx=0x7fade400cd60 comp rx=0 tx=0).stop 2024-09-04T16:55:59.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.999+0000 7fadf71a3640 1 -- 172.21.15.170:0/4005442229 shutdown_connections 2024-09-04T16:55:59.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.999+0000 7fadf71a3640 1 --2- 172.21.15.170:0/4005442229 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fade0079e30 0x7fade007c2f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:59.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.999+0000 7fadf71a3640 1 --2- 172.21.15.170:0/4005442229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fadf0106810 0x7fadf019dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:59.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.999+0000 7fadf71a3640 1 --2- 172.21.15.170:0/4005442229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadf0100810 0x7fadf019d690 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:55:59.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.999+0000 7fadf71a3640 1 -- 172.21.15.170:0/4005442229 >> 172.21.15.170:0/4005442229 conn(0x7fadf00fc510 msgr2=0x7fadf0104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:55:59.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.999+0000 7fadf71a3640 1 -- 172.21.15.170:0/4005442229 shutdown_connections 2024-09-04T16:55:59.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:55:58.999+0000 7fadf71a3640 1 -- 172.21.15.170:0/4005442229 wait complete. 2024-09-04T16:55:59.644 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:59 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/4005442229' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-04T16:55:59.644 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:55:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:55:59.670 DEBUG:tasks.fs:max_mds not reduced in epoch 16 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-04T16:55:59.671 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 17 2024-09-04T16:55:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:59 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/4005442229' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-04T16:55:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:55:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:55:59.924 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:00.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.414+0000 7f6c70e69640 1 -- 172.21.15.170:0/189528541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c6c107910 msgr2=0x7f6c6c107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:00.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.414+0000 7f6c70e69640 1 --2- 172.21.15.170:0/189528541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c6c107910 0x7f6c6c107cf0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009880 tx=0x7f6c5c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:56:00.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.414+0000 7f6c70e69640 1 -- 172.21.15.170:0/189528541 shutdown_connections 2024-09-04T16:56:00.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.414+0000 7f6c70e69640 1 --2- 172.21.15.170:0/189528541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c6c101910 0x7f6c6c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:00.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.414+0000 7f6c70e69640 1 --2- 172.21.15.170:0/189528541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c6c107910 0x7f6c6c107cf0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:00.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.414+0000 7f6c70e69640 1 -- 172.21.15.170:0/189528541 >> 172.21.15.170:0/189528541 conn(0x7f6c6c0fd5f0 msgr2=0x7f6c6c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:00.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.415+0000 7f6c70e69640 1 -- 172.21.15.170:0/189528541 shutdown_connections 2024-09-04T16:56:00.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.415+0000 7f6c70e69640 1 -- 172.21.15.170:0/189528541 wait complete. 2024-09-04T16:56:00.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.415+0000 7f6c70e69640 1 Processor -- start 2024-09-04T16:56:00.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.415+0000 7f6c70e69640 1 -- start start 2024-09-04T16:56:00.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.416+0000 7f6c70e69640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c6c101910 0x7f6c6c19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:00.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.416+0000 7f6c70e69640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c6c107910 0x7f6c6c19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:00.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.416+0000 7f6c70e69640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c10ede0 con 0x7f6c6c107910 2024-09-04T16:56:00.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.416+0000 7f6c70e69640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c10ec60 con 0x7f6c6c101910 2024-09-04T16:56:00.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.416+0000 7f6c63fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c6c107910 0x7f6c6c19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:00.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.416+0000 7f6c63fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c6c107910 0x7f6c6c19db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41676/0 (socket says 172.21.15.170:41676) 2024-09-04T16:56:00.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.416+0000 7f6c63fff640 1 -- 172.21.15.170:0/3241482593 learned_addr learned my addr 172.21.15.170:0/3241482593 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:00.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.416+0000 7f6c6a59c640 1 --2- 172.21.15.170:0/3241482593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c6c101910 0x7f6c6c19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:00.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.416+0000 7f6c63fff640 1 -- 172.21.15.170:0/3241482593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c6c101910 msgr2=0x7f6c6c19d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:00.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.416+0000 7f6c63fff640 1 --2- 172.21.15.170:0/3241482593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c6c101910 0x7f6c6c19d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:00.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.416+0000 7f6c63fff640 1 -- 172.21.15.170:0/3241482593 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c1977b0 con 0x7f6c6c107910 2024-09-04T16:56:00.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.416+0000 7f6c63fff640 1 --2- 172.21.15.170:0/3241482593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c6c107910 0x7f6c6c19db70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400d6f0 tx=0x7f6c5400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:00.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.416+0000 7f6c637fe640 1 -- 172.21.15.170:0/3241482593 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c54017070 con 0x7f6c6c107910 2024-09-04T16:56:00.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.416+0000 7f6c70e69640 1 -- 172.21.15.170:0/3241482593 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6c197aa0 con 0x7f6c6c107910 2024-09-04T16:56:00.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.416+0000 7f6c637fe640 1 -- 172.21.15.170:0/3241482593 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6c5400de00 con 0x7f6c6c107910 2024-09-04T16:56:00.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.416+0000 7f6c637fe640 1 -- 172.21.15.170:0/3241482593 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c54004bb0 con 0x7f6c6c107910 2024-09-04T16:56:00.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.417+0000 7f6c70e69640 1 -- 172.21.15.170:0/3241482593 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c6c198030 con 0x7f6c6c107910 2024-09-04T16:56:00.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.418+0000 7f6c70e69640 1 -- 172.21.15.170:0/3241482593 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c6c103050 con 0x7f6c6c107910 2024-09-04T16:56:00.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.418+0000 7f6c637fe640 1 -- 172.21.15.170:0/3241482593 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f6c54010460 con 0x7f6c6c107910 2024-09-04T16:56:00.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.419+0000 7f6c637fe640 1 --2- 172.21.15.170:0/3241482593 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6c58079e30 0x7f6c5807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:00.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.419+0000 7f6c637fe640 1 -- 172.21.15.170:0/3241482593 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6c5409c660 con 0x7f6c6c107910 2024-09-04T16:56:00.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.419+0000 7f6c6a59c640 1 --2- 172.21.15.170:0/3241482593 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6c58079e30 0x7f6c5807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:00.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.419+0000 7f6c6a59c640 1 --2- 172.21.15.170:0/3241482593 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6c58079e30 0x7f6c5807c2f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0096c0 tx=0x7f6c5c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:00.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.423+0000 7f6c637fe640 1 -- 172.21.15.170:0/3241482593 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6c540681e0 con 0x7f6c6c107910 2024-09-04T16:56:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:00 smithi170 ceph-mon[113855]: pgmap v790: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:00.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.635+0000 7f6c70e69640 1 -- 172.21.15.170:0/3241482593 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) -- 0x7f6c6c109e80 con 0x7f6c6c107910 2024-09-04T16:56:00.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.636+0000 7f6c637fe640 1 -- 172.21.15.170:0/3241482593 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v33) ==== 107+0+5310 (secure 0 0 0) 0x7f6c5406cc00 con 0x7f6c6c107910 2024-09-04T16:56:00.637 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:56:00.637 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":17,"btime":"2024-09-04T16:38:16:785968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24315,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.193:6827/288890560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":288890560},{"type":"v1","addr":"172.21.15.193:6827","nonce":288890560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":24319,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1128257367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1128257367},{"type":"v1","addr":"172.21.15.193:6825","nonce":1128257367}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34314,"name":"cephfs.smithi170.rzbrux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/2819765606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2819765606},{"type":"v1","addr":"172.21.15.170:6827","nonce":2819765606}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34318,"name":"cephfs.smithi170.zkhdil","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6829/3038480657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3038480657},{"type":"v1","addr":"172.21.15.170:6829","nonce":3038480657}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":16,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:38:15.784227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-04T16:56:00.637 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 17 2024-09-04T16:56:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.638+0000 7f6c70e69640 1 -- 172.21.15.170:0/3241482593 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6c58079e30 msgr2=0x7f6c5807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.638+0000 7f6c70e69640 1 --2- 172.21.15.170:0/3241482593 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6c58079e30 0x7f6c5807c2f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0096c0 tx=0x7f6c5c031400 comp rx=0 tx=0).stop 2024-09-04T16:56:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.638+0000 7f6c70e69640 1 -- 172.21.15.170:0/3241482593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c6c107910 msgr2=0x7f6c6c19db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.638+0000 7f6c70e69640 1 --2- 172.21.15.170:0/3241482593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c6c107910 0x7f6c6c19db70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400d6f0 tx=0x7f6c5400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:56:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.638+0000 7f6c70e69640 1 -- 172.21.15.170:0/3241482593 shutdown_connections 2024-09-04T16:56:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.638+0000 7f6c70e69640 1 --2- 172.21.15.170:0/3241482593 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6c58079e30 0x7f6c5807c2f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.638+0000 7f6c70e69640 1 --2- 172.21.15.170:0/3241482593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c6c107910 0x7f6c6c19db70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.638+0000 7f6c70e69640 1 --2- 172.21.15.170:0/3241482593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c6c101910 0x7f6c6c19d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.638+0000 7f6c70e69640 1 -- 172.21.15.170:0/3241482593 >> 172.21.15.170:0/3241482593 conn(0x7f6c6c0fd5f0 msgr2=0x7f6c6c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:00.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.638+0000 7f6c70e69640 1 -- 172.21.15.170:0/3241482593 shutdown_connections 2024-09-04T16:56:00.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:00.638+0000 7f6c70e69640 1 -- 172.21.15.170:0/3241482593 wait complete. 2024-09-04T16:56:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:00 smithi193 ceph-mon[82547]: pgmap v790: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:01.291 DEBUG:tasks.fs:max_mds not reduced in epoch 17 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-04T16:56:01.291 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 18 2024-09-04T16:56:01.541 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:01.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:01 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3241482593' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-04T16:56:01.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:01 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3241482593' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-04T16:56:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.013+0000 7fd346a8e640 1 -- 172.21.15.170:0/83367571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd340101930 msgr2=0x7fd340101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.013+0000 7fd346a8e640 1 --2- 172.21.15.170:0/83367571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd340101930 0x7fd340101d90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd328009880 tx=0x7fd32802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:56:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.013+0000 7fd346a8e640 1 -- 172.21.15.170:0/83367571 shutdown_connections 2024-09-04T16:56:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.013+0000 7fd346a8e640 1 --2- 172.21.15.170:0/83367571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd340101930 0x7fd340101d90 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.013+0000 7fd346a8e640 1 --2- 172.21.15.170:0/83367571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd340107930 0x7fd340107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.013+0000 7fd346a8e640 1 -- 172.21.15.170:0/83367571 >> 172.21.15.170:0/83367571 conn(0x7fd3400fd630 msgr2=0x7fd3400ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.013+0000 7fd346a8e640 1 -- 172.21.15.170:0/83367571 shutdown_connections 2024-09-04T16:56:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.013+0000 7fd346a8e640 1 -- 172.21.15.170:0/83367571 wait complete. 2024-09-04T16:56:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.014+0000 7fd346a8e640 1 Processor -- start 2024-09-04T16:56:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.014+0000 7fd346a8e640 1 -- start start 2024-09-04T16:56:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.014+0000 7fd346a8e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd340101930 0x7fd34019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.014+0000 7fd346a8e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd340107930 0x7fd34019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.014+0000 7fd346a8e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd34010ee60 con 0x7fd340101930 2024-09-04T16:56:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.014+0000 7fd346a8e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd34010ece0 con 0x7fd340107930 2024-09-04T16:56:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.014+0000 7fd34482a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd340101930 0x7fd34019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.014+0000 7fd34482a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd340101930 0x7fd34019d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41690/0 (socket says 172.21.15.170:41690) 2024-09-04T16:56:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.014+0000 7fd34482a640 1 -- 172.21.15.170:0/1219868853 learned_addr learned my addr 172.21.15.170:0/1219868853 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.014+0000 7fd33ffff640 1 --2- 172.21.15.170:0/1219868853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd340107930 0x7fd34019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.014+0000 7fd34482a640 1 -- 172.21.15.170:0/1219868853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd340107930 msgr2=0x7fd34019dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.014+0000 7fd34482a640 1 --2- 172.21.15.170:0/1219868853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd340107930 0x7fd34019dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.014+0000 7fd34482a640 1 -- 172.21.15.170:0/1219868853 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd340197870 con 0x7fd340101930 2024-09-04T16:56:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.015+0000 7fd34482a640 1 --2- 172.21.15.170:0/1219868853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd340101930 0x7fd34019d6b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd33000ba50 tx=0x7fd33000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.015+0000 7fd33dffb640 1 -- 172.21.15.170:0/1219868853 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd330019070 con 0x7fd340101930 2024-09-04T16:56:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.015+0000 7fd346a8e640 1 -- 172.21.15.170:0/1219868853 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd340197b60 con 0x7fd340101930 2024-09-04T16:56:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.015+0000 7fd33dffb640 1 -- 172.21.15.170:0/1219868853 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd33000ce20 con 0x7fd340101930 2024-09-04T16:56:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.015+0000 7fd33dffb640 1 -- 172.21.15.170:0/1219868853 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3300075a0 con 0x7fd340101930 2024-09-04T16:56:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.015+0000 7fd346a8e640 1 -- 172.21.15.170:0/1219868853 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3401980c0 con 0x7fd340101930 2024-09-04T16:56:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.016+0000 7fd346a8e640 1 -- 172.21.15.170:0/1219868853 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd340103070 con 0x7fd340101930 2024-09-04T16:56:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.016+0000 7fd33dffb640 1 -- 172.21.15.170:0/1219868853 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fd33001c070 con 0x7fd340101930 2024-09-04T16:56:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.017+0000 7fd33dffb640 1 --2- 172.21.15.170:0/1219868853 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd32c079e30 0x7fd32c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.017+0000 7fd33dffb640 1 -- 172.21.15.170:0/1219868853 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd33009c3a0 con 0x7fd340101930 2024-09-04T16:56:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.017+0000 7fd33ffff640 1 --2- 172.21.15.170:0/1219868853 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd32c079e30 0x7fd32c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.017+0000 7fd33ffff640 1 --2- 172.21.15.170:0/1219868853 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd32c079e30 0x7fd32c07c2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd340199060 tx=0x7fd328031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:02.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.022+0000 7fd33dffb640 1 -- 172.21.15.170:0/1219868853 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd330063db0 con 0x7fd340101930 2024-09-04T16:56:02.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.230+0000 7fd346a8e640 1 -- 172.21.15.170:0/1219868853 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) -- 0x7fd340109ef0 con 0x7fd340101930 2024-09-04T16:56:02.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.230+0000 7fd33dffb640 1 -- 172.21.15.170:0/1219868853 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v33) ==== 107+0+4460 (secure 0 0 0) 0x7fd330067f20 con 0x7fd340101930 2024-09-04T16:56:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:56:02.232 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":18,"btime":"2024-09-04T16:38:19:806024+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24315,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.193:6827/288890560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":288890560},{"type":"v1","addr":"172.21.15.193:6827","nonce":288890560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":24319,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1128257367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1128257367},{"type":"v1","addr":"172.21.15.193:6825","nonce":1128257367}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34314,"name":"cephfs.smithi170.rzbrux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/2819765606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2819765606},{"type":"v1","addr":"172.21.15.170:6827","nonce":2819765606}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":16,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:38:15.784227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-04T16:56:02.232 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 18 2024-09-04T16:56:02.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.233+0000 7fd346a8e640 1 -- 172.21.15.170:0/1219868853 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd32c079e30 msgr2=0x7fd32c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:02.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.233+0000 7fd346a8e640 1 --2- 172.21.15.170:0/1219868853 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd32c079e30 0x7fd32c07c2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd340199060 tx=0x7fd328031400 comp rx=0 tx=0).stop 2024-09-04T16:56:02.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.233+0000 7fd346a8e640 1 -- 172.21.15.170:0/1219868853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd340101930 msgr2=0x7fd34019d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:02.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.233+0000 7fd346a8e640 1 --2- 172.21.15.170:0/1219868853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd340101930 0x7fd34019d6b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd33000ba50 tx=0x7fd33000bf10 comp rx=0 tx=0).stop 2024-09-04T16:56:02.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.233+0000 7fd346a8e640 1 -- 172.21.15.170:0/1219868853 shutdown_connections 2024-09-04T16:56:02.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.233+0000 7fd346a8e640 1 --2- 172.21.15.170:0/1219868853 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd32c079e30 0x7fd32c07c2f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:02.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.233+0000 7fd346a8e640 1 --2- 172.21.15.170:0/1219868853 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd340107930 0x7fd34019dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:02.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.233+0000 7fd346a8e640 1 --2- 172.21.15.170:0/1219868853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd340101930 0x7fd34019d6b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:02.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.233+0000 7fd346a8e640 1 -- 172.21.15.170:0/1219868853 >> 172.21.15.170:0/1219868853 conn(0x7fd3400fd630 msgr2=0x7fd3400fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:02.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.233+0000 7fd346a8e640 1 -- 172.21.15.170:0/1219868853 shutdown_connections 2024-09-04T16:56:02.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:02.233+0000 7fd346a8e640 1 -- 172.21.15.170:0/1219868853 wait complete. 2024-09-04T16:56:02.794 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:02 smithi170 ceph-mon[113855]: pgmap v791: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:02.794 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:02 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1219868853' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-04T16:56:02.823 DEBUG:tasks.fs:max_mds not reduced in epoch 18 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-04T16:56:02.823 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 19 2024-09-04T16:56:02.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:02 smithi193 ceph-mon[82547]: pgmap v791: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:02.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:02 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1219868853' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-04T16:56:03.073 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:03.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.579+0000 7f3503c67640 1 -- 172.21.15.170:0/2230370876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34fc107910 msgr2=0x7f34fc107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:03.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.579+0000 7f3503c67640 1 --2- 172.21.15.170:0/2230370876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34fc107910 0x7f34fc107cf0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009880 tx=0x7f34f802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:56:03.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.580+0000 7f3503c67640 1 -- 172.21.15.170:0/2230370876 shutdown_connections 2024-09-04T16:56:03.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.580+0000 7f3503c67640 1 --2- 172.21.15.170:0/2230370876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34fc101910 0x7f34fc101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:03.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.580+0000 7f3503c67640 1 --2- 172.21.15.170:0/2230370876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34fc107910 0x7f34fc107cf0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:03.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.580+0000 7f3503c67640 1 -- 172.21.15.170:0/2230370876 >> 172.21.15.170:0/2230370876 conn(0x7f34fc0fd630 msgr2=0x7f34fc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:03.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.580+0000 7f3503c67640 1 -- 172.21.15.170:0/2230370876 shutdown_connections 2024-09-04T16:56:03.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.580+0000 7f3503c67640 1 -- 172.21.15.170:0/2230370876 wait complete. 2024-09-04T16:56:03.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.580+0000 7f3503c67640 1 Processor -- start 2024-09-04T16:56:03.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.580+0000 7f3503c67640 1 -- start start 2024-09-04T16:56:03.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f3503c67640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34fc101910 0x7f34fc19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:03.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f3503c67640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34fc107910 0x7f34fc19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:03.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f3503c67640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc10ede0 con 0x7f34fc101910 2024-09-04T16:56:03.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f3503c67640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc10ec60 con 0x7f34fc107910 2024-09-04T16:56:03.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f3501a03640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34fc101910 0x7f34fc19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:03.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f3501a03640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34fc101910 0x7f34fc19d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41712/0 (socket says 172.21.15.170:41712) 2024-09-04T16:56:03.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f3501a03640 1 -- 172.21.15.170:0/2378515397 learned_addr learned my addr 172.21.15.170:0/2378515397 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:03.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f3501202640 1 --2- 172.21.15.170:0/2378515397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34fc107910 0x7f34fc19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:03.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f3501a03640 1 -- 172.21.15.170:0/2378515397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34fc107910 msgr2=0x7f34fc19db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:03.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f3501a03640 1 --2- 172.21.15.170:0/2378515397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34fc107910 0x7f34fc19db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:03.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f3501a03640 1 -- 172.21.15.170:0/2378515397 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34fc1977d0 con 0x7f34fc101910 2024-09-04T16:56:03.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f3501a03640 1 --2- 172.21.15.170:0/2378515397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34fc101910 0x7f34fc19d650 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f34f8031460 tx=0x7f34f80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:03.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f34f2ffd640 1 -- 172.21.15.170:0/2378515397 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34f803f070 con 0x7f34fc101910 2024-09-04T16:56:03.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f3503c67640 1 -- 172.21.15.170:0/2378515397 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34fc197a60 con 0x7f34fc101910 2024-09-04T16:56:03.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f34f2ffd640 1 -- 172.21.15.170:0/2378515397 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f34f8004b10 con 0x7f34fc101910 2024-09-04T16:56:03.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f34f2ffd640 1 -- 172.21.15.170:0/2378515397 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34f8035030 con 0x7f34fc101910 2024-09-04T16:56:03.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.581+0000 7f3503c67640 1 -- 172.21.15.170:0/2378515397 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34fc197f90 con 0x7f34fc101910 2024-09-04T16:56:03.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.583+0000 7f3503c67640 1 -- 172.21.15.170:0/2378515397 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34fc103050 con 0x7f34fc101910 2024-09-04T16:56:03.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.583+0000 7f34f2ffd640 1 -- 172.21.15.170:0/2378515397 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f34f8042070 con 0x7f34fc101910 2024-09-04T16:56:03.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.584+0000 7f34f2ffd640 1 --2- 172.21.15.170:0/2378515397 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34e8079e40 0x7f34e807c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:03.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.584+0000 7f34f2ffd640 1 -- 172.21.15.170:0/2378515397 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f34f80bd610 con 0x7f34fc101910 2024-09-04T16:56:03.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.584+0000 7f3501202640 1 --2- 172.21.15.170:0/2378515397 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34e8079e40 0x7f34e807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:03.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.584+0000 7f3501202640 1 --2- 172.21.15.170:0/2378515397 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34e8079e40 0x7f34e807c300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f34ec005fd0 tx=0x7f34ec005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:03.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.588+0000 7f34f2ffd640 1 -- 172.21.15.170:0/2378515397 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f34f8085020 con 0x7f34fc101910 2024-09-04T16:56:03.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.796+0000 7f3503c67640 1 -- 172.21.15.170:0/2378515397 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) -- 0x7f34fc109e80 con 0x7f34fc101910 2024-09-04T16:56:03.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.797+0000 7f34f2ffd640 1 -- 172.21.15.170:0/2378515397 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v33) ==== 107+0+5310 (secure 0 0 0) 0x7f34f8089190 con 0x7f34fc101910 2024-09-04T16:56:03.800 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:56:03.800 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":19,"btime":"2024-09-04T16:38:24:820923+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24315,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.193:6827/288890560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":288890560},{"type":"v1","addr":"172.21.15.193:6827","nonce":288890560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":24319,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1128257367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1128257367},{"type":"v1","addr":"172.21.15.193:6825","nonce":1128257367}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34314,"name":"cephfs.smithi170.rzbrux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/2819765606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2819765606},{"type":"v1","addr":"172.21.15.170:6827","nonce":2819765606}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34324,"name":"cephfs.smithi170.zkhdil","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6829/1635879781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1635879781},{"type":"v1","addr":"172.21.15.170:6829","nonce":1635879781}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":16,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:38:15.784227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-04T16:56:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 19 2024-09-04T16:56:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.800+0000 7f3503c67640 1 -- 172.21.15.170:0/2378515397 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34e8079e40 msgr2=0x7f34e807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.800+0000 7f3503c67640 1 --2- 172.21.15.170:0/2378515397 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34e8079e40 0x7f34e807c300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f34ec005fd0 tx=0x7f34ec005850 comp rx=0 tx=0).stop 2024-09-04T16:56:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.800+0000 7f3503c67640 1 -- 172.21.15.170:0/2378515397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34fc101910 msgr2=0x7f34fc19d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.800+0000 7f3503c67640 1 --2- 172.21.15.170:0/2378515397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34fc101910 0x7f34fc19d650 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f34f8031460 tx=0x7f34f80045e0 comp rx=0 tx=0).stop 2024-09-04T16:56:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.800+0000 7f3503c67640 1 -- 172.21.15.170:0/2378515397 shutdown_connections 2024-09-04T16:56:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.800+0000 7f3503c67640 1 --2- 172.21.15.170:0/2378515397 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34e8079e40 0x7f34e807c300 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.800+0000 7f3503c67640 1 --2- 172.21.15.170:0/2378515397 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34fc107910 0x7f34fc19db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.800+0000 7f3503c67640 1 --2- 172.21.15.170:0/2378515397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34fc101910 0x7f34fc19d650 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.800+0000 7f3503c67640 1 -- 172.21.15.170:0/2378515397 >> 172.21.15.170:0/2378515397 conn(0x7f34fc0fd630 msgr2=0x7f34fc0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.800+0000 7f3503c67640 1 -- 172.21.15.170:0/2378515397 shutdown_connections 2024-09-04T16:56:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:03.800+0000 7f3503c67640 1 -- 172.21.15.170:0/2378515397 wait complete. 2024-09-04T16:56:04.694 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:04 smithi170 ceph-mon[113855]: pgmap v792: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:04.695 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:04 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2378515397' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-04T16:56:04.721 DEBUG:tasks.fs:max_mds not reduced in epoch 19 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-04T16:56:04.722 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 20 2024-09-04T16:56:04.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:04 smithi193 ceph-mon[82547]: pgmap v792: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:04.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:04 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2378515397' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-04T16:56:04.969 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:05.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.465+0000 7f8685c20640 1 -- 172.21.15.170:0/1795606025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86801067e0 msgr2=0x7f8680106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:05.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.465+0000 7f8685c20640 1 --2- 172.21.15.170:0/1795606025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86801067e0 0x7f8680106bc0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8670009880 tx=0x7f867002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:56:05.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.465+0000 7f8685c20640 1 -- 172.21.15.170:0/1795606025 shutdown_connections 2024-09-04T16:56:05.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.465+0000 7f8685c20640 1 --2- 172.21.15.170:0/1795606025 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86801007e0 0x7f8680100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:05.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.465+0000 7f8685c20640 1 --2- 172.21.15.170:0/1795606025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86801067e0 0x7f8680106bc0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:05.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.465+0000 7f8685c20640 1 -- 172.21.15.170:0/1795606025 >> 172.21.15.170:0/1795606025 conn(0x7f86800fc4c0 msgr2=0x7f86800fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:05.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.465+0000 7f8685c20640 1 -- 172.21.15.170:0/1795606025 shutdown_connections 2024-09-04T16:56:05.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.465+0000 7f8685c20640 1 -- 172.21.15.170:0/1795606025 wait complete. 2024-09-04T16:56:05.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.466+0000 7f8685c20640 1 Processor -- start 2024-09-04T16:56:05.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.466+0000 7f8685c20640 1 -- start start 2024-09-04T16:56:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.466+0000 7f8685c20640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86801007e0 0x7f868019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.466+0000 7f8685c20640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86801067e0 0x7f868019cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.466+0000 7f8685c20640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f868010dcb0 con 0x7f86801067e0 2024-09-04T16:56:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.466+0000 7f8685c20640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f868010db30 con 0x7f86801007e0 2024-09-04T16:56:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.466+0000 7f8676ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86801067e0 0x7f868019cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.466+0000 7f8676ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86801067e0 0x7f868019cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60648/0 (socket says 172.21.15.170:60648) 2024-09-04T16:56:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.466+0000 7f8676ffd640 1 -- 172.21.15.170:0/1549169058 learned_addr learned my addr 172.21.15.170:0/1549169058 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.466+0000 7f867f7fe640 1 --2- 172.21.15.170:0/1549169058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86801007e0 0x7f868019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.467+0000 7f8676ffd640 1 -- 172.21.15.170:0/1549169058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86801007e0 msgr2=0x7f868019c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.467+0000 7f8676ffd640 1 --2- 172.21.15.170:0/1549169058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86801007e0 0x7f868019c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.467+0000 7f8676ffd640 1 -- 172.21.15.170:0/1549169058 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86801966e0 con 0x7f86801067e0 2024-09-04T16:56:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.467+0000 7f867f7fe640 1 --2- 172.21.15.170:0/1549169058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86801007e0 0x7f868019c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:56:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.467+0000 7f8676ffd640 1 --2- 172.21.15.170:0/1549169058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86801067e0 0x7f868019cb50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f866800d6f0 tx=0x7f866800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.467+0000 7f867d7fa640 1 -- 172.21.15.170:0/1549169058 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8668017070 con 0x7f86801067e0 2024-09-04T16:56:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.467+0000 7f867d7fa640 1 -- 172.21.15.170:0/1549169058 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f866800de00 con 0x7f86801067e0 2024-09-04T16:56:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.467+0000 7f8685c20640 1 -- 172.21.15.170:0/1549169058 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86801969d0 con 0x7f86801067e0 2024-09-04T16:56:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.467+0000 7f867d7fa640 1 -- 172.21.15.170:0/1549169058 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8668004bb0 con 0x7f86801067e0 2024-09-04T16:56:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.467+0000 7f8685c20640 1 -- 172.21.15.170:0/1549169058 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8680196f30 con 0x7f86801067e0 2024-09-04T16:56:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.468+0000 7f8685c20640 1 -- 172.21.15.170:0/1549169058 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8680101f20 con 0x7f86801067e0 2024-09-04T16:56:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.469+0000 7f867d7fa640 1 -- 172.21.15.170:0/1549169058 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f8668009a30 con 0x7f86801067e0 2024-09-04T16:56:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.469+0000 7f867d7fa640 1 --2- 172.21.15.170:0/1549169058 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f866c079e30 0x7f866c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.470+0000 7f867f7fe640 1 --2- 172.21.15.170:0/1549169058 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f866c079e30 0x7f866c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.470+0000 7f867d7fa640 1 -- 172.21.15.170:0/1549169058 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f866809c730 con 0x7f86801067e0 2024-09-04T16:56:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.470+0000 7f867f7fe640 1 --2- 172.21.15.170:0/1549169058 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f866c079e30 0x7f866c07c2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8670000c00 tx=0x7f8670031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:05.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.474+0000 7f867d7fa640 1 -- 172.21.15.170:0/1549169058 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8668064140 con 0x7f86801067e0 2024-09-04T16:56:05.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.680+0000 7f8685c20640 1 -- 172.21.15.170:0/1549169058 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) -- 0x7f8680108d50 con 0x7f86801067e0 2024-09-04T16:56:05.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.680+0000 7f867d7fa640 1 -- 172.21.15.170:0/1549169058 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v33) ==== 107+0+4460 (secure 0 0 0) 0x7f86680682b0 con 0x7f86801067e0 2024-09-04T16:56:05.681 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:56:05.681 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":20,"btime":"2024-09-04T16:38:37:847015+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24315,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.193:6827/288890560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":288890560},{"type":"v1","addr":"172.21.15.193:6827","nonce":288890560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":24319,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1128257367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1128257367},{"type":"v1","addr":"172.21.15.193:6825","nonce":1128257367}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34324,"name":"cephfs.smithi170.zkhdil","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6829/1635879781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1635879781},{"type":"v1","addr":"172.21.15.170:6829","nonce":1635879781}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":16,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:38:15.784227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-04T16:56:05.681 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 20 2024-09-04T16:56:05.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.682+0000 7f8685c20640 1 -- 172.21.15.170:0/1549169058 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f866c079e30 msgr2=0x7f866c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:05.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.682+0000 7f8685c20640 1 --2- 172.21.15.170:0/1549169058 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f866c079e30 0x7f866c07c2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8670000c00 tx=0x7f8670031400 comp rx=0 tx=0).stop 2024-09-04T16:56:05.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.682+0000 7f8685c20640 1 -- 172.21.15.170:0/1549169058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86801067e0 msgr2=0x7f868019cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:05.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.682+0000 7f8685c20640 1 --2- 172.21.15.170:0/1549169058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86801067e0 0x7f868019cb50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f866800d6f0 tx=0x7f866800dbb0 comp rx=0 tx=0).stop 2024-09-04T16:56:05.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.683+0000 7f8685c20640 1 -- 172.21.15.170:0/1549169058 shutdown_connections 2024-09-04T16:56:05.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.683+0000 7f8685c20640 1 --2- 172.21.15.170:0/1549169058 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f866c079e30 0x7f866c07c2f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:05.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.683+0000 7f8685c20640 1 --2- 172.21.15.170:0/1549169058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86801067e0 0x7f868019cb50 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:05.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.683+0000 7f8685c20640 1 --2- 172.21.15.170:0/1549169058 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86801007e0 0x7f868019c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:05.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.683+0000 7f8685c20640 1 -- 172.21.15.170:0/1549169058 >> 172.21.15.170:0/1549169058 conn(0x7f86800fc4c0 msgr2=0x7f86800fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:05.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.683+0000 7f8685c20640 1 -- 172.21.15.170:0/1549169058 shutdown_connections 2024-09-04T16:56:05.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:05.683+0000 7f8685c20640 1 -- 172.21.15.170:0/1549169058 wait complete. 2024-09-04T16:56:06.380 DEBUG:tasks.fs:max_mds not reduced in epoch 20 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-04T16:56:06.381 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 21 2024-09-04T16:56:06.630 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:06.751 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:06 smithi170 ceph-mon[113855]: pgmap v793: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:06.751 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:06 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1549169058' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-04T16:56:06.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:06 smithi193 ceph-mon[82547]: pgmap v793: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:06.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:06 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1549169058' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-04T16:56:07.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.127+0000 7f67a4b9d640 1 -- 172.21.15.170:0/3234983866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67a01007e0 msgr2=0x7f67a0100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:07.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.127+0000 7f67a4b9d640 1 --2- 172.21.15.170:0/3234983866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67a01007e0 0x7f67a0100c40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6794009880 tx=0x7f679402a4a0 comp rx=0 tx=0).stop 2024-09-04T16:56:07.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.127+0000 7f67a4b9d640 1 -- 172.21.15.170:0/3234983866 shutdown_connections 2024-09-04T16:56:07.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.127+0000 7f67a4b9d640 1 --2- 172.21.15.170:0/3234983866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67a01007e0 0x7f67a0100c40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:07.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.127+0000 7f67a4b9d640 1 --2- 172.21.15.170:0/3234983866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67a01067e0 0x7f67a0106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:07.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.127+0000 7f67a4b9d640 1 -- 172.21.15.170:0/3234983866 >> 172.21.15.170:0/3234983866 conn(0x7f67a00fc4c0 msgr2=0x7f67a00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:07.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.127+0000 7f67a4b9d640 1 -- 172.21.15.170:0/3234983866 shutdown_connections 2024-09-04T16:56:07.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.127+0000 7f67a4b9d640 1 -- 172.21.15.170:0/3234983866 wait complete. 2024-09-04T16:56:07.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.128+0000 7f67a4b9d640 1 Processor -- start 2024-09-04T16:56:07.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.128+0000 7f67a4b9d640 1 -- start start 2024-09-04T16:56:07.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.128+0000 7f67a4b9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67a01007e0 0x7f67a00fcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:07.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.128+0000 7f67a4b9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67a01067e0 0x7f67a00fd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:07.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.128+0000 7f67a4b9d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f67a010dc90 con 0x7f67a01007e0 2024-09-04T16:56:07.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.128+0000 7f67a4b9d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f67a010db10 con 0x7f67a01067e0 2024-09-04T16:56:07.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.128+0000 7f679e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67a01007e0 0x7f67a00fcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:07.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.128+0000 7f679e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67a01007e0 0x7f67a00fcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60680/0 (socket says 172.21.15.170:60680) 2024-09-04T16:56:07.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.128+0000 7f679e59c640 1 -- 172.21.15.170:0/2786146001 learned_addr learned my addr 172.21.15.170:0/2786146001 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:07.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.128+0000 7f679dd9b640 1 --2- 172.21.15.170:0/2786146001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67a01067e0 0x7f67a00fd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:07.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.128+0000 7f679e59c640 1 -- 172.21.15.170:0/2786146001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67a01067e0 msgr2=0x7f67a00fd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:07.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.128+0000 7f679e59c640 1 --2- 172.21.15.170:0/2786146001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67a01067e0 0x7f67a00fd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:07.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.128+0000 7f679e59c640 1 -- 172.21.15.170:0/2786146001 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a00fd6f0 con 0x7f67a01007e0 2024-09-04T16:56:07.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.128+0000 7f679dd9b640 1 --2- 172.21.15.170:0/2786146001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67a01067e0 0x7f67a00fd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:56:07.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.129+0000 7f679e59c640 1 --2- 172.21.15.170:0/2786146001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67a01007e0 0x7f67a00fcc70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f679000c810 tx=0x7f679000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:07.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.129+0000 7f678f7fe640 1 -- 172.21.15.170:0/2786146001 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6790004020 con 0x7f67a01007e0 2024-09-04T16:56:07.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.129+0000 7f678f7fe640 1 -- 172.21.15.170:0/2786146001 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f67900041c0 con 0x7f67a01007e0 2024-09-04T16:56:07.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.129+0000 7f67a4b9d640 1 -- 172.21.15.170:0/2786146001 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a00fd9e0 con 0x7f67a01007e0 2024-09-04T16:56:07.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.129+0000 7f678f7fe640 1 -- 172.21.15.170:0/2786146001 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67900047a0 con 0x7f67a01007e0 2024-09-04T16:56:07.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.129+0000 7f67a4b9d640 1 -- 172.21.15.170:0/2786146001 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a01a3e20 con 0x7f67a01007e0 2024-09-04T16:56:07.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.130+0000 7f67a4b9d640 1 -- 172.21.15.170:0/2786146001 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a0101f20 con 0x7f67a01007e0 2024-09-04T16:56:07.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.131+0000 7f678f7fe640 1 -- 172.21.15.170:0/2786146001 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f67900079b0 con 0x7f67a01007e0 2024-09-04T16:56:07.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.131+0000 7f678f7fe640 1 --2- 172.21.15.170:0/2786146001 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6788079e40 0x7f678807c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:07.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.131+0000 7f679dd9b640 1 --2- 172.21.15.170:0/2786146001 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6788079e40 0x7f678807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:07.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.131+0000 7f678f7fe640 1 -- 172.21.15.170:0/2786146001 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f679009c9c0 con 0x7f67a01007e0 2024-09-04T16:56:07.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.132+0000 7f679dd9b640 1 --2- 172.21.15.170:0/2786146001 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6788079e40 0x7f678807c300 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f67a00fe700 tx=0x7f6794031420 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:07.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.136+0000 7f678f7fe640 1 -- 172.21.15.170:0/2786146001 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6790014030 con 0x7f67a01007e0 2024-09-04T16:56:07.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.343+0000 7f67a4b9d640 1 -- 172.21.15.170:0/2786146001 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) -- 0x7f67a0100c40 con 0x7f67a01007e0 2024-09-04T16:56:07.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.344+0000 7f678f7fe640 1 -- 172.21.15.170:0/2786146001 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v33) ==== 107+0+5307 (secure 0 0 0) 0x7f67900643d0 con 0x7f67a01007e0 2024-09-04T16:56:07.345 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:56:07.345 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":21,"btime":"2024-09-04T16:38:41:504522+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24315,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.193:6827/288890560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":288890560},{"type":"v1","addr":"172.21.15.193:6827","nonce":288890560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":24319,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1128257367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1128257367},{"type":"v1","addr":"172.21.15.193:6825","nonce":1128257367}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34324,"name":"cephfs.smithi170.zkhdil","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6829/1635879781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1635879781},{"type":"v1","addr":"172.21.15.170:6829","nonce":1635879781}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34356,"name":"cephfs.smithi170.rzbrux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/455916915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":455916915},{"type":"v1","addr":"172.21.15.170:6827","nonce":455916915}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":16,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:38:15.784227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-04T16:56:07.345 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 21 2024-09-04T16:56:07.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.346+0000 7f67a4b9d640 1 -- 172.21.15.170:0/2786146001 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6788079e40 msgr2=0x7f678807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:07.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.346+0000 7f67a4b9d640 1 --2- 172.21.15.170:0/2786146001 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6788079e40 0x7f678807c300 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f67a00fe700 tx=0x7f6794031420 comp rx=0 tx=0).stop 2024-09-04T16:56:07.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.346+0000 7f67a4b9d640 1 -- 172.21.15.170:0/2786146001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67a01007e0 msgr2=0x7f67a00fcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:07.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.346+0000 7f67a4b9d640 1 --2- 172.21.15.170:0/2786146001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67a01007e0 0x7f67a00fcc70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f679000c810 tx=0x7f679000ccd0 comp rx=0 tx=0).stop 2024-09-04T16:56:07.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.346+0000 7f67a4b9d640 1 -- 172.21.15.170:0/2786146001 shutdown_connections 2024-09-04T16:56:07.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.346+0000 7f67a4b9d640 1 --2- 172.21.15.170:0/2786146001 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f6788079e40 0x7f678807c300 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:07.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.346+0000 7f67a4b9d640 1 --2- 172.21.15.170:0/2786146001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67a01067e0 0x7f67a00fd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:07.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.346+0000 7f67a4b9d640 1 --2- 172.21.15.170:0/2786146001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67a01007e0 0x7f67a00fcc70 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:07.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.346+0000 7f67a4b9d640 1 -- 172.21.15.170:0/2786146001 >> 172.21.15.170:0/2786146001 conn(0x7f67a00fc4c0 msgr2=0x7f67a0069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:07.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.347+0000 7f67a4b9d640 1 -- 172.21.15.170:0/2786146001 shutdown_connections 2024-09-04T16:56:07.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:07.347+0000 7f67a4b9d640 1 -- 172.21.15.170:0/2786146001 wait complete. 2024-09-04T16:56:07.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:07 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2786146001' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-04T16:56:07.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:07 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2786146001' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-04T16:56:07.982 DEBUG:tasks.fs:max_mds not reduced in epoch 21 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-04T16:56:07.982 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 22 2024-09-04T16:56:08.239 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:08.614 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:08 smithi170 ceph-mon[113855]: pgmap v794: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:08.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.771+0000 7f5c63a38640 1 -- 172.21.15.170:0/671419730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c5c1033f0 msgr2=0x7f5c5c10b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:08.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.771+0000 7f5c63a38640 1 --2- 172.21.15.170:0/671419730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c5c1033f0 0x7f5c5c10b8e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5c50009880 tx=0x7f5c5002a530 comp rx=0 tx=0).stop 2024-09-04T16:56:08.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.771+0000 7f5c63a38640 1 -- 172.21.15.170:0/671419730 shutdown_connections 2024-09-04T16:56:08.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.771+0000 7f5c63a38640 1 --2- 172.21.15.170:0/671419730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c5c1033f0 0x7f5c5c10b8e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:08.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.771+0000 7f5c63a38640 1 --2- 172.21.15.170:0/671419730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c5c102ad0 0x7f5c5c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:08.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.771+0000 7f5c63a38640 1 -- 172.21.15.170:0/671419730 >> 172.21.15.170:0/671419730 conn(0x7f5c5c0fc510 msgr2=0x7f5c5c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:08.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.771+0000 7f5c63a38640 1 -- 172.21.15.170:0/671419730 shutdown_connections 2024-09-04T16:56:08.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.771+0000 7f5c63a38640 1 -- 172.21.15.170:0/671419730 wait complete. 2024-09-04T16:56:08.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.771+0000 7f5c63a38640 1 Processor -- start 2024-09-04T16:56:08.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.771+0000 7f5c63a38640 1 -- start start 2024-09-04T16:56:08.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.772+0000 7f5c63a38640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c5c102ad0 0x7f5c5c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:08.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.772+0000 7f5c63a38640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c5c1033f0 0x7f5c5c19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:08.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.772+0000 7f5c63a38640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c10ee00 con 0x7f5c5c1033f0 2024-09-04T16:56:08.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.772+0000 7f5c63a38640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c10ec80 con 0x7f5c5c102ad0 2024-09-04T16:56:08.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.772+0000 7f5c60fd3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c5c1033f0 0x7f5c5c19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:08.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.772+0000 7f5c60fd3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c5c1033f0 0x7f5c5c19dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60690/0 (socket says 172.21.15.170:60690) 2024-09-04T16:56:08.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.772+0000 7f5c60fd3640 1 -- 172.21.15.170:0/3418542787 learned_addr learned my addr 172.21.15.170:0/3418542787 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:08.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.772+0000 7f5c617d4640 1 --2- 172.21.15.170:0/3418542787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c5c102ad0 0x7f5c5c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:08.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.772+0000 7f5c60fd3640 1 -- 172.21.15.170:0/3418542787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c5c102ad0 msgr2=0x7f5c5c19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:08.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.772+0000 7f5c60fd3640 1 --2- 172.21.15.170:0/3418542787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c5c102ad0 0x7f5c5c19d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:08.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.772+0000 7f5c60fd3640 1 -- 172.21.15.170:0/3418542787 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5c197870 con 0x7f5c5c1033f0 2024-09-04T16:56:08.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.772+0000 7f5c60fd3640 1 --2- 172.21.15.170:0/3418542787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c5c1033f0 0x7f5c5c19dbf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5c50031460 tx=0x7f5c500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:08.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.772+0000 7f5c5a7fc640 1 -- 172.21.15.170:0/3418542787 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c5003f070 con 0x7f5c5c1033f0 2024-09-04T16:56:08.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.773+0000 7f5c5a7fc640 1 -- 172.21.15.170:0/3418542787 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c50004ac0 con 0x7f5c5c1033f0 2024-09-04T16:56:08.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.773+0000 7f5c63a38640 1 -- 172.21.15.170:0/3418542787 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c5c197b00 con 0x7f5c5c1033f0 2024-09-04T16:56:08.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.773+0000 7f5c5a7fc640 1 -- 172.21.15.170:0/3418542787 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c50035030 con 0x7f5c5c1033f0 2024-09-04T16:56:08.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.773+0000 7f5c63a38640 1 -- 172.21.15.170:0/3418542787 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c5c198030 con 0x7f5c5c1033f0 2024-09-04T16:56:08.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.774+0000 7f5c63a38640 1 -- 172.21.15.170:0/3418542787 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c5c06ac30 con 0x7f5c5c1033f0 2024-09-04T16:56:08.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.774+0000 7f5c5a7fc640 1 -- 172.21.15.170:0/3418542787 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f5c50042070 con 0x7f5c5c1033f0 2024-09-04T16:56:08.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.774+0000 7f5c5a7fc640 1 --2- 172.21.15.170:0/3418542787 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5c44079e30 0x7f5c4407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:08.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.775+0000 7f5c5a7fc640 1 -- 172.21.15.170:0/3418542787 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5c500bd3b0 con 0x7f5c5c1033f0 2024-09-04T16:56:08.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.775+0000 7f5c617d4640 1 --2- 172.21.15.170:0/3418542787 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5c44079e30 0x7f5c4407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:08.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.775+0000 7f5c617d4640 1 --2- 172.21.15.170:0/3418542787 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5c44079e30 0x7f5c4407c2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c005c40 tx=0x7f5c4c00a570 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:08.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.779+0000 7f5c5a7fc640 1 -- 172.21.15.170:0/3418542787 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5c50088f30 con 0x7f5c5c1033f0 2024-09-04T16:56:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:08 smithi193 ceph-mon[82547]: pgmap v794: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:08.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.988+0000 7f5c63a38640 1 -- 172.21.15.170:0/3418542787 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) -- 0x7f5c5c105fa0 con 0x7f5c5c1033f0 2024-09-04T16:56:08.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.989+0000 7f5c5a7fc640 1 -- 172.21.15.170:0/3418542787 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v33) ==== 107+0+4457 (secure 0 0 0) 0x7f5c5008d950 con 0x7f5c5c1033f0 2024-09-04T16:56:08.990 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:56:08.990 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":22,"btime":"2024-09-04T16:38:53:920898+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24315,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.193:6827/288890560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":288890560},{"type":"v1","addr":"172.21.15.193:6827","nonce":288890560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34324,"name":"cephfs.smithi170.zkhdil","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6829/1635879781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1635879781},{"type":"v1","addr":"172.21.15.170:6829","nonce":1635879781}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34356,"name":"cephfs.smithi170.rzbrux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/455916915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":455916915},{"type":"v1","addr":"172.21.15.170:6827","nonce":455916915}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":16,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:38:15.784227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-04T16:56:08.991 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 22 2024-09-04T16:56:08.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.991+0000 7f5c63a38640 1 -- 172.21.15.170:0/3418542787 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5c44079e30 msgr2=0x7f5c4407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:08.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.991+0000 7f5c63a38640 1 --2- 172.21.15.170:0/3418542787 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5c44079e30 0x7f5c4407c2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c005c40 tx=0x7f5c4c00a570 comp rx=0 tx=0).stop 2024-09-04T16:56:08.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.991+0000 7f5c63a38640 1 -- 172.21.15.170:0/3418542787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c5c1033f0 msgr2=0x7f5c5c19dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:08.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.991+0000 7f5c63a38640 1 --2- 172.21.15.170:0/3418542787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c5c1033f0 0x7f5c5c19dbf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5c50031460 tx=0x7f5c500046c0 comp rx=0 tx=0).stop 2024-09-04T16:56:08.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.992+0000 7f5c63a38640 1 -- 172.21.15.170:0/3418542787 shutdown_connections 2024-09-04T16:56:08.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.992+0000 7f5c63a38640 1 --2- 172.21.15.170:0/3418542787 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f5c44079e30 0x7f5c4407c2f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:08.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.992+0000 7f5c63a38640 1 --2- 172.21.15.170:0/3418542787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c5c1033f0 0x7f5c5c19dbf0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:08.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.992+0000 7f5c63a38640 1 --2- 172.21.15.170:0/3418542787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c5c102ad0 0x7f5c5c19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:08.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.992+0000 7f5c63a38640 1 -- 172.21.15.170:0/3418542787 >> 172.21.15.170:0/3418542787 conn(0x7f5c5c0fc510 msgr2=0x7f5c5c108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:08.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.992+0000 7f5c63a38640 1 -- 172.21.15.170:0/3418542787 shutdown_connections 2024-09-04T16:56:08.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:08.992+0000 7f5c63a38640 1 -- 172.21.15.170:0/3418542787 wait complete. 2024-09-04T16:56:09.589 DEBUG:tasks.fs:max_mds not reduced in epoch 22 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-04T16:56:09.589 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 23 2024-09-04T16:56:09.846 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:09.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:09 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/3418542787' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-04T16:56:09.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:09 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/3418542787' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-04T16:56:10.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.312+0000 7f40c21ec640 1 -- 172.21.15.170:0/297133728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40bc102b40 msgr2=0x7f40bc102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:10.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.312+0000 7f40c21ec640 1 --2- 172.21.15.170:0/297133728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40bc102b40 0x7f40bc102f20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009c50 tx=0x7f40ac02aa30 comp rx=0 tx=0).stop 2024-09-04T16:56:10.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.312+0000 7f40c21ec640 1 -- 172.21.15.170:0/297133728 shutdown_connections 2024-09-04T16:56:10.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.312+0000 7f40c21ec640 1 --2- 172.21.15.170:0/297133728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40bc103460 0x7f40bc10b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:10.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.312+0000 7f40c21ec640 1 --2- 172.21.15.170:0/297133728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40bc102b40 0x7f40bc102f20 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:10.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.312+0000 7f40c21ec640 1 -- 172.21.15.170:0/297133728 >> 172.21.15.170:0/297133728 conn(0x7f40bc0fc520 msgr2=0x7f40bc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:10.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.312+0000 7f40c21ec640 1 -- 172.21.15.170:0/297133728 shutdown_connections 2024-09-04T16:56:10.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.312+0000 7f40c21ec640 1 -- 172.21.15.170:0/297133728 wait complete. 2024-09-04T16:56:10.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.313+0000 7f40c21ec640 1 Processor -- start 2024-09-04T16:56:10.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.313+0000 7f40c21ec640 1 -- start start 2024-09-04T16:56:10.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.313+0000 7f40c21ec640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40bc102b40 0x7f40bc1007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:10.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.313+0000 7f40c21ec640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40bc103460 0x7f40bc100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:10.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.313+0000 7f40c21ec640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc10edf0 con 0x7f40bc102b40 2024-09-04T16:56:10.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.313+0000 7f40c21ec640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc10ec70 con 0x7f40bc103460 2024-09-04T16:56:10.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.313+0000 7f40bb7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40bc102b40 0x7f40bc1007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:10.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.313+0000 7f40bb7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40bc102b40 0x7f40bc1007a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60706/0 (socket says 172.21.15.170:60706) 2024-09-04T16:56:10.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.313+0000 7f40bb7fe640 1 -- 172.21.15.170:0/1555633174 learned_addr learned my addr 172.21.15.170:0/1555633174 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:10.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.314+0000 7f40baffd640 1 --2- 172.21.15.170:0/1555633174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40bc103460 0x7f40bc100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:10.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.314+0000 7f40bb7fe640 1 -- 172.21.15.170:0/1555633174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40bc103460 msgr2=0x7f40bc100ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:10.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.314+0000 7f40bb7fe640 1 --2- 172.21.15.170:0/1555633174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40bc103460 0x7f40bc100ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:10.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.314+0000 7f40bb7fe640 1 -- 172.21.15.170:0/1555633174 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40bc101220 con 0x7f40bc102b40 2024-09-04T16:56:10.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.314+0000 7f40bb7fe640 1 --2- 172.21.15.170:0/1555633174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40bc102b40 0x7f40bc1007a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f40ac006010 tx=0x7f40ac02ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:10.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.314+0000 7f40b8ff9640 1 -- 172.21.15.170:0/1555633174 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40ac047070 con 0x7f40bc102b40 2024-09-04T16:56:10.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.314+0000 7f40b8ff9640 1 -- 172.21.15.170:0/1555633174 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f40ac003e30 con 0x7f40bc102b40 2024-09-04T16:56:10.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.314+0000 7f40c21ec640 1 -- 172.21.15.170:0/1555633174 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40bc1014b0 con 0x7f40bc102b40 2024-09-04T16:56:10.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.314+0000 7f40b8ff9640 1 -- 172.21.15.170:0/1555633174 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40ac033050 con 0x7f40bc102b40 2024-09-04T16:56:10.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.314+0000 7f40c21ec640 1 -- 172.21.15.170:0/1555633174 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40bc1a3db0 con 0x7f40bc102b40 2024-09-04T16:56:10.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.315+0000 7f40c21ec640 1 -- 172.21.15.170:0/1555633174 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40bc06ab80 con 0x7f40bc102b40 2024-09-04T16:56:10.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.316+0000 7f40b8ff9640 1 -- 172.21.15.170:0/1555633174 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f40ac04a070 con 0x7f40bc102b40 2024-09-04T16:56:10.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.316+0000 7f40b8ff9640 1 --2- 172.21.15.170:0/1555633174 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f40a8079e30 0x7f40a807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:10.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.316+0000 7f40b8ff9640 1 -- 172.21.15.170:0/1555633174 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f40ac03e030 con 0x7f40bc102b40 2024-09-04T16:56:10.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.316+0000 7f40baffd640 1 --2- 172.21.15.170:0/1555633174 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f40a8079e30 0x7f40a807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:10.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.317+0000 7f40baffd640 1 --2- 172.21.15.170:0/1555633174 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f40a8079e30 0x7f40a807c2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f40bc102230 tx=0x7f40a400a2d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:10.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.320+0000 7f40b8ff9640 1 -- 172.21.15.170:0/1555633174 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f40ac085650 con 0x7f40bc102b40 2024-09-04T16:56:10.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.529+0000 7f40c21ec640 1 -- 172.21.15.170:0/1555633174 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) -- 0x7f40bc104f90 con 0x7f40bc102b40 2024-09-04T16:56:10.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.530+0000 7f40b8ff9640 1 -- 172.21.15.170:0/1555633174 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v33) ==== 107+0+5307 (secure 0 0 0) 0x7f40ac0897c0 con 0x7f40bc102b40 2024-09-04T16:56:10.531 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:56:10.531 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":23,"btime":"2024-09-04T16:38:57:507295+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24315,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.193:6827/288890560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":288890560},{"type":"v1","addr":"172.21.15.193:6827","nonce":288890560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34324,"name":"cephfs.smithi170.zkhdil","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6829/1635879781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1635879781},{"type":"v1","addr":"172.21.15.170:6829","nonce":1635879781}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34356,"name":"cephfs.smithi170.rzbrux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/455916915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":455916915},{"type":"v1","addr":"172.21.15.170:6827","nonce":455916915}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44313,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1344840973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1344840973},{"type":"v1","addr":"172.21.15.193:6825","nonce":1344840973}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":16,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:38:15.784227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-04T16:56:10.532 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 23 2024-09-04T16:56:10.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.533+0000 7f40c21ec640 1 -- 172.21.15.170:0/1555633174 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f40a8079e30 msgr2=0x7f40a807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:10.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.533+0000 7f40c21ec640 1 --2- 172.21.15.170:0/1555633174 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f40a8079e30 0x7f40a807c2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f40bc102230 tx=0x7f40a400a2d0 comp rx=0 tx=0).stop 2024-09-04T16:56:10.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.533+0000 7f40c21ec640 1 -- 172.21.15.170:0/1555633174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40bc102b40 msgr2=0x7f40bc1007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:10.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.533+0000 7f40c21ec640 1 --2- 172.21.15.170:0/1555633174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40bc102b40 0x7f40bc1007a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f40ac006010 tx=0x7f40ac02ed90 comp rx=0 tx=0).stop 2024-09-04T16:56:10.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.533+0000 7f40c21ec640 1 -- 172.21.15.170:0/1555633174 shutdown_connections 2024-09-04T16:56:10.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.533+0000 7f40c21ec640 1 --2- 172.21.15.170:0/1555633174 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f40a8079e30 0x7f40a807c2f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:10.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.533+0000 7f40c21ec640 1 --2- 172.21.15.170:0/1555633174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f40bc103460 0x7f40bc100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:10.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.533+0000 7f40c21ec640 1 --2- 172.21.15.170:0/1555633174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f40bc102b40 0x7f40bc1007a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:10.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.533+0000 7f40c21ec640 1 -- 172.21.15.170:0/1555633174 >> 172.21.15.170:0/1555633174 conn(0x7f40bc0fc520 msgr2=0x7f40bc107e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:10.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.533+0000 7f40c21ec640 1 -- 172.21.15.170:0/1555633174 shutdown_connections 2024-09-04T16:56:10.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:10.533+0000 7f40c21ec640 1 -- 172.21.15.170:0/1555633174 wait complete. 2024-09-04T16:56:10.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:10 smithi170 ceph-mon[113855]: pgmap v795: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:10.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:10 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1555633174' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-04T16:56:10.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:10 smithi193 ceph-mon[82547]: pgmap v795: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:10.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:10 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1555633174' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-04T16:56:11.197 DEBUG:tasks.fs:max_mds not reduced in epoch 23 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-04T16:56:11.198 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 24 2024-09-04T16:56:11.450 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:11.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.936+0000 7f4f4e6f5640 1 -- 172.21.15.170:0/3914700948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f48103400 msgr2=0x7f4f4810b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:11.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.936+0000 7f4f4e6f5640 1 --2- 172.21.15.170:0/3914700948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f48103400 0x7f4f4810b8f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009880 tx=0x7f4f3c02a530 comp rx=0 tx=0).stop 2024-09-04T16:56:11.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.936+0000 7f4f4e6f5640 1 -- 172.21.15.170:0/3914700948 shutdown_connections 2024-09-04T16:56:11.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.936+0000 7f4f4e6f5640 1 --2- 172.21.15.170:0/3914700948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f48103400 0x7f4f4810b8f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:11.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.936+0000 7f4f4e6f5640 1 --2- 172.21.15.170:0/3914700948 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f48102ae0 0x7f4f48102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:11.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.936+0000 7f4f4e6f5640 1 -- 172.21.15.170:0/3914700948 >> 172.21.15.170:0/3914700948 conn(0x7f4f480fc520 msgr2=0x7f4f480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:11.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.936+0000 7f4f4e6f5640 1 -- 172.21.15.170:0/3914700948 shutdown_connections 2024-09-04T16:56:11.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.936+0000 7f4f4e6f5640 1 -- 172.21.15.170:0/3914700948 wait complete. 2024-09-04T16:56:11.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.937+0000 7f4f4e6f5640 1 Processor -- start 2024-09-04T16:56:11.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.937+0000 7f4f4e6f5640 1 -- start start 2024-09-04T16:56:11.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.937+0000 7f4f4e6f5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f48102ae0 0x7f4f4819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.937+0000 7f4f4e6f5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f48103400 0x7f4f4819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.937+0000 7f4f4e6f5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4810ee70 con 0x7f4f48103400 2024-09-04T16:56:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.937+0000 7f4f4e6f5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4810ecf0 con 0x7f4f48102ae0 2024-09-04T16:56:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.937+0000 7f4f477fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f48103400 0x7f4f4819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.937+0000 7f4f477fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f48103400 0x7f4f4819dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60730/0 (socket says 172.21.15.170:60730) 2024-09-04T16:56:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.937+0000 7f4f477fe640 1 -- 172.21.15.170:0/45219269 learned_addr learned my addr 172.21.15.170:0/45219269 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.937+0000 7f4f477fe640 1 -- 172.21.15.170:0/45219269 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f48102ae0 msgr2=0x7f4f4819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.937+0000 7f4f477fe640 1 --2- 172.21.15.170:0/45219269 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f48102ae0 0x7f4f4819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.937+0000 7f4f477fe640 1 -- 172.21.15.170:0/45219269 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f48197880 con 0x7f4f48103400 2024-09-04T16:56:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.937+0000 7f4f477fe640 1 --2- 172.21.15.170:0/45219269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f48103400 0x7f4f4819dc00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c031460 tx=0x7f4f3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.938+0000 7f4f457fa640 1 -- 172.21.15.170:0/45219269 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f3c03f070 con 0x7f4f48103400 2024-09-04T16:56:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.938+0000 7f4f457fa640 1 -- 172.21.15.170:0/45219269 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f3c004ac0 con 0x7f4f48103400 2024-09-04T16:56:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.938+0000 7f4f4e6f5640 1 -- 172.21.15.170:0/45219269 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f48197b10 con 0x7f4f48103400 2024-09-04T16:56:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.938+0000 7f4f457fa640 1 -- 172.21.15.170:0/45219269 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f3c035030 con 0x7f4f48103400 2024-09-04T16:56:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.938+0000 7f4f4e6f5640 1 -- 172.21.15.170:0/45219269 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f48198040 con 0x7f4f48103400 2024-09-04T16:56:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.939+0000 7f4f4e6f5640 1 -- 172.21.15.170:0/45219269 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f4806abe0 con 0x7f4f48103400 2024-09-04T16:56:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.939+0000 7f4f457fa640 1 -- 172.21.15.170:0/45219269 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f4f3c042070 con 0x7f4f48103400 2024-09-04T16:56:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.940+0000 7f4f457fa640 1 --2- 172.21.15.170:0/45219269 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4f30079e30 0x7f4f3007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.940+0000 7f4f457fa640 1 -- 172.21.15.170:0/45219269 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4f3c0bd590 con 0x7f4f48103400 2024-09-04T16:56:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.940+0000 7f4f47fff640 1 --2- 172.21.15.170:0/45219269 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4f30079e30 0x7f4f3007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.940+0000 7f4f47fff640 1 --2- 172.21.15.170:0/45219269 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4f30079e30 0x7f4f3007c2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4f481989c0 tx=0x7f4f38006c90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:11.944+0000 7f4f457fa640 1 -- 172.21.15.170:0/45219269 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4f3c084fa0 con 0x7f4f48103400 2024-09-04T16:56:12.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:12.153+0000 7f4f4e6f5640 1 -- 172.21.15.170:0/45219269 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) -- 0x7f4f48198db0 con 0x7f4f48103400 2024-09-04T16:56:12.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:12.154+0000 7f4f457fa640 1 -- 172.21.15.170:0/45219269 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v33) ==== 107+0+4460 (secure 0 0 0) 0x7f4f3c089110 con 0x7f4f48103400 2024-09-04T16:56:12.154 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:56:12.155 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":24,"btime":"2024-09-04T16:39:07:298723+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34324,"name":"cephfs.smithi170.zkhdil","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6829/1635879781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1635879781},{"type":"v1","addr":"172.21.15.170:6829","nonce":1635879781}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34356,"name":"cephfs.smithi170.rzbrux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/455916915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":455916915},{"type":"v1","addr":"172.21.15.170:6827","nonce":455916915}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44313,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1344840973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1344840973},{"type":"v1","addr":"172.21.15.193:6825","nonce":1344840973}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":16,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:38:15.784227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-04T16:56:12.155 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 24 2024-09-04T16:56:12.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:12.156+0000 7f4f4e6f5640 1 -- 172.21.15.170:0/45219269 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4f30079e30 msgr2=0x7f4f3007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:12.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:12.156+0000 7f4f4e6f5640 1 --2- 172.21.15.170:0/45219269 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4f30079e30 0x7f4f3007c2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4f481989c0 tx=0x7f4f38006c90 comp rx=0 tx=0).stop 2024-09-04T16:56:12.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:12.156+0000 7f4f4e6f5640 1 -- 172.21.15.170:0/45219269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f48103400 msgr2=0x7f4f4819dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:12.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:12.156+0000 7f4f4e6f5640 1 --2- 172.21.15.170:0/45219269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f48103400 0x7f4f4819dc00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c031460 tx=0x7f4f3c0046c0 comp rx=0 tx=0).stop 2024-09-04T16:56:12.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:12.156+0000 7f4f4e6f5640 1 -- 172.21.15.170:0/45219269 shutdown_connections 2024-09-04T16:56:12.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:12.156+0000 7f4f4e6f5640 1 --2- 172.21.15.170:0/45219269 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4f30079e30 0x7f4f3007c2f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:12.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:12.156+0000 7f4f4e6f5640 1 --2- 172.21.15.170:0/45219269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f48103400 0x7f4f4819dc00 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:12.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:12.156+0000 7f4f4e6f5640 1 --2- 172.21.15.170:0/45219269 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f48102ae0 0x7f4f4819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:12.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:12.156+0000 7f4f4e6f5640 1 -- 172.21.15.170:0/45219269 >> 172.21.15.170:0/45219269 conn(0x7f4f480fc520 msgr2=0x7f4f48108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:12.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:12.156+0000 7f4f4e6f5640 1 -- 172.21.15.170:0/45219269 shutdown_connections 2024-09-04T16:56:12.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:12.156+0000 7f4f4e6f5640 1 -- 172.21.15.170:0/45219269 wait complete. 2024-09-04T16:56:12.744 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:12 smithi170 ceph-mon[113855]: pgmap v796: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:12.744 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:12 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/45219269' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-04T16:56:12.773 DEBUG:tasks.fs:max_mds not reduced in epoch 24 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-04T16:56:12.773 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 25 2024-09-04T16:56:12.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:12 smithi193 ceph-mon[82547]: pgmap v796: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:12.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:12 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/45219269' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-04T16:56:13.022 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:13.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.528+0000 7f94bdbd0640 1 -- 172.21.15.170:0/3637720031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b81007e0 msgr2=0x7f94b8100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:13.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.528+0000 7f94bdbd0640 1 --2- 172.21.15.170:0/3637720031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b81007e0 0x7f94b8100c40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009880 tx=0x7f94a002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:56:13.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.528+0000 7f94bdbd0640 1 -- 172.21.15.170:0/3637720031 shutdown_connections 2024-09-04T16:56:13.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.528+0000 7f94bdbd0640 1 --2- 172.21.15.170:0/3637720031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b81007e0 0x7f94b8100c40 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:13.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.528+0000 7f94bdbd0640 1 --2- 172.21.15.170:0/3637720031 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94b81067e0 0x7f94b8106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:13.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.528+0000 7f94bdbd0640 1 -- 172.21.15.170:0/3637720031 >> 172.21.15.170:0/3637720031 conn(0x7f94b80fc4c0 msgr2=0x7f94b80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:13.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.528+0000 7f94bdbd0640 1 -- 172.21.15.170:0/3637720031 shutdown_connections 2024-09-04T16:56:13.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.528+0000 7f94bdbd0640 1 -- 172.21.15.170:0/3637720031 wait complete. 2024-09-04T16:56:13.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.528+0000 7f94bdbd0640 1 Processor -- start 2024-09-04T16:56:13.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.528+0000 7f94bdbd0640 1 -- start start 2024-09-04T16:56:13.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.529+0000 7f94bdbd0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94b81007e0 0x7f94b81987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:13.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.529+0000 7f94bdbd0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b81067e0 0x7f94b8198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:13.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.529+0000 7f94bdbd0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f94b810dcb0 con 0x7f94b81067e0 2024-09-04T16:56:13.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.529+0000 7f94bdbd0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f94b810db30 con 0x7f94b81007e0 2024-09-04T16:56:13.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.529+0000 7f94b6ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b81067e0 0x7f94b8198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:13.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.529+0000 7f94b6ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b81067e0 0x7f94b8198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60736/0 (socket says 172.21.15.170:60736) 2024-09-04T16:56:13.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.529+0000 7f94b6ffd640 1 -- 172.21.15.170:0/1744326438 learned_addr learned my addr 172.21.15.170:0/1744326438 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:13.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.529+0000 7f94b77fe640 1 --2- 172.21.15.170:0/1744326438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94b81007e0 0x7f94b81987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:13.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.529+0000 7f94b6ffd640 1 -- 172.21.15.170:0/1744326438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94b81007e0 msgr2=0x7f94b81987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:13.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.529+0000 7f94b6ffd640 1 --2- 172.21.15.170:0/1744326438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94b81007e0 0x7f94b81987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:13.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.529+0000 7f94b6ffd640 1 -- 172.21.15.170:0/1744326438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b8199320 con 0x7f94b81067e0 2024-09-04T16:56:13.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.529+0000 7f94b6ffd640 1 --2- 172.21.15.170:0/1744326438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b81067e0 0x7f94b8198d20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f94a0031460 tx=0x7f94a0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:13.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.529+0000 7f94b4ff9640 1 -- 172.21.15.170:0/1744326438 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94a003f070 con 0x7f94b81067e0 2024-09-04T16:56:13.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.529+0000 7f94b4ff9640 1 -- 172.21.15.170:0/1744326438 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94a00035f0 con 0x7f94b81067e0 2024-09-04T16:56:13.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.529+0000 7f94bdbd0640 1 -- 172.21.15.170:0/1744326438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b81995b0 con 0x7f94b81067e0 2024-09-04T16:56:13.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.529+0000 7f94b4ff9640 1 -- 172.21.15.170:0/1744326438 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94a0035030 con 0x7f94b81067e0 2024-09-04T16:56:13.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.530+0000 7f94bdbd0640 1 -- 172.21.15.170:0/1744326438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b81a1b60 con 0x7f94b81067e0 2024-09-04T16:56:13.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.531+0000 7f94bdbd0640 1 -- 172.21.15.170:0/1744326438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b8101f20 con 0x7f94b81067e0 2024-09-04T16:56:13.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.531+0000 7f94b4ff9640 1 -- 172.21.15.170:0/1744326438 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f94a0042070 con 0x7f94b81067e0 2024-09-04T16:56:13.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.532+0000 7f94b4ff9640 1 --2- 172.21.15.170:0/1744326438 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f94a4079e30 0x7f94a407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:13.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.532+0000 7f94b4ff9640 1 -- 172.21.15.170:0/1744326438 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f94a00bd380 con 0x7f94b81067e0 2024-09-04T16:56:13.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.532+0000 7f94b77fe640 1 --2- 172.21.15.170:0/1744326438 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f94a4079e30 0x7f94a407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:13.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.532+0000 7f94b77fe640 1 --2- 172.21.15.170:0/1744326438 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f94a4079e30 0x7f94a407c2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009bd0 tx=0x7f94a8005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:13.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.536+0000 7f94b4ff9640 1 -- 172.21.15.170:0/1744326438 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f94a0088f00 con 0x7f94b81067e0 2024-09-04T16:56:13.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.747+0000 7f94bdbd0640 1 -- 172.21.15.170:0/1744326438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) -- 0x7f94b8108d50 con 0x7f94b81067e0 2024-09-04T16:56:13.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.747+0000 7f94b4ff9640 1 -- 172.21.15.170:0/1744326438 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v33) ==== 107+0+5304 (secure 0 0 0) 0x7f94a008d920 con 0x7f94b81067e0 2024-09-04T16:56:13.748 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:56:13.748 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":25,"btime":"2024-09-04T16:39:11:508921+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34324,"name":"cephfs.smithi170.zkhdil","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6829/1635879781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1635879781},{"type":"v1","addr":"172.21.15.170:6829","nonce":1635879781}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34356,"name":"cephfs.smithi170.rzbrux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/455916915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":455916915},{"type":"v1","addr":"172.21.15.170:6827","nonce":455916915}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44313,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1344840973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1344840973},{"type":"v1","addr":"172.21.15.193:6825","nonce":1344840973}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44339,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6827/45732148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":45732148},{"type":"v1","addr":"172.21.15.193:6827","nonce":45732148}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":16,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:38:15.784227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-04T16:56:13.749 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-09-04T16:56:13.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.750+0000 7f94bdbd0640 1 -- 172.21.15.170:0/1744326438 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f94a4079e30 msgr2=0x7f94a407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:13.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.750+0000 7f94bdbd0640 1 --2- 172.21.15.170:0/1744326438 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f94a4079e30 0x7f94a407c2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009bd0 tx=0x7f94a8005f90 comp rx=0 tx=0).stop 2024-09-04T16:56:13.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.750+0000 7f94bdbd0640 1 -- 172.21.15.170:0/1744326438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b81067e0 msgr2=0x7f94b8198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:13.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.750+0000 7f94bdbd0640 1 --2- 172.21.15.170:0/1744326438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b81067e0 0x7f94b8198d20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f94a0031460 tx=0x7f94a0004530 comp rx=0 tx=0).stop 2024-09-04T16:56:13.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.750+0000 7f94bdbd0640 1 -- 172.21.15.170:0/1744326438 shutdown_connections 2024-09-04T16:56:13.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.750+0000 7f94bdbd0640 1 --2- 172.21.15.170:0/1744326438 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f94a4079e30 0x7f94a407c2f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:13.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.750+0000 7f94bdbd0640 1 --2- 172.21.15.170:0/1744326438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b81067e0 0x7f94b8198d20 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:13.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.750+0000 7f94bdbd0640 1 --2- 172.21.15.170:0/1744326438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94b81007e0 0x7f94b81987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:13.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.750+0000 7f94bdbd0640 1 -- 172.21.15.170:0/1744326438 >> 172.21.15.170:0/1744326438 conn(0x7f94b80fc4c0 msgr2=0x7f94b80fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:13.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.750+0000 7f94bdbd0640 1 -- 172.21.15.170:0/1744326438 shutdown_connections 2024-09-04T16:56:13.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:13.750+0000 7f94bdbd0640 1 -- 172.21.15.170:0/1744326438 wait complete. 2024-09-04T16:56:14.455 DEBUG:tasks.fs:max_mds not reduced in epoch 25 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-04T16:56:14.455 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 26 2024-09-04T16:56:14.704 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:14.712 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:14 smithi170 ceph-mon[113855]: pgmap v797: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:14.712 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:14 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1744326438' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-04T16:56:14.712 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:56:14.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:14 smithi193 ceph-mon[82547]: pgmap v797: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:14.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:14 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1744326438' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-04T16:56:14.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:56:15.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.194+0000 7f3506ddc640 1 -- 172.21.15.170:0/3230304625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3500106820 msgr2=0x7f3500106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:15.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.194+0000 7f3506ddc640 1 --2- 172.21.15.170:0/3230304625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3500106820 0x7f3500106c00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009880 tx=0x7f34e802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:56:15.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.194+0000 7f3506ddc640 1 -- 172.21.15.170:0/3230304625 shutdown_connections 2024-09-04T16:56:15.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.194+0000 7f3506ddc640 1 --2- 172.21.15.170:0/3230304625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3500100820 0x7f3500100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:15.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.194+0000 7f3506ddc640 1 --2- 172.21.15.170:0/3230304625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3500106820 0x7f3500106c00 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:15.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.194+0000 7f3506ddc640 1 -- 172.21.15.170:0/3230304625 >> 172.21.15.170:0/3230304625 conn(0x7f35000fc520 msgr2=0x7f35000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:15.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.194+0000 7f3506ddc640 1 -- 172.21.15.170:0/3230304625 shutdown_connections 2024-09-04T16:56:15.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.194+0000 7f3506ddc640 1 -- 172.21.15.170:0/3230304625 wait complete. 2024-09-04T16:56:15.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.195+0000 7f3506ddc640 1 Processor -- start 2024-09-04T16:56:15.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.195+0000 7f3506ddc640 1 -- start start 2024-09-04T16:56:15.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.195+0000 7f3506ddc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3500100820 0x7f350019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:15.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.195+0000 7f3506ddc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3500106820 0x7f350019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:15.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.195+0000 7f3506ddc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f350010dcf0 con 0x7f3500106820 2024-09-04T16:56:15.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.195+0000 7f3506ddc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f350010db70 con 0x7f3500100820 2024-09-04T16:56:15.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.195+0000 7f34fffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3500106820 0x7f350019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:15.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.195+0000 7f34fffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3500106820 0x7f350019dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48832/0 (socket says 172.21.15.170:48832) 2024-09-04T16:56:15.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.195+0000 7f34fffff640 1 -- 172.21.15.170:0/1394946198 learned_addr learned my addr 172.21.15.170:0/1394946198 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:15.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.195+0000 7f3504b78640 1 --2- 172.21.15.170:0/1394946198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3500100820 0x7f350019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:15.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.195+0000 7f34fffff640 1 -- 172.21.15.170:0/1394946198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3500100820 msgr2=0x7f350019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:15.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.195+0000 7f34fffff640 1 --2- 172.21.15.170:0/1394946198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3500100820 0x7f350019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:15.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.195+0000 7f34fffff640 1 -- 172.21.15.170:0/1394946198 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35001977e0 con 0x7f3500106820 2024-09-04T16:56:15.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.195+0000 7f3504b78640 1 --2- 172.21.15.170:0/1394946198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3500100820 0x7f350019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:56:15.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.196+0000 7f34fffff640 1 --2- 172.21.15.170:0/1394946198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3500106820 0x7f350019dba0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f34f000c8f0 tx=0x7f34f000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:15.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.196+0000 7f34fdffb640 1 -- 172.21.15.170:0/1394946198 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34f00079b0 con 0x7f3500106820 2024-09-04T16:56:15.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.196+0000 7f3506ddc640 1 -- 172.21.15.170:0/1394946198 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3500197ad0 con 0x7f3500106820 2024-09-04T16:56:15.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.196+0000 7f34fdffb640 1 -- 172.21.15.170:0/1394946198 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f34f0007b50 con 0x7f3500106820 2024-09-04T16:56:15.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.196+0000 7f34fdffb640 1 -- 172.21.15.170:0/1394946198 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34f00185f0 con 0x7f3500106820 2024-09-04T16:56:15.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.196+0000 7f3506ddc640 1 -- 172.21.15.170:0/1394946198 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3500198060 con 0x7f3500106820 2024-09-04T16:56:15.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.197+0000 7f3506ddc640 1 -- 172.21.15.170:0/1394946198 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3500101f60 con 0x7f3500106820 2024-09-04T16:56:15.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.197+0000 7f34fdffb640 1 -- 172.21.15.170:0/1394946198 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f34f000f450 con 0x7f3500106820 2024-09-04T16:56:15.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.198+0000 7f34fdffb640 1 --2- 172.21.15.170:0/1394946198 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34ec079e30 0x7f34ec07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:15.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.198+0000 7f34fdffb640 1 -- 172.21.15.170:0/1394946198 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f34f009cd00 con 0x7f3500106820 2024-09-04T16:56:15.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.198+0000 7f3504b78640 1 --2- 172.21.15.170:0/1394946198 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34ec079e30 0x7f34ec07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:15.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.198+0000 7f3504b78640 1 --2- 172.21.15.170:0/1394946198 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34ec079e30 0x7f34ec07c2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f34e8031460 tx=0x7f34e8009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:15.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.202+0000 7f34fdffb640 1 -- 172.21.15.170:0/1394946198 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f34f0014030 con 0x7f3500106820 2024-09-04T16:56:15.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.417+0000 7f3506ddc640 1 -- 172.21.15.170:0/1394946198 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) -- 0x7f3500109da0 con 0x7f3500106820 2024-09-04T16:56:15.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.417+0000 7f34fdffb640 1 -- 172.21.15.170:0/1394946198 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v33) ==== 107+0+5303 (secure 0 0 0) 0x7f34f00646b0 con 0x7f3500106820 2024-09-04T16:56:15.418 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:56:15.418 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":26,"btime":"2024-09-04T16:54:11:926534+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34324,"name":"cephfs.smithi170.zkhdil","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6829/1635879781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1635879781},{"type":"v1","addr":"172.21.15.170:6829","nonce":1635879781}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34356,"name":"cephfs.smithi170.rzbrux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/455916915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":455916915},{"type":"v1","addr":"172.21.15.170:6827","nonce":455916915}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44313,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1344840973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1344840973},{"type":"v1","addr":"172.21.15.193:6825","nonce":1344840973}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44339,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6827/45732148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":45732148},{"type":"v1","addr":"172.21.15.193:6827","nonce":45732148}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:54:10.929504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-04T16:56:15.419 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 26 2024-09-04T16:56:15.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.420+0000 7f3506ddc640 1 -- 172.21.15.170:0/1394946198 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34ec079e30 msgr2=0x7f34ec07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:15.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.420+0000 7f3506ddc640 1 --2- 172.21.15.170:0/1394946198 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34ec079e30 0x7f34ec07c2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f34e8031460 tx=0x7f34e8009560 comp rx=0 tx=0).stop 2024-09-04T16:56:15.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.420+0000 7f3506ddc640 1 -- 172.21.15.170:0/1394946198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3500106820 msgr2=0x7f350019dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:15.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.420+0000 7f3506ddc640 1 --2- 172.21.15.170:0/1394946198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3500106820 0x7f350019dba0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f34f000c8f0 tx=0x7f34f000cdb0 comp rx=0 tx=0).stop 2024-09-04T16:56:15.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.420+0000 7f3506ddc640 1 -- 172.21.15.170:0/1394946198 shutdown_connections 2024-09-04T16:56:15.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.420+0000 7f3506ddc640 1 --2- 172.21.15.170:0/1394946198 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f34ec079e30 0x7f34ec07c2f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:15.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.420+0000 7f3506ddc640 1 --2- 172.21.15.170:0/1394946198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3500106820 0x7f350019dba0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:15.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.420+0000 7f3506ddc640 1 --2- 172.21.15.170:0/1394946198 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3500100820 0x7f350019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:15.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.420+0000 7f3506ddc640 1 -- 172.21.15.170:0/1394946198 >> 172.21.15.170:0/1394946198 conn(0x7f35000fc520 msgr2=0x7f350006a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:15.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.420+0000 7f3506ddc640 1 -- 172.21.15.170:0/1394946198 shutdown_connections 2024-09-04T16:56:15.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:15.420+0000 7f3506ddc640 1 -- 172.21.15.170:0/1394946198 wait complete. 2024-09-04T16:56:15.711 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:15 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1394946198' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-04T16:56:15.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:15 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1394946198' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-04T16:56:16.047 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 27 2024-09-04T16:56:16.295 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:16.731 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:16 smithi170 ceph-mon[113855]: pgmap v798: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:16.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.810+0000 7fa7c84be640 1 -- 172.21.15.170:0/4195853117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7c01078f0 msgr2=0x7fa7c0107cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:16.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.810+0000 7fa7c84be640 1 --2- 172.21.15.170:0/4195853117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7c01078f0 0x7fa7c0107cd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009c20 tx=0x7fa7b002a970 comp rx=0 tx=0).stop 2024-09-04T16:56:16.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.810+0000 7fa7c84be640 1 -- 172.21.15.170:0/4195853117 shutdown_connections 2024-09-04T16:56:16.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.810+0000 7fa7c84be640 1 --2- 172.21.15.170:0/4195853117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7c01018f0 0x7fa7c0101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:16.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.810+0000 7fa7c84be640 1 --2- 172.21.15.170:0/4195853117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7c01078f0 0x7fa7c0107cd0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:16.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.810+0000 7fa7c84be640 1 -- 172.21.15.170:0/4195853117 >> 172.21.15.170:0/4195853117 conn(0x7fa7c00fd630 msgr2=0x7fa7c00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:16.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.810+0000 7fa7c84be640 1 -- 172.21.15.170:0/4195853117 shutdown_connections 2024-09-04T16:56:16.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.810+0000 7fa7c84be640 1 -- 172.21.15.170:0/4195853117 wait complete. 2024-09-04T16:56:16.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.811+0000 7fa7c84be640 1 Processor -- start 2024-09-04T16:56:16.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.811+0000 7fa7c84be640 1 -- start start 2024-09-04T16:56:16.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.811+0000 7fa7c84be640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7c01018f0 0x7fa7c019f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:16.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.811+0000 7fa7c84be640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7c01078f0 0x7fa7c019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:16.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.811+0000 7fa7c84be640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c010eda0 con 0x7fa7c01078f0 2024-09-04T16:56:16.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.811+0000 7fa7c84be640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c010ec20 con 0x7fa7c01018f0 2024-09-04T16:56:16.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.811+0000 7fa7c5a59640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7c01078f0 0x7fa7c019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:16.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.811+0000 7fa7c5a59640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7c01078f0 0x7fa7c019fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48856/0 (socket says 172.21.15.170:48856) 2024-09-04T16:56:16.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.811+0000 7fa7c5a59640 1 -- 172.21.15.170:0/2334322203 learned_addr learned my addr 172.21.15.170:0/2334322203 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:16.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.811+0000 7fa7c625a640 1 --2- 172.21.15.170:0/2334322203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7c01018f0 0x7fa7c019f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:16.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.812+0000 7fa7c5a59640 1 -- 172.21.15.170:0/2334322203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7c01018f0 msgr2=0x7fa7c019f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:16.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.812+0000 7fa7c5a59640 1 --2- 172.21.15.170:0/2334322203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7c01018f0 0x7fa7c019f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:16.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.812+0000 7fa7c5a59640 1 -- 172.21.15.170:0/2334322203 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c0199a00 con 0x7fa7c01078f0 2024-09-04T16:56:16.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.812+0000 7fa7c625a640 1 --2- 172.21.15.170:0/2334322203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7c01018f0 0x7fa7c019f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-04T16:56:16.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.812+0000 7fa7c5a59640 1 --2- 172.21.15.170:0/2334322203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7c01078f0 0x7fa7c019fd80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400d8d0 tx=0x7fa7b400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:16.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.812+0000 7fa7bf7fe640 1 -- 172.21.15.170:0/2334322203 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7b4017070 con 0x7fa7c01078f0 2024-09-04T16:56:16.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.812+0000 7fa7bf7fe640 1 -- 172.21.15.170:0/2334322203 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa7b4010460 con 0x7fa7c01078f0 2024-09-04T16:56:16.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.812+0000 7fa7c84be640 1 -- 172.21.15.170:0/2334322203 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c0199cf0 con 0x7fa7c01078f0 2024-09-04T16:56:16.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.812+0000 7fa7bf7fe640 1 -- 172.21.15.170:0/2334322203 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7b400f5f0 con 0x7fa7c01078f0 2024-09-04T16:56:16.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.812+0000 7fa7c84be640 1 -- 172.21.15.170:0/2334322203 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c019a280 con 0x7fa7c01078f0 2024-09-04T16:56:16.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.813+0000 7fa7c84be640 1 -- 172.21.15.170:0/2334322203 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c0103030 con 0x7fa7c01078f0 2024-09-04T16:56:16.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.814+0000 7fa7bf7fe640 1 -- 172.21.15.170:0/2334322203 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fa7b4009a30 con 0x7fa7c01078f0 2024-09-04T16:56:16.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.814+0000 7fa7bf7fe640 1 --2- 172.21.15.170:0/2334322203 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa7a8079e40 0x7fa7a807c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:16.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.814+0000 7fa7bf7fe640 1 -- 172.21.15.170:0/2334322203 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa7b409c990 con 0x7fa7c01078f0 2024-09-04T16:56:16.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.814+0000 7fa7c625a640 1 --2- 172.21.15.170:0/2334322203 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa7a8079e40 0x7fa7a807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:16.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.815+0000 7fa7c625a640 1 --2- 172.21.15.170:0/2334322203 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa7a8079e40 0x7fa7a807c300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009430 tx=0x7fa7b00093a0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:16.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:16.818+0000 7fa7bf7fe640 1 -- 172.21.15.170:0/2334322203 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa7b40643a0 con 0x7fa7c01078f0 2024-09-04T16:56:16.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:16 smithi193 ceph-mon[82547]: pgmap v798: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:17.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:17.029+0000 7fa7c84be640 1 -- 172.21.15.170:0/2334322203 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) -- 0x7fa7c019af30 con 0x7fa7c01078f0 2024-09-04T16:56:17.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:17.029+0000 7fa7bf7fe640 1 -- 172.21.15.170:0/2334322203 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v33) ==== 107+0+5326 (secure 0 0 0) 0x7fa7b4068510 con 0x7fa7c01078f0 2024-09-04T16:56:17.031 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:56:17.031 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":27,"btime":"2024-09-04T16:54:11:931539+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44313,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1344840973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1344840973},{"type":"v1","addr":"172.21.15.193:6825","nonce":1344840973}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44339,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6827/45732148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":45732148},{"type":"v1","addr":"172.21.15.193:6827","nonce":45732148}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:54:11.931522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34324,"mds_1":34356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34324":{"gid":34324,"name":"cephfs.smithi170.zkhdil","rank":0,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.170:6829/1635879781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1635879781},{"type":"v1","addr":"172.21.15.170:6829","nonce":1635879781}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34356":{"gid":34356,"name":"cephfs.smithi170.rzbrux","rank":1,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.170:6827/455916915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":455916915},{"type":"v1","addr":"172.21.15.170:6827","nonce":455916915}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-04T16:56:17.031 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 27 2024-09-04T16:56:17.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:17.032+0000 7fa7c84be640 1 -- 172.21.15.170:0/2334322203 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa7a8079e40 msgr2=0x7fa7a807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:17.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:17.032+0000 7fa7c84be640 1 --2- 172.21.15.170:0/2334322203 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa7a8079e40 0x7fa7a807c300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009430 tx=0x7fa7b00093a0 comp rx=0 tx=0).stop 2024-09-04T16:56:17.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:17.032+0000 7fa7c84be640 1 -- 172.21.15.170:0/2334322203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7c01078f0 msgr2=0x7fa7c019fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:17.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:17.032+0000 7fa7c84be640 1 --2- 172.21.15.170:0/2334322203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7c01078f0 0x7fa7c019fd80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400d8d0 tx=0x7fa7b400dd90 comp rx=0 tx=0).stop 2024-09-04T16:56:17.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:17.032+0000 7fa7c84be640 1 -- 172.21.15.170:0/2334322203 shutdown_connections 2024-09-04T16:56:17.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:17.032+0000 7fa7c84be640 1 --2- 172.21.15.170:0/2334322203 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fa7a8079e40 0x7fa7a807c300 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:17.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:17.032+0000 7fa7c84be640 1 --2- 172.21.15.170:0/2334322203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7c01078f0 0x7fa7c019fd80 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:17.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:17.032+0000 7fa7c84be640 1 --2- 172.21.15.170:0/2334322203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7c01018f0 0x7fa7c019f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:17.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:17.032+0000 7fa7c84be640 1 -- 172.21.15.170:0/2334322203 >> 172.21.15.170:0/2334322203 conn(0x7fa7c00fd630 msgr2=0x7fa7c00fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:17.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:17.032+0000 7fa7c84be640 1 -- 172.21.15.170:0/2334322203 shutdown_connections 2024-09-04T16:56:17.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:17.032+0000 7fa7c84be640 1 -- 172.21.15.170:0/2334322203 wait complete. 2024-09-04T16:56:17.646 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:17 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2334322203' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-04T16:56:17.672 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 28 2024-09-04T16:56:17.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:17 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2334322203' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-04T16:56:17.925 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:18.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.444+0000 7fe8922c6640 1 -- 172.21.15.170:0/1111373701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88c106820 msgr2=0x7fe88c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:18.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.444+0000 7fe8922c6640 1 --2- 172.21.15.170:0/1111373701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88c106820 0x7fe88c106c00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe87c009880 tx=0x7fe87c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:56:18.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.444+0000 7fe8922c6640 1 -- 172.21.15.170:0/1111373701 shutdown_connections 2024-09-04T16:56:18.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.444+0000 7fe8922c6640 1 --2- 172.21.15.170:0/1111373701 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe88c100820 0x7fe88c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:18.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.444+0000 7fe8922c6640 1 --2- 172.21.15.170:0/1111373701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88c106820 0x7fe88c106c00 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:18.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.444+0000 7fe8922c6640 1 -- 172.21.15.170:0/1111373701 >> 172.21.15.170:0/1111373701 conn(0x7fe88c0fc520 msgr2=0x7fe88c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:18.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.444+0000 7fe8922c6640 1 -- 172.21.15.170:0/1111373701 shutdown_connections 2024-09-04T16:56:18.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.444+0000 7fe8922c6640 1 -- 172.21.15.170:0/1111373701 wait complete. 2024-09-04T16:56:18.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.444+0000 7fe8922c6640 1 Processor -- start 2024-09-04T16:56:18.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.444+0000 7fe8922c6640 1 -- start start 2024-09-04T16:56:18.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe8922c6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe88c100820 0x7fe88c196620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:18.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe8922c6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88c106820 0x7fe88c196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:18.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe8922c6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c10dcd0 con 0x7fe88c106820 2024-09-04T16:56:18.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe8922c6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c10db50 con 0x7fe88c100820 2024-09-04T16:56:18.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe88b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88c106820 0x7fe88c196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:18.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe88b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88c106820 0x7fe88c196b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48872/0 (socket says 172.21.15.170:48872) 2024-09-04T16:56:18.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe88b7fe640 1 -- 172.21.15.170:0/335813953 learned_addr learned my addr 172.21.15.170:0/335813953 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:18.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe88bfff640 1 --2- 172.21.15.170:0/335813953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe88c100820 0x7fe88c196620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:18.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe88b7fe640 1 -- 172.21.15.170:0/335813953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe88c100820 msgr2=0x7fe88c196620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:18.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe88b7fe640 1 --2- 172.21.15.170:0/335813953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe88c100820 0x7fe88c196620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:18.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe88b7fe640 1 -- 172.21.15.170:0/335813953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88c1970a0 con 0x7fe88c106820 2024-09-04T16:56:18.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe88b7fe640 1 --2- 172.21.15.170:0/335813953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88c106820 0x7fe88c196b60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe87400c8a0 tx=0x7fe87400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:18.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe8897fa640 1 -- 172.21.15.170:0/335813953 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe8740079b0 con 0x7fe88c106820 2024-09-04T16:56:18.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe8922c6640 1 -- 172.21.15.170:0/335813953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88c197390 con 0x7fe88c106820 2024-09-04T16:56:18.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe8897fa640 1 -- 172.21.15.170:0/335813953 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe874007b50 con 0x7fe88c106820 2024-09-04T16:56:18.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe8897fa640 1 -- 172.21.15.170:0/335813953 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe874018700 con 0x7fe88c106820 2024-09-04T16:56:18.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.445+0000 7fe8922c6640 1 -- 172.21.15.170:0/335813953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe88c1a3e60 con 0x7fe88c106820 2024-09-04T16:56:18.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.446+0000 7fe8922c6640 1 -- 172.21.15.170:0/335813953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe88c101f60 con 0x7fe88c106820 2024-09-04T16:56:18.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.447+0000 7fe8897fa640 1 -- 172.21.15.170:0/335813953 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fe874007d00 con 0x7fe88c106820 2024-09-04T16:56:18.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.447+0000 7fe8897fa640 1 --2- 172.21.15.170:0/335813953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe878079e30 0x7fe87807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:18.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.447+0000 7fe8897fa640 1 -- 172.21.15.170:0/335813953 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe87409cd70 con 0x7fe88c106820 2024-09-04T16:56:18.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.448+0000 7fe88bfff640 1 --2- 172.21.15.170:0/335813953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe878079e30 0x7fe87807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:18.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.448+0000 7fe88bfff640 1 --2- 172.21.15.170:0/335813953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe878079e30 0x7fe87807c2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe87c031460 tx=0x7fe87c005bd0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:18.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.452+0000 7fe8897fa640 1 -- 172.21.15.170:0/335813953 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe874014030 con 0x7fe88c106820 2024-09-04T16:56:18.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.663+0000 7fe8922c6640 1 -- 172.21.15.170:0/335813953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) -- 0x7fe88c100c80 con 0x7fe88c106820 2024-09-04T16:56:18.665 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:18 smithi170 ceph-mon[113855]: pgmap v799: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:18.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.664+0000 7fe8897fa640 1 -- 172.21.15.170:0/335813953 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v33) ==== 107+0+5329 (secure 0 0 0) 0x7fe874064780 con 0x7fe88c106820 2024-09-04T16:56:18.665 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:56:18.665 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":28,"btime":"2024-09-04T16:54:12:939302+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44313,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1344840973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1344840973},{"type":"v1","addr":"172.21.15.193:6825","nonce":1344840973}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44339,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6827/45732148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":45732148},{"type":"v1","addr":"172.21.15.193:6827","nonce":45732148}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:54:11.946181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34324,"mds_1":34356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34324":{"gid":34324,"name":"cephfs.smithi170.zkhdil","rank":0,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.170:6829/1635879781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1635879781},{"type":"v1","addr":"172.21.15.170:6829","nonce":1635879781}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34356":{"gid":34356,"name":"cephfs.smithi170.rzbrux","rank":1,"incarnation":27,"state":"up:resolve","state_seq":234,"addr":"172.21.15.170:6827/455916915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":455916915},{"type":"v1","addr":"172.21.15.170:6827","nonce":455916915}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-04T16:56:18.666 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 28 2024-09-04T16:56:18.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.668+0000 7fe8922c6640 1 -- 172.21.15.170:0/335813953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe878079e30 msgr2=0x7fe87807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:18.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.668+0000 7fe8922c6640 1 --2- 172.21.15.170:0/335813953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe878079e30 0x7fe87807c2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe87c031460 tx=0x7fe87c005bd0 comp rx=0 tx=0).stop 2024-09-04T16:56:18.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.668+0000 7fe8922c6640 1 -- 172.21.15.170:0/335813953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88c106820 msgr2=0x7fe88c196b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:18.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.668+0000 7fe8922c6640 1 --2- 172.21.15.170:0/335813953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88c106820 0x7fe88c196b60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe87400c8a0 tx=0x7fe87400cd60 comp rx=0 tx=0).stop 2024-09-04T16:56:18.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.668+0000 7fe8922c6640 1 -- 172.21.15.170:0/335813953 shutdown_connections 2024-09-04T16:56:18.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.668+0000 7fe8922c6640 1 --2- 172.21.15.170:0/335813953 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fe878079e30 0x7fe87807c2f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:18.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.668+0000 7fe8922c6640 1 --2- 172.21.15.170:0/335813953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88c106820 0x7fe88c196b60 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:18.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.668+0000 7fe8922c6640 1 --2- 172.21.15.170:0/335813953 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe88c100820 0x7fe88c196620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:18.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.668+0000 7fe8922c6640 1 -- 172.21.15.170:0/335813953 >> 172.21.15.170:0/335813953 conn(0x7fe88c0fc520 msgr2=0x7fe88c0fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:18.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.668+0000 7fe8922c6640 1 -- 172.21.15.170:0/335813953 shutdown_connections 2024-09-04T16:56:18.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:18.668+0000 7fe8922c6640 1 -- 172.21.15.170:0/335813953 wait complete. 2024-09-04T16:56:18.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:18 smithi193 ceph-mon[82547]: pgmap v799: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:19.282 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 29 2024-09-04T16:56:19.545 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:19.824 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:19 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/335813953' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-04T16:56:19.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:19 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/335813953' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-04T16:56:20.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.081+0000 7fc17eaaf640 1 -- 172.21.15.170:0/3715689191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1781067e0 msgr2=0x7fc178106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:20.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.081+0000 7fc17eaaf640 1 --2- 172.21.15.170:0/3715689191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1781067e0 0x7fc178106bc0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009880 tx=0x7fc16c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:56:20.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.081+0000 7fc17eaaf640 1 -- 172.21.15.170:0/3715689191 shutdown_connections 2024-09-04T16:56:20.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.081+0000 7fc17eaaf640 1 --2- 172.21.15.170:0/3715689191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1781007e0 0x7fc178100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:20.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.081+0000 7fc17eaaf640 1 --2- 172.21.15.170:0/3715689191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1781067e0 0x7fc178106bc0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:20.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.081+0000 7fc17eaaf640 1 -- 172.21.15.170:0/3715689191 >> 172.21.15.170:0/3715689191 conn(0x7fc1780fc4c0 msgr2=0x7fc1780fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:20.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.081+0000 7fc17eaaf640 1 -- 172.21.15.170:0/3715689191 shutdown_connections 2024-09-04T16:56:20.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.081+0000 7fc17eaaf640 1 -- 172.21.15.170:0/3715689191 wait complete. 2024-09-04T16:56:20.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.082+0000 7fc17eaaf640 1 Processor -- start 2024-09-04T16:56:20.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.082+0000 7fc17eaaf640 1 -- start start 2024-09-04T16:56:20.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.082+0000 7fc17eaaf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1781007e0 0x7fc17819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:20.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.082+0000 7fc17eaaf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1781067e0 0x7fc17819cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:20.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.082+0000 7fc17eaaf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc17810dc90 con 0x7fc1781067e0 2024-09-04T16:56:20.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.082+0000 7fc17eaaf640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc17810db10 con 0x7fc1781007e0 2024-09-04T16:56:20.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.082+0000 7fc177fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1781067e0 0x7fc17819cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:20.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.082+0000 7fc177fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1781067e0 0x7fc17819cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48884/0 (socket says 172.21.15.170:48884) 2024-09-04T16:56:20.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.082+0000 7fc177fff640 1 -- 172.21.15.170:0/686627985 learned_addr learned my addr 172.21.15.170:0/686627985 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:20.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.083+0000 7fc17c84b640 1 --2- 172.21.15.170:0/686627985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1781007e0 0x7fc17819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:20.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.083+0000 7fc177fff640 1 -- 172.21.15.170:0/686627985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1781007e0 msgr2=0x7fc17819c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:20.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.083+0000 7fc177fff640 1 --2- 172.21.15.170:0/686627985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1781007e0 0x7fc17819c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:20.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.083+0000 7fc177fff640 1 -- 172.21.15.170:0/686627985 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1781966a0 con 0x7fc1781067e0 2024-09-04T16:56:20.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.083+0000 7fc177fff640 1 --2- 172.21.15.170:0/686627985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1781067e0 0x7fc17819cb10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc16400c8a0 tx=0x7fc16400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:20.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.083+0000 7fc175ffb640 1 -- 172.21.15.170:0/686627985 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1640079b0 con 0x7fc1781067e0 2024-09-04T16:56:20.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.083+0000 7fc17eaaf640 1 -- 172.21.15.170:0/686627985 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc178196990 con 0x7fc1781067e0 2024-09-04T16:56:20.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.083+0000 7fc175ffb640 1 -- 172.21.15.170:0/686627985 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc164007b50 con 0x7fc1781067e0 2024-09-04T16:56:20.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.083+0000 7fc175ffb640 1 -- 172.21.15.170:0/686627985 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc164018700 con 0x7fc1781067e0 2024-09-04T16:56:20.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.083+0000 7fc17eaaf640 1 -- 172.21.15.170:0/686627985 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc178196f20 con 0x7fc1781067e0 2024-09-04T16:56:20.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.085+0000 7fc17eaaf640 1 -- 172.21.15.170:0/686627985 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc178101f20 con 0x7fc1781067e0 2024-09-04T16:56:20.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.085+0000 7fc175ffb640 1 -- 172.21.15.170:0/686627985 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fc164007d00 con 0x7fc1781067e0 2024-09-04T16:56:20.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.086+0000 7fc175ffb640 1 --2- 172.21.15.170:0/686627985 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc168079e30 0x7fc16807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:20.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.086+0000 7fc175ffb640 1 -- 172.21.15.170:0/686627985 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc16409cd80 con 0x7fc1781067e0 2024-09-04T16:56:20.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.086+0000 7fc17c84b640 1 --2- 172.21.15.170:0/686627985 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc168079e30 0x7fc16807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:20.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.086+0000 7fc17c84b640 1 --2- 172.21.15.170:0/686627985 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc168079e30 0x7fc16807c2f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc16c000c00 tx=0x7fc16c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:20.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.090+0000 7fc175ffb640 1 -- 172.21.15.170:0/686627985 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc164014030 con 0x7fc1781067e0 2024-09-04T16:56:20.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.306+0000 7fc17eaaf640 1 -- 172.21.15.170:0/686627985 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) -- 0x7fc178197bd0 con 0x7fc1781067e0 2024-09-04T16:56:20.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.307+0000 7fc175ffb640 1 -- 172.21.15.170:0/686627985 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v33) ==== 107+0+5332 (secure 0 0 0) 0x7fc1640646f0 con 0x7fc1781067e0 2024-09-04T16:56:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:56:20.308 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":29,"btime":"2024-09-04T16:54:20:201123+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44313,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1344840973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1344840973},{"type":"v1","addr":"172.21.15.193:6825","nonce":1344840973}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44339,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6827/45732148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":45732148},{"type":"v1","addr":"172.21.15.193:6827","nonce":45732148}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:54:19.661931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34324,"mds_1":34356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34324":{"gid":34324,"name":"cephfs.smithi170.zkhdil","rank":0,"incarnation":27,"state":"up:resolve","state_seq":240,"addr":"172.21.15.170:6829/1635879781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1635879781},{"type":"v1","addr":"172.21.15.170:6829","nonce":1635879781}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34356":{"gid":34356,"name":"cephfs.smithi170.rzbrux","rank":1,"incarnation":27,"state":"up:resolve","state_seq":234,"addr":"172.21.15.170:6827/455916915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":455916915},{"type":"v1","addr":"172.21.15.170:6827","nonce":455916915}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-04T16:56:20.308 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 29 2024-09-04T16:56:20.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.310+0000 7fc17eaaf640 1 -- 172.21.15.170:0/686627985 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc168079e30 msgr2=0x7fc16807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:20.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.310+0000 7fc17eaaf640 1 --2- 172.21.15.170:0/686627985 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc168079e30 0x7fc16807c2f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc16c000c00 tx=0x7fc16c031400 comp rx=0 tx=0).stop 2024-09-04T16:56:20.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.310+0000 7fc17eaaf640 1 -- 172.21.15.170:0/686627985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1781067e0 msgr2=0x7fc17819cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:20.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.310+0000 7fc17eaaf640 1 --2- 172.21.15.170:0/686627985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1781067e0 0x7fc17819cb10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc16400c8a0 tx=0x7fc16400cd60 comp rx=0 tx=0).stop 2024-09-04T16:56:20.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.310+0000 7fc17eaaf640 1 -- 172.21.15.170:0/686627985 shutdown_connections 2024-09-04T16:56:20.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.310+0000 7fc17eaaf640 1 --2- 172.21.15.170:0/686627985 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fc168079e30 0x7fc16807c2f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:20.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.310+0000 7fc17eaaf640 1 --2- 172.21.15.170:0/686627985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1781067e0 0x7fc17819cb10 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:20.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.310+0000 7fc17eaaf640 1 --2- 172.21.15.170:0/686627985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1781007e0 0x7fc17819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:20.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.310+0000 7fc17eaaf640 1 -- 172.21.15.170:0/686627985 >> 172.21.15.170:0/686627985 conn(0x7fc1780fc4c0 msgr2=0x7fc1780fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:20.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.310+0000 7fc17eaaf640 1 -- 172.21.15.170:0/686627985 shutdown_connections 2024-09-04T16:56:20.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:20.310+0000 7fc17eaaf640 1 -- 172.21.15.170:0/686627985 wait complete. 2024-09-04T16:56:20.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:20 smithi170 ceph-mon[113855]: pgmap v800: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:20.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:20 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/686627985' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-04T16:56:20.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:20 smithi193 ceph-mon[82547]: pgmap v800: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:20.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:20 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/686627985' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-04T16:56:20.980 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 30 2024-09-04T16:56:21.232 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:21.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.710+0000 7fd5d4258640 1 -- 172.21.15.170:0/847655655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5cc100200 msgr2=0x7fd5cc1005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:21.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.710+0000 7fd5d4258640 1 --2- 172.21.15.170:0/847655655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5cc100200 0x7fd5cc1005e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009880 tx=0x7fd5c802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:56:21.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.711+0000 7fd5d4258640 1 -- 172.21.15.170:0/847655655 shutdown_connections 2024-09-04T16:56:21.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.711+0000 7fd5d4258640 1 --2- 172.21.15.170:0/847655655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5cc100bb0 0x7fd5cc104c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.711+0000 7fd5d4258640 1 --2- 172.21.15.170:0/847655655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5cc100200 0x7fd5cc1005e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.711+0000 7fd5d4258640 1 -- 172.21.15.170:0/847655655 >> 172.21.15.170:0/847655655 conn(0x7fd5cc0fbc60 msgr2=0x7fd5cc0fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.711+0000 7fd5d4258640 1 -- 172.21.15.170:0/847655655 shutdown_connections 2024-09-04T16:56:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.711+0000 7fd5d4258640 1 -- 172.21.15.170:0/847655655 wait complete. 2024-09-04T16:56:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.711+0000 7fd5d4258640 1 Processor -- start 2024-09-04T16:56:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.711+0000 7fd5d4258640 1 -- start start 2024-09-04T16:56:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5d4258640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5cc100200 0x7fd5cc19f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5d4258640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5cc100bb0 0x7fd5cc19fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5d4258640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd5cc10d460 con 0x7fd5cc100200 2024-09-04T16:56:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5d4258640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd5cc10d2e0 con 0x7fd5cc100bb0 2024-09-04T16:56:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5d1ff4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5cc100200 0x7fd5cc19f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5d1ff4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5cc100200 0x7fd5cc19f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48908/0 (socket says 172.21.15.170:48908) 2024-09-04T16:56:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5d1ff4640 1 -- 172.21.15.170:0/2185020968 learned_addr learned my addr 172.21.15.170:0/2185020968 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5d17f3640 1 --2- 172.21.15.170:0/2185020968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5cc100bb0 0x7fd5cc19fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5d1ff4640 1 -- 172.21.15.170:0/2185020968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5cc100bb0 msgr2=0x7fd5cc19fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5d1ff4640 1 --2- 172.21.15.170:0/2185020968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5cc100bb0 0x7fd5cc19fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5d1ff4640 1 -- 172.21.15.170:0/2185020968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5cc1a04e0 con 0x7fd5cc100200 2024-09-04T16:56:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5d1ff4640 1 --2- 172.21.15.170:0/2185020968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5cc100200 0x7fd5cc19f8f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8031460 tx=0x7fd5c80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5c2ffd640 1 -- 172.21.15.170:0/2185020968 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd5c803f070 con 0x7fd5cc100200 2024-09-04T16:56:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5c2ffd640 1 -- 172.21.15.170:0/2185020968 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd5c8004cf0 con 0x7fd5cc100200 2024-09-04T16:56:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5c2ffd640 1 -- 172.21.15.170:0/2185020968 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd5c8035030 con 0x7fd5cc100200 2024-09-04T16:56:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5d4258640 1 -- 172.21.15.170:0/2185020968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5cc199b70 con 0x7fd5cc100200 2024-09-04T16:56:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.712+0000 7fd5d4258640 1 -- 172.21.15.170:0/2185020968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5cc19a070 con 0x7fd5cc100200 2024-09-04T16:56:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.714+0000 7fd5d4258640 1 -- 172.21.15.170:0/2185020968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5cc1016e0 con 0x7fd5cc100200 2024-09-04T16:56:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.714+0000 7fd5c2ffd640 1 -- 172.21.15.170:0/2185020968 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7fd5c8042070 con 0x7fd5cc100200 2024-09-04T16:56:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.715+0000 7fd5c2ffd640 1 --2- 172.21.15.170:0/2185020968 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd5b8079e80 0x7fd5b807c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.715+0000 7fd5c2ffd640 1 -- 172.21.15.170:0/2185020968 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd5c80bd550 con 0x7fd5cc100200 2024-09-04T16:56:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.715+0000 7fd5d17f3640 1 --2- 172.21.15.170:0/2185020968 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd5b8079e80 0x7fd5b807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.716+0000 7fd5d17f3640 1 --2- 172.21.15.170:0/2185020968 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd5b8079e80 0x7fd5b807c340 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc005e10 tx=0x7fd5bc005da0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:21.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.719+0000 7fd5c2ffd640 1 -- 172.21.15.170:0/2185020968 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd5c8084f40 con 0x7fd5cc100200 2024-09-04T16:56:21.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.928+0000 7fd5d4258640 1 -- 172.21.15.170:0/2185020968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) -- 0x7fd5cc19a320 con 0x7fd5cc100200 2024-09-04T16:56:21.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.929+0000 7fd5c2ffd640 1 -- 172.21.15.170:0/2185020968 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v33) ==== 107+0+5336 (secure 0 0 0) 0x7fd5c808d3f0 con 0x7fd5cc100200 2024-09-04T16:56:21.930 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:56:21.930 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":30,"btime":"2024-09-04T16:54:21:203083+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44313,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1344840973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1344840973},{"type":"v1","addr":"172.21.15.193:6825","nonce":1344840973}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44339,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6827/45732148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":45732148},{"type":"v1","addr":"172.21.15.193:6827","nonce":45732148}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:54:20.258052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34324,"mds_1":34356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34324":{"gid":34324,"name":"cephfs.smithi170.zkhdil","rank":0,"incarnation":27,"state":"up:reconnect","state_seq":241,"addr":"172.21.15.170:6829/1635879781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1635879781},{"type":"v1","addr":"172.21.15.170:6829","nonce":1635879781}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34356":{"gid":34356,"name":"cephfs.smithi170.rzbrux","rank":1,"incarnation":27,"state":"up:reconnect","state_seq":237,"addr":"172.21.15.170:6827/455916915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":455916915},{"type":"v1","addr":"172.21.15.170:6827","nonce":455916915}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-04T16:56:21.931 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 30 2024-09-04T16:56:21.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.931+0000 7fd5d4258640 1 -- 172.21.15.170:0/2185020968 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd5b8079e80 msgr2=0x7fd5b807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:21.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.931+0000 7fd5d4258640 1 --2- 172.21.15.170:0/2185020968 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd5b8079e80 0x7fd5b807c340 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc005e10 tx=0x7fd5bc005da0 comp rx=0 tx=0).stop 2024-09-04T16:56:21.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.931+0000 7fd5d4258640 1 -- 172.21.15.170:0/2185020968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5cc100200 msgr2=0x7fd5cc19f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:21.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.931+0000 7fd5d4258640 1 --2- 172.21.15.170:0/2185020968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5cc100200 0x7fd5cc19f8f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8031460 tx=0x7fd5c80048f0 comp rx=0 tx=0).stop 2024-09-04T16:56:21.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.931+0000 7fd5d4258640 1 -- 172.21.15.170:0/2185020968 shutdown_connections 2024-09-04T16:56:21.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.931+0000 7fd5d4258640 1 --2- 172.21.15.170:0/2185020968 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7fd5b8079e80 0x7fd5b807c340 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:21.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.931+0000 7fd5d4258640 1 --2- 172.21.15.170:0/2185020968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5cc100bb0 0x7fd5cc19fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:21.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.931+0000 7fd5d4258640 1 --2- 172.21.15.170:0/2185020968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5cc100200 0x7fd5cc19f8f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:21.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.931+0000 7fd5d4258640 1 -- 172.21.15.170:0/2185020968 >> 172.21.15.170:0/2185020968 conn(0x7fd5cc0fbc60 msgr2=0x7fd5cc0fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:21.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.931+0000 7fd5d4258640 1 -- 172.21.15.170:0/2185020968 shutdown_connections 2024-09-04T16:56:21.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:21.931+0000 7fd5d4258640 1 -- 172.21.15.170:0/2185020968 wait complete. 2024-09-04T16:56:22.565 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 31 2024-09-04T16:56:22.816 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:22.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:22 smithi170 ceph-mon[113855]: pgmap v801: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:22.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:22 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2185020968' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-04T16:56:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:22 smithi193 ceph-mon[82547]: pgmap v801: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:22 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2185020968' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-04T16:56:23.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.311+0000 7f1758390640 1 -- 172.21.15.170:0/122986349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1750107910 msgr2=0x7f1750107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:23.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.311+0000 7f1758390640 1 --2- 172.21.15.170:0/122986349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1750107910 0x7f1750107cf0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1740009880 tx=0x7f174002a4a0 comp rx=0 tx=0).stop 2024-09-04T16:56:23.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.311+0000 7f1758390640 1 -- 172.21.15.170:0/122986349 shutdown_connections 2024-09-04T16:56:23.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.311+0000 7f1758390640 1 --2- 172.21.15.170:0/122986349 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1750101910 0x7f1750101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:23.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.311+0000 7f1758390640 1 --2- 172.21.15.170:0/122986349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1750107910 0x7f1750107cf0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:23.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.311+0000 7f1758390640 1 -- 172.21.15.170:0/122986349 >> 172.21.15.170:0/122986349 conn(0x7f17500fd5f0 msgr2=0x7f17500ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:23.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.311+0000 7f1758390640 1 -- 172.21.15.170:0/122986349 shutdown_connections 2024-09-04T16:56:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.311+0000 7f1758390640 1 -- 172.21.15.170:0/122986349 wait complete. 2024-09-04T16:56:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.311+0000 7f1758390640 1 Processor -- start 2024-09-04T16:56:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.311+0000 7f1758390640 1 -- start start 2024-09-04T16:56:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.312+0000 7f1758390640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1750101910 0x7f17500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.312+0000 7f1758390640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1750107910 0x7f1750074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.312+0000 7f1758390640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f175010edc0 con 0x7f1750101910 2024-09-04T16:56:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.312+0000 7f1758390640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f175010ec40 con 0x7f1750107910 2024-09-04T16:56:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.312+0000 7f175612c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1750101910 0x7f17500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.312+0000 7f175612c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1750101910 0x7f17500744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48926/0 (socket says 172.21.15.170:48926) 2024-09-04T16:56:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.312+0000 7f175612c640 1 -- 172.21.15.170:0/2803932005 learned_addr learned my addr 172.21.15.170:0/2803932005 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.312+0000 7f175592b640 1 --2- 172.21.15.170:0/2803932005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1750107910 0x7f1750074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.312+0000 7f175612c640 1 -- 172.21.15.170:0/2803932005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1750107910 msgr2=0x7f1750074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.312+0000 7f175612c640 1 --2- 172.21.15.170:0/2803932005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1750107910 0x7f1750074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.312+0000 7f175612c640 1 -- 172.21.15.170:0/2803932005 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1750074f70 con 0x7f1750101910 2024-09-04T16:56:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.312+0000 7f175592b640 1 --2- 172.21.15.170:0/2803932005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1750107910 0x7f1750074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-04T16:56:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.312+0000 7f175612c640 1 --2- 172.21.15.170:0/2803932005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1750101910 0x7f17500744f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1740031460 tx=0x7f17400048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.312+0000 7f17477fe640 1 -- 172.21.15.170:0/2803932005 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f174003f070 con 0x7f1750101910 2024-09-04T16:56:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.312+0000 7f17477fe640 1 -- 172.21.15.170:0/2803932005 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1740004cf0 con 0x7f1750101910 2024-09-04T16:56:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.312+0000 7f17477fe640 1 -- 172.21.15.170:0/2803932005 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1740035030 con 0x7f1750101910 2024-09-04T16:56:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.313+0000 7f1758390640 1 -- 172.21.15.170:0/2803932005 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1750075200 con 0x7f1750101910 2024-09-04T16:56:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.313+0000 7f1758390640 1 -- 172.21.15.170:0/2803932005 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17501a3d20 con 0x7f1750101910 2024-09-04T16:56:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.313+0000 7f1758390640 1 -- 172.21.15.170:0/2803932005 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1750103050 con 0x7f1750101910 2024-09-04T16:56:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.314+0000 7f17477fe640 1 -- 172.21.15.170:0/2803932005 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f1740042070 con 0x7f1750101910 2024-09-04T16:56:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.314+0000 7f17477fe640 1 --2- 172.21.15.170:0/2803932005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f173c079e30 0x7f173c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.315+0000 7f17477fe640 1 -- 172.21.15.170:0/2803932005 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f17400bd520 con 0x7f1750101910 2024-09-04T16:56:23.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.315+0000 7f175592b640 1 --2- 172.21.15.170:0/2803932005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f173c079e30 0x7f173c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:23.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.315+0000 7f175592b640 1 --2- 172.21.15.170:0/2803932005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f173c079e30 0x7f173c07c2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1750075f80 tx=0x7f174c005d90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:23.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.319+0000 7f17477fe640 1 -- 172.21.15.170:0/2803932005 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1740084f30 con 0x7f1750101910 2024-09-04T16:56:23.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.527+0000 7f1758390640 1 -- 172.21.15.170:0/2803932005 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) -- 0x7f1750104b20 con 0x7f1750101910 2024-09-04T16:56:23.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.528+0000 7f17477fe640 1 -- 172.21.15.170:0/2803932005 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v33) ==== 107+0+5330 (secure 0 0 0) 0x7f174008d3e0 con 0x7f1750101910 2024-09-04T16:56:23.529 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:56:23.529 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":31,"btime":"2024-09-04T16:54:22:208025+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44313,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1344840973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1344840973},{"type":"v1","addr":"172.21.15.193:6825","nonce":1344840973}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44339,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6827/45732148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":45732148},{"type":"v1","addr":"172.21.15.193:6827","nonce":45732148}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:54:21.211899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34324,"mds_1":34356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34324":{"gid":34324,"name":"cephfs.smithi170.zkhdil","rank":0,"incarnation":27,"state":"up:rejoin","state_seq":242,"addr":"172.21.15.170:6829/1635879781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1635879781},{"type":"v1","addr":"172.21.15.170:6829","nonce":1635879781}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34356":{"gid":34356,"name":"cephfs.smithi170.rzbrux","rank":1,"incarnation":27,"state":"up:rejoin","state_seq":238,"addr":"172.21.15.170:6827/455916915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":455916915},{"type":"v1","addr":"172.21.15.170:6827","nonce":455916915}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-04T16:56:23.529 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 31 2024-09-04T16:56:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.530+0000 7f1758390640 1 -- 172.21.15.170:0/2803932005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f173c079e30 msgr2=0x7f173c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.530+0000 7f1758390640 1 --2- 172.21.15.170:0/2803932005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f173c079e30 0x7f173c07c2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1750075f80 tx=0x7f174c005d90 comp rx=0 tx=0).stop 2024-09-04T16:56:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.530+0000 7f1758390640 1 -- 172.21.15.170:0/2803932005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1750101910 msgr2=0x7f17500744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.530+0000 7f1758390640 1 --2- 172.21.15.170:0/2803932005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1750101910 0x7f17500744f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1740031460 tx=0x7f17400048f0 comp rx=0 tx=0).stop 2024-09-04T16:56:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.530+0000 7f1758390640 1 -- 172.21.15.170:0/2803932005 shutdown_connections 2024-09-04T16:56:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.530+0000 7f1758390640 1 --2- 172.21.15.170:0/2803932005 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f173c079e30 0x7f173c07c2f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.530+0000 7f1758390640 1 --2- 172.21.15.170:0/2803932005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1750107910 0x7f1750074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.530+0000 7f1758390640 1 --2- 172.21.15.170:0/2803932005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1750101910 0x7f17500744f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.530+0000 7f1758390640 1 -- 172.21.15.170:0/2803932005 >> 172.21.15.170:0/2803932005 conn(0x7f17500fd5f0 msgr2=0x7f17500feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:23.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.530+0000 7f1758390640 1 -- 172.21.15.170:0/2803932005 shutdown_connections 2024-09-04T16:56:23.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:23.530+0000 7f1758390640 1 -- 172.21.15.170:0/2803932005 wait complete. 2024-09-04T16:56:23.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:23 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/2803932005' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-04T16:56:23.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:23 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/2803932005' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-04T16:56:24.172 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 32 2024-09-04T16:56:24.423 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:24.838 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:24 smithi170 ceph-mon[113855]: pgmap v802: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:24.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:24 smithi193 ceph-mon[82547]: pgmap v802: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:24.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.918+0000 7f7ec01df640 1 -- 172.21.15.170:0/1573698815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eb81007e0 msgr2=0x7f7eb8100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:24.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.918+0000 7f7ec01df640 1 --2- 172.21.15.170:0/1573698815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eb81007e0 0x7f7eb8100c40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8009880 tx=0x7f7ea802a4a0 comp rx=0 tx=0).stop 2024-09-04T16:56:24.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.918+0000 7f7ec01df640 1 -- 172.21.15.170:0/1573698815 shutdown_connections 2024-09-04T16:56:24.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.918+0000 7f7ec01df640 1 --2- 172.21.15.170:0/1573698815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eb81007e0 0x7f7eb8100c40 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:24.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.918+0000 7f7ec01df640 1 --2- 172.21.15.170:0/1573698815 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7eb81067e0 0x7f7eb8106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:24.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.918+0000 7f7ec01df640 1 -- 172.21.15.170:0/1573698815 >> 172.21.15.170:0/1573698815 conn(0x7f7eb80fc4c0 msgr2=0x7f7eb80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:24.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.918+0000 7f7ec01df640 1 -- 172.21.15.170:0/1573698815 shutdown_connections 2024-09-04T16:56:24.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.918+0000 7f7ec01df640 1 -- 172.21.15.170:0/1573698815 wait complete. 2024-09-04T16:56:24.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.919+0000 7f7ec01df640 1 Processor -- start 2024-09-04T16:56:24.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.919+0000 7f7ec01df640 1 -- start start 2024-09-04T16:56:24.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.919+0000 7f7ec01df640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eb81007e0 0x7f7eb81023b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:24.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.919+0000 7f7ec01df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7eb81067e0 0x7f7eb81028f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:24.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.919+0000 7f7ec01df640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb810dcb0 con 0x7f7eb81007e0 2024-09-04T16:56:24.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.919+0000 7f7ec01df640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb810db30 con 0x7f7eb81067e0 2024-09-04T16:56:24.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.919+0000 7f7ebdf7b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eb81007e0 0x7f7eb81023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:24.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.919+0000 7f7ebdf7b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eb81007e0 0x7f7eb81023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48946/0 (socket says 172.21.15.170:48946) 2024-09-04T16:56:24.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.919+0000 7f7ebdf7b640 1 -- 172.21.15.170:0/418428188 learned_addr learned my addr 172.21.15.170:0/418428188 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:24.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.919+0000 7f7ebd77a640 1 --2- 172.21.15.170:0/418428188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7eb81067e0 0x7f7eb81028f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:24.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.920+0000 7f7ebdf7b640 1 -- 172.21.15.170:0/418428188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7eb81067e0 msgr2=0x7f7eb81028f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:24.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.920+0000 7f7ebdf7b640 1 --2- 172.21.15.170:0/418428188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7eb81067e0 0x7f7eb81028f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:24.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.920+0000 7f7ebdf7b640 1 -- 172.21.15.170:0/418428188 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb8102e30 con 0x7f7eb81007e0 2024-09-04T16:56:24.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.920+0000 7f7ebdf7b640 1 --2- 172.21.15.170:0/418428188 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eb81007e0 0x7f7eb81023b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400d6f0 tx=0x7f7eb400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:24.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.920+0000 7f7eaeffd640 1 -- 172.21.15.170:0/418428188 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7eb4017070 con 0x7f7eb81007e0 2024-09-04T16:56:24.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.920+0000 7f7eaeffd640 1 -- 172.21.15.170:0/418428188 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7eb400de00 con 0x7f7eb81007e0 2024-09-04T16:56:24.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.920+0000 7f7ec01df640 1 -- 172.21.15.170:0/418428188 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb8103120 con 0x7f7eb81007e0 2024-09-04T16:56:24.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.920+0000 7f7eaeffd640 1 -- 172.21.15.170:0/418428188 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7eb4004bb0 con 0x7f7eb81007e0 2024-09-04T16:56:24.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.920+0000 7f7ec01df640 1 -- 172.21.15.170:0/418428188 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb81a3e60 con 0x7f7eb81007e0 2024-09-04T16:56:24.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.921+0000 7f7ec01df640 1 -- 172.21.15.170:0/418428188 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb8101f20 con 0x7f7eb81007e0 2024-09-04T16:56:24.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.922+0000 7f7eaeffd640 1 -- 172.21.15.170:0/418428188 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f7eb4004e60 con 0x7f7eb81007e0 2024-09-04T16:56:24.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.922+0000 7f7eaeffd640 1 --2- 172.21.15.170:0/418428188 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7ea4079e30 0x7f7ea407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:24.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.923+0000 7f7ebd77a640 1 --2- 172.21.15.170:0/418428188 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7ea4079e30 0x7f7ea407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:24.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.923+0000 7f7eaeffd640 1 -- 172.21.15.170:0/418428188 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f7eb409c730 con 0x7f7eb81007e0 2024-09-04T16:56:24.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.923+0000 7f7ebd77a640 1 --2- 172.21.15.170:0/418428188 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7ea4079e30 0x7f7ea407c2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8103e40 tx=0x7f7ea8031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:24.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:24.927+0000 7f7eaeffd640 1 -- 172.21.15.170:0/418428188 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7eb4064140 con 0x7f7eb81007e0 2024-09-04T16:56:25.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:25.147+0000 7f7ec01df640 1 -- 172.21.15.170:0/418428188 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) -- 0x7f7eb81a4110 con 0x7f7eb81007e0 2024-09-04T16:56:25.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:25.147+0000 7f7eaeffd640 1 -- 172.21.15.170:0/418428188 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v33) ==== 107+0+5345 (secure 0 0 0) 0x7f7eb40682b0 con 0x7f7eb81007e0 2024-09-04T16:56:25.149 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-04T16:56:25.149 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":32,"btime":"2024-09-04T16:54:23:212959+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44313,"name":"cephfs.smithi193.xostco","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6825/1344840973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1344840973},{"type":"v1","addr":"172.21.15.193:6825","nonce":1344840973}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44339,"name":"cephfs.smithi193.kabapr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6827/45732148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":45732148},{"type":"v1","addr":"172.21.15.193:6827","nonce":45732148}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-04T16:27:21.512483+0000","modified":"2024-09-04T16:54:23.212954+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34324,"mds_1":34356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34324":{"gid":34324,"name":"cephfs.smithi170.zkhdil","rank":0,"incarnation":27,"state":"up:active","state_seq":243,"addr":"172.21.15.170:6829/1635879781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1635879781},{"type":"v1","addr":"172.21.15.170:6829","nonce":1635879781}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34356":{"gid":34356,"name":"cephfs.smithi170.rzbrux","rank":1,"incarnation":27,"state":"up:active","state_seq":239,"addr":"172.21.15.170:6827/455916915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":455916915},{"type":"v1","addr":"172.21.15.170:6827","nonce":455916915}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34324,"qdb_cluster":[34324,34356]},"id":1}]} 2024-09-04T16:56:25.149 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 32 2024-09-04T16:56:25.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:25.150+0000 7f7ec01df640 1 -- 172.21.15.170:0/418428188 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7ea4079e30 msgr2=0x7f7ea407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:25.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:25.150+0000 7f7ec01df640 1 --2- 172.21.15.170:0/418428188 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7ea4079e30 0x7f7ea407c2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8103e40 tx=0x7f7ea8031400 comp rx=0 tx=0).stop 2024-09-04T16:56:25.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:25.150+0000 7f7ec01df640 1 -- 172.21.15.170:0/418428188 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eb81007e0 msgr2=0x7f7eb81023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:25.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:25.150+0000 7f7ec01df640 1 --2- 172.21.15.170:0/418428188 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eb81007e0 0x7f7eb81023b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400d6f0 tx=0x7f7eb400dbb0 comp rx=0 tx=0).stop 2024-09-04T16:56:25.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:25.150+0000 7f7ec01df640 1 -- 172.21.15.170:0/418428188 shutdown_connections 2024-09-04T16:56:25.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:25.150+0000 7f7ec01df640 1 --2- 172.21.15.170:0/418428188 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f7ea4079e30 0x7f7ea407c2f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:25.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:25.150+0000 7f7ec01df640 1 --2- 172.21.15.170:0/418428188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7eb81067e0 0x7f7eb81028f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:25.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:25.150+0000 7f7ec01df640 1 --2- 172.21.15.170:0/418428188 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eb81007e0 0x7f7eb81023b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:25.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:25.150+0000 7f7ec01df640 1 -- 172.21.15.170:0/418428188 >> 172.21.15.170:0/418428188 conn(0x7f7eb80fc4c0 msgr2=0x7f7eb8104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:25.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:25.150+0000 7f7ec01df640 1 -- 172.21.15.170:0/418428188 shutdown_connections 2024-09-04T16:56:25.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:25.150+0000 7f7ec01df640 1 -- 172.21.15.170:0/418428188 wait complete. 2024-09-04T16:56:25.747 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-04T16:56:25.759 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-04T16:56:25.760 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:56:25.760 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-04T16:56:25.779 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:56:25.779 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-04T16:56:25.837 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph osd blocklist ls 2024-09-04T16:56:25.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:25 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/418428188' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-04T16:56:25.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:25 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/418428188' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-04T16:56:26.101 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:26.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.652+0000 7f4e8981b640 1 -- 172.21.15.170:0/147158196 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e84100820 msgr2=0x7f4e84100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:26.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.652+0000 7f4e8981b640 1 --2- 172.21.15.170:0/147158196 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e84100820 0x7f4e84100c80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009880 tx=0x7f4e6c02a4a0 comp rx=0 tx=0).stop 2024-09-04T16:56:26.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.652+0000 7f4e8981b640 1 -- 172.21.15.170:0/147158196 shutdown_connections 2024-09-04T16:56:26.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.652+0000 7f4e8981b640 1 --2- 172.21.15.170:0/147158196 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e84100820 0x7f4e84100c80 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:26.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.652+0000 7f4e8981b640 1 --2- 172.21.15.170:0/147158196 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e84106820 0x7f4e84106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:26.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.652+0000 7f4e8981b640 1 -- 172.21.15.170:0/147158196 >> 172.21.15.170:0/147158196 conn(0x7f4e840fc520 msgr2=0x7f4e840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:26.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.652+0000 7f4e8981b640 1 -- 172.21.15.170:0/147158196 shutdown_connections 2024-09-04T16:56:26.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.652+0000 7f4e8981b640 1 -- 172.21.15.170:0/147158196 wait complete. 2024-09-04T16:56:26.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.653+0000 7f4e8981b640 1 Processor -- start 2024-09-04T16:56:26.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.653+0000 7f4e8981b640 1 -- start start 2024-09-04T16:56:26.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.653+0000 7f4e8981b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e84100820 0x7f4e84198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:26.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.653+0000 7f4e8981b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e84106820 0x7f4e84198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:26.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.653+0000 7f4e8981b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8410dcf0 con 0x7f4e84106820 2024-09-04T16:56:26.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.653+0000 7f4e8981b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8410db70 con 0x7f4e84100820 2024-09-04T16:56:26.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.653+0000 7f4e7a7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e84106820 0x7f4e84198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:26.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.653+0000 7f4e7a7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e84106820 0x7f4e84198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48902/0 (socket says 172.21.15.170:48902) 2024-09-04T16:56:26.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.653+0000 7f4e7a7fc640 1 -- 172.21.15.170:0/1221033267 learned_addr learned my addr 172.21.15.170:0/1221033267 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:26.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.653+0000 7f4e82ffd640 1 --2- 172.21.15.170:0/1221033267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e84100820 0x7f4e84198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:26.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.654+0000 7f4e7a7fc640 1 -- 172.21.15.170:0/1221033267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e84100820 msgr2=0x7f4e84198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:26.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.654+0000 7f4e7a7fc640 1 --2- 172.21.15.170:0/1221033267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e84100820 0x7f4e84198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:26.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.654+0000 7f4e7a7fc640 1 -- 172.21.15.170:0/1221033267 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e84199390 con 0x7f4e84106820 2024-09-04T16:56:26.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.654+0000 7f4e7a7fc640 1 --2- 172.21.15.170:0/1221033267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e84106820 0x7f4e84198d40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c031460 tx=0x7f4e6c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:26.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.654+0000 7f4e88819640 1 -- 172.21.15.170:0/1221033267 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e6c03f070 con 0x7f4e84106820 2024-09-04T16:56:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.654+0000 7f4e88819640 1 -- 172.21.15.170:0/1221033267 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4e6c004cf0 con 0x7f4e84106820 2024-09-04T16:56:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.654+0000 7f4e8981b640 1 -- 172.21.15.170:0/1221033267 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e84199620 con 0x7f4e84106820 2024-09-04T16:56:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.654+0000 7f4e88819640 1 -- 172.21.15.170:0/1221033267 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e6c035030 con 0x7f4e84106820 2024-09-04T16:56:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.654+0000 7f4e8981b640 1 -- 172.21.15.170:0/1221033267 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e841a1bd0 con 0x7f4e84106820 2024-09-04T16:56:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.655+0000 7f4e8981b640 1 -- 172.21.15.170:0/1221033267 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e84101f60 con 0x7f4e84106820 2024-09-04T16:56:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.655+0000 7f4e88819640 1 -- 172.21.15.170:0/1221033267 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f4e6c042070 con 0x7f4e84106820 2024-09-04T16:56:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.656+0000 7f4e88819640 1 --2- 172.21.15.170:0/1221033267 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4e70079e30 0x7f4e7007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.656+0000 7f4e88819640 1 -- 172.21.15.170:0/1221033267 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4e6c0bd520 con 0x7f4e84106820 2024-09-04T16:56:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.656+0000 7f4e82ffd640 1 --2- 172.21.15.170:0/1221033267 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4e70079e30 0x7f4e7007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.656+0000 7f4e82ffd640 1 --2- 172.21.15.170:0/1221033267 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4e70079e30 0x7f4e7007c2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4e74005fd0 tx=0x7f4e74005e20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.660+0000 7f4e88819640 1 -- 172.21.15.170:0/1221033267 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4e6c084f30 con 0x7f4e84106820 2024-09-04T16:56:26.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.848+0000 7f4e8981b640 1 -- 172.21.15.170:0/1221033267 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4e84108d90 con 0x7f4e84106820 2024-09-04T16:56:26.849 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:26 smithi170 ceph-mon[113855]: pgmap v803: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:26.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.849+0000 7f4e88819640 1 -- 172.21.15.170:0/1221033267 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v82) ==== 81+0+2111 (secure 0 0 0) 0x7f4e6c08d3e0 con 0x7f4e84106820 2024-09-04T16:56:26.850 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6829/3937288624 2024-09-05T16:38:15.784019+0000 2024-09-04T16:56:26.850 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6828/3937288624 2024-09-05T16:38:15.784019+0000 2024-09-04T16:56:26.850 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6826/3443400311 2024-09-05T16:38:15.784006+0000 2024-09-04T16:56:26.850 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/3721031413 2024-09-05T16:29:26.169571+0000 2024-09-04T16:56:26.850 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:6824/1755428205 2024-09-05T16:27:35.139397+0000 2024-09-04T16:56:26.850 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6800/1933182229 2024-09-05T16:21:43.532674+0000 2024-09-04T16:56:26.850 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6800/1415431517 2024-09-05T16:29:26.169571+0000 2024-09-04T16:56:26.851 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6827/3443400311 2024-09-05T16:38:15.784006+0000 2024-09-04T16:56:26.851 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/805677094 2024-09-05T16:21:43.532674+0000 2024-09-04T16:56:26.851 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:0/3638128589 2024-09-05T16:30:58.302737+0000 2024-09-04T16:56:26.851 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6801/1344937001 2024-09-05T16:21:12.676489+0000 2024-09-04T16:56:26.851 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:6829/4218378172 2024-09-05T16:30:58.302737+0000 2024-09-04T16:56:26.851 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/2879400972 2024-09-05T16:22:43.188580+0000 2024-09-04T16:56:26.851 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6801/1933182229 2024-09-05T16:21:43.532674+0000 2024-09-04T16:56:26.851 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6800/1344937001 2024-09-05T16:21:12.676489+0000 2024-09-04T16:56:26.851 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:0/3985431161 2024-09-05T16:30:58.302737+0000 2024-09-04T16:56:26.851 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/715338811 2024-09-05T16:29:26.169571+0000 2024-09-04T16:56:26.851 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/3694273822 2024-09-05T16:29:26.169571+0000 2024-09-04T16:56:26.851 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:0/1421527181 2024-09-05T16:30:58.302737+0000 2024-09-04T16:56:26.851 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/2398984574 2024-09-05T16:21:12.676489+0000 2024-09-04T16:56:26.851 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:0/1388266887 2024-09-05T16:30:58.302737+0000 2024-09-04T16:56:26.851 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/3495410490 2024-09-05T16:22:43.188580+0000 2024-09-04T16:56:26.852 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:0/4195853727 2024-09-05T16:30:58.302737+0000 2024-09-04T16:56:26.852 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/1110147744 2024-09-05T16:21:43.532674+0000 2024-09-04T16:56:26.852 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/4140626365 2024-09-05T16:21:12.676489+0000 2024-09-04T16:56:26.852 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/3196924100 2024-09-05T16:22:43.188580+0000 2024-09-04T16:56:26.852 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/1792862708 2024-09-05T16:29:26.169571+0000 2024-09-04T16:56:26.852 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/3147587826 2024-09-05T16:21:12.676489+0000 2024-09-04T16:56:26.852 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:0/1603316950 2024-09-05T16:30:58.302737+0000 2024-09-04T16:56:26.852 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6801/1415431517 2024-09-05T16:29:26.169571+0000 2024-09-04T16:56:26.852 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:6825/1755428205 2024-09-05T16:27:35.139397+0000 2024-09-04T16:56:26.852 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6800/4082719191 2024-09-05T16:22:43.188580+0000 2024-09-04T16:56:26.852 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6801/4082719191 2024-09-05T16:22:43.188580+0000 2024-09-04T16:56:26.852 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:6828/4218378172 2024-09-05T16:30:58.302737+0000 2024-09-04T16:56:26.852 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/2639013592 2024-09-05T16:21:43.532674+0000 2024-09-04T16:56:26.853 INFO:teuthology.orchestra.run.smithi170.stderr:listed 35 entries 2024-09-04T16:56:26.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.852+0000 7f4e8981b640 1 -- 172.21.15.170:0/1221033267 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4e70079e30 msgr2=0x7f4e7007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:26.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.852+0000 7f4e8981b640 1 --2- 172.21.15.170:0/1221033267 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4e70079e30 0x7f4e7007c2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4e74005fd0 tx=0x7f4e74005e20 comp rx=0 tx=0).stop 2024-09-04T16:56:26.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.852+0000 7f4e8981b640 1 -- 172.21.15.170:0/1221033267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e84106820 msgr2=0x7f4e84198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:26.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.852+0000 7f4e8981b640 1 --2- 172.21.15.170:0/1221033267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e84106820 0x7f4e84198d40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c031460 tx=0x7f4e6c0048f0 comp rx=0 tx=0).stop 2024-09-04T16:56:26.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.852+0000 7f4e8981b640 1 -- 172.21.15.170:0/1221033267 shutdown_connections 2024-09-04T16:56:26.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.852+0000 7f4e8981b640 1 --2- 172.21.15.170:0/1221033267 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f4e70079e30 0x7f4e7007c2f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:26.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.852+0000 7f4e8981b640 1 --2- 172.21.15.170:0/1221033267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e84106820 0x7f4e84198d40 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:26.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.852+0000 7f4e8981b640 1 --2- 172.21.15.170:0/1221033267 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e84100820 0x7f4e84198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:26.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.852+0000 7f4e8981b640 1 -- 172.21.15.170:0/1221033267 >> 172.21.15.170:0/1221033267 conn(0x7f4e840fc520 msgr2=0x7f4e840fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:26.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.852+0000 7f4e8981b640 1 -- 172.21.15.170:0/1221033267 shutdown_connections 2024-09-04T16:56:26.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:26.852+0000 7f4e8981b640 1 -- 172.21.15.170:0/1221033267 wait complete. 2024-09-04T16:56:26.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:26 smithi193 ceph-mon[82547]: pgmap v803: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:27.562 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-04T16:56:27.562 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-04T16:56:27.582 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 -- ceph osd blocklist ls 2024-09-04T16:56:27.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:27 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/1221033267' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-04T16:56:27.871 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/mon.smithi170/config 2024-09-04T16:56:27.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:27 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/1221033267' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-04T16:56:28.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.341+0000 7f3ce7fe4640 1 -- 172.21.15.170:0/3380404660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ce0100f60 msgr2=0x7f3ce01013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:28.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.341+0000 7f3ce7fe4640 1 --2- 172.21.15.170:0/3380404660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ce0100f60 0x7f3ce01013c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009880 tx=0x7f3cd002a530 comp rx=0 tx=0).stop 2024-09-04T16:56:28.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.341+0000 7f3ce7fe4640 1 -- 172.21.15.170:0/3380404660 shutdown_connections 2024-09-04T16:56:28.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.341+0000 7f3ce7fe4640 1 --2- 172.21.15.170:0/3380404660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ce0100f60 0x7f3ce01013c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:28.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.341+0000 7f3ce7fe4640 1 --2- 172.21.15.170:0/3380404660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ce0106840 0x7f3ce0106c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:28.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.341+0000 7f3ce7fe4640 1 -- 172.21.15.170:0/3380404660 >> 172.21.15.170:0/3380404660 conn(0x7f3ce00fbc40 msgr2=0x7f3ce00fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:28.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.341+0000 7f3ce7fe4640 1 -- 172.21.15.170:0/3380404660 shutdown_connections 2024-09-04T16:56:28.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.341+0000 7f3ce7fe4640 1 -- 172.21.15.170:0/3380404660 wait complete. 2024-09-04T16:56:28.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.342+0000 7f3ce7fe4640 1 Processor -- start 2024-09-04T16:56:28.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.342+0000 7f3ce7fe4640 1 -- start start 2024-09-04T16:56:28.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.342+0000 7f3ce7fe4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ce0100f60 0x7f3ce01988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:28.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.342+0000 7f3ce7fe4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ce0106840 0x7f3ce0198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:28.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.342+0000 7f3ce7fe4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce010dce0 con 0x7f3ce0106840 2024-09-04T16:56:28.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.342+0000 7f3ce7fe4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce010db60 con 0x7f3ce0100f60 2024-09-04T16:56:28.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.342+0000 7f3ce557f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ce0106840 0x7f3ce0198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:28.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.342+0000 7f3ce557f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ce0106840 0x7f3ce0198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48922/0 (socket says 172.21.15.170:48922) 2024-09-04T16:56:28.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.342+0000 7f3ce557f640 1 -- 172.21.15.170:0/432992585 learned_addr learned my addr 172.21.15.170:0/432992585 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-04T16:56:28.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.342+0000 7f3ce557f640 1 -- 172.21.15.170:0/432992585 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ce0100f60 msgr2=0x7f3ce01988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:28.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.342+0000 7f3ce557f640 1 --2- 172.21.15.170:0/432992585 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ce0100f60 0x7f3ce01988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:28.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.342+0000 7f3ce557f640 1 -- 172.21.15.170:0/432992585 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce0199380 con 0x7f3ce0106840 2024-09-04T16:56:28.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.342+0000 7f3ce557f640 1 --2- 172.21.15.170:0/432992585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ce0106840 0x7f3ce0198e10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0031460 tx=0x7f3cd00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:28.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.343+0000 7f3cd6ffd640 1 -- 172.21.15.170:0/432992585 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3cd003f070 con 0x7f3ce0106840 2024-09-04T16:56:28.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.343+0000 7f3cd6ffd640 1 -- 172.21.15.170:0/432992585 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3cd0004cf0 con 0x7f3ce0106840 2024-09-04T16:56:28.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.343+0000 7f3cd6ffd640 1 -- 172.21.15.170:0/432992585 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3cd0035030 con 0x7f3ce0106840 2024-09-04T16:56:28.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.343+0000 7f3ce7fe4640 1 -- 172.21.15.170:0/432992585 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce0199610 con 0x7f3ce0106840 2024-09-04T16:56:28.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.343+0000 7f3ce7fe4640 1 -- 172.21.15.170:0/432992585 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce01a1bc0 con 0x7f3ce0106840 2024-09-04T16:56:28.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.344+0000 7f3ce7fe4640 1 -- 172.21.15.170:0/432992585 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce01013c0 con 0x7f3ce0106840 2024-09-04T16:56:28.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.344+0000 7f3cd6ffd640 1 -- 172.21.15.170:0/432992585 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 33) ==== 102098+0+0 (secure 0 0 0) 0x7f3cd0042070 con 0x7f3ce0106840 2024-09-04T16:56:28.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.345+0000 7f3cd6ffd640 1 --2- 172.21.15.170:0/432992585 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3ccc079e80 0x7f3ccc07c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-04T16:56:28.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.345+0000 7f3ce5d80640 1 --2- 172.21.15.170:0/432992585 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3ccc079e80 0x7f3ccc07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-04T16:56:28.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.345+0000 7f3cd6ffd640 1 -- 172.21.15.170:0/432992585 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3cd00bd510 con 0x7f3ce0106840 2024-09-04T16:56:28.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.345+0000 7f3ce5d80640 1 --2- 172.21.15.170:0/432992585 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3ccc079e80 0x7f3ccc07c340 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00a990 tx=0x7f3cdc005c70 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-04T16:56:28.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.349+0000 7f3cd6ffd640 1 -- 172.21.15.170:0/432992585 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3cd0084f40 con 0x7f3ce0106840 2024-09-04T16:56:28.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.532+0000 7f3ce7fe4640 1 -- 172.21.15.170:0/432992585 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3ce0101f30 con 0x7f3ce0106840 2024-09-04T16:56:28.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.533+0000 7f3cd6ffd640 1 -- 172.21.15.170:0/432992585 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v82) ==== 81+0+2111 (secure 0 0 0) 0x7f3cd008d3f0 con 0x7f3ce0106840 2024-09-04T16:56:28.534 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6829/3937288624 2024-09-05T16:38:15.784019+0000 2024-09-04T16:56:28.534 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6828/3937288624 2024-09-05T16:38:15.784019+0000 2024-09-04T16:56:28.534 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6826/3443400311 2024-09-05T16:38:15.784006+0000 2024-09-04T16:56:28.534 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/3721031413 2024-09-05T16:29:26.169571+0000 2024-09-04T16:56:28.534 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:6824/1755428205 2024-09-05T16:27:35.139397+0000 2024-09-04T16:56:28.534 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6800/1933182229 2024-09-05T16:21:43.532674+0000 2024-09-04T16:56:28.534 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6800/1415431517 2024-09-05T16:29:26.169571+0000 2024-09-04T16:56:28.534 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6827/3443400311 2024-09-05T16:38:15.784006+0000 2024-09-04T16:56:28.534 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/805677094 2024-09-05T16:21:43.532674+0000 2024-09-04T16:56:28.534 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:0/3638128589 2024-09-05T16:30:58.302737+0000 2024-09-04T16:56:28.535 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6801/1344937001 2024-09-05T16:21:12.676489+0000 2024-09-04T16:56:28.535 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:6829/4218378172 2024-09-05T16:30:58.302737+0000 2024-09-04T16:56:28.535 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/2879400972 2024-09-05T16:22:43.188580+0000 2024-09-04T16:56:28.535 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6801/1933182229 2024-09-05T16:21:43.532674+0000 2024-09-04T16:56:28.535 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6800/1344937001 2024-09-05T16:21:12.676489+0000 2024-09-04T16:56:28.535 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:0/3985431161 2024-09-05T16:30:58.302737+0000 2024-09-04T16:56:28.535 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/715338811 2024-09-05T16:29:26.169571+0000 2024-09-04T16:56:28.535 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/3694273822 2024-09-05T16:29:26.169571+0000 2024-09-04T16:56:28.535 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:0/1421527181 2024-09-05T16:30:58.302737+0000 2024-09-04T16:56:28.535 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/2398984574 2024-09-05T16:21:12.676489+0000 2024-09-04T16:56:28.535 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:0/1388266887 2024-09-05T16:30:58.302737+0000 2024-09-04T16:56:28.535 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/3495410490 2024-09-05T16:22:43.188580+0000 2024-09-04T16:56:28.535 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:0/4195853727 2024-09-05T16:30:58.302737+0000 2024-09-04T16:56:28.535 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/1110147744 2024-09-05T16:21:43.532674+0000 2024-09-04T16:56:28.535 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/4140626365 2024-09-05T16:21:12.676489+0000 2024-09-04T16:56:28.536 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/3196924100 2024-09-05T16:22:43.188580+0000 2024-09-04T16:56:28.536 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/1792862708 2024-09-05T16:29:26.169571+0000 2024-09-04T16:56:28.536 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/3147587826 2024-09-05T16:21:12.676489+0000 2024-09-04T16:56:28.536 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:0/1603316950 2024-09-05T16:30:58.302737+0000 2024-09-04T16:56:28.536 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6801/1415431517 2024-09-05T16:29:26.169571+0000 2024-09-04T16:56:28.536 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:6825/1755428205 2024-09-05T16:27:35.139397+0000 2024-09-04T16:56:28.536 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6800/4082719191 2024-09-05T16:22:43.188580+0000 2024-09-04T16:56:28.536 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6801/4082719191 2024-09-05T16:22:43.188580+0000 2024-09-04T16:56:28.536 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.193:6828/4218378172 2024-09-05T16:30:58.302737+0000 2024-09-04T16:56:28.536 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/2639013592 2024-09-05T16:21:43.532674+0000 2024-09-04T16:56:28.537 INFO:teuthology.orchestra.run.smithi170.stderr:listed 35 entries 2024-09-04T16:56:28.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.535+0000 7f3ce7fe4640 1 -- 172.21.15.170:0/432992585 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3ccc079e80 msgr2=0x7f3ccc07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:28.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.535+0000 7f3ce7fe4640 1 --2- 172.21.15.170:0/432992585 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3ccc079e80 0x7f3ccc07c340 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00a990 tx=0x7f3cdc005c70 comp rx=0 tx=0).stop 2024-09-04T16:56:28.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.535+0000 7f3ce7fe4640 1 -- 172.21.15.170:0/432992585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ce0106840 msgr2=0x7f3ce0198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-04T16:56:28.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.535+0000 7f3ce7fe4640 1 --2- 172.21.15.170:0/432992585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ce0106840 0x7f3ce0198e10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0031460 tx=0x7f3cd00048f0 comp rx=0 tx=0).stop 2024-09-04T16:56:28.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.535+0000 7f3ce7fe4640 1 -- 172.21.15.170:0/432992585 shutdown_connections 2024-09-04T16:56:28.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.535+0000 7f3ce7fe4640 1 --2- 172.21.15.170:0/432992585 >> [v2:172.21.15.170:6800/3535185718,v1:172.21.15.170:6801/3535185718] conn(0x7f3ccc079e80 0x7f3ccc07c340 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:28.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.535+0000 7f3ce7fe4640 1 --2- 172.21.15.170:0/432992585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ce0106840 0x7f3ce0198e10 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:28.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.535+0000 7f3ce7fe4640 1 --2- 172.21.15.170:0/432992585 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ce0100f60 0x7f3ce01988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-04T16:56:28.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.535+0000 7f3ce7fe4640 1 -- 172.21.15.170:0/432992585 >> 172.21.15.170:0/432992585 conn(0x7f3ce00fbc40 msgr2=0x7f3ce00fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-04T16:56:28.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.535+0000 7f3ce7fe4640 1 -- 172.21.15.170:0/432992585 shutdown_connections 2024-09-04T16:56:28.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-04T16:56:28.535+0000 7f3ce7fe4640 1 -- 172.21.15.170:0/432992585 wait complete. 2024-09-04T16:56:28.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:28 smithi170 ceph-mon[113855]: pgmap v804: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:28.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:28 smithi170 ceph-mon[113855]: from='client.? 172.21.15.170:0/432992585' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-04T16:56:28.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:28 smithi193 ceph-mon[82547]: pgmap v804: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:28.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:28 smithi193 ceph-mon[82547]: from='client.? 172.21.15.170:0/432992585' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-04T16:56:29.146 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi170.front.sepia.ceph.com... 2024-09-04T16:56:29.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-04T16:56:29.146 DEBUG:teuthology.orchestra.run.smithi170:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-04T16:56:29.173 INFO:teuthology.orchestra.run:waiting for 300 2024-09-04T16:56:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:29 smithi193 ceph-mon[82547]: pgmap v805: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:56:30.015 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:29 smithi170 ceph-mon[113855]: pgmap v805: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:30.015 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:56:32.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:32 smithi170 ceph-mon[113855]: pgmap v806: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:32.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:32 smithi193 ceph-mon[82547]: pgmap v806: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:33.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:33 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:56:33.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:33 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:56:34.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:34 smithi170 ceph-mon[113855]: pgmap v807: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:56:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:56:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:56:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:34 smithi193 ceph-mon[82547]: pgmap v807: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:56:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:56:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:56:36.503 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:36 smithi170 ceph-mon[113855]: pgmap v808: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:36.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:36 smithi193 ceph-mon[82547]: pgmap v808: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:38.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:38 smithi170 ceph-mon[113855]: pgmap v809: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:38.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:38 smithi193 ceph-mon[82547]: pgmap v809: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:40.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:40 smithi170 ceph-mon[113855]: pgmap v810: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:40.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:40 smithi193 ceph-mon[82547]: pgmap v810: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:42.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:42 smithi170 ceph-mon[113855]: pgmap v811: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:42.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:42 smithi193 ceph-mon[82547]: pgmap v811: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:44.555 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:44 smithi193 ceph-mon[82547]: pgmap v812: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:44.555 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:56:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:44 smithi170 ceph-mon[113855]: pgmap v812: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:56:46.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:46 smithi170 ceph-mon[113855]: pgmap v813: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:46 smithi193 ceph-mon[82547]: pgmap v813: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:48.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:48 smithi170 ceph-mon[113855]: pgmap v814: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:48.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:48 smithi193 ceph-mon[82547]: pgmap v814: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:50.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:50 smithi170 ceph-mon[113855]: pgmap v815: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:50 smithi193 ceph-mon[82547]: pgmap v815: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:52.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:52 smithi170 ceph-mon[113855]: pgmap v816: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:52.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:52 smithi193 ceph-mon[82547]: pgmap v816: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:54 smithi170 ceph-mon[113855]: pgmap v817: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:54 smithi193 ceph-mon[82547]: pgmap v817: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:56.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:56 smithi170 ceph-mon[113855]: pgmap v818: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:56.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:56 smithi193 ceph-mon[82547]: pgmap v818: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:58.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:58 smithi170 ceph-mon[113855]: pgmap v819: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:58.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:58 smithi193 ceph-mon[82547]: pgmap v819: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:56:59.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:56:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:56:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:56:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:57:00.589 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:00 smithi170 ceph-mon[113855]: pgmap v820: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:00.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:00 smithi193 ceph-mon[82547]: pgmap v820: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:02.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:02 smithi170 ceph-mon[113855]: pgmap v821: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:02 smithi193 ceph-mon[82547]: pgmap v821: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:04 smithi170 ceph-mon[113855]: pgmap v822: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:04 smithi193 ceph-mon[82547]: pgmap v822: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:06.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:06 smithi170 ceph-mon[113855]: pgmap v823: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:06.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:06 smithi193 ceph-mon[82547]: pgmap v823: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:08.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:08 smithi170 ceph-mon[113855]: pgmap v824: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:08.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:08 smithi193 ceph-mon[82547]: pgmap v824: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:10 smithi170 ceph-mon[113855]: pgmap v825: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:10 smithi193 ceph-mon[82547]: pgmap v825: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:12 smithi170 ceph-mon[113855]: pgmap v826: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:12.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:12 smithi193 ceph-mon[82547]: pgmap v826: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:14 smithi170 ceph-mon[113855]: pgmap v827: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:57:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:14 smithi193 ceph-mon[82547]: pgmap v827: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:57:16.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:16 smithi170 ceph-mon[113855]: pgmap v828: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:16 smithi193 ceph-mon[82547]: pgmap v828: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:18.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:18 smithi170 ceph-mon[113855]: pgmap v829: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:18 smithi193 ceph-mon[82547]: pgmap v829: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:20.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:20 smithi193 ceph-mon[82547]: pgmap v830: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:20.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:20 smithi170 ceph-mon[113855]: pgmap v830: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:22 smithi170 ceph-mon[113855]: pgmap v831: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:22 smithi193 ceph-mon[82547]: pgmap v831: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:24.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:24 smithi170 ceph-mon[113855]: pgmap v832: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:24.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:24 smithi193 ceph-mon[82547]: pgmap v832: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:26.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:26 smithi170 ceph-mon[113855]: pgmap v833: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:26 smithi193 ceph-mon[82547]: pgmap v833: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:28.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:28 smithi170 ceph-mon[113855]: pgmap v834: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:28 smithi193 ceph-mon[82547]: pgmap v834: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:57:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:57:30.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:30 smithi170 ceph-mon[113855]: pgmap v835: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:30 smithi193 ceph-mon[82547]: pgmap v835: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:32.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:32 smithi170 ceph-mon[113855]: pgmap v836: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:32.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:32 smithi193 ceph-mon[82547]: pgmap v836: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:34 smithi170 ceph-mon[113855]: pgmap v837: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:57:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:57:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:57:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:57:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:34 smithi193 ceph-mon[82547]: pgmap v837: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:57:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:57:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:57:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:57:36.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:36 smithi170 ceph-mon[113855]: pgmap v838: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:36.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:36 smithi193 ceph-mon[82547]: pgmap v838: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:38.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:38 smithi170 ceph-mon[113855]: pgmap v839: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:38.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:38 smithi193 ceph-mon[82547]: pgmap v839: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:40.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:40 smithi170 ceph-mon[113855]: pgmap v840: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:40.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:40 smithi193 ceph-mon[82547]: pgmap v840: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:42.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:42 smithi170 ceph-mon[113855]: pgmap v841: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:42.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:42 smithi193 ceph-mon[82547]: pgmap v841: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:44 smithi170 ceph-mon[113855]: pgmap v842: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:57:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:44 smithi193 ceph-mon[82547]: pgmap v842: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:57:46.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:46 smithi170 ceph-mon[113855]: pgmap v843: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:46 smithi193 ceph-mon[82547]: pgmap v843: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:48.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:48 smithi170 ceph-mon[113855]: pgmap v844: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:48.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:48 smithi193 ceph-mon[82547]: pgmap v844: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:50.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:50 smithi170 ceph-mon[113855]: pgmap v845: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:50 smithi193 ceph-mon[82547]: pgmap v845: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:52.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:52 smithi170 ceph-mon[113855]: pgmap v846: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:52.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:52 smithi193 ceph-mon[82547]: pgmap v846: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:54 smithi170 ceph-mon[113855]: pgmap v847: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:54 smithi193 ceph-mon[82547]: pgmap v847: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:56.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:56 smithi170 ceph-mon[113855]: pgmap v848: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:56.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:56 smithi193 ceph-mon[82547]: pgmap v848: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:58.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:58 smithi170 ceph-mon[113855]: pgmap v849: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:58.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:58 smithi193 ceph-mon[82547]: pgmap v849: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:57:59.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:57:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:57:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:57:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:58:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:00 smithi170 ceph-mon[113855]: pgmap v850: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:00.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:00 smithi193 ceph-mon[82547]: pgmap v850: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:02.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:02 smithi170 ceph-mon[113855]: pgmap v851: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:02 smithi193 ceph-mon[82547]: pgmap v851: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:04.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:04 smithi170 ceph-mon[113855]: pgmap v852: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:04 smithi193 ceph-mon[82547]: pgmap v852: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:06.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:06 smithi170 ceph-mon[113855]: pgmap v853: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:06.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:06 smithi193 ceph-mon[82547]: pgmap v853: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:08.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:08 smithi170 ceph-mon[113855]: pgmap v854: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:08.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:08 smithi193 ceph-mon[82547]: pgmap v854: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:10 smithi170 ceph-mon[113855]: pgmap v855: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:10 smithi193 ceph-mon[82547]: pgmap v855: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:12.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:12 smithi170 ceph-mon[113855]: pgmap v856: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:12.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:12 smithi193 ceph-mon[82547]: pgmap v856: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:14 smithi170 ceph-mon[113855]: pgmap v857: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:58:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:14 smithi193 ceph-mon[82547]: pgmap v857: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:58:16.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:16 smithi170 ceph-mon[113855]: pgmap v858: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:16 smithi193 ceph-mon[82547]: pgmap v858: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:18.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:18 smithi170 ceph-mon[113855]: pgmap v859: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:18 smithi193 ceph-mon[82547]: pgmap v859: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:20.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:20 smithi170 ceph-mon[113855]: pgmap v860: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:20.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:20 smithi193 ceph-mon[82547]: pgmap v860: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:22.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:22 smithi170 ceph-mon[113855]: pgmap v861: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:22 smithi193 ceph-mon[82547]: pgmap v861: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:24.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:24 smithi170 ceph-mon[113855]: pgmap v862: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:24.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:24 smithi193 ceph-mon[82547]: pgmap v862: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:26 smithi193 ceph-mon[82547]: pgmap v863: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:26.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:26 smithi170 ceph-mon[113855]: pgmap v863: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:28 smithi193 ceph-mon[82547]: pgmap v864: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:28.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:28 smithi170 ceph-mon[113855]: pgmap v864: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:58:29.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:58:30.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:30 smithi170 ceph-mon[113855]: pgmap v865: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:30 smithi193 ceph-mon[82547]: pgmap v865: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:32.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:32 smithi170 ceph-mon[113855]: pgmap v866: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:32.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:32 smithi193 ceph-mon[82547]: pgmap v866: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:34 smithi193 ceph-mon[82547]: pgmap v867: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:34 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:58:34.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:34 smithi170 ceph-mon[113855]: pgmap v867: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:34.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:34 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:58:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:35 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:58:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:35 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:58:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:35 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:58:35.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:35 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:58:35.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:35 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:58:35.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:35 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:58:36.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:36 smithi170 ceph-mon[113855]: pgmap v868: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:36 smithi193 ceph-mon[82547]: pgmap v868: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:38 smithi170 ceph-mon[113855]: pgmap v869: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:38 smithi193 ceph-mon[82547]: pgmap v869: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:40.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:40 smithi170 ceph-mon[113855]: pgmap v870: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:40.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:40 smithi193 ceph-mon[82547]: pgmap v870: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:42.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:42 smithi170 ceph-mon[113855]: pgmap v871: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:42 smithi193 ceph-mon[82547]: pgmap v871: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:44 smithi170 ceph-mon[113855]: pgmap v872: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:44.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:58:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:44 smithi193 ceph-mon[82547]: pgmap v872: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:58:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:46 smithi193 ceph-mon[82547]: pgmap v873: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:46.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:46 smithi170 ceph-mon[113855]: pgmap v873: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:48.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:48 smithi170 ceph-mon[113855]: pgmap v874: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:48 smithi193 ceph-mon[82547]: pgmap v874: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:50.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:50 smithi170 ceph-mon[113855]: pgmap v875: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:50 smithi193 ceph-mon[82547]: pgmap v875: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:52.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:52 smithi170 ceph-mon[113855]: pgmap v876: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:52 smithi193 ceph-mon[82547]: pgmap v876: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:54.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:54 smithi170 ceph-mon[113855]: pgmap v877: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:54 smithi193 ceph-mon[82547]: pgmap v877: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:56.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:56 smithi170 ceph-mon[113855]: pgmap v878: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:56.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:56 smithi193 ceph-mon[82547]: pgmap v878: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:58.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:58 smithi170 ceph-mon[113855]: pgmap v879: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:58.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:58 smithi193 ceph-mon[82547]: pgmap v879: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:58:59.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:58:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:58:59.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:58:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:59:00.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:00 smithi170 ceph-mon[113855]: pgmap v880: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:00.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:00 smithi193 ceph-mon[82547]: pgmap v880: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:02 smithi170 ceph-mon[113855]: pgmap v881: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:02.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:02 smithi193 ceph-mon[82547]: pgmap v881: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:04.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:04 smithi170 ceph-mon[113855]: pgmap v882: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:04.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:04 smithi193 ceph-mon[82547]: pgmap v882: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:06.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:06 smithi170 ceph-mon[113855]: pgmap v883: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:06.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:06 smithi193 ceph-mon[82547]: pgmap v883: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:08.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:08 smithi170 ceph-mon[113855]: pgmap v884: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:08.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:08 smithi193 ceph-mon[82547]: pgmap v884: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:10.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:10 smithi170 ceph-mon[113855]: pgmap v885: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:10.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:10 smithi193 ceph-mon[82547]: pgmap v885: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:12.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:12 smithi170 ceph-mon[113855]: pgmap v886: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:12.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:12 smithi193 ceph-mon[82547]: pgmap v886: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:14 smithi170 ceph-mon[113855]: pgmap v887: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:59:14.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:14 smithi193 ceph-mon[82547]: pgmap v887: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:14.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:59:16.843 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:16 smithi193 ceph-mon[82547]: pgmap v888: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:16.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:16 smithi170 ceph-mon[113855]: pgmap v888: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:18.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:18 smithi170 ceph-mon[113855]: pgmap v889: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:18.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:18 smithi193 ceph-mon[82547]: pgmap v889: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:20.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:20 smithi170 ceph-mon[113855]: pgmap v890: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:20.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:20 smithi193 ceph-mon[82547]: pgmap v890: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:22.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:22 smithi170 ceph-mon[113855]: pgmap v891: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:22.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:22 smithi193 ceph-mon[82547]: pgmap v891: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:24.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:24 smithi193 ceph-mon[82547]: pgmap v892: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:25.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:24 smithi170 ceph-mon[113855]: pgmap v892: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:26.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:26 smithi193 ceph-mon[82547]: pgmap v893: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:27.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:26 smithi170 ceph-mon[113855]: pgmap v893: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:28.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:28 smithi170 ceph-mon[113855]: pgmap v894: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:28.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:28 smithi193 ceph-mon[82547]: pgmap v894: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:29.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:59:30.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:59:30.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:30 smithi193 ceph-mon[82547]: pgmap v895: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:31.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:30 smithi170 ceph-mon[113855]: pgmap v895: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:32.908 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:32 smithi193 ceph-mon[82547]: pgmap v896: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:33.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:32 smithi170 ceph-mon[113855]: pgmap v896: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:34.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:34 smithi193 ceph-mon[82547]: pgmap v897: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:35.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:34 smithi170 ceph-mon[113855]: pgmap v897: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:35.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:35 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:59:35.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:35 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:59:35.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:35 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:59:35.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:35 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:59:36.003 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:35 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T16:59:36.003 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:35 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T16:59:36.003 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:35 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T16:59:36.003 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:35 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T16:59:36.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:36 smithi193 ceph-mon[82547]: pgmap v898: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:37.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:36 smithi170 ceph-mon[113855]: pgmap v898: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:38.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:38 smithi170 ceph-mon[113855]: pgmap v899: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:38.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:38 smithi193 ceph-mon[82547]: pgmap v899: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:40.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:40 smithi193 ceph-mon[82547]: pgmap v900: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:41.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:40 smithi170 ceph-mon[113855]: pgmap v900: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:42.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:42 smithi193 ceph-mon[82547]: pgmap v901: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:43.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:42 smithi170 ceph-mon[113855]: pgmap v901: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:44 smithi193 ceph-mon[82547]: pgmap v902: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:44.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:59:45.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:44 smithi170 ceph-mon[113855]: pgmap v902: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:45.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:59:46.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:46 smithi193 ceph-mon[82547]: pgmap v903: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:47.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:46 smithi170 ceph-mon[113855]: pgmap v903: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:48.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:48 smithi193 ceph-mon[82547]: pgmap v904: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:49.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:48 smithi170 ceph-mon[113855]: pgmap v904: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:50.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:50 smithi193 ceph-mon[82547]: pgmap v905: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:51.101 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:50 smithi170 ceph-mon[113855]: pgmap v905: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:52.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:52 smithi193 ceph-mon[82547]: pgmap v906: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:53.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:52 smithi170 ceph-mon[113855]: pgmap v906: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:54.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:54 smithi193 ceph-mon[82547]: pgmap v907: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:55.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:54 smithi170 ceph-mon[113855]: pgmap v907: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:56.102 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:55 smithi170 ceph-mon[113855]: pgmap v908: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:56.156 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:55 smithi193 ceph-mon[82547]: pgmap v908: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:58.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:58 smithi170 ceph-mon[113855]: pgmap v909: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:58.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:58 smithi193 ceph-mon[82547]: pgmap v909: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T16:59:59.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 16:59:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T16:59:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 16:59:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T17:00:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:00 smithi170 ceph-mon[113855]: pgmap v910: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:00 smithi170 ceph-mon[113855]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-04T17:00:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:00 smithi170 ceph-mon[113855]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T17:00:00.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:00 smithi170 ceph-mon[113855]: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T17:00:00.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:00 smithi193 ceph-mon[82547]: pgmap v910: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:00.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:00 smithi193 ceph-mon[82547]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-04T17:00:00.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:00 smithi193 ceph-mon[82547]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-04T17:00:00.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:00 smithi193 ceph-mon[82547]: fs cephfs has deprecated feature inline_data enabled. 2024-09-04T17:00:02.534 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:02 smithi193 ceph-mon[82547]: pgmap v911: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:02.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:02 smithi170 ceph-mon[113855]: pgmap v911: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:04.352 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:04 smithi170 ceph-mon[113855]: pgmap v912: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:04 smithi193 ceph-mon[82547]: pgmap v912: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:06.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:06 smithi170 ceph-mon[113855]: pgmap v913: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:06.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:06 smithi193 ceph-mon[82547]: pgmap v913: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:08.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:08 smithi170 ceph-mon[113855]: pgmap v914: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:08.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:08 smithi193 ceph-mon[82547]: pgmap v914: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:10 smithi170 ceph-mon[113855]: pgmap v915: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:10 smithi193 ceph-mon[82547]: pgmap v915: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:12.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:12 smithi170 ceph-mon[113855]: pgmap v916: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:12.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:12 smithi193 ceph-mon[82547]: pgmap v916: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:14.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:14 smithi170 ceph-mon[113855]: pgmap v917: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:14.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T17:00:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:14 smithi193 ceph-mon[82547]: pgmap v917: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T17:00:16.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:16 smithi170 ceph-mon[113855]: pgmap v918: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:16 smithi193 ceph-mon[82547]: pgmap v918: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:18.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:18 smithi170 ceph-mon[113855]: pgmap v919: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:18 smithi193 ceph-mon[82547]: pgmap v919: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:20.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:20 smithi170 ceph-mon[113855]: pgmap v920: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:20.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:20 smithi193 ceph-mon[82547]: pgmap v920: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:22.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:22 smithi170 ceph-mon[113855]: pgmap v921: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:22 smithi193 ceph-mon[82547]: pgmap v921: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:24.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:24 smithi170 ceph-mon[113855]: pgmap v922: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:24.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:24 smithi193 ceph-mon[82547]: pgmap v922: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:26.604 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:26 smithi170 ceph-mon[113855]: pgmap v923: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:26 smithi193 ceph-mon[82547]: pgmap v923: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:28.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:28 smithi170 ceph-mon[113855]: pgmap v924: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:28 smithi193 ceph-mon[82547]: pgmap v924: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:29.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:29 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T17:00:29.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:29 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T17:00:30.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:30 smithi170 ceph-mon[113855]: pgmap v925: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:30.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:30 smithi193 ceph-mon[82547]: pgmap v925: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:32.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:32 smithi170 ceph-mon[113855]: pgmap v926: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:32.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:32 smithi193 ceph-mon[82547]: pgmap v926: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:34.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:34 smithi170 ceph-mon[113855]: pgmap v927: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:34.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:34 smithi193 ceph-mon[82547]: pgmap v927: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:35.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:35 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T17:00:35.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:35 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-04T17:00:36.503 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:36 smithi170 ceph-mon[113855]: pgmap v928: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:36.503 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:36 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T17:00:36.503 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:36 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T17:00:36.503 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:36 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T17:00:36.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:36 smithi193 ceph-mon[82547]: pgmap v928: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:36.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:36 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-04T17:00:36.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:36 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-04T17:00:36.657 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:36 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' 2024-09-04T17:00:38.406 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:38 smithi193 ceph-mon[82547]: pgmap v929: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:38.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:38 smithi170 ceph-mon[113855]: pgmap v929: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:40.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:40 smithi170 ceph-mon[113855]: pgmap v930: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:40.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:40 smithi193 ceph-mon[82547]: pgmap v930: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:42.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:42 smithi170 ceph-mon[113855]: pgmap v931: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:42.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:42 smithi193 ceph-mon[82547]: pgmap v931: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:44 smithi170 ceph-mon[113855]: pgmap v932: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:44.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:44 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T17:00:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:44 smithi193 ceph-mon[82547]: pgmap v932: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:44.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:44 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T17:00:46.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:46 smithi170 ceph-mon[113855]: pgmap v933: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:46.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:46 smithi193 ceph-mon[82547]: pgmap v933: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:48.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:48 smithi170 ceph-mon[113855]: pgmap v934: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:48.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:48 smithi193 ceph-mon[82547]: pgmap v934: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:50.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:50 smithi170 ceph-mon[113855]: pgmap v935: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:50.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:50 smithi193 ceph-mon[82547]: pgmap v935: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:52.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:52 smithi170 ceph-mon[113855]: pgmap v936: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:52.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:52 smithi193 ceph-mon[82547]: pgmap v936: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:54.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:54 smithi170 ceph-mon[113855]: pgmap v937: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:54.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:54 smithi193 ceph-mon[82547]: pgmap v937: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:56.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:56 smithi170 ceph-mon[113855]: pgmap v938: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:56.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:56 smithi193 ceph-mon[82547]: pgmap v938: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:58.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:58 smithi170 ceph-mon[113855]: pgmap v939: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:58.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:58 smithi193 ceph-mon[82547]: pgmap v939: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:00:59.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:00:59 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T17:00:59.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:00:59 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T17:01:00.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:00 smithi170 ceph-mon[113855]: pgmap v940: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:00.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:00 smithi193 ceph-mon[82547]: pgmap v940: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:02.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:02 smithi193 ceph-mon[82547]: pgmap v941: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:02.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:02 smithi170 ceph-mon[113855]: pgmap v941: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:04.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:04 smithi193 ceph-mon[82547]: pgmap v942: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:04.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:04 smithi170 ceph-mon[113855]: pgmap v942: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:06.503 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:06 smithi170 ceph-mon[113855]: pgmap v943: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:06.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:06 smithi193 ceph-mon[82547]: pgmap v943: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:08.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:08 smithi193 ceph-mon[82547]: pgmap v944: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:08.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:08 smithi170 ceph-mon[113855]: pgmap v944: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:10.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:10 smithi170 ceph-mon[113855]: pgmap v945: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:10.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:10 smithi193 ceph-mon[82547]: pgmap v945: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:12.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:12 smithi170 ceph-mon[113855]: pgmap v946: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:12.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:12 smithi193 ceph-mon[82547]: pgmap v946: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:14 smithi193 ceph-mon[82547]: pgmap v947: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:14.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:14 smithi193 ceph-mon[82547]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T17:01:14.851 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:14 smithi170 ceph-mon[113855]: pgmap v947: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:14.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:14 smithi170 ceph-mon[113855]: from='mgr.14774 172.21.15.170:0/653903696' entity='mgr.smithi170.fbszap' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-04T17:01:16.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:16 smithi193 ceph-mon[82547]: pgmap v948: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:16.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:16 smithi170 ceph-mon[113855]: pgmap v948: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:18.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:18 smithi170 ceph-mon[113855]: pgmap v949: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:18.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:18 smithi193 ceph-mon[82547]: pgmap v949: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:20.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:20 smithi170 ceph-mon[113855]: pgmap v950: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:20.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:20 smithi193 ceph-mon[82547]: pgmap v950: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:22.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:22 smithi193 ceph-mon[82547]: pgmap v951: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:22.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:22 smithi170 ceph-mon[113855]: pgmap v951: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:24.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:24 smithi170 ceph-mon[113855]: pgmap v952: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:24.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:24 smithi193 ceph-mon[82547]: pgmap v952: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:26.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:26 smithi193 ceph-mon[82547]: pgmap v953: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:26.852 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:26 smithi170 ceph-mon[113855]: pgmap v953: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:28.253 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-04T17:01:28.254 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_f9fcca5273b6971f640393d33a94730179073754/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_f9fcca5273b6971f640393d33a94730179073754/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-04T17:01:28.256 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-04T17:01:28.266 INFO:tasks.cephadm:Teardown begin 2024-09-04T17:01:28.266 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_f9fcca5273b6971f640393d33a94730179073754/qa/tasks/cephadm.py", line 2374, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_f9fcca5273b6971f640393d33a94730179073754/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_f9fcca5273b6971f640393d33a94730179073754/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-04T17:01:28.268 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-04T17:01:28.303 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-04T17:01:28.338 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-04T17:01:28.339 DEBUG:teuthology.orchestra.run.smithi170:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-04T17:01:28.362 DEBUG:teuthology.orchestra.run.smithi193:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-04T17:01:28.396 INFO:tasks.cephadm:Stopping all daemons... 2024-09-04T17:01:28.397 INFO:tasks.cephadm.mon.smithi170:Stopping mon.smithi170... 2024-09-04T17:01:28.397 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mon.smithi170 2024-09-04T17:01:28.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:28 smithi170 ceph-mon[113855]: pgmap v954: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:28.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:28 smithi170 systemd[1]: Stopping Ceph mon.smithi170 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T17:01:28.656 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:28 smithi193 ceph-mon[82547]: pgmap v954: 65 pgs: 65 active+clean; 245 MiB data, 966 MiB used, 535 GiB / 536 GiB avail 2024-09-04T17:01:29.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:28 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170[113851]: 2024-09-04T17:01:28.713+0000 7f15866c4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi170 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T17:01:29.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:28 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170[113851]: 2024-09-04T17:01:28.713+0000 7f15866c4640 -1 mon.smithi170@0(leader) e2 *** Got Signal Terminated *** 2024-09-04T17:01:29.105 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:28 smithi170 podman[162721]: 2024-09-04 17:01:28.908185778 +0000 UTC m=+0.314202201 container died ea912d4e404df353420a41b291877cf59257c30a5165dc1c548fda2d709195db (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-04T17:01:29.601 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:29 smithi170 podman[162721]: 2024-09-04 17:01:29.406166571 +0000 UTC m=+0.812182993 container cleanup ea912d4e404df353420a41b291877cf59257c30a5165dc1c548fda2d709195db (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-04T17:01:29.602 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Sep 04 17:01:29 smithi170 bash[162721]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi170 2024-09-04T17:01:29.828 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mon.smithi170.service' 2024-09-04T17:01:29.878 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-04T17:01:29.878 INFO:tasks.cephadm.mon.smithi170:Stopped mon.smithi170 2024-09-04T17:01:29.879 INFO:tasks.cephadm.mon.smithi193:Stopping mon.smithi193... 2024-09-04T17:01:29.879 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mon.smithi193 2024-09-04T17:01:30.181 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:29 smithi193 systemd[1]: Stopping Ceph mon.smithi193 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T17:01:30.574 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:30 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi193[82543]: 2024-09-04T17:01:30.180+0000 7fa871094640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi193 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T17:01:30.574 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:30 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi193[82543]: 2024-09-04T17:01:30.180+0000 7fa871094640 -1 mon.smithi193@1(peon) e2 *** Got Signal Terminated *** 2024-09-04T17:01:30.574 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:30 smithi193 podman[117861]: 2024-09-04 17:01:30.313438835 +0000 UTC m=+0.227707114 container died 6a9e9faed0c8c6a0fd937d7338cd4786efa9ef4764a0e4e51aa244f0f5c35173 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi193, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5) 2024-09-04T17:01:30.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:30 smithi193 podman[117861]: 2024-09-04 17:01:30.780813337 +0000 UTC m=+0.695081661 container cleanup 6a9e9faed0c8c6a0fd937d7338cd4786efa9ef4764a0e4e51aa244f0f5c35173 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi193, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-04T17:01:30.906 INFO:journalctl@ceph.mon.smithi193.smithi193.stdout:Sep 04 17:01:30 smithi193 bash[117861]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-mon-smithi193 2024-09-04T17:01:31.351 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@mon.smithi193.service' 2024-09-04T17:01:31.398 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-04T17:01:31.399 INFO:tasks.cephadm.mon.smithi193:Stopped mon.smithi193 2024-09-04T17:01:31.399 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-04T17:01:31.399 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.0 2024-09-04T17:01:31.736 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 17:01:31 smithi170 systemd[1]: Stopping Ceph osd.0 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T17:01:32.102 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 17:01:31 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0[123095]: 2024-09-04T17:01:31.735+0000 7f132deff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T17:01:32.102 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 17:01:31 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0[123095]: 2024-09-04T17:01:31.735+0000 7f132deff640 -1 osd.0 82 *** Got signal Terminated *** 2024-09-04T17:01:32.102 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 17:01:31 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0[123095]: 2024-09-04T17:01:31.735+0000 7f132deff640 -1 osd.0 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-04T17:01:37.352 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 17:01:37 smithi170 podman[162853]: 2024-09-04 17:01:37.067655414 +0000 UTC m=+5.474465472 container died 22f8c54550e023a988cc1fcaf58de6ef22211457331dec2c63e96c24d6a38075 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-04T17:01:37.680 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 17:01:37 smithi170 podman[162853]: 2024-09-04 17:01:37.486283913 +0000 UTC m=+5.893093971 container cleanup 22f8c54550e023a988cc1fcaf58de6ef22211457331dec2c63e96c24d6a38075 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-04T17:01:37.680 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 17:01:37 smithi170 bash[162853]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0 2024-09-04T17:01:38.101 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 17:01:37 smithi170 podman[162867]: 2024-09-04 17:01:37.679464417 +0000 UTC m=+0.608268927 container remove 22f8c54550e023a988cc1fcaf58de6ef22211457331dec2c63e96c24d6a38075 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_CLEAN=True) 2024-09-04T17:01:38.378 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 17:01:38 smithi170 podman[162969]: 2024-09-04 17:01:38.011622988 +0000 UTC m=+0.016641243 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T17:01:38.378 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 17:01:38 smithi170 podman[162969]: 2024-09-04 17:01:38.113822252 +0000 UTC m=+0.118840500 container create 96bf815eb566c4afeb1decb4dd47ba11c98a742b391da24d36064594e6fae8fc (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-09-04T17:01:38.852 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 17:01:38 smithi170 podman[162969]: 2024-09-04 17:01:38.411458278 +0000 UTC m=+0.416476524 container init 96bf815eb566c4afeb1decb4dd47ba11c98a742b391da24d36064594e6fae8fc (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-04T17:01:38.852 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 17:01:38 smithi170 podman[162969]: 2024-09-04 17:01:38.415101433 +0000 UTC m=+0.420119688 container start 96bf815eb566c4afeb1decb4dd47ba11c98a742b391da24d36064594e6fae8fc (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-04T17:01:38.852 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 17:01:38 smithi170 podman[162969]: 2024-09-04 17:01:38.500306402 +0000 UTC m=+0.505324662 container attach 96bf815eb566c4afeb1decb4dd47ba11c98a742b391da24d36064594e6fae8fc (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-04T17:01:38.852 INFO:journalctl@ceph.osd.0.smithi170.stdout:Sep 04 17:01:38 smithi170 podman[162993]: 2024-09-04 17:01:38.628148 +0000 UTC m=+0.016637711 container died 96bf815eb566c4afeb1decb4dd47ba11c98a742b391da24d36064594e6fae8fc (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-04T17:01:39.255 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.0.service' 2024-09-04T17:01:39.295 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-04T17:01:39.296 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-04T17:01:39.296 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-04T17:01:39.296 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.1 2024-09-04T17:01:39.602 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 17:01:39 smithi170 systemd[1]: Stopping Ceph osd.1 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T17:01:40.102 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 17:01:39 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1[128964]: 2024-09-04T17:01:39.621+0000 7f46e5936640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T17:01:40.102 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 17:01:39 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1[128964]: 2024-09-04T17:01:39.621+0000 7f46e5936640 -1 osd.1 82 *** Got signal Terminated *** 2024-09-04T17:01:40.102 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 17:01:39 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1[128964]: 2024-09-04T17:01:39.621+0000 7f46e5936640 -1 osd.1 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-04T17:01:45.221 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 17:01:44 smithi170 podman[163075]: 2024-09-04 17:01:44.945181868 +0000 UTC m=+5.431023880 container died e39a15bc741ae642948aed7f21b55a9c8ad85b088a7aebc942a3be9f554cd7aa (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5) 2024-09-04T17:01:45.569 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 17:01:45 smithi170 podman[163075]: 2024-09-04 17:01:45.309842396 +0000 UTC m=+5.795684406 container cleanup e39a15bc741ae642948aed7f21b55a9c8ad85b088a7aebc942a3be9f554cd7aa (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-04T17:01:45.569 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 17:01:45 smithi170 bash[163075]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1 2024-09-04T17:01:45.851 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 17:01:45 smithi170 podman[163089]: 2024-09-04 17:01:45.569498166 +0000 UTC m=+0.625104009 container remove e39a15bc741ae642948aed7f21b55a9c8ad85b088a7aebc942a3be9f554cd7aa (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-04T17:01:46.239 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 17:01:45 smithi170 podman[163181]: 2024-09-04 17:01:45.840421095 +0000 UTC m=+0.016843161 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T17:01:46.240 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 17:01:45 smithi170 podman[163181]: 2024-09-04 17:01:45.945323303 +0000 UTC m=+0.121745381 container create 0272c1d0ae6f0a80f22459a28e98bc4ce1b1dcde5b0de0a5b5294f5dca40e2ca (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-04T17:01:46.240 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 17:01:46 smithi170 podman[163181]: 2024-09-04 17:01:46.239817602 +0000 UTC m=+0.416239669 container init 0272c1d0ae6f0a80f22459a28e98bc4ce1b1dcde5b0de0a5b5294f5dca40e2ca (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-04T17:01:46.602 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 17:01:46 smithi170 podman[163181]: 2024-09-04 17:01:46.243307423 +0000 UTC m=+0.419729499 container start 0272c1d0ae6f0a80f22459a28e98bc4ce1b1dcde5b0de0a5b5294f5dca40e2ca (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-04T17:01:46.602 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 17:01:46 smithi170 podman[163181]: 2024-09-04 17:01:46.331629133 +0000 UTC m=+0.508051220 container attach 0272c1d0ae6f0a80f22459a28e98bc4ce1b1dcde5b0de0a5b5294f5dca40e2ca (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-04T17:01:46.602 INFO:journalctl@ceph.osd.1.smithi170.stdout:Sep 04 17:01:46 smithi170 podman[163181]: 2024-09-04 17:01:46.428783945 +0000 UTC m=+0.605206024 container died 0272c1d0ae6f0a80f22459a28e98bc4ce1b1dcde5b0de0a5b5294f5dca40e2ca (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-04T17:01:47.122 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.1.service' 2024-09-04T17:01:47.163 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-04T17:01:47.163 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-04T17:01:47.163 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-04T17:01:47.164 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.2 2024-09-04T17:01:47.489 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 17:01:47 smithi170 systemd[1]: Stopping Ceph osd.2 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T17:01:47.851 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 17:01:47 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2[134658]: 2024-09-04T17:01:47.488+0000 7f6716324640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T17:01:47.852 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 17:01:47 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2[134658]: 2024-09-04T17:01:47.488+0000 7f6716324640 -1 osd.2 82 *** Got signal Terminated *** 2024-09-04T17:01:47.852 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 17:01:47 smithi170 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2[134658]: 2024-09-04T17:01:47.488+0000 7f6716324640 -1 osd.2 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-04T17:01:53.102 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 17:01:52 smithi170 podman[163283]: 2024-09-04 17:01:52.851593296 +0000 UTC m=+5.455335421 container died 50a84942a2f505a3128e3b939267adc38ed14c8ac8f7335849cb1198ac959e04 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5) 2024-09-04T17:01:53.507 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 17:01:53 smithi170 podman[163283]: 2024-09-04 17:01:53.213820646 +0000 UTC m=+5.817562813 container cleanup 50a84942a2f505a3128e3b939267adc38ed14c8ac8f7335849cb1198ac959e04 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-04T17:01:53.507 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 17:01:53 smithi170 bash[163283]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2 2024-09-04T17:01:53.838 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 17:01:53 smithi170 podman[163300]: 2024-09-04 17:01:53.507011965 +0000 UTC m=+0.655851835 container remove 50a84942a2f505a3128e3b939267adc38ed14c8ac8f7335849cb1198ac959e04 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-04T17:01:54.101 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 17:01:53 smithi170 podman[163390]: 2024-09-04 17:01:53.741191395 +0000 UTC m=+0.016399169 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T17:01:54.102 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 17:01:53 smithi170 podman[163390]: 2024-09-04 17:01:53.866430655 +0000 UTC m=+0.141638418 container create cfe7696c213d63a319e36d9736d56df07066c99bb5902f7d17bc2f754286776b (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-04T17:01:54.602 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 17:01:54 smithi170 podman[163390]: 2024-09-04 17:01:54.139228606 +0000 UTC m=+0.414436379 container init cfe7696c213d63a319e36d9736d56df07066c99bb5902f7d17bc2f754286776b (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-deactivate, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-04T17:01:54.602 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 17:01:54 smithi170 podman[163390]: 2024-09-04 17:01:54.143134355 +0000 UTC m=+0.418342127 container start cfe7696c213d63a319e36d9736d56df07066c99bb5902f7d17bc2f754286776b (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-04T17:01:54.602 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 17:01:54 smithi170 podman[163390]: 2024-09-04 17:01:54.227449916 +0000 UTC m=+0.502657683 container attach cfe7696c213d63a319e36d9736d56df07066c99bb5902f7d17bc2f754286776b (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-04T17:01:54.602 INFO:journalctl@ceph.osd.2.smithi170.stdout:Sep 04 17:01:54 smithi170 podman[163390]: 2024-09-04 17:01:54.328626151 +0000 UTC m=+0.603833919 container died cfe7696c213d63a319e36d9736d56df07066c99bb5902f7d17bc2f754286776b (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-2-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-04T17:01:54.963 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.2.service' 2024-09-04T17:01:55.002 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-04T17:01:55.002 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-04T17:01:55.002 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-04T17:01:55.002 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.3 2024-09-04T17:01:55.308 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:01:55 smithi193 systemd[1]: Stopping Ceph osd.3 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T17:01:55.656 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:01:55 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3[90670]: 2024-09-04T17:01:55.306+0000 7fb160e6c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T17:01:55.656 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:01:55 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3[90670]: 2024-09-04T17:01:55.306+0000 7fb160e6c640 -1 osd.3 82 *** Got signal Terminated *** 2024-09-04T17:01:55.657 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:01:55 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3[90670]: 2024-09-04T17:01:55.306+0000 7fb160e6c640 -1 osd.3 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-04T17:01:58.631 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:01:58 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3[90670]: 2024-09-04T17:01:58.196+0000 7fb15d481640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:32.555366+0000 front 2024-09-04T17:01:32.555395+0000 (oldest deadline 2024-09-04T17:01:57.255291+0000) 2024-09-04T17:01:59.589 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:01:59 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3[90670]: 2024-09-04T17:01:59.199+0000 7fb15d481640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:32.555366+0000 front 2024-09-04T17:01:32.555395+0000 (oldest deadline 2024-09-04T17:01:57.255291+0000) 2024-09-04T17:02:00.244 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:01:59 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:01:59.987+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:34.463876+0000 front 2024-09-04T17:01:34.463781+0000 (oldest deadline 2024-09-04T17:01:59.763697+0000) 2024-09-04T17:02:00.656 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:02:00 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3[90670]: 2024-09-04T17:02:00.243+0000 7fb15d481640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:32.555366+0000 front 2024-09-04T17:01:32.555395+0000 (oldest deadline 2024-09-04T17:01:57.255291+0000) 2024-09-04T17:02:00.950 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:00 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T17:02:00.773+0000 7f1f2387c640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:35.442611+0000 front 2024-09-04T17:01:35.442737+0000 (oldest deadline 2024-09-04T17:02:00.742549+0000) 2024-09-04T17:02:00.951 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:02:00 smithi193 podman[117983]: 2024-09-04 17:02:00.667467526 +0000 UTC m=+5.474907805 container died c571a091a612220beca002d0001a33443140568c92953e49b82c46d75439279e (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-04T17:02:01.309 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:01 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:01.034+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:34.463876+0000 front 2024-09-04T17:01:34.463781+0000 (oldest deadline 2024-09-04T17:01:59.763697+0000) 2024-09-04T17:02:01.309 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:02:01 smithi193 podman[117983]: 2024-09-04 17:02:01.041185846 +0000 UTC m=+5.848626113 container cleanup c571a091a612220beca002d0001a33443140568c92953e49b82c46d75439279e (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-04T17:02:01.310 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:02:01 smithi193 bash[117983]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3 2024-09-04T17:02:01.618 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:02:01 smithi193 podman[118010]: 2024-09-04 17:02:01.309423616 +0000 UTC m=+0.643732100 container remove c571a091a612220beca002d0001a33443140568c92953e49b82c46d75439279e (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-04T17:02:01.906 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:01 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T17:02:01.740+0000 7f1f2387c640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:35.442611+0000 front 2024-09-04T17:01:35.442737+0000 (oldest deadline 2024-09-04T17:02:00.742549+0000) 2024-09-04T17:02:01.906 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:02:01 smithi193 podman[118099]: 2024-09-04 17:02:01.61870006 +0000 UTC m=+0.113090873 container create cdb2fd3d5844e76cdccf946503cd40f65438859dad9f9bc85ca95b734e3495fc (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5) 2024-09-04T17:02:01.906 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:02:01 smithi193 podman[118099]: 2024-09-04 17:02:01.521680546 +0000 UTC m=+0.016071366 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T17:02:01.907 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:02:01 smithi193 podman[118099]: 2024-09-04 17:02:01.846455757 +0000 UTC m=+0.340846563 container init cdb2fd3d5844e76cdccf946503cd40f65438859dad9f9bc85ca95b734e3495fc (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-04T17:02:01.907 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:02:01 smithi193 podman[118099]: 2024-09-04 17:02:01.849700529 +0000 UTC m=+0.344091343 container start cdb2fd3d5844e76cdccf946503cd40f65438859dad9f9bc85ca95b734e3495fc (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-deactivate, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-04T17:02:02.342 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:02:01 smithi193 podman[118099]: 2024-09-04 17:02:01.940720645 +0000 UTC m=+0.435111459 container attach cdb2fd3d5844e76cdccf946503cd40f65438859dad9f9bc85ca95b734e3495fc (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-04T17:02:02.342 INFO:journalctl@ceph.osd.3.smithi193.stdout:Sep 04 17:02:02 smithi193 podman[118099]: 2024-09-04 17:02:02.034949414 +0000 UTC m=+0.529340230 container died cdb2fd3d5844e76cdccf946503cd40f65438859dad9f9bc85ca95b734e3495fc (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-04T17:02:02.342 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:02 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:02.070+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:34.463876+0000 front 2024-09-04T17:01:34.463781+0000 (oldest deadline 2024-09-04T17:01:59.763697+0000) 2024-09-04T17:02:02.695 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.3.service' 2024-09-04T17:02:02.734 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-04T17:02:02.734 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-04T17:02:02.735 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-04T17:02:02.735 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.4 2024-09-04T17:02:03.075 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:02 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T17:02:02.744+0000 7f1f2387c640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:35.442611+0000 front 2024-09-04T17:01:35.442737+0000 (oldest deadline 2024-09-04T17:02:00.742549+0000) 2024-09-04T17:02:03.076 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:02 smithi193 systemd[1]: Stopping Ceph osd.4 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T17:02:03.406 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:03 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:03.074+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:34.463876+0000 front 2024-09-04T17:01:34.463781+0000 (oldest deadline 2024-09-04T17:01:59.763697+0000) 2024-09-04T17:02:03.406 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:03 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T17:02:03.108+0000 7f1f2b26f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T17:02:03.407 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:03 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T17:02:03.108+0000 7f1f2b26f640 -1 osd.4 82 *** Got signal Terminated *** 2024-09-04T17:02:03.407 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:03 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T17:02:03.108+0000 7f1f2b26f640 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-04T17:02:04.046 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:03 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T17:02:03.775+0000 7f1f2387c640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:35.442611+0000 front 2024-09-04T17:01:35.442737+0000 (oldest deadline 2024-09-04T17:02:00.742549+0000) 2024-09-04T17:02:04.322 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:04 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:04.045+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:34.463876+0000 front 2024-09-04T17:01:34.463781+0000 (oldest deadline 2024-09-04T17:01:59.763697+0000) 2024-09-04T17:02:05.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:04 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T17:02:04.781+0000 7f1f2387c640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:35.442611+0000 front 2024-09-04T17:01:35.442737+0000 (oldest deadline 2024-09-04T17:02:00.742549+0000) 2024-09-04T17:02:05.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:04 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:04.995+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:34.463876+0000 front 2024-09-04T17:01:34.463781+0000 (oldest deadline 2024-09-04T17:01:59.763697+0000) 2024-09-04T17:02:06.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:05 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T17:02:05.802+0000 7f1f2387c640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:35.442611+0000 front 2024-09-04T17:01:35.442737+0000 (oldest deadline 2024-09-04T17:02:00.742549+0000) 2024-09-04T17:02:06.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:05 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T17:02:05.802+0000 7f1f2387c640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.170:6814 osd.1 since back 2024-09-04T17:01:40.743170+0000 front 2024-09-04T17:01:40.743103+0000 (oldest deadline 2024-09-04T17:02:05.443003+0000) 2024-09-04T17:02:06.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:05 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:05.987+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:34.463876+0000 front 2024-09-04T17:01:34.463781+0000 (oldest deadline 2024-09-04T17:01:59.763697+0000) 2024-09-04T17:02:06.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:05 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:05.987+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6814 osd.1 since back 2024-09-04T17:01:39.764190+0000 front 2024-09-04T17:01:39.764247+0000 (oldest deadline 2024-09-04T17:02:05.664134+0000) 2024-09-04T17:02:07.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:06 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T17:02:06.772+0000 7f1f2387c640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:35.442611+0000 front 2024-09-04T17:01:35.442737+0000 (oldest deadline 2024-09-04T17:02:00.742549+0000) 2024-09-04T17:02:07.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:06 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T17:02:06.772+0000 7f1f2387c640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.170:6814 osd.1 since back 2024-09-04T17:01:40.743170+0000 front 2024-09-04T17:01:40.743103+0000 (oldest deadline 2024-09-04T17:02:05.443003+0000) 2024-09-04T17:02:07.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:06 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:06.998+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:34.463876+0000 front 2024-09-04T17:01:34.463781+0000 (oldest deadline 2024-09-04T17:01:59.763697+0000) 2024-09-04T17:02:07.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:06 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:06.998+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6814 osd.1 since back 2024-09-04T17:01:39.764190+0000 front 2024-09-04T17:01:39.764247+0000 (oldest deadline 2024-09-04T17:02:05.664134+0000) 2024-09-04T17:02:08.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:07 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T17:02:07.820+0000 7f1f2387c640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:35.442611+0000 front 2024-09-04T17:01:35.442737+0000 (oldest deadline 2024-09-04T17:02:00.742549+0000) 2024-09-04T17:02:08.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:07 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4[95548]: 2024-09-04T17:02:07.820+0000 7f1f2387c640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.170:6814 osd.1 since back 2024-09-04T17:01:40.743170+0000 front 2024-09-04T17:01:40.743103+0000 (oldest deadline 2024-09-04T17:02:05.443003+0000) 2024-09-04T17:02:08.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:07 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:07.982+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:34.463876+0000 front 2024-09-04T17:01:34.463781+0000 (oldest deadline 2024-09-04T17:01:59.763697+0000) 2024-09-04T17:02:08.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:07 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:07.982+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6814 osd.1 since back 2024-09-04T17:01:39.764190+0000 front 2024-09-04T17:01:39.764247+0000 (oldest deadline 2024-09-04T17:02:05.664134+0000) 2024-09-04T17:02:08.806 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:08 smithi193 podman[118202]: 2024-09-04 17:02:08.518726963 +0000 UTC m=+5.550768980 container died b402c5732f0b11111a3e1ae021a90e78d8cbd9333735c281bee1cae7e31bf551 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-04T17:02:09.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:08 smithi193 podman[118202]: 2024-09-04 17:02:08.894841171 +0000 UTC m=+5.926883173 container cleanup b402c5732f0b11111a3e1ae021a90e78d8cbd9333735c281bee1cae7e31bf551 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-04T17:02:09.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:08 smithi193 bash[118202]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4 2024-09-04T17:02:09.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:08 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:08.944+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:34.463876+0000 front 2024-09-04T17:01:34.463781+0000 (oldest deadline 2024-09-04T17:01:59.763697+0000) 2024-09-04T17:02:09.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:08 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:08.944+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6814 osd.1 since back 2024-09-04T17:01:39.764190+0000 front 2024-09-04T17:01:39.764247+0000 (oldest deadline 2024-09-04T17:02:05.664134+0000) 2024-09-04T17:02:09.520 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:09 smithi193 podman[118216]: 2024-09-04 17:02:09.162619657 +0000 UTC m=+0.638962992 container remove b402c5732f0b11111a3e1ae021a90e78d8cbd9333735c281bee1cae7e31bf551 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-04T17:02:09.858 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:09 smithi193 podman[118307]: 2024-09-04 17:02:09.423000685 +0000 UTC m=+0.016140614 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T17:02:09.858 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:09 smithi193 podman[118307]: 2024-09-04 17:02:09.538545403 +0000 UTC m=+0.131685366 container create df9c0c7dbd543bf62066797adbbd4665d2b48b787dc1d46241524de632775be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-04T17:02:09.858 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:09 smithi193 podman[118307]: 2024-09-04 17:02:09.749355341 +0000 UTC m=+0.342495258 container init df9c0c7dbd543bf62066797adbbd4665d2b48b787dc1d46241524de632775be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-04T17:02:09.858 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:09 smithi193 podman[118307]: 2024-09-04 17:02:09.752609867 +0000 UTC m=+0.345749787 container start df9c0c7dbd543bf62066797adbbd4665d2b48b787dc1d46241524de632775be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-deactivate, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-04T17:02:09.858 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:09 smithi193 podman[118307]: 2024-09-04 17:02:09.857560801 +0000 UTC m=+0.450700748 container attach df9c0c7dbd543bf62066797adbbd4665d2b48b787dc1d46241524de632775be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-deactivate, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-04T17:02:10.156 INFO:journalctl@ceph.osd.4.smithi193.stdout:Sep 04 17:02:09 smithi193 podman[118307]: 2024-09-04 17:02:09.951871703 +0000 UTC m=+0.545011631 container died df9c0c7dbd543bf62066797adbbd4665d2b48b787dc1d46241524de632775be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-04T17:02:10.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:09 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:09.941+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:34.463876+0000 front 2024-09-04T17:01:34.463781+0000 (oldest deadline 2024-09-04T17:01:59.763697+0000) 2024-09-04T17:02:10.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:09 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:09.941+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6814 osd.1 since back 2024-09-04T17:01:39.764190+0000 front 2024-09-04T17:01:39.764247+0000 (oldest deadline 2024-09-04T17:02:05.664134+0000) 2024-09-04T17:02:10.509 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.4.service' 2024-09-04T17:02:10.547 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-04T17:02:10.548 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-04T17:02:10.548 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-04T17:02:10.548 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.5 2024-09-04T17:02:10.872 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:10 smithi193 systemd[1]: Stopping Ceph osd.5 for 89be7670-6ad9-11ef-bcd6-c7b262605968... 2024-09-04T17:02:11.156 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:10 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:10.872+0000 7f056cd0e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-04T17:02:11.156 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:10 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:10.872+0000 7f056cd0e640 -1 osd.5 82 *** Got signal Terminated *** 2024-09-04T17:02:11.156 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:10 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:10.872+0000 7f056cd0e640 -1 osd.5 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-04T17:02:11.156 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:10 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:10.945+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:34.463876+0000 front 2024-09-04T17:01:34.463781+0000 (oldest deadline 2024-09-04T17:01:59.763697+0000) 2024-09-04T17:02:11.157 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:10 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:10.945+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6814 osd.1 since back 2024-09-04T17:01:39.764190+0000 front 2024-09-04T17:01:39.764247+0000 (oldest deadline 2024-09-04T17:02:05.664134+0000) 2024-09-04T17:02:12.406 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:11 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:11.992+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:34.463876+0000 front 2024-09-04T17:01:34.463781+0000 (oldest deadline 2024-09-04T17:01:59.763697+0000) 2024-09-04T17:02:12.407 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:11 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:11.992+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6814 osd.1 since back 2024-09-04T17:01:39.764190+0000 front 2024-09-04T17:01:39.764247+0000 (oldest deadline 2024-09-04T17:02:05.664134+0000) 2024-09-04T17:02:13.406 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:12 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:12.977+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:34.463876+0000 front 2024-09-04T17:01:34.463781+0000 (oldest deadline 2024-09-04T17:01:59.763697+0000) 2024-09-04T17:02:13.406 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:12 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:12.977+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6814 osd.1 since back 2024-09-04T17:01:39.764190+0000 front 2024-09-04T17:01:39.764247+0000 (oldest deadline 2024-09-04T17:02:05.664134+0000) 2024-09-04T17:02:14.398 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:13 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:13.965+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:34.463876+0000 front 2024-09-04T17:01:34.463781+0000 (oldest deadline 2024-09-04T17:01:59.763697+0000) 2024-09-04T17:02:14.399 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:13 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:13.965+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6814 osd.1 since back 2024-09-04T17:01:39.764190+0000 front 2024-09-04T17:01:39.764247+0000 (oldest deadline 2024-09-04T17:02:05.664134+0000) 2024-09-04T17:02:15.406 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:14 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:14.981+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-09-04T17:01:34.463876+0000 front 2024-09-04T17:01:34.463781+0000 (oldest deadline 2024-09-04T17:01:59.763697+0000) 2024-09-04T17:02:15.406 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:14 smithi193 ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5[100444]: 2024-09-04T17:02:14.981+0000 7f056531b640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.170:6814 osd.1 since back 2024-09-04T17:01:39.764190+0000 front 2024-09-04T17:01:39.764247+0000 (oldest deadline 2024-09-04T17:02:05.664134+0000) 2024-09-04T17:02:16.572 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:16 smithi193 podman[118410]: 2024-09-04 17:02:16.274495772 +0000 UTC m=+5.507036677 container died 877ff342899c6729e23bbc40fa06af747083d1d5463e728723e8acef74b64b43 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-04T17:02:16.898 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:16 smithi193 podman[118410]: 2024-09-04 17:02:16.655076486 +0000 UTC m=+5.887617391 container cleanup 877ff342899c6729e23bbc40fa06af747083d1d5463e728723e8acef74b64b43 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-04T17:02:16.898 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:16 smithi193 bash[118410]: ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5 2024-09-04T17:02:17.156 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:16 smithi193 podman[118429]: 2024-09-04 17:02:16.897987484 +0000 UTC m=+0.621335657 container remove 877ff342899c6729e23bbc40fa06af747083d1d5463e728723e8acef74b64b43 (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-04T17:02:17.501 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:17 smithi193 podman[118514]: 2024-09-04 17:02:17.207032968 +0000 UTC m=+0.102427751 container create 44b17ff336ccbc3b61602727b661e62cf6e71238400cf22517120a83ba865a2a (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-04T17:02:17.501 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:17 smithi193 podman[118514]: 2024-09-04 17:02:17.120475849 +0000 UTC m=+0.015870637 image pull 8cfc4091ae56805dc996b79454b33c79a65ee7969bcd5271ddcb97094fdd169c quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4 2024-09-04T17:02:17.501 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:17 smithi193 podman[118514]: 2024-09-04 17:02:17.42618224 +0000 UTC m=+0.321577013 container init 44b17ff336ccbc3b61602727b661e62cf6e71238400cf22517120a83ba865a2a (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-04T17:02:17.501 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:17 smithi193 podman[118514]: 2024-09-04 17:02:17.42952654 +0000 UTC m=+0.324921315 container start 44b17ff336ccbc3b61602727b661e62cf6e71238400cf22517120a83ba865a2a (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-04T17:02:17.501 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:17 smithi193 podman[118514]: 2024-09-04 17:02:17.500955726 +0000 UTC m=+0.396350514 container attach 44b17ff336ccbc3b61602727b661e62cf6e71238400cf22517120a83ba865a2a (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-04T17:02:17.904 INFO:journalctl@ceph.osd.5.smithi193.stdout:Sep 04 17:02:17 smithi193 podman[118514]: 2024-09-04 17:02:17.621184184 +0000 UTC m=+0.516579200 container died 44b17ff336ccbc3b61602727b661e62cf6e71238400cf22517120a83ba865a2a (image=quay.ceph.io/ceph-ci/ceph@sha256:374fc5b78546dbe9d2be4234bcc40090c95dba2d3680e3e0a530b1ee75f9a0a4, name=ceph-89be7670-6ad9-11ef-bcd6-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-04-1323-f9fcca5, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-04T17:02:18.218 DEBUG:teuthology.orchestra.run.smithi193:> sudo pkill -f 'journalctl -f -n 0 -u ceph-89be7670-6ad9-11ef-bcd6-c7b262605968@osd.5.service' 2024-09-04T17:02:18.256 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-04T17:02:18.257 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-04T17:02:18.257 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 --force --keep-logs 2024-09-04T17:02:18.455 INFO:teuthology.orchestra.run.smithi170.stdout:Deleting cluster with fsid: 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T17:02:22.875 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi170.stderr:ceph-fuse[77750]: fuse finished with error 0 and tester_r 0 2024-09-04T17:02:40.772 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 --force --keep-logs 2024-09-04T17:02:40.966 INFO:teuthology.orchestra.run.smithi193.stdout:Deleting cluster with fsid: 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T17:02:55.763 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-04T17:02:55.796 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-04T17:02:55.824 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-04T17:02:55.826 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/crash to /home/teuthworker/archive/gabrioux-2024-09-04_15:42:18-orch:cephadm-wip-guits-main-2024-09-04-1323-distro-default-smithi/7889192/remote/smithi170/crash 2024-09-04T17:02:55.827 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/crash -- . 2024-09-04T17:02:55.865 INFO:teuthology.orchestra.run.smithi170.stderr:tar: /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/crash: Cannot open: No such file or directory 2024-09-04T17:02:55.865 INFO:teuthology.orchestra.run.smithi170.stderr:tar: Error is not recoverable: exiting now 2024-09-04T17:02:55.867 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/crash to /home/teuthworker/archive/gabrioux-2024-09-04_15:42:18-orch:cephadm-wip-guits-main-2024-09-04-1323-distro-default-smithi/7889192/remote/smithi193/crash 2024-09-04T17:02:55.867 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/crash -- . 2024-09-04T17:02:55.891 INFO:teuthology.orchestra.run.smithi193.stderr:tar: /var/lib/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/crash: Cannot open: No such file or directory 2024-09-04T17:02:55.891 INFO:teuthology.orchestra.run.smithi193.stderr:tar: Error is not recoverable: exiting now 2024-09-04T17:02:55.892 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-04T17:02:55.893 DEBUG:teuthology.orchestra.run.smithi170:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-04T17:02:55.947 INFO:teuthology.orchestra.run.smithi170.stdout:2024-09-04T16:40:00.000233+0000 mon.smithi170 (mon.0) 530 : cluster [ERR] fs cephfs is offline because no MDS is active for it. 2024-09-04T17:02:55.948 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-04T17:02:55.948 INFO:tasks.cephadm:Compressing logs... 2024-09-04T17:02:55.948 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-04T17:02:55.990 DEBUG:teuthology.orchestra.run.smithi193:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-04T17:02:56.015 INFO:teuthology.orchestra.run.smithi170.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.0.log 2024-09-04T17:02:56.015 INFO:teuthology.orchestra.run.smithi170.stderr:: No such file or directory 2024-09-04T17:02:56.015 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.1.log 2024-09-04T17:02:56.015 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-volume.log 2024-09-04T17:02:56.015 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.0.log: /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.audit.log 2024-09-04T17:02:56.017 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-client.ceph-exporter.smithi170.log 2024-09-04T17:02:56.018 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.cephadm.log 2024-09-04T17:02:56.018 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.audit.log: /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-client.ceph-exporter.smithi170.log: gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mds.cephfs.smithi170.zkhdil.log 2024-09-04T17:02:56.018 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.cephadm.log: /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mds.cephfs.smithi170.zkhdil.log: 86.5% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.cephadm.log.gz 2024-09-04T17:02:56.021 INFO:teuthology.orchestra.run.smithi170.stderr: 94.4% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-client.ceph-exporter.smithi170.log.gz 2024-09-04T17:02:56.022 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.2.log 2024-09-04T17:02:56.022 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mgr.smithi170.fbszap.log 2024-09-04T17:02:56.022 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mon.smithi170.log 2024-09-04T17:02:56.022 INFO:teuthology.orchestra.run.smithi193.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-client.ceph-exporter.smithi193.log 2024-09-04T17:02:56.022 INFO:teuthology.orchestra.run.smithi193.stderr:: No such file or directory 2024-09-04T17:02:56.022 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mds.cephfs.smithi193.xostco.log 2024-09-04T17:02:56.022 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-client.ceph-exporter.smithi193.log: gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-volume.log 2024-09-04T17:02:56.022 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mds.cephfs.smithi193.xostco.log: gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.4.log 2024-09-04T17:02:56.023 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.audit.log 2024-09-04T17:02:56.023 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mon.smithi193.log 2024-09-04T17:02:56.023 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.4.log: /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mgr.smithi193.gvfizn.log 2024-09-04T17:02:56.023 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mon.smithi193.log: gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.cephadm.log 2024-09-04T17:02:56.023 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mgr.smithi193.gvfizn.log: gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.5.log 2024-09-04T17:02:56.023 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.cephadm.log: 85.1% 94.4% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-client.ceph-exporter.smithi193.log.gz 2024-09-04T17:02:56.023 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.cephadm.log.gz 2024-09-04T17:02:56.023 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.log 2024-09-04T17:02:56.023 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mds.cephfs.smithi193.kabapr.log 2024-09-04T17:02:56.023 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.log: 91.6% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.audit.log.gz 2024-09-04T17:02:56.024 INFO:teuthology.orchestra.run.smithi193.stderr: 89.3% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.log.gz 2024-09-04T17:02:56.024 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mgr.smithi170.fbszap.log: gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mds.cephfs.smithi170.rzbrux.log 2024-09-04T17:02:56.024 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mon.smithi170.log: 91.5% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.audit.log.gz 2024-09-04T17:02:56.024 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.log 2024-09-04T17:02:56.025 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.3.log 2024-09-04T17:02:56.026 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mds.cephfs.smithi193.kabapr.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-04T17:02:56.035 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.3.log: 93.2% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mds.cephfs.smithi193.xostco.log.gz 2024-09-04T17:02:56.035 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-04T17:02:56.037 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.1.log: 94.7% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mds.cephfs.smithi193.kabapr.log.gz 2024-09-04T17:02:56.037 INFO:teuthology.orchestra.run.smithi193.stderr: 91.0% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-volume.log.gz 2024-09-04T17:02:56.040 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-04T17:02:56.040 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mds.cephfs.smithi170.rzbrux.log: 91.0% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-volume.log.gz 2024-09-04T17:02:56.041 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-04T17:02:56.047 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.log: 89.3% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph.log.gz 2024-09-04T17:02:56.047 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-04T17:02:56.073 INFO:teuthology.orchestra.run.smithi193.stderr: 89.7% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mgr.smithi193.gvfizn.log.gz 2024-09-04T17:02:56.108 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 93.5% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mds.cephfs.smithi170.rzbrux.log.gz 2024-09-04T17:02:56.123 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-04T17:02:56.535 INFO:teuthology.orchestra.run.smithi170.stderr: 89.8% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mgr.smithi170.fbszap.log.gz 2024-09-04T17:02:56.669 INFO:teuthology.orchestra.run.smithi193.stderr: 92.7% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mon.smithi193.log.gz 2024-09-04T17:02:57.778 INFO:teuthology.orchestra.run.smithi170.stderr: 90.2% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mon.smithi170.log.gz 2024-09-04T17:02:59.799 INFO:teuthology.orchestra.run.smithi193.stderr: 93.8% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.4.log.gz 2024-09-04T17:03:00.167 INFO:teuthology.orchestra.run.smithi170.stderr: 93.8% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.2.log.gz 2024-09-04T17:03:00.802 INFO:teuthology.orchestra.run.smithi193.stderr: 93.8% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.5.log.gz 2024-09-04T17:03:01.097 INFO:teuthology.orchestra.run.smithi170.stderr: 93.7% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.0.log.gz 2024-09-04T17:03:01.116 INFO:teuthology.orchestra.run.smithi170.stderr: 93.8% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.1.log.gz 2024-09-04T17:03:01.689 INFO:teuthology.orchestra.run.smithi193.stderr: 93.8% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-osd.3.log.gz 2024-09-04T17:03:10.176 INFO:teuthology.orchestra.run.smithi193.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-04T17:03:10.177 INFO:teuthology.orchestra.run.smithi193.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-04T17:03:10.178 INFO:teuthology.orchestra.run.smithi193.stderr: 2024-09-04T17:03:10.178 INFO:teuthology.orchestra.run.smithi193.stderr:real 0m14.173s 2024-09-04T17:03:10.178 INFO:teuthology.orchestra.run.smithi193.stderr:user 0m28.211s 2024-09-04T17:03:10.178 INFO:teuthology.orchestra.run.smithi193.stderr:sys 0m0.914s 2024-09-04T17:03:11.884 INFO:teuthology.orchestra.run.smithi170.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-04T17:04:38.919 INFO:teuthology.orchestra.run.smithi170.stderr: 92.9% -- replaced with /var/log/ceph/89be7670-6ad9-11ef-bcd6-c7b262605968/ceph-mds.cephfs.smithi170.zkhdil.log.gz 2024-09-04T17:04:38.920 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-04T17:04:38.921 INFO:teuthology.orchestra.run.smithi170.stderr:real 1m42.916s 2024-09-04T17:04:38.921 INFO:teuthology.orchestra.run.smithi170.stderr:user 2m10.922s 2024-09-04T17:04:38.921 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m4.316s 2024-09-04T17:04:38.921 INFO:tasks.cephadm:Archiving logs... 2024-09-04T17:04:38.921 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-04_15:42:18-orch:cephadm-wip-guits-main-2024-09-04-1323-distro-default-smithi/7889192/remote/smithi170/log 2024-09-04T17:04:38.922 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-04T17:04:59.403 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-04_15:42:18-orch:cephadm-wip-guits-main-2024-09-04-1323-distro-default-smithi/7889192/remote/smithi193/log 2024-09-04T17:04:59.404 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-04T17:05:03.604 INFO:tasks.cephadm:Removing cluster... 2024-09-04T17:05:03.605 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 --force 2024-09-04T17:05:03.808 INFO:teuthology.orchestra.run.smithi170.stdout:Deleting cluster with fsid: 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T17:05:04.240 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 89be7670-6ad9-11ef-bcd6-c7b262605968 --force 2024-09-04T17:05:04.441 INFO:teuthology.orchestra.run.smithi193.stdout:Deleting cluster with fsid: 89be7670-6ad9-11ef-bcd6-c7b262605968 2024-09-04T17:05:04.713 INFO:tasks.cephadm:Removing cephadm ... 2024-09-04T17:05:04.714 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-04T17:05:04.732 DEBUG:teuthology.orchestra.run.smithi193:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-04T17:05:04.748 INFO:tasks.cephadm:Teardown complete 2024-09-04T17:05:04.748 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-04T17:05:04.765 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_f9fcca5273b6971f640393d33a94730179073754/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_f9fcca5273b6971f640393d33a94730179073754/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-04T17:05:04.766 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-04T17:05:04.766 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-04T17:05:04.775 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-04T17:05:04.861 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-04T17:05:04.872 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-04T17:05:04.873 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-04T17:05:04.876 DEBUG:teuthology.orchestra.run.smithi193:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-04T17:05:04.888 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-09-04T17:05:04.890 INFO:teuthology.orchestra.run.smithi193.stderr:bash: line 1: ntpq: command not found 2024-09-04T17:05:04.893 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-04T17:05:04.893 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-09-04T17:05:04.893 INFO:teuthology.orchestra.run.smithi170.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 +334us[ +325us] +/- 44ms 2024-09-04T17:05:04.893 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 -1022us[-1031us] +/- 62ms 2024-09-04T17:05:04.894 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 +618us[ +610us] +/- 73ms 2024-09-04T17:05:04.894 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-04T17:05:04.895 INFO:teuthology.orchestra.run.smithi193.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-04T17:05:04.895 INFO:teuthology.orchestra.run.smithi193.stdout:=============================================================================== 2024-09-04T17:05:04.895 INFO:teuthology.orchestra.run.smithi193.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 +325us[ +330us] +/- 43ms 2024-09-04T17:05:04.895 INFO:teuthology.orchestra.run.smithi193.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 114 -999us[ -993us] +/- 61ms 2024-09-04T17:05:04.895 INFO:teuthology.orchestra.run.smithi193.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 +605us[ +605us] +/- 73ms 2024-09-04T17:05:04.895 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-04T17:05:04.896 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-04T17:05:04.908 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-04T17:05:04.908 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-04T17:05:04.921 DEBUG:teuthology.orchestra.run.smithi170:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-04T17:05:05.018 DEBUG:teuthology.orchestra.run.smithi193:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-04T17:05:05.093 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-04T17:05:05.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-04T17:05:05.122 DEBUG:teuthology.orchestra.run.smithi193:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-04T17:05:05.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-04T17:05:05.150 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-04T17:05:05.161 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-04T17:05:05.174 INFO:teuthology.task.internal:Duration was 3056.972119 seconds 2024-09-04T17:05:05.174 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-04T17:05:05.186 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-04T17:05:05.186 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-04T17:05:05.188 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-04T17:05:05.225 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-04T17:05:05.229 INFO:teuthology.orchestra.run.smithi193.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-04T17:05:05.639 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-04T17:05:05.639 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2024-09-04T17:05:05.639 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-04T17:05:05.699 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi193.front.sepia.ceph.com 2024-09-04T17:05:05.700 DEBUG:teuthology.orchestra.run.smithi193:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-04T17:05:05.728 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-04T17:05:05.728 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-04T17:05:05.742 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-04T17:05:05.795 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-04T17:05:05.795 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-04T17:05:05.809 DEBUG:teuthology.orchestra.run.smithi193:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-04T17:05:06.730 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-04T17:05:06.750 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-04T17:05:06.750 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-04T17:05:06.775 DEBUG:teuthology.orchestra.run.smithi193:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-04T17:05:06.803 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-04T17:05:06.816 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-04T17:05:06.818 DEBUG:teuthology.orchestra.run.smithi193:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-04T17:05:06.839 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2024-09-04T17:05:06.869 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = core 2024-09-04T17:05:06.899 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-04T17:05:06.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-04T17:05:06.924 DEBUG:teuthology.orchestra.run.smithi193:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-04T17:05:06.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-04T17:05:06.955 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-04T17:05:06.968 INFO:teuthology.task.internal:Transferring archived files... 2024-09-04T17:05:06.969 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-04_15:42:18-orch:cephadm-wip-guits-main-2024-09-04-1323-distro-default-smithi/7889192/remote/smithi170 2024-09-04T17:05:06.969 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-04T17:05:07.023 DEBUG:teuthology.misc:Transferring archived files from smithi193:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-04_15:42:18-orch:cephadm-wip-guits-main-2024-09-04-1323-distro-default-smithi/7889192/remote/smithi193 2024-09-04T17:05:07.023 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-04T17:05:07.061 INFO:teuthology.task.internal:Removing archive directory... 2024-09-04T17:05:07.061 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-04T17:05:07.064 DEBUG:teuthology.orchestra.run.smithi193:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-04T17:05:07.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-04T17:05:07.124 INFO:teuthology.task.internal:Not uploading archives. 2024-09-04T17:05:07.124 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-04T17:05:07.137 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-04T17:05:07.137 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-04T17:05:07.140 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-04T17:05:07.153 INFO:teuthology.orchestra.run.smithi170.stdout: 262217 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 4 17:05 /home/ubuntu/cephtest 2024-09-04T17:05:07.153 INFO:teuthology.orchestra.run.smithi170.stdout: 531323 4 d--------- 2 ubuntu ubuntu 4096 Sep 4 16:27 /home/ubuntu/cephtest/mnt.0 2024-09-04T17:05:07.154 INFO:teuthology.orchestra.run.smithi170.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-04T17:05:07.154 INFO:teuthology.orchestra.run.smithi170.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-04T17:05:07.155 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-04T17:05:07.155 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_f9fcca5273b6971f640393d33a94730179073754/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_f9fcca5273b6971f640393d33a94730179073754/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi170 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-04T17:05:07.156 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-04T17:05:07.167 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-04T17:05:07.180 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-04T17:05:07.182 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 3056.9721188545227 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_gabrioux@teuthology status: fail success: false 2024-09-04T17:05:07.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-04T17:05:07.270 INFO:teuthology.run:FAIL